2024-09-10T23:56:05.089 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T23:56:05.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T23:56:05.224 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899821 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/fsstress}} email: hyelloji@redhat.com first_in_suite: false job_id: '7899821' kernel: client: sha1: distro flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cephfs: max_mds: 1 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug cephsqlite: 20 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mgr: cephsqlite lock renewal timeout: 900000 client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIVywiZx2gsdAkh0w7sB1xuNAkrct+kxRfeKM8bxsHf7Xo4N40bqBJOWHCIyiMOzTe9hVZag6OUKs61WTKzlgsg= smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMigmEhwoyaGiw0/bG/kZtxfoK2hv8k/+prFNDzFIAvwkRDYLX5xF91JGgZyLV2xBKJHnDvzYdbhFo3sxqanoBg= smithi138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDqptMKZvIO1AAqzECCXupfSHV5wR7rl9vJ4w7jg5oNdGETdw6uzx7A/A7GIFEjoEwuXsMgHiEWk1eO4xDxguNo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T23:56:05.224 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-10T23:56:05.225 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-10T23:56:05.225 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T23:56:05.227 INFO:teuthology.task.internal:Checking packages... 2024-09-10T23:56:05.247 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-10T23:56:05.247 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T23:56:05.247 INFO:teuthology.packaging:ref: None 2024-09-10T23:56:05.247 INFO:teuthology.packaging:tag: None 2024-09-10T23:56:05.247 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:56:05.247 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:56:05.247 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:56:05.404 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854.g8f219c47 2024-09-10T23:56:05.406 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T23:56:05.413 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T23:56:05.413 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T23:56:05.490 INFO:teuthology.task.internal:Saving configuration 2024-09-10T23:56:05.509 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T23:56:05.518 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T23:56:05.546 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899821', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 23:51:07.282647', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIVywiZx2gsdAkh0w7sB1xuNAkrct+kxRfeKM8bxsHf7Xo4N40bqBJOWHCIyiMOzTe9hVZag6OUKs61WTKzlgsg='} 2024-09-10T23:56:05.572 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899821', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 23:51:07.280900', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMigmEhwoyaGiw0/bG/kZtxfoK2hv8k/+prFNDzFIAvwkRDYLX5xF91JGgZyLV2xBKJHnDvzYdbhFo3sxqanoBg='} 2024-09-10T23:56:05.599 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899821', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 23:51:07.278835', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDqptMKZvIO1AAqzECCXupfSHV5wR7rl9vJ4w7jg5oNdGETdw6uzx7A/A7GIFEjoEwuXsMgHiEWk1eO4xDxguNo='} 2024-09-10T23:56:05.600 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T23:56:05.606 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-10T23:56:05.606 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-10T23:56:05.606 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-10T23:56:05.606 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T23:56:05.714 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0972ea3be0>, signals=[15]) 2024-09-10T23:56:05.715 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T23:56:05.723 INFO:teuthology.task.internal:Opening connections... 2024-09-10T23:56:05.724 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2024-09-10T23:56:05.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:56:05.810 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T23:56:05.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:56:05.895 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com 2024-09-10T23:56:05.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:56:05.981 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T23:56:05.987 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2024-09-10T23:56:06.006 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2024-09-10T23:56:06.006 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2024-09-10T23:56:06.064 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream" 2024-09-10T23:56:06.064 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="9" 2024-09-10T23:56:06.064 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos" 2024-09-10T23:56:06.064 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora" 2024-09-10T23:56:06.064 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="9" 2024-09-10T23:56:06.064 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el9" 2024-09-10T23:56:06.064 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T23:56:06.064 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2024-09-10T23:56:06.064 INFO:teuthology.orchestra.run.smithi078.stdout:LOGO="fedora-logo-icon" 2024-09-10T23:56:06.064 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T23:56:06.065 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/" 2024-09-10T23:56:06.065 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T23:56:06.065 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T23:56:06.065 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T23:56:06.066 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2024-09-10T23:56:06.090 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-09-10T23:56:06.108 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-09-10T23:56:06.109 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-09-10T23:56:06.166 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-09-10T23:56:06.166 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-09-10T23:56:06.166 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-09-10T23:56:06.166 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-09-10T23:56:06.166 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-09-10T23:56:06.166 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-09-10T23:56:06.166 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T23:56:06.166 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-09-10T23:56:06.166 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-09-10T23:56:06.166 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T23:56:06.167 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-09-10T23:56:06.167 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T23:56:06.167 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T23:56:06.167 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T23:56:06.167 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-09-10T23:56:06.190 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2024-09-10T23:56:06.208 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2024-09-10T23:56:06.208 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-09-10T23:56:06.267 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream" 2024-09-10T23:56:06.267 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="9" 2024-09-10T23:56:06.267 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2024-09-10T23:56:06.267 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2024-09-10T23:56:06.267 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="9" 2024-09-10T23:56:06.267 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el9" 2024-09-10T23:56:06.267 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T23:56:06.267 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2024-09-10T23:56:06.267 INFO:teuthology.orchestra.run.smithi138.stdout:LOGO="fedora-logo-icon" 2024-09-10T23:56:06.268 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T23:56:06.268 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/" 2024-09-10T23:56:06.268 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T23:56:06.268 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T23:56:06.268 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T23:56:06.268 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-09-10T23:56:06.298 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T23:56:06.310 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T23:56:06.355 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T23:56:06.355 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:56:06.358 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:56:06.360 DEBUG:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:56:06.377 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T23:56:06.387 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T23:56:06.387 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:56:06.416 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:56:06.418 DEBUG:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:56:06.551 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T23:56:06.642 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T23:56:06.659 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-10T23:56:06.659 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-10T23:56:06.659 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-10T23:56:06.660 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:56:06.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:56:06.677 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-09-10T23:56:06.736 INFO:teuthology.orchestra.run.smithi078.stdout:5.14.0-503.el9.x86_64 2024-09-10T23:56:06.736 INFO:teuthology.task.kernel:Running kernel on smithi078: 5.14.0-503.el9.x86_64 2024-09-10T23:56:06.736 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum install -y kernel 2024-09-10T23:56:09.364 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - BaseOS 8.8 MB/s | 8.2 MB 00:00 2024-09-10T23:56:13.900 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - AppStream 6.0 MB/s | 20 MB 00:03 2024-09-10T23:56:18.532 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - CRB 8.1 MB/s | 6.5 MB 00:00 2024-09-10T23:56:20.133 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 19 kB 00:00 2024-09-10T23:56:21.096 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-10T23:56:26.502 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-09-10T23:56:28.516 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T23:56:28.517 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T23:56:28.594 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-10T23:56:28.605 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-10T23:56:28.605 INFO:teuthology.orchestra.run.smithi078.stdout: Package Architecture Version Repository Size 2024-09-10T23:56:28.605 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-10T23:56:28.605 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-10T23:56:28.605 INFO:teuthology.orchestra.run.smithi078.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T23:56:28.605 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-09-10T23:56:28.606 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T23:56:28.606 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T23:56:28.606 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T23:56:28.606 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T23:56:28.606 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-10T23:56:28.606 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-10T23:56:28.606 INFO:teuthology.orchestra.run.smithi078.stdout:Install 4 Packages 2024-09-10T23:56:28.606 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T23:56:28.607 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 79 M 2024-09-10T23:56:28.607 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 126 M 2024-09-10T23:56:28.607 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-10T23:56:28.720 INFO:teuthology.orchestra.run.smithi078.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 245 kB/s | 23 kB 00:00 2024-09-10T23:56:29.112 INFO:teuthology.orchestra.run.smithi078.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-10T23:56:29.495 INFO:teuthology.orchestra.run.smithi078.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 37 MB/s | 29 MB 00:00 2024-09-10T23:56:29.796 INFO:teuthology.orchestra.run.smithi078.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 30 MB/s | 35 MB 00:01 2024-09-10T23:56:29.796 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-10T23:56:29.796 INFO:teuthology.orchestra.run.smithi078.stdout:Total 66 MB/s | 79 MB 00:01 2024-09-10T23:56:30.479 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-10T23:56:30.819 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-10T23:56:30.819 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-10T23:56:31.773 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-10T23:56:31.774 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-10T23:56:34.201 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-10T23:56:34.904 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T23:56:34.989 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T23:56:37.773 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T23:56:37.909 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T23:56:42.728 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T23:56:42.759 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:56:47.631 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:57:25.848 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:57:25.887 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:57:26.258 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:57:26.258 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T23:57:26.258 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T23:57:26.258 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T23:57:27.117 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T23:57:27.117 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T23:57:27.117 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-10T23:57:27.117 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T23:57:27.117 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T23:57:27.117 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T23:57:27.117 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T23:57:27.118 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T23:57:27.118 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-10T23:57:27.481 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T23:57:27.559 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T23:57:27.559 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T23:57:27.559 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T23:57:27.559 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T23:57:27.560 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T23:57:27.560 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-10T23:57:27.560 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi078.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T23:57:27.560 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T23:57:27.619 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T23:57:27.619 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T23:57:27.619 DEBUG:teuthology.orchestra.run.smithi078:> sudo rpm -qi grub2-tools 2024-09-10T23:57:27.652 INFO:teuthology.orchestra.run.smithi078.stdout:Name : grub2-tools 2024-09-10T23:57:27.652 INFO:teuthology.orchestra.run.smithi078.stdout:Epoch : 1 2024-09-10T23:57:27.652 INFO:teuthology.orchestra.run.smithi078.stdout:Version : 2.06 2024-09-10T23:57:27.652 INFO:teuthology.orchestra.run.smithi078.stdout:Release : 82.el9 2024-09-10T23:57:27.652 INFO:teuthology.orchestra.run.smithi078.stdout:Architecture: x86_64 2024-09-10T23:57:27.652 INFO:teuthology.orchestra.run.smithi078.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T23:57:27.652 INFO:teuthology.orchestra.run.smithi078.stdout:Group : Unspecified 2024-09-10T23:57:27.652 INFO:teuthology.orchestra.run.smithi078.stdout:Size : 8274670 2024-09-10T23:57:27.652 INFO:teuthology.orchestra.run.smithi078.stdout:License : GPLv3+ 2024-09-10T23:57:27.652 INFO:teuthology.orchestra.run.smithi078.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T23:57:27.652 INFO:teuthology.orchestra.run.smithi078.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T23:57:27.653 INFO:teuthology.orchestra.run.smithi078.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T23:57:27.653 INFO:teuthology.orchestra.run.smithi078.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T23:57:27.653 INFO:teuthology.orchestra.run.smithi078.stdout:Packager : builder@centos.org 2024-09-10T23:57:27.653 INFO:teuthology.orchestra.run.smithi078.stdout:Vendor : CentOS 2024-09-10T23:57:27.653 INFO:teuthology.orchestra.run.smithi078.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T23:57:27.653 INFO:teuthology.orchestra.run.smithi078.stdout:Summary : Support tools for GRUB. 2024-09-10T23:57:27.653 INFO:teuthology.orchestra.run.smithi078.stdout:Description : 2024-09-10T23:57:27.653 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T23:57:27.653 INFO:teuthology.orchestra.run.smithi078.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T23:57:27.653 INFO:teuthology.orchestra.run.smithi078.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T23:57:27.653 INFO:teuthology.orchestra.run.smithi078.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T23:57:27.653 INFO:teuthology.orchestra.run.smithi078.stdout:hardware devices. 2024-09-10T23:57:27.653 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-10T23:57:27.653 INFO:teuthology.orchestra.run.smithi078.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T23:57:27.654 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T23:57:27.655 INFO:teuthology.task.kernel:Updating grub on smithi078 to boot 5.14.0-505.el9.x86_64 2024-09-10T23:57:27.655 DEBUG:teuthology.orchestra.run.smithi078:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T23:57:28.302 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2024-09-10T23:57:29.571 INFO:teuthology.orchestra.run.smithi078.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T23:57:29.603 INFO:teuthology.orchestra.run.smithi078.stderr:done 2024-09-10T23:57:29.614 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-09-10T23:57:29.630 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.Ek70FOHxPs 2024-09-10T23:57:29.630 DEBUG:teuthology.orchestra.run.smithi078:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Ek70FOHxPs 2024-09-10T23:57:29.698 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.Ek70FOHxPs 2024-09-10T23:57:29.848 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.Ek70FOHxPs is 6KB 2024-09-10T23:57:29.897 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.Ek70FOHxPs 2024-09-10T23:57:29.912 DEBUG:teuthology.orchestra.run.smithi078:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T23:57:29.974 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T23:57:29.974 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T23:57:29.974 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T23:57:29.974 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T23:57:29.975 DEBUG:teuthology.orchestra.run.smithi078:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T23:57:30.117 DEBUG:teuthology.orchestra.run.smithi078:> sudo shutdown -r now 2024-09-10T23:58:00.120 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-10T23:58:00.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-10T23:58:00.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:58:18.689 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-09-10T23:58:27.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-10T23:58:27.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:58:30.785 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-09-10T23:58:42.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-10T23:58:42.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:59:01.181 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-09-10T23:59:16.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-10T23:59:16.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:59:16.579 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-09-10T23:59:17.164 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-10T23:59:17.164 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-10T23:59:17.165 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-09-10T23:59:17.208 INFO:teuthology.orchestra.run.smithi078.stdout:5.14.0-505.el9.x86_64 2024-09-10T23:59:17.209 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T23:59:17.209 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T23:59:17.209 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T23:59:18.210 DEBUG:teuthology.parallel:result is None 2024-09-10T23:59:18.210 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T23:59:18.217 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T23:59:18.217 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:59:18.220 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:59:18.223 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:59:18.242 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T23:59:18.248 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T23:59:18.258 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T23:59:18.258 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:59:18.278 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:59:18.281 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:59:18.407 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T23:59:18.414 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T23:59:18.414 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:59:18.431 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:59:18.431 DEBUG:teuthology.orchestra.run.smithi138:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:59:18.448 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:59:18.449 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:59:18.451 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:59:18.474 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:59:18.528 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:59:18.537 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:59:18.557 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:59:18.562 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:59:18.620 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:59:18.672 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:59:18.673 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T23:59:18.680 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T23:59:18.681 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:59:18.683 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:59:18.685 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:59:18.714 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T23:59:18.723 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T23:59:18.723 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:59:18.747 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:59:18.754 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:59:18.771 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:59:18.852 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:59:18.895 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:59:18.982 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:59:19.017 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-10T23:59:19.017 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:59:19.081 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:59:19.135 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:59:19.187 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:59:19.239 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:59:19.273 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T23:59:19.273 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:59:19.340 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:59:19.392 DEBUG:teuthology.orchestra.run.smithi138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:59:19.440 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:59:19.534 DEBUG:teuthology.orchestra.run.smithi138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:59:19.568 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-10T23:59:19.568 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:59:19.635 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2024-09-10T23:59:19.638 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2024-09-10T23:59:19.640 DEBUG:teuthology.orchestra.run.smithi138:> sudo service rsyslog restart 2024-09-10T23:59:19.678 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:59:19.684 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:59:19.716 INFO:teuthology.orchestra.run.smithi138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T23:59:20.121 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T23:59:20.128 INFO:teuthology.task.internal:Starting timer... 2024-09-10T23:59:20.128 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T23:59:20.139 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T23:59:20.153 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-10T23:59:20.153 DEBUG:teuthology.orchestra.run.smithi078:> sudo service auditd rotate 2024-09-10T23:59:20.221 INFO:teuthology.orchestra.run.smithi078.stdout:Rotating logs: 2024-09-10T23:59:20.223 DEBUG:teuthology.orchestra.run.smithi112:> sudo service auditd rotate 2024-09-10T23:59:20.284 INFO:teuthology.orchestra.run.smithi112.stdout:Rotating logs: 2024-09-10T23:59:20.286 DEBUG:teuthology.orchestra.run.smithi138:> sudo service auditd rotate 2024-09-10T23:59:20.351 INFO:teuthology.orchestra.run.smithi138.stdout:Rotating logs: 2024-09-10T23:59:20.353 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T23:59:20.353 DEBUG:teuthology.orchestra.run.smithi078:> /usr/sbin/getenforce 2024-09-10T23:59:20.377 INFO:teuthology.orchestra.run.smithi078.stdout:Permissive 2024-09-10T23:59:20.377 DEBUG:teuthology.orchestra.run.smithi112:> /usr/sbin/getenforce 2024-09-10T23:59:20.407 INFO:teuthology.orchestra.run.smithi112.stdout:Permissive 2024-09-10T23:59:20.408 DEBUG:teuthology.orchestra.run.smithi138:> /usr/sbin/getenforce 2024-09-10T23:59:20.432 INFO:teuthology.orchestra.run.smithi138.stdout:Permissive 2024-09-10T23:59:20.432 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi078.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi112.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi138.front.sepia.ceph.com': 'permissive'} 2024-09-10T23:59:20.433 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:59:20.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:59:20.463 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:59:20.491 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:59:20.492 DEBUG:teuthology.orchestra.run.smithi138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T23:59:20.519 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:59:20.519 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T23:59:20.519 DEBUG:teuthology.orchestra.run.smithi078:> sudo /usr/sbin/setenforce permissive 2024-09-10T23:59:20.559 DEBUG:teuthology.orchestra.run.smithi112:> sudo /usr/sbin/setenforce permissive 2024-09-10T23:59:20.593 DEBUG:teuthology.orchestra.run.smithi138:> sudo /usr/sbin/setenforce permissive 2024-09-10T23:59:20.624 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T23:59:20.633 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-10T23:59:20.636 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-10T23:59:20.789 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T23:59:20.811 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T23:59:20.812 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi078.front.sepia.ceph.com,smithi112.front.sepia.ceph.com,smithi138.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T00:03:20.722 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi078.front.sepia.ceph.com'), Remote(name='ubuntu@smithi112.front.sepia.ceph.com'), Remote(name='ubuntu@smithi138.front.sepia.ceph.com')] 2024-09-11T00:03:20.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-11T00:03:20.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:03:20.810 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-09-11T00:03:20.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-11T00:03:20.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-11T00:03:20.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:03:20.982 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-11T00:03:21.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-11T00:03:21.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-11T00:03:21.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:03:21.146 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-09-11T00:03:21.226 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-11T00:03:21.227 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T00:03:21.313 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T00:03:21.313 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T00:03:21.314 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:03:21.316 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T00:03:21.316 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:03:21.318 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T00:03:21.319 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:03:21.344 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T00:03:21.345 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T00:03:21.350 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T00:03:21.358 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T00:03:21.360 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T00:03:21.366 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T00:03:21.382 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: ntpd: command not found 2024-09-11T00:03:21.384 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: ntpd: command not found 2024-09-11T00:03:21.392 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: ntpd: command not found 2024-09-11T00:03:21.393 INFO:teuthology.orchestra.run.smithi078.stdout:506 Cannot talk to daemon 2024-09-11T00:03:21.396 INFO:teuthology.orchestra.run.smithi112.stdout:506 Cannot talk to daemon 2024-09-11T00:03:21.404 INFO:teuthology.orchestra.run.smithi138.stdout:506 Cannot talk to daemon 2024-09-11T00:03:21.407 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T00:03:21.410 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T00:03:21.418 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T00:03:21.421 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T00:03:21.423 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T00:03:21.433 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T00:03:21.475 INFO:teuthology.orchestra.run.smithi078.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:03:21.478 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:03:21.478 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2024-09-11T00:03:21.479 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:03:21.479 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:03:21.479 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:03:21.479 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:03:21.480 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:03:21.484 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:03:21.484 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-09-11T00:03:21.484 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:03:21.484 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:03:21.484 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:03:21.484 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:03:21.495 INFO:teuthology.orchestra.run.smithi138.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:03:21.498 INFO:teuthology.orchestra.run.smithi138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:03:21.498 INFO:teuthology.orchestra.run.smithi138.stdout:=============================================================================== 2024-09-11T00:03:21.499 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:03:21.499 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:03:21.499 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:03:21.499 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:03:21.500 INFO:teuthology.run_tasks:Running task install... 2024-09-11T00:03:21.509 DEBUG:teuthology.task.install:project ceph 2024-09-11T00:03:21.509 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-11T00:03:21.509 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-11T00:03:21.509 INFO:teuthology.task.install:Using flavor: default 2024-09-11T00:03:21.515 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T00:03:21.515 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-11T00:03:21.516 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-11T00:03:21.516 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:03:21.519 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-11T00:03:21.520 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:03:21.521 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-11T00:03:21.521 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:03:21.684 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-11T00:03:21.684 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-11T00:03:21.700 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-11T00:03:21.700 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-11T00:03:21.701 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-11T00:03:21.701 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-11T00:03:21.816 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T00:03:21.816 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-11T00:03:21.816 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T00:03:21.825 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T00:03:21.825 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-11T00:03:21.825 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T00:03:21.833 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T00:03:21.833 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-11T00:03:21.833 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T00:03:21.843 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T00:03:21.843 DEBUG:teuthology.orchestra.run.smithi078:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T00:03:21.851 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T00:03:21.852 DEBUG:teuthology.orchestra.run.smithi138:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T00:03:21.859 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T00:03:21.859 DEBUG:teuthology.orchestra.run.smithi112:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T00:03:21.909 DEBUG:teuthology.orchestra.run.smithi078:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T00:03:21.917 DEBUG:teuthology.orchestra.run.smithi138:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T00:03:21.925 DEBUG:teuthology.orchestra.run.smithi112:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T00:03:21.985 DEBUG:teuthology.orchestra.run.smithi078:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T00:03:21.992 DEBUG:teuthology.orchestra.run.smithi138:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T00:03:22.000 DEBUG:teuthology.orchestra.run.smithi112:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T00:03:22.049 INFO:teuthology.orchestra.run.smithi078.stdout:check_obsoletes = 1 2024-09-11T00:03:22.051 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum clean all 2024-09-11T00:03:22.056 INFO:teuthology.orchestra.run.smithi138.stdout:check_obsoletes = 1 2024-09-11T00:03:22.057 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum clean all 2024-09-11T00:03:22.063 INFO:teuthology.orchestra.run.smithi112.stdout:check_obsoletes = 1 2024-09-11T00:03:22.065 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum clean all 2024-09-11T00:03:22.277 INFO:teuthology.orchestra.run.smithi078.stdout:45 files removed 2024-09-11T00:03:22.282 INFO:teuthology.orchestra.run.smithi138.stdout:45 files removed 2024-09-11T00:03:22.291 INFO:teuthology.orchestra.run.smithi112.stdout:45 files removed 2024-09-11T00:03:22.303 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T00:03:22.310 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T00:03:22.317 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T00:03:22.852 INFO:teuthology.orchestra.run.smithi078.stdout:ceph packages for x86_64 321 kB/s | 84 kB 00:00 2024-09-11T00:03:22.863 INFO:teuthology.orchestra.run.smithi138.stdout:ceph packages for x86_64 303 kB/s | 84 kB 00:00 2024-09-11T00:03:22.864 INFO:teuthology.orchestra.run.smithi112.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-09-11T00:03:23.136 INFO:teuthology.orchestra.run.smithi078.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-11T00:03:23.156 INFO:teuthology.orchestra.run.smithi138.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-11T00:03:23.156 INFO:teuthology.orchestra.run.smithi112.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-11T00:03:23.411 INFO:teuthology.orchestra.run.smithi078.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-11T00:03:23.431 INFO:teuthology.orchestra.run.smithi112.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-11T00:03:23.432 INFO:teuthology.orchestra.run.smithi138.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-11T00:03:23.895 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.2 MB 00:00 2024-09-11T00:03:24.931 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.2 MB 00:01 2024-09-11T00:03:25.507 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.2 MB 00:02 2024-09-11T00:03:26.154 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - AppStream 18 MB/s | 20 MB 00:01 2024-09-11T00:03:27.649 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - AppStream 13 MB/s | 20 MB 00:01 2024-09-11T00:03:29.025 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - AppStream 8.4 MB/s | 20 MB 00:02 2024-09-11T00:03:32.599 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.5 MB 00:02 2024-09-11T00:03:34.158 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - Extras packages 84 kB/s | 19 kB 00:00 2024-09-11T00:03:34.710 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-11T00:03:34.967 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - CRB 1.9 MB/s | 6.5 MB 00:03 2024-09-11T00:03:35.204 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-11T00:03:36.252 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 19 kB 00:00 2024-09-11T00:03:36.351 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - Extras packages 109 kB/s | 19 kB 00:00 2024-09-11T00:03:37.406 INFO:teuthology.orchestra.run.smithi138.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-11T00:03:37.521 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-11T00:03:40.626 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-11T00:03:42.904 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-11T00:03:42.905 INFO:teuthology.orchestra.run.smithi138.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-09-11T00:03:42.987 INFO:teuthology.orchestra.run.smithi078.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:03:42.987 INFO:teuthology.orchestra.run.smithi078.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:03:42.999 INFO:teuthology.orchestra.run.smithi078.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T00:03:43.000 INFO:teuthology.orchestra.run.smithi078.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T00:03:43.001 INFO:teuthology.orchestra.run.smithi078.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T00:03:43.001 INFO:teuthology.orchestra.run.smithi078.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T00:03:43.003 INFO:teuthology.orchestra.run.smithi078.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T00:03:43.005 INFO:teuthology.orchestra.run.smithi078.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T00:03:43.006 INFO:teuthology.orchestra.run.smithi078.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T00:03:43.070 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-11T00:03:43.084 INFO:teuthology.orchestra.run.smithi078.stdout:======================================================================================= 2024-09-11T00:03:43.085 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repository Size 2024-09-11T00:03:43.085 INFO:teuthology.orchestra.run.smithi078.stdout:======================================================================================= 2024-09-11T00:03:43.085 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-11T00:03:43.085 INFO:teuthology.orchestra.run.smithi078.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T00:03:43.085 INFO:teuthology.orchestra.run.smithi078.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-11T00:03:43.085 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:03:43.085 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-11T00:03:43.085 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-11T00:03:43.085 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-11T00:03:43.085 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-11T00:03:43.085 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-11T00:03:43.086 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-11T00:03:43.086 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-11T00:03:43.086 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-11T00:03:43.086 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-11T00:03:43.086 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-11T00:03:43.086 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-11T00:03:43.086 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-11T00:03:43.086 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-11T00:03:43.086 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-11T00:03:43.086 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T00:03:43.086 INFO:teuthology.orchestra.run.smithi078.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T00:03:43.086 INFO:teuthology.orchestra.run.smithi078.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T00:03:43.087 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-11T00:03:43.087 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-11T00:03:43.087 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-11T00:03:43.087 INFO:teuthology.orchestra.run.smithi078.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T00:03:43.087 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T00:03:43.087 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T00:03:43.087 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T00:03:43.087 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T00:03:43.087 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T00:03:43.087 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-11T00:03:43.087 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-11T00:03:43.087 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-11T00:03:43.087 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-11T00:03:43.087 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-11T00:03:43.088 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:03:43.088 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-11T00:03:43.088 INFO:teuthology.orchestra.run.smithi078.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T00:03:43.088 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrading: 2024-09-11T00:03:43.088 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T00:03:43.088 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T00:03:43.088 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T00:03:43.088 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T00:03:43.088 INFO:teuthology.orchestra.run.smithi078.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-11T00:03:43.088 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:03:43.088 INFO:teuthology.orchestra.run.smithi078.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T00:03:43.088 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T00:03:43.088 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-09-11T00:03:43.089 INFO:teuthology.orchestra.run.smithi078.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T00:03:43.089 INFO:teuthology.orchestra.run.smithi078.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T00:03:43.089 INFO:teuthology.orchestra.run.smithi078.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T00:03:43.089 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-11T00:03:43.089 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-11T00:03:43.089 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-11T00:03:43.089 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-11T00:03:43.089 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-11T00:03:43.089 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-11T00:03:43.089 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-11T00:03:43.089 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-11T00:03:43.089 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T00:03:43.089 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T00:03:43.090 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T00:03:43.090 INFO:teuthology.orchestra.run.smithi078.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T00:03:43.090 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T00:03:43.090 INFO:teuthology.orchestra.run.smithi078.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T00:03:43.090 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T00:03:43.090 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T00:03:43.090 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-11T00:03:43.090 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T00:03:43.090 INFO:teuthology.orchestra.run.smithi078.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T00:03:43.090 INFO:teuthology.orchestra.run.smithi078.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T00:03:43.090 INFO:teuthology.orchestra.run.smithi078.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T00:03:43.090 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T00:03:43.090 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T00:03:43.091 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-11T00:03:43.091 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T00:03:43.091 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:03:43.091 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T00:03:43.091 INFO:teuthology.orchestra.run.smithi078.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T00:03:43.091 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T00:03:43.091 INFO:teuthology.orchestra.run.smithi078.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T00:03:43.091 INFO:teuthology.orchestra.run.smithi078.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T00:03:43.091 INFO:teuthology.orchestra.run.smithi078.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T00:03:43.092 INFO:teuthology.orchestra.run.smithi078.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T00:03:43.092 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T00:03:43.092 INFO:teuthology.orchestra.run.smithi078.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T00:03:43.092 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T00:03:43.092 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T00:03:43.092 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T00:03:43.092 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T00:03:43.092 INFO:teuthology.orchestra.run.smithi078.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T00:03:43.092 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T00:03:43.092 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T00:03:43.092 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T00:03:43.092 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-11T00:03:43.092 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-11T00:03:43.093 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T00:03:43.093 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T00:03:43.093 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T00:03:43.093 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T00:03:43.093 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T00:03:43.093 INFO:teuthology.orchestra.run.smithi078.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T00:03:43.093 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T00:03:43.093 INFO:teuthology.orchestra.run.smithi078.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T00:03:43.093 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T00:03:43.093 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T00:03:43.093 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T00:03:43.093 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T00:03:43.093 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T00:03:43.094 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T00:03:43.094 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T00:03:43.094 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T00:03:43.094 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T00:03:43.094 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T00:03:43.094 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T00:03:43.094 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T00:03:43.094 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T00:03:43.094 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T00:03:43.094 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T00:03:43.094 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T00:03:43.094 INFO:teuthology.orchestra.run.smithi078.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T00:03:43.094 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T00:03:43.094 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T00:03:43.094 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T00:03:43.095 INFO:teuthology.orchestra.run.smithi078.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T00:03:43.095 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T00:03:43.095 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T00:03:43.095 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T00:03:43.095 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T00:03:43.095 INFO:teuthology.orchestra.run.smithi078.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T00:03:43.095 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T00:03:43.095 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T00:03:43.095 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T00:03:43.095 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T00:03:43.095 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T00:03:43.095 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T00:03:43.095 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T00:03:43.096 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T00:03:43.096 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T00:03:43.096 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T00:03:43.096 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T00:03:43.096 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T00:03:43.096 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T00:03:43.096 INFO:teuthology.orchestra.run.smithi078.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T00:03:43.096 INFO:teuthology.orchestra.run.smithi078.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T00:03:43.096 INFO:teuthology.orchestra.run.smithi078.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T00:03:43.096 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T00:03:43.096 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T00:03:43.096 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T00:03:43.097 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T00:03:43.097 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T00:03:43.097 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T00:03:43.097 INFO:teuthology.orchestra.run.smithi078.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T00:03:43.097 INFO:teuthology.orchestra.run.smithi078.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T00:03:43.097 INFO:teuthology.orchestra.run.smithi078.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T00:03:43.097 INFO:teuthology.orchestra.run.smithi078.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T00:03:43.097 INFO:teuthology.orchestra.run.smithi078.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T00:03:43.097 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T00:03:43.097 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T00:03:43.097 INFO:teuthology.orchestra.run.smithi078.stdout:Installing weak dependencies: 2024-09-11T00:03:43.097 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T00:03:43.097 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:03:43.097 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-11T00:03:43.098 INFO:teuthology.orchestra.run.smithi078.stdout:======================================================================================= 2024-09-11T00:03:43.098 INFO:teuthology.orchestra.run.smithi078.stdout:Install 149 Packages 2024-09-11T00:03:43.098 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrade 8 Packages 2024-09-11T00:03:43.098 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:03:43.098 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 240 M 2024-09-11T00:03:43.098 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-11T00:03:43.427 INFO:teuthology.orchestra.run.smithi078.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 29 kB/s | 6.6 kB 00:00 2024-09-11T00:03:44.028 INFO:teuthology.orchestra.run.smithi078.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 1.5 MB/s | 900 kB 00:00 2024-09-11T00:03:44.120 INFO:teuthology.orchestra.run.smithi078.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 1.5 MB/s | 145 kB 00:00 2024-09-11T00:03:44.370 INFO:teuthology.orchestra.run.smithi078.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 4.7 MB/s | 5.5 MB 00:01 2024-09-11T00:03:44.620 INFO:teuthology.orchestra.run.smithi078.stdout:(5/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 6.1 MB/s | 1.5 MB 00:00 2024-09-11T00:03:45.020 INFO:teuthology.orchestra.run.smithi078.stdout:(6/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 2.6 MB/s | 2.4 MB 00:00 2024-09-11T00:03:45.170 INFO:teuthology.orchestra.run.smithi112.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:03:45.171 INFO:teuthology.orchestra.run.smithi112.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:03:45.182 INFO:teuthology.orchestra.run.smithi112.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T00:03:45.183 INFO:teuthology.orchestra.run.smithi112.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T00:03:45.183 INFO:teuthology.orchestra.run.smithi112.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T00:03:45.184 INFO:teuthology.orchestra.run.smithi112.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T00:03:45.186 INFO:teuthology.orchestra.run.smithi112.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T00:03:45.187 INFO:teuthology.orchestra.run.smithi078.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 8.5 MB/s | 4.8 MB 00:00 2024-09-11T00:03:45.188 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T00:03:45.189 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T00:03:45.190 INFO:teuthology.orchestra.run.smithi138.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:03:45.191 INFO:teuthology.orchestra.run.smithi138.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:03:45.202 INFO:teuthology.orchestra.run.smithi138.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T00:03:45.202 INFO:teuthology.orchestra.run.smithi138.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T00:03:45.203 INFO:teuthology.orchestra.run.smithi138.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T00:03:45.204 INFO:teuthology.orchestra.run.smithi138.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T00:03:45.206 INFO:teuthology.orchestra.run.smithi138.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T00:03:45.208 INFO:teuthology.orchestra.run.smithi138.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T00:03:45.209 INFO:teuthology.orchestra.run.smithi138.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T00:03:45.249 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-11T00:03:45.271 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================= 2024-09-11T00:03:45.271 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-11T00:03:45.271 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================= 2024-09-11T00:03:45.272 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-11T00:03:45.272 INFO:teuthology.orchestra.run.smithi112.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T00:03:45.272 INFO:teuthology.orchestra.run.smithi112.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-11T00:03:45.272 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:03:45.272 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-11T00:03:45.272 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-11T00:03:45.272 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-11T00:03:45.272 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-11T00:03:45.272 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-11T00:03:45.272 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-11T00:03:45.272 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-11T00:03:45.272 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-11T00:03:45.272 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-11T00:03:45.273 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-11T00:03:45.273 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-11T00:03:45.273 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-11T00:03:45.273 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-11T00:03:45.273 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-11T00:03:45.273 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T00:03:45.273 INFO:teuthology.orchestra.run.smithi112.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T00:03:45.273 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T00:03:45.273 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-11T00:03:45.273 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-11T00:03:45.274 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-11T00:03:45.274 INFO:teuthology.orchestra.run.smithi112.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T00:03:45.274 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T00:03:45.274 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T00:03:45.274 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T00:03:45.274 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T00:03:45.274 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T00:03:45.274 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-11T00:03:45.274 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-11T00:03:45.274 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-11T00:03:45.274 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-11T00:03:45.274 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-11T00:03:45.274 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:03:45.275 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-11T00:03:45.275 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T00:03:45.275 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrading: 2024-09-11T00:03:45.275 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T00:03:45.275 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T00:03:45.275 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T00:03:45.275 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T00:03:45.275 INFO:teuthology.orchestra.run.smithi112.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-11T00:03:45.275 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:03:45.276 INFO:teuthology.orchestra.run.smithi112.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T00:03:45.276 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T00:03:45.276 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-11T00:03:45.276 INFO:teuthology.orchestra.run.smithi112.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T00:03:45.276 INFO:teuthology.orchestra.run.smithi112.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T00:03:45.276 INFO:teuthology.orchestra.run.smithi112.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T00:03:45.276 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-11T00:03:45.276 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-11T00:03:45.276 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-11T00:03:45.276 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-11T00:03:45.276 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-11T00:03:45.276 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-11T00:03:45.277 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-11T00:03:45.277 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-11T00:03:45.277 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T00:03:45.277 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T00:03:45.277 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T00:03:45.277 INFO:teuthology.orchestra.run.smithi112.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T00:03:45.277 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T00:03:45.277 INFO:teuthology.orchestra.run.smithi112.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T00:03:45.277 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T00:03:45.277 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T00:03:45.277 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-11T00:03:45.278 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T00:03:45.278 INFO:teuthology.orchestra.run.smithi112.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T00:03:45.278 INFO:teuthology.orchestra.run.smithi112.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T00:03:45.278 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T00:03:45.278 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T00:03:45.278 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T00:03:45.278 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-11T00:03:45.278 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T00:03:45.278 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:03:45.278 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T00:03:45.278 INFO:teuthology.orchestra.run.smithi112.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T00:03:45.279 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T00:03:45.279 INFO:teuthology.orchestra.run.smithi112.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T00:03:45.279 INFO:teuthology.orchestra.run.smithi112.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T00:03:45.279 INFO:teuthology.orchestra.run.smithi112.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T00:03:45.279 INFO:teuthology.orchestra.run.smithi112.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T00:03:45.279 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T00:03:45.279 INFO:teuthology.orchestra.run.smithi112.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T00:03:45.279 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T00:03:45.279 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T00:03:45.279 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T00:03:45.279 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T00:03:45.280 INFO:teuthology.orchestra.run.smithi112.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T00:03:45.280 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T00:03:45.280 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T00:03:45.280 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T00:03:45.280 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-11T00:03:45.280 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-11T00:03:45.281 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T00:03:45.281 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T00:03:45.281 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T00:03:45.281 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T00:03:45.281 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T00:03:45.281 INFO:teuthology.orchestra.run.smithi112.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T00:03:45.281 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T00:03:45.281 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T00:03:45.281 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T00:03:45.281 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T00:03:45.281 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T00:03:45.281 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T00:03:45.282 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T00:03:45.282 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T00:03:45.282 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T00:03:45.282 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T00:03:45.282 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T00:03:45.282 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T00:03:45.282 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T00:03:45.282 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T00:03:45.282 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T00:03:45.283 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T00:03:45.283 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T00:03:45.283 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T00:03:45.283 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T00:03:45.283 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T00:03:45.284 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T00:03:45.284 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T00:03:45.284 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T00:03:45.284 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T00:03:45.284 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T00:03:45.285 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T00:03:45.285 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T00:03:45.285 INFO:teuthology.orchestra.run.smithi112.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T00:03:45.285 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T00:03:45.285 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T00:03:45.285 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T00:03:45.286 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T00:03:45.286 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T00:03:45.286 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T00:03:45.286 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T00:03:45.286 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T00:03:45.286 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T00:03:45.287 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T00:03:45.287 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T00:03:45.287 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T00:03:45.287 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T00:03:45.287 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T00:03:45.287 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T00:03:45.287 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T00:03:45.287 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T00:03:45.287 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T00:03:45.287 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T00:03:45.287 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T00:03:45.287 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T00:03:45.287 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T00:03:45.288 INFO:teuthology.orchestra.run.smithi112.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T00:03:45.288 INFO:teuthology.orchestra.run.smithi112.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T00:03:45.288 INFO:teuthology.orchestra.run.smithi112.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T00:03:45.288 INFO:teuthology.orchestra.run.smithi112.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T00:03:45.288 INFO:teuthology.orchestra.run.smithi112.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T00:03:45.288 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T00:03:45.288 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T00:03:45.288 INFO:teuthology.orchestra.run.smithi112.stdout:Installing weak dependencies: 2024-09-11T00:03:45.288 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T00:03:45.289 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-11T00:03:45.289 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-11T00:03:45.289 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================= 2024-09-11T00:03:45.289 INFO:teuthology.orchestra.run.smithi112.stdout:Install 149 Packages 2024-09-11T00:03:45.289 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrade 8 Packages 2024-09-11T00:03:45.289 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-11T00:03:45.290 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-11T00:03:45.290 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 240 M 2024-09-11T00:03:45.290 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-11T00:03:45.292 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-09-11T00:03:45.292 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-11T00:03:45.292 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-09-11T00:03:45.292 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-11T00:03:45.292 INFO:teuthology.orchestra.run.smithi138.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T00:03:45.293 INFO:teuthology.orchestra.run.smithi138.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-11T00:03:45.293 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:03:45.293 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-11T00:03:45.293 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-11T00:03:45.293 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-11T00:03:45.293 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-11T00:03:45.293 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-11T00:03:45.293 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-11T00:03:45.293 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-11T00:03:45.293 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-11T00:03:45.294 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-11T00:03:45.294 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-11T00:03:45.294 INFO:teuthology.orchestra.run.smithi138.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-11T00:03:45.294 INFO:teuthology.orchestra.run.smithi138.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-11T00:03:45.294 INFO:teuthology.orchestra.run.smithi138.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-11T00:03:45.294 INFO:teuthology.orchestra.run.smithi138.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-11T00:03:45.294 INFO:teuthology.orchestra.run.smithi138.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T00:03:45.294 INFO:teuthology.orchestra.run.smithi138.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T00:03:45.294 INFO:teuthology.orchestra.run.smithi138.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T00:03:45.294 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-11T00:03:45.294 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-11T00:03:45.294 INFO:teuthology.orchestra.run.smithi138.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-11T00:03:45.294 INFO:teuthology.orchestra.run.smithi138.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T00:03:45.295 INFO:teuthology.orchestra.run.smithi138.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T00:03:45.295 INFO:teuthology.orchestra.run.smithi138.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T00:03:45.295 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T00:03:45.295 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T00:03:45.295 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T00:03:45.295 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-11T00:03:45.295 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-11T00:03:45.295 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-11T00:03:45.295 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-11T00:03:45.296 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-11T00:03:45.296 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:03:45.296 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-11T00:03:45.296 INFO:teuthology.orchestra.run.smithi138.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T00:03:45.296 INFO:teuthology.orchestra.run.smithi138.stdout:Upgrading: 2024-09-11T00:03:45.297 INFO:teuthology.orchestra.run.smithi138.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T00:03:45.297 INFO:teuthology.orchestra.run.smithi138.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T00:03:45.297 INFO:teuthology.orchestra.run.smithi138.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T00:03:45.297 INFO:teuthology.orchestra.run.smithi138.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T00:03:45.297 INFO:teuthology.orchestra.run.smithi138.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-11T00:03:45.297 INFO:teuthology.orchestra.run.smithi138.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:03:45.298 INFO:teuthology.orchestra.run.smithi138.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T00:03:45.298 INFO:teuthology.orchestra.run.smithi138.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T00:03:45.298 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-11T00:03:45.298 INFO:teuthology.orchestra.run.smithi138.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T00:03:45.298 INFO:teuthology.orchestra.run.smithi138.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T00:03:45.298 INFO:teuthology.orchestra.run.smithi138.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T00:03:45.298 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-11T00:03:45.298 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-11T00:03:45.298 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-11T00:03:45.298 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-11T00:03:45.298 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-11T00:03:45.299 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-11T00:03:45.299 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-11T00:03:45.299 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-11T00:03:45.299 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T00:03:45.299 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T00:03:45.299 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T00:03:45.299 INFO:teuthology.orchestra.run.smithi138.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T00:03:45.299 INFO:teuthology.orchestra.run.smithi138.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T00:03:45.300 INFO:teuthology.orchestra.run.smithi138.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T00:03:45.300 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T00:03:45.300 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T00:03:45.300 INFO:teuthology.orchestra.run.smithi138.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-11T00:03:45.300 INFO:teuthology.orchestra.run.smithi138.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T00:03:45.300 INFO:teuthology.orchestra.run.smithi138.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T00:03:45.300 INFO:teuthology.orchestra.run.smithi138.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T00:03:45.300 INFO:teuthology.orchestra.run.smithi138.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T00:03:45.301 INFO:teuthology.orchestra.run.smithi138.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T00:03:45.301 INFO:teuthology.orchestra.run.smithi138.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T00:03:45.301 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-11T00:03:45.301 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T00:03:45.301 INFO:teuthology.orchestra.run.smithi138.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:03:45.301 INFO:teuthology.orchestra.run.smithi138.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T00:03:45.301 INFO:teuthology.orchestra.run.smithi138.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T00:03:45.301 INFO:teuthology.orchestra.run.smithi138.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T00:03:45.301 INFO:teuthology.orchestra.run.smithi138.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T00:03:45.301 INFO:teuthology.orchestra.run.smithi138.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T00:03:45.301 INFO:teuthology.orchestra.run.smithi138.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T00:03:45.301 INFO:teuthology.orchestra.run.smithi138.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T00:03:45.302 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T00:03:45.302 INFO:teuthology.orchestra.run.smithi138.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T00:03:45.302 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T00:03:45.302 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T00:03:45.302 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T00:03:45.302 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T00:03:45.302 INFO:teuthology.orchestra.run.smithi138.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T00:03:45.302 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T00:03:45.302 INFO:teuthology.orchestra.run.smithi138.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T00:03:45.302 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T00:03:45.302 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-11T00:03:45.302 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-11T00:03:45.302 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T00:03:45.303 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T00:03:45.303 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T00:03:45.303 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T00:03:45.303 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T00:03:45.303 INFO:teuthology.orchestra.run.smithi138.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T00:03:45.303 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T00:03:45.303 INFO:teuthology.orchestra.run.smithi138.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T00:03:45.303 INFO:teuthology.orchestra.run.smithi138.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T00:03:45.303 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T00:03:45.303 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T00:03:45.303 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T00:03:45.304 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T00:03:45.304 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T00:03:45.304 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T00:03:45.304 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T00:03:45.304 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T00:03:45.304 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T00:03:45.304 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T00:03:45.304 INFO:teuthology.orchestra.run.smithi138.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T00:03:45.304 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T00:03:45.304 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T00:03:45.304 INFO:teuthology.orchestra.run.smithi138.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T00:03:45.304 INFO:teuthology.orchestra.run.smithi138.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T00:03:45.304 INFO:teuthology.orchestra.run.smithi138.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T00:03:45.304 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T00:03:45.305 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T00:03:45.305 INFO:teuthology.orchestra.run.smithi138.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T00:03:45.305 INFO:teuthology.orchestra.run.smithi138.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T00:03:45.305 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T00:03:45.305 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T00:03:45.305 INFO:teuthology.orchestra.run.smithi138.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T00:03:45.305 INFO:teuthology.orchestra.run.smithi138.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T00:03:45.305 INFO:teuthology.orchestra.run.smithi138.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T00:03:45.305 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T00:03:45.305 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T00:03:45.305 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T00:03:45.305 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T00:03:45.306 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T00:03:45.306 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T00:03:45.306 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T00:03:45.306 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T00:03:45.306 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T00:03:45.306 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T00:03:45.306 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T00:03:45.306 INFO:teuthology.orchestra.run.smithi138.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T00:03:45.306 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T00:03:45.306 INFO:teuthology.orchestra.run.smithi138.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T00:03:45.306 INFO:teuthology.orchestra.run.smithi138.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T00:03:45.306 INFO:teuthology.orchestra.run.smithi138.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T00:03:45.306 INFO:teuthology.orchestra.run.smithi138.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T00:03:45.306 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T00:03:45.307 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T00:03:45.307 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T00:03:45.307 INFO:teuthology.orchestra.run.smithi138.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T00:03:45.307 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T00:03:45.307 INFO:teuthology.orchestra.run.smithi138.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T00:03:45.307 INFO:teuthology.orchestra.run.smithi138.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T00:03:45.307 INFO:teuthology.orchestra.run.smithi138.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T00:03:45.307 INFO:teuthology.orchestra.run.smithi138.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T00:03:45.307 INFO:teuthology.orchestra.run.smithi138.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T00:03:45.307 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T00:03:45.307 INFO:teuthology.orchestra.run.smithi138.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T00:03:45.307 INFO:teuthology.orchestra.run.smithi138.stdout:Installing weak dependencies: 2024-09-11T00:03:45.307 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T00:03:45.307 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:03:45.308 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-11T00:03:45.308 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-09-11T00:03:45.308 INFO:teuthology.orchestra.run.smithi138.stdout:Install 149 Packages 2024-09-11T00:03:45.308 INFO:teuthology.orchestra.run.smithi138.stdout:Upgrade 8 Packages 2024-09-11T00:03:45.308 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:03:45.308 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 240 M 2024-09-11T00:03:45.308 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-11T00:03:45.838 INFO:teuthology.orchestra.run.smithi078.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 8.2 MB/s | 22 MB 00:02 2024-09-11T00:03:45.904 INFO:teuthology.orchestra.run.smithi078.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 380 kB/s | 25 kB 00:00 2024-09-11T00:03:45.921 INFO:teuthology.orchestra.run.smithi112.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 32 kB/s | 6.6 kB 00:00 2024-09-11T00:03:46.498 INFO:teuthology.orchestra.run.smithi138.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-09-11T00:03:46.564 INFO:teuthology.orchestra.run.smithi078.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 8.0 MB/s | 11 MB 00:01 2024-09-11T00:03:46.664 INFO:teuthology.orchestra.run.smithi078.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 2.2 MB/s | 225 kB 00:00 2024-09-11T00:03:46.756 INFO:teuthology.orchestra.run.smithi078.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 295 kB/s | 27 kB 00:00 2024-09-11T00:03:46.847 INFO:teuthology.orchestra.run.smithi078.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 347 kB/s | 32 kB 00:00 2024-09-11T00:03:47.138 INFO:teuthology.orchestra.run.smithi112.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 740 kB/s | 900 kB 00:01 2024-09-11T00:03:47.156 INFO:teuthology.orchestra.run.smithi078.stdout:(14/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 8.0 MB/s | 17 MB 00:02 2024-09-11T00:03:47.248 INFO:teuthology.orchestra.run.smithi078.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 1.7 MB/s | 162 kB 00:00 2024-09-11T00:03:47.290 INFO:teuthology.orchestra.run.smithi078.stdout:(16/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 1.7 MB/s | 755 kB 00:00 2024-09-11T00:03:47.331 INFO:teuthology.orchestra.run.smithi078.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 1.5 MB/s | 127 kB 00:00 2024-09-11T00:03:47.338 INFO:teuthology.orchestra.run.smithi112.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 725 kB/s | 145 kB 00:00 2024-09-11T00:03:47.365 INFO:teuthology.orchestra.run.smithi138.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 1.0 MB/s | 900 kB 00:00 2024-09-11T00:03:47.457 INFO:teuthology.orchestra.run.smithi078.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 3.0 MB/s | 507 kB 00:00 2024-09-11T00:03:47.541 INFO:teuthology.orchestra.run.smithi078.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 541 kB/s | 45 kB 00:00 2024-09-11T00:03:47.548 INFO:teuthology.orchestra.run.smithi138.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 790 kB/s | 145 kB 00:00 2024-09-11T00:03:47.632 INFO:teuthology.orchestra.run.smithi078.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.5 MB/s | 143 kB 00:00 2024-09-11T00:03:47.766 INFO:teuthology.orchestra.run.smithi078.stdout:(21/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 13 MB/s | 5.5 MB 00:00 2024-09-11T00:03:47.791 INFO:teuthology.orchestra.run.smithi078.stdout:(22/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.0 MB/s | 161 kB 00:00 2024-09-11T00:03:47.841 INFO:teuthology.orchestra.run.smithi078.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 4.2 MB/s | 321 kB 00:00 2024-09-11T00:03:47.875 INFO:teuthology.orchestra.run.smithi078.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 3.6 MB/s | 306 kB 00:00 2024-09-11T00:03:47.917 INFO:teuthology.orchestra.run.smithi078.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.3 MB/s | 99 kB 00:00 2024-09-11T00:03:47.959 INFO:teuthology.orchestra.run.smithi078.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.0 MB/s | 85 kB 00:00 2024-09-11T00:03:48.059 INFO:teuthology.orchestra.run.smithi078.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 1.7 MB/s | 171 kB 00:00 2024-09-11T00:03:48.193 INFO:teuthology.orchestra.run.smithi078.stdout:(28/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 12 MB/s | 3.2 MB 00:00 2024-09-11T00:03:48.218 INFO:teuthology.orchestra.run.smithi078.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4854.g 216 kB/s | 34 kB 00:00 2024-09-11T00:03:48.277 INFO:teuthology.orchestra.run.smithi078.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 1.8 MB/s | 154 kB 00:00 2024-09-11T00:03:48.590 INFO:teuthology.orchestra.run.smithi138.stdout:(4/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 2.3 MB/s | 2.4 MB 00:01 2024-09-11T00:03:48.844 INFO:teuthology.orchestra.run.smithi078.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 13 MB/s | 7.4 MB 00:00 2024-09-11T00:03:48.936 INFO:teuthology.orchestra.run.smithi078.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 3.1 MB/s | 291 kB 00:00 2024-09-11T00:03:48.982 INFO:teuthology.orchestra.run.smithi138.stdout:(5/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 2.0 MB/s | 5.5 MB 00:02 2024-09-11T00:03:49.002 INFO:teuthology.orchestra.run.smithi078.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 739 kB/s | 49 kB 00:00 2024-09-11T00:03:49.086 INFO:teuthology.orchestra.run.smithi078.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 197 kB/s | 16 kB 00:00 2024-09-11T00:03:49.170 INFO:teuthology.orchestra.run.smithi078.stdout:(35/157): ceph-volume-19.3.0-4854.g8f219c47.el9 3.3 MB/s | 285 kB 00:00 2024-09-11T00:03:49.191 INFO:teuthology.orchestra.run.smithi138.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 2.5 MB/s | 1.5 MB 00:00 2024-09-11T00:03:49.253 INFO:teuthology.orchestra.run.smithi078.stdout:(36/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 9.2 MB/s | 783 kB 00:00 2024-09-11T00:03:49.329 INFO:teuthology.orchestra.run.smithi078.stdout:(37/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 243 kB/s | 18 kB 00:00 2024-09-11T00:03:49.388 INFO:teuthology.orchestra.run.smithi112.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 1.5 MB/s | 5.5 MB 00:03 2024-09-11T00:03:49.446 INFO:teuthology.orchestra.run.smithi078.stdout:(38/157): fuse-2.9.9-16.el9.x86_64.rpm 685 kB/s | 80 kB 00:00 2024-09-11T00:03:49.563 INFO:teuthology.orchestra.run.smithi078.stdout:(39/157): libgfortran-11.5.0-2.el9.x86_64.rpm 6.7 MB/s | 801 kB 00:00 2024-09-11T00:03:49.638 INFO:teuthology.orchestra.run.smithi078.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-11T00:03:49.713 INFO:teuthology.orchestra.run.smithi078.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-11T00:03:49.797 INFO:teuthology.orchestra.run.smithi078.stdout:(42/157): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-09-11T00:03:49.930 INFO:teuthology.orchestra.run.smithi112.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 941 kB/s | 2.4 MB 00:02 2024-09-11T00:03:49.980 INFO:teuthology.orchestra.run.smithi112.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 2.6 MB/s | 1.5 MB 00:00 2024-09-11T00:03:50.075 INFO:teuthology.orchestra.run.smithi138.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 4.4 MB/s | 4.8 MB 00:01 2024-09-11T00:03:50.223 INFO:teuthology.orchestra.run.smithi078.stdout:(43/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 12 MB/s | 50 MB 00:04 2024-09-11T00:03:50.248 INFO:teuthology.orchestra.run.smithi078.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 236 kB/s | 106 kB 00:00 2024-09-11T00:03:50.323 INFO:teuthology.orchestra.run.smithi078.stdout:(45/157): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-11T00:03:50.325 INFO:teuthology.orchestra.run.smithi138.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 5.2 MB/s | 22 MB 00:04 2024-09-11T00:03:50.365 INFO:teuthology.orchestra.run.smithi078.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 953 kB/s | 135 kB 00:00 2024-09-11T00:03:50.366 INFO:teuthology.orchestra.run.smithi138.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 608 kB/s | 25 kB 00:00 2024-09-11T00:03:50.398 INFO:teuthology.orchestra.run.smithi078.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-11T00:03:50.540 INFO:teuthology.orchestra.run.smithi078.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-11T00:03:50.582 INFO:teuthology.orchestra.run.smithi078.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-11T00:03:50.624 INFO:teuthology.orchestra.run.smithi078.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-09-11T00:03:50.650 INFO:teuthology.orchestra.run.smithi078.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 324 kB/s | 22 kB 00:00 2024-09-11T00:03:50.792 INFO:teuthology.orchestra.run.smithi078.stdout:(52/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 5.5 MB/s | 14 MB 00:02 2024-09-11T00:03:50.817 INFO:teuthology.orchestra.run.smithi078.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 196 kB/s | 33 kB 00:00 2024-09-11T00:03:50.842 INFO:teuthology.orchestra.run.smithi078.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 1.4 MB/s | 313 kB 00:00 2024-09-11T00:03:50.868 INFO:teuthology.orchestra.run.smithi078.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-11T00:03:50.892 INFO:teuthology.orchestra.run.smithi078.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-11T00:03:50.918 INFO:teuthology.orchestra.run.smithi078.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-11T00:03:50.951 INFO:teuthology.orchestra.run.smithi078.stdout:(58/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-09-11T00:03:50.968 INFO:teuthology.orchestra.run.smithi078.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-11T00:03:51.010 INFO:teuthology.orchestra.run.smithi078.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-11T00:03:51.119 INFO:teuthology.orchestra.run.smithi078.stdout:(61/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.1 MB/s | 3.0 MB 00:00 2024-09-11T00:03:51.144 INFO:teuthology.orchestra.run.smithi078.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 183 kB/s | 24 kB 00:00 2024-09-11T00:03:51.169 INFO:teuthology.orchestra.run.smithi078.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-11T00:03:51.203 INFO:teuthology.orchestra.run.smithi078.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-11T00:03:51.228 INFO:teuthology.orchestra.run.smithi078.stdout:(65/157): libtool-2.4.6-46.el9.x86_64.rpm 2.2 MB/s | 581 kB 00:00 2024-09-11T00:03:51.253 INFO:teuthology.orchestra.run.smithi078.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-11T00:03:51.279 INFO:teuthology.orchestra.run.smithi078.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 510 kB/s | 38 kB 00:00 2024-09-11T00:03:51.362 INFO:teuthology.orchestra.run.smithi078.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-11T00:03:51.388 INFO:teuthology.orchestra.run.smithi112.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 3.3 MB/s | 4.8 MB 00:01 2024-09-11T00:03:51.429 INFO:teuthology.orchestra.run.smithi078.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 13 MB/s | 910 kB 00:00 2024-09-11T00:03:51.471 INFO:teuthology.orchestra.run.smithi078.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 3.2 MB/s | 137 kB 00:00 2024-09-11T00:03:51.546 INFO:teuthology.orchestra.run.smithi078.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-09-11T00:03:51.575 INFO:teuthology.orchestra.run.smithi138.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 7.3 MB/s | 11 MB 00:01 2024-09-11T00:03:51.614 INFO:teuthology.orchestra.run.smithi078.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-11T00:03:51.656 INFO:teuthology.orchestra.run.smithi078.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-09-11T00:03:51.723 INFO:teuthology.orchestra.run.smithi078.stdout:(74/157): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-11T00:03:51.751 INFO:teuthology.orchestra.run.smithi138.stdout:(11/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 6.7 MB/s | 17 MB 00:02 2024-09-11T00:03:51.764 INFO:teuthology.orchestra.run.smithi078.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-11T00:03:51.776 INFO:teuthology.orchestra.run.smithi138.stdout:(12/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 1.1 MB/s | 225 kB 00:00 2024-09-11T00:03:51.801 INFO:teuthology.orchestra.run.smithi138.stdout:(13/157): cephfs-shell-19.3.0-4854.g8f219c47.el 539 kB/s | 27 kB 00:00 2024-09-11T00:03:51.815 INFO:teuthology.orchestra.run.smithi078.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-11T00:03:51.826 INFO:teuthology.orchestra.run.smithi138.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 631 kB/s | 32 kB 00:00 2024-09-11T00:03:51.865 INFO:teuthology.orchestra.run.smithi078.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-11T00:03:51.877 INFO:teuthology.orchestra.run.smithi138.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 3.2 MB/s | 162 kB 00:00 2024-09-11T00:03:51.907 INFO:teuthology.orchestra.run.smithi078.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 615 kB/s | 26 kB 00:00 2024-09-11T00:03:51.927 INFO:teuthology.orchestra.run.smithi138.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 2.5 MB/s | 127 kB 00:00 2024-09-11T00:03:51.949 INFO:teuthology.orchestra.run.smithi078.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 460 kB/s | 19 kB 00:00 2024-09-11T00:03:51.961 INFO:teuthology.orchestra.run.smithi138.stdout:(17/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 4.6 MB/s | 755 kB 00:00 2024-09-11T00:03:52.028 INFO:teuthology.orchestra.run.smithi138.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 4.9 MB/s | 507 kB 00:00 2024-09-11T00:03:52.033 INFO:teuthology.orchestra.run.smithi078.stdout:(80/157): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-11T00:03:52.058 INFO:teuthology.orchestra.run.smithi078.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-11T00:03:52.078 INFO:teuthology.orchestra.run.smithi138.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 904 kB/s | 45 kB 00:00 2024-09-11T00:03:52.083 INFO:teuthology.orchestra.run.smithi078.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-09-11T00:03:52.134 INFO:teuthology.orchestra.run.smithi078.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-11T00:03:52.137 INFO:teuthology.orchestra.run.smithi138.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 2.4 MB/s | 143 kB 00:00 2024-09-11T00:03:52.184 INFO:teuthology.orchestra.run.smithi078.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-09-11T00:03:52.187 INFO:teuthology.orchestra.run.smithi138.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 3.1 MB/s | 161 kB 00:00 2024-09-11T00:03:52.226 INFO:teuthology.orchestra.run.smithi078.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-09-11T00:03:52.263 INFO:teuthology.orchestra.run.smithi138.stdout:(22/157): python3-rados-19.3.0-4854.g8f219c47.e 4.2 MB/s | 321 kB 00:00 2024-09-11T00:03:52.284 INFO:teuthology.orchestra.run.smithi078.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 5.1 MB 00:00 2024-09-11T00:03:52.309 INFO:teuthology.orchestra.run.smithi078.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 506 kB/s | 42 kB 00:00 2024-09-11T00:03:52.335 INFO:teuthology.orchestra.run.smithi078.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-11T00:03:52.338 INFO:teuthology.orchestra.run.smithi138.stdout:(23/157): python3-rbd-19.3.0-4854.g8f219c47.el9 4.0 MB/s | 306 kB 00:00 2024-09-11T00:03:52.360 INFO:teuthology.orchestra.run.smithi078.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-11T00:03:52.385 INFO:teuthology.orchestra.run.smithi078.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-11T00:03:52.389 INFO:teuthology.orchestra.run.smithi138.stdout:(24/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.9 MB/s | 99 kB 00:00 2024-09-11T00:03:52.411 INFO:teuthology.orchestra.run.smithi078.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-11T00:03:52.431 INFO:teuthology.orchestra.run.smithi138.stdout:(25/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 2.0 MB/s | 85 kB 00:00 2024-09-11T00:03:52.436 INFO:teuthology.orchestra.run.smithi078.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-11T00:03:52.478 INFO:teuthology.orchestra.run.smithi078.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-11T00:03:52.520 INFO:teuthology.orchestra.run.smithi078.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-11T00:03:52.570 INFO:teuthology.orchestra.run.smithi078.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-11T00:03:52.612 INFO:teuthology.orchestra.run.smithi078.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 862 kB/s | 36 kB 00:00 2024-09-11T00:03:52.654 INFO:teuthology.orchestra.run.smithi078.stdout:(97/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-11T00:03:52.656 INFO:teuthology.orchestra.run.smithi138.stdout:(26/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 7.9 MB/s | 5.5 MB 00:00 2024-09-11T00:03:52.704 INFO:teuthology.orchestra.run.smithi078.stdout:(98/157): socat-1.7.4.1-6.el9.x86_64.rpm 6.0 MB/s | 304 kB 00:00 2024-09-11T00:03:52.706 INFO:teuthology.orchestra.run.smithi138.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 3.3 MB/s | 171 kB 00:00 2024-09-11T00:03:52.738 INFO:teuthology.orchestra.run.smithi078.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 58 kB 00:00 2024-09-11T00:03:52.757 INFO:teuthology.orchestra.run.smithi138.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 687 kB/s | 34 kB 00:00 2024-09-11T00:03:52.780 INFO:teuthology.orchestra.run.smithi078.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-09-11T00:03:52.807 INFO:teuthology.orchestra.run.smithi138.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 3.0 MB/s | 154 kB 00:00 2024-09-11T00:03:52.814 INFO:teuthology.orchestra.run.smithi078.stdout:(101/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 64 kB 00:00 2024-09-11T00:03:52.847 INFO:teuthology.orchestra.run.smithi078.stdout:(102/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-09-11T00:03:52.881 INFO:teuthology.orchestra.run.smithi112.stdout:(8/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x86 5.9 MB/s | 17 MB 00:02 2024-09-11T00:03:52.882 INFO:teuthology.orchestra.run.smithi138.stdout:(30/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 7.0 MB/s | 3.2 MB 00:00 2024-09-11T00:03:52.914 INFO:teuthology.orchestra.run.smithi078.stdout:(103/157): lua-devel-5.4.4-4.el9.x86_64.rpm 335 kB/s | 22 kB 00:00 2024-09-11T00:03:53.015 INFO:teuthology.orchestra.run.smithi078.stdout:(104/157): protobuf-compiler-3.14.0-13.el9.x86_ 8.4 MB/s | 863 kB 00:00 2024-09-11T00:03:53.089 INFO:teuthology.orchestra.run.smithi112.stdout:(9/157): ceph-common-19.3.0-4854.g8f219c47.el9. 2.9 MB/s | 22 MB 00:07 2024-09-11T00:03:53.123 INFO:teuthology.orchestra.run.smithi112.stdout:(10/157): ceph-selinux-19.3.0-4854.g8f219c47.el 104 kB/s | 25 kB 00:00 2024-09-11T00:03:53.215 INFO:teuthology.orchestra.run.smithi112.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 2.4 MB/s | 225 kB 00:00 2024-09-11T00:03:53.215 INFO:teuthology.orchestra.run.smithi078.stdout:(105/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-09-11T00:03:53.249 INFO:teuthology.orchestra.run.smithi078.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 2.3 MB/s | 548 kB 00:00 2024-09-11T00:03:53.256 INFO:teuthology.orchestra.run.smithi112.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 653 kB/s | 27 kB 00:00 2024-09-11T00:03:53.274 INFO:teuthology.orchestra.run.smithi078.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 839 kB/s | 19 kB 00:00 2024-09-11T00:03:53.307 INFO:teuthology.orchestra.run.smithi112.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 635 kB/s | 32 kB 00:00 2024-09-11T00:03:53.307 INFO:teuthology.orchestra.run.smithi078.stdout:(108/157): gperftools-libs-2.9.1-2.el9.x86_64.r 3.3 MB/s | 309 kB 00:00 2024-09-11T00:03:53.333 INFO:teuthology.orchestra.run.smithi078.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-11T00:03:53.400 INFO:teuthology.orchestra.run.smithi078.stdout:(110/157): openblas-openmp-0.3.26-2.el9.x86_64. 2.3 MB/s | 4.9 MB 00:02 2024-09-11T00:03:53.425 INFO:teuthology.orchestra.run.smithi078.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 528 kB/s | 49 kB 00:00 2024-09-11T00:03:53.432 INFO:teuthology.orchestra.run.smithi112.stdout:(14/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 5.9 MB/s | 755 kB 00:00 2024-09-11T00:03:53.467 INFO:teuthology.orchestra.run.smithi078.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.3 MB/s | 151 kB 00:00 2024-09-11T00:03:53.482 INFO:teuthology.orchestra.run.smithi112.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 3.2 MB/s | 162 kB 00:00 2024-09-11T00:03:53.500 INFO:teuthology.orchestra.run.smithi078.stdout:(113/157): libunwind-1.6.2-1.el9.x86_64.rpm 671 kB/s | 67 kB 00:00 2024-09-11T00:03:53.533 INFO:teuthology.orchestra.run.smithi112.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 2.5 MB/s | 127 kB 00:00 2024-09-11T00:03:53.559 INFO:teuthology.orchestra.run.smithi078.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.1 MB/s | 839 kB 00:00 2024-09-11T00:03:53.626 INFO:teuthology.orchestra.run.smithi078.stdout:(115/157): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-11T00:03:53.650 INFO:teuthology.orchestra.run.smithi112.stdout:(17/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 4.8 MB/s | 11 MB 00:02 2024-09-11T00:03:53.651 INFO:teuthology.orchestra.run.smithi078.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 473 kB/s | 43 kB 00:00 2024-09-11T00:03:53.676 INFO:teuthology.orchestra.run.smithi078.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-11T00:03:53.700 INFO:teuthology.orchestra.run.smithi112.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 3.0 MB/s | 507 kB 00:00 2024-09-11T00:03:53.701 INFO:teuthology.orchestra.run.smithi078.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-11T00:03:53.727 INFO:teuthology.orchestra.run.smithi078.stdout:(119/157): python3-asyncssh-2.13.2-5.el9.noarch 2.4 MB/s | 548 kB 00:00 2024-09-11T00:03:53.750 INFO:teuthology.orchestra.run.smithi112.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 904 kB/s | 45 kB 00:00 2024-09-11T00:03:53.752 INFO:teuthology.orchestra.run.smithi078.stdout:(120/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-09-11T00:03:53.760 INFO:teuthology.orchestra.run.smithi138.stdout:(31/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 15 MB/s | 50 MB 00:03 2024-09-11T00:03:53.777 INFO:teuthology.orchestra.run.smithi078.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-09-11T00:03:53.800 INFO:teuthology.orchestra.run.smithi112.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 2.8 MB/s | 143 kB 00:00 2024-09-11T00:03:53.803 INFO:teuthology.orchestra.run.smithi078.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-11T00:03:53.828 INFO:teuthology.orchestra.run.smithi078.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.9 MB/s | 220 kB 00:00 2024-09-11T00:03:53.833 INFO:teuthology.orchestra.run.smithi138.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 3.8 MB/s | 291 kB 00:00 2024-09-11T00:03:53.851 INFO:teuthology.orchestra.run.smithi112.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 3.2 MB/s | 161 kB 00:00 2024-09-11T00:03:53.853 INFO:teuthology.orchestra.run.smithi078.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-11T00:03:53.878 INFO:teuthology.orchestra.run.smithi078.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-11T00:03:53.883 INFO:teuthology.orchestra.run.smithi138.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 988 kB/s | 49 kB 00:00 2024-09-11T00:03:53.904 INFO:teuthology.orchestra.run.smithi078.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-11T00:03:53.917 INFO:teuthology.orchestra.run.smithi112.stdout:(22/157): python3-rados-19.3.0-4854.g8f219c47.e 4.7 MB/s | 321 kB 00:00 2024-09-11T00:03:53.937 INFO:teuthology.orchestra.run.smithi078.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 395 kB/s | 23 kB 00:00 2024-09-11T00:03:53.962 INFO:teuthology.orchestra.run.smithi078.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 332 kB/s | 19 kB 00:00 2024-09-11T00:03:53.984 INFO:teuthology.orchestra.run.smithi138.stdout:(34/157): ceph-mgr-diskprediction-local-19.3.0- 6.7 MB/s | 7.4 MB 00:01 2024-09-11T00:03:53.984 INFO:teuthology.orchestra.run.smithi112.stdout:(23/157): python3-rbd-19.3.0-4854.g8f219c47.el9 4.5 MB/s | 306 kB 00:00 2024-09-11T00:03:53.988 INFO:teuthology.orchestra.run.smithi078.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-11T00:03:54.001 INFO:teuthology.orchestra.run.smithi138.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 141 kB/s | 16 kB 00:00 2024-09-11T00:03:54.013 INFO:teuthology.orchestra.run.smithi078.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T00:03:54.035 INFO:teuthology.orchestra.run.smithi112.stdout:(24/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.9 MB/s | 99 kB 00:00 2024-09-11T00:03:54.038 INFO:teuthology.orchestra.run.smithi078.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T00:03:54.051 INFO:teuthology.orchestra.run.smithi138.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 4.2 MB/s | 285 kB 00:00 2024-09-11T00:03:54.064 INFO:teuthology.orchestra.run.smithi078.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-11T00:03:54.085 INFO:teuthology.orchestra.run.smithi112.stdout:(25/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-11T00:03:54.093 INFO:teuthology.orchestra.run.smithi138.stdout:(37/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 8.3 MB/s | 783 kB 00:00 2024-09-11T00:03:54.110 INFO:teuthology.orchestra.run.smithi138.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 312 kB/s | 18 kB 00:00 2024-09-11T00:03:54.114 INFO:teuthology.orchestra.run.smithi078.stdout:(133/157): python3-grpcio-1.46.7-10.el9.x86_64. 6.1 MB/s | 2.0 MB 00:00 2024-09-11T00:03:54.139 INFO:teuthology.orchestra.run.smithi078.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-11T00:03:54.165 INFO:teuthology.orchestra.run.smithi078.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-11T00:03:54.198 INFO:teuthology.orchestra.run.smithi078.stdout:(136/157): python3-kubernetes-26.1.0-2.el9.noar 4.3 MB/s | 1.0 MB 00:00 2024-09-11T00:03:54.202 INFO:teuthology.orchestra.run.smithi138.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 735 kB/s | 80 kB 00:00 2024-09-11T00:03:54.224 INFO:teuthology.orchestra.run.smithi078.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 482 kB/s | 28 kB 00:00 2024-09-11T00:03:54.249 INFO:teuthology.orchestra.run.smithi078.stdout:(138/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 824 kB/s | 90 kB 00:00 2024-09-11T00:03:54.261 INFO:teuthology.orchestra.run.smithi138.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-11T00:03:54.266 INFO:teuthology.orchestra.run.smithi078.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 458 kB/s | 31 kB 00:00 2024-09-11T00:03:54.291 INFO:teuthology.orchestra.run.smithi078.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-09-11T00:03:54.294 INFO:teuthology.orchestra.run.smithi138.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-11T00:03:54.308 INFO:teuthology.orchestra.run.smithi078.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 855 kB/s | 36 kB 00:00 2024-09-11T00:03:54.319 INFO:teuthology.orchestra.run.smithi138.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-11T00:03:54.333 INFO:teuthology.orchestra.run.smithi078.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-11T00:03:54.359 INFO:teuthology.orchestra.run.smithi078.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-11T00:03:54.362 INFO:teuthology.orchestra.run.smithi138.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-11T00:03:54.384 INFO:teuthology.orchestra.run.smithi078.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-11T00:03:54.409 INFO:teuthology.orchestra.run.smithi078.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-11T00:03:54.412 INFO:teuthology.orchestra.run.smithi138.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-11T00:03:54.434 INFO:teuthology.orchestra.run.smithi078.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-11T00:03:54.437 INFO:teuthology.orchestra.run.smithi138.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-11T00:03:54.459 INFO:teuthology.orchestra.run.smithi078.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-11T00:03:54.463 INFO:teuthology.orchestra.run.smithi138.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-11T00:03:54.485 INFO:teuthology.orchestra.run.smithi078.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-11T00:03:54.485 INFO:teuthology.orchestra.run.smithi112.stdout:(26/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 6.6 MB/s | 5.5 MB 00:00 2024-09-11T00:03:54.497 INFO:teuthology.orchestra.run.smithi138.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-11T00:03:54.535 INFO:teuthology.orchestra.run.smithi078.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T00:03:54.536 INFO:teuthology.orchestra.run.smithi112.stdout:(27/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 7.1 MB/s | 3.2 MB 00:00 2024-09-11T00:03:54.561 INFO:teuthology.orchestra.run.smithi112.stdout:(28/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 2.2 MB/s | 171 kB 00:00 2024-09-11T00:03:54.578 INFO:teuthology.orchestra.run.smithi112.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4854.g 821 kB/s | 34 kB 00:00 2024-09-11T00:03:54.611 INFO:teuthology.orchestra.run.smithi112.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 3.0 MB/s | 154 kB 00:00 2024-09-11T00:03:54.656 INFO:teuthology.orchestra.run.smithi138.stdout:(48/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 7.7 MB/s | 14 MB 00:01 2024-09-11T00:03:54.660 INFO:teuthology.orchestra.run.smithi078.stdout:(150/157): NetworkManager-1.49.90-1.el9.x86_64. 19 MB/s | 2.3 MB 00:00 2024-09-11T00:03:54.761 INFO:teuthology.orchestra.run.smithi078.stdout:(151/157): NetworkManager-libnm-1.49.90-1.el9.x 18 MB/s | 1.8 MB 00:00 2024-09-11T00:03:54.819 INFO:teuthology.orchestra.run.smithi078.stdout:(152/157): librados2-19.3.0-4854.g8f219c47.el9. 9.6 MB/s | 3.5 MB 00:00 2024-09-11T00:03:54.844 INFO:teuthology.orchestra.run.smithi078.stdout:(153/157): NetworkManager-team-1.49.90-1.el9.x8 489 kB/s | 41 kB 00:00 2024-09-11T00:03:54.911 INFO:teuthology.orchestra.run.smithi078.stdout:(154/157): NetworkManager-tui-1.49.90-1.el9.x86 2.7 MB/s | 249 kB 00:00 2024-09-11T00:03:54.953 INFO:teuthology.orchestra.run.smithi078.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-11T00:03:55.029 INFO:teuthology.orchestra.run.smithi078.stdout:(156/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 6.0 MB/s | 3.2 MB 00:00 2024-09-11T00:03:55.079 INFO:teuthology.orchestra.run.smithi078.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-09-11T00:03:55.085 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-11T00:03:55.085 INFO:teuthology.orchestra.run.smithi078.stdout:Total 20 MB/s | 240 MB 00:11 2024-09-11T00:03:55.122 INFO:teuthology.orchestra.run.smithi138.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 229 kB/s | 107 kB 00:00 2024-09-11T00:03:55.231 INFO:teuthology.orchestra.run.smithi138.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-11T00:03:55.381 INFO:teuthology.orchestra.run.smithi138.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 751 kB/s | 689 kB 00:00 2024-09-11T00:03:55.424 INFO:teuthology.orchestra.run.smithi138.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-11T00:03:55.490 INFO:teuthology.orchestra.run.smithi138.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 300 kB/s | 33 kB 00:00 2024-09-11T00:03:55.528 INFO:teuthology.orchestra.run.smithi112.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 8.1 MB/s | 7.4 MB 00:00 2024-09-11T00:03:55.607 INFO:teuthology.orchestra.run.smithi138.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 156 kB/s | 18 kB 00:00 2024-09-11T00:03:55.612 INFO:teuthology.orchestra.run.smithi112.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 3.4 MB/s | 291 kB 00:00 2024-09-11T00:03:55.633 INFO:teuthology.orchestra.run.smithi138.stdout:(55/157): flex-2.6.4-9.el9.x86_64.rpm 781 kB/s | 313 kB 00:00 2024-09-11T00:03:55.654 INFO:teuthology.orchestra.run.smithi112.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 1.2 MB/s | 49 kB 00:00 2024-09-11T00:03:55.696 INFO:teuthology.orchestra.run.smithi112.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 397 kB/s | 16 kB 00:00 2024-09-11T00:03:55.733 INFO:teuthology.orchestra.run.smithi138.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 89 kB/s | 11 kB 00:00 2024-09-11T00:03:55.758 INFO:teuthology.orchestra.run.smithi138.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.3 MB/s | 171 kB 00:00 2024-09-11T00:03:55.763 INFO:teuthology.orchestra.run.smithi112.stdout:(35/157): ceph-volume-19.3.0-4854.g8f219c47.el9 4.2 MB/s | 285 kB 00:00 2024-09-11T00:03:55.850 INFO:teuthology.orchestra.run.smithi138.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-11T00:03:55.875 INFO:teuthology.orchestra.run.smithi138.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 386 kB/s | 45 kB 00:00 2024-09-11T00:03:55.879 INFO:teuthology.orchestra.run.smithi112.stdout:(36/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 6.6 MB/s | 783 kB 00:00 2024-09-11T00:03:55.930 INFO:teuthology.orchestra.run.smithi112.stdout:(37/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 364 kB/s | 18 kB 00:00 2024-09-11T00:03:55.942 INFO:teuthology.orchestra.run.smithi138.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.8 MB/s | 3.0 MB 00:00 2024-09-11T00:03:56.060 INFO:teuthology.orchestra.run.smithi138.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 209 kB/s | 24 kB 00:00 2024-09-11T00:03:56.085 INFO:teuthology.orchestra.run.smithi138.stdout:(62/157): libtool-2.4.6-46.el9.x86_64.rpm 2.7 MB/s | 581 kB 00:00 2024-09-11T00:03:56.144 INFO:teuthology.orchestra.run.smithi138.stdout:(63/157): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-09-11T00:03:56.164 INFO:teuthology.orchestra.run.smithi112.stdout:(38/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 8.9 MB/s | 14 MB 00:01 2024-09-11T00:03:56.170 INFO:teuthology.orchestra.run.smithi138.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-09-11T00:03:56.215 INFO:teuthology.orchestra.run.smithi112.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 281 kB/s | 80 kB 00:00 2024-09-11T00:03:56.219 INFO:teuthology.orchestra.run.smithi138.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-11T00:03:56.253 INFO:teuthology.orchestra.run.smithi138.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-11T00:03:56.278 INFO:teuthology.orchestra.run.smithi138.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 352 kB/s | 38 kB 00:00 2024-09-11T00:03:56.298 INFO:teuthology.orchestra.run.smithi112.stdout:(40/157): libgfortran-11.5.0-2.el9.x86_64.rpm 5.9 MB/s | 801 kB 00:00 2024-09-11T00:03:56.330 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-11T00:03:56.339 INFO:teuthology.orchestra.run.smithi112.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.0 MB/s | 253 kB 00:00 2024-09-11T00:03:56.365 INFO:teuthology.orchestra.run.smithi112.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-11T00:03:56.415 INFO:teuthology.orchestra.run.smithi112.stdout:(43/157): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-09-11T00:03:56.420 INFO:teuthology.orchestra.run.smithi138.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-11T00:03:56.440 INFO:teuthology.orchestra.run.smithi112.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-11T00:03:56.466 INFO:teuthology.orchestra.run.smithi112.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-11T00:03:56.483 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-11T00:03:56.483 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-11T00:03:56.491 INFO:teuthology.orchestra.run.smithi112.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-11T00:03:56.525 INFO:teuthology.orchestra.run.smithi112.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-11T00:03:56.554 INFO:teuthology.orchestra.run.smithi138.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 6.7 MB/s | 910 kB 00:00 2024-09-11T00:03:56.629 INFO:teuthology.orchestra.run.smithi138.stdout:(70/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-11T00:03:56.663 INFO:teuthology.orchestra.run.smithi138.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-11T00:03:56.797 INFO:teuthology.orchestra.run.smithi138.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-09-11T00:03:56.864 INFO:teuthology.orchestra.run.smithi138.stdout:(73/157): openblas-openmp-0.3.26-2.el9.x86_64.r 7.7 MB/s | 4.9 MB 00:00 2024-09-11T00:03:56.947 INFO:teuthology.orchestra.run.smithi138.stdout:(74/157): postgresql-server-13.16-1.el9.x86_64. 18 MB/s | 5.8 MB 00:00 2024-09-11T00:03:56.973 INFO:teuthology.orchestra.run.smithi138.stdout:(75/157): python3-attrs-20.3.0-7.el9.noarch.rpm 498 kB/s | 87 kB 00:00 2024-09-11T00:03:57.056 INFO:teuthology.orchestra.run.smithi138.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 563 kB/s | 61 kB 00:00 2024-09-11T00:03:57.094 INFO:teuthology.orchestra.run.smithi138.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-11T00:03:57.169 INFO:teuthology.orchestra.run.smithi138.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-09-11T00:03:57.175 INFO:teuthology.orchestra.run.smithi112.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 1.0 MB/s | 689 kB 00:00 2024-09-11T00:03:57.203 INFO:teuthology.orchestra.run.smithi138.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-09-11T00:03:57.208 INFO:teuthology.orchestra.run.smithi112.stdout:(49/157): bison-3.7.4-5.el9.x86_64.rpm 1.3 MB/s | 943 kB 00:00 2024-09-11T00:03:57.278 INFO:teuthology.orchestra.run.smithi138.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-09-11T00:03:57.312 INFO:teuthology.orchestra.run.smithi138.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-11T00:03:57.387 INFO:teuthology.orchestra.run.smithi138.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 319 kB/s | 35 kB 00:00 2024-09-11T00:03:57.467 INFO:teuthology.orchestra.run.smithi112.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 84 kB/s | 22 kB 00:00 2024-09-11T00:03:57.471 INFO:teuthology.orchestra.run.smithi138.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 9.8 MB/s | 6.0 MB 00:00 2024-09-11T00:03:57.505 INFO:teuthology.orchestra.run.smithi138.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-11T00:03:57.584 INFO:teuthology.orchestra.run.smithi112.stdout:(51/157): boost-program-options-1.75.0-8.el9.x8 262 kB/s | 107 kB 00:00 2024-09-11T00:03:57.597 INFO:teuthology.orchestra.run.smithi138.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.7 MB/s | 222 kB 00:00 2024-09-11T00:03:57.614 INFO:teuthology.orchestra.run.smithi138.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 709 kB/s | 77 kB 00:00 2024-09-11T00:03:57.689 INFO:teuthology.orchestra.run.smithi138.stdout:(87/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-11T00:03:57.706 INFO:teuthology.orchestra.run.smithi138.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 387 kB/s | 42 kB 00:00 2024-09-11T00:03:57.733 INFO:teuthology.orchestra.run.smithi138.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 2.2 MB/s | 269 kB 00:00 2024-09-11T00:03:57.791 INFO:teuthology.orchestra.run.smithi138.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-09-11T00:03:57.851 INFO:teuthology.orchestra.run.smithi112.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 123 kB/s | 33 kB 00:00 2024-09-11T00:03:57.907 INFO:teuthology.orchestra.run.smithi138.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 1.4 MB/s | 279 kB 00:00 2024-09-11T00:03:57.933 INFO:teuthology.orchestra.run.smithi138.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 253 kB/s | 51 kB 00:00 2024-09-11T00:03:57.958 INFO:teuthology.orchestra.run.smithi138.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 320 kB/s | 54 kB 00:00 2024-09-11T00:03:58.051 INFO:teuthology.orchestra.run.smithi112.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 537 kB/s | 313 kB 00:00 2024-09-11T00:03:58.067 INFO:teuthology.orchestra.run.smithi138.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-11T00:03:58.092 INFO:teuthology.orchestra.run.smithi138.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 331 kB/s | 44 kB 00:00 2024-09-11T00:03:58.184 INFO:teuthology.orchestra.run.smithi138.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-11T00:03:58.209 INFO:teuthology.orchestra.run.smithi138.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 306 kB/s | 36 kB 00:00 2024-09-11T00:03:58.310 INFO:teuthology.orchestra.run.smithi138.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 378 kB/s | 47 kB 00:00 2024-09-11T00:03:58.335 INFO:teuthology.orchestra.run.smithi138.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-11T00:03:58.395 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-11T00:03:58.396 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-11T00:03:58.419 INFO:teuthology.orchestra.run.smithi138.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 533 kB/s | 58 kB 00:00 2024-09-11T00:03:58.444 INFO:teuthology.orchestra.run.smithi138.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 881 kB/s | 96 kB 00:00 2024-09-11T00:03:58.568 INFO:teuthology.orchestra.run.smithi112.stdout:(54/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 9.2 MB/s | 50 MB 00:05 2024-09-11T00:03:58.611 INFO:teuthology.orchestra.run.smithi138.stdout:(102/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-09-11T00:03:58.636 INFO:teuthology.orchestra.run.smithi138.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 233 kB/s | 45 kB 00:00 2024-09-11T00:03:58.661 INFO:teuthology.orchestra.run.smithi138.stdout:(104/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 262 kB/s | 64 kB 00:00 2024-09-11T00:03:58.712 INFO:teuthology.orchestra.run.smithi138.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-11T00:03:58.737 INFO:teuthology.orchestra.run.smithi138.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-09-11T00:03:58.752 INFO:teuthology.orchestra.run.smithi112.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 26 kB/s | 18 kB 00:00 2024-09-11T00:03:58.763 INFO:teuthology.orchestra.run.smithi138.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 771 kB/s | 19 kB 00:00 2024-09-11T00:03:58.777 INFO:teuthology.orchestra.run.smithi112.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 53 kB/s | 11 kB 00:00 2024-09-11T00:03:58.880 INFO:teuthology.orchestra.run.smithi138.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-11T00:03:58.922 INFO:teuthology.orchestra.run.smithi138.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 930 kB/s | 26 kB 00:00 2024-09-11T00:03:58.947 INFO:teuthology.orchestra.run.smithi138.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-11T00:03:58.972 INFO:teuthology.orchestra.run.smithi138.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-11T00:03:58.998 INFO:teuthology.orchestra.run.smithi138.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 6.2 MB/s | 151 kB 00:00 2024-09-11T00:03:59.031 INFO:teuthology.orchestra.run.smithi138.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 24 MB/s | 839 kB 00:00 2024-09-11T00:03:59.073 INFO:teuthology.orchestra.run.smithi138.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-11T00:03:59.099 INFO:teuthology.orchestra.run.smithi138.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T00:03:59.124 INFO:teuthology.orchestra.run.smithi138.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-11T00:03:59.149 INFO:teuthology.orchestra.run.smithi138.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-11T00:03:59.177 INFO:teuthology.orchestra.run.smithi112.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.3 MB/s | 3.0 MB 00:01 2024-09-11T00:03:59.183 INFO:teuthology.orchestra.run.smithi138.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-11T00:03:59.217 INFO:teuthology.orchestra.run.smithi138.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-11T00:03:59.242 INFO:teuthology.orchestra.run.smithi138.stdout:(120/157): lua-devel-5.4.4-4.el9.x86_64.rpm 35 kB/s | 22 kB 00:00 2024-09-11T00:03:59.244 INFO:teuthology.orchestra.run.smithi112.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 347 kB/s | 171 kB 00:00 2024-09-11T00:03:59.276 INFO:teuthology.orchestra.run.smithi138.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-11T00:03:59.278 INFO:teuthology.orchestra.run.smithi112.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 320 kB/s | 160 kB 00:00 2024-09-11T00:03:59.326 INFO:teuthology.orchestra.run.smithi138.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-11T00:03:59.360 INFO:teuthology.orchestra.run.smithi138.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-11T00:03:59.402 INFO:teuthology.orchestra.run.smithi138.stdout:(124/157): python3-grpcio-1.46.7-10.el9.x86_64. 16 MB/s | 2.0 MB 00:00 2024-09-11T00:03:59.427 INFO:teuthology.orchestra.run.smithi138.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 159 kB/s | 11 kB 00:00 2024-09-11T00:03:59.453 INFO:teuthology.orchestra.run.smithi138.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 350 kB/s | 18 kB 00:00 2024-09-11T00:03:59.478 INFO:teuthology.orchestra.run.smithi138.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-09-11T00:03:59.503 INFO:teuthology.orchestra.run.smithi138.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-11T00:03:59.529 INFO:teuthology.orchestra.run.smithi138.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-11T00:03:59.553 INFO:teuthology.orchestra.run.smithi112.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 120 kB/s | 45 kB 00:00 2024-09-11T00:03:59.554 INFO:teuthology.orchestra.run.smithi138.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T00:03:59.579 INFO:teuthology.orchestra.run.smithi138.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T00:03:59.605 INFO:teuthology.orchestra.run.smithi138.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-09-11T00:03:59.647 INFO:teuthology.orchestra.run.smithi138.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 7.1 MB/s | 1.0 MB 00:00 2024-09-11T00:03:59.672 INFO:teuthology.orchestra.run.smithi138.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-09-11T00:03:59.698 INFO:teuthology.orchestra.run.smithi138.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 655 kB/s | 16 kB 00:00 2024-09-11T00:03:59.723 INFO:teuthology.orchestra.run.smithi138.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-11T00:03:59.748 INFO:teuthology.orchestra.run.smithi138.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-11T00:03:59.773 INFO:teuthology.orchestra.run.smithi138.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 609 kB/s | 31 kB 00:00 2024-09-11T00:03:59.799 INFO:teuthology.orchestra.run.smithi138.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-11T00:03:59.820 INFO:teuthology.orchestra.run.smithi112.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 92 kB/s | 24 kB 00:00 2024-09-11T00:03:59.824 INFO:teuthology.orchestra.run.smithi138.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-11T00:03:59.845 INFO:teuthology.orchestra.run.smithi112.stdout:(62/157): librdkafka-1.6.1-102.el9.x86_64.rpm 1.1 MB/s | 662 kB 00:00 2024-09-11T00:03:59.850 INFO:teuthology.orchestra.run.smithi138.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 709 kB/s | 36 kB 00:00 2024-09-11T00:03:59.870 INFO:teuthology.orchestra.run.smithi112.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 981 kB/s | 581 kB 00:00 2024-09-11T00:03:59.892 INFO:teuthology.orchestra.run.smithi138.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-11T00:03:59.917 INFO:teuthology.orchestra.run.smithi138.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-11T00:03:59.942 INFO:teuthology.orchestra.run.smithi138.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-11T00:03:59.968 INFO:teuthology.orchestra.run.smithi138.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 806 kB/s | 20 kB 00:00 2024-09-11T00:03:59.993 INFO:teuthology.orchestra.run.smithi138.stdout:(146/157): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-11T00:04:00.027 INFO:teuthology.orchestra.run.smithi138.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-11T00:04:00.094 INFO:teuthology.orchestra.run.smithi138.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T00:04:00.144 INFO:teuthology.orchestra.run.smithi138.stdout:(149/157): protobuf-compiler-3.14.0-13.el9.x86_ 573 kB/s | 863 kB 00:01 2024-09-11T00:04:00.179 INFO:teuthology.orchestra.run.smithi112.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 132 kB/s | 47 kB 00:00 2024-09-11T00:04:00.437 INFO:teuthology.orchestra.run.smithi112.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 494 kB/s | 292 kB 00:00 2024-09-11T00:04:00.444 INFO:teuthology.orchestra.run.smithi138.stdout:(150/157): librados2-19.3.0-4854.g8f219c47.el9. 8.3 MB/s | 3.5 MB 00:00 2024-09-11T00:04:00.463 INFO:teuthology.orchestra.run.smithi112.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 318 kB/s | 188 kB 00:00 2024-09-11T00:04:00.487 INFO:teuthology.orchestra.run.smithi112.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 125 kB/s | 38 kB 00:00 2024-09-11T00:04:00.561 INFO:teuthology.orchestra.run.smithi138.stdout:(151/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 6.9 MB/s | 3.2 MB 00:00 2024-09-11T00:04:00.637 INFO:teuthology.orchestra.run.smithi138.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 545 kB/s | 41 kB 00:00 2024-09-11T00:04:00.721 INFO:teuthology.orchestra.run.smithi138.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 2.9 MB/s | 249 kB 00:00 2024-09-11T00:04:00.763 INFO:teuthology.orchestra.run.smithi138.stdout:(154/157): NetworkManager-1.49.90-1.el9.x86_64. 3.8 MB/s | 2.3 MB 00:00 2024-09-11T00:04:00.846 INFO:teuthology.orchestra.run.smithi138.stdout:(155/157): NetworkManager-libnm-1.49.90-1.el9.x 4.5 MB/s | 1.8 MB 00:00 2024-09-11T00:04:01.005 INFO:teuthology.orchestra.run.smithi138.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 4.8 MB/s | 1.4 MB 00:00 2024-09-11T00:04:01.246 INFO:teuthology.orchestra.run.smithi112.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 2.1 MB/s | 1.6 MB 00:00 2024-09-11T00:04:01.388 INFO:teuthology.orchestra.run.smithi112.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.9 MB/s | 4.4 MB 00:00 2024-09-11T00:04:01.455 INFO:teuthology.orchestra.run.smithi112.stdout:(70/157): openblas-openmp-0.3.26-2.el9.x86_64.r 4.9 MB/s | 4.9 MB 00:01 2024-09-11T00:04:01.463 INFO:teuthology.orchestra.run.smithi138.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.4 MB/s | 2.4 MB 00:00 2024-09-11T00:04:01.469 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-11T00:04:01.469 INFO:teuthology.orchestra.run.smithi138.stdout:Total 15 MB/s | 240 MB 00:16 2024-09-11T00:04:01.805 INFO:teuthology.orchestra.run.smithi112.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 329 kB/s | 137 kB 00:00 2024-09-11T00:04:02.030 INFO:teuthology.orchestra.run.smithi112.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 1.1 MB/s | 910 kB 00:00 2024-09-11T00:04:02.406 INFO:teuthology.orchestra.run.smithi112.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 6.1 MB/s | 5.8 MB 00:00 2024-09-11T00:04:02.431 INFO:teuthology.orchestra.run.smithi112.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 218 kB/s | 87 kB 00:00 2024-09-11T00:04:02.531 INFO:teuthology.orchestra.run.smithi112.stdout:(75/157): protobuf-3.14.0-13.el9.x86_64.rpm 1.4 MB/s | 1.0 MB 00:00 2024-09-11T00:04:02.714 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-11T00:04:02.798 INFO:teuthology.orchestra.run.smithi112.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 167 kB/s | 61 kB 00:00 2024-09-11T00:04:02.867 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-11T00:04:02.867 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-11T00:04:03.040 INFO:teuthology.orchestra.run.smithi112.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 481 kB/s | 245 kB 00:00 2024-09-11T00:04:03.307 INFO:teuthology.orchestra.run.smithi112.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 488 kB/s | 248 kB 00:00 2024-09-11T00:04:03.332 INFO:teuthology.orchestra.run.smithi112.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 88 kB/s | 26 kB 00:00 2024-09-11T00:04:03.699 INFO:teuthology.orchestra.run.smithi112.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 49 kB/s | 19 kB 00:00 2024-09-11T00:04:03.758 INFO:teuthology.orchestra.run.smithi112.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 405 kB/s | 172 kB 00:00 2024-09-11T00:04:03.975 INFO:teuthology.orchestra.run.smithi112.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 126 kB/s | 35 kB 00:00 2024-09-11T00:04:04.475 INFO:teuthology.orchestra.run.smithi112.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 501 kB/s | 250 kB 00:00 2024-09-11T00:04:04.709 INFO:teuthology.orchestra.run.smithi112.stdout:(84/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.4 MB/s | 5.1 MB 00:00 2024-09-11T00:04:04.719 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-11T00:04:04.752 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-11T00:04:04.754 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-11T00:04:04.858 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-11T00:04:04.904 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-11T00:04:04.958 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-11T00:04:04.975 INFO:teuthology.orchestra.run.smithi112.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 444 kB/s | 222 kB 00:00 2024-09-11T00:04:04.991 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-11T00:04:05.028 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-11T00:04:05.091 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-11T00:04:05.125 INFO:teuthology.orchestra.run.smithi112.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 185 kB/s | 77 kB 00:00 2024-09-11T00:04:05.318 INFO:teuthology.orchestra.run.smithi112.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 124 kB/s | 42 kB 00:00 2024-09-11T00:04:05.465 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-11T00:04:05.468 INFO:teuthology.orchestra.run.smithi112.stdout:(88/157): python3-babel-2.9.1-2.el9.noarch.rpm 1.9 MB/s | 6.0 MB 00:03 2024-09-11T00:04:05.577 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:04:05.635 INFO:teuthology.orchestra.run.smithi112.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 529 kB/s | 269 kB 00:00 2024-09-11T00:04:05.698 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:04:05.728 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:04:05.819 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:04:05.855 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:04:05.885 INFO:teuthology.orchestra.run.smithi112.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 280 kB/s | 159 kB 00:00 2024-09-11T00:04:05.904 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-11T00:04:05.977 INFO:teuthology.orchestra.run.smithi112.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 149 kB/s | 51 kB 00:00 2024-09-11T00:04:06.092 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-11T00:04:06.094 INFO:teuthology.orchestra.run.smithi112.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 446 kB/s | 279 kB 00:00 2024-09-11T00:04:06.160 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-11T00:04:06.191 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:04:06.244 INFO:teuthology.orchestra.run.smithi112.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 149 kB/s | 54 kB 00:00 2024-09-11T00:04:06.278 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:04:06.300 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:04:06.363 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:04:06.369 INFO:teuthology.orchestra.run.smithi112.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 151 kB/s | 42 kB 00:00 2024-09-11T00:04:06.393 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:04:06.413 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:04:06.580 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:04:06.603 INFO:teuthology.orchestra.run.smithi112.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 123 kB/s | 44 kB 00:00 2024-09-11T00:04:06.767 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:04:06.870 INFO:teuthology.orchestra.run.smithi112.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 135 kB/s | 36 kB 00:00 2024-09-11T00:04:06.895 INFO:teuthology.orchestra.run.smithi112.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 420 kB/s | 221 kB 00:00 2024-09-11T00:04:06.910 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-11T00:04:07.013 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:04:07.119 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:04:07.212 INFO:teuthology.orchestra.run.smithi112.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 139 kB/s | 47 kB 00:00 2024-09-11T00:04:07.338 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:04:07.445 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-11T00:04:07.470 INFO:teuthology.orchestra.run.smithi112.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 529 kB/s | 304 kB 00:00 2024-09-11T00:04:07.473 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-11T00:04:07.508 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-11T00:04:07.580 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-11T00:04:07.633 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-11T00:04:07.666 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-11T00:04:07.709 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-11T00:04:07.742 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-11T00:04:07.769 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-11T00:04:07.838 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-11T00:04:07.897 INFO:teuthology.orchestra.run.smithi112.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 225 kB/s | 96 kB 00:00 2024-09-11T00:04:07.899 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-11T00:04:07.931 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-11T00:04:07.954 INFO:teuthology.orchestra.run.smithi112.stdout:(101/157): uuid-1.6.2-55.el9.x86_64.rpm 78 kB/s | 58 kB 00:00 2024-09-11T00:04:07.974 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-11T00:04:08.063 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-11T00:04:08.093 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-11T00:04:08.136 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-11T00:04:08.165 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-11T00:04:08.236 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-11T00:04:08.297 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-11T00:04:08.346 INFO:teuthology.orchestra.run.smithi112.stdout:(102/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 114 kB/s | 45 kB 00:00 2024-09-11T00:04:08.371 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-11T00:04:08.372 INFO:teuthology.orchestra.run.smithi112.stdout:(103/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 134 kB/s | 64 kB 00:00 2024-09-11T00:04:08.502 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-11T00:04:08.557 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-11T00:04:08.939 INFO:teuthology.orchestra.run.smithi112.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 38 kB/s | 22 kB 00:00 2024-09-11T00:04:08.997 INFO:teuthology.orchestra.run.smithi112.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.3 MB/s | 548 kB 00:00 2024-09-11T00:04:09.031 INFO:teuthology.orchestra.run.smithi112.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-11T00:04:09.056 INFO:teuthology.orchestra.run.smithi112.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-11T00:04:09.077 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-11T00:04:09.161 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-11T00:04:09.190 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-11T00:04:09.223 INFO:teuthology.orchestra.run.smithi112.stdout:(108/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.0 MB/s | 16 MB 00:03 2024-09-11T00:04:09.225 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-11T00:04:09.263 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-11T00:04:09.273 INFO:teuthology.orchestra.run.smithi112.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 524 kB/s | 26 kB 00:00 2024-09-11T00:04:09.305 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-11T00:04:09.315 INFO:teuthology.orchestra.run.smithi112.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-09-11T00:04:09.341 INFO:teuthology.orchestra.run.smithi112.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-11T00:04:09.374 INFO:teuthology.orchestra.run.smithi112.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-11T00:04:09.441 INFO:teuthology.orchestra.run.smithi112.stdout:(113/157): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-11T00:04:09.460 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-11T00:04:09.483 INFO:teuthology.orchestra.run.smithi112.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-11T00:04:09.516 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-11T00:04:09.525 INFO:teuthology.orchestra.run.smithi112.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-09-11T00:04:09.550 INFO:teuthology.orchestra.run.smithi112.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-11T00:04:09.576 INFO:teuthology.orchestra.run.smithi112.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-11T00:04:09.606 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-11T00:04:09.609 INFO:teuthology.orchestra.run.smithi112.stdout:(118/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.5 MB/s | 839 kB 00:00 2024-09-11T00:04:09.634 INFO:teuthology.orchestra.run.smithi112.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-11T00:04:09.660 INFO:teuthology.orchestra.run.smithi112.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-11T00:04:09.672 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-11T00:04:09.685 INFO:teuthology.orchestra.run.smithi112.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-11T00:04:09.710 INFO:teuthology.orchestra.run.smithi112.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-11T00:04:09.744 INFO:teuthology.orchestra.run.smithi112.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-11T00:04:09.744 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-11T00:04:09.769 INFO:teuthology.orchestra.run.smithi112.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-11T00:04:09.776 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-11T00:04:09.794 INFO:teuthology.orchestra.run.smithi112.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-09-11T00:04:09.813 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-11T00:04:09.820 INFO:teuthology.orchestra.run.smithi112.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 930 kB/s | 23 kB 00:00 2024-09-11T00:04:09.845 INFO:teuthology.orchestra.run.smithi112.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-09-11T00:04:09.867 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-11T00:04:09.870 INFO:teuthology.orchestra.run.smithi112.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 792 kB/s | 20 kB 00:00 2024-09-11T00:04:09.904 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-11T00:04:09.929 INFO:teuthology.orchestra.run.smithi112.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-11T00:04:09.948 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-11T00:04:09.971 INFO:teuthology.orchestra.run.smithi112.stdout:(130/157): protobuf-compiler-3.14.0-13.el9.x86_ 540 kB/s | 863 kB 00:01 2024-09-11T00:04:09.988 INFO:teuthology.orchestra.run.smithi112.stdout:(131/157): python3-logutils-0.3.5-21.el9.noarch 791 kB/s | 46 kB 00:00 2024-09-11T00:04:09.989 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-11T00:04:10.013 INFO:teuthology.orchestra.run.smithi112.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 3.3 MB/s | 58 kB 00:00 2024-09-11T00:04:10.047 INFO:teuthology.orchestra.run.smithi112.stdout:(133/157): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-09-11T00:04:10.080 INFO:teuthology.orchestra.run.smithi112.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 4.1 MB/s | 272 kB 00:00 2024-09-11T00:04:10.099 INFO:teuthology.orchestra.run.smithi112.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 325 kB/s | 16 kB 00:00 2024-09-11T00:04:10.131 INFO:teuthology.orchestra.run.smithi112.stdout:(136/157): python3-kubernetes-26.1.0-2.el9.noar 3.9 MB/s | 1.0 MB 00:00 2024-09-11T00:04:10.142 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-11T00:04:10.156 INFO:teuthology.orchestra.run.smithi112.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 483 kB/s | 28 kB 00:00 2024-09-11T00:04:10.182 INFO:teuthology.orchestra.run.smithi112.stdout:(138/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 892 kB/s | 90 kB 00:00 2024-09-11T00:04:10.182 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-11T00:04:10.207 INFO:teuthology.orchestra.run.smithi112.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-09-11T00:04:10.223 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-11T00:04:10.232 INFO:teuthology.orchestra.run.smithi112.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-11T00:04:10.257 INFO:teuthology.orchestra.run.smithi112.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-11T00:04:10.291 INFO:teuthology.orchestra.run.smithi112.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-11T00:04:10.317 INFO:teuthology.orchestra.run.smithi112.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 889 kB/s | 74 kB 00:00 2024-09-11T00:04:10.325 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-11T00:04:10.341 INFO:teuthology.orchestra.run.smithi112.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-11T00:04:10.366 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-11T00:04:10.367 INFO:teuthology.orchestra.run.smithi112.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-09-11T00:04:10.392 INFO:teuthology.orchestra.run.smithi112.stdout:(146/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-11T00:04:10.406 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-11T00:04:10.425 INFO:teuthology.orchestra.run.smithi112.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-11T00:04:10.431 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-11T00:04:10.451 INFO:teuthology.orchestra.run.smithi112.stdout:(148/157): re2-20211101-20.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-11T00:04:10.456 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-11T00:04:10.501 INFO:teuthology.orchestra.run.smithi112.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-11T00:04:10.614 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-11T00:04:10.685 INFO:teuthology.orchestra.run.smithi112.stdout:(150/157): NetworkManager-1.49.90-1.el9.x86_64. 13 MB/s | 2.3 MB 00:00 2024-09-11T00:04:10.743 INFO:teuthology.orchestra.run.smithi112.stdout:(151/157): NetworkManager-libnm-1.49.90-1.el9.x 31 MB/s | 1.8 MB 00:00 2024-09-11T00:04:10.785 INFO:teuthology.orchestra.run.smithi112.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 982 kB/s | 41 kB 00:00 2024-09-11T00:04:10.827 INFO:teuthology.orchestra.run.smithi112.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 5.8 MB/s | 249 kB 00:00 2024-09-11T00:04:10.886 INFO:teuthology.orchestra.run.smithi112.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2024-09-11T00:04:10.910 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-11T00:04:10.944 INFO:teuthology.orchestra.run.smithi112.stdout:(155/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 6.6 MB/s | 3.2 MB 00:00 2024-09-11T00:04:10.955 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-11T00:04:10.984 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-11T00:04:10.994 INFO:teuthology.orchestra.run.smithi112.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-11T00:04:11.025 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-11T00:04:11.045 INFO:teuthology.orchestra.run.smithi112.stdout:(157/157): librados2-19.3.0-4854.g8f219c47.el9. 5.6 MB/s | 3.5 MB 00:00 2024-09-11T00:04:11.052 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-11T00:04:11.052 INFO:teuthology.orchestra.run.smithi112.stdout:Total 9.3 MB/s | 240 MB 00:25 2024-09-11T00:04:11.064 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-11T00:04:11.096 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-11T00:04:11.126 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-11T00:04:11.156 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-11T00:04:11.160 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-11T00:04:11.202 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-11T00:04:11.243 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-11T00:04:11.278 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-11T00:04:11.284 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-11T00:04:11.323 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-11T00:04:11.364 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-11T00:04:11.376 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-11T00:04:11.409 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-11T00:04:11.410 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-11T00:04:11.436 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-11T00:04:11.440 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-11T00:04:11.479 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-11T00:04:11.542 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-11T00:04:11.599 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-11T00:04:11.872 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-11T00:04:11.996 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:04:12.119 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:04:12.156 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:04:12.235 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-11T00:04:12.248 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:04:12.277 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:04:12.306 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-11T00:04:12.327 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-11T00:04:12.374 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-11T00:04:12.387 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-11T00:04:12.387 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-11T00:04:12.408 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-11T00:04:12.468 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-11T00:04:12.515 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-11T00:04:12.525 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-11T00:04:12.553 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:04:12.563 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-11T00:04:12.607 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-11T00:04:12.658 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:04:12.687 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-11T00:04:12.688 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:04:12.727 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-11T00:04:12.751 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:04:12.773 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:04:12.794 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:04:12.910 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-11T00:04:12.958 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-11T00:04:12.984 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:04:13.036 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-11T00:04:13.124 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:04:13.248 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-11T00:04:13.345 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:04:13.425 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:04:13.663 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:04:13.699 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-11T00:04:13.805 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-11T00:04:13.814 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-11T00:04:13.837 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-11T00:04:13.873 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-11T00:04:13.947 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-11T00:04:14.008 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-11T00:04:14.048 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-11T00:04:14.091 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-11T00:04:14.124 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-11T00:04:14.152 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-11T00:04:14.222 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-11T00:04:14.264 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-11T00:04:14.264 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-11T00:04:14.275 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-11T00:04:14.305 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-11T00:04:14.332 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-11T00:04:14.411 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-11T00:04:14.443 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-11T00:04:14.487 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-11T00:04:14.515 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-11T00:04:14.585 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-11T00:04:14.630 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-11T00:04:14.705 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-11T00:04:14.838 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-11T00:04:14.900 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-11T00:04:15.055 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-11T00:04:15.155 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-11T00:04:15.191 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-11T00:04:15.224 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-11T00:04:15.421 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-11T00:04:15.509 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-11T00:04:15.538 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-11T00:04:15.542 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-11T00:04:15.581 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-11T00:04:15.587 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:04:15.619 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-11T00:04:15.660 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-11T00:04:15.677 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:04:15.708 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-11T00:04:15.744 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-11T00:04:15.815 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-11T00:04:15.873 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-11T00:04:15.965 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-11T00:04:16.029 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-11T00:04:16.102 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-11T00:04:16.134 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-11T00:04:16.170 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-11T00:04:16.217 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-11T00:04:16.235 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-11T00:04:16.253 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-11T00:04:16.265 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:04:16.304 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-11T00:04:16.336 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:04:16.355 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-11T00:04:16.366 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-11T00:04:16.493 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-11T00:04:16.533 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-11T00:04:16.574 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-11T00:04:16.677 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-11T00:04:16.708 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-11T00:04:16.748 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-11T00:04:16.865 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-11T00:04:16.899 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-11T00:04:16.976 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-11T00:04:17.116 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-11T00:04:17.163 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-11T00:04:17.183 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-11T00:04:17.217 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-11T00:04:17.256 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-11T00:04:17.288 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-11T00:04:17.319 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-11T00:04:17.353 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-11T00:04:17.387 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-11T00:04:17.428 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-11T00:04:17.463 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-11T00:04:17.550 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-11T00:04:17.602 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-11T00:04:17.642 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-11T00:04:17.746 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-11T00:04:17.793 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-11T00:04:18.515 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-11T00:04:18.575 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-11T00:04:18.609 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-11T00:04:18.694 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:04:18.708 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-11T00:04:18.729 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:04:18.765 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-11T00:04:18.810 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-11T00:04:18.897 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-11T00:04:18.938 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-11T00:04:19.121 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-11T00:04:19.152 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-11T00:04:19.230 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-11T00:04:19.295 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:04:19.333 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:04:19.434 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:04:19.435 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T00:04:19.435 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T00:04:19.435 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:04:19.467 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:04:19.874 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-11T00:04:19.994 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-11T00:04:20.628 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-11T00:04:20.732 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-11T00:04:20.788 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-11T00:04:20.849 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-11T00:04:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-11T00:04:20.909 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-11T00:04:20.977 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-11T00:04:21.223 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-11T00:04:21.303 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-11T00:04:21.331 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-11T00:04:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-11T00:04:21.364 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-11T00:04:21.451 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:04:21.575 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:04:21.610 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:04:21.685 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-11T00:04:21.702 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:04:21.736 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:04:21.739 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:04:21.769 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-11T00:04:21.818 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:04:21.850 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-11T00:04:21.885 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-11T00:04:21.924 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-11T00:04:21.979 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-11T00:04:22.016 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:04:22.103 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:04:22.133 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:04:22.179 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:04:22.201 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:04:22.226 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:04:22.378 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-11T00:04:22.406 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:04:22.419 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:04:22.470 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:04:22.500 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-11T00:04:22.566 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:04:22.682 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-11T00:04:22.791 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:04:22.876 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:04:23.090 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:04:23.195 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-11T00:04:23.221 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-11T00:04:23.255 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-11T00:04:23.337 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-11T00:04:23.381 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-11T00:04:23.413 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-11T00:04:23.457 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-11T00:04:23.490 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-11T00:04:23.526 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-11T00:04:23.593 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-11T00:04:23.647 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-11T00:04:23.678 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-11T00:04:23.713 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-11T00:04:23.790 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-11T00:04:23.824 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-11T00:04:23.867 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-11T00:04:23.897 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-11T00:04:23.975 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-11T00:04:24.023 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-11T00:04:24.096 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-11T00:04:24.237 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-11T00:04:24.291 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-11T00:04:24.787 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:04:24.806 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-11T00:04:24.831 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:04:24.887 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-11T00:04:24.916 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-11T00:04:24.959 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-11T00:04:24.997 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-11T00:04:25.038 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-11T00:04:25.203 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-11T00:04:25.283 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-11T00:04:25.383 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:04:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-11T00:04:25.419 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:04:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-11T00:04:25.519 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:04:25.519 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T00:04:25.519 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T00:04:25.519 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:04:25.520 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-11T00:04:25.552 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-11T00:04:25.554 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:04:25.588 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-11T00:04:25.639 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-11T00:04:25.679 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-11T00:04:25.738 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-11T00:04:25.789 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-11T00:04:25.924 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-11T00:04:25.973 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-11T00:04:26.015 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-11T00:04:26.116 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-11T00:04:26.165 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-11T00:04:26.233 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-11T00:04:26.264 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-11T00:04:26.288 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-11T00:04:26.363 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-11T00:04:26.489 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-11T00:04:26.521 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-11T00:04:26.549 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-11T00:04:26.583 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-11T00:04:26.630 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-11T00:04:26.670 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-11T00:04:26.699 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-11T00:04:26.734 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-11T00:04:26.776 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-11T00:04:26.817 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-11T00:04:26.852 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-11T00:04:26.937 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-11T00:04:26.982 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-11T00:04:27.022 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-11T00:04:27.133 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-11T00:04:27.189 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-11T00:04:27.907 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-11T00:04:27.961 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-11T00:04:27.995 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-11T00:04:28.094 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-11T00:04:28.149 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-11T00:04:28.196 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-11T00:04:28.280 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-11T00:04:28.322 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-11T00:04:28.505 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-11T00:04:28.537 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-11T00:04:28.613 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-11T00:04:29.245 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-11T00:04:29.358 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-11T00:04:30.552 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-11T00:04:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-11T00:04:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-11T00:04:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-11T00:04:31.028 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-11T00:04:31.030 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:04:31.030 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /sys 2024-09-11T00:04:31.030 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /proc 2024-09-11T00:04:31.030 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /mnt 2024-09-11T00:04:31.030 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /var/tmp 2024-09-11T00:04:31.030 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /home 2024-09-11T00:04:31.030 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /root 2024-09-11T00:04:31.030 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /tmp 2024-09-11T00:04:31.031 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:04:31.074 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:04:31.163 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:04:31.195 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-11T00:04:31.204 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:04:31.221 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:04:31.221 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:31.221 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T00:04:31.221 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:04:31.231 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-11T00:04:31.724 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-11T00:04:31.752 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:04:31.822 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:04:31.845 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-11T00:04:32.724 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:04:32.752 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:04:32.752 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:32.752 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T00:04:32.752 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:04:32.752 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:04:32.752 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:04:32.985 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:04:33.008 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:04:33.008 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:33.008 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T00:04:33.008 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:04:33.008 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:04:33.009 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:04:33.460 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:04:33.484 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:04:33.484 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:33.484 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T00:04:33.484 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:04:33.484 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:04:33.485 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:04:33.590 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-11T00:04:33.655 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-11T00:04:33.711 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-11T00:04:33.905 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-11T00:04:33.961 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-11T00:04:34.039 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-11T00:04:34.135 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-11T00:04:34.219 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:04:34.258 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:04:34.284 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-11T00:04:34.331 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-11T00:04:34.368 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-11T00:04:34.396 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-11T00:04:34.810 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:04:34.844 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:04:34.860 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:04:34.886 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:04:34.918 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-11T00:04:34.936 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:04:34.936 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T00:04:34.936 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T00:04:34.936 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-11T00:04:34.962 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:04:34.984 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-11T00:04:35.009 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:04:37.701 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:04:37.701 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /sys 2024-09-11T00:04:37.701 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /proc 2024-09-11T00:04:37.701 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /mnt 2024-09-11T00:04:37.701 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /var/tmp 2024-09-11T00:04:37.702 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /home 2024-09-11T00:04:37.702 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /root 2024-09-11T00:04:37.702 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /tmp 2024-09-11T00:04:37.702 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:04:37.876 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:04:37.892 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:04:37.893 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:37.893 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T00:04:37.893 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:04:38.192 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:04:38.257 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:04:39.219 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:04:39.248 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:04:39.364 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:04:39.405 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:04:39.432 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:04:39.432 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:39.432 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T00:04:39.432 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:04:39.432 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:04:39.432 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:04:39.527 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-11T00:04:39.551 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:04:39.575 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:04:39.575 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:39.575 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T00:04:39.575 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:04:39.575 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:04:39.575 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:04:39.635 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:04:39.647 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:04:39.656 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:04:39.679 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:04:39.679 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:39.680 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T00:04:39.680 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:04:39.680 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:04:39.680 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:04:39.745 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-11T00:04:39.804 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-11T00:04:40.123 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:04:40.147 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:04:40.147 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:40.147 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T00:04:40.148 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:04:40.148 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:04:40.148 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:04:40.262 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-11T00:04:40.328 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-11T00:04:40.384 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-11T00:04:40.571 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-11T00:04:40.626 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-11T00:04:40.713 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-11T00:04:40.757 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-11T00:04:40.787 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:04:40.808 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-11T00:04:40.811 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:04:40.811 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:40.811 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T00:04:40.812 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:04:40.812 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:04:40.812 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:04:40.855 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:04:40.878 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:04:40.878 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:40.878 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T00:04:40.878 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:04:40.930 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:04:40.940 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-11T00:04:40.954 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:04:40.954 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:40.954 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T00:04:40.954 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:04:40.954 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:04:40.954 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:04:40.976 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-11T00:04:41.009 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-11T00:04:41.045 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-11T00:04:41.264 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:04:41.288 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:04:41.288 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:41.288 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T00:04:41.288 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:04:41.289 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:04:41.289 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:04:41.520 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:04:41.544 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:04:41.576 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-11T00:04:41.643 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-11T00:04:41.668 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:04:44.848 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:04:44.900 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:04:45.867 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:04:45.892 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:04:46.002 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-11T00:04:46.007 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:04:46.042 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-11T00:04:46.083 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-11T00:04:46.116 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-11T00:04:46.143 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-11T00:04:46.163 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-11T00:04:46.195 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:04:46.219 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:04:46.219 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:46.219 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T00:04:46.219 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:04:46.219 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:04:46.219 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:04:46.271 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:04:46.283 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:04:46.336 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-11T00:04:46.381 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-11T00:04:46.381 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-11T00:04:46.412 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-11T00:04:46.427 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-11T00:04:46.442 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-11T00:04:46.488 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-11T00:04:46.692 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:04:46.692 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /sys 2024-09-11T00:04:46.692 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /proc 2024-09-11T00:04:46.692 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /mnt 2024-09-11T00:04:46.692 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /var/tmp 2024-09-11T00:04:46.692 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /home 2024-09-11T00:04:46.693 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /root 2024-09-11T00:04:46.693 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /tmp 2024-09-11T00:04:46.693 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-11T00:04:46.872 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:04:46.888 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:04:46.888 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:46.888 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T00:04:46.888 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-11T00:04:47.034 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:04:47.077 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:04:47.097 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:04:47.383 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-11T00:04:47.407 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:04:47.431 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:04:47.431 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:47.431 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T00:04:47.431 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:04:47.431 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:04:47.431 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:04:47.483 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:04:47.506 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:04:47.506 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:47.506 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T00:04:47.506 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:04:47.550 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:04:47.574 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:04:47.574 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:47.574 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T00:04:47.574 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:04:47.575 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:04:47.575 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:04:47.893 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:04:47.916 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:04:47.917 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:47.917 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T00:04:47.917 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:04:47.917 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:04:47.917 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:04:47.920 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-11T00:04:48.006 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-11T00:04:48.055 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-11T00:04:48.147 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-11T00:04:48.185 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-11T00:04:48.210 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-11T00:04:48.236 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-11T00:04:48.236 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:04:48.321 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:04:48.321 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:04:48.400 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:04:48.404 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:04:48.427 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:04:48.427 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:48.427 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T00:04:48.427 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:04:48.428 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:04:48.428 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-11T00:04:48.429 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-11T00:04:48.435 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:04:48.435 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:04:48.623 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:04:48.623 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:04:48.651 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:04:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:04:48.674 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:48.674 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T00:04:48.674 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:04:48.674 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:04:48.674 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-11T00:04:48.707 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:04:48.772 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:04:49.118 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:04:49.141 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:04:49.141 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:49.141 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T00:04:49.141 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:04:49.141 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:04:49.141 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-11T00:04:49.240 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-11T00:04:49.305 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-11T00:04:49.360 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-11T00:04:49.545 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-11T00:04:49.610 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-11T00:04:49.679 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-11T00:04:49.776 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-11T00:04:49.939 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-11T00:04:49.985 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-11T00:04:50.017 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-11T00:04:50.045 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-11T00:04:50.382 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:04:50.418 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:04:50.450 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-11T00:04:50.516 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-11T00:04:50.541 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:04:52.623 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-11T00:04:52.664 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-11T00:04:52.705 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-11T00:04:52.737 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-11T00:04:52.765 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-11T00:04:52.948 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-11T00:04:53.004 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-11T00:04:53.035 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-11T00:04:53.082 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-11T00:04:53.128 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-11T00:04:53.692 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:04:53.710 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:04:53.727 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:04:53.749 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:04:53.772 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:04:54.580 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-11T00:04:54.669 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-11T00:04:54.710 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-11T00:04:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:04:54.756 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:04:54.791 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-11T00:04:54.823 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-11T00:04:54.848 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-11T00:04:54.867 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:04:54.874 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-11T00:04:54.874 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:04:54.967 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:04:54.967 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:04:55.035 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-11T00:04:55.051 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:04:55.066 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:04:55.076 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-11T00:04:55.082 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:04:55.082 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:04:55.090 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:04:55.090 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:55.090 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T00:04:55.090 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:04:55.090 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:04:55.091 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-11T00:04:55.142 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:04:55.153 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:04:55.252 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-11T00:04:55.262 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:04:55.262 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:04:55.306 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-11T00:04:55.346 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:04:55.386 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:04:55.386 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-11T00:04:55.386 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-11T00:04:55.386 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-11T00:04:55.387 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-11T00:04:55.387 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-11T00:04:55.387 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-11T00:04:55.387 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-11T00:04:55.387 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:04:55.387 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:04:55.387 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:04:55.387 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-11T00:04:55.387 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-11T00:04:55.387 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-11T00:04:55.387 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:04:55.388 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-11T00:04:55.388 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-11T00:04:55.388 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-11T00:04:55.388 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-11T00:04:55.388 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-11T00:04:55.388 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-11T00:04:55.388 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-11T00:04:55.388 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-11T00:04:55.388 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-11T00:04:55.388 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-11T00:04:55.388 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-11T00:04:55.388 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-11T00:04:55.389 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-11T00:04:55.389 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-11T00:04:55.389 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-11T00:04:55.401 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-11T00:04:55.401 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-11T00:04:55.401 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-11T00:04:55.401 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-11T00:04:55.401 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-11T00:04:55.401 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-11T00:04:55.401 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-11T00:04:55.401 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-11T00:04:55.401 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-11T00:04:55.401 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-11T00:04:55.401 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-11T00:04:55.401 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-11T00:04:55.402 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-11T00:04:55.402 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-11T00:04:55.402 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-11T00:04:55.402 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-11T00:04:55.402 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-11T00:04:55.402 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-11T00:04:55.402 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-11T00:04:55.402 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-11T00:04:55.402 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-11T00:04:55.402 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-11T00:04:55.402 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-11T00:04:55.402 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-11T00:04:55.403 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-11T00:04:55.403 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-11T00:04:55.403 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-11T00:04:55.403 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-11T00:04:55.403 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-11T00:04:55.403 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-11T00:04:55.403 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-11T00:04:55.403 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-11T00:04:55.403 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-11T00:04:55.403 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-11T00:04:55.403 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-11T00:04:55.403 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-11T00:04:55.403 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-11T00:04:55.404 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-11T00:04:55.404 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-11T00:04:55.404 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-11T00:04:55.404 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-11T00:04:55.404 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-11T00:04:55.404 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-11T00:04:55.404 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-11T00:04:55.404 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-11T00:04:55.404 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-11T00:04:55.404 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-11T00:04:55.404 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-11T00:04:55.405 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-11T00:04:55.405 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-11T00:04:55.405 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-11T00:04:55.405 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-11T00:04:55.405 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-11T00:04:55.405 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-11T00:04:55.405 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-11T00:04:55.405 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-11T00:04:55.405 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-11T00:04:55.405 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-11T00:04:55.405 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-11T00:04:55.405 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-11T00:04:55.405 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-11T00:04:55.405 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-11T00:04:55.406 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-11T00:04:55.406 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-11T00:04:55.406 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-11T00:04:55.406 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-11T00:04:55.406 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-11T00:04:55.406 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-11T00:04:55.406 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-11T00:04:55.406 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-11T00:04:55.406 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-11T00:04:55.406 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-11T00:04:55.406 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-11T00:04:55.406 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-11T00:04:55.406 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-11T00:04:55.407 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-11T00:04:55.407 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-11T00:04:55.407 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-11T00:04:55.407 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-11T00:04:55.407 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-11T00:04:55.407 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-11T00:04:55.407 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-11T00:04:55.407 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-11T00:04:55.407 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-11T00:04:55.407 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-11T00:04:55.407 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-11T00:04:55.407 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-11T00:04:55.408 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-11T00:04:55.408 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-11T00:04:55.408 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-11T00:04:55.408 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-11T00:04:55.408 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-11T00:04:55.408 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-11T00:04:55.408 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-11T00:04:55.408 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-11T00:04:55.408 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-11T00:04:55.408 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-11T00:04:55.408 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-11T00:04:55.408 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-11T00:04:55.408 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-11T00:04:55.409 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-11T00:04:55.409 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-11T00:04:55.409 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-11T00:04:55.409 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-11T00:04:55.409 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-11T00:04:55.409 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-11T00:04:55.409 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-11T00:04:55.409 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-11T00:04:55.409 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-11T00:04:55.409 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-11T00:04:55.409 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-11T00:04:55.409 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-11T00:04:55.409 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-11T00:04:55.410 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-11T00:04:55.410 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-11T00:04:55.410 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-11T00:04:55.410 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-11T00:04:55.410 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-11T00:04:55.410 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-11T00:04:55.410 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-11T00:04:55.410 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-11T00:04:55.410 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-11T00:04:55.410 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-11T00:04:55.410 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-11T00:04:55.410 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-11T00:04:55.410 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-11T00:04:55.411 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-11T00:04:55.411 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-11T00:04:55.411 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-11T00:04:55.411 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-11T00:04:55.411 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-11T00:04:55.411 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-11T00:04:55.411 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-11T00:04:55.411 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-11T00:04:55.411 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-11T00:04:55.412 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:04:56.259 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-11T00:04:56.286 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:04:56.309 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:04:56.309 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:56.309 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T00:04:56.309 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:04:56.309 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:04:56.309 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-11T00:04:56.353 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:04:56.376 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:04:56.376 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:56.376 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T00:04:56.376 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-11T00:04:56.429 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:04:56.452 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:04:56.452 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:56.452 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T00:04:56.452 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:04:56.452 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:04:56.453 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-11T00:04:56.771 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:04:56.794 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:04:56.795 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:04:56.795 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T00:04:56.795 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:04:56.795 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:04:56.795 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-11T00:04:57.829 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:04:57.829 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:04:57.829 INFO:teuthology.orchestra.run.smithi078.stdout:Upgraded: 2024-09-11T00:04:57.829 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T00:04:57.829 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T00:04:57.829 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T00:04:57.829 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T00:04:57.829 INFO:teuthology.orchestra.run.smithi078.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.829 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.829 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T00:04:57.830 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T00:04:57.830 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-11T00:04:57.830 INFO:teuthology.orchestra.run.smithi078.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T00:04:57.830 INFO:teuthology.orchestra.run.smithi078.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T00:04:57.830 INFO:teuthology.orchestra.run.smithi078.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T00:04:57.830 INFO:teuthology.orchestra.run.smithi078.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T00:04:57.830 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.830 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.830 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.830 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.830 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:04:57.830 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.831 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.831 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.831 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:04:57.831 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:04:57.831 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:04:57.831 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:04:57.831 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:04:57.831 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.831 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.831 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:04:57.832 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.832 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.832 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.832 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:04:57.832 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:04:57.832 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.832 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.832 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:04:57.832 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T00:04:57.832 INFO:teuthology.orchestra.run.smithi078.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T00:04:57.832 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T00:04:57.833 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T00:04:57.833 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T00:04:57.833 INFO:teuthology.orchestra.run.smithi078.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T00:04:57.833 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T00:04:57.833 INFO:teuthology.orchestra.run.smithi078.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T00:04:57.833 INFO:teuthology.orchestra.run.smithi078.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T00:04:57.833 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T00:04:57.833 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T00:04:57.833 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.833 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.833 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.834 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T00:04:57.834 INFO:teuthology.orchestra.run.smithi078.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T00:04:57.834 INFO:teuthology.orchestra.run.smithi078.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T00:04:57.834 INFO:teuthology.orchestra.run.smithi078.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T00:04:57.834 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T00:04:57.834 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T00:04:57.834 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.834 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.834 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T00:04:57.834 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.834 INFO:teuthology.orchestra.run.smithi078.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T00:04:57.834 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T00:04:57.835 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T00:04:57.835 INFO:teuthology.orchestra.run.smithi078.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T00:04:57.835 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T00:04:57.835 INFO:teuthology.orchestra.run.smithi078.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T00:04:57.835 INFO:teuthology.orchestra.run.smithi078.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T00:04:57.835 INFO:teuthology.orchestra.run.smithi078.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T00:04:57.835 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T00:04:57.835 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T00:04:57.835 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T00:04:57.835 INFO:teuthology.orchestra.run.smithi078.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T00:04:57.835 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T00:04:57.835 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T00:04:57.835 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T00:04:57.836 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T00:04:57.836 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T00:04:57.836 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T00:04:57.836 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T00:04:57.836 INFO:teuthology.orchestra.run.smithi078.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T00:04:57.836 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T00:04:57.836 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T00:04:57.836 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T00:04:57.836 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.836 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.836 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.837 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T00:04:57.837 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T00:04:57.837 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T00:04:57.837 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T00:04:57.837 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T00:04:57.837 INFO:teuthology.orchestra.run.smithi078.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T00:04:57.837 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T00:04:57.837 INFO:teuthology.orchestra.run.smithi078.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T00:04:57.837 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T00:04:57.837 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T00:04:57.837 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T00:04:57.837 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T00:04:57.838 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T00:04:57.838 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T00:04:57.838 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T00:04:57.838 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T00:04:57.838 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T00:04:57.838 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T00:04:57.838 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T00:04:57.838 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T00:04:57.838 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T00:04:57.838 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T00:04:57.838 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T00:04:57.838 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T00:04:57.839 INFO:teuthology.orchestra.run.smithi078.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T00:04:57.839 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T00:04:57.839 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T00:04:57.839 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T00:04:57.839 INFO:teuthology.orchestra.run.smithi078.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T00:04:57.839 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T00:04:57.839 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T00:04:57.839 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T00:04:57.839 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T00:04:57.839 INFO:teuthology.orchestra.run.smithi078.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T00:04:57.839 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T00:04:57.839 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T00:04:57.840 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T00:04:57.840 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T00:04:57.840 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T00:04:57.840 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T00:04:57.840 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.840 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.840 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T00:04:57.840 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T00:04:57.840 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T00:04:57.840 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.840 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T00:04:57.840 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T00:04:57.840 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T00:04:57.841 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T00:04:57.841 INFO:teuthology.orchestra.run.smithi078.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T00:04:57.841 INFO:teuthology.orchestra.run.smithi078.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T00:04:57.841 INFO:teuthology.orchestra.run.smithi078.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T00:04:57.841 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T00:04:57.841 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T00:04:57.841 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T00:04:57.841 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T00:04:57.841 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T00:04:57.841 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T00:04:57.841 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T00:04:57.841 INFO:teuthology.orchestra.run.smithi078.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T00:04:57.842 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.842 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.842 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:04:57.842 INFO:teuthology.orchestra.run.smithi078.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T00:04:57.842 INFO:teuthology.orchestra.run.smithi078.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T00:04:57.842 INFO:teuthology.orchestra.run.smithi078.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T00:04:57.842 INFO:teuthology.orchestra.run.smithi078.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T00:04:57.842 INFO:teuthology.orchestra.run.smithi078.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T00:04:57.842 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T00:04:57.843 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T00:04:57.843 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:04:57.843 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-11T00:04:58.288 DEBUG:teuthology.parallel:result is None 2024-09-11T00:05:01.458 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-11T00:05:01.500 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-11T00:05:01.540 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-11T00:05:01.573 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-11T00:05:01.600 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-11T00:05:01.780 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-11T00:05:01.830 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-11T00:05:01.860 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-11T00:05:01.890 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-11T00:05:01.936 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-11T00:05:01.978 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:05:01.978 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-11T00:05:01.978 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-11T00:05:01.978 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-11T00:05:01.978 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-11T00:05:01.979 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-11T00:05:01.979 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-11T00:05:01.979 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-11T00:05:01.979 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:05:01.979 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:05:01.980 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:05:01.980 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-11T00:05:01.980 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-11T00:05:01.980 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-11T00:05:01.980 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:05:01.980 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-11T00:05:01.980 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-11T00:05:01.980 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-11T00:05:01.980 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-11T00:05:01.980 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-11T00:05:01.981 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-11T00:05:01.981 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-11T00:05:01.981 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-11T00:05:01.981 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-11T00:05:01.981 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-11T00:05:01.981 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-11T00:05:01.981 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-11T00:05:01.981 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-11T00:05:01.981 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-11T00:05:01.981 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-11T00:05:01.995 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-11T00:05:01.995 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-11T00:05:01.995 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-11T00:05:01.995 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-11T00:05:01.995 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-11T00:05:01.995 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-11T00:05:01.995 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-11T00:05:01.995 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-11T00:05:01.995 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-11T00:05:01.995 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-11T00:05:01.995 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-11T00:05:01.995 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-11T00:05:01.996 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-11T00:05:01.996 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-11T00:05:01.996 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-11T00:05:01.996 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-11T00:05:01.996 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-11T00:05:01.996 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-11T00:05:01.996 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-11T00:05:01.996 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-11T00:05:01.996 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-11T00:05:01.996 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-11T00:05:01.996 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-11T00:05:01.996 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-11T00:05:01.997 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-11T00:05:01.997 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-11T00:05:01.997 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-11T00:05:01.997 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-11T00:05:01.997 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-11T00:05:01.997 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-11T00:05:01.997 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-11T00:05:01.997 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-11T00:05:01.997 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-11T00:05:01.997 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-11T00:05:01.997 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-11T00:05:01.997 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-11T00:05:01.998 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-11T00:05:01.998 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-11T00:05:01.998 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-11T00:05:01.998 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-11T00:05:01.998 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-11T00:05:01.998 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-11T00:05:01.998 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-11T00:05:01.998 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-11T00:05:01.998 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-11T00:05:01.998 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-11T00:05:01.998 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-11T00:05:01.998 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-11T00:05:01.998 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-11T00:05:01.999 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-11T00:05:01.999 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-11T00:05:01.999 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-11T00:05:01.999 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-11T00:05:01.999 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-11T00:05:01.999 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-11T00:05:01.999 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-11T00:05:01.999 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-11T00:05:01.999 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-11T00:05:01.999 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-11T00:05:01.999 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-11T00:05:01.999 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-11T00:05:01.999 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-11T00:05:02.000 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-11T00:05:02.000 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-11T00:05:02.000 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-11T00:05:02.000 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-11T00:05:02.000 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-11T00:05:02.000 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-11T00:05:02.000 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-11T00:05:02.000 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-11T00:05:02.000 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-11T00:05:02.000 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-11T00:05:02.000 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-11T00:05:02.000 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-11T00:05:02.000 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-11T00:05:02.001 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-11T00:05:02.001 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-11T00:05:02.001 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-11T00:05:02.001 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-11T00:05:02.001 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-11T00:05:02.001 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-11T00:05:02.001 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-11T00:05:02.001 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-11T00:05:02.001 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-11T00:05:02.001 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-11T00:05:02.001 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-11T00:05:02.001 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-11T00:05:02.001 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-11T00:05:02.002 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-11T00:05:02.002 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-11T00:05:02.002 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-11T00:05:02.002 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-11T00:05:02.002 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-11T00:05:02.002 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-11T00:05:02.002 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-11T00:05:02.002 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-11T00:05:02.002 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-11T00:05:02.002 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-11T00:05:02.002 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-11T00:05:02.002 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-11T00:05:02.002 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-11T00:05:02.002 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-11T00:05:02.003 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-11T00:05:02.003 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-11T00:05:02.003 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-11T00:05:02.003 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-11T00:05:02.003 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-11T00:05:02.003 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-11T00:05:02.003 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-11T00:05:02.003 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-11T00:05:02.003 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-11T00:05:02.003 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-11T00:05:02.003 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-11T00:05:02.003 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-11T00:05:02.004 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-11T00:05:02.004 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-11T00:05:02.004 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-11T00:05:02.004 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-11T00:05:02.004 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-11T00:05:02.004 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-11T00:05:02.004 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-11T00:05:02.004 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-11T00:05:02.004 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-11T00:05:02.004 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-11T00:05:02.004 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-11T00:05:02.004 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-11T00:05:02.004 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-11T00:05:02.004 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-11T00:05:02.005 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-11T00:05:02.005 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-11T00:05:02.005 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-11T00:05:02.005 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-11T00:05:02.005 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-11T00:05:02.005 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-11T00:05:02.005 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-11T00:05:02.523 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:05:02.566 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:05:02.586 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:05:03.404 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-11T00:05:03.479 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-11T00:05:03.528 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-11T00:05:03.617 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-11T00:05:03.657 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-11T00:05:03.682 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-11T00:05:03.708 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-11T00:05:03.708 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:05:03.793 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:05:03.793 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:05:03.877 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:05:03.902 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-11T00:05:03.907 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:05:03.907 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:05:04.095 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:05:04.095 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:05:04.179 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:05:04.243 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:05:04.605 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:05:04.605 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:05:04.605 INFO:teuthology.orchestra.run.smithi138.stdout:Upgraded: 2024-09-11T00:05:04.606 INFO:teuthology.orchestra.run.smithi138.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T00:05:04.606 INFO:teuthology.orchestra.run.smithi138.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T00:05:04.606 INFO:teuthology.orchestra.run.smithi138.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T00:05:04.606 INFO:teuthology.orchestra.run.smithi138.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T00:05:04.606 INFO:teuthology.orchestra.run.smithi138.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.606 INFO:teuthology.orchestra.run.smithi138.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.606 INFO:teuthology.orchestra.run.smithi138.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T00:05:04.606 INFO:teuthology.orchestra.run.smithi138.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T00:05:04.606 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-11T00:05:04.606 INFO:teuthology.orchestra.run.smithi138.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T00:05:04.606 INFO:teuthology.orchestra.run.smithi138.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T00:05:04.606 INFO:teuthology.orchestra.run.smithi138.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T00:05:04.606 INFO:teuthology.orchestra.run.smithi138.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T00:05:04.607 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.607 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.607 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.607 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.607 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:05:04.607 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.607 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.607 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.607 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:05:04.607 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:05:04.607 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:05:04.607 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:05:04.607 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:05:04.608 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.608 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.608 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:05:04.608 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.608 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.608 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.608 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:05:04.608 INFO:teuthology.orchestra.run.smithi138.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:05:04.608 INFO:teuthology.orchestra.run.smithi138.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.608 INFO:teuthology.orchestra.run.smithi138.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.608 INFO:teuthology.orchestra.run.smithi138.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:05:04.608 INFO:teuthology.orchestra.run.smithi138.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T00:05:04.608 INFO:teuthology.orchestra.run.smithi138.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T00:05:04.609 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T00:05:04.609 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T00:05:04.609 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T00:05:04.609 INFO:teuthology.orchestra.run.smithi138.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T00:05:04.609 INFO:teuthology.orchestra.run.smithi138.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T00:05:04.609 INFO:teuthology.orchestra.run.smithi138.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T00:05:04.609 INFO:teuthology.orchestra.run.smithi138.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T00:05:04.609 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T00:05:04.609 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T00:05:04.609 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.609 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.609 INFO:teuthology.orchestra.run.smithi138.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.609 INFO:teuthology.orchestra.run.smithi138.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T00:05:04.610 INFO:teuthology.orchestra.run.smithi138.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T00:05:04.610 INFO:teuthology.orchestra.run.smithi138.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T00:05:04.610 INFO:teuthology.orchestra.run.smithi138.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T00:05:04.610 INFO:teuthology.orchestra.run.smithi138.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T00:05:04.610 INFO:teuthology.orchestra.run.smithi138.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T00:05:04.610 INFO:teuthology.orchestra.run.smithi138.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.610 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.610 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T00:05:04.610 INFO:teuthology.orchestra.run.smithi138.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.610 INFO:teuthology.orchestra.run.smithi138.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T00:05:04.610 INFO:teuthology.orchestra.run.smithi138.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T00:05:04.610 INFO:teuthology.orchestra.run.smithi138.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T00:05:04.610 INFO:teuthology.orchestra.run.smithi138.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T00:05:04.611 INFO:teuthology.orchestra.run.smithi138.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T00:05:04.611 INFO:teuthology.orchestra.run.smithi138.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T00:05:04.611 INFO:teuthology.orchestra.run.smithi138.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T00:05:04.611 INFO:teuthology.orchestra.run.smithi138.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T00:05:04.611 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T00:05:04.611 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T00:05:04.611 INFO:teuthology.orchestra.run.smithi138.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T00:05:04.611 INFO:teuthology.orchestra.run.smithi138.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T00:05:04.611 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T00:05:04.611 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T00:05:04.611 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T00:05:04.611 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T00:05:04.611 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T00:05:04.612 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T00:05:04.612 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T00:05:04.612 INFO:teuthology.orchestra.run.smithi138.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T00:05:04.612 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T00:05:04.612 INFO:teuthology.orchestra.run.smithi138.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T00:05:04.612 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T00:05:04.612 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.612 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.612 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.612 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T00:05:04.612 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T00:05:04.612 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T00:05:04.612 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T00:05:04.613 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T00:05:04.613 INFO:teuthology.orchestra.run.smithi138.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T00:05:04.613 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T00:05:04.613 INFO:teuthology.orchestra.run.smithi138.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T00:05:04.613 INFO:teuthology.orchestra.run.smithi138.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T00:05:04.613 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T00:05:04.613 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T00:05:04.613 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T00:05:04.613 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T00:05:04.613 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T00:05:04.613 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T00:05:04.613 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T00:05:04.613 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T00:05:04.614 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T00:05:04.614 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T00:05:04.614 INFO:teuthology.orchestra.run.smithi138.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T00:05:04.614 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T00:05:04.614 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T00:05:04.614 INFO:teuthology.orchestra.run.smithi138.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T00:05:04.614 INFO:teuthology.orchestra.run.smithi138.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T00:05:04.614 INFO:teuthology.orchestra.run.smithi138.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T00:05:04.614 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T00:05:04.614 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T00:05:04.614 INFO:teuthology.orchestra.run.smithi138.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T00:05:04.614 INFO:teuthology.orchestra.run.smithi138.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T00:05:04.614 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T00:05:04.615 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T00:05:04.615 INFO:teuthology.orchestra.run.smithi138.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T00:05:04.615 INFO:teuthology.orchestra.run.smithi138.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T00:05:04.615 INFO:teuthology.orchestra.run.smithi138.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T00:05:04.615 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T00:05:04.615 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T00:05:04.615 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T00:05:04.615 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T00:05:04.615 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T00:05:04.615 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T00:05:04.615 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.615 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.615 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T00:05:04.616 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T00:05:04.616 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T00:05:04.616 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.616 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T00:05:04.616 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T00:05:04.616 INFO:teuthology.orchestra.run.smithi138.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T00:05:04.616 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T00:05:04.616 INFO:teuthology.orchestra.run.smithi138.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T00:05:04.616 INFO:teuthology.orchestra.run.smithi138.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T00:05:04.616 INFO:teuthology.orchestra.run.smithi138.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T00:05:04.616 INFO:teuthology.orchestra.run.smithi138.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T00:05:04.616 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T00:05:04.616 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T00:05:04.617 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T00:05:04.617 INFO:teuthology.orchestra.run.smithi138.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T00:05:04.617 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T00:05:04.617 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T00:05:04.617 INFO:teuthology.orchestra.run.smithi138.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T00:05:04.617 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.617 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.617 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:04.617 INFO:teuthology.orchestra.run.smithi138.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T00:05:04.617 INFO:teuthology.orchestra.run.smithi138.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T00:05:04.617 INFO:teuthology.orchestra.run.smithi138.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T00:05:04.617 INFO:teuthology.orchestra.run.smithi138.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T00:05:04.617 INFO:teuthology.orchestra.run.smithi138.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T00:05:04.617 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T00:05:04.618 INFO:teuthology.orchestra.run.smithi138.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T00:05:04.618 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:05:04.618 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-11T00:05:05.037 DEBUG:teuthology.parallel:result is None 2024-09-11T00:05:10.517 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:05:10.517 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-11T00:05:10.517 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-11T00:05:10.517 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-11T00:05:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-11T00:05:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-11T00:05:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-11T00:05:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-11T00:05:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:05:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:05:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:05:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-11T00:05:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-11T00:05:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-11T00:05:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:05:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-11T00:05:10.518 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-11T00:05:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-11T00:05:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-11T00:05:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-11T00:05:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-11T00:05:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-11T00:05:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-11T00:05:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-11T00:05:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-11T00:05:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-11T00:05:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-11T00:05:10.519 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-11T00:05:10.532 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-11T00:05:10.532 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-11T00:05:10.532 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-11T00:05:10.532 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-11T00:05:10.532 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-11T00:05:10.532 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-11T00:05:10.532 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-11T00:05:10.532 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-11T00:05:10.532 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-11T00:05:10.533 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-11T00:05:10.533 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-11T00:05:10.533 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-11T00:05:10.533 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-11T00:05:10.533 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-11T00:05:10.533 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-11T00:05:10.533 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-11T00:05:10.533 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-11T00:05:10.533 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-11T00:05:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-11T00:05:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-11T00:05:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-11T00:05:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-11T00:05:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-11T00:05:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-11T00:05:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-11T00:05:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-11T00:05:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-11T00:05:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-11T00:05:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-11T00:05:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-11T00:05:10.534 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-11T00:05:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-11T00:05:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-11T00:05:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-11T00:05:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-11T00:05:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-11T00:05:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-11T00:05:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-11T00:05:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-11T00:05:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-11T00:05:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-11T00:05:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-11T00:05:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-11T00:05:10.535 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-11T00:05:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-11T00:05:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-11T00:05:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-11T00:05:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-11T00:05:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-11T00:05:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-11T00:05:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-11T00:05:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-11T00:05:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-11T00:05:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-11T00:05:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-11T00:05:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-11T00:05:10.536 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-11T00:05:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-11T00:05:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-11T00:05:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-11T00:05:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-11T00:05:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-11T00:05:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-11T00:05:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-11T00:05:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-11T00:05:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-11T00:05:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-11T00:05:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-11T00:05:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-11T00:05:10.537 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-11T00:05:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-11T00:05:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-11T00:05:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-11T00:05:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-11T00:05:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-11T00:05:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-11T00:05:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-11T00:05:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-11T00:05:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-11T00:05:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-11T00:05:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-11T00:05:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-11T00:05:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-11T00:05:10.538 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-11T00:05:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-11T00:05:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-11T00:05:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-11T00:05:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-11T00:05:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-11T00:05:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-11T00:05:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-11T00:05:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-11T00:05:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-11T00:05:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-11T00:05:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-11T00:05:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-11T00:05:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-11T00:05:10.539 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-11T00:05:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-11T00:05:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-11T00:05:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-11T00:05:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-11T00:05:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-11T00:05:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-11T00:05:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-11T00:05:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-11T00:05:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-11T00:05:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-11T00:05:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-11T00:05:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-11T00:05:10.540 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-11T00:05:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-11T00:05:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-11T00:05:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-11T00:05:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-11T00:05:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-11T00:05:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-11T00:05:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-11T00:05:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-11T00:05:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-11T00:05:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-11T00:05:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-11T00:05:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-11T00:05:10.541 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-11T00:05:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-11T00:05:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-11T00:05:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-11T00:05:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-11T00:05:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-11T00:05:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-11T00:05:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-11T00:05:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-11T00:05:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-11T00:05:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-11T00:05:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-11T00:05:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-11T00:05:10.542 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-11T00:05:13.262 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:05:13.263 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-11T00:05:13.263 INFO:teuthology.orchestra.run.smithi112.stdout:Upgraded: 2024-09-11T00:05:13.263 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T00:05:13.263 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T00:05:13.263 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T00:05:13.263 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T00:05:13.263 INFO:teuthology.orchestra.run.smithi112.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.263 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.263 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T00:05:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T00:05:13.264 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-11T00:05:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T00:05:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T00:05:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T00:05:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T00:05:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:05:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.264 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:05:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:05:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:05:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:05:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:05:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:05:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.265 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:05:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:05:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:05:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T00:05:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T00:05:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T00:05:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T00:05:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T00:05:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T00:05:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T00:05:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T00:05:13.266 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T00:05:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T00:05:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T00:05:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T00:05:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T00:05:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T00:05:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T00:05:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T00:05:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T00:05:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.267 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T00:05:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T00:05:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T00:05:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T00:05:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T00:05:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T00:05:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T00:05:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T00:05:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T00:05:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T00:05:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T00:05:13.268 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T00:05:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T00:05:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T00:05:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T00:05:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T00:05:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T00:05:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T00:05:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T00:05:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T00:05:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T00:05:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T00:05:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T00:05:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T00:05:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.269 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T00:05:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T00:05:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T00:05:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T00:05:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T00:05:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T00:05:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T00:05:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T00:05:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T00:05:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T00:05:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T00:05:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T00:05:13.270 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T00:05:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T00:05:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T00:05:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T00:05:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T00:05:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T00:05:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T00:05:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T00:05:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T00:05:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T00:05:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T00:05:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T00:05:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T00:05:13.271 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T00:05:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T00:05:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T00:05:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T00:05:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T00:05:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T00:05:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T00:05:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T00:05:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T00:05:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T00:05:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T00:05:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T00:05:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T00:05:13.272 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T00:05:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T00:05:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T00:05:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T00:05:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T00:05:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T00:05:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T00:05:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T00:05:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T00:05:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T00:05:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T00:05:13.273 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T00:05:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T00:05:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T00:05:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T00:05:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T00:05:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T00:05:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T00:05:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T00:05:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T00:05:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:05:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T00:05:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T00:05:13.274 INFO:teuthology.orchestra.run.smithi112.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T00:05:13.275 INFO:teuthology.orchestra.run.smithi112.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T00:05:13.275 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T00:05:13.275 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T00:05:13.275 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T00:05:13.275 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-11T00:05:13.275 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-11T00:05:13.710 DEBUG:teuthology.parallel:result is None 2024-09-11T00:05:13.711 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:05:13.861 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T00:05:13.887 INFO:teuthology.orchestra.run.smithi078.stdout:19.3.0-4854.g8f219c47.el9 2024-09-11T00:05:13.888 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-11T00:05:13.888 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-11T00:05:13.890 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:05:14.034 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T00:05:14.056 INFO:teuthology.orchestra.run.smithi112.stdout:19.3.0-4854.g8f219c47.el9 2024-09-11T00:05:14.056 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-11T00:05:14.056 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-11T00:05:14.058 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:05:14.202 DEBUG:teuthology.orchestra.run.smithi138:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T00:05:14.229 INFO:teuthology.orchestra.run.smithi138.stdout:19.3.0-4854.g8f219c47.el9 2024-09-11T00:05:14.229 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-11T00:05:14.229 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-11T00:05:14.232 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T00:05:14.233 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-11T00:05:14.233 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T00:05:14.265 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-11T00:05:14.266 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T00:05:14.292 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-11T00:05:14.292 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T00:05:14.325 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T00:05:14.326 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-11T00:05:14.326 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T00:05:14.354 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T00:05:14.421 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-11T00:05:14.421 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T00:05:14.446 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T00:05:14.512 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-11T00:05:14.513 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T00:05:14.543 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T00:05:14.613 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T00:05:14.613 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-11T00:05:14.613 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T00:05:14.641 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T00:05:14.707 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-11T00:05:14.707 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T00:05:14.731 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T00:05:14.795 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-11T00:05:14.796 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T00:05:14.825 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T00:05:14.895 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T00:05:14.895 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-11T00:05:14.895 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T00:05:14.920 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T00:05:14.985 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-11T00:05:14.985 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T00:05:15.010 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T00:05:15.075 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-11T00:05:15.075 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T00:05:15.105 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T00:05:15.174 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-11T00:05:15.281 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug cephsqlite': 20, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug'}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-11T00:05:15.281 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:05:15.282 INFO:tasks.cephadm:Cluster fsid is 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:05:15.282 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-11T00:05:15.282 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.78', 'mon.b': '172.21.15.112', 'mon.c': '172.21.15.138'} 2024-09-11T00:05:15.282 INFO:tasks.cephadm:First mon is mon.a on smithi078 2024-09-11T00:05:15.282 INFO:tasks.cephadm:First mgr is x 2024-09-11T00:05:15.282 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-11T00:05:15.282 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname $(hostname -s) 2024-09-11T00:05:15.308 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname $(hostname -s) 2024-09-11T00:05:15.333 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname $(hostname -s) 2024-09-11T00:05:15.363 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-11T00:05:15.363 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:05:15.513 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82938/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4854-g8f219c47', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4854.g8f219c47'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 09:27:13.215997', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-hemanth-testing-2024-09-10-0723', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-11T00:05:15.660 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-hemanth-testing-2024-09-10-0723, sha1 8f219c476cb4f26fc5719c661c0323719a45cb30 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:05:15.662 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-11T00:05:15.662 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-11T00:05:15.662 DEBUG:teuthology.orchestra.run.smithi078:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T00:05:16.037 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 11 00:05 /home/ubuntu/cephtest/cephadm 2024-09-11T00:05:16.037 DEBUG:teuthology.orchestra.run.smithi112:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T00:05:16.415 INFO:teuthology.orchestra.run.smithi112.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 11 00:05 /home/ubuntu/cephtest/cephadm 2024-09-11T00:05:16.416 DEBUG:teuthology.orchestra.run.smithi138:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T00:05:16.796 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 11 00:05 /home/ubuntu/cephtest/cephadm 2024-09-11T00:05:16.797 DEBUG:teuthology.orchestra.run.smithi078:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T00:05:16.817 DEBUG:teuthology.orchestra.run.smithi112:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T00:05:16.836 DEBUG:teuthology.orchestra.run.smithi138:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T00:05:16.871 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 on all hosts... 2024-09-11T00:05:16.871 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-11T00:05:16.873 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-11T00:05:16.878 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-11T00:05:18.453 INFO:teuthology.orchestra.run.smithi112.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-11T00:05:18.487 INFO:teuthology.orchestra.run.smithi138.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-11T00:05:18.539 INFO:teuthology.orchestra.run.smithi078.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-11T00:05:51.709 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-11T00:05:51.709 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-11T00:05:51.709 INFO:teuthology.orchestra.run.smithi138.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-11T00:05:51.709 INFO:teuthology.orchestra.run.smithi138.stdout: "repo_digests": [ 2024-09-11T00:05:51.709 INFO:teuthology.orchestra.run.smithi138.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-11T00:05:51.709 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-09-11T00:05:51.710 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-11T00:05:54.853 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-11T00:05:54.853 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-11T00:05:54.853 INFO:teuthology.orchestra.run.smithi112.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-11T00:05:54.853 INFO:teuthology.orchestra.run.smithi112.stdout: "repo_digests": [ 2024-09-11T00:05:54.853 INFO:teuthology.orchestra.run.smithi112.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-11T00:05:54.853 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-11T00:05:54.853 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-11T00:05:56.821 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:05:56.821 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-11T00:05:56.821 INFO:teuthology.orchestra.run.smithi078.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-11T00:05:56.821 INFO:teuthology.orchestra.run.smithi078.stdout: "repo_digests": [ 2024-09-11T00:05:56.821 INFO:teuthology.orchestra.run.smithi078.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-11T00:05:56.821 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-09-11T00:05:56.821 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:05:56.846 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph 2024-09-11T00:05:56.891 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph 2024-09-11T00:05:56.924 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph 2024-09-11T00:05:56.959 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /etc/ceph 2024-09-11T00:05:56.984 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /etc/ceph 2024-09-11T00:05:57.013 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 777 /etc/ceph 2024-09-11T00:05:57.042 INFO:tasks.cephadm:Writing seed config... 2024-09-11T00:05:57.043 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-11T00:05:57.043 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-11T00:05:57.043 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-11T00:05:57.043 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-11T00:05:57.043 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-11T00:05:57.043 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-11T00:05:57.044 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-11T00:05:57.044 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-11T00:05:57.044 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-11T00:05:57.044 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-11T00:05:57.044 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-11T00:05:57.044 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-11T00:05:57.044 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-11T00:05:57.044 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-11T00:05:57.044 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-11T00:05:57.044 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-11T00:05:57.044 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-11T00:05:57.044 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-11T00:05:57.045 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-11T00:05:57.045 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-11T00:05:57.045 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-11T00:05:57.045 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-11T00:05:57.045 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-11T00:05:57.045 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-11T00:05:57.045 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-11T00:05:57.046 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-11T00:05:57.046 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-11T00:05:57.061 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 85a53860-6fd1-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-11T00:05:57.062 DEBUG:teuthology.orchestra.run.smithi078:mon.a> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mon.a.service 2024-09-11T00:05:57.104 DEBUG:teuthology.orchestra.run.smithi078:mgr.x> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mgr.x.service 2024-09-11T00:05:57.147 INFO:tasks.cephadm:Bootstrapping... 2024-09-11T00:05:57.148 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 -v bootstrap --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.78 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:05:57.351 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-11T00:05:57.352 INFO:teuthology.orchestra.run.smithi078.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', '-v', 'bootstrap', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.78', '--skip-admin-label'] 2024-09-11T00:05:57.352 INFO:teuthology.orchestra.run.smithi078.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-11T00:05:57.353 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying podman|docker is present... 2024-09-11T00:05:57.376 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/podman: stdout 5.2.2 2024-09-11T00:05:57.376 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying lvm2 is present... 2024-09-11T00:05:57.376 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying time synchronization is in place... 2024-09-11T00:05:57.383 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-11T00:05:57.384 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-11T00:05:57.390 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-11T00:05:57.390 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout inactive 2024-09-11T00:05:57.396 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout enabled 2024-09-11T00:05:57.403 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout active 2024-09-11T00:05:57.403 INFO:teuthology.orchestra.run.smithi078.stdout:Unit chronyd.service is enabled and running 2024-09-11T00:05:57.403 INFO:teuthology.orchestra.run.smithi078.stdout:Repeating the final host check... 2024-09-11T00:05:57.424 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/podman: stdout 5.2.2 2024-09-11T00:05:57.424 INFO:teuthology.orchestra.run.smithi078.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-11T00:05:57.424 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl is present 2024-09-11T00:05:57.425 INFO:teuthology.orchestra.run.smithi078.stdout:lvcreate is present 2024-09-11T00:05:57.431 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-11T00:05:57.431 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-11T00:05:57.437 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-11T00:05:57.437 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout inactive 2024-09-11T00:05:57.443 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout enabled 2024-09-11T00:05:57.450 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout active 2024-09-11T00:05:57.450 INFO:teuthology.orchestra.run.smithi078.stdout:Unit chronyd.service is enabled and running 2024-09-11T00:05:57.450 INFO:teuthology.orchestra.run.smithi078.stdout:Host looks OK 2024-09-11T00:05:57.450 INFO:teuthology.orchestra.run.smithi078.stdout:Cluster fsid: 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:05:57.450 INFO:teuthology.orchestra.run.smithi078.stdout:Acquiring lock 140010929509232 on /run/cephadm/85a53860-6fd1-11ef-bcea-c7b262605968.lock 2024-09-11T00:05:57.450 INFO:teuthology.orchestra.run.smithi078.stdout:Lock 140010929509232 acquired on /run/cephadm/85a53860-6fd1-11ef-bcea-c7b262605968.lock 2024-09-11T00:05:57.451 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying IP 172.21.15.78 port 3300 ... 2024-09-11T00:05:57.451 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying IP 172.21.15.78 port 6789 ... 2024-09-11T00:05:57.451 INFO:teuthology.orchestra.run.smithi078.stdout:Base mon IP(s) is [172.21.15.78:3300, 172.21.15.78:6789], mon addrv is [v2:172.21.15.78:3300,v1:172.21.15.78:6789] 2024-09-11T00:05:57.454 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.78 metric 100 2024-09-11T00:05:57.455 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.78 metric 100 2024-09-11T00:05:57.457 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-11T00:05:57.457 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-11T00:05:57.457 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-11T00:05:57.459 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-11T00:05:57.459 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-11T00:05:57.459 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-11T00:05:57.459 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-11T00:05:57.459 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link noprefixroute 2024-09-11T00:05:57.459 INFO:teuthology.orchestra.run.smithi078.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-11T00:05:57.460 INFO:teuthology.orchestra.run.smithi078.stdout:Mon IP `172.21.15.78` is in CIDR network `172.21.0.0/20` 2024-09-11T00:05:57.460 INFO:teuthology.orchestra.run.smithi078.stdout:Mon IP `172.21.15.78` is in CIDR network `172.21.0.0/20` 2024-09-11T00:05:57.460 INFO:teuthology.orchestra.run.smithi078.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-11T00:05:57.460 INFO:teuthology.orchestra.run.smithi078.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-11T00:05:57.461 INFO:teuthology.orchestra.run.smithi078.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-11T00:05:57.948 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/podman: stdout 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-11T00:05:57.948 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-11T00:05:57.948 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/podman: stderr Getting image source signatures 2024-09-11T00:05:57.948 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/podman: stderr Copying blob sha256:edd8cbe4deb828f809e8d76f308301dd93e971948e909d25cc03015fed1fd796 2024-09-11T00:05:57.949 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-11T00:05:57.949 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/podman: stderr Copying config sha256:589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-11T00:05:57.949 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-11T00:05:58.811 INFO:teuthology.orchestra.run.smithi078.stdout:ceph: stdout ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-11T00:05:58.811 INFO:teuthology.orchestra.run.smithi078.stdout:Ceph version: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-11T00:05:58.811 INFO:teuthology.orchestra.run.smithi078.stdout:Extracting ceph user uid/gid from container image... 2024-09-11T00:05:59.649 INFO:teuthology.orchestra.run.smithi078.stdout:stat: stdout 167 167 2024-09-11T00:05:59.649 INFO:teuthology.orchestra.run.smithi078.stdout:Creating initial keys... 2024-09-11T00:06:00.471 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-authtool: stdout AQDn3uBm32P7NxAACV5+vv78I79nmnO/X65MbQ== 2024-09-11T00:06:01.427 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-authtool: stdout AQDo3uBmxKbwMBAAKwrzMVPX8MsB6p3lp1T0YQ== 2024-09-11T00:06:02.383 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph-authtool: stdout AQDp3uBmjWLGLBAAjcPCmCHI0r7L6gYqqr76TQ== 2024-09-11T00:06:02.383 INFO:teuthology.orchestra.run.smithi078.stdout:Creating initial monmap... 2024-09-11T00:06:03.339 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-11T00:06:03.339 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-11T00:06:03.339 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:06:03.340 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-11T00:06:03.340 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool for a [v2:172.21.15.78:3300,v1:172.21.15.78:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-11T00:06:03.340 INFO:teuthology.orchestra.run.smithi078.stdout:setting min_mon_release = quincy 2024-09-11T00:06:03.340 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/monmaptool: set fsid to 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:06:03.340 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-11T00:06:03.340 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:06:03.340 INFO:teuthology.orchestra.run.smithi078.stdout:Creating mon... 2024-09-11T00:06:04.269 INFO:teuthology.orchestra.run.smithi078.stdout:create mon.a on 2024-09-11T00:06:04.481 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-11T00:06:04.625 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-11T00:06:04.812 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-85a53860-6fd1-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-85a53860-6fd1-11ef-bcea-c7b262605968.target. 2024-09-11T00:06:04.812 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-85a53860-6fd1-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-85a53860-6fd1-11ef-bcea-c7b262605968.target. 2024-09-11T00:06:05.045 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mon.a 2024-09-11T00:06:05.045 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Failed to reset failed state of unit ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-11T00:06:05.202 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-85a53860-6fd1-11ef-bcea-c7b262605968.target.wants/ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-85a53860-6fd1-11ef-bcea-c7b262605968@.service. 2024-09-11T00:06:05.707 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:05 smithi078 podman[30484]: 2024-09-11 00:06:05.665282021 +0000 UTC m=+0.341232791 container start e7ec94bf6d7f6a0a3b7ac02b470c9dda378fc4501602295655a18502a30e0a16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-11T00:06:05.759 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T00:06:05.759 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout disabled 2024-09-11T00:06:05.766 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T00:06:05.766 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout inactive 2024-09-11T00:06:05.766 INFO:teuthology.orchestra.run.smithi078.stdout:firewalld.service is not enabled 2024-09-11T00:06:05.766 INFO:teuthology.orchestra.run.smithi078.stdout:Not possible to enable service . firewalld.service is not available 2024-09-11T00:06:05.767 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for mon to start... 2024-09-11T00:06:05.767 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for mon... 2024-09-11T00:06:05.965 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:05 smithi078 ceph-mon[30502]: mkfs 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:06:05.965 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:05 smithi078 ceph-mon[30502]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T00:06:05.965 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:05 smithi078 bash[30484]: e7ec94bf6d7f6a0a3b7ac02b470c9dda378fc4501602295655a18502a30e0a16 2024-09-11T00:06:05.966 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:05 smithi078 systemd[1]: Started Ceph mon.a for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:06:06.753 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:06 smithi078 ceph-mon[30502]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T00:06:06.753 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:06 smithi078 ceph-mon[30502]: monmap epoch 1 2024-09-11T00:06:06.753 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:06 smithi078 ceph-mon[30502]: fsid 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:06:06.753 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:06 smithi078 ceph-mon[30502]: last_changed 2024-09-11T00:06:02.756204+0000 2024-09-11T00:06:06.753 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:06 smithi078 ceph-mon[30502]: created 2024-09-11T00:06:02.756204+0000 2024-09-11T00:06:06.753 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:06 smithi078 ceph-mon[30502]: min_mon_release 19 (squid) 2024-09-11T00:06:06.753 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:06 smithi078 ceph-mon[30502]: election_strategy: 1 2024-09-11T00:06:06.753 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:06 smithi078 ceph-mon[30502]: 0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-11T00:06:06.753 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:06 smithi078 ceph-mon[30502]: fsmap 2024-09-11T00:06:06.753 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:06 smithi078 ceph-mon[30502]: osdmap e1: 0 total, 0 up, 0 in 2024-09-11T00:06:06.753 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:06 smithi078 ceph-mon[30502]: mgrmap e1: no daemons active 2024-09-11T00:06:06.754 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:06 smithi078 ceph-mon[30502]: from='client.? 172.21.15.78:0/4144847352' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-11T00:06:06.755 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout cluster: 2024-09-11T00:06:06.757 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout id: 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:06:06.757 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-11T00:06:06.757 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-11T00:06:06.757 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout services: 2024-09-11T00:06:06.757 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.51402s) 2024-09-11T00:06:06.757 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-11T00:06:06.757 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-11T00:06:06.757 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-11T00:06:06.758 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout data: 2024-09-11T00:06:06.758 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-11T00:06:06.758 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-11T00:06:06.758 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-11T00:06:06.758 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout pgs: 2024-09-11T00:06:06.758 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-11T00:06:06.758 INFO:teuthology.orchestra.run.smithi078.stdout:mon is available 2024-09-11T00:06:06.758 INFO:teuthology.orchestra.run.smithi078.stdout:Assimilating anything we can from ceph.conf... 2024-09-11T00:06:07.754 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-11T00:06:07.754 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout [global] 2024-09-11T00:06:07.754 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout fsid = 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:06:07.755 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-11T00:06:07.755 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.78:3300,v1:172.21.15.78:6789] 2024-09-11T00:06:07.755 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-11T00:06:07.755 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-11T00:06:07.755 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-11T00:06:07.755 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-11T00:06:07.755 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-11T00:06:07.755 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-11T00:06:07.755 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-11T00:06:07.755 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-11T00:06:07.755 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout [osd] 2024-09-11T00:06:07.755 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-11T00:06:07.756 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-11T00:06:07.756 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-11T00:06:07.756 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-11T00:06:07.756 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-11T00:06:07.756 INFO:teuthology.orchestra.run.smithi078.stdout:Generating new minimal ceph.conf... 2024-09-11T00:06:07.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:07 smithi078 ceph-mon[30502]: from='client.? 172.21.15.78:0/2938523779' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-11T00:06:07.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:07 smithi078 ceph-mon[30502]: from='client.? 172.21.15.78:0/2938523779' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-11T00:06:08.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:08 smithi078 ceph-mon[30502]: from='client.? 172.21.15.78:0/493658664' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:06:08.842 INFO:teuthology.orchestra.run.smithi078.stdout:Restarting the monitor... 2024-09-11T00:06:09.118 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:08 smithi078 systemd[1]: Stopping Ceph mon.a for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:06:09.401 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:09 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-a[30498]: 2024-09-11T00:06:09.116+0000 7f372f267640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:06:09.401 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:09 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-a[30498]: 2024-09-11T00:06:09.116+0000 7f372f267640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-11T00:06:09.401 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:09 smithi078 podman[30740]: 2024-09-11 00:06:09.137283398 +0000 UTC m=+0.136849346 container died e7ec94bf6d7f6a0a3b7ac02b470c9dda378fc4501602295655a18502a30e0a16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-11T00:06:09.751 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:09 smithi078 podman[30740]: 2024-09-11 00:06:09.49951883 +0000 UTC m=+0.499084774 container cleanup e7ec94bf6d7f6a0a3b7ac02b470c9dda378fc4501602295655a18502a30e0a16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0) 2024-09-11T00:06:09.751 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:09 smithi078 bash[30740]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-a 2024-09-11T00:06:10.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:09 smithi078 podman[30753]: 2024-09-11 00:06:09.750340672 +0000 UTC m=+0.610340198 container remove e7ec94bf6d7f6a0a3b7ac02b470c9dda378fc4501602295655a18502a30e0a16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:06:10.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:09 smithi078 systemd[1]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-11T00:06:10.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:09 smithi078 systemd[1]: Stopped Ceph mon.a for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:06:10.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:09 smithi078 systemd[1]: Starting Ceph mon.a for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:06:10.405 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 podman[30845]: 2024-09-11 00:06:10.019218021 +0000 UTC m=+0.015861837 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:06:10.405 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 podman[30845]: 2024-09-11 00:06:10.12647095 +0000 UTC m=+0.123114807 container create bbe0280c637f15797db422ec026267387eebe74d60a085d3471efc9dea76c0bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-a, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-11T00:06:10.405 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 podman[30845]: 2024-09-11 00:06:10.321114276 +0000 UTC m=+0.317758087 container init bbe0280c637f15797db422ec026267387eebe74d60a085d3471efc9dea76c0bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0) 2024-09-11T00:06:10.405 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 podman[30845]: 2024-09-11 00:06:10.324430066 +0000 UTC m=+0.321073879 container start bbe0280c637f15797db422ec026267387eebe74d60a085d3471efc9dea76c0bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731) 2024-09-11T00:06:10.406 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: set uid:gid to 167:167 (ceph:ceph) 2024-09-11T00:06:10.406 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-11T00:06:10.406 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: pidfile_write: ignore empty --pid-file 2024-09-11T00:06:10.406 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: load: jerasure load: lrc 2024-09-11T00:06:10.406 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: RocksDB version: 7.9.2 2024-09-11T00:06:10.406 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Git sha 0 2024-09-11T00:06:10.406 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-11T00:06:10.406 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: DB SUMMARY 2024-09-11T00:06:10.406 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: DB Session ID: NO526CTOD3TNS7AP9008 2024-09-11T00:06:10.406 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: CURRENT file: CURRENT 2024-09-11T00:06:10.406 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: IDENTITY file: IDENTITY 2024-09-11T00:06:10.407 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-11T00:06:10.407 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-11T00:06:10.407 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95122 ; 2024-09-11T00:06:10.408 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.error_if_exists: 0 2024-09-11T00:06:10.408 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.create_if_missing: 0 2024-09-11T00:06:10.408 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.paranoid_checks: 1 2024-09-11T00:06:10.408 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-11T00:06:10.409 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-11T00:06:10.409 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-11T00:06:10.409 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.env: 0x5632e81d2180 2024-09-11T00:06:10.409 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.fs: PosixFileSystem 2024-09-11T00:06:10.409 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.info_log: 0x5632e90ff700 2024-09-11T00:06:10.409 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_file_opening_threads: 16 2024-09-11T00:06:10.409 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.statistics: (nil) 2024-09-11T00:06:10.409 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.use_fsync: 0 2024-09-11T00:06:10.409 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_log_file_size: 0 2024-09-11T00:06:10.409 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-11T00:06:10.409 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-11T00:06:10.409 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.keep_log_file_num: 1000 2024-09-11T00:06:10.409 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.recycle_log_file_num: 0 2024-09-11T00:06:10.410 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.allow_fallocate: 1 2024-09-11T00:06:10.410 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.allow_mmap_reads: 0 2024-09-11T00:06:10.410 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.allow_mmap_writes: 0 2024-09-11T00:06:10.410 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.use_direct_reads: 0 2024-09-11T00:06:10.410 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-11T00:06:10.410 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.create_missing_column_families: 0 2024-09-11T00:06:10.410 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.db_log_dir: 2024-09-11T00:06:10.410 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.wal_dir: 2024-09-11T00:06:10.410 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-11T00:06:10.410 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-11T00:06:10.410 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-11T00:06:10.410 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-11T00:06:10.410 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-11T00:06:10.411 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-11T00:06:10.411 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.advise_random_on_open: 1 2024-09-11T00:06:10.411 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.db_write_buffer_size: 0 2024-09-11T00:06:10.411 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.write_buffer_manager: 0x5632e9103b80 2024-09-11T00:06:10.411 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-11T00:06:10.411 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-11T00:06:10.411 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-11T00:06:10.411 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.rate_limiter: (nil) 2024-09-11T00:06:10.411 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-11T00:06:10.411 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.wal_recovery_mode: 2 2024-09-11T00:06:10.411 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.enable_thread_tracking: 0 2024-09-11T00:06:10.411 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.enable_pipelined_write: 0 2024-09-11T00:06:10.411 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.unordered_write: 0 2024-09-11T00:06:10.412 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-11T00:06:10.412 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-11T00:06:10.412 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-11T00:06:10.412 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-11T00:06:10.412 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.row_cache: None 2024-09-11T00:06:10.412 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.wal_filter: None 2024-09-11T00:06:10.412 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-11T00:06:10.412 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.allow_ingest_behind: 0 2024-09-11T00:06:10.412 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.two_write_queues: 0 2024-09-11T00:06:10.412 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.manual_wal_flush: 0 2024-09-11T00:06:10.412 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.wal_compression: 0 2024-09-11T00:06:10.412 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.atomic_flush: 0 2024-09-11T00:06:10.412 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-11T00:06:10.413 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-11T00:06:10.413 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-11T00:06:10.413 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.log_readahead_size: 0 2024-09-11T00:06:10.413 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-11T00:06:10.413 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.best_efforts_recovery: 0 2024-09-11T00:06:10.413 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-11T00:06:10.413 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-11T00:06:10.413 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.allow_data_in_errors: 0 2024-09-11T00:06:10.413 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.db_host_id: __hostname__ 2024-09-11T00:06:10.413 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-11T00:06:10.413 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_background_jobs: 2 2024-09-11T00:06:10.413 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_background_compactions: -1 2024-09-11T00:06:10.413 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_subcompactions: 1 2024-09-11T00:06:10.413 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-11T00:06:10.414 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-11T00:06:10.414 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-11T00:06:10.414 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_total_wal_size: 0 2024-09-11T00:06:10.414 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-11T00:06:10.414 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-11T00:06:10.414 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-11T00:06:10.414 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-11T00:06:10.414 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_open_files: -1 2024-09-11T00:06:10.414 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.bytes_per_sync: 0 2024-09-11T00:06:10.414 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-11T00:06:10.414 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-11T00:06:10.414 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compaction_readahead_size: 0 2024-09-11T00:06:10.414 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_background_flushes: -1 2024-09-11T00:06:10.414 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Compression algorithms supported: 2024-09-11T00:06:10.415 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: kZSTD supported: 0 2024-09-11T00:06:10.415 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: kXpressCompression supported: 0 2024-09-11T00:06:10.415 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: kBZip2Compression supported: 0 2024-09-11T00:06:10.415 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-11T00:06:10.415 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: kLZ4Compression supported: 1 2024-09-11T00:06:10.415 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: kZlibCompression supported: 1 2024-09-11T00:06:10.415 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: kLZ4HCCompression supported: 1 2024-09-11T00:06:10.415 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: kSnappyCompression supported: 1 2024-09-11T00:06:10.415 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-11T00:06:10.415 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-11T00:06:10.415 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-11T00:06:10.415 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-11T00:06:10.415 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-11T00:06:10.415 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.merge_operator: 2024-09-11T00:06:10.415 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compaction_filter: None 2024-09-11T00:06:10.416 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compaction_filter_factory: None 2024-09-11T00:06:10.416 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.sst_partitioner_factory: None 2024-09-11T00:06:10.416 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-11T00:06:10.416 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-11T00:06:10.416 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5632e90ff320) 2024-09-11T00:06:10.416 INFO:journalctl@ceph.mon.a.smithi078.stdout: cache_index_and_filter_blocks: 1 2024-09-11T00:06:10.416 INFO:journalctl@ceph.mon.a.smithi078.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-11T00:06:10.416 INFO:journalctl@ceph.mon.a.smithi078.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-11T00:06:10.416 INFO:journalctl@ceph.mon.a.smithi078.stdout: pin_top_level_index_and_filter: 1 2024-09-11T00:06:10.416 INFO:journalctl@ceph.mon.a.smithi078.stdout: index_type: 0 2024-09-11T00:06:10.417 INFO:journalctl@ceph.mon.a.smithi078.stdout: data_block_index_type: 0 2024-09-11T00:06:10.417 INFO:journalctl@ceph.mon.a.smithi078.stdout: index_shortening: 1 2024-09-11T00:06:10.417 INFO:journalctl@ceph.mon.a.smithi078.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-11T00:06:10.417 INFO:journalctl@ceph.mon.a.smithi078.stdout: checksum: 4 2024-09-11T00:06:10.417 INFO:journalctl@ceph.mon.a.smithi078.stdout: no_block_cache: 0 2024-09-11T00:06:10.417 INFO:journalctl@ceph.mon.a.smithi078.stdout: block_cache: 0x5632e90f3610 2024-09-11T00:06:10.417 INFO:journalctl@ceph.mon.a.smithi078.stdout: block_cache_name: BinnedLRUCache 2024-09-11T00:06:10.417 INFO:journalctl@ceph.mon.a.smithi078.stdout: block_cache_options: 2024-09-11T00:06:10.417 INFO:journalctl@ceph.mon.a.smithi078.stdout: capacity : 536870912 2024-09-11T00:06:10.417 INFO:journalctl@ceph.mon.a.smithi078.stdout: num_shard_bits : 4 2024-09-11T00:06:10.417 INFO:journalctl@ceph.mon.a.smithi078.stdout: strict_capacity_limit : 0 2024-09-11T00:06:10.417 INFO:journalctl@ceph.mon.a.smithi078.stdout: high_pri_pool_ratio: 0.000 2024-09-11T00:06:10.417 INFO:journalctl@ceph.mon.a.smithi078.stdout: block_cache_compressed: (nil) 2024-09-11T00:06:10.418 INFO:journalctl@ceph.mon.a.smithi078.stdout: persistent_cache: (nil) 2024-09-11T00:06:10.418 INFO:journalctl@ceph.mon.a.smithi078.stdout: block_size: 4096 2024-09-11T00:06:10.418 INFO:journalctl@ceph.mon.a.smithi078.stdout: block_size_deviation: 10 2024-09-11T00:06:10.418 INFO:journalctl@ceph.mon.a.smithi078.stdout: block_restart_interval: 16 2024-09-11T00:06:10.418 INFO:journalctl@ceph.mon.a.smithi078.stdout: index_block_restart_interval: 1 2024-09-11T00:06:10.418 INFO:journalctl@ceph.mon.a.smithi078.stdout: metadata_block_size: 4096 2024-09-11T00:06:10.418 INFO:journalctl@ceph.mon.a.smithi078.stdout: partition_filters: 0 2024-09-11T00:06:10.418 INFO:journalctl@ceph.mon.a.smithi078.stdout: use_delta_encoding: 1 2024-09-11T00:06:10.418 INFO:journalctl@ceph.mon.a.smithi078.stdout: filter_policy: bloomfilter 2024-09-11T00:06:10.418 INFO:journalctl@ceph.mon.a.smithi078.stdout: whole_key_filtering: 1 2024-09-11T00:06:10.418 INFO:journalctl@ceph.mon.a.smithi078.stdout: verify_compression: 0 2024-09-11T00:06:10.418 INFO:journalctl@ceph.mon.a.smithi078.stdout: read_amp_bytes_per_bit: 0 2024-09-11T00:06:10.418 INFO:journalctl@ceph.mon.a.smithi078.stdout: format_version: 5 2024-09-11T00:06:10.418 INFO:journalctl@ceph.mon.a.smithi078.stdout: enable_index_compression: 1 2024-09-11T00:06:10.418 INFO:journalctl@ceph.mon.a.smithi078.stdout: block_align: 0 2024-09-11T00:06:10.419 INFO:journalctl@ceph.mon.a.smithi078.stdout: max_auto_readahead_size: 262144 2024-09-11T00:06:10.419 INFO:journalctl@ceph.mon.a.smithi078.stdout: prepopulate_block_cache: 0 2024-09-11T00:06:10.419 INFO:journalctl@ceph.mon.a.smithi078.stdout: initial_auto_readahead_size: 8192 2024-09-11T00:06:10.419 INFO:journalctl@ceph.mon.a.smithi078.stdout: num_file_reads_for_auto_readahead: 2 2024-09-11T00:06:10.419 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.write_buffer_size: 33554432 2024-09-11T00:06:10.419 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_write_buffer_number: 2 2024-09-11T00:06:10.419 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compression: NoCompression 2024-09-11T00:06:10.419 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.bottommost_compression: Disabled 2024-09-11T00:06:10.419 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.prefix_extractor: nullptr 2024-09-11T00:06:10.419 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-11T00:06:10.419 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.num_levels: 7 2024-09-11T00:06:10.419 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-11T00:06:10.419 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-11T00:06:10.419 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-11T00:06:10.420 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-11T00:06:10.420 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-11T00:06:10.420 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-11T00:06:10.420 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-11T00:06:10.420 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-11T00:06:10.420 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-11T00:06:10.420 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-11T00:06:10.420 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-11T00:06:10.420 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-11T00:06:10.420 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-11T00:06:10.420 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compression_opts.level: 32767 2024-09-11T00:06:10.420 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compression_opts.strategy: 0 2024-09-11T00:06:10.420 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-11T00:06:10.420 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-11T00:06:10.421 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-11T00:06:10.421 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-11T00:06:10.421 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compression_opts.enabled: false 2024-09-11T00:06:10.421 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-11T00:06:10.421 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-11T00:06:10.421 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-11T00:06:10.421 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-11T00:06:10.421 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.target_file_size_base: 67108864 2024-09-11T00:06:10.421 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-11T00:06:10.421 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-11T00:06:10.421 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-11T00:06:10.422 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-11T00:06:10.422 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-11T00:06:10.422 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-11T00:06:10.422 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-11T00:06:10.422 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-11T00:06:10.422 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-11T00:06:10.422 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-11T00:06:10.422 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-11T00:06:10.422 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-11T00:06:10.422 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-11T00:06:10.422 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-11T00:06:10.422 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.arena_block_size: 1048576 2024-09-11T00:06:10.422 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-11T00:06:10.422 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-11T00:06:10.423 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.disable_auto_compactions: 0 2024-09-11T00:06:10.423 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-11T00:06:10.423 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-11T00:06:10.423 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-11T00:06:10.423 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-11T00:06:10.423 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-11T00:06:10.423 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-11T00:06:10.423 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-11T00:06:10.423 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-11T00:06:10.423 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-11T00:06:10.423 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-11T00:06:10.423 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-11T00:06:10.424 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.inplace_update_support: 0 2024-09-11T00:06:10.424 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-11T00:06:10.424 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-11T00:06:10.424 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-11T00:06:10.424 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-11T00:06:10.424 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.bloom_locality: 0 2024-09-11T00:06:10.424 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.max_successive_merges: 0 2024-09-11T00:06:10.424 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-11T00:06:10.424 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.paranoid_file_checks: 0 2024-09-11T00:06:10.424 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.force_consistency_checks: 1 2024-09-11T00:06:10.424 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.report_bg_io_stats: 0 2024-09-11T00:06:10.425 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.ttl: 2592000 2024-09-11T00:06:10.425 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-11T00:06:10.425 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-11T00:06:10.425 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-11T00:06:10.425 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.enable_blob_files: false 2024-09-11T00:06:10.425 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.min_blob_size: 0 2024-09-11T00:06:10.425 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.blob_file_size: 268435456 2024-09-11T00:06:10.425 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-11T00:06:10.425 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-11T00:06:10.425 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-11T00:06:10.425 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-11T00:06:10.425 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-11T00:06:10.425 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.blob_file_starting_level: 0 2024-09-11T00:06:10.425 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-11T00:06:10.426 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-11T00:06:10.426 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-11T00:06:10.426 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7fe14cb5-a1a9-46e2-bb33-618dc9b5c337 2024-09-11T00:06:10.426 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726013170350428, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-11T00:06:10.426 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-11T00:06:10.426 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726013170351385, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91275, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 285, "table_properties": {"data_size": 89323, "index_size": 272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11686, "raw_average_key_size": 47, "raw_value_size": 82743, "raw_average_value_size": 339, "num_data_blocks": 12, "num_entries": 244, "num_filter_entries": 244, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726013170, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7fe14cb5-a1a9-46e2-bb33-618dc9b5c337", "db_session_id": "NO526CTOD3TNS7AP9008", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-11T00:06:10.426 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726013170351477, "job": 1, "event": "recovery_finished"} 2024-09-11T00:06:10.426 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-11T00:06:10.426 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-11T00:06:10.426 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5632e9122e00 2024-09-11T00:06:10.426 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: DB pointer 0x5632e9224000 2024-09-11T00:06:10.426 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-11T00:06:10.426 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-11T00:06:10.426 INFO:journalctl@ceph.mon.a.smithi078.stdout: ** DB Stats ** 2024-09-11T00:06:10.427 INFO:journalctl@ceph.mon.a.smithi078.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T00:06:10.427 INFO:journalctl@ceph.mon.a.smithi078.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-11T00:06:10.427 INFO:journalctl@ceph.mon.a.smithi078.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T00:06:10.427 INFO:journalctl@ceph.mon.a.smithi078.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T00:06:10.427 INFO:journalctl@ceph.mon.a.smithi078.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-11T00:06:10.427 INFO:journalctl@ceph.mon.a.smithi078.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T00:06:10.427 INFO:journalctl@ceph.mon.a.smithi078.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T00:06:10.427 INFO:journalctl@ceph.mon.a.smithi078.stdout: 2024-09-11T00:06:10.427 INFO:journalctl@ceph.mon.a.smithi078.stdout: ** Compaction Stats [default] ** 2024-09-11T00:06:10.427 INFO:journalctl@ceph.mon.a.smithi078.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T00:06:10.427 INFO:journalctl@ceph.mon.a.smithi078.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-11T00:06:10.427 INFO:journalctl@ceph.mon.a.smithi078.stdout: L0 2/0 91.00 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 136.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T00:06:10.427 INFO:journalctl@ceph.mon.a.smithi078.stdout: Sum 2/0 91.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 136.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T00:06:10.428 INFO:journalctl@ceph.mon.a.smithi078.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 136.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T00:06:10.428 INFO:journalctl@ceph.mon.a.smithi078.stdout: 2024-09-11T00:06:10.428 INFO:journalctl@ceph.mon.a.smithi078.stdout: ** Compaction Stats [default] ** 2024-09-11T00:06:10.428 INFO:journalctl@ceph.mon.a.smithi078.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T00:06:10.428 INFO:journalctl@ceph.mon.a.smithi078.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T00:06:10.428 INFO:journalctl@ceph.mon.a.smithi078.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 136.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T00:06:10.428 INFO:journalctl@ceph.mon.a.smithi078.stdout: 2024-09-11T00:06:10.428 INFO:journalctl@ceph.mon.a.smithi078.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-11T00:06:10.428 INFO:journalctl@ceph.mon.a.smithi078.stdout: 2024-09-11T00:06:10.428 INFO:journalctl@ceph.mon.a.smithi078.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T00:06:10.428 INFO:journalctl@ceph.mon.a.smithi078.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-11T00:06:10.428 INFO:journalctl@ceph.mon.a.smithi078.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-11T00:06:10.428 INFO:journalctl@ceph.mon.a.smithi078.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-11T00:06:10.428 INFO:journalctl@ceph.mon.a.smithi078.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-11T00:06:10.429 INFO:journalctl@ceph.mon.a.smithi078.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-11T00:06:10.429 INFO:journalctl@ceph.mon.a.smithi078.stdout: Cumulative compaction: 0.00 GB write, 28.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T00:06:10.429 INFO:journalctl@ceph.mon.a.smithi078.stdout: Interval compaction: 0.00 GB write, 28.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T00:06:10.429 INFO:journalctl@ceph.mon.a.smithi078.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-11T00:06:10.429 INFO:journalctl@ceph.mon.a.smithi078.stdout: Block cache BinnedLRUCache@0x5632e90f3610#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-11T00:06:10.429 INFO:journalctl@ceph.mon.a.smithi078.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-11T00:06:10.429 INFO:journalctl@ceph.mon.a.smithi078.stdout: 2024-09-11T00:06:10.429 INFO:journalctl@ceph.mon.a.smithi078.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-11T00:06:10.429 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: starting mon.a rank 0 at public addrs [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] at bind addrs [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:06:10.429 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: mon.a@-1(???) e1 preinit fsid 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:06:10.429 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: mon.a@-1(???).mds e1 new map 2024-09-11T00:06:10.429 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: mon.a@-1(???).mds e1 print_map 2024-09-11T00:06:10.429 INFO:journalctl@ceph.mon.a.smithi078.stdout: e1 2024-09-11T00:06:10.429 INFO:journalctl@ceph.mon.a.smithi078.stdout: btime 2024-09-11T00:06:05:704536+0000 2024-09-11T00:06:10.430 INFO:journalctl@ceph.mon.a.smithi078.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:06:10.430 INFO:journalctl@ceph.mon.a.smithi078.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T00:06:10.430 INFO:journalctl@ceph.mon.a.smithi078.stdout: legacy client fscid: -1 2024-09-11T00:06:10.430 INFO:journalctl@ceph.mon.a.smithi078.stdout: 2024-09-11T00:06:10.430 INFO:journalctl@ceph.mon.a.smithi078.stdout: No filesystems configured 2024-09-11T00:06:10.430 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-11T00:06:10.430 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T00:06:10.430 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T00:06:10.430 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T00:06:10.430 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-11T00:06:10.430 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 bash[30845]: bbe0280c637f15797db422ec026267387eebe74d60a085d3471efc9dea76c0bb 2024-09-11T00:06:10.430 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 systemd[1]: Started Ceph mon.a for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:06:10.431 INFO:teuthology.orchestra.run.smithi078.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-11T00:06:10.691 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T00:06:10.691 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: monmap epoch 1 2024-09-11T00:06:10.691 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: fsid 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:06:10.691 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: last_changed 2024-09-11T00:06:02.756204+0000 2024-09-11T00:06:10.691 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: created 2024-09-11T00:06:02.756204+0000 2024-09-11T00:06:10.691 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: min_mon_release 19 (squid) 2024-09-11T00:06:10.691 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: election_strategy: 1 2024-09-11T00:06:10.691 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: 0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-11T00:06:10.691 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: fsmap 2024-09-11T00:06:10.692 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: osdmap e1: 0 total, 0 up, 0 in 2024-09-11T00:06:10.692 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:10 smithi078 ceph-mon[30865]: mgrmap e1: no daemons active 2024-09-11T00:06:11.405 INFO:teuthology.orchestra.run.smithi078.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-11T00:06:11.427 INFO:teuthology.orchestra.run.smithi078.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:06:11.427 INFO:teuthology.orchestra.run.smithi078.stdout:Creating mgr... 2024-09-11T00:06:11.428 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-11T00:06:11.428 INFO:teuthology.orchestra.run.smithi078.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-11T00:06:11.670 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mgr.x 2024-09-11T00:06:11.671 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Failed to reset failed state of unit ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-11T00:06:11.817 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-85a53860-6fd1-11ef-bcea-c7b262605968.target.wants/ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-85a53860-6fd1-11ef-bcea-c7b262605968@.service. 2024-09-11T00:06:12.046 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:11 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1638438042' entity='client.admin' 2024-09-11T00:06:12.046 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:11 smithi078 systemd[1]: Starting Ceph mgr.x for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:06:12.304 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T00:06:12.304 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout disabled 2024-09-11T00:06:12.311 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T00:06:12.311 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout inactive 2024-09-11T00:06:12.311 INFO:teuthology.orchestra.run.smithi078.stdout:firewalld.service is not enabled 2024-09-11T00:06:12.311 INFO:teuthology.orchestra.run.smithi078.stdout:Not possible to enable service . firewalld.service is not available 2024-09-11T00:06:12.320 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T00:06:12.320 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout disabled 2024-09-11T00:06:12.327 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T00:06:12.327 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout inactive 2024-09-11T00:06:12.327 INFO:teuthology.orchestra.run.smithi078.stdout:firewalld.service is not enabled 2024-09-11T00:06:12.327 INFO:teuthology.orchestra.run.smithi078.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-11T00:06:12.328 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for mgr to start... 2024-09-11T00:06:12.328 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for mgr... 2024-09-11T00:06:12.334 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:12 smithi078 podman[31078]: 2024-09-11 00:06:12.045560862 +0000 UTC m=+0.108472550 container create 01d2b57432f8f15c23568bc32f5bbb36debdb16d49212e5363e970a5e689fae8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-11T00:06:12.334 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:12 smithi078 podman[31078]: 2024-09-11 00:06:11.952352635 +0000 UTC m=+0.015264336 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:06:12.334 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:12 smithi078 podman[31078]: 2024-09-11 00:06:12.222843548 +0000 UTC m=+0.285755236 container init 01d2b57432f8f15c23568bc32f5bbb36debdb16d49212e5363e970a5e689fae8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-11T00:06:12.334 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:12 smithi078 podman[31078]: 2024-09-11 00:06:12.225599914 +0000 UTC m=+0.288511613 container start 01d2b57432f8f15c23568bc32f5bbb36debdb16d49212e5363e970a5e689fae8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True) 2024-09-11T00:06:12.334 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:12 smithi078 bash[31078]: 01d2b57432f8f15c23568bc32f5bbb36debdb16d49212e5363e970a5e689fae8 2024-09-11T00:06:12.334 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:12 smithi078 systemd[1]: Started Ceph mgr.x for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:06:13.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:12 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3758553628' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-11T00:06:13.443 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-11T00:06:13.443 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout { 2024-09-11T00:06:13.443 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "fsid": "85a53860-6fd1-11ef-bcea-c7b262605968", 2024-09-11T00:06:13.443 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T00:06:13.443 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T00:06:13.443 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T00:06:13.443 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T00:06:13.444 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:06:13.444 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T00:06:13.444 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T00:06:13.444 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 0 2024-09-11T00:06:13.444 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-11T00:06:13.444 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T00:06:13.444 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T00:06:13.444 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-11T00:06:13.444 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-11T00:06:13.444 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T00:06:13.444 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T00:06:13.444 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T00:06:13.445 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T00:06:13.445 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:06:13.445 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T00:06:13.445 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T00:06:13.445 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T00:06:13.445 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T00:06:13.445 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T00:06:13.445 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T00:06:13.445 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T00:06:13.445 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T00:06:13.449 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:06:13.449 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T00:06:13.449 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T00:06:13.449 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T00:06:13.449 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T00:06:13.449 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T00:06:13.449 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T00:06:13.449 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T00:06:13.450 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T00:06:13.450 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T00:06:13.450 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:06:13.450 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T00:06:13.450 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T00:06:13.450 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T00:06:05:704536+0000", 2024-09-11T00:06:13.450 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T00:06:13.450 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T00:06:13.450 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:06:13.450 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T00:06:13.450 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-11T00:06:13.450 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T00:06:13.450 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T00:06:13.450 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T00:06:13.451 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T00:06:13.451 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T00:06:13.451 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-11T00:06:13.451 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T00:06:13.451 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:06:13.451 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T00:06:13.451 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T00:06:13.451 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T00:06:05.705208+0000", 2024-09-11T00:06:13.451 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T00:06:13.451 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:06:13.451 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T00:06:13.451 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout } 2024-09-11T00:06:13.451 INFO:teuthology.orchestra.run.smithi078.stdout:mgr not available, waiting (1/15)... 2024-09-11T00:06:17.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:17 smithi078 ceph-mon[30865]: Activating manager daemon x 2024-09-11T00:06:17.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:17 smithi078 ceph-mon[30865]: mgrmap e2: x(active, starting, since 0.00337244s) 2024-09-11T00:06:17.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:17 smithi078 ceph-mon[30865]: from='mgr.14100 172.21.15.78:0/2331356138' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-11T00:06:17.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:17 smithi078 ceph-mon[30865]: from='mgr.14100 172.21.15.78:0/2331356138' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-11T00:06:17.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:17 smithi078 ceph-mon[30865]: from='mgr.14100 172.21.15.78:0/2331356138' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-11T00:06:17.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:17 smithi078 ceph-mon[30865]: from='mgr.14100 172.21.15.78:0/2331356138' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:06:17.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:17 smithi078 ceph-mon[30865]: from='mgr.14100 172.21.15.78:0/2331356138' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-11T00:06:17.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:17 smithi078 ceph-mon[30865]: Manager daemon x is now available 2024-09-11T00:06:17.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:17 smithi078 ceph-mon[30865]: from='mgr.14100 172.21.15.78:0/2331356138' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-11T00:06:17.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:17 smithi078 ceph-mon[30865]: from='mgr.14100 172.21.15.78:0/2331356138' entity='mgr.x' 2024-09-11T00:06:17.585 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:17 smithi078 ceph-mon[30865]: from='mgr.14100 172.21.15.78:0/2331356138' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-11T00:06:17.585 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:17 smithi078 ceph-mon[30865]: from='mgr.14100 172.21.15.78:0/2331356138' entity='mgr.x' 2024-09-11T00:06:17.585 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:17 smithi078 ceph-mon[30865]: from='mgr.14100 172.21.15.78:0/2331356138' entity='mgr.x' 2024-09-11T00:06:19.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:19 smithi078 ceph-mon[30865]: mgrmap e3: x(active, since 1.00734s) 2024-09-11T00:06:19.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:19 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1787873007' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-11T00:06:20.583 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:20 smithi078 ceph-mon[30865]: mgrmap e4: x(active, since 2s) 2024-09-11T00:06:25.254 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-11T00:06:25.254 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout { 2024-09-11T00:06:25.254 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "fsid": "85a53860-6fd1-11ef-bcea-c7b262605968", 2024-09-11T00:06:25.254 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T00:06:25.254 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T00:06:25.254 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T00:06:25.255 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T00:06:25.255 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:06:25.255 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T00:06:25.255 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T00:06:25.255 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 0 2024-09-11T00:06:25.255 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-11T00:06:25.255 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T00:06:25.256 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T00:06:25.256 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-11T00:06:25.256 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-11T00:06:25.256 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T00:06:25.256 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T00:06:25.256 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T00:06:25.256 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T00:06:25.256 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:06:25.256 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T00:06:25.257 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T00:06:25.257 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T00:06:25.257 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T00:06:25.257 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T00:06:25.257 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T00:06:25.257 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T00:06:25.257 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T00:06:25.257 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:06:25.258 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T00:06:25.258 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T00:06:25.258 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T00:06:25.258 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T00:06:25.258 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T00:06:25.258 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T00:06:25.258 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T00:06:25.259 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T00:06:25.259 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T00:06:25.259 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:06:25.259 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T00:06:25.259 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T00:06:25.259 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T00:06:05:704536+0000", 2024-09-11T00:06:25.259 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T00:06:25.260 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T00:06:25.260 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:06:25.260 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T00:06:25.260 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T00:06:25.260 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T00:06:25.260 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T00:06:25.260 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T00:06:25.260 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T00:06:25.261 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T00:06:25.261 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ], 2024-09-11T00:06:25.261 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T00:06:25.261 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:06:25.261 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T00:06:25.262 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T00:06:25.262 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T00:06:05.705208+0000", 2024-09-11T00:06:25.262 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T00:06:25.262 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:06:25.262 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T00:06:25.262 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout } 2024-09-11T00:06:25.262 INFO:teuthology.orchestra.run.smithi078.stdout:mgr is available 2024-09-11T00:06:26.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:26 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3113647181' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-11T00:06:27.294 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-11T00:06:27.294 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout [global] 2024-09-11T00:06:27.294 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout fsid = 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:06:27.294 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-11T00:06:27.294 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.78:3300,v1:172.21.15.78:6789] 2024-09-11T00:06:27.294 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-11T00:06:27.294 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-11T00:06:27.294 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-11T00:06:27.294 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-11T00:06:27.295 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-11T00:06:27.295 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-11T00:06:27.295 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-11T00:06:27.295 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 2024-09-11T00:06:27.295 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout [osd] 2024-09-11T00:06:27.295 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-11T00:06:27.295 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-11T00:06:27.295 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-11T00:06:27.295 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-11T00:06:27.295 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-11T00:06:27.295 INFO:teuthology.orchestra.run.smithi078.stdout:Enabling cephadm module... 2024-09-11T00:06:28.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:27 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2849628109' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-11T00:06:28.334 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:27 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: ignoring --setuser ceph since I am not root 2024-09-11T00:06:28.334 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:27 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: ignoring --setgroup ceph since I am not root 2024-09-11T00:06:29.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:28 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2849628109' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-11T00:06:29.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:28 smithi078 ceph-mon[30865]: mgrmap e5: x(active, since 10s) 2024-09-11T00:06:29.630 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout { 2024-09-11T00:06:29.630 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-11T00:06:29.630 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T00:06:29.630 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-11T00:06:29.630 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-11T00:06:29.630 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout } 2024-09-11T00:06:29.630 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for the mgr to restart... 2024-09-11T00:06:29.631 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for mgr epoch 5... 2024-09-11T00:06:30.029 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:29 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2808393999' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-11T00:06:33.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:33 smithi078 ceph-mon[30865]: Active manager daemon x restarted 2024-09-11T00:06:33.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:33 smithi078 ceph-mon[30865]: Activating manager daemon x 2024-09-11T00:06:33.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:33 smithi078 ceph-mon[30865]: osdmap e2: 0 total, 0 up, 0 in 2024-09-11T00:06:33.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:33 smithi078 ceph-mon[30865]: mgrmap e6: x(active, starting, since 0.00316775s) 2024-09-11T00:06:33.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:33 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:06:33.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:33 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-11T00:06:33.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:33 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-11T00:06:33.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:33 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-11T00:06:33.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:33 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-11T00:06:33.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:33 smithi078 ceph-mon[30865]: Manager daemon x is now available 2024-09-11T00:06:34.546 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout { 2024-09-11T00:06:34.547 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-11T00:06:34.547 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-11T00:06:34.547 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout } 2024-09-11T00:06:34.547 INFO:teuthology.orchestra.run.smithi078.stdout:mgr epoch 5 is available 2024-09-11T00:06:34.547 INFO:teuthology.orchestra.run.smithi078.stdout:Setting orchestrator backend to cephadm... 2024-09-11T00:06:35.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:34 smithi078 ceph-mon[30865]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-11T00:06:35.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:34 smithi078 ceph-mon[30865]: mgrmap e7: x(active, since 1.00522s) 2024-09-11T00:06:35.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:34 smithi078 ceph-mon[30865]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-11T00:06:35.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:34 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' 2024-09-11T00:06:35.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:34 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' 2024-09-11T00:06:35.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:34 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' 2024-09-11T00:06:35.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:34 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' 2024-09-11T00:06:35.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:34 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:06:35.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:34 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:06:35.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:34 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-11T00:06:35.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:34 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-11T00:06:35.085 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: 2024-09-11T00:06:35.031+0000 7f9133709640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:00:06:35] ENGINE Error in HTTPServer.serve 2024-09-11T00:06:35.085 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: Traceback (most recent call last): 2024-09-11T00:06:35.085 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T00:06:35.085 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: self._connections.run(self.expiration_interval) 2024-09-11T00:06:35.085 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T00:06:35.085 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: self._run(expiration_interval) 2024-09-11T00:06:35.085 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T00:06:35.085 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T00:06:35.085 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T00:06:35.086 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T00:06:35.086 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T00:06:35.086 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: s = self.context.wrap_socket( 2024-09-11T00:06:35.086 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T00:06:35.086 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: return self.sslsocket_class._create( 2024-09-11T00:06:35.086 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T00:06:35.086 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: self.do_handshake() 2024-09-11T00:06:35.086 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T00:06:35.086 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: self._sslobj.do_handshake() 2024-09-11T00:06:35.086 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T00:06:35.086 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: 2024-09-11T00:06:36.296 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-mon[30865]: Found migration_current of "None". Setting to last migration. 2024-09-11T00:06:36.296 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-mon[30865]: [11/Sep/2024:00:06:34] ENGINE Bus STARTING 2024-09-11T00:06:36.296 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-mon[30865]: [11/Sep/2024:00:06:34] ENGINE Serving on http://172.21.15.78:8765 2024-09-11T00:06:36.297 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:06:36.297 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-mon[30865]: mgrmap e8: x(active, since 2s) 2024-09-11T00:06:36.297 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' 2024-09-11T00:06:36.297 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:35 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:06:36.817 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-11T00:06:36.817 INFO:teuthology.orchestra.run.smithi078.stdout:Generating ssh key... 2024-09-11T00:06:37.208 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:36 smithi078 ceph-mon[30865]: [11/Sep/2024:00:06:35] ENGINE Serving on https://172.21.15.78:7150 2024-09-11T00:06:37.208 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:36 smithi078 ceph-mon[30865]: [11/Sep/2024:00:06:35] ENGINE Bus STARTED 2024-09-11T00:06:37.208 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:36 smithi078 ceph-mon[30865]: [11/Sep/2024:00:06:35] ENGINE Error in HTTPServer.serve 2024-09-11T00:06:37.208 INFO:journalctl@ceph.mon.a.smithi078.stdout: Traceback (most recent call last): 2024-09-11T00:06:37.208 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T00:06:37.208 INFO:journalctl@ceph.mon.a.smithi078.stdout: self._connections.run(self.expiration_interval) 2024-09-11T00:06:37.209 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T00:06:37.209 INFO:journalctl@ceph.mon.a.smithi078.stdout: self._run(expiration_interval) 2024-09-11T00:06:37.209 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T00:06:37.209 INFO:journalctl@ceph.mon.a.smithi078.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T00:06:37.209 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T00:06:37.209 INFO:journalctl@ceph.mon.a.smithi078.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T00:06:37.209 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T00:06:37.209 INFO:journalctl@ceph.mon.a.smithi078.stdout: s = self.context.wrap_socket( 2024-09-11T00:06:37.209 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T00:06:37.209 INFO:journalctl@ceph.mon.a.smithi078.stdout: return self.sslsocket_class._create( 2024-09-11T00:06:37.209 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T00:06:37.209 INFO:journalctl@ceph.mon.a.smithi078.stdout: self.do_handshake() 2024-09-11T00:06:37.209 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T00:06:37.209 INFO:journalctl@ceph.mon.a.smithi078.stdout: self._sslobj.do_handshake() 2024-09-11T00:06:37.210 INFO:journalctl@ceph.mon.a.smithi078.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T00:06:37.210 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:36 smithi078 ceph-mon[30865]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:37.962 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:37 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: Generating public/private rsa key pair. 2024-09-11T00:06:37.962 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:37 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: Your identification has been saved in /tmp/tmpf39z7vx6/key 2024-09-11T00:06:37.962 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:37 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: Your public key has been saved in /tmp/tmpf39z7vx6/key.pub 2024-09-11T00:06:37.962 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:37 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: The key fingerprint is: 2024-09-11T00:06:37.962 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:37 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: SHA256:Kd0EnpE7Cxc8xv340KtBUgw3jIIVfwQ2VHFGGFL4xos ceph-85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:06:37.962 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:37 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: The key's randomart image is: 2024-09-11T00:06:37.962 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:37 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: +---[RSA 3072]----+ 2024-09-11T00:06:37.962 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:37 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: | oo=X%O=+ | 2024-09-11T00:06:37.963 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:37 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: | . .+XO*+ | 2024-09-11T00:06:37.963 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:37 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: | o+Bo+ | 2024-09-11T00:06:37.963 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:37 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: | ..==B o | 2024-09-11T00:06:37.963 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:37 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: | .oSB.+ . | 2024-09-11T00:06:37.963 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:37 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: | .E o o | 2024-09-11T00:06:37.963 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:37 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: | o | 2024-09-11T00:06:37.963 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:37 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: | . | 2024-09-11T00:06:37.963 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:37 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: | | 2024-09-11T00:06:37.963 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:37 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: +----[SHA256]-----+ 2024-09-11T00:06:38.312 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:37 smithi078 ceph-mon[30865]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:38.313 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:37 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' 2024-09-11T00:06:38.313 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:37 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' 2024-09-11T00:06:39.315 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:38 smithi078 ceph-mon[30865]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:39.315 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:38 smithi078 ceph-mon[30865]: Generating ssh key... 2024-09-11T00:06:39.319 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQ8RfBWbIQ7kJiWoq6+pFQYyfmoJYPQ8OkqUnSJJnik1S+Hl/+pT4sJUivQ5DlBvmK0R1hshAYJfCnl+azIX75tPVwd8suaFsfQdD/Tn93QmStTSqqblVoq5yaW+cXLGy+GcYZXtGiZxF+0Y7ESeATgRrlrvlmZ7Fy0dQshoaqVM8hS/oFZ/6XsAuvwyo1wu1pePOmPZgePyP9VIqvuHrUQJPnYPjMTTB1fCVfC1bmg7342FoSzBYqZ/3J4N3cgvVl9XEDdXJ1AWTU5C3opeNokNYQRznjpzLCwLDxfxvCJMJCjQrwbDVtTCwkxh7S1cDo0XzP60HBVBqFPbrwmbX+1E349xXz64GGo8jXYNTOkeEsyqn7eGbLfOjnzliyoVIgVwQmspUA+HW3wR+sYlAtSeVR27fvbMZU0ssBuPnkuSMEgA6Z09MnQ5YLSCYbLS4Pgt+z/WhRVRsZFPRogysvZIG9kr8f+jC9gnQXTYYNIbtrjblKtx7RVBgFBvSC1us= ceph-85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:06:39.320 INFO:teuthology.orchestra.run.smithi078.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-11T00:06:39.320 INFO:teuthology.orchestra.run.smithi078.stdout:Adding key to root@localhost authorized_keys... 2024-09-11T00:06:39.326 INFO:teuthology.orchestra.run.smithi078.stdout:Adding host smithi078... 2024-09-11T00:06:40.217 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:39 smithi078 ceph-mon[30865]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:41.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:40 smithi078 ceph-mon[30865]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi078", "addr": "172.21.15.78", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:42.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:41 smithi078 ceph-mon[30865]: Deploying cephadm binary to smithi078 2024-09-11T00:06:43.711 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout Added host 'smithi078' with addr '172.21.15.78' 2024-09-11T00:06:43.711 INFO:teuthology.orchestra.run.smithi078.stdout:Deploying unmanaged mon service... 2024-09-11T00:06:44.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:44 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' 2024-09-11T00:06:44.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:44 smithi078 ceph-mon[30865]: Added host smithi078 2024-09-11T00:06:44.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:44 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:06:44.969 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-11T00:06:44.970 INFO:teuthology.orchestra.run.smithi078.stdout:Deploying unmanaged mgr service... 2024-09-11T00:06:45.529 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:45 smithi078 ceph-mon[30865]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:45.529 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:45 smithi078 ceph-mon[30865]: Saving service mon spec with placement count:5 2024-09-11T00:06:45.529 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:45 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' 2024-09-11T00:06:46.496 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-11T00:06:46.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:46 smithi078 ceph-mon[30865]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:46.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:46 smithi078 ceph-mon[30865]: Saving service mgr spec with placement count:2 2024-09-11T00:06:46.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:46 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' 2024-09-11T00:06:48.221 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:47 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' 2024-09-11T00:06:48.221 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:47 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' 2024-09-11T00:06:48.221 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:47 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3410256924' entity='client.admin' 2024-09-11T00:06:49.338 INFO:teuthology.orchestra.run.smithi078.stdout:Enabling the dashboard module... 2024-09-11T00:06:50.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:49 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3351905373' entity='client.admin' 2024-09-11T00:06:51.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:51 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' 2024-09-11T00:06:51.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:51 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1760380862' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-11T00:06:51.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:51 smithi078 ceph-mon[30865]: from='mgr.14116 172.21.15.78:0/3134555021' entity='mgr.x' 2024-09-11T00:06:51.334 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:51 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: ignoring --setuser ceph since I am not root 2024-09-11T00:06:51.334 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:51 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: ignoring --setgroup ceph since I am not root 2024-09-11T00:06:52.230 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:52 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1760380862' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-11T00:06:52.230 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:52 smithi078 ceph-mon[30865]: mgrmap e9: x(active, since 18s) 2024-09-11T00:06:52.782 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout { 2024-09-11T00:06:52.783 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-11T00:06:52.783 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T00:06:52.783 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-11T00:06:52.783 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-11T00:06:52.783 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout } 2024-09-11T00:06:52.783 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for the mgr to restart... 2024-09-11T00:06:52.783 INFO:teuthology.orchestra.run.smithi078.stdout:Waiting for mgr epoch 9... 2024-09-11T00:06:53.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:53 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1340687431' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-11T00:06:56.408 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:56 smithi078 ceph-mon[30865]: Active manager daemon x restarted 2024-09-11T00:06:56.408 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:56 smithi078 ceph-mon[30865]: Activating manager daemon x 2024-09-11T00:06:56.408 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:56 smithi078 ceph-mon[30865]: osdmap e3: 0 total, 0 up, 0 in 2024-09-11T00:06:56.408 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:56 smithi078 ceph-mon[30865]: mgrmap e10: x(active, starting, since 0.00419347s) 2024-09-11T00:06:56.408 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:56 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:06:56.408 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:56 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-11T00:06:56.408 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:56 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-11T00:06:56.408 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:56 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-11T00:06:56.409 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:56 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-11T00:06:56.409 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:56 smithi078 ceph-mon[30865]: Manager daemon x is now available 2024-09-11T00:06:57.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:06:57.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-11T00:06:57.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-11T00:06:57.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-mon[30865]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-11T00:06:57.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-mon[30865]: mgrmap e11: x(active, since 1.00631s) 2024-09-11T00:06:57.334 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: 2024-09-11T00:06:57.313+0000 7fdd4eb47640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:00:06:57] ENGINE Error in HTTPServer.serve 2024-09-11T00:06:57.334 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: Traceback (most recent call last): 2024-09-11T00:06:57.334 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T00:06:57.334 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: self._connections.run(self.expiration_interval) 2024-09-11T00:06:57.335 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T00:06:57.335 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: self._run(expiration_interval) 2024-09-11T00:06:57.335 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T00:06:57.335 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T00:06:57.335 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T00:06:57.335 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T00:06:57.335 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T00:06:57.335 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: s = self.context.wrap_socket( 2024-09-11T00:06:57.335 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T00:06:57.335 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: return self.sslsocket_class._create( 2024-09-11T00:06:57.335 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T00:06:57.335 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: self.do_handshake() 2024-09-11T00:06:57.335 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T00:06:57.336 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: self._sslobj.do_handshake() 2024-09-11T00:06:57.336 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T00:06:57.336 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:06:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: 2024-09-11T00:06:57.704 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout { 2024-09-11T00:06:57.704 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-11T00:06:57.704 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-11T00:06:57.704 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout } 2024-09-11T00:06:57.704 INFO:teuthology.orchestra.run.smithi078.stdout:mgr epoch 9 is available 2024-09-11T00:06:57.704 INFO:teuthology.orchestra.run.smithi078.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-11T00:06:58.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:58 smithi078 ceph-mon[30865]: [11/Sep/2024:00:06:57] ENGINE Bus STARTING 2024-09-11T00:06:58.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:58 smithi078 ceph-mon[30865]: [11/Sep/2024:00:06:57] ENGINE Serving on http://172.21.15.78:8765 2024-09-11T00:06:58.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:58 smithi078 ceph-mon[30865]: [11/Sep/2024:00:06:57] ENGINE Serving on https://172.21.15.78:7150 2024-09-11T00:06:58.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:58 smithi078 ceph-mon[30865]: [11/Sep/2024:00:06:57] ENGINE Bus STARTED 2024-09-11T00:06:58.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:58 smithi078 ceph-mon[30865]: [11/Sep/2024:00:06:57] ENGINE Error in HTTPServer.serve 2024-09-11T00:06:58.334 INFO:journalctl@ceph.mon.a.smithi078.stdout: Traceback (most recent call last): 2024-09-11T00:06:58.334 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T00:06:58.334 INFO:journalctl@ceph.mon.a.smithi078.stdout: self._connections.run(self.expiration_interval) 2024-09-11T00:06:58.334 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T00:06:58.334 INFO:journalctl@ceph.mon.a.smithi078.stdout: self._run(expiration_interval) 2024-09-11T00:06:58.334 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T00:06:58.335 INFO:journalctl@ceph.mon.a.smithi078.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T00:06:58.335 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T00:06:58.335 INFO:journalctl@ceph.mon.a.smithi078.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T00:06:58.335 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T00:06:58.335 INFO:journalctl@ceph.mon.a.smithi078.stdout: s = self.context.wrap_socket( 2024-09-11T00:06:58.335 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T00:06:58.335 INFO:journalctl@ceph.mon.a.smithi078.stdout: return self.sslsocket_class._create( 2024-09-11T00:06:58.335 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T00:06:58.335 INFO:journalctl@ceph.mon.a.smithi078.stdout: self.do_handshake() 2024-09-11T00:06:58.335 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T00:06:58.335 INFO:journalctl@ceph.mon.a.smithi078.stdout: self._sslobj.do_handshake() 2024-09-11T00:06:58.335 INFO:journalctl@ceph.mon.a.smithi078.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T00:06:59.378 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:59 smithi078 ceph-mon[30865]: mgrmap e12: x(active, since 2s) 2024-09-11T00:06:59.378 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:59 smithi078 ceph-mon[30865]: from='client.14160 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:06:59.378 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:06:59 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:06:59.913 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUT+UW0krM4D4fzOsQotxg4LgZh2kwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkxMTAwMDY1OVoXDTM0\nMDkxMjAwMDY1OVowFzEVMBMGA1UEAwwMMTcyLjIxLjE1Ljc4MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEApR9nwcA/YFnaBDItsmdOdzBsRCbv556nzY+E\nhh1WYpneKFTkiifL+bn9zjgrhos1exTuVafbAcjSSqfi/vyUpJvmV+VAmZxeB/qH\n6R9FHDMAJOxsN/ae+6yIElcaKzWrxRGGHr9jHqAXLiYx49nn6FLvDGtRLmKtC7O1\n8+nGN6PWCXndr6uNL0NdPy9QK/Hixv47w0mOhDvT6UFQmnLHNGPWxhDTrIf0MsAJ\nEXuXJm0Z8uCoCudZBT0OYg4tyIPTZKVBQw946ldqh3n3dUlt2jDXs8jXzFEGRAFn\nTNA78YdrWufSDbvhlMcQ05oCxSAgVqaMlVIggcn+Nx8O5PjyCZhUmCewjVBoJtbj\nX3hhH0C/NUD5d0AHM1DfMuEApfIi7pz5v1ZdmSb8yl3l/6NgG3MhZskIqQRGiZuz\nFK54ij7KKLrP7qxSQnKvaKhMv5JS2pM6hFErJpmSEZiKcN9nins8P9Z7yi1DfLrb\nKfWwYLVaxsVNEf9gxxzOXIAd+pqxh2NpXfnmCuDHInzjVvm52PwkrpbXyVwOwhCv\nzLOdsCmuChOLL7PhNONt16QehcFTiHUTD1LJHzbRo9xtUMiYSRG6028Wyhm0yXNz\n/UEJsScqzaqGEqMu501LRv0cPsag/7p5bQ8IqMIXmceEzMUcEO1hzubunjzE0ePB\n816k/6UCAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDc4ghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPTjAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQA8\ncR+XF4493yzyscx+Hr1AKMihw0DC+j93xY2ooO2dV5WFhvNPxjDBiIBrcmcalqEV\nRQqzP/NvesRcRm+ZCwKNVQjwNLTAmxCpBg9FmHPPfX6IfHb6USmnrfrSyQ+z0o7v\nSwEwqgQ6bsNYGl2mtZ4ZoXGrhJ5rMYGMKEhCoAX7EsESFH/WVcIzItEoj0obDFnZ\n05oOhGASbLcbC0zZL3ALzxuR4XLBDgUnwnFlcqOHGW7QFmhJoGT0DEPGhV2gReKN\nzq1UIGn8T4SwnAyGJO7/bDf4wZg9GMsfIZwl0QkFe1FTO5yaHSLrR9bN2YdiVitX\nABOiybJaTC3JGdI+YrY4fnvDbjMTzr0yPLvcvAx5swvp0C1nNqq4km57H3WF5k9b\nSCX7GREYjifsRpw9ACzdP8KYh3sxFAIY7ud1rBC2PkgXCw4DOVkgh1UwQc5uBV4j\nGL0w445lto9yZTztUhgxEvIh53wjjtCYtoptksXjEcf8Iiw1mDQOWvfsnG0M8fur\nai9k/wfoKPRJG7owLC1H0qxnpu52ONaVFWIhNe7j8P305Ftdd+vq7NGTeq5b86m/\n03j7I67S7Xv4jo5F3jXkIt+8KQGUiqQwC6h8W8TMKVkFEP05+muT8QFRDMO254ze\nA74SvxcStcNLo5YbnHrCITRUnqWQCGgigKKdtC++gQ==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEApR9nwcA/YFnaBDItsmdOdzBsRCbv556nzY+Ehh1WYpneKFTk\niifL+bn9zjgrhos1exTuVafbAcjSSqfi/vyUpJvmV+VAmZxeB/qH6R9FHDMAJOxs\nN/ae+6yIElcaKzWrxRGGHr9jHqAXLiYx49nn6FLvDGtRLmKtC7O18+nGN6PWCXnd\nr6uNL0NdPy9QK/Hixv47w0mOhDvT6UFQmnLHNGPWxhDTrIf0MsAJEXuXJm0Z8uCo\nCudZBT0OYg4tyIPTZKVBQw946ldqh3n3dUlt2jDXs8jXzFEGRAFnTNA78YdrWufS\nDbvhlMcQ05oCxSAgVqaMlVIggcn+Nx8O5PjyCZhUmCewjVBoJtbjX3hhH0C/NUD5\nd0AHM1DfMuEApfIi7pz5v1ZdmSb8yl3l/6NgG3MhZskIqQRGiZuzFK54ij7KKLrP\n7qxSQnKvaKhMv5JS2pM6hFErJpmSEZiKcN9nins8P9Z7yi1DfLrbKfWwYLVaxsVN\nEf9gxxzOXIAd+pqxh2NpXfnmCuDHInzjVvm52PwkrpbXyVwOwhCvzLOdsCmuChOL\nL7PhNONt16QehcFTiHUTD1LJHzbRo9xtUMiYSRG6028Wyhm0yXNz/UEJsScqzaqG\nEqMu501LRv0cPsag/7p5bQ8IqMIXmceEzMUcEO1hzubunjzE0ePB816k/6UCAwEA\nAQKCAgAFAx8IfT1vP0r5ivcNeJ/5HjnVwm4l1GW456euKoB6Hbw7R9hoGS0n4hgX\nhRJNKIycX9ZG41bShwtbGMgwf++YejhTvVxoopvNbN1om3pi5hQVtYIoxg5YCrSs\nBIOBgZo6hn2mZp4rn9BppjR9e2/UAtsewA3cH+1WHZkNqQWgoBMvK8kpkUYyg75L\nh17M9rAGOlFgwYAso2RGAFA3X/nhV+Z9EfsFkbA9RMxXANlltooYb+6p5hEzB4IY\nQotBOunVHu8MNLwG4QBq0a5L8R6p24cF/g1kNlFqXwszrwkixmmL04hHbRyRLORl\n3UGYROa2ZU0p0IRhbDA7RsYSTTw2NzJ1lHvef6ifUDw36U8iLeLkRdeAaGQ+yQpN\nTZurrcA6B8RNvPagqCvSH52B1vapFVenadR5qpeMLHUpaMIEVjsYTjEhU39V3an/\nTWgBMgeBIuCLWzqSMu74Lu/AypR5YIhdqNlR4TVE1gAQGkoc8ULkNozM9pr245zE\n9/0mnb10dCxx95Bfs/KlRh4aMjUjCGuhBr2gYHZYbQNEYj6AsL8o4Cbv4mde+xP8\nXS6Tuu7OrIuFfgQ/sM2WxAJUR9XsZHorC8CNmydNtQ9iWnXFaUtg5ZXAXLORkUrT\ncKscE7/r2/nQpaAoYa5a7fYNF3VVWuYLopgIc8kbSx+tySD1QQKCAQEA0t95tqNq\nbdZJGp08YgqM4rvYMGx+tg54C2F1mqr7CL6HCmu8AfypD77yeSfXDzNLnQ0i5lr5\nu+jhoNdzPzhF6tPCDkbAhgJ8iQmxKGEs/5Xyf8vShrUssp3nMqDKAvlL8WyfHboA\n4C2gITDW14674VGCzFyYr2Gknt6PMWWa03xoJIuCNzE4HcObioyyBARfw81qqeoP\nErqdwEV/gD+rOKXZWRhRTD50suEnYhp6PeaayPW0nXhNw52fubBthiOqRi/KrLj3\nIgOQC+AqGMLbQR4Xx6wH/x+LgeBvWtAOYCgwDlJcNN50spyqwzJECaDpN1PlvhYv\nK+TAUqMTRD5eCwKCAQEAyHWInXng4wasjX4NyT/RNN4GJl7eeOamWDmpudr+HhR5\nws/g2aaQKNpfr/FyIHbt3Nj44oVtg+uKo4XFZCwNC/il/l4A8WEZWCnhyRpsOGVV\n7Mgk85BjOzi9iqOudB4fAmFcnnb3/TzkEoPKlDzaRU0xmWjQuVtszGS+9/hhzutn\nGbB0+17ImNh5dw0qwPKRjk3QUU5FK6NMYBGV7a1Bb1XhM/PkwJxlR4C/5KPXgFqI\nsap5vPwCNygPmP0Fo/k5QL9BphtrMsVcMFv288G0Y4u9/4Ic2yWLNkMc2LQ+RgsM\nmOQ9iRMf65xQQ1aaNgWEVd/Fuz9Vhgld5CB5ZK+XDwKCAQEAoa6ZOvD3JHo9mPtg\nFefy99GBRDebu+lCH6+9JTbdvWmgTtwlzfw0gA8vCLgES/JPkn5E+QxeGLbJcLJg\n+eMisJdmXd3ftaBobgYRYF2Jy/njchsMMx7sw5MQdqAT483TbauUII3CKCCze19g\nCuy0n2EJAbopk6cxOmJ4ti4qVOc5TnPtBnZliWS2eLfBshTMfGue0eLVZc3SMF7Z\nELNAi/GVwZtEkkn83j6GHNEiUx3iJh1GO8rHDSppEk302/myj5gLNP2o9tp2crSQ\ncmXNCJOTNhRwGSvNomo71wxZSV7m4cRCUIMURPKcd4et5RgMWNCqAWIvDt+YmoPQ\nvO142wKCAQBAKaa1yRobcLpwe6WMAhpDksFjLMCG8ETUPni+HYNzO1iR65nr8K15\n9hPkrCK8k3SlWOmpD84zCISSvLGm05bFeywelBY3LL5BAv7bMNLs5jqvlIyHTXMF\ntK6unp+rWSzRxToxGqFb9E6IQpjoA+ZVglTa5rrQaZwUfDbIBj/ATIbuqRV4lCkf\nC0MtwRArPDks1GlWbPgk9JrwsRBNSESGj3WK/Ij+wdCFJ4fEdlD3K4NPYuKehAdt\ngiwj6vEQQCh8OfuYYHRahuNwMy+DbEACEOuayhnUZ1r83lRwZJj+MHEyyvOLWYzB\nDIKAW0r2+aMXHY4b1jTYt0zPRTm16aIvAoIBAAHgSZcvJYl9/fGbf8L+gLx1UQ8H\nUUw1k+sQHsGrmuVIvhbmEDFnAgMxXQl1OePaSgg4DJjhS08xRw8M4QuF/i67Og3a\n7PZ8zIYgZmI7VJvfPoDfNISX5ZLwKU4Lji+lLI4huQR86tYjAH6hJUCxhN7zX/ub\n7FcbnI/8HkLqL7+1pw0ttlCdQr0wqgmWTjXfrU6IeJK6w2vI6Ks2hSQAVt9ttt7A\nJQbhp6i4pJ01LsAwGZLxEy4oIeZOuV+Sg0anFvZDPCccv8Aetc9luqLq7aUyd7RU\nECFl0PqR3KXQCovebMB2bWZRyaHY976DKol1Thm70FLEV3S9A/77qZbdoNI=\n-----END RSA PRIVATE KEY-----\n"} 2024-09-11T00:07:00.297 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:00 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:01.449 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-11T00:07:02.045 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:01 smithi078 ceph-mon[30865]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:02.045 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:01 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:02.893 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-11T00:07:02.893 INFO:teuthology.orchestra.run.smithi078.stdout:Creating initial admin user... 2024-09-11T00:07:03.318 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:03 smithi078 ceph-mon[30865]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:03.318 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:03 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:04.274 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$NjF5OOXCVQwvLtQcKz9.G.sFiZaYB4ImZmAsQ5tDRifLqIkDpx4Ay", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726013223, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-11T00:07:04.274 INFO:teuthology.orchestra.run.smithi078.stdout:Fetching dashboard port number... 2024-09-11T00:07:04.881 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:04 smithi078 ceph-mon[30865]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:04.882 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:04 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:05.455 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stdout 8443 2024-09-11T00:07:05.465 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T00:07:05.465 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout disabled 2024-09-11T00:07:05.472 INFO:teuthology.orchestra.run.smithi078.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T00:07:05.472 INFO:teuthology.orchestra.run.smithi078.stdout:systemctl: stdout inactive 2024-09-11T00:07:05.472 INFO:teuthology.orchestra.run.smithi078.stdout:firewalld.service is not enabled 2024-09-11T00:07:05.472 INFO:teuthology.orchestra.run.smithi078.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-11T00:07:05.474 INFO:teuthology.orchestra.run.smithi078.stdout:Ceph Dashboard is now available at: 2024-09-11T00:07:05.474 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:07:05.474 INFO:teuthology.orchestra.run.smithi078.stdout: URL: https://smithi078.front.sepia.ceph.com:8443/ 2024-09-11T00:07:05.474 INFO:teuthology.orchestra.run.smithi078.stdout: User: admin 2024-09-11T00:07:05.475 INFO:teuthology.orchestra.run.smithi078.stdout: Password: 5jun6d61ta 2024-09-11T00:07:05.475 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:07:05.475 INFO:teuthology.orchestra.run.smithi078.stdout:Saving cluster configuration to /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config directory 2024-09-11T00:07:06.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:05 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/370799482' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-11T00:07:06.705 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-11T00:07:06.705 INFO:teuthology.orchestra.run.smithi078.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-11T00:07:06.705 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:07:06.705 INFO:teuthology.orchestra.run.smithi078.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:07:06.705 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:07:06.705 INFO:teuthology.orchestra.run.smithi078.stdout:Or, if you are only running a single cluster on this host: 2024-09-11T00:07:06.705 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:07:06.705 INFO:teuthology.orchestra.run.smithi078.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-11T00:07:06.706 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:07:06.706 INFO:teuthology.orchestra.run.smithi078.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-11T00:07:06.706 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:07:06.706 INFO:teuthology.orchestra.run.smithi078.stdout: ceph telemetry on 2024-09-11T00:07:06.706 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:07:06.706 INFO:teuthology.orchestra.run.smithi078.stdout:For more information see: 2024-09-11T00:07:06.706 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:07:06.706 INFO:teuthology.orchestra.run.smithi078.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-11T00:07:06.706 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:07:06.706 INFO:teuthology.orchestra.run.smithi078.stdout:Bootstrap complete. 2024-09-11T00:07:06.746 INFO:tasks.cephadm:Fetching config... 2024-09-11T00:07:06.747 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-11T00:07:06.747 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-11T00:07:06.764 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-11T00:07:06.764 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-11T00:07:06.765 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-11T00:07:06.821 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-11T00:07:06.821 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-11T00:07:06.821 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-11T00:07:06.887 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-11T00:07:06.887 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-11T00:07:06.887 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-11T00:07:06.942 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-11T00:07:06.943 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQ8RfBWbIQ7kJiWoq6+pFQYyfmoJYPQ8OkqUnSJJnik1S+Hl/+pT4sJUivQ5DlBvmK0R1hshAYJfCnl+azIX75tPVwd8suaFsfQdD/Tn93QmStTSqqblVoq5yaW+cXLGy+GcYZXtGiZxF+0Y7ESeATgRrlrvlmZ7Fy0dQshoaqVM8hS/oFZ/6XsAuvwyo1wu1pePOmPZgePyP9VIqvuHrUQJPnYPjMTTB1fCVfC1bmg7342FoSzBYqZ/3J4N3cgvVl9XEDdXJ1AWTU5C3opeNokNYQRznjpzLCwLDxfxvCJMJCjQrwbDVtTCwkxh7S1cDo0XzP60HBVBqFPbrwmbX+1E349xXz64GGo8jXYNTOkeEsyqn7eGbLfOjnzliyoVIgVwQmspUA+HW3wR+sYlAtSeVR27fvbMZU0ssBuPnkuSMEgA6Z09MnQ5YLSCYbLS4Pgt+z/WhRVRsZFPRogysvZIG9kr8f+jC9gnQXTYYNIbtrjblKtx7RVBgFBvSC1us= ceph-85a53860-6fd1-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T00:07:07.016 INFO:teuthology.orchestra.run.smithi078.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQ8RfBWbIQ7kJiWoq6+pFQYyfmoJYPQ8OkqUnSJJnik1S+Hl/+pT4sJUivQ5DlBvmK0R1hshAYJfCnl+azIX75tPVwd8suaFsfQdD/Tn93QmStTSqqblVoq5yaW+cXLGy+GcYZXtGiZxF+0Y7ESeATgRrlrvlmZ7Fy0dQshoaqVM8hS/oFZ/6XsAuvwyo1wu1pePOmPZgePyP9VIqvuHrUQJPnYPjMTTB1fCVfC1bmg7342FoSzBYqZ/3J4N3cgvVl9XEDdXJ1AWTU5C3opeNokNYQRznjpzLCwLDxfxvCJMJCjQrwbDVtTCwkxh7S1cDo0XzP60HBVBqFPbrwmbX+1E349xXz64GGo8jXYNTOkeEsyqn7eGbLfOjnzliyoVIgVwQmspUA+HW3wR+sYlAtSeVR27fvbMZU0ssBuPnkuSMEgA6Z09MnQ5YLSCYbLS4Pgt+z/WhRVRsZFPRogysvZIG9kr8f+jC9gnQXTYYNIbtrjblKtx7RVBgFBvSC1us= ceph-85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:07:07.027 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQ8RfBWbIQ7kJiWoq6+pFQYyfmoJYPQ8OkqUnSJJnik1S+Hl/+pT4sJUivQ5DlBvmK0R1hshAYJfCnl+azIX75tPVwd8suaFsfQdD/Tn93QmStTSqqblVoq5yaW+cXLGy+GcYZXtGiZxF+0Y7ESeATgRrlrvlmZ7Fy0dQshoaqVM8hS/oFZ/6XsAuvwyo1wu1pePOmPZgePyP9VIqvuHrUQJPnYPjMTTB1fCVfC1bmg7342FoSzBYqZ/3J4N3cgvVl9XEDdXJ1AWTU5C3opeNokNYQRznjpzLCwLDxfxvCJMJCjQrwbDVtTCwkxh7S1cDo0XzP60HBVBqFPbrwmbX+1E349xXz64GGo8jXYNTOkeEsyqn7eGbLfOjnzliyoVIgVwQmspUA+HW3wR+sYlAtSeVR27fvbMZU0ssBuPnkuSMEgA6Z09MnQ5YLSCYbLS4Pgt+z/WhRVRsZFPRogysvZIG9kr8f+jC9gnQXTYYNIbtrjblKtx7RVBgFBvSC1us= ceph-85a53860-6fd1-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T00:07:07.075 INFO:teuthology.orchestra.run.smithi112.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQ8RfBWbIQ7kJiWoq6+pFQYyfmoJYPQ8OkqUnSJJnik1S+Hl/+pT4sJUivQ5DlBvmK0R1hshAYJfCnl+azIX75tPVwd8suaFsfQdD/Tn93QmStTSqqblVoq5yaW+cXLGy+GcYZXtGiZxF+0Y7ESeATgRrlrvlmZ7Fy0dQshoaqVM8hS/oFZ/6XsAuvwyo1wu1pePOmPZgePyP9VIqvuHrUQJPnYPjMTTB1fCVfC1bmg7342FoSzBYqZ/3J4N3cgvVl9XEDdXJ1AWTU5C3opeNokNYQRznjpzLCwLDxfxvCJMJCjQrwbDVtTCwkxh7S1cDo0XzP60HBVBqFPbrwmbX+1E349xXz64GGo8jXYNTOkeEsyqn7eGbLfOjnzliyoVIgVwQmspUA+HW3wR+sYlAtSeVR27fvbMZU0ssBuPnkuSMEgA6Z09MnQ5YLSCYbLS4Pgt+z/WhRVRsZFPRogysvZIG9kr8f+jC9gnQXTYYNIbtrjblKtx7RVBgFBvSC1us= ceph-85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:07:07.089 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQ8RfBWbIQ7kJiWoq6+pFQYyfmoJYPQ8OkqUnSJJnik1S+Hl/+pT4sJUivQ5DlBvmK0R1hshAYJfCnl+azIX75tPVwd8suaFsfQdD/Tn93QmStTSqqblVoq5yaW+cXLGy+GcYZXtGiZxF+0Y7ESeATgRrlrvlmZ7Fy0dQshoaqVM8hS/oFZ/6XsAuvwyo1wu1pePOmPZgePyP9VIqvuHrUQJPnYPjMTTB1fCVfC1bmg7342FoSzBYqZ/3J4N3cgvVl9XEDdXJ1AWTU5C3opeNokNYQRznjpzLCwLDxfxvCJMJCjQrwbDVtTCwkxh7S1cDo0XzP60HBVBqFPbrwmbX+1E349xXz64GGo8jXYNTOkeEsyqn7eGbLfOjnzliyoVIgVwQmspUA+HW3wR+sYlAtSeVR27fvbMZU0ssBuPnkuSMEgA6Z09MnQ5YLSCYbLS4Pgt+z/WhRVRsZFPRogysvZIG9kr8f+jC9gnQXTYYNIbtrjblKtx7RVBgFBvSC1us= ceph-85a53860-6fd1-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T00:07:07.131 INFO:teuthology.orchestra.run.smithi138.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQ8RfBWbIQ7kJiWoq6+pFQYyfmoJYPQ8OkqUnSJJnik1S+Hl/+pT4sJUivQ5DlBvmK0R1hshAYJfCnl+azIX75tPVwd8suaFsfQdD/Tn93QmStTSqqblVoq5yaW+cXLGy+GcYZXtGiZxF+0Y7ESeATgRrlrvlmZ7Fy0dQshoaqVM8hS/oFZ/6XsAuvwyo1wu1pePOmPZgePyP9VIqvuHrUQJPnYPjMTTB1fCVfC1bmg7342FoSzBYqZ/3J4N3cgvVl9XEDdXJ1AWTU5C3opeNokNYQRznjpzLCwLDxfxvCJMJCjQrwbDVtTCwkxh7S1cDo0XzP60HBVBqFPbrwmbX+1E349xXz64GGo8jXYNTOkeEsyqn7eGbLfOjnzliyoVIgVwQmspUA+HW3wR+sYlAtSeVR27fvbMZU0ssBuPnkuSMEgA6Z09MnQ5YLSCYbLS4Pgt+z/WhRVRsZFPRogysvZIG9kr8f+jC9gnQXTYYNIbtrjblKtx7RVBgFBvSC1us= ceph-85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:07:07.144 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-11T00:07:07.391 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:07:07.505 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:07 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2362095825' entity='client.admin' 2024-09-11T00:07:09.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:09 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2769119977' entity='client.admin' 2024-09-11T00:07:09.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:09 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:09.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:09 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:09.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:09 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi078", "name": "osd_memory_target"} : dispatch 2024-09-11T00:07:09.335 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:09 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:09.335 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:09 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:07:09.335 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:09 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:09.453 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-11T00:07:09.453 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-11T00:07:10.187 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:10 smithi078 ceph-mon[30865]: mgrmap e13: x(active, since 13s) 2024-09-11T00:07:10.218 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:07:11.557 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi112 2024-09-11T00:07:11.558 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-11T00:07:11.558 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/etc/ceph/ceph.conf 2024-09-11T00:07:11.578 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-11T00:07:11.578 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:07:11.636 INFO:tasks.cephadm:Adding host smithi112 to orchestrator... 2024-09-11T00:07:11.636 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph orch host add smithi112 2024-09-11T00:07:11.882 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:07:12.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:11 smithi078 ceph-mon[30865]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:11 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:11 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:07:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:11 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:11 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:07:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:11 smithi078 ceph-mon[30865]: Updating smithi078:/etc/ceph/ceph.conf 2024-09-11T00:07:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:11 smithi078 ceph-mon[30865]: Updating smithi078:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:07:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:11 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:11 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:11 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:13.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:12 smithi078 ceph-mon[30865]: Updating smithi078:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:07:13.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:12 smithi078 ceph-mon[30865]: Updating smithi078:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:07:14.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:13 smithi078 ceph-mon[30865]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi112", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:15.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:14 smithi078 ceph-mon[30865]: Deploying cephadm binary to smithi112 2024-09-11T00:07:15.648 INFO:teuthology.orchestra.run.smithi078.stdout:Added host 'smithi112' with addr '172.21.15.112' 2024-09-11T00:07:16.264 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-11T00:07:16.500 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:07:16.963 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:16 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:16.963 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:16 smithi078 ceph-mon[30865]: Added host smithi112 2024-09-11T00:07:16.963 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:16 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:07:16.963 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:16 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:16.963 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:16 smithi078 ceph-mon[30865]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:16.963 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:16 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:17.127 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:07:17.127 INFO:teuthology.orchestra.run.smithi078.stdout:[{"addr": "172.21.15.78", "hostname": "smithi078", "labels": [], "status": ""}, {"addr": "172.21.15.112", "hostname": "smithi112", "labels": [], "status": ""}] 2024-09-11T00:07:17.693 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi138 2024-09-11T00:07:17.693 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-11T00:07:17.693 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/etc/ceph/ceph.conf 2024-09-11T00:07:17.713 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-11T00:07:17.713 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:07:17.771 INFO:tasks.cephadm:Adding host smithi138 to orchestrator... 2024-09-11T00:07:17.772 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph orch host add smithi138 2024-09-11T00:07:18.009 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:07:18.270 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:18 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:19.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:19 smithi078 ceph-mon[30865]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:07:19.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:19 smithi078 ceph-mon[30865]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:20.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:20 smithi078 ceph-mon[30865]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi138", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:20.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:20 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:20.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:20 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:20.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:20 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:20.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:20 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:20.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:20 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"} : dispatch 2024-09-11T00:07:20.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:20 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:20.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:20 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:07:21.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:21 smithi078 ceph-mon[30865]: Deploying cephadm binary to smithi138 2024-09-11T00:07:21.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:21 smithi078 ceph-mon[30865]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-11T00:07:21.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:21 smithi078 ceph-mon[30865]: Updating smithi112:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:07:21.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:21 smithi078 ceph-mon[30865]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:21.964 INFO:teuthology.orchestra.run.smithi078.stdout:Added host 'smithi138' with addr '172.21.15.138' 2024-09-11T00:07:22.274 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:22 smithi078 ceph-mon[30865]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:07:22.275 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:22 smithi078 ceph-mon[30865]: Updating smithi112:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:07:22.275 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:22 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:22.275 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:22 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:22.275 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:22 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:22.275 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:22 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:22.275 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:22 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:07:22.601 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-11T00:07:22.838 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:07:23.276 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:23 smithi078 ceph-mon[30865]: Added host smithi138 2024-09-11T00:07:23.276 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:23 smithi078 ceph-mon[30865]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:23.277 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:23 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:23.277 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:23 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:23.477 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:07:23.477 INFO:teuthology.orchestra.run.smithi078.stdout:[{"addr": "172.21.15.78", "hostname": "smithi078", "labels": [], "status": ""}, {"addr": "172.21.15.112", "hostname": "smithi112", "labels": [], "status": ""}, {"addr": "172.21.15.138", "hostname": "smithi138", "labels": [], "status": ""}] 2024-09-11T00:07:24.044 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-11T00:07:24.044 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-11T00:07:24.283 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:07:24.583 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:24 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:24.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:24 smithi078 ceph-mon[30865]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:07:24.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:24 smithi078 ceph-mon[30865]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:25.322 INFO:teuthology.orchestra.run.smithi078.stderr:adjusted tunables profile to default 2024-09-11T00:07:25.583 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:25 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2950611232' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-11T00:07:25.901 INFO:tasks.cephadm:Adding mon.a on smithi078 2024-09-11T00:07:25.901 INFO:tasks.cephadm:Adding mon.b on smithi112 2024-09-11T00:07:25.901 INFO:tasks.cephadm:Adding mon.c on smithi138 2024-09-11T00:07:25.901 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi078:172.21.15.78=a;smithi112:172.21.15.112=b;smithi138:172.21.15.138=c' 2024-09-11T00:07:26.160 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-11T00:07:26.205 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-11T00:07:26.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:26 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2950611232' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-11T00:07:26.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:26 smithi078 ceph-mon[30865]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T00:07:26.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:26 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:26.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:26 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:26.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:26 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:26.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:26 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:26.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:26 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi138", "name": "osd_memory_target"} : dispatch 2024-09-11T00:07:26.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:26 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:26.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:26 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:07:26.585 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:26 smithi078 ceph-mon[30865]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:26.585 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:26 smithi078 ceph-mon[30865]: Updating smithi138:/etc/ceph/ceph.conf 2024-09-11T00:07:26.934 INFO:teuthology.orchestra.run.smithi138.stdout:Scheduled mon update... 2024-09-11T00:07:27.536 DEBUG:teuthology.orchestra.run.smithi112:mon.b> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mon.b.service 2024-09-11T00:07:27.539 DEBUG:teuthology.orchestra.run.smithi138:mon.c> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mon.c.service 2024-09-11T00:07:27.541 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T00:07:27.541 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T00:07:28.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:27 smithi078 ceph-mon[30865]: Updating smithi138:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:07:28.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:27 smithi078 ceph-mon[30865]: Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:07:28.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:27 smithi078 ceph-mon[30865]: Updating smithi138:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:07:28.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:27 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:28.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:27 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:28.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:27 smithi078 ceph-mon[30865]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi078:172.21.15.78=a;smithi112:172.21.15.112=b;smithi138:172.21.15.138=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:28.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:27 smithi078 ceph-mon[30865]: Saving service mon spec with placement smithi078:172.21.15.78=a;smithi112:172.21.15.112=b;smithi138:172.21.15.138=c;count:3 2024-09-11T00:07:28.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:27 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:28.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:27 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:28.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:27 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:07:28.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:27 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:28.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:27 smithi078 ceph-mon[30865]: Deploying daemon mon.c on smithi138 2024-09-11T00:07:28.566 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:07:29.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:28 smithi078 ceph-mon[30865]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:29.781 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:07:29.781 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":1,"fsid":"85a53860-6fd1-11ef-bcea-c7b262605968","modified":"2024-09-11T00:06:02.756204Z","created":"2024-09-11T00:06:02.756204Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-11T00:07:29.782 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 1 2024-09-11T00:07:30.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:29 smithi078 ceph-mon[30865]: from='client.? 172.21.15.138:0/2078137721' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-11T00:07:31.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:30 smithi078 ceph-mon[30865]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:31.546 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T00:07:31.546 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T00:07:31.801 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:07:36.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:36 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:36.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:07:36.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:07:36.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: mon.a calling monitor election 2024-09-11T00:07:36.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:36.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:07:36.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:07:36.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: mon.c calling monitor election 2024-09-11T00:07:36.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:36.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:07:36.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:07:36.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:36.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:07:36.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T00:07:36.836 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: monmap epoch 2 2024-09-11T00:07:36.836 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: fsid 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:07:36.836 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: last_changed 2024-09-11T00:07:31.421156+0000 2024-09-11T00:07:36.836 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: created 2024-09-11T00:06:02.756204+0000 2024-09-11T00:07:36.836 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: min_mon_release 19 (squid) 2024-09-11T00:07:36.837 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: election_strategy: 1 2024-09-11T00:07:36.837 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: 0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-11T00:07:36.837 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: 1: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.c 2024-09-11T00:07:36.837 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: fsmap 2024-09-11T00:07:36.837 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T00:07:36.837 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: mgrmap e13: x(active, since 40s) 2024-09-11T00:07:36.838 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: overall HEALTH_OK 2024-09-11T00:07:36.838 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:36.838 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:36.838 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:36.838 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:07:36.838 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:36 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:36.878 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:07:36.878 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":2,"fsid":"85a53860-6fd1-11ef-bcea-c7b262605968","modified":"2024-09-11T00:07:31.421156Z","created":"2024-09-11T00:06:02.756204Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T00:07:36.878 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 2 2024-09-11T00:07:37.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:37 smithi138 ceph-mon[35019]: Deploying daemon mon.b on smithi112 2024-09-11T00:07:37.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:37 smithi138 ceph-mon[35019]: from='client.? 172.21.15.138:0/1216839892' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-11T00:07:37.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:37 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:07:37.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:37 smithi078 ceph-mon[30865]: Deploying daemon mon.b on smithi112 2024-09-11T00:07:37.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:37 smithi078 ceph-mon[30865]: from='client.? 172.21.15.138:0/1216839892' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-11T00:07:37.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:37 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:07:38.459 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T00:07:38.460 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T00:07:38.714 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:07:38.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:38 smithi138 ceph-mon[35019]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:38.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:38 smithi078 ceph-mon[30865]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:39.347 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:07:39.348 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":2,"fsid":"85a53860-6fd1-11ef-bcea-c7b262605968","modified":"2024-09-11T00:07:31.421156Z","created":"2024-09-11T00:06:02.756204Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T00:07:39.348 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 2 2024-09-11T00:07:39.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:39 smithi138 ceph-mon[35019]: from='client.? 172.21.15.138:0/515546189' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-11T00:07:39.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:39 smithi078 ceph-mon[30865]: from='client.? 172.21.15.138:0/515546189' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-11T00:07:39.986 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:39 smithi112 systemd[1]: Starting Ceph mon.b for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:07:40.279 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 podman[35608]: 2024-09-11 00:07:40.079637149 +0000 UTC m=+0.016051904 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:07:40.279 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 podman[35608]: 2024-09-11 00:07:40.181201104 +0000 UTC m=+0.117615848 container create d7e4d59fe83afcef44841f3684d61c9085e833c61735568503c81d37c9c62cd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:07:40.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 podman[35608]: 2024-09-11 00:07:40.375153002 +0000 UTC m=+0.311567753 container init d7e4d59fe83afcef44841f3684d61c9085e833c61735568503c81d37c9c62cd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-11T00:07:40.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 podman[35608]: 2024-09-11 00:07:40.378302259 +0000 UTC m=+0.314717003 container start d7e4d59fe83afcef44841f3684d61c9085e833c61735568503c81d37c9c62cd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-b, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:07:40.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: set uid:gid to 167:167 (ceph:ceph) 2024-09-11T00:07:40.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-11T00:07:40.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: pidfile_write: ignore empty --pid-file 2024-09-11T00:07:40.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: load: jerasure load: lrc 2024-09-11T00:07:40.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: RocksDB version: 7.9.2 2024-09-11T00:07:40.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Git sha 0 2024-09-11T00:07:40.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-11T00:07:40.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: DB SUMMARY 2024-09-11T00:07:40.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: DB Session ID: AHVFQ5BIP8BFVD4OHMWE 2024-09-11T00:07:40.734 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: CURRENT file: CURRENT 2024-09-11T00:07:40.734 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: IDENTITY file: IDENTITY 2024-09-11T00:07:40.734 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-11T00:07:40.734 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-11T00:07:40.734 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-11T00:07:40.734 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.error_if_exists: 0 2024-09-11T00:07:40.734 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.create_if_missing: 0 2024-09-11T00:07:40.734 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.paranoid_checks: 1 2024-09-11T00:07:40.734 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-11T00:07:40.734 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-11T00:07:40.734 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-11T00:07:40.734 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.env: 0x55939e0a5180 2024-09-11T00:07:40.734 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.fs: PosixFileSystem 2024-09-11T00:07:40.735 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.info_log: 0x55939f1db700 2024-09-11T00:07:40.735 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_file_opening_threads: 16 2024-09-11T00:07:40.735 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.statistics: (nil) 2024-09-11T00:07:40.735 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.use_fsync: 0 2024-09-11T00:07:40.735 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_log_file_size: 0 2024-09-11T00:07:40.735 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-11T00:07:40.735 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-11T00:07:40.735 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.keep_log_file_num: 1000 2024-09-11T00:07:40.735 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.recycle_log_file_num: 0 2024-09-11T00:07:40.735 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.allow_fallocate: 1 2024-09-11T00:07:40.735 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.allow_mmap_reads: 0 2024-09-11T00:07:40.735 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.allow_mmap_writes: 0 2024-09-11T00:07:40.735 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.use_direct_reads: 0 2024-09-11T00:07:40.736 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-11T00:07:40.736 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.create_missing_column_families: 0 2024-09-11T00:07:40.736 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.db_log_dir: 2024-09-11T00:07:40.736 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.wal_dir: 2024-09-11T00:07:40.736 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-11T00:07:40.736 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-11T00:07:40.736 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-11T00:07:40.736 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-11T00:07:40.736 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-11T00:07:40.736 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-11T00:07:40.736 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.advise_random_on_open: 1 2024-09-11T00:07:40.736 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.db_write_buffer_size: 0 2024-09-11T00:07:40.736 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.write_buffer_manager: 0x55939f1dfb80 2024-09-11T00:07:40.736 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-11T00:07:40.737 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-11T00:07:40.737 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-11T00:07:40.737 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.rate_limiter: (nil) 2024-09-11T00:07:40.737 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-11T00:07:40.737 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.wal_recovery_mode: 2 2024-09-11T00:07:40.737 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.enable_thread_tracking: 0 2024-09-11T00:07:40.737 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.enable_pipelined_write: 0 2024-09-11T00:07:40.737 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.unordered_write: 0 2024-09-11T00:07:40.737 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-11T00:07:40.737 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-11T00:07:40.737 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-11T00:07:40.737 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-11T00:07:40.737 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.row_cache: None 2024-09-11T00:07:40.738 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.wal_filter: None 2024-09-11T00:07:40.739 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-11T00:07:40.739 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.allow_ingest_behind: 0 2024-09-11T00:07:40.739 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.two_write_queues: 0 2024-09-11T00:07:40.739 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.manual_wal_flush: 0 2024-09-11T00:07:40.740 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.wal_compression: 0 2024-09-11T00:07:40.740 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.atomic_flush: 0 2024-09-11T00:07:40.740 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-11T00:07:40.740 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-11T00:07:40.740 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-11T00:07:40.740 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.log_readahead_size: 0 2024-09-11T00:07:40.740 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-11T00:07:40.740 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.best_efforts_recovery: 0 2024-09-11T00:07:40.740 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-11T00:07:40.740 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-11T00:07:40.740 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.allow_data_in_errors: 0 2024-09-11T00:07:40.740 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.db_host_id: __hostname__ 2024-09-11T00:07:40.741 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-11T00:07:40.741 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_background_jobs: 2 2024-09-11T00:07:40.741 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_background_compactions: -1 2024-09-11T00:07:40.741 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_subcompactions: 1 2024-09-11T00:07:40.741 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-11T00:07:40.741 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-11T00:07:40.741 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-11T00:07:40.741 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_total_wal_size: 0 2024-09-11T00:07:40.741 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-11T00:07:40.741 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-11T00:07:40.741 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-11T00:07:40.741 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-11T00:07:40.741 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_open_files: -1 2024-09-11T00:07:40.742 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.bytes_per_sync: 0 2024-09-11T00:07:40.742 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-11T00:07:40.742 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-11T00:07:40.742 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compaction_readahead_size: 0 2024-09-11T00:07:40.742 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_background_flushes: -1 2024-09-11T00:07:40.742 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Compression algorithms supported: 2024-09-11T00:07:40.742 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: kZSTD supported: 0 2024-09-11T00:07:40.742 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: kXpressCompression supported: 0 2024-09-11T00:07:40.742 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: kBZip2Compression supported: 0 2024-09-11T00:07:40.742 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-11T00:07:40.742 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: kLZ4Compression supported: 1 2024-09-11T00:07:40.742 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: kZlibCompression supported: 1 2024-09-11T00:07:40.742 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: kLZ4HCCompression supported: 1 2024-09-11T00:07:40.743 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: kSnappyCompression supported: 1 2024-09-11T00:07:40.743 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-11T00:07:40.743 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-11T00:07:40.743 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-11T00:07:40.743 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-11T00:07:40.743 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-11T00:07:40.743 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.merge_operator: 2024-09-11T00:07:40.743 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compaction_filter: None 2024-09-11T00:07:40.743 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compaction_filter_factory: None 2024-09-11T00:07:40.743 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.sst_partitioner_factory: None 2024-09-11T00:07:40.743 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-11T00:07:40.743 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-11T00:07:40.743 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55939f1db320) 2024-09-11T00:07:40.743 INFO:journalctl@ceph.mon.b.smithi112.stdout: cache_index_and_filter_blocks: 1 2024-09-11T00:07:40.744 INFO:journalctl@ceph.mon.b.smithi112.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-11T00:07:40.744 INFO:journalctl@ceph.mon.b.smithi112.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-11T00:07:40.744 INFO:journalctl@ceph.mon.b.smithi112.stdout: pin_top_level_index_and_filter: 1 2024-09-11T00:07:40.744 INFO:journalctl@ceph.mon.b.smithi112.stdout: index_type: 0 2024-09-11T00:07:40.744 INFO:journalctl@ceph.mon.b.smithi112.stdout: data_block_index_type: 0 2024-09-11T00:07:40.744 INFO:journalctl@ceph.mon.b.smithi112.stdout: index_shortening: 1 2024-09-11T00:07:40.744 INFO:journalctl@ceph.mon.b.smithi112.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-11T00:07:40.744 INFO:journalctl@ceph.mon.b.smithi112.stdout: checksum: 4 2024-09-11T00:07:40.744 INFO:journalctl@ceph.mon.b.smithi112.stdout: no_block_cache: 0 2024-09-11T00:07:40.744 INFO:journalctl@ceph.mon.b.smithi112.stdout: block_cache: 0x55939f1cf610 2024-09-11T00:07:40.744 INFO:journalctl@ceph.mon.b.smithi112.stdout: block_cache_name: BinnedLRUCache 2024-09-11T00:07:40.744 INFO:journalctl@ceph.mon.b.smithi112.stdout: block_cache_options: 2024-09-11T00:07:40.744 INFO:journalctl@ceph.mon.b.smithi112.stdout: capacity : 536870912 2024-09-11T00:07:40.744 INFO:journalctl@ceph.mon.b.smithi112.stdout: num_shard_bits : 4 2024-09-11T00:07:40.745 INFO:journalctl@ceph.mon.b.smithi112.stdout: strict_capacity_limit : 0 2024-09-11T00:07:40.745 INFO:journalctl@ceph.mon.b.smithi112.stdout: high_pri_pool_ratio: 0.000 2024-09-11T00:07:40.745 INFO:journalctl@ceph.mon.b.smithi112.stdout: block_cache_compressed: (nil) 2024-09-11T00:07:40.745 INFO:journalctl@ceph.mon.b.smithi112.stdout: persistent_cache: (nil) 2024-09-11T00:07:40.745 INFO:journalctl@ceph.mon.b.smithi112.stdout: block_size: 4096 2024-09-11T00:07:40.745 INFO:journalctl@ceph.mon.b.smithi112.stdout: block_size_deviation: 10 2024-09-11T00:07:40.745 INFO:journalctl@ceph.mon.b.smithi112.stdout: block_restart_interval: 16 2024-09-11T00:07:40.745 INFO:journalctl@ceph.mon.b.smithi112.stdout: index_block_restart_interval: 1 2024-09-11T00:07:40.745 INFO:journalctl@ceph.mon.b.smithi112.stdout: metadata_block_size: 4096 2024-09-11T00:07:40.745 INFO:journalctl@ceph.mon.b.smithi112.stdout: partition_filters: 0 2024-09-11T00:07:40.745 INFO:journalctl@ceph.mon.b.smithi112.stdout: use_delta_encoding: 1 2024-09-11T00:07:40.745 INFO:journalctl@ceph.mon.b.smithi112.stdout: filter_policy: bloomfilter 2024-09-11T00:07:40.745 INFO:journalctl@ceph.mon.b.smithi112.stdout: whole_key_filtering: 1 2024-09-11T00:07:40.745 INFO:journalctl@ceph.mon.b.smithi112.stdout: verify_compression: 0 2024-09-11T00:07:40.746 INFO:journalctl@ceph.mon.b.smithi112.stdout: read_amp_bytes_per_bit: 0 2024-09-11T00:07:40.746 INFO:journalctl@ceph.mon.b.smithi112.stdout: format_version: 5 2024-09-11T00:07:40.746 INFO:journalctl@ceph.mon.b.smithi112.stdout: enable_index_compression: 1 2024-09-11T00:07:40.746 INFO:journalctl@ceph.mon.b.smithi112.stdout: block_align: 0 2024-09-11T00:07:40.746 INFO:journalctl@ceph.mon.b.smithi112.stdout: max_auto_readahead_size: 262144 2024-09-11T00:07:40.746 INFO:journalctl@ceph.mon.b.smithi112.stdout: prepopulate_block_cache: 0 2024-09-11T00:07:40.746 INFO:journalctl@ceph.mon.b.smithi112.stdout: initial_auto_readahead_size: 8192 2024-09-11T00:07:40.746 INFO:journalctl@ceph.mon.b.smithi112.stdout: num_file_reads_for_auto_readahead: 2 2024-09-11T00:07:40.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.write_buffer_size: 33554432 2024-09-11T00:07:40.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_write_buffer_number: 2 2024-09-11T00:07:40.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compression: NoCompression 2024-09-11T00:07:40.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.bottommost_compression: Disabled 2024-09-11T00:07:40.746 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.prefix_extractor: nullptr 2024-09-11T00:07:40.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-11T00:07:40.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.num_levels: 7 2024-09-11T00:07:40.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-11T00:07:40.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-11T00:07:40.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-11T00:07:40.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-11T00:07:40.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-11T00:07:40.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-11T00:07:40.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-11T00:07:40.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-11T00:07:40.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-11T00:07:40.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-11T00:07:40.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-11T00:07:40.747 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-11T00:07:40.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-11T00:07:40.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compression_opts.level: 32767 2024-09-11T00:07:40.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compression_opts.strategy: 0 2024-09-11T00:07:40.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-11T00:07:40.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-11T00:07:40.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-11T00:07:40.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-11T00:07:40.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compression_opts.enabled: false 2024-09-11T00:07:40.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-11T00:07:40.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-11T00:07:40.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-11T00:07:40.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-11T00:07:40.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.target_file_size_base: 67108864 2024-09-11T00:07:40.748 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-11T00:07:40.749 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-11T00:07:40.749 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-11T00:07:40.749 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-11T00:07:40.749 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-11T00:07:40.749 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-11T00:07:40.749 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-11T00:07:40.749 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-11T00:07:40.749 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-11T00:07:40.749 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-11T00:07:40.749 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-11T00:07:40.749 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-11T00:07:40.749 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-11T00:07:40.749 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-11T00:07:40.750 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.arena_block_size: 1048576 2024-09-11T00:07:40.750 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-11T00:07:40.750 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-11T00:07:40.750 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.disable_auto_compactions: 0 2024-09-11T00:07:40.750 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-11T00:07:40.750 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-11T00:07:40.750 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-11T00:07:40.750 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-11T00:07:40.750 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-11T00:07:40.750 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-11T00:07:40.750 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-11T00:07:40.750 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-11T00:07:40.750 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-11T00:07:40.751 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-11T00:07:40.751 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-11T00:07:40.751 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.inplace_update_support: 0 2024-09-11T00:07:40.751 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-11T00:07:40.751 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-11T00:07:40.751 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-11T00:07:40.751 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-11T00:07:40.751 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.bloom_locality: 0 2024-09-11T00:07:40.751 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.max_successive_merges: 0 2024-09-11T00:07:40.751 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-11T00:07:40.751 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.paranoid_file_checks: 0 2024-09-11T00:07:40.751 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.force_consistency_checks: 1 2024-09-11T00:07:40.751 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.report_bg_io_stats: 0 2024-09-11T00:07:40.751 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.ttl: 2592000 2024-09-11T00:07:40.751 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-11T00:07:40.752 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-11T00:07:40.752 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-11T00:07:40.752 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.enable_blob_files: false 2024-09-11T00:07:40.752 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.min_blob_size: 0 2024-09-11T00:07:40.752 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.blob_file_size: 268435456 2024-09-11T00:07:40.752 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-11T00:07:40.752 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-11T00:07:40.752 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-11T00:07:40.752 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-11T00:07:40.752 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-11T00:07:40.752 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.blob_file_starting_level: 0 2024-09-11T00:07:40.752 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-11T00:07:40.752 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-11T00:07:40.753 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-11T00:07:40.753 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 006c21aa-7cbb-4d2c-9f99-fe7eb940bf69 2024-09-11T00:07:40.753 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726013260405466, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-11T00:07:40.753 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-11T00:07:40.753 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726013260405873, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726013260, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "006c21aa-7cbb-4d2c-9f99-fe7eb940bf69", "db_session_id": "AHVFQ5BIP8BFVD4OHMWE", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-11T00:07:40.753 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726013260405968, "job": 1, "event": "recovery_finished"} 2024-09-11T00:07:40.753 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-11T00:07:40.753 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-11T00:07:40.753 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55939f1fee00 2024-09-11T00:07:40.753 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: DB pointer 0x55939f300000 2024-09-11T00:07:40.753 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-11T00:07:40.753 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-11T00:07:40.753 INFO:journalctl@ceph.mon.b.smithi112.stdout: ** DB Stats ** 2024-09-11T00:07:40.754 INFO:journalctl@ceph.mon.b.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T00:07:40.754 INFO:journalctl@ceph.mon.b.smithi112.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-11T00:07:40.754 INFO:journalctl@ceph.mon.b.smithi112.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T00:07:40.754 INFO:journalctl@ceph.mon.b.smithi112.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T00:07:40.754 INFO:journalctl@ceph.mon.b.smithi112.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-11T00:07:40.754 INFO:journalctl@ceph.mon.b.smithi112.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T00:07:40.754 INFO:journalctl@ceph.mon.b.smithi112.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T00:07:40.754 INFO:journalctl@ceph.mon.b.smithi112.stdout: 2024-09-11T00:07:40.754 INFO:journalctl@ceph.mon.b.smithi112.stdout: ** Compaction Stats [default] ** 2024-09-11T00:07:40.754 INFO:journalctl@ceph.mon.b.smithi112.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T00:07:40.754 INFO:journalctl@ceph.mon.b.smithi112.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-11T00:07:40.754 INFO:journalctl@ceph.mon.b.smithi112.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T00:07:40.754 INFO:journalctl@ceph.mon.b.smithi112.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T00:07:40.754 INFO:journalctl@ceph.mon.b.smithi112.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T00:07:40.755 INFO:journalctl@ceph.mon.b.smithi112.stdout: 2024-09-11T00:07:40.755 INFO:journalctl@ceph.mon.b.smithi112.stdout: ** Compaction Stats [default] ** 2024-09-11T00:07:40.755 INFO:journalctl@ceph.mon.b.smithi112.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T00:07:40.755 INFO:journalctl@ceph.mon.b.smithi112.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T00:07:40.755 INFO:journalctl@ceph.mon.b.smithi112.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T00:07:40.755 INFO:journalctl@ceph.mon.b.smithi112.stdout: 2024-09-11T00:07:40.755 INFO:journalctl@ceph.mon.b.smithi112.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-11T00:07:40.755 INFO:journalctl@ceph.mon.b.smithi112.stdout: 2024-09-11T00:07:40.755 INFO:journalctl@ceph.mon.b.smithi112.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T00:07:40.755 INFO:journalctl@ceph.mon.b.smithi112.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-11T00:07:40.755 INFO:journalctl@ceph.mon.b.smithi112.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-11T00:07:40.755 INFO:journalctl@ceph.mon.b.smithi112.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-11T00:07:40.755 INFO:journalctl@ceph.mon.b.smithi112.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-11T00:07:40.755 INFO:journalctl@ceph.mon.b.smithi112.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-11T00:07:40.756 INFO:journalctl@ceph.mon.b.smithi112.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T00:07:40.756 INFO:journalctl@ceph.mon.b.smithi112.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T00:07:40.756 INFO:journalctl@ceph.mon.b.smithi112.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-11T00:07:40.756 INFO:journalctl@ceph.mon.b.smithi112.stdout: Block cache BinnedLRUCache@0x55939f1cf610#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-11T00:07:40.756 INFO:journalctl@ceph.mon.b.smithi112.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-11T00:07:40.756 INFO:journalctl@ceph.mon.b.smithi112.stdout: 2024-09-11T00:07:40.756 INFO:journalctl@ceph.mon.b.smithi112.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-11T00:07:40.756 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-11T00:07:40.756 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: using public_addr v2:172.21.15.112:0/0 -> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] 2024-09-11T00:07:40.756 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: starting mon.b rank -1 at public addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] at bind addrs [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:07:40.757 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: mon.b@-1(???) e0 preinit fsid 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:07:40.757 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: mon.b@-1(synchronizing).mds e1 new map 2024-09-11T00:07:40.757 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-11T00:07:40.757 INFO:journalctl@ceph.mon.b.smithi112.stdout: e1 2024-09-11T00:07:40.757 INFO:journalctl@ceph.mon.b.smithi112.stdout: btime 2024-09-11T00:06:05:704536+0000 2024-09-11T00:07:40.757 INFO:journalctl@ceph.mon.b.smithi112.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:07:40.757 INFO:journalctl@ceph.mon.b.smithi112.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T00:07:40.757 INFO:journalctl@ceph.mon.b.smithi112.stdout: legacy client fscid: -1 2024-09-11T00:07:40.757 INFO:journalctl@ceph.mon.b.smithi112.stdout: 2024-09-11T00:07:40.757 INFO:journalctl@ceph.mon.b.smithi112.stdout: No filesystems configured 2024-09-11T00:07:40.757 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-11T00:07:40.757 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-11T00:07:40.757 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-11T00:07:40.758 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-11T00:07:40.758 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-11T00:07:40.758 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-11T00:07:40.758 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-11T00:07:40.758 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T00:07:40.758 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T00:07:40.758 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T00:07:40.758 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi138", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:40.758 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:40.758 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:40.758 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:40.758 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:40.758 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"} : dispatch 2024-09-11T00:07:40.758 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:40.759 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:07:40.759 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: Deploying cephadm binary to smithi138 2024-09-11T00:07:40.759 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-11T00:07:40.759 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: Updating smithi112:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:07:40.759 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:40.759 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:07:40.759 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: Updating smithi112:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:07:40.759 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:40.759 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:40.759 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:40.759 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:40.759 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:07:40.759 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: Added host smithi138 2024-09-11T00:07:40.759 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:40.760 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:40.760 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:40.760 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:40.760 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:07:40.760 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:40.760 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2950611232' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-11T00:07:40.760 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2950611232' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-11T00:07:40.760 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T00:07:40.760 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:40.760 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:40.760 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:40.760 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:40.760 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi138", "name": "osd_memory_target"} : dispatch 2024-09-11T00:07:40.760 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:40.761 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:07:40.761 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:40.761 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: Updating smithi138:/etc/ceph/ceph.conf 2024-09-11T00:07:40.761 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: Updating smithi138:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:07:40.761 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:07:40.761 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: Updating smithi138:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:07:40.761 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:40.761 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:40.761 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi078:172.21.15.78=a;smithi112:172.21.15.112=b;smithi138:172.21.15.138=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:07:40.761 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: Saving service mon spec with placement smithi078:172.21.15.78=a;smithi112:172.21.15.112=b;smithi138:172.21.15.138=c;count:3 2024-09-11T00:07:40.761 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:40.761 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:40.761 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:07:40.761 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:40.762 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: Deploying daemon mon.c on smithi138 2024-09-11T00:07:40.762 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:40.762 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='client.? 172.21.15.138:0/2078137721' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-11T00:07:40.762 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:40.762 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:07:40.762 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:07:40.762 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: mon.a calling monitor election 2024-09-11T00:07:40.762 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:40.762 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:07:40.762 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:07:40.762 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: mon.c calling monitor election 2024-09-11T00:07:40.762 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:40.762 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:07:40.762 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:07:40.763 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:40.763 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:07:40.763 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T00:07:40.763 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: monmap epoch 2 2024-09-11T00:07:40.763 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: fsid 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:07:40.763 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: last_changed 2024-09-11T00:07:31.421156+0000 2024-09-11T00:07:40.763 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: created 2024-09-11T00:06:02.756204+0000 2024-09-11T00:07:40.763 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: min_mon_release 19 (squid) 2024-09-11T00:07:40.763 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: election_strategy: 1 2024-09-11T00:07:40.763 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: 0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-11T00:07:40.763 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: 1: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.c 2024-09-11T00:07:40.763 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: fsmap 2024-09-11T00:07:40.763 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T00:07:40.764 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: mgrmap e13: x(active, since 40s) 2024-09-11T00:07:40.764 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: overall HEALTH_OK 2024-09-11T00:07:40.764 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:40.764 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:40.764 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:40.764 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:07:40.764 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:40.764 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: Deploying daemon mon.b on smithi112 2024-09-11T00:07:40.764 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='client.? 172.21.15.138:0/1216839892' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-11T00:07:40.764 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:07:40.764 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:40.764 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: from='client.? 172.21.15.138:0/515546189' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-11T00:07:40.764 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 ceph-mon[35627]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-11T00:07:40.764 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 bash[35608]: d7e4d59fe83afcef44841f3684d61c9085e833c61735568503c81d37c9c62cd5 2024-09-11T00:07:40.765 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:40 smithi112 systemd[1]: Started Ceph mon.b for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:07:40.857 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T00:07:40.858 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T00:07:41.109 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:07:45.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:07:45.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: mon.a calling monitor election 2024-09-11T00:07:45.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:45.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:07:45.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: mon.c calling monitor election 2024-09-11T00:07:45.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:45.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:45.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:45.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: mon.b calling monitor election 2024-09-11T00:07:45.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:45.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:45.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:45.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:45.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T00:07:45.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: monmap epoch 3 2024-09-11T00:07:45.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: fsid 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:07:45.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: last_changed 2024-09-11T00:07:40.432126+0000 2024-09-11T00:07:45.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: created 2024-09-11T00:06:02.756204+0000 2024-09-11T00:07:45.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: min_mon_release 19 (squid) 2024-09-11T00:07:45.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: election_strategy: 1 2024-09-11T00:07:45.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: 0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-11T00:07:45.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: 1: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.c 2024-09-11T00:07:45.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: 2: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.b 2024-09-11T00:07:45.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: fsmap 2024-09-11T00:07:45.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T00:07:45.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: mgrmap e13: x(active, since 49s) 2024-09-11T00:07:45.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: overall HEALTH_OK 2024-09-11T00:07:45.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:45.796 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:45.796 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:45.796 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:45 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:45.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:07:45.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: mon.a calling monitor election 2024-09-11T00:07:45.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:45.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:07:45.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: mon.c calling monitor election 2024-09-11T00:07:45.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:45.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:45.836 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:45.836 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: mon.b calling monitor election 2024-09-11T00:07:45.836 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:45.836 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:45.836 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:45.836 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:45.837 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T00:07:45.837 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: monmap epoch 3 2024-09-11T00:07:45.837 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: fsid 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:07:45.837 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: last_changed 2024-09-11T00:07:40.432126+0000 2024-09-11T00:07:45.837 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: created 2024-09-11T00:06:02.756204+0000 2024-09-11T00:07:45.837 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: min_mon_release 19 (squid) 2024-09-11T00:07:45.838 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: election_strategy: 1 2024-09-11T00:07:45.838 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: 0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-11T00:07:45.838 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: 1: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.c 2024-09-11T00:07:45.838 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: 2: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.b 2024-09-11T00:07:45.838 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: fsmap 2024-09-11T00:07:45.838 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T00:07:45.839 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: mgrmap e13: x(active, since 49s) 2024-09-11T00:07:45.839 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: overall HEALTH_OK 2024-09-11T00:07:45.839 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:45.839 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:45.839 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:45.839 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:45 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:07:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: mon.a calling monitor election 2024-09-11T00:07:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:07:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: mon.c calling monitor election 2024-09-11T00:07:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: mon.b calling monitor election 2024-09-11T00:07:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T00:07:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: monmap epoch 3 2024-09-11T00:07:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: fsid 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:07:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: last_changed 2024-09-11T00:07:40.432126+0000 2024-09-11T00:07:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: created 2024-09-11T00:06:02.756204+0000 2024-09-11T00:07:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: min_mon_release 19 (squid) 2024-09-11T00:07:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: election_strategy: 1 2024-09-11T00:07:45.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: 0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-11T00:07:45.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: 1: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.c 2024-09-11T00:07:45.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: 2: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.b 2024-09-11T00:07:45.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: fsmap 2024-09-11T00:07:45.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T00:07:45.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: mgrmap e13: x(active, since 49s) 2024-09-11T00:07:45.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: overall HEALTH_OK 2024-09-11T00:07:45.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:45.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:45.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:45.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:45 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:46.159 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:07:46.160 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":3,"fsid":"85a53860-6fd1-11ef-bcea-c7b262605968","modified":"2024-09-11T00:07:40.432126Z","created":"2024-09-11T00:06:02.756204Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-11T00:07:46.160 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 3 2024-09-11T00:07:46.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:46 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:07:46.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:46 smithi138 ceph-mon[35019]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:46.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:46 smithi138 ceph-mon[35019]: from='client.? 172.21.15.138:0/3909787786' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-11T00:07:46.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:46 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:46.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:46 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:46.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:46 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:07:46.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:46 smithi078 ceph-mon[30865]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:46.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:46 smithi078 ceph-mon[30865]: from='client.? 172.21.15.138:0/3909787786' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-11T00:07:46.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:46 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:46.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:46 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:46.890 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-11T00:07:46.890 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-11T00:07:46.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:46 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:07:46.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:46 smithi112 ceph-mon[35627]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:46.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:46 smithi112 ceph-mon[35627]: from='client.? 172.21.15.138:0/3909787786' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-11T00:07:46.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:46 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:46.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:46 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:47.141 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:07:47.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:47 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:47.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:47 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:47.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:47 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:47.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:47 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:47.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:47 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:47.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:47 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:07:47.882 INFO:teuthology.orchestra.run.smithi078.stdout:# minimal ceph.conf for 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:07:47.883 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2024-09-11T00:07:47.883 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:07:47.883 INFO:teuthology.orchestra.run.smithi078.stdout: mon_host = [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-11T00:07:47.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:47 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:47.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:47 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:47.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:47 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:47.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:47 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:47.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:47 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:47.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:47 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:07:48.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:47 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:47 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:47 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:47 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:47 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:48.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:47 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:07:48.467 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-11T00:07:48.468 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-11T00:07:48.468 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T00:07:48.494 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-11T00:07:48.494 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:07:48.559 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-11T00:07:48.559 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T00:07:48.589 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-11T00:07:48.589 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:07:48.656 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-11T00:07:48.656 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T00:07:48.683 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-11T00:07:48.684 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:07:48.749 INFO:tasks.cephadm:enabling module snap_schedule 2024-09-11T00:07:48.749 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-09-11T00:07:48.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: Updating smithi078:/etc/ceph/ceph.conf 2024-09-11T00:07:48.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-11T00:07:48.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: Updating smithi138:/etc/ceph/ceph.conf 2024-09-11T00:07:48.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: Updating smithi078:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:07:48.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: Updating smithi138:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:07:48.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: Updating smithi112:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:07:48.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.796 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.796 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T00:07:48.796 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:07:48.796 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:07:48.796 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:48.796 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: Reconfiguring daemon mon.a on smithi078 2024-09-11T00:07:48.796 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1337748233' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:48.797 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:48 smithi138 ceph-mon[35019]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:48.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: Updating smithi078:/etc/ceph/ceph.conf 2024-09-11T00:07:48.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-11T00:07:48.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: Updating smithi138:/etc/ceph/ceph.conf 2024-09-11T00:07:48.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: Updating smithi078:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:07:48.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: Updating smithi138:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:07:48.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: Updating smithi112:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:07:48.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T00:07:48.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:07:48.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:07:48.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:48.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: Reconfiguring daemon mon.a on smithi078 2024-09-11T00:07:48.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1337748233' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:48.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:48 smithi078 ceph-mon[30865]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:48.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: Updating smithi078:/etc/ceph/ceph.conf 2024-09-11T00:07:48.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-11T00:07:48.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: Updating smithi138:/etc/ceph/ceph.conf 2024-09-11T00:07:48.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: Updating smithi078:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:07:48.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: Updating smithi138:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:07:48.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: Updating smithi112:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:07:48.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.985 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:48.985 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T00:07:48.985 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:07:48.985 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:07:48.985 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:48.985 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: Reconfiguring daemon mon.a on smithi078 2024-09-11T00:07:48.985 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1337748233' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:48.985 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:48 smithi112 ceph-mon[35627]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:49.225 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:07:50.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:50 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:50.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:50 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:50.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:50 smithi112 ceph-mon[35627]: Reconfiguring mon.b (monmap changed)... 2024-09-11T00:07:50.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:50 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:07:50.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:50 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:07:50.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:50 smithi112 ceph-mon[35627]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:50.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:50 smithi112 ceph-mon[35627]: Reconfiguring daemon mon.b on smithi112 2024-09-11T00:07:50.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:50 smithi112 ceph-mon[35627]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:50.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:50 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/4156110810' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-11T00:07:50.984 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:50 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:50.984 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:50 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:50.985 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:50 smithi078 ceph-mon[30865]: Reconfiguring mon.b (monmap changed)... 2024-09-11T00:07:50.985 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:50 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:07:50.985 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:50 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:07:50.985 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:50 smithi078 ceph-mon[30865]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:50.985 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:50 smithi078 ceph-mon[30865]: Reconfiguring daemon mon.b on smithi112 2024-09-11T00:07:50.985 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:50 smithi078 ceph-mon[30865]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:50.985 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:50 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/4156110810' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-11T00:07:50.985 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:07:50 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: ignoring --setuser ceph since I am not root 2024-09-11T00:07:50.985 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:07:50 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: ignoring --setgroup ceph since I am not root 2024-09-11T00:07:51.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:50 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:51.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:50 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' 2024-09-11T00:07:51.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:50 smithi138 ceph-mon[35019]: Reconfiguring mon.b (monmap changed)... 2024-09-11T00:07:51.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:50 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:07:51.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:50 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:07:51.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:50 smithi138 ceph-mon[35019]: from='mgr.14148 172.21.15.78:0/1272781094' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:07:51.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:50 smithi138 ceph-mon[35019]: Reconfiguring daemon mon.b on smithi112 2024-09-11T00:07:51.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:50 smithi138 ceph-mon[35019]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:07:51.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:50 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/4156110810' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-11T00:07:51.281 INFO:tasks.cephadm:Adding mgr.x on smithi078 2024-09-11T00:07:51.281 INFO:tasks.cephadm:Adding mgr.y on smithi112 2024-09-11T00:07:51.281 INFO:tasks.cephadm:Adding mgr.z on smithi138 2024-09-11T00:07:51.282 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi078=x;smithi112=y;smithi138=z' 2024-09-11T00:07:51.535 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:07:51.958 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:51 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/4156110810' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-11T00:07:51.959 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:51 smithi138 ceph-mon[35019]: mgrmap e14: x(active, since 54s) 2024-09-11T00:07:51.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:51 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/4156110810' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-11T00:07:51.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:51 smithi112 ceph-mon[35627]: mgrmap e14: x(active, since 54s) 2024-09-11T00:07:52.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:51 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/4156110810' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-11T00:07:52.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:51 smithi078 ceph-mon[30865]: mgrmap e14: x(active, since 54s) 2024-09-11T00:07:55.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:55 smithi112 ceph-mon[35627]: Active manager daemon x restarted 2024-09-11T00:07:55.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:55 smithi112 ceph-mon[35627]: Activating manager daemon x 2024-09-11T00:07:55.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:55 smithi112 ceph-mon[35627]: osdmap e5: 0 total, 0 up, 0 in 2024-09-11T00:07:55.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:55 smithi112 ceph-mon[35627]: mgrmap e15: x(active, starting, since 0.00669627s) 2024-09-11T00:07:55.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:55 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:07:55.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:55 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:55.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:55 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:07:55.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:55 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-11T00:07:55.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:55 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-11T00:07:55.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:55 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-11T00:07:55.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:55 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-11T00:07:55.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:55 smithi112 ceph-mon[35627]: Manager daemon x is now available 2024-09-11T00:07:56.003 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:55 smithi138 ceph-mon[35019]: Active manager daemon x restarted 2024-09-11T00:07:56.003 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:55 smithi138 ceph-mon[35019]: Activating manager daemon x 2024-09-11T00:07:56.003 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:55 smithi138 ceph-mon[35019]: osdmap e5: 0 total, 0 up, 0 in 2024-09-11T00:07:56.003 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:55 smithi138 ceph-mon[35019]: mgrmap e15: x(active, starting, since 0.00669627s) 2024-09-11T00:07:56.003 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:55 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:07:56.003 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:55 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:56.003 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:55 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:07:56.003 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:55 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-11T00:07:56.003 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:55 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-11T00:07:56.003 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:55 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-11T00:07:56.003 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:55 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-11T00:07:56.003 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:55 smithi138 ceph-mon[35019]: Manager daemon x is now available 2024-09-11T00:07:56.068 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:55 smithi078 ceph-mon[30865]: Active manager daemon x restarted 2024-09-11T00:07:56.068 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:55 smithi078 ceph-mon[30865]: Activating manager daemon x 2024-09-11T00:07:56.068 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:55 smithi078 ceph-mon[30865]: osdmap e5: 0 total, 0 up, 0 in 2024-09-11T00:07:56.069 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:55 smithi078 ceph-mon[30865]: mgrmap e15: x(active, starting, since 0.00669627s) 2024-09-11T00:07:56.069 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:55 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:07:56.069 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:55 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:07:56.069 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:55 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:07:56.069 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:55 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-11T00:07:56.069 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:55 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-11T00:07:56.069 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:55 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-11T00:07:56.069 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:55 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-11T00:07:56.069 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:55 smithi078 ceph-mon[30865]: Manager daemon x is now available 2024-09-11T00:07:56.604 INFO:teuthology.orchestra.run.smithi138.stdout:Scheduled mgr update... 2024-09-11T00:07:56.940 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:07:56.940 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-11T00:07:56.940 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-11T00:07:56.940 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-mon[30865]: mgrmap e16: x(active, since 1.0084s) 2024-09-11T00:07:56.940 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:56.941 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: 2024-09-11T00:07:56.806+0000 7f36c4400640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:00:07:56] ENGINE Error in HTTPServer.serve 2024-09-11T00:07:56.941 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: Traceback (most recent call last): 2024-09-11T00:07:56.941 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T00:07:56.941 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: self._connections.run(self.expiration_interval) 2024-09-11T00:07:56.941 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T00:07:56.941 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: self._run(expiration_interval) 2024-09-11T00:07:56.941 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T00:07:56.941 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T00:07:56.941 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T00:07:56.941 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T00:07:56.941 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T00:07:56.941 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: s = self.context.wrap_socket( 2024-09-11T00:07:56.941 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T00:07:56.942 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: return self.sslsocket_class._create( 2024-09-11T00:07:56.942 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T00:07:56.942 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: self.do_handshake() 2024-09-11T00:07:56.942 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T00:07:56.942 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: self._sslobj.do_handshake() 2024-09-11T00:07:56.942 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T00:07:56.942 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:07:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: 2024-09-11T00:07:56.946 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:56 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:07:56.947 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:56 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-11T00:07:56.947 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:56 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-11T00:07:56.947 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:56 smithi138 ceph-mon[35019]: mgrmap e16: x(active, since 1.0084s) 2024-09-11T00:07:56.947 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:56 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:56.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:56 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:07:56.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:56 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-11T00:07:56.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:56 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-11T00:07:56.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:56 smithi112 ceph-mon[35627]: mgrmap e16: x(active, since 1.0084s) 2024-09-11T00:07:56.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:56 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:57.233 DEBUG:teuthology.orchestra.run.smithi112:mgr.y> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mgr.y.service 2024-09-11T00:07:57.236 DEBUG:teuthology.orchestra.run.smithi138:mgr.z> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mgr.z.service 2024-09-11T00:07:57.238 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-11T00:07:57.238 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-09-11T00:07:57.241 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-11T00:07:57.241 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set client debug_client 20 2024-09-11T00:07:57.284 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-11T00:07:57.284 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set client debug_ms 1 2024-09-11T00:07:57.327 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-11T00:07:57.327 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-09-11T00:07:57.372 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-11T00:07:57.372 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-09-11T00:07:57.415 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-11T00:07:57.415 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds 20 2024-09-11T00:07:57.458 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-11T00:07:57.458 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-09-11T00:07:57.507 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-11T00:07:57.507 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set mds debug_ms 2 2024-09-11T00:07:57.555 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-11T00:07:57.555 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-11T00:07:57.599 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-11T00:07:57.600 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-09-11T00:07:57.605 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:07:57.614 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-11T00:07:57.614 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-09-11T00:07:57.662 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-11T00:07:57.662 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-09-11T00:07:57.663 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:07:57.707 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-11T00:07:57.707 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-09-11T00:07:57.750 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-11T00:07:57.750 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-09-11T00:07:57.793 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-11T00:07:57.794 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-09-11T00:07:57.826 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:57 smithi078 ceph-mon[30865]: Saving service mgr spec with placement smithi078=x;smithi112=y;smithi138=z;count:3 2024-09-11T00:07:57.826 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:57 smithi078 ceph-mon[30865]: [11/Sep/2024:00:07:56] ENGINE Bus STARTING 2024-09-11T00:07:57.826 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:57 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:57.826 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:57 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:57.826 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:57 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:57.826 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:57 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:57.834 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-11T00:07:57.834 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-09-11T00:07:57.890 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-11T00:07:57.891 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-09-11T00:07:57.942 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-11T00:07:57.942 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-09-11T00:07:57.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:57 smithi112 ceph-mon[35627]: Saving service mgr spec with placement smithi078=x;smithi112=y;smithi138=z;count:3 2024-09-11T00:07:57.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:57 smithi112 ceph-mon[35627]: [11/Sep/2024:00:07:56] ENGINE Bus STARTING 2024-09-11T00:07:57.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:57 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:57.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:57 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:57.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:57 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:57.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:57 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:57.990 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-11T00:07:57.991 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-09-11T00:07:58.041 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-09-11T00:07:58.042 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set mgr debug_cephsqlite 20 2024-09-11T00:07:58.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:57 smithi138 ceph-mon[35019]: Saving service mgr spec with placement smithi078=x;smithi112=y;smithi138=z;count:3 2024-09-11T00:07:58.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:57 smithi138 ceph-mon[35019]: [11/Sep/2024:00:07:56] ENGINE Bus STARTING 2024-09-11T00:07:58.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:57 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:58.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:57 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:58.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:57 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:58.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:57 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:58.109 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-09-11T00:07:58.109 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-09-11T00:07:58.153 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-09-11T00:07:58.153 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-09-11T00:07:58.198 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-09-11T00:07:58.198 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-09-11T00:07:58.251 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-11T00:07:58.251 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-09-11T00:07:58.300 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-11T00:07:58.300 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-11T00:07:58.359 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-11T00:07:58.359 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-09-11T00:07:58.431 DEBUG:tasks.cephadm:set 26 configs 2024-09-11T00:07:58.431 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi078') 2024-09-11T00:07:58.973 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:58 smithi078 ceph-mon[30865]: [11/Sep/2024:00:07:56] ENGINE Serving on https://172.21.15.78:7150 2024-09-11T00:07:58.974 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:58 smithi078 ceph-mon[30865]: [11/Sep/2024:00:07:56] ENGINE Error in HTTPServer.serve 2024-09-11T00:07:58.974 INFO:journalctl@ceph.mon.a.smithi078.stdout: Traceback (most recent call last): 2024-09-11T00:07:58.974 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T00:07:58.974 INFO:journalctl@ceph.mon.a.smithi078.stdout: self._connections.run(self.expiration_interval) 2024-09-11T00:07:58.974 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T00:07:58.975 INFO:journalctl@ceph.mon.a.smithi078.stdout: self._run(expiration_interval) 2024-09-11T00:07:58.975 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T00:07:58.975 INFO:journalctl@ceph.mon.a.smithi078.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T00:07:58.975 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T00:07:58.975 INFO:journalctl@ceph.mon.a.smithi078.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T00:07:58.975 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T00:07:58.975 INFO:journalctl@ceph.mon.a.smithi078.stdout: s = self.context.wrap_socket( 2024-09-11T00:07:58.975 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T00:07:58.976 INFO:journalctl@ceph.mon.a.smithi078.stdout: return self.sslsocket_class._create( 2024-09-11T00:07:58.976 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T00:07:58.976 INFO:journalctl@ceph.mon.a.smithi078.stdout: self.do_handshake() 2024-09-11T00:07:58.976 INFO:journalctl@ceph.mon.a.smithi078.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T00:07:58.976 INFO:journalctl@ceph.mon.a.smithi078.stdout: self._sslobj.do_handshake() 2024-09-11T00:07:58.976 INFO:journalctl@ceph.mon.a.smithi078.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T00:07:58.976 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:58 smithi078 ceph-mon[30865]: [11/Sep/2024:00:07:56] ENGINE Serving on http://172.21.15.78:8765 2024-09-11T00:07:58.977 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:58 smithi078 ceph-mon[30865]: [11/Sep/2024:00:07:56] ENGINE Bus STARTED 2024-09-11T00:07:58.977 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:58.977 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:58.977 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:58.977 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:58.977 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"} : dispatch 2024-09-11T00:07:58.978 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:58.978 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:58.978 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi138", "name": "osd_memory_target"} : dispatch 2024-09-11T00:07:58.978 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:58 smithi078 ceph-mon[30865]: mgrmap e17: x(active, since 2s) 2024-09-11T00:07:58.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:58 smithi112 ceph-mon[35627]: [11/Sep/2024:00:07:56] ENGINE Serving on https://172.21.15.78:7150 2024-09-11T00:07:58.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:58 smithi112 ceph-mon[35627]: [11/Sep/2024:00:07:56] ENGINE Error in HTTPServer.serve 2024-09-11T00:07:58.982 INFO:journalctl@ceph.mon.b.smithi112.stdout: Traceback (most recent call last): 2024-09-11T00:07:58.982 INFO:journalctl@ceph.mon.b.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T00:07:58.982 INFO:journalctl@ceph.mon.b.smithi112.stdout: self._connections.run(self.expiration_interval) 2024-09-11T00:07:58.982 INFO:journalctl@ceph.mon.b.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T00:07:58.982 INFO:journalctl@ceph.mon.b.smithi112.stdout: self._run(expiration_interval) 2024-09-11T00:07:58.983 INFO:journalctl@ceph.mon.b.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T00:07:58.983 INFO:journalctl@ceph.mon.b.smithi112.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T00:07:58.983 INFO:journalctl@ceph.mon.b.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T00:07:58.983 INFO:journalctl@ceph.mon.b.smithi112.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T00:07:58.983 INFO:journalctl@ceph.mon.b.smithi112.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T00:07:58.983 INFO:journalctl@ceph.mon.b.smithi112.stdout: s = self.context.wrap_socket( 2024-09-11T00:07:58.983 INFO:journalctl@ceph.mon.b.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T00:07:58.984 INFO:journalctl@ceph.mon.b.smithi112.stdout: return self.sslsocket_class._create( 2024-09-11T00:07:58.984 INFO:journalctl@ceph.mon.b.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T00:07:58.984 INFO:journalctl@ceph.mon.b.smithi112.stdout: self.do_handshake() 2024-09-11T00:07:58.984 INFO:journalctl@ceph.mon.b.smithi112.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T00:07:58.984 INFO:journalctl@ceph.mon.b.smithi112.stdout: self._sslobj.do_handshake() 2024-09-11T00:07:58.984 INFO:journalctl@ceph.mon.b.smithi112.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T00:07:58.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:58 smithi112 ceph-mon[35627]: [11/Sep/2024:00:07:56] ENGINE Serving on http://172.21.15.78:8765 2024-09-11T00:07:58.985 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:58 smithi112 ceph-mon[35627]: [11/Sep/2024:00:07:56] ENGINE Bus STARTED 2024-09-11T00:07:58.985 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:58.985 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:58.985 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:58.985 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:58.985 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"} : dispatch 2024-09-11T00:07:58.985 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:58.986 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:58.986 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi138", "name": "osd_memory_target"} : dispatch 2024-09-11T00:07:58.986 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:58 smithi112 ceph-mon[35627]: mgrmap e17: x(active, since 2s) 2024-09-11T00:07:59.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:58 smithi138 ceph-mon[35019]: [11/Sep/2024:00:07:56] ENGINE Serving on https://172.21.15.78:7150 2024-09-11T00:07:59.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:58 smithi138 ceph-mon[35019]: [11/Sep/2024:00:07:56] ENGINE Error in HTTPServer.serve 2024-09-11T00:07:59.044 INFO:journalctl@ceph.mon.c.smithi138.stdout: Traceback (most recent call last): 2024-09-11T00:07:59.044 INFO:journalctl@ceph.mon.c.smithi138.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T00:07:59.044 INFO:journalctl@ceph.mon.c.smithi138.stdout: self._connections.run(self.expiration_interval) 2024-09-11T00:07:59.044 INFO:journalctl@ceph.mon.c.smithi138.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T00:07:59.044 INFO:journalctl@ceph.mon.c.smithi138.stdout: self._run(expiration_interval) 2024-09-11T00:07:59.044 INFO:journalctl@ceph.mon.c.smithi138.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T00:07:59.045 INFO:journalctl@ceph.mon.c.smithi138.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T00:07:59.045 INFO:journalctl@ceph.mon.c.smithi138.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T00:07:59.045 INFO:journalctl@ceph.mon.c.smithi138.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T00:07:59.045 INFO:journalctl@ceph.mon.c.smithi138.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T00:07:59.045 INFO:journalctl@ceph.mon.c.smithi138.stdout: s = self.context.wrap_socket( 2024-09-11T00:07:59.045 INFO:journalctl@ceph.mon.c.smithi138.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T00:07:59.045 INFO:journalctl@ceph.mon.c.smithi138.stdout: return self.sslsocket_class._create( 2024-09-11T00:07:59.046 INFO:journalctl@ceph.mon.c.smithi138.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T00:07:59.046 INFO:journalctl@ceph.mon.c.smithi138.stdout: self.do_handshake() 2024-09-11T00:07:59.046 INFO:journalctl@ceph.mon.c.smithi138.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T00:07:59.046 INFO:journalctl@ceph.mon.c.smithi138.stdout: self._sslobj.do_handshake() 2024-09-11T00:07:59.046 INFO:journalctl@ceph.mon.c.smithi138.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T00:07:59.046 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:58 smithi138 ceph-mon[35019]: [11/Sep/2024:00:07:56] ENGINE Serving on http://172.21.15.78:8765 2024-09-11T00:07:59.047 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:58 smithi138 ceph-mon[35019]: [11/Sep/2024:00:07:56] ENGINE Bus STARTED 2024-09-11T00:07:59.047 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:59.047 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:59.047 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:59.047 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:59.047 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi112", "name": "osd_memory_target"} : dispatch 2024-09-11T00:07:59.048 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:59.048 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:07:59.048 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi138", "name": "osd_memory_target"} : dispatch 2024-09-11T00:07:59.048 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:58 smithi138 ceph-mon[35019]: mgrmap e17: x(active, since 2s) 2024-09-11T00:07:59.978 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:00.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi078", "name": "osd_memory_target"} : dispatch 2024-09-11T00:08:00.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:00.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:00.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: Updating smithi078:/etc/ceph/ceph.conf 2024-09-11T00:08:00.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-11T00:08:00.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: Updating smithi138:/etc/ceph/ceph.conf 2024-09-11T00:08:00.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: from='client.? ' entity='client.admin' 2024-09-11T00:08:00.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: from='client.? ' entity='client.admin' 2024-09-11T00:08:00.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: Updating smithi078:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:08:00.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: Updating smithi138:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:08:00.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: Updating smithi112:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:08:00.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: Updating smithi078:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:08:00.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:08:00.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:08:00.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: Updating smithi078:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:08:00.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: Updating smithi138:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:08:00.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: Updating smithi112:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:08:00.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-11T00:08:00.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T00:08:00.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-11T00:08:00.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:07:59 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:00.252 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.252 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.252 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi078", "name": "osd_memory_target"} : dispatch 2024-09-11T00:08:00.252 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:00.252 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:00.253 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: Updating smithi078:/etc/ceph/ceph.conf 2024-09-11T00:08:00.253 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-11T00:08:00.256 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: Updating smithi138:/etc/ceph/ceph.conf 2024-09-11T00:08:00.256 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: from='client.? ' entity='client.admin' 2024-09-11T00:08:00.256 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: from='client.? ' entity='client.admin' 2024-09-11T00:08:00.256 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: Updating smithi078:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:08:00.256 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: Updating smithi138:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:08:00.256 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: Updating smithi112:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:08:00.256 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: Updating smithi078:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:08:00.256 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:08:00.256 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:08:00.257 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: Updating smithi078:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:08:00.257 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: Updating smithi138:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:08:00.257 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: Updating smithi112:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:08:00.257 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.257 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.257 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.257 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.257 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.257 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.257 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.257 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-11T00:08:00.257 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T00:08:00.257 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-11T00:08:00.257 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:07:59 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:00.311 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.311 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.311 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi078", "name": "osd_memory_target"} : dispatch 2024-09-11T00:08:00.311 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:00.311 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:00.312 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: Updating smithi078:/etc/ceph/ceph.conf 2024-09-11T00:08:00.312 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: Updating smithi112:/etc/ceph/ceph.conf 2024-09-11T00:08:00.312 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: Updating smithi138:/etc/ceph/ceph.conf 2024-09-11T00:08:00.312 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: from='client.? ' entity='client.admin' 2024-09-11T00:08:00.312 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: from='client.? ' entity='client.admin' 2024-09-11T00:08:00.313 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: Updating smithi078:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:08:00.313 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: Updating smithi138:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:08:00.313 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: Updating smithi112:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:08:00.313 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: Updating smithi078:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:08:00.313 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:08:00.313 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: Updating smithi112:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:08:00.314 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: Updating smithi078:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:08:00.314 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: Updating smithi138:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:08:00.314 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: Updating smithi112:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:08:00.314 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.314 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.314 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.314 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.314 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.315 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.315 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:00.315 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-11T00:08:00.315 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T00:08:00.315 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-11T00:08:00.315 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:07:59 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:00.337 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi078') 2024-09-11T00:08:00.337 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi078') 2024-09-11T00:08:00.640 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:00.640 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:00.641 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:00.644 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:00.653 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:00.659 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:00.663 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:00.663 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:00.663 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:00.825 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:01.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.033+0000 7f7911216640 1 -- 172.21.15.78:0/251774450 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f78f403f560 msgr2=0x7f78f4041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:01.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.033+0000 7f7911216640 1 --2- 172.21.15.78:0/251774450 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f78f403f560 0x7f78f4041a20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7900000c00 tx=0x7f7900005e20 comp rx=0 tx=0).stop 2024-09-11T00:08:01.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.033+0000 7f7911216640 1 -- 172.21.15.78:0/251774450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f790c101d30 msgr2=0x7f790c197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:01.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.033+0000 7f7911216640 1 --2- 172.21.15.78:0/251774450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f790c101d30 0x7f790c197f00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00c970 tx=0x7f78fc00ce30 comp rx=0 tx=0).stop 2024-09-11T00:08:01.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.033+0000 7f7911216640 1 -- 172.21.15.78:0/251774450 shutdown_connections 2024-09-11T00:08:01.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.033+0000 7f7911216640 1 --2- 172.21.15.78:0/251774450 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f78f403f560 0x7f78f4041a20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.033+0000 7f7911216640 1 --2- 172.21.15.78:0/251774450 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f790c1080c0 0x7f790c19d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.033+0000 7f7911216640 1 --2- 172.21.15.78:0/251774450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f790c107740 0x7f790c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.033+0000 7f7911216640 1 --2- 172.21.15.78:0/251774450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f790c101d30 0x7f790c197f00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.033+0000 7f7911216640 1 -- 172.21.15.78:0/251774450 >> 172.21.15.78:0/251774450 conn(0x7f790c0fd7e0 msgr2=0x7f790c0ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:01.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.033+0000 7f7911216640 1 -- 172.21.15.78:0/251774450 shutdown_connections 2024-09-11T00:08:01.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.034+0000 7f7911216640 1 -- 172.21.15.78:0/251774450 wait complete. 2024-09-11T00:08:01.230 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:00 smithi138 ceph-mon[35019]: Deploying daemon mgr.z on smithi138 2024-09-11T00:08:01.231 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:00 smithi112 ceph-mon[35627]: Deploying daemon mgr.z on smithi138 2024-09-11T00:08:01.328 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:00 smithi078 ceph-mon[30865]: Deploying daemon mgr.z on smithi138 2024-09-11T00:08:01.543 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 11 00:08:01 smithi138 systemd[1]: Starting Ceph mgr.z for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:08:01.653 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi078') 2024-09-11T00:08:01.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.839+0000 7fc5d8a3c640 1 -- 172.21.15.78:0/2924778069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5d41076b0 msgr2=0x7fc5d4107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:01.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.839+0000 7fc5d8a3c640 1 --2- 172.21.15.78:0/2924778069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5d41076b0 0x7fc5d4107af0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009900 tx=0x7fc5c802a410 comp rx=0 tx=0).stop 2024-09-11T00:08:01.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.840+0000 7fc5d8a3c640 1 -- 172.21.15.78:0/2924778069 shutdown_connections 2024-09-11T00:08:01.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.840+0000 7fc5d8a3c640 1 --2- 172.21.15.78:0/2924778069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5d4108030 0x7fc5d410e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.840+0000 7fc5d8a3c640 1 --2- 172.21.15.78:0/2924778069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5d41076b0 0x7fc5d4107af0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.840+0000 7fc5d8a3c640 1 --2- 172.21.15.78:0/2924778069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5d4101ca0 0x7fc5d4102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.840+0000 7fc5d8a3c640 1 -- 172.21.15.78:0/2924778069 >> 172.21.15.78:0/2924778069 conn(0x7fc5d40fd6f0 msgr2=0x7fc5d40ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:01.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.840+0000 7fc5d8a3c640 1 -- 172.21.15.78:0/2924778069 shutdown_connections 2024-09-11T00:08:01.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.840+0000 7fc5d8a3c640 1 -- 172.21.15.78:0/2924778069 wait complete. 2024-09-11T00:08:01.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.840+0000 7fc5d8a3c640 1 Processor -- start 2024-09-11T00:08:01.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.840+0000 7fc5d8a3c640 1 -- start start 2024-09-11T00:08:01.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.841+0000 7fc5d8a3c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5d4101ca0 0x7fc5d41990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:01.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.841+0000 7fc5d8a3c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5d41076b0 0x7fc5d41995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.841+0000 7fc5d8a3c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5d4108030 0x7fc5d419e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.841+0000 7fc5d8a3c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d4111a70 con 0x7fc5d41076b0 2024-09-11T00:08:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.841+0000 7fc5d8a3c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d41118f0 con 0x7fc5d4108030 2024-09-11T00:08:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.841+0000 7fc5d8a3c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d4111bf0 con 0x7fc5d4101ca0 2024-09-11T00:08:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.841+0000 7fc5d1d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5d41076b0 0x7fc5d41995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.841+0000 7fc5d1d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5d41076b0 0x7fc5d41995f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53412/0 (socket says 172.21.15.78:53412) 2024-09-11T00:08:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.841+0000 7fc5d1d9b640 1 -- 172.21.15.78:0/329189563 learned_addr learned my addr 172.21.15.78:0/329189563 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.841+0000 7fc5d259c640 1 --2- 172.21.15.78:0/329189563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5d4101ca0 0x7fc5d41990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.841+0000 7fc5d2d9d640 1 --2- 172.21.15.78:0/329189563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5d4108030 0x7fc5d419e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.841+0000 7fc5d1d9b640 1 -- 172.21.15.78:0/329189563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5d4101ca0 msgr2=0x7fc5d41990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:01.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.841+0000 7fc5d1d9b640 1 --2- 172.21.15.78:0/329189563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5d4101ca0 0x7fc5d41990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.841+0000 7fc5d1d9b640 1 -- 172.21.15.78:0/329189563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5d4108030 msgr2=0x7fc5d419e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:01.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.841+0000 7fc5d1d9b640 1 --2- 172.21.15.78:0/329189563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5d4108030 0x7fc5d419e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:01.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.841+0000 7fc5d1d9b640 1 -- 172.21.15.78:0/329189563 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d419f160 con 0x7fc5d41076b0 2024-09-11T00:08:01.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.841+0000 7fc5d259c640 1 --2- 172.21.15.78:0/329189563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5d4101ca0 0x7fc5d41990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:08:01.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.841+0000 7fc5d1d9b640 1 --2- 172.21.15.78:0/329189563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5d41076b0 0x7fc5d41995f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8005940 tx=0x7fc5c8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:01.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.841+0000 7fc5c37fe640 1 -- 172.21.15.78:0/329189563 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c803f070 con 0x7fc5d41076b0 2024-09-11T00:08:01.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.842+0000 7fc5c37fe640 1 -- 172.21.15.78:0/329189563 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7fc5c8031b20 con 0x7fc5d41076b0 2024-09-11T00:08:01.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.842+0000 7fc5c37fe640 1 -- 172.21.15.78:0/329189563 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8035030 con 0x7fc5d41076b0 2024-09-11T00:08:01.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.842+0000 7fc5d8a3c640 1 -- 172.21.15.78:0/329189563 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5d419f3f0 con 0x7fc5d41076b0 2024-09-11T00:08:01.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.842+0000 7fc5d8a3c640 1 -- 172.21.15.78:0/329189563 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5d41a5b10 con 0x7fc5d41076b0 2024-09-11T00:08:01.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.843+0000 7fc5c37fe640 1 -- 172.21.15.78:0/329189563 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 17) ==== 51497+0+0 (secure 0 0 0) 0x7fc5c80316b0 con 0x7fc5d41076b0 2024-09-11T00:08:01.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.843+0000 7fc5d8a3c640 1 -- 172.21.15.78:0/329189563 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5d4102080 con 0x7fc5d41076b0 2024-09-11T00:08:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.843+0000 7fc5c37fe640 1 --2- 172.21.15.78:0/329189563 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc5bc03f560 0x7fc5bc041a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.843+0000 7fc5c37fe640 1 -- 172.21.15.78:0/329189563 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc5c80748f0 con 0x7fc5d41076b0 2024-09-11T00:08:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.843+0000 7fc5d259c640 1 --2- 172.21.15.78:0/329189563 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc5bc03f560 0x7fc5bc041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.843+0000 7fc5d259c640 1 --2- 172.21.15.78:0/329189563 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc5bc03f560 0x7fc5bc041a20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc5c400bfd0 tx=0x7fc5c400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:01.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:01.848+0000 7fc5c37fe640 1 -- 172.21.15.78:0/329189563 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc5c803fe40 con 0x7fc5d41076b0 2024-09-11T00:08:01.913 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 11 00:08:01 smithi138 podman[37645]: 2024-09-11 00:08:01.625286689 +0000 UTC m=+0.092593714 container create b8d535b4a3ee5a74f6de922004fb950666c8a8227a1f4da62a7b64c57e37037c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-11T00:08:01.913 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 11 00:08:01 smithi138 podman[37645]: 2024-09-11 00:08:01.548910028 +0000 UTC m=+0.016217052 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:08:01.914 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 11 00:08:01 smithi138 podman[37645]: 2024-09-11 00:08:01.819337258 +0000 UTC m=+0.286644280 container init b8d535b4a3ee5a74f6de922004fb950666c8a8227a1f4da62a7b64c57e37037c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-11T00:08:01.914 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 11 00:08:01 smithi138 podman[37645]: 2024-09-11 00:08:01.822742723 +0000 UTC m=+0.290049745 container start b8d535b4a3ee5a74f6de922004fb950666c8a8227a1f4da62a7b64c57e37037c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-z, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:08:01.914 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 11 00:08:01 smithi138 ceph-mgr[37665]: -- 172.21.15.138:0/2363444867 <== mon.1 v2:172.21.15.138:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555c89f490e0 con 0x555c89f26800 2024-09-11T00:08:01.914 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 11 00:08:01 smithi138 bash[37645]: b8d535b4a3ee5a74f6de922004fb950666c8a8227a1f4da62a7b64c57e37037c 2024-09-11T00:08:02.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.034+0000 7fc5d8a3c640 1 -- 172.21.15.78:0/329189563 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fc5d41a5d40 con 0x7fc5d41076b0 2024-09-11T00:08:02.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.039+0000 7fc5c37fe640 1 -- 172.21.15.78:0/329189563 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v13)=0 v13) ==== 125+0+0 (secure 0 0 0) 0x7fc5c8042d80 con 0x7fc5d41076b0 2024-09-11T00:08:02.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.041+0000 7fc5d8a3c640 1 -- 172.21.15.78:0/329189563 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc5bc03f560 msgr2=0x7fc5bc041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:02.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.041+0000 7fc5d8a3c640 1 --2- 172.21.15.78:0/329189563 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc5bc03f560 0x7fc5bc041a20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc5c400bfd0 tx=0x7fc5c400b390 comp rx=0 tx=0).stop 2024-09-11T00:08:02.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.041+0000 7fc5d8a3c640 1 -- 172.21.15.78:0/329189563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5d41076b0 msgr2=0x7fc5d41995f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:02.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.041+0000 7fc5d8a3c640 1 --2- 172.21.15.78:0/329189563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5d41076b0 0x7fc5d41995f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8005940 tx=0x7fc5c8003c10 comp rx=0 tx=0).stop 2024-09-11T00:08:02.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.042+0000 7fc5d8a3c640 1 -- 172.21.15.78:0/329189563 shutdown_connections 2024-09-11T00:08:02.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.042+0000 7fc5d8a3c640 1 --2- 172.21.15.78:0/329189563 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc5bc03f560 0x7fc5bc041a20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:02.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.042+0000 7fc5d8a3c640 1 --2- 172.21.15.78:0/329189563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5d4108030 0x7fc5d419e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:02.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.042+0000 7fc5d8a3c640 1 --2- 172.21.15.78:0/329189563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5d41076b0 0x7fc5d41995f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:02.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.042+0000 7fc5d8a3c640 1 --2- 172.21.15.78:0/329189563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc5d4101ca0 0x7fc5d41990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:02.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.042+0000 7fc5d8a3c640 1 -- 172.21.15.78:0/329189563 >> 172.21.15.78:0/329189563 conn(0x7fc5d40fd6f0 msgr2=0x7fc5d4100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:02.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.042+0000 7fc5d8a3c640 1 -- 172.21.15.78:0/329189563 shutdown_connections 2024-09-11T00:08:02.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.042+0000 7fc5d8a3c640 1 -- 172.21.15.78:0/329189563 wait complete. 2024-09-11T00:08:02.284 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:02 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/251774450' entity='client.admin' 2024-09-11T00:08:02.284 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:02 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:02.284 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:02 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:02.284 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:02 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:02.284 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:02 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-11T00:08:02.285 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:02 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T00:08:02.285 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:02 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-11T00:08:02.285 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:02 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:02.292 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 11 00:08:01 smithi138 systemd[1]: Started Ceph mgr.z for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:08:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:02 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/251774450' entity='client.admin' 2024-09-11T00:08:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:02 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:02 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:02 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:02 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-11T00:08:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:02 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T00:08:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:02 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-11T00:08:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:02 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:02.420 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:02 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/251774450' entity='client.admin' 2024-09-11T00:08:02.420 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:02 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:02.420 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:02 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:02.420 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:02 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:02.420 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:02 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-11T00:08:02.420 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:02 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T00:08:02.420 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:02 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-11T00:08:02.420 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:02 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:02.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.727+0000 7f2497d88640 1 -- 172.21.15.78:0/2207230211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24901076a0 msgr2=0x7f2490107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.727+0000 7f2497d88640 1 --2- 172.21.15.78:0/2207230211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24901076a0 0x7f2490107ae0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2480009900 tx=0x7f248002a410 comp rx=0 tx=0).stop 2024-09-11T00:08:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.727+0000 7f2497d88640 1 -- 172.21.15.78:0/2207230211 shutdown_connections 2024-09-11T00:08:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.727+0000 7f2497d88640 1 --2- 172.21.15.78:0/2207230211 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2490108020 0x7f249010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.727+0000 7f2497d88640 1 --2- 172.21.15.78:0/2207230211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24901076a0 0x7f2490107ae0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.727+0000 7f2497d88640 1 --2- 172.21.15.78:0/2207230211 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2490101c90 0x7f2490102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.727+0000 7f2497d88640 1 -- 172.21.15.78:0/2207230211 >> 172.21.15.78:0/2207230211 conn(0x7f24900fd700 msgr2=0x7f24900ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.727+0000 7f2497d88640 1 -- 172.21.15.78:0/2207230211 shutdown_connections 2024-09-11T00:08:02.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.727+0000 7f2497d88640 1 -- 172.21.15.78:0/2207230211 wait complete. 2024-09-11T00:08:02.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.728+0000 7f2497d88640 1 Processor -- start 2024-09-11T00:08:02.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.728+0000 7f2497d88640 1 -- start start 2024-09-11T00:08:02.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.728+0000 7f2497d88640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2490101c90 0x7f2490199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:02.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.728+0000 7f2497d88640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24901076a0 0x7f2490199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:02.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.728+0000 7f2497d88640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2490108020 0x7f249019ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:02.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.728+0000 7f2497d88640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2490111a80 con 0x7f2490108020 2024-09-11T00:08:02.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.728+0000 7f2497d88640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2490111900 con 0x7f24901076a0 2024-09-11T00:08:02.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.728+0000 7f2497d88640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2490111c00 con 0x7f2490101c90 2024-09-11T00:08:02.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.728+0000 7f2496325640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2490108020 0x7f249019ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:02.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.728+0000 7f2495b24640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2490101c90 0x7f2490199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:02.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.728+0000 7f2496325640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2490108020 0x7f249019ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53444/0 (socket says 172.21.15.78:53444) 2024-09-11T00:08:02.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.728+0000 7f2496325640 1 -- 172.21.15.78:0/2593374784 learned_addr learned my addr 172.21.15.78:0/2593374784 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:02.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.728+0000 7f2495323640 1 --2- 172.21.15.78:0/2593374784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24901076a0 0x7f2490199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:02.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.728+0000 7f2496325640 1 -- 172.21.15.78:0/2593374784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2490101c90 msgr2=0x7f2490199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:02.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.728+0000 7f2496325640 1 --2- 172.21.15.78:0/2593374784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2490101c90 0x7f2490199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:02.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.728+0000 7f2496325640 1 -- 172.21.15.78:0/2593374784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24901076a0 msgr2=0x7f2490199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:02.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.728+0000 7f2496325640 1 --2- 172.21.15.78:0/2593374784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24901076a0 0x7f2490199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:02.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.729+0000 7f2496325640 1 -- 172.21.15.78:0/2593374784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249019f1f0 con 0x7f2490108020 2024-09-11T00:08:02.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.729+0000 7f2496325640 1 --2- 172.21.15.78:0/2593374784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2490108020 0x7f249019ea20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f248800eaa0 tx=0x7f248800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:02.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.729+0000 7f2486ffd640 1 -- 172.21.15.78:0/2593374784 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248800cdb0 con 0x7f2490108020 2024-09-11T00:08:02.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.729+0000 7f2486ffd640 1 -- 172.21.15.78:0/2593374784 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f2488005020 con 0x7f2490108020 2024-09-11T00:08:02.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.729+0000 7f2497d88640 1 -- 172.21.15.78:0/2593374784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f249019f4e0 con 0x7f2490108020 2024-09-11T00:08:02.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.729+0000 7f2486ffd640 1 -- 172.21.15.78:0/2593374784 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24880116d0 con 0x7f2490108020 2024-09-11T00:08:02.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.729+0000 7f2497d88640 1 -- 172.21.15.78:0/2593374784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24900fdae0 con 0x7f2490108020 2024-09-11T00:08:02.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.730+0000 7f2497d88640 1 -- 172.21.15.78:0/2593374784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2490102070 con 0x7f2490108020 2024-09-11T00:08:02.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.730+0000 7f2486ffd640 1 -- 172.21.15.78:0/2593374784 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 17) ==== 51497+0+0 (secure 0 0 0) 0x7f248800f040 con 0x7f2490108020 2024-09-11T00:08:02.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.731+0000 7f2486ffd640 1 --2- 172.21.15.78:0/2593374784 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f247c03f560 0x7f247c041a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:02.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.731+0000 7f2486ffd640 1 -- 172.21.15.78:0/2593374784 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f2488053d20 con 0x7f2490108020 2024-09-11T00:08:02.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.731+0000 7f2495b24640 1 --2- 172.21.15.78:0/2593374784 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f247c03f560 0x7f247c041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:02.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.731+0000 7f2495b24640 1 --2- 172.21.15.78:0/2593374784 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f247c03f560 0x7f247c041a20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f248c00bbe0 tx=0x7f248c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:02.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.735+0000 7f2486ffd640 1 -- 172.21.15.78:0/2593374784 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2488016030 con 0x7f2490108020 2024-09-11T00:08:02.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.919+0000 7f2497d88640 1 -- 172.21.15.78:0/2593374784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f24900fdda0 con 0x7f2490108020 2024-09-11T00:08:02.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.925+0000 7f2486ffd640 1 -- 172.21.15.78:0/2593374784 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v15)=0 v15) ==== 123+0+0 (secure 0 0 0) 0x7f24880103d0 con 0x7f2490108020 2024-09-11T00:08:02.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.925+0000 7f2486ffd640 1 -- 172.21.15.78:0/2593374784 <== mon.0 v2:172.21.15.78:3300/0 8 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f2488057030 con 0x7f2490108020 2024-09-11T00:08:02.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.927+0000 7f2497d88640 1 -- 172.21.15.78:0/2593374784 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f247c03f560 msgr2=0x7f247c041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:02.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.927+0000 7f2497d88640 1 --2- 172.21.15.78:0/2593374784 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f247c03f560 0x7f247c041a20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f248c00bbe0 tx=0x7f248c00b390 comp rx=0 tx=0).stop 2024-09-11T00:08:02.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.927+0000 7f2497d88640 1 -- 172.21.15.78:0/2593374784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2490108020 msgr2=0x7f249019ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:02.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.927+0000 7f2497d88640 1 --2- 172.21.15.78:0/2593374784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2490108020 0x7f249019ea20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f248800eaa0 tx=0x7f248800ef60 comp rx=0 tx=0).stop 2024-09-11T00:08:02.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.927+0000 7f2497d88640 1 -- 172.21.15.78:0/2593374784 shutdown_connections 2024-09-11T00:08:02.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.927+0000 7f2497d88640 1 --2- 172.21.15.78:0/2593374784 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f247c03f560 0x7f247c041a20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:02.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.927+0000 7f2497d88640 1 --2- 172.21.15.78:0/2593374784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2490108020 0x7f249019ea20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:02.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.927+0000 7f2497d88640 1 --2- 172.21.15.78:0/2593374784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24901076a0 0x7f2490199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:02.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.927+0000 7f2497d88640 1 --2- 172.21.15.78:0/2593374784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2490101c90 0x7f2490199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:02.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.927+0000 7f2497d88640 1 -- 172.21.15.78:0/2593374784 >> 172.21.15.78:0/2593374784 conn(0x7f24900fd700 msgr2=0x7f24901006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:02.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.927+0000 7f2497d88640 1 -- 172.21.15.78:0/2593374784 shutdown_connections 2024-09-11T00:08:02.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.927+0000 7f2497d88640 1 -- 172.21.15.78:0/2593374784 wait complete. 2024-09-11T00:08:03.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:03 smithi078 ceph-mon[30865]: Deploying daemon mgr.y on smithi112 2024-09-11T00:08:03.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:03 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/329189563' entity='client.admin' 2024-09-11T00:08:03.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:03 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1411317788' entity='client.admin' 2024-09-11T00:08:03.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:03 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2593374784' entity='client.admin' 2024-09-11T00:08:03.313 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:03 smithi112 ceph-mon[35627]: Deploying daemon mgr.y on smithi112 2024-09-11T00:08:03.313 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:03 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/329189563' entity='client.admin' 2024-09-11T00:08:03.313 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:03 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1411317788' entity='client.admin' 2024-09-11T00:08:03.313 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:03 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2593374784' entity='client.admin' 2024-09-11T00:08:03.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:03 smithi138 ceph-mon[35019]: Deploying daemon mgr.y on smithi112 2024-09-11T00:08:03.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:03 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/329189563' entity='client.admin' 2024-09-11T00:08:03.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:03 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1411317788' entity='client.admin' 2024-09-11T00:08:03.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:03 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2593374784' entity='client.admin' 2024-09-11T00:08:03.891 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:03.957 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 11 00:08:03 smithi112 systemd[1]: Starting Ceph mgr.y for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:08:04.232 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 11 00:08:03 smithi112 podman[37936]: 2024-09-11 00:08:03.859137811 +0000 UTC m=+0.015506831 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:08:04.233 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 11 00:08:03 smithi112 podman[37936]: 2024-09-11 00:08:03.973153905 +0000 UTC m=+0.129522920 container create aaa7b99388fe0e7e807f780286fc31db544882bb634cb25bb98777424da40a42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-y, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:08:04.233 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 11 00:08:04 smithi112 podman[37936]: 2024-09-11 00:08:04.167136727 +0000 UTC m=+0.323505742 container init aaa7b99388fe0e7e807f780286fc31db544882bb634cb25bb98777424da40a42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:08:04.233 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 11 00:08:04 smithi112 podman[37936]: 2024-09-11 00:08:04.170660157 +0000 UTC m=+0.327029172 container start aaa7b99388fe0e7e807f780286fc31db544882bb634cb25bb98777424da40a42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-11T00:08:04.233 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 11 00:08:04 smithi112 ceph-mgr[37955]: -- 172.21.15.112:0/505147284 <== mon.2 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5566c8ec90e0 con 0x5566c8ea7000 2024-09-11T00:08:04.732 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 11 00:08:04 smithi112 bash[37936]: aaa7b99388fe0e7e807f780286fc31db544882bb634cb25bb98777424da40a42 2024-09-11T00:08:04.732 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 11 00:08:04 smithi112 systemd[1]: Started Ceph mgr.y for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:08:05.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.063+0000 7f35c29f8640 1 -- 172.21.15.78:0/1067264136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35bc108020 msgr2=0x7f35bc10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.063+0000 7f35c29f8640 1 --2- 172.21.15.78:0/1067264136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35bc108020 0x7f35bc10e820 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009ca0 tx=0x7f35b402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.064+0000 7f35c29f8640 1 -- 172.21.15.78:0/1067264136 shutdown_connections 2024-09-11T00:08:05.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.064+0000 7f35c29f8640 1 --2- 172.21.15.78:0/1067264136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35bc108020 0x7f35bc10e820 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.064+0000 7f35c29f8640 1 --2- 172.21.15.78:0/1067264136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35bc1076a0 0x7f35bc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.064+0000 7f35c29f8640 1 --2- 172.21.15.78:0/1067264136 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35bc101c90 0x7f35bc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.064+0000 7f35c29f8640 1 -- 172.21.15.78:0/1067264136 >> 172.21.15.78:0/1067264136 conn(0x7f35bc0fd700 msgr2=0x7f35bc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:05.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.064+0000 7f35c29f8640 1 -- 172.21.15.78:0/1067264136 shutdown_connections 2024-09-11T00:08:05.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.064+0000 7f35c29f8640 1 -- 172.21.15.78:0/1067264136 wait complete. 2024-09-11T00:08:05.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.064+0000 7f35c29f8640 1 Processor -- start 2024-09-11T00:08:05.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.064+0000 7f35c29f8640 1 -- start start 2024-09-11T00:08:05.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.065+0000 7f35c29f8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35bc101c90 0x7f35bc199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.065+0000 7f35c29f8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35bc1076a0 0x7f35bc1996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.065+0000 7f35c29f8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35bc108020 0x7f35bc19ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.065+0000 7f35c29f8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f35bc111bc0 con 0x7f35bc108020 2024-09-11T00:08:05.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.065+0000 7f35c29f8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f35bc111a40 con 0x7f35bc1076a0 2024-09-11T00:08:05.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.065+0000 7f35c29f8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f35bc111d40 con 0x7f35bc101c90 2024-09-11T00:08:05.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.065+0000 7f35c0f95640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35bc108020 0x7f35bc19ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.065+0000 7f35bbfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35bc101c90 0x7f35bc199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.065+0000 7f35c0f95640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35bc108020 0x7f35bc19ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56362/0 (socket says 172.21.15.78:56362) 2024-09-11T00:08:05.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.065+0000 7f35c0f95640 1 -- 172.21.15.78:0/177527738 learned_addr learned my addr 172.21.15.78:0/177527738 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:05.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.065+0000 7f35bbfff640 1 --2- 172.21.15.78:0/177527738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35bc101c90 0x7f35bc199190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.78:51272/0 (socket says 172.21.15.78:51272) 2024-09-11T00:08:05.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.065+0000 7f35bb7fe640 1 --2- 172.21.15.78:0/177527738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35bc1076a0 0x7f35bc1996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.065+0000 7f35bbfff640 1 -- 172.21.15.78:0/177527738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35bc1076a0 msgr2=0x7f35bc1996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.065+0000 7f35bbfff640 1 --2- 172.21.15.78:0/177527738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35bc1076a0 0x7f35bc1996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.065+0000 7f35bbfff640 1 -- 172.21.15.78:0/177527738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35bc108020 msgr2=0x7f35bc19ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.065+0000 7f35bbfff640 1 --2- 172.21.15.78:0/177527738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35bc108020 0x7f35bc19ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.065+0000 7f35bbfff640 1 -- 172.21.15.78:0/177527738 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35bc19f240 con 0x7f35bc101c90 2024-09-11T00:08:05.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.065+0000 7f35c0f95640 1 --2- 172.21.15.78:0/177527738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35bc108020 0x7f35bc19ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:08:05.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.065+0000 7f35bbfff640 1 --2- 172.21.15.78:0/177527738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35bc101c90 0x7f35bc199190 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f35ac00e9f0 tx=0x7f35ac00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:05.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.065+0000 7f35b97fa640 1 -- 172.21.15.78:0/177527738 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ac00ccc0 con 0x7f35bc101c90 2024-09-11T00:08:05.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.066+0000 7f35c29f8640 1 -- 172.21.15.78:0/177527738 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35bc19f530 con 0x7f35bc101c90 2024-09-11T00:08:05.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.066+0000 7f35b97fa640 1 -- 172.21.15.78:0/177527738 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f35ac0108c0 con 0x7f35bc101c90 2024-09-11T00:08:05.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.066+0000 7f35b97fa640 1 -- 172.21.15.78:0/177527738 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ac0187d0 con 0x7f35bc101c90 2024-09-11T00:08:05.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.066+0000 7f35c29f8640 1 -- 172.21.15.78:0/177527738 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35bc1a5dc0 con 0x7f35bc101c90 2024-09-11T00:08:05.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.067+0000 7f35b97fa640 1 -- 172.21.15.78:0/177527738 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 17) ==== 51497+0+0 (secure 0 0 0) 0x7f35ac010430 con 0x7f35bc101c90 2024-09-11T00:08:05.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.067+0000 7f35c29f8640 1 -- 172.21.15.78:0/177527738 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35bc102f40 con 0x7f35bc101c90 2024-09-11T00:08:05.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.067+0000 7f35b97fa640 1 --2- 172.21.15.78:0/177527738 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f35a803f560 0x7f35a8041a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.067+0000 7f35b97fa640 1 -- 172.21.15.78:0/177527738 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f35ac054250 con 0x7f35bc101c90 2024-09-11T00:08:05.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.067+0000 7f35bb7fe640 1 --2- 172.21.15.78:0/177527738 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f35a803f560 0x7f35a8041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.067+0000 7f35bb7fe640 1 --2- 172.21.15.78:0/177527738 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f35a803f560 0x7f35a8041a20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f35bc106eb0 tx=0x7f35a4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:05.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.072+0000 7f35b97fa640 1 -- 172.21.15.78:0/177527738 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f35ac014230 con 0x7f35bc101c90 2024-09-11T00:08:05.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.250+0000 7f35c29f8640 1 -- 172.21.15.78:0/177527738 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f35bc102070 con 0x7f35bc101c90 2024-09-11T00:08:05.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.254+0000 7f35b97fa640 1 -- 172.21.15.78:0/177527738 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v16)=0 v16) ==== 117+0+0 (secure 0 0 0) 0x7f35ac013dc0 con 0x7f35bc101c90 2024-09-11T00:08:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.257+0000 7f35c29f8640 1 -- 172.21.15.78:0/177527738 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f35a803f560 msgr2=0x7f35a8041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.257+0000 7f35c29f8640 1 --2- 172.21.15.78:0/177527738 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f35a803f560 0x7f35a8041a20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f35bc106eb0 tx=0x7f35a4005f90 comp rx=0 tx=0).stop 2024-09-11T00:08:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.257+0000 7f35c29f8640 1 -- 172.21.15.78:0/177527738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35bc101c90 msgr2=0x7f35bc199190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.257+0000 7f35c29f8640 1 --2- 172.21.15.78:0/177527738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35bc101c90 0x7f35bc199190 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f35ac00e9f0 tx=0x7f35ac00eeb0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.257+0000 7f35c29f8640 1 -- 172.21.15.78:0/177527738 shutdown_connections 2024-09-11T00:08:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.257+0000 7f35c29f8640 1 --2- 172.21.15.78:0/177527738 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f35a803f560 0x7f35a8041a20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.257+0000 7f35c29f8640 1 --2- 172.21.15.78:0/177527738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35bc108020 0x7f35bc19ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.257+0000 7f35c29f8640 1 --2- 172.21.15.78:0/177527738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35bc1076a0 0x7f35bc1996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.257+0000 7f35c29f8640 1 --2- 172.21.15.78:0/177527738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35bc101c90 0x7f35bc199190 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.257+0000 7f35c29f8640 1 -- 172.21.15.78:0/177527738 >> 172.21.15.78:0/177527738 conn(0x7f35bc0fd700 msgr2=0x7f35bc06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.257+0000 7f35c29f8640 1 -- 172.21.15.78:0/177527738 shutdown_connections 2024-09-11T00:08:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.257+0000 7f35c29f8640 1 -- 172.21.15.78:0/177527738 wait complete. 2024-09-11T00:08:05.553 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:05 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:05.553 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:05 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:05.553 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:05 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:05.553 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:05 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:05.553 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:05 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:08:05.553 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:05 smithi078 ceph-mon[30865]: from='client.? ' entity='client.admin' 2024-09-11T00:08:05.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.560+0000 7f6e20c97640 1 -- 172.21.15.78:0/547812902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e1c103b90 msgr2=0x7f6e1c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.560+0000 7f6e20c97640 1 --2- 172.21.15.78:0/547812902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e1c103b90 0x7f6e1c103f70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c009900 tx=0x7f6e0c02a410 comp rx=0 tx=0).stop 2024-09-11T00:08:05.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.560+0000 7f6e20c97640 1 -- 172.21.15.78:0/547812902 shutdown_connections 2024-09-11T00:08:05.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.560+0000 7f6e20c97640 1 --2- 172.21.15.78:0/547812902 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e1c10d140 0x7f6e1c10f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.560+0000 7f6e20c97640 1 --2- 172.21.15.78:0/547812902 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e1c104590 0x7f6e1c10cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.560+0000 7f6e20c97640 1 --2- 172.21.15.78:0/547812902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e1c103b90 0x7f6e1c103f70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.560+0000 7f6e20c97640 1 -- 172.21.15.78:0/547812902 >> 172.21.15.78:0/547812902 conn(0x7f6e1c0fd740 msgr2=0x7f6e1c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:05.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.560+0000 7f6e20c97640 1 -- 172.21.15.78:0/547812902 shutdown_connections 2024-09-11T00:08:05.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.560+0000 7f6e20c97640 1 -- 172.21.15.78:0/547812902 wait complete. 2024-09-11T00:08:05.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.561+0000 7f6e20c97640 1 Processor -- start 2024-09-11T00:08:05.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.561+0000 7f6e20c97640 1 -- start start 2024-09-11T00:08:05.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.561+0000 7f6e20c97640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e1c103b90 0x7f6e1c19b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.561+0000 7f6e20c97640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e1c104590 0x7f6e1c19b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.561+0000 7f6e20c97640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e1c10d140 0x7f6e1c1a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.561+0000 7f6e20c97640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1c112cd0 con 0x7f6e1c10d140 2024-09-11T00:08:05.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.561+0000 7f6e20c97640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1c112b50 con 0x7f6e1c104590 2024-09-11T00:08:05.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.561+0000 7f6e20c97640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1c112e50 con 0x7f6e1c103b90 2024-09-11T00:08:05.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.561+0000 7f6e1a59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e1c103b90 0x7f6e1c19b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.562+0000 7f6e1ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e1c10d140 0x7f6e1c1a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.562+0000 7f6e1a59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e1c103b90 0x7f6e1c19b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.78:51296/0 (socket says 172.21.15.78:51296) 2024-09-11T00:08:05.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.562+0000 7f6e1a59c640 1 -- 172.21.15.78:0/2339921850 learned_addr learned my addr 172.21.15.78:0/2339921850 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:05.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.562+0000 7f6e19d9b640 1 --2- 172.21.15.78:0/2339921850 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e1c104590 0x7f6e1c19b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.562+0000 7f6e1ad9d640 1 -- 172.21.15.78:0/2339921850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e1c103b90 msgr2=0x7f6e1c19b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.562+0000 7f6e1ad9d640 1 --2- 172.21.15.78:0/2339921850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e1c103b90 0x7f6e1c19b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.562+0000 7f6e1ad9d640 1 -- 172.21.15.78:0/2339921850 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e1c104590 msgr2=0x7f6e1c19b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.562+0000 7f6e1ad9d640 1 --2- 172.21.15.78:0/2339921850 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e1c104590 0x7f6e1c19b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.562+0000 7f6e1ad9d640 1 -- 172.21.15.78:0/2339921850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e1c1a1490 con 0x7f6e1c10d140 2024-09-11T00:08:05.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.562+0000 7f6e1ad9d640 1 --2- 172.21.15.78:0/2339921850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e1c10d140 0x7f6e1c1a0cc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400e940 tx=0x7f6e1400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:05.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.562+0000 7f6e0b7fe640 1 -- 172.21.15.78:0/2339921850 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e14004d20 con 0x7f6e1c10d140 2024-09-11T00:08:05.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.562+0000 7f6e0b7fe640 1 -- 172.21.15.78:0/2339921850 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6e14005020 con 0x7f6e1c10d140 2024-09-11T00:08:05.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.562+0000 7f6e20c97640 1 -- 172.21.15.78:0/2339921850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e1c1a1780 con 0x7f6e1c10d140 2024-09-11T00:08:05.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.562+0000 7f6e0b7fe640 1 -- 172.21.15.78:0/2339921850 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e140116d0 con 0x7f6e1c10d140 2024-09-11T00:08:05.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.562+0000 7f6e20c97640 1 -- 172.21.15.78:0/2339921850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e1c1a7e40 con 0x7f6e1c10d140 2024-09-11T00:08:05.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.563+0000 7f6e0b7fe640 1 -- 172.21.15.78:0/2339921850 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 17) ==== 51497+0+0 (secure 0 0 0) 0x7f6e1400f040 con 0x7f6e1c10d140 2024-09-11T00:08:05.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.563+0000 7f6e20c97640 1 -- 172.21.15.78:0/2339921850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e1c103f70 con 0x7f6e1c10d140 2024-09-11T00:08:05.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.564+0000 7f6e0b7fe640 1 --2- 172.21.15.78:0/2339921850 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f6e0403f560 0x7f6e04041a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.564+0000 7f6e0b7fe640 1 -- 172.21.15.78:0/2339921850 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f6e14053b70 con 0x7f6e1c10d140 2024-09-11T00:08:05.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.564+0000 7f6e1a59c640 1 --2- 172.21.15.78:0/2339921850 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f6e0403f560 0x7f6e04041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.564+0000 7f6e1a59c640 1 --2- 172.21.15.78:0/2339921850 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f6e0403f560 0x7f6e04041a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0096c0 tx=0x7f6e0c0046c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:05.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.568+0000 7f6e0b7fe640 1 -- 172.21.15.78:0/2339921850 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6e14016030 con 0x7f6e1c10d140 2024-09-11T00:08:05.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:05 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:05.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:05 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:05.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:05 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:05.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:05 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:05.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:05 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:08:05.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:05 smithi112 ceph-mon[35627]: from='client.? ' entity='client.admin' 2024-09-11T00:08:05.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.756+0000 7f6e20c97640 1 -- 172.21.15.78:0/2339921850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f6e1c1a81d0 con 0x7f6e1c10d140 2024-09-11T00:08:05.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.759+0000 7f6e0b7fe640 1 -- 172.21.15.78:0/2339921850 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v17)=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f6e140051d0 con 0x7f6e1c10d140 2024-09-11T00:08:05.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.761+0000 7f6e20c97640 1 -- 172.21.15.78:0/2339921850 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f6e0403f560 msgr2=0x7f6e04041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.761+0000 7f6e20c97640 1 --2- 172.21.15.78:0/2339921850 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f6e0403f560 0x7f6e04041a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0096c0 tx=0x7f6e0c0046c0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.761+0000 7f6e20c97640 1 -- 172.21.15.78:0/2339921850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e1c10d140 msgr2=0x7f6e1c1a0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.761+0000 7f6e20c97640 1 --2- 172.21.15.78:0/2339921850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e1c10d140 0x7f6e1c1a0cc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400e940 tx=0x7f6e1400ee00 comp rx=0 tx=0).stop 2024-09-11T00:08:05.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.761+0000 7f6e20c97640 1 -- 172.21.15.78:0/2339921850 shutdown_connections 2024-09-11T00:08:05.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.761+0000 7f6e20c97640 1 --2- 172.21.15.78:0/2339921850 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f6e0403f560 0x7f6e04041a20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.761+0000 7f6e20c97640 1 --2- 172.21.15.78:0/2339921850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e1c10d140 0x7f6e1c1a0cc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.761+0000 7f6e20c97640 1 --2- 172.21.15.78:0/2339921850 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e1c104590 0x7f6e1c19b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.761+0000 7f6e20c97640 1 --2- 172.21.15.78:0/2339921850 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e1c103b90 0x7f6e1c19b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.761+0000 7f6e20c97640 1 -- 172.21.15.78:0/2339921850 >> 172.21.15.78:0/2339921850 conn(0x7f6e1c0fd740 msgr2=0x7f6e1c10f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:05.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.761+0000 7f6e20c97640 1 -- 172.21.15.78:0/2339921850 shutdown_connections 2024-09-11T00:08:05.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:05.761+0000 7f6e20c97640 1 -- 172.21.15.78:0/2339921850 wait complete. 2024-09-11T00:08:05.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:05 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:05.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:05 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:05.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:05 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:05.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:05 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:05.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:05 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:08:05.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:05 smithi138 ceph-mon[35019]: from='client.? ' entity='client.admin' 2024-09-11T00:08:05.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.617+0000 7fe44c17b640 1 -- 172.21.15.78:0/3937312148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe444102da0 msgr2=0x7fe444103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.617+0000 7fe44c17b640 1 --2- 172.21.15.78:0/3937312148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe444102da0 0x7fe444103180 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe440009900 tx=0x7fe44002a410 comp rx=0 tx=0).stop 2024-09-11T00:08:05.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.617+0000 7fe44c17b640 1 -- 172.21.15.78:0/3937312148 shutdown_connections 2024-09-11T00:08:05.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.617+0000 7fe44c17b640 1 --2- 172.21.15.78:0/3937312148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe444109130 0x7fe44410f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.617+0000 7fe44c17b640 1 --2- 172.21.15.78:0/3937312148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4441087b0 0x7fe444108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.617+0000 7fe44c17b640 1 --2- 172.21.15.78:0/3937312148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe444102da0 0x7fe444103180 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.617+0000 7fe44c17b640 1 -- 172.21.15.78:0/3937312148 >> 172.21.15.78:0/3937312148 conn(0x7fe4440fe810 msgr2=0x7fe444100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:05.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.617+0000 7fe44c17b640 1 -- 172.21.15.78:0/3937312148 shutdown_connections 2024-09-11T00:08:05.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.617+0000 7fe44c17b640 1 -- 172.21.15.78:0/3937312148 wait complete. 2024-09-11T00:08:05.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.618+0000 7fe44c17b640 1 Processor -- start 2024-09-11T00:08:05.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.618+0000 7fe44c17b640 1 -- start start 2024-09-11T00:08:05.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.618+0000 7fe44c17b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe444102da0 0x7fe4441990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.618+0000 7fe44c17b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4441087b0 0x7fe444199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.618+0000 7fe44c17b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe444109130 0x7fe44419e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.618+0000 7fe44c17b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe444112bb0 con 0x7fe4441087b0 2024-09-11T00:08:05.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.618+0000 7fe44c17b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe444112a30 con 0x7fe444109130 2024-09-11T00:08:05.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.618+0000 7fe44c17b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe444112d30 con 0x7fe444102da0 2024-09-11T00:08:05.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.618+0000 7fe449716640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4441087b0 0x7fe444199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.618+0000 7fe449716640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4441087b0 0x7fe444199620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53426/0 (socket says 172.21.15.78:53426) 2024-09-11T00:08:05.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.618+0000 7fe449716640 1 -- 172.21.15.78:0/1411317788 learned_addr learned my addr 172.21.15.78:0/1411317788 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:05.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.618+0000 7fe449f17640 1 --2- 172.21.15.78:0/1411317788 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe444102da0 0x7fe4441990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.618+0000 7fe44a718640 1 --2- 172.21.15.78:0/1411317788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe444109130 0x7fe44419e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.618+0000 7fe449716640 1 -- 172.21.15.78:0/1411317788 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe444102da0 msgr2=0x7fe4441990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.618+0000 7fe449716640 1 --2- 172.21.15.78:0/1411317788 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe444102da0 0x7fe4441990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.618+0000 7fe449716640 1 -- 172.21.15.78:0/1411317788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe444109130 msgr2=0x7fe44419e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.618+0000 7fe449716640 1 --2- 172.21.15.78:0/1411317788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe444109130 0x7fe44419e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.618+0000 7fe449716640 1 -- 172.21.15.78:0/1411317788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe44419f190 con 0x7fe4441087b0 2024-09-11T00:08:05.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.618+0000 7fe449716640 1 --2- 172.21.15.78:0/1411317788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4441087b0 0x7fe444199620 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe43400c890 tx=0x7fe43400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:05.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.619+0000 7fe43affd640 1 -- 172.21.15.78:0/1411317788 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe434004220 con 0x7fe4441087b0 2024-09-11T00:08:05.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.619+0000 7fe43affd640 1 -- 172.21.15.78:0/1411317788 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7fe434007e20 con 0x7fe4441087b0 2024-09-11T00:08:05.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.619+0000 7fe43affd640 1 -- 172.21.15.78:0/1411317788 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4340047a0 con 0x7fe4441087b0 2024-09-11T00:08:05.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.619+0000 7fe44c17b640 1 -- 172.21.15.78:0/1411317788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe44419f480 con 0x7fe4441087b0 2024-09-11T00:08:05.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.619+0000 7fe44c17b640 1 -- 172.21.15.78:0/1411317788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4441a5b40 con 0x7fe4441087b0 2024-09-11T00:08:05.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.619+0000 7fe43affd640 1 -- 172.21.15.78:0/1411317788 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 17) ==== 51497+0+0 (secure 0 0 0) 0x7fe434004940 con 0x7fe4441087b0 2024-09-11T00:08:05.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.620+0000 7fe43affd640 1 --2- 172.21.15.78:0/1411317788 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe43003f560 0x7fe430041a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:05.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.620+0000 7fe44c17b640 1 -- 172.21.15.78:0/1411317788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe444103180 con 0x7fe4441087b0 2024-09-11T00:08:05.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.620+0000 7fe43affd640 1 -- 172.21.15.78:0/1411317788 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe434053b20 con 0x7fe4441087b0 2024-09-11T00:08:05.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.620+0000 7fe449f17640 1 --2- 172.21.15.78:0/1411317788 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe43003f560 0x7fe430041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:05.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.620+0000 7fe449f17640 1 --2- 172.21.15.78:0/1411317788 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe43003f560 0x7fe430041a20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe440031440 tx=0x7fe440005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:05.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.624+0000 7fe43affd640 1 -- 172.21.15.78:0/1411317788 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe434014030 con 0x7fe4441087b0 2024-09-11T00:08:05.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.811+0000 7fe44c17b640 1 -- 172.21.15.78:0/1411317788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fe44410af10 con 0x7fe4441087b0 2024-09-11T00:08:05.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.814+0000 7fe43affd640 1 -- 172.21.15.78:0/1411317788 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v14)=0 v14) ==== 120+0+0 (secure 0 0 0) 0x7fe434004d50 con 0x7fe4441087b0 2024-09-11T00:08:05.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.816+0000 7fe44c17b640 1 -- 172.21.15.78:0/1411317788 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe43003f560 msgr2=0x7fe430041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.816+0000 7fe44c17b640 1 --2- 172.21.15.78:0/1411317788 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe43003f560 0x7fe430041a20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe440031440 tx=0x7fe440005b50 comp rx=0 tx=0).stop 2024-09-11T00:08:05.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.816+0000 7fe44c17b640 1 -- 172.21.15.78:0/1411317788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4441087b0 msgr2=0x7fe444199620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:05.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.816+0000 7fe44c17b640 1 --2- 172.21.15.78:0/1411317788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4441087b0 0x7fe444199620 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe43400c890 tx=0x7fe43400cd50 comp rx=0 tx=0).stop 2024-09-11T00:08:05.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.816+0000 7fe44c17b640 1 -- 172.21.15.78:0/1411317788 shutdown_connections 2024-09-11T00:08:05.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.816+0000 7fe44c17b640 1 --2- 172.21.15.78:0/1411317788 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe43003f560 0x7fe430041a20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.816+0000 7fe44c17b640 1 --2- 172.21.15.78:0/1411317788 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe444109130 0x7fe44419e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.816+0000 7fe44c17b640 1 --2- 172.21.15.78:0/1411317788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4441087b0 0x7fe444199620 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.816+0000 7fe44c17b640 1 --2- 172.21.15.78:0/1411317788 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe444102da0 0x7fe4441990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:05.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.816+0000 7fe44c17b640 1 -- 172.21.15.78:0/1411317788 >> 172.21.15.78:0/1411317788 conn(0x7fe4440fe810 msgr2=0x7fe444100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:05.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.816+0000 7fe44c17b640 1 -- 172.21.15.78:0/1411317788 shutdown_connections 2024-09-11T00:08:05.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:02.816+0000 7fe44c17b640 1 -- 172.21.15.78:0/1411317788 wait complete. 2024-09-11T00:08:06.162 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi078') 2024-09-11T00:08:06.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.413+0000 7f7965e0c640 1 -- 172.21.15.78:0/2049634458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f796010d100 msgr2=0x7f796010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:06.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.413+0000 7f7965e0c640 1 --2- 172.21.15.78:0/2049634458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f796010d100 0x7f796010f560 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7958009ca0 tx=0x7f795802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:08:06.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.413+0000 7f7965e0c640 1 -- 172.21.15.78:0/2049634458 shutdown_connections 2024-09-11T00:08:06.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.413+0000 7f7965e0c640 1 --2- 172.21.15.78:0/2049634458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f796010d100 0x7f796010f560 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:06.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.413+0000 7f7965e0c640 1 --2- 172.21.15.78:0/2049634458 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f79601045c0 0x7f796010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:06.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.413+0000 7f7965e0c640 1 --2- 172.21.15.78:0/2049634458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7960103ca0 0x7f7960104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:06.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.413+0000 7f7965e0c640 1 -- 172.21.15.78:0/2049634458 >> 172.21.15.78:0/2049634458 conn(0x7f79600fd700 msgr2=0x7f79600ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:06.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.413+0000 7f7965e0c640 1 -- 172.21.15.78:0/2049634458 shutdown_connections 2024-09-11T00:08:06.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.413+0000 7f7965e0c640 1 -- 172.21.15.78:0/2049634458 wait complete. 2024-09-11T00:08:06.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.414+0000 7f7965e0c640 1 Processor -- start 2024-09-11T00:08:06.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.414+0000 7f7965e0c640 1 -- start start 2024-09-11T00:08:06.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.414+0000 7f7965e0c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7960103ca0 0x7f7960199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:06.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.414+0000 7f7965e0c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79601045c0 0x7f7960199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:06.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.414+0000 7f7965e0c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f796010d100 0x7f796019ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:06.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.414+0000 7f7965e0c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7960112c50 con 0x7f79601045c0 2024-09-11T00:08:06.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.414+0000 7f7965e0c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7960112ad0 con 0x7f796010d100 2024-09-11T00:08:06.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.414+0000 7f7965e0c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7960112dd0 con 0x7f7960103ca0 2024-09-11T00:08:06.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.414+0000 7f795effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79601045c0 0x7f7960199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:06.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.414+0000 7f795effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79601045c0 0x7f7960199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56380/0 (socket says 172.21.15.78:56380) 2024-09-11T00:08:06.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.414+0000 7f795effd640 1 -- 172.21.15.78:0/1615587024 learned_addr learned my addr 172.21.15.78:0/1615587024 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:06.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.414+0000 7f795f7fe640 1 --2- 172.21.15.78:0/1615587024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7960103ca0 0x7f7960199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:06.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.415+0000 7f795ffff640 1 --2- 172.21.15.78:0/1615587024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f796010d100 0x7f796019ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:06.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.415+0000 7f795effd640 1 -- 172.21.15.78:0/1615587024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7960103ca0 msgr2=0x7f7960199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:06.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.415+0000 7f795effd640 1 --2- 172.21.15.78:0/1615587024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7960103ca0 0x7f7960199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:06.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.415+0000 7f795effd640 1 -- 172.21.15.78:0/1615587024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f796010d100 msgr2=0x7f796019ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:06.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.415+0000 7f795effd640 1 --2- 172.21.15.78:0/1615587024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f796010d100 0x7f796019ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:06.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.415+0000 7f795effd640 1 -- 172.21.15.78:0/1615587024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f796019f1f0 con 0x7f79601045c0 2024-09-11T00:08:06.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.415+0000 7f795effd640 1 --2- 172.21.15.78:0/1615587024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79601045c0 0x7f7960199680 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f795400e9c0 tx=0x7f795400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:06.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.415+0000 7f795cff9640 1 -- 172.21.15.78:0/1615587024 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795400ccc0 con 0x7f79601045c0 2024-09-11T00:08:06.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.415+0000 7f7965e0c640 1 -- 172.21.15.78:0/1615587024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f796019f4e0 con 0x7f79601045c0 2024-09-11T00:08:06.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.415+0000 7f795cff9640 1 -- 172.21.15.78:0/1615587024 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f79540044b0 con 0x7f79601045c0 2024-09-11T00:08:06.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.415+0000 7f795cff9640 1 -- 172.21.15.78:0/1615587024 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7954003e60 con 0x7f79601045c0 2024-09-11T00:08:06.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.415+0000 7f7965e0c640 1 -- 172.21.15.78:0/1615587024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79601a5d70 con 0x7f79601045c0 2024-09-11T00:08:06.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.416+0000 7f7965e0c640 1 -- 172.21.15.78:0/1615587024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7960104080 con 0x7f79601045c0 2024-09-11T00:08:06.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.416+0000 7f795cff9640 1 -- 172.21.15.78:0/1615587024 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 17) ==== 51497+0+0 (secure 0 0 0) 0x7f79540104d0 con 0x7f79601045c0 2024-09-11T00:08:06.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.417+0000 7f795cff9640 1 --2- 172.21.15.78:0/1615587024 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f794803f560 0x7f7948041a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:06.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.417+0000 7f795cff9640 1 -- 172.21.15.78:0/1615587024 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f7954054210 con 0x7f79601045c0 2024-09-11T00:08:06.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.417+0000 7f795f7fe640 1 --2- 172.21.15.78:0/1615587024 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f794803f560 0x7f7948041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:06.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.417+0000 7f795f7fe640 1 --2- 172.21.15.78:0/1615587024 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f794803f560 0x7f7948041a20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7950005d00 tx=0x7f795000b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:06.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.421+0000 7f795cff9640 1 -- 172.21.15.78:0/1615587024 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7954021430 con 0x7f79601045c0 2024-09-11T00:08:06.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.602+0000 7f7965e0c640 1 -- 172.21.15.78:0/1615587024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f796019a270 con 0x7f79601045c0 2024-09-11T00:08:06.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.605+0000 7f795cff9640 1 -- 172.21.15.78:0/1615587024 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v18)=0 v18) ==== 133+0+0 (secure 0 0 0) 0x7f79540035f0 con 0x7f79601045c0 2024-09-11T00:08:06.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.608+0000 7f7965e0c640 1 -- 172.21.15.78:0/1615587024 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f794803f560 msgr2=0x7f7948041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:06.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.608+0000 7f7965e0c640 1 --2- 172.21.15.78:0/1615587024 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f794803f560 0x7f7948041a20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7950005d00 tx=0x7f795000b410 comp rx=0 tx=0).stop 2024-09-11T00:08:06.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.608+0000 7f7965e0c640 1 -- 172.21.15.78:0/1615587024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79601045c0 msgr2=0x7f7960199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:06.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.608+0000 7f7965e0c640 1 --2- 172.21.15.78:0/1615587024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79601045c0 0x7f7960199680 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f795400e9c0 tx=0x7f795400ee80 comp rx=0 tx=0).stop 2024-09-11T00:08:06.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.608+0000 7f7965e0c640 1 -- 172.21.15.78:0/1615587024 shutdown_connections 2024-09-11T00:08:06.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.608+0000 7f7965e0c640 1 --2- 172.21.15.78:0/1615587024 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f794803f560 0x7f7948041a20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:06.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.608+0000 7f7965e0c640 1 --2- 172.21.15.78:0/1615587024 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f796010d100 0x7f796019ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:06.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.608+0000 7f7965e0c640 1 --2- 172.21.15.78:0/1615587024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79601045c0 0x7f7960199680 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:06.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.608+0000 7f7965e0c640 1 --2- 172.21.15.78:0/1615587024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7960103ca0 0x7f7960199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:06.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.608+0000 7f7965e0c640 1 -- 172.21.15.78:0/1615587024 >> 172.21.15.78:0/1615587024 conn(0x7f79600fd700 msgr2=0x7f79600fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:06.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.608+0000 7f7965e0c640 1 -- 172.21.15.78:0/1615587024 shutdown_connections 2024-09-11T00:08:06.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:06.608+0000 7f7965e0c640 1 -- 172.21.15.78:0/1615587024 wait complete. 2024-09-11T00:08:06.660 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:06 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:06.660 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:06 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:06.660 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:06 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:06.661 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:06 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:06.661 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:06 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:06.661 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:06 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:06.661 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:06 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:06.661 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:06 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-11T00:08:06.661 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:06 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-11T00:08:06.661 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:06 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:06.661 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:06 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2339921850' entity='client.admin' 2024-09-11T00:08:06.661 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:06 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:06.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:06 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:06.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:06 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:06.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:06 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:06.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:06 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:06.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:06 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:06.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:06 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:06.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:06 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:06.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:06 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-11T00:08:06.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:06 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-11T00:08:06.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:06 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:06.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:06 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2339921850' entity='client.admin' 2024-09-11T00:08:06.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:06 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:06.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:06 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:06.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:06 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:06.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:06 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:06.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:06 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:06.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:06 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:06.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:06 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:06.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:06 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:06.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:06 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-11T00:08:06.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:06 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-11T00:08:06.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:06 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:06.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:06 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2339921850' entity='client.admin' 2024-09-11T00:08:06.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:06 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:07.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.426+0000 7fcc74fc6640 1 -- 172.21.15.78:0/1811359592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc70109150 msgr2=0x7fcc7010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:07.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.426+0000 7fcc74fc6640 1 --2- 172.21.15.78:0/1811359592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc70109150 0x7fcc7010f950 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcc68009ca0 tx=0x7fcc6802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:08:07.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.426+0000 7fcc74fc6640 1 -- 172.21.15.78:0/1811359592 shutdown_connections 2024-09-11T00:08:07.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.426+0000 7fcc74fc6640 1 --2- 172.21.15.78:0/1811359592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc70109150 0x7fcc7010f950 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:07.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.426+0000 7fcc74fc6640 1 --2- 172.21.15.78:0/1811359592 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc701087d0 0x7fcc70108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:07.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.426+0000 7fcc74fc6640 1 --2- 172.21.15.78:0/1811359592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc70102dc0 0x7fcc701031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:07.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.426+0000 7fcc74fc6640 1 -- 172.21.15.78:0/1811359592 >> 172.21.15.78:0/1811359592 conn(0x7fcc700fe830 msgr2=0x7fcc70100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:07.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.426+0000 7fcc74fc6640 1 -- 172.21.15.78:0/1811359592 shutdown_connections 2024-09-11T00:08:07.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.426+0000 7fcc74fc6640 1 -- 172.21.15.78:0/1811359592 wait complete. 2024-09-11T00:08:07.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.427+0000 7fcc74fc6640 1 Processor -- start 2024-09-11T00:08:07.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.427+0000 7fcc74fc6640 1 -- start start 2024-09-11T00:08:07.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.427+0000 7fcc74fc6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc70102dc0 0x7fcc7019b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:07.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.427+0000 7fcc74fc6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc701087d0 0x7fcc7019b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:07.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.427+0000 7fcc74fc6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc70109150 0x7fcc701a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:07.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.427+0000 7fcc74fc6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcc70112cf0 con 0x7fcc70102dc0 2024-09-11T00:08:07.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.427+0000 7fcc74fc6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcc70112b70 con 0x7fcc701087d0 2024-09-11T00:08:07.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.427+0000 7fcc74fc6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcc70112e70 con 0x7fcc70109150 2024-09-11T00:08:07.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.428+0000 7fcc6e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc70102dc0 0x7fcc7019b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:07.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.428+0000 7fcc6e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc70102dc0 0x7fcc7019b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56386/0 (socket says 172.21.15.78:56386) 2024-09-11T00:08:07.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.428+0000 7fcc6e59c640 1 -- 172.21.15.78:0/1171987970 learned_addr learned my addr 172.21.15.78:0/1171987970 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:07.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.428+0000 7fcc6dd9b640 1 --2- 172.21.15.78:0/1171987970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc701087d0 0x7fcc7019b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.428+0000 7fcc6ed9d640 1 --2- 172.21.15.78:0/1171987970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc70109150 0x7fcc701a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.428+0000 7fcc6dd9b640 1 -- 172.21.15.78:0/1171987970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc70109150 msgr2=0x7fcc701a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.428+0000 7fcc6dd9b640 1 --2- 172.21.15.78:0/1171987970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc70109150 0x7fcc701a0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.428+0000 7fcc6dd9b640 1 -- 172.21.15.78:0/1171987970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc70102dc0 msgr2=0x7fcc7019b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.428+0000 7fcc6dd9b640 1 --2- 172.21.15.78:0/1171987970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc70102dc0 0x7fcc7019b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.428+0000 7fcc6dd9b640 1 -- 172.21.15.78:0/1171987970 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc701a1440 con 0x7fcc701087d0 2024-09-11T00:08:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.428+0000 7fcc6e59c640 1 --2- 172.21.15.78:0/1171987970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc70102dc0 0x7fcc7019b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:08:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.428+0000 7fcc6dd9b640 1 --2- 172.21.15.78:0/1171987970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc701087d0 0x7fcc7019b8d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcc64005fd0 tx=0x7fcc6400dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.428+0000 7fcc5f7fe640 1 -- 172.21.15.78:0/1171987970 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc64009c30 con 0x7fcc701087d0 2024-09-11T00:08:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.428+0000 7fcc5f7fe640 1 -- 172.21.15.78:0/1171987970 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fcc640044c0 con 0x7fcc701087d0 2024-09-11T00:08:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.428+0000 7fcc74fc6640 1 -- 172.21.15.78:0/1171987970 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc701a1730 con 0x7fcc701087d0 2024-09-11T00:08:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.428+0000 7fcc5f7fe640 1 -- 172.21.15.78:0/1171987970 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc64003d80 con 0x7fcc701087d0 2024-09-11T00:08:07.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.428+0000 7fcc74fc6640 1 -- 172.21.15.78:0/1171987970 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc701a7df0 con 0x7fcc701087d0 2024-09-11T00:08:07.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.429+0000 7fcc5f7fe640 1 -- 172.21.15.78:0/1171987970 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 17) ==== 51497+0+0 (secure 0 0 0) 0x7fcc64010460 con 0x7fcc701087d0 2024-09-11T00:08:07.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.429+0000 7fcc74fc6640 1 -- 172.21.15.78:0/1171987970 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc701031a0 con 0x7fcc701087d0 2024-09-11T00:08:07.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.429+0000 7fcc5f7fe640 1 --2- 172.21.15.78:0/1171987970 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcc5803f560 0x7fcc58041a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:07.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.429+0000 7fcc5f7fe640 1 -- 172.21.15.78:0/1171987970 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fcc64053c90 con 0x7fcc701087d0 2024-09-11T00:08:07.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.430+0000 7fcc6e59c640 1 --2- 172.21.15.78:0/1171987970 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcc5803f560 0x7fcc58041a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:07.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.430+0000 7fcc6e59c640 1 --2- 172.21.15.78:0/1171987970 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcc5803f560 0x7fcc58041a20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcc60011550 tx=0x7fcc60005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:07.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.434+0000 7fcc5f7fe640 1 -- 172.21.15.78:0/1171987970 <== mon.2 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcc64017020 con 0x7fcc701087d0 2024-09-11T00:08:07.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.609+0000 7fcc5f7fe640 1 -- 172.21.15.78:0/1171987970 <== mon.2 v2:172.21.15.112:3300/0 7 ==== mgrmap(e 18) ==== 102354+0+0 (secure 0 0 0) 0x7fcc6401c4b0 con 0x7fcc701087d0 2024-09-11T00:08:07.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.615+0000 7fcc74fc6640 1 -- 172.21.15.78:0/1171987970 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fcc7002e5c0 con 0x7fcc701087d0 2024-09-11T00:08:07.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.624+0000 7fcc5f7fe640 1 -- 172.21.15.78:0/1171987970 <== mon.2 v2:172.21.15.112:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v19)=0 v19) ==== 138+0+0 (secure 0 0 0) 0x7fcc64067b40 con 0x7fcc701087d0 2024-09-11T00:08:07.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.627+0000 7fcc74fc6640 1 -- 172.21.15.78:0/1171987970 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcc5803f560 msgr2=0x7fcc58041a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:07.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.627+0000 7fcc74fc6640 1 --2- 172.21.15.78:0/1171987970 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcc5803f560 0x7fcc58041a20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcc60011550 tx=0x7fcc60005f90 comp rx=0 tx=0).stop 2024-09-11T00:08:07.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.627+0000 7fcc74fc6640 1 -- 172.21.15.78:0/1171987970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc701087d0 msgr2=0x7fcc7019b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:07.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.627+0000 7fcc74fc6640 1 --2- 172.21.15.78:0/1171987970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc701087d0 0x7fcc7019b8d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcc64005fd0 tx=0x7fcc6400dde0 comp rx=0 tx=0).stop 2024-09-11T00:08:07.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.627+0000 7fcc74fc6640 1 -- 172.21.15.78:0/1171987970 shutdown_connections 2024-09-11T00:08:07.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.627+0000 7fcc74fc6640 1 --2- 172.21.15.78:0/1171987970 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcc5803f560 0x7fcc58041a20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:07.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.627+0000 7fcc74fc6640 1 --2- 172.21.15.78:0/1171987970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc70109150 0x7fcc701a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:07.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.627+0000 7fcc74fc6640 1 --2- 172.21.15.78:0/1171987970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcc701087d0 0x7fcc7019b8d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:07.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.627+0000 7fcc74fc6640 1 --2- 172.21.15.78:0/1171987970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc70102dc0 0x7fcc7019b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:07.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.627+0000 7fcc74fc6640 1 -- 172.21.15.78:0/1171987970 >> 172.21.15.78:0/1171987970 conn(0x7fcc700fe830 msgr2=0x7fcc70104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:07.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.627+0000 7fcc74fc6640 1 -- 172.21.15.78:0/1171987970 shutdown_connections 2024-09-11T00:08:07.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:07.627+0000 7fcc74fc6640 1 -- 172.21.15.78:0/1171987970 wait complete. 2024-09-11T00:08:07.898 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:07 smithi112 ceph-mon[35627]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T00:08:07.898 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:07 smithi112 ceph-mon[35627]: Reconfiguring daemon mgr.x on smithi078 2024-09-11T00:08:07.898 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:07 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1615587024' entity='client.admin' 2024-09-11T00:08:07.898 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:07 smithi112 ceph-mon[35627]: Standby manager daemon z started 2024-09-11T00:08:07.898 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:07 smithi112 ceph-mon[35627]: from='mgr.? 172.21.15.138:0/3947485214' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-11T00:08:07.899 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:07 smithi112 ceph-mon[35627]: from='mgr.? 172.21.15.138:0/3947485214' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-11T00:08:07.899 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:07 smithi112 ceph-mon[35627]: from='mgr.? 172.21.15.138:0/3947485214' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-11T00:08:07.899 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:07 smithi112 ceph-mon[35627]: from='mgr.? 172.21.15.138:0/3947485214' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-11T00:08:07.932 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:07 smithi078 ceph-mon[30865]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T00:08:07.932 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:07 smithi078 ceph-mon[30865]: Reconfiguring daemon mgr.x on smithi078 2024-09-11T00:08:07.932 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:07 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1615587024' entity='client.admin' 2024-09-11T00:08:07.933 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:07 smithi078 ceph-mon[30865]: Standby manager daemon z started 2024-09-11T00:08:07.933 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:07 smithi078 ceph-mon[30865]: from='mgr.? 172.21.15.138:0/3947485214' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-11T00:08:07.933 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:07 smithi078 ceph-mon[30865]: from='mgr.? 172.21.15.138:0/3947485214' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-11T00:08:07.933 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:07 smithi078 ceph-mon[30865]: from='mgr.? 172.21.15.138:0/3947485214' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-11T00:08:07.933 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:07 smithi078 ceph-mon[30865]: from='mgr.? 172.21.15.138:0/3947485214' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-11T00:08:08.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.013+0000 7f45274da640 1 -- 172.21.15.78:0/3162729122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4520075540 msgr2=0x7f4520075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:08.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.013+0000 7f45274da640 1 --2- 172.21.15.78:0/3162729122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4520075540 0x7f4520075920 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f451c009900 tx=0x7f451c02a410 comp rx=0 tx=0).stop 2024-09-11T00:08:08.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.013+0000 7f45274da640 1 -- 172.21.15.78:0/3162729122 shutdown_connections 2024-09-11T00:08:08.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.013+0000 7f45274da640 1 --2- 172.21.15.78:0/3162729122 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4520113b20 0x7f4520115f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.013+0000 7f45274da640 1 --2- 172.21.15.78:0/3162729122 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4520075e60 0x7f45201135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.013+0000 7f45274da640 1 --2- 172.21.15.78:0/3162729122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4520075540 0x7f4520075920 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.013+0000 7f45274da640 1 -- 172.21.15.78:0/3162729122 >> 172.21.15.78:0/3162729122 conn(0x7f45200fe830 msgr2=0x7f4520100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:08.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.014+0000 7f45274da640 1 -- 172.21.15.78:0/3162729122 shutdown_connections 2024-09-11T00:08:08.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.014+0000 7f45274da640 1 -- 172.21.15.78:0/3162729122 wait complete. 2024-09-11T00:08:08.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.014+0000 7f45274da640 1 Processor -- start 2024-09-11T00:08:08.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.014+0000 7f45274da640 1 -- start start 2024-09-11T00:08:08.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f45274da640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4520075540 0x7f452019f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f45274da640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4520075e60 0x7f452019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f45274da640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4520113b20 0x7f45201a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f45274da640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f45201192c0 con 0x7f4520075e60 2024-09-11T00:08:08.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f45274da640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4520119140 con 0x7f4520113b20 2024-09-11T00:08:08.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f45274da640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4520119440 con 0x7f4520075540 2024-09-11T00:08:08.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f4524a75640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4520075e60 0x7f452019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:08.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f4524a75640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4520075e60 0x7f452019fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56404/0 (socket says 172.21.15.78:56404) 2024-09-11T00:08:08.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f4524a75640 1 -- 172.21.15.78:0/2576082680 learned_addr learned my addr 172.21.15.78:0/2576082680 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:08.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f4525a77640 1 --2- 172.21.15.78:0/2576082680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4520113b20 0x7f45201a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:08.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f4525276640 1 --2- 172.21.15.78:0/2576082680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4520075540 0x7f452019f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:08.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f4524a75640 1 -- 172.21.15.78:0/2576082680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4520075540 msgr2=0x7f452019f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:08.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f4524a75640 1 --2- 172.21.15.78:0/2576082680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4520075540 0x7f452019f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f4524a75640 1 -- 172.21.15.78:0/2576082680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4520113b20 msgr2=0x7f45201a50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:08.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f4524a75640 1 --2- 172.21.15.78:0/2576082680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4520113b20 0x7f45201a50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f4524a75640 1 -- 172.21.15.78:0/2576082680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45201a58c0 con 0x7f4520075e60 2024-09-11T00:08:08.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f4525a77640 1 --2- 172.21.15.78:0/2576082680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4520113b20 0x7f45201a50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:08:08.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f4525276640 1 --2- 172.21.15.78:0/2576082680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4520075540 0x7f452019f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:08:08.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f4524a75640 1 --2- 172.21.15.78:0/2576082680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4520075e60 0x7f452019fd50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f451000e9f0 tx=0x7f451000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:08.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f45167fc640 1 -- 172.21.15.78:0/2576082680 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451000cd80 con 0x7f4520075e60 2024-09-11T00:08:08.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f45167fc640 1 -- 172.21.15.78:0/2576082680 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f45100108c0 con 0x7f4520075e60 2024-09-11T00:08:08.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f45167fc640 1 -- 172.21.15.78:0/2576082680 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45100187d0 con 0x7f4520075e60 2024-09-11T00:08:08.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f45274da640 1 -- 172.21.15.78:0/2576082680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45201a5bb0 con 0x7f4520075e60 2024-09-11T00:08:08.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.015+0000 7f45274da640 1 -- 172.21.15.78:0/2576082680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45201ac270 con 0x7f4520075e60 2024-09-11T00:08:08.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.016+0000 7f45274da640 1 -- 172.21.15.78:0/2576082680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4520075920 con 0x7f4520075e60 2024-09-11T00:08:08.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.017+0000 7f45167fc640 1 -- 172.21.15.78:0/2576082680 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 18) ==== 102354+0+0 (secure 0 0 0) 0x7f4510010430 con 0x7f4520075e60 2024-09-11T00:08:08.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.018+0000 7f45167fc640 1 --2- 172.21.15.78:0/2576082680 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f450c07a400 0x7f450c07c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.018+0000 7f4525276640 1 --2- 172.21.15.78:0/2576082680 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f450c07a400 0x7f450c07c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:08.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.018+0000 7f45167fc640 1 -- 172.21.15.78:0/2576082680 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f451009c3e0 con 0x7f4520075e60 2024-09-11T00:08:08.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.018+0000 7f4525276640 1 --2- 172.21.15.78:0/2576082680 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f450c07a400 0x7f450c07c8c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f451c000c00 tx=0x7f451c005a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:08.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.022+0000 7f45167fc640 1 -- 172.21.15.78:0/2576082680 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4510065080 con 0x7f4520075e60 2024-09-11T00:08:08.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:07 smithi138 ceph-mon[35019]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T00:08:08.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:07 smithi138 ceph-mon[35019]: Reconfiguring daemon mgr.x on smithi078 2024-09-11T00:08:08.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:07 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1615587024' entity='client.admin' 2024-09-11T00:08:08.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:07 smithi138 ceph-mon[35019]: Standby manager daemon z started 2024-09-11T00:08:08.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:07 smithi138 ceph-mon[35019]: from='mgr.? 172.21.15.138:0/3947485214' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-11T00:08:08.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:07 smithi138 ceph-mon[35019]: from='mgr.? 172.21.15.138:0/3947485214' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-11T00:08:08.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:07 smithi138 ceph-mon[35019]: from='mgr.? 172.21.15.138:0/3947485214' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-11T00:08:08.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:07 smithi138 ceph-mon[35019]: from='mgr.? 172.21.15.138:0/3947485214' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-11T00:08:08.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.208+0000 7f45274da640 1 -- 172.21.15.78:0/2576082680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f45201ac560 con 0x7f4520075e60 2024-09-11T00:08:08.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.211+0000 7f45167fc640 1 -- 172.21.15.78:0/2576082680 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v20)=0 v20) ==== 108+0+0 (secure 0 0 0) 0x7f4510064980 con 0x7f4520075e60 2024-09-11T00:08:08.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.213+0000 7f45274da640 1 -- 172.21.15.78:0/2576082680 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f450c07a400 msgr2=0x7f450c07c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:08.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.213+0000 7f45274da640 1 --2- 172.21.15.78:0/2576082680 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f450c07a400 0x7f450c07c8c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f451c000c00 tx=0x7f451c005a40 comp rx=0 tx=0).stop 2024-09-11T00:08:08.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.213+0000 7f45274da640 1 -- 172.21.15.78:0/2576082680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4520075e60 msgr2=0x7f452019fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:08.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.213+0000 7f45274da640 1 --2- 172.21.15.78:0/2576082680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4520075e60 0x7f452019fd50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f451000e9f0 tx=0x7f451000eeb0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.213+0000 7f45274da640 1 -- 172.21.15.78:0/2576082680 shutdown_connections 2024-09-11T00:08:08.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.213+0000 7f45274da640 1 --2- 172.21.15.78:0/2576082680 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f450c07a400 0x7f450c07c8c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.213+0000 7f45274da640 1 --2- 172.21.15.78:0/2576082680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4520113b20 0x7f45201a50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.213+0000 7f45274da640 1 --2- 172.21.15.78:0/2576082680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4520075e60 0x7f452019fd50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.213+0000 7f45274da640 1 --2- 172.21.15.78:0/2576082680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4520075540 0x7f452019f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.213+0000 7f45274da640 1 -- 172.21.15.78:0/2576082680 >> 172.21.15.78:0/2576082680 conn(0x7f45200fe830 msgr2=0x7f45200ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:08.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.213+0000 7f45274da640 1 -- 172.21.15.78:0/2576082680 shutdown_connections 2024-09-11T00:08:08.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.213+0000 7f45274da640 1 -- 172.21.15.78:0/2576082680 wait complete. 2024-09-11T00:08:08.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:08 smithi078 ceph-mon[30865]: mgrmap e18: x(active, since 12s), standbys: z 2024-09-11T00:08:08.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:08 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-11T00:08:08.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:08 smithi078 ceph-mon[30865]: from='client.? ' entity='client.admin' 2024-09-11T00:08:08.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:08 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2576082680' entity='client.admin' 2024-09-11T00:08:08.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.938+0000 7fb1a136b640 1 -- 172.21.15.78:0/3927700284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb19c1076b0 msgr2=0x7fb19c107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:08.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.938+0000 7fb1a136b640 1 --2- 172.21.15.78:0/3927700284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb19c1076b0 0x7fb19c107af0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb184009900 tx=0x7fb18402a410 comp rx=0 tx=0).stop 2024-09-11T00:08:08.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.938+0000 7fb1a136b640 1 -- 172.21.15.78:0/3927700284 shutdown_connections 2024-09-11T00:08:08.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.938+0000 7fb1a136b640 1 --2- 172.21.15.78:0/3927700284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb19c108030 0x7fb19c10e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.938+0000 7fb1a136b640 1 --2- 172.21.15.78:0/3927700284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb19c1076b0 0x7fb19c107af0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.938+0000 7fb1a136b640 1 --2- 172.21.15.78:0/3927700284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb19c101ca0 0x7fb19c102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.938+0000 7fb1a136b640 1 -- 172.21.15.78:0/3927700284 >> 172.21.15.78:0/3927700284 conn(0x7fb19c0fd730 msgr2=0x7fb19c0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:08.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.938+0000 7fb1a136b640 1 -- 172.21.15.78:0/3927700284 shutdown_connections 2024-09-11T00:08:08.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.938+0000 7fb1a136b640 1 -- 172.21.15.78:0/3927700284 wait complete. 2024-09-11T00:08:08.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.939+0000 7fb1a136b640 1 Processor -- start 2024-09-11T00:08:08.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.939+0000 7fb1a136b640 1 -- start start 2024-09-11T00:08:08.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.939+0000 7fb1a136b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb19c101ca0 0x7fb19c199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.939+0000 7fb1a136b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb19c1076b0 0x7fb19c19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.939+0000 7fb1a136b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb19c108030 0x7fb19c19a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.939+0000 7fb1a136b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c111bb0 con 0x7fb19c108030 2024-09-11T00:08:08.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.939+0000 7fb1a136b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c111a30 con 0x7fb19c1076b0 2024-09-11T00:08:08.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.939+0000 7fb1a136b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c111d30 con 0x7fb19c101ca0 2024-09-11T00:08:08.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.939+0000 7fb19b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb19c108030 0x7fb19c19a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:08.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.939+0000 7fb19b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb19c108030 0x7fb19c19a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56412/0 (socket says 172.21.15.78:56412) 2024-09-11T00:08:08.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.939+0000 7fb19b7fe640 1 -- 172.21.15.78:0/2718037772 learned_addr learned my addr 172.21.15.78:0/2718037772 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:08.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.939+0000 7fb193fff640 1 --2- 172.21.15.78:0/2718037772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb19c1076b0 0x7fb19c19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:08.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.939+0000 7fb19affd640 1 --2- 172.21.15.78:0/2718037772 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb19c101ca0 0x7fb19c199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:08.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.940+0000 7fb19b7fe640 1 -- 172.21.15.78:0/2718037772 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb19c101ca0 msgr2=0x7fb19c199ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:08.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.940+0000 7fb19b7fe640 1 --2- 172.21.15.78:0/2718037772 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb19c101ca0 0x7fb19c199ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.940+0000 7fb19b7fe640 1 -- 172.21.15.78:0/2718037772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb19c1076b0 msgr2=0x7fb19c19a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:08.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.940+0000 7fb19b7fe640 1 --2- 172.21.15.78:0/2718037772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb19c1076b0 0x7fb19c19a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:08.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.940+0000 7fb19b7fe640 1 -- 172.21.15.78:0/2718037772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb19c1a52e0 con 0x7fb19c108030 2024-09-11T00:08:08.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.940+0000 7fb19b7fe640 1 --2- 172.21.15.78:0/2718037772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb19c108030 0x7fb19c19a9a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb19400eaa0 tx=0x7fb19400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:08.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.940+0000 7fb198ff9640 1 -- 172.21.15.78:0/2718037772 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194004d20 con 0x7fb19c108030 2024-09-11T00:08:08.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.940+0000 7fb198ff9640 1 -- 172.21.15.78:0/2718037772 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb194005020 con 0x7fb19c108030 2024-09-11T00:08:08.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.940+0000 7fb198ff9640 1 -- 172.21.15.78:0/2718037772 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1940116d0 con 0x7fb19c108030 2024-09-11T00:08:08.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.940+0000 7fb1a136b640 1 -- 172.21.15.78:0/2718037772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb19c1a55d0 con 0x7fb19c108030 2024-09-11T00:08:08.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.940+0000 7fb1a136b640 1 -- 172.21.15.78:0/2718037772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb19c1a5a90 con 0x7fb19c108030 2024-09-11T00:08:08.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.941+0000 7fb1a136b640 1 -- 172.21.15.78:0/2718037772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb19c102080 con 0x7fb19c108030 2024-09-11T00:08:08.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.942+0000 7fb198ff9640 1 -- 172.21.15.78:0/2718037772 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 18) ==== 102354+0+0 (secure 0 0 0) 0x7fb19400f040 con 0x7fb19c108030 2024-09-11T00:08:08.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.942+0000 7fb198ff9640 1 --2- 172.21.15.78:0/2718037772 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb18807a400 0x7fb18807c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:08.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.942+0000 7fb19affd640 1 --2- 172.21.15.78:0/2718037772 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb18807a400 0x7fb18807c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:08.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.942+0000 7fb198ff9640 1 -- 172.21.15.78:0/2718037772 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb19409bc10 con 0x7fb19c108030 2024-09-11T00:08:08.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.943+0000 7fb19affd640 1 --2- 172.21.15.78:0/2718037772 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb18807a400 0x7fb18807c8c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00abe0 tx=0x7fb18c00a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:08.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:08.947+0000 7fb198ff9640 1 -- 172.21.15.78:0/2718037772 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb194016030 con 0x7fb19c108030 2024-09-11T00:08:08.981 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:08 smithi112 ceph-mon[35627]: mgrmap e18: x(active, since 12s), standbys: z 2024-09-11T00:08:08.981 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:08 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-11T00:08:08.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:08 smithi112 ceph-mon[35627]: from='client.? ' entity='client.admin' 2024-09-11T00:08:08.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:08 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2576082680' entity='client.admin' 2024-09-11T00:08:09.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:08 smithi138 ceph-mon[35019]: mgrmap e18: x(active, since 12s), standbys: z 2024-09-11T00:08:09.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:08 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-11T00:08:09.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:08 smithi138 ceph-mon[35019]: from='client.? ' entity='client.admin' 2024-09-11T00:08:09.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:08 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2576082680' entity='client.admin' 2024-09-11T00:08:09.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.122+0000 7f9361307640 1 -- 172.21.15.78:0/3517025214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f935c101cb0 msgr2=0x7f935c102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:09.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.122+0000 7f9361307640 1 --2- 172.21.15.78:0/3517025214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f935c101cb0 0x7f935c102090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f934c009900 tx=0x7f934c02a410 comp rx=0 tx=0).stop 2024-09-11T00:08:09.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.122+0000 7f9361307640 1 -- 172.21.15.78:0/3517025214 shutdown_connections 2024-09-11T00:08:09.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.122+0000 7f9361307640 1 --2- 172.21.15.78:0/3517025214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f935c108040 0x7f935c10e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:09.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.122+0000 7f9361307640 1 --2- 172.21.15.78:0/3517025214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f935c1076c0 0x7f935c107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:09.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.122+0000 7f9361307640 1 --2- 172.21.15.78:0/3517025214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f935c101cb0 0x7f935c102090 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:09.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.122+0000 7f9361307640 1 -- 172.21.15.78:0/3517025214 >> 172.21.15.78:0/3517025214 conn(0x7f935c0fd700 msgr2=0x7f935c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:09.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.122+0000 7f9361307640 1 -- 172.21.15.78:0/3517025214 shutdown_connections 2024-09-11T00:08:09.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.122+0000 7f9361307640 1 -- 172.21.15.78:0/3517025214 wait complete. 2024-09-11T00:08:09.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.123+0000 7f9361307640 1 Processor -- start 2024-09-11T00:08:09.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.123+0000 7f9361307640 1 -- start start 2024-09-11T00:08:09.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.123+0000 7f9361307640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f935c101cb0 0x7f935c1980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:09.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.123+0000 7f9361307640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f935c1076c0 0x7f935c1985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:09.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.123+0000 7f9361307640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f935c108040 0x7f935c19d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:09.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.123+0000 7f9361307640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f935c111be0 con 0x7f935c101cb0 2024-09-11T00:08:09.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.123+0000 7f9361307640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f935c111a60 con 0x7f935c108040 2024-09-11T00:08:09.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.123+0000 7f935affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f935c101cb0 0x7f935c1980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:09.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.123+0000 7f9361307640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f935c111d60 con 0x7f935c1076c0 2024-09-11T00:08:09.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.123+0000 7f935affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f935c101cb0 0x7f935c1980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56432/0 (socket says 172.21.15.78:56432) 2024-09-11T00:08:09.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.123+0000 7f935affd640 1 -- 172.21.15.78:0/4086318938 learned_addr learned my addr 172.21.15.78:0/4086318938 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:09.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.123+0000 7f935b7fe640 1 --2- 172.21.15.78:0/4086318938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f935c108040 0x7f935c19d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:09.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.123+0000 7f935a7fc640 1 --2- 172.21.15.78:0/4086318938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f935c1076c0 0x7f935c1985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:09.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.124+0000 7f935affd640 1 -- 172.21.15.78:0/4086318938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f935c1076c0 msgr2=0x7f935c1985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:09.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.124+0000 7f935affd640 1 --2- 172.21.15.78:0/4086318938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f935c1076c0 0x7f935c1985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:09.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.124+0000 7f935affd640 1 -- 172.21.15.78:0/4086318938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f935c108040 msgr2=0x7f935c19d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:09.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.124+0000 7f935affd640 1 --2- 172.21.15.78:0/4086318938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f935c108040 0x7f935c19d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:09.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.124+0000 7f935affd640 1 -- 172.21.15.78:0/4086318938 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935c19e160 con 0x7f935c101cb0 2024-09-11T00:08:09.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.124+0000 7f935a7fc640 1 --2- 172.21.15.78:0/4086318938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f935c1076c0 0x7f935c1985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:08:09.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.124+0000 7f935affd640 1 --2- 172.21.15.78:0/4086318938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f935c101cb0 0x7f935c1980b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f934c006010 tx=0x7f934c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:09.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.124+0000 7f9353fff640 1 -- 172.21.15.78:0/4086318938 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c03f030 con 0x7f935c101cb0 2024-09-11T00:08:09.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.124+0000 7f9353fff640 1 -- 172.21.15.78:0/4086318938 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f934c003a80 con 0x7f935c101cb0 2024-09-11T00:08:09.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.124+0000 7f9361307640 1 -- 172.21.15.78:0/4086318938 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f935c19e3f0 con 0x7f935c101cb0 2024-09-11T00:08:09.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.124+0000 7f9353fff640 1 -- 172.21.15.78:0/4086318938 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c035070 con 0x7f935c101cb0 2024-09-11T00:08:09.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.124+0000 7f9361307640 1 -- 172.21.15.78:0/4086318938 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f935c06b430 con 0x7f935c101cb0 2024-09-11T00:08:09.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.125+0000 7f9361307640 1 -- 172.21.15.78:0/4086318938 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f935c102f60 con 0x7f935c101cb0 2024-09-11T00:08:09.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.126+0000 7f9353fff640 1 -- 172.21.15.78:0/4086318938 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 18) ==== 102354+0+0 (secure 0 0 0) 0x7f934c0035f0 con 0x7f935c101cb0 2024-09-11T00:08:09.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.127+0000 7f9353fff640 1 --2- 172.21.15.78:0/4086318938 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f934807a400 0x7f934807c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:09.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.127+0000 7f9353fff640 1 -- 172.21.15.78:0/4086318938 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f934c0bc530 con 0x7f935c101cb0 2024-09-11T00:08:09.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.127+0000 7f935a7fc640 1 --2- 172.21.15.78:0/4086318938 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f934807a400 0x7f934807c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:09.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.127+0000 7f935a7fc640 1 --2- 172.21.15.78:0/4086318938 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f934807a400 0x7f934807c8c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f935c0fea90 tx=0x7f9344005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:09.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.131+0000 7f9353fff640 1 -- 172.21.15.78:0/4086318938 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f934c084b40 con 0x7f935c101cb0 2024-09-11T00:08:09.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.134+0000 7fb1a136b640 1 -- 172.21.15.78:0/2718037772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fb19c1a5ef0 con 0x7fb19c108030 2024-09-11T00:08:09.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.138+0000 7fb198ff9640 1 -- 172.21.15.78:0/2718037772 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v21)=0 v21) ==== 127+0+0 (secure 0 0 0) 0x7fb194064220 con 0x7fb19c108030 2024-09-11T00:08:09.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.141+0000 7fb1a136b640 1 -- 172.21.15.78:0/2718037772 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb18807a400 msgr2=0x7fb18807c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:09.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.141+0000 7fb1a136b640 1 --2- 172.21.15.78:0/2718037772 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb18807a400 0x7fb18807c8c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00abe0 tx=0x7fb18c00a2d0 comp rx=0 tx=0).stop 2024-09-11T00:08:09.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.141+0000 7fb1a136b640 1 -- 172.21.15.78:0/2718037772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb19c108030 msgr2=0x7fb19c19a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:09.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.141+0000 7fb1a136b640 1 --2- 172.21.15.78:0/2718037772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb19c108030 0x7fb19c19a9a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb19400eaa0 tx=0x7fb19400eea0 comp rx=0 tx=0).stop 2024-09-11T00:08:09.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.141+0000 7fb1a136b640 1 -- 172.21.15.78:0/2718037772 shutdown_connections 2024-09-11T00:08:09.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.141+0000 7fb1a136b640 1 --2- 172.21.15.78:0/2718037772 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb18807a400 0x7fb18807c8c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:09.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.141+0000 7fb1a136b640 1 --2- 172.21.15.78:0/2718037772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb19c108030 0x7fb19c19a9a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:09.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.141+0000 7fb1a136b640 1 --2- 172.21.15.78:0/2718037772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb19c1076b0 0x7fb19c19a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:09.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.141+0000 7fb1a136b640 1 --2- 172.21.15.78:0/2718037772 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb19c101ca0 0x7fb19c199ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:09.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.141+0000 7fb1a136b640 1 -- 172.21.15.78:0/2718037772 >> 172.21.15.78:0/2718037772 conn(0x7fb19c0fd730 msgr2=0x7fb19c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:09.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.141+0000 7fb1a136b640 1 -- 172.21.15.78:0/2718037772 shutdown_connections 2024-09-11T00:08:09.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.141+0000 7fb1a136b640 1 -- 172.21.15.78:0/2718037772 wait complete. 2024-09-11T00:08:09.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.321+0000 7f9361307640 1 -- 172.21.15.78:0/4086318938 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f935c06b6f0 con 0x7f935c101cb0 2024-09-11T00:08:09.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.324+0000 7f9353fff640 1 -- 172.21.15.78:0/4086318938 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f934c089570 con 0x7f935c101cb0 2024-09-11T00:08:09.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.327+0000 7f9361307640 1 -- 172.21.15.78:0/4086318938 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f934807a400 msgr2=0x7f934807c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:09.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.327+0000 7f9361307640 1 --2- 172.21.15.78:0/4086318938 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f934807a400 0x7f934807c8c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f935c0fea90 tx=0x7f9344005f90 comp rx=0 tx=0).stop 2024-09-11T00:08:09.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.327+0000 7f9361307640 1 -- 172.21.15.78:0/4086318938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f935c101cb0 msgr2=0x7f935c1980b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:09.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.327+0000 7f9361307640 1 --2- 172.21.15.78:0/4086318938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f935c101cb0 0x7f935c1980b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f934c006010 tx=0x7f934c0040c0 comp rx=0 tx=0).stop 2024-09-11T00:08:09.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.327+0000 7f9361307640 1 -- 172.21.15.78:0/4086318938 shutdown_connections 2024-09-11T00:08:09.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.327+0000 7f9361307640 1 --2- 172.21.15.78:0/4086318938 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f934807a400 0x7f934807c8c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:09.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.327+0000 7f9361307640 1 --2- 172.21.15.78:0/4086318938 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f935c108040 0x7f935c19d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:09.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.327+0000 7f9361307640 1 --2- 172.21.15.78:0/4086318938 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f935c1076c0 0x7f935c1985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:09.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.327+0000 7f9361307640 1 --2- 172.21.15.78:0/4086318938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f935c101cb0 0x7f935c1980b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:09.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.327+0000 7f9361307640 1 -- 172.21.15.78:0/4086318938 >> 172.21.15.78:0/4086318938 conn(0x7f935c0fd700 msgr2=0x7f935c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:09.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.327+0000 7f9361307640 1 -- 172.21.15.78:0/4086318938 shutdown_connections 2024-09-11T00:08:09.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:09.327+0000 7f9361307640 1 -- 172.21.15.78:0/4086318938 wait complete. 2024-09-11T00:08:10.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.129+0000 7f5798ab4640 1 -- 172.21.15.78:0/703768336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57941087d0 msgr2=0x7f5794108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:10.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.129+0000 7f5798ab4640 1 --2- 172.21.15.78:0/703768336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57941087d0 0x7f5794108c10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f577c009900 tx=0x7f577c02a410 comp rx=0 tx=0).stop 2024-09-11T00:08:10.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.129+0000 7f5798ab4640 1 -- 172.21.15.78:0/703768336 shutdown_connections 2024-09-11T00:08:10.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.129+0000 7f5798ab4640 1 --2- 172.21.15.78:0/703768336 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5794109150 0x7f579410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:10.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.129+0000 7f5798ab4640 1 --2- 172.21.15.78:0/703768336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57941087d0 0x7f5794108c10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:10.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.129+0000 7f5798ab4640 1 --2- 172.21.15.78:0/703768336 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5794102dc0 0x7f57941031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:10.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.129+0000 7f5798ab4640 1 -- 172.21.15.78:0/703768336 >> 172.21.15.78:0/703768336 conn(0x7f57940fe830 msgr2=0x7f5794100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:10.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.130+0000 7f5798ab4640 1 -- 172.21.15.78:0/703768336 shutdown_connections 2024-09-11T00:08:10.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.130+0000 7f5798ab4640 1 -- 172.21.15.78:0/703768336 wait complete. 2024-09-11T00:08:10.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.130+0000 7f5798ab4640 1 Processor -- start 2024-09-11T00:08:10.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.130+0000 7f5798ab4640 1 -- start start 2024-09-11T00:08:10.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.130+0000 7f5798ab4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5794102dc0 0x7f5794199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:10.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.130+0000 7f5798ab4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57941087d0 0x7f5794199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:10.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.130+0000 7f5798ab4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5794109150 0x7f579419eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:10.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.130+0000 7f5798ab4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5794112d00 con 0x7f5794109150 2024-09-11T00:08:10.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.130+0000 7f5798ab4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5794112b80 con 0x7f5794102dc0 2024-09-11T00:08:10.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.130+0000 7f5798ab4640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5794112e80 con 0x7f57941087d0 2024-09-11T00:08:10.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.131+0000 7f5792d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5794109150 0x7f579419eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:10.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.131+0000 7f5792d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5794109150 0x7f579419eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56444/0 (socket says 172.21.15.78:56444) 2024-09-11T00:08:10.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.131+0000 7f5792d9d640 1 -- 172.21.15.78:0/3212454705 learned_addr learned my addr 172.21.15.78:0/3212454705 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:10.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.131+0000 7f5791d9b640 1 --2- 172.21.15.78:0/3212454705 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57941087d0 0x7f5794199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:10.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.131+0000 7f579259c640 1 --2- 172.21.15.78:0/3212454705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5794102dc0 0x7f5794199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:10.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.131+0000 7f5792d9d640 1 -- 172.21.15.78:0/3212454705 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57941087d0 msgr2=0x7f5794199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:10.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.131+0000 7f5792d9d640 1 --2- 172.21.15.78:0/3212454705 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57941087d0 0x7f5794199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:10.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.131+0000 7f5792d9d640 1 -- 172.21.15.78:0/3212454705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5794102dc0 msgr2=0x7f5794199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:10.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.131+0000 7f5792d9d640 1 --2- 172.21.15.78:0/3212454705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5794102dc0 0x7f5794199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:10.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.131+0000 7f5792d9d640 1 -- 172.21.15.78:0/3212454705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579419f2e0 con 0x7f5794109150 2024-09-11T00:08:10.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.131+0000 7f579259c640 1 --2- 172.21.15.78:0/3212454705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5794102dc0 0x7f5794199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:08:10.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.131+0000 7f5792d9d640 1 --2- 172.21.15.78:0/3212454705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5794109150 0x7f579419eb10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f578c00c970 tx=0x7f578c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:10.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.131+0000 7f578b7fe640 1 -- 172.21.15.78:0/3212454705 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c007bb0 con 0x7f5794109150 2024-09-11T00:08:10.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.131+0000 7f578b7fe640 1 -- 172.21.15.78:0/3212454705 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f578c007d50 con 0x7f5794109150 2024-09-11T00:08:10.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.131+0000 7f578b7fe640 1 -- 172.21.15.78:0/3212454705 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c004d60 con 0x7f5794109150 2024-09-11T00:08:10.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.131+0000 7f5798ab4640 1 -- 172.21.15.78:0/3212454705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f579419f5d0 con 0x7f5794109150 2024-09-11T00:08:10.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.131+0000 7f5798ab4640 1 -- 172.21.15.78:0/3212454705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57941a5c90 con 0x7f5794109150 2024-09-11T00:08:10.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.132+0000 7f5798ab4640 1 -- 172.21.15.78:0/3212454705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57941031a0 con 0x7f5794109150 2024-09-11T00:08:10.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.133+0000 7f578b7fe640 1 -- 172.21.15.78:0/3212454705 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 18) ==== 102354+0+0 (secure 0 0 0) 0x7f578c004f80 con 0x7f5794109150 2024-09-11T00:08:10.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.133+0000 7f578b7fe640 1 --2- 172.21.15.78:0/3212454705 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f578007a400 0x7f578007c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:10.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.134+0000 7f579259c640 1 --2- 172.21.15.78:0/3212454705 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f578007a400 0x7f578007c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:10.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.134+0000 7f578b7fe640 1 -- 172.21.15.78:0/3212454705 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f578c09bbd0 con 0x7f5794109150 2024-09-11T00:08:10.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.134+0000 7f579259c640 1 --2- 172.21.15.78:0/3212454705 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f578007a400 0x7f578007c8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5784005fd0 tx=0x7f5784009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:10.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.138+0000 7f578b7fe640 1 -- 172.21.15.78:0/3212454705 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f578c014030 con 0x7f5794109150 2024-09-11T00:08:10.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.150+0000 7f578b7fe640 1 -- 172.21.15.78:0/3212454705 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f578c060320 con 0x7f5794109150 2024-09-11T00:08:10.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.320+0000 7f5798ab4640 1 -- 172.21.15.78:0/3212454705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f579410af60 con 0x7f5794109150 2024-09-11T00:08:10.322 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:10 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2718037772' entity='client.admin' 2024-09-11T00:08:10.322 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:10 smithi078 ceph-mon[30865]: Standby manager daemon y started 2024-09-11T00:08:10.322 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:10 smithi078 ceph-mon[30865]: from='mgr.? 172.21.15.112:0/3659938010' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-11T00:08:10.322 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:10 smithi078 ceph-mon[30865]: from='mgr.? 172.21.15.112:0/3659938010' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-11T00:08:10.322 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:10 smithi078 ceph-mon[30865]: from='mgr.? 172.21.15.112:0/3659938010' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-11T00:08:10.322 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:10 smithi078 ceph-mon[30865]: from='mgr.? 172.21.15.112:0/3659938010' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-11T00:08:10.322 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:10 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/4086318938' entity='client.admin' 2024-09-11T00:08:10.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.326+0000 7f578b7fe640 1 -- 172.21.15.78:0/3212454705 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v23)=0 v23) ==== 120+0+0 (secure 0 0 0) 0x7f578c004d40 con 0x7f5794109150 2024-09-11T00:08:10.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.328+0000 7f5798ab4640 1 -- 172.21.15.78:0/3212454705 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f578007a400 msgr2=0x7f578007c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:10.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.328+0000 7f5798ab4640 1 --2- 172.21.15.78:0/3212454705 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f578007a400 0x7f578007c8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5784005fd0 tx=0x7f5784009500 comp rx=0 tx=0).stop 2024-09-11T00:08:10.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.328+0000 7f5798ab4640 1 -- 172.21.15.78:0/3212454705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5794109150 msgr2=0x7f579419eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:10.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.328+0000 7f5798ab4640 1 --2- 172.21.15.78:0/3212454705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5794109150 0x7f579419eb10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f578c00c970 tx=0x7f578c00ce30 comp rx=0 tx=0).stop 2024-09-11T00:08:10.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.328+0000 7f5798ab4640 1 -- 172.21.15.78:0/3212454705 shutdown_connections 2024-09-11T00:08:10.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.328+0000 7f5798ab4640 1 --2- 172.21.15.78:0/3212454705 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f578007a400 0x7f578007c8c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:10.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.328+0000 7f5798ab4640 1 --2- 172.21.15.78:0/3212454705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5794109150 0x7f579419eb10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:10.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.328+0000 7f5798ab4640 1 --2- 172.21.15.78:0/3212454705 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57941087d0 0x7f5794199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:10.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.328+0000 7f5798ab4640 1 --2- 172.21.15.78:0/3212454705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5794102dc0 0x7f5794199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:10.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.328+0000 7f5798ab4640 1 -- 172.21.15.78:0/3212454705 >> 172.21.15.78:0/3212454705 conn(0x7f57940fe830 msgr2=0x7f5794100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:10.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.328+0000 7f5798ab4640 1 -- 172.21.15.78:0/3212454705 shutdown_connections 2024-09-11T00:08:10.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.328+0000 7f5798ab4640 1 -- 172.21.15.78:0/3212454705 wait complete. 2024-09-11T00:08:10.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:10 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2718037772' entity='client.admin' 2024-09-11T00:08:10.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:10 smithi112 ceph-mon[35627]: Standby manager daemon y started 2024-09-11T00:08:10.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:10 smithi112 ceph-mon[35627]: from='mgr.? 172.21.15.112:0/3659938010' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-11T00:08:10.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:10 smithi112 ceph-mon[35627]: from='mgr.? 172.21.15.112:0/3659938010' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-11T00:08:10.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:10 smithi112 ceph-mon[35627]: from='mgr.? 172.21.15.112:0/3659938010' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-11T00:08:10.483 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:10 smithi112 ceph-mon[35627]: from='mgr.? 172.21.15.112:0/3659938010' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-11T00:08:10.483 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:10 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/4086318938' entity='client.admin' 2024-09-11T00:08:10.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:10 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2718037772' entity='client.admin' 2024-09-11T00:08:10.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:10 smithi138 ceph-mon[35019]: Standby manager daemon y started 2024-09-11T00:08:10.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:10 smithi138 ceph-mon[35019]: from='mgr.? 172.21.15.112:0/3659938010' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-11T00:08:10.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:10 smithi138 ceph-mon[35019]: from='mgr.? 172.21.15.112:0/3659938010' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-11T00:08:10.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:10 smithi138 ceph-mon[35019]: from='mgr.? 172.21.15.112:0/3659938010' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-11T00:08:10.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:10 smithi138 ceph-mon[35019]: from='mgr.? 172.21.15.112:0/3659938010' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-11T00:08:10.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:10 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/4086318938' entity='client.admin' 2024-09-11T00:08:11.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:11 smithi078 ceph-mon[30865]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-09-11T00:08:11.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:11 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-11T00:08:11.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:11 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3212454705' entity='client.admin' 2024-09-11T00:08:11.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:11 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/927764767' entity='client.admin' 2024-09-11T00:08:11.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:11 smithi112 ceph-mon[35627]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-09-11T00:08:11.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:11 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-11T00:08:11.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:11 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3212454705' entity='client.admin' 2024-09-11T00:08:11.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:11 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/927764767' entity='client.admin' 2024-09-11T00:08:11.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:11 smithi138 ceph-mon[35019]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-09-11T00:08:11.545 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:11 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-11T00:08:11.545 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:11 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3212454705' entity='client.admin' 2024-09-11T00:08:11.545 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:11 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/927764767' entity='client.admin' 2024-09-11T00:08:11.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.865+0000 7f5cba8e8640 1 -- 172.21.15.78:0/1356803797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cb4108020 msgr2=0x7f5cb410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:11.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.865+0000 7f5cba8e8640 1 --2- 172.21.15.78:0/1356803797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cb4108020 0x7f5cb410e820 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5cac009ca0 tx=0x7f5cac02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:08:11.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.865+0000 7f5cba8e8640 1 -- 172.21.15.78:0/1356803797 shutdown_connections 2024-09-11T00:08:11.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.865+0000 7f5cba8e8640 1 --2- 172.21.15.78:0/1356803797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cb4108020 0x7f5cb410e820 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:11.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.865+0000 7f5cba8e8640 1 --2- 172.21.15.78:0/1356803797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cb41076a0 0x7f5cb4107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:11.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.865+0000 7f5cba8e8640 1 --2- 172.21.15.78:0/1356803797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cb4101c90 0x7f5cb4102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:11.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.865+0000 7f5cba8e8640 1 -- 172.21.15.78:0/1356803797 >> 172.21.15.78:0/1356803797 conn(0x7f5cb40fd700 msgr2=0x7f5cb40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:11.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.865+0000 7f5cba8e8640 1 -- 172.21.15.78:0/1356803797 shutdown_connections 2024-09-11T00:08:11.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.865+0000 7f5cba8e8640 1 -- 172.21.15.78:0/1356803797 wait complete. 2024-09-11T00:08:11.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.866+0000 7f5cba8e8640 1 Processor -- start 2024-09-11T00:08:11.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.866+0000 7f5cba8e8640 1 -- start start 2024-09-11T00:08:11.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.866+0000 7f5cba8e8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cb4101c90 0x7f5cb4197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:11.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.866+0000 7f5cba8e8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cb41076a0 0x7f5cb41982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:11.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.866+0000 7f5cba8e8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cb4108020 0x7f5cb4198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:11.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.866+0000 7f5cba8e8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb4111bc0 con 0x7f5cb4108020 2024-09-11T00:08:11.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.866+0000 7f5cba8e8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb4111a40 con 0x7f5cb4101c90 2024-09-11T00:08:11.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.866+0000 7f5cba8e8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb4111d40 con 0x7f5cb41076a0 2024-09-11T00:08:11.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.866+0000 7f5cb8e85640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cb4108020 0x7f5cb4198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:11.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.866+0000 7f5cb8e85640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cb4108020 0x7f5cb4198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56466/0 (socket says 172.21.15.78:56466) 2024-09-11T00:08:11.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.866+0000 7f5cb8e85640 1 -- 172.21.15.78:0/927764767 learned_addr learned my addr 172.21.15.78:0/927764767 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:11.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.866+0000 7f5cb3fff640 1 --2- 172.21.15.78:0/927764767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cb4101c90 0x7f5cb4197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:11.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.866+0000 7f5cb37fe640 1 --2- 172.21.15.78:0/927764767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cb41076a0 0x7f5cb41982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:11.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.866+0000 7f5cb8e85640 1 -- 172.21.15.78:0/927764767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cb41076a0 msgr2=0x7f5cb41982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:11.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.866+0000 7f5cb8e85640 1 --2- 172.21.15.78:0/927764767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cb41076a0 0x7f5cb41982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:11.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.866+0000 7f5cb8e85640 1 -- 172.21.15.78:0/927764767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cb4101c90 msgr2=0x7f5cb4197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:11.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.866+0000 7f5cb8e85640 1 --2- 172.21.15.78:0/927764767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cb4101c90 0x7f5cb4197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:11.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.866+0000 7f5cb8e85640 1 -- 172.21.15.78:0/927764767 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb41a7580 con 0x7f5cb4108020 2024-09-11T00:08:11.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.866+0000 7f5cb37fe640 1 --2- 172.21.15.78:0/927764767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cb41076a0 0x7f5cb41982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:08:11.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.867+0000 7f5cb8e85640 1 --2- 172.21.15.78:0/927764767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cb4108020 0x7f5cb4198820 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5cac031040 tx=0x7f5cac003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:11.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.867+0000 7f5cb17fa640 1 -- 172.21.15.78:0/927764767 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cac004040 con 0x7f5cb4108020 2024-09-11T00:08:11.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.867+0000 7f5cb17fa640 1 -- 172.21.15.78:0/927764767 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5cac004670 con 0x7f5cb4108020 2024-09-11T00:08:11.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.867+0000 7f5cba8e8640 1 -- 172.21.15.78:0/927764767 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cb41a7810 con 0x7f5cb4108020 2024-09-11T00:08:11.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.867+0000 7f5cb17fa640 1 -- 172.21.15.78:0/927764767 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cac030ca0 con 0x7f5cb4108020 2024-09-11T00:08:11.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.867+0000 7f5cba8e8640 1 -- 172.21.15.78:0/927764767 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cb41a7da0 con 0x7f5cb4108020 2024-09-11T00:08:11.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.868+0000 7f5cba8e8640 1 -- 172.21.15.78:0/927764767 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cb4102070 con 0x7f5cb4108020 2024-09-11T00:08:11.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.869+0000 7f5cb17fa640 1 -- 172.21.15.78:0/927764767 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f5cac0041e0 con 0x7f5cb4108020 2024-09-11T00:08:11.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.870+0000 7f5cb17fa640 1 --2- 172.21.15.78:0/927764767 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5c9c0b5320 0x7f5c9c0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:11.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.870+0000 7f5cb3fff640 1 --2- 172.21.15.78:0/927764767 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5c9c0b5320 0x7f5c9c0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:11.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.870+0000 7f5cb17fa640 1 -- 172.21.15.78:0/927764767 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5cac105520 con 0x7f5cb4108020 2024-09-11T00:08:11.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.871+0000 7f5cb3fff640 1 --2- 172.21.15.78:0/927764767 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5c9c0b5320 0x7f5c9c0b77e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5ca400abe0 tx=0x7f5ca400a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:11.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:10.873+0000 7f5cb17fa640 1 -- 172.21.15.78:0/927764767 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5cac0cdfe0 con 0x7f5cb4108020 2024-09-11T00:08:11.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:11.053+0000 7f5cba8e8640 1 -- 172.21.15.78:0/927764767 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f5cb406aec0 con 0x7f5cb4108020 2024-09-11T00:08:11.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:11.057+0000 7f5cb17fa640 1 -- 172.21.15.78:0/927764767 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v24)=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7f5cb406aec0 con 0x7f5cb4108020 2024-09-11T00:08:11.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:11.059+0000 7f5cba8e8640 1 -- 172.21.15.78:0/927764767 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5c9c0b5320 msgr2=0x7f5c9c0b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:11.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:11.059+0000 7f5cba8e8640 1 --2- 172.21.15.78:0/927764767 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5c9c0b5320 0x7f5c9c0b77e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5ca400abe0 tx=0x7f5ca400a2d0 comp rx=0 tx=0).stop 2024-09-11T00:08:11.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:11.059+0000 7f5cba8e8640 1 -- 172.21.15.78:0/927764767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cb4108020 msgr2=0x7f5cb4198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:11.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:11.059+0000 7f5cba8e8640 1 --2- 172.21.15.78:0/927764767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cb4108020 0x7f5cb4198820 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5cac031040 tx=0x7f5cac003ba0 comp rx=0 tx=0).stop 2024-09-11T00:08:11.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:11.059+0000 7f5cba8e8640 1 -- 172.21.15.78:0/927764767 shutdown_connections 2024-09-11T00:08:11.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:11.059+0000 7f5cba8e8640 1 --2- 172.21.15.78:0/927764767 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5c9c0b5320 0x7f5c9c0b77e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:11.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:11.059+0000 7f5cba8e8640 1 --2- 172.21.15.78:0/927764767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cb4108020 0x7f5cb4198820 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:11.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:11.059+0000 7f5cba8e8640 1 --2- 172.21.15.78:0/927764767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cb41076a0 0x7f5cb41982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:11.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:11.059+0000 7f5cba8e8640 1 --2- 172.21.15.78:0/927764767 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cb4101c90 0x7f5cb4197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:11.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:11.059+0000 7f5cba8e8640 1 -- 172.21.15.78:0/927764767 >> 172.21.15.78:0/927764767 conn(0x7f5cb40fd700 msgr2=0x7f5cb40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:11.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:11.059+0000 7f5cba8e8640 1 -- 172.21.15.78:0/927764767 shutdown_connections 2024-09-11T00:08:11.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:11.059+0000 7f5cba8e8640 1 -- 172.21.15.78:0/927764767 wait complete. 2024-09-11T00:08:11.811 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:11.812 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:13.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.483+0000 7f888f12f640 1 -- 172.21.15.78:0/1850604738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88881076a0 msgr2=0x7f8888107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:13.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.483+0000 7f888f12f640 1 --2- 172.21.15.78:0/1850604738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88881076a0 0x7f8888107ae0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8874009900 tx=0x7f887402a410 comp rx=0 tx=0).stop 2024-09-11T00:08:13.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.483+0000 7f888f12f640 1 -- 172.21.15.78:0/1850604738 shutdown_connections 2024-09-11T00:08:13.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.483+0000 7f888f12f640 1 --2- 172.21.15.78:0/1850604738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8888108020 0x7f888810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:13.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.483+0000 7f888f12f640 1 --2- 172.21.15.78:0/1850604738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88881076a0 0x7f8888107ae0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:13.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.483+0000 7f888f12f640 1 --2- 172.21.15.78:0/1850604738 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8888101c90 0x7f8888102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:13.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.483+0000 7f888f12f640 1 -- 172.21.15.78:0/1850604738 >> 172.21.15.78:0/1850604738 conn(0x7f88880fd700 msgr2=0x7f88880ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:13.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.483+0000 7f888f12f640 1 -- 172.21.15.78:0/1850604738 shutdown_connections 2024-09-11T00:08:13.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.483+0000 7f888f12f640 1 -- 172.21.15.78:0/1850604738 wait complete. 2024-09-11T00:08:13.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.484+0000 7f888f12f640 1 Processor -- start 2024-09-11T00:08:13.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.484+0000 7f888f12f640 1 -- start start 2024-09-11T00:08:13.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.484+0000 7f888f12f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8888101c90 0x7f888819a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:13.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.484+0000 7f888f12f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88881076a0 0x7f888819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:13.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.484+0000 7f888f12f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8888108020 0x7f888819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:13.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.484+0000 7f888f12f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8888111c10 con 0x7f88881076a0 2024-09-11T00:08:13.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.484+0000 7f888f12f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8888111a90 con 0x7f8888101c90 2024-09-11T00:08:13.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.484+0000 7f888f12f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8888111d90 con 0x7f8888108020 2024-09-11T00:08:13.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.484+0000 7f8887fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88881076a0 0x7f888819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:13.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.484+0000 7f8887fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88881076a0 0x7f888819a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56480/0 (socket says 172.21.15.78:56480) 2024-09-11T00:08:13.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.484+0000 7f8887fff640 1 -- 172.21.15.78:0/4247862723 learned_addr learned my addr 172.21.15.78:0/4247862723 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:13.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.484+0000 7f888cecb640 1 --2- 172.21.15.78:0/4247862723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8888101c90 0x7f888819a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:13.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.484+0000 7f8887fff640 1 -- 172.21.15.78:0/4247862723 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8888108020 msgr2=0x7f888819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:13.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.484+0000 7f8887fff640 1 --2- 172.21.15.78:0/4247862723 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8888108020 0x7f888819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:13.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.484+0000 7f8887fff640 1 -- 172.21.15.78:0/4247862723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8888101c90 msgr2=0x7f888819a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:13.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.484+0000 7f8887fff640 1 --2- 172.21.15.78:0/4247862723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8888101c90 0x7f888819a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:13.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.484+0000 7f8887fff640 1 -- 172.21.15.78:0/4247862723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88881a5420 con 0x7f88881076a0 2024-09-11T00:08:13.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.485+0000 7f8887fff640 1 --2- 172.21.15.78:0/4247862723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88881076a0 0x7f888819a560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8874004770 tx=0x7f8874003ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:13.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.485+0000 7f8885ffb640 1 -- 172.21.15.78:0/4247862723 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887403f070 con 0x7f88881076a0 2024-09-11T00:08:13.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.485+0000 7f8885ffb640 1 -- 172.21.15.78:0/4247862723 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f887403bd00 con 0x7f88881076a0 2024-09-11T00:08:13.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.485+0000 7f888f12f640 1 -- 172.21.15.78:0/4247862723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88881a56b0 con 0x7f88881076a0 2024-09-11T00:08:13.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.485+0000 7f8885ffb640 1 -- 172.21.15.78:0/4247862723 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8874035030 con 0x7f88881076a0 2024-09-11T00:08:13.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.485+0000 7f888f12f640 1 -- 172.21.15.78:0/4247862723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88881a5c60 con 0x7f88881076a0 2024-09-11T00:08:13.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.486+0000 7f888f12f640 1 -- 172.21.15.78:0/4247862723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8888102070 con 0x7f88881076a0 2024-09-11T00:08:13.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.487+0000 7f8885ffb640 1 -- 172.21.15.78:0/4247862723 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f8874031400 con 0x7f88881076a0 2024-09-11T00:08:13.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.488+0000 7f8885ffb640 1 --2- 172.21.15.78:0/4247862723 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f88780b5320 0x7f88780b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:13.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.488+0000 7f888cecb640 1 --2- 172.21.15.78:0/4247862723 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f88780b5320 0x7f88780b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:13.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.488+0000 7f8885ffb640 1 -- 172.21.15.78:0/4247862723 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f88741050e0 con 0x7f88881076a0 2024-09-11T00:08:13.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.488+0000 7f888cecb640 1 --2- 172.21.15.78:0/4247862723 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f88780b5320 0x7f88780b77e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f887c005fd0 tx=0x7f887c005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:13.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.491+0000 7f8885ffb640 1 -- 172.21.15.78:0/4247862723 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f88740cdba0 con 0x7f88881076a0 2024-09-11T00:08:13.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.675+0000 7f888f12f640 1 -- 172.21.15.78:0/4247862723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f888802e5c0 con 0x7f88881076a0 2024-09-11T00:08:13.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.679+0000 7f8885ffb640 1 -- 172.21.15.78:0/4247862723 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v25)=0 v25) ==== 115+0+0 (secure 0 0 0) 0x7f88740cd4a0 con 0x7f88881076a0 2024-09-11T00:08:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.681+0000 7f888f12f640 1 -- 172.21.15.78:0/4247862723 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f88780b5320 msgr2=0x7f88780b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.681+0000 7f888f12f640 1 --2- 172.21.15.78:0/4247862723 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f88780b5320 0x7f88780b77e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f887c005fd0 tx=0x7f887c005850 comp rx=0 tx=0).stop 2024-09-11T00:08:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.681+0000 7f888f12f640 1 -- 172.21.15.78:0/4247862723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88881076a0 msgr2=0x7f888819a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.681+0000 7f888f12f640 1 --2- 172.21.15.78:0/4247862723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88881076a0 0x7f888819a560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8874004770 tx=0x7f8874003ca0 comp rx=0 tx=0).stop 2024-09-11T00:08:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.681+0000 7f888f12f640 1 -- 172.21.15.78:0/4247862723 shutdown_connections 2024-09-11T00:08:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.681+0000 7f888f12f640 1 --2- 172.21.15.78:0/4247862723 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f88780b5320 0x7f88780b77e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.681+0000 7f888f12f640 1 --2- 172.21.15.78:0/4247862723 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8888108020 0x7f888819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.681+0000 7f888f12f640 1 --2- 172.21.15.78:0/4247862723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88881076a0 0x7f888819a560 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.681+0000 7f888f12f640 1 --2- 172.21.15.78:0/4247862723 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8888101c90 0x7f888819a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.681+0000 7f888f12f640 1 -- 172.21.15.78:0/4247862723 >> 172.21.15.78:0/4247862723 conn(0x7f88880fd700 msgr2=0x7f88880ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.681+0000 7f888f12f640 1 -- 172.21.15.78:0/4247862723 shutdown_connections 2024-09-11T00:08:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:13.681+0000 7f888f12f640 1 -- 172.21.15.78:0/4247862723 wait complete. 2024-09-11T00:08:13.773 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:13.774 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:14.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:14 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/4247862723' entity='client.admin' 2024-09-11T00:08:14.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:14 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/4247862723' entity='client.admin' 2024-09-11T00:08:15.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.028+0000 7ff6e4873640 1 -- 172.21.15.78:0/1295675569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6e010d130 msgr2=0x7ff6e010f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:15.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.028+0000 7ff6e4873640 1 --2- 172.21.15.78:0/1295675569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6e010d130 0x7ff6e010f590 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8009ca0 tx=0x7ff6d802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:08:15.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.028+0000 7ff6e4873640 1 -- 172.21.15.78:0/1295675569 shutdown_connections 2024-09-11T00:08:15.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.028+0000 7ff6e4873640 1 --2- 172.21.15.78:0/1295675569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6e010d130 0x7ff6e010f590 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.028+0000 7ff6e4873640 1 --2- 172.21.15.78:0/1295675569 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6e01045f0 0x7ff6e010cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.028+0000 7ff6e4873640 1 --2- 172.21.15.78:0/1295675569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6e0103cd0 0x7ff6e01040b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.028+0000 7ff6e4873640 1 -- 172.21.15.78:0/1295675569 >> 172.21.15.78:0/1295675569 conn(0x7ff6e00fd770 msgr2=0x7ff6e00ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.029+0000 7ff6e4873640 1 -- 172.21.15.78:0/1295675569 shutdown_connections 2024-09-11T00:08:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.029+0000 7ff6e4873640 1 -- 172.21.15.78:0/1295675569 wait complete. 2024-09-11T00:08:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.029+0000 7ff6e4873640 1 Processor -- start 2024-09-11T00:08:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.029+0000 7ff6e4873640 1 -- start start 2024-09-11T00:08:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.030+0000 7ff6e4873640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6e0103cd0 0x7ff6e01991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.030+0000 7ff6e4873640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6e01045f0 0x7ff6e01996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.030+0000 7ff6e4873640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6e010d130 0x7ff6e019ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.030+0000 7ff6e4873640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e0112c80 con 0x7ff6e010d130 2024-09-11T00:08:15.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.030+0000 7ff6e4873640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e0112b00 con 0x7ff6e01045f0 2024-09-11T00:08:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.030+0000 7ff6e4873640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e0112e00 con 0x7ff6e0103cd0 2024-09-11T00:08:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.030+0000 7ff6ded9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6e010d130 0x7ff6e019ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.030+0000 7ff6ded9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6e010d130 0x7ff6e019ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43694/0 (socket says 172.21.15.78:43694) 2024-09-11T00:08:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.030+0000 7ff6ded9d640 1 -- 172.21.15.78:0/580917804 learned_addr learned my addr 172.21.15.78:0/580917804 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.030+0000 7ff6ddd9b640 1 --2- 172.21.15.78:0/580917804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6e01045f0 0x7ff6e01996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.030+0000 7ff6de59c640 1 --2- 172.21.15.78:0/580917804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6e0103cd0 0x7ff6e01991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.030+0000 7ff6ded9d640 1 -- 172.21.15.78:0/580917804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6e0103cd0 msgr2=0x7ff6e01991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.030+0000 7ff6ded9d640 1 --2- 172.21.15.78:0/580917804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6e0103cd0 0x7ff6e01991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.030+0000 7ff6ded9d640 1 -- 172.21.15.78:0/580917804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6e01045f0 msgr2=0x7ff6e01996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.030+0000 7ff6ded9d640 1 --2- 172.21.15.78:0/580917804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6e01045f0 0x7ff6e01996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.030+0000 7ff6ded9d640 1 -- 172.21.15.78:0/580917804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e019f260 con 0x7ff6e010d130 2024-09-11T00:08:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.030+0000 7ff6ded9d640 1 --2- 172.21.15.78:0/580917804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6e010d130 0x7ff6e019ea90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8031040 tx=0x7ff6d8003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:15.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.031+0000 7ff6cf7fe640 1 -- 172.21.15.78:0/580917804 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8003ce0 con 0x7ff6e010d130 2024-09-11T00:08:15.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.031+0000 7ff6e4873640 1 -- 172.21.15.78:0/580917804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e019f4f0 con 0x7ff6e010d130 2024-09-11T00:08:15.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.031+0000 7ff6cf7fe640 1 -- 172.21.15.78:0/580917804 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff6d80044d0 con 0x7ff6e010d130 2024-09-11T00:08:15.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.031+0000 7ff6cf7fe640 1 -- 172.21.15.78:0/580917804 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8030b60 con 0x7ff6e010d130 2024-09-11T00:08:15.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.031+0000 7ff6e4873640 1 -- 172.21.15.78:0/580917804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e01a5c10 con 0x7ff6e010d130 2024-09-11T00:08:15.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.032+0000 7ff6e4873640 1 -- 172.21.15.78:0/580917804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6e01040b0 con 0x7ff6e010d130 2024-09-11T00:08:15.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.033+0000 7ff6cf7fe640 1 -- 172.21.15.78:0/580917804 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7ff6d8004680 con 0x7ff6e010d130 2024-09-11T00:08:15.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.034+0000 7ff6cf7fe640 1 --2- 172.21.15.78:0/580917804 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff6c80b52a0 0x7ff6c80b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:15.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.034+0000 7ff6de59c640 1 --2- 172.21.15.78:0/580917804 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff6c80b52a0 0x7ff6c80b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:15.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.034+0000 7ff6cf7fe640 1 -- 172.21.15.78:0/580917804 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff6d8105310 con 0x7ff6e010d130 2024-09-11T00:08:15.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.034+0000 7ff6de59c640 1 --2- 172.21.15.78:0/580917804 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff6c80b52a0 0x7ff6c80b7760 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000bbe0 tx=0x7ff6d000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:15.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.040+0000 7ff6cf7fe640 1 -- 172.21.15.78:0/580917804 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff6d80cddd0 con 0x7ff6e010d130 2024-09-11T00:08:15.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:14 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/4247862723' entity='client.admin' 2024-09-11T00:08:15.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.936+0000 7fdd56a9e640 1 -- 172.21.15.78:0/3813077648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd50101c90 msgr2=0x7fdd50102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:15.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.936+0000 7fdd56a9e640 1 --2- 172.21.15.78:0/3813077648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd50101c90 0x7fdd50102070 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009900 tx=0x7fdd4402a410 comp rx=0 tx=0).stop 2024-09-11T00:08:15.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.936+0000 7fdd56a9e640 1 -- 172.21.15.78:0/3813077648 shutdown_connections 2024-09-11T00:08:15.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.936+0000 7fdd56a9e640 1 --2- 172.21.15.78:0/3813077648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd50108020 0x7fdd5010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:15.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.936+0000 7fdd56a9e640 1 --2- 172.21.15.78:0/3813077648 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd501076a0 0x7fdd50107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:15.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.936+0000 7fdd56a9e640 1 --2- 172.21.15.78:0/3813077648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd50101c90 0x7fdd50102070 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:15.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.936+0000 7fdd56a9e640 1 -- 172.21.15.78:0/3813077648 >> 172.21.15.78:0/3813077648 conn(0x7fdd500fd700 msgr2=0x7fdd500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:15.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.936+0000 7fdd56a9e640 1 -- 172.21.15.78:0/3813077648 shutdown_connections 2024-09-11T00:08:15.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.936+0000 7fdd56a9e640 1 -- 172.21.15.78:0/3813077648 wait complete. 2024-09-11T00:08:15.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.937+0000 7fdd56a9e640 1 Processor -- start 2024-09-11T00:08:15.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.937+0000 7fdd56a9e640 1 -- start start 2024-09-11T00:08:15.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.937+0000 7fdd56a9e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd50101c90 0x7fdd5019a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:15.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.937+0000 7fdd56a9e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd501076a0 0x7fdd5019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:15.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.937+0000 7fdd56a9e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd50108020 0x7fdd5019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:15.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.937+0000 7fdd56a9e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdd50111be0 con 0x7fdd50108020 2024-09-11T00:08:15.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.937+0000 7fdd56a9e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdd50111a60 con 0x7fdd501076a0 2024-09-11T00:08:15.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.937+0000 7fdd56a9e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdd50111d60 con 0x7fdd50101c90 2024-09-11T00:08:15.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.937+0000 7fdd5503b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd50108020 0x7fdd5019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:15.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.937+0000 7fdd5503b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd50108020 0x7fdd5019abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43672/0 (socket says 172.21.15.78:43672) 2024-09-11T00:08:15.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.937+0000 7fdd5503b640 1 -- 172.21.15.78:0/1036122722 learned_addr learned my addr 172.21.15.78:0/1036122722 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:15.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.937+0000 7fdd5483a640 1 --2- 172.21.15.78:0/1036122722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd50101c90 0x7fdd5019a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:15.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.937+0000 7fdd4ffff640 1 --2- 172.21.15.78:0/1036122722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd501076a0 0x7fdd5019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:15.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.937+0000 7fdd5503b640 1 -- 172.21.15.78:0/1036122722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd50101c90 msgr2=0x7fdd5019a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:15.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.937+0000 7fdd5503b640 1 --2- 172.21.15.78:0/1036122722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd50101c90 0x7fdd5019a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:15.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.937+0000 7fdd5503b640 1 -- 172.21.15.78:0/1036122722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd501076a0 msgr2=0x7fdd5019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:15.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.937+0000 7fdd5503b640 1 --2- 172.21.15.78:0/1036122722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd501076a0 0x7fdd5019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:15.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.937+0000 7fdd5503b640 1 -- 172.21.15.78:0/1036122722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd501a5510 con 0x7fdd50108020 2024-09-11T00:08:15.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.937+0000 7fdd4ffff640 1 --2- 172.21.15.78:0/1036122722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd501076a0 0x7fdd5019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:08:15.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.938+0000 7fdd5503b640 1 --2- 172.21.15.78:0/1036122722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd50108020 0x7fdd5019abd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800b970 tx=0x7fdd4800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:15.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.938+0000 7fdd4dffb640 1 -- 172.21.15.78:0/1036122722 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48019070 con 0x7fdd50108020 2024-09-11T00:08:15.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.938+0000 7fdd4dffb640 1 -- 172.21.15.78:0/1036122722 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fdd48014440 con 0x7fdd50108020 2024-09-11T00:08:15.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.938+0000 7fdd56a9e640 1 -- 172.21.15.78:0/1036122722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd501a5800 con 0x7fdd50108020 2024-09-11T00:08:15.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.938+0000 7fdd4dffb640 1 -- 172.21.15.78:0/1036122722 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd480075d0 con 0x7fdd50108020 2024-09-11T00:08:15.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.938+0000 7fdd56a9e640 1 -- 172.21.15.78:0/1036122722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd501a5dc0 con 0x7fdd50108020 2024-09-11T00:08:15.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.939+0000 7fdd56a9e640 1 -- 172.21.15.78:0/1036122722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd501020f0 con 0x7fdd50108020 2024-09-11T00:08:15.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.940+0000 7fdd4dffb640 1 -- 172.21.15.78:0/1036122722 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7fdd48014930 con 0x7fdd50108020 2024-09-11T00:08:15.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.941+0000 7fdd4dffb640 1 --2- 172.21.15.78:0/1036122722 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdd400b5320 0x7fdd400b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:15.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.941+0000 7fdd5483a640 1 --2- 172.21.15.78:0/1036122722 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdd400b5320 0x7fdd400b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:15.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.941+0000 7fdd4dffb640 1 -- 172.21.15.78:0/1036122722 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fdd480e37b0 con 0x7fdd50108020 2024-09-11T00:08:15.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.941+0000 7fdd5483a640 1 --2- 172.21.15.78:0/1036122722 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdd400b5320 0x7fdd400b77e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdd44005ab0 tx=0x7fdd44005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:15.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:14.945+0000 7fdd4dffb640 1 -- 172.21.15.78:0/1036122722 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdd480ac270 con 0x7fdd50108020 2024-09-11T00:08:15.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.132+0000 7fdd56a9e640 1 -- 172.21.15.78:0/1036122722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fdd5002e5c0 con 0x7fdd50108020 2024-09-11T00:08:15.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.138+0000 7fdd4dffb640 1 -- 172.21.15.78:0/1036122722 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v26)=0 v26) ==== 123+0+0 (secure 0 0 0) 0x7fdd480abb70 con 0x7fdd50108020 2024-09-11T00:08:15.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.139+0000 7fdd4dffb640 1 -- 172.21.15.78:0/1036122722 <== mon.0 v2:172.21.15.78:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd480a72d0 con 0x7fdd50108020 2024-09-11T00:08:15.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.140+0000 7ff6cf7fe640 1 -- 172.21.15.78:0/580917804 <== mon.0 v2:172.21.15.78:3300/0 7 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6d8036020 con 0x7ff6e010d130 2024-09-11T00:08:15.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.141+0000 7fdd56a9e640 1 -- 172.21.15.78:0/1036122722 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdd400b5320 msgr2=0x7fdd400b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:15.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.141+0000 7fdd56a9e640 1 --2- 172.21.15.78:0/1036122722 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdd400b5320 0x7fdd400b77e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdd44005ab0 tx=0x7fdd44005a20 comp rx=0 tx=0).stop 2024-09-11T00:08:15.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.141+0000 7fdd56a9e640 1 -- 172.21.15.78:0/1036122722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd50108020 msgr2=0x7fdd5019abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:15.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.141+0000 7fdd56a9e640 1 --2- 172.21.15.78:0/1036122722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd50108020 0x7fdd5019abd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800b970 tx=0x7fdd4800be30 comp rx=0 tx=0).stop 2024-09-11T00:08:15.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.141+0000 7fdd56a9e640 1 -- 172.21.15.78:0/1036122722 shutdown_connections 2024-09-11T00:08:15.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.141+0000 7fdd56a9e640 1 --2- 172.21.15.78:0/1036122722 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdd400b5320 0x7fdd400b77e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:15.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.141+0000 7fdd56a9e640 1 --2- 172.21.15.78:0/1036122722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd50108020 0x7fdd5019abd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:15.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.141+0000 7fdd56a9e640 1 --2- 172.21.15.78:0/1036122722 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd501076a0 0x7fdd5019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:15.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.141+0000 7fdd56a9e640 1 --2- 172.21.15.78:0/1036122722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd50101c90 0x7fdd5019a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:15.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.141+0000 7fdd56a9e640 1 -- 172.21.15.78:0/1036122722 >> 172.21.15.78:0/1036122722 conn(0x7fdd500fd700 msgr2=0x7fdd500ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:15.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.141+0000 7fdd56a9e640 1 -- 172.21.15.78:0/1036122722 shutdown_connections 2024-09-11T00:08:15.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.141+0000 7fdd56a9e640 1 -- 172.21.15.78:0/1036122722 wait complete. 2024-09-11T00:08:15.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.225+0000 7ff6e4873640 1 -- 172.21.15.78:0/580917804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7ff6c40051a0 con 0x7ff6e010d130 2024-09-11T00:08:15.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.231+0000 7ff6cf7fe640 1 -- 172.21.15.78:0/580917804 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v27)=0 v27) ==== 129+0+0 (secure 0 0 0) 0x7ff6d80cd6d0 con 0x7ff6e010d130 2024-09-11T00:08:15.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.234+0000 7ff6e4873640 1 -- 172.21.15.78:0/580917804 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff6c80b52a0 msgr2=0x7ff6c80b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:15.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.234+0000 7ff6e4873640 1 --2- 172.21.15.78:0/580917804 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff6c80b52a0 0x7ff6c80b7760 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000bbe0 tx=0x7ff6d000b390 comp rx=0 tx=0).stop 2024-09-11T00:08:15.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.234+0000 7ff6e4873640 1 -- 172.21.15.78:0/580917804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6e010d130 msgr2=0x7ff6e019ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:15.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.234+0000 7ff6e4873640 1 --2- 172.21.15.78:0/580917804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6e010d130 0x7ff6e019ea90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8031040 tx=0x7ff6d8003970 comp rx=0 tx=0).stop 2024-09-11T00:08:15.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.234+0000 7ff6e4873640 1 -- 172.21.15.78:0/580917804 shutdown_connections 2024-09-11T00:08:15.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.234+0000 7ff6e4873640 1 --2- 172.21.15.78:0/580917804 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff6c80b52a0 0x7ff6c80b7760 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:15.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.234+0000 7ff6e4873640 1 --2- 172.21.15.78:0/580917804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6e010d130 0x7ff6e019ea90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:15.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.234+0000 7ff6e4873640 1 --2- 172.21.15.78:0/580917804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6e01045f0 0x7ff6e01996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:15.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.234+0000 7ff6e4873640 1 --2- 172.21.15.78:0/580917804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6e0103cd0 0x7ff6e01991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:15.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.234+0000 7ff6e4873640 1 -- 172.21.15.78:0/580917804 >> 172.21.15.78:0/580917804 conn(0x7ff6e00fd770 msgr2=0x7ff6e00fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:15.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.234+0000 7ff6e4873640 1 -- 172.21.15.78:0/580917804 shutdown_connections 2024-09-11T00:08:15.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:15.234+0000 7ff6e4873640 1 -- 172.21.15.78:0/580917804 wait complete. 2024-09-11T00:08:16.314 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:16 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1036122722' entity='client.admin' 2024-09-11T00:08:16.314 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:16 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/580917804' entity='client.admin' 2024-09-11T00:08:16.315 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:16 smithi078 ceph-mon[30865]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:16.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:16 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1036122722' entity='client.admin' 2024-09-11T00:08:16.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:16 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/580917804' entity='client.admin' 2024-09-11T00:08:16.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:16 smithi112 ceph-mon[35627]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:16.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:16 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1036122722' entity='client.admin' 2024-09-11T00:08:16.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:16 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/580917804' entity='client.admin' 2024-09-11T00:08:16.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:16 smithi138 ceph-mon[35019]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.362+0000 7f757c7a9640 1 -- 172.21.15.78:0/1842719568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7574109150 msgr2=0x7f757410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.362+0000 7f757c7a9640 1 --2- 172.21.15.78:0/1842719568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7574109150 0x7f757410f950 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f756c009ca0 tx=0x7f756c02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.362+0000 7f757c7a9640 1 -- 172.21.15.78:0/1842719568 shutdown_connections 2024-09-11T00:08:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.362+0000 7f757c7a9640 1 --2- 172.21.15.78:0/1842719568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7574109150 0x7f757410f950 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.362+0000 7f757c7a9640 1 --2- 172.21.15.78:0/1842719568 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75741087d0 0x7f7574108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.362+0000 7f757c7a9640 1 --2- 172.21.15.78:0/1842719568 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7574102dc0 0x7f75741031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.362+0000 7f757c7a9640 1 -- 172.21.15.78:0/1842719568 >> 172.21.15.78:0/1842719568 conn(0x7f75740fe830 msgr2=0x7f7574100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.362+0000 7f757c7a9640 1 -- 172.21.15.78:0/1842719568 shutdown_connections 2024-09-11T00:08:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.362+0000 7f757c7a9640 1 -- 172.21.15.78:0/1842719568 wait complete. 2024-09-11T00:08:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.363+0000 7f757c7a9640 1 Processor -- start 2024-09-11T00:08:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.363+0000 7f757c7a9640 1 -- start start 2024-09-11T00:08:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.363+0000 7f757c7a9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7574102dc0 0x7f75741993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.363+0000 7f757c7a9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75741087d0 0x7f75741998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.363+0000 7f757c7a9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7574109150 0x7f757419ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.363+0000 7f757c7a9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7574112e50 con 0x7f75741087d0 2024-09-11T00:08:17.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.363+0000 7f757c7a9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7574112cd0 con 0x7f7574102dc0 2024-09-11T00:08:17.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.363+0000 7f757c7a9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7574112fd0 con 0x7f7574109150 2024-09-11T00:08:17.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.363+0000 7f7579d44640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75741087d0 0x7f75741998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.364+0000 7f7579d44640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75741087d0 0x7f75741998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43716/0 (socket says 172.21.15.78:43716) 2024-09-11T00:08:17.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.364+0000 7f7579d44640 1 -- 172.21.15.78:0/2083927136 learned_addr learned my addr 172.21.15.78:0/2083927136 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:17.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.364+0000 7f757a545640 1 --2- 172.21.15.78:0/2083927136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7574102dc0 0x7f75741993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.364+0000 7f757ad46640 1 --2- 172.21.15.78:0/2083927136 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7574109150 0x7f757419ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.364+0000 7f7579d44640 1 -- 172.21.15.78:0/2083927136 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7574109150 msgr2=0x7f757419ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:17.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.364+0000 7f7579d44640 1 --2- 172.21.15.78:0/2083927136 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7574109150 0x7f757419ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.364+0000 7f7579d44640 1 -- 172.21.15.78:0/2083927136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7574102dc0 msgr2=0x7f75741993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:17.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.364+0000 7f7579d44640 1 --2- 172.21.15.78:0/2083927136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7574102dc0 0x7f75741993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.364+0000 7f7579d44640 1 -- 172.21.15.78:0/2083927136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757419f450 con 0x7f75741087d0 2024-09-11T00:08:17.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.364+0000 7f7579d44640 1 --2- 172.21.15.78:0/2083927136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75741087d0 0x7f75741998e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f756400b4a0 tx=0x7f756400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:17.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.364+0000 7f756b7fe640 1 -- 172.21.15.78:0/2083927136 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7564015020 con 0x7f75741087d0 2024-09-11T00:08:17.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.364+0000 7f757c7a9640 1 -- 172.21.15.78:0/2083927136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f757419f740 con 0x7f75741087d0 2024-09-11T00:08:17.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.364+0000 7f756b7fe640 1 -- 172.21.15.78:0/2083927136 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7564011ce0 con 0x7f75741087d0 2024-09-11T00:08:17.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.364+0000 7f756b7fe640 1 -- 172.21.15.78:0/2083927136 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7564010dc0 con 0x7f75741087d0 2024-09-11T00:08:17.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.364+0000 7f757c7a9640 1 -- 172.21.15.78:0/2083927136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75740755d0 con 0x7f75741087d0 2024-09-11T00:08:17.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.365+0000 7f757c7a9640 1 -- 172.21.15.78:0/2083927136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7574104070 con 0x7f75741087d0 2024-09-11T00:08:17.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.367+0000 7f756b7fe640 1 -- 172.21.15.78:0/2083927136 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f7564011830 con 0x7f75741087d0 2024-09-11T00:08:17.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.367+0000 7f756b7fe640 1 --2- 172.21.15.78:0/2083927136 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f75600b52a0 0x7f75600b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.368+0000 7f757a545640 1 --2- 172.21.15.78:0/2083927136 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f75600b52a0 0x7f75600b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.368+0000 7f756b7fe640 1 -- 172.21.15.78:0/2083927136 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f75640e4030 con 0x7f75741087d0 2024-09-11T00:08:17.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.368+0000 7f757a545640 1 --2- 172.21.15.78:0/2083927136 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f75600b52a0 0x7f75600b7760 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7570009990 tx=0x7f7570009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:17.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.370+0000 7f756b7fe640 1 -- 172.21.15.78:0/2083927136 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f756401f020 con 0x7f75741087d0 2024-09-11T00:08:17.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.552+0000 7f757c7a9640 1 -- 172.21.15.78:0/2083927136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f7574103220 con 0x7f75741087d0 2024-09-11T00:08:17.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.555+0000 7f756b7fe640 1 -- 172.21.15.78:0/2083927136 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v28)=0 v28) ==== 121+0+0 (secure 0 0 0) 0x7f7574103220 con 0x7f75741087d0 2024-09-11T00:08:17.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.558+0000 7f757c7a9640 1 -- 172.21.15.78:0/2083927136 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f75600b52a0 msgr2=0x7f75600b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:17.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.558+0000 7f757c7a9640 1 --2- 172.21.15.78:0/2083927136 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f75600b52a0 0x7f75600b7760 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7570009990 tx=0x7f7570009110 comp rx=0 tx=0).stop 2024-09-11T00:08:17.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.558+0000 7f757c7a9640 1 -- 172.21.15.78:0/2083927136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75741087d0 msgr2=0x7f75741998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:17.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.558+0000 7f757c7a9640 1 --2- 172.21.15.78:0/2083927136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75741087d0 0x7f75741998e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f756400b4a0 tx=0x7f756400b8a0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.558+0000 7f757c7a9640 1 -- 172.21.15.78:0/2083927136 shutdown_connections 2024-09-11T00:08:17.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.558+0000 7f757c7a9640 1 --2- 172.21.15.78:0/2083927136 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f75600b52a0 0x7f75600b7760 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.558+0000 7f757c7a9640 1 --2- 172.21.15.78:0/2083927136 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7574109150 0x7f757419ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.558+0000 7f757c7a9640 1 --2- 172.21.15.78:0/2083927136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75741087d0 0x7f75741998e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.558+0000 7f757c7a9640 1 --2- 172.21.15.78:0/2083927136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7574102dc0 0x7f75741993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.558+0000 7f757c7a9640 1 -- 172.21.15.78:0/2083927136 >> 172.21.15.78:0/2083927136 conn(0x7f75740fe830 msgr2=0x7f7574100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:17.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.558+0000 7f757c7a9640 1 -- 172.21.15.78:0/2083927136 shutdown_connections 2024-09-11T00:08:17.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.558+0000 7f757c7a9640 1 -- 172.21.15.78:0/2083927136 wait complete. 2024-09-11T00:08:17.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.582+0000 7f80e926b640 1 -- 172.21.15.78:0/485655591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80e41045f0 msgr2=0x7f80e410cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:17.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.582+0000 7f80e926b640 1 --2- 172.21.15.78:0/485655591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80e41045f0 0x7f80e410cae0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009900 tx=0x7f80d802a410 comp rx=0 tx=0).stop 2024-09-11T00:08:17.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.582+0000 7f80e926b640 1 -- 172.21.15.78:0/485655591 shutdown_connections 2024-09-11T00:08:17.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.582+0000 7f80e926b640 1 --2- 172.21.15.78:0/485655591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80e410d130 0x7f80e410f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.582+0000 7f80e926b640 1 --2- 172.21.15.78:0/485655591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80e41045f0 0x7f80e410cae0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.582+0000 7f80e926b640 1 --2- 172.21.15.78:0/485655591 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80e4103cd0 0x7f80e41040b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.582+0000 7f80e926b640 1 -- 172.21.15.78:0/485655591 >> 172.21.15.78:0/485655591 conn(0x7f80e40fd770 msgr2=0x7f80e40ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:17.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.582+0000 7f80e926b640 1 -- 172.21.15.78:0/485655591 shutdown_connections 2024-09-11T00:08:17.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.582+0000 7f80e926b640 1 -- 172.21.15.78:0/485655591 wait complete. 2024-09-11T00:08:17.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.583+0000 7f80e926b640 1 Processor -- start 2024-09-11T00:08:17.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.583+0000 7f80e926b640 1 -- start start 2024-09-11T00:08:17.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.583+0000 7f80e926b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80e4103cd0 0x7f80e419b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.583+0000 7f80e926b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80e41045f0 0x7f80e419ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.583+0000 7f80e926b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80e410d130 0x7f80e41a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.584+0000 7f80e926b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f80e4112df0 con 0x7f80e41045f0 2024-09-11T00:08:17.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.584+0000 7f80e926b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f80e4112c70 con 0x7f80e4103cd0 2024-09-11T00:08:17.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.584+0000 7f80e926b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f80e4112f70 con 0x7f80e410d130 2024-09-11T00:08:17.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.584+0000 7f80e27fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80e41045f0 0x7f80e419ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.584+0000 7f80e27fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80e41045f0 0x7f80e419ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43742/0 (socket says 172.21.15.78:43742) 2024-09-11T00:08:17.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.584+0000 7f80e27fc640 1 -- 172.21.15.78:0/1578185245 learned_addr learned my addr 172.21.15.78:0/1578185245 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:17.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.584+0000 7f80e2ffd640 1 --2- 172.21.15.78:0/1578185245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80e4103cd0 0x7f80e419b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.584+0000 7f80e37fe640 1 --2- 172.21.15.78:0/1578185245 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80e410d130 0x7f80e41a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.584+0000 7f80e27fc640 1 -- 172.21.15.78:0/1578185245 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80e410d130 msgr2=0x7f80e41a0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:17.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.584+0000 7f80e27fc640 1 --2- 172.21.15.78:0/1578185245 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80e410d130 0x7f80e41a0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.584+0000 7f80e27fc640 1 -- 172.21.15.78:0/1578185245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80e4103cd0 msgr2=0x7f80e419b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:17.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.584+0000 7f80e27fc640 1 --2- 172.21.15.78:0/1578185245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80e4103cd0 0x7f80e419b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.584+0000 7f80e27fc640 1 -- 172.21.15.78:0/1578185245 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e41a15e0 con 0x7f80e41045f0 2024-09-11T00:08:17.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.584+0000 7f80e2ffd640 1 --2- 172.21.15.78:0/1578185245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80e4103cd0 0x7f80e419b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:08:17.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.584+0000 7f80e37fe640 1 --2- 172.21.15.78:0/1578185245 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80e410d130 0x7f80e41a0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:08:17.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.584+0000 7f80e27fc640 1 --2- 172.21.15.78:0/1578185245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80e41045f0 0x7f80e419ba70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f80d8005ab0 tx=0x7f80d8003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:17.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.584+0000 7f80cbfff640 1 -- 172.21.15.78:0/1578185245 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d803f070 con 0x7f80e41045f0 2024-09-11T00:08:17.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.584+0000 7f80e926b640 1 -- 172.21.15.78:0/1578185245 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e41a1870 con 0x7f80e41045f0 2024-09-11T00:08:17.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.584+0000 7f80cbfff640 1 -- 172.21.15.78:0/1578185245 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80d8031b50 con 0x7f80e41045f0 2024-09-11T00:08:17.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.584+0000 7f80cbfff640 1 -- 172.21.15.78:0/1578185245 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8035030 con 0x7f80e41045f0 2024-09-11T00:08:17.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.585+0000 7f80e926b640 1 -- 172.21.15.78:0/1578185245 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e41a7f90 con 0x7f80e41045f0 2024-09-11T00:08:17.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.586+0000 7f80e926b640 1 -- 172.21.15.78:0/1578185245 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80e41040b0 con 0x7f80e41045f0 2024-09-11T00:08:17.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.587+0000 7f80cbfff640 1 -- 172.21.15.78:0/1578185245 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f80d803bb90 con 0x7f80e41045f0 2024-09-11T00:08:17.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.588+0000 7f80cbfff640 1 --2- 172.21.15.78:0/1578185245 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f80cc0b52a0 0x7f80cc0b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:17.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.588+0000 7f80e2ffd640 1 --2- 172.21.15.78:0/1578185245 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f80cc0b52a0 0x7f80cc0b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:17.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.589+0000 7f80cbfff640 1 -- 172.21.15.78:0/1578185245 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f80d8104d40 con 0x7f80e41045f0 2024-09-11T00:08:17.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.589+0000 7f80e2ffd640 1 --2- 172.21.15.78:0/1578185245 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f80cc0b52a0 0x7f80cc0b7760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009fc0 tx=0x7f80d4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:17.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.591+0000 7f80cbfff640 1 -- 172.21.15.78:0/1578185245 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f80d80cd800 con 0x7f80e41045f0 2024-09-11T00:08:17.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.770+0000 7f80e926b640 1 -- 172.21.15.78:0/1578185245 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f80e41a81c0 con 0x7f80e41045f0 2024-09-11T00:08:17.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.773+0000 7f80cbfff640 1 -- 172.21.15.78:0/1578185245 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v29)=0 v29) ==== 118+0+0 (secure 0 0 0) 0x7f80d80cd100 con 0x7f80e41045f0 2024-09-11T00:08:17.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.776+0000 7f80e926b640 1 -- 172.21.15.78:0/1578185245 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f80cc0b52a0 msgr2=0x7f80cc0b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:17.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.776+0000 7f80e926b640 1 --2- 172.21.15.78:0/1578185245 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f80cc0b52a0 0x7f80cc0b7760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009fc0 tx=0x7f80d4005f90 comp rx=0 tx=0).stop 2024-09-11T00:08:17.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.776+0000 7f80e926b640 1 -- 172.21.15.78:0/1578185245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80e41045f0 msgr2=0x7f80e419ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:17.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.776+0000 7f80e926b640 1 --2- 172.21.15.78:0/1578185245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80e41045f0 0x7f80e419ba70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f80d8005ab0 tx=0x7f80d8003b90 comp rx=0 tx=0).stop 2024-09-11T00:08:17.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.776+0000 7f80e926b640 1 -- 172.21.15.78:0/1578185245 shutdown_connections 2024-09-11T00:08:17.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.776+0000 7f80e926b640 1 --2- 172.21.15.78:0/1578185245 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f80cc0b52a0 0x7f80cc0b7760 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.776+0000 7f80e926b640 1 --2- 172.21.15.78:0/1578185245 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80e410d130 0x7f80e41a0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.776+0000 7f80e926b640 1 --2- 172.21.15.78:0/1578185245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80e41045f0 0x7f80e419ba70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.776+0000 7f80e926b640 1 --2- 172.21.15.78:0/1578185245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f80e4103cd0 0x7f80e419b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:17.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.776+0000 7f80e926b640 1 -- 172.21.15.78:0/1578185245 >> 172.21.15.78:0/1578185245 conn(0x7f80e40fd770 msgr2=0x7f80e40ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:17.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.777+0000 7f80e926b640 1 -- 172.21.15.78:0/1578185245 shutdown_connections 2024-09-11T00:08:17.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:17.777+0000 7f80e926b640 1 -- 172.21.15.78:0/1578185245 wait complete. 2024-09-11T00:08:18.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:17 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:18.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:17 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:18.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:17 smithi138 ceph-mon[35019]: Reconfiguring mon.b (monmap changed)... 2024-09-11T00:08:18.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:17 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:08:18.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:17 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:08:18.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:17 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:18.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:17 smithi138 ceph-mon[35019]: Reconfiguring daemon mon.b on smithi112 2024-09-11T00:08:18.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:17 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2083927136' entity='client.admin' 2024-09-11T00:08:18.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:17 smithi138 ceph-mon[35019]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:18.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:17 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1578185245' entity='client.admin' 2024-09-11T00:08:18.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:17 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:18.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:17 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:18.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:17 smithi078 ceph-mon[30865]: Reconfiguring mon.b (monmap changed)... 2024-09-11T00:08:18.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:17 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:08:18.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:17 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:08:18.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:17 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:18.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:17 smithi078 ceph-mon[30865]: Reconfiguring daemon mon.b on smithi112 2024-09-11T00:08:18.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:17 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2083927136' entity='client.admin' 2024-09-11T00:08:18.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:17 smithi078 ceph-mon[30865]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:18.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:17 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1578185245' entity='client.admin' 2024-09-11T00:08:18.225 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:17 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:18.225 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:17 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:18.225 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:17 smithi112 ceph-mon[35627]: Reconfiguring mon.b (monmap changed)... 2024-09-11T00:08:18.225 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:17 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:08:18.225 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:17 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:08:18.225 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:17 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:18.226 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:17 smithi112 ceph-mon[35627]: Reconfiguring daemon mon.b on smithi112 2024-09-11T00:08:18.226 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:17 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2083927136' entity='client.admin' 2024-09-11T00:08:18.226 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:17 smithi112 ceph-mon[35627]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:18.226 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:17 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1578185245' entity='client.admin' 2024-09-11T00:08:18.736 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:18.737 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:18.737 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:18.738 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:19.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:19 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:19.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:19 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:19.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:19 smithi112 ceph-mon[35627]: Reconfiguring mon.c (monmap changed)... 2024-09-11T00:08:19.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:19 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:08:19.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:19 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:08:19.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:19 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:19.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:19 smithi112 ceph-mon[35627]: Reconfiguring daemon mon.c on smithi138 2024-09-11T00:08:19.354 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:19 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:19.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:19 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:19.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:19 smithi078 ceph-mon[30865]: Reconfiguring mon.c (monmap changed)... 2024-09-11T00:08:19.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:19 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:08:19.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:19 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:08:19.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:19 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:19.355 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:19 smithi078 ceph-mon[30865]: Reconfiguring daemon mon.c on smithi138 2024-09-11T00:08:19.447 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:19 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:19.447 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:19 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:19.447 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:19 smithi138 ceph-mon[35019]: Reconfiguring mon.c (monmap changed)... 2024-09-11T00:08:19.447 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:19 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:08:19.447 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:19 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:08:19.447 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:19 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:19.447 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:19 smithi138 ceph-mon[35019]: Reconfiguring daemon mon.c on smithi138 2024-09-11T00:08:20.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.035+0000 7fe6502eb640 1 -- 172.21.15.78:0/3528341897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6481045c0 msgr2=0x7fe64810cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:20.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.035+0000 7fe6502eb640 1 --2- 172.21.15.78:0/3528341897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6481045c0 0x7fe64810cab0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe638009900 tx=0x7fe63802a410 comp rx=0 tx=0).stop 2024-09-11T00:08:20.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.035+0000 7fe6502eb640 1 -- 172.21.15.78:0/3528341897 shutdown_connections 2024-09-11T00:08:20.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.035+0000 7fe6502eb640 1 --2- 172.21.15.78:0/3528341897 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe64810d100 0x7fe64810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:20.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.035+0000 7fe6502eb640 1 --2- 172.21.15.78:0/3528341897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6481045c0 0x7fe64810cab0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:20.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.035+0000 7fe6502eb640 1 --2- 172.21.15.78:0/3528341897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe648103ca0 0x7fe648104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:20.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.035+0000 7fe6502eb640 1 -- 172.21.15.78:0/3528341897 >> 172.21.15.78:0/3528341897 conn(0x7fe6480fd700 msgr2=0x7fe6480ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:20.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.035+0000 7fe6502eb640 1 -- 172.21.15.78:0/3528341897 shutdown_connections 2024-09-11T00:08:20.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.035+0000 7fe6502eb640 1 -- 172.21.15.78:0/3528341897 wait complete. 2024-09-11T00:08:20.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.036+0000 7fe6502eb640 1 Processor -- start 2024-09-11T00:08:20.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.036+0000 7fe6502eb640 1 -- start start 2024-09-11T00:08:20.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.036+0000 7fe6502eb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe648103ca0 0x7fe648199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:20.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.036+0000 7fe6502eb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6481045c0 0x7fe6481997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:20.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.036+0000 7fe6502eb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe64810d100 0x7fe64819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:20.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.037+0000 7fe6502eb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe648112d70 con 0x7fe648103ca0 2024-09-11T00:08:20.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.037+0000 7fe6502eb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe648112bf0 con 0x7fe6481045c0 2024-09-11T00:08:20.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.037+0000 7fe6502eb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe648112ef0 con 0x7fe64810d100 2024-09-11T00:08:20.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.037+0000 7fe64e087640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe648103ca0 0x7fe648199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:20.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.037+0000 7fe64e087640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe648103ca0 0x7fe648199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43764/0 (socket says 172.21.15.78:43764) 2024-09-11T00:08:20.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.037+0000 7fe64e087640 1 -- 172.21.15.78:0/2879488936 learned_addr learned my addr 172.21.15.78:0/2879488936 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:20.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.037+0000 7fe64e888640 1 --2- 172.21.15.78:0/2879488936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe64810d100 0x7fe64819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:20.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.037+0000 7fe64d886640 1 --2- 172.21.15.78:0/2879488936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6481045c0 0x7fe6481997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:20.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.037+0000 7fe64e087640 1 -- 172.21.15.78:0/2879488936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe64810d100 msgr2=0x7fe64819eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:20.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.037+0000 7fe64e087640 1 --2- 172.21.15.78:0/2879488936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe64810d100 0x7fe64819eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:20.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.037+0000 7fe64e087640 1 -- 172.21.15.78:0/2879488936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6481045c0 msgr2=0x7fe6481997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:20.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.037+0000 7fe64e087640 1 --2- 172.21.15.78:0/2879488936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6481045c0 0x7fe6481997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:20.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.037+0000 7fe64e087640 1 -- 172.21.15.78:0/2879488936 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64819f330 con 0x7fe648103ca0 2024-09-11T00:08:20.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.037+0000 7fe64e087640 1 --2- 172.21.15.78:0/2879488936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe648103ca0 0x7fe648199280 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe64400c890 tx=0x7fe64400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:20.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.037+0000 7fe63f7fe640 1 -- 172.21.15.78:0/2879488936 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe644004220 con 0x7fe648103ca0 2024-09-11T00:08:20.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.037+0000 7fe6502eb640 1 -- 172.21.15.78:0/2879488936 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe64819f620 con 0x7fe648103ca0 2024-09-11T00:08:20.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.037+0000 7fe63f7fe640 1 -- 172.21.15.78:0/2879488936 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6440043c0 con 0x7fe648103ca0 2024-09-11T00:08:20.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.037+0000 7fe63f7fe640 1 -- 172.21.15.78:0/2879488936 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe644004a00 con 0x7fe648103ca0 2024-09-11T00:08:20.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.037+0000 7fe6502eb640 1 -- 172.21.15.78:0/2879488936 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6481a5ce0 con 0x7fe648103ca0 2024-09-11T00:08:20.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.038+0000 7fe6502eb640 1 -- 172.21.15.78:0/2879488936 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe648104080 con 0x7fe648103ca0 2024-09-11T00:08:20.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.041+0000 7fe63f7fe640 1 -- 172.21.15.78:0/2879488936 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7fe6440079b0 con 0x7fe648103ca0 2024-09-11T00:08:20.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.041+0000 7fe63f7fe640 1 --2- 172.21.15.78:0/2879488936 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe6340b52a0 0x7fe6340b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:20.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.041+0000 7fe64d886640 1 --2- 172.21.15.78:0/2879488936 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe6340b52a0 0x7fe6340b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:20.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.041+0000 7fe63f7fe640 1 -- 172.21.15.78:0/2879488936 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe6440e4130 con 0x7fe648103ca0 2024-09-11T00:08:20.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.042+0000 7fe64d886640 1 --2- 172.21.15.78:0/2879488936 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe6340b52a0 0x7fe6340b7760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe638000c00 tx=0x7fe638031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:20.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.043+0000 7fe63f7fe640 1 -- 172.21.15.78:0/2879488936 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe644014030 con 0x7fe648103ca0 2024-09-11T00:08:20.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.226+0000 7f4e20cca640 1 -- 172.21.15.78:0/2783539437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e1c103cc0 msgr2=0x7f4e1c1040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:20.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.226+0000 7f4e20cca640 1 --2- 172.21.15.78:0/2783539437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e1c103cc0 0x7f4e1c1040a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c009900 tx=0x7f4e0c02a410 comp rx=0 tx=0).stop 2024-09-11T00:08:20.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.226+0000 7f4e20cca640 1 -- 172.21.15.78:0/2783539437 shutdown_connections 2024-09-11T00:08:20.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.226+0000 7f4e20cca640 1 --2- 172.21.15.78:0/2783539437 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e1c10d120 0x7f4e1c10f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:20.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.226+0000 7f4e20cca640 1 --2- 172.21.15.78:0/2783539437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e1c1045e0 0x7f4e1c10cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:20.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.226+0000 7f4e20cca640 1 --2- 172.21.15.78:0/2783539437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e1c103cc0 0x7f4e1c1040a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:20.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.226+0000 7f4e20cca640 1 -- 172.21.15.78:0/2783539437 >> 172.21.15.78:0/2783539437 conn(0x7f4e1c0fd700 msgr2=0x7f4e1c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:20.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.226+0000 7f4e20cca640 1 -- 172.21.15.78:0/2783539437 shutdown_connections 2024-09-11T00:08:20.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.226+0000 7f4e20cca640 1 -- 172.21.15.78:0/2783539437 wait complete. 2024-09-11T00:08:20.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.227+0000 7f4e20cca640 1 Processor -- start 2024-09-11T00:08:20.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.227+0000 7f4e20cca640 1 -- start start 2024-09-11T00:08:20.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.227+0000 7f4e20cca640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e1c103cc0 0x7f4e1c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:20.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.227+0000 7f4e20cca640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e1c1045e0 0x7f4e1c199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:20.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.227+0000 7f4e20cca640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e1c10d120 0x7f4e1c19ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:20.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.227+0000 7f4e20cca640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1c112de0 con 0x7f4e1c1045e0 2024-09-11T00:08:20.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.227+0000 7f4e20cca640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1c112c60 con 0x7f4e1c103cc0 2024-09-11T00:08:20.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.227+0000 7f4e20cca640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1c112f60 con 0x7f4e1c10d120 2024-09-11T00:08:20.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.227+0000 7f4e19d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e1c1045e0 0x7f4e1c199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:20.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.228+0000 7f4e19d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e1c1045e0 0x7f4e1c199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43782/0 (socket says 172.21.15.78:43782) 2024-09-11T00:08:20.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.228+0000 7f4e19d9b640 1 -- 172.21.15.78:0/4016117470 learned_addr learned my addr 172.21.15.78:0/4016117470 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:20.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.228+0000 7f4e1a59c640 1 --2- 172.21.15.78:0/4016117470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e1c103cc0 0x7f4e1c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:20.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.228+0000 7f4e1ad9d640 1 --2- 172.21.15.78:0/4016117470 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e1c10d120 0x7f4e1c19ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:20.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.228+0000 7f4e19d9b640 1 -- 172.21.15.78:0/4016117470 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e1c10d120 msgr2=0x7f4e1c19ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:20.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.228+0000 7f4e19d9b640 1 --2- 172.21.15.78:0/4016117470 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e1c10d120 0x7f4e1c19ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:20.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.228+0000 7f4e19d9b640 1 -- 172.21.15.78:0/4016117470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e1c103cc0 msgr2=0x7f4e1c199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:20.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.228+0000 7f4e19d9b640 1 --2- 172.21.15.78:0/4016117470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e1c103cc0 0x7f4e1c199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:20.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.228+0000 7f4e19d9b640 1 -- 172.21.15.78:0/4016117470 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e1c19f400 con 0x7f4e1c1045e0 2024-09-11T00:08:20.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.228+0000 7f4e19d9b640 1 --2- 172.21.15.78:0/4016117470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e1c1045e0 0x7f4e1c199890 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000d750 tx=0x7f4e1000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:20.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.228+0000 7f4e0b7fe640 1 -- 172.21.15.78:0/4016117470 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e10017070 con 0x7f4e1c1045e0 2024-09-11T00:08:20.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.228+0000 7f4e20cca640 1 -- 172.21.15.78:0/4016117470 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e1c19f6f0 con 0x7f4e1c1045e0 2024-09-11T00:08:20.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.228+0000 7f4e0b7fe640 1 -- 172.21.15.78:0/4016117470 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e10004020 con 0x7f4e1c1045e0 2024-09-11T00:08:20.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.228+0000 7f4e0b7fe640 1 -- 172.21.15.78:0/4016117470 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e10003c00 con 0x7f4e1c1045e0 2024-09-11T00:08:20.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.228+0000 7f4e20cca640 1 -- 172.21.15.78:0/4016117470 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e1c1a5db0 con 0x7f4e1c1045e0 2024-09-11T00:08:20.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.230+0000 7f4e20cca640 1 -- 172.21.15.78:0/4016117470 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e1c1040a0 con 0x7f4e1c1045e0 2024-09-11T00:08:20.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.231+0000 7f4e0b7fe640 1 -- 172.21.15.78:0/4016117470 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f4e10023060 con 0x7f4e1c1045e0 2024-09-11T00:08:20.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.231+0000 7fe6502eb640 1 -- 172.21.15.78:0/2879488936 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fe64819a3b0 con 0x7fe648103ca0 2024-09-11T00:08:20.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.232+0000 7f4e0b7fe640 1 --2- 172.21.15.78:0/4016117470 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4e040b52a0 0x7f4e040b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:20.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.232+0000 7f4e1a59c640 1 --2- 172.21.15.78:0/4016117470 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4e040b52a0 0x7f4e040b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:20.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.232+0000 7f4e0b7fe640 1 -- 172.21.15.78:0/4016117470 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4e100e31e0 con 0x7f4e1c1045e0 2024-09-11T00:08:20.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.232+0000 7f4e1a59c640 1 --2- 172.21.15.78:0/4016117470 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4e040b52a0 0x7f4e040b7760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c005ab0 tx=0x7f4e0c005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:20.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.236+0000 7f4e0b7fe640 1 -- 172.21.15.78:0/4016117470 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4e100ab650 con 0x7f4e1c1045e0 2024-09-11T00:08:20.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.239+0000 7fe63f7fe640 1 -- 172.21.15.78:0/2879488936 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v30)=0 v30) ==== 121+0+0 (secure 0 0 0) 0x7fe64819a3b0 con 0x7fe648103ca0 2024-09-11T00:08:20.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.242+0000 7fe6502eb640 1 -- 172.21.15.78:0/2879488936 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe6340b52a0 msgr2=0x7fe6340b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:20.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.242+0000 7fe6502eb640 1 --2- 172.21.15.78:0/2879488936 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe6340b52a0 0x7fe6340b7760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe638000c00 tx=0x7fe638031400 comp rx=0 tx=0).stop 2024-09-11T00:08:20.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.242+0000 7fe6502eb640 1 -- 172.21.15.78:0/2879488936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe648103ca0 msgr2=0x7fe648199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:20.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.242+0000 7fe6502eb640 1 --2- 172.21.15.78:0/2879488936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe648103ca0 0x7fe648199280 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe64400c890 tx=0x7fe64400cd50 comp rx=0 tx=0).stop 2024-09-11T00:08:20.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.242+0000 7fe6502eb640 1 -- 172.21.15.78:0/2879488936 shutdown_connections 2024-09-11T00:08:20.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.242+0000 7fe6502eb640 1 --2- 172.21.15.78:0/2879488936 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe6340b52a0 0x7fe6340b7760 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:20.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.242+0000 7fe6502eb640 1 --2- 172.21.15.78:0/2879488936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe64810d100 0x7fe64819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:20.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.242+0000 7fe6502eb640 1 --2- 172.21.15.78:0/2879488936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe6481045c0 0x7fe6481997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:20.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.242+0000 7fe6502eb640 1 --2- 172.21.15.78:0/2879488936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe648103ca0 0x7fe648199280 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:20.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.242+0000 7fe6502eb640 1 -- 172.21.15.78:0/2879488936 >> 172.21.15.78:0/2879488936 conn(0x7fe6480fd700 msgr2=0x7fe6480fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:20.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.242+0000 7fe6502eb640 1 -- 172.21.15.78:0/2879488936 shutdown_connections 2024-09-11T00:08:20.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.242+0000 7fe6502eb640 1 -- 172.21.15.78:0/2879488936 wait complete. 2024-09-11T00:08:20.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.449+0000 7f4e20cca640 1 -- 172.21.15.78:0/4016117470 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f4e1c101880 con 0x7f4e1c1045e0 2024-09-11T00:08:20.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.452+0000 7f4e0b7fe640 1 -- 172.21.15.78:0/4016117470 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v31)=0 v31) ==== 116+0+0 (secure 0 0 0) 0x7f4e100b0080 con 0x7f4e1c1045e0 2024-09-11T00:08:20.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.455+0000 7f4e20cca640 1 -- 172.21.15.78:0/4016117470 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4e040b52a0 msgr2=0x7f4e040b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:20.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.455+0000 7f4e20cca640 1 --2- 172.21.15.78:0/4016117470 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4e040b52a0 0x7f4e040b7760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c005ab0 tx=0x7f4e0c005a20 comp rx=0 tx=0).stop 2024-09-11T00:08:20.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.455+0000 7f4e20cca640 1 -- 172.21.15.78:0/4016117470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e1c1045e0 msgr2=0x7f4e1c199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:20.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.455+0000 7f4e20cca640 1 --2- 172.21.15.78:0/4016117470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e1c1045e0 0x7f4e1c199890 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000d750 tx=0x7f4e1000dc10 comp rx=0 tx=0).stop 2024-09-11T00:08:20.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.455+0000 7f4e20cca640 1 -- 172.21.15.78:0/4016117470 shutdown_connections 2024-09-11T00:08:20.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.455+0000 7f4e20cca640 1 --2- 172.21.15.78:0/4016117470 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4e040b52a0 0x7f4e040b7760 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:20.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.455+0000 7f4e20cca640 1 --2- 172.21.15.78:0/4016117470 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4e1c10d120 0x7f4e1c19ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:20.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.455+0000 7f4e20cca640 1 --2- 172.21.15.78:0/4016117470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e1c1045e0 0x7f4e1c199890 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:20.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.455+0000 7f4e20cca640 1 --2- 172.21.15.78:0/4016117470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4e1c103cc0 0x7f4e1c199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:20.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.455+0000 7f4e20cca640 1 -- 172.21.15.78:0/4016117470 >> 172.21.15.78:0/4016117470 conn(0x7f4e1c0fd700 msgr2=0x7f4e1c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:20.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.455+0000 7f4e20cca640 1 -- 172.21.15.78:0/4016117470 shutdown_connections 2024-09-11T00:08:20.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:20.455+0000 7f4e20cca640 1 -- 172.21.15.78:0/4016117470 wait complete. 2024-09-11T00:08:20.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:20 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:20.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:20 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:20.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:20 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:08:20.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:20 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:20.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:20 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:20.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:20 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:20.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:20 smithi138 ceph-mon[35019]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:20.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:20 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2879488936' entity='client.admin' 2024-09-11T00:08:20.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:20 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/4016117470' entity='client.admin' 2024-09-11T00:08:20.813 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:20 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:20.813 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:20 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:20.813 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:20 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:08:20.813 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:20 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:20.813 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:20 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:20.813 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:20 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:20.813 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:20 smithi078 ceph-mon[30865]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:20.813 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:20 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2879488936' entity='client.admin' 2024-09-11T00:08:20.813 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:20 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/4016117470' entity='client.admin' 2024-09-11T00:08:20.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:20 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:20.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:20 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:20.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:20 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:08:20.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:20 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:20.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:20 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:20.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:20 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:20.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:20 smithi112 ceph-mon[35627]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:20.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:20 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2879488936' entity='client.admin' 2024-09-11T00:08:20.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:20 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/4016117470' entity='client.admin' 2024-09-11T00:08:21.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.097+0000 7feb90fdf640 1 -- 172.21.15.78:0/3896696148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb8c108020 msgr2=0x7feb8c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:21.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.097+0000 7feb90fdf640 1 --2- 172.21.15.78:0/3896696148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb8c108020 0x7feb8c10e820 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7feb84009ca0 tx=0x7feb8402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:08:21.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.097+0000 7feb90fdf640 1 -- 172.21.15.78:0/3896696148 shutdown_connections 2024-09-11T00:08:21.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.097+0000 7feb90fdf640 1 --2- 172.21.15.78:0/3896696148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb8c108020 0x7feb8c10e820 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:21.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.097+0000 7feb90fdf640 1 --2- 172.21.15.78:0/3896696148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb8c1076a0 0x7feb8c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:21.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.097+0000 7feb90fdf640 1 --2- 172.21.15.78:0/3896696148 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb8c101c90 0x7feb8c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:21.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.097+0000 7feb90fdf640 1 -- 172.21.15.78:0/3896696148 >> 172.21.15.78:0/3896696148 conn(0x7feb8c0fd700 msgr2=0x7feb8c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:21.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.097+0000 7feb90fdf640 1 -- 172.21.15.78:0/3896696148 shutdown_connections 2024-09-11T00:08:21.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.097+0000 7feb90fdf640 1 -- 172.21.15.78:0/3896696148 wait complete. 2024-09-11T00:08:21.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.098+0000 7feb90fdf640 1 Processor -- start 2024-09-11T00:08:21.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.098+0000 7feb90fdf640 1 -- start start 2024-09-11T00:08:21.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.098+0000 7feb90fdf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb8c101c90 0x7feb8c10f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:21.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.098+0000 7feb90fdf640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb8c1076a0 0x7feb8c10f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:21.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.098+0000 7feb90fdf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb8c108020 0x7feb8c10fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:21.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.098+0000 7feb90fdf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c112dc0 con 0x7feb8c101c90 2024-09-11T00:08:21.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.098+0000 7feb90fdf640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c112c40 con 0x7feb8c108020 2024-09-11T00:08:21.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.098+0000 7feb90fdf640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c112f40 con 0x7feb8c1076a0 2024-09-11T00:08:21.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.098+0000 7feb8a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb8c101c90 0x7feb8c10f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:21.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.098+0000 7feb8a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb8c101c90 0x7feb8c10f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43798/0 (socket says 172.21.15.78:43798) 2024-09-11T00:08:21.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.098+0000 7feb8a59c640 1 -- 172.21.15.78:0/726753597 learned_addr learned my addr 172.21.15.78:0/726753597 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:21.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.098+0000 7feb83fff640 1 --2- 172.21.15.78:0/726753597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb8c1076a0 0x7feb8c10f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:21.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.098+0000 7feb8ad9d640 1 --2- 172.21.15.78:0/726753597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb8c108020 0x7feb8c10fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:21.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.098+0000 7feb8a59c640 1 -- 172.21.15.78:0/726753597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb8c1076a0 msgr2=0x7feb8c10f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:21.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.098+0000 7feb8a59c640 1 --2- 172.21.15.78:0/726753597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb8c1076a0 0x7feb8c10f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:21.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.098+0000 7feb8a59c640 1 -- 172.21.15.78:0/726753597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb8c108020 msgr2=0x7feb8c10fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:21.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.098+0000 7feb8a59c640 1 --2- 172.21.15.78:0/726753597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb8c108020 0x7feb8c10fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:21.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.098+0000 7feb8a59c640 1 -- 172.21.15.78:0/726753597 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8c1a7690 con 0x7feb8c101c90 2024-09-11T00:08:21.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.099+0000 7feb8a59c640 1 --2- 172.21.15.78:0/726753597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb8c101c90 0x7feb8c10f330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00d950 tx=0x7feb7c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:21.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.099+0000 7feb837fe640 1 -- 172.21.15.78:0/726753597 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c017030 con 0x7feb8c101c90 2024-09-11T00:08:21.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.099+0000 7feb837fe640 1 -- 172.21.15.78:0/726753597 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb7c004020 con 0x7feb8c101c90 2024-09-11T00:08:21.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.099+0000 7feb90fdf640 1 -- 172.21.15.78:0/726753597 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb8c1a7980 con 0x7feb8c101c90 2024-09-11T00:08:21.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.099+0000 7feb837fe640 1 -- 172.21.15.78:0/726753597 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0047a0 con 0x7feb8c101c90 2024-09-11T00:08:21.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.099+0000 7feb90fdf640 1 -- 172.21.15.78:0/726753597 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb8c1a7ec0 con 0x7feb8c101c90 2024-09-11T00:08:21.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.100+0000 7feb90fdf640 1 -- 172.21.15.78:0/726753597 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb8c102070 con 0x7feb8c101c90 2024-09-11T00:08:21.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.101+0000 7feb837fe640 1 -- 172.21.15.78:0/726753597 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7feb7c009a30 con 0x7feb8c101c90 2024-09-11T00:08:21.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.102+0000 7feb837fe640 1 --2- 172.21.15.78:0/726753597 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7feb780b52a0 0x7feb780b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:21.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.102+0000 7feb83fff640 1 --2- 172.21.15.78:0/726753597 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7feb780b52a0 0x7feb780b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:21.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.102+0000 7feb837fe640 1 -- 172.21.15.78:0/726753597 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7feb7c0e41c0 con 0x7feb8c101c90 2024-09-11T00:08:21.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.102+0000 7feb83fff640 1 --2- 172.21.15.78:0/726753597 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7feb780b52a0 0x7feb780b7760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feb74005d70 tx=0x7feb74005d00 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:21.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.105+0000 7feb837fe640 1 -- 172.21.15.78:0/726753597 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7feb7c0acc80 con 0x7feb8c101c90 2024-09-11T00:08:21.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.285+0000 7feb90fdf640 1 -- 172.21.15.78:0/726753597 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7feb8c02e5c0 con 0x7feb8c101c90 2024-09-11T00:08:21.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.289+0000 7feb837fe640 1 -- 172.21.15.78:0/726753597 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v32)=0 v32) ==== 106+0+0 (secure 0 0 0) 0x7feb7c0ac580 con 0x7feb8c101c90 2024-09-11T00:08:21.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.291+0000 7feb90fdf640 1 -- 172.21.15.78:0/726753597 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7feb780b52a0 msgr2=0x7feb780b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:21.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.291+0000 7feb90fdf640 1 --2- 172.21.15.78:0/726753597 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7feb780b52a0 0x7feb780b7760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feb74005d70 tx=0x7feb74005d00 comp rx=0 tx=0).stop 2024-09-11T00:08:21.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.291+0000 7feb90fdf640 1 -- 172.21.15.78:0/726753597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb8c101c90 msgr2=0x7feb8c10f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:21.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.291+0000 7feb90fdf640 1 --2- 172.21.15.78:0/726753597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb8c101c90 0x7feb8c10f330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00d950 tx=0x7feb7c00de10 comp rx=0 tx=0).stop 2024-09-11T00:08:21.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.291+0000 7feb90fdf640 1 -- 172.21.15.78:0/726753597 shutdown_connections 2024-09-11T00:08:21.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.291+0000 7feb90fdf640 1 --2- 172.21.15.78:0/726753597 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7feb780b52a0 0x7feb780b7760 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:21.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.291+0000 7feb90fdf640 1 --2- 172.21.15.78:0/726753597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feb8c108020 0x7feb8c10fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:21.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.291+0000 7feb90fdf640 1 --2- 172.21.15.78:0/726753597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb8c1076a0 0x7feb8c10f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:21.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.291+0000 7feb90fdf640 1 --2- 172.21.15.78:0/726753597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb8c101c90 0x7feb8c10f330 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:21.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.291+0000 7feb90fdf640 1 -- 172.21.15.78:0/726753597 >> 172.21.15.78:0/726753597 conn(0x7feb8c0fd700 msgr2=0x7feb8c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:21.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.291+0000 7feb90fdf640 1 -- 172.21.15.78:0/726753597 shutdown_connections 2024-09-11T00:08:21.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:21.291+0000 7feb90fdf640 1 -- 172.21.15.78:0/726753597 wait complete. 2024-09-11T00:08:22.146 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi078') 2024-09-11T00:08:22.147 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi078') 2024-09-11T00:08:22.147 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi078') 2024-09-11T00:08:22.441 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:22 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/726753597' entity='client.admin' 2024-09-11T00:08:22.441 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:22 smithi078 ceph-mon[30865]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:22.470 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi078') 2024-09-11T00:08:22.470 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi078') 2024-09-11T00:08:22.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.625+0000 7fef7599e640 1 -- 172.21.15.78:0/3306373674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef70108fa0 msgr2=0x7fef7010f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:22.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.625+0000 7fef7599e640 1 --2- 172.21.15.78:0/3306373674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef70108fa0 0x7fef7010f7a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fef68009ca0 tx=0x7fef6802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.625+0000 7fef7599e640 1 -- 172.21.15.78:0/3306373674 shutdown_connections 2024-09-11T00:08:22.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.625+0000 7fef7599e640 1 --2- 172.21.15.78:0/3306373674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef70108fa0 0x7fef7010f7a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.625+0000 7fef7599e640 1 --2- 172.21.15.78:0/3306373674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef70108620 0x7fef70108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.625+0000 7fef7599e640 1 --2- 172.21.15.78:0/3306373674 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef70102c10 0x7fef70102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.625+0000 7fef7599e640 1 -- 172.21.15.78:0/3306373674 >> 172.21.15.78:0/3306373674 conn(0x7fef700fe6c0 msgr2=0x7fef70100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:22.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.625+0000 7fef7599e640 1 -- 172.21.15.78:0/3306373674 shutdown_connections 2024-09-11T00:08:22.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.625+0000 7fef7599e640 1 -- 172.21.15.78:0/3306373674 wait complete. 2024-09-11T00:08:22.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.626+0000 7fef7599e640 1 Processor -- start 2024-09-11T00:08:22.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.626+0000 7fef7599e640 1 -- start start 2024-09-11T00:08:22.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.626+0000 7fef7599e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef70102c10 0x7fef70199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:22.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.626+0000 7fef7599e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef70108620 0x7fef70199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:22.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.626+0000 7fef7599e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef70108fa0 0x7fef7019e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:22.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.626+0000 7fef7599e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fef70112c60 con 0x7fef70108620 2024-09-11T00:08:22.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.626+0000 7fef7599e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fef70112ae0 con 0x7fef70102c10 2024-09-11T00:08:22.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.626+0000 7fef7599e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fef70112de0 con 0x7fef70108fa0 2024-09-11T00:08:22.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.627+0000 7fef6ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef70108620 0x7fef70199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:22.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.627+0000 7fef6ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef70108620 0x7fef70199590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43818/0 (socket says 172.21.15.78:43818) 2024-09-11T00:08:22.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.627+0000 7fef6ffff640 1 -- 172.21.15.78:0/3616131691 learned_addr learned my addr 172.21.15.78:0/3616131691 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:22.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.627+0000 7fef7519d640 1 --2- 172.21.15.78:0/3616131691 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef70108fa0 0x7fef7019e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:22.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.627+0000 7fef7499c640 1 --2- 172.21.15.78:0/3616131691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef70102c10 0x7fef70199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:22.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.627+0000 7fef6ffff640 1 -- 172.21.15.78:0/3616131691 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef70108fa0 msgr2=0x7fef7019e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:22.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.627+0000 7fef6ffff640 1 --2- 172.21.15.78:0/3616131691 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef70108fa0 0x7fef7019e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.627+0000 7fef6ffff640 1 -- 172.21.15.78:0/3616131691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef70102c10 msgr2=0x7fef70199050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:22.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.627+0000 7fef6ffff640 1 --2- 172.21.15.78:0/3616131691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef70102c10 0x7fef70199050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.627+0000 7fef6ffff640 1 -- 172.21.15.78:0/3616131691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7019f100 con 0x7fef70108620 2024-09-11T00:08:22.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.627+0000 7fef6ffff640 1 --2- 172.21.15.78:0/3616131691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef70108620 0x7fef70199590 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fef6400d950 tx=0x7fef6400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:22.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.627+0000 7fef6dffb640 1 -- 172.21.15.78:0/3616131691 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef64017070 con 0x7fef70108620 2024-09-11T00:08:22.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.627+0000 7fef6dffb640 1 -- 172.21.15.78:0/3616131691 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef64009c30 con 0x7fef70108620 2024-09-11T00:08:22.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.627+0000 7fef7599e640 1 -- 172.21.15.78:0/3616131691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef7019f3f0 con 0x7fef70108620 2024-09-11T00:08:22.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.627+0000 7fef6dffb640 1 -- 172.21.15.78:0/3616131691 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6400f620 con 0x7fef70108620 2024-09-11T00:08:22.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.627+0000 7fef7599e640 1 -- 172.21.15.78:0/3616131691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef701a5ab0 con 0x7fef70108620 2024-09-11T00:08:22.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.628+0000 7fef7599e640 1 -- 172.21.15.78:0/3616131691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef70102ff0 con 0x7fef70108620 2024-09-11T00:08:22.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.630+0000 7fef6dffb640 1 -- 172.21.15.78:0/3616131691 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7fef64010460 con 0x7fef70108620 2024-09-11T00:08:22.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.631+0000 7fef6dffb640 1 --2- 172.21.15.78:0/3616131691 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fef580b5340 0x7fef580b7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:22.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.631+0000 7fef7499c640 1 --2- 172.21.15.78:0/3616131691 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fef580b5340 0x7fef580b7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:22.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.631+0000 7fef6dffb640 1 -- 172.21.15.78:0/3616131691 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fef640e3c00 con 0x7fef70108620 2024-09-11T00:08:22.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.631+0000 7fef7499c640 1 --2- 172.21.15.78:0/3616131691 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fef580b5340 0x7fef580b7800 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef60005fd0 tx=0x7fef60005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:22.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.635+0000 7fef6dffb640 1 -- 172.21.15.78:0/3616131691 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fef640ac6c0 con 0x7fef70108620 2024-09-11T00:08:22.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:22 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/726753597' entity='client.admin' 2024-09-11T00:08:22.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:22 smithi112 ceph-mon[35627]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:22.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:22 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/726753597' entity='client.admin' 2024-09-11T00:08:22.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:22 smithi138 ceph-mon[35019]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:22.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.811+0000 7fef7599e640 1 -- 172.21.15.78:0/3616131691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7fef701a5da0 con 0x7fef70108620 2024-09-11T00:08:22.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.815+0000 7fef6dffb640 1 -- 172.21.15.78:0/3616131691 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v33)=0 v33) ==== 115+0+0 (secure 0 0 0) 0x7fef640b3e20 con 0x7fef70108620 2024-09-11T00:08:22.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.817+0000 7fef7599e640 1 -- 172.21.15.78:0/3616131691 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fef580b5340 msgr2=0x7fef580b7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:22.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.817+0000 7fef7599e640 1 --2- 172.21.15.78:0/3616131691 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fef580b5340 0x7fef580b7800 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef60005fd0 tx=0x7fef60005850 comp rx=0 tx=0).stop 2024-09-11T00:08:22.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.817+0000 7fef7599e640 1 -- 172.21.15.78:0/3616131691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef70108620 msgr2=0x7fef70199590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:22.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.817+0000 7fef7599e640 1 --2- 172.21.15.78:0/3616131691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef70108620 0x7fef70199590 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fef6400d950 tx=0x7fef6400de10 comp rx=0 tx=0).stop 2024-09-11T00:08:22.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.817+0000 7fef7599e640 1 -- 172.21.15.78:0/3616131691 shutdown_connections 2024-09-11T00:08:22.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.817+0000 7fef7599e640 1 --2- 172.21.15.78:0/3616131691 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fef580b5340 0x7fef580b7800 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.817+0000 7fef7599e640 1 --2- 172.21.15.78:0/3616131691 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef70108fa0 0x7fef7019e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.817+0000 7fef7599e640 1 --2- 172.21.15.78:0/3616131691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef70108620 0x7fef70199590 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.817+0000 7fef7599e640 1 --2- 172.21.15.78:0/3616131691 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fef70102c10 0x7fef70199050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:22.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.817+0000 7fef7599e640 1 -- 172.21.15.78:0/3616131691 >> 172.21.15.78:0/3616131691 conn(0x7fef700fe6c0 msgr2=0x7fef70101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:22.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.818+0000 7fef7599e640 1 -- 172.21.15.78:0/3616131691 shutdown_connections 2024-09-11T00:08:22.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:22.818+0000 7fef7599e640 1 -- 172.21.15.78:0/3616131691 wait complete. 2024-09-11T00:08:23.583 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:23.583 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:24.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:23 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3616131691' entity='client.admin' 2024-09-11T00:08:24.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:23 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:08:24.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:23 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:24.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:23 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:24.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:23 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:24.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:23 smithi078 ceph-mon[30865]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:24.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:23 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3616131691' entity='client.admin' 2024-09-11T00:08:24.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:23 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:08:24.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:23 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:24.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:23 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:24.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:23 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:24.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:23 smithi112 ceph-mon[35627]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:24.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:23 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3616131691' entity='client.admin' 2024-09-11T00:08:24.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:23 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:08:24.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:23 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:24.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:23 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:24.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:23 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:24.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:23 smithi138 ceph-mon[35019]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:24.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.748+0000 7f2887ae0640 1 -- 172.21.15.78:0/2446073257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f288010d100 msgr2=0x7f288010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:24.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.748+0000 7f2887ae0640 1 --2- 172.21.15.78:0/2446073257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f288010d100 0x7f288010f560 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2878009ca0 tx=0x7f287802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:08:24.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.748+0000 7f2887ae0640 1 -- 172.21.15.78:0/2446073257 shutdown_connections 2024-09-11T00:08:24.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.748+0000 7f2887ae0640 1 --2- 172.21.15.78:0/2446073257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f288010d100 0x7f288010f560 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:24.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.748+0000 7f2887ae0640 1 --2- 172.21.15.78:0/2446073257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f28801045c0 0x7f288010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:24.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.748+0000 7f2887ae0640 1 --2- 172.21.15.78:0/2446073257 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2880103ca0 0x7f2880104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:24.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.748+0000 7f2887ae0640 1 -- 172.21.15.78:0/2446073257 >> 172.21.15.78:0/2446073257 conn(0x7f28800fd700 msgr2=0x7f28800ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:24.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.748+0000 7f2887ae0640 1 -- 172.21.15.78:0/2446073257 shutdown_connections 2024-09-11T00:08:24.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.748+0000 7f2887ae0640 1 -- 172.21.15.78:0/2446073257 wait complete. 2024-09-11T00:08:24.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.748+0000 7f2887ae0640 1 Processor -- start 2024-09-11T00:08:24.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.748+0000 7f2887ae0640 1 -- start start 2024-09-11T00:08:24.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.749+0000 7f2887ae0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2880103ca0 0x7f2880199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:24.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.749+0000 7f2887ae0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28801045c0 0x7f2880199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:24.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.749+0000 7f2887ae0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f288010d100 0x7f288019ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:24.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.749+0000 7f2887ae0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2880112d70 con 0x7f288010d100 2024-09-11T00:08:24.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.749+0000 7f2887ae0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2880112bf0 con 0x7f2880103ca0 2024-09-11T00:08:24.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.749+0000 7f2887ae0640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2880112ef0 con 0x7f28801045c0 2024-09-11T00:08:24.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.749+0000 7f288607d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f288010d100 0x7f288019ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:24.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.749+0000 7f288607d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f288010d100 0x7f288019ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43850/0 (socket says 172.21.15.78:43850) 2024-09-11T00:08:24.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.749+0000 7f288607d640 1 -- 172.21.15.78:0/598655683 learned_addr learned my addr 172.21.15.78:0/598655683 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:24.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.749+0000 7f288507b640 1 --2- 172.21.15.78:0/598655683 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28801045c0 0x7f2880199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:24.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.749+0000 7f288587c640 1 --2- 172.21.15.78:0/598655683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2880103ca0 0x7f2880199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:24.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.749+0000 7f288607d640 1 -- 172.21.15.78:0/598655683 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28801045c0 msgr2=0x7f2880199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:24.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.749+0000 7f288607d640 1 --2- 172.21.15.78:0/598655683 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28801045c0 0x7f2880199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:24.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.749+0000 7f288607d640 1 -- 172.21.15.78:0/598655683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2880103ca0 msgr2=0x7f2880199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:24.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.749+0000 7f288607d640 1 --2- 172.21.15.78:0/598655683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2880103ca0 0x7f2880199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:24.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.749+0000 7f288607d640 1 -- 172.21.15.78:0/598655683 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f288019f3f0 con 0x7f288010d100 2024-09-11T00:08:24.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.749+0000 7f288607d640 1 --2- 172.21.15.78:0/598655683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f288010d100 0x7f288019ec20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2878005cc0 tx=0x7f287802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:24.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.750+0000 7f2876ffd640 1 -- 172.21.15.78:0/598655683 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2878003bf0 con 0x7f288010d100 2024-09-11T00:08:24.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.750+0000 7f2876ffd640 1 -- 172.21.15.78:0/598655683 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2878003d90 con 0x7f288010d100 2024-09-11T00:08:24.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.750+0000 7f2887ae0640 1 -- 172.21.15.78:0/598655683 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f288019f680 con 0x7f288010d100 2024-09-11T00:08:24.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.750+0000 7f2876ffd640 1 -- 172.21.15.78:0/598655683 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f287802fbc0 con 0x7f288010d100 2024-09-11T00:08:24.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.750+0000 7f2887ae0640 1 -- 172.21.15.78:0/598655683 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28801a5da0 con 0x7f288010d100 2024-09-11T00:08:24.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.750+0000 7f2887ae0640 1 -- 172.21.15.78:0/598655683 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2880104080 con 0x7f288010d100 2024-09-11T00:08:24.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.753+0000 7f2876ffd640 1 -- 172.21.15.78:0/598655683 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f2878004610 con 0x7f288010d100 2024-09-11T00:08:24.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.753+0000 7f2876ffd640 1 --2- 172.21.15.78:0/598655683 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f286c0b5320 0x7f286c0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:24.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.754+0000 7f288587c640 1 --2- 172.21.15.78:0/598655683 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f286c0b5320 0x7f286c0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:24.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.754+0000 7f2876ffd640 1 -- 172.21.15.78:0/598655683 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f2878105640 con 0x7f288010d100 2024-09-11T00:08:24.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.754+0000 7f288587c640 1 --2- 172.21.15.78:0/598655683 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f286c0b5320 0x7f286c0b77e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f287c00bbe0 tx=0x7f287c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:24.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.756+0000 7f2876ffd640 1 -- 172.21.15.78:0/598655683 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f28780ce0e0 con 0x7f288010d100 2024-09-11T00:08:24.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.671+0000 7f305a3f9640 1 -- 172.21.15.78:0/1630003309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3054102dc0 msgr2=0x7f30541031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:24.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.671+0000 7f305a3f9640 1 --2- 172.21.15.78:0/1630003309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3054102dc0 0x7f30541031a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3044009900 tx=0x7f304402a410 comp rx=0 tx=0).stop 2024-09-11T00:08:24.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.671+0000 7f305a3f9640 1 -- 172.21.15.78:0/1630003309 shutdown_connections 2024-09-11T00:08:24.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.671+0000 7f305a3f9640 1 --2- 172.21.15.78:0/1630003309 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3054109150 0x7f305410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:24.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.671+0000 7f305a3f9640 1 --2- 172.21.15.78:0/1630003309 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30541087d0 0x7f3054108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:24.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.671+0000 7f305a3f9640 1 --2- 172.21.15.78:0/1630003309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3054102dc0 0x7f30541031a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:24.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.671+0000 7f305a3f9640 1 -- 172.21.15.78:0/1630003309 >> 172.21.15.78:0/1630003309 conn(0x7f30540fe830 msgr2=0x7f3054100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:24.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.671+0000 7f305a3f9640 1 -- 172.21.15.78:0/1630003309 shutdown_connections 2024-09-11T00:08:24.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.671+0000 7f305a3f9640 1 -- 172.21.15.78:0/1630003309 wait complete. 2024-09-11T00:08:24.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.672+0000 7f305a3f9640 1 Processor -- start 2024-09-11T00:08:24.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.672+0000 7f305a3f9640 1 -- start start 2024-09-11T00:08:24.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.672+0000 7f305a3f9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3054102dc0 0x7f3054199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:24.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.672+0000 7f305a3f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30541087d0 0x7f30541997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:24.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.672+0000 7f305a3f9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3054109150 0x7f305419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:24.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.672+0000 7f305a3f9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3054112e10 con 0x7f3054109150 2024-09-11T00:08:24.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.672+0000 7f305a3f9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3054112c90 con 0x7f30541087d0 2024-09-11T00:08:24.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.672+0000 7f305a3f9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3054112f90 con 0x7f3054102dc0 2024-09-11T00:08:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.672+0000 7f3058996640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3054109150 0x7f305419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.672+0000 7f3058996640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3054109150 0x7f305419eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43840/0 (socket says 172.21.15.78:43840) 2024-09-11T00:08:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.672+0000 7f3058996640 1 -- 172.21.15.78:0/1927239434 learned_addr learned my addr 172.21.15.78:0/1927239434 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.673+0000 7f3053fff640 1 --2- 172.21.15.78:0/1927239434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3054102dc0 0x7f3054199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.673+0000 7f30537fe640 1 --2- 172.21.15.78:0/1927239434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30541087d0 0x7f30541997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.673+0000 7f3058996640 1 -- 172.21.15.78:0/1927239434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3054102dc0 msgr2=0x7f3054199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.673+0000 7f3058996640 1 --2- 172.21.15.78:0/1927239434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3054102dc0 0x7f3054199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.673+0000 7f3058996640 1 -- 172.21.15.78:0/1927239434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30541087d0 msgr2=0x7f30541997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.673+0000 7f3058996640 1 --2- 172.21.15.78:0/1927239434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30541087d0 0x7f30541997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.673+0000 7f3058996640 1 -- 172.21.15.78:0/1927239434 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f305419f330 con 0x7f3054109150 2024-09-11T00:08:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.673+0000 7f3058996640 1 --2- 172.21.15.78:0/1927239434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3054109150 0x7f305419eb60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f304c00cce0 tx=0x7f304c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.673+0000 7f30517fa640 1 -- 172.21.15.78:0/1927239434 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304c00f450 con 0x7f3054109150 2024-09-11T00:08:24.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.673+0000 7f30517fa640 1 -- 172.21.15.78:0/1927239434 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f304c00faa0 con 0x7f3054109150 2024-09-11T00:08:24.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.673+0000 7f30517fa640 1 -- 172.21.15.78:0/1927239434 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304c018b70 con 0x7f3054109150 2024-09-11T00:08:24.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.673+0000 7f305a3f9640 1 -- 172.21.15.78:0/1927239434 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f305419f620 con 0x7f3054109150 2024-09-11T00:08:24.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.673+0000 7f305a3f9640 1 -- 172.21.15.78:0/1927239434 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30541a5d60 con 0x7f3054109150 2024-09-11T00:08:24.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.674+0000 7f305a3f9640 1 -- 172.21.15.78:0/1927239434 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30541031a0 con 0x7f3054109150 2024-09-11T00:08:24.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.676+0000 7f30517fa640 1 -- 172.21.15.78:0/1927239434 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f304c00f5f0 con 0x7f3054109150 2024-09-11T00:08:24.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.677+0000 7f30517fa640 1 --2- 172.21.15.78:0/1927239434 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f30400b5320 0x7f30400b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:24.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.677+0000 7f3053fff640 1 --2- 172.21.15.78:0/1927239434 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f30400b5320 0x7f30400b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:24.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.677+0000 7f30517fa640 1 -- 172.21.15.78:0/1927239434 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f304c0e4780 con 0x7f3054109150 2024-09-11T00:08:24.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.677+0000 7f3053fff640 1 --2- 172.21.15.78:0/1927239434 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f30400b5320 0x7f30400b77e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3044031440 tx=0x7f3044005e80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:24.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.679+0000 7f30517fa640 1 -- 172.21.15.78:0/1927239434 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f304c014030 con 0x7f3054109150 2024-09-11T00:08:24.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.865+0000 7f305a3f9640 1 -- 172.21.15.78:0/1927239434 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f305419a3b0 con 0x7f3054109150 2024-09-11T00:08:24.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.869+0000 7f30517fa640 1 -- 172.21.15.78:0/1927239434 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v34)=0 v34) ==== 119+0+0 (secure 0 0 0) 0x7f304c0ad350 con 0x7f3054109150 2024-09-11T00:08:24.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.871+0000 7f305a3f9640 1 -- 172.21.15.78:0/1927239434 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f30400b5320 msgr2=0x7f30400b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:24.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.871+0000 7f305a3f9640 1 --2- 172.21.15.78:0/1927239434 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f30400b5320 0x7f30400b77e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3044031440 tx=0x7f3044005e80 comp rx=0 tx=0).stop 2024-09-11T00:08:24.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.871+0000 7f305a3f9640 1 -- 172.21.15.78:0/1927239434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3054109150 msgr2=0x7f305419eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:24.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.871+0000 7f305a3f9640 1 --2- 172.21.15.78:0/1927239434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3054109150 0x7f305419eb60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f304c00cce0 tx=0x7f304c00a620 comp rx=0 tx=0).stop 2024-09-11T00:08:24.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.872+0000 7f305a3f9640 1 -- 172.21.15.78:0/1927239434 shutdown_connections 2024-09-11T00:08:24.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.872+0000 7f305a3f9640 1 --2- 172.21.15.78:0/1927239434 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f30400b5320 0x7f30400b77e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:24.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.872+0000 7f305a3f9640 1 --2- 172.21.15.78:0/1927239434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3054109150 0x7f305419eb60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:24.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.872+0000 7f305a3f9640 1 --2- 172.21.15.78:0/1927239434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30541087d0 0x7f30541997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:24.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.872+0000 7f305a3f9640 1 --2- 172.21.15.78:0/1927239434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3054102dc0 0x7f3054199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:24.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.872+0000 7f305a3f9640 1 -- 172.21.15.78:0/1927239434 >> 172.21.15.78:0/1927239434 conn(0x7f30540fe830 msgr2=0x7f3054100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:24.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.872+0000 7f305a3f9640 1 -- 172.21.15.78:0/1927239434 shutdown_connections 2024-09-11T00:08:24.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.872+0000 7f305a3f9640 1 -- 172.21.15.78:0/1927239434 wait complete. 2024-09-11T00:08:24.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.940+0000 7f2887ae0640 1 -- 172.21.15.78:0/598655683 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f288019a470 con 0x7f288010d100 2024-09-11T00:08:24.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.946+0000 7f2876ffd640 1 -- 172.21.15.78:0/598655683 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v35)=0 v35) ==== 116+0+0 (secure 0 0 0) 0x7f288019a470 con 0x7f288010d100 2024-09-11T00:08:24.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.949+0000 7f2887ae0640 1 -- 172.21.15.78:0/598655683 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f286c0b5320 msgr2=0x7f286c0b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:24.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.949+0000 7f2887ae0640 1 --2- 172.21.15.78:0/598655683 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f286c0b5320 0x7f286c0b77e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f287c00bbe0 tx=0x7f287c00b390 comp rx=0 tx=0).stop 2024-09-11T00:08:24.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.949+0000 7f2887ae0640 1 -- 172.21.15.78:0/598655683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f288010d100 msgr2=0x7f288019ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:24.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.949+0000 7f2887ae0640 1 --2- 172.21.15.78:0/598655683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f288010d100 0x7f288019ec20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2878005cc0 tx=0x7f287802f380 comp rx=0 tx=0).stop 2024-09-11T00:08:24.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.949+0000 7f2887ae0640 1 -- 172.21.15.78:0/598655683 shutdown_connections 2024-09-11T00:08:24.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.949+0000 7f2887ae0640 1 --2- 172.21.15.78:0/598655683 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f286c0b5320 0x7f286c0b77e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:24.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.949+0000 7f2887ae0640 1 --2- 172.21.15.78:0/598655683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f288010d100 0x7f288019ec20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:24.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.949+0000 7f2887ae0640 1 --2- 172.21.15.78:0/598655683 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f28801045c0 0x7f2880199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:24.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.949+0000 7f2887ae0640 1 --2- 172.21.15.78:0/598655683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2880103ca0 0x7f2880199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:24.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.949+0000 7f2887ae0640 1 -- 172.21.15.78:0/598655683 >> 172.21.15.78:0/598655683 conn(0x7f28800fd700 msgr2=0x7f28800fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:24.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.949+0000 7f2887ae0640 1 -- 172.21.15.78:0/598655683 shutdown_connections 2024-09-11T00:08:24.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:24.949+0000 7f2887ae0640 1 -- 172.21.15.78:0/598655683 wait complete. 2024-09-11T00:08:25.750 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi078') 2024-09-11T00:08:25.751 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi078') 2024-09-11T00:08:25.751 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi078') 2024-09-11T00:08:25.752 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi078') 2024-09-11T00:08:25.752 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi078') 2024-09-11T00:08:25.752 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi078') 2024-09-11T00:08:26.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:25 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1927239434' entity='client.admin' 2024-09-11T00:08:26.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:25 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/598655683' entity='client.admin' 2024-09-11T00:08:26.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:25 smithi078 ceph-mon[30865]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:26.152 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi078') 2024-09-11T00:08:26.152 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi078') 2024-09-11T00:08:26.153 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi078') 2024-09-11T00:08:26.153 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi078') 2024-09-11T00:08:26.153 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi078') 2024-09-11T00:08:26.153 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi078') 2024-09-11T00:08:26.153 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi078') 2024-09-11T00:08:26.153 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi078') 2024-09-11T00:08:26.153 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi078') 2024-09-11T00:08:26.153 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '85a53860-6fd1-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi078') 2024-09-11T00:08:26.154 INFO:tasks.cephadm:Deploying OSDs... 2024-09-11T00:08:26.154 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-11T00:08:26.154 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T00:08:26.172 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T00:08:26.172 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 2024-09-11T00:08:26.228 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T00:08:26.228 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:08:26.228 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-11T00:08:26.229 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:08:26.229 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:08:26.229 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-11 00:07:09.374129320 +0000 2024-09-11T00:08:26.229 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-11 00:02:40.855737805 +0000 2024-09-11T00:08:26.229 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-11 00:02:40.855737805 +0000 2024-09-11T00:08:26.229 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-11 00:02:40.855737805 +0000 2024-09-11T00:08:26.229 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T00:08:26.231 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:25 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1927239434' entity='client.admin' 2024-09-11T00:08:26.231 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:25 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/598655683' entity='client.admin' 2024-09-11T00:08:26.231 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:25 smithi112 ceph-mon[35627]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:26.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:25 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1927239434' entity='client.admin' 2024-09-11T00:08:26.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:25 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/598655683' entity='client.admin' 2024-09-11T00:08:26.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:25 smithi138 ceph-mon[35019]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:26.294 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-11T00:08:26.294 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-11T00:08:26.294 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000236666 s, 2.2 MB/s 2024-09-11T00:08:26.295 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T00:08:26.352 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 2024-09-11T00:08:26.408 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T00:08:26.408 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:08:26.408 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-11T00:08:26.408 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:08:26.408 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:08:26.408 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-11 00:07:09.407128823 +0000 2024-09-11T00:08:26.409 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-11 00:02:41.206732791 +0000 2024-09-11T00:08:26.409 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-11 00:02:41.206732791 +0000 2024-09-11T00:08:26.409 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-11 00:02:41.206732791 +0000 2024-09-11T00:08:26.409 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T00:08:26.472 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-11T00:08:26.472 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-11T00:08:26.472 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000191176 s, 2.7 MB/s 2024-09-11T00:08:26.473 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T00:08:26.529 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 2024-09-11T00:08:26.584 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T00:08:26.584 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:08:26.584 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-11T00:08:26.584 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:08:26.585 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:08:26.585 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-11 00:07:09.443128281 +0000 2024-09-11T00:08:26.585 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-11 00:02:41.524728249 +0000 2024-09-11T00:08:26.585 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-11 00:02:41.524728249 +0000 2024-09-11T00:08:26.585 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-11 00:02:41.524728249 +0000 2024-09-11T00:08:26.585 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T00:08:26.647 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-11T00:08:26.647 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-11T00:08:26.647 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000196798 s, 2.6 MB/s 2024-09-11T00:08:26.649 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T00:08:26.705 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 2024-09-11T00:08:26.760 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T00:08:26.760 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:08:26.760 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-11T00:08:26.761 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:08:26.761 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:08:26.761 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-11 00:07:09.481127709 +0000 2024-09-11T00:08:26.761 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-11 00:02:41.849723606 +0000 2024-09-11T00:08:26.761 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-11 00:02:41.849723606 +0000 2024-09-11T00:08:26.761 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-11 00:02:41.849723606 +0000 2024-09-11T00:08:26.761 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T00:08:26.823 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-11T00:08:26.823 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-11T00:08:26.823 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000208071 s, 2.5 MB/s 2024-09-11T00:08:26.824 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T00:08:26.881 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-11T00:08:26.881 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T00:08:26.901 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T00:08:26.901 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2024-09-11T00:08:26.959 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T00:08:26.959 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:08:26.959 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-11T00:08:26.960 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:08:26.960 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:08:26.960 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-11 00:08:03.684790295 +0000 2024-09-11T00:08:26.960 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-11 00:03:02.658241191 +0000 2024-09-11T00:08:26.960 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-11 00:03:02.658241191 +0000 2024-09-11T00:08:26.960 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-11 00:03:02.658241191 +0000 2024-09-11T00:08:26.960 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T00:08:27.030 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-11T00:08:27.030 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-11T00:08:27.030 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000289395 s, 1.8 MB/s 2024-09-11T00:08:27.032 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T00:08:27.091 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2024-09-11T00:08:27.148 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T00:08:27.149 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:08:27.149 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-11T00:08:27.149 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:08:27.149 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:08:27.149 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-11 00:08:03.684790295 +0000 2024-09-11T00:08:27.149 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-11 00:03:02.984232594 +0000 2024-09-11T00:08:27.149 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-11 00:03:02.984232594 +0000 2024-09-11T00:08:27.150 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-11 00:03:02.984232594 +0000 2024-09-11T00:08:27.150 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T00:08:27.215 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-11T00:08:27.215 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-11T00:08:27.215 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000238878 s, 2.1 MB/s 2024-09-11T00:08:27.216 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T00:08:27.274 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2024-09-11T00:08:27.330 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T00:08:27.330 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:08:27.330 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-11T00:08:27.330 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:08:27.330 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:08:27.330 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-11 00:08:03.684790295 +0000 2024-09-11T00:08:27.331 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-11 00:03:03.307224075 +0000 2024-09-11T00:08:27.331 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-11 00:03:03.307224075 +0000 2024-09-11T00:08:27.331 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-11 00:03:03.307224075 +0000 2024-09-11T00:08:27.331 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T00:08:27.394 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-11T00:08:27.395 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-11T00:08:27.395 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000219491 s, 2.3 MB/s 2024-09-11T00:08:27.396 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T00:08:27.452 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2024-09-11T00:08:27.510 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T00:08:27.510 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:08:27.511 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-11T00:08:27.511 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:08:27.511 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:08:27.512 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-11 00:08:03.685790270 +0000 2024-09-11T00:08:27.512 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-11 00:03:03.623215740 +0000 2024-09-11T00:08:27.512 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-11 00:03:03.623215740 +0000 2024-09-11T00:08:27.513 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-11 00:03:03.623215740 +0000 2024-09-11T00:08:27.514 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T00:08:27.574 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-11T00:08:27.575 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-11T00:08:27.575 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.00023668 s, 2.2 MB/s 2024-09-11T00:08:27.576 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T00:08:27.632 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-11T00:08:27.632 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T00:08:27.652 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T00:08:27.652 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_1 2024-09-11T00:08:27.712 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T00:08:27.713 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:08:27.713 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-11T00:08:27.713 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:08:27.713 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:08:27.713 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-11 00:08:01.376085841 +0000 2024-09-11T00:08:27.714 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-11 00:02:57.010516504 +0000 2024-09-11T00:08:27.714 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-11 00:02:57.010516504 +0000 2024-09-11T00:08:27.714 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-09-11 00:02:57.010516504 +0000 2024-09-11T00:08:27.714 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T00:08:27.783 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-11T00:08:27.783 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-11T00:08:27.783 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000286474 s, 1.8 MB/s 2024-09-11T00:08:27.785 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T00:08:27.844 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_2 2024-09-11T00:08:27.902 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T00:08:27.902 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:08:27.902 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-11T00:08:27.902 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:08:27.902 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:08:27.902 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-11 00:08:01.377085820 +0000 2024-09-11T00:08:27.902 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-11 00:02:57.344509316 +0000 2024-09-11T00:08:27.902 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-11 00:02:57.344509316 +0000 2024-09-11T00:08:27.902 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-09-11 00:02:57.344509316 +0000 2024-09-11T00:08:27.903 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T00:08:27.968 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-11T00:08:27.968 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-11T00:08:27.968 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000224817 s, 2.3 MB/s 2024-09-11T00:08:27.969 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T00:08:28.027 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_3 2024-09-11T00:08:28.085 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T00:08:28.085 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:08:28.086 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-11T00:08:28.086 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:08:28.086 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:08:28.086 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-11 00:08:01.377085820 +0000 2024-09-11T00:08:28.086 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-11 00:02:57.660502514 +0000 2024-09-11T00:08:28.086 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-11 00:02:57.660502514 +0000 2024-09-11T00:08:28.086 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-09-11 00:02:57.660502514 +0000 2024-09-11T00:08:28.087 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T00:08:28.150 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-11T00:08:28.150 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-11T00:08:28.150 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000193995 s, 2.6 MB/s 2024-09-11T00:08:28.151 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T00:08:28.208 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_4 2024-09-11T00:08:28.265 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T00:08:28.265 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:08:28.265 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-11T00:08:28.265 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:08:28.265 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:08:28.265 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-11 00:08:01.377085820 +0000 2024-09-11T00:08:28.265 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-11 00:02:57.994495325 +0000 2024-09-11T00:08:28.266 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-11 00:02:57.994495325 +0000 2024-09-11T00:08:28.266 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-09-11 00:02:57.994495325 +0000 2024-09-11T00:08:28.266 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T00:08:28.329 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-11T00:08:28.329 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-11T00:08:28.329 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000198674 s, 2.6 MB/s 2024-09-11T00:08:28.330 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T00:08:28.387 INFO:tasks.cephadm:Deploying osd.0 on smithi078 with /dev/vg_nvme/lv_4... 2024-09-11T00:08:28.388 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T00:08:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:28.785 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:28 smithi078 ceph-mon[30865]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:28.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:28 smithi112 ceph-mon[35627]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:29.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:28 smithi138 ceph-mon[35019]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:30.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:30 smithi112 ceph-mon[35627]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:31.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:30 smithi138 ceph-mon[35019]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:31.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:30 smithi078 ceph-mon[30865]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:31.111 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:08:31.137 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi078:vg_nvme/lv_4 2024-09-11T00:08:31.382 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:08:31.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.850+0000 7f2f14f3a640 1 -- 172.21.15.78:0/520474837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f10101cb0 msgr2=0x7f2f10102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:31.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.850+0000 7f2f14f3a640 1 --2- 172.21.15.78:0/520474837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f10101cb0 0x7f2f10102090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2f00009900 tx=0x7f2f0002a410 comp rx=0 tx=0).stop 2024-09-11T00:08:31.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.850+0000 7f2f14f3a640 1 -- 172.21.15.78:0/520474837 shutdown_connections 2024-09-11T00:08:31.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.850+0000 7f2f14f3a640 1 --2- 172.21.15.78:0/520474837 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f10108040 0x7f2f1010e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:31.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.850+0000 7f2f14f3a640 1 --2- 172.21.15.78:0/520474837 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f101076c0 0x7f2f10107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:31.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.850+0000 7f2f14f3a640 1 --2- 172.21.15.78:0/520474837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f10101cb0 0x7f2f10102090 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:31.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.850+0000 7f2f14f3a640 1 -- 172.21.15.78:0/520474837 >> 172.21.15.78:0/520474837 conn(0x7f2f100fd740 msgr2=0x7f2f100ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:31.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.850+0000 7f2f14f3a640 1 -- 172.21.15.78:0/520474837 shutdown_connections 2024-09-11T00:08:31.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.850+0000 7f2f14f3a640 1 -- 172.21.15.78:0/520474837 wait complete. 2024-09-11T00:08:31.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.851+0000 7f2f14f3a640 1 Processor -- start 2024-09-11T00:08:31.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.851+0000 7f2f14f3a640 1 -- start start 2024-09-11T00:08:31.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.851+0000 7f2f14f3a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f10101cb0 0x7f2f10108930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:31.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.851+0000 7f2f14f3a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f101076c0 0x7f2f10108e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:31.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.851+0000 7f2f14f3a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f10108040 0x7f2f101093b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:31.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.851+0000 7f2f14f3a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2f10111d50 con 0x7f2f10108040 2024-09-11T00:08:31.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.851+0000 7f2f14f3a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2f10111bd0 con 0x7f2f101076c0 2024-09-11T00:08:31.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.851+0000 7f2f14f3a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2f10111ed0 con 0x7f2f10101cb0 2024-09-11T00:08:31.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.851+0000 7f2f0ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f10108040 0x7f2f101093b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:31.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.851+0000 7f2f0ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f10108040 0x7f2f101093b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48684/0 (socket says 172.21.15.78:48684) 2024-09-11T00:08:31.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.851+0000 7f2f0ed9d640 1 -- 172.21.15.78:0/322524298 learned_addr learned my addr 172.21.15.78:0/322524298 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:08:31.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.851+0000 7f2f0dd9b640 1 --2- 172.21.15.78:0/322524298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f101076c0 0x7f2f10108e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.851+0000 7f2f0e59c640 1 --2- 172.21.15.78:0/322524298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f10101cb0 0x7f2f10108930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.851+0000 7f2f0ed9d640 1 -- 172.21.15.78:0/322524298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f10101cb0 msgr2=0x7f2f10108930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.852+0000 7f2f0ed9d640 1 --2- 172.21.15.78:0/322524298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f10101cb0 0x7f2f10108930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.852+0000 7f2f0ed9d640 1 -- 172.21.15.78:0/322524298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f101076c0 msgr2=0x7f2f10108e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.852+0000 7f2f0ed9d640 1 --2- 172.21.15.78:0/322524298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f101076c0 0x7f2f10108e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.852+0000 7f2f0ed9d640 1 -- 172.21.15.78:0/322524298 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f101a7650 con 0x7f2f10108040 2024-09-11T00:08:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.852+0000 7f2f0ed9d640 1 --2- 172.21.15.78:0/322524298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f10108040 0x7f2f101093b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800cce0 tx=0x7f2f0800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.852+0000 7f2eff7fe640 1 -- 172.21.15.78:0/322524298 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0800f450 con 0x7f2f10108040 2024-09-11T00:08:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.852+0000 7f2eff7fe640 1 -- 172.21.15.78:0/322524298 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f0800faa0 con 0x7f2f10108040 2024-09-11T00:08:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.852+0000 7f2f14f3a640 1 -- 172.21.15.78:0/322524298 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f101a7940 con 0x7f2f10108040 2024-09-11T00:08:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.852+0000 7f2eff7fe640 1 -- 172.21.15.78:0/322524298 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08018b70 con 0x7f2f10108040 2024-09-11T00:08:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.852+0000 7f2f14f3a640 1 -- 172.21.15.78:0/322524298 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f101a7e30 con 0x7f2f10108040 2024-09-11T00:08:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.853+0000 7f2f14f3a640 1 -- 172.21.15.78:0/322524298 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f10102090 con 0x7f2f10108040 2024-09-11T00:08:31.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.854+0000 7f2eff7fe640 1 -- 172.21.15.78:0/322524298 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f2f0800f5f0 con 0x7f2f10108040 2024-09-11T00:08:31.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.855+0000 7f2eff7fe640 1 --2- 172.21.15.78:0/322524298 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2ef80b52a0 0x7f2ef80b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:31.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.855+0000 7f2f0e59c640 1 --2- 172.21.15.78:0/322524298 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2ef80b52a0 0x7f2ef80b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:31.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.855+0000 7f2eff7fe640 1 -- 172.21.15.78:0/322524298 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f2f080e4710 con 0x7f2f10108040 2024-09-11T00:08:31.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.855+0000 7f2f0e59c640 1 --2- 172.21.15.78:0/322524298 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2ef80b52a0 0x7f2ef80b7760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2f00005ab0 tx=0x7f2f00005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:31.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:31.858+0000 7f2eff7fe640 1 -- 172.21.15.78:0/322524298 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2f08014030 con 0x7f2f10108040 2024-09-11T00:08:32.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:32.042+0000 7f2f14f3a640 1 -- 172.21.15.78:0/322524298 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f2f10105c10 con 0x7f2ef80b52a0 2024-09-11T00:08:32.754 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:32 smithi078 ceph-mon[30865]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:32.754 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:32 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:08:32.754 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:32 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:08:32.754 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:32 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:32.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:32 smithi112 ceph-mon[35627]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:32.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:32 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:08:32.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:32 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:08:32.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:32 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:33.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:32 smithi138 ceph-mon[35019]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:33.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:32 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:08:33.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:32 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:08:33.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:32 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:33.811 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:33 smithi078 ceph-mon[30865]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:08:33.981 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:33 smithi112 ceph-mon[35627]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:08:34.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:33 smithi138 ceph-mon[35019]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:08:34.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:34 smithi078 ceph-mon[30865]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:34.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:34 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/889993612' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d260c219-52f2-4e7f-9188-9e66ee01dacd"} : dispatch 2024-09-11T00:08:34.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:34 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/889993612' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d260c219-52f2-4e7f-9188-9e66ee01dacd"}]': finished 2024-09-11T00:08:34.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:34 smithi078 ceph-mon[30865]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T00:08:34.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:34 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:08:34.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:34 smithi112 ceph-mon[35627]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:34.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:34 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/889993612' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d260c219-52f2-4e7f-9188-9e66ee01dacd"} : dispatch 2024-09-11T00:08:34.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:34 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/889993612' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d260c219-52f2-4e7f-9188-9e66ee01dacd"}]': finished 2024-09-11T00:08:34.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:34 smithi112 ceph-mon[35627]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T00:08:34.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:34 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:08:35.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:34 smithi138 ceph-mon[35019]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:35.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:34 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/889993612' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d260c219-52f2-4e7f-9188-9e66ee01dacd"} : dispatch 2024-09-11T00:08:35.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:34 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/889993612' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d260c219-52f2-4e7f-9188-9e66ee01dacd"}]': finished 2024-09-11T00:08:35.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:34 smithi138 ceph-mon[35019]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T00:08:35.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:34 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:08:35.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:35 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3467132603' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:08:36.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:35 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3467132603' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:08:36.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:35 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3467132603' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:08:36.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:36 smithi112 ceph-mon[35627]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:37.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:36 smithi138 ceph-mon[35019]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:37.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:36 smithi078 ceph-mon[30865]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:38.981 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:38 smithi112 ceph-mon[35627]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:39.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:38 smithi138 ceph-mon[35019]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:39.077 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:38 smithi078 ceph-mon[30865]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:40.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:40 smithi112 ceph-mon[35627]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:41.031 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:40 smithi078 ceph-mon[30865]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:41.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:40 smithi138 ceph-mon[35019]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:42.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:42 smithi078 ceph-mon[30865]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:42.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:42 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-11T00:08:42.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:42 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:42.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:42 smithi112 ceph-mon[35627]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:42.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:42 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-11T00:08:42.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:42 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:43.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:42 smithi138 ceph-mon[35019]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:43.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:42 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-11T00:08:43.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:42 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:43.933 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:43 smithi078 ceph-mon[30865]: Deploying daemon osd.0 on smithi078 2024-09-11T00:08:43.981 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:43 smithi112 ceph-mon[35627]: Deploying daemon osd.0 on smithi078 2024-09-11T00:08:44.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:43 smithi138 ceph-mon[35019]: Deploying daemon osd.0 on smithi078 2024-09-11T00:08:44.933 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:44 smithi078 ceph-mon[30865]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:44.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:44 smithi112 ceph-mon[35627]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:45.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:44 smithi138 ceph-mon[35019]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:46.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:46 smithi112 ceph-mon[35627]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:46 smithi138 ceph-mon[35019]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:47.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:46 smithi078 ceph-mon[30865]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:48.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:48 smithi112 ceph-mon[35627]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:49.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:48 smithi138 ceph-mon[35019]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:49.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:48 smithi078 ceph-mon[30865]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:49.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:49 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:08:49.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:49 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:49.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:49 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:49.987 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:49 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:08:49.987 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:49 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:49.987 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:49 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:50.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:49 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:08:50.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:49 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:50.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:49 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:50.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:50 smithi078 ceph-mon[30865]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:50.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:50 smithi112 ceph-mon[35627]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:51.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:50 smithi138 ceph-mon[35019]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:52.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:52 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:52.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:52 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:52.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:52 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:52.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:52 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:52.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:52 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:52.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:52 smithi112 ceph-mon[35627]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:52.484 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:52 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:52.484 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:52 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:52.484 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:52 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:52.484 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:52 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:52.485 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:52 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:52.485 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:52 smithi078 ceph-mon[30865]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:52.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:52 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:52.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:52 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:52.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:52 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:52.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:52 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:52.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:52 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:52.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:52 smithi138 ceph-mon[35019]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:53.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:53.077+0000 7f2eff7fe640 1 -- 172.21.15.78:0/322524298 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2f10105c10 con 0x7f2ef80b52a0 2024-09-11T00:08:53.080 INFO:teuthology.orchestra.run.smithi078.stdout:Created osd(s) 0 on host 'smithi078' 2024-09-11T00:08:53.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:53.080+0000 7f2f14f3a640 1 -- 172.21.15.78:0/322524298 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2ef80b52a0 msgr2=0x7f2ef80b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:53.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:53.080+0000 7f2f14f3a640 1 --2- 172.21.15.78:0/322524298 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2ef80b52a0 0x7f2ef80b7760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2f00005ab0 tx=0x7f2f00005a20 comp rx=0 tx=0).stop 2024-09-11T00:08:53.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:53.080+0000 7f2f14f3a640 1 -- 172.21.15.78:0/322524298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f10108040 msgr2=0x7f2f101093b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:53.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:53.080+0000 7f2f14f3a640 1 --2- 172.21.15.78:0/322524298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f10108040 0x7f2f101093b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800cce0 tx=0x7f2f0800a620 comp rx=0 tx=0).stop 2024-09-11T00:08:53.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:53.080+0000 7f2f14f3a640 1 -- 172.21.15.78:0/322524298 shutdown_connections 2024-09-11T00:08:53.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:53.080+0000 7f2f14f3a640 1 --2- 172.21.15.78:0/322524298 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2ef80b52a0 0x7f2ef80b7760 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:53.080+0000 7f2f14f3a640 1 --2- 172.21.15.78:0/322524298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f10108040 0x7f2f101093b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:53.080+0000 7f2f14f3a640 1 --2- 172.21.15.78:0/322524298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2f101076c0 0x7f2f10108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:53.080+0000 7f2f14f3a640 1 --2- 172.21.15.78:0/322524298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2f10101cb0 0x7f2f10108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:53.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:53.080+0000 7f2f14f3a640 1 -- 172.21.15.78:0/322524298 >> 172.21.15.78:0/322524298 conn(0x7f2f100fd740 msgr2=0x7f2f10105500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:53.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:53.080+0000 7f2f14f3a640 1 -- 172.21.15.78:0/322524298 shutdown_connections 2024-09-11T00:08:53.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:08:53.080+0000 7f2f14f3a640 1 -- 172.21.15.78:0/322524298 wait complete. 2024-09-11T00:08:53.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:53 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:08:53.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:53 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:53.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:53 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:53.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:53 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:08:53.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:53 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:53.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:53 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:53.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:53 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:08:53.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:53 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:53.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:53 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:53.738 DEBUG:teuthology.orchestra.run.smithi078:osd.0> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.0.service 2024-09-11T00:08:53.741 INFO:tasks.cephadm:Deploying osd.1 on smithi112 with /dev/vg_nvme/lv_4... 2024-09-11T00:08:53.741 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T00:08:53.993 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T00:08:54.437 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:54 smithi112 ceph-mon[35627]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:54.542 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:54 smithi138 ceph-mon[35019]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:54.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:54 smithi078 ceph-mon[30865]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:55.173 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:08:54 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-0[48993]: 2024-09-11T00:08:54.899+0000 7f5b2ee69640 -1 osd.0 0 log_to_monitors true 2024-09-11T00:08:55.301 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:55 smithi112 ceph-mon[35627]: from='osd.0 [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-11T00:08:55.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:55 smithi138 ceph-mon[35019]: from='osd.0 [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-11T00:08:55.583 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:55 smithi078 ceph-mon[30865]: from='osd.0 [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-11T00:08:56.349 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-11T00:08:56.376 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi112:vg_nvme/lv_4 2024-09-11T00:08:56.384 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:56 smithi112 ceph-mon[35627]: from='osd.0 [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T00:08:56.414 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:56 smithi112 ceph-mon[35627]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T00:08:56.414 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:56 smithi112 ceph-mon[35627]: from='osd.0 [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi078", "root=default"]} : dispatch 2024-09-11T00:08:56.414 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:56 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:08:56.414 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:56 smithi112 ceph-mon[35627]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:56.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:56 smithi138 ceph-mon[35019]: from='osd.0 [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T00:08:56.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:56 smithi138 ceph-mon[35019]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T00:08:56.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:56 smithi138 ceph-mon[35019]: from='osd.0 [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi078", "root=default"]} : dispatch 2024-09-11T00:08:56.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:56 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:08:56.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:56 smithi138 ceph-mon[35019]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:56.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:56 smithi078 ceph-mon[30865]: from='osd.0 [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T00:08:56.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:56 smithi078 ceph-mon[30865]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T00:08:56.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:56 smithi078 ceph-mon[30865]: from='osd.0 [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi078", "root=default"]} : dispatch 2024-09-11T00:08:56.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:56 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:08:56.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:56 smithi078 ceph-mon[30865]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:56.626 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T00:08:57.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.067+0000 7fdf86a63640 1 -- 172.21.15.112:0/885128029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf80104570 msgr2=0x7fdf8010cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:57.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.067+0000 7fdf86a63640 1 --2- 172.21.15.112:0/885128029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf80104570 0x7fdf8010cb50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdf68009900 tx=0x7fdf6802a410 comp rx=0 tx=0).stop 2024-09-11T00:08:57.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.067+0000 7fdf86a63640 1 -- 172.21.15.112:0/885128029 shutdown_connections 2024-09-11T00:08:57.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.067+0000 7fdf86a63640 1 --2- 172.21.15.112:0/885128029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf8010d120 0x7fdf8010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:57.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.067+0000 7fdf86a63640 1 --2- 172.21.15.112:0/885128029 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf80104570 0x7fdf8010cb50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:57.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.067+0000 7fdf86a63640 1 --2- 172.21.15.112:0/885128029 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf80103b70 0x7fdf80103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:57.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.067+0000 7fdf86a63640 1 -- 172.21.15.112:0/885128029 >> 172.21.15.112:0/885128029 conn(0x7fdf800fd700 msgr2=0x7fdf800ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:08:57.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.067+0000 7fdf86a63640 1 -- 172.21.15.112:0/885128029 shutdown_connections 2024-09-11T00:08:57.075 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.067+0000 7fdf86a63640 1 -- 172.21.15.112:0/885128029 wait complete. 2024-09-11T00:08:57.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.068+0000 7fdf86a63640 1 Processor -- start 2024-09-11T00:08:57.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.068+0000 7fdf86a63640 1 -- start start 2024-09-11T00:08:57.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.068+0000 7fdf86a63640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf80103b70 0x7fdf80199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:57.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.068+0000 7fdf86a63640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf80104570 0x7fdf80199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:57.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.068+0000 7fdf86a63640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf8010d120 0x7fdf8019ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:57.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.068+0000 7fdf86a63640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdf80112da0 con 0x7fdf8010d120 2024-09-11T00:08:57.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.068+0000 7fdf86a63640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdf80112c20 con 0x7fdf80103b70 2024-09-11T00:08:57.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.068+0000 7fdf86a63640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdf80112f20 con 0x7fdf80104570 2024-09-11T00:08:57.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.068+0000 7fdf7ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf80103b70 0x7fdf80199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:57.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.068+0000 7fdf7ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf80103b70 0x7fdf80199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:38086/0 (socket says 172.21.15.112:38086) 2024-09-11T00:08:57.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.068+0000 7fdf7ffff640 1 -- 172.21.15.112:0/4204612360 learned_addr learned my addr 172.21.15.112:0/4204612360 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-11T00:08:57.076 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.069+0000 7fdf7f7fe640 1 --2- 172.21.15.112:0/4204612360 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf80104570 0x7fdf80199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:57.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.069+0000 7fdf7ffff640 1 -- 172.21.15.112:0/4204612360 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf80104570 msgr2=0x7fdf80199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:57.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.069+0000 7fdf7ffff640 1 --2- 172.21.15.112:0/4204612360 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf80104570 0x7fdf80199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:57.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.069+0000 7fdf7ffff640 1 -- 172.21.15.112:0/4204612360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf8010d120 msgr2=0x7fdf8019ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:08:57.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.069+0000 7fdf7ffff640 1 --2- 172.21.15.112:0/4204612360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf8010d120 0x7fdf8019ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:08:57.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.069+0000 7fdf7ffff640 1 -- 172.21.15.112:0/4204612360 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf8019f3c0 con 0x7fdf80103b70 2024-09-11T00:08:57.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.069+0000 7fdf7f7fe640 1 --2- 172.21.15.112:0/4204612360 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf80104570 0x7fdf80199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:08:57.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.069+0000 7fdf7ffff640 1 --2- 172.21.15.112:0/4204612360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf80103b70 0x7fdf80199310 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000b4a0 tx=0x7fdf7000b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:57.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.069+0000 7fdf7d7fa640 1 -- 172.21.15.112:0/4204612360 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf70014070 con 0x7fdf80103b70 2024-09-11T00:08:57.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.069+0000 7fdf86a63640 1 -- 172.21.15.112:0/4204612360 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf8019f6b0 con 0x7fdf80103b70 2024-09-11T00:08:57.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.069+0000 7fdf7d7fa640 1 -- 172.21.15.112:0/4204612360 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf70010ac0 con 0x7fdf80103b70 2024-09-11T00:08:57.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.069+0000 7fdf7d7fa640 1 -- 172.21.15.112:0/4204612360 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf70017c30 con 0x7fdf80103b70 2024-09-11T00:08:57.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.069+0000 7fdf86a63640 1 -- 172.21.15.112:0/4204612360 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf801a5d70 con 0x7fdf80103b70 2024-09-11T00:08:57.077 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.070+0000 7fdf86a63640 1 -- 172.21.15.112:0/4204612360 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf80103f50 con 0x7fdf80103b70 2024-09-11T00:08:57.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.072+0000 7fdf7d7fa640 1 -- 172.21.15.112:0/4204612360 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7fdf70010610 con 0x7fdf80103b70 2024-09-11T00:08:57.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.073+0000 7fdf7d7fa640 1 --2- 172.21.15.112:0/4204612360 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdf6c0b5320 0x7fdf6c0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:08:57.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.073+0000 7fdf7d7fa640 1 -- 172.21.15.112:0/4204612360 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1702+0+0 (secure 0 0 0) 0x7fdf700e3850 con 0x7fdf80103b70 2024-09-11T00:08:57.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.073+0000 7fdf7f7fe640 1 --2- 172.21.15.112:0/4204612360 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdf6c0b5320 0x7fdf6c0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:08:57.078 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.074+0000 7fdf7f7fe640 1 --2- 172.21.15.112:0/4204612360 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdf6c0b5320 0x7fdf6c0b77e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdf68000c00 tx=0x7fdf68031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:08:57.079 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.077+0000 7fdf7d7fa640 1 -- 172.21.15.112:0/4204612360 <== mon.2 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdf700ac120 con 0x7fdf80103b70 2024-09-11T00:08:57.083 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:08:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-0[48993]: 2024-09-11T00:08:56.638+0000 7f5b2adec640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T00:08:57.083 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:08:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-0[48993]: 2024-09-11T00:08:56.641+0000 7f5b22c0b640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:08:57.272 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:08:57.271+0000 7fdf86a63640 1 -- 172.21.15.112:0/4204612360 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fdf80063590 con 0x7fdf6c0b5320 2024-09-11T00:08:57.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:57 smithi138 ceph-mon[35019]: from='osd.0 [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-11T00:08:57.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:57 smithi138 ceph-mon[35019]: osdmap e8: 1 total, 0 up, 1 in 2024-09-11T00:08:57.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:57 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:08:57.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:57 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:08:57.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:57 smithi138 ceph-mon[35019]: Detected new or changed devices on smithi078 2024-09-11T00:08:57.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:57 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:57.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:57 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:57.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:57 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:08:57.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:57 smithi138 ceph-mon[35019]: Adjusting osd_memory_target on smithi078 to 17088M 2024-09-11T00:08:57.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:57 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:57.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:57 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:57.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:57 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:57.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:57 smithi138 ceph-mon[35019]: from='osd.0 [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730]' entity='osd.0' 2024-09-11T00:08:57.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:57 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:57.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:57 smithi078 ceph-mon[30865]: from='osd.0 [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-11T00:08:57.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:57 smithi078 ceph-mon[30865]: osdmap e8: 1 total, 0 up, 1 in 2024-09-11T00:08:57.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:57 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:08:57.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:57 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:08:57.585 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:57 smithi078 ceph-mon[30865]: Detected new or changed devices on smithi078 2024-09-11T00:08:57.585 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:57 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:57.585 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:57 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:57.585 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:57 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:08:57.586 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:57 smithi078 ceph-mon[30865]: Adjusting osd_memory_target on smithi078 to 17088M 2024-09-11T00:08:57.586 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:57 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:57.586 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:57 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:57.586 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:57 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:57.586 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:57 smithi078 ceph-mon[30865]: from='osd.0 [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730]' entity='osd.0' 2024-09-11T00:08:57.586 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:57 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:57.642 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:57 smithi112 ceph-mon[35627]: from='osd.0 [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-11T00:08:57.643 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:57 smithi112 ceph-mon[35627]: osdmap e8: 1 total, 0 up, 1 in 2024-09-11T00:08:57.643 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:57 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:08:57.643 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:57 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:08:57.643 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:57 smithi112 ceph-mon[35627]: Detected new or changed devices on smithi078 2024-09-11T00:08:57.643 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:57 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:57.643 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:57 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:57.643 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:57 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:08:57.643 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:57 smithi112 ceph-mon[35627]: Adjusting osd_memory_target on smithi078 to 17088M 2024-09-11T00:08:57.643 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:57 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:57.643 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:57 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:57.643 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:57 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:08:57.643 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:57 smithi112 ceph-mon[35627]: from='osd.0 [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730]' entity='osd.0' 2024-09-11T00:08:57.643 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:57 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:08:58.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:58 smithi138 ceph-mon[35019]: purged_snaps scrub starts 2024-09-11T00:08:58.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:58 smithi138 ceph-mon[35019]: purged_snaps scrub ok 2024-09-11T00:08:58.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:08:58.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:58 smithi138 ceph-mon[35019]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:08:58.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:08:58.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:08:58.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:58.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:58 smithi138 ceph-mon[35019]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:58.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:58 smithi138 ceph-mon[35019]: osd.0 [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730] boot 2024-09-11T00:08:58.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:58 smithi138 ceph-mon[35019]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T00:08:58.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:08:58.564 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:58 smithi112 ceph-mon[35627]: purged_snaps scrub starts 2024-09-11T00:08:58.564 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:58 smithi112 ceph-mon[35627]: purged_snaps scrub ok 2024-09-11T00:08:58.564 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:08:58.564 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:58 smithi112 ceph-mon[35627]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:08:58.564 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:08:58.565 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:08:58.565 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:58.565 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:58 smithi112 ceph-mon[35627]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:58.565 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:58 smithi112 ceph-mon[35627]: osd.0 [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730] boot 2024-09-11T00:08:58.565 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:58 smithi112 ceph-mon[35627]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T00:08:58.565 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:08:58.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:58 smithi078 ceph-mon[30865]: purged_snaps scrub starts 2024-09-11T00:08:58.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:58 smithi078 ceph-mon[30865]: purged_snaps scrub ok 2024-09-11T00:08:58.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:08:58.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:58 smithi078 ceph-mon[30865]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:08:58.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:08:58.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:08:58.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:08:58.585 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:58 smithi078 ceph-mon[30865]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:08:58.585 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:58 smithi078 ceph-mon[30865]: osd.0 [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730] boot 2024-09-11T00:08:58.585 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:58 smithi078 ceph-mon[30865]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T00:08:58.585 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:08:59.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:59 smithi112 ceph-mon[35627]: osdmap e10: 1 total, 1 up, 1 in 2024-09-11T00:08:59.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:59 smithi112 ceph-mon[35627]: from='client.? 172.21.15.112:0/1181382779' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d0f286a2-a121-40ee-8134-67ef01b1bc9d"} : dispatch 2024-09-11T00:08:59.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:59 smithi112 ceph-mon[35627]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d0f286a2-a121-40ee-8134-67ef01b1bc9d"} : dispatch 2024-09-11T00:08:59.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:59 smithi112 ceph-mon[35627]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d0f286a2-a121-40ee-8134-67ef01b1bc9d"}]': finished 2024-09-11T00:08:59.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:59 smithi112 ceph-mon[35627]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T00:08:59.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:08:59 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:09:00.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:59 smithi138 ceph-mon[35019]: osdmap e10: 1 total, 1 up, 1 in 2024-09-11T00:09:00.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:59 smithi138 ceph-mon[35019]: from='client.? 172.21.15.112:0/1181382779' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d0f286a2-a121-40ee-8134-67ef01b1bc9d"} : dispatch 2024-09-11T00:09:00.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:59 smithi138 ceph-mon[35019]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d0f286a2-a121-40ee-8134-67ef01b1bc9d"} : dispatch 2024-09-11T00:09:00.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:59 smithi138 ceph-mon[35019]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d0f286a2-a121-40ee-8134-67ef01b1bc9d"}]': finished 2024-09-11T00:09:00.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:59 smithi138 ceph-mon[35019]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T00:09:00.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:08:59 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:09:00.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:59 smithi078 ceph-mon[30865]: osdmap e10: 1 total, 1 up, 1 in 2024-09-11T00:09:00.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:59 smithi078 ceph-mon[30865]: from='client.? 172.21.15.112:0/1181382779' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d0f286a2-a121-40ee-8134-67ef01b1bc9d"} : dispatch 2024-09-11T00:09:00.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:59 smithi078 ceph-mon[30865]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d0f286a2-a121-40ee-8134-67ef01b1bc9d"} : dispatch 2024-09-11T00:09:00.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:59 smithi078 ceph-mon[30865]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d0f286a2-a121-40ee-8134-67ef01b1bc9d"}]': finished 2024-09-11T00:09:00.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:59 smithi078 ceph-mon[30865]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T00:09:00.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:08:59 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:09:00.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:00 smithi112 ceph-mon[35627]: pgmap v31: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:00.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:00 smithi112 ceph-mon[35627]: from='client.? 172.21.15.112:0/1352747070' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:09:01.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:00 smithi138 ceph-mon[35019]: pgmap v31: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:01.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:00 smithi138 ceph-mon[35019]: from='client.? 172.21.15.112:0/1352747070' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:09:01.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:00 smithi078 ceph-mon[30865]: pgmap v31: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:01.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:00 smithi078 ceph-mon[30865]: from='client.? 172.21.15.112:0/1352747070' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:09:02.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:02 smithi112 ceph-mon[35627]: pgmap v32: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:03.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:02 smithi138 ceph-mon[35019]: pgmap v32: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:03.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:02 smithi078 ceph-mon[30865]: pgmap v32: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:04.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:04 smithi112 ceph-mon[35627]: pgmap v33: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:05.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:04 smithi138 ceph-mon[35019]: pgmap v33: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:05.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:04 smithi078 ceph-mon[30865]: pgmap v33: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:06.956 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:06 smithi112 ceph-mon[35627]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:07.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:06 smithi138 ceph-mon[35019]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:07.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:06 smithi078 ceph-mon[30865]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:08.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:08 smithi112 ceph-mon[35627]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:08.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:08 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-11T00:09:08.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:08 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:09.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:08 smithi138 ceph-mon[35019]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:09.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:08 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-11T00:09:09.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:08 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:09.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:08 smithi078 ceph-mon[30865]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:09.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:08 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-11T00:09:09.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:08 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:09.872 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:09 smithi112 ceph-mon[35627]: Deploying daemon osd.1 on smithi112 2024-09-11T00:09:10.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:09 smithi138 ceph-mon[35019]: Deploying daemon osd.1 on smithi112 2024-09-11T00:09:10.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:09 smithi078 ceph-mon[30865]: Deploying daemon osd.1 on smithi112 2024-09-11T00:09:10.714 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:10 smithi112 ceph-mon[35627]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:11.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:10 smithi138 ceph-mon[35019]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:11.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:10 smithi078 ceph-mon[30865]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:12.788 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:12 smithi112 ceph-mon[35627]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:13.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:12 smithi138 ceph-mon[35019]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:13.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:12 smithi078 ceph-mon[30865]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:14.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:14 smithi112 ceph-mon[35627]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:14.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:14 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:09:14.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:14 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:14.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:14 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:15.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:14 smithi138 ceph-mon[35019]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:15.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:14 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:09:15.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:14 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:15.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:14 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:15.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:14 smithi078 ceph-mon[30865]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:15.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:14 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:09:15.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:14 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:15.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:14 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:16.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:16 smithi112 ceph-mon[35627]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:16.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:16 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:16.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:16 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:16 smithi138 ceph-mon[35019]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:16 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:16 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:17.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:16 smithi078 ceph-mon[30865]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:17.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:16 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:17.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:16 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:17.860 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:17 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:17.861 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:17 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:09:17.861 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:17 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:18.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:17 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:18.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:17 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:09:18.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:17 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:18.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:17 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:18.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:17 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:09:18.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:17 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:18.183 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:09:18.181+0000 7fdf7d7fa640 1 -- 172.21.15.112:0/4204612360 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdf80063590 con 0x7fdf6c0b5320 2024-09-11T00:09:18.184 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 1 on host 'smithi112' 2024-09-11T00:09:18.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:09:18.184+0000 7fdf86a63640 1 -- 172.21.15.112:0/4204612360 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdf6c0b5320 msgr2=0x7fdf6c0b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:18.186 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:09:18.184+0000 7fdf86a63640 1 --2- 172.21.15.112:0/4204612360 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdf6c0b5320 0x7fdf6c0b77e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdf68000c00 tx=0x7fdf68031400 comp rx=0 tx=0).stop 2024-09-11T00:09:18.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:09:18.184+0000 7fdf86a63640 1 -- 172.21.15.112:0/4204612360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf80103b70 msgr2=0x7fdf80199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:18.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:09:18.184+0000 7fdf86a63640 1 --2- 172.21.15.112:0/4204612360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf80103b70 0x7fdf80199310 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000b4a0 tx=0x7fdf7000b960 comp rx=0 tx=0).stop 2024-09-11T00:09:18.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:09:18.184+0000 7fdf86a63640 1 -- 172.21.15.112:0/4204612360 shutdown_connections 2024-09-11T00:09:18.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:09:18.184+0000 7fdf86a63640 1 --2- 172.21.15.112:0/4204612360 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdf6c0b5320 0x7fdf6c0b77e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:18.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:09:18.184+0000 7fdf86a63640 1 --2- 172.21.15.112:0/4204612360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf8010d120 0x7fdf8019ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:18.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:09:18.184+0000 7fdf86a63640 1 --2- 172.21.15.112:0/4204612360 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf80104570 0x7fdf80199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:18.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:09:18.184+0000 7fdf86a63640 1 --2- 172.21.15.112:0/4204612360 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf80103b70 0x7fdf80199310 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:18.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:09:18.184+0000 7fdf86a63640 1 -- 172.21.15.112:0/4204612360 >> 172.21.15.112:0/4204612360 conn(0x7fdf800fd700 msgr2=0x7fdf800fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:18.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:09:18.184+0000 7fdf86a63640 1 -- 172.21.15.112:0/4204612360 shutdown_connections 2024-09-11T00:09:18.187 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:09:18.184+0000 7fdf86a63640 1 -- 172.21.15.112:0/4204612360 wait complete. 2024-09-11T00:09:18.806 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:18 smithi112 ceph-mon[35627]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:18.806 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:18 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:09:18.806 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:18 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:18.806 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:18 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:18.832 DEBUG:teuthology.orchestra.run.smithi112:osd.1> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.1.service 2024-09-11T00:09:18.875 INFO:tasks.cephadm:Deploying osd.2 on smithi138 with /dev/vg_nvme/lv_4... 2024-09-11T00:09:18.875 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T00:09:19.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:18 smithi138 ceph-mon[35019]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:19.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:18 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:09:19.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:18 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:19.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:18 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:19.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:18 smithi078 ceph-mon[30865]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:19.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:18 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:09:19.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:18 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:19.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:18 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:19.127 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:09:20.037 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:09:19 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-1[41333]: 2024-09-11T00:09:19.742+0000 7f5a828bf640 -1 osd.1 0 log_to_monitors true 2024-09-11T00:09:20.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:20 smithi112 ceph-mon[35627]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:20.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:20 smithi112 ceph-mon[35627]: from='osd.1 [v2:172.21.15.112:6800/3186321784,v1:172.21.15.112:6801/3186321784]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-11T00:09:20.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:20 smithi112 ceph-mon[35627]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-11T00:09:21.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:20 smithi138 ceph-mon[35019]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:21.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:20 smithi138 ceph-mon[35019]: from='osd.1 [v2:172.21.15.112:6800/3186321784,v1:172.21.15.112:6801/3186321784]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-11T00:09:21.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:20 smithi138 ceph-mon[35019]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-11T00:09:21.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:20 smithi078 ceph-mon[30865]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:21.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:20 smithi078 ceph-mon[30865]: from='osd.1 [v2:172.21.15.112:6800/3186321784,v1:172.21.15.112:6801/3186321784]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-11T00:09:21.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:20 smithi078 ceph-mon[30865]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-11T00:09:21.375 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:09:21.401 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi138:vg_nvme/lv_4 2024-09-11T00:09:21.653 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:09:21.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:21 smithi112 ceph-mon[35627]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T00:09:22.028 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:21 smithi112 ceph-mon[35627]: from='osd.1 [v2:172.21.15.112:6800/3186321784,v1:172.21.15.112:6801/3186321784]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:09:22.028 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:21 smithi112 ceph-mon[35627]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T00:09:22.028 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:21 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:09:22.028 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:21 smithi112 ceph-mon[35627]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:09:22.028 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:21 smithi112 ceph-mon[35627]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-11T00:09:22.028 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:21 smithi112 ceph-mon[35627]: osdmap e13: 2 total, 1 up, 2 in 2024-09-11T00:09:22.029 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:21 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:09:22.029 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:21 smithi138 ceph-mon[35019]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T00:09:22.029 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:21 smithi138 ceph-mon[35019]: from='osd.1 [v2:172.21.15.112:6800/3186321784,v1:172.21.15.112:6801/3186321784]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:09:22.029 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:21 smithi138 ceph-mon[35019]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T00:09:22.029 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:21 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:09:22.029 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:21 smithi138 ceph-mon[35019]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:09:22.030 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:21 smithi138 ceph-mon[35019]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-11T00:09:22.030 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:21 smithi138 ceph-mon[35019]: osdmap e13: 2 total, 1 up, 2 in 2024-09-11T00:09:22.030 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:21 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:09:22.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:21 smithi078 ceph-mon[30865]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T00:09:22.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:21 smithi078 ceph-mon[30865]: from='osd.1 [v2:172.21.15.112:6800/3186321784,v1:172.21.15.112:6801/3186321784]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:09:22.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:21 smithi078 ceph-mon[30865]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T00:09:22.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:21 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:09:22.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:21 smithi078 ceph-mon[30865]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:09:22.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:21 smithi078 ceph-mon[30865]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-11T00:09:22.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:21 smithi078 ceph-mon[30865]: osdmap e13: 2 total, 1 up, 2 in 2024-09-11T00:09:22.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:21 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:09:22.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.092+0000 7f743b6e9640 1 -- 172.21.15.138:0/659935132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7434108020 msgr2=0x7f743410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:22.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.092+0000 7f743b6e9640 1 --2- 172.21.15.138:0/659935132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7434108020 0x7f743410e820 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f742c009ca0 tx=0x7f742c02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.092+0000 7f743b6e9640 1 -- 172.21.15.138:0/659935132 shutdown_connections 2024-09-11T00:09:22.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.093+0000 7f743b6e9640 1 --2- 172.21.15.138:0/659935132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7434108020 0x7f743410e820 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.093+0000 7f743b6e9640 1 --2- 172.21.15.138:0/659935132 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f74341076a0 0x7f7434107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.093+0000 7f743b6e9640 1 --2- 172.21.15.138:0/659935132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7434101c90 0x7f7434102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.093+0000 7f743b6e9640 1 -- 172.21.15.138:0/659935132 >> 172.21.15.138:0/659935132 conn(0x7f74340fd700 msgr2=0x7f74340ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:22.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.093+0000 7f743b6e9640 1 -- 172.21.15.138:0/659935132 shutdown_connections 2024-09-11T00:09:22.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.093+0000 7f743b6e9640 1 -- 172.21.15.138:0/659935132 wait complete. 2024-09-11T00:09:22.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.093+0000 7f743b6e9640 1 Processor -- start 2024-09-11T00:09:22.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.093+0000 7f743b6e9640 1 -- start start 2024-09-11T00:09:22.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.093+0000 7f743b6e9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7434101c90 0x7f74340fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:22.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.093+0000 7f743b6e9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74341076a0 0x7f74340fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:22.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.093+0000 7f743b6e9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7434108020 0x7f74340fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:22.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.093+0000 7f743b6e9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7434111ce0 con 0x7f74341076a0 2024-09-11T00:09:22.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.093+0000 7f743b6e9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7434111b60 con 0x7f7434101c90 2024-09-11T00:09:22.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.093+0000 7f743b6e9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7434111e60 con 0x7f7434108020 2024-09-11T00:09:22.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.093+0000 7f7439c86640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7434108020 0x7f74340fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:22.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.094+0000 7f7439485640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7434101c90 0x7f74340fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:22.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.094+0000 7f7439c86640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7434108020 0x7f74340fe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:50894/0 (socket says 172.21.15.138:50894) 2024-09-11T00:09:22.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.094+0000 7f7439485640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7434101c90 0x7f74340fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.138:49196/0 (socket says 172.21.15.138:49196) 2024-09-11T00:09:22.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.094+0000 7f7439c86640 1 -- 172.21.15.138:0/996877535 learned_addr learned my addr 172.21.15.138:0/996877535 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-09-11T00:09:22.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.094+0000 7f7438c84640 1 --2- 172.21.15.138:0/996877535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74341076a0 0x7f74340fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:22.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.094+0000 7f7439c86640 1 -- 172.21.15.138:0/996877535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7434101c90 msgr2=0x7f74340fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:22.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.094+0000 7f7439c86640 1 --2- 172.21.15.138:0/996877535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7434101c90 0x7f74340fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.094+0000 7f7439c86640 1 -- 172.21.15.138:0/996877535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74341076a0 msgr2=0x7f74340fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:22.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.094+0000 7f7439c86640 1 --2- 172.21.15.138:0/996877535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74341076a0 0x7f74340fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:22.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.094+0000 7f7439c86640 1 -- 172.21.15.138:0/996877535 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74341a76f0 con 0x7f7434108020 2024-09-11T00:09:22.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.094+0000 7f7439485640 1 --2- 172.21.15.138:0/996877535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7434101c90 0x7f74340fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:09:22.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.094+0000 7f7439c86640 1 --2- 172.21.15.138:0/996877535 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7434108020 0x7f74340fe680 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f742c005cc0 tx=0x7f742c02f380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:22.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.094+0000 7f742a7fc640 1 -- 172.21.15.138:0/996877535 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c003bf0 con 0x7f7434108020 2024-09-11T00:09:22.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.094+0000 7f743b6e9640 1 -- 172.21.15.138:0/996877535 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74341a7980 con 0x7f7434108020 2024-09-11T00:09:22.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.094+0000 7f742a7fc640 1 -- 172.21.15.138:0/996877535 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f742c003d90 con 0x7f7434108020 2024-09-11T00:09:22.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.094+0000 7f742a7fc640 1 -- 172.21.15.138:0/996877535 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c02fb20 con 0x7f7434108020 2024-09-11T00:09:22.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.094+0000 7f743b6e9640 1 -- 172.21.15.138:0/996877535 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74341a7ec0 con 0x7f7434108020 2024-09-11T00:09:22.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.095+0000 7f743b6e9640 1 -- 172.21.15.138:0/996877535 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7434102070 con 0x7f7434108020 2024-09-11T00:09:22.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.097+0000 7f742a7fc640 1 -- 172.21.15.138:0/996877535 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f742c004580 con 0x7f7434108020 2024-09-11T00:09:22.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.097+0000 7f742a7fc640 1 --2- 172.21.15.138:0/996877535 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f74200b52a0 0x7f74200b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:22.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.098+0000 7f742a7fc640 1 -- 172.21.15.138:0/996877535 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2244+0+0 (secure 0 0 0) 0x7f742c105770 con 0x7f7434108020 2024-09-11T00:09:22.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.098+0000 7f7439485640 1 --2- 172.21.15.138:0/996877535 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f74200b52a0 0x7f74200b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:22.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.098+0000 7f7439485640 1 --2- 172.21.15.138:0/996877535 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f74200b52a0 0x7f74200b7760 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7430009d60 tx=0x7f7430009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:22.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.101+0000 7f742a7fc640 1 -- 172.21.15.138:0/996877535 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f742c0cdec0 con 0x7f7434108020 2024-09-11T00:09:22.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:22.288+0000 7f743b6e9640 1 -- 172.21.15.138:0/996877535 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f743406aab0 con 0x7f74200b52a0 2024-09-11T00:09:22.482 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:09:22 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-1[41333]: 2024-09-11T00:09:22.148+0000 7f5a7e842640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T00:09:22.482 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:09:22 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-1[41333]: 2024-09-11T00:09:22.151+0000 7f5a76661640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:09:22.928 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:22 smithi138 ceph-mon[35019]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:22.928 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:22 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:09:22.928 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:22 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:22.928 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:22 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:22.928 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:22 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:09:22.928 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:22 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:22.929 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:22 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:22.929 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:22 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:09:22.929 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:22 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:22.929 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:22 smithi138 ceph-mon[35019]: from='osd.1 ' entity='osd.1' 2024-09-11T00:09:22.929 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:22 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:09:22.929 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:22 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:09:22.929 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:22 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:22.929 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:22 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:09:22.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:22 smithi112 ceph-mon[35627]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:22.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:22 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:09:22.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:22 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:22.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:22 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:22.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:22 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:09:22.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:22 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:22.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:22 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:22.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:22 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:09:22.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:22 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:22.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:22 smithi112 ceph-mon[35627]: from='osd.1 ' entity='osd.1' 2024-09-11T00:09:22.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:22 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:09:22.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:22 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:09:22.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:22 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:22.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:22 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:09:23.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:22 smithi078 ceph-mon[30865]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:23.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:22 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:09:23.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:22 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:23.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:22 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:23.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:22 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:09:23.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:22 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:23.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:22 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:23.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:22 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:09:23.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:22 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:23.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:22 smithi078 ceph-mon[30865]: from='osd.1 ' entity='osd.1' 2024-09-11T00:09:23.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:22 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:09:23.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:22 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:09:23.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:22 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:23.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:22 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:09:23.889 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:23 smithi138 ceph-mon[35019]: purged_snaps scrub starts 2024-09-11T00:09:23.889 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:23 smithi138 ceph-mon[35019]: purged_snaps scrub ok 2024-09-11T00:09:23.889 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:23 smithi138 ceph-mon[35019]: Detected new or changed devices on smithi112 2024-09-11T00:09:23.889 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:23 smithi138 ceph-mon[35019]: Adjusting osd_memory_target on smithi112 to 17088M 2024-09-11T00:09:23.889 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:23 smithi138 ceph-mon[35019]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:09:23.889 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:23 smithi138 ceph-mon[35019]: osd.1 [v2:172.21.15.112:6800/3186321784,v1:172.21.15.112:6801/3186321784] boot 2024-09-11T00:09:23.889 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:23 smithi138 ceph-mon[35019]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T00:09:23.889 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:23 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:09:23.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:23 smithi112 ceph-mon[35627]: purged_snaps scrub starts 2024-09-11T00:09:23.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:23 smithi112 ceph-mon[35627]: purged_snaps scrub ok 2024-09-11T00:09:23.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:23 smithi112 ceph-mon[35627]: Detected new or changed devices on smithi112 2024-09-11T00:09:23.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:23 smithi112 ceph-mon[35627]: Adjusting osd_memory_target on smithi112 to 17088M 2024-09-11T00:09:23.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:23 smithi112 ceph-mon[35627]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:09:23.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:23 smithi112 ceph-mon[35627]: osd.1 [v2:172.21.15.112:6800/3186321784,v1:172.21.15.112:6801/3186321784] boot 2024-09-11T00:09:23.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:23 smithi112 ceph-mon[35627]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T00:09:23.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:23 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:09:24.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:23 smithi078 ceph-mon[30865]: purged_snaps scrub starts 2024-09-11T00:09:24.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:23 smithi078 ceph-mon[30865]: purged_snaps scrub ok 2024-09-11T00:09:24.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:23 smithi078 ceph-mon[30865]: Detected new or changed devices on smithi112 2024-09-11T00:09:24.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:23 smithi078 ceph-mon[30865]: Adjusting osd_memory_target on smithi112 to 17088M 2024-09-11T00:09:24.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:23 smithi078 ceph-mon[30865]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:09:24.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:23 smithi078 ceph-mon[30865]: osd.1 [v2:172.21.15.112:6800/3186321784,v1:172.21.15.112:6801/3186321784] boot 2024-09-11T00:09:24.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:23 smithi078 ceph-mon[30865]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T00:09:24.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:23 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:09:24.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:24 smithi112 ceph-mon[35627]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:24.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:24 smithi112 ceph-mon[35627]: from='client.? 172.21.15.138:0/3174675593' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0eadcce5-12af-4af6-9b4e-159e84454d8f"} : dispatch 2024-09-11T00:09:24.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:24 smithi112 ceph-mon[35627]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0eadcce5-12af-4af6-9b4e-159e84454d8f"} : dispatch 2024-09-11T00:09:24.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:24 smithi112 ceph-mon[35627]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0eadcce5-12af-4af6-9b4e-159e84454d8f"}]': finished 2024-09-11T00:09:24.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:24 smithi112 ceph-mon[35627]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T00:09:24.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:24 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T00:09:25.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:24 smithi138 ceph-mon[35019]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:25.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:24 smithi138 ceph-mon[35019]: from='client.? 172.21.15.138:0/3174675593' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0eadcce5-12af-4af6-9b4e-159e84454d8f"} : dispatch 2024-09-11T00:09:25.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:24 smithi138 ceph-mon[35019]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0eadcce5-12af-4af6-9b4e-159e84454d8f"} : dispatch 2024-09-11T00:09:25.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:24 smithi138 ceph-mon[35019]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0eadcce5-12af-4af6-9b4e-159e84454d8f"}]': finished 2024-09-11T00:09:25.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:24 smithi138 ceph-mon[35019]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T00:09:25.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:24 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T00:09:25.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:24 smithi078 ceph-mon[30865]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:09:25.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:24 smithi078 ceph-mon[30865]: from='client.? 172.21.15.138:0/3174675593' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0eadcce5-12af-4af6-9b4e-159e84454d8f"} : dispatch 2024-09-11T00:09:25.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:24 smithi078 ceph-mon[30865]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0eadcce5-12af-4af6-9b4e-159e84454d8f"} : dispatch 2024-09-11T00:09:25.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:24 smithi078 ceph-mon[30865]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0eadcce5-12af-4af6-9b4e-159e84454d8f"}]': finished 2024-09-11T00:09:25.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:24 smithi078 ceph-mon[30865]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T00:09:25.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:24 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T00:09:25.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:25 smithi112 ceph-mon[35627]: from='client.? 172.21.15.138:0/4042424698' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:09:26.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:25 smithi138 ceph-mon[35019]: from='client.? 172.21.15.138:0/4042424698' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:09:26.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:25 smithi078 ceph-mon[30865]: from='client.? 172.21.15.138:0/4042424698' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:09:26.981 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:26 smithi112 ceph-mon[35627]: pgmap v48: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:26.984 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:26 smithi078 ceph-mon[30865]: pgmap v48: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:27.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:26 smithi138 ceph-mon[35019]: pgmap v48: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:28.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:27 smithi138 ceph-mon[35019]: pgmap v49: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:28.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:27 smithi078 ceph-mon[30865]: pgmap v49: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:28.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:27 smithi112 ceph-mon[35627]: pgmap v49: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:30.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:30 smithi138 ceph-mon[35019]: pgmap v50: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:30.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:30 smithi112 ceph-mon[35627]: pgmap v50: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:31.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:30 smithi078 ceph-mon[30865]: pgmap v50: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:32.723 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:32 smithi138 ceph-mon[35019]: pgmap v51: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:32.723 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:32 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-11T00:09:32.723 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:32 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:32.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:32 smithi112 ceph-mon[35627]: pgmap v51: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:32.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:32 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-11T00:09:32.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:32 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:33.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:32 smithi078 ceph-mon[30865]: pgmap v51: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:33.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:32 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-11T00:09:33.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:32 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:33.854 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:33 smithi138 ceph-mon[35019]: Deploying daemon osd.2 on smithi138 2024-09-11T00:09:33.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:33 smithi112 ceph-mon[35627]: Deploying daemon osd.2 on smithi138 2024-09-11T00:09:34.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:33 smithi078 ceph-mon[30865]: Deploying daemon osd.2 on smithi138 2024-09-11T00:09:34.780 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:34 smithi138 ceph-mon[35019]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:34.981 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:34 smithi112 ceph-mon[35627]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:35.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:34 smithi078 ceph-mon[30865]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:36.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:36 smithi112 ceph-mon[35627]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:37.033 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:36 smithi138 ceph-mon[35019]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:37.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:36 smithi078 ceph-mon[30865]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:38.915 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:38 smithi138 ceph-mon[35019]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:38.915 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:38 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:09:38.915 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:38 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:38.915 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:38 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:38.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:38 smithi112 ceph-mon[35627]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:38.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:38 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:09:38.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:38 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:38.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:38 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:39.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:38 smithi078 ceph-mon[30865]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:39.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:38 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:09:39.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:38 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:39.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:38 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:40.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:40 smithi112 ceph-mon[35627]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:40.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:40.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:40.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:40.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:09:40.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:41.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:40 smithi138 ceph-mon[35019]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:41.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:41.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:41.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:41.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:09:41.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:41.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:40 smithi078 ceph-mon[30865]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:41.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:41.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:41.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:41.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:09:41.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:42.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:42.201+0000 7f742a7fc640 1 -- 172.21.15.138:0/996877535 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f743406aab0 con 0x7f74200b52a0 2024-09-11T00:09:42.203 INFO:teuthology.orchestra.run.smithi138.stdout:Created osd(s) 2 on host 'smithi138' 2024-09-11T00:09:42.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:42.203+0000 7f743b6e9640 1 -- 172.21.15.138:0/996877535 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f74200b52a0 msgr2=0x7f74200b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:42.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:42.203+0000 7f743b6e9640 1 --2- 172.21.15.138:0/996877535 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f74200b52a0 0x7f74200b7760 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7430009d60 tx=0x7f7430009110 comp rx=0 tx=0).stop 2024-09-11T00:09:42.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:42.203+0000 7f743b6e9640 1 -- 172.21.15.138:0/996877535 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7434108020 msgr2=0x7f74340fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:42.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:42.203+0000 7f743b6e9640 1 --2- 172.21.15.138:0/996877535 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7434108020 0x7f74340fe680 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f742c005cc0 tx=0x7f742c02f380 comp rx=0 tx=0).stop 2024-09-11T00:09:42.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:42.203+0000 7f743b6e9640 1 -- 172.21.15.138:0/996877535 shutdown_connections 2024-09-11T00:09:42.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:42.204+0000 7f743b6e9640 1 --2- 172.21.15.138:0/996877535 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f74200b52a0 0x7f74200b7760 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:42.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:42.204+0000 7f743b6e9640 1 --2- 172.21.15.138:0/996877535 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7434108020 0x7f74340fe680 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:42.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:42.204+0000 7f743b6e9640 1 --2- 172.21.15.138:0/996877535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74341076a0 0x7f74340fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:42.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:42.204+0000 7f743b6e9640 1 --2- 172.21.15.138:0/996877535 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7434101c90 0x7f74340fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:42.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:42.204+0000 7f743b6e9640 1 -- 172.21.15.138:0/996877535 >> 172.21.15.138:0/996877535 conn(0x7f74340fd700 msgr2=0x7f7434100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:42.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:42.204+0000 7f743b6e9640 1 -- 172.21.15.138:0/996877535 shutdown_connections 2024-09-11T00:09:42.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:09:42.204+0000 7f743b6e9640 1 -- 172.21.15.138:0/996877535 wait complete. 2024-09-11T00:09:42.849 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:42 smithi138 ceph-mon[35019]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:42.849 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:42 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:09:42.849 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:42 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:42.849 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:42 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:42.876 DEBUG:teuthology.orchestra.run.smithi138:osd.2> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.2.service 2024-09-11T00:09:42.879 INFO:tasks.cephadm:Deploying osd.3 on smithi078 with /dev/vg_nvme/lv_3... 2024-09-11T00:09:42.879 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T00:09:42.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:42 smithi112 ceph-mon[35627]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:42.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:42 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:09:42.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:42 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:42.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:42 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:43.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:42 smithi078 ceph-mon[30865]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:43.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:42 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:09:43.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:42 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:43.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:42 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:43.141 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:09:44.067 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:09:43 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-2[41172]: 2024-09-11T00:09:43.810+0000 7efdceaee640 -1 osd.2 0 log_to_monitors true 2024-09-11T00:09:44.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:44 smithi112 ceph-mon[35627]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:44.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:44 smithi112 ceph-mon[35627]: from='osd.2 [v2:172.21.15.138:6800/3206386630,v1:172.21.15.138:6801/3206386630]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-11T00:09:44.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:44 smithi112 ceph-mon[35627]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-11T00:09:45.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:44 smithi138 ceph-mon[35019]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:45.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:44 smithi138 ceph-mon[35019]: from='osd.2 [v2:172.21.15.138:6800/3206386630,v1:172.21.15.138:6801/3206386630]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-11T00:09:45.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:44 smithi138 ceph-mon[35019]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-11T00:09:45.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:44 smithi078 ceph-mon[30865]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:45.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:44 smithi078 ceph-mon[30865]: from='osd.2 [v2:172.21.15.138:6800/3206386630,v1:172.21.15.138:6801/3206386630]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-11T00:09:45.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:44 smithi078 ceph-mon[30865]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-11T00:09:45.517 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:09:45.544 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi078:vg_nvme/lv_3 2024-09-11T00:09:45.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:45 smithi138 ceph-mon[35019]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T00:09:45.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:45 smithi138 ceph-mon[35019]: from='osd.2 [v2:172.21.15.138:6800/3206386630,v1:172.21.15.138:6801/3206386630]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:09:45.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:45 smithi138 ceph-mon[35019]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T00:09:45.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:45 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T00:09:45.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:45 smithi138 ceph-mon[35019]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:09:45.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:45 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:45.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:45 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:45.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:45 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T00:09:45.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:45 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:45.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:45 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:45.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:45 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:09:45.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:45 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:45.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:45 smithi138 ceph-mon[35019]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-11T00:09:45.805 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:09:45.831 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:45 smithi078 ceph-mon[30865]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T00:09:45.831 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:45 smithi078 ceph-mon[30865]: from='osd.2 [v2:172.21.15.138:6800/3206386630,v1:172.21.15.138:6801/3206386630]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:09:45.831 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:45 smithi078 ceph-mon[30865]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T00:09:45.831 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:45 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T00:09:45.831 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:45 smithi078 ceph-mon[30865]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:09:45.831 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:45 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:45.831 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:45 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:45.831 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:45 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T00:09:45.831 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:45 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:45.831 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:45 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:45.831 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:45 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:09:45.831 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:45 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:45.832 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:45 smithi078 ceph-mon[30865]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-11T00:09:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:45 smithi112 ceph-mon[35627]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T00:09:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:45 smithi112 ceph-mon[35627]: from='osd.2 [v2:172.21.15.138:6800/3206386630,v1:172.21.15.138:6801/3206386630]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:09:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:45 smithi112 ceph-mon[35627]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T00:09:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:45 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T00:09:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:45 smithi112 ceph-mon[35627]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:09:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:45 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:45 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:45 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T00:09:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:45 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:45 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:45 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:09:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:45 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:45 smithi112 ceph-mon[35627]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-11T00:09:46.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.318+0000 7f75afc70640 1 -- 172.21.15.78:0/1844454724 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a81076a0 msgr2=0x7f75a8107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:46.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.318+0000 7f75afc70640 1 --2- 172.21.15.78:0/1844454724 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a81076a0 0x7f75a8107ae0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7598009900 tx=0x7f759802a410 comp rx=0 tx=0).stop 2024-09-11T00:09:46.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.318+0000 7f75afc70640 1 -- 172.21.15.78:0/1844454724 shutdown_connections 2024-09-11T00:09:46.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.318+0000 7f75afc70640 1 --2- 172.21.15.78:0/1844454724 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75a8108020 0x7f75a810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:46.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.318+0000 7f75afc70640 1 --2- 172.21.15.78:0/1844454724 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a81076a0 0x7f75a8107ae0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:46.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.318+0000 7f75afc70640 1 --2- 172.21.15.78:0/1844454724 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75a8101c90 0x7f75a8102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:46.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.318+0000 7f75afc70640 1 -- 172.21.15.78:0/1844454724 >> 172.21.15.78:0/1844454724 conn(0x7f75a80fd700 msgr2=0x7f75a80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:09:46.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.318+0000 7f75afc70640 1 -- 172.21.15.78:0/1844454724 shutdown_connections 2024-09-11T00:09:46.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.318+0000 7f75afc70640 1 -- 172.21.15.78:0/1844454724 wait complete. 2024-09-11T00:09:46.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.319+0000 7f75afc70640 1 Processor -- start 2024-09-11T00:09:46.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.319+0000 7f75afc70640 1 -- start start 2024-09-11T00:09:46.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.319+0000 7f75afc70640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75a8101c90 0x7f75a819a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:46.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.319+0000 7f75afc70640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75a81076a0 0x7f75a819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:46.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.319+0000 7f75afc70640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a8108020 0x7f75a819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:46.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.319+0000 7f75afc70640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f75a8111ce0 con 0x7f75a8108020 2024-09-11T00:09:46.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.319+0000 7f75afc70640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f75a8111b60 con 0x7f75a8101c90 2024-09-11T00:09:46.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.319+0000 7f75afc70640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f75a8111e60 con 0x7f75a81076a0 2024-09-11T00:09:46.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.319+0000 7f75ae20d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a8108020 0x7f75a819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:46.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.319+0000 7f75ae20d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a8108020 0x7f75a819abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37152/0 (socket says 172.21.15.78:37152) 2024-09-11T00:09:46.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.319+0000 7f75ae20d640 1 -- 172.21.15.78:0/1531013755 learned_addr learned my addr 172.21.15.78:0/1531013755 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:09:46.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.319+0000 7f75ada0c640 1 --2- 172.21.15.78:0/1531013755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75a8101c90 0x7f75a819a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:46.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.319+0000 7f75ad20b640 1 --2- 172.21.15.78:0/1531013755 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75a81076a0 0x7f75a819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:46.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.319+0000 7f75ae20d640 1 -- 172.21.15.78:0/1531013755 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75a81076a0 msgr2=0x7f75a819a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:46.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.319+0000 7f75ae20d640 1 --2- 172.21.15.78:0/1531013755 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75a81076a0 0x7f75a819a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:46.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.319+0000 7f75ae20d640 1 -- 172.21.15.78:0/1531013755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75a8101c90 msgr2=0x7f75a819a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:09:46.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.319+0000 7f75ae20d640 1 --2- 172.21.15.78:0/1531013755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75a8101c90 0x7f75a819a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:09:46.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.319+0000 7f75ae20d640 1 -- 172.21.15.78:0/1531013755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a81a54f0 con 0x7f75a8108020 2024-09-11T00:09:46.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.319+0000 7f75ad20b640 1 --2- 172.21.15.78:0/1531013755 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75a81076a0 0x7f75a819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:09:46.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.319+0000 7f75ae20d640 1 --2- 172.21.15.78:0/1531013755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a8108020 0x7f75a819abb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f75a400cad0 tx=0x7f75a400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:46.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.320+0000 7f759effd640 1 -- 172.21.15.78:0/1531013755 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a400ad60 con 0x7f75a8108020 2024-09-11T00:09:46.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.320+0000 7f759effd640 1 -- 172.21.15.78:0/1531013755 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75a4005020 con 0x7f75a8108020 2024-09-11T00:09:46.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.320+0000 7f75afc70640 1 -- 172.21.15.78:0/1531013755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75a81a57e0 con 0x7f75a8108020 2024-09-11T00:09:46.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.320+0000 7f759effd640 1 -- 172.21.15.78:0/1531013755 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a400f6b0 con 0x7f75a8108020 2024-09-11T00:09:46.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.320+0000 7f75afc70640 1 -- 172.21.15.78:0/1531013755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75a81a5d70 con 0x7f75a8108020 2024-09-11T00:09:46.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.321+0000 7f75afc70640 1 -- 172.21.15.78:0/1531013755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75a8102070 con 0x7f75a8108020 2024-09-11T00:09:46.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.322+0000 7f759effd640 1 -- 172.21.15.78:0/1531013755 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 19) ==== 153211+0+0 (secure 0 0 0) 0x7f75a40054f0 con 0x7f75a8108020 2024-09-11T00:09:46.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.323+0000 7f759effd640 1 --2- 172.21.15.78:0/1531013755 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f75940b5320 0x7f75940b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:09:46.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.323+0000 7f75ada0c640 1 --2- 172.21.15.78:0/1531013755 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f75940b5320 0x7f75940b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:09:46.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.323+0000 7f759effd640 1 -- 172.21.15.78:0/1531013755 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2786+0+0 (secure 0 0 0) 0x7f75a40e4530 con 0x7f75a8108020 2024-09-11T00:09:46.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.323+0000 7f75ada0c640 1 --2- 172.21.15.78:0/1531013755 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f75940b5320 0x7f75940b77e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009990 tx=0x7f75a0009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:09:46.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.328+0000 7f759effd640 1 -- 172.21.15.78:0/1531013755 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f75a4014030 con 0x7f75a8108020 2024-09-11T00:09:46.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:46.520+0000 7f75afc70640 1 -- 172.21.15.78:0/1531013755 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f75a8063590 con 0x7f75940b5320 2024-09-11T00:09:46.543 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:09:46 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-2[41172]: 2024-09-11T00:09:46.093+0000 7efdcaa71640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T00:09:46.543 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:09:46 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-2[41172]: 2024-09-11T00:09:46.097+0000 7efdc2890640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:09:46.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:46 smithi078 ceph-mon[30865]: Detected new or changed devices on smithi138 2024-09-11T00:09:46.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:46 smithi078 ceph-mon[30865]: Adjusting osd_memory_target on smithi138 to 17088M 2024-09-11T00:09:46.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:46 smithi078 ceph-mon[30865]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:46.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:46 smithi078 ceph-mon[30865]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T00:09:46.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:46 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T00:09:46.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:46 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T00:09:46.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:46 smithi078 ceph-mon[30865]: from='osd.2 ' entity='osd.2' 2024-09-11T00:09:46.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:46 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:09:46.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:46 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:09:46.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:46 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:46.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:46 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T00:09:46.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:46 smithi112 ceph-mon[35627]: Detected new or changed devices on smithi138 2024-09-11T00:09:46.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:46 smithi112 ceph-mon[35627]: Adjusting osd_memory_target on smithi138 to 17088M 2024-09-11T00:09:46.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:46 smithi112 ceph-mon[35627]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:46.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:46 smithi112 ceph-mon[35627]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T00:09:46.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:46 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T00:09:46.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:46 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T00:09:46.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:46 smithi112 ceph-mon[35627]: from='osd.2 ' entity='osd.2' 2024-09-11T00:09:46.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:46 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:09:46.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:46 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:09:46.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:46 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:46.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:46 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T00:09:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:46 smithi138 ceph-mon[35019]: Detected new or changed devices on smithi138 2024-09-11T00:09:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:46 smithi138 ceph-mon[35019]: Adjusting osd_memory_target on smithi138 to 17088M 2024-09-11T00:09:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:46 smithi138 ceph-mon[35019]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:46 smithi138 ceph-mon[35019]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T00:09:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:46 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T00:09:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:46 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T00:09:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:46 smithi138 ceph-mon[35019]: from='osd.2 ' entity='osd.2' 2024-09-11T00:09:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:46 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:09:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:46 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:09:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:46 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:46 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T00:09:47.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:47 smithi112 ceph-mon[35627]: purged_snaps scrub starts 2024-09-11T00:09:47.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:47 smithi112 ceph-mon[35627]: purged_snaps scrub ok 2024-09-11T00:09:47.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:47 smithi112 ceph-mon[35627]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:09:47.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:47 smithi112 ceph-mon[35627]: osd.2 [v2:172.21.15.138:6800/3206386630,v1:172.21.15.138:6801/3206386630] boot 2024-09-11T00:09:47.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:47 smithi112 ceph-mon[35627]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T00:09:47.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:47 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T00:09:48.024 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:47 smithi078 ceph-mon[30865]: purged_snaps scrub starts 2024-09-11T00:09:48.025 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:47 smithi078 ceph-mon[30865]: purged_snaps scrub ok 2024-09-11T00:09:48.025 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:47 smithi078 ceph-mon[30865]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:09:48.025 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:47 smithi078 ceph-mon[30865]: osd.2 [v2:172.21.15.138:6800/3206386630,v1:172.21.15.138:6801/3206386630] boot 2024-09-11T00:09:48.025 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:47 smithi078 ceph-mon[30865]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T00:09:48.025 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:47 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T00:09:48.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:47 smithi138 ceph-mon[35019]: purged_snaps scrub starts 2024-09-11T00:09:48.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:47 smithi138 ceph-mon[35019]: purged_snaps scrub ok 2024-09-11T00:09:48.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:47 smithi138 ceph-mon[35019]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:09:48.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:47 smithi138 ceph-mon[35019]: osd.2 [v2:172.21.15.138:6800/3206386630,v1:172.21.15.138:6801/3206386630] boot 2024-09-11T00:09:48.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:47 smithi138 ceph-mon[35019]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T00:09:48.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:47 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T00:09:48.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:48 smithi078 ceph-mon[30865]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:48.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:48 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-11T00:09:48.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:48 smithi112 ceph-mon[35627]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:48.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:48 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-11T00:09:49.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:48 smithi138 ceph-mon[35019]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T00:09:49.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:48 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-11T00:09:49.389 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 sudo[53849]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:09:49.389 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 sudo[53849]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:09:49.389 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 sudo[53849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:09:49.389 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 sudo[53849]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:09:49.389 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 sudo[53857]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:09:49.389 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 sudo[53857]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:09:49.389 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 sudo[53857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:09:49.389 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 sudo[53857]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:09:49.390 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:09:49 smithi078 sudo[53840]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:09:49.390 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:09:49 smithi078 sudo[53840]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:09:49.390 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:09:49 smithi078 sudo[53840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:09:49.390 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:09:49 smithi078 sudo[53840]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:09:49.390 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:09:49 smithi078 sudo[53845]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:09:49.390 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:09:49 smithi078 sudo[53845]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:09:49.390 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:09:49 smithi078 sudo[53845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:09:49.390 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:09:49 smithi078 sudo[53845]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:09:49.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 sudo[45580]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:09:49.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 sudo[45580]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:09:49.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 sudo[45580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:09:49.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 sudo[45580]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:09:49.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 sudo[45583]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:09:49.483 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 sudo[45583]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:09:49.483 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 sudo[45583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:09:49.483 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 sudo[45583]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:09:49.483 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:09:49 smithi112 sudo[45574]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:09:49.483 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:09:49 smithi112 sudo[45574]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:09:49.483 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:09:49 smithi112 sudo[45574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:09:49.483 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:09:49 smithi112 sudo[45574]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:09:49.483 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:09:49 smithi112 sudo[45577]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:09:49.484 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:09:49 smithi112 sudo[45577]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:09:49.484 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:09:49 smithi112 sudo[45577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:09:49.484 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:09:49 smithi112 sudo[45577]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:09:49.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 sudo[44981]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:09:49.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 sudo[44981]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:09:49.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 sudo[44981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:09:49.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 sudo[44981]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:09:49.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 sudo[44984]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:09:49.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 sudo[44984]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:09:49.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 sudo[44984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:09:49.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 sudo[44984]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:09:49.544 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:09:49 smithi138 sudo[44975]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T00:09:49.544 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:09:49 smithi138 sudo[44975]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:09:49.544 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:09:49 smithi138 sudo[44975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:09:49.544 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:09:49 smithi138 sudo[44975]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:09:49.544 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:09:49 smithi138 sudo[44978]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T00:09:49.544 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:09:49 smithi138 sudo[44978]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T00:09:49.544 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:09:49 smithi138 sudo[44978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T00:09:49.544 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:09:49 smithi138 sudo[44978]: pam_unix(sudo:session): session closed for user root 2024-09-11T00:09:49.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T00:09:49.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T00:09:49.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-11T00:09:49.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3008921993' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5f3f683d-6306-43da-8bbd-c103eca442ae"} : dispatch 2024-09-11T00:09:49.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T00:09:49.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3008921993' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f3f683d-6306-43da-8bbd-c103eca442ae"}]': finished 2024-09-11T00:09:49.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: osdmap e20: 4 total, 3 up, 4 in 2024-09-11T00:09:49.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T00:09:49.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:49.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:49.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:49.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:09:49.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:09:49.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:09:49.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:09:49.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:09:49.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:09:49.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:09:49.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:09:49.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:09:49.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:09:49.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:09:49.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:09:49.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:09:49.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:09:49.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:09:49.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:49 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/11429361' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:09:50.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T00:09:50.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T00:09:50.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-11T00:09:50.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3008921993' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5f3f683d-6306-43da-8bbd-c103eca442ae"} : dispatch 2024-09-11T00:09:50.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T00:09:50.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3008921993' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f3f683d-6306-43da-8bbd-c103eca442ae"}]': finished 2024-09-11T00:09:50.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: osdmap e20: 4 total, 3 up, 4 in 2024-09-11T00:09:50.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T00:09:50.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:50.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:50.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:50.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:09:50.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:09:50.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:09:50.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:09:50.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:09:50.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:09:50.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:09:50.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:09:50.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:09:50.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:09:50.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:09:50.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:09:50.045 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:09:50.045 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:09:50.045 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:09:50.045 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:49 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/11429361' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:09:50.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T00:09:50.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T00:09:50.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-11T00:09:50.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3008921993' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5f3f683d-6306-43da-8bbd-c103eca442ae"} : dispatch 2024-09-11T00:09:50.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T00:09:50.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3008921993' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f3f683d-6306-43da-8bbd-c103eca442ae"}]': finished 2024-09-11T00:09:50.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: osdmap e20: 4 total, 3 up, 4 in 2024-09-11T00:09:50.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T00:09:50.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:50.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:50.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:09:50.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:09:50.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:09:50.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:09:50.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:09:50.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:09:50.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:09:50.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:09:50.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:09:50.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:09:50.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:09:50.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T00:09:50.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:09:50.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:09:50.086 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:09:50.086 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T00:09:50.086 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:49 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/11429361' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:09:50.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:09:50.298+0000 7f759effd640 1 -- 172.21.15.78:0/1531013755 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f75a40a85d0 con 0x7f75a8108020 2024-09-11T00:09:50.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:50 smithi112 ceph-mon[35627]: pgmap v65: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:09:50.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:50 smithi112 ceph-mon[35627]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T00:09:50.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:50 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T00:09:50.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:50 smithi112 ceph-mon[35627]: mgrmap e20: x(active, since 114s), standbys: z, y 2024-09-11T00:09:51.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:50 smithi138 ceph-mon[35019]: pgmap v65: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:09:51.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:50 smithi138 ceph-mon[35019]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T00:09:51.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:50 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T00:09:51.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:50 smithi138 ceph-mon[35019]: mgrmap e20: x(active, since 114s), standbys: z, y 2024-09-11T00:09:51.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:50 smithi078 ceph-mon[30865]: pgmap v65: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:09:51.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:50 smithi078 ceph-mon[30865]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T00:09:51.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:50 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T00:09:51.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:50 smithi078 ceph-mon[30865]: mgrmap e20: x(active, since 114s), standbys: z, y 2024-09-11T00:09:52.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:52 smithi112 ceph-mon[35627]: pgmap v67: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:09:53.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:52 smithi138 ceph-mon[35019]: pgmap v67: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:09:53.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:52 smithi078 ceph-mon[30865]: pgmap v67: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:09:54.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:54 smithi112 ceph-mon[35627]: pgmap v68: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:09:55.043 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:54 smithi078 ceph-mon[30865]: pgmap v68: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:09:55.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:54 smithi138 ceph-mon[35019]: pgmap v68: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:09:56.916 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:56 smithi078 ceph-mon[30865]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:09:56.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:56 smithi112 ceph-mon[35627]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:09:57.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:56 smithi138 ceph-mon[35019]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:09:57.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:57 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-11T00:09:57.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:57 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:58.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:57 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-11T00:09:58.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:57 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:58.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:57 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-11T00:09:58.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:57 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:09:59.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:58 smithi138 ceph-mon[35019]: Deploying daemon osd.3 on smithi078 2024-09-11T00:09:59.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:58 smithi138 ceph-mon[35019]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:09:59.078 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:58 smithi078 ceph-mon[30865]: Deploying daemon osd.3 on smithi078 2024-09-11T00:09:59.079 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:58 smithi078 ceph-mon[30865]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:09:59.231 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:58 smithi112 ceph-mon[35627]: Deploying daemon osd.3 on smithi078 2024-09-11T00:09:59.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:58 smithi112 ceph-mon[35627]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:10:00.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:09:59 smithi138 ceph-mon[35019]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:10:00.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:09:59 smithi078 ceph-mon[30865]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:10:00.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:09:59 smithi112 ceph-mon[35627]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:10:00.992 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:00 smithi078 ceph-mon[30865]: overall HEALTH_OK 2024-09-11T00:10:01.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:00 smithi138 ceph-mon[35019]: overall HEALTH_OK 2024-09-11T00:10:01.231 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:00 smithi112 ceph-mon[35627]: overall HEALTH_OK 2024-09-11T00:10:02.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:01 smithi138 ceph-mon[35019]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:10:02.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:01 smithi078 ceph-mon[30865]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:10:02.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:01 smithi112 ceph-mon[35627]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:10:04.922 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:04 smithi078 ceph-mon[30865]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:10:04.923 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:04 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:04.923 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:04 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:04.923 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:04 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:04.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:04 smithi112 ceph-mon[35627]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:10:04.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:04 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:04.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:04 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:04.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:04 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:05.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:04 smithi138 ceph-mon[35019]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:10:05.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:04 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:05.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:04 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:05.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:04 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:06.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:06 smithi112 ceph-mon[35627]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:10:06.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:06 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:06.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:06 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:06.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:06 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:06.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:06 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:10:06.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:06 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:07.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:06 smithi138 ceph-mon[35019]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:10:07.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:06 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:07.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:06 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:07.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:06 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:07.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:06 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:10:07.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:06 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:07.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:06 smithi078 ceph-mon[30865]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:10:07.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:06 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:07.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:06 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:07.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:06 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:07.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:06 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:10:07.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:06 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:07.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:10:07.811+0000 7f759effd640 1 -- 172.21.15.78:0/1531013755 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f75a8063590 con 0x7f75940b5320 2024-09-11T00:10:07.814 INFO:teuthology.orchestra.run.smithi078.stdout:Created osd(s) 3 on host 'smithi078' 2024-09-11T00:10:07.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:10:07.814+0000 7f75afc70640 1 -- 172.21.15.78:0/1531013755 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f75940b5320 msgr2=0x7f75940b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:07.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:10:07.814+0000 7f75afc70640 1 --2- 172.21.15.78:0/1531013755 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f75940b5320 0x7f75940b77e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009990 tx=0x7f75a0009110 comp rx=0 tx=0).stop 2024-09-11T00:10:07.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:10:07.814+0000 7f75afc70640 1 -- 172.21.15.78:0/1531013755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a8108020 msgr2=0x7f75a819abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:07.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:10:07.814+0000 7f75afc70640 1 --2- 172.21.15.78:0/1531013755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a8108020 0x7f75a819abb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f75a400cad0 tx=0x7f75a400ced0 comp rx=0 tx=0).stop 2024-09-11T00:10:07.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:10:07.814+0000 7f75afc70640 1 -- 172.21.15.78:0/1531013755 shutdown_connections 2024-09-11T00:10:07.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:10:07.814+0000 7f75afc70640 1 --2- 172.21.15.78:0/1531013755 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f75940b5320 0x7f75940b77e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:07.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:10:07.814+0000 7f75afc70640 1 --2- 172.21.15.78:0/1531013755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a8108020 0x7f75a819abb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:07.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:10:07.814+0000 7f75afc70640 1 --2- 172.21.15.78:0/1531013755 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75a81076a0 0x7f75a819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:07.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:10:07.814+0000 7f75afc70640 1 --2- 172.21.15.78:0/1531013755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75a8101c90 0x7f75a819a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:07.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:10:07.814+0000 7f75afc70640 1 -- 172.21.15.78:0/1531013755 >> 172.21.15.78:0/1531013755 conn(0x7f75a80fd700 msgr2=0x7f75a80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:07.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:10:07.814+0000 7f75afc70640 1 -- 172.21.15.78:0/1531013755 shutdown_connections 2024-09-11T00:10:07.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:10:07.814+0000 7f75afc70640 1 -- 172.21.15.78:0/1531013755 wait complete. 2024-09-11T00:10:08.466 DEBUG:teuthology.orchestra.run.smithi078:osd.3> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.3.service 2024-09-11T00:10:08.468 INFO:tasks.cephadm:Deploying osd.4 on smithi112 with /dev/vg_nvme/lv_3... 2024-09-11T00:10:08.469 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T00:10:08.688 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:08 smithi078 ceph-mon[30865]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:10:08.688 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:08 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:08.688 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:08 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:08.688 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:08 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:08.727 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T00:10:08.784 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:08 smithi112 ceph-mon[35627]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:10:08.784 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:08 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:08.784 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:08 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:08.784 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:08 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:09.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:08 smithi138 ceph-mon[35019]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:10:09.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:08 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:09.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:08 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:09.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:08 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:09.938 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 11 00:10:09 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-3[55897]: 2024-09-11T00:10:09.825+0000 7f69e1d66640 -1 osd.3 0 log_to_monitors true 2024-09-11T00:10:10.887 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:10 smithi112 ceph-mon[35627]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:10:10.888 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:10 smithi112 ceph-mon[35627]: from='osd.3 [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-11T00:10:10.992 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:10 smithi078 ceph-mon[30865]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:10:10.992 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:10 smithi078 ceph-mon[30865]: from='osd.3 [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-11T00:10:11.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:10 smithi138 ceph-mon[35019]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:10:11.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:10 smithi138 ceph-mon[35019]: from='osd.3 [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-11T00:10:11.276 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-11T00:10:11.302 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi112:vg_nvme/lv_3 2024-09-11T00:10:11.552 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T00:10:11.830 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:11 smithi112 ceph-mon[35627]: from='osd.3 [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T00:10:11.831 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:11 smithi112 ceph-mon[35627]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T00:10:11.831 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:11 smithi112 ceph-mon[35627]: from='osd.3 [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi078", "root=default"]} : dispatch 2024-09-11T00:10:11.831 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:11 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T00:10:11.831 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:11 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:11.831 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:11 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:11.831 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:11 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:11.831 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:11 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:11.831 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:11 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:11.831 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:11 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:11.831 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:11 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:10:11.831 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:11 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:11.831 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:11 smithi112 ceph-mon[35627]: from='osd.3 [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-11T00:10:11.832 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:11 smithi112 ceph-mon[35627]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T00:10:11.832 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:11 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T00:10:12.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:11 smithi138 ceph-mon[35019]: from='osd.3 [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T00:10:12.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:11 smithi138 ceph-mon[35019]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T00:10:12.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:11 smithi138 ceph-mon[35019]: from='osd.3 [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi078", "root=default"]} : dispatch 2024-09-11T00:10:12.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:11 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T00:10:12.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:11 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:12.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:11 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:12.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:11 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:12.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:11 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:12.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:11 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:12.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:11 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:12.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:11 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:10:12.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:11 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:12.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:11 smithi138 ceph-mon[35019]: from='osd.3 [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-11T00:10:12.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:11 smithi138 ceph-mon[35019]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T00:10:12.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:11 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T00:10:12.083 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 11 00:10:11 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-3[55897]: 2024-09-11T00:10:11.683+0000 7f69ddce9640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T00:10:12.083 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 11 00:10:11 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-3[55897]: 2024-09-11T00:10:11.689+0000 7f69d9b10640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:10:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:11 smithi078 ceph-mon[30865]: from='osd.3 [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T00:10:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:11 smithi078 ceph-mon[30865]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T00:10:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:11 smithi078 ceph-mon[30865]: from='osd.3 [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi078", "root=default"]} : dispatch 2024-09-11T00:10:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:11 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T00:10:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:11 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:11 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:11 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:11 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:11 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:11 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:11 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:10:12.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:11 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:12.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:11 smithi078 ceph-mon[30865]: from='osd.3 [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-11T00:10:12.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:11 smithi078 ceph-mon[30865]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T00:10:12.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:11 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T00:10:12.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.061+0000 7f19fd8ee640 1 -- 172.21.15.112:0/3682206972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19f8101c90 msgr2=0x7f19f8102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:12.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.061+0000 7f19fd8ee640 1 --2- 172.21.15.112:0/3682206972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19f8101c90 0x7f19f8102070 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009900 tx=0x7f19e802a410 comp rx=0 tx=0).stop 2024-09-11T00:10:12.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.061+0000 7f19fd8ee640 1 -- 172.21.15.112:0/3682206972 shutdown_connections 2024-09-11T00:10:12.085 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.061+0000 7f19fd8ee640 1 --2- 172.21.15.112:0/3682206972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f8108020 0x7f19f810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:12.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.061+0000 7f19fd8ee640 1 --2- 172.21.15.112:0/3682206972 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19f81076a0 0x7f19f8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:12.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.061+0000 7f19fd8ee640 1 --2- 172.21.15.112:0/3682206972 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19f8101c90 0x7f19f8102070 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:12.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.061+0000 7f19fd8ee640 1 -- 172.21.15.112:0/3682206972 >> 172.21.15.112:0/3682206972 conn(0x7f19f80fd700 msgr2=0x7f19f80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:12.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.061+0000 7f19fd8ee640 1 -- 172.21.15.112:0/3682206972 shutdown_connections 2024-09-11T00:10:12.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.061+0000 7f19fd8ee640 1 -- 172.21.15.112:0/3682206972 wait complete. 2024-09-11T00:10:12.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.062+0000 7f19fd8ee640 1 Processor -- start 2024-09-11T00:10:12.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.062+0000 7f19fd8ee640 1 -- start start 2024-09-11T00:10:12.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.062+0000 7f19fd8ee640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19f8101c90 0x7f19f80fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:12.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.062+0000 7f19fd8ee640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f81076a0 0x7f19f80fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:12.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.062+0000 7f19fd8ee640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19f8108020 0x7f19f80fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:12.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.062+0000 7f19fd8ee640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f19f8111ce0 con 0x7f19f81076a0 2024-09-11T00:10:12.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.062+0000 7f19fd8ee640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f19f8111b60 con 0x7f19f8108020 2024-09-11T00:10:12.086 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.062+0000 7f19fd8ee640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f19f8111e60 con 0x7f19f8101c90 2024-09-11T00:10:12.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.063+0000 7f19f77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19f8108020 0x7f19f80fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:12.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.063+0000 7f19f77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19f8108020 0x7f19f80fe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:39810/0 (socket says 172.21.15.112:39810) 2024-09-11T00:10:12.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.063+0000 7f19f77fe640 1 -- 172.21.15.112:0/858121222 learned_addr learned my addr 172.21.15.112:0/858121222 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-11T00:10:12.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.063+0000 7f19f6ffd640 1 --2- 172.21.15.112:0/858121222 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19f8101c90 0x7f19f80fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:12.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.063+0000 7f19effff640 1 --2- 172.21.15.112:0/858121222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f81076a0 0x7f19f80fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:12.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.063+0000 7f19f77fe640 1 -- 172.21.15.112:0/858121222 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19f8101c90 msgr2=0x7f19f80fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:12.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.063+0000 7f19f77fe640 1 --2- 172.21.15.112:0/858121222 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19f8101c90 0x7f19f80fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:12.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.063+0000 7f19f77fe640 1 -- 172.21.15.112:0/858121222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f81076a0 msgr2=0x7f19f80fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:12.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.063+0000 7f19f77fe640 1 --2- 172.21.15.112:0/858121222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f81076a0 0x7f19f80fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:12.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.063+0000 7f19f77fe640 1 -- 172.21.15.112:0/858121222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f81a76b0 con 0x7f19f8108020 2024-09-11T00:10:12.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.063+0000 7f19effff640 1 --2- 172.21.15.112:0/858121222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f81076a0 0x7f19f80fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:10:12.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.063+0000 7f19f6ffd640 1 --2- 172.21.15.112:0/858121222 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19f8101c90 0x7f19f80fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:10:12.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.063+0000 7f19f77fe640 1 --2- 172.21.15.112:0/858121222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19f8108020 0x7f19f80fe680 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f19f000eb10 tx=0x7f19f000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:12.087 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.063+0000 7f19fc8ec640 1 -- 172.21.15.112:0/858121222 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f0004b20 con 0x7f19f8108020 2024-09-11T00:10:12.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.063+0000 7f19fd8ee640 1 -- 172.21.15.112:0/858121222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f81a79a0 con 0x7f19f8108020 2024-09-11T00:10:12.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.063+0000 7f19fc8ec640 1 -- 172.21.15.112:0/858121222 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19f0004cc0 con 0x7f19f8108020 2024-09-11T00:10:12.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.063+0000 7f19fc8ec640 1 -- 172.21.15.112:0/858121222 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f0010670 con 0x7f19f8108020 2024-09-11T00:10:12.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.063+0000 7f19fd8ee640 1 -- 172.21.15.112:0/858121222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f81a7e90 con 0x7f19f8108020 2024-09-11T00:10:12.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.064+0000 7f19fd8ee640 1 -- 172.21.15.112:0/858121222 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f8102070 con 0x7f19f8108020 2024-09-11T00:10:12.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.065+0000 7f19fc8ec640 1 -- 172.21.15.112:0/858121222 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f19f0005020 con 0x7f19f8108020 2024-09-11T00:10:12.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.066+0000 7f19fc8ec640 1 --2- 172.21.15.112:0/858121222 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f19e40b5330 0x7f19e40b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:12.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.066+0000 7f19fc8ec640 1 -- 172.21.15.112:0/858121222 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3604+0+0 (secure 0 0 0) 0x7f19f00e5110 con 0x7f19f8108020 2024-09-11T00:10:12.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.067+0000 7f19f6ffd640 1 --2- 172.21.15.112:0/858121222 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f19e40b5330 0x7f19e40b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:12.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.067+0000 7f19f6ffd640 1 --2- 172.21.15.112:0/858121222 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f19e40b5330 0x7f19e40b77f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f19e8031440 tx=0x7f19e8005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:12.088 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.074+0000 7f19fc8ec640 1 -- 172.21.15.112:0/858121222 <== mon.2 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f19f00ad230 con 0x7f19f8108020 2024-09-11T00:10:12.269 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:12.267+0000 7f19fd8ee640 1 -- 172.21.15.112:0/858121222 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f19f8106ce0 con 0x7f19e40b5330 2024-09-11T00:10:12.938 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:12 smithi112 ceph-mon[35627]: Detected new or changed devices on smithi078 2024-09-11T00:10:12.938 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:12 smithi112 ceph-mon[35627]: Adjusting osd_memory_target on smithi078 to 8544M 2024-09-11T00:10:12.938 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:12 smithi112 ceph-mon[35627]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:10:12.938 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:12 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T00:10:12.939 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:12 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:10:12.939 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:12 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:10:12.939 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:12 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:12.939 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:12 smithi112 ceph-mon[35627]: osd.3 [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256] boot 2024-09-11T00:10:12.939 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:12 smithi112 ceph-mon[35627]: osdmap e24: 4 total, 4 up, 4 in 2024-09-11T00:10:13.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:12 smithi138 ceph-mon[35019]: Detected new or changed devices on smithi078 2024-09-11T00:10:13.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:12 smithi138 ceph-mon[35019]: Adjusting osd_memory_target on smithi078 to 8544M 2024-09-11T00:10:13.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:12 smithi138 ceph-mon[35019]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:10:13.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:12 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T00:10:13.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:12 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:10:13.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:12 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:10:13.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:12 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:13.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:12 smithi138 ceph-mon[35019]: osd.3 [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256] boot 2024-09-11T00:10:13.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:12 smithi138 ceph-mon[35019]: osdmap e24: 4 total, 4 up, 4 in 2024-09-11T00:10:13.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:12 smithi078 ceph-mon[30865]: Detected new or changed devices on smithi078 2024-09-11T00:10:13.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:12 smithi078 ceph-mon[30865]: Adjusting osd_memory_target on smithi078 to 8544M 2024-09-11T00:10:13.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:12 smithi078 ceph-mon[30865]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-11T00:10:13.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:12 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T00:10:13.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:12 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:10:13.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:12 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:10:13.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:12 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:13.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:12 smithi078 ceph-mon[30865]: osd.3 [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256] boot 2024-09-11T00:10:13.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:12 smithi078 ceph-mon[30865]: osdmap e24: 4 total, 4 up, 4 in 2024-09-11T00:10:13.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:13 smithi112 ceph-mon[35627]: purged_snaps scrub starts 2024-09-11T00:10:13.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:13 smithi112 ceph-mon[35627]: purged_snaps scrub ok 2024-09-11T00:10:13.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:13 smithi112 ceph-mon[35627]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:10:13.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:13 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T00:10:14.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:13 smithi138 ceph-mon[35019]: purged_snaps scrub starts 2024-09-11T00:10:14.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:13 smithi138 ceph-mon[35019]: purged_snaps scrub ok 2024-09-11T00:10:14.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:13 smithi138 ceph-mon[35019]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:10:14.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:13 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T00:10:14.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:13 smithi078 ceph-mon[30865]: purged_snaps scrub starts 2024-09-11T00:10:14.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:13 smithi078 ceph-mon[30865]: purged_snaps scrub ok 2024-09-11T00:10:14.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:13 smithi078 ceph-mon[30865]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:10:14.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:13 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T00:10:14.948 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:14 smithi112 ceph-mon[35627]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-11T00:10:14.948 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:14 smithi112 ceph-mon[35627]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T00:10:14.948 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:14 smithi112 ceph-mon[35627]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T00:10:15.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:14 smithi138 ceph-mon[35019]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-11T00:10:15.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:14 smithi138 ceph-mon[35019]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T00:10:15.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:14 smithi138 ceph-mon[35019]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T00:10:15.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:14 smithi078 ceph-mon[30865]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-11T00:10:15.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:14 smithi078 ceph-mon[30865]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T00:10:15.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:14 smithi078 ceph-mon[30865]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T00:10:15.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:15 smithi112 ceph-mon[35627]: from='client.? 172.21.15.112:0/2594370313' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4575a0a5-821e-4346-84ac-5396042b0550"} : dispatch 2024-09-11T00:10:15.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:15 smithi112 ceph-mon[35627]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4575a0a5-821e-4346-84ac-5396042b0550"} : dispatch 2024-09-11T00:10:15.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:15 smithi112 ceph-mon[35627]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4575a0a5-821e-4346-84ac-5396042b0550"}]': finished 2024-09-11T00:10:15.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:15 smithi112 ceph-mon[35627]: osdmap e27: 5 total, 4 up, 5 in 2024-09-11T00:10:15.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:15 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T00:10:15.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:15 smithi112 ceph-mon[35627]: from='client.? 172.21.15.112:0/1641740996' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:10:16.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:15 smithi138 ceph-mon[35019]: from='client.? 172.21.15.112:0/2594370313' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4575a0a5-821e-4346-84ac-5396042b0550"} : dispatch 2024-09-11T00:10:16.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:15 smithi138 ceph-mon[35019]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4575a0a5-821e-4346-84ac-5396042b0550"} : dispatch 2024-09-11T00:10:16.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:15 smithi138 ceph-mon[35019]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4575a0a5-821e-4346-84ac-5396042b0550"}]': finished 2024-09-11T00:10:16.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:15 smithi138 ceph-mon[35019]: osdmap e27: 5 total, 4 up, 5 in 2024-09-11T00:10:16.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:15 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T00:10:16.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:15 smithi138 ceph-mon[35019]: from='client.? 172.21.15.112:0/1641740996' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:10:16.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:15 smithi078 ceph-mon[30865]: from='client.? 172.21.15.112:0/2594370313' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4575a0a5-821e-4346-84ac-5396042b0550"} : dispatch 2024-09-11T00:10:16.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:15 smithi078 ceph-mon[30865]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4575a0a5-821e-4346-84ac-5396042b0550"} : dispatch 2024-09-11T00:10:16.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:15 smithi078 ceph-mon[30865]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4575a0a5-821e-4346-84ac-5396042b0550"}]': finished 2024-09-11T00:10:16.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:15 smithi078 ceph-mon[30865]: osdmap e27: 5 total, 4 up, 5 in 2024-09-11T00:10:16.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:15 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T00:10:16.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:15 smithi078 ceph-mon[30865]: from='client.? 172.21.15.112:0/1641740996' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:10:16.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:16 smithi112 ceph-mon[35627]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-11T00:10:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:16 smithi138 ceph-mon[35019]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-11T00:10:17.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:16 smithi078 ceph-mon[30865]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-11T00:10:18.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:18 smithi112 ceph-mon[35627]: pgmap v86: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-11T00:10:19.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:18 smithi138 ceph-mon[35019]: pgmap v86: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-11T00:10:19.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:18 smithi078 ceph-mon[30865]: pgmap v86: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-11T00:10:20.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:20 smithi112 ceph-mon[35627]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T00:10:21.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:20 smithi138 ceph-mon[35019]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T00:10:21.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:20 smithi078 ceph-mon[30865]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T00:10:22.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:22 smithi112 ceph-mon[35627]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-11T00:10:23.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:22 smithi138 ceph-mon[35019]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-11T00:10:23.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:22 smithi078 ceph-mon[30865]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-11T00:10:23.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:23 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-11T00:10:23.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:23 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:24.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:23 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-11T00:10:24.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:23 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:24.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:23 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-11T00:10:24.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:23 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:24.805 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:24 smithi112 ceph-mon[35627]: Deploying daemon osd.4 on smithi112 2024-09-11T00:10:24.805 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:24 smithi112 ceph-mon[35627]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-11T00:10:25.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:24 smithi138 ceph-mon[35019]: Deploying daemon osd.4 on smithi112 2024-09-11T00:10:25.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:24 smithi138 ceph-mon[35019]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-11T00:10:25.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:24 smithi078 ceph-mon[30865]: Deploying daemon osd.4 on smithi112 2024-09-11T00:10:25.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:24 smithi078 ceph-mon[30865]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-11T00:10:26.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:26 smithi112 ceph-mon[35627]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-11T00:10:27.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:26 smithi138 ceph-mon[35019]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-11T00:10:27.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:26 smithi078 ceph-mon[30865]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-11T00:10:28.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:28 smithi112 ceph-mon[35627]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T00:10:29.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:28 smithi138 ceph-mon[35019]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T00:10:29.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:28 smithi078 ceph-mon[30865]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T00:10:29.851 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:29 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:29.851 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:29 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:29.851 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:29 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:30.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:29 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:30.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:29 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:30.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:29 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:30.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:29 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:30.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:29 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:30.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:29 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:30.870 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:30 smithi112 ceph-mon[35627]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T00:10:31.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:30 smithi138 ceph-mon[35019]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T00:10:31.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:30 smithi078 ceph-mon[30865]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T00:10:33.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:32 smithi138 ceph-mon[35019]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-11T00:10:33.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:32 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:33.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:32 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:33.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:32 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:33.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:32 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:10:33.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:32 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:33.083 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:32 smithi112 ceph-mon[35627]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-11T00:10:33.083 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:32 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:33.083 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:32 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:33.084 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:32 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:33.084 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:32 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:10:33.084 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:32 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:33.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:32 smithi078 ceph-mon[30865]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-11T00:10:33.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:32 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:33.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:32 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:33.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:32 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:33.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:32 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:10:33.086 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:32 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:33.124 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:33.121+0000 7f19fc8ec640 1 -- 172.21.15.112:0/858121222 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f19f8106ce0 con 0x7f19e40b5330 2024-09-11T00:10:33.124 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 4 on host 'smithi112' 2024-09-11T00:10:33.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:33.124+0000 7f19fd8ee640 1 -- 172.21.15.112:0/858121222 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f19e40b5330 msgr2=0x7f19e40b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:33.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:33.124+0000 7f19fd8ee640 1 --2- 172.21.15.112:0/858121222 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f19e40b5330 0x7f19e40b77f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f19e8031440 tx=0x7f19e8005a20 comp rx=0 tx=0).stop 2024-09-11T00:10:33.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:33.124+0000 7f19fd8ee640 1 -- 172.21.15.112:0/858121222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19f8108020 msgr2=0x7f19f80fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:33.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:33.124+0000 7f19fd8ee640 1 --2- 172.21.15.112:0/858121222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19f8108020 0x7f19f80fe680 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f19f000eb10 tx=0x7f19f000c2d0 comp rx=0 tx=0).stop 2024-09-11T00:10:33.127 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:33.124+0000 7f19fd8ee640 1 -- 172.21.15.112:0/858121222 shutdown_connections 2024-09-11T00:10:33.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:33.124+0000 7f19fd8ee640 1 --2- 172.21.15.112:0/858121222 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f19e40b5330 0x7f19e40b77f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:33.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:33.124+0000 7f19fd8ee640 1 --2- 172.21.15.112:0/858121222 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f19f8108020 0x7f19f80fe680 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:33.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:33.124+0000 7f19fd8ee640 1 --2- 172.21.15.112:0/858121222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f81076a0 0x7f19f80fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:33.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:33.124+0000 7f19fd8ee640 1 --2- 172.21.15.112:0/858121222 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19f8101c90 0x7f19f80fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:33.128 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:33.124+0000 7f19fd8ee640 1 -- 172.21.15.112:0/858121222 >> 172.21.15.112:0/858121222 conn(0x7f19f80fd700 msgr2=0x7f19f806aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:33.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:33.124+0000 7f19fd8ee640 1 -- 172.21.15.112:0/858121222 shutdown_connections 2024-09-11T00:10:33.129 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:10:33.124+0000 7f19fd8ee640 1 -- 172.21.15.112:0/858121222 wait complete. 2024-09-11T00:10:33.805 DEBUG:teuthology.orchestra.run.smithi112:osd.4> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.4.service 2024-09-11T00:10:33.808 INFO:tasks.cephadm:Deploying osd.5 on smithi138 with /dev/vg_nvme/lv_3... 2024-09-11T00:10:33.808 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T00:10:34.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:33 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:34.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:33 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:34.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:33 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:34.064 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:10:34.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:33 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:34.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:33 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:34.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:33 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:34.103 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:33 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:34.103 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:33 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:34.104 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:33 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:35.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:34 smithi138 ceph-mon[35019]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-11T00:10:35.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:34 smithi078 ceph-mon[30865]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-11T00:10:35.128 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:34 smithi112 ceph-mon[35627]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-11T00:10:35.128 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 11 00:10:34 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-4[48254]: 2024-09-11T00:10:34.896+0000 7f88e42c0640 -1 osd.4 0 log_to_monitors true 2024-09-11T00:10:36.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:35 smithi138 ceph-mon[35019]: from='osd.4 [v2:172.21.15.112:6808/2650243435,v1:172.21.15.112:6809/2650243435]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-11T00:10:36.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:35 smithi138 ceph-mon[35019]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-11T00:10:36.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:35 smithi138 ceph-mon[35019]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-11T00:10:36.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:35 smithi078 ceph-mon[30865]: from='osd.4 [v2:172.21.15.112:6808/2650243435,v1:172.21.15.112:6809/2650243435]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-11T00:10:36.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:35 smithi078 ceph-mon[30865]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-11T00:10:36.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:35 smithi078 ceph-mon[30865]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-11T00:10:36.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:35 smithi112 ceph-mon[35627]: from='osd.4 [v2:172.21.15.112:6808/2650243435,v1:172.21.15.112:6809/2650243435]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-11T00:10:36.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:35 smithi112 ceph-mon[35627]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-11T00:10:36.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:35 smithi112 ceph-mon[35627]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-11T00:10:36.644 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:10:36.670 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi138:vg_nvme/lv_3 2024-09-11T00:10:36.920 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:10:36.948 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:36 smithi138 ceph-mon[35019]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T00:10:36.949 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:36 smithi138 ceph-mon[35019]: osdmap e28: 5 total, 4 up, 5 in 2024-09-11T00:10:36.949 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:36 smithi138 ceph-mon[35019]: from='osd.4 [v2:172.21.15.112:6808/2650243435,v1:172.21.15.112:6809/2650243435]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:10:36.949 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T00:10:36.949 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:36 smithi138 ceph-mon[35019]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:10:36.949 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:36 smithi138 ceph-mon[35019]: Detected new or changed devices on smithi112 2024-09-11T00:10:36.949 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:36.949 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:36.949 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:36.949 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:36.949 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:36 smithi138 ceph-mon[35019]: Adjusting osd_memory_target on smithi112 to 8544M 2024-09-11T00:10:36.949 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:36.949 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:36.950 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:10:36.950 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:36.982 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 11 00:10:36 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-4[48254]: 2024-09-11T00:10:36.751+0000 7f88e0243640 -1 osd.4 0 waiting for initial osdmap 2024-09-11T00:10:36.982 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 11 00:10:36 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-4[48254]: 2024-09-11T00:10:36.760+0000 7f88dc06a640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:10:36.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:36 smithi112 ceph-mon[35627]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T00:10:36.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:36 smithi112 ceph-mon[35627]: osdmap e28: 5 total, 4 up, 5 in 2024-09-11T00:10:36.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:36 smithi112 ceph-mon[35627]: from='osd.4 [v2:172.21.15.112:6808/2650243435,v1:172.21.15.112:6809/2650243435]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:10:36.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T00:10:36.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:36 smithi112 ceph-mon[35627]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:10:36.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:36 smithi112 ceph-mon[35627]: Detected new or changed devices on smithi112 2024-09-11T00:10:36.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:36.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:36.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:36.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:36.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:36 smithi112 ceph-mon[35627]: Adjusting osd_memory_target on smithi112 to 8544M 2024-09-11T00:10:36.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:36.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:36.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:10:36.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:36 smithi078 ceph-mon[30865]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T00:10:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:36 smithi078 ceph-mon[30865]: osdmap e28: 5 total, 4 up, 5 in 2024-09-11T00:10:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:36 smithi078 ceph-mon[30865]: from='osd.4 [v2:172.21.15.112:6808/2650243435,v1:172.21.15.112:6809/2650243435]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:10:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T00:10:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:36 smithi078 ceph-mon[30865]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:10:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:36 smithi078 ceph-mon[30865]: Detected new or changed devices on smithi112 2024-09-11T00:10:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:37.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:37.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T00:10:37.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:36 smithi078 ceph-mon[30865]: Adjusting osd_memory_target on smithi112 to 8544M 2024-09-11T00:10:37.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:37.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:37.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:10:37.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:37.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.371+0000 7faa7d250640 1 -- 172.21.15.138:0/3254012627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa7810d100 msgr2=0x7faa7810f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:37.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.371+0000 7faa7d250640 1 --2- 172.21.15.138:0/3254012627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa7810d100 0x7faa7810f560 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faa70009ca0 tx=0x7faa7002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:10:37.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.371+0000 7faa7d250640 1 -- 172.21.15.138:0/3254012627 shutdown_connections 2024-09-11T00:10:37.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.371+0000 7faa7d250640 1 --2- 172.21.15.138:0/3254012627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa7810d100 0x7faa7810f560 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:37.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.371+0000 7faa7d250640 1 --2- 172.21.15.138:0/3254012627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa781045c0 0x7faa7810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:37.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.371+0000 7faa7d250640 1 --2- 172.21.15.138:0/3254012627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa78103ca0 0x7faa78104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:37.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.371+0000 7faa7d250640 1 -- 172.21.15.138:0/3254012627 >> 172.21.15.138:0/3254012627 conn(0x7faa780fd700 msgr2=0x7faa780ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:37.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.371+0000 7faa7d250640 1 -- 172.21.15.138:0/3254012627 shutdown_connections 2024-09-11T00:10:37.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.371+0000 7faa7d250640 1 -- 172.21.15.138:0/3254012627 wait complete. 2024-09-11T00:10:37.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.372+0000 7faa7d250640 1 Processor -- start 2024-09-11T00:10:37.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.372+0000 7faa7d250640 1 -- start start 2024-09-11T00:10:37.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.372+0000 7faa7d250640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa78103ca0 0x7faa78101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:37.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.372+0000 7faa7d250640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa781045c0 0x7faa78101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:37.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.372+0000 7faa7d250640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa7810d100 0x7faa781023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:37.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.372+0000 7faa7d250640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7faa78112d70 con 0x7faa7810d100 2024-09-11T00:10:37.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.372+0000 7faa7d250640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faa78112bf0 con 0x7faa781045c0 2024-09-11T00:10:37.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.372+0000 7faa7d250640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7faa78112ef0 con 0x7faa78103ca0 2024-09-11T00:10:37.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.372+0000 7faa76d9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa78103ca0 0x7faa78101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:37.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.372+0000 7faa76d9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa78103ca0 0x7faa78101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:53392/0 (socket says 172.21.15.138:53392) 2024-09-11T00:10:37.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.372+0000 7faa76d9d640 1 -- 172.21.15.138:0/347471924 learned_addr learned my addr 172.21.15.138:0/347471924 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-09-11T00:10:37.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.372+0000 7faa6ffff640 1 --2- 172.21.15.138:0/347471924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa781045c0 0x7faa78101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:37.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.372+0000 7faa7759e640 1 --2- 172.21.15.138:0/347471924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa7810d100 0x7faa781023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:37.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.372+0000 7faa76d9d640 1 -- 172.21.15.138:0/347471924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa781045c0 msgr2=0x7faa78101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:37.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.372+0000 7faa76d9d640 1 --2- 172.21.15.138:0/347471924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa781045c0 0x7faa78101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:37.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.372+0000 7faa76d9d640 1 -- 172.21.15.138:0/347471924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa7810d100 msgr2=0x7faa781023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:37.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.372+0000 7faa76d9d640 1 --2- 172.21.15.138:0/347471924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa7810d100 0x7faa781023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:37.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.372+0000 7faa76d9d640 1 -- 172.21.15.138:0/347471924 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa781a76a0 con 0x7faa78103ca0 2024-09-11T00:10:37.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.372+0000 7faa7759e640 1 --2- 172.21.15.138:0/347471924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa7810d100 0x7faa781023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:10:37.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.373+0000 7faa76d9d640 1 --2- 172.21.15.138:0/347471924 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa78103ca0 0x7faa78101950 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faa6800d770 tx=0x7faa6800dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:37.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.373+0000 7faa74d99640 1 -- 172.21.15.138:0/347471924 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa68017070 con 0x7faa78103ca0 2024-09-11T00:10:37.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.373+0000 7faa74d99640 1 -- 172.21.15.138:0/347471924 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa680054d0 con 0x7faa78103ca0 2024-09-11T00:10:37.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.373+0000 7faa7d250640 1 -- 172.21.15.138:0/347471924 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa781a7990 con 0x7faa78103ca0 2024-09-11T00:10:37.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.373+0000 7faa74d99640 1 -- 172.21.15.138:0/347471924 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa68004c30 con 0x7faa78103ca0 2024-09-11T00:10:37.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.373+0000 7faa7d250640 1 -- 172.21.15.138:0/347471924 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa781a7ed0 con 0x7faa78103ca0 2024-09-11T00:10:37.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.374+0000 7faa7d250640 1 -- 172.21.15.138:0/347471924 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa78104080 con 0x7faa78103ca0 2024-09-11T00:10:37.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.375+0000 7faa74d99640 1 -- 172.21.15.138:0/347471924 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7faa68004dd0 con 0x7faa78103ca0 2024-09-11T00:10:37.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.376+0000 7faa74d99640 1 --2- 172.21.15.138:0/347471924 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7faa640b53b0 0x7faa640b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:10:37.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.376+0000 7faa74d99640 1 -- 172.21.15.138:0/347471924 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4036+0+0 (secure 0 0 0) 0x7faa680e4ab0 con 0x7faa78103ca0 2024-09-11T00:10:37.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.376+0000 7faa6ffff640 1 --2- 172.21.15.138:0/347471924 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7faa640b53b0 0x7faa640b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:10:37.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.377+0000 7faa6ffff640 1 --2- 172.21.15.138:0/347471924 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7faa640b53b0 0x7faa640b7870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faa600058c0 tx=0x7faa60005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:10:37.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.379+0000 7faa74d99640 1 -- 172.21.15.138:0/347471924 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7faa680aca80 con 0x7faa78103ca0 2024-09-11T00:10:37.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:37.571+0000 7faa7d250640 1 -- 172.21.15.138:0/347471924 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7faa780ffa20 con 0x7faa640b53b0 2024-09-11T00:10:37.951 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:37 smithi138 ceph-mon[35019]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-11T00:10:37.951 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:37 smithi138 ceph-mon[35019]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T00:10:37.951 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:37 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T00:10:37.951 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:37 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T00:10:37.951 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:37 smithi138 ceph-mon[35019]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:10:37.951 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:37 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:10:37.951 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:37 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:10:37.951 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:37 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:37.951 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:37 smithi138 ceph-mon[35019]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-11T00:10:38.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:37 smithi078 ceph-mon[30865]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-11T00:10:38.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:37 smithi078 ceph-mon[30865]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T00:10:38.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:37 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T00:10:38.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:37 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T00:10:38.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:37 smithi078 ceph-mon[30865]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:10:38.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:37 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:10:38.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:37 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:10:38.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:37 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:38.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:37 smithi078 ceph-mon[30865]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-11T00:10:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:37 smithi112 ceph-mon[35627]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-11T00:10:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:37 smithi112 ceph-mon[35627]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T00:10:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:37 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T00:10:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:37 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T00:10:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:37 smithi112 ceph-mon[35627]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:10:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:37 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:10:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:37 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:10:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:37 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:37 smithi112 ceph-mon[35627]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-11T00:10:38.977 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:38 smithi138 ceph-mon[35019]: purged_snaps scrub starts 2024-09-11T00:10:38.977 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:38 smithi138 ceph-mon[35019]: purged_snaps scrub ok 2024-09-11T00:10:38.977 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:38 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T00:10:38.977 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:38 smithi138 ceph-mon[35019]: osd.4 [v2:172.21.15.112:6808/2650243435,v1:172.21.15.112:6809/2650243435] boot 2024-09-11T00:10:38.977 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:38 smithi138 ceph-mon[35019]: osdmap e30: 5 total, 5 up, 5 in 2024-09-11T00:10:38.977 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:38 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T00:10:39.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:38 smithi078 ceph-mon[30865]: purged_snaps scrub starts 2024-09-11T00:10:39.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:38 smithi078 ceph-mon[30865]: purged_snaps scrub ok 2024-09-11T00:10:39.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:38 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T00:10:39.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:38 smithi078 ceph-mon[30865]: osd.4 [v2:172.21.15.112:6808/2650243435,v1:172.21.15.112:6809/2650243435] boot 2024-09-11T00:10:39.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:38 smithi078 ceph-mon[30865]: osdmap e30: 5 total, 5 up, 5 in 2024-09-11T00:10:39.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:38 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T00:10:39.133 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:38 smithi112 ceph-mon[35627]: purged_snaps scrub starts 2024-09-11T00:10:39.133 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:38 smithi112 ceph-mon[35627]: purged_snaps scrub ok 2024-09-11T00:10:39.134 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:38 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T00:10:39.134 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:38 smithi112 ceph-mon[35627]: osd.4 [v2:172.21.15.112:6808/2650243435,v1:172.21.15.112:6809/2650243435] boot 2024-09-11T00:10:39.134 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:38 smithi112 ceph-mon[35627]: osdmap e30: 5 total, 5 up, 5 in 2024-09-11T00:10:39.134 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:38 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T00:10:40.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:39 smithi138 ceph-mon[35019]: osdmap e31: 5 total, 5 up, 5 in 2024-09-11T00:10:40.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:39 smithi138 ceph-mon[35019]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:40.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:39 smithi078 ceph-mon[30865]: osdmap e31: 5 total, 5 up, 5 in 2024-09-11T00:10:40.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:39 smithi078 ceph-mon[30865]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:40.150 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:39 smithi112 ceph-mon[35627]: osdmap e31: 5 total, 5 up, 5 in 2024-09-11T00:10:40.150 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:39 smithi112 ceph-mon[35627]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:41.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:40 smithi138 ceph-mon[35019]: from='client.? 172.21.15.138:0/504334012' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e81eb98f-76eb-4da5-8047-f160888720e8"} : dispatch 2024-09-11T00:10:41.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:40 smithi138 ceph-mon[35019]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e81eb98f-76eb-4da5-8047-f160888720e8"} : dispatch 2024-09-11T00:10:41.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:40 smithi138 ceph-mon[35019]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e81eb98f-76eb-4da5-8047-f160888720e8"}]': finished 2024-09-11T00:10:41.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:40 smithi138 ceph-mon[35019]: osdmap e32: 6 total, 5 up, 6 in 2024-09-11T00:10:41.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T00:10:41.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:40 smithi138 ceph-mon[35019]: from='client.? 172.21.15.138:0/414373484' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:10:41.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:40 smithi078 ceph-mon[30865]: from='client.? 172.21.15.138:0/504334012' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e81eb98f-76eb-4da5-8047-f160888720e8"} : dispatch 2024-09-11T00:10:41.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:40 smithi078 ceph-mon[30865]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e81eb98f-76eb-4da5-8047-f160888720e8"} : dispatch 2024-09-11T00:10:41.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:40 smithi078 ceph-mon[30865]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e81eb98f-76eb-4da5-8047-f160888720e8"}]': finished 2024-09-11T00:10:41.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:40 smithi078 ceph-mon[30865]: osdmap e32: 6 total, 5 up, 6 in 2024-09-11T00:10:41.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T00:10:41.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:40 smithi078 ceph-mon[30865]: from='client.? 172.21.15.138:0/414373484' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:10:41.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:40 smithi112 ceph-mon[35627]: from='client.? 172.21.15.138:0/504334012' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e81eb98f-76eb-4da5-8047-f160888720e8"} : dispatch 2024-09-11T00:10:41.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:40 smithi112 ceph-mon[35627]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e81eb98f-76eb-4da5-8047-f160888720e8"} : dispatch 2024-09-11T00:10:41.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:40 smithi112 ceph-mon[35627]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e81eb98f-76eb-4da5-8047-f160888720e8"}]': finished 2024-09-11T00:10:41.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:40 smithi112 ceph-mon[35627]: osdmap e32: 6 total, 5 up, 6 in 2024-09-11T00:10:41.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T00:10:41.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:40 smithi112 ceph-mon[35627]: from='client.? 172.21.15.138:0/414373484' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:10:42.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:41 smithi138 ceph-mon[35019]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:42.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:41 smithi078 ceph-mon[30865]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:42.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:41 smithi112 ceph-mon[35627]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:44.935 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:44 smithi138 ceph-mon[35019]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:44.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:44 smithi112 ceph-mon[35627]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:45.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:44 smithi078 ceph-mon[30865]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:46.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:46 smithi112 ceph-mon[35627]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:46 smithi138 ceph-mon[35019]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:47.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:46 smithi078 ceph-mon[30865]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:48.886 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:48 smithi138 ceph-mon[35019]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:48.887 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:48 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-11T00:10:48.887 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:48 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:48.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:48 smithi112 ceph-mon[35627]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:48.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:48 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-11T00:10:48.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:48 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:49.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:48 smithi078 ceph-mon[30865]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:49.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:48 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-11T00:10:49.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:48 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:49.883 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:49 smithi138 ceph-mon[35019]: Deploying daemon osd.5 on smithi138 2024-09-11T00:10:49.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:49 smithi112 ceph-mon[35627]: Deploying daemon osd.5 on smithi138 2024-09-11T00:10:50.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:49 smithi078 ceph-mon[30865]: Deploying daemon osd.5 on smithi138 2024-09-11T00:10:50.839 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:50 smithi138 ceph-mon[35019]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:50.981 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:50 smithi112 ceph-mon[35627]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:51.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:50 smithi078 ceph-mon[30865]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:52.946 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:52 smithi138 ceph-mon[35019]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:52.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:52 smithi112 ceph-mon[35627]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:53.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:52 smithi078 ceph-mon[30865]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:54.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:54 smithi112 ceph-mon[35627]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:54.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:54 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:54.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:54 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:54.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:54 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:54.994 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:54 smithi138 ceph-mon[35019]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:54.994 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:54 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:54.994 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:54 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:54.994 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:54 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:55.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:54 smithi078 ceph-mon[30865]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:55.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:54 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:55.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:54 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:55.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:54 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:56.933 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:56 smithi138 ceph-mon[35019]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:56.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:56 smithi112 ceph-mon[35627]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:57.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:56 smithi078 ceph-mon[30865]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:58.253 INFO:teuthology.orchestra.run.smithi138.stdout:Created osd(s) 5 on host 'smithi138' 2024-09-11T00:10:58.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:58.250+0000 7faa74d99640 1 -- 172.21.15.138:0/347471924 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7faa780ffa20 con 0x7faa640b53b0 2024-09-11T00:10:58.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:58.253+0000 7faa7d250640 1 -- 172.21.15.138:0/347471924 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7faa640b53b0 msgr2=0x7faa640b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:58.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:58.253+0000 7faa7d250640 1 --2- 172.21.15.138:0/347471924 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7faa640b53b0 0x7faa640b7870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faa600058c0 tx=0x7faa60005850 comp rx=0 tx=0).stop 2024-09-11T00:10:58.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:58.253+0000 7faa7d250640 1 -- 172.21.15.138:0/347471924 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa78103ca0 msgr2=0x7faa78101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:10:58.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:58.253+0000 7faa7d250640 1 --2- 172.21.15.138:0/347471924 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa78103ca0 0x7faa78101950 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faa6800d770 tx=0x7faa6800dc30 comp rx=0 tx=0).stop 2024-09-11T00:10:58.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:58.253+0000 7faa7d250640 1 -- 172.21.15.138:0/347471924 shutdown_connections 2024-09-11T00:10:58.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:58.253+0000 7faa7d250640 1 --2- 172.21.15.138:0/347471924 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7faa640b53b0 0x7faa640b7870 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:58.253+0000 7faa7d250640 1 --2- 172.21.15.138:0/347471924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa7810d100 0x7faa781023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:58.253+0000 7faa7d250640 1 --2- 172.21.15.138:0/347471924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa781045c0 0x7faa78101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:58.253+0000 7faa7d250640 1 --2- 172.21.15.138:0/347471924 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa78103ca0 0x7faa78101950 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:10:58.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:58.253+0000 7faa7d250640 1 -- 172.21.15.138:0/347471924 >> 172.21.15.138:0/347471924 conn(0x7faa780fd700 msgr2=0x7faa780fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:10:58.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:58.253+0000 7faa7d250640 1 -- 172.21.15.138:0/347471924 shutdown_connections 2024-09-11T00:10:58.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:10:58.253+0000 7faa7d250640 1 -- 172.21.15.138:0/347471924 wait complete. 2024-09-11T00:10:58.522 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:58.522 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:58.523 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:58.523 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:10:58.523 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:58.523 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:58 smithi078 ceph-mon[30865]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:58.523 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:58.523 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:58.523 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:10:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:58.531 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:58.532 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:58.532 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:58.532 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:10:58.532 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:58.533 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:58 smithi138 ceph-mon[35019]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:58.533 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:58.533 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:58.533 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:10:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:58.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:58.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:58.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:10:58.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:10:58.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:58.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:58 smithi112 ceph-mon[35627]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:10:58.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:10:58.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:58.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:10:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:10:58.836 DEBUG:teuthology.orchestra.run.smithi138:osd.5> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.5.service 2024-09-11T00:10:58.839 INFO:tasks.cephadm:Deploying osd.6 on smithi078 with /dev/vg_nvme/lv_2... 2024-09-11T00:10:58.839 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T00:10:59.082 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:11:00.545 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:11:00 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:11:00.391+0000 7f7a38374640 -1 osd.5 0 log_to_monitors true 2024-09-11T00:11:00.947 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:00 smithi138 ceph-mon[35019]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:11:00.947 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:00 smithi138 ceph-mon[35019]: from='osd.5 [v2:172.21.15.138:6808/3033110975,v1:172.21.15.138:6809/3033110975]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-11T00:11:00.947 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:00 smithi138 ceph-mon[35019]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-11T00:11:00.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:00 smithi112 ceph-mon[35627]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:11:00.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:00 smithi112 ceph-mon[35627]: from='osd.5 [v2:172.21.15.138:6808/3033110975,v1:172.21.15.138:6809/3033110975]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-11T00:11:00.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:00 smithi112 ceph-mon[35627]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-11T00:11:01.007 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:00 smithi078 ceph-mon[30865]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:11:01.007 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:00 smithi078 ceph-mon[30865]: from='osd.5 [v2:172.21.15.138:6808/3033110975,v1:172.21.15.138:6809/3033110975]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-11T00:11:01.007 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:00 smithi078 ceph-mon[30865]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-11T00:11:01.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:01 smithi078 ceph-mon[30865]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T00:11:01.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:01 smithi078 ceph-mon[30865]: osdmap e33: 6 total, 5 up, 6 in 2024-09-11T00:11:01.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:01 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T00:11:01.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:01 smithi078 ceph-mon[30865]: from='osd.5 [v2:172.21.15.138:6808/3033110975,v1:172.21.15.138:6809/3033110975]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:11:01.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:01 smithi078 ceph-mon[30865]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:11:01.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:01 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:01.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:01 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:01.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:01 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:01.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:01 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:01.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:01 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:01.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:01 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:01.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:01 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:11:01.835 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:01 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:01.959 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:11:01.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:01 smithi112 ceph-mon[35627]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T00:11:01.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:01 smithi112 ceph-mon[35627]: osdmap e33: 6 total, 5 up, 6 in 2024-09-11T00:11:01.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:01 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T00:11:01.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:01 smithi112 ceph-mon[35627]: from='osd.5 [v2:172.21.15.138:6808/3033110975,v1:172.21.15.138:6809/3033110975]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:11:01.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:01 smithi112 ceph-mon[35627]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:11:01.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:01 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:01.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:01 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:01.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:01 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:01.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:01 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:01.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:01 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:01.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:01 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:01.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:01 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:11:01.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:01 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:01.984 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi078:vg_nvme/lv_2 2024-09-11T00:11:02.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:11:01 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:11:01.690+0000 7f7a342f7640 -1 osd.5 0 waiting for initial osdmap 2024-09-11T00:11:02.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:11:01 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:11:01.698+0000 7f7a3011e640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:11:02.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:01 smithi138 ceph-mon[35019]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T00:11:02.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:01 smithi138 ceph-mon[35019]: osdmap e33: 6 total, 5 up, 6 in 2024-09-11T00:11:02.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:01 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T00:11:02.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:01 smithi138 ceph-mon[35019]: from='osd.5 [v2:172.21.15.138:6808/3033110975,v1:172.21.15.138:6809/3033110975]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:11:02.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:01 smithi138 ceph-mon[35019]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:11:02.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:01 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:02.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:01 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:02.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:01 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:02.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:01 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:02.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:01 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:02.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:01 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:02.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:01 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:11:02.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:01 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:02.224 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:11:02.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.720+0000 7f97242f6640 1 -- 172.21.15.78:0/933319456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f971c104660 msgr2=0x7f971c10cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:02.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.720+0000 7f97242f6640 1 --2- 172.21.15.78:0/933319456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f971c104660 0x7f971c10cb50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9710009900 tx=0x7f971002a410 comp rx=0 tx=0).stop 2024-09-11T00:11:02.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.720+0000 7f97242f6640 1 -- 172.21.15.78:0/933319456 shutdown_connections 2024-09-11T00:11:02.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.720+0000 7f97242f6640 1 --2- 172.21.15.78:0/933319456 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f971c10d1a0 0x7f971c10f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:02.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.720+0000 7f97242f6640 1 --2- 172.21.15.78:0/933319456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f971c104660 0x7f971c10cb50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:02.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.720+0000 7f97242f6640 1 --2- 172.21.15.78:0/933319456 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f971c103d40 0x7f971c104120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:02.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.720+0000 7f97242f6640 1 -- 172.21.15.78:0/933319456 >> 172.21.15.78:0/933319456 conn(0x7f971c0fd7e0 msgr2=0x7f971c0ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:02.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.720+0000 7f97242f6640 1 -- 172.21.15.78:0/933319456 shutdown_connections 2024-09-11T00:11:02.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.720+0000 7f97242f6640 1 -- 172.21.15.78:0/933319456 wait complete. 2024-09-11T00:11:02.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.720+0000 7f97242f6640 1 Processor -- start 2024-09-11T00:11:02.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.720+0000 7f97242f6640 1 -- start start 2024-09-11T00:11:02.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.721+0000 7f97242f6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f971c103d40 0x7f971c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:02.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.721+0000 7f97242f6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f971c104660 0x7f971c199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:02.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.721+0000 7f97242f6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f971c10d1a0 0x7f971c19ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:02.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.721+0000 7f97242f6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f971c112e10 con 0x7f971c10d1a0 2024-09-11T00:11:02.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.721+0000 7f97242f6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f971c112c90 con 0x7f971c103d40 2024-09-11T00:11:02.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.721+0000 7f97242f6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f971c112f90 con 0x7f971c104660 2024-09-11T00:11:02.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.721+0000 7f9722893640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f971c10d1a0 0x7f971c19ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:02.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.721+0000 7f9722893640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f971c10d1a0 0x7f971c19ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42716/0 (socket says 172.21.15.78:42716) 2024-09-11T00:11:02.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.721+0000 7f9722893640 1 -- 172.21.15.78:0/2554714044 learned_addr learned my addr 172.21.15.78:0/2554714044 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:11:02.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.721+0000 7f9721891640 1 --2- 172.21.15.78:0/2554714044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f971c104660 0x7f971c199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:02.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.721+0000 7f9722092640 1 --2- 172.21.15.78:0/2554714044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f971c103d40 0x7f971c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:02.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.721+0000 7f9722893640 1 -- 172.21.15.78:0/2554714044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f971c104660 msgr2=0x7f971c199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:02.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.721+0000 7f9722893640 1 --2- 172.21.15.78:0/2554714044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f971c104660 0x7f971c199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:02.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.721+0000 7f9722893640 1 -- 172.21.15.78:0/2554714044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f971c103d40 msgr2=0x7f971c1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:02.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.721+0000 7f9722893640 1 --2- 172.21.15.78:0/2554714044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f971c103d40 0x7f971c1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:02.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.721+0000 7f9722893640 1 -- 172.21.15.78:0/2554714044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f971c19f390 con 0x7f971c10d1a0 2024-09-11T00:11:02.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.721+0000 7f9722092640 1 --2- 172.21.15.78:0/2554714044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f971c103d40 0x7f971c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:11:02.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.721+0000 7f9722893640 1 --2- 172.21.15.78:0/2554714044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f971c10d1a0 0x7f971c19ebc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f970c00d750 tx=0x7f970c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:02.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.721+0000 7f971b7fe640 1 -- 172.21.15.78:0/2554714044 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c017070 con 0x7f971c10d1a0 2024-09-11T00:11:02.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.721+0000 7f97242f6640 1 -- 172.21.15.78:0/2554714044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f971c19f680 con 0x7f971c10d1a0 2024-09-11T00:11:02.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.721+0000 7f971b7fe640 1 -- 172.21.15.78:0/2554714044 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f970c0054d0 con 0x7f971c10d1a0 2024-09-11T00:11:02.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.722+0000 7f971b7fe640 1 -- 172.21.15.78:0/2554714044 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c004c60 con 0x7f971c10d1a0 2024-09-11T00:11:02.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.722+0000 7f97242f6640 1 -- 172.21.15.78:0/2554714044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f971c1a5d40 con 0x7f971c10d1a0 2024-09-11T00:11:02.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.722+0000 7f97242f6640 1 -- 172.21.15.78:0/2554714044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f971c104120 con 0x7f971c10d1a0 2024-09-11T00:11:02.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.724+0000 7f971b7fe640 1 -- 172.21.15.78:0/2554714044 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f970c004e00 con 0x7f971c10d1a0 2024-09-11T00:11:02.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.725+0000 7f971b7fe640 1 --2- 172.21.15.78:0/2554714044 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f97040b5330 0x7f97040b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:02.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.725+0000 7f9722092640 1 --2- 172.21.15.78:0/2554714044 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f97040b5330 0x7f97040b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:02.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.725+0000 7f971b7fe640 1 -- 172.21.15.78:0/2554714044 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4781+0+0 (secure 0 0 0) 0x7f970c0e4c70 con 0x7f971c10d1a0 2024-09-11T00:11:02.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.725+0000 7f9722092640 1 --2- 172.21.15.78:0/2554714044 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f97040b5330 0x7f97040b77f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9714007e70 tx=0x7f9714007850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:02.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.728+0000 7f971b7fe640 1 -- 172.21.15.78:0/2554714044 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f970c0ac900 con 0x7f971c10d1a0 2024-09-11T00:11:02.913 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:02 smithi078 ceph-mon[30865]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:11:02.913 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:02 smithi078 ceph-mon[30865]: Detected new or changed devices on smithi138 2024-09-11T00:11:02.913 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:02 smithi078 ceph-mon[30865]: Adjusting osd_memory_target on smithi138 to 8544M 2024-09-11T00:11:02.914 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:02 smithi078 ceph-mon[30865]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-11T00:11:02.914 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:02 smithi078 ceph-mon[30865]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T00:11:02.914 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:02 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T00:11:02.914 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:02 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T00:11:02.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:02.911+0000 7f97242f6640 1 -- 172.21.15.78:0/2554714044 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f971c1081e0 con 0x7f97040b5330 2024-09-11T00:11:02.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:02 smithi112 ceph-mon[35627]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:11:02.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:02 smithi112 ceph-mon[35627]: Detected new or changed devices on smithi138 2024-09-11T00:11:02.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:02 smithi112 ceph-mon[35627]: Adjusting osd_memory_target on smithi138 to 8544M 2024-09-11T00:11:02.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:02 smithi112 ceph-mon[35627]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-11T00:11:02.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:02 smithi112 ceph-mon[35627]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T00:11:02.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:02 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T00:11:02.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:02 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T00:11:03.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:02 smithi138 ceph-mon[35019]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:11:03.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:02 smithi138 ceph-mon[35019]: Detected new or changed devices on smithi138 2024-09-11T00:11:03.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:02 smithi138 ceph-mon[35019]: Adjusting osd_memory_target on smithi138 to 8544M 2024-09-11T00:11:03.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:02 smithi138 ceph-mon[35019]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-11T00:11:03.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:02 smithi138 ceph-mon[35019]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T00:11:03.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:02 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T00:11:03.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:02 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T00:11:03.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:03 smithi078 ceph-mon[30865]: purged_snaps scrub starts 2024-09-11T00:11:03.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:03 smithi078 ceph-mon[30865]: purged_snaps scrub ok 2024-09-11T00:11:03.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:03 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T00:11:03.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:03 smithi078 ceph-mon[30865]: osd.5 [v2:172.21.15.138:6808/3033110975,v1:172.21.15.138:6809/3033110975] boot 2024-09-11T00:11:03.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:03 smithi078 ceph-mon[30865]: osdmap e35: 6 total, 6 up, 6 in 2024-09-11T00:11:03.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:03 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T00:11:03.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:03 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:11:03.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:03 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:11:03.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:03 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:03.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:03 smithi112 ceph-mon[35627]: purged_snaps scrub starts 2024-09-11T00:11:03.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:03 smithi112 ceph-mon[35627]: purged_snaps scrub ok 2024-09-11T00:11:03.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:03 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T00:11:03.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:03 smithi112 ceph-mon[35627]: osd.5 [v2:172.21.15.138:6808/3033110975,v1:172.21.15.138:6809/3033110975] boot 2024-09-11T00:11:03.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:03 smithi112 ceph-mon[35627]: osdmap e35: 6 total, 6 up, 6 in 2024-09-11T00:11:03.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:03 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T00:11:03.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:03 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:11:03.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:03 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:11:03.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:03 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:04.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:03 smithi138 ceph-mon[35019]: purged_snaps scrub starts 2024-09-11T00:11:04.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:03 smithi138 ceph-mon[35019]: purged_snaps scrub ok 2024-09-11T00:11:04.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:03 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T00:11:04.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:03 smithi138 ceph-mon[35019]: osd.5 [v2:172.21.15.138:6808/3033110975,v1:172.21.15.138:6809/3033110975] boot 2024-09-11T00:11:04.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:03 smithi138 ceph-mon[35019]: osdmap e35: 6 total, 6 up, 6 in 2024-09-11T00:11:04.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:03 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T00:11:04.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:03 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:11:04.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:03 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:11:04.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:03 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:04.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:04 smithi112 ceph-mon[35627]: from='client.14541 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:04.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:04 smithi112 ceph-mon[35627]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:11:04.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:04 smithi112 ceph-mon[35627]: osdmap e36: 6 total, 6 up, 6 in 2024-09-11T00:11:05.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:04 smithi138 ceph-mon[35019]: from='client.14541 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:05.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:04 smithi138 ceph-mon[35019]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:11:05.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:04 smithi138 ceph-mon[35019]: osdmap e36: 6 total, 6 up, 6 in 2024-09-11T00:11:05.079 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:04 smithi078 ceph-mon[30865]: from='client.14541 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:05.079 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:04 smithi078 ceph-mon[30865]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-11T00:11:05.079 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:04 smithi078 ceph-mon[30865]: osdmap e36: 6 total, 6 up, 6 in 2024-09-11T00:11:05.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:05 smithi112 ceph-mon[35627]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T00:11:05.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:05 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3004727832' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7442a091-4dba-45c4-808b-7c3b97087aa4"} : dispatch 2024-09-11T00:11:05.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:05 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3004727832' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7442a091-4dba-45c4-808b-7c3b97087aa4"}]': finished 2024-09-11T00:11:05.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:05 smithi112 ceph-mon[35627]: osdmap e38: 7 total, 6 up, 7 in 2024-09-11T00:11:05.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:05 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T00:11:05.998 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:05 smithi078 ceph-mon[30865]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T00:11:05.999 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:05 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3004727832' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7442a091-4dba-45c4-808b-7c3b97087aa4"} : dispatch 2024-09-11T00:11:05.999 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:05 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3004727832' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7442a091-4dba-45c4-808b-7c3b97087aa4"}]': finished 2024-09-11T00:11:05.999 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:05 smithi078 ceph-mon[30865]: osdmap e38: 7 total, 6 up, 7 in 2024-09-11T00:11:05.999 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:05 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T00:11:06.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:05 smithi138 ceph-mon[35019]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T00:11:06.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:05 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3004727832' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7442a091-4dba-45c4-808b-7c3b97087aa4"} : dispatch 2024-09-11T00:11:06.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:05 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3004727832' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7442a091-4dba-45c4-808b-7c3b97087aa4"}]': finished 2024-09-11T00:11:06.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:05 smithi138 ceph-mon[35019]: osdmap e38: 7 total, 6 up, 7 in 2024-09-11T00:11:06.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:05 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T00:11:06.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:06 smithi112 ceph-mon[35627]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:11:06.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:06 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3676491243' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:11:07.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:06 smithi138 ceph-mon[35019]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:11:07.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:06 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3676491243' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:11:07.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:06 smithi078 ceph-mon[30865]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:11:07.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:06 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3676491243' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:11:08.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:08 smithi078 ceph-mon[30865]: pgmap v122: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:11:08.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:08 smithi112 ceph-mon[35627]: pgmap v122: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:11:09.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:08 smithi138 ceph-mon[35019]: pgmap v122: 1 pgs: 1 peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:11:10.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:10 smithi078 ceph-mon[30865]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T00:11:10.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:10 smithi112 ceph-mon[35627]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T00:11:11.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:10 smithi138 ceph-mon[35019]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T00:11:12.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:12 smithi112 ceph-mon[35627]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-11T00:11:13.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:12 smithi138 ceph-mon[35019]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-11T00:11:13.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:12 smithi078 ceph-mon[30865]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-11T00:11:14.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:14 smithi112 ceph-mon[35627]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-11T00:11:14.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:14 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-11T00:11:14.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:14 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:15.037 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:14 smithi078 ceph-mon[30865]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-11T00:11:15.037 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:14 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-11T00:11:15.037 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:14 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:15.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:14 smithi138 ceph-mon[35019]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-11T00:11:15.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:14 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-11T00:11:15.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:14 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:16.032 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:15 smithi078 ceph-mon[30865]: Deploying daemon osd.6 on smithi078 2024-09-11T00:11:16.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:15 smithi138 ceph-mon[35019]: Deploying daemon osd.6 on smithi078 2024-09-11T00:11:16.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:15 smithi112 ceph-mon[35627]: Deploying daemon osd.6 on smithi078 2024-09-11T00:11:16.973 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:16 smithi078 ceph-mon[30865]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-11T00:11:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:16 smithi138 ceph-mon[35019]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-11T00:11:17.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:16 smithi112 ceph-mon[35627]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-11T00:11:19.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:18 smithi138 ceph-mon[35019]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T00:11:19.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:18 smithi078 ceph-mon[30865]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T00:11:19.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:18 smithi112 ceph-mon[35627]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T00:11:21.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:20 smithi138 ceph-mon[35019]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T00:11:21.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:20 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:11:21.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:20 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:21.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:20 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:21.072 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:20 smithi078 ceph-mon[30865]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T00:11:21.073 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:20 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:11:21.073 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:20 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:21.073 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:20 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:21.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:20 smithi112 ceph-mon[35627]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T00:11:21.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:20 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:11:21.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:20 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:21.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:20 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:22.933 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:22 smithi078 ceph-mon[30865]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:11:23.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:22 smithi138 ceph-mon[35019]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:11:23.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:22 smithi112 ceph-mon[35627]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:11:24.203 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:24 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:24.203 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:24 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:24.203 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:24 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:24.203 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:24 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:11:24.203 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:24 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:24.203 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:24 smithi078 ceph-mon[30865]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:11:24.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:24.240+0000 7f971b7fe640 1 -- 172.21.15.78:0/2554714044 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f971c1081e0 con 0x7f97040b5330 2024-09-11T00:11:24.241 INFO:teuthology.orchestra.run.smithi078.stdout:Created osd(s) 6 on host 'smithi078' 2024-09-11T00:11:24.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:24.242+0000 7f97242f6640 1 -- 172.21.15.78:0/2554714044 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f97040b5330 msgr2=0x7f97040b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:24.242+0000 7f97242f6640 1 --2- 172.21.15.78:0/2554714044 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f97040b5330 0x7f97040b77f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9714007e70 tx=0x7f9714007850 comp rx=0 tx=0).stop 2024-09-11T00:11:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:24.242+0000 7f97242f6640 1 -- 172.21.15.78:0/2554714044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f971c10d1a0 msgr2=0x7f971c19ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:24.242+0000 7f97242f6640 1 --2- 172.21.15.78:0/2554714044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f971c10d1a0 0x7f971c19ebc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f970c00d750 tx=0x7f970c00dc10 comp rx=0 tx=0).stop 2024-09-11T00:11:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:24.242+0000 7f97242f6640 1 -- 172.21.15.78:0/2554714044 shutdown_connections 2024-09-11T00:11:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:24.242+0000 7f97242f6640 1 --2- 172.21.15.78:0/2554714044 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f97040b5330 0x7f97040b77f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:24.242+0000 7f97242f6640 1 --2- 172.21.15.78:0/2554714044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f971c10d1a0 0x7f971c19ebc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:24.242+0000 7f97242f6640 1 --2- 172.21.15.78:0/2554714044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f971c104660 0x7f971c199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:24.242+0000 7f97242f6640 1 --2- 172.21.15.78:0/2554714044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f971c103d40 0x7f971c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:24.242+0000 7f97242f6640 1 -- 172.21.15.78:0/2554714044 >> 172.21.15.78:0/2554714044 conn(0x7f971c0fd7e0 msgr2=0x7f971c0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:24.242+0000 7f97242f6640 1 -- 172.21.15.78:0/2554714044 shutdown_connections 2024-09-11T00:11:24.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:11:24.242+0000 7f97242f6640 1 -- 172.21.15.78:0/2554714044 wait complete. 2024-09-11T00:11:24.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:24 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:24.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:24 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:24.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:24 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:24.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:24 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:11:24.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:24 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:24.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:24 smithi112 ceph-mon[35627]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:11:24.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:24 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:24.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:24 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:24.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:24 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:24.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:24 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:11:24.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:24 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:24.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:24 smithi138 ceph-mon[35019]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:11:24.911 DEBUG:teuthology.orchestra.run.smithi078:osd.6> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.6.service 2024-09-11T00:11:24.913 INFO:tasks.cephadm:Deploying osd.7 on smithi112 with /dev/vg_nvme/lv_2... 2024-09-11T00:11:24.914 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T00:11:25.172 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T00:11:25.183 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:25 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:11:25.183 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:25 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:25.183 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:25 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:25.231 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:25 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:11:25.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:25 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:25.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:25 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:25.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:25 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:11:25.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:25 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:25.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:25 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:26.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:26 smithi078 ceph-mon[30865]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:11:26.374 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:26 smithi112 ceph-mon[35627]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:11:26.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:26 smithi138 ceph-mon[35019]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:11:26.834 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:11:26 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:11:26.530+0000 7f6a0341a640 -1 osd.6 0 log_to_monitors true 2024-09-11T00:11:27.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:27 smithi078 ceph-mon[30865]: from='osd.6 [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-11T00:11:27.475 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:27 smithi112 ceph-mon[35627]: from='osd.6 [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-11T00:11:27.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:27 smithi138 ceph-mon[35019]: from='osd.6 [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-11T00:11:27.878 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-11T00:11:27.910 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi112:vg_nvme/lv_2 2024-09-11T00:11:28.165 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T00:11:28.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:28 smithi078 ceph-mon[30865]: from='osd.6 [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T00:11:28.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:28 smithi078 ceph-mon[30865]: osdmap e39: 7 total, 6 up, 7 in 2024-09-11T00:11:28.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:28 smithi078 ceph-mon[30865]: from='osd.6 [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi078", "root=default"]} : dispatch 2024-09-11T00:11:28.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:28 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T00:11:28.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:28 smithi078 ceph-mon[30865]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:11:28.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:28 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:28.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:28 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:28.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:28 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:28.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:28 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:28.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:28 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:28.335 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:28 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:28.335 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:28 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:28.335 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:28 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:11:28.335 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:28 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:28.398 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:28 smithi112 ceph-mon[35627]: from='osd.6 [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T00:11:28.398 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:28 smithi112 ceph-mon[35627]: osdmap e39: 7 total, 6 up, 7 in 2024-09-11T00:11:28.398 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:28 smithi112 ceph-mon[35627]: from='osd.6 [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi078", "root=default"]} : dispatch 2024-09-11T00:11:28.398 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:28 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T00:11:28.398 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:28 smithi112 ceph-mon[35627]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:11:28.398 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:28 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:28.398 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:28 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:28.398 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:28 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:28.398 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:28 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:28.398 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:28 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:28.398 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:28 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:28.399 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:28 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:28.399 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:28 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:11:28.399 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:28 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:28.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:28 smithi138 ceph-mon[35019]: from='osd.6 [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T00:11:28.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:28 smithi138 ceph-mon[35019]: osdmap e39: 7 total, 6 up, 7 in 2024-09-11T00:11:28.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:28 smithi138 ceph-mon[35019]: from='osd.6 [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi078", "root=default"]} : dispatch 2024-09-11T00:11:28.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:28 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T00:11:28.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:28 smithi138 ceph-mon[35019]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:11:28.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:28 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:28.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:28 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:28.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:28 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:28.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:28 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:28.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:28 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:28.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:28 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:28.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:28 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:28.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:28 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:11:28.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:28 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.592+0000 7f9f028a0640 1 -- 172.21.15.112:0/1528321702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9efc101c90 msgr2=0x7f9efc102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.592+0000 7f9f028a0640 1 --2- 172.21.15.112:0/1528321702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9efc101c90 0x7f9efc102070 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9eec009900 tx=0x7f9eec02a410 comp rx=0 tx=0).stop 2024-09-11T00:11:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.592+0000 7f9f028a0640 1 -- 172.21.15.112:0/1528321702 shutdown_connections 2024-09-11T00:11:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.592+0000 7f9f028a0640 1 --2- 172.21.15.112:0/1528321702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9efc108020 0x7f9efc10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.592+0000 7f9f028a0640 1 --2- 172.21.15.112:0/1528321702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9efc1076a0 0x7f9efc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.592+0000 7f9f028a0640 1 --2- 172.21.15.112:0/1528321702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9efc101c90 0x7f9efc102070 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:28.611 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.592+0000 7f9f028a0640 1 -- 172.21.15.112:0/1528321702 >> 172.21.15.112:0/1528321702 conn(0x7f9efc0fd6e0 msgr2=0x7f9efc0ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.593+0000 7f9f028a0640 1 -- 172.21.15.112:0/1528321702 shutdown_connections 2024-09-11T00:11:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.593+0000 7f9f028a0640 1 -- 172.21.15.112:0/1528321702 wait complete. 2024-09-11T00:11:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.593+0000 7f9f028a0640 1 Processor -- start 2024-09-11T00:11:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.593+0000 7f9f028a0640 1 -- start start 2024-09-11T00:11:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.593+0000 7f9f028a0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9efc101c90 0x7f9efc19a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.593+0000 7f9f028a0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9efc1076a0 0x7f9efc19a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.594+0000 7f9f028a0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9efc108020 0x7f9efc19ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.594+0000 7f9f028a0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc111d20 con 0x7f9efc108020 2024-09-11T00:11:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.594+0000 7f9f028a0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc111ba0 con 0x7f9efc1076a0 2024-09-11T00:11:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.594+0000 7f9f028a0640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc111ea0 con 0x7f9efc101c90 2024-09-11T00:11:28.612 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.594+0000 7f9efb7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9efc1076a0 0x7f9efc19a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:28.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.594+0000 7f9efb7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9efc1076a0 0x7f9efc19a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60394/0 (socket says 172.21.15.112:60394) 2024-09-11T00:11:28.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.594+0000 7f9efb7fe640 1 -- 172.21.15.112:0/3845188861 learned_addr learned my addr 172.21.15.112:0/3845188861 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-11T00:11:28.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.594+0000 7f9efbfff640 1 --2- 172.21.15.112:0/3845188861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9efc101c90 0x7f9efc19a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:28.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.594+0000 7f9f00e3d640 1 --2- 172.21.15.112:0/3845188861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9efc108020 0x7f9efc19ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:28.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.594+0000 7f9efb7fe640 1 -- 172.21.15.112:0/3845188861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9efc101c90 msgr2=0x7f9efc19a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:28.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.594+0000 7f9efb7fe640 1 --2- 172.21.15.112:0/3845188861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9efc101c90 0x7f9efc19a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:28.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.594+0000 7f9efb7fe640 1 -- 172.21.15.112:0/3845188861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9efc108020 msgr2=0x7f9efc19ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:28.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.594+0000 7f9efb7fe640 1 --2- 172.21.15.112:0/3845188861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9efc108020 0x7f9efc19ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:28.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.594+0000 7f9efb7fe640 1 -- 172.21.15.112:0/3845188861 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9efc1a55c0 con 0x7f9efc1076a0 2024-09-11T00:11:28.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.594+0000 7f9f00e3d640 1 --2- 172.21.15.112:0/3845188861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9efc108020 0x7f9efc19ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:11:28.613 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.594+0000 7f9efb7fe640 1 --2- 172.21.15.112:0/3845188861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9efc1076a0 0x7f9efc19a720 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400b4a0 tx=0x7f9ee400b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:28.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.594+0000 7f9ef97fa640 1 -- 172.21.15.112:0/3845188861 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4014070 con 0x7f9efc1076a0 2024-09-11T00:11:28.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.594+0000 7f9ef97fa640 1 -- 172.21.15.112:0/3845188861 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ee4010ac0 con 0x7f9efc1076a0 2024-09-11T00:11:28.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.594+0000 7f9f028a0640 1 -- 172.21.15.112:0/3845188861 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9efc1a58b0 con 0x7f9efc1076a0 2024-09-11T00:11:28.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.594+0000 7f9ef97fa640 1 -- 172.21.15.112:0/3845188861 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4017c30 con 0x7f9efc1076a0 2024-09-11T00:11:28.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.594+0000 7f9f028a0640 1 -- 172.21.15.112:0/3845188861 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9efc1a5e70 con 0x7f9efc1076a0 2024-09-11T00:11:28.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.595+0000 7f9f028a0640 1 -- 172.21.15.112:0/3845188861 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9efc1020f0 con 0x7f9efc1076a0 2024-09-11T00:11:28.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.597+0000 7f9ef97fa640 1 -- 172.21.15.112:0/3845188861 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f9ee4010610 con 0x7f9efc1076a0 2024-09-11T00:11:28.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.597+0000 7f9ef97fa640 1 --2- 172.21.15.112:0/3845188861 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f9ee80b5330 0x7f9ee80b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:28.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.598+0000 7f9ef97fa640 1 -- 172.21.15.112:0/3845188861 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4900+0+0 (secure 0 0 0) 0x7f9ee40e4770 con 0x7f9efc1076a0 2024-09-11T00:11:28.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.598+0000 7f9efbfff640 1 --2- 172.21.15.112:0/3845188861 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f9ee80b5330 0x7f9ee80b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:28.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.598+0000 7f9efbfff640 1 --2- 172.21.15.112:0/3845188861 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f9ee80b5330 0x7f9ee80b77f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9eec031440 tx=0x7f9eec005e80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:28.614 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.600+0000 7f9ef97fa640 1 -- 172.21.15.112:0/3845188861 <== mon.2 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9ee40ac360 con 0x7f9efc1076a0 2024-09-11T00:11:28.789 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:28.788+0000 7f9f028a0640 1 -- 172.21.15.112:0/3845188861 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f9efc063590 con 0x7f9ee80b5330 2024-09-11T00:11:28.833 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:11:28 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:11:28.561+0000 7f69ff39d640 -1 osd.6 0 waiting for initial osdmap 2024-09-11T00:11:28.834 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:11:28 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:11:28.568+0000 7f69f71bc640 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:11:29.431 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:29 smithi112 ceph-mon[35627]: Detected new or changed devices on smithi078 2024-09-11T00:11:29.431 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:29 smithi112 ceph-mon[35627]: Adjusting osd_memory_target on smithi078 to 5696M 2024-09-11T00:11:29.431 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:29 smithi112 ceph-mon[35627]: from='osd.6 [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-11T00:11:29.431 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:29 smithi112 ceph-mon[35627]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T00:11:29.431 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:29 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T00:11:29.431 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:29 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T00:11:29.431 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:29 smithi112 ceph-mon[35627]: from='osd.6 [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575]' entity='osd.6' 2024-09-11T00:11:29.431 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:29 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:11:29.431 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:29 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:11:29.432 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:29 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:29.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:29 smithi138 ceph-mon[35019]: Detected new or changed devices on smithi078 2024-09-11T00:11:29.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:29 smithi138 ceph-mon[35019]: Adjusting osd_memory_target on smithi078 to 5696M 2024-09-11T00:11:29.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:29 smithi138 ceph-mon[35019]: from='osd.6 [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-11T00:11:29.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:29 smithi138 ceph-mon[35019]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T00:11:29.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:29 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T00:11:29.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:29 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T00:11:29.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:29 smithi138 ceph-mon[35019]: from='osd.6 [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575]' entity='osd.6' 2024-09-11T00:11:29.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:29 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:11:29.545 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:29 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:11:29.545 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:29 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:29.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:29 smithi078 ceph-mon[30865]: Detected new or changed devices on smithi078 2024-09-11T00:11:29.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:29 smithi078 ceph-mon[30865]: Adjusting osd_memory_target on smithi078 to 5696M 2024-09-11T00:11:29.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:29 smithi078 ceph-mon[30865]: from='osd.6 [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-11T00:11:29.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:29 smithi078 ceph-mon[30865]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T00:11:29.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:29 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T00:11:29.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:29 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T00:11:29.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:29 smithi078 ceph-mon[30865]: from='osd.6 [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575]' entity='osd.6' 2024-09-11T00:11:29.585 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:29 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:11:29.585 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:29 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:11:29.585 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:29 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:30.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:30 smithi112 ceph-mon[35627]: purged_snaps scrub starts 2024-09-11T00:11:30.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:30 smithi112 ceph-mon[35627]: purged_snaps scrub ok 2024-09-11T00:11:30.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:30 smithi112 ceph-mon[35627]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:30.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:30 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T00:11:30.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:30 smithi112 ceph-mon[35627]: osd.6 [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575] boot 2024-09-11T00:11:30.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:30 smithi112 ceph-mon[35627]: osdmap e41: 7 total, 7 up, 7 in 2024-09-11T00:11:30.483 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:30 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T00:11:30.483 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:30 smithi112 ceph-mon[35627]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:11:30.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:30 smithi138 ceph-mon[35019]: purged_snaps scrub starts 2024-09-11T00:11:30.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:30 smithi138 ceph-mon[35019]: purged_snaps scrub ok 2024-09-11T00:11:30.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:30 smithi138 ceph-mon[35019]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:30.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:30 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T00:11:30.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:30 smithi138 ceph-mon[35019]: osd.6 [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575] boot 2024-09-11T00:11:30.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:30 smithi138 ceph-mon[35019]: osdmap e41: 7 total, 7 up, 7 in 2024-09-11T00:11:30.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:30 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T00:11:30.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:30 smithi138 ceph-mon[35019]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:11:30.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:30 smithi078 ceph-mon[30865]: purged_snaps scrub starts 2024-09-11T00:11:30.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:30 smithi078 ceph-mon[30865]: purged_snaps scrub ok 2024-09-11T00:11:30.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:30 smithi078 ceph-mon[30865]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:30.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:30 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T00:11:30.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:30 smithi078 ceph-mon[30865]: osd.6 [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575] boot 2024-09-11T00:11:30.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:30 smithi078 ceph-mon[30865]: osdmap e41: 7 total, 7 up, 7 in 2024-09-11T00:11:30.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:30 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T00:11:30.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:30 smithi078 ceph-mon[30865]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-11T00:11:31.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:31 smithi078 ceph-mon[30865]: osdmap e42: 7 total, 7 up, 7 in 2024-09-11T00:11:31.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:31 smithi078 ceph-mon[30865]: from='client.? 172.21.15.112:0/106265729' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "220c1f03-ace9-4dd0-a06d-485b0d2d08bd"} : dispatch 2024-09-11T00:11:31.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:31 smithi078 ceph-mon[30865]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "220c1f03-ace9-4dd0-a06d-485b0d2d08bd"} : dispatch 2024-09-11T00:11:31.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:31 smithi078 ceph-mon[30865]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "220c1f03-ace9-4dd0-a06d-485b0d2d08bd"}]': finished 2024-09-11T00:11:31.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:31 smithi078 ceph-mon[30865]: osdmap e43: 8 total, 7 up, 8 in 2024-09-11T00:11:31.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:31 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T00:11:31.916 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:31 smithi112 ceph-mon[35627]: osdmap e42: 7 total, 7 up, 7 in 2024-09-11T00:11:31.916 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:31 smithi112 ceph-mon[35627]: from='client.? 172.21.15.112:0/106265729' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "220c1f03-ace9-4dd0-a06d-485b0d2d08bd"} : dispatch 2024-09-11T00:11:31.916 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:31 smithi112 ceph-mon[35627]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "220c1f03-ace9-4dd0-a06d-485b0d2d08bd"} : dispatch 2024-09-11T00:11:31.916 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:31 smithi112 ceph-mon[35627]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "220c1f03-ace9-4dd0-a06d-485b0d2d08bd"}]': finished 2024-09-11T00:11:31.916 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:31 smithi112 ceph-mon[35627]: osdmap e43: 8 total, 7 up, 8 in 2024-09-11T00:11:31.917 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:31 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T00:11:32.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:31 smithi138 ceph-mon[35019]: osdmap e42: 7 total, 7 up, 7 in 2024-09-11T00:11:32.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:31 smithi138 ceph-mon[35019]: from='client.? 172.21.15.112:0/106265729' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "220c1f03-ace9-4dd0-a06d-485b0d2d08bd"} : dispatch 2024-09-11T00:11:32.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:31 smithi138 ceph-mon[35019]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "220c1f03-ace9-4dd0-a06d-485b0d2d08bd"} : dispatch 2024-09-11T00:11:32.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:31 smithi138 ceph-mon[35019]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "220c1f03-ace9-4dd0-a06d-485b0d2d08bd"}]': finished 2024-09-11T00:11:32.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:31 smithi138 ceph-mon[35019]: osdmap e43: 8 total, 7 up, 8 in 2024-09-11T00:11:32.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:31 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T00:11:32.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:32 smithi078 ceph-mon[30865]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:32.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:32 smithi078 ceph-mon[30865]: from='client.? 172.21.15.112:0/3196213350' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:11:32.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:32 smithi112 ceph-mon[35627]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:32.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:32 smithi112 ceph-mon[35627]: from='client.? 172.21.15.112:0/3196213350' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:11:33.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:32 smithi138 ceph-mon[35019]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:33.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:32 smithi138 ceph-mon[35019]: from='client.? 172.21.15.112:0/3196213350' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:11:34.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:34 smithi112 ceph-mon[35627]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:35.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:34 smithi138 ceph-mon[35019]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:35.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:34 smithi078 ceph-mon[30865]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:36.936 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:36 smithi112 ceph-mon[35627]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:37.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:36 smithi138 ceph-mon[35019]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:36 smithi078 ceph-mon[30865]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:38.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:38 smithi078 ceph-mon[30865]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:38.930 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:38 smithi112 ceph-mon[35627]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:39.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:38 smithi138 ceph-mon[35019]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:39.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:39 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-11T00:11:39.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:39 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:40.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:39 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-11T00:11:40.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:39 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:40.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:39 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-11T00:11:40.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:39 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:40.858 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:40 smithi112 ceph-mon[35627]: Deploying daemon osd.7 on smithi112 2024-09-11T00:11:40.858 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:40 smithi112 ceph-mon[35627]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:41.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:40 smithi138 ceph-mon[35019]: Deploying daemon osd.7 on smithi112 2024-09-11T00:11:41.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:40 smithi138 ceph-mon[35019]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:41.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:40 smithi078 ceph-mon[30865]: Deploying daemon osd.7 on smithi112 2024-09-11T00:11:41.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:40 smithi078 ceph-mon[30865]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:42.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:42 smithi112 ceph-mon[35627]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:43.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:42 smithi138 ceph-mon[35019]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:43.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:42 smithi078 ceph-mon[30865]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:44.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:44 smithi112 ceph-mon[35627]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:45.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:44 smithi138 ceph-mon[35019]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:45.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:44 smithi078 ceph-mon[30865]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:46.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:46 smithi112 ceph-mon[35627]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:46.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:46 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:11:46.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:46 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:46.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:46 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:46 smithi138 ceph-mon[35019]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:46 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:11:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:46 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:46 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:47.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:46 smithi078 ceph-mon[30865]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:47.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:46 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:11:47.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:46 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:47.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:46 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:48.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:48 smithi112 ceph-mon[35627]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:49.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:48 smithi138 ceph-mon[35019]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:49.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:48 smithi078 ceph-mon[30865]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:49.653 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:49.651+0000 7f9ef97fa640 1 -- 172.21.15.112:0/3845188861 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9efc063590 con 0x7f9ee80b5330 2024-09-11T00:11:49.654 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 7 on host 'smithi112' 2024-09-11T00:11:49.655 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:49.653+0000 7f9f028a0640 1 -- 172.21.15.112:0/3845188861 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f9ee80b5330 msgr2=0x7f9ee80b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:49.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:49.653+0000 7f9f028a0640 1 --2- 172.21.15.112:0/3845188861 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f9ee80b5330 0x7f9ee80b77f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9eec031440 tx=0x7f9eec005e80 comp rx=0 tx=0).stop 2024-09-11T00:11:49.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:49.653+0000 7f9f028a0640 1 -- 172.21.15.112:0/3845188861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9efc1076a0 msgr2=0x7f9efc19a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:49.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:49.653+0000 7f9f028a0640 1 --2- 172.21.15.112:0/3845188861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9efc1076a0 0x7f9efc19a720 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400b4a0 tx=0x7f9ee400b960 comp rx=0 tx=0).stop 2024-09-11T00:11:49.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:49.653+0000 7f9f028a0640 1 -- 172.21.15.112:0/3845188861 shutdown_connections 2024-09-11T00:11:49.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:49.653+0000 7f9f028a0640 1 --2- 172.21.15.112:0/3845188861 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f9ee80b5330 0x7f9ee80b77f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:49.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:49.653+0000 7f9f028a0640 1 --2- 172.21.15.112:0/3845188861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9efc108020 0x7f9efc19ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:49.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:49.653+0000 7f9f028a0640 1 --2- 172.21.15.112:0/3845188861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9efc1076a0 0x7f9efc19a720 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:49.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:49.653+0000 7f9f028a0640 1 --2- 172.21.15.112:0/3845188861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9efc101c90 0x7f9efc19a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:49.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:49.653+0000 7f9f028a0640 1 -- 172.21.15.112:0/3845188861 >> 172.21.15.112:0/3845188861 conn(0x7f9efc0fd6e0 msgr2=0x7f9efc0ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:49.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:49.653+0000 7f9f028a0640 1 -- 172.21.15.112:0/3845188861 shutdown_connections 2024-09-11T00:11:49.656 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:11:49.653+0000 7f9f028a0640 1 -- 172.21.15.112:0/3845188861 wait complete. 2024-09-11T00:11:50.354 DEBUG:teuthology.orchestra.run.smithi112:osd.7> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.7.service 2024-09-11T00:11:50.356 INFO:tasks.cephadm:Deploying osd.8 on smithi138 with /dev/vg_nvme/lv_2... 2024-09-11T00:11:50.356 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T00:11:50.613 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:11:50.933 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:50 smithi138 ceph-mon[35019]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:50.933 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:50 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:50.933 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:50 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:50.933 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:50 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:50.933 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:50 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:50.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:50 smithi112 ceph-mon[35627]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:50.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:50 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:50.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:50 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:50.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:50 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:50.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:50 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:51.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:50 smithi078 ceph-mon[30865]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:51.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:50 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:51.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:50 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:51.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:50 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:51.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:50 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:52.232 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:11:51 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:11:51.810+0000 7f3076147640 -1 osd.7 0 log_to_monitors true 2024-09-11T00:11:52.904 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:52 smithi138 ceph-mon[35019]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:52.905 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:52 smithi138 ceph-mon[35019]: from='osd.7 [v2:172.21.15.112:6816/1481363296,v1:172.21.15.112:6817/1481363296]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-11T00:11:52.905 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:52 smithi138 ceph-mon[35019]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-11T00:11:52.921 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:52 smithi112 ceph-mon[35627]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:52.921 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:52 smithi112 ceph-mon[35627]: from='osd.7 [v2:172.21.15.112:6816/1481363296,v1:172.21.15.112:6817/1481363296]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-11T00:11:52.921 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:52 smithi112 ceph-mon[35627]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-11T00:11:53.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:52 smithi078 ceph-mon[30865]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:53.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:52 smithi078 ceph-mon[30865]: from='osd.7 [v2:172.21.15.112:6816/1481363296,v1:172.21.15.112:6817/1481363296]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-11T00:11:53.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:52 smithi078 ceph-mon[30865]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-11T00:11:53.216 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:11:53.242 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi138:vg_nvme/lv_2 2024-09-11T00:11:53.501 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:11:53.908 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:53 smithi138 ceph-mon[35019]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T00:11:53.909 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:53 smithi138 ceph-mon[35019]: from='osd.7 [v2:172.21.15.112:6816/1481363296,v1:172.21.15.112:6817/1481363296]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:11:53.909 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:53 smithi138 ceph-mon[35019]: osdmap e44: 8 total, 7 up, 8 in 2024-09-11T00:11:53.909 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:53 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T00:11:53.909 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:53 smithi138 ceph-mon[35019]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:11:53.909 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:53 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:53.909 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:53 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:53.909 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:53 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:53.909 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:53 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:53.909 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:53 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:53.909 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:53 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:53.909 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:53 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:53.910 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:53 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:11:53.910 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:53 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:53.910 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:53 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:11:53.910 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:53 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:53.910 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:53 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:11:53.910 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:53 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:53.910 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:53 smithi138 ceph-mon[35019]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-11T00:11:53.910 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:53 smithi138 ceph-mon[35019]: osdmap e45: 8 total, 7 up, 8 in 2024-09-11T00:11:53.910 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:53 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T00:11:53.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:53 smithi112 ceph-mon[35627]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T00:11:53.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:53 smithi112 ceph-mon[35627]: from='osd.7 [v2:172.21.15.112:6816/1481363296,v1:172.21.15.112:6817/1481363296]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:11:53.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:53 smithi112 ceph-mon[35627]: osdmap e44: 8 total, 7 up, 8 in 2024-09-11T00:11:53.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:53 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T00:11:53.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:53 smithi112 ceph-mon[35627]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:11:53.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:53 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:53.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:53 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:53.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:53 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:53.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:53 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:53.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:53 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:53.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:53 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:53.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:53 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:53.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:53 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:11:53.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:53 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:53.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:53 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:11:53.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:53 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:53.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:53 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:11:53.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:53 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:53.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:53 smithi112 ceph-mon[35627]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-11T00:11:53.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:53 smithi112 ceph-mon[35627]: osdmap e45: 8 total, 7 up, 8 in 2024-09-11T00:11:53.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:53 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T00:11:54.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.990+0000 7feaf330f640 1 -- 172.21.15.138:0/2939464154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feaec104600 msgr2=0x7feaec10caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:54.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.990+0000 7feaf330f640 1 --2- 172.21.15.138:0/2939464154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feaec104600 0x7feaec10caf0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feae8009860 tx=0x7feae802a340 comp rx=0 tx=0).stop 2024-09-11T00:11:54.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.990+0000 7feaf330f640 1 -- 172.21.15.138:0/2939464154 shutdown_connections 2024-09-11T00:11:54.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.990+0000 7feaf330f640 1 --2- 172.21.15.138:0/2939464154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec10d140 0x7feaec10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:54.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.990+0000 7feaf330f640 1 --2- 172.21.15.138:0/2939464154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feaec104600 0x7feaec10caf0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:54.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.990+0000 7feaf330f640 1 --2- 172.21.15.138:0/2939464154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feaec103ce0 0x7feaec1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:54.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.990+0000 7feaf330f640 1 -- 172.21.15.138:0/2939464154 >> 172.21.15.138:0/2939464154 conn(0x7feaec0fd700 msgr2=0x7feaec0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:11:54.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.990+0000 7feaf330f640 1 -- 172.21.15.138:0/2939464154 shutdown_connections 2024-09-11T00:11:54.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.990+0000 7feaf330f640 1 -- 172.21.15.138:0/2939464154 wait complete. 2024-09-11T00:11:54.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.991+0000 7feaf330f640 1 Processor -- start 2024-09-11T00:11:54.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.991+0000 7feaf330f640 1 -- start start 2024-09-11T00:11:54.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.991+0000 7feaf330f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feaec103ce0 0x7feaec199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:54.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.991+0000 7feaf330f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec104600 0x7feaec199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:54.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.991+0000 7feaf330f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feaec10d140 0x7feaec19ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:54.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.991+0000 7feaf330f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7feaec112db0 con 0x7feaec10d140 2024-09-11T00:11:54.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.991+0000 7feaf330f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feaec112c30 con 0x7feaec104600 2024-09-11T00:11:54.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.991+0000 7feaf330f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7feaec112f30 con 0x7feaec103ce0 2024-09-11T00:11:54.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.991+0000 7feaf10ab640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feaec103ce0 0x7feaec199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:54.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.991+0000 7feaf10ab640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feaec103ce0 0x7feaec199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:42892/0 (socket says 172.21.15.138:42892) 2024-09-11T00:11:54.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.991+0000 7feaf10ab640 1 -- 172.21.15.138:0/1782069840 learned_addr learned my addr 172.21.15.138:0/1782069840 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-09-11T00:11:54.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.991+0000 7feaf08aa640 1 --2- 172.21.15.138:0/1782069840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec104600 0x7feaec199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:54.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.991+0000 7feaf18ac640 1 --2- 172.21.15.138:0/1782069840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feaec10d140 0x7feaec19ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:54.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.991+0000 7feaf10ab640 1 -- 172.21.15.138:0/1782069840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec104600 msgr2=0x7feaec199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:54.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.991+0000 7feaf10ab640 1 --2- 172.21.15.138:0/1782069840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec104600 0x7feaec199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:54.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.992+0000 7feaf10ab640 1 -- 172.21.15.138:0/1782069840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feaec10d140 msgr2=0x7feaec19ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:11:54.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.992+0000 7feaf10ab640 1 --2- 172.21.15.138:0/1782069840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feaec10d140 0x7feaec19ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:11:54.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.992+0000 7feaf10ab640 1 -- 172.21.15.138:0/1782069840 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaec19f3d0 con 0x7feaec103ce0 2024-09-11T00:11:54.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.992+0000 7feaf18ac640 1 --2- 172.21.15.138:0/1782069840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feaec10d140 0x7feaec19ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:11:54.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.992+0000 7feaf10ab640 1 --2- 172.21.15.138:0/1782069840 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feaec103ce0 0x7feaec199320 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feae000e9f0 tx=0x7feae000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:54.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.992+0000 7feade7fc640 1 -- 172.21.15.138:0/1782069840 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae000cd80 con 0x7feaec103ce0 2024-09-11T00:11:54.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.992+0000 7feaf330f640 1 -- 172.21.15.138:0/1782069840 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaec19f6c0 con 0x7feaec103ce0 2024-09-11T00:11:54.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.992+0000 7feade7fc640 1 -- 172.21.15.138:0/1782069840 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feae00108e0 con 0x7feaec103ce0 2024-09-11T00:11:54.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.992+0000 7feade7fc640 1 -- 172.21.15.138:0/1782069840 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae0018980 con 0x7feaec103ce0 2024-09-11T00:11:54.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.992+0000 7feaf330f640 1 -- 172.21.15.138:0/1782069840 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaec1a5d80 con 0x7feaec103ce0 2024-09-11T00:11:54.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.993+0000 7feaf330f640 1 -- 172.21.15.138:0/1782069840 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaec1040c0 con 0x7feaec103ce0 2024-09-11T00:11:54.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.994+0000 7feade7fc640 1 -- 172.21.15.138:0/1782069840 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7feae0010430 con 0x7feaec103ce0 2024-09-11T00:11:54.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.995+0000 7feade7fc640 1 --2- 172.21.15.138:0/1782069840 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fead80b5330 0x7fead80b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:11:54.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.995+0000 7feade7fc640 1 -- 172.21.15.138:0/1782069840 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5332+0+0 (secure 0 0 0) 0x7feae00e58d0 con 0x7feaec103ce0 2024-09-11T00:11:54.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.995+0000 7feaf08aa640 1 --2- 172.21.15.138:0/1782069840 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fead80b5330 0x7fead80b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:11:54.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.996+0000 7feaf08aa640 1 --2- 172.21.15.138:0/1782069840 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fead80b5330 0x7fead80b77f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feae8009830 tx=0x7feae80058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:11:54.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:53.998+0000 7feade7fc640 1 -- 172.21.15.138:0/1782069840 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7feae00ad330 con 0x7feaec103ce0 2024-09-11T00:11:54.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:53 smithi078 ceph-mon[30865]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T00:11:54.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:53 smithi078 ceph-mon[30865]: from='osd.7 [v2:172.21.15.112:6816/1481363296,v1:172.21.15.112:6817/1481363296]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:11:54.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:53 smithi078 ceph-mon[30865]: osdmap e44: 8 total, 7 up, 8 in 2024-09-11T00:11:54.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:53 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T00:11:54.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:53 smithi078 ceph-mon[30865]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:11:54.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:53 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:54.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:53 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:54.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:53 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:54.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:53 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:54.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:53 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T00:11:54.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:53 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:54.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:53 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:54.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:53 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:11:54.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:53 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:54.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:53 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:11:54.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:53 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:54.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:53 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:11:54.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:53 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:11:54.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:53 smithi078 ceph-mon[30865]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-11T00:11:54.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:53 smithi078 ceph-mon[30865]: osdmap e45: 8 total, 7 up, 8 in 2024-09-11T00:11:54.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:53 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T00:11:54.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:11:54.185+0000 7feaf330f640 1 -- 172.21.15.138:0/1782069840 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7feaec0ffa20 con 0x7fead80b5330 2024-09-11T00:11:54.482 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:11:54 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:11:54.035+0000 7f30720ca640 -1 osd.7 0 waiting for initial osdmap 2024-09-11T00:11:54.482 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:11:54 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:11:54.047+0000 7f3069ee9640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:11:54.928 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:54 smithi138 ceph-mon[35019]: Detected new or changed devices on smithi112 2024-09-11T00:11:54.929 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:54 smithi138 ceph-mon[35019]: Adjusting osd_memory_target on smithi112 to 5696M 2024-09-11T00:11:54.929 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:54 smithi138 ceph-mon[35019]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:54.929 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:54 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T00:11:54.929 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:54 smithi138 ceph-mon[35019]: from='osd.7 ' entity='osd.7' 2024-09-11T00:11:54.929 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:54 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:11:54.929 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:54 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:11:54.929 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:54 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:54.929 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:54 smithi138 ceph-mon[35019]: osd.7 [v2:172.21.15.112:6816/1481363296,v1:172.21.15.112:6817/1481363296] boot 2024-09-11T00:11:54.929 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:54 smithi138 ceph-mon[35019]: osdmap e46: 8 total, 8 up, 8 in 2024-09-11T00:11:54.929 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:54 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T00:11:54.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:54 smithi112 ceph-mon[35627]: Detected new or changed devices on smithi112 2024-09-11T00:11:54.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:54 smithi112 ceph-mon[35627]: Adjusting osd_memory_target on smithi112 to 5696M 2024-09-11T00:11:54.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:54 smithi112 ceph-mon[35627]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:54.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:54 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T00:11:54.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:54 smithi112 ceph-mon[35627]: from='osd.7 ' entity='osd.7' 2024-09-11T00:11:54.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:54 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:11:54.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:54 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:11:54.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:54 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:54.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:54 smithi112 ceph-mon[35627]: osd.7 [v2:172.21.15.112:6816/1481363296,v1:172.21.15.112:6817/1481363296] boot 2024-09-11T00:11:54.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:54 smithi112 ceph-mon[35627]: osdmap e46: 8 total, 8 up, 8 in 2024-09-11T00:11:54.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:54 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T00:11:55.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:54 smithi078 ceph-mon[30865]: Detected new or changed devices on smithi112 2024-09-11T00:11:55.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:54 smithi078 ceph-mon[30865]: Adjusting osd_memory_target on smithi112 to 5696M 2024-09-11T00:11:55.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:54 smithi078 ceph-mon[30865]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-11T00:11:55.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:54 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T00:11:55.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:54 smithi078 ceph-mon[30865]: from='osd.7 ' entity='osd.7' 2024-09-11T00:11:55.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:54 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:11:55.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:54 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:11:55.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:54 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:11:55.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:54 smithi078 ceph-mon[30865]: osd.7 [v2:172.21.15.112:6816/1481363296,v1:172.21.15.112:6817/1481363296] boot 2024-09-11T00:11:55.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:54 smithi078 ceph-mon[30865]: osdmap e46: 8 total, 8 up, 8 in 2024-09-11T00:11:55.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:54 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T00:11:55.935 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:55 smithi138 ceph-mon[35019]: purged_snaps scrub starts 2024-09-11T00:11:55.935 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:55 smithi138 ceph-mon[35019]: purged_snaps scrub ok 2024-09-11T00:11:55.936 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:55 smithi138 ceph-mon[35019]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:55.936 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:55 smithi138 ceph-mon[35019]: osdmap e47: 8 total, 8 up, 8 in 2024-09-11T00:11:55.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:55 smithi112 ceph-mon[35627]: purged_snaps scrub starts 2024-09-11T00:11:55.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:55 smithi112 ceph-mon[35627]: purged_snaps scrub ok 2024-09-11T00:11:55.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:55 smithi112 ceph-mon[35627]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:55.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:55 smithi112 ceph-mon[35627]: osdmap e47: 8 total, 8 up, 8 in 2024-09-11T00:11:56.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:55 smithi078 ceph-mon[30865]: purged_snaps scrub starts 2024-09-11T00:11:56.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:55 smithi078 ceph-mon[30865]: purged_snaps scrub ok 2024-09-11T00:11:56.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:55 smithi078 ceph-mon[30865]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:11:56.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:55 smithi078 ceph-mon[30865]: osdmap e47: 8 total, 8 up, 8 in 2024-09-11T00:11:56.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:56 smithi112 ceph-mon[35627]: pgmap v155: 1 pgs: 1 unknown; 577 KiB data, 259 MiB used, 715 GiB / 715 GiB avail 2024-09-11T00:11:56.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:56 smithi112 ceph-mon[35627]: osdmap e48: 8 total, 8 up, 8 in 2024-09-11T00:11:56.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:56 smithi112 ceph-mon[35627]: from='client.? 172.21.15.138:0/1620215044' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "adb6edaa-9a8c-4b0b-aa6a-26dc77a3a7cc"} : dispatch 2024-09-11T00:11:56.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:56 smithi112 ceph-mon[35627]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "adb6edaa-9a8c-4b0b-aa6a-26dc77a3a7cc"} : dispatch 2024-09-11T00:11:56.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:56 smithi112 ceph-mon[35627]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "adb6edaa-9a8c-4b0b-aa6a-26dc77a3a7cc"}]': finished 2024-09-11T00:11:56.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:56 smithi112 ceph-mon[35627]: osdmap e49: 9 total, 8 up, 9 in 2024-09-11T00:11:56.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:56 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T00:11:56.984 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:56 smithi078 ceph-mon[30865]: pgmap v155: 1 pgs: 1 unknown; 577 KiB data, 259 MiB used, 715 GiB / 715 GiB avail 2024-09-11T00:11:56.985 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:56 smithi078 ceph-mon[30865]: osdmap e48: 8 total, 8 up, 8 in 2024-09-11T00:11:56.985 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:56 smithi078 ceph-mon[30865]: from='client.? 172.21.15.138:0/1620215044' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "adb6edaa-9a8c-4b0b-aa6a-26dc77a3a7cc"} : dispatch 2024-09-11T00:11:56.985 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:56 smithi078 ceph-mon[30865]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "adb6edaa-9a8c-4b0b-aa6a-26dc77a3a7cc"} : dispatch 2024-09-11T00:11:56.985 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:56 smithi078 ceph-mon[30865]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "adb6edaa-9a8c-4b0b-aa6a-26dc77a3a7cc"}]': finished 2024-09-11T00:11:56.985 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:56 smithi078 ceph-mon[30865]: osdmap e49: 9 total, 8 up, 9 in 2024-09-11T00:11:56.985 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:56 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T00:11:56.985 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:56 smithi138 ceph-mon[35019]: pgmap v155: 1 pgs: 1 unknown; 577 KiB data, 259 MiB used, 715 GiB / 715 GiB avail 2024-09-11T00:11:56.985 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:56 smithi138 ceph-mon[35019]: osdmap e48: 8 total, 8 up, 8 in 2024-09-11T00:11:56.985 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:56 smithi138 ceph-mon[35019]: from='client.? 172.21.15.138:0/1620215044' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "adb6edaa-9a8c-4b0b-aa6a-26dc77a3a7cc"} : dispatch 2024-09-11T00:11:56.986 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:56 smithi138 ceph-mon[35019]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "adb6edaa-9a8c-4b0b-aa6a-26dc77a3a7cc"} : dispatch 2024-09-11T00:11:56.986 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:56 smithi138 ceph-mon[35019]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "adb6edaa-9a8c-4b0b-aa6a-26dc77a3a7cc"}]': finished 2024-09-11T00:11:56.986 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:56 smithi138 ceph-mon[35019]: osdmap e49: 9 total, 8 up, 9 in 2024-09-11T00:11:56.986 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:56 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T00:11:57.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:57 smithi112 ceph-mon[35627]: from='client.? 172.21.15.138:0/1717198094' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:11:58.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:57 smithi138 ceph-mon[35019]: from='client.? 172.21.15.138:0/1717198094' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:11:58.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:57 smithi078 ceph-mon[30865]: from='client.? 172.21.15.138:0/1717198094' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:11:58.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:11:58 smithi112 ceph-mon[35627]: pgmap v158: 1 pgs: 1 unknown; 577 KiB data, 259 MiB used, 715 GiB / 715 GiB avail 2024-09-11T00:11:59.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:11:58 smithi138 ceph-mon[35019]: pgmap v158: 1 pgs: 1 unknown; 577 KiB data, 259 MiB used, 715 GiB / 715 GiB avail 2024-09-11T00:11:59.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:11:58 smithi078 ceph-mon[30865]: pgmap v158: 1 pgs: 1 unknown; 577 KiB data, 259 MiB used, 715 GiB / 715 GiB avail 2024-09-11T00:12:00.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:00 smithi112 ceph-mon[35627]: pgmap v159: 1 pgs: 1 unknown; 577 KiB data, 259 MiB used, 715 GiB / 715 GiB avail 2024-09-11T00:12:01.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:00 smithi138 ceph-mon[35019]: pgmap v159: 1 pgs: 1 unknown; 577 KiB data, 259 MiB used, 715 GiB / 715 GiB avail 2024-09-11T00:12:01.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:00 smithi078 ceph-mon[30865]: pgmap v159: 1 pgs: 1 unknown; 577 KiB data, 259 MiB used, 715 GiB / 715 GiB avail 2024-09-11T00:12:02.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:02 smithi112 ceph-mon[35627]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 185 KiB/s, 0 objects/s recovering 2024-09-11T00:12:03.004 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:02 smithi138 ceph-mon[35019]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 185 KiB/s, 0 objects/s recovering 2024-09-11T00:12:03.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:02 smithi078 ceph-mon[30865]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 185 KiB/s, 0 objects/s recovering 2024-09-11T00:12:04.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:04 smithi112 ceph-mon[35627]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T00:12:05.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:04 smithi138 ceph-mon[35019]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T00:12:05.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:04 smithi078 ceph-mon[30865]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T00:12:05.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:05 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-11T00:12:05.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:05 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:05.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:05 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-11T00:12:05.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:05 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:06.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:05 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-11T00:12:06.205 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:05 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:06.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:06 smithi138 ceph-mon[35019]: Deploying daemon osd.8 on smithi138 2024-09-11T00:12:06.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:06 smithi138 ceph-mon[35019]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-09-11T00:12:06.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:06 smithi112 ceph-mon[35627]: Deploying daemon osd.8 on smithi138 2024-09-11T00:12:06.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:06 smithi112 ceph-mon[35627]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-09-11T00:12:07.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:06 smithi078 ceph-mon[30865]: Deploying daemon osd.8 on smithi138 2024-09-11T00:12:07.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:06 smithi078 ceph-mon[30865]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-09-11T00:12:08.772 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:08 smithi138 ceph-mon[35019]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-11T00:12:08.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:08 smithi112 ceph-mon[35627]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-11T00:12:09.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:08 smithi078 ceph-mon[30865]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-11T00:12:10.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:10 smithi138 ceph-mon[35019]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T00:12:10.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:10 smithi112 ceph-mon[35627]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T00:12:11.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:10 smithi078 ceph-mon[30865]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T00:12:11.826 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:11 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:11.826 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:11 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:11.826 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:11 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:11.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:11 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:11.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:11 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:11.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:11 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:12.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:11 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:11 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:11 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:12.825 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:12 smithi138 ceph-mon[35019]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T00:12:12.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:12 smithi112 ceph-mon[35627]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T00:12:13.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:12 smithi078 ceph-mon[30865]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T00:12:14.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:14 smithi138 ceph-mon[35019]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-11T00:12:14.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:14 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:14.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:14 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:14.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:14 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:14.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:14 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:12:14.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:14 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:14.874 INFO:teuthology.orchestra.run.smithi138.stdout:Created osd(s) 8 on host 'smithi138' 2024-09-11T00:12:14.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:12:14.872+0000 7feade7fc640 1 -- 172.21.15.138:0/1782069840 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7feaec0ffa20 con 0x7fead80b5330 2024-09-11T00:12:14.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:12:14.874+0000 7feaf330f640 1 -- 172.21.15.138:0/1782069840 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fead80b5330 msgr2=0x7fead80b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:14.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:12:14.874+0000 7feaf330f640 1 --2- 172.21.15.138:0/1782069840 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fead80b5330 0x7fead80b77f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feae8009830 tx=0x7feae80058d0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:12:14.874+0000 7feaf330f640 1 -- 172.21.15.138:0/1782069840 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feaec103ce0 msgr2=0x7feaec199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:14.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:12:14.874+0000 7feaf330f640 1 --2- 172.21.15.138:0/1782069840 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feaec103ce0 0x7feaec199320 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feae000e9f0 tx=0x7feae000eeb0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:12:14.874+0000 7feaf330f640 1 -- 172.21.15.138:0/1782069840 shutdown_connections 2024-09-11T00:12:14.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:12:14.874+0000 7feaf330f640 1 --2- 172.21.15.138:0/1782069840 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fead80b5330 0x7fead80b77f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:12:14.874+0000 7feaf330f640 1 --2- 172.21.15.138:0/1782069840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feaec10d140 0x7feaec19ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:12:14.874+0000 7feaf330f640 1 --2- 172.21.15.138:0/1782069840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feaec104600 0x7feaec199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:12:14.874+0000 7feaf330f640 1 --2- 172.21.15.138:0/1782069840 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feaec103ce0 0x7feaec199320 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:14.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:12:14.874+0000 7feaf330f640 1 -- 172.21.15.138:0/1782069840 >> 172.21.15.138:0/1782069840 conn(0x7feaec0fd700 msgr2=0x7feaec0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:14.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:12:14.874+0000 7feaf330f640 1 -- 172.21.15.138:0/1782069840 shutdown_connections 2024-09-11T00:12:14.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:12:14.874+0000 7feaf330f640 1 -- 172.21.15.138:0/1782069840 wait complete. 2024-09-11T00:12:14.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:14 smithi112 ceph-mon[35627]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-11T00:12:14.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:14 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:14.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:14 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:14.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:14 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:14.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:14 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:12:14.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:14 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:15.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:14 smithi078 ceph-mon[30865]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-11T00:12:15.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:14 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:15.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:14 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:15.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:14 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:15.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:14 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:12:15.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:14 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:15.566 DEBUG:teuthology.orchestra.run.smithi138:osd.8> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.8.service 2024-09-11T00:12:15.569 INFO:tasks.cephadm:Deploying osd.9 on smithi078 with /dev/vg_nvme/lv_1... 2024-09-11T00:12:15.569 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T00:12:15.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:15 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:15.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:15 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:15.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:15 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:15.833 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:12:15.953 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:15 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:15.954 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:15 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:15.954 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:15 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:15.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:15 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:15.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:15 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:15.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:15 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:16.956 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:16 smithi138 ceph-mon[35019]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-11T00:12:16.956 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:12:16 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:12:16.903+0000 7f94f97ae640 -1 osd.8 0 log_to_monitors true 2024-09-11T00:12:16.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:16 smithi112 ceph-mon[35627]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-11T00:12:17.001 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:16 smithi078 ceph-mon[30865]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-11T00:12:17.841 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:17 smithi078 ceph-mon[30865]: from='osd.8 [v2:172.21.15.138:6816/2195149036,v1:172.21.15.138:6817/2195149036]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-11T00:12:17.841 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:17 smithi078 ceph-mon[30865]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-11T00:12:17.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:17 smithi112 ceph-mon[35627]: from='osd.8 [v2:172.21.15.138:6816/2195149036,v1:172.21.15.138:6817/2195149036]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-11T00:12:17.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:17 smithi112 ceph-mon[35627]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-11T00:12:18.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:17 smithi138 ceph-mon[35019]: from='osd.8 [v2:172.21.15.138:6816/2195149036,v1:172.21.15.138:6817/2195149036]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-11T00:12:18.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:17 smithi138 ceph-mon[35019]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-11T00:12:18.516 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:12:18.545 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi078:vg_nvme/lv_1 2024-09-11T00:12:18.771 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:18 smithi078 ceph-mon[30865]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-11T00:12:18.771 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:18 smithi078 ceph-mon[30865]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T00:12:18.771 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:18 smithi078 ceph-mon[30865]: osdmap e50: 9 total, 8 up, 9 in 2024-09-11T00:12:18.771 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:18 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T00:12:18.771 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:18 smithi078 ceph-mon[30865]: from='osd.8 [v2:172.21.15.138:6816/2195149036,v1:172.21.15.138:6817/2195149036]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:12:18.771 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:18 smithi078 ceph-mon[30865]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:12:18.771 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:18 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:18.772 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:18 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:18.772 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:18 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:18.772 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:18 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:18.772 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:18 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:18.772 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:18 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:18.772 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:18 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:18.772 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:18 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:12:18.772 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:18 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:18.801 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:12:18.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:18 smithi112 ceph-mon[35627]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-11T00:12:18.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:18 smithi112 ceph-mon[35627]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T00:12:18.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:18 smithi112 ceph-mon[35627]: osdmap e50: 9 total, 8 up, 9 in 2024-09-11T00:12:18.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:18 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T00:12:18.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:18 smithi112 ceph-mon[35627]: from='osd.8 [v2:172.21.15.138:6816/2195149036,v1:172.21.15.138:6817/2195149036]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:12:18.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:18 smithi112 ceph-mon[35627]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:12:18.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:18 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:18.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:18 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:18.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:18 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:18.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:18 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:18.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:18 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:18.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:18 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:18.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:18 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:18.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:18 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:12:18.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:18 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:19.043 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:12:18 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:12:18.721+0000 7f94f5731640 -1 osd.8 0 waiting for initial osdmap 2024-09-11T00:12:19.043 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:12:18 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:12:18.729+0000 7f94f1558640 -1 osd.8 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:12:19.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:18 smithi138 ceph-mon[35019]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-11T00:12:19.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:18 smithi138 ceph-mon[35019]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T00:12:19.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:18 smithi138 ceph-mon[35019]: osdmap e50: 9 total, 8 up, 9 in 2024-09-11T00:12:19.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:18 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T00:12:19.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:18 smithi138 ceph-mon[35019]: from='osd.8 [v2:172.21.15.138:6816/2195149036,v1:172.21.15.138:6817/2195149036]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:12:19.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:18 smithi138 ceph-mon[35019]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:12:19.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:18 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:19.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:18 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:19.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:18 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:19.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:18 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:19.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:18 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:19.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:18 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:19.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:18 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:19.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:18 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:12:19.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:18 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:19.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.251+0000 7fbf6dd4a640 1 -- 172.21.15.78:0/3206411130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf6810d140 msgr2=0x7fbf6810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:19.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.251+0000 7fbf6dd4a640 1 --2- 172.21.15.78:0/3206411130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf6810d140 0x7fbf6810f550 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbf60009ca0 tx=0x7fbf6002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.251+0000 7fbf6dd4a640 1 -- 172.21.15.78:0/3206411130 shutdown_connections 2024-09-11T00:12:19.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.251+0000 7fbf6dd4a640 1 --2- 172.21.15.78:0/3206411130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf6810d140 0x7fbf6810f550 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.252+0000 7fbf6dd4a640 1 --2- 172.21.15.78:0/3206411130 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf68104590 0x7fbf6810cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.252+0000 7fbf6dd4a640 1 --2- 172.21.15.78:0/3206411130 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf68103b90 0x7fbf68103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.252+0000 7fbf6dd4a640 1 -- 172.21.15.78:0/3206411130 >> 172.21.15.78:0/3206411130 conn(0x7fbf680fd700 msgr2=0x7fbf680ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:19.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.252+0000 7fbf6dd4a640 1 -- 172.21.15.78:0/3206411130 shutdown_connections 2024-09-11T00:12:19.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.252+0000 7fbf6dd4a640 1 -- 172.21.15.78:0/3206411130 wait complete. 2024-09-11T00:12:19.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.252+0000 7fbf6dd4a640 1 Processor -- start 2024-09-11T00:12:19.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.252+0000 7fbf6dd4a640 1 -- start start 2024-09-11T00:12:19.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.253+0000 7fbf6dd4a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf68103b90 0x7fbf68199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:19.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.253+0000 7fbf6dd4a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf68104590 0x7fbf68199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:19.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.253+0000 7fbf6dd4a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf6810d140 0x7fbf6819eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:19.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.253+0000 7fbf6dd4a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbf68112d60 con 0x7fbf68104590 2024-09-11T00:12:19.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.253+0000 7fbf6dd4a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbf68112be0 con 0x7fbf68103b90 2024-09-11T00:12:19.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.253+0000 7fbf6dd4a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbf68112ee0 con 0x7fbf6810d140 2024-09-11T00:12:19.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.253+0000 7fbf66ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf68104590 0x7fbf68199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:19.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.253+0000 7fbf66ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf68104590 0x7fbf68199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43080/0 (socket says 172.21.15.78:43080) 2024-09-11T00:12:19.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.253+0000 7fbf66ffd640 1 -- 172.21.15.78:0/3168813744 learned_addr learned my addr 172.21.15.78:0/3168813744 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:12:19.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.253+0000 7fbf677fe640 1 --2- 172.21.15.78:0/3168813744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf68103b90 0x7fbf68199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:19.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.253+0000 7fbf67fff640 1 --2- 172.21.15.78:0/3168813744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf6810d140 0x7fbf6819eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:19.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.253+0000 7fbf66ffd640 1 -- 172.21.15.78:0/3168813744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf6810d140 msgr2=0x7fbf6819eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:19.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.253+0000 7fbf66ffd640 1 --2- 172.21.15.78:0/3168813744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf6810d140 0x7fbf6819eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.253+0000 7fbf66ffd640 1 -- 172.21.15.78:0/3168813744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf68103b90 msgr2=0x7fbf68199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:19.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.253+0000 7fbf66ffd640 1 --2- 172.21.15.78:0/3168813744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf68103b90 0x7fbf68199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:19.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.253+0000 7fbf66ffd640 1 -- 172.21.15.78:0/3168813744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf6819f300 con 0x7fbf68104590 2024-09-11T00:12:19.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.253+0000 7fbf66ffd640 1 --2- 172.21.15.78:0/3168813744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf68104590 0x7fbf68199790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000d950 tx=0x7fbf5000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:19.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.253+0000 7fbf64ff9640 1 -- 172.21.15.78:0/3168813744 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf50017030 con 0x7fbf68104590 2024-09-11T00:12:19.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.254+0000 7fbf64ff9640 1 -- 172.21.15.78:0/3168813744 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf50004020 con 0x7fbf68104590 2024-09-11T00:12:19.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.254+0000 7fbf6dd4a640 1 -- 172.21.15.78:0/3168813744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf6819f5f0 con 0x7fbf68104590 2024-09-11T00:12:19.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.254+0000 7fbf64ff9640 1 -- 172.21.15.78:0/3168813744 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf500047a0 con 0x7fbf68104590 2024-09-11T00:12:19.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.254+0000 7fbf6dd4a640 1 -- 172.21.15.78:0/3168813744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf68101ac0 con 0x7fbf68104590 2024-09-11T00:12:19.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.255+0000 7fbf6dd4a640 1 -- 172.21.15.78:0/3168813744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf6806b0f0 con 0x7fbf68104590 2024-09-11T00:12:19.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.256+0000 7fbf64ff9640 1 -- 172.21.15.78:0/3168813744 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fbf50009a30 con 0x7fbf68104590 2024-09-11T00:12:19.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.256+0000 7fbf64ff9640 1 --2- 172.21.15.78:0/3168813744 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbf540b53b0 0x7fbf540b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:19.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.257+0000 7fbf677fe640 1 --2- 172.21.15.78:0/3168813744 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbf540b53b0 0x7fbf540b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:19.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.257+0000 7fbf64ff9640 1 -- 172.21.15.78:0/3168813744 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5764+0+0 (secure 0 0 0) 0x7fbf500e4d30 con 0x7fbf68104590 2024-09-11T00:12:19.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.257+0000 7fbf677fe640 1 --2- 172.21.15.78:0/3168813744 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbf540b53b0 0x7fbf540b7870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbf58005fd0 tx=0x7fbf58005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:19.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.261+0000 7fbf64ff9640 1 -- 172.21.15.78:0/3168813744 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbf500ac5e0 con 0x7fbf68104590 2024-09-11T00:12:19.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:19.464+0000 7fbf6dd4a640 1 -- 172.21.15.78:0/3168813744 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fbf68063590 con 0x7fbf540b53b0 2024-09-11T00:12:19.725 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:19 smithi078 ceph-mon[30865]: Detected new or changed devices on smithi138 2024-09-11T00:12:19.725 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:19 smithi078 ceph-mon[30865]: Adjusting osd_memory_target on smithi138 to 5696M 2024-09-11T00:12:19.725 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:19 smithi078 ceph-mon[30865]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-11T00:12:19.725 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:19 smithi078 ceph-mon[30865]: osdmap e51: 9 total, 8 up, 9 in 2024-09-11T00:12:19.725 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:19 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T00:12:19.726 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:19 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T00:12:19.726 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:19 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:12:19.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:19 smithi112 ceph-mon[35627]: Detected new or changed devices on smithi138 2024-09-11T00:12:19.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:19 smithi112 ceph-mon[35627]: Adjusting osd_memory_target on smithi138 to 5696M 2024-09-11T00:12:19.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:19 smithi112 ceph-mon[35627]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-11T00:12:19.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:19 smithi112 ceph-mon[35627]: osdmap e51: 9 total, 8 up, 9 in 2024-09-11T00:12:19.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:19 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T00:12:19.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:19 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T00:12:19.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:19 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:12:19.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:19 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:12:19.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:19 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:20.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:19 smithi138 ceph-mon[35019]: Detected new or changed devices on smithi138 2024-09-11T00:12:20.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:19 smithi138 ceph-mon[35019]: Adjusting osd_memory_target on smithi138 to 5696M 2024-09-11T00:12:20.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:19 smithi138 ceph-mon[35019]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-11T00:12:20.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:19 smithi138 ceph-mon[35019]: osdmap e51: 9 total, 8 up, 9 in 2024-09-11T00:12:20.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:19 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T00:12:20.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:19 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T00:12:20.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:19 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:12:20.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:19 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:12:20.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:19 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:20.079 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:19 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:12:20.079 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:19 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:20.934 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:20 smithi078 ceph-mon[30865]: purged_snaps scrub starts 2024-09-11T00:12:20.934 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:20 smithi078 ceph-mon[30865]: purged_snaps scrub ok 2024-09-11T00:12:20.934 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:20 smithi078 ceph-mon[30865]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:20.934 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:20 smithi078 ceph-mon[30865]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-11T00:12:20.934 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:20 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T00:12:20.934 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:20 smithi078 ceph-mon[30865]: osd.8 [v2:172.21.15.138:6816/2195149036,v1:172.21.15.138:6817/2195149036] boot 2024-09-11T00:12:20.934 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:20 smithi078 ceph-mon[30865]: osdmap e52: 9 total, 9 up, 9 in 2024-09-11T00:12:20.934 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:20 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T00:12:20.935 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:20 smithi078 ceph-mon[30865]: osdmap e53: 9 total, 9 up, 9 in 2024-09-11T00:12:20.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:20 smithi112 ceph-mon[35627]: purged_snaps scrub starts 2024-09-11T00:12:20.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:20 smithi112 ceph-mon[35627]: purged_snaps scrub ok 2024-09-11T00:12:20.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:20 smithi112 ceph-mon[35627]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:20.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:20 smithi112 ceph-mon[35627]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-11T00:12:20.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:20 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T00:12:20.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:20 smithi112 ceph-mon[35627]: osd.8 [v2:172.21.15.138:6816/2195149036,v1:172.21.15.138:6817/2195149036] boot 2024-09-11T00:12:20.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:20 smithi112 ceph-mon[35627]: osdmap e52: 9 total, 9 up, 9 in 2024-09-11T00:12:20.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:20 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T00:12:20.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:20 smithi112 ceph-mon[35627]: osdmap e53: 9 total, 9 up, 9 in 2024-09-11T00:12:21.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:20 smithi138 ceph-mon[35019]: purged_snaps scrub starts 2024-09-11T00:12:21.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:20 smithi138 ceph-mon[35019]: purged_snaps scrub ok 2024-09-11T00:12:21.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:20 smithi138 ceph-mon[35019]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:21.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:20 smithi138 ceph-mon[35019]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-11T00:12:21.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:20 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T00:12:21.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:20 smithi138 ceph-mon[35019]: osd.8 [v2:172.21.15.138:6816/2195149036,v1:172.21.15.138:6817/2195149036] boot 2024-09-11T00:12:21.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:20 smithi138 ceph-mon[35019]: osdmap e52: 9 total, 9 up, 9 in 2024-09-11T00:12:21.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:20 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T00:12:21.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:20 smithi138 ceph-mon[35019]: osdmap e53: 9 total, 9 up, 9 in 2024-09-11T00:12:22.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:22 smithi112 ceph-mon[35627]: osdmap e54: 9 total, 9 up, 9 in 2024-09-11T00:12:22.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:22 smithi112 ceph-mon[35627]: pgmap v175: 1 pgs: 1 peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-09-11T00:12:22.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:22 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2144826795' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dd01f408-3712-410e-acbd-c797b7ea5058"} : dispatch 2024-09-11T00:12:22.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:22 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2144826795' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd01f408-3712-410e-acbd-c797b7ea5058"}]': finished 2024-09-11T00:12:22.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:22 smithi112 ceph-mon[35627]: osdmap e55: 10 total, 9 up, 10 in 2024-09-11T00:12:22.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:22 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T00:12:22.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:22 smithi138 ceph-mon[35019]: osdmap e54: 9 total, 9 up, 9 in 2024-09-11T00:12:22.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:22 smithi138 ceph-mon[35019]: pgmap v175: 1 pgs: 1 peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-09-11T00:12:22.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:22 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2144826795' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dd01f408-3712-410e-acbd-c797b7ea5058"} : dispatch 2024-09-11T00:12:22.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:22 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2144826795' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd01f408-3712-410e-acbd-c797b7ea5058"}]': finished 2024-09-11T00:12:22.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:22 smithi138 ceph-mon[35019]: osdmap e55: 10 total, 9 up, 10 in 2024-09-11T00:12:22.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:22 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T00:12:22.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:22 smithi078 ceph-mon[30865]: osdmap e54: 9 total, 9 up, 9 in 2024-09-11T00:12:22.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:22 smithi078 ceph-mon[30865]: pgmap v175: 1 pgs: 1 peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-09-11T00:12:22.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:22 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2144826795' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dd01f408-3712-410e-acbd-c797b7ea5058"} : dispatch 2024-09-11T00:12:22.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:22 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2144826795' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd01f408-3712-410e-acbd-c797b7ea5058"}]': finished 2024-09-11T00:12:22.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:22 smithi078 ceph-mon[30865]: osdmap e55: 10 total, 9 up, 10 in 2024-09-11T00:12:22.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:22 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T00:12:23.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:23 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/4272004632' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:12:23.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:23 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/4272004632' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:12:23.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:23 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/4272004632' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:12:24.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:24 smithi112 ceph-mon[35627]: pgmap v177: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T00:12:24.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:24 smithi138 ceph-mon[35019]: pgmap v177: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T00:12:24.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:24 smithi078 ceph-mon[30865]: pgmap v177: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T00:12:26.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:26 smithi112 ceph-mon[35627]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-11T00:12:27.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:26 smithi138 ceph-mon[35019]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-11T00:12:27.061 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:26 smithi078 ceph-mon[30865]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-11T00:12:28.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:28 smithi078 ceph-mon[30865]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-11T00:12:28.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:28 smithi112 ceph-mon[35627]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-11T00:12:29.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:28 smithi138 ceph-mon[35019]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-11T00:12:30.959 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:30 smithi078 ceph-mon[30865]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-11T00:12:30.959 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:30 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-11T00:12:30.959 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:30 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:30.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:30 smithi112 ceph-mon[35627]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-11T00:12:30.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:30 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-11T00:12:30.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:30 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:31.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:30 smithi138 ceph-mon[35019]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-11T00:12:31.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:30 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-11T00:12:31.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:30 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:31.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:31 smithi112 ceph-mon[35627]: Deploying daemon osd.9 on smithi078 2024-09-11T00:12:31.991 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:31 smithi078 ceph-mon[30865]: Deploying daemon osd.9 on smithi078 2024-09-11T00:12:32.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:31 smithi138 ceph-mon[35019]: Deploying daemon osd.9 on smithi078 2024-09-11T00:12:32.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:32 smithi112 ceph-mon[35627]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T00:12:33.007 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:32 smithi078 ceph-mon[30865]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T00:12:33.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:32 smithi138 ceph-mon[35019]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T00:12:34.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:34 smithi112 ceph-mon[35627]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-11T00:12:35.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:34 smithi138 ceph-mon[35019]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-11T00:12:35.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:34 smithi078 ceph-mon[30865]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-11T00:12:36.975 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:36 smithi078 ceph-mon[30865]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T00:12:36.975 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:36.976 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:36.976 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:36.981 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:36 smithi112 ceph-mon[35627]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T00:12:36.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:36.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:36.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:37.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:36 smithi138 ceph-mon[35019]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T00:12:37.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:37.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:37.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:38.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:38 smithi112 ceph-mon[35627]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T00:12:38.996 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:38 smithi138 ceph-mon[35019]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T00:12:39.035 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:38 smithi078 ceph-mon[30865]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T00:12:39.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:39.893+0000 7fbf64ff9640 1 -- 172.21.15.78:0/3168813744 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbf68063590 con 0x7fbf540b53b0 2024-09-11T00:12:39.895 INFO:teuthology.orchestra.run.smithi078.stdout:Created osd(s) 9 on host 'smithi078' 2024-09-11T00:12:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:39.895+0000 7fbf6dd4a640 1 -- 172.21.15.78:0/3168813744 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbf540b53b0 msgr2=0x7fbf540b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:39.895+0000 7fbf6dd4a640 1 --2- 172.21.15.78:0/3168813744 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbf540b53b0 0x7fbf540b7870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbf58005fd0 tx=0x7fbf58005850 comp rx=0 tx=0).stop 2024-09-11T00:12:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:39.895+0000 7fbf6dd4a640 1 -- 172.21.15.78:0/3168813744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf68104590 msgr2=0x7fbf68199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:39.895+0000 7fbf6dd4a640 1 --2- 172.21.15.78:0/3168813744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf68104590 0x7fbf68199790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000d950 tx=0x7fbf5000de10 comp rx=0 tx=0).stop 2024-09-11T00:12:39.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:39.896+0000 7fbf6dd4a640 1 -- 172.21.15.78:0/3168813744 shutdown_connections 2024-09-11T00:12:39.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:39.896+0000 7fbf6dd4a640 1 --2- 172.21.15.78:0/3168813744 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbf540b53b0 0x7fbf540b7870 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:39.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:39.896+0000 7fbf6dd4a640 1 --2- 172.21.15.78:0/3168813744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf6810d140 0x7fbf6819eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:39.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:39.896+0000 7fbf6dd4a640 1 --2- 172.21.15.78:0/3168813744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf68104590 0x7fbf68199790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:39.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:39.896+0000 7fbf6dd4a640 1 --2- 172.21.15.78:0/3168813744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbf68103b90 0x7fbf68199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:39.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:39.896+0000 7fbf6dd4a640 1 -- 172.21.15.78:0/3168813744 >> 172.21.15.78:0/3168813744 conn(0x7fbf680fd700 msgr2=0x7fbf680fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:39.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:39.896+0000 7fbf6dd4a640 1 -- 172.21.15.78:0/3168813744 shutdown_connections 2024-09-11T00:12:39.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:12:39.896+0000 7fbf6dd4a640 1 -- 172.21.15.78:0/3168813744 wait complete. 2024-09-11T00:12:40.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:40.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:40.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:40.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:12:40.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:40.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:40 smithi138 ceph-mon[35019]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T00:12:40.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:40.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:40.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:40.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:40.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:40.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:40.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:12:40.483 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:40.483 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:40 smithi112 ceph-mon[35627]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T00:12:40.483 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:40.483 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:40.483 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:40.502 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:40.502 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:40.502 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:40.502 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:12:40.502 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:40.502 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:40 smithi078 ceph-mon[30865]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T00:12:40.502 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:12:40.502 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:40.502 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:40.528 DEBUG:teuthology.orchestra.run.smithi078:osd.9> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.9.service 2024-09-11T00:12:40.531 INFO:tasks.cephadm:Deploying osd.10 on smithi112 with /dev/vg_nvme/lv_1... 2024-09-11T00:12:40.531 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T00:12:40.791 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T00:12:42.334 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:12:42 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:12:42.222+0000 7f8be3b1a640 -1 osd.9 0 log_to_monitors true 2024-09-11T00:12:42.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:42 smithi112 ceph-mon[35627]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T00:12:42.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:42 smithi112 ceph-mon[35627]: from='osd.9 [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-11T00:12:43.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:42 smithi138 ceph-mon[35019]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T00:12:43.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:42 smithi138 ceph-mon[35019]: from='osd.9 [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-11T00:12:43.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:42 smithi078 ceph-mon[30865]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T00:12:43.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:42 smithi078 ceph-mon[30865]: from='osd.9 [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-11T00:12:43.540 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-11T00:12:43.571 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi112:vg_nvme/lv_1 2024-09-11T00:12:43.802 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:43 smithi112 ceph-mon[35627]: from='osd.9 [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T00:12:43.802 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:43 smithi112 ceph-mon[35627]: osdmap e56: 10 total, 9 up, 10 in 2024-09-11T00:12:43.802 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:43 smithi112 ceph-mon[35627]: from='osd.9 [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi078", "root=default"]} : dispatch 2024-09-11T00:12:43.802 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:43 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T00:12:43.802 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:43 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:43.802 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:43 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:43.802 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:43 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:43.802 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:43 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:43.802 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:43 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:43.803 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:43 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:43.803 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:43 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:43.803 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:43 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:43.803 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:43 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:12:43.803 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:43 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:43.803 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:43 smithi112 ceph-mon[35627]: from='osd.9 [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-11T00:12:43.825 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T00:12:44.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:43 smithi138 ceph-mon[35019]: from='osd.9 [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T00:12:44.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:43 smithi138 ceph-mon[35019]: osdmap e56: 10 total, 9 up, 10 in 2024-09-11T00:12:44.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:43 smithi138 ceph-mon[35019]: from='osd.9 [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi078", "root=default"]} : dispatch 2024-09-11T00:12:44.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:43 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T00:12:44.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:43 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:44.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:43 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:44.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:43 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:44.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:43 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:44.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:43 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:44.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:43 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:44.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:43 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:44.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:43 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:44.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:43 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:12:44.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:43 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:44.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:43 smithi138 ceph-mon[35019]: from='osd.9 [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-11T00:12:44.084 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:12:43 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:12:43.709+0000 7f8bdfa9d640 -1 osd.9 0 waiting for initial osdmap 2024-09-11T00:12:44.084 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:12:43 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:12:43.720+0000 7f8bdb8c4640 -1 osd.9 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:12:44.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:43 smithi078 ceph-mon[30865]: from='osd.9 [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T00:12:44.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:43 smithi078 ceph-mon[30865]: osdmap e56: 10 total, 9 up, 10 in 2024-09-11T00:12:44.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:43 smithi078 ceph-mon[30865]: from='osd.9 [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi078", "root=default"]} : dispatch 2024-09-11T00:12:44.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:43 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T00:12:44.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:43 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:44.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:43 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:44.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:43 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:44.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:43 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:44.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:43 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:44.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:43 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-11T00:12:44.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:43 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:44.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:43 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:44.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:43 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:12:44.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:43 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:12:44.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:43 smithi078 ceph-mon[30865]: from='osd.9 [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-11T00:12:44.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.346+0000 7fc69ba14640 1 -- 172.21.15.112:0/3164676006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc694101c90 msgr2=0x7fc694102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:44.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.346+0000 7fc69ba14640 1 --2- 172.21.15.112:0/3164676006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc694101c90 0x7fc694102070 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc690009900 tx=0x7fc69002a410 comp rx=0 tx=0).stop 2024-09-11T00:12:44.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.347+0000 7fc69ba14640 1 -- 172.21.15.112:0/3164676006 shutdown_connections 2024-09-11T00:12:44.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.347+0000 7fc69ba14640 1 --2- 172.21.15.112:0/3164676006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc694108020 0x7fc69410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:44.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.347+0000 7fc69ba14640 1 --2- 172.21.15.112:0/3164676006 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6941076a0 0x7fc694107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:44.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.347+0000 7fc69ba14640 1 --2- 172.21.15.112:0/3164676006 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc694101c90 0x7fc694102070 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:44.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.347+0000 7fc69ba14640 1 -- 172.21.15.112:0/3164676006 >> 172.21.15.112:0/3164676006 conn(0x7fc6940fd700 msgr2=0x7fc6940ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:12:44.357 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.347+0000 7fc69ba14640 1 -- 172.21.15.112:0/3164676006 shutdown_connections 2024-09-11T00:12:44.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.347+0000 7fc69ba14640 1 -- 172.21.15.112:0/3164676006 wait complete. 2024-09-11T00:12:44.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.347+0000 7fc69ba14640 1 Processor -- start 2024-09-11T00:12:44.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.347+0000 7fc69ba14640 1 -- start start 2024-09-11T00:12:44.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.348+0000 7fc69ba14640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc694101c90 0x7fc6941981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:44.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.348+0000 7fc69ba14640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6941076a0 0x7fc6941986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:44.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.348+0000 7fc69ba14640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc694108020 0x7fc69419da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:44.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.348+0000 7fc69ba14640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc694111cf0 con 0x7fc6941076a0 2024-09-11T00:12:44.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.348+0000 7fc69ba14640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc694111b70 con 0x7fc694101c90 2024-09-11T00:12:44.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.348+0000 7fc69ba14640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc694111e70 con 0x7fc694108020 2024-09-11T00:12:44.358 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.348+0000 7fc6997b0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc694101c90 0x7fc6941981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:44.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.348+0000 7fc6997b0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc694101c90 0x7fc6941981a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:60744/0 (socket says 172.21.15.112:60744) 2024-09-11T00:12:44.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.348+0000 7fc6997b0640 1 -- 172.21.15.112:0/1862477464 learned_addr learned my addr 172.21.15.112:0/1862477464 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-11T00:12:44.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.348+0000 7fc699fb1640 1 --2- 172.21.15.112:0/1862477464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc694108020 0x7fc69419da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:44.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.348+0000 7fc698faf640 1 --2- 172.21.15.112:0/1862477464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6941076a0 0x7fc6941986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:44.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.348+0000 7fc6997b0640 1 -- 172.21.15.112:0/1862477464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc694108020 msgr2=0x7fc69419da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:44.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.348+0000 7fc6997b0640 1 --2- 172.21.15.112:0/1862477464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc694108020 0x7fc69419da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:44.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.348+0000 7fc6997b0640 1 -- 172.21.15.112:0/1862477464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6941076a0 msgr2=0x7fc6941986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:12:44.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.348+0000 7fc6997b0640 1 --2- 172.21.15.112:0/1862477464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6941076a0 0x7fc6941986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:12:44.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.348+0000 7fc6997b0640 1 -- 172.21.15.112:0/1862477464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69419e250 con 0x7fc694101c90 2024-09-11T00:12:44.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.348+0000 7fc698faf640 1 --2- 172.21.15.112:0/1862477464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6941076a0 0x7fc6941986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:12:44.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.348+0000 7fc699fb1640 1 --2- 172.21.15.112:0/1862477464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc694108020 0x7fc69419da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:12:44.359 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.348+0000 7fc6997b0640 1 --2- 172.21.15.112:0/1862477464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc694101c90 0x7fc6941981a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc690005ab0 tx=0x7fc690003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:44.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.348+0000 7fc68a7fc640 1 -- 172.21.15.112:0/1862477464 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69003f070 con 0x7fc694101c90 2024-09-11T00:12:44.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.348+0000 7fc68a7fc640 1 -- 172.21.15.112:0/1862477464 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc690031d60 con 0x7fc694101c90 2024-09-11T00:12:44.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.348+0000 7fc69ba14640 1 -- 172.21.15.112:0/1862477464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc69419e4e0 con 0x7fc694101c90 2024-09-11T00:12:44.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.349+0000 7fc68a7fc640 1 -- 172.21.15.112:0/1862477464 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690035030 con 0x7fc694101c90 2024-09-11T00:12:44.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.349+0000 7fc69ba14640 1 -- 172.21.15.112:0/1862477464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6941a4c00 con 0x7fc694101c90 2024-09-11T00:12:44.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.350+0000 7fc69ba14640 1 -- 172.21.15.112:0/1862477464 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc694102070 con 0x7fc694101c90 2024-09-11T00:12:44.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.351+0000 7fc68a7fc640 1 -- 172.21.15.112:0/1862477464 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fc69003b560 con 0x7fc694101c90 2024-09-11T00:12:44.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.351+0000 7fc68a7fc640 1 --2- 172.21.15.112:0/1862477464 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc6800b53b0 0x7fc6800b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:12:44.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.352+0000 7fc68a7fc640 1 -- 172.21.15.112:0/1862477464 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6196+0+0 (secure 0 0 0) 0x7fc690106070 con 0x7fc694101c90 2024-09-11T00:12:44.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.352+0000 7fc698faf640 1 --2- 172.21.15.112:0/1862477464 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc6800b53b0 0x7fc6800b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:12:44.360 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.352+0000 7fc698faf640 1 --2- 172.21.15.112:0/1862477464 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc6800b53b0 0x7fc6800b7870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc684005d00 tx=0x7fc684005ed0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:12:44.361 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.356+0000 7fc68a7fc640 1 -- 172.21.15.112:0/1862477464 <== mon.2 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc6900cd770 con 0x7fc694101c90 2024-09-11T00:12:44.545 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:12:44.544+0000 7fc69ba14640 1 -- 172.21.15.112:0/1862477464 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc694063590 con 0x7fc6800b53b0 2024-09-11T00:12:44.797 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:44 smithi112 ceph-mon[35627]: Detected new or changed devices on smithi078 2024-09-11T00:12:44.798 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:44 smithi112 ceph-mon[35627]: Adjusting osd_memory_target on smithi078 to 4272M 2024-09-11T00:12:44.798 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:44 smithi112 ceph-mon[35627]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T00:12:44.798 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:44 smithi112 ceph-mon[35627]: osdmap e57: 10 total, 9 up, 10 in 2024-09-11T00:12:44.798 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:44 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T00:12:44.798 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:44 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T00:12:44.798 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:44 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:12:44.798 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:44 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:12:44.798 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:44 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:45.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:44 smithi138 ceph-mon[35019]: Detected new or changed devices on smithi078 2024-09-11T00:12:45.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:44 smithi138 ceph-mon[35019]: Adjusting osd_memory_target on smithi078 to 4272M 2024-09-11T00:12:45.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:44 smithi138 ceph-mon[35019]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T00:12:45.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:44 smithi138 ceph-mon[35019]: osdmap e57: 10 total, 9 up, 10 in 2024-09-11T00:12:45.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:44 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T00:12:45.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:44 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T00:12:45.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:44 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:12:45.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:44 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:12:45.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:44 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:45.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:44 smithi078 ceph-mon[30865]: Detected new or changed devices on smithi078 2024-09-11T00:12:45.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:44 smithi078 ceph-mon[30865]: Adjusting osd_memory_target on smithi078 to 4272M 2024-09-11T00:12:45.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:44 smithi078 ceph-mon[30865]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T00:12:45.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:44 smithi078 ceph-mon[30865]: osdmap e57: 10 total, 9 up, 10 in 2024-09-11T00:12:45.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:44 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T00:12:45.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:44 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T00:12:45.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:44 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:12:45.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:44 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:12:45.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:44 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:45 smithi112 ceph-mon[35627]: purged_snaps scrub starts 2024-09-11T00:12:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:45 smithi112 ceph-mon[35627]: purged_snaps scrub ok 2024-09-11T00:12:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:45 smithi112 ceph-mon[35627]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:45 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T00:12:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:45 smithi112 ceph-mon[35627]: osd.9 [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449] boot 2024-09-11T00:12:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:45 smithi112 ceph-mon[35627]: osdmap e58: 10 total, 10 up, 10 in 2024-09-11T00:12:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:45 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T00:12:46.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:45 smithi138 ceph-mon[35019]: purged_snaps scrub starts 2024-09-11T00:12:46.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:45 smithi138 ceph-mon[35019]: purged_snaps scrub ok 2024-09-11T00:12:46.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:45 smithi138 ceph-mon[35019]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:46.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:45 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T00:12:46.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:45 smithi138 ceph-mon[35019]: osd.9 [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449] boot 2024-09-11T00:12:46.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:45 smithi138 ceph-mon[35019]: osdmap e58: 10 total, 10 up, 10 in 2024-09-11T00:12:46.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:45 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T00:12:46.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:45 smithi078 ceph-mon[30865]: purged_snaps scrub starts 2024-09-11T00:12:46.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:45 smithi078 ceph-mon[30865]: purged_snaps scrub ok 2024-09-11T00:12:46.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:45 smithi078 ceph-mon[30865]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi112:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:12:46.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:45 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T00:12:46.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:45 smithi078 ceph-mon[30865]: osd.9 [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449] boot 2024-09-11T00:12:46.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:45 smithi078 ceph-mon[30865]: osdmap e58: 10 total, 10 up, 10 in 2024-09-11T00:12:46.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:45 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T00:12:46.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:46 smithi112 ceph-mon[35627]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T00:12:46.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:46 smithi112 ceph-mon[35627]: osdmap e59: 10 total, 10 up, 10 in 2024-09-11T00:12:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:46 smithi138 ceph-mon[35019]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T00:12:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:46 smithi138 ceph-mon[35019]: osdmap e59: 10 total, 10 up, 10 in 2024-09-11T00:12:47.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:46 smithi078 ceph-mon[30865]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-11T00:12:47.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:46 smithi078 ceph-mon[30865]: osdmap e59: 10 total, 10 up, 10 in 2024-09-11T00:12:47.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:47 smithi112 ceph-mon[35627]: from='client.? 172.21.15.112:0/1276912992' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "243c6483-1b0e-49f2-b99c-116d9e9c0617"} : dispatch 2024-09-11T00:12:47.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:47 smithi112 ceph-mon[35627]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "243c6483-1b0e-49f2-b99c-116d9e9c0617"} : dispatch 2024-09-11T00:12:47.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:47 smithi112 ceph-mon[35627]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "243c6483-1b0e-49f2-b99c-116d9e9c0617"}]': finished 2024-09-11T00:12:47.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:47 smithi112 ceph-mon[35627]: osdmap e60: 11 total, 10 up, 11 in 2024-09-11T00:12:47.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:47 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T00:12:47.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:47 smithi112 ceph-mon[35627]: from='client.? 172.21.15.112:0/2035505109' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:12:48.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:47 smithi138 ceph-mon[35019]: from='client.? 172.21.15.112:0/1276912992' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "243c6483-1b0e-49f2-b99c-116d9e9c0617"} : dispatch 2024-09-11T00:12:48.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:47 smithi138 ceph-mon[35019]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "243c6483-1b0e-49f2-b99c-116d9e9c0617"} : dispatch 2024-09-11T00:12:48.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:47 smithi138 ceph-mon[35019]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "243c6483-1b0e-49f2-b99c-116d9e9c0617"}]': finished 2024-09-11T00:12:48.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:47 smithi138 ceph-mon[35019]: osdmap e60: 11 total, 10 up, 11 in 2024-09-11T00:12:48.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:47 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T00:12:48.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:47 smithi138 ceph-mon[35019]: from='client.? 172.21.15.112:0/2035505109' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:12:48.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:47 smithi078 ceph-mon[30865]: from='client.? 172.21.15.112:0/1276912992' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "243c6483-1b0e-49f2-b99c-116d9e9c0617"} : dispatch 2024-09-11T00:12:48.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:47 smithi078 ceph-mon[30865]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "243c6483-1b0e-49f2-b99c-116d9e9c0617"} : dispatch 2024-09-11T00:12:48.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:47 smithi078 ceph-mon[30865]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "243c6483-1b0e-49f2-b99c-116d9e9c0617"}]': finished 2024-09-11T00:12:48.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:47 smithi078 ceph-mon[30865]: osdmap e60: 11 total, 10 up, 11 in 2024-09-11T00:12:48.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:47 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T00:12:48.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:47 smithi078 ceph-mon[30865]: from='client.? 172.21.15.112:0/2035505109' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:12:48.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:48 smithi112 ceph-mon[35627]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:12:49.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:48 smithi138 ceph-mon[35019]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:12:49.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:48 smithi078 ceph-mon[30865]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:12:50.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:50 smithi112 ceph-mon[35627]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:12:51.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:50 smithi138 ceph-mon[35019]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:12:51.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:50 smithi078 ceph-mon[30865]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:12:52.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:52 smithi112 ceph-mon[35627]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:12:53.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:52 smithi138 ceph-mon[35019]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:12:53.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:52 smithi078 ceph-mon[30865]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:12:54.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:54 smithi112 ceph-mon[35627]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:12:55.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:54 smithi138 ceph-mon[35019]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:12:55.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:54 smithi078 ceph-mon[30865]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:12:55.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:55 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-11T00:12:55.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:55 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:56.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:55 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-11T00:12:56.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:55 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:56.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:55 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-11T00:12:56.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:55 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:12:57.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:56 smithi138 ceph-mon[35019]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:12:57.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:56 smithi138 ceph-mon[35019]: Deploying daemon osd.10 on smithi112 2024-09-11T00:12:57.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:56 smithi078 ceph-mon[30865]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:12:57.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:56 smithi078 ceph-mon[30865]: Deploying daemon osd.10 on smithi112 2024-09-11T00:12:57.127 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:56 smithi112 ceph-mon[35627]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:12:57.127 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:56 smithi112 ceph-mon[35627]: Deploying daemon osd.10 on smithi112 2024-09-11T00:12:59.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:12:58 smithi138 ceph-mon[35019]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:12:59.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:12:58 smithi078 ceph-mon[30865]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:12:59.126 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:12:58 smithi112 ceph-mon[35627]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:13:00.968 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:00 smithi112 ceph-mon[35627]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:13:01.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:00 smithi138 ceph-mon[35019]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:13:01.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:00 smithi078 ceph-mon[30865]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:13:02.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:01 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:02.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:01 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:02.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:01 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:02.062 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:01 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:02.062 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:01 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:02.062 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:01 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:02.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:01 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:02.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:01 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:02.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:01 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:03.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:02 smithi138 ceph-mon[35019]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:13:03.065 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:02 smithi112 ceph-mon[35627]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:13:03.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:02 smithi078 ceph-mon[30865]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:13:04.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:04 smithi112 ceph-mon[35627]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:13:04.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:04 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:04.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:04 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:05.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:04 smithi138 ceph-mon[35019]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:13:05.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:04 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:05.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:04 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:05.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:04 smithi078 ceph-mon[30865]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:13:05.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:04 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:05.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:04 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:05.584 INFO:teuthology.orchestra.run.smithi112.stdout:Created osd(s) 10 on host 'smithi112' 2024-09-11T00:13:05.585 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:13:05.581+0000 7fc68a7fc640 1 -- 172.21.15.112:0/1862477464 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fc694063590 con 0x7fc6800b53b0 2024-09-11T00:13:05.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:13:05.584+0000 7fc69ba14640 1 -- 172.21.15.112:0/1862477464 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc6800b53b0 msgr2=0x7fc6800b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:05.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:13:05.584+0000 7fc69ba14640 1 --2- 172.21.15.112:0/1862477464 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc6800b53b0 0x7fc6800b7870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc684005d00 tx=0x7fc684005ed0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.586 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:13:05.584+0000 7fc69ba14640 1 -- 172.21.15.112:0/1862477464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc694101c90 msgr2=0x7fc6941981a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:05.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:13:05.584+0000 7fc69ba14640 1 --2- 172.21.15.112:0/1862477464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc694101c90 0x7fc6941981a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc690005ab0 tx=0x7fc690003cd0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:13:05.584+0000 7fc69ba14640 1 -- 172.21.15.112:0/1862477464 shutdown_connections 2024-09-11T00:13:05.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:13:05.584+0000 7fc69ba14640 1 --2- 172.21.15.112:0/1862477464 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc6800b53b0 0x7fc6800b7870 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:13:05.584+0000 7fc69ba14640 1 --2- 172.21.15.112:0/1862477464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc694108020 0x7fc69419da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:13:05.584+0000 7fc69ba14640 1 --2- 172.21.15.112:0/1862477464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6941076a0 0x7fc6941986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:13:05.584+0000 7fc69ba14640 1 --2- 172.21.15.112:0/1862477464 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc694101c90 0x7fc6941981a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:05.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:13:05.584+0000 7fc69ba14640 1 -- 172.21.15.112:0/1862477464 >> 172.21.15.112:0/1862477464 conn(0x7fc6940fd700 msgr2=0x7fc6940ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:05.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:13:05.584+0000 7fc69ba14640 1 -- 172.21.15.112:0/1862477464 shutdown_connections 2024-09-11T00:13:05.587 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-11T00:13:05.584+0000 7fc69ba14640 1 -- 172.21.15.112:0/1862477464 wait complete. 2024-09-11T00:13:05.964 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:05 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:05.964 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:05 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:05.964 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:05 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:05.964 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:05 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:05.964 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:05 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:05.965 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:05 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:06.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:05 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:06.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:05 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:06.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:05 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:06.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:05 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:06.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:05 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:06.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:05 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:06.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:05 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:06.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:05 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:06.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:05 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:06.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:05 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:06.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:05 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:06.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:05 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:06.284 DEBUG:teuthology.orchestra.run.smithi112:osd.10> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.10.service 2024-09-11T00:13:06.287 INFO:tasks.cephadm:Deploying osd.11 on smithi138 with /dev/vg_nvme/lv_1... 2024-09-11T00:13:06.287 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T00:13:06.546 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:13:06.923 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:06 smithi138 ceph-mon[35019]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:13:06.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:06 smithi112 ceph-mon[35627]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:13:07.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:06 smithi078 ceph-mon[30865]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:13:07.473 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:13:07 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:13:07.384+0000 7fa11fd01640 -1 osd.10 0 log_to_monitors true 2024-09-11T00:13:08.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:07 smithi138 ceph-mon[35019]: from='osd.10 [v2:172.21.15.112:6824/775023408,v1:172.21.15.112:6825/775023408]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-11T00:13:08.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:07 smithi138 ceph-mon[35019]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-11T00:13:08.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:07 smithi078 ceph-mon[30865]: from='osd.10 [v2:172.21.15.112:6824/775023408,v1:172.21.15.112:6825/775023408]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-11T00:13:08.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:07 smithi078 ceph-mon[30865]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-11T00:13:08.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:07 smithi112 ceph-mon[35627]: from='osd.10 [v2:172.21.15.112:6824/775023408,v1:172.21.15.112:6825/775023408]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-11T00:13:08.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:07 smithi112 ceph-mon[35627]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-11T00:13:09.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:08 smithi138 ceph-mon[35019]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:13:09.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:08 smithi138 ceph-mon[35019]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T00:13:09.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:08 smithi138 ceph-mon[35019]: osdmap e61: 11 total, 10 up, 11 in 2024-09-11T00:13:09.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:08 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T00:13:09.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:08 smithi138 ceph-mon[35019]: from='osd.10 [v2:172.21.15.112:6824/775023408,v1:172.21.15.112:6825/775023408]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:13:09.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:08 smithi138 ceph-mon[35019]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:13:09.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:08 smithi078 ceph-mon[30865]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:13:09.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:08 smithi078 ceph-mon[30865]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T00:13:09.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:08 smithi078 ceph-mon[30865]: osdmap e61: 11 total, 10 up, 11 in 2024-09-11T00:13:09.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:08 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T00:13:09.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:08 smithi078 ceph-mon[30865]: from='osd.10 [v2:172.21.15.112:6824/775023408,v1:172.21.15.112:6825/775023408]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:13:09.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:08 smithi078 ceph-mon[30865]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:13:09.187 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:08 smithi112 ceph-mon[35627]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:13:09.187 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:08 smithi112 ceph-mon[35627]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T00:13:09.187 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:08 smithi112 ceph-mon[35627]: osdmap e61: 11 total, 10 up, 11 in 2024-09-11T00:13:09.187 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:08 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T00:13:09.187 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:08 smithi112 ceph-mon[35627]: from='osd.10 [v2:172.21.15.112:6824/775023408,v1:172.21.15.112:6825/775023408]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:13:09.187 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:08 smithi112 ceph-mon[35627]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]} : dispatch 2024-09-11T00:13:09.350 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-11T00:13:09.377 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi138:vg_nvme/lv_1 2024-09-11T00:13:09.482 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:13:09 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:13:09.183+0000 7fa11bc84640 -1 osd.10 0 waiting for initial osdmap 2024-09-11T00:13:09.482 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:13:09 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:13:09.193+0000 7fa113aa3640 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:13:09.622 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:13:10.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:09 smithi138 ceph-mon[35019]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-11T00:13:10.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:09 smithi138 ceph-mon[35019]: osdmap e62: 11 total, 10 up, 11 in 2024-09-11T00:13:10.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:09 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T00:13:10.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:09 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T00:13:10.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:09 smithi138 ceph-mon[35019]: from='osd.10 ' entity='osd.10' 2024-09-11T00:13:10.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:09 smithi138 ceph-mon[35019]: Detected new or changed devices on smithi112 2024-09-11T00:13:10.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:09 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:10.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:09 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:10.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:09 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:10.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:09 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:10.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:09 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:10.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:09 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:10.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:09 smithi138 ceph-mon[35019]: Adjusting osd_memory_target on smithi112 to 4272M 2024-09-11T00:13:10.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:09 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:10.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:09 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:10.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:09 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:10.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:09 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:10.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:09 smithi138 ceph-mon[35019]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:13:10.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:09 smithi078 ceph-mon[30865]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-11T00:13:10.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:09 smithi078 ceph-mon[30865]: osdmap e62: 11 total, 10 up, 11 in 2024-09-11T00:13:10.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:09 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T00:13:10.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:09 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T00:13:10.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:09 smithi078 ceph-mon[30865]: from='osd.10 ' entity='osd.10' 2024-09-11T00:13:10.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:09 smithi078 ceph-mon[30865]: Detected new or changed devices on smithi112 2024-09-11T00:13:10.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:09 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:10.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:09 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:10.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:09 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:10.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:09 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:10.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:09 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:10.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:09 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:10.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:09 smithi078 ceph-mon[30865]: Adjusting osd_memory_target on smithi112 to 4272M 2024-09-11T00:13:10.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:09 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:10.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:09 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:10.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:09 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:10.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:09 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:10.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:09 smithi078 ceph-mon[30865]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:13:10.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.124+0000 7fbfa9008640 1 -- 172.21.15.138:0/214680322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfa4101cb0 msgr2=0x7fbfa4102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:10.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.124+0000 7fbfa9008640 1 --2- 172.21.15.138:0/214680322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfa4101cb0 0x7fbfa4102090 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbf94009900 tx=0x7fbf9402a410 comp rx=0 tx=0).stop 2024-09-11T00:13:10.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.124+0000 7fbfa9008640 1 -- 172.21.15.138:0/214680322 shutdown_connections 2024-09-11T00:13:10.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.124+0000 7fbfa9008640 1 --2- 172.21.15.138:0/214680322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfa4108040 0x7fbfa410e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:10.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.124+0000 7fbfa9008640 1 --2- 172.21.15.138:0/214680322 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfa41076c0 0x7fbfa4107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:10.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.124+0000 7fbfa9008640 1 --2- 172.21.15.138:0/214680322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfa4101cb0 0x7fbfa4102090 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:10.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.124+0000 7fbfa9008640 1 -- 172.21.15.138:0/214680322 >> 172.21.15.138:0/214680322 conn(0x7fbfa40fd700 msgr2=0x7fbfa40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:10.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.124+0000 7fbfa9008640 1 -- 172.21.15.138:0/214680322 shutdown_connections 2024-09-11T00:13:10.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.124+0000 7fbfa9008640 1 -- 172.21.15.138:0/214680322 wait complete. 2024-09-11T00:13:10.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.125+0000 7fbfa9008640 1 Processor -- start 2024-09-11T00:13:10.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.125+0000 7fbfa9008640 1 -- start start 2024-09-11T00:13:10.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.126+0000 7fbfa9008640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfa4101cb0 0x7fbfa4198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:10.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.126+0000 7fbfa9008640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfa41076c0 0x7fbfa4198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:10.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.126+0000 7fbfa9008640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfa4108040 0x7fbfa419d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:10.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.126+0000 7fbfa9008640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa4111d00 con 0x7fbfa4108040 2024-09-11T00:13:10.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.126+0000 7fbfa9008640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa4111b80 con 0x7fbfa4101cb0 2024-09-11T00:13:10.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.126+0000 7fbfa9008640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa4111e80 con 0x7fbfa41076c0 2024-09-11T00:13:10.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.126+0000 7fbf9bfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfa41076c0 0x7fbfa4198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:10.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.126+0000 7fbf9bfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfa41076c0 0x7fbfa4198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:54674/0 (socket says 172.21.15.138:54674) 2024-09-11T00:13:10.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.126+0000 7fbf9bfff640 1 -- 172.21.15.138:0/2877867644 learned_addr learned my addr 172.21.15.138:0/2877867644 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-09-11T00:13:10.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.126+0000 7fbfa2d9d640 1 --2- 172.21.15.138:0/2877867644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfa4101cb0 0x7fbfa4198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:10.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.126+0000 7fbfa359e640 1 --2- 172.21.15.138:0/2877867644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfa4108040 0x7fbfa419d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:10.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.126+0000 7fbf9bfff640 1 -- 172.21.15.138:0/2877867644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfa4101cb0 msgr2=0x7fbfa4198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:10.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.126+0000 7fbf9bfff640 1 --2- 172.21.15.138:0/2877867644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfa4101cb0 0x7fbfa4198100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:10.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.126+0000 7fbf9bfff640 1 -- 172.21.15.138:0/2877867644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfa4108040 msgr2=0x7fbfa419d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:10.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.126+0000 7fbf9bfff640 1 --2- 172.21.15.138:0/2877867644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfa4108040 0x7fbfa419d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:10.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.126+0000 7fbf9bfff640 1 -- 172.21.15.138:0/2877867644 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa419e1b0 con 0x7fbfa41076c0 2024-09-11T00:13:10.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.126+0000 7fbf9bfff640 1 --2- 172.21.15.138:0/2877867644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfa41076c0 0x7fbfa4198640 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c00d950 tx=0x7fbf8c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:10.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.126+0000 7fbfa0d99640 1 -- 172.21.15.138:0/2877867644 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c017070 con 0x7fbfa41076c0 2024-09-11T00:13:10.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.126+0000 7fbfa9008640 1 -- 172.21.15.138:0/2877867644 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfa419e4a0 con 0x7fbfa41076c0 2024-09-11T00:13:10.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.126+0000 7fbfa0d99640 1 -- 172.21.15.138:0/2877867644 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf8c009c30 con 0x7fbfa41076c0 2024-09-11T00:13:10.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.126+0000 7fbfa0d99640 1 -- 172.21.15.138:0/2877867644 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c00f620 con 0x7fbfa41076c0 2024-09-11T00:13:10.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.126+0000 7fbfa9008640 1 -- 172.21.15.138:0/2877867644 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfa41a4b60 con 0x7fbfa41076c0 2024-09-11T00:13:10.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.127+0000 7fbfa9008640 1 -- 172.21.15.138:0/2877867644 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfa4102090 con 0x7fbfa41076c0 2024-09-11T00:13:10.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.129+0000 7fbfa0d99640 1 -- 172.21.15.138:0/2877867644 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fbf8c010460 con 0x7fbfa41076c0 2024-09-11T00:13:10.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.130+0000 7fbfa0d99640 1 --2- 172.21.15.138:0/2877867644 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbf900b5330 0x7fbf900b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:10.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.130+0000 7fbfa0d99640 1 -- 172.21.15.138:0/2877867644 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6942+0+0 (secure 0 0 0) 0x7fbf8c0e5310 con 0x7fbfa41076c0 2024-09-11T00:13:10.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.130+0000 7fbfa2d9d640 1 --2- 172.21.15.138:0/2877867644 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbf900b5330 0x7fbf900b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:10.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.131+0000 7fbfa2d9d640 1 --2- 172.21.15.138:0/2877867644 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbf900b5330 0x7fbf900b77f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbf94031440 tx=0x7fbf94005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:10.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.133+0000 7fbfa0d99640 1 -- 172.21.15.138:0/2877867644 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbf8c0ac730 con 0x7fbfa41076c0 2024-09-11T00:13:10.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:09 smithi112 ceph-mon[35627]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi112", "root=default"]}]': finished 2024-09-11T00:13:10.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:09 smithi112 ceph-mon[35627]: osdmap e62: 11 total, 10 up, 11 in 2024-09-11T00:13:10.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:09 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T00:13:10.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:09 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T00:13:10.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:09 smithi112 ceph-mon[35627]: from='osd.10 ' entity='osd.10' 2024-09-11T00:13:10.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:09 smithi112 ceph-mon[35627]: Detected new or changed devices on smithi112 2024-09-11T00:13:10.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:09 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:10.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:09 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:10.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:09 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:10.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:09 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:10.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:09 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:10.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:09 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:10.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:09 smithi112 ceph-mon[35627]: Adjusting osd_memory_target on smithi112 to 4272M 2024-09-11T00:13:10.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:09 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:10.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:09 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:10.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:09 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:10.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:09 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:10.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:09 smithi112 ceph-mon[35627]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-11T00:13:10.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:10.320+0000 7fbfa9008640 1 -- 172.21.15.138:0/2877867644 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fbfa4063590 con 0x7fbf900b5330 2024-09-11T00:13:10.982 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:10 smithi138 ceph-mon[35019]: purged_snaps scrub starts 2024-09-11T00:13:10.982 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:10 smithi138 ceph-mon[35019]: purged_snaps scrub ok 2024-09-11T00:13:10.982 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:10 smithi138 ceph-mon[35019]: osd.10 [v2:172.21.15.112:6824/775023408,v1:172.21.15.112:6825/775023408] boot 2024-09-11T00:13:10.982 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:10 smithi138 ceph-mon[35019]: osdmap e63: 11 total, 11 up, 11 in 2024-09-11T00:13:10.983 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:10 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T00:13:10.983 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:10 smithi138 ceph-mon[35019]: from='client.24475 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:13:10.983 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:10 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:13:10.983 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:10 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:13:10.983 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:10 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:10.983 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:10 smithi138 ceph-mon[35019]: osdmap e64: 11 total, 11 up, 11 in 2024-09-11T00:13:11.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:10 smithi078 ceph-mon[30865]: purged_snaps scrub starts 2024-09-11T00:13:11.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:10 smithi078 ceph-mon[30865]: purged_snaps scrub ok 2024-09-11T00:13:11.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:10 smithi078 ceph-mon[30865]: osd.10 [v2:172.21.15.112:6824/775023408,v1:172.21.15.112:6825/775023408] boot 2024-09-11T00:13:11.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:10 smithi078 ceph-mon[30865]: osdmap e63: 11 total, 11 up, 11 in 2024-09-11T00:13:11.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:10 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T00:13:11.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:10 smithi078 ceph-mon[30865]: from='client.24475 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:13:11.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:10 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:13:11.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:10 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:13:11.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:10 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:11.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:10 smithi078 ceph-mon[30865]: osdmap e64: 11 total, 11 up, 11 in 2024-09-11T00:13:11.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:10 smithi112 ceph-mon[35627]: purged_snaps scrub starts 2024-09-11T00:13:11.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:10 smithi112 ceph-mon[35627]: purged_snaps scrub ok 2024-09-11T00:13:11.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:10 smithi112 ceph-mon[35627]: osd.10 [v2:172.21.15.112:6824/775023408,v1:172.21.15.112:6825/775023408] boot 2024-09-11T00:13:11.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:10 smithi112 ceph-mon[35627]: osdmap e63: 11 total, 11 up, 11 in 2024-09-11T00:13:11.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:10 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T00:13:11.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:10 smithi112 ceph-mon[35627]: from='client.24475 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:13:11.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:10 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:13:11.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:10 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:13:11.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:10 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:11.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:10 smithi112 ceph-mon[35627]: osdmap e64: 11 total, 11 up, 11 in 2024-09-11T00:13:12.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:12 smithi112 ceph-mon[35627]: osdmap e65: 11 total, 11 up, 11 in 2024-09-11T00:13:12.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:12 smithi112 ceph-mon[35627]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T00:13:12.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:12 smithi138 ceph-mon[35019]: osdmap e65: 11 total, 11 up, 11 in 2024-09-11T00:13:12.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:12 smithi138 ceph-mon[35019]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T00:13:12.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:12 smithi078 ceph-mon[30865]: osdmap e65: 11 total, 11 up, 11 in 2024-09-11T00:13:12.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:12 smithi078 ceph-mon[30865]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T00:13:13.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:13 smithi112 ceph-mon[35627]: from='client.? 172.21.15.138:0/1466175543' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fa20ac9e-b5f7-4b3a-bb51-31569f909609"} : dispatch 2024-09-11T00:13:13.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:13 smithi112 ceph-mon[35627]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fa20ac9e-b5f7-4b3a-bb51-31569f909609"} : dispatch 2024-09-11T00:13:13.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:13 smithi112 ceph-mon[35627]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa20ac9e-b5f7-4b3a-bb51-31569f909609"}]': finished 2024-09-11T00:13:13.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:13 smithi112 ceph-mon[35627]: osdmap e66: 12 total, 11 up, 12 in 2024-09-11T00:13:13.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:13 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T00:13:13.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:13 smithi112 ceph-mon[35627]: from='client.? 172.21.15.138:0/1654982605' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:13:13.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:13 smithi138 ceph-mon[35019]: from='client.? 172.21.15.138:0/1466175543' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fa20ac9e-b5f7-4b3a-bb51-31569f909609"} : dispatch 2024-09-11T00:13:13.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:13 smithi138 ceph-mon[35019]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fa20ac9e-b5f7-4b3a-bb51-31569f909609"} : dispatch 2024-09-11T00:13:13.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:13 smithi138 ceph-mon[35019]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa20ac9e-b5f7-4b3a-bb51-31569f909609"}]': finished 2024-09-11T00:13:13.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:13 smithi138 ceph-mon[35019]: osdmap e66: 12 total, 11 up, 12 in 2024-09-11T00:13:13.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:13 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T00:13:13.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:13 smithi138 ceph-mon[35019]: from='client.? 172.21.15.138:0/1654982605' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:13:13.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:13 smithi078 ceph-mon[30865]: from='client.? 172.21.15.138:0/1466175543' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fa20ac9e-b5f7-4b3a-bb51-31569f909609"} : dispatch 2024-09-11T00:13:13.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:13 smithi078 ceph-mon[30865]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fa20ac9e-b5f7-4b3a-bb51-31569f909609"} : dispatch 2024-09-11T00:13:13.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:13 smithi078 ceph-mon[30865]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa20ac9e-b5f7-4b3a-bb51-31569f909609"}]': finished 2024-09-11T00:13:13.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:13 smithi078 ceph-mon[30865]: osdmap e66: 12 total, 11 up, 12 in 2024-09-11T00:13:13.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:13 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T00:13:13.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:13 smithi078 ceph-mon[30865]: from='client.? 172.21.15.138:0/1654982605' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:13:14.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:14 smithi112 ceph-mon[35627]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T00:13:14.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:14 smithi138 ceph-mon[35019]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T00:13:14.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:14 smithi078 ceph-mon[30865]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T00:13:16.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:16 smithi112 ceph-mon[35627]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-11T00:13:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:16 smithi138 ceph-mon[35019]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-11T00:13:17.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:16 smithi078 ceph-mon[30865]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-11T00:13:18.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:18 smithi112 ceph-mon[35627]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-11T00:13:19.014 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:18 smithi138 ceph-mon[35019]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-11T00:13:19.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:18 smithi078 ceph-mon[30865]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-11T00:13:20.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:20 smithi112 ceph-mon[35627]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-11T00:13:21.031 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:20 smithi138 ceph-mon[35019]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-11T00:13:21.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:20 smithi078 ceph-mon[30865]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-11T00:13:21.865 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:21 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-11T00:13:21.865 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:21 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:21.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:21 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-11T00:13:21.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:21 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:22.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:21 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-11T00:13:22.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:21 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:22.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:22 smithi138 ceph-mon[35019]: Deploying daemon osd.11 on smithi138 2024-09-11T00:13:22.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:22 smithi138 ceph-mon[35019]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T00:13:22.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:22 smithi112 ceph-mon[35627]: Deploying daemon osd.11 on smithi138 2024-09-11T00:13:22.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:22 smithi112 ceph-mon[35627]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T00:13:23.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:22 smithi078 ceph-mon[30865]: Deploying daemon osd.11 on smithi138 2024-09-11T00:13:23.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:22 smithi078 ceph-mon[30865]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T00:13:24.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:24 smithi112 ceph-mon[35627]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-11T00:13:25.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:24 smithi138 ceph-mon[35019]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-11T00:13:25.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:24 smithi078 ceph-mon[30865]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-11T00:13:26.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:26 smithi112 ceph-mon[35627]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T00:13:27.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:26 smithi138 ceph-mon[35019]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T00:13:27.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:26 smithi078 ceph-mon[30865]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T00:13:27.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:27 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:27.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:27 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:27.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:27 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:28.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:27 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:28.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:27 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:28.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:27 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:28.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:27 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:28.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:27 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:28.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:27 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:28.973 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:28 smithi138 ceph-mon[35019]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T00:13:28.985 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:28 smithi078 ceph-mon[30865]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T00:13:29.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:28 smithi112 ceph-mon[35627]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T00:13:30.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:30.245+0000 7fbfa0d99640 1 -- 172.21.15.138:0/2877867644 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fbfa4063590 con 0x7fbf900b5330 2024-09-11T00:13:30.247 INFO:teuthology.orchestra.run.smithi138.stdout:Created osd(s) 11 on host 'smithi138' 2024-09-11T00:13:30.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:30.248+0000 7fbfa9008640 1 -- 172.21.15.138:0/2877867644 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbf900b5330 msgr2=0x7fbf900b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:30.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:30.248+0000 7fbfa9008640 1 --2- 172.21.15.138:0/2877867644 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbf900b5330 0x7fbf900b77f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbf94031440 tx=0x7fbf94005b50 comp rx=0 tx=0).stop 2024-09-11T00:13:30.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:30.248+0000 7fbfa9008640 1 -- 172.21.15.138:0/2877867644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfa41076c0 msgr2=0x7fbfa4198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:30.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:30.248+0000 7fbfa9008640 1 --2- 172.21.15.138:0/2877867644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfa41076c0 0x7fbfa4198640 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c00d950 tx=0x7fbf8c00de10 comp rx=0 tx=0).stop 2024-09-11T00:13:30.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:30.248+0000 7fbfa9008640 1 -- 172.21.15.138:0/2877867644 shutdown_connections 2024-09-11T00:13:30.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:30.248+0000 7fbfa9008640 1 --2- 172.21.15.138:0/2877867644 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbf900b5330 0x7fbf900b77f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:30.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:30.248+0000 7fbfa9008640 1 --2- 172.21.15.138:0/2877867644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbfa4108040 0x7fbfa419d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:30.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:30.248+0000 7fbfa9008640 1 --2- 172.21.15.138:0/2877867644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfa41076c0 0x7fbfa4198640 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:30.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:30.248+0000 7fbfa9008640 1 --2- 172.21.15.138:0/2877867644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbfa4101cb0 0x7fbfa4198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:30.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:30.248+0000 7fbfa9008640 1 -- 172.21.15.138:0/2877867644 >> 172.21.15.138:0/2877867644 conn(0x7fbfa40fd700 msgr2=0x7fbfa40ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:30.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:30.249+0000 7fbfa9008640 1 -- 172.21.15.138:0/2877867644 shutdown_connections 2024-09-11T00:13:30.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:30.249+0000 7fbfa9008640 1 -- 172.21.15.138:0/2877867644 wait complete. 2024-09-11T00:13:30.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:30 smithi138 ceph-mon[35019]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T00:13:30.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:30 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:30.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:30 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:30.866 DEBUG:teuthology.orchestra.run.smithi138:osd.11> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.11.service 2024-09-11T00:13:30.869 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-11T00:13:30.869 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T00:13:31.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:30 smithi078 ceph-mon[30865]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T00:13:31.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:30 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:31.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:30 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:31.122 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:31.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:30 smithi112 ceph-mon[35627]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T00:13:31.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:30 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:31.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:30 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.564+0000 7f2bd3c6b640 1 -- 172.21.15.78:0/2181346059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2bcc1087d0 msgr2=0x7f2bcc108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.564+0000 7f2bd3c6b640 1 --2- 172.21.15.78:0/2181346059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2bcc1087d0 0x7f2bcc108c10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0009ca0 tx=0x7f2bc002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:13:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.564+0000 7f2bd3c6b640 1 -- 172.21.15.78:0/2181346059 shutdown_connections 2024-09-11T00:13:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.564+0000 7f2bd3c6b640 1 --2- 172.21.15.78:0/2181346059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2bcc109150 0x7f2bcc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.564+0000 7f2bd3c6b640 1 --2- 172.21.15.78:0/2181346059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2bcc1087d0 0x7f2bcc108c10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.564+0000 7f2bd3c6b640 1 --2- 172.21.15.78:0/2181346059 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bcc102dc0 0x7f2bcc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.564+0000 7f2bd3c6b640 1 -- 172.21.15.78:0/2181346059 >> 172.21.15.78:0/2181346059 conn(0x7f2bcc0fe830 msgr2=0x7f2bcc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.564+0000 7f2bd3c6b640 1 -- 172.21.15.78:0/2181346059 shutdown_connections 2024-09-11T00:13:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.564+0000 7f2bd3c6b640 1 -- 172.21.15.78:0/2181346059 wait complete. 2024-09-11T00:13:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.564+0000 7f2bd3c6b640 1 Processor -- start 2024-09-11T00:13:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.564+0000 7f2bd3c6b640 1 -- start start 2024-09-11T00:13:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.564+0000 7f2bd3c6b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bcc102dc0 0x7f2bcc1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bd3c6b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2bcc1087d0 0x7f2bcc199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bd3c6b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2bcc109150 0x7f2bcc19ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bd3c6b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2bcc112dd0 con 0x7f2bcc109150 2024-09-11T00:13:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bd3c6b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2bcc112c50 con 0x7f2bcc102dc0 2024-09-11T00:13:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bd3c6b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2bcc112f50 con 0x7f2bcc1087d0 2024-09-11T00:13:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bd2208640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2bcc109150 0x7f2bcc19ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bd2208640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2bcc109150 0x7f2bcc19ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60154/0 (socket says 172.21.15.78:60154) 2024-09-11T00:13:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bd2208640 1 -- 172.21.15.78:0/3044922261 learned_addr learned my addr 172.21.15.78:0/3044922261 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:13:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bd1a07640 1 --2- 172.21.15.78:0/3044922261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bcc102dc0 0x7f2bcc1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bd1206640 1 --2- 172.21.15.78:0/3044922261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2bcc1087d0 0x7f2bcc199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bd2208640 1 -- 172.21.15.78:0/3044922261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2bcc1087d0 msgr2=0x7f2bcc199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bd2208640 1 --2- 172.21.15.78:0/3044922261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2bcc1087d0 0x7f2bcc199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bd2208640 1 -- 172.21.15.78:0/3044922261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bcc102dc0 msgr2=0x7f2bcc1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bd2208640 1 --2- 172.21.15.78:0/3044922261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bcc102dc0 0x7f2bcc1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bd2208640 1 -- 172.21.15.78:0/3044922261 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bcc19f390 con 0x7f2bcc109150 2024-09-11T00:13:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bd1206640 1 --2- 172.21.15.78:0/3044922261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2bcc1087d0 0x7f2bcc199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bd1a07640 1 --2- 172.21.15.78:0/3044922261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bcc102dc0 0x7f2bcc1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bd2208640 1 --2- 172.21.15.78:0/3044922261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2bcc109150 0x7f2bcc19ebc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00d750 tx=0x7f2bbc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bcaffd640 1 -- 172.21.15.78:0/3044922261 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc017070 con 0x7f2bcc109150 2024-09-11T00:13:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bcaffd640 1 -- 172.21.15.78:0/3044922261 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bbc0054d0 con 0x7f2bcc109150 2024-09-11T00:13:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bd3c6b640 1 -- 172.21.15.78:0/3044922261 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bcc19f680 con 0x7f2bcc109150 2024-09-11T00:13:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bcaffd640 1 -- 172.21.15.78:0/3044922261 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc004c60 con 0x7f2bcc109150 2024-09-11T00:13:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.565+0000 7f2bd3c6b640 1 -- 172.21.15.78:0/3044922261 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bcc1a5d40 con 0x7f2bcc109150 2024-09-11T00:13:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.567+0000 7f2bd3c6b640 1 -- 172.21.15.78:0/3044922261 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bcc1031a0 con 0x7f2bcc109150 2024-09-11T00:13:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.568+0000 7f2bcaffd640 1 -- 172.21.15.78:0/3044922261 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f2bbc004e00 con 0x7f2bcc109150 2024-09-11T00:13:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.568+0000 7f2bcaffd640 1 --2- 172.21.15.78:0/3044922261 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2bb40b5330 0x7f2bb40b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.568+0000 7f2bd1a07640 1 --2- 172.21.15.78:0/3044922261 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2bb40b5330 0x7f2bb40b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.569+0000 7f2bcaffd640 1 -- 172.21.15.78:0/3044922261 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7024+0+0 (secure 0 0 0) 0x7f2bbc0e51b0 con 0x7f2bcc109150 2024-09-11T00:13:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.569+0000 7f2bd1a07640 1 --2- 172.21.15.78:0/3044922261 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2bb40b5330 0x7f2bb40b77f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40058c0 tx=0x7f2bc4005ec0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.573+0000 7f2bcaffd640 1 -- 172.21.15.78:0/3044922261 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2bbc0ac580 con 0x7f2bcc109150 2024-09-11T00:13:31.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.750+0000 7f2bd3c6b640 1 -- 172.21.15.78:0/3044922261 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f2bcc10a9a0 con 0x7f2bcc109150 2024-09-11T00:13:31.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.751+0000 7f2bcaffd640 1 -- 172.21.15.78:0/3044922261 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7f2bbc0abe80 con 0x7f2bcc109150 2024-09-11T00:13:31.753 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:13:31.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.753+0000 7f2bd3c6b640 1 -- 172.21.15.78:0/3044922261 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2bb40b5330 msgr2=0x7f2bb40b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:31.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.753+0000 7f2bd3c6b640 1 --2- 172.21.15.78:0/3044922261 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2bb40b5330 0x7f2bb40b77f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40058c0 tx=0x7f2bc4005ec0 comp rx=0 tx=0).stop 2024-09-11T00:13:31.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.753+0000 7f2bd3c6b640 1 -- 172.21.15.78:0/3044922261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2bcc109150 msgr2=0x7f2bcc19ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:31.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.753+0000 7f2bd3c6b640 1 --2- 172.21.15.78:0/3044922261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2bcc109150 0x7f2bcc19ebc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00d750 tx=0x7f2bbc00dc10 comp rx=0 tx=0).stop 2024-09-11T00:13:31.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.753+0000 7f2bd3c6b640 1 -- 172.21.15.78:0/3044922261 shutdown_connections 2024-09-11T00:13:31.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.753+0000 7f2bd3c6b640 1 --2- 172.21.15.78:0/3044922261 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2bb40b5330 0x7f2bb40b77f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:31.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.753+0000 7f2bd3c6b640 1 --2- 172.21.15.78:0/3044922261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2bcc109150 0x7f2bcc19ebc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:31.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.753+0000 7f2bd3c6b640 1 --2- 172.21.15.78:0/3044922261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2bcc1087d0 0x7f2bcc199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:31.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.753+0000 7f2bd3c6b640 1 --2- 172.21.15.78:0/3044922261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2bcc102dc0 0x7f2bcc1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:31.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.753+0000 7f2bd3c6b640 1 -- 172.21.15.78:0/3044922261 >> 172.21.15.78:0/3044922261 conn(0x7f2bcc0fe830 msgr2=0x7f2bcc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:31.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.753+0000 7f2bd3c6b640 1 -- 172.21.15.78:0/3044922261 shutdown_connections 2024-09-11T00:13:31.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:31.753+0000 7f2bd3c6b640 1 -- 172.21.15.78:0/3044922261 wait complete. 2024-09-11T00:13:32.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:31 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:32.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:31 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:32.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:31 smithi078 ceph-mon[30865]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T00:13:32.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:31 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3044922261' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-11T00:13:32.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:31 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:32.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:31 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:32.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:31 smithi112 ceph-mon[35627]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T00:13:32.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:31 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3044922261' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-11T00:13:32.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:31 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:32.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:31 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:32.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:31 smithi138 ceph-mon[35019]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T00:13:32.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:31 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3044922261' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-11T00:13:32.517 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":66,"num_osds":12,"num_up_osds":11,"osd_up_since":1726013589,"num_in_osds":12,"osd_in_since":1726013592,"num_remapped_pgs":0} 2024-09-11T00:13:33.517 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T00:13:33.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:33 smithi138 ceph-mon[35019]: from='osd.11 [v2:172.21.15.138:6824/4046089012,v1:172.21.15.138:6825/4046089012]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-11T00:13:33.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:33 smithi138 ceph-mon[35019]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-11T00:13:33.543 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:13:33 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:13:33.233+0000 7f759318a640 -1 osd.11 0 log_to_monitors true 2024-09-11T00:13:33.583 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:33 smithi078 ceph-mon[30865]: from='osd.11 [v2:172.21.15.138:6824/4046089012,v1:172.21.15.138:6825/4046089012]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-11T00:13:33.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:33 smithi078 ceph-mon[30865]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-11T00:13:33.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:33 smithi112 ceph-mon[35627]: from='osd.11 [v2:172.21.15.138:6824/4046089012,v1:172.21.15.138:6825/4046089012]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-11T00:13:33.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:33 smithi112 ceph-mon[35627]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-11T00:13:33.780 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:34.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.240+0000 7f84e08db640 1 -- 172.21.15.78:0/3423718113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84dc1076a0 msgr2=0x7f84dc107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:34.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.240+0000 7f84e08db640 1 --2- 172.21.15.78:0/3423718113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84dc1076a0 0x7f84dc107ae0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009900 tx=0x7f84d002a410 comp rx=0 tx=0).stop 2024-09-11T00:13:34.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.240+0000 7f84e08db640 1 -- 172.21.15.78:0/3423718113 shutdown_connections 2024-09-11T00:13:34.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.240+0000 7f84e08db640 1 --2- 172.21.15.78:0/3423718113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84dc108020 0x7f84dc10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:34.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.240+0000 7f84e08db640 1 --2- 172.21.15.78:0/3423718113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84dc1076a0 0x7f84dc107ae0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:34.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.240+0000 7f84e08db640 1 --2- 172.21.15.78:0/3423718113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84dc101c90 0x7f84dc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:34.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.240+0000 7f84e08db640 1 -- 172.21.15.78:0/3423718113 >> 172.21.15.78:0/3423718113 conn(0x7f84dc0fd700 msgr2=0x7f84dc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:34.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.240+0000 7f84e08db640 1 -- 172.21.15.78:0/3423718113 shutdown_connections 2024-09-11T00:13:34.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.240+0000 7f84e08db640 1 -- 172.21.15.78:0/3423718113 wait complete. 2024-09-11T00:13:34.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.241+0000 7f84e08db640 1 Processor -- start 2024-09-11T00:13:34.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.241+0000 7f84e08db640 1 -- start start 2024-09-11T00:13:34.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.241+0000 7f84e08db640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84dc101c90 0x7f84dc19a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:34.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.241+0000 7f84e08db640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84dc1076a0 0x7f84dc19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:34.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.241+0000 7f84e08db640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84dc108020 0x7f84dc19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:34.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.241+0000 7f84e08db640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc111ce0 con 0x7f84dc108020 2024-09-11T00:13:34.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.241+0000 7f84e08db640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc111b60 con 0x7f84dc101c90 2024-09-11T00:13:34.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.241+0000 7f84e08db640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc111e60 con 0x7f84dc1076a0 2024-09-11T00:13:34.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.241+0000 7f84dad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84dc108020 0x7f84dc19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:34.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.242+0000 7f84dad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84dc108020 0x7f84dc19ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60166/0 (socket says 172.21.15.78:60166) 2024-09-11T00:13:34.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.242+0000 7f84dad9d640 1 -- 172.21.15.78:0/3889248184 learned_addr learned my addr 172.21.15.78:0/3889248184 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:13:34.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.242+0000 7f84d9d9b640 1 --2- 172.21.15.78:0/3889248184 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84dc1076a0 0x7f84dc19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:34.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.242+0000 7f84da59c640 1 --2- 172.21.15.78:0/3889248184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84dc101c90 0x7f84dc19a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:34.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.242+0000 7f84dad9d640 1 -- 172.21.15.78:0/3889248184 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84dc1076a0 msgr2=0x7f84dc19a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:34.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.242+0000 7f84dad9d640 1 --2- 172.21.15.78:0/3889248184 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84dc1076a0 0x7f84dc19a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:34.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.242+0000 7f84dad9d640 1 -- 172.21.15.78:0/3889248184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84dc101c90 msgr2=0x7f84dc19a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:34.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.242+0000 7f84dad9d640 1 --2- 172.21.15.78:0/3889248184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84dc101c90 0x7f84dc19a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:34.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.242+0000 7f84dad9d640 1 -- 172.21.15.78:0/3889248184 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84dc1a5490 con 0x7f84dc108020 2024-09-11T00:13:34.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.242+0000 7f84dad9d640 1 --2- 172.21.15.78:0/3889248184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84dc108020 0x7f84dc19ab50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f84d400eaa0 tx=0x7f84d400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:34.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.242+0000 7f84cb7fe640 1 -- 172.21.15.78:0/3889248184 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d400cdb0 con 0x7f84dc108020 2024-09-11T00:13:34.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.242+0000 7f84e08db640 1 -- 172.21.15.78:0/3889248184 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84dc1a5780 con 0x7f84dc108020 2024-09-11T00:13:34.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.242+0000 7f84cb7fe640 1 -- 172.21.15.78:0/3889248184 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84d4005020 con 0x7f84dc108020 2024-09-11T00:13:34.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.242+0000 7f84cb7fe640 1 -- 172.21.15.78:0/3889248184 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d40116d0 con 0x7f84dc108020 2024-09-11T00:13:34.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.242+0000 7f84e08db640 1 -- 172.21.15.78:0/3889248184 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84dc1a5c90 con 0x7f84dc108020 2024-09-11T00:13:34.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.243+0000 7f84e08db640 1 -- 172.21.15.78:0/3889248184 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84dc102070 con 0x7f84dc108020 2024-09-11T00:13:34.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.245+0000 7f84cb7fe640 1 -- 172.21.15.78:0/3889248184 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f84d400f040 con 0x7f84dc108020 2024-09-11T00:13:34.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.246+0000 7f84cb7fe640 1 --2- 172.21.15.78:0/3889248184 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f84c40b5330 0x7f84c40b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:34.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.246+0000 7f84da59c640 1 --2- 172.21.15.78:0/3889248184 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f84c40b5330 0x7f84c40b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:34.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.246+0000 7f84cb7fe640 1 -- 172.21.15.78:0/3889248184 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7046+0+0 (secure 0 0 0) 0x7f84d40e59b0 con 0x7f84dc108020 2024-09-11T00:13:34.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.246+0000 7f84da59c640 1 --2- 172.21.15.78:0/3889248184 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f84c40b5330 0x7f84c40b77f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00bbe0 tx=0x7f84cc00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:34.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.249+0000 7f84cb7fe640 1 -- 172.21.15.78:0/3889248184 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f84d4016030 con 0x7f84dc108020 2024-09-11T00:13:34.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.427+0000 7f84e08db640 1 -- 172.21.15.78:0/3889248184 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f84dc06aec0 con 0x7f84dc108020 2024-09-11T00:13:34.429 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:34 smithi078 ceph-mon[30865]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T00:13:34.430 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:34 smithi078 ceph-mon[30865]: from='osd.11 [v2:172.21.15.138:6824/4046089012,v1:172.21.15.138:6825/4046089012]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:13:34.430 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:34 smithi078 ceph-mon[30865]: osdmap e67: 12 total, 11 up, 12 in 2024-09-11T00:13:34.430 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:34 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T00:13:34.430 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:34 smithi078 ceph-mon[30865]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:13:34.430 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:34 smithi078 ceph-mon[30865]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T00:13:34.430 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:34 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:34.430 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:34 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:34.430 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:34 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:34.430 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:34 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:34.430 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:34 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:34.430 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:34 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:34.431 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:34 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:34.431 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:34 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:34.431 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:34 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:34.431 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:34 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:34.431 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:34 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:34.431 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:34 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:34.431 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:34 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:34.432 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:34 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:34.432 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:34 smithi078 ceph-mon[30865]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-11T00:13:34.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.428+0000 7f84cb7fe640 1 -- 172.21.15.78:0/3889248184 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7f84dc06aec0 con 0x7f84dc108020 2024-09-11T00:13:34.432 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:13:34.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.430+0000 7f84e08db640 1 -- 172.21.15.78:0/3889248184 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f84c40b5330 msgr2=0x7f84c40b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:34.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.430+0000 7f84e08db640 1 --2- 172.21.15.78:0/3889248184 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f84c40b5330 0x7f84c40b77f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00bbe0 tx=0x7f84cc00b390 comp rx=0 tx=0).stop 2024-09-11T00:13:34.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.430+0000 7f84e08db640 1 -- 172.21.15.78:0/3889248184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84dc108020 msgr2=0x7f84dc19ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:34.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.430+0000 7f84e08db640 1 --2- 172.21.15.78:0/3889248184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84dc108020 0x7f84dc19ab50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f84d400eaa0 tx=0x7f84d400ef60 comp rx=0 tx=0).stop 2024-09-11T00:13:34.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.430+0000 7f84e08db640 1 -- 172.21.15.78:0/3889248184 shutdown_connections 2024-09-11T00:13:34.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.430+0000 7f84e08db640 1 --2- 172.21.15.78:0/3889248184 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f84c40b5330 0x7f84c40b77f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:34.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.430+0000 7f84e08db640 1 --2- 172.21.15.78:0/3889248184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84dc108020 0x7f84dc19ab50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:34.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.430+0000 7f84e08db640 1 --2- 172.21.15.78:0/3889248184 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84dc1076a0 0x7f84dc19a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:34.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.430+0000 7f84e08db640 1 --2- 172.21.15.78:0/3889248184 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84dc101c90 0x7f84dc19a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:34.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.430+0000 7f84e08db640 1 -- 172.21.15.78:0/3889248184 >> 172.21.15.78:0/3889248184 conn(0x7f84dc0fd700 msgr2=0x7f84dc0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:34.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.430+0000 7f84e08db640 1 -- 172.21.15.78:0/3889248184 shutdown_connections 2024-09-11T00:13:34.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:34.430+0000 7f84e08db640 1 -- 172.21.15.78:0/3889248184 wait complete. 2024-09-11T00:13:34.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:34 smithi112 ceph-mon[35627]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T00:13:34.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:34 smithi112 ceph-mon[35627]: from='osd.11 [v2:172.21.15.138:6824/4046089012,v1:172.21.15.138:6825/4046089012]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:13:34.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:34 smithi112 ceph-mon[35627]: osdmap e67: 12 total, 11 up, 12 in 2024-09-11T00:13:34.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:34 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T00:13:34.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:34 smithi112 ceph-mon[35627]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:13:34.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:34 smithi112 ceph-mon[35627]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T00:13:34.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:34 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:34.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:34 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:34.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:34 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:34.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:34 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:34.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:34 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:34.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:34 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:34.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:34 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:34.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:34 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:34.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:34 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:34.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:34 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:34.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:34 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:34.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:34 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:34.734 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:34 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:34.734 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:34 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:34.734 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:34 smithi112 ceph-mon[35627]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-11T00:13:34.793 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:13:34.300+0000 7f758f10d640 -1 osd.11 0 waiting for initial osdmap 2024-09-11T00:13:34.793 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:13:34.310+0000 7f758af34640 -1 osd.11 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:13:34.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-mon[35019]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T00:13:34.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-mon[35019]: from='osd.11 [v2:172.21.15.138:6824/4046089012,v1:172.21.15.138:6825/4046089012]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:13:34.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-mon[35019]: osdmap e67: 12 total, 11 up, 12 in 2024-09-11T00:13:34.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T00:13:34.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-mon[35019]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-11T00:13:34.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-mon[35019]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T00:13:34.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:34.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:34.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:34.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:34.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:34.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-11T00:13:34.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:34.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:34.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:34.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:34.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:34.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:34.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:34.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:34.795 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:34 smithi138 ceph-mon[35019]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-11T00:13:35.150 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1726013589,"num_in_osds":12,"osd_in_since":1726013592,"num_remapped_pgs":0} 2024-09-11T00:13:35.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:35 smithi078 ceph-mon[30865]: Detected new or changed devices on smithi138 2024-09-11T00:13:35.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:35 smithi078 ceph-mon[30865]: Adjusting osd_memory_target on smithi138 to 4272M 2024-09-11T00:13:35.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:35 smithi078 ceph-mon[30865]: osdmap e68: 12 total, 11 up, 12 in 2024-09-11T00:13:35.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:35 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T00:13:35.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:35 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T00:13:35.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:35 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3889248184' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-11T00:13:35.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:35 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T00:13:35.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:35 smithi112 ceph-mon[35627]: Detected new or changed devices on smithi138 2024-09-11T00:13:35.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:35 smithi112 ceph-mon[35627]: Adjusting osd_memory_target on smithi138 to 4272M 2024-09-11T00:13:35.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:35 smithi112 ceph-mon[35627]: osdmap e68: 12 total, 11 up, 12 in 2024-09-11T00:13:35.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:35 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T00:13:35.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:35 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T00:13:35.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:35 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3889248184' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-11T00:13:35.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:35 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T00:13:35.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:35 smithi138 ceph-mon[35019]: Detected new or changed devices on smithi138 2024-09-11T00:13:35.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:35 smithi138 ceph-mon[35019]: Adjusting osd_memory_target on smithi138 to 4272M 2024-09-11T00:13:35.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:35 smithi138 ceph-mon[35019]: osdmap e68: 12 total, 11 up, 12 in 2024-09-11T00:13:35.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:35 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T00:13:35.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:35 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T00:13:35.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:35 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3889248184' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-11T00:13:35.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:35 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T00:13:36.151 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T00:13:36.410 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:36.529 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:36 smithi078 ceph-mon[30865]: purged_snaps scrub starts 2024-09-11T00:13:36.530 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:36 smithi078 ceph-mon[30865]: purged_snaps scrub ok 2024-09-11T00:13:36.530 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:36 smithi078 ceph-mon[30865]: osd.11 [v2:172.21.15.138:6824/4046089012,v1:172.21.15.138:6825/4046089012] boot 2024-09-11T00:13:36.530 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:36 smithi078 ceph-mon[30865]: osdmap e69: 12 total, 12 up, 12 in 2024-09-11T00:13:36.530 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T00:13:36.530 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:36 smithi078 ceph-mon[30865]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T00:13:36.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:36 smithi112 ceph-mon[35627]: purged_snaps scrub starts 2024-09-11T00:13:36.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:36 smithi112 ceph-mon[35627]: purged_snaps scrub ok 2024-09-11T00:13:36.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:36 smithi112 ceph-mon[35627]: osd.11 [v2:172.21.15.138:6824/4046089012,v1:172.21.15.138:6825/4046089012] boot 2024-09-11T00:13:36.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:36 smithi112 ceph-mon[35627]: osdmap e69: 12 total, 12 up, 12 in 2024-09-11T00:13:36.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T00:13:36.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:36 smithi112 ceph-mon[35627]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T00:13:36.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:36 smithi138 ceph-mon[35019]: purged_snaps scrub starts 2024-09-11T00:13:36.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:36 smithi138 ceph-mon[35019]: purged_snaps scrub ok 2024-09-11T00:13:36.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:36 smithi138 ceph-mon[35019]: osd.11 [v2:172.21.15.138:6824/4046089012,v1:172.21.15.138:6825/4046089012] boot 2024-09-11T00:13:36.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:36 smithi138 ceph-mon[35019]: osdmap e69: 12 total, 12 up, 12 in 2024-09-11T00:13:36.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T00:13:36.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:36 smithi138 ceph-mon[35019]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-11T00:13:36.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.877+0000 7f49c3c74640 1 -- 172.21.15.78:0/3673814544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49bc108020 msgr2=0x7f49bc10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:36.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.877+0000 7f49c3c74640 1 --2- 172.21.15.78:0/3673814544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49bc108020 0x7f49bc10e820 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009ca0 tx=0x7f49b402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:13:36.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.877+0000 7f49c3c74640 1 -- 172.21.15.78:0/3673814544 shutdown_connections 2024-09-11T00:13:36.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.877+0000 7f49c3c74640 1 --2- 172.21.15.78:0/3673814544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49bc108020 0x7f49bc10e820 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:36.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.877+0000 7f49c3c74640 1 --2- 172.21.15.78:0/3673814544 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49bc1076a0 0x7f49bc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:36.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.877+0000 7f49c3c74640 1 --2- 172.21.15.78:0/3673814544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49bc101c90 0x7f49bc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:36.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.877+0000 7f49c3c74640 1 -- 172.21.15.78:0/3673814544 >> 172.21.15.78:0/3673814544 conn(0x7f49bc0fd700 msgr2=0x7f49bc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:36.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.877+0000 7f49c3c74640 1 -- 172.21.15.78:0/3673814544 shutdown_connections 2024-09-11T00:13:36.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.877+0000 7f49c3c74640 1 -- 172.21.15.78:0/3673814544 wait complete. 2024-09-11T00:13:36.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.878+0000 7f49c3c74640 1 Processor -- start 2024-09-11T00:13:36.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.878+0000 7f49c3c74640 1 -- start start 2024-09-11T00:13:36.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.878+0000 7f49c3c74640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49bc101c90 0x7f49bc19b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:36.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.878+0000 7f49c3c74640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49bc1076a0 0x7f49bc19b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:36.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.878+0000 7f49c3c74640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49bc108020 0x7f49bc1a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:36.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.878+0000 7f49c3c74640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f49bc111ca0 con 0x7f49bc1076a0 2024-09-11T00:13:36.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.878+0000 7f49c3c74640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f49bc111b20 con 0x7f49bc108020 2024-09-11T00:13:36.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.878+0000 7f49c3c74640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f49bc111e20 con 0x7f49bc101c90 2024-09-11T00:13:36.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.878+0000 7f49c120f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49bc1076a0 0x7f49bc19b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:36.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.878+0000 7f49c120f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49bc1076a0 0x7f49bc19b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53468/0 (socket says 172.21.15.78:53468) 2024-09-11T00:13:36.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.878+0000 7f49c120f640 1 -- 172.21.15.78:0/4063598552 learned_addr learned my addr 172.21.15.78:0/4063598552 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:13:36.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.878+0000 7f49c2211640 1 --2- 172.21.15.78:0/4063598552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49bc108020 0x7f49bc1a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:36.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.878+0000 7f49c1a10640 1 --2- 172.21.15.78:0/4063598552 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49bc101c90 0x7f49bc19b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:36.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.879+0000 7f49c120f640 1 -- 172.21.15.78:0/4063598552 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49bc101c90 msgr2=0x7f49bc19b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:36.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.879+0000 7f49c120f640 1 --2- 172.21.15.78:0/4063598552 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49bc101c90 0x7f49bc19b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:36.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.879+0000 7f49c120f640 1 -- 172.21.15.78:0/4063598552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49bc108020 msgr2=0x7f49bc1a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:36.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.879+0000 7f49c120f640 1 --2- 172.21.15.78:0/4063598552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49bc108020 0x7f49bc1a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:36.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.879+0000 7f49c120f640 1 -- 172.21.15.78:0/4063598552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49bc1a14f0 con 0x7f49bc1076a0 2024-09-11T00:13:36.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.879+0000 7f49c120f640 1 --2- 172.21.15.78:0/4063598552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49bc1076a0 0x7f49bc19b980 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f49ac00d950 tx=0x7f49ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:36.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.879+0000 7f49b2ffd640 1 -- 172.21.15.78:0/4063598552 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac017070 con 0x7f49bc1076a0 2024-09-11T00:13:36.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.879+0000 7f49b2ffd640 1 -- 172.21.15.78:0/4063598552 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49ac009c30 con 0x7f49bc1076a0 2024-09-11T00:13:36.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.879+0000 7f49c3c74640 1 -- 172.21.15.78:0/4063598552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49bc1a17e0 con 0x7f49bc1076a0 2024-09-11T00:13:36.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.879+0000 7f49b2ffd640 1 -- 172.21.15.78:0/4063598552 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac00f620 con 0x7f49bc1076a0 2024-09-11T00:13:36.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.879+0000 7f49c3c74640 1 -- 172.21.15.78:0/4063598552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49bc1a7ea0 con 0x7f49bc1076a0 2024-09-11T00:13:36.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.880+0000 7f49c3c74640 1 -- 172.21.15.78:0/4063598552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49bc102070 con 0x7f49bc1076a0 2024-09-11T00:13:36.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.882+0000 7f49b2ffd640 1 -- 172.21.15.78:0/4063598552 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f49ac010460 con 0x7f49bc1076a0 2024-09-11T00:13:36.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.883+0000 7f49b2ffd640 1 --2- 172.21.15.78:0/4063598552 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f49a80b53b0 0x7f49a80b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:36.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.883+0000 7f49c1a10640 1 --2- 172.21.15.78:0/4063598552 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f49a80b53b0 0x7f49a80b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:36.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.883+0000 7f49b2ffd640 1 -- 172.21.15.78:0/4063598552 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f49ac0e5370 con 0x7f49bc1076a0 2024-09-11T00:13:36.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.884+0000 7f49c1a10640 1 --2- 172.21.15.78:0/4063598552 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f49a80b53b0 0x7f49a80b7870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f49b80058c0 tx=0x7f49b800a250 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:36.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:36.886+0000 7f49b2ffd640 1 -- 172.21.15.78:0/4063598552 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f49ac009de0 con 0x7f49bc1076a0 2024-09-11T00:13:37.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:37.061+0000 7f49c3c74640 1 -- 172.21.15.78:0/4063598552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f49bc1a82a0 con 0x7f49bc1076a0 2024-09-11T00:13:37.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:37.061+0000 7f49b2ffd640 1 -- 172.21.15.78:0/4063598552 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f49ac0ac030 con 0x7f49bc1076a0 2024-09-11T00:13:37.063 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:13:37.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:37.064+0000 7f49c3c74640 1 -- 172.21.15.78:0/4063598552 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f49a80b53b0 msgr2=0x7f49a80b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:37.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:37.064+0000 7f49c3c74640 1 --2- 172.21.15.78:0/4063598552 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f49a80b53b0 0x7f49a80b7870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f49b80058c0 tx=0x7f49b800a250 comp rx=0 tx=0).stop 2024-09-11T00:13:37.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:37.064+0000 7f49c3c74640 1 -- 172.21.15.78:0/4063598552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49bc1076a0 msgr2=0x7f49bc19b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:37.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:37.064+0000 7f49c3c74640 1 --2- 172.21.15.78:0/4063598552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49bc1076a0 0x7f49bc19b980 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f49ac00d950 tx=0x7f49ac00de10 comp rx=0 tx=0).stop 2024-09-11T00:13:37.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:37.064+0000 7f49c3c74640 1 -- 172.21.15.78:0/4063598552 shutdown_connections 2024-09-11T00:13:37.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:37.064+0000 7f49c3c74640 1 --2- 172.21.15.78:0/4063598552 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f49a80b53b0 0x7f49a80b7870 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:37.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:37.064+0000 7f49c3c74640 1 --2- 172.21.15.78:0/4063598552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f49bc108020 0x7f49bc1a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:37.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:37.064+0000 7f49c3c74640 1 --2- 172.21.15.78:0/4063598552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49bc1076a0 0x7f49bc19b980 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:37.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:37.064+0000 7f49c3c74640 1 --2- 172.21.15.78:0/4063598552 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49bc101c90 0x7f49bc19b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:37.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:37.064+0000 7f49c3c74640 1 -- 172.21.15.78:0/4063598552 >> 172.21.15.78:0/4063598552 conn(0x7f49bc0fd700 msgr2=0x7f49bc06ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:37.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:37.064+0000 7f49c3c74640 1 -- 172.21.15.78:0/4063598552 shutdown_connections 2024-09-11T00:13:37.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:37.064+0000 7f49c3c74640 1 -- 172.21.15.78:0/4063598552 wait complete. 2024-09-11T00:13:37.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:37 smithi078 ceph-mon[30865]: osdmap e70: 12 total, 12 up, 12 in 2024-09-11T00:13:37.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:37 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/4063598552' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-11T00:13:37.682 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":70,"num_osds":12,"num_up_osds":12,"osd_up_since":1726013615,"num_in_osds":12,"osd_in_since":1726013592,"num_remapped_pgs":0} 2024-09-11T00:13:37.683 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:13:37.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:37 smithi112 ceph-mon[35627]: osdmap e70: 12 total, 12 up, 12 in 2024-09-11T00:13:37.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:37 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/4063598552' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-11T00:13:37.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:37 smithi138 ceph-mon[35019]: osdmap e70: 12 total, 12 up, 12 in 2024-09-11T00:13:37.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:37 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/4063598552' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-11T00:13:37.927 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:38.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.378+0000 7f53b30a4640 1 -- 172.21.15.78:0/1532498367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53ac102dc0 msgr2=0x7f53ac1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:38.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.378+0000 7f53b30a4640 1 --2- 172.21.15.78:0/1532498367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53ac102dc0 0x7f53ac1031a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009900 tx=0x7f53a402a410 comp rx=0 tx=0).stop 2024-09-11T00:13:38.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.379+0000 7f53b30a4640 1 -- 172.21.15.78:0/1532498367 shutdown_connections 2024-09-11T00:13:38.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.379+0000 7f53b30a4640 1 --2- 172.21.15.78:0/1532498367 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53ac109150 0x7f53ac10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:38.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.379+0000 7f53b30a4640 1 --2- 172.21.15.78:0/1532498367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53ac1087d0 0x7f53ac108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:38.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.379+0000 7f53b30a4640 1 --2- 172.21.15.78:0/1532498367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53ac102dc0 0x7f53ac1031a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:38.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.379+0000 7f53b30a4640 1 -- 172.21.15.78:0/1532498367 >> 172.21.15.78:0/1532498367 conn(0x7f53ac0fe830 msgr2=0x7f53ac100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:38.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.379+0000 7f53b30a4640 1 -- 172.21.15.78:0/1532498367 shutdown_connections 2024-09-11T00:13:38.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.379+0000 7f53b30a4640 1 -- 172.21.15.78:0/1532498367 wait complete. 2024-09-11T00:13:38.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.379+0000 7f53b30a4640 1 Processor -- start 2024-09-11T00:13:38.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.379+0000 7f53b30a4640 1 -- start start 2024-09-11T00:13:38.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.379+0000 7f53b30a4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53ac102dc0 0x7f53ac0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.379+0000 7f53b30a4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53ac1087d0 0x7f53ac0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.379+0000 7f53b30a4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53ac109150 0x7f53ac075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.379+0000 7f53b30a4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac112e10 con 0x7f53ac109150 2024-09-11T00:13:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.379+0000 7f53b30a4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac112c90 con 0x7f53ac1087d0 2024-09-11T00:13:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.379+0000 7f53b30a4640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac112f90 con 0x7f53ac102dc0 2024-09-11T00:13:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.379+0000 7f53b1641640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53ac109150 0x7f53ac075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.380+0000 7f53b1641640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53ac109150 0x7f53ac075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53486/0 (socket says 172.21.15.78:53486) 2024-09-11T00:13:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.380+0000 7f53b0e40640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53ac102dc0 0x7f53ac0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.380+0000 7f53b1641640 1 -- 172.21.15.78:0/2203999929 learned_addr learned my addr 172.21.15.78:0/2203999929 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:13:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.380+0000 7f53abfff640 1 --2- 172.21.15.78:0/2203999929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53ac1087d0 0x7f53ac0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.380+0000 7f53b1641640 1 -- 172.21.15.78:0/2203999929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53ac102dc0 msgr2=0x7f53ac0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.380+0000 7f53b1641640 1 --2- 172.21.15.78:0/2203999929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53ac102dc0 0x7f53ac0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.380+0000 7f53b1641640 1 -- 172.21.15.78:0/2203999929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53ac1087d0 msgr2=0x7f53ac0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.380+0000 7f53b1641640 1 --2- 172.21.15.78:0/2203999929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53ac1087d0 0x7f53ac0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:38.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.380+0000 7f53b1641640 1 -- 172.21.15.78:0/2203999929 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ac1a7660 con 0x7f53ac109150 2024-09-11T00:13:38.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.380+0000 7f53b1641640 1 --2- 172.21.15.78:0/2203999929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53ac109150 0x7f53ac075f20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f539400c970 tx=0x7f539400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:38.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.380+0000 7f53a9ffb640 1 -- 172.21.15.78:0/2203999929 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5394007bb0 con 0x7f53ac109150 2024-09-11T00:13:38.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.380+0000 7f53a9ffb640 1 -- 172.21.15.78:0/2203999929 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5394007d50 con 0x7f53ac109150 2024-09-11T00:13:38.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.380+0000 7f53a9ffb640 1 -- 172.21.15.78:0/2203999929 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5394004e60 con 0x7f53ac109150 2024-09-11T00:13:38.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.380+0000 7f53b30a4640 1 -- 172.21.15.78:0/2203999929 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53ac1a7950 con 0x7f53ac109150 2024-09-11T00:13:38.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.380+0000 7f53b30a4640 1 -- 172.21.15.78:0/2203999929 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53ac1a7ee0 con 0x7f53ac109150 2024-09-11T00:13:38.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.381+0000 7f53b30a4640 1 -- 172.21.15.78:0/2203999929 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53ac1031a0 con 0x7f53ac109150 2024-09-11T00:13:38.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.383+0000 7f53a9ffb640 1 -- 172.21.15.78:0/2203999929 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f5394005000 con 0x7f53ac109150 2024-09-11T00:13:38.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.384+0000 7f53a9ffb640 1 --2- 172.21.15.78:0/2203999929 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f53980b53b0 0x7f53980b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:38.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.384+0000 7f53b0e40640 1 --2- 172.21.15.78:0/2203999929 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f53980b53b0 0x7f53980b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:38.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.384+0000 7f53a9ffb640 1 -- 172.21.15.78:0/2203999929 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f53940e56f0 con 0x7f53ac109150 2024-09-11T00:13:38.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.385+0000 7f53b0e40640 1 --2- 172.21.15.78:0/2203999929 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f53980b53b0 0x7f53980b7870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f53a4031440 tx=0x7f53a4005e80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:38.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.387+0000 7f53a9ffb640 1 -- 172.21.15.78:0/2203999929 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5394014030 con 0x7f53ac109150 2024-09-11T00:13:38.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.562+0000 7f53b30a4640 1 -- 172.21.15.78:0/2203999929 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f53ac0767a0 con 0x7f53ac109150 2024-09-11T00:13:38.564 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:38 smithi078 ceph-mon[30865]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:38.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.563+0000 7f53a9ffb640 1 -- 172.21.15.78:0/2203999929 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+18810 (secure 0 0 0) 0x7f53940ac3b0 con 0x7f53ac109150 2024-09-11T00:13:38.565 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:13:38.565 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":70,"fsid":"85a53860-6fd1-11ef-bcea-c7b262605968","created":"2024-09-11T00:06:05.704745+0000","modified":"2024-09-11T00:13:36.316019+0000","last_up_change":"2024-09-11T00:13:35.307216+0000","last_in_change":"2024-09-11T00:13:12.730667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:09:47.891696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d260c219-52f2-4e7f-9188-9e66ee01dacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6803","nonce":3736366730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6805","nonce":3736366730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6809","nonce":3736366730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6807","nonce":3736366730}]},"public_addr":"172.21.15.78:6803/3736366730","cluster_addr":"172.21.15.78:6805/3736366730","heartbeat_back_addr":"172.21.15.78:6809/3736366730","heartbeat_front_addr":"172.21.15.78:6807/3736366730","state":["exists","up"]},{"osd":1,"uuid":"d0f286a2-a121-40ee-8134-67ef01b1bc9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6801","nonce":3186321784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6803","nonce":3186321784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6807","nonce":3186321784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6805","nonce":3186321784}]},"public_addr":"172.21.15.112:6801/3186321784","cluster_addr":"172.21.15.112:6803/3186321784","heartbeat_back_addr":"172.21.15.112:6807/3186321784","heartbeat_front_addr":"172.21.15.112:6805/3186321784","state":["exists","up"]},{"osd":2,"uuid":"0eadcce5-12af-4af6-9b4e-159e84454d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6801","nonce":3206386630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6803","nonce":3206386630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6807","nonce":3206386630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6805","nonce":3206386630}]},"public_addr":"172.21.15.138:6801/3206386630","cluster_addr":"172.21.15.138:6803/3206386630","heartbeat_back_addr":"172.21.15.138:6807/3206386630","heartbeat_front_addr":"172.21.15.138:6805/3206386630","state":["exists","up"]},{"osd":3,"uuid":"5f3f683d-6306-43da-8bbd-c103eca442ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6811","nonce":3832405256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6813","nonce":3832405256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6817","nonce":3832405256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6815","nonce":3832405256}]},"public_addr":"172.21.15.78:6811/3832405256","cluster_addr":"172.21.15.78:6813/3832405256","heartbeat_back_addr":"172.21.15.78:6817/3832405256","heartbeat_front_addr":"172.21.15.78:6815/3832405256","state":["exists","up"]},{"osd":4,"uuid":"4575a0a5-821e-4346-84ac-5396042b0550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6809","nonce":2650243435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6811","nonce":2650243435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6815","nonce":2650243435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6813","nonce":2650243435}]},"public_addr":"172.21.15.112:6809/2650243435","cluster_addr":"172.21.15.112:6811/2650243435","heartbeat_back_addr":"172.21.15.112:6815/2650243435","heartbeat_front_addr":"172.21.15.112:6813/2650243435","state":["exists","up"]},{"osd":5,"uuid":"e81eb98f-76eb-4da5-8047-f160888720e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6809","nonce":3033110975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6811","nonce":3033110975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6815","nonce":3033110975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6813","nonce":3033110975}]},"public_addr":"172.21.15.138:6809/3033110975","cluster_addr":"172.21.15.138:6811/3033110975","heartbeat_back_addr":"172.21.15.138:6815/3033110975","heartbeat_front_addr":"172.21.15.138:6813/3033110975","state":["exists","up"]},{"osd":6,"uuid":"7442a091-4dba-45c4-808b-7c3b97087aa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6819","nonce":477087575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6821","nonce":477087575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6825","nonce":477087575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6823","nonce":477087575}]},"public_addr":"172.21.15.78:6819/477087575","cluster_addr":"172.21.15.78:6821/477087575","heartbeat_back_addr":"172.21.15.78:6825/477087575","heartbeat_front_addr":"172.21.15.78:6823/477087575","state":["exists","up"]},{"osd":7,"uuid":"220c1f03-ace9-4dd0-a06d-485b0d2d08bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6817","nonce":1481363296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6819","nonce":1481363296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6823","nonce":1481363296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6821","nonce":1481363296}]},"public_addr":"172.21.15.112:6817/1481363296","cluster_addr":"172.21.15.112:6819/1481363296","heartbeat_back_addr":"172.21.15.112:6823/1481363296","heartbeat_front_addr":"172.21.15.112:6821/1481363296","state":["exists","up"]},{"osd":8,"uuid":"adb6edaa-9a8c-4b0b-aa6a-26dc77a3a7cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6817","nonce":2195149036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6819","nonce":2195149036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6823","nonce":2195149036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6821","nonce":2195149036}]},"public_addr":"172.21.15.138:6817/2195149036","cluster_addr":"172.21.15.138:6819/2195149036","heartbeat_back_addr":"172.21.15.138:6823/2195149036","heartbeat_front_addr":"172.21.15.138:6821/2195149036","state":["exists","up"]},{"osd":9,"uuid":"dd01f408-3712-410e-acbd-c797b7ea5058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6827","nonce":3367249449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6829","nonce":3367249449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6833","nonce":3367249449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6831","nonce":3367249449}]},"public_addr":"172.21.15.78:6827/3367249449","cluster_addr":"172.21.15.78:6829/3367249449","heartbeat_back_addr":"172.21.15.78:6833/3367249449","heartbeat_front_addr":"172.21.15.78:6831/3367249449","state":["exists","up"]},{"osd":10,"uuid":"243c6483-1b0e-49f2-b99c-116d9e9c0617","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6825","nonce":775023408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6827","nonce":775023408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6831","nonce":775023408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6829","nonce":775023408}]},"public_addr":"172.21.15.112:6825/775023408","cluster_addr":"172.21.15.112:6827/775023408","heartbeat_back_addr":"172.21.15.112:6831/775023408","heartbeat_front_addr":"172.21.15.112:6829/775023408","state":["exists","up"]},{"osd":11,"uuid":"fa20ac9e-b5f7-4b3a-bb51-31569f909609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6825","nonce":4046089012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6827","nonce":4046089012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6831","nonce":4046089012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6829","nonce":4046089012}]},"public_addr":"172.21.15.138:6825/4046089012","cluster_addr":"172.21.15.138:6827/4046089012","heartbeat_back_addr":"172.21.15.138:6831/4046089012","heartbeat_front_addr":"172.21.15.138:6829/4046089012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:08:55.896475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:20.695819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:44.785187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:10.858705+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:35.855800+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:01.353037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:27.492985+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:52.860532+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:17.946878+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:43.188966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:08.369978+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:34.192288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6801/2525199237":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/1476776463":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1949658157":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2276853910":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/4205790529":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6800/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/4286825123":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6801/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1304243506":"2024-09-12T00:06:56.062555+0000","172.21.15.78:6800/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1614270050":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6801/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1679390655":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2957982486":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6800/2525199237":"2024-09-12T00:07:55.586578+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:13:38.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.566+0000 7f53b30a4640 1 -- 172.21.15.78:0/2203999929 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f53980b53b0 msgr2=0x7f53980b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:38.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.566+0000 7f53b30a4640 1 --2- 172.21.15.78:0/2203999929 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f53980b53b0 0x7f53980b7870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f53a4031440 tx=0x7f53a4005e80 comp rx=0 tx=0).stop 2024-09-11T00:13:38.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.566+0000 7f53b30a4640 1 -- 172.21.15.78:0/2203999929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53ac109150 msgr2=0x7f53ac075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:38.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.566+0000 7f53b30a4640 1 --2- 172.21.15.78:0/2203999929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53ac109150 0x7f53ac075f20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f539400c970 tx=0x7f539400ce30 comp rx=0 tx=0).stop 2024-09-11T00:13:38.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.566+0000 7f53b30a4640 1 -- 172.21.15.78:0/2203999929 shutdown_connections 2024-09-11T00:13:38.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.566+0000 7f53b30a4640 1 --2- 172.21.15.78:0/2203999929 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f53980b53b0 0x7f53980b7870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:38.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.566+0000 7f53b30a4640 1 --2- 172.21.15.78:0/2203999929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53ac109150 0x7f53ac075f20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:38.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.566+0000 7f53b30a4640 1 --2- 172.21.15.78:0/2203999929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f53ac1087d0 0x7f53ac0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:38.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.566+0000 7f53b30a4640 1 --2- 172.21.15.78:0/2203999929 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f53ac102dc0 0x7f53ac0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:38.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.566+0000 7f53b30a4640 1 -- 172.21.15.78:0/2203999929 >> 172.21.15.78:0/2203999929 conn(0x7f53ac0fe830 msgr2=0x7f53ac100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:38.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.566+0000 7f53b30a4640 1 -- 172.21.15.78:0/2203999929 shutdown_connections 2024-09-11T00:13:38.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:38.566+0000 7f53b30a4640 1 -- 172.21.15.78:0/2203999929 wait complete. 2024-09-11T00:13:38.694 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:38 smithi138 ceph-mon[35019]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:38.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:38 smithi112 ceph-mon[35627]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:39.404 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T00:09:47.891696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T00:13:39.404 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-11T00:13:39.583 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:39 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2203999929' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:13:39.650 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:39.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:39 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2203999929' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:13:39.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:39 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2203999929' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:13:40.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.089+0000 7f151a67c640 1 -- 172.21.15.78:0/3451256119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1514101cb0 msgr2=0x7f1514102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:40.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.089+0000 7f151a67c640 1 --2- 172.21.15.78:0/3451256119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1514101cb0 0x7f1514102090 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1504009900 tx=0x7f150402a410 comp rx=0 tx=0).stop 2024-09-11T00:13:40.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.089+0000 7f151a67c640 1 -- 172.21.15.78:0/3451256119 shutdown_connections 2024-09-11T00:13:40.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.089+0000 7f151a67c640 1 --2- 172.21.15.78:0/3451256119 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1514108040 0x7f151410e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:40.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.089+0000 7f151a67c640 1 --2- 172.21.15.78:0/3451256119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15141076c0 0x7f1514107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:40.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.089+0000 7f151a67c640 1 --2- 172.21.15.78:0/3451256119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1514101cb0 0x7f1514102090 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:40.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.089+0000 7f151a67c640 1 -- 172.21.15.78:0/3451256119 >> 172.21.15.78:0/3451256119 conn(0x7f15140fd700 msgr2=0x7f15140ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:40.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.089+0000 7f151a67c640 1 -- 172.21.15.78:0/3451256119 shutdown_connections 2024-09-11T00:13:40.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.089+0000 7f151a67c640 1 -- 172.21.15.78:0/3451256119 wait complete. 2024-09-11T00:13:40.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.090+0000 7f151a67c640 1 Processor -- start 2024-09-11T00:13:40.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.090+0000 7f151a67c640 1 -- start start 2024-09-11T00:13:40.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.090+0000 7f151a67c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1514101cb0 0x7f15141993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:40.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.090+0000 7f151a67c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15141076c0 0x7f1514199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:40.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.090+0000 7f151a67c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1514108040 0x7f151419ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:40.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.090+0000 7f151a67c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1514111d40 con 0x7f15141076c0 2024-09-11T00:13:40.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.090+0000 7f151a67c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1514111bc0 con 0x7f1514101cb0 2024-09-11T00:13:40.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.090+0000 7f151a67c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1514111ec0 con 0x7f1514108040 2024-09-11T00:13:40.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.090+0000 7f15137fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15141076c0 0x7f1514199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:40.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.090+0000 7f15137fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15141076c0 0x7f1514199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53514/0 (socket says 172.21.15.78:53514) 2024-09-11T00:13:40.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.090+0000 7f15137fe640 1 -- 172.21.15.78:0/1567088323 learned_addr learned my addr 172.21.15.78:0/1567088323 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:13:40.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.090+0000 7f1518c19640 1 --2- 172.21.15.78:0/1567088323 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1514108040 0x7f151419ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:40.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.091+0000 7f1513fff640 1 --2- 172.21.15.78:0/1567088323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1514101cb0 0x7f15141993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:40.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.091+0000 7f15137fe640 1 -- 172.21.15.78:0/1567088323 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1514108040 msgr2=0x7f151419ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:40.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.091+0000 7f15137fe640 1 --2- 172.21.15.78:0/1567088323 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1514108040 0x7f151419ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:40.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.091+0000 7f15137fe640 1 -- 172.21.15.78:0/1567088323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1514101cb0 msgr2=0x7f15141993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:40.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.091+0000 7f15137fe640 1 --2- 172.21.15.78:0/1567088323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1514101cb0 0x7f15141993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:40.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.091+0000 7f15137fe640 1 -- 172.21.15.78:0/1567088323 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151419f4a0 con 0x7f15141076c0 2024-09-11T00:13:40.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.091+0000 7f1518c19640 1 --2- 172.21.15.78:0/1567088323 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1514108040 0x7f151419ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:40.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.091+0000 7f15137fe640 1 --2- 172.21.15.78:0/1567088323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15141076c0 0x7f1514199930 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f150800b4a0 tx=0x7f150800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:40.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.091+0000 7f15117fa640 1 -- 172.21.15.78:0/1567088323 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1508014070 con 0x7f15141076c0 2024-09-11T00:13:40.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.091+0000 7f15117fa640 1 -- 172.21.15.78:0/1567088323 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1508010ac0 con 0x7f15141076c0 2024-09-11T00:13:40.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.091+0000 7f151a67c640 1 -- 172.21.15.78:0/1567088323 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f151419f790 con 0x7f15141076c0 2024-09-11T00:13:40.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.091+0000 7f15117fa640 1 -- 172.21.15.78:0/1567088323 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1508017c30 con 0x7f15141076c0 2024-09-11T00:13:40.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.091+0000 7f151a67c640 1 -- 172.21.15.78:0/1567088323 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15141a5e50 con 0x7f15141076c0 2024-09-11T00:13:40.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.092+0000 7f151a67c640 1 -- 172.21.15.78:0/1567088323 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1514102110 con 0x7f15141076c0 2024-09-11T00:13:40.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.093+0000 7f15117fa640 1 -- 172.21.15.78:0/1567088323 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f1508010610 con 0x7f15141076c0 2024-09-11T00:13:40.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.094+0000 7f15117fa640 1 --2- 172.21.15.78:0/1567088323 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f14fc0b53b0 0x7f14fc0b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:40.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.094+0000 7f1513fff640 1 --2- 172.21.15.78:0/1567088323 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f14fc0b53b0 0x7f14fc0b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:40.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.094+0000 7f15117fa640 1 -- 172.21.15.78:0/1567088323 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f15080e5160 con 0x7f15141076c0 2024-09-11T00:13:40.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.095+0000 7f1513fff640 1 --2- 172.21.15.78:0/1567088323 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f14fc0b53b0 0x7f14fc0b7870 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1504006010 tx=0x7f1504000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:40.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.097+0000 7f15117fa640 1 -- 172.21.15.78:0/1567088323 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f15080ac3f0 con 0x7f15141076c0 2024-09-11T00:13:40.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.273+0000 7f151a67c640 1 -- 172.21.15.78:0/1567088323 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f151402e5c0 con 0x7f15141076c0 2024-09-11T00:13:40.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.273+0000 7f15117fa640 1 -- 172.21.15.78:0/1567088323 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7f15080abcf0 con 0x7f15141076c0 2024-09-11T00:13:40.275 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-09-11T00:13:40.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.275+0000 7f151a67c640 1 -- 172.21.15.78:0/1567088323 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f14fc0b53b0 msgr2=0x7f14fc0b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:40.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.275+0000 7f151a67c640 1 --2- 172.21.15.78:0/1567088323 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f14fc0b53b0 0x7f14fc0b7870 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1504006010 tx=0x7f1504000bc0 comp rx=0 tx=0).stop 2024-09-11T00:13:40.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.275+0000 7f151a67c640 1 -- 172.21.15.78:0/1567088323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15141076c0 msgr2=0x7f1514199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:40.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.275+0000 7f151a67c640 1 --2- 172.21.15.78:0/1567088323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15141076c0 0x7f1514199930 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f150800b4a0 tx=0x7f150800b960 comp rx=0 tx=0).stop 2024-09-11T00:13:40.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.275+0000 7f151a67c640 1 -- 172.21.15.78:0/1567088323 shutdown_connections 2024-09-11T00:13:40.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.275+0000 7f151a67c640 1 --2- 172.21.15.78:0/1567088323 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f14fc0b53b0 0x7f14fc0b7870 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:40.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.275+0000 7f151a67c640 1 --2- 172.21.15.78:0/1567088323 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1514108040 0x7f151419ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:40.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.275+0000 7f151a67c640 1 --2- 172.21.15.78:0/1567088323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15141076c0 0x7f1514199930 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:40.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.275+0000 7f151a67c640 1 --2- 172.21.15.78:0/1567088323 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1514101cb0 0x7f15141993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:40.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.275+0000 7f151a67c640 1 -- 172.21.15.78:0/1567088323 >> 172.21.15.78:0/1567088323 conn(0x7f15140fd700 msgr2=0x7f151406b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:40.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.275+0000 7f151a67c640 1 -- 172.21.15.78:0/1567088323 shutdown_connections 2024-09-11T00:13:40.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:40.275+0000 7f151a67c640 1 -- 172.21.15.78:0/1567088323 wait complete. 2024-09-11T00:13:40.578 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:40 smithi078 ceph-mon[30865]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:40.578 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:40 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1567088323' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T00:13:40.633 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:40 smithi112 ceph-mon[35627]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:40.633 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:40 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1567088323' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T00:13:40.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:40 smithi138 ceph-mon[35019]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:40.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:40 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1567088323' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T00:13:40.975 INFO:tasks.cephadm:Adding mds.a on smithi078 2024-09-11T00:13:40.975 INFO:tasks.cephadm:Adding mds.d on smithi078 2024-09-11T00:13:40.975 INFO:tasks.cephadm:Adding mds.g on smithi078 2024-09-11T00:13:40.975 INFO:tasks.cephadm:Adding mds.j on smithi078 2024-09-11T00:13:40.976 INFO:tasks.cephadm:Adding mds.b on smithi112 2024-09-11T00:13:40.976 INFO:tasks.cephadm:Adding mds.e on smithi112 2024-09-11T00:13:40.976 INFO:tasks.cephadm:Adding mds.h on smithi112 2024-09-11T00:13:40.976 INFO:tasks.cephadm:Adding mds.k on smithi112 2024-09-11T00:13:40.976 INFO:tasks.cephadm:Adding mds.c on smithi138 2024-09-11T00:13:40.976 INFO:tasks.cephadm:Adding mds.f on smithi138 2024-09-11T00:13:40.977 INFO:tasks.cephadm:Adding mds.i on smithi138 2024-09-11T00:13:40.977 INFO:tasks.cephadm:Adding mds.l on smithi138 2024-09-11T00:13:40.977 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi078=a;smithi078=d;smithi078=g;smithi078=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi138=c;smithi138=f;smithi138=i;smithi138=l' 2024-09-11T00:13:41.238 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:13:41.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.731+0000 7faa8383e640 1 -- 172.21.15.138:0/426523607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa7c1076e0 msgr2=0x7faa7c107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:41.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.731+0000 7faa8383e640 1 --2- 172.21.15.138:0/426523607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa7c1076e0 0x7faa7c107b20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faa6c009900 tx=0x7faa6c02a410 comp rx=0 tx=0).stop 2024-09-11T00:13:41.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.731+0000 7faa8383e640 1 -- 172.21.15.138:0/426523607 shutdown_connections 2024-09-11T00:13:41.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.731+0000 7faa8383e640 1 --2- 172.21.15.138:0/426523607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa7c108060 0x7faa7c10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.731+0000 7faa8383e640 1 --2- 172.21.15.138:0/426523607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa7c1076e0 0x7faa7c107b20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.731+0000 7faa8383e640 1 --2- 172.21.15.138:0/426523607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa7c101cd0 0x7faa7c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.731+0000 7faa8383e640 1 -- 172.21.15.138:0/426523607 >> 172.21.15.138:0/426523607 conn(0x7faa7c0fd700 msgr2=0x7faa7c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:41.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.731+0000 7faa8383e640 1 -- 172.21.15.138:0/426523607 shutdown_connections 2024-09-11T00:13:41.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.731+0000 7faa8383e640 1 -- 172.21.15.138:0/426523607 wait complete. 2024-09-11T00:13:41.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.732+0000 7faa8383e640 1 Processor -- start 2024-09-11T00:13:41.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.732+0000 7faa8383e640 1 -- start start 2024-09-11T00:13:41.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.732+0000 7faa8383e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa7c101cd0 0x7faa7c19a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.732+0000 7faa8383e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa7c1076e0 0x7faa7c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.732+0000 7faa8383e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa7c108060 0x7faa7c19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.732+0000 7faa8383e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7faa7c111ce0 con 0x7faa7c108060 2024-09-11T00:13:41.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.732+0000 7faa8383e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faa7c111b60 con 0x7faa7c101cd0 2024-09-11T00:13:41.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.732+0000 7faa8383e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7faa7c111e60 con 0x7faa7c1076e0 2024-09-11T00:13:41.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.732+0000 7faa80dd9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa7c1076e0 0x7faa7c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.732+0000 7faa80dd9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa7c1076e0 0x7faa7c19a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:51122/0 (socket says 172.21.15.138:51122) 2024-09-11T00:13:41.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.732+0000 7faa80dd9640 1 -- 172.21.15.138:0/2532665313 learned_addr learned my addr 172.21.15.138:0/2532665313 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-09-11T00:13:41.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.732+0000 7faa81ddb640 1 --2- 172.21.15.138:0/2532665313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa7c108060 0x7faa7c19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.732+0000 7faa815da640 1 --2- 172.21.15.138:0/2532665313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa7c101cd0 0x7faa7c19a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.732+0000 7faa80dd9640 1 -- 172.21.15.138:0/2532665313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa7c101cd0 msgr2=0x7faa7c19a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:41.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.732+0000 7faa80dd9640 1 --2- 172.21.15.138:0/2532665313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa7c101cd0 0x7faa7c19a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.732+0000 7faa80dd9640 1 -- 172.21.15.138:0/2532665313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa7c108060 msgr2=0x7faa7c19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:41.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.732+0000 7faa80dd9640 1 --2- 172.21.15.138:0/2532665313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa7c108060 0x7faa7c19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.732+0000 7faa80dd9640 1 -- 172.21.15.138:0/2532665313 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa7c1a54b0 con 0x7faa7c1076e0 2024-09-11T00:13:41.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.732+0000 7faa815da640 1 --2- 172.21.15.138:0/2532665313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa7c101cd0 0x7faa7c19a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:41.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.733+0000 7faa80dd9640 1 --2- 172.21.15.138:0/2532665313 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa7c1076e0 0x7faa7c19a610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faa6c005940 tx=0x7faa6c004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:41.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.733+0000 7faa727fc640 1 -- 172.21.15.138:0/2532665313 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c03f030 con 0x7faa7c1076e0 2024-09-11T00:13:41.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.733+0000 7faa727fc640 1 -- 172.21.15.138:0/2532665313 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa6c003aa0 con 0x7faa7c1076e0 2024-09-11T00:13:41.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.733+0000 7faa8383e640 1 -- 172.21.15.138:0/2532665313 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa7c1a5740 con 0x7faa7c1076e0 2024-09-11T00:13:41.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.733+0000 7faa727fc640 1 -- 172.21.15.138:0/2532665313 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c035070 con 0x7faa7c1076e0 2024-09-11T00:13:41.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.733+0000 7faa8383e640 1 -- 172.21.15.138:0/2532665313 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa7c1a5c20 con 0x7faa7c1076e0 2024-09-11T00:13:41.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.734+0000 7faa8383e640 1 -- 172.21.15.138:0/2532665313 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa7c1020b0 con 0x7faa7c1076e0 2024-09-11T00:13:41.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.735+0000 7faa727fc640 1 -- 172.21.15.138:0/2532665313 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7faa6c03bce0 con 0x7faa7c1076e0 2024-09-11T00:13:41.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.736+0000 7faa727fc640 1 --2- 172.21.15.138:0/2532665313 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7faa680b5330 0x7faa680b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:41.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.736+0000 7faa727fc640 1 -- 172.21.15.138:0/2532665313 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7faa6c106280 con 0x7faa7c1076e0 2024-09-11T00:13:41.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.736+0000 7faa815da640 1 --2- 172.21.15.138:0/2532665313 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7faa680b5330 0x7faa680b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:41.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.737+0000 7faa815da640 1 --2- 172.21.15.138:0/2532665313 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7faa680b5330 0x7faa680b77f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faa78009c20 tx=0x7faa78005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:41.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.740+0000 7faa727fc640 1 -- 172.21.15.138:0/2532665313 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7faa6c0cd510 con 0x7faa7c1076e0 2024-09-11T00:13:41.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.924+0000 7faa8383e640 1 -- 172.21.15.138:0/2532665313 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi078=a;smithi078=d;smithi078=g;smithi078=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi138=c;smithi138=f;smithi138=i;smithi138=l", "target": ["mon-mgr", ""]}) -- 0x7faa7c063690 con 0x7faa680b5330 2024-09-11T00:13:41.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.931+0000 7faa727fc640 1 -- 172.21.15.138:0/2532665313 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7faa7c063690 con 0x7faa680b5330 2024-09-11T00:13:41.933 INFO:teuthology.orchestra.run.smithi138.stdout:Scheduled mds.all update... 2024-09-11T00:13:41.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.933+0000 7faa8383e640 1 -- 172.21.15.138:0/2532665313 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7faa680b5330 msgr2=0x7faa680b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:41.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.933+0000 7faa8383e640 1 --2- 172.21.15.138:0/2532665313 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7faa680b5330 0x7faa680b77f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faa78009c20 tx=0x7faa78005f90 comp rx=0 tx=0).stop 2024-09-11T00:13:41.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.933+0000 7faa8383e640 1 -- 172.21.15.138:0/2532665313 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa7c1076e0 msgr2=0x7faa7c19a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:41.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.933+0000 7faa8383e640 1 --2- 172.21.15.138:0/2532665313 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa7c1076e0 0x7faa7c19a610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faa6c005940 tx=0x7faa6c004270 comp rx=0 tx=0).stop 2024-09-11T00:13:41.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.933+0000 7faa8383e640 1 -- 172.21.15.138:0/2532665313 shutdown_connections 2024-09-11T00:13:41.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.933+0000 7faa8383e640 1 --2- 172.21.15.138:0/2532665313 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7faa680b5330 0x7faa680b77f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.933+0000 7faa8383e640 1 --2- 172.21.15.138:0/2532665313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa7c108060 0x7faa7c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.933+0000 7faa8383e640 1 --2- 172.21.15.138:0/2532665313 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa7c1076e0 0x7faa7c19a610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.933+0000 7faa8383e640 1 --2- 172.21.15.138:0/2532665313 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa7c101cd0 0x7faa7c19a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:41.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.933+0000 7faa8383e640 1 -- 172.21.15.138:0/2532665313 >> 172.21.15.138:0/2532665313 conn(0x7faa7c0fd700 msgr2=0x7faa7c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:41.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.933+0000 7faa8383e640 1 -- 172.21.15.138:0/2532665313 shutdown_connections 2024-09-11T00:13:41.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-11T00:13:41.933+0000 7faa8383e640 1 -- 172.21.15.138:0/2532665313 wait complete. 2024-09-11T00:13:42.659 DEBUG:teuthology.orchestra.run.smithi078:mds.a> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.a.service 2024-09-11T00:13:42.662 DEBUG:teuthology.orchestra.run.smithi078:mds.d> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.d.service 2024-09-11T00:13:42.706 DEBUG:teuthology.orchestra.run.smithi078:mds.g> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.g.service 2024-09-11T00:13:42.751 DEBUG:teuthology.orchestra.run.smithi078:mds.j> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.j.service 2024-09-11T00:13:42.793 DEBUG:teuthology.orchestra.run.smithi112:mds.b> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.b.service 2024-09-11T00:13:42.796 DEBUG:teuthology.orchestra.run.smithi112:mds.e> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.e.service 2024-09-11T00:13:42.839 DEBUG:teuthology.orchestra.run.smithi112:mds.h> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.h.service 2024-09-11T00:13:42.884 DEBUG:teuthology.orchestra.run.smithi112:mds.k> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.k.service 2024-09-11T00:13:42.900 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:42 smithi138 ceph-mon[35019]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:42.900 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:42 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:42.900 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:42 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:42.900 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:42 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:42.901 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:42 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:42.901 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:42 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:42.901 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:42 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:42.901 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:42 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:13:42.901 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:42 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:42.927 DEBUG:teuthology.orchestra.run.smithi138:mds.c> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.c.service 2024-09-11T00:13:42.929 DEBUG:teuthology.orchestra.run.smithi138:mds.f> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.f.service 2024-09-11T00:13:42.972 DEBUG:teuthology.orchestra.run.smithi138:mds.i> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.i.service 2024-09-11T00:13:42.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:42 smithi112 ceph-mon[35627]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:42.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:42 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:42.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:42 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:42.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:42 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:42.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:42 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:42.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:42 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:42.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:42 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:42.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:42 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:13:42.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:42 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:43.015 DEBUG:teuthology.orchestra.run.smithi138:mds.l> sudo journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.l.service 2024-09-11T00:13:43.058 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-11T00:13:43.059 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:13:43.082 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:42 smithi078 ceph-mon[30865]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:43.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:42 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:43.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:42 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:13:43.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:42 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:43.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:42 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:13:43.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:42 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:43.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:42 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:43.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:42 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:13:43.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:42 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:43.302 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:43.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.780+0000 7efeabf18640 1 -- 172.21.15.78:0/2132514939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efea41087d0 msgr2=0x7efea4108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:43.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.780+0000 7efeabf18640 1 --2- 172.21.15.78:0/2132514939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efea41087d0 0x7efea4108c10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efe94009900 tx=0x7efe9402a410 comp rx=0 tx=0).stop 2024-09-11T00:13:43.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.780+0000 7efeabf18640 1 -- 172.21.15.78:0/2132514939 shutdown_connections 2024-09-11T00:13:43.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.780+0000 7efeabf18640 1 --2- 172.21.15.78:0/2132514939 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efea4109150 0x7efea410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:43.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.780+0000 7efeabf18640 1 --2- 172.21.15.78:0/2132514939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efea41087d0 0x7efea4108c10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.780+0000 7efeabf18640 1 --2- 172.21.15.78:0/2132514939 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efea4102dc0 0x7efea41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.780+0000 7efeabf18640 1 -- 172.21.15.78:0/2132514939 >> 172.21.15.78:0/2132514939 conn(0x7efea40fe870 msgr2=0x7efea4100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.780+0000 7efeabf18640 1 -- 172.21.15.78:0/2132514939 shutdown_connections 2024-09-11T00:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.780+0000 7efeabf18640 1 -- 172.21.15.78:0/2132514939 wait complete. 2024-09-11T00:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.780+0000 7efeabf18640 1 Processor -- start 2024-09-11T00:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.781+0000 7efeabf18640 1 -- start start 2024-09-11T00:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.781+0000 7efeabf18640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efea4102dc0 0x7efea4199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.781+0000 7efeabf18640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efea41087d0 0x7efea41997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.781+0000 7efeabf18640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efea4109150 0x7efea419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.781+0000 7efeabf18640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efea4112e10 con 0x7efea4109150 2024-09-11T00:13:43.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.781+0000 7efeabf18640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efea4112c90 con 0x7efea4102dc0 2024-09-11T00:13:43.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.781+0000 7efeabf18640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7efea4112f90 con 0x7efea41087d0 2024-09-11T00:13:43.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.781+0000 7efeaa4b5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efea4109150 0x7efea419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:43.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.781+0000 7efeaa4b5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efea4109150 0x7efea419eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53518/0 (socket says 172.21.15.78:53518) 2024-09-11T00:13:43.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.781+0000 7efeaa4b5640 1 -- 172.21.15.78:0/2174892860 learned_addr learned my addr 172.21.15.78:0/2174892860 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:13:43.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.781+0000 7efea9cb4640 1 --2- 172.21.15.78:0/2174892860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efea4102dc0 0x7efea4199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:43.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.781+0000 7efea94b3640 1 --2- 172.21.15.78:0/2174892860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efea41087d0 0x7efea41997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:43.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.781+0000 7efeaa4b5640 1 -- 172.21.15.78:0/2174892860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efea41087d0 msgr2=0x7efea41997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:43.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.781+0000 7efeaa4b5640 1 --2- 172.21.15.78:0/2174892860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efea41087d0 0x7efea41997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:43.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.781+0000 7efeaa4b5640 1 -- 172.21.15.78:0/2174892860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efea4102dc0 msgr2=0x7efea4199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:43.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.781+0000 7efeaa4b5640 1 --2- 172.21.15.78:0/2174892860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efea4102dc0 0x7efea4199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:43.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.781+0000 7efeaa4b5640 1 -- 172.21.15.78:0/2174892860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea419f330 con 0x7efea4109150 2024-09-11T00:13:43.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.781+0000 7efeaa4b5640 1 --2- 172.21.15.78:0/2174892860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efea4109150 0x7efea419eb60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00b970 tx=0x7efe9c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:43.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.781+0000 7efe9affd640 1 -- 172.21.15.78:0/2174892860 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9c019070 con 0x7efea4109150 2024-09-11T00:13:43.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.781+0000 7efe9affd640 1 -- 172.21.15.78:0/2174892860 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe9c014440 con 0x7efea4109150 2024-09-11T00:13:43.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.781+0000 7efeabf18640 1 -- 172.21.15.78:0/2174892860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efea419f620 con 0x7efea4109150 2024-09-11T00:13:43.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.781+0000 7efe9affd640 1 -- 172.21.15.78:0/2174892860 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9c0075d0 con 0x7efea4109150 2024-09-11T00:13:43.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.782+0000 7efeabf18640 1 -- 172.21.15.78:0/2174892860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efea41a5ce0 con 0x7efea4109150 2024-09-11T00:13:43.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.782+0000 7efeabf18640 1 -- 172.21.15.78:0/2174892860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efea41031a0 con 0x7efea4109150 2024-09-11T00:13:43.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.784+0000 7efe9affd640 1 -- 172.21.15.78:0/2174892860 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7efe9c0145f0 con 0x7efea4109150 2024-09-11T00:13:43.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.785+0000 7efe9affd640 1 --2- 172.21.15.78:0/2174892860 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efe900b5330 0x7efe900b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:43.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.785+0000 7efea9cb4640 1 --2- 172.21.15.78:0/2174892860 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efe900b5330 0x7efe900b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:43.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.785+0000 7efe9affd640 1 -- 172.21.15.78:0/2174892860 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7efe9c0e5590 con 0x7efea4109150 2024-09-11T00:13:43.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.785+0000 7efea9cb4640 1 --2- 172.21.15.78:0/2174892860 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efe900b5330 0x7efe900b77f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efea000abe0 tx=0x7efea000a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:43.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.788+0000 7efe9affd640 1 -- 172.21.15.78:0/2174892860 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efe9c0ac780 con 0x7efea4109150 2024-09-11T00:13:43.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:43 smithi112 ceph-mon[35627]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi078=a;smithi078=d;smithi078=g;smithi078=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi138=c;smithi138=f;smithi138=i;smithi138=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:13:43.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:43 smithi112 ceph-mon[35627]: Saving service mds.all spec with placement smithi078=a;smithi078=d;smithi078=g;smithi078=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi138=c;smithi138=f;smithi138=i;smithi138=l;count:12 2024-09-11T00:13:43.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:43 smithi112 ceph-mon[35627]: Deploying daemon mds.l on smithi138 2024-09-11T00:13:44.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.998+0000 7efeabf18640 1 -- 172.21.15.78:0/2174892860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efea419a3b0 con 0x7efea4109150 2024-09-11T00:13:44.001 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:43 smithi078 ceph-mon[30865]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi078=a;smithi078=d;smithi078=g;smithi078=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi138=c;smithi138=f;smithi138=i;smithi138=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:13:44.001 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:43 smithi078 ceph-mon[30865]: Saving service mds.all spec with placement smithi078=a;smithi078=d;smithi078=g;smithi078=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi138=c;smithi138=f;smithi138=i;smithi138=l;count:12 2024-09-11T00:13:44.001 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:43 smithi078 ceph-mon[30865]: Deploying daemon mds.l on smithi138 2024-09-11T00:13:44.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:43.999+0000 7efe9affd640 1 -- 172.21.15.78:0/2174892860 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7efea419a3b0 con 0x7efea4109150 2024-09-11T00:13:44.002 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:13:44.002 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":1,"btime":"2024-09-11T00:06:05:704536+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-11T00:13:44.002 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 1 2024-09-11T00:13:44.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:44.001+0000 7efeabf18640 1 -- 172.21.15.78:0/2174892860 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efe900b5330 msgr2=0x7efe900b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:44.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:44.002+0000 7efeabf18640 1 --2- 172.21.15.78:0/2174892860 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efe900b5330 0x7efe900b77f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efea000abe0 tx=0x7efea000a2d0 comp rx=0 tx=0).stop 2024-09-11T00:13:44.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:44.002+0000 7efeabf18640 1 -- 172.21.15.78:0/2174892860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efea4109150 msgr2=0x7efea419eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:44.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:44.002+0000 7efeabf18640 1 --2- 172.21.15.78:0/2174892860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efea4109150 0x7efea419eb60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00b970 tx=0x7efe9c00bd70 comp rx=0 tx=0).stop 2024-09-11T00:13:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:44.002+0000 7efeabf18640 1 -- 172.21.15.78:0/2174892860 shutdown_connections 2024-09-11T00:13:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:44.002+0000 7efeabf18640 1 --2- 172.21.15.78:0/2174892860 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efe900b5330 0x7efe900b77f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:44.002+0000 7efeabf18640 1 --2- 172.21.15.78:0/2174892860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efea4109150 0x7efea419eb60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:44.002+0000 7efeabf18640 1 --2- 172.21.15.78:0/2174892860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efea41087d0 0x7efea41997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:44.002+0000 7efeabf18640 1 --2- 172.21.15.78:0/2174892860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efea4102dc0 0x7efea4199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:44.002+0000 7efeabf18640 1 -- 172.21.15.78:0/2174892860 >> 172.21.15.78:0/2174892860 conn(0x7efea40fe870 msgr2=0x7efea4100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:44.002+0000 7efeabf18640 1 -- 172.21.15.78:0/2174892860 shutdown_connections 2024-09-11T00:13:44.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:44.002+0000 7efeabf18640 1 -- 172.21.15.78:0/2174892860 wait complete. 2024-09-11T00:13:44.017 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:43 smithi138 ceph-mon[35019]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi078=a;smithi078=d;smithi078=g;smithi078=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi138=c;smithi138=f;smithi138=i;smithi138=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:13:44.017 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:43 smithi138 ceph-mon[35019]: Saving service mds.all spec with placement smithi078=a;smithi078=d;smithi078=g;smithi078=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi138=c;smithi138=f;smithi138=i;smithi138=l;count:12 2024-09-11T00:13:44.017 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:43 smithi138 ceph-mon[35019]: Deploying daemon mds.l on smithi138 2024-09-11T00:13:44.293 INFO:journalctl@ceph.mds.l.smithi138.stdout:Sep 11 00:13:44 smithi138 systemd[1]: Starting Ceph mds.l for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:13:44.718 INFO:journalctl@ceph.mds.l.smithi138.stdout:Sep 11 00:13:44 smithi138 podman[65316]: 2024-09-11 00:13:44.302140705 +0000 UTC m=+0.015873022 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:13:44.718 INFO:journalctl@ceph.mds.l.smithi138.stdout:Sep 11 00:13:44 smithi138 podman[65316]: 2024-09-11 00:13:44.406204103 +0000 UTC m=+0.119936457 container create 7ed2a552280d302d21c6e13fc5097b0c70c094ec5f14a9a08cff40f21eb52c10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-l, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-11T00:13:44.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:44 smithi112 ceph-mon[35627]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:44.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:44 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2174892860' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:45.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:44 smithi138 ceph-mon[35019]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:45.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:44 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2174892860' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:45.043 INFO:journalctl@ceph.mds.l.smithi138.stdout:Sep 11 00:13:44 smithi138 podman[65316]: 2024-09-11 00:13:44.759071485 +0000 UTC m=+0.472803790 container init 7ed2a552280d302d21c6e13fc5097b0c70c094ec5f14a9a08cff40f21eb52c10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-l, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:13:45.044 INFO:journalctl@ceph.mds.l.smithi138.stdout:Sep 11 00:13:44 smithi138 podman[65316]: 2024-09-11 00:13:44.762041426 +0000 UTC m=+0.475773742 container start 7ed2a552280d302d21c6e13fc5097b0c70c094ec5f14a9a08cff40f21eb52c10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-l, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-11T00:13:45.044 INFO:journalctl@ceph.mds.l.smithi138.stdout:Sep 11 00:13:44 smithi138 ceph-mds[65335]: -- 172.21.15.138:0/2603122554 <== mon.1 v2:172.21.15.138:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564c7f17f860 con 0x564c7f15d000 2024-09-11T00:13:45.044 INFO:journalctl@ceph.mds.l.smithi138.stdout:Sep 11 00:13:44 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-l[65331]: starting mds.l at 2024-09-11T00:13:45.044 INFO:journalctl@ceph.mds.l.smithi138.stdout:Sep 11 00:13:44 smithi138 bash[65316]: 7ed2a552280d302d21c6e13fc5097b0c70c094ec5f14a9a08cff40f21eb52c10 2024-09-11T00:13:45.044 INFO:journalctl@ceph.mds.l.smithi138.stdout:Sep 11 00:13:44 smithi138 systemd[1]: Started Ceph mds.l for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:13:45.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:44 smithi078 ceph-mon[30865]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:45.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:44 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2174892860' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:45 smithi112 ceph-mon[35627]: mds.? [v2:172.21.15.138:6832/2451542817,v1:172.21.15.138:6833/2451542817] up:boot 2024-09-11T00:13:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:45 smithi112 ceph-mon[35627]: fsmap 1 up:standby 2024-09-11T00:13:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:45 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-11T00:13:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:45 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:45 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:45.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:45 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:45 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:45 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:13:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:45 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:45 smithi112 ceph-mon[35627]: Deploying daemon mds.k on smithi112 2024-09-11T00:13:45.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:45 smithi112 ceph-mon[35627]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:46.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:45 smithi078 ceph-mon[30865]: mds.? [v2:172.21.15.138:6832/2451542817,v1:172.21.15.138:6833/2451542817] up:boot 2024-09-11T00:13:46.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:45 smithi078 ceph-mon[30865]: fsmap 1 up:standby 2024-09-11T00:13:46.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:45 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-11T00:13:46.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:45 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:46.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:45 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:46.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:45 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:46.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:45 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:46.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:45 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:13:46.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:45 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:46.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:45 smithi078 ceph-mon[30865]: Deploying daemon mds.k on smithi112 2024-09-11T00:13:46.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:45 smithi078 ceph-mon[30865]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:46.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:45 smithi138 ceph-mon[35019]: mds.? [v2:172.21.15.138:6832/2451542817,v1:172.21.15.138:6833/2451542817] up:boot 2024-09-11T00:13:46.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:45 smithi138 ceph-mon[35019]: fsmap 1 up:standby 2024-09-11T00:13:46.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:45 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-11T00:13:46.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:45 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:46.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:45 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:46.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:45 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:46.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:45 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:46.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:45 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:13:46.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:45 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:46.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:45 smithi138 ceph-mon[35019]: Deploying daemon mds.k on smithi112 2024-09-11T00:13:46.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:45 smithi138 ceph-mon[35019]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:46.753 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:13:47.011 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:47.232 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 11 00:13:47 smithi112 systemd[1]: Starting Ceph mds.k for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:13:47.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.444+0000 7f97599f9640 1 -- 172.21.15.78:0/1769449957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97541087d0 msgr2=0x7f9754108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:47.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.444+0000 7f97599f9640 1 --2- 172.21.15.78:0/1769449957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97541087d0 0x7f9754108c10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9748009900 tx=0x7f974802a410 comp rx=0 tx=0).stop 2024-09-11T00:13:47.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.445+0000 7f97599f9640 1 -- 172.21.15.78:0/1769449957 shutdown_connections 2024-09-11T00:13:47.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.445+0000 7f97599f9640 1 --2- 172.21.15.78:0/1769449957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9754109150 0x7f975410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.445+0000 7f97599f9640 1 --2- 172.21.15.78:0/1769449957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97541087d0 0x7f9754108c10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.445+0000 7f97599f9640 1 --2- 172.21.15.78:0/1769449957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9754102dc0 0x7f97541031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.445+0000 7f97599f9640 1 -- 172.21.15.78:0/1769449957 >> 172.21.15.78:0/1769449957 conn(0x7f97540fe830 msgr2=0x7f9754100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:47.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.445+0000 7f97599f9640 1 -- 172.21.15.78:0/1769449957 shutdown_connections 2024-09-11T00:13:47.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.445+0000 7f97599f9640 1 -- 172.21.15.78:0/1769449957 wait complete. 2024-09-11T00:13:47.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.445+0000 7f97599f9640 1 Processor -- start 2024-09-11T00:13:47.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.446+0000 7f97599f9640 1 -- start start 2024-09-11T00:13:47.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.446+0000 7f97599f9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9754102dc0 0x7f97541992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:47.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.446+0000 7f97599f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97541087d0 0x7f9754199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:47.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.446+0000 7f97599f9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9754109150 0x7f975419ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:47.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.446+0000 7f97599f9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9754112e60 con 0x7f9754102dc0 2024-09-11T00:13:47.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.446+0000 7f97599f9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9754112ce0 con 0x7f97541087d0 2024-09-11T00:13:47.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.446+0000 7f97599f9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9754112fe0 con 0x7f9754109150 2024-09-11T00:13:47.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.446+0000 7f9752ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9754102dc0 0x7f97541992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:47.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.446+0000 7f9752ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9754102dc0 0x7f97541992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46564/0 (socket says 172.21.15.78:46564) 2024-09-11T00:13:47.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.446+0000 7f9752ffd640 1 -- 172.21.15.78:0/1240677412 learned_addr learned my addr 172.21.15.78:0/1240677412 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:13:47.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.446+0000 7f9752ffd640 1 -- 172.21.15.78:0/1240677412 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9754109150 msgr2=0x7f975419ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:47.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.446+0000 7f9752ffd640 1 --2- 172.21.15.78:0/1240677412 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9754109150 0x7f975419ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.446+0000 7f9752ffd640 1 -- 172.21.15.78:0/1240677412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97541087d0 msgr2=0x7f9754199830 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:13:47.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.446+0000 7f9752ffd640 1 --2- 172.21.15.78:0/1240677412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97541087d0 0x7f9754199830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.446+0000 7f9752ffd640 1 -- 172.21.15.78:0/1240677412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975419f3a0 con 0x7f9754102dc0 2024-09-11T00:13:47.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.447+0000 7f9752ffd640 1 --2- 172.21.15.78:0/1240677412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9754102dc0 0x7f97541992f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f974400d770 tx=0x7f974400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:47.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.447+0000 7f97589f7640 1 -- 172.21.15.78:0/1240677412 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9744017070 con 0x7f9754102dc0 2024-09-11T00:13:47.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.447+0000 7f97599f9640 1 -- 172.21.15.78:0/1240677412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f975419f690 con 0x7f9754102dc0 2024-09-11T00:13:47.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.447+0000 7f97589f7640 1 -- 172.21.15.78:0/1240677412 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97440054d0 con 0x7f9754102dc0 2024-09-11T00:13:47.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.447+0000 7f97589f7640 1 -- 172.21.15.78:0/1240677412 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9744004c30 con 0x7f9754102dc0 2024-09-11T00:13:47.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.447+0000 7f97599f9640 1 -- 172.21.15.78:0/1240677412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97541a5d50 con 0x7f9754102dc0 2024-09-11T00:13:47.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.448+0000 7f97599f9640 1 -- 172.21.15.78:0/1240677412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97541031a0 con 0x7f9754102dc0 2024-09-11T00:13:47.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.449+0000 7f97589f7640 1 -- 172.21.15.78:0/1240677412 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f9744004dd0 con 0x7f9754102dc0 2024-09-11T00:13:47.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.450+0000 7f97589f7640 1 --2- 172.21.15.78:0/1240677412 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f973c0b5330 0x7f973c0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:47.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.450+0000 7f97527fc640 1 --2- 172.21.15.78:0/1240677412 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f973c0b5330 0x7f973c0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:47.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.450+0000 7f97589f7640 1 -- 172.21.15.78:0/1240677412 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f97440e5800 con 0x7f9754102dc0 2024-09-11T00:13:47.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.450+0000 7f97527fc640 1 --2- 172.21.15.78:0/1240677412 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f973c0b5330 0x7f973c0b77f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f97480096c0 tx=0x7f9748005fd0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:47.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.453+0000 7f97589f7640 1 -- 172.21.15.78:0/1240677412 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f97440aca90 con 0x7f9754102dc0 2024-09-11T00:13:47.571 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 11 00:13:47 smithi112 podman[66285]: 2024-09-11 00:13:47.161721567 +0000 UTC m=+0.015803833 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:13:47.571 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 11 00:13:47 smithi112 podman[66285]: 2024-09-11 00:13:47.31715339 +0000 UTC m=+0.171235646 container create 325005625e377af09da987fcc4c5806b76c8854ed19348c8baba966c254eab5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-k, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-11T00:13:47.571 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 11 00:13:47 smithi112 podman[66285]: 2024-09-11 00:13:47.570246098 +0000 UTC m=+0.424328353 container init 325005625e377af09da987fcc4c5806b76c8854ed19348c8baba966c254eab5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0) 2024-09-11T00:13:47.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.666+0000 7f97599f9640 1 -- 172.21.15.78:0/1240677412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f975419a420 con 0x7f9754102dc0 2024-09-11T00:13:47.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.667+0000 7f97589f7640 1 -- 172.21.15.78:0/1240677412 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2266 (secure 0 0 0) 0x7f97440ac390 con 0x7f9754102dc0 2024-09-11T00:13:47.669 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:13:47.669 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":3,"btime":"2024-09-11T00:13:47:651106+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T00:13:47.669 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 3 2024-09-11T00:13:47.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.669+0000 7f97599f9640 1 -- 172.21.15.78:0/1240677412 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f973c0b5330 msgr2=0x7f973c0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:47.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.669+0000 7f97599f9640 1 --2- 172.21.15.78:0/1240677412 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f973c0b5330 0x7f973c0b77f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f97480096c0 tx=0x7f9748005fd0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.669+0000 7f97599f9640 1 -- 172.21.15.78:0/1240677412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9754102dc0 msgr2=0x7f97541992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:47.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.669+0000 7f97599f9640 1 --2- 172.21.15.78:0/1240677412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9754102dc0 0x7f97541992f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f974400d770 tx=0x7f974400dc30 comp rx=0 tx=0).stop 2024-09-11T00:13:47.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.669+0000 7f97599f9640 1 -- 172.21.15.78:0/1240677412 shutdown_connections 2024-09-11T00:13:47.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.669+0000 7f97599f9640 1 --2- 172.21.15.78:0/1240677412 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f973c0b5330 0x7f973c0b77f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.669+0000 7f97599f9640 1 --2- 172.21.15.78:0/1240677412 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9754109150 0x7f975419ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.669+0000 7f97599f9640 1 --2- 172.21.15.78:0/1240677412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f97541087d0 0x7f9754199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.669+0000 7f97599f9640 1 --2- 172.21.15.78:0/1240677412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9754102dc0 0x7f97541992f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:47.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.669+0000 7f97599f9640 1 -- 172.21.15.78:0/1240677412 >> 172.21.15.78:0/1240677412 conn(0x7f97540fe830 msgr2=0x7f9754100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:47.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.669+0000 7f97599f9640 1 -- 172.21.15.78:0/1240677412 shutdown_connections 2024-09-11T00:13:47.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:47.669+0000 7f97599f9640 1 -- 172.21.15.78:0/1240677412 wait complete. 2024-09-11T00:13:47.982 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 11 00:13:47 smithi112 podman[66285]: 2024-09-11 00:13:47.573298482 +0000 UTC m=+0.427380754 container start 325005625e377af09da987fcc4c5806b76c8854ed19348c8baba966c254eab5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-11T00:13:47.982 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 11 00:13:47 smithi112 ceph-mds[66304]: -- 172.21.15.112:0/597421689 <== mon.2 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5640433b7860 con 0x564043394800 2024-09-11T00:13:47.982 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 11 00:13:47 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-k[66300]: starting mds.k at 2024-09-11T00:13:47.982 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 11 00:13:47 smithi112 bash[66285]: 325005625e377af09da987fcc4c5806b76c8854ed19348c8baba966c254eab5c 2024-09-11T00:13:47.982 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 11 00:13:47 smithi112 systemd[1]: Started Ceph mds.k for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:13:48.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:48 smithi112 ceph-mon[35627]: mds.? [v2:172.21.15.112:6832/1151759844,v1:172.21.15.112:6833/1151759844] up:boot 2024-09-11T00:13:48.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:48 smithi112 ceph-mon[35627]: fsmap 2 up:standby 2024-09-11T00:13:48.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:48 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-11T00:13:48.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:48 smithi112 ceph-mon[35627]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:48.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:48 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1240677412' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:48.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:48 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:48.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:48 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:48.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:48 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:48.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:48 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:48.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:48 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:13:48.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:48 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:48.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:48 smithi112 ceph-mon[35627]: Deploying daemon mds.j on smithi078 2024-09-11T00:13:48.993 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:48 smithi078 ceph-mon[30865]: mds.? [v2:172.21.15.112:6832/1151759844,v1:172.21.15.112:6833/1151759844] up:boot 2024-09-11T00:13:48.993 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:48 smithi078 ceph-mon[30865]: fsmap 2 up:standby 2024-09-11T00:13:48.993 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:48 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-11T00:13:48.993 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:48 smithi078 ceph-mon[30865]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:48.993 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:48 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1240677412' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:48.993 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:48 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:48.993 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:48 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:48.993 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:48 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:48.994 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:48 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:48.994 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:48 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:13:48.994 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:48 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:48.994 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:48 smithi078 ceph-mon[30865]: Deploying daemon mds.j on smithi078 2024-09-11T00:13:49.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:48 smithi138 ceph-mon[35019]: mds.? [v2:172.21.15.112:6832/1151759844,v1:172.21.15.112:6833/1151759844] up:boot 2024-09-11T00:13:49.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:48 smithi138 ceph-mon[35019]: fsmap 2 up:standby 2024-09-11T00:13:49.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:48 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-11T00:13:49.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:48 smithi138 ceph-mon[35019]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:49.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:48 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1240677412' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:49.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:48 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:49.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:48 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:49.045 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:48 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:49.045 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:48 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:49.045 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:48 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:13:49.045 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:48 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:49.045 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:48 smithi138 ceph-mon[35019]: Deploying daemon mds.j on smithi078 2024-09-11T00:13:50.334 INFO:journalctl@ceph.mds.j.smithi078.stdout:Sep 11 00:13:50 smithi078 systemd[1]: Starting Ceph mds.j for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:13:50.425 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:13:50.694 INFO:journalctl@ceph.mds.j.smithi078.stdout:Sep 11 00:13:50 smithi078 podman[74604]: 2024-09-11 00:13:50.308480985 +0000 UTC m=+0.015513620 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:13:50.694 INFO:journalctl@ceph.mds.j.smithi078.stdout:Sep 11 00:13:50 smithi078 podman[74604]: 2024-09-11 00:13:50.431461278 +0000 UTC m=+0.138493907 container create 080545d92df4370e0b427ec78b57335060a829c4cbff79b2d70d210b37dc5792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-j, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-11T00:13:50.694 INFO:journalctl@ceph.mds.j.smithi078.stdout:Sep 11 00:13:50 smithi078 podman[74604]: 2024-09-11 00:13:50.692894675 +0000 UTC m=+0.399927306 container init 080545d92df4370e0b427ec78b57335060a829c4cbff79b2d70d210b37dc5792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-11T00:13:50.840 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:50.964 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:50 smithi078 ceph-mon[30865]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:50.964 INFO:journalctl@ceph.mds.j.smithi078.stdout:Sep 11 00:13:50 smithi078 podman[74604]: 2024-09-11 00:13:50.696355729 +0000 UTC m=+0.403388368 container start 080545d92df4370e0b427ec78b57335060a829c4cbff79b2d70d210b37dc5792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-j, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-09-11T00:13:50.964 INFO:journalctl@ceph.mds.j.smithi078.stdout:Sep 11 00:13:50 smithi078 ceph-mds[74653]: -- 172.21.15.78:0/822585536 <== mon.0 v2:172.21.15.78:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56270078b860 con 0x562700768800 2024-09-11T00:13:50.964 INFO:journalctl@ceph.mds.j.smithi078.stdout:Sep 11 00:13:50 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-j[74637]: starting mds.j at 2024-09-11T00:13:50.964 INFO:journalctl@ceph.mds.j.smithi078.stdout:Sep 11 00:13:50 smithi078 bash[74604]: 080545d92df4370e0b427ec78b57335060a829c4cbff79b2d70d210b37dc5792 2024-09-11T00:13:50.964 INFO:journalctl@ceph.mds.j.smithi078.stdout:Sep 11 00:13:50 smithi078 systemd[1]: Started Ceph mds.j for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:13:50.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:50 smithi112 ceph-mon[35627]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:51.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:50 smithi138 ceph-mon[35019]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:51.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.335+0000 7f5cb47c4640 1 -- 172.21.15.78:0/4202378434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cac108010 msgr2=0x7f5cac10e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:51.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.335+0000 7f5cb47c4640 1 --2- 172.21.15.78:0/4202378434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cac108010 0x7f5cac10e810 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4009ca0 tx=0x7f5ca402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:13:51.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.335+0000 7f5cb47c4640 1 -- 172.21.15.78:0/4202378434 shutdown_connections 2024-09-11T00:13:51.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.335+0000 7f5cb47c4640 1 --2- 172.21.15.78:0/4202378434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cac108010 0x7f5cac10e810 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:51.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.335+0000 7f5cb47c4640 1 --2- 172.21.15.78:0/4202378434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cac107690 0x7f5cac107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:51.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.335+0000 7f5cb47c4640 1 --2- 172.21.15.78:0/4202378434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cac101c80 0x7f5cac102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:51.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.335+0000 7f5cb47c4640 1 -- 172.21.15.78:0/4202378434 >> 172.21.15.78:0/4202378434 conn(0x7f5cac0fd6d0 msgr2=0x7f5cac0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:51.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.335+0000 7f5cb47c4640 1 -- 172.21.15.78:0/4202378434 shutdown_connections 2024-09-11T00:13:51.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.335+0000 7f5cb47c4640 1 -- 172.21.15.78:0/4202378434 wait complete. 2024-09-11T00:13:51.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.336+0000 7f5cb47c4640 1 Processor -- start 2024-09-11T00:13:51.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.336+0000 7f5cb47c4640 1 -- start start 2024-09-11T00:13:51.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.336+0000 7f5cb47c4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cac101c80 0x7f5cac197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:51.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.336+0000 7f5cb47c4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cac107690 0x7f5cac198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:51.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.336+0000 7f5cb47c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cac108010 0x7f5cac1988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:51.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.336+0000 7f5cb47c4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5cac111c90 con 0x7f5cac108010 2024-09-11T00:13:51.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.336+0000 7f5cb47c4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5cac111b10 con 0x7f5cac101c80 2024-09-11T00:13:51.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.336+0000 7f5cb47c4640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5cac111e10 con 0x7f5cac107690 2024-09-11T00:13:51.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.336+0000 7f5cb2d61640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cac108010 0x7f5cac1988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:51.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.336+0000 7f5cb2560640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cac101c80 0x7f5cac197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:51.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.336+0000 7f5cb2d61640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cac108010 0x7f5cac1988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46594/0 (socket says 172.21.15.78:46594) 2024-09-11T00:13:51.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.336+0000 7f5cb2d61640 1 -- 172.21.15.78:0/1257583374 learned_addr learned my addr 172.21.15.78:0/1257583374 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:13:51.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.336+0000 7f5cb1d5f640 1 --2- 172.21.15.78:0/1257583374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cac107690 0x7f5cac198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:51.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.337+0000 7f5cb2d61640 1 -- 172.21.15.78:0/1257583374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cac107690 msgr2=0x7f5cac198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:51.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.337+0000 7f5cb2d61640 1 --2- 172.21.15.78:0/1257583374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cac107690 0x7f5cac198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:51.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.337+0000 7f5cb2d61640 1 -- 172.21.15.78:0/1257583374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cac101c80 msgr2=0x7f5cac197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:51.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.337+0000 7f5cb2d61640 1 --2- 172.21.15.78:0/1257583374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cac101c80 0x7f5cac197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:51.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.337+0000 7f5cb2d61640 1 -- 172.21.15.78:0/1257583374 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cac19d1c0 con 0x7f5cac108010 2024-09-11T00:13:51.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.337+0000 7f5cb1d5f640 1 --2- 172.21.15.78:0/1257583374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cac107690 0x7f5cac198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:13:51.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.337+0000 7f5cb2d61640 1 --2- 172.21.15.78:0/1257583374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cac108010 0x7f5cac1988b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4005cc0 tx=0x7f5ca402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:51.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.337+0000 7f5c9f7fe640 1 -- 172.21.15.78:0/1257583374 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca4003bf0 con 0x7f5cac108010 2024-09-11T00:13:51.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.337+0000 7f5c9f7fe640 1 -- 172.21.15.78:0/1257583374 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ca4003d90 con 0x7f5cac108010 2024-09-11T00:13:51.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.337+0000 7f5cb47c4640 1 -- 172.21.15.78:0/1257583374 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cac19d450 con 0x7f5cac108010 2024-09-11T00:13:51.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.337+0000 7f5c9f7fe640 1 -- 172.21.15.78:0/1257583374 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca402fb20 con 0x7f5cac108010 2024-09-11T00:13:51.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.337+0000 7f5cb47c4640 1 -- 172.21.15.78:0/1257583374 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cac19d990 con 0x7f5cac108010 2024-09-11T00:13:51.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.338+0000 7f5cb47c4640 1 -- 172.21.15.78:0/1257583374 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cac102060 con 0x7f5cac108010 2024-09-11T00:13:51.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.340+0000 7f5c9f7fe640 1 -- 172.21.15.78:0/1257583374 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f5ca4004580 con 0x7f5cac108010 2024-09-11T00:13:51.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.340+0000 7f5c9f7fe640 1 --2- 172.21.15.78:0/1257583374 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5c980b5330 0x7f5c980b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:51.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.340+0000 7f5cb2560640 1 --2- 172.21.15.78:0/1257583374 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5c980b5330 0x7f5c980b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:51.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.340+0000 7f5c9f7fe640 1 -- 172.21.15.78:0/1257583374 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f5ca4106d50 con 0x7f5cac108010 2024-09-11T00:13:51.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.341+0000 7f5cb2560640 1 --2- 172.21.15.78:0/1257583374 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5c980b5330 0x7f5c980b77f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800abe0 tx=0x7f5ca800a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:51.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.344+0000 7f5c9f7fe640 1 -- 172.21.15.78:0/1257583374 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5ca40cdfe0 con 0x7f5cac108010 2024-09-11T00:13:51.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.561+0000 7f5cb47c4640 1 -- 172.21.15.78:0/1257583374 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cac109a60 con 0x7f5cac108010 2024-09-11T00:13:51.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.562+0000 7f5c9f7fe640 1 -- 172.21.15.78:0/1257583374 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2266 (secure 0 0 0) 0x7f5ca40cd8e0 con 0x7f5cac108010 2024-09-11T00:13:51.564 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:13:51.564 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":3,"btime":"2024-09-11T00:13:47:651106+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T00:13:51.564 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 3 2024-09-11T00:13:51.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.564+0000 7f5cb47c4640 1 -- 172.21.15.78:0/1257583374 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5c980b5330 msgr2=0x7f5c980b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:51.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.564+0000 7f5cb47c4640 1 --2- 172.21.15.78:0/1257583374 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5c980b5330 0x7f5c980b77f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800abe0 tx=0x7f5ca800a2d0 comp rx=0 tx=0).stop 2024-09-11T00:13:51.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.564+0000 7f5cb47c4640 1 -- 172.21.15.78:0/1257583374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cac108010 msgr2=0x7f5cac1988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:51.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.564+0000 7f5cb47c4640 1 --2- 172.21.15.78:0/1257583374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cac108010 0x7f5cac1988b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4005cc0 tx=0x7f5ca402f380 comp rx=0 tx=0).stop 2024-09-11T00:13:51.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.564+0000 7f5cb47c4640 1 -- 172.21.15.78:0/1257583374 shutdown_connections 2024-09-11T00:13:51.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.564+0000 7f5cb47c4640 1 --2- 172.21.15.78:0/1257583374 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5c980b5330 0x7f5c980b77f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:51.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.564+0000 7f5cb47c4640 1 --2- 172.21.15.78:0/1257583374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cac108010 0x7f5cac1988b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:51.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.564+0000 7f5cb47c4640 1 --2- 172.21.15.78:0/1257583374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cac107690 0x7f5cac198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:51.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.564+0000 7f5cb47c4640 1 --2- 172.21.15.78:0/1257583374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5cac101c80 0x7f5cac197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:51.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.564+0000 7f5cb47c4640 1 -- 172.21.15.78:0/1257583374 >> 172.21.15.78:0/1257583374 conn(0x7f5cac0fd6d0 msgr2=0x7f5cac0fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:51.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.564+0000 7f5cb47c4640 1 -- 172.21.15.78:0/1257583374 shutdown_connections 2024-09-11T00:13:51.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:51.564+0000 7f5cb47c4640 1 -- 172.21.15.78:0/1257583374 wait complete. 2024-09-11T00:13:52.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:51 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:52.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:51 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:52.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:51 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:52.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:51 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:52.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:51 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:13:52.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:51 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:52.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:51 smithi112 ceph-mon[35627]: Deploying daemon mds.d on smithi078 2024-09-11T00:13:52.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:51 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1257583374' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:52.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:51 smithi112 ceph-mon[35627]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:52.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:51 smithi112 ceph-mon[35627]: mds.? [v2:172.21.15.78:6834/968608466,v1:172.21.15.78:6835/968608466] up:boot 2024-09-11T00:13:52.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:51 smithi112 ceph-mon[35627]: fsmap 3 up:standby 2024-09-11T00:13:52.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:51 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-11T00:13:52.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:51 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:52.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:51 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:52.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:51 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:52.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:51 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:52.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:51 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:13:52.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:51 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:52.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:51 smithi138 ceph-mon[35019]: Deploying daemon mds.d on smithi078 2024-09-11T00:13:52.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:51 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1257583374' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:52.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:51 smithi138 ceph-mon[35019]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:52.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:51 smithi138 ceph-mon[35019]: mds.? [v2:172.21.15.78:6834/968608466,v1:172.21.15.78:6835/968608466] up:boot 2024-09-11T00:13:52.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:51 smithi138 ceph-mon[35019]: fsmap 3 up:standby 2024-09-11T00:13:52.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:51 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-11T00:13:52.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:51 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:52.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:51 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:52.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:51 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:52.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:51 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:52.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:51 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:13:52.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:51 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:52.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:51 smithi078 ceph-mon[30865]: Deploying daemon mds.d on smithi078 2024-09-11T00:13:52.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:51 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1257583374' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:52.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:51 smithi078 ceph-mon[30865]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:52.335 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:51 smithi078 ceph-mon[30865]: mds.? [v2:172.21.15.78:6834/968608466,v1:172.21.15.78:6835/968608466] up:boot 2024-09-11T00:13:52.335 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:51 smithi078 ceph-mon[30865]: fsmap 3 up:standby 2024-09-11T00:13:52.335 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:51 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-11T00:13:53.978 INFO:journalctl@ceph.mds.d.smithi078.stdout:Sep 11 00:13:53 smithi078 systemd[1]: Starting Ceph mds.d for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:13:54.233 INFO:journalctl@ceph.mds.d.smithi078.stdout:Sep 11 00:13:53 smithi078 podman[75021]: 2024-09-11 00:13:53.879801789 +0000 UTC m=+0.015970453 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:13:54.233 INFO:journalctl@ceph.mds.d.smithi078.stdout:Sep 11 00:13:53 smithi078 podman[75021]: 2024-09-11 00:13:53.986935963 +0000 UTC m=+0.123104657 container create f7b431cb7153892d824c3196b21afde994ec2a6da4ad3bcf7e6280f041bc2ee8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:13:54.233 INFO:journalctl@ceph.mds.d.smithi078.stdout:Sep 11 00:13:54 smithi078 podman[75021]: 2024-09-11 00:13:54.231780462 +0000 UTC m=+0.367949114 container init f7b431cb7153892d824c3196b21afde994ec2a6da4ad3bcf7e6280f041bc2ee8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-d, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux ) 2024-09-11T00:13:54.369 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:13:54.584 INFO:journalctl@ceph.mds.d.smithi078.stdout:Sep 11 00:13:54 smithi078 podman[75021]: 2024-09-11 00:13:54.234913775 +0000 UTC m=+0.371082436 container start f7b431cb7153892d824c3196b21afde994ec2a6da4ad3bcf7e6280f041bc2ee8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-11T00:13:54.584 INFO:journalctl@ceph.mds.d.smithi078.stdout:Sep 11 00:13:54 smithi078 ceph-mds[75040]: -- 172.21.15.78:0/798504914 <== mon.0 v2:172.21.15.78:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5609be0b3860 con 0x5609be090800 2024-09-11T00:13:54.584 INFO:journalctl@ceph.mds.d.smithi078.stdout:Sep 11 00:13:54 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-d[75036]: starting mds.d at 2024-09-11T00:13:54.584 INFO:journalctl@ceph.mds.d.smithi078.stdout:Sep 11 00:13:54 smithi078 bash[75021]: f7b431cb7153892d824c3196b21afde994ec2a6da4ad3bcf7e6280f041bc2ee8 2024-09-11T00:13:54.584 INFO:journalctl@ceph.mds.d.smithi078.stdout:Sep 11 00:13:54 smithi078 systemd[1]: Started Ceph mds.d for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:13:54.619 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:54.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:54 smithi112 ceph-mon[35627]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:54.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:54 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:54.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:54 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:54.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:54 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:54.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:54 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:54.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:54 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:13:54.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:54 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:55.002 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:54 smithi078 ceph-mon[30865]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:55.003 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:54 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:55.003 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:54 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:55.003 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:54 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:55.003 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:54 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:55.003 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:54 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:13:55.003 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:54 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:55.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:54 smithi138 ceph-mon[35019]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:55.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:54 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:55.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:54 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:55.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:54 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:55.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:54 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:55.045 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:54 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:13:55.045 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:54 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:55.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.082+0000 7f9941d32640 1 -- 172.21.15.78:0/1383398702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f993c108030 msgr2=0x7f993c10e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.082+0000 7f9941d32640 1 --2- 172.21.15.78:0/1383398702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f993c108030 0x7f993c10e830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9934009ca0 tx=0x7f993402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.082+0000 7f9941d32640 1 -- 172.21.15.78:0/1383398702 shutdown_connections 2024-09-11T00:13:55.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.082+0000 7f9941d32640 1 --2- 172.21.15.78:0/1383398702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f993c108030 0x7f993c10e830 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.082+0000 7f9941d32640 1 --2- 172.21.15.78:0/1383398702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f993c1076b0 0x7f993c107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.082+0000 7f9941d32640 1 --2- 172.21.15.78:0/1383398702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f993c101ca0 0x7f993c102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.082+0000 7f9941d32640 1 -- 172.21.15.78:0/1383398702 >> 172.21.15.78:0/1383398702 conn(0x7f993c0fd730 msgr2=0x7f993c0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:55.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.082+0000 7f9941d32640 1 -- 172.21.15.78:0/1383398702 shutdown_connections 2024-09-11T00:13:55.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.082+0000 7f9941d32640 1 -- 172.21.15.78:0/1383398702 wait complete. 2024-09-11T00:13:55.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.083+0000 7f9941d32640 1 Processor -- start 2024-09-11T00:13:55.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.083+0000 7f9941d32640 1 -- start start 2024-09-11T00:13:55.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.083+0000 7f9941d32640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f993c101ca0 0x7f993c0fdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.083+0000 7f9941d32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f993c1076b0 0x7f993c0fe170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.083+0000 7f9941d32640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f993c108030 0x7f993c0fe6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.083+0000 7f9941d32640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f993c111cf0 con 0x7f993c1076b0 2024-09-11T00:13:55.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.083+0000 7f9941d32640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f993c111b70 con 0x7f993c108030 2024-09-11T00:13:55.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.083+0000 7f9941d32640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f993c111e70 con 0x7f993c101ca0 2024-09-11T00:13:55.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.083+0000 7f9933fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f993c1076b0 0x7f993c0fe170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.083+0000 7f9933fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f993c1076b0 0x7f993c0fe170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41114/0 (socket says 172.21.15.78:41114) 2024-09-11T00:13:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.083+0000 7f9933fff640 1 -- 172.21.15.78:0/843633660 learned_addr learned my addr 172.21.15.78:0/843633660 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:13:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.083+0000 7f993bfff640 1 --2- 172.21.15.78:0/843633660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f993c108030 0x7f993c0fe6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.083+0000 7f993b7fe640 1 --2- 172.21.15.78:0/843633660 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f993c101ca0 0x7f993c0fdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.083+0000 7f9933fff640 1 -- 172.21.15.78:0/843633660 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f993c101ca0 msgr2=0x7f993c0fdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.083+0000 7f9933fff640 1 --2- 172.21.15.78:0/843633660 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f993c101ca0 0x7f993c0fdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.083+0000 7f9933fff640 1 -- 172.21.15.78:0/843633660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f993c108030 msgr2=0x7f993c0fe6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.083+0000 7f9933fff640 1 --2- 172.21.15.78:0/843633660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f993c108030 0x7f993c0fe6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.083+0000 7f9933fff640 1 -- 172.21.15.78:0/843633660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f993c1a76f0 con 0x7f993c1076b0 2024-09-11T00:13:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.083+0000 7f9933fff640 1 --2- 172.21.15.78:0/843633660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f993c1076b0 0x7f993c0fe170 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f992400c890 tx=0x7f992400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.084+0000 7f99397fa640 1 -- 172.21.15.78:0/843633660 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9924004220 con 0x7f993c1076b0 2024-09-11T00:13:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.084+0000 7f99397fa640 1 -- 172.21.15.78:0/843633660 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99240043c0 con 0x7f993c1076b0 2024-09-11T00:13:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.084+0000 7f99397fa640 1 -- 172.21.15.78:0/843633660 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9924004a00 con 0x7f993c1076b0 2024-09-11T00:13:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.084+0000 7f9941d32640 1 -- 172.21.15.78:0/843633660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f993c1a79e0 con 0x7f993c1076b0 2024-09-11T00:13:55.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.084+0000 7f9941d32640 1 -- 172.21.15.78:0/843633660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f993c1a7ff0 con 0x7f993c1076b0 2024-09-11T00:13:55.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.085+0000 7f9941d32640 1 -- 172.21.15.78:0/843633660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f993c102080 con 0x7f993c1076b0 2024-09-11T00:13:55.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.086+0000 7f99397fa640 1 -- 172.21.15.78:0/843633660 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f99240079b0 con 0x7f993c1076b0 2024-09-11T00:13:55.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.087+0000 7f99397fa640 1 --2- 172.21.15.78:0/843633660 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f99280b53b0 0x7f99280b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:55.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.087+0000 7f993b7fe640 1 --2- 172.21.15.78:0/843633660 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f99280b53b0 0x7f99280b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:55.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.087+0000 7f99397fa640 1 -- 172.21.15.78:0/843633660 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f99240e59c0 con 0x7f993c1076b0 2024-09-11T00:13:55.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.087+0000 7f993b7fe640 1 --2- 172.21.15.78:0/843633660 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f99280b53b0 0x7f99280b7870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f992c009890 tx=0x7f992c008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:55.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.090+0000 7f99397fa640 1 -- 172.21.15.78:0/843633660 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9924014030 con 0x7f993c1076b0 2024-09-11T00:13:55.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.299+0000 7f9941d32640 1 -- 172.21.15.78:0/843633660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f993c0fef30 con 0x7f993c1076b0 2024-09-11T00:13:55.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.299+0000 7f99397fa640 1 -- 172.21.15.78:0/843633660 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f993c0fef30 con 0x7f993c1076b0 2024-09-11T00:13:55.301 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:13:55.301 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"btime":"2024-09-11T00:13:54:711037+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T00:13:55.302 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 5 2024-09-11T00:13:55.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.301+0000 7f9941d32640 1 -- 172.21.15.78:0/843633660 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f99280b53b0 msgr2=0x7f99280b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.301+0000 7f9941d32640 1 --2- 172.21.15.78:0/843633660 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f99280b53b0 0x7f99280b7870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f992c009890 tx=0x7f992c008040 comp rx=0 tx=0).stop 2024-09-11T00:13:55.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.301+0000 7f9941d32640 1 -- 172.21.15.78:0/843633660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f993c1076b0 msgr2=0x7f993c0fe170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:55.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.301+0000 7f9941d32640 1 --2- 172.21.15.78:0/843633660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f993c1076b0 0x7f993c0fe170 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f992400c890 tx=0x7f992400cd50 comp rx=0 tx=0).stop 2024-09-11T00:13:55.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.302+0000 7f9941d32640 1 -- 172.21.15.78:0/843633660 shutdown_connections 2024-09-11T00:13:55.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.302+0000 7f9941d32640 1 --2- 172.21.15.78:0/843633660 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f99280b53b0 0x7f99280b7870 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.302+0000 7f9941d32640 1 --2- 172.21.15.78:0/843633660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f993c108030 0x7f993c0fe6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.302+0000 7f9941d32640 1 --2- 172.21.15.78:0/843633660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f993c1076b0 0x7f993c0fe170 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.302+0000 7f9941d32640 1 --2- 172.21.15.78:0/843633660 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f993c101ca0 0x7f993c0fdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:55.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.302+0000 7f9941d32640 1 -- 172.21.15.78:0/843633660 >> 172.21.15.78:0/843633660 conn(0x7f993c0fd730 msgr2=0x7f993c100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:55.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.302+0000 7f9941d32640 1 -- 172.21.15.78:0/843633660 shutdown_connections 2024-09-11T00:13:55.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:55.302+0000 7f9941d32640 1 -- 172.21.15.78:0/843633660 wait complete. 2024-09-11T00:13:55.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:55 smithi112 ceph-mon[35627]: Deploying daemon mds.e on smithi112 2024-09-11T00:13:55.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:55 smithi112 ceph-mon[35627]: mds.? [v2:172.21.15.78:6836/2804778258,v1:172.21.15.78:6837/2804778258] up:boot 2024-09-11T00:13:55.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:55 smithi112 ceph-mon[35627]: fsmap 4 up:standby 2024-09-11T00:13:55.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:55 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-11T00:13:55.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:55 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/843633660' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:56.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:55 smithi138 ceph-mon[35019]: Deploying daemon mds.e on smithi112 2024-09-11T00:13:56.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:55 smithi138 ceph-mon[35019]: mds.? [v2:172.21.15.78:6836/2804778258,v1:172.21.15.78:6837/2804778258] up:boot 2024-09-11T00:13:56.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:55 smithi138 ceph-mon[35019]: fsmap 4 up:standby 2024-09-11T00:13:56.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:55 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-11T00:13:56.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:55 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/843633660' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:56.068 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:55 smithi078 ceph-mon[30865]: Deploying daemon mds.e on smithi112 2024-09-11T00:13:56.069 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:55 smithi078 ceph-mon[30865]: mds.? [v2:172.21.15.78:6836/2804778258,v1:172.21.15.78:6837/2804778258] up:boot 2024-09-11T00:13:56.069 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:55 smithi078 ceph-mon[30865]: fsmap 4 up:standby 2024-09-11T00:13:56.069 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:55 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-11T00:13:56.069 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:55 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/843633660' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:56.726 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 11 00:13:56 smithi112 systemd[1]: Starting Ceph mds.e for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:13:56.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:56 smithi112 ceph-mon[35627]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:56.982 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 11 00:13:56 smithi112 podman[66598]: 2024-09-11 00:13:56.631422999 +0000 UTC m=+0.015427634 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:13:56.982 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 11 00:13:56 smithi112 podman[66598]: 2024-09-11 00:13:56.757423342 +0000 UTC m=+0.141428009 container create 1413e0deebb9ac334f2c09c70a48be65cea4c5020970713413d5b302ae631ba0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS) 2024-09-11T00:13:57.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:56 smithi138 ceph-mon[35019]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:57.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:56 smithi078 ceph-mon[30865]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:57.482 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 11 00:13:57 smithi112 podman[66598]: 2024-09-11 00:13:57.03327533 +0000 UTC m=+0.417279952 container init 1413e0deebb9ac334f2c09c70a48be65cea4c5020970713413d5b302ae631ba0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-11T00:13:57.482 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 11 00:13:57 smithi112 podman[66598]: 2024-09-11 00:13:57.03599585 +0000 UTC m=+0.420000479 container start 1413e0deebb9ac334f2c09c70a48be65cea4c5020970713413d5b302ae631ba0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-e, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-11T00:13:57.482 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 11 00:13:57 smithi112 ceph-mds[66617]: -- 172.21.15.112:0/2755065093 <== mon.2 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e125fb1860 con 0x55e125f8f400 2024-09-11T00:13:57.482 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 11 00:13:57 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-e[66613]: starting mds.e at 2024-09-11T00:13:57.482 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 11 00:13:57 smithi112 bash[66598]: 1413e0deebb9ac334f2c09c70a48be65cea4c5020970713413d5b302ae631ba0 2024-09-11T00:13:57.483 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 11 00:13:57 smithi112 systemd[1]: Started Ceph mds.e for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:13:58.096 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:13:58.364 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:13:58.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:58.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:58.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:58.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:58.483 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:13:58.483 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:58.483 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:58 smithi112 ceph-mon[35627]: Deploying daemon mds.f on smithi138 2024-09-11T00:13:58.483 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:58 smithi112 ceph-mon[35627]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:58.483 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:58 smithi112 ceph-mon[35627]: mds.? [v2:172.21.15.112:6834/2046327807,v1:172.21.15.112:6835/2046327807] up:boot 2024-09-11T00:13:58.483 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:58 smithi112 ceph-mon[35627]: fsmap 5 up:standby 2024-09-11T00:13:58.483 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:58 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-11T00:13:58.484 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:58.484 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:58.484 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:58.484 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:58.484 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:13:58.484 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:58.484 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:58 smithi078 ceph-mon[30865]: Deploying daemon mds.f on smithi138 2024-09-11T00:13:58.484 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:58 smithi078 ceph-mon[30865]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:58.485 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:58 smithi078 ceph-mon[30865]: mds.? [v2:172.21.15.112:6834/2046327807,v1:172.21.15.112:6835/2046327807] up:boot 2024-09-11T00:13:58.485 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:58 smithi078 ceph-mon[30865]: fsmap 5 up:standby 2024-09-11T00:13:58.485 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:58 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-11T00:13:58.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:58.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:58.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:13:58.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:13:58.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:13:58.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:13:58.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:58 smithi138 ceph-mon[35019]: Deploying daemon mds.f on smithi138 2024-09-11T00:13:58.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:58 smithi138 ceph-mon[35019]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:13:58.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:58 smithi138 ceph-mon[35019]: mds.? [v2:172.21.15.112:6834/2046327807,v1:172.21.15.112:6835/2046327807] up:boot 2024-09-11T00:13:58.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:58 smithi138 ceph-mon[35019]: fsmap 5 up:standby 2024-09-11T00:13:58.544 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:58 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-11T00:13:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.866+0000 7fa724b50640 1 -- 172.21.15.78:0/1043736891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7201076a0 msgr2=0x7fa720107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:58.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.866+0000 7fa724b50640 1 --2- 172.21.15.78:0/1043736891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7201076a0 0x7fa720107ae0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa708009860 tx=0x7fa70802a340 comp rx=0 tx=0).stop 2024-09-11T00:13:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.866+0000 7fa724b50640 1 -- 172.21.15.78:0/1043736891 shutdown_connections 2024-09-11T00:13:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.866+0000 7fa724b50640 1 --2- 172.21.15.78:0/1043736891 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa720108020 0x7fa72010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.866+0000 7fa724b50640 1 --2- 172.21.15.78:0/1043736891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7201076a0 0x7fa720107ae0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.866+0000 7fa724b50640 1 --2- 172.21.15.78:0/1043736891 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa720101c90 0x7fa720102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.866+0000 7fa724b50640 1 -- 172.21.15.78:0/1043736891 >> 172.21.15.78:0/1043736891 conn(0x7fa7200fd700 msgr2=0x7fa7200ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.866+0000 7fa724b50640 1 -- 172.21.15.78:0/1043736891 shutdown_connections 2024-09-11T00:13:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.866+0000 7fa724b50640 1 -- 172.21.15.78:0/1043736891 wait complete. 2024-09-11T00:13:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.867+0000 7fa724b50640 1 Processor -- start 2024-09-11T00:13:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.867+0000 7fa724b50640 1 -- start start 2024-09-11T00:13:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.867+0000 7fa724b50640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa720101c90 0x7fa720199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.867+0000 7fa724b50640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7201076a0 0x7fa7201997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.867+0000 7fa724b50640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa720108020 0x7fa72019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.867+0000 7fa724b50640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa720112dd0 con 0x7fa720108020 2024-09-11T00:13:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.867+0000 7fa724b50640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa720112c50 con 0x7fa720101c90 2024-09-11T00:13:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.867+0000 7fa724b50640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa720112f50 con 0x7fa7201076a0 2024-09-11T00:13:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.867+0000 7fa71ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa720108020 0x7fa72019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.867+0000 7fa71ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa720108020 0x7fa72019eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41130/0 (socket says 172.21.15.78:41130) 2024-09-11T00:13:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.867+0000 7fa71e59c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa720101c90 0x7fa720199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.867+0000 7fa71ed9d640 1 -- 172.21.15.78:0/547273449 learned_addr learned my addr 172.21.15.78:0/547273449 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:13:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.868+0000 7fa717fff640 1 --2- 172.21.15.78:0/547273449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7201076a0 0x7fa7201997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.868+0000 7fa71ed9d640 1 -- 172.21.15.78:0/547273449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7201076a0 msgr2=0x7fa7201997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.868+0000 7fa71ed9d640 1 --2- 172.21.15.78:0/547273449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7201076a0 0x7fa7201997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.868+0000 7fa71ed9d640 1 -- 172.21.15.78:0/547273449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa720101c90 msgr2=0x7fa720199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.868+0000 7fa71ed9d640 1 --2- 172.21.15.78:0/547273449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa720101c90 0x7fa720199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:58.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.868+0000 7fa71ed9d640 1 -- 172.21.15.78:0/547273449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa72019f310 con 0x7fa720108020 2024-09-11T00:13:58.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.868+0000 7fa71e59c640 1 --2- 172.21.15.78:0/547273449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa720101c90 0x7fa720199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:13:58.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.868+0000 7fa71ed9d640 1 --2- 172.21.15.78:0/547273449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa720108020 0x7fa72019eb40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa71800eb10 tx=0x7fa71800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:58.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.868+0000 7fa7177fe640 1 -- 172.21.15.78:0/547273449 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71800ce20 con 0x7fa720108020 2024-09-11T00:13:58.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.868+0000 7fa7177fe640 1 -- 172.21.15.78:0/547273449 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa718005020 con 0x7fa720108020 2024-09-11T00:13:58.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.868+0000 7fa724b50640 1 -- 172.21.15.78:0/547273449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa72019f600 con 0x7fa720108020 2024-09-11T00:13:58.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.868+0000 7fa7177fe640 1 -- 172.21.15.78:0/547273449 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa718010690 con 0x7fa720108020 2024-09-11T00:13:58.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.868+0000 7fa724b50640 1 -- 172.21.15.78:0/547273449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7201a5cc0 con 0x7fa720108020 2024-09-11T00:13:58.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.869+0000 7fa724b50640 1 -- 172.21.15.78:0/547273449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa720102070 con 0x7fa720108020 2024-09-11T00:13:58.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.871+0000 7fa7177fe640 1 -- 172.21.15.78:0/547273449 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fa718005510 con 0x7fa720108020 2024-09-11T00:13:58.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.871+0000 7fa7177fe640 1 --2- 172.21.15.78:0/547273449 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa70c0b5330 0x7fa70c0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:13:58.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.871+0000 7fa71e59c640 1 --2- 172.21.15.78:0/547273449 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa70c0b5330 0x7fa70c0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:13:58.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.871+0000 7fa7177fe640 1 -- 172.21.15.78:0/547273449 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fa7180e6010 con 0x7fa720108020 2024-09-11T00:13:58.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.872+0000 7fa71e59c640 1 --2- 172.21.15.78:0/547273449 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa70c0b5330 0x7fa70c0b77f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa710005fd0 tx=0x7fa710009260 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:13:58.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:58.874+0000 7fa7177fe640 1 -- 172.21.15.78:0/547273449 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa718056220 con 0x7fa720108020 2024-09-11T00:13:59.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:59.096+0000 7fa724b50640 1 -- 172.21.15.78:0/547273449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa72002e5c0 con 0x7fa720108020 2024-09-11T00:13:59.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:59.096+0000 7fa7177fe640 1 -- 172.21.15.78:0/547273449 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4741 (secure 0 0 0) 0x7fa7180ad2a0 con 0x7fa720108020 2024-09-11T00:13:59.098 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:13:59.098 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":6,"btime":"2024-09-11T00:13:57:724501+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-11T00:13:59.098 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 6 2024-09-11T00:13:59.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:59.099+0000 7fa724b50640 1 -- 172.21.15.78:0/547273449 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa70c0b5330 msgr2=0x7fa70c0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:59.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:59.099+0000 7fa724b50640 1 --2- 172.21.15.78:0/547273449 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa70c0b5330 0x7fa70c0b77f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa710005fd0 tx=0x7fa710009260 comp rx=0 tx=0).stop 2024-09-11T00:13:59.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:59.099+0000 7fa724b50640 1 -- 172.21.15.78:0/547273449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa720108020 msgr2=0x7fa72019eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:13:59.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:59.099+0000 7fa724b50640 1 --2- 172.21.15.78:0/547273449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa720108020 0x7fa72019eb40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa71800eb10 tx=0x7fa71800ef10 comp rx=0 tx=0).stop 2024-09-11T00:13:59.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:59.099+0000 7fa724b50640 1 -- 172.21.15.78:0/547273449 shutdown_connections 2024-09-11T00:13:59.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:59.099+0000 7fa724b50640 1 --2- 172.21.15.78:0/547273449 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa70c0b5330 0x7fa70c0b77f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:59.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:59.099+0000 7fa724b50640 1 --2- 172.21.15.78:0/547273449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa720108020 0x7fa72019eb40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:59.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:59.099+0000 7fa724b50640 1 --2- 172.21.15.78:0/547273449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7201076a0 0x7fa7201997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:59.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:59.099+0000 7fa724b50640 1 --2- 172.21.15.78:0/547273449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa720101c90 0x7fa720199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:13:59.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:59.099+0000 7fa724b50640 1 -- 172.21.15.78:0/547273449 >> 172.21.15.78:0/547273449 conn(0x7fa7200fd700 msgr2=0x7fa7200ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:13:59.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:59.099+0000 7fa724b50640 1 -- 172.21.15.78:0/547273449 shutdown_connections 2024-09-11T00:13:59.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:13:59.099+0000 7fa724b50640 1 -- 172.21.15.78:0/547273449 wait complete. 2024-09-11T00:13:59.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:13:59 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/547273449' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:59.415 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:13:59 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/547273449' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:13:59.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:13:59 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/547273449' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:14:00.043 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 11 00:13:59 smithi138 systemd[1]: Started Ceph mds.f for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:14:01.010 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:00 smithi112 ceph-mon[35627]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:01.010 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:00 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:01.010 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:00 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:01.010 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:00 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:01.010 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:00 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:14:01.010 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:00 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:14:01.010 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:00 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:01.011 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:00 smithi112 ceph-mon[35627]: mds.? [v2:172.21.15.138:6834/1086283757,v1:172.21.15.138:6835/1086283757] up:boot 2024-09-11T00:14:01.011 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:00 smithi112 ceph-mon[35627]: fsmap 6 up:standby 2024-09-11T00:14:01.011 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:00 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-11T00:14:01.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:00 smithi138 ceph-mon[35019]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:01.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:00 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:01.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:00 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:01.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:00 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:01.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:00 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:14:01.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:00 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:14:01.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:00 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:01.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:00 smithi138 ceph-mon[35019]: mds.? [v2:172.21.15.138:6834/1086283757,v1:172.21.15.138:6835/1086283757] up:boot 2024-09-11T00:14:01.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:00 smithi138 ceph-mon[35019]: fsmap 6 up:standby 2024-09-11T00:14:01.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:00 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-11T00:14:01.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:00 smithi078 ceph-mon[30865]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:01.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:00 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:01.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:00 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:01.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:00 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:01.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:00 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:14:01.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:00 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:14:01.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:00 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:01.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:00 smithi078 ceph-mon[30865]: mds.? [v2:172.21.15.138:6834/1086283757,v1:172.21.15.138:6835/1086283757] up:boot 2024-09-11T00:14:01.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:00 smithi078 ceph-mon[30865]: fsmap 6 up:standby 2024-09-11T00:14:01.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:00 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-11T00:14:01.748 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:14:01.765 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 11 00:14:01 smithi138 systemd[1]: Starting Ceph mds.c for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:14:02.011 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:02.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:01 smithi138 ceph-mon[35019]: Deploying daemon mds.c on smithi138 2024-09-11T00:14:02.043 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 11 00:14:01 smithi138 podman[65916]: 2024-09-11 00:14:01.840810196 +0000 UTC m=+0.108483914 container create 5ca828deae51a50bd353053cc1ab05340e9c1243cbbc3e245d4acb842e6b3b89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:14:02.043 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 11 00:14:01 smithi138 podman[65916]: 2024-09-11 00:14:01.748283351 +0000 UTC m=+0.015957069 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:14:02.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:01 smithi078 ceph-mon[30865]: Deploying daemon mds.c on smithi138 2024-09-11T00:14:02.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:01 smithi112 ceph-mon[35627]: Deploying daemon mds.c on smithi138 2024-09-11T00:14:02.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.497+0000 7fe62d048640 1 -- 172.21.15.78:0/664032165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe628108020 msgr2=0x7fe62810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:02.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.497+0000 7fe62d048640 1 --2- 172.21.15.78:0/664032165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe628108020 0x7fe62810e820 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe620009900 tx=0x7fe62002a410 comp rx=0 tx=0).stop 2024-09-11T00:14:02.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.497+0000 7fe62d048640 1 -- 172.21.15.78:0/664032165 shutdown_connections 2024-09-11T00:14:02.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.497+0000 7fe62d048640 1 --2- 172.21.15.78:0/664032165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe628108020 0x7fe62810e820 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:02.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.497+0000 7fe62d048640 1 --2- 172.21.15.78:0/664032165 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe6281076a0 0x7fe628107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:02.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.497+0000 7fe62d048640 1 --2- 172.21.15.78:0/664032165 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe628101c90 0x7fe628102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:02.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.497+0000 7fe62d048640 1 -- 172.21.15.78:0/664032165 >> 172.21.15.78:0/664032165 conn(0x7fe6280fd6e0 msgr2=0x7fe6280ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:02.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.497+0000 7fe62d048640 1 -- 172.21.15.78:0/664032165 shutdown_connections 2024-09-11T00:14:02.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.497+0000 7fe62d048640 1 -- 172.21.15.78:0/664032165 wait complete. 2024-09-11T00:14:02.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.498+0000 7fe62d048640 1 Processor -- start 2024-09-11T00:14:02.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.498+0000 7fe62d048640 1 -- start start 2024-09-11T00:14:02.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.499+0000 7fe62d048640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe628101c90 0x7fe6280fdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:02.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.499+0000 7fe62d048640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6281076a0 0x7fe6280fe120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:02.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.499+0000 7fe62d048640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe628108020 0x7fe6280fe660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:02.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.499+0000 7fe62d048640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe628111ca0 con 0x7fe6281076a0 2024-09-11T00:14:02.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.499+0000 7fe62d048640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe628111b20 con 0x7fe628108020 2024-09-11T00:14:02.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.499+0000 7fe62d048640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe628111e20 con 0x7fe628101c90 2024-09-11T00:14:02.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.499+0000 7fe62659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6281076a0 0x7fe6280fe120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:02.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.499+0000 7fe62659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6281076a0 0x7fe6280fe120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41150/0 (socket says 172.21.15.78:41150) 2024-09-11T00:14:02.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.499+0000 7fe62659c640 1 -- 172.21.15.78:0/2520925997 learned_addr learned my addr 172.21.15.78:0/2520925997 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:02.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.499+0000 7fe62759e640 1 --2- 172.21.15.78:0/2520925997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe628108020 0x7fe6280fe660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:02.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.499+0000 7fe626d9d640 1 --2- 172.21.15.78:0/2520925997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe628101c90 0x7fe6280fdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:02.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.499+0000 7fe62659c640 1 -- 172.21.15.78:0/2520925997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe628101c90 msgr2=0x7fe6280fdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.499+0000 7fe62659c640 1 --2- 172.21.15.78:0/2520925997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe628101c90 0x7fe6280fdbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.499+0000 7fe62659c640 1 -- 172.21.15.78:0/2520925997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe628108020 msgr2=0x7fe6280fe660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.499+0000 7fe62659c640 1 --2- 172.21.15.78:0/2520925997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe628108020 0x7fe6280fe660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.499+0000 7fe62659c640 1 -- 172.21.15.78:0/2520925997 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6281a75f0 con 0x7fe6281076a0 2024-09-11T00:14:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.499+0000 7fe62659c640 1 --2- 172.21.15.78:0/2520925997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6281076a0 0x7fe6280fe120 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe61c00eb90 tx=0x7fe61c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.499+0000 7fe60ffff640 1 -- 172.21.15.78:0/2520925997 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61c004d20 con 0x7fe6281076a0 2024-09-11T00:14:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.499+0000 7fe62d048640 1 -- 172.21.15.78:0/2520925997 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6281a78e0 con 0x7fe6281076a0 2024-09-11T00:14:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.499+0000 7fe60ffff640 1 -- 172.21.15.78:0/2520925997 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe61c00ee90 con 0x7fe6281076a0 2024-09-11T00:14:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.499+0000 7fe60ffff640 1 -- 172.21.15.78:0/2520925997 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61c010670 con 0x7fe6281076a0 2024-09-11T00:14:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.499+0000 7fe62d048640 1 -- 172.21.15.78:0/2520925997 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6281a7dd0 con 0x7fe6281076a0 2024-09-11T00:14:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.500+0000 7fe62d048640 1 -- 172.21.15.78:0/2520925997 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe628102070 con 0x7fe6281076a0 2024-09-11T00:14:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.502+0000 7fe60ffff640 1 -- 172.21.15.78:0/2520925997 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fe61c010850 con 0x7fe6281076a0 2024-09-11T00:14:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.502+0000 7fe60ffff640 1 --2- 172.21.15.78:0/2520925997 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe6100b5330 0x7fe6100b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:02.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.502+0000 7fe626d9d640 1 --2- 172.21.15.78:0/2520925997 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe6100b5330 0x7fe6100b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:02.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.503+0000 7fe60ffff640 1 -- 172.21.15.78:0/2520925997 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fe61c0e6130 con 0x7fe6281076a0 2024-09-11T00:14:02.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.503+0000 7fe626d9d640 1 --2- 172.21.15.78:0/2520925997 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe6100b5330 0x7fe6100b77f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe618009aa0 tx=0x7fe618005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:02.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.505+0000 7fe60ffff640 1 -- 172.21.15.78:0/2520925997 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe61c056220 con 0x7fe6281076a0 2024-09-11T00:14:02.543 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 11 00:14:02 smithi138 podman[65916]: 2024-09-11 00:14:02.110408984 +0000 UTC m=+0.378082701 container init 5ca828deae51a50bd353053cc1ab05340e9c1243cbbc3e245d4acb842e6b3b89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-c, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-11T00:14:02.543 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 11 00:14:02 smithi138 podman[65916]: 2024-09-11 00:14:02.113301553 +0000 UTC m=+0.380975280 container start 5ca828deae51a50bd353053cc1ab05340e9c1243cbbc3e245d4acb842e6b3b89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-11T00:14:02.543 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 11 00:14:02 smithi138 ceph-mds[65936]: -- 172.21.15.138:0/2989094621 <== mon.1 v2:172.21.15.138:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b2d64cfc20 con 0x55b2d64ac800 2024-09-11T00:14:02.543 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 11 00:14:02 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-c[65932]: starting mds.c at 2024-09-11T00:14:02.543 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 11 00:14:02 smithi138 bash[65916]: 5ca828deae51a50bd353053cc1ab05340e9c1243cbbc3e245d4acb842e6b3b89 2024-09-11T00:14:02.543 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 11 00:14:02 smithi138 systemd[1]: Started Ceph mds.c for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:14:02.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.716+0000 7fe62d048640 1 -- 172.21.15.78:0/2520925997 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe62802e5c0 con 0x7fe6281076a0 2024-09-11T00:14:02.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.717+0000 7fe60ffff640 1 -- 172.21.15.78:0/2520925997 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5569 (secure 0 0 0) 0x7fe61c0ad3c0 con 0x7fe6281076a0 2024-09-11T00:14:02.720 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:14:02.720 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":7,"btime":"2024-09-11T00:14:00:192635+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-11T00:14:02.720 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 7 2024-09-11T00:14:02.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.719+0000 7fe62d048640 1 -- 172.21.15.78:0/2520925997 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe6100b5330 msgr2=0x7fe6100b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:02.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.719+0000 7fe62d048640 1 --2- 172.21.15.78:0/2520925997 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe6100b5330 0x7fe6100b77f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe618009aa0 tx=0x7fe618005f90 comp rx=0 tx=0).stop 2024-09-11T00:14:02.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.719+0000 7fe62d048640 1 -- 172.21.15.78:0/2520925997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6281076a0 msgr2=0x7fe6280fe120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:02.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.719+0000 7fe62d048640 1 --2- 172.21.15.78:0/2520925997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6281076a0 0x7fe6280fe120 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe61c00eb90 tx=0x7fe61c00c6a0 comp rx=0 tx=0).stop 2024-09-11T00:14:02.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.719+0000 7fe62d048640 1 -- 172.21.15.78:0/2520925997 shutdown_connections 2024-09-11T00:14:02.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.719+0000 7fe62d048640 1 --2- 172.21.15.78:0/2520925997 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe6100b5330 0x7fe6100b77f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:02.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.720+0000 7fe62d048640 1 --2- 172.21.15.78:0/2520925997 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe628108020 0x7fe6280fe660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:02.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.720+0000 7fe62d048640 1 --2- 172.21.15.78:0/2520925997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6281076a0 0x7fe6280fe120 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:02.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.720+0000 7fe62d048640 1 --2- 172.21.15.78:0/2520925997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe628101c90 0x7fe6280fdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:02.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.720+0000 7fe62d048640 1 -- 172.21.15.78:0/2520925997 >> 172.21.15.78:0/2520925997 conn(0x7fe6280fd6e0 msgr2=0x7fe62806b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:02.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.720+0000 7fe62d048640 1 -- 172.21.15.78:0/2520925997 shutdown_connections 2024-09-11T00:14:02.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:02.720+0000 7fe62d048640 1 -- 172.21.15.78:0/2520925997 wait complete. 2024-09-11T00:14:02.948 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:02 smithi112 ceph-mon[35627]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:02.948 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:02 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:02.948 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:02 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:02.948 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:02 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:02.948 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:02 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:14:02.948 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:02 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:14:02.948 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:02 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:02.948 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:02 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2520925997' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:14:03.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:02 smithi138 ceph-mon[35019]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:03.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:02 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:03.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:02 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:03.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:02 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:03.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:02 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:14:03.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:02 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:14:03.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:02 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:03.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:02 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2520925997' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:14:03.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:02 smithi078 ceph-mon[30865]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:03.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:02 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:03.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:02 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:03.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:02 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:03.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:02 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:14:03.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:02 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:14:03.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:02 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:03.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:02 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2520925997' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:14:03.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:03 smithi112 ceph-mon[35627]: Deploying daemon mds.h on smithi112 2024-09-11T00:14:03.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:03 smithi112 ceph-mon[35627]: mds.? [v2:172.21.15.138:6836/3566830955,v1:172.21.15.138:6837/3566830955] up:boot 2024-09-11T00:14:03.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:03 smithi112 ceph-mon[35627]: fsmap 7 up:standby 2024-09-11T00:14:03.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:03 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-11T00:14:04.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:03 smithi138 ceph-mon[35019]: Deploying daemon mds.h on smithi112 2024-09-11T00:14:04.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:03 smithi138 ceph-mon[35019]: mds.? [v2:172.21.15.138:6836/3566830955,v1:172.21.15.138:6837/3566830955] up:boot 2024-09-11T00:14:04.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:03 smithi138 ceph-mon[35019]: fsmap 7 up:standby 2024-09-11T00:14:04.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:03 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-11T00:14:04.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:03 smithi078 ceph-mon[30865]: Deploying daemon mds.h on smithi112 2024-09-11T00:14:04.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:03 smithi078 ceph-mon[30865]: mds.? [v2:172.21.15.138:6836/3566830955,v1:172.21.15.138:6837/3566830955] up:boot 2024-09-11T00:14:04.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:03 smithi078 ceph-mon[30865]: fsmap 7 up:standby 2024-09-11T00:14:04.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:03 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-11T00:14:04.482 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 11 00:14:04 smithi112 systemd[1]: Starting Ceph mds.h for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:14:04.767 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 11 00:14:04 smithi112 podman[66901]: 2024-09-11 00:14:04.403191155 +0000 UTC m=+0.015542732 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:14:04.767 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 11 00:14:04 smithi112 podman[66901]: 2024-09-11 00:14:04.521892435 +0000 UTC m=+0.134244004 container create 24fe572bdc9fa2081cdde2383293b34ed6daf84f0924166085900407b7db84a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-11T00:14:04.767 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 11 00:14:04 smithi112 podman[66901]: 2024-09-11 00:14:04.766344767 +0000 UTC m=+0.378696337 container init 24fe572bdc9fa2081cdde2383293b34ed6daf84f0924166085900407b7db84a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-h, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True) 2024-09-11T00:14:05.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:04 smithi138 ceph-mon[35019]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:05.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:04 smithi078 ceph-mon[30865]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:05.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:04 smithi112 ceph-mon[35627]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:05.232 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 11 00:14:04 smithi112 podman[66901]: 2024-09-11 00:14:04.76959989 +0000 UTC m=+0.381951467 container start 24fe572bdc9fa2081cdde2383293b34ed6daf84f0924166085900407b7db84a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-h, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-11T00:14:05.232 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 11 00:14:04 smithi112 ceph-mds[66921]: -- 172.21.15.112:0/759839078 <== mon.2 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ff83127860 con 0x55ff83105000 2024-09-11T00:14:05.232 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 11 00:14:04 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-h[66917]: starting mds.h at 2024-09-11T00:14:05.232 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 11 00:14:04 smithi112 bash[66901]: 24fe572bdc9fa2081cdde2383293b34ed6daf84f0924166085900407b7db84a6 2024-09-11T00:14:05.232 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 11 00:14:04 smithi112 systemd[1]: Started Ceph mds.h for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:14:05.371 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:14:05.634 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:06.037 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:05 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:06.037 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:05 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:06.037 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:05 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:06.037 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:05 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:14:06.037 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:05 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:14:06.038 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:05 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:06.038 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:05 smithi078 ceph-mon[30865]: Deploying daemon mds.i on smithi138 2024-09-11T00:14:06.038 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:05 smithi078 ceph-mon[30865]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:06.038 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:05 smithi078 ceph-mon[30865]: mds.? [v2:172.21.15.112:6836/3784369511,v1:172.21.15.112:6837/3784369511] up:boot 2024-09-11T00:14:06.038 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:05 smithi078 ceph-mon[30865]: fsmap 8 up:standby 2024-09-11T00:14:06.038 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:05 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-11T00:14:06.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.116+0000 7f274167e640 1 -- 172.21.15.78:0/3758554284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f273c1076e0 msgr2=0x7f273c107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:06.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.116+0000 7f274167e640 1 --2- 172.21.15.78:0/3758554284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f273c1076e0 0x7f273c107b20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2724009900 tx=0x7f272402a410 comp rx=0 tx=0).stop 2024-09-11T00:14:06.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.116+0000 7f274167e640 1 -- 172.21.15.78:0/3758554284 shutdown_connections 2024-09-11T00:14:06.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.116+0000 7f274167e640 1 --2- 172.21.15.78:0/3758554284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f273c108060 0x7f273c10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:06.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.116+0000 7f274167e640 1 --2- 172.21.15.78:0/3758554284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f273c1076e0 0x7f273c107b20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:06.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.116+0000 7f274167e640 1 --2- 172.21.15.78:0/3758554284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f273c101cd0 0x7f273c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:06.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.116+0000 7f274167e640 1 -- 172.21.15.78:0/3758554284 >> 172.21.15.78:0/3758554284 conn(0x7f273c0fd700 msgr2=0x7f273c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:06.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.116+0000 7f274167e640 1 -- 172.21.15.78:0/3758554284 shutdown_connections 2024-09-11T00:14:06.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.116+0000 7f274167e640 1 -- 172.21.15.78:0/3758554284 wait complete. 2024-09-11T00:14:06.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.117+0000 7f274167e640 1 Processor -- start 2024-09-11T00:14:06.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.117+0000 7f274167e640 1 -- start start 2024-09-11T00:14:06.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.117+0000 7f274167e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f273c101cd0 0x7f273c19a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:06.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.117+0000 7f274167e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f273c1076e0 0x7f273c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:06.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.117+0000 7f274167e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f273c108060 0x7f273c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:06.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.117+0000 7f274167e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f273c111d20 con 0x7f273c101cd0 2024-09-11T00:14:06.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.117+0000 7f274167e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f273c111ba0 con 0x7f273c108060 2024-09-11T00:14:06.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.117+0000 7f274167e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f273c111ea0 con 0x7f273c1076e0 2024-09-11T00:14:06.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.117+0000 7f273affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f273c101cd0 0x7f273c19a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:06.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.117+0000 7f273affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f273c101cd0 0x7f273c19a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46048/0 (socket says 172.21.15.78:46048) 2024-09-11T00:14:06.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.117+0000 7f273affd640 1 -- 172.21.15.78:0/900407155 learned_addr learned my addr 172.21.15.78:0/900407155 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:06.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.117+0000 7f2733fff640 1 --2- 172.21.15.78:0/900407155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f273c1076e0 0x7f273c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:06.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.117+0000 7f273b7fe640 1 --2- 172.21.15.78:0/900407155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f273c108060 0x7f273c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:06.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.117+0000 7f273affd640 1 -- 172.21.15.78:0/900407155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f273c1076e0 msgr2=0x7f273c19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:06.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.117+0000 7f273affd640 1 --2- 172.21.15.78:0/900407155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f273c1076e0 0x7f273c19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:06.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.117+0000 7f273affd640 1 -- 172.21.15.78:0/900407155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f273c108060 msgr2=0x7f273c19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:06.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.117+0000 7f273affd640 1 --2- 172.21.15.78:0/900407155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f273c108060 0x7f273c19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:06.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.117+0000 7f273affd640 1 -- 172.21.15.78:0/900407155 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273c1a54f0 con 0x7f273c101cd0 2024-09-11T00:14:06.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.117+0000 7f273b7fe640 1 --2- 172.21.15.78:0/900407155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f273c108060 0x7f273c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:06.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.117+0000 7f273affd640 1 --2- 172.21.15.78:0/900407155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f273c101cd0 0x7f273c19a110 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f272c00d770 tx=0x7f272c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:06.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.118+0000 7f2738ff9640 1 -- 172.21.15.78:0/900407155 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c017070 con 0x7f273c101cd0 2024-09-11T00:14:06.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.118+0000 7f2738ff9640 1 -- 172.21.15.78:0/900407155 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f272c0054d0 con 0x7f273c101cd0 2024-09-11T00:14:06.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.118+0000 7f2738ff9640 1 -- 172.21.15.78:0/900407155 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c004c30 con 0x7f273c101cd0 2024-09-11T00:14:06.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.118+0000 7f274167e640 1 -- 172.21.15.78:0/900407155 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f273c1a57e0 con 0x7f273c101cd0 2024-09-11T00:14:06.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.118+0000 7f274167e640 1 -- 172.21.15.78:0/900407155 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f273c1a5d20 con 0x7f273c101cd0 2024-09-11T00:14:06.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.119+0000 7f274167e640 1 -- 172.21.15.78:0/900407155 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f273c1020b0 con 0x7f273c101cd0 2024-09-11T00:14:06.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.120+0000 7f2738ff9640 1 -- 172.21.15.78:0/900407155 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f272c004dd0 con 0x7f273c101cd0 2024-09-11T00:14:06.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.121+0000 7f2738ff9640 1 --2- 172.21.15.78:0/900407155 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f27280b5330 0x7f27280b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:06.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.121+0000 7f2733fff640 1 --2- 172.21.15.78:0/900407155 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f27280b5330 0x7f27280b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:06.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.121+0000 7f2738ff9640 1 -- 172.21.15.78:0/900407155 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f272c0e5740 con 0x7f273c101cd0 2024-09-11T00:14:06.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.121+0000 7f2733fff640 1 --2- 172.21.15.78:0/900407155 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f27280b5330 0x7f27280b77f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2724031440 tx=0x7f2724005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:06.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.124+0000 7f2738ff9640 1 -- 172.21.15.78:0/900407155 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f272c0ac9d0 con 0x7f273c101cd0 2024-09-11T00:14:06.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:05 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:06.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:05 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:06.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:05 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:06.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:05 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:14:06.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:05 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:14:06.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:05 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:06.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:05 smithi112 ceph-mon[35627]: Deploying daemon mds.i on smithi138 2024-09-11T00:14:06.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:05 smithi112 ceph-mon[35627]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:06.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:05 smithi112 ceph-mon[35627]: mds.? [v2:172.21.15.112:6836/3784369511,v1:172.21.15.112:6837/3784369511] up:boot 2024-09-11T00:14:06.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:05 smithi112 ceph-mon[35627]: fsmap 8 up:standby 2024-09-11T00:14:06.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:05 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-11T00:14:06.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:05 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:06.296 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:05 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:06.296 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:05 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:06.296 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:05 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:14:06.296 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:05 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:14:06.296 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:05 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:06.297 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:05 smithi138 ceph-mon[35019]: Deploying daemon mds.i on smithi138 2024-09-11T00:14:06.297 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:05 smithi138 ceph-mon[35019]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:06.297 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:05 smithi138 ceph-mon[35019]: mds.? [v2:172.21.15.112:6836/3784369511,v1:172.21.15.112:6837/3784369511] up:boot 2024-09-11T00:14:06.297 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:05 smithi138 ceph-mon[35019]: fsmap 8 up:standby 2024-09-11T00:14:06.297 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:05 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-11T00:14:06.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.336+0000 7f274167e640 1 -- 172.21.15.78:0/900407155 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f273c02e5c0 con 0x7f273c101cd0 2024-09-11T00:14:06.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.336+0000 7f2738ff9640 1 -- 172.21.15.78:0/900407155 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7225 (secure 0 0 0) 0x7f272c0ac2d0 con 0x7f273c101cd0 2024-09-11T00:14:06.338 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:14:06.339 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"btime":"2024-09-11T00:14:05:767440+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-11T00:14:06.339 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2024-09-11T00:14:06.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.339+0000 7f274167e640 1 -- 172.21.15.78:0/900407155 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f27280b5330 msgr2=0x7f27280b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:06.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.339+0000 7f274167e640 1 --2- 172.21.15.78:0/900407155 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f27280b5330 0x7f27280b77f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2724031440 tx=0x7f2724005b50 comp rx=0 tx=0).stop 2024-09-11T00:14:06.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.339+0000 7f274167e640 1 -- 172.21.15.78:0/900407155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f273c101cd0 msgr2=0x7f273c19a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:06.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.339+0000 7f274167e640 1 --2- 172.21.15.78:0/900407155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f273c101cd0 0x7f273c19a110 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f272c00d770 tx=0x7f272c00dc30 comp rx=0 tx=0).stop 2024-09-11T00:14:06.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.339+0000 7f274167e640 1 -- 172.21.15.78:0/900407155 shutdown_connections 2024-09-11T00:14:06.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.339+0000 7f274167e640 1 --2- 172.21.15.78:0/900407155 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f27280b5330 0x7f27280b77f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:06.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.339+0000 7f274167e640 1 --2- 172.21.15.78:0/900407155 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f273c108060 0x7f273c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:06.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.339+0000 7f274167e640 1 --2- 172.21.15.78:0/900407155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f273c1076e0 0x7f273c19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:06.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.339+0000 7f274167e640 1 --2- 172.21.15.78:0/900407155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f273c101cd0 0x7f273c19a110 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:06.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.339+0000 7f274167e640 1 -- 172.21.15.78:0/900407155 >> 172.21.15.78:0/900407155 conn(0x7f273c0fd700 msgr2=0x7f273c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:06.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.339+0000 7f274167e640 1 -- 172.21.15.78:0/900407155 shutdown_connections 2024-09-11T00:14:06.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:06.339+0000 7f274167e640 1 -- 172.21.15.78:0/900407155 wait complete. 2024-09-11T00:14:06.949 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:14:06 smithi138 systemd[1]: Starting Ceph mds.i for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:14:07.051 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:06 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/900407155' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:14:07.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:06 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/900407155' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:14:07.253 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:06 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/900407155' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:14:07.253 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:14:07 smithi138 podman[66220]: 2024-09-11 00:14:06.99165953 +0000 UTC m=+0.015972406 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:14:07.253 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:14:07 smithi138 podman[66220]: 2024-09-11 00:14:07.125536266 +0000 UTC m=+0.149849139 container create 60be5793b80ff311ccd03fe0e26963ee2167111453d5ba82d3fd87c9a43c1bad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-i, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-09-11T00:14:07.543 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:14:07 smithi138 podman[66220]: 2024-09-11 00:14:07.373384549 +0000 UTC m=+0.397697412 container init 60be5793b80ff311ccd03fe0e26963ee2167111453d5ba82d3fd87c9a43c1bad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-i, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:14:07.543 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:14:07 smithi138 podman[66220]: 2024-09-11 00:14:07.376174421 +0000 UTC m=+0.400487286 container start 60be5793b80ff311ccd03fe0e26963ee2167111453d5ba82d3fd87c9a43c1bad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-i, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-11T00:14:07.543 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:14:07 smithi138 ceph-mds[66240]: -- 172.21.15.138:0/3980297620 <== mon.1 v2:172.21.15.138:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c23dce9860 con 0x55c23dcc6800 2024-09-11T00:14:07.543 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:14:07 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-i[66236]: starting mds.i at 2024-09-11T00:14:07.543 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:14:07 smithi138 bash[66220]: 60be5793b80ff311ccd03fe0e26963ee2167111453d5ba82d3fd87c9a43c1bad 2024-09-11T00:14:07.543 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:14:07 smithi138 systemd[1]: Started Ceph mds.i for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:14:08.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:08 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:08.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:08 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:08.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:08 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:08.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:08 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:14:08.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:08 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:14:08.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:08 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:08.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:08 smithi138 ceph-mon[35019]: Deploying daemon mds.g on smithi078 2024-09-11T00:14:08.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:08 smithi138 ceph-mon[35019]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:08.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:08 smithi138 ceph-mon[35019]: mds.? [v2:172.21.15.138:6838/1175492512,v1:172.21.15.138:6839/1175492512] up:boot 2024-09-11T00:14:08.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:08 smithi138 ceph-mon[35019]: fsmap 9 up:standby 2024-09-11T00:14:08.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:08 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-11T00:14:08.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:08 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:08.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:08 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:08.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:08 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:08.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:08 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:14:08.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:08 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:14:08.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:08 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:08.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:08 smithi078 ceph-mon[30865]: Deploying daemon mds.g on smithi078 2024-09-11T00:14:08.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:08 smithi078 ceph-mon[30865]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:08.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:08 smithi078 ceph-mon[30865]: mds.? [v2:172.21.15.138:6838/1175492512,v1:172.21.15.138:6839/1175492512] up:boot 2024-09-11T00:14:08.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:08 smithi078 ceph-mon[30865]: fsmap 9 up:standby 2024-09-11T00:14:08.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:08 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-11T00:14:08.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:08 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:08.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:08 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:08.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:08 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:08.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:08 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:14:08.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:08 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:14:08.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:08 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:08.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:08 smithi112 ceph-mon[35627]: Deploying daemon mds.g on smithi078 2024-09-11T00:14:08.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:08 smithi112 ceph-mon[35627]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:08.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:08 smithi112 ceph-mon[35627]: mds.? [v2:172.21.15.138:6838/1175492512,v1:172.21.15.138:6839/1175492512] up:boot 2024-09-11T00:14:08.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:08 smithi112 ceph-mon[35627]: fsmap 9 up:standby 2024-09-11T00:14:08.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:08 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-11T00:14:09.053 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:14:09.484 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:09.584 INFO:journalctl@ceph.mds.g.smithi078.stdout:Sep 11 00:14:09 smithi078 systemd[1]: Starting Ceph mds.g for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:14:10.213 INFO:journalctl@ceph.mds.g.smithi078.stdout:Sep 11 00:14:09 smithi078 podman[75862]: 2024-09-11 00:14:09.787929161 +0000 UTC m=+0.018920801 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:14:10.213 INFO:journalctl@ceph.mds.g.smithi078.stdout:Sep 11 00:14:09 smithi078 podman[75862]: 2024-09-11 00:14:09.894063395 +0000 UTC m=+0.125055085 container create fe509132061ebf57987344c459f085ba766341be11213a4af4f9b3c02c680086 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-g, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:14:10.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.210+0000 7f92e27cc640 1 -- 172.21.15.78:0/4097745339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92dc101c90 msgr2=0x7f92dc102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:10.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.210+0000 7f92e27cc640 1 --2- 172.21.15.78:0/4097745339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92dc101c90 0x7f92dc102070 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f92cc009900 tx=0x7f92cc02a410 comp rx=0 tx=0).stop 2024-09-11T00:14:10.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.210+0000 7f92e27cc640 1 -- 172.21.15.78:0/4097745339 shutdown_connections 2024-09-11T00:14:10.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.210+0000 7f92e27cc640 1 --2- 172.21.15.78:0/4097745339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92dc108020 0x7f92dc10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:10.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.210+0000 7f92e27cc640 1 --2- 172.21.15.78:0/4097745339 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92dc1076a0 0x7f92dc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:10.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.210+0000 7f92e27cc640 1 --2- 172.21.15.78:0/4097745339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92dc101c90 0x7f92dc102070 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:10.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.210+0000 7f92e27cc640 1 -- 172.21.15.78:0/4097745339 >> 172.21.15.78:0/4097745339 conn(0x7f92dc0fd6e0 msgr2=0x7f92dc0ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:10.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.210+0000 7f92e27cc640 1 -- 172.21.15.78:0/4097745339 shutdown_connections 2024-09-11T00:14:10.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.210+0000 7f92e27cc640 1 -- 172.21.15.78:0/4097745339 wait complete. 2024-09-11T00:14:10.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.211+0000 7f92e27cc640 1 Processor -- start 2024-09-11T00:14:10.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.211+0000 7f92e27cc640 1 -- start start 2024-09-11T00:14:10.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.211+0000 7f92e27cc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92dc101c90 0x7f92dc19a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:10.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.211+0000 7f92e27cc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92dc1076a0 0x7f92dc19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:10.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.211+0000 7f92e27cc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92dc108020 0x7f92dc1a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:10.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.211+0000 7f92e27cc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f92dc111ce0 con 0x7f92dc101c90 2024-09-11T00:14:10.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.211+0000 7f92e27cc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f92dc111b60 con 0x7f92dc1076a0 2024-09-11T00:14:10.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.211+0000 7f92e27cc640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f92dc111e60 con 0x7f92dc108020 2024-09-11T00:14:10.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.212+0000 7f92e0d69640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92dc108020 0x7f92dc1a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:10.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.212+0000 7f92dbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92dc101c90 0x7f92dc19a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:10.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.212+0000 7f92e0d69640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92dc108020 0x7f92dc1a5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.78:47246/0 (socket says 172.21.15.78:47246) 2024-09-11T00:14:10.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.212+0000 7f92e0d69640 1 -- 172.21.15.78:0/222153062 learned_addr learned my addr 172.21.15.78:0/222153062 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:10.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.212+0000 7f92d3fff640 1 --2- 172.21.15.78:0/222153062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92dc1076a0 0x7f92dc19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:10.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.212+0000 7f92e0d69640 1 -- 172.21.15.78:0/222153062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92dc1076a0 msgr2=0x7f92dc19a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:10.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.212+0000 7f92e0d69640 1 --2- 172.21.15.78:0/222153062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92dc1076a0 0x7f92dc19a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:10.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.212+0000 7f92e0d69640 1 -- 172.21.15.78:0/222153062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92dc101c90 msgr2=0x7f92dc19a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:10.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.212+0000 7f92e0d69640 1 --2- 172.21.15.78:0/222153062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92dc101c90 0x7f92dc19a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:10.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.212+0000 7f92e0d69640 1 -- 172.21.15.78:0/222153062 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92dc1a55d0 con 0x7f92dc108020 2024-09-11T00:14:10.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.212+0000 7f92d3fff640 1 --2- 172.21.15.78:0/222153062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92dc1076a0 0x7f92dc19a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:10.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.212+0000 7f92e0d69640 1 --2- 172.21.15.78:0/222153062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92dc108020 0x7f92dc1a5090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92d400eaa0 tx=0x7f92d400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:10.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.212+0000 7f92d9ffb640 1 -- 172.21.15.78:0/222153062 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d400cdb0 con 0x7f92dc108020 2024-09-11T00:14:10.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.212+0000 7f92e27cc640 1 -- 172.21.15.78:0/222153062 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92dc197e00 con 0x7f92dc108020 2024-09-11T00:14:10.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.212+0000 7f92d9ffb640 1 -- 172.21.15.78:0/222153062 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92d4005020 con 0x7f92dc108020 2024-09-11T00:14:10.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.212+0000 7f92d9ffb640 1 -- 172.21.15.78:0/222153062 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d40116d0 con 0x7f92dc108020 2024-09-11T00:14:10.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.212+0000 7f92e27cc640 1 -- 172.21.15.78:0/222153062 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92dc198340 con 0x7f92dc108020 2024-09-11T00:14:10.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.213+0000 7f92e27cc640 1 -- 172.21.15.78:0/222153062 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92dc102070 con 0x7f92dc108020 2024-09-11T00:14:10.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.215+0000 7f92d9ffb640 1 -- 172.21.15.78:0/222153062 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f92d400f040 con 0x7f92dc108020 2024-09-11T00:14:10.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.215+0000 7f92d9ffb640 1 --2- 172.21.15.78:0/222153062 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f92c80b5330 0x7f92c80b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:10.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.215+0000 7f92dbfff640 1 --2- 172.21.15.78:0/222153062 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f92c80b5330 0x7f92c80b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:10.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.215+0000 7f92d9ffb640 1 -- 172.21.15.78:0/222153062 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f92d40e5750 con 0x7f92dc108020 2024-09-11T00:14:10.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.216+0000 7f92dbfff640 1 --2- 172.21.15.78:0/222153062 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f92c80b5330 0x7f92c80b77f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f92cc031440 tx=0x7f92cc03c040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:10.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.218+0000 7f92d9ffb640 1 -- 172.21.15.78:0/222153062 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f92d4016030 con 0x7f92dc108020 2024-09-11T00:14:10.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.433+0000 7f92e27cc640 1 -- 172.21.15.78:0/222153062 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92dc06b920 con 0x7f92dc108020 2024-09-11T00:14:10.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.433+0000 7f92d9ffb640 1 -- 172.21.15.78:0/222153062 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8055 (secure 0 0 0) 0x7f92dc06b920 con 0x7f92dc108020 2024-09-11T00:14:10.435 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:14:10.435 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":10,"btime":"2024-09-11T00:14:07:947497+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24589,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-11T00:14:10.436 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 10 2024-09-11T00:14:10.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.435+0000 7f92e27cc640 1 -- 172.21.15.78:0/222153062 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f92c80b5330 msgr2=0x7f92c80b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:10.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.435+0000 7f92e27cc640 1 --2- 172.21.15.78:0/222153062 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f92c80b5330 0x7f92c80b77f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f92cc031440 tx=0x7f92cc03c040 comp rx=0 tx=0).stop 2024-09-11T00:14:10.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.435+0000 7f92e27cc640 1 -- 172.21.15.78:0/222153062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92dc108020 msgr2=0x7f92dc1a5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:10.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.435+0000 7f92e27cc640 1 --2- 172.21.15.78:0/222153062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92dc108020 0x7f92dc1a5090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92d400eaa0 tx=0x7f92d400ef60 comp rx=0 tx=0).stop 2024-09-11T00:14:10.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.436+0000 7f92e27cc640 1 -- 172.21.15.78:0/222153062 shutdown_connections 2024-09-11T00:14:10.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.436+0000 7f92e27cc640 1 --2- 172.21.15.78:0/222153062 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f92c80b5330 0x7f92c80b77f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:10.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.436+0000 7f92e27cc640 1 --2- 172.21.15.78:0/222153062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92dc108020 0x7f92dc1a5090 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:10.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.436+0000 7f92e27cc640 1 --2- 172.21.15.78:0/222153062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f92dc1076a0 0x7f92dc19a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:10.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.436+0000 7f92e27cc640 1 --2- 172.21.15.78:0/222153062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92dc101c90 0x7f92dc19a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:10.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.436+0000 7f92e27cc640 1 -- 172.21.15.78:0/222153062 >> 172.21.15.78:0/222153062 conn(0x7f92dc0fd6e0 msgr2=0x7f92dc0ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:10.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.436+0000 7f92e27cc640 1 -- 172.21.15.78:0/222153062 shutdown_connections 2024-09-11T00:14:10.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:10.436+0000 7f92e27cc640 1 -- 172.21.15.78:0/222153062 wait complete. 2024-09-11T00:14:10.465 INFO:journalctl@ceph.mds.g.smithi078.stdout:Sep 11 00:14:10 smithi078 podman[75862]: 2024-09-11 00:14:10.347625638 +0000 UTC m=+0.578617264 container init fe509132061ebf57987344c459f085ba766341be11213a4af4f9b3c02c680086 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-g, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:14:10.465 INFO:journalctl@ceph.mds.g.smithi078.stdout:Sep 11 00:14:10 smithi078 podman[75862]: 2024-09-11 00:14:10.350548148 +0000 UTC m=+0.581539773 container start fe509132061ebf57987344c459f085ba766341be11213a4af4f9b3c02c680086 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-g, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-11T00:14:10.465 INFO:journalctl@ceph.mds.g.smithi078.stdout:Sep 11 00:14:10 smithi078 ceph-mds[75902]: -- 172.21.15.78:0/4282534934 <== mon.0 v2:172.21.15.78:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ad0e77d860 con 0x55ad0e75b400 2024-09-11T00:14:10.465 INFO:journalctl@ceph.mds.g.smithi078.stdout:Sep 11 00:14:10 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-g[75877]: starting mds.g at 2024-09-11T00:14:10.466 INFO:journalctl@ceph.mds.g.smithi078.stdout:Sep 11 00:14:10 smithi078 bash[75862]: fe509132061ebf57987344c459f085ba766341be11213a4af4f9b3c02c680086 2024-09-11T00:14:10.466 INFO:journalctl@ceph.mds.g.smithi078.stdout:Sep 11 00:14:10 smithi078 systemd[1]: Started Ceph mds.g for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:14:10.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:10 smithi112 ceph-mon[35627]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:10.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:10 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/222153062' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:14:10.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:10 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:10.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:10 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:10.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:10 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:10.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:10 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:14:10.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:10 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:14:10.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:10 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:11.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:10 smithi138 ceph-mon[35019]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:11.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:10 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/222153062' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:14:11.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:10 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:11.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:10 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:11.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:10 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:11.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:10 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:14:11.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:10 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:14:11.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:10 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:11.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:10 smithi078 ceph-mon[30865]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:11.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:10 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/222153062' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:14:11.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:10 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:11.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:10 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:11.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:10 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:11.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:10 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:14:11.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:10 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:14:11.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:10 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:11.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:11 smithi112 ceph-mon[35627]: Deploying daemon mds.a on smithi078 2024-09-11T00:14:11.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:11 smithi112 ceph-mon[35627]: mds.? [v2:172.21.15.78:6838/2754095227,v1:172.21.15.78:6839/2754095227] up:boot 2024-09-11T00:14:11.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:11 smithi112 ceph-mon[35627]: fsmap 10 up:standby 2024-09-11T00:14:11.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:11 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-11T00:14:12.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:11 smithi138 ceph-mon[35019]: Deploying daemon mds.a on smithi078 2024-09-11T00:14:12.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:11 smithi138 ceph-mon[35019]: mds.? [v2:172.21.15.78:6838/2754095227,v1:172.21.15.78:6839/2754095227] up:boot 2024-09-11T00:14:12.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:11 smithi138 ceph-mon[35019]: fsmap 10 up:standby 2024-09-11T00:14:12.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:11 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-11T00:14:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:11 smithi078 ceph-mon[30865]: Deploying daemon mds.a on smithi078 2024-09-11T00:14:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:11 smithi078 ceph-mon[30865]: mds.? [v2:172.21.15.78:6838/2754095227,v1:172.21.15.78:6839/2754095227] up:boot 2024-09-11T00:14:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:11 smithi078 ceph-mon[30865]: fsmap 10 up:standby 2024-09-11T00:14:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:11 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-11T00:14:12.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:12 smithi112 ceph-mon[35627]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:13.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:12 smithi138 ceph-mon[35019]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:13.074 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:12 smithi078 ceph-mon[30865]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:13.074 INFO:journalctl@ceph.mds.a.smithi078.stdout:Sep 11 00:14:12 smithi078 systemd[1]: Starting Ceph mds.a for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:14:13.156 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:14:13.334 INFO:journalctl@ceph.mds.a.smithi078.stdout:Sep 11 00:14:13 smithi078 podman[76197]: 2024-09-11 00:14:12.975223719 +0000 UTC m=+0.015595491 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:14:13.334 INFO:journalctl@ceph.mds.a.smithi078.stdout:Sep 11 00:14:13 smithi078 podman[76197]: 2024-09-11 00:14:13.095443613 +0000 UTC m=+0.135815414 container create 648cf2d995e69f49029f1b12c89dcfa3cecc0903675855b8a76975a1c4b200c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:14:13.536 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:13.657 INFO:journalctl@ceph.mds.a.smithi078.stdout:Sep 11 00:14:13 smithi078 podman[76197]: 2024-09-11 00:14:13.339594981 +0000 UTC m=+0.379966741 container init 648cf2d995e69f49029f1b12c89dcfa3cecc0903675855b8a76975a1c4b200c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True) 2024-09-11T00:14:13.658 INFO:journalctl@ceph.mds.a.smithi078.stdout:Sep 11 00:14:13 smithi078 podman[76197]: 2024-09-11 00:14:13.343530122 +0000 UTC m=+0.383901886 container start 648cf2d995e69f49029f1b12c89dcfa3cecc0903675855b8a76975a1c4b200c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-11T00:14:13.658 INFO:journalctl@ceph.mds.a.smithi078.stdout:Sep 11 00:14:13 smithi078 ceph-mds[76241]: -- 172.21.15.78:0/951826051 <== mon.0 v2:172.21.15.78:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556352bf3860 con 0x556352bd1000 2024-09-11T00:14:13.658 INFO:journalctl@ceph.mds.a.smithi078.stdout:Sep 11 00:14:13 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-a[76230]: starting mds.a at 2024-09-11T00:14:13.658 INFO:journalctl@ceph.mds.a.smithi078.stdout:Sep 11 00:14:13 smithi078 bash[76197]: 648cf2d995e69f49029f1b12c89dcfa3cecc0903675855b8a76975a1c4b200c6 2024-09-11T00:14:13.658 INFO:journalctl@ceph.mds.a.smithi078.stdout:Sep 11 00:14:13 smithi078 systemd[1]: Started Ceph mds.a for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:14:14.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.047+0000 7f5c3ce34640 1 -- 172.21.15.78:0/1732530070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c38101ca0 msgr2=0x7f5c38102080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:14.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.047+0000 7f5c3ce34640 1 --2- 172.21.15.78:0/1732530070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c38101ca0 0x7f5c38102080 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5c28009900 tx=0x7f5c2802a410 comp rx=0 tx=0).stop 2024-09-11T00:14:14.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.047+0000 7f5c3ce34640 1 -- 172.21.15.78:0/1732530070 shutdown_connections 2024-09-11T00:14:14.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.047+0000 7f5c3ce34640 1 --2- 172.21.15.78:0/1732530070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c38108030 0x7f5c3810e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:14.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.047+0000 7f5c3ce34640 1 --2- 172.21.15.78:0/1732530070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c381076b0 0x7f5c38107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:14.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.048+0000 7f5c3ce34640 1 --2- 172.21.15.78:0/1732530070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c38101ca0 0x7f5c38102080 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:14.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.048+0000 7f5c3ce34640 1 -- 172.21.15.78:0/1732530070 >> 172.21.15.78:0/1732530070 conn(0x7f5c380fd6d0 msgr2=0x7f5c380ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:14.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.048+0000 7f5c3ce34640 1 -- 172.21.15.78:0/1732530070 shutdown_connections 2024-09-11T00:14:14.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.048+0000 7f5c3ce34640 1 -- 172.21.15.78:0/1732530070 wait complete. 2024-09-11T00:14:14.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.048+0000 7f5c3ce34640 1 Processor -- start 2024-09-11T00:14:14.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.048+0000 7f5c3ce34640 1 -- start start 2024-09-11T00:14:14.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.049+0000 7f5c3ce34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c38101ca0 0x7f5c38198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:14.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.049+0000 7f5c3ce34640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c381076b0 0x7f5c38198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:14.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.049+0000 7f5c3ce34640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c38108030 0x7f5c3819da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:14.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.049+0000 7f5c3ce34640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5c38111cb0 con 0x7f5c38108030 2024-09-11T00:14:14.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.049+0000 7f5c3ce34640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5c38111b30 con 0x7f5c381076b0 2024-09-11T00:14:14.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.049+0000 7f5c3ce34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5c38111e30 con 0x7f5c38101ca0 2024-09-11T00:14:14.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.049+0000 7f5c36d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c38108030 0x7f5c3819da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:14.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.049+0000 7f5c36d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c38108030 0x7f5c3819da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46122/0 (socket says 172.21.15.78:46122) 2024-09-11T00:14:14.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.049+0000 7f5c36d9d640 1 -- 172.21.15.78:0/573319188 learned_addr learned my addr 172.21.15.78:0/573319188 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:14.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.049+0000 7f5c3659c640 1 --2- 172.21.15.78:0/573319188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c38101ca0 0x7f5c38198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:14.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.049+0000 7f5c35d9b640 1 --2- 172.21.15.78:0/573319188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c381076b0 0x7f5c38198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:14.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.049+0000 7f5c36d9d640 1 -- 172.21.15.78:0/573319188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c38101ca0 msgr2=0x7f5c38198120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:14.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.049+0000 7f5c36d9d640 1 --2- 172.21.15.78:0/573319188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c38101ca0 0x7f5c38198120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:14.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.049+0000 7f5c36d9d640 1 -- 172.21.15.78:0/573319188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c381076b0 msgr2=0x7f5c38198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:14.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.049+0000 7f5c36d9d640 1 --2- 172.21.15.78:0/573319188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c381076b0 0x7f5c38198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:14.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.049+0000 7f5c36d9d640 1 -- 172.21.15.78:0/573319188 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3819e1d0 con 0x7f5c38108030 2024-09-11T00:14:14.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.049+0000 7f5c36d9d640 1 --2- 172.21.15.78:0/573319188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c38108030 0x7f5c3819da00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000cad0 tx=0x7f5c3000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:14.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.049+0000 7f5c277fe640 1 -- 172.21.15.78:0/573319188 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3000ae20 con 0x7f5c38108030 2024-09-11T00:14:14.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.049+0000 7f5c3ce34640 1 -- 172.21.15.78:0/573319188 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c3819e4c0 con 0x7f5c38108030 2024-09-11T00:14:14.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.049+0000 7f5c277fe640 1 -- 172.21.15.78:0/573319188 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c30005020 con 0x7f5c38108030 2024-09-11T00:14:14.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.049+0000 7f5c277fe640 1 -- 172.21.15.78:0/573319188 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3000f6b0 con 0x7f5c38108030 2024-09-11T00:14:14.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.049+0000 7f5c3ce34640 1 -- 172.21.15.78:0/573319188 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c381a4b80 con 0x7f5c38108030 2024-09-11T00:14:14.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.050+0000 7f5c3ce34640 1 -- 172.21.15.78:0/573319188 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c38102080 con 0x7f5c38108030 2024-09-11T00:14:14.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.052+0000 7f5c277fe640 1 -- 172.21.15.78:0/573319188 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f5c300054f0 con 0x7f5c38108030 2024-09-11T00:14:14.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.053+0000 7f5c277fe640 1 --2- 172.21.15.78:0/573319188 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5c200b5330 0x7f5c200b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:14.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.053+0000 7f5c3659c640 1 --2- 172.21.15.78:0/573319188 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5c200b5330 0x7f5c200b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:14.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.053+0000 7f5c277fe640 1 -- 172.21.15.78:0/573319188 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f5c300e5c90 con 0x7f5c38108030 2024-09-11T00:14:14.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.053+0000 7f5c3659c640 1 --2- 172.21.15.78:0/573319188 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5c200b5330 0x7f5c200b77f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5c28031440 tx=0x7f5c28005e80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:14.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.056+0000 7f5c277fe640 1 -- 172.21.15.78:0/573319188 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5c30014030 con 0x7f5c38108030 2024-09-11T00:14:14.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.268+0000 7f5c3ce34640 1 -- 172.21.15.78:0/573319188 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c38199250 con 0x7f5c38108030 2024-09-11T00:14:14.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.269+0000 7f5c277fe640 1 -- 172.21.15.78:0/573319188 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9707 (secure 0 0 0) 0x7f5c38199250 con 0x7f5c38108030 2024-09-11T00:14:14.271 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:14:14.271 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":12,"btime":"2024-09-11T00:14:13:726457+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24589,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-11T00:14:14.271 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 12 2024-09-11T00:14:14.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.271+0000 7f5c3ce34640 1 -- 172.21.15.78:0/573319188 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5c200b5330 msgr2=0x7f5c200b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:14.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.271+0000 7f5c3ce34640 1 --2- 172.21.15.78:0/573319188 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5c200b5330 0x7f5c200b77f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5c28031440 tx=0x7f5c28005e80 comp rx=0 tx=0).stop 2024-09-11T00:14:14.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.271+0000 7f5c3ce34640 1 -- 172.21.15.78:0/573319188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c38108030 msgr2=0x7f5c3819da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:14.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.271+0000 7f5c3ce34640 1 --2- 172.21.15.78:0/573319188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c38108030 0x7f5c3819da00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000cad0 tx=0x7f5c3000cf90 comp rx=0 tx=0).stop 2024-09-11T00:14:14.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.271+0000 7f5c3ce34640 1 -- 172.21.15.78:0/573319188 shutdown_connections 2024-09-11T00:14:14.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.271+0000 7f5c3ce34640 1 --2- 172.21.15.78:0/573319188 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5c200b5330 0x7f5c200b77f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:14.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.271+0000 7f5c3ce34640 1 --2- 172.21.15.78:0/573319188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c38108030 0x7f5c3819da00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:14.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.271+0000 7f5c3ce34640 1 --2- 172.21.15.78:0/573319188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5c381076b0 0x7f5c38198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:14.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.271+0000 7f5c3ce34640 1 --2- 172.21.15.78:0/573319188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5c38101ca0 0x7f5c38198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:14.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.271+0000 7f5c3ce34640 1 -- 172.21.15.78:0/573319188 >> 172.21.15.78:0/573319188 conn(0x7f5c380fd6d0 msgr2=0x7f5c380ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:14.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.271+0000 7f5c3ce34640 1 -- 172.21.15.78:0/573319188 shutdown_connections 2024-09-11T00:14:14.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:14.271+0000 7f5c3ce34640 1 -- 172.21.15.78:0/573319188 wait complete. 2024-09-11T00:14:14.581 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:14 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:14.581 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:14 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:14.581 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:14 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:14.581 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:14 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:14:14.582 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:14 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:14:14.582 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:14 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:14.582 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:14 smithi078 ceph-mon[30865]: Deploying daemon mds.b on smithi112 2024-09-11T00:14:14.582 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:14 smithi078 ceph-mon[30865]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:14.582 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:14 smithi078 ceph-mon[30865]: mds.? [v2:172.21.15.78:6840/3067187523,v1:172.21.15.78:6841/3067187523] up:boot 2024-09-11T00:14:14.582 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:14 smithi078 ceph-mon[30865]: fsmap 11 up:standby 2024-09-11T00:14:14.582 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:14 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-11T00:14:14.582 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:14 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/573319188' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:14:14.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:14 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:14.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:14 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:14.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:14 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:14.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:14 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:14:14.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:14 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:14:14.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:14 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:14.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:14 smithi138 ceph-mon[35019]: Deploying daemon mds.b on smithi112 2024-09-11T00:14:14.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:14 smithi138 ceph-mon[35019]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:14.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:14 smithi138 ceph-mon[35019]: mds.? [v2:172.21.15.78:6840/3067187523,v1:172.21.15.78:6841/3067187523] up:boot 2024-09-11T00:14:14.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:14 smithi138 ceph-mon[35019]: fsmap 11 up:standby 2024-09-11T00:14:14.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:14 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-11T00:14:14.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:14 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/573319188' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:14:14.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:14 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:14.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:14 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:14.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:14 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:14.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:14 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T00:14:14.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:14 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T00:14:14.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:14 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:14.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:14 smithi112 ceph-mon[35627]: Deploying daemon mds.b on smithi112 2024-09-11T00:14:14.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:14 smithi112 ceph-mon[35627]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:14.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:14 smithi112 ceph-mon[35627]: mds.? [v2:172.21.15.78:6840/3067187523,v1:172.21.15.78:6841/3067187523] up:boot 2024-09-11T00:14:14.984 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:14 smithi112 ceph-mon[35627]: fsmap 11 up:standby 2024-09-11T00:14:14.985 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:14 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-11T00:14:14.985 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:14 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/573319188' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:14:15.982 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 11 00:14:15 smithi112 podman[67215]: 2024-09-11 00:14:15.91200444 +0000 UTC m=+0.132064872 container create f257b690f013fd9e43f3ea8397bd10e4c9167c2f4c55bdd5bd61f3daf3df8e6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-b, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:14:16.482 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 11 00:14:16 smithi112 podman[67215]: 2024-09-11 00:14:16.173343682 +0000 UTC m=+0.393404114 container init f257b690f013fd9e43f3ea8397bd10e4c9167c2f4c55bdd5bd61f3daf3df8e6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-11T00:14:16.482 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 11 00:14:16 smithi112 podman[67215]: 2024-09-11 00:14:16.176051081 +0000 UTC m=+0.396111515 container start f257b690f013fd9e43f3ea8397bd10e4c9167c2f4c55bdd5bd61f3daf3df8e6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-11T00:14:16.482 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 11 00:14:16 smithi112 ceph-mds[67234]: -- 172.21.15.112:0/3605829212 <== mon.2 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560c4a0c9860 con 0x560c4a0a7000 2024-09-11T00:14:16.482 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 11 00:14:16 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-b[67230]: starting mds.b at 2024-09-11T00:14:16.482 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 11 00:14:16 smithi112 bash[67215]: f257b690f013fd9e43f3ea8397bd10e4c9167c2f4c55bdd5bd61f3daf3df8e6d 2024-09-11T00:14:16.482 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 11 00:14:16 smithi112 systemd[1]: Started Ceph mds.b for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:14:16.910 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:14:16.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:16 smithi112 ceph-mon[35627]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:16.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:16 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:16.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:16 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:16.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:16 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:16.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:16 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:16.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:16 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:16.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:16 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:14:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:16 smithi138 ceph-mon[35019]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:16 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:16 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:16 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:16 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:16 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:16 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:14:17.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:16 smithi078 ceph-mon[30865]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:17.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:16 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:17.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:16 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:17.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:16 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:17.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:16 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:17.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:16 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:17.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:16 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:14:17.722 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:18.002 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:17 smithi078 ceph-mon[30865]: mds.? [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] up:boot 2024-09-11T00:14:18.002 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:17 smithi078 ceph-mon[30865]: fsmap 12 up:standby 2024-09-11T00:14:18.002 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:17 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-11T00:14:18.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:17 smithi138 ceph-mon[35019]: mds.? [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] up:boot 2024-09-11T00:14:18.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:17 smithi138 ceph-mon[35019]: fsmap 12 up:standby 2024-09-11T00:14:18.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:17 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-11T00:14:18.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.192+0000 7ffa11def640 1 -- 172.21.15.78:0/2002227277 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa0c102dc0 msgr2=0x7ffa0c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:18.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.192+0000 7ffa11def640 1 --2- 172.21.15.78:0/2002227277 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa0c102dc0 0x7ffa0c1031a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc009900 tx=0x7ff9fc02a410 comp rx=0 tx=0).stop 2024-09-11T00:14:18.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.192+0000 7ffa11def640 1 -- 172.21.15.78:0/2002227277 shutdown_connections 2024-09-11T00:14:18.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.192+0000 7ffa11def640 1 --2- 172.21.15.78:0/2002227277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa0c109150 0x7ffa0c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:18.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.192+0000 7ffa11def640 1 --2- 172.21.15.78:0/2002227277 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa0c1087d0 0x7ffa0c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:18.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.192+0000 7ffa11def640 1 --2- 172.21.15.78:0/2002227277 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa0c102dc0 0x7ffa0c1031a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:18.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.192+0000 7ffa11def640 1 -- 172.21.15.78:0/2002227277 >> 172.21.15.78:0/2002227277 conn(0x7ffa0c0fe830 msgr2=0x7ffa0c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:18.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.192+0000 7ffa11def640 1 -- 172.21.15.78:0/2002227277 shutdown_connections 2024-09-11T00:14:18.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.192+0000 7ffa11def640 1 -- 172.21.15.78:0/2002227277 wait complete. 2024-09-11T00:14:18.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.193+0000 7ffa11def640 1 Processor -- start 2024-09-11T00:14:18.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.193+0000 7ffa11def640 1 -- start start 2024-09-11T00:14:18.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.193+0000 7ffa11def640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa0c102dc0 0x7ffa0c1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:18.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.193+0000 7ffa11def640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa0c1087d0 0x7ffa0c199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:18.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.193+0000 7ffa11def640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa0c109150 0x7ffa0c19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:18.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.193+0000 7ffa11def640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c112e10 con 0x7ffa0c109150 2024-09-11T00:14:18.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.193+0000 7ffa11def640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c112c90 con 0x7ffa0c102dc0 2024-09-11T00:14:18.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.193+0000 7ffa11def640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c112f90 con 0x7ffa0c1087d0 2024-09-11T00:14:18.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.193+0000 7ffa0bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa0c109150 0x7ffa0c19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:18.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.193+0000 7ffa0b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa0c102dc0 0x7ffa0c1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:18.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.193+0000 7ffa0bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa0c109150 0x7ffa0c19ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44732/0 (socket says 172.21.15.78:44732) 2024-09-11T00:14:18.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.193+0000 7ffa0b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa0c102dc0 0x7ffa0c1992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.78:47922/0 (socket says 172.21.15.78:47922) 2024-09-11T00:14:18.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.193+0000 7ffa0bfff640 1 -- 172.21.15.78:0/3126804465 learned_addr learned my addr 172.21.15.78:0/3126804465 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:18.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.193+0000 7ffa0affd640 1 --2- 172.21.15.78:0/3126804465 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa0c1087d0 0x7ffa0c199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:18.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.194+0000 7ffa0bfff640 1 -- 172.21.15.78:0/3126804465 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa0c1087d0 msgr2=0x7ffa0c199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:18.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.194+0000 7ffa0bfff640 1 --2- 172.21.15.78:0/3126804465 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa0c1087d0 0x7ffa0c199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:18.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.194+0000 7ffa0bfff640 1 -- 172.21.15.78:0/3126804465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa0c102dc0 msgr2=0x7ffa0c1992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:18.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.194+0000 7ffa0bfff640 1 --2- 172.21.15.78:0/3126804465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa0c102dc0 0x7ffa0c1992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:18.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.194+0000 7ffa0bfff640 1 -- 172.21.15.78:0/3126804465 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa0c19f380 con 0x7ffa0c109150 2024-09-11T00:14:18.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.194+0000 7ffa0bfff640 1 --2- 172.21.15.78:0/3126804465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa0c109150 0x7ffa0c19ebb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400d750 tx=0x7ffa0400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:18.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.194+0000 7ffa08ff9640 1 -- 172.21.15.78:0/3126804465 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04017070 con 0x7ffa0c109150 2024-09-11T00:14:18.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.194+0000 7ffa11def640 1 -- 172.21.15.78:0/3126804465 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa0c19f670 con 0x7ffa0c109150 2024-09-11T00:14:18.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.194+0000 7ffa08ff9640 1 -- 172.21.15.78:0/3126804465 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa040054d0 con 0x7ffa0c109150 2024-09-11T00:14:18.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.194+0000 7ffa08ff9640 1 -- 172.21.15.78:0/3126804465 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04004c60 con 0x7ffa0c109150 2024-09-11T00:14:18.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.194+0000 7ffa11def640 1 -- 172.21.15.78:0/3126804465 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa0c1a5d30 con 0x7ffa0c109150 2024-09-11T00:14:18.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.195+0000 7ffa11def640 1 -- 172.21.15.78:0/3126804465 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa0c1031a0 con 0x7ffa0c109150 2024-09-11T00:14:18.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.196+0000 7ffa08ff9640 1 -- 172.21.15.78:0/3126804465 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7ffa04004e00 con 0x7ffa0c109150 2024-09-11T00:14:18.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.197+0000 7ffa08ff9640 1 --2- 172.21.15.78:0/3126804465 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff9f40b5330 0x7ff9f40b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:18.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.197+0000 7ffa0b7fe640 1 --2- 172.21.15.78:0/3126804465 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff9f40b5330 0x7ff9f40b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:18.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.197+0000 7ffa08ff9640 1 -- 172.21.15.78:0/3126804465 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7ffa040e55c0 con 0x7ffa0c109150 2024-09-11T00:14:18.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.197+0000 7ffa0b7fe640 1 --2- 172.21.15.78:0/3126804465 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff9f40b5330 0x7ff9f40b77f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc031440 tx=0x7ff9fc005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:18.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.200+0000 7ffa08ff9640 1 -- 172.21.15.78:0/3126804465 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ffa040ac200 con 0x7ffa0c109150 2024-09-11T00:14:18.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:17 smithi112 ceph-mon[35627]: mds.? [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] up:boot 2024-09-11T00:14:18.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:17 smithi112 ceph-mon[35627]: fsmap 12 up:standby 2024-09-11T00:14:18.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:17 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-11T00:14:18.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.439+0000 7ffa11def640 1 -- 172.21.15.78:0/3126804465 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa0c19a400 con 0x7ffa0c109150 2024-09-11T00:14:18.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.440+0000 7ffa08ff9640 1 -- 172.21.15.78:0/3126804465 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10533 (secure 0 0 0) 0x7ffa0c19a400 con 0x7ffa0c109150 2024-09-11T00:14:18.442 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:14:18.442 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":13,"btime":"2024-09-11T00:14:16:715926+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24589,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-11T00:14:18.443 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 13 2024-09-11T00:14:18.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.442+0000 7ffa11def640 1 -- 172.21.15.78:0/3126804465 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff9f40b5330 msgr2=0x7ff9f40b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:18.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.442+0000 7ffa11def640 1 --2- 172.21.15.78:0/3126804465 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff9f40b5330 0x7ff9f40b77f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc031440 tx=0x7ff9fc005b50 comp rx=0 tx=0).stop 2024-09-11T00:14:18.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.442+0000 7ffa11def640 1 -- 172.21.15.78:0/3126804465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa0c109150 msgr2=0x7ffa0c19ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:18.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.442+0000 7ffa11def640 1 --2- 172.21.15.78:0/3126804465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa0c109150 0x7ffa0c19ebb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400d750 tx=0x7ffa0400dc10 comp rx=0 tx=0).stop 2024-09-11T00:14:18.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.442+0000 7ffa11def640 1 -- 172.21.15.78:0/3126804465 shutdown_connections 2024-09-11T00:14:18.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.442+0000 7ffa11def640 1 --2- 172.21.15.78:0/3126804465 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff9f40b5330 0x7ff9f40b77f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:18.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.442+0000 7ffa11def640 1 --2- 172.21.15.78:0/3126804465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa0c109150 0x7ffa0c19ebb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:18.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.442+0000 7ffa11def640 1 --2- 172.21.15.78:0/3126804465 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa0c1087d0 0x7ffa0c199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:18.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.442+0000 7ffa11def640 1 --2- 172.21.15.78:0/3126804465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa0c102dc0 0x7ffa0c1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:18.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.442+0000 7ffa11def640 1 -- 172.21.15.78:0/3126804465 >> 172.21.15.78:0/3126804465 conn(0x7ffa0c0fe830 msgr2=0x7ffa0c1001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:18.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.442+0000 7ffa11def640 1 -- 172.21.15.78:0/3126804465 shutdown_connections 2024-09-11T00:14:18.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:18.442+0000 7ffa11def640 1 -- 172.21.15.78:0/3126804465 wait complete. 2024-09-11T00:14:19.030 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:18 smithi078 ceph-mon[30865]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:19.030 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:18 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:19.030 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:18 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:19.030 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:18 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:19.031 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:18 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:19.031 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:18 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3126804465' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:14:19.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:18 smithi138 ceph-mon[35019]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:19.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:18 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:19.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:18 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:19.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:18 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:19.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:18 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:19.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:18 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3126804465' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:14:19.058 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-11T00:14:19.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:18 smithi112 ceph-mon[35627]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:19.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:18 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:19.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:18 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:19.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:18 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:19.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:18 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:19.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:18 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3126804465' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:14:19.322 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:19.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.807+0000 7ff39e93f640 1 -- 172.21.15.78:0/1095194921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff398108020 msgr2=0x7ff39810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:19.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.807+0000 7ff39e93f640 1 --2- 172.21.15.78:0/1095194921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff398108020 0x7ff39810e820 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff390009ca0 tx=0x7ff39002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:14:19.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.807+0000 7ff39e93f640 1 -- 172.21.15.78:0/1095194921 shutdown_connections 2024-09-11T00:14:19.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.807+0000 7ff39e93f640 1 --2- 172.21.15.78:0/1095194921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff398108020 0x7ff39810e820 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:19.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.807+0000 7ff39e93f640 1 --2- 172.21.15.78:0/1095194921 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3981076a0 0x7ff398107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:19.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.807+0000 7ff39e93f640 1 --2- 172.21.15.78:0/1095194921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff398101c90 0x7ff398102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:19.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.807+0000 7ff39e93f640 1 -- 172.21.15.78:0/1095194921 >> 172.21.15.78:0/1095194921 conn(0x7ff3980fd700 msgr2=0x7ff3980ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:19.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.807+0000 7ff39e93f640 1 -- 172.21.15.78:0/1095194921 shutdown_connections 2024-09-11T00:14:19.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.807+0000 7ff39e93f640 1 -- 172.21.15.78:0/1095194921 wait complete. 2024-09-11T00:14:19.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.807+0000 7ff39e93f640 1 Processor -- start 2024-09-11T00:14:19.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.807+0000 7ff39e93f640 1 -- start start 2024-09-11T00:14:19.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.808+0000 7ff39e93f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff398101c90 0x7ff39819a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:19.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.808+0000 7ff39e93f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3981076a0 0x7ff39819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:19.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.808+0000 7ff39e93f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff398108020 0x7ff39819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:19.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.808+0000 7ff39e93f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff398111ce0 con 0x7ff398108020 2024-09-11T00:14:19.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.808+0000 7ff39e93f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff398111b60 con 0x7ff398101c90 2024-09-11T00:14:19.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.808+0000 7ff39e93f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff398111e60 con 0x7ff3981076a0 2024-09-11T00:14:19.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.808+0000 7ff39cedc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff398108020 0x7ff39819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:19.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.808+0000 7ff39cedc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff398108020 0x7ff39819aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44754/0 (socket says 172.21.15.78:44754) 2024-09-11T00:14:19.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.808+0000 7ff39cedc640 1 -- 172.21.15.78:0/3371752169 learned_addr learned my addr 172.21.15.78:0/3371752169 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:19.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.808+0000 7ff3977fe640 1 --2- 172.21.15.78:0/3371752169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3981076a0 0x7ff39819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:19.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.808+0000 7ff397fff640 1 --2- 172.21.15.78:0/3371752169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff398101c90 0x7ff39819a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:19.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.808+0000 7ff39cedc640 1 -- 172.21.15.78:0/3371752169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3981076a0 msgr2=0x7ff39819a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:19.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.808+0000 7ff39cedc640 1 --2- 172.21.15.78:0/3371752169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3981076a0 0x7ff39819a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:19.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.808+0000 7ff39cedc640 1 -- 172.21.15.78:0/3371752169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff398101c90 msgr2=0x7ff39819a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:19.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.808+0000 7ff39cedc640 1 --2- 172.21.15.78:0/3371752169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff398101c90 0x7ff39819a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:19.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.808+0000 7ff39cedc640 1 -- 172.21.15.78:0/3371752169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3981a5430 con 0x7ff398108020 2024-09-11T00:14:19.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.808+0000 7ff397fff640 1 --2- 172.21.15.78:0/3371752169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff398101c90 0x7ff39819a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:19.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.808+0000 7ff39cedc640 1 --2- 172.21.15.78:0/3371752169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff398108020 0x7ff39819aaf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff390005cc0 tx=0x7ff39002f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:19.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.809+0000 7ff3957fa640 1 -- 172.21.15.78:0/3371752169 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff390003cf0 con 0x7ff398108020 2024-09-11T00:14:19.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.809+0000 7ff3957fa640 1 -- 172.21.15.78:0/3371752169 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3900044f0 con 0x7ff398108020 2024-09-11T00:14:19.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.809+0000 7ff39e93f640 1 -- 172.21.15.78:0/3371752169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3981a56c0 con 0x7ff398108020 2024-09-11T00:14:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.809+0000 7ff3957fa640 1 -- 172.21.15.78:0/3371752169 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39002fc30 con 0x7ff398108020 2024-09-11T00:14:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.809+0000 7ff39e93f640 1 -- 172.21.15.78:0/3371752169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3981a5c80 con 0x7ff398108020 2024-09-11T00:14:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.810+0000 7ff39e93f640 1 -- 172.21.15.78:0/3371752169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff398102070 con 0x7ff398108020 2024-09-11T00:14:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.811+0000 7ff3957fa640 1 -- 172.21.15.78:0/3371752169 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7ff390004040 con 0x7ff398108020 2024-09-11T00:14:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.812+0000 7ff3957fa640 1 --2- 172.21.15.78:0/3371752169 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff3840b5330 0x7ff3840b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.812+0000 7ff397fff640 1 --2- 172.21.15.78:0/3371752169 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff3840b5330 0x7ff3840b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.812+0000 7ff3957fa640 1 -- 172.21.15.78:0/3371752169 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7ff390106f90 con 0x7ff398108020 2024-09-11T00:14:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.812+0000 7ff397fff640 1 --2- 172.21.15.78:0/3371752169 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff3840b5330 0x7ff3840b77f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff38800abe0 tx=0x7ff38800a5c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:19.815+0000 7ff3957fa640 1 -- 172.21.15.78:0/3371752169 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff3900ce180 con 0x7ff398108020 2024-09-11T00:14:20.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:20.011+0000 7ff39e93f640 1 -- 172.21.15.78:0/3371752169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff39802e5c0 con 0x7ff398108020 2024-09-11T00:14:20.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:20.011+0000 7ff3957fa640 1 -- 172.21.15.78:0/3371752169 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v70) ==== 84+0+65 (secure 0 0 0) 0x7ff3900cda80 con 0x7ff398108020 2024-09-11T00:14:20.013 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:14:20.013 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2024-09-11T00:14:20.013 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:14:20.013 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2024-09-11T00:14:20.013 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2024-09-11T00:14:20.013 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:14:20.013 INFO:teuthology.orchestra.run.smithi078.stdout:] 2024-09-11T00:14:20.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:20.013+0000 7ff39e93f640 1 -- 172.21.15.78:0/3371752169 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff3840b5330 msgr2=0x7ff3840b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:20.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:20.013+0000 7ff39e93f640 1 --2- 172.21.15.78:0/3371752169 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff3840b5330 0x7ff3840b77f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff38800abe0 tx=0x7ff38800a5c0 comp rx=0 tx=0).stop 2024-09-11T00:14:20.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:20.013+0000 7ff39e93f640 1 -- 172.21.15.78:0/3371752169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff398108020 msgr2=0x7ff39819aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:20.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:20.013+0000 7ff39e93f640 1 --2- 172.21.15.78:0/3371752169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff398108020 0x7ff39819aaf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff390005cc0 tx=0x7ff39002f470 comp rx=0 tx=0).stop 2024-09-11T00:14:20.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:20.014+0000 7ff39e93f640 1 -- 172.21.15.78:0/3371752169 shutdown_connections 2024-09-11T00:14:20.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:20.014+0000 7ff39e93f640 1 --2- 172.21.15.78:0/3371752169 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff3840b5330 0x7ff3840b77f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:20.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:20.014+0000 7ff39e93f640 1 --2- 172.21.15.78:0/3371752169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff398108020 0x7ff39819aaf0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:20.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:20.014+0000 7ff39e93f640 1 --2- 172.21.15.78:0/3371752169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3981076a0 0x7ff39819a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:20.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:20.014+0000 7ff39e93f640 1 --2- 172.21.15.78:0/3371752169 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff398101c90 0x7ff39819a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:20.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:20.014+0000 7ff39e93f640 1 -- 172.21.15.78:0/3371752169 >> 172.21.15.78:0/3371752169 conn(0x7ff3980fd700 msgr2=0x7ff3980ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:20.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:20.014+0000 7ff39e93f640 1 -- 172.21.15.78:0/3371752169 shutdown_connections 2024-09-11T00:14:20.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:20.014+0000 7ff39e93f640 1 -- 172.21.15.78:0/3371752169 wait complete. 2024-09-11T00:14:20.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:20 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:20.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:20 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:20.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:20 smithi078 ceph-mon[30865]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:20.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:20 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:20.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:20 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:14:20.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:20 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:20.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:20 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:14:20.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:20 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3371752169' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-11T00:14:20.449 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:20 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:20.449 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:20 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:20.449 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:20 smithi112 ceph-mon[35627]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:20.449 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:20 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:20.449 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:20 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:14:20.449 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:20 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:20.450 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:20 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:14:20.450 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:20 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3371752169' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-11T00:14:20.482 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:20 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:20.482 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:20 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:20.482 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:20 smithi138 ceph-mon[35019]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:20.482 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:20 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:20.482 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:20 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:14:20.482 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:20 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:20.482 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:20 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:14:20.482 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:20 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3371752169' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-11T00:14:20.721 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T00:14:20.721 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T00:14:21.615 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:22.033 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:21 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:22.033 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:21 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:22.033 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:21 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:22.033 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:21 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:22.033 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:21 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:22.033 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:21 smithi078 ceph-mon[30865]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:22.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.115+0000 7f33454fe640 1 -- 172.21.15.78:0/3716011031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f334010d110 msgr2=0x7f334010f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:22.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.115+0000 7f33454fe640 1 --2- 172.21.15.78:0/3716011031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f334010d110 0x7f334010f570 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3338009ca0 tx=0x7f333802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.115+0000 7f33454fe640 1 -- 172.21.15.78:0/3716011031 shutdown_connections 2024-09-11T00:14:22.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.115+0000 7f33454fe640 1 --2- 172.21.15.78:0/3716011031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f334010d110 0x7f334010f570 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.115+0000 7f33454fe640 1 --2- 172.21.15.78:0/3716011031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33401045d0 0x7f334010cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.115+0000 7f33454fe640 1 --2- 172.21.15.78:0/3716011031 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3340103cb0 0x7f3340104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.115+0000 7f33454fe640 1 -- 172.21.15.78:0/3716011031 >> 172.21.15.78:0/3716011031 conn(0x7f33400fd6d0 msgr2=0x7f33400ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:22.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.115+0000 7f33454fe640 1 -- 172.21.15.78:0/3716011031 shutdown_connections 2024-09-11T00:14:22.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.115+0000 7f33454fe640 1 -- 172.21.15.78:0/3716011031 wait complete. 2024-09-11T00:14:22.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.116+0000 7f33454fe640 1 Processor -- start 2024-09-11T00:14:22.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.116+0000 7f33454fe640 1 -- start start 2024-09-11T00:14:22.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.116+0000 7f33454fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3340103cb0 0x7f3340101960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:22.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.116+0000 7f33454fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33401045d0 0x7f3340101ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:22.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.116+0000 7f33454fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f334010d110 0x7f33401023e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:22.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.116+0000 7f33454fe640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3340112de0 con 0x7f33401045d0 2024-09-11T00:14:22.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.116+0000 7f33454fe640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3340112c60 con 0x7f3340103cb0 2024-09-11T00:14:22.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.116+0000 7f33454fe640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3340112f60 con 0x7f334010d110 2024-09-11T00:14:22.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.116+0000 7f333e7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33401045d0 0x7f3340101ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:22.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.116+0000 7f333e7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33401045d0 0x7f3340101ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44770/0 (socket says 172.21.15.78:44770) 2024-09-11T00:14:22.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.116+0000 7f333e7fc640 1 -- 172.21.15.78:0/2550154353 learned_addr learned my addr 172.21.15.78:0/2550154353 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:22.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.116+0000 7f333effd640 1 --2- 172.21.15.78:0/2550154353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3340103cb0 0x7f3340101960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:22.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.116+0000 7f333f7fe640 1 --2- 172.21.15.78:0/2550154353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f334010d110 0x7f33401023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:22.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.116+0000 7f333e7fc640 1 -- 172.21.15.78:0/2550154353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f334010d110 msgr2=0x7f33401023e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:22.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.116+0000 7f333e7fc640 1 --2- 172.21.15.78:0/2550154353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f334010d110 0x7f33401023e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.116+0000 7f333e7fc640 1 -- 172.21.15.78:0/2550154353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3340103cb0 msgr2=0x7f3340101960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:22.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.116+0000 7f333e7fc640 1 --2- 172.21.15.78:0/2550154353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3340103cb0 0x7f3340101960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.116+0000 7f333e7fc640 1 -- 172.21.15.78:0/2550154353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33401a76f0 con 0x7f33401045d0 2024-09-11T00:14:22.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.116+0000 7f333effd640 1 --2- 172.21.15.78:0/2550154353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3340103cb0 0x7f3340101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:22.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.117+0000 7f333e7fc640 1 --2- 172.21.15.78:0/2550154353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33401045d0 0x7f3340101ea0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f333400b3c0 tx=0x7f333400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:22.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.117+0000 7f3327fff640 1 -- 172.21.15.78:0/2550154353 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334011830 con 0x7f33401045d0 2024-09-11T00:14:22.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.117+0000 7f33454fe640 1 -- 172.21.15.78:0/2550154353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33401a79e0 con 0x7f33401045d0 2024-09-11T00:14:22.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.117+0000 7f3327fff640 1 -- 172.21.15.78:0/2550154353 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3334016070 con 0x7f33401045d0 2024-09-11T00:14:22.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.117+0000 7f3327fff640 1 -- 172.21.15.78:0/2550154353 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334010de0 con 0x7f33401045d0 2024-09-11T00:14:22.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.117+0000 7f33454fe640 1 -- 172.21.15.78:0/2550154353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33401a7fa0 con 0x7f33401045d0 2024-09-11T00:14:22.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.118+0000 7f33454fe640 1 -- 172.21.15.78:0/2550154353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3340104090 con 0x7f33401045d0 2024-09-11T00:14:22.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.119+0000 7f3327fff640 1 -- 172.21.15.78:0/2550154353 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f33340119d0 con 0x7f33401045d0 2024-09-11T00:14:22.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.120+0000 7f3327fff640 1 --2- 172.21.15.78:0/2550154353 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f33280b5330 0x7f33280b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:22.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.120+0000 7f333effd640 1 --2- 172.21.15.78:0/2550154353 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f33280b5330 0x7f33280b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:22.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.120+0000 7f3327fff640 1 -- 172.21.15.78:0/2550154353 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f33340e5500 con 0x7f33401045d0 2024-09-11T00:14:22.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.120+0000 7f333effd640 1 --2- 172.21.15.78:0/2550154353 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f33280b5330 0x7f33280b77f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f33300058c0 tx=0x7f3330005d30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:22.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.123+0000 7f3327fff640 1 -- 172.21.15.78:0/2550154353 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f33340ac790 con 0x7f33401045d0 2024-09-11T00:14:22.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:21 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:22.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:21 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:22.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:21 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:22.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:21 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:22.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:21 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:22.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:21 smithi112 ceph-mon[35627]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:22.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:21 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:22.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:21 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:22.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:21 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:22.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:21 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:22.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:21 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:22.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:21 smithi138 ceph-mon[35019]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:22.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.340+0000 7f33454fe640 1 -- 172.21.15.78:0/2550154353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f33401a8340 con 0x7f33401045d0 2024-09-11T00:14:22.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.888+0000 7f3327fff640 1 -- 172.21.15.78:0/2550154353 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v71) ==== 138+0+0 (secure 0 0 0) 0x7f33340ac090 con 0x7f33401045d0 2024-09-11T00:14:22.890 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2024-09-11T00:14:22.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.891+0000 7f33454fe640 1 -- 172.21.15.78:0/2550154353 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f33280b5330 msgr2=0x7f33280b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:22.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.891+0000 7f33454fe640 1 --2- 172.21.15.78:0/2550154353 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f33280b5330 0x7f33280b77f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f33300058c0 tx=0x7f3330005d30 comp rx=0 tx=0).stop 2024-09-11T00:14:22.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.891+0000 7f33454fe640 1 -- 172.21.15.78:0/2550154353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33401045d0 msgr2=0x7f3340101ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:22.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.891+0000 7f33454fe640 1 --2- 172.21.15.78:0/2550154353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33401045d0 0x7f3340101ea0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f333400b3c0 tx=0x7f333400b880 comp rx=0 tx=0).stop 2024-09-11T00:14:22.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.891+0000 7f33454fe640 1 -- 172.21.15.78:0/2550154353 shutdown_connections 2024-09-11T00:14:22.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.891+0000 7f33454fe640 1 --2- 172.21.15.78:0/2550154353 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f33280b5330 0x7f33280b77f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.891+0000 7f33454fe640 1 --2- 172.21.15.78:0/2550154353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f334010d110 0x7f33401023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.891+0000 7f33454fe640 1 --2- 172.21.15.78:0/2550154353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33401045d0 0x7f3340101ea0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.891+0000 7f33454fe640 1 --2- 172.21.15.78:0/2550154353 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3340103cb0 0x7f3340101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:22.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.891+0000 7f33454fe640 1 -- 172.21.15.78:0/2550154353 >> 172.21.15.78:0/2550154353 conn(0x7f33400fd6d0 msgr2=0x7f33400fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:22.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.891+0000 7f33454fe640 1 -- 172.21.15.78:0/2550154353 shutdown_connections 2024-09-11T00:14:22.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:22.891+0000 7f33454fe640 1 -- 172.21.15.78:0/2550154353 wait complete. 2024-09-11T00:14:23.202 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:22 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2550154353' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-11T00:14:23.203 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:22 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:23.203 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:22 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:23.203 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:22 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:23.203 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:22 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:14:23.203 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:22 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:23.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:22 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2550154353' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-11T00:14:23.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:22 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:23.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:22 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:23.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:22 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:23.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:22 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:14:23.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:22 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:23.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:22 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2550154353' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-11T00:14:23.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:22 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:23.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:22 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:23.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:22 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:14:23.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:22 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:14:23.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:22 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:14:23.557 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T00:14:23.802 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:24.174 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:23 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2550154353' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T00:14:24.174 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:23 smithi078 ceph-mon[30865]: osdmap e71: 12 total, 12 up, 12 in 2024-09-11T00:14:24.174 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:23 smithi078 ceph-mon[30865]: pgmap v253: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:24.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:23 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2550154353' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T00:14:24.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:23 smithi112 ceph-mon[35627]: osdmap e71: 12 total, 12 up, 12 in 2024-09-11T00:14:24.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:23 smithi112 ceph-mon[35627]: pgmap v253: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:24.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.259+0000 7f409eaa4640 1 -- 172.21.15.78:0/1113485346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4098103b70 msgr2=0x7f4098103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:24.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.259+0000 7f409eaa4640 1 --2- 172.21.15.78:0/1113485346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4098103b70 0x7f4098103f50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4094009900 tx=0x7f409402a410 comp rx=0 tx=0).stop 2024-09-11T00:14:24.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.259+0000 7f409eaa4640 1 -- 172.21.15.78:0/1113485346 shutdown_connections 2024-09-11T00:14:24.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.259+0000 7f409eaa4640 1 --2- 172.21.15.78:0/1113485346 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409810d120 0x7f409810f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.259+0000 7f409eaa4640 1 --2- 172.21.15.78:0/1113485346 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4098104570 0x7f409810cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.259+0000 7f409eaa4640 1 --2- 172.21.15.78:0/1113485346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4098103b70 0x7f4098103f50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.259+0000 7f409eaa4640 1 -- 172.21.15.78:0/1113485346 >> 172.21.15.78:0/1113485346 conn(0x7f40980fd700 msgr2=0x7f40980ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:24.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.259+0000 7f409eaa4640 1 -- 172.21.15.78:0/1113485346 shutdown_connections 2024-09-11T00:14:24.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.259+0000 7f409eaa4640 1 -- 172.21.15.78:0/1113485346 wait complete. 2024-09-11T00:14:24.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.260+0000 7f409eaa4640 1 Processor -- start 2024-09-11T00:14:24.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.260+0000 7f409eaa4640 1 -- start start 2024-09-11T00:14:24.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.260+0000 7f409eaa4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4098103b70 0x7f40981992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:24.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.260+0000 7f409eaa4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4098104570 0x7f4098199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:24.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.260+0000 7f409eaa4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409810d120 0x7f409819ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:24.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.260+0000 7f409eaa4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4098112dc0 con 0x7f4098104570 2024-09-11T00:14:24.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.260+0000 7f409eaa4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4098112c40 con 0x7f409810d120 2024-09-11T00:14:24.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.260+0000 7f409eaa4640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4098112f40 con 0x7f4098103b70 2024-09-11T00:14:24.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.260+0000 7f408ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4098104570 0x7f4098199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:24.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.260+0000 7f408ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4098104570 0x7f4098199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44780/0 (socket says 172.21.15.78:44780) 2024-09-11T00:14:24.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.260+0000 7f408ffff640 1 -- 172.21.15.78:0/2292921621 learned_addr learned my addr 172.21.15.78:0/2292921621 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:24.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.260+0000 7f409d041640 1 --2- 172.21.15.78:0/2292921621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409810d120 0x7f409819ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:24.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.260+0000 7f408ffff640 1 -- 172.21.15.78:0/2292921621 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4098103b70 msgr2=0x7f40981992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:24.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.260+0000 7f408ffff640 1 --2- 172.21.15.78:0/2292921621 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4098103b70 0x7f40981992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.260+0000 7f408ffff640 1 -- 172.21.15.78:0/2292921621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409810d120 msgr2=0x7f409819ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:24.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.260+0000 7f408ffff640 1 --2- 172.21.15.78:0/2292921621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409810d120 0x7f409819ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.260+0000 7f408ffff640 1 -- 172.21.15.78:0/2292921621 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f409819f380 con 0x7f4098104570 2024-09-11T00:14:24.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.261+0000 7f408ffff640 1 --2- 172.21.15.78:0/2292921621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4098104570 0x7f4098199810 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f408800b4a0 tx=0x7f408800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:24.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.261+0000 7f408dffb640 1 -- 172.21.15.78:0/2292921621 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4088014070 con 0x7f4098104570 2024-09-11T00:14:24.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.261+0000 7f408dffb640 1 -- 172.21.15.78:0/2292921621 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4088010ac0 con 0x7f4098104570 2024-09-11T00:14:24.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.261+0000 7f408dffb640 1 -- 172.21.15.78:0/2292921621 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4088017c30 con 0x7f4098104570 2024-09-11T00:14:24.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.261+0000 7f409eaa4640 1 -- 172.21.15.78:0/2292921621 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f409819f670 con 0x7f4098104570 2024-09-11T00:14:24.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.261+0000 7f409eaa4640 1 -- 172.21.15.78:0/2292921621 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40981a5f00 con 0x7f4098104570 2024-09-11T00:14:24.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.262+0000 7f409eaa4640 1 -- 172.21.15.78:0/2292921621 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4098103f50 con 0x7f4098104570 2024-09-11T00:14:24.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.263+0000 7f408dffb640 1 -- 172.21.15.78:0/2292921621 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f4088010610 con 0x7f4098104570 2024-09-11T00:14:24.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.264+0000 7f408dffb640 1 --2- 172.21.15.78:0/2292921621 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f40800b53b0 0x7f40800b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:24.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.264+0000 7f409c840640 1 --2- 172.21.15.78:0/2292921621 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f40800b53b0 0x7f40800b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:24.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.264+0000 7f408dffb640 1 -- 172.21.15.78:0/2292921621 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7712+0+0 (secure 0 0 0) 0x7f40880e5280 con 0x7f4098104570 2024-09-11T00:14:24.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.265+0000 7f409c840640 1 --2- 172.21.15.78:0/2292921621 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f40800b53b0 0x7f40800b7870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f40940096c0 tx=0x7f4094031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:24.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.267+0000 7f408dffb640 1 -- 172.21.15.78:0/2292921621 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f40880ac3a0 con 0x7f4098104570 2024-09-11T00:14:24.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:23 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2550154353' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T00:14:24.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:23 smithi138 ceph-mon[35019]: osdmap e71: 12 total, 12 up, 12 in 2024-09-11T00:14:24.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:23 smithi138 ceph-mon[35019]: pgmap v253: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:24.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.441+0000 7f409eaa4640 1 -- 172.21.15.78:0/2292921621 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f409819a400 con 0x7f4098104570 2024-09-11T00:14:24.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.897+0000 7f408dffb640 1 -- 172.21.15.78:0/2292921621 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7f40880abca0 con 0x7f4098104570 2024-09-11T00:14:24.899 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2024-09-11T00:14:24.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.899+0000 7f409eaa4640 1 -- 172.21.15.78:0/2292921621 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f40800b53b0 msgr2=0x7f40800b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:24.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.899+0000 7f409eaa4640 1 --2- 172.21.15.78:0/2292921621 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f40800b53b0 0x7f40800b7870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f40940096c0 tx=0x7f4094031400 comp rx=0 tx=0).stop 2024-09-11T00:14:24.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.899+0000 7f409eaa4640 1 -- 172.21.15.78:0/2292921621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4098104570 msgr2=0x7f4098199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:24.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.899+0000 7f409eaa4640 1 --2- 172.21.15.78:0/2292921621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4098104570 0x7f4098199810 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f408800b4a0 tx=0x7f408800b960 comp rx=0 tx=0).stop 2024-09-11T00:14:24.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.899+0000 7f409eaa4640 1 -- 172.21.15.78:0/2292921621 shutdown_connections 2024-09-11T00:14:24.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.899+0000 7f409eaa4640 1 --2- 172.21.15.78:0/2292921621 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f40800b53b0 0x7f40800b7870 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.899+0000 7f409eaa4640 1 --2- 172.21.15.78:0/2292921621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f409810d120 0x7f409819ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.899+0000 7f409eaa4640 1 --2- 172.21.15.78:0/2292921621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4098104570 0x7f4098199810 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.899+0000 7f409eaa4640 1 --2- 172.21.15.78:0/2292921621 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4098103b70 0x7f40981992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:24.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.900+0000 7f409eaa4640 1 -- 172.21.15.78:0/2292921621 >> 172.21.15.78:0/2292921621 conn(0x7f40980fd700 msgr2=0x7f40980fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:24.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.900+0000 7f409eaa4640 1 -- 172.21.15.78:0/2292921621 shutdown_connections 2024-09-11T00:14:24.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:24.900+0000 7f409eaa4640 1 -- 172.21.15.78:0/2292921621 wait complete. 2024-09-11T00:14:25.219 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:24 smithi078 ceph-mon[30865]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T00:14:25.219 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:24 smithi078 ceph-mon[30865]: osdmap e72: 12 total, 12 up, 12 in 2024-09-11T00:14:25.219 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:24 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2292921621' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-11T00:14:25.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:24 smithi112 ceph-mon[35627]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T00:14:25.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:24 smithi112 ceph-mon[35627]: osdmap e72: 12 total, 12 up, 12 in 2024-09-11T00:14:25.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:24 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2292921621' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-11T00:14:25.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:24 smithi138 ceph-mon[35019]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T00:14:25.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:24 smithi138 ceph-mon[35019]: osdmap e72: 12 total, 12 up, 12 in 2024-09-11T00:14:25.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:24 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2292921621' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-11T00:14:25.518 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T00:14:25.763 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:26.158 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:25 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2292921621' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T00:14:26.158 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:25 smithi078 ceph-mon[30865]: osdmap e73: 12 total, 12 up, 12 in 2024-09-11T00:14:26.159 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:25 smithi078 ceph-mon[30865]: pgmap v256: 97 pgs: 10 active+clean, 15 creating+peering, 72 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:26.159 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:25 smithi078 ceph-mon[30865]: osdmap e74: 12 total, 12 up, 12 in 2024-09-11T00:14:26.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:25 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2292921621' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T00:14:26.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:25 smithi112 ceph-mon[35627]: osdmap e73: 12 total, 12 up, 12 in 2024-09-11T00:14:26.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:25 smithi112 ceph-mon[35627]: pgmap v256: 97 pgs: 10 active+clean, 15 creating+peering, 72 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:26.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:25 smithi112 ceph-mon[35627]: osdmap e74: 12 total, 12 up, 12 in 2024-09-11T00:14:26.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.240+0000 7f6d41e1c640 1 -- 172.21.15.78:0/1617493664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d3c1076a0 msgr2=0x7f6d3c107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:26.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.240+0000 7f6d41e1c640 1 --2- 172.21.15.78:0/1617493664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d3c1076a0 0x7f6d3c107ae0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009900 tx=0x7f6d2402a410 comp rx=0 tx=0).stop 2024-09-11T00:14:26.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.240+0000 7f6d41e1c640 1 -- 172.21.15.78:0/1617493664 shutdown_connections 2024-09-11T00:14:26.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.240+0000 7f6d41e1c640 1 --2- 172.21.15.78:0/1617493664 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d3c108020 0x7f6d3c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:26.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.240+0000 7f6d41e1c640 1 --2- 172.21.15.78:0/1617493664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d3c1076a0 0x7f6d3c107ae0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:26.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.240+0000 7f6d41e1c640 1 --2- 172.21.15.78:0/1617493664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d3c101c90 0x7f6d3c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:26.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.240+0000 7f6d41e1c640 1 -- 172.21.15.78:0/1617493664 >> 172.21.15.78:0/1617493664 conn(0x7f6d3c0fd6e0 msgr2=0x7f6d3c0ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:26.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.240+0000 7f6d41e1c640 1 -- 172.21.15.78:0/1617493664 shutdown_connections 2024-09-11T00:14:26.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.240+0000 7f6d41e1c640 1 -- 172.21.15.78:0/1617493664 wait complete. 2024-09-11T00:14:26.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.240+0000 7f6d41e1c640 1 Processor -- start 2024-09-11T00:14:26.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.241+0000 7f6d41e1c640 1 -- start start 2024-09-11T00:14:26.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.241+0000 7f6d41e1c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d3c101c90 0x7f6d3c199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:26.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.241+0000 7f6d41e1c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d3c1076a0 0x7f6d3c199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:26.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.241+0000 7f6d41e1c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d3c108020 0x7f6d3c19eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.241+0000 7f6d41e1c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c111ce0 con 0x7f6d3c108020 2024-09-11T00:14:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.241+0000 7f6d41e1c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c111b60 con 0x7f6d3c101c90 2024-09-11T00:14:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.241+0000 7f6d41e1c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c111e60 con 0x7f6d3c1076a0 2024-09-11T00:14:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.241+0000 7f6d3bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d3c108020 0x7f6d3c19eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.241+0000 7f6d3bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d3c108020 0x7f6d3c19eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51396/0 (socket says 172.21.15.78:51396) 2024-09-11T00:14:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.241+0000 7f6d3bfff640 1 -- 172.21.15.78:0/766905522 learned_addr learned my addr 172.21.15.78:0/766905522 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.241+0000 7f6d32ffd640 1 --2- 172.21.15.78:0/766905522 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d3c1076a0 0x7f6d3c199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.241+0000 7f6d3b7fe640 1 --2- 172.21.15.78:0/766905522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d3c101c90 0x7f6d3c199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.241+0000 7f6d3bfff640 1 -- 172.21.15.78:0/766905522 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d3c1076a0 msgr2=0x7f6d3c199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.241+0000 7f6d3bfff640 1 --2- 172.21.15.78:0/766905522 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d3c1076a0 0x7f6d3c199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.241+0000 7f6d3bfff640 1 -- 172.21.15.78:0/766905522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d3c101c90 msgr2=0x7f6d3c199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.241+0000 7f6d3bfff640 1 --2- 172.21.15.78:0/766905522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d3c101c90 0x7f6d3c199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.241+0000 7f6d3bfff640 1 -- 172.21.15.78:0/766905522 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d3c19f300 con 0x7f6d3c108020 2024-09-11T00:14:26.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.241+0000 7f6d3b7fe640 1 --2- 172.21.15.78:0/766905522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d3c101c90 0x7f6d3c199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:26.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.242+0000 7f6d3bfff640 1 --2- 172.21.15.78:0/766905522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d3c108020 0x7f6d3c19eb30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6d3400b970 tx=0x7f6d3400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:26.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.242+0000 7f6d397fa640 1 -- 172.21.15.78:0/766905522 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d34019070 con 0x7f6d3c108020 2024-09-11T00:14:26.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.242+0000 7f6d397fa640 1 -- 172.21.15.78:0/766905522 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d34014440 con 0x7f6d3c108020 2024-09-11T00:14:26.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.242+0000 7f6d397fa640 1 -- 172.21.15.78:0/766905522 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d340075d0 con 0x7f6d3c108020 2024-09-11T00:14:26.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.242+0000 7f6d41e1c640 1 -- 172.21.15.78:0/766905522 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d3c19f5f0 con 0x7f6d3c108020 2024-09-11T00:14:26.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.242+0000 7f6d41e1c640 1 -- 172.21.15.78:0/766905522 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d3c1a5d30 con 0x7f6d3c108020 2024-09-11T00:14:26.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.243+0000 7f6d41e1c640 1 -- 172.21.15.78:0/766905522 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d3c102070 con 0x7f6d3c108020 2024-09-11T00:14:26.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.244+0000 7f6d397fa640 1 -- 172.21.15.78:0/766905522 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f6d3400cb40 con 0x7f6d3c108020 2024-09-11T00:14:26.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.245+0000 7f6d397fa640 1 --2- 172.21.15.78:0/766905522 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f6d280b53b0 0x7f6d280b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:26.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.245+0000 7f6d3b7fe640 1 --2- 172.21.15.78:0/766905522 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f6d280b53b0 0x7f6d280b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:26.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.245+0000 7f6d397fa640 1 -- 172.21.15.78:0/766905522 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8094+0+0 (secure 0 0 0) 0x7f6d340e5770 con 0x7f6d3c108020 2024-09-11T00:14:26.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.245+0000 7f6d3b7fe640 1 --2- 172.21.15.78:0/766905522 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f6d280b53b0 0x7f6d280b7870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c00baa0 tx=0x7f6d2c005d90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:26.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.248+0000 7f6d397fa640 1 -- 172.21.15.78:0/766905522 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6d340ac6f0 con 0x7f6d3c108020 2024-09-11T00:14:26.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:25 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2292921621' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T00:14:26.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:25 smithi138 ceph-mon[35019]: osdmap e73: 12 total, 12 up, 12 in 2024-09-11T00:14:26.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:25 smithi138 ceph-mon[35019]: pgmap v256: 97 pgs: 10 active+clean, 15 creating+peering, 72 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:26.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:25 smithi138 ceph-mon[35019]: osdmap e74: 12 total, 12 up, 12 in 2024-09-11T00:14:26.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.460+0000 7f6d41e1c640 1 -- 172.21.15.78:0/766905522 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6d3c1a6090 con 0x7f6d3c108020 2024-09-11T00:14:26.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.926+0000 7f6d397fa640 1 -- 172.21.15.78:0/766905522 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f6d340abff0 con 0x7f6d3c108020 2024-09-11T00:14:26.928 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 2 and data pool 3 2024-09-11T00:14:26.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.928+0000 7f6d41e1c640 1 -- 172.21.15.78:0/766905522 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f6d280b53b0 msgr2=0x7f6d280b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:26.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.928+0000 7f6d41e1c640 1 --2- 172.21.15.78:0/766905522 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f6d280b53b0 0x7f6d280b7870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c00baa0 tx=0x7f6d2c005d90 comp rx=0 tx=0).stop 2024-09-11T00:14:26.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.928+0000 7f6d41e1c640 1 -- 172.21.15.78:0/766905522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d3c108020 msgr2=0x7f6d3c19eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:26.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.928+0000 7f6d41e1c640 1 --2- 172.21.15.78:0/766905522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d3c108020 0x7f6d3c19eb30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6d3400b970 tx=0x7f6d3400be30 comp rx=0 tx=0).stop 2024-09-11T00:14:26.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.929+0000 7f6d41e1c640 1 -- 172.21.15.78:0/766905522 shutdown_connections 2024-09-11T00:14:26.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.929+0000 7f6d41e1c640 1 --2- 172.21.15.78:0/766905522 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f6d280b53b0 0x7f6d280b7870 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:26.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.929+0000 7f6d41e1c640 1 --2- 172.21.15.78:0/766905522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d3c108020 0x7f6d3c19eb30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:26.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.929+0000 7f6d41e1c640 1 --2- 172.21.15.78:0/766905522 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d3c1076a0 0x7f6d3c199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:26.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.929+0000 7f6d41e1c640 1 --2- 172.21.15.78:0/766905522 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d3c101c90 0x7f6d3c199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:26.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.929+0000 7f6d41e1c640 1 -- 172.21.15.78:0/766905522 >> 172.21.15.78:0/766905522 conn(0x7f6d3c0fd6e0 msgr2=0x7f6d3c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:26.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.929+0000 7f6d41e1c640 1 -- 172.21.15.78:0/766905522 shutdown_connections 2024-09-11T00:14:26.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:26.929+0000 7f6d41e1c640 1 -- 172.21.15.78:0/766905522 wait complete. 2024-09-11T00:14:27.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:26 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/766905522' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-11T00:14:27.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:26 smithi112 ceph-mon[35627]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-11T00:14:27.244 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:26 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/766905522' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-11T00:14:27.245 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:26 smithi078 ceph-mon[30865]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-11T00:14:27.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:26 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/766905522' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-11T00:14:27.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:26 smithi138 ceph-mon[35019]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-11T00:14:27.609 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:14:27.855 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:28.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:27 smithi112 ceph-mon[35627]: osdmap e75: 12 total, 12 up, 12 in 2024-09-11T00:14:28.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:27 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/766905522' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T00:14:28.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:27 smithi112 ceph-mon[35627]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-11T00:14:28.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:27 smithi112 ceph-mon[35627]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-11T00:14:28.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:27 smithi112 ceph-mon[35627]: pgmap v259: 97 pgs: 26 active+clean, 21 creating+peering, 50 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:28.275 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:27 smithi078 ceph-mon[30865]: osdmap e75: 12 total, 12 up, 12 in 2024-09-11T00:14:28.275 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:27 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/766905522' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T00:14:28.275 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:27 smithi078 ceph-mon[30865]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-11T00:14:28.275 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:27 smithi078 ceph-mon[30865]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-11T00:14:28.275 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:27 smithi078 ceph-mon[30865]: pgmap v259: 97 pgs: 26 active+clean, 21 creating+peering, 50 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:28.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:27 smithi138 ceph-mon[35019]: osdmap e75: 12 total, 12 up, 12 in 2024-09-11T00:14:28.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:27 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/766905522' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T00:14:28.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:27 smithi138 ceph-mon[35019]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-11T00:14:28.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:27 smithi138 ceph-mon[35019]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-11T00:14:28.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:27 smithi138 ceph-mon[35019]: pgmap v259: 97 pgs: 26 active+clean, 21 creating+peering, 50 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:14:28.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.355+0000 7f133426d640 1 -- 172.21.15.78:0/1522997440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f132c10d100 msgr2=0x7f132c10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.355+0000 7f133426d640 1 --2- 172.21.15.78:0/1522997440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f132c10d100 0x7f132c10f560 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1324009ca0 tx=0x7f132402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.355+0000 7f133426d640 1 -- 172.21.15.78:0/1522997440 shutdown_connections 2024-09-11T00:14:28.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.355+0000 7f133426d640 1 --2- 172.21.15.78:0/1522997440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f132c10d100 0x7f132c10f560 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.355+0000 7f133426d640 1 --2- 172.21.15.78:0/1522997440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f132c1045c0 0x7f132c10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.355+0000 7f133426d640 1 --2- 172.21.15.78:0/1522997440 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f132c103ca0 0x7f132c104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.355+0000 7f133426d640 1 -- 172.21.15.78:0/1522997440 >> 172.21.15.78:0/1522997440 conn(0x7f132c0fd700 msgr2=0x7f132c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:28.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.355+0000 7f133426d640 1 -- 172.21.15.78:0/1522997440 shutdown_connections 2024-09-11T00:14:28.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.355+0000 7f133426d640 1 -- 172.21.15.78:0/1522997440 wait complete. 2024-09-11T00:14:28.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.355+0000 7f133426d640 1 Processor -- start 2024-09-11T00:14:28.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.355+0000 7f133426d640 1 -- start start 2024-09-11T00:14:28.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f133426d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f132c103ca0 0x7f132c199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:28.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f133426d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f132c1045c0 0x7f132c199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:28.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f133426d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f132c10d100 0x7f132c19ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:28.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f133426d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f132c112d70 con 0x7f132c10d100 2024-09-11T00:14:28.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f133426d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f132c112bf0 con 0x7f132c1045c0 2024-09-11T00:14:28.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f133426d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f132c112ef0 con 0x7f132c103ca0 2024-09-11T00:14:28.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f133280a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f132c10d100 0x7f132c19ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:28.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f133280a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f132c10d100 0x7f132c19ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51416/0 (socket says 172.21.15.78:51416) 2024-09-11T00:14:28.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f133280a640 1 -- 172.21.15.78:0/41512918 learned_addr learned my addr 172.21.15.78:0/41512918 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:28.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f1331808640 1 --2- 172.21.15.78:0/41512918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f132c1045c0 0x7f132c199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:28.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f1332009640 1 --2- 172.21.15.78:0/41512918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f132c103ca0 0x7f132c199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:28.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f133280a640 1 -- 172.21.15.78:0/41512918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f132c103ca0 msgr2=0x7f132c199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f133280a640 1 --2- 172.21.15.78:0/41512918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f132c103ca0 0x7f132c199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f133280a640 1 -- 172.21.15.78:0/41512918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f132c1045c0 msgr2=0x7f132c199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f133280a640 1 --2- 172.21.15.78:0/41512918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f132c1045c0 0x7f132c199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f133280a640 1 -- 172.21.15.78:0/41512918 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132c19f3f0 con 0x7f132c10d100 2024-09-11T00:14:28.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f1332009640 1 --2- 172.21.15.78:0/41512918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f132c103ca0 0x7f132c199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:28.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f1331808640 1 --2- 172.21.15.78:0/41512918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f132c1045c0 0x7f132c199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:28.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f133280a640 1 --2- 172.21.15.78:0/41512918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f132c10d100 0x7f132c19ec20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1324005cc0 tx=0x7f132402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:28.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f13237fe640 1 -- 172.21.15.78:0/41512918 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1324003bf0 con 0x7f132c10d100 2024-09-11T00:14:28.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f13237fe640 1 -- 172.21.15.78:0/41512918 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1324003d90 con 0x7f132c10d100 2024-09-11T00:14:28.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f133426d640 1 -- 172.21.15.78:0/41512918 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f132c19f680 con 0x7f132c10d100 2024-09-11T00:14:28.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.356+0000 7f13237fe640 1 -- 172.21.15.78:0/41512918 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f132402fbc0 con 0x7f132c10d100 2024-09-11T00:14:28.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.357+0000 7f133426d640 1 -- 172.21.15.78:0/41512918 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f132c1a5da0 con 0x7f132c10d100 2024-09-11T00:14:28.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.357+0000 7f133426d640 1 -- 172.21.15.78:0/41512918 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f132c104080 con 0x7f132c10d100 2024-09-11T00:14:28.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.359+0000 7f13237fe640 1 -- 172.21.15.78:0/41512918 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f1324004610 con 0x7f132c10d100 2024-09-11T00:14:28.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.359+0000 7f13237fe640 1 --2- 172.21.15.78:0/41512918 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f13180b5330 0x7f13180b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:28.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.360+0000 7f1332009640 1 --2- 172.21.15.78:0/41512918 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f13180b5330 0x7f13180b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:28.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.360+0000 7f13237fe640 1 -- 172.21.15.78:0/41512918 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f1324107360 con 0x7f132c10d100 2024-09-11T00:14:28.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.360+0000 7f1332009640 1 --2- 172.21.15.78:0/41512918 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f13180b5330 0x7f13180b77f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1328009b40 tx=0x7f1328005e50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:28.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.366+0000 7f13237fe640 1 -- 172.21.15.78:0/41512918 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f13240ce240 con 0x7f132c10d100 2024-09-11T00:14:28.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.550+0000 7f133426d640 1 -- 172.21.15.78:0/41512918 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f132c108120 con 0x7f132c10d100 2024-09-11T00:14:28.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.552+0000 7f13237fe640 1 -- 172.21.15.78:0/41512918 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22621 (secure 0 0 0) 0x7f13240cdb40 con 0x7f132c10d100 2024-09-11T00:14:28.554 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:14:28.554 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":75,"fsid":"85a53860-6fd1-11ef-bcea-c7b262605968","created":"2024-09-11T00:06:05.704745+0000","modified":"2024-09-11T00:14:26.461780+0000","last_up_change":"2024-09-11T00:13:35.307216+0000","last_in_change":"2024-09-11T00:13:12.730667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:09:47.891696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:22.345345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:24.446029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d260c219-52f2-4e7f-9188-9e66ee01dacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6803","nonce":3736366730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6805","nonce":3736366730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6809","nonce":3736366730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6807","nonce":3736366730}]},"public_addr":"172.21.15.78:6803/3736366730","cluster_addr":"172.21.15.78:6805/3736366730","heartbeat_back_addr":"172.21.15.78:6809/3736366730","heartbeat_front_addr":"172.21.15.78:6807/3736366730","state":["exists","up"]},{"osd":1,"uuid":"d0f286a2-a121-40ee-8134-67ef01b1bc9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6801","nonce":3186321784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6803","nonce":3186321784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6807","nonce":3186321784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6805","nonce":3186321784}]},"public_addr":"172.21.15.112:6801/3186321784","cluster_addr":"172.21.15.112:6803/3186321784","heartbeat_back_addr":"172.21.15.112:6807/3186321784","heartbeat_front_addr":"172.21.15.112:6805/3186321784","state":["exists","up"]},{"osd":2,"uuid":"0eadcce5-12af-4af6-9b4e-159e84454d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6801","nonce":3206386630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6803","nonce":3206386630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6807","nonce":3206386630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6805","nonce":3206386630}]},"public_addr":"172.21.15.138:6801/3206386630","cluster_addr":"172.21.15.138:6803/3206386630","heartbeat_back_addr":"172.21.15.138:6807/3206386630","heartbeat_front_addr":"172.21.15.138:6805/3206386630","state":["exists","up"]},{"osd":3,"uuid":"5f3f683d-6306-43da-8bbd-c103eca442ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6811","nonce":3832405256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6813","nonce":3832405256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6817","nonce":3832405256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6815","nonce":3832405256}]},"public_addr":"172.21.15.78:6811/3832405256","cluster_addr":"172.21.15.78:6813/3832405256","heartbeat_back_addr":"172.21.15.78:6817/3832405256","heartbeat_front_addr":"172.21.15.78:6815/3832405256","state":["exists","up"]},{"osd":4,"uuid":"4575a0a5-821e-4346-84ac-5396042b0550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6809","nonce":2650243435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6811","nonce":2650243435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6815","nonce":2650243435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6813","nonce":2650243435}]},"public_addr":"172.21.15.112:6809/2650243435","cluster_addr":"172.21.15.112:6811/2650243435","heartbeat_back_addr":"172.21.15.112:6815/2650243435","heartbeat_front_addr":"172.21.15.112:6813/2650243435","state":["exists","up"]},{"osd":5,"uuid":"e81eb98f-76eb-4da5-8047-f160888720e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6809","nonce":3033110975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6811","nonce":3033110975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6815","nonce":3033110975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6813","nonce":3033110975}]},"public_addr":"172.21.15.138:6809/3033110975","cluster_addr":"172.21.15.138:6811/3033110975","heartbeat_back_addr":"172.21.15.138:6815/3033110975","heartbeat_front_addr":"172.21.15.138:6813/3033110975","state":["exists","up"]},{"osd":6,"uuid":"7442a091-4dba-45c4-808b-7c3b97087aa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6819","nonce":477087575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6821","nonce":477087575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6825","nonce":477087575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6823","nonce":477087575}]},"public_addr":"172.21.15.78:6819/477087575","cluster_addr":"172.21.15.78:6821/477087575","heartbeat_back_addr":"172.21.15.78:6825/477087575","heartbeat_front_addr":"172.21.15.78:6823/477087575","state":["exists","up"]},{"osd":7,"uuid":"220c1f03-ace9-4dd0-a06d-485b0d2d08bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6817","nonce":1481363296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6819","nonce":1481363296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6823","nonce":1481363296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6821","nonce":1481363296}]},"public_addr":"172.21.15.112:6817/1481363296","cluster_addr":"172.21.15.112:6819/1481363296","heartbeat_back_addr":"172.21.15.112:6823/1481363296","heartbeat_front_addr":"172.21.15.112:6821/1481363296","state":["exists","up"]},{"osd":8,"uuid":"adb6edaa-9a8c-4b0b-aa6a-26dc77a3a7cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6817","nonce":2195149036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6819","nonce":2195149036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6823","nonce":2195149036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6821","nonce":2195149036}]},"public_addr":"172.21.15.138:6817/2195149036","cluster_addr":"172.21.15.138:6819/2195149036","heartbeat_back_addr":"172.21.15.138:6823/2195149036","heartbeat_front_addr":"172.21.15.138:6821/2195149036","state":["exists","up"]},{"osd":9,"uuid":"dd01f408-3712-410e-acbd-c797b7ea5058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6827","nonce":3367249449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6829","nonce":3367249449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6833","nonce":3367249449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6831","nonce":3367249449}]},"public_addr":"172.21.15.78:6827/3367249449","cluster_addr":"172.21.15.78:6829/3367249449","heartbeat_back_addr":"172.21.15.78:6833/3367249449","heartbeat_front_addr":"172.21.15.78:6831/3367249449","state":["exists","up"]},{"osd":10,"uuid":"243c6483-1b0e-49f2-b99c-116d9e9c0617","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6825","nonce":775023408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6827","nonce":775023408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6831","nonce":775023408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6829","nonce":775023408}]},"public_addr":"172.21.15.112:6825/775023408","cluster_addr":"172.21.15.112:6827/775023408","heartbeat_back_addr":"172.21.15.112:6831/775023408","heartbeat_front_addr":"172.21.15.112:6829/775023408","state":["exists","up"]},{"osd":11,"uuid":"fa20ac9e-b5f7-4b3a-bb51-31569f909609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6825","nonce":4046089012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6827","nonce":4046089012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6831","nonce":4046089012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6829","nonce":4046089012}]},"public_addr":"172.21.15.138:6825/4046089012","cluster_addr":"172.21.15.138:6827/4046089012","heartbeat_back_addr":"172.21.15.138:6831/4046089012","heartbeat_front_addr":"172.21.15.138:6829/4046089012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:08:55.896475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:20.695819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:44.785187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:10.858705+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:35.855800+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:01.353037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:27.492985+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:52.860532+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:17.946878+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:43.188966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:08.369978+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:34.192288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6801/2525199237":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/1476776463":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1949658157":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2276853910":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/4205790529":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6800/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/4286825123":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6801/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1304243506":"2024-09-12T00:06:56.062555+0000","172.21.15.78:6800/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1614270050":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6801/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1679390655":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2957982486":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6800/2525199237":"2024-09-12T00:07:55.586578+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:14:28.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.555+0000 7f133426d640 1 -- 172.21.15.78:0/41512918 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f13180b5330 msgr2=0x7f13180b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.555+0000 7f133426d640 1 --2- 172.21.15.78:0/41512918 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f13180b5330 0x7f13180b77f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1328009b40 tx=0x7f1328005e50 comp rx=0 tx=0).stop 2024-09-11T00:14:28.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.555+0000 7f133426d640 1 -- 172.21.15.78:0/41512918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f132c10d100 msgr2=0x7f132c19ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:28.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.555+0000 7f133426d640 1 --2- 172.21.15.78:0/41512918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f132c10d100 0x7f132c19ec20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1324005cc0 tx=0x7f132402f380 comp rx=0 tx=0).stop 2024-09-11T00:14:28.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.555+0000 7f133426d640 1 -- 172.21.15.78:0/41512918 shutdown_connections 2024-09-11T00:14:28.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.555+0000 7f133426d640 1 --2- 172.21.15.78:0/41512918 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f13180b5330 0x7f13180b77f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.555+0000 7f133426d640 1 --2- 172.21.15.78:0/41512918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f132c10d100 0x7f132c19ec20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.555+0000 7f133426d640 1 --2- 172.21.15.78:0/41512918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f132c1045c0 0x7f132c199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.555+0000 7f133426d640 1 --2- 172.21.15.78:0/41512918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f132c103ca0 0x7f132c199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:28.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.555+0000 7f133426d640 1 -- 172.21.15.78:0/41512918 >> 172.21.15.78:0/41512918 conn(0x7f132c0fd700 msgr2=0x7f132c0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:28.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.555+0000 7f133426d640 1 -- 172.21.15.78:0/41512918 shutdown_connections 2024-09-11T00:14:28.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:28.555+0000 7f133426d640 1 -- 172.21.15.78:0/41512918 wait complete. 2024-09-11T00:14:29.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:28 smithi112 ceph-mon[35627]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T00:14:29.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:28 smithi112 ceph-mon[35627]: Cluster is now healthy 2024-09-11T00:14:29.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:28 smithi112 ceph-mon[35627]: mds.? [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] up:active 2024-09-11T00:14:29.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:28 smithi112 ceph-mon[35627]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T00:14:29.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:28 smithi112 ceph-mon[35627]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T00:14:29.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:28 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/41512918' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:14:29.239 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:28 smithi078 ceph-mon[30865]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T00:14:29.239 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:28 smithi078 ceph-mon[30865]: Cluster is now healthy 2024-09-11T00:14:29.239 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:28 smithi078 ceph-mon[30865]: mds.? [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] up:active 2024-09-11T00:14:29.239 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:28 smithi078 ceph-mon[30865]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T00:14:29.239 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:28 smithi078 ceph-mon[30865]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T00:14:29.240 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:28 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/41512918' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:14:29.267 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:14:29.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:28 smithi138 ceph-mon[35019]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T00:14:29.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:28 smithi138 ceph-mon[35019]: Cluster is now healthy 2024-09-11T00:14:29.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:28 smithi138 ceph-mon[35019]: mds.? [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] up:active 2024-09-11T00:14:29.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:28 smithi138 ceph-mon[35019]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T00:14:29.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:28 smithi138 ceph-mon[35019]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T00:14:29.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:28 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/41512918' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:14:29.520 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:30.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.989+0000 7fe730592640 1 -- 172.21.15.78:0/1028884284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe72810a920 msgr2=0x7fe72810cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:30.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.989+0000 7fe730592640 1 --2- 172.21.15.78:0/1028884284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe72810a920 0x7fe72810cd10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe724009900 tx=0x7fe72402a410 comp rx=0 tx=0).stop 2024-09-11T00:14:30.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.989+0000 7fe730592640 1 -- 172.21.15.78:0/1028884284 shutdown_connections 2024-09-11T00:14:30.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.989+0000 7fe730592640 1 --2- 172.21.15.78:0/1028884284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe72810d250 0x7fe72810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:30.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.989+0000 7fe730592640 1 --2- 172.21.15.78:0/1028884284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe72810a920 0x7fe72810cd10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:30.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.989+0000 7fe730592640 1 --2- 172.21.15.78:0/1028884284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe728101810 0x7fe728101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:30.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.989+0000 7fe730592640 1 -- 172.21.15.78:0/1028884284 >> 172.21.15.78:0/1028884284 conn(0x7fe728076f50 msgr2=0x7fe728077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:30.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.989+0000 7fe730592640 1 -- 172.21.15.78:0/1028884284 shutdown_connections 2024-09-11T00:14:30.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.989+0000 7fe730592640 1 -- 172.21.15.78:0/1028884284 wait complete. 2024-09-11T00:14:30.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.990+0000 7fe730592640 1 Processor -- start 2024-09-11T00:14:30.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.990+0000 7fe730592640 1 -- start start 2024-09-11T00:14:30.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.990+0000 7fe730592640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe728101810 0x7fe7281993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:30.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.990+0000 7fe730592640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe72810a920 0x7fe728199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:30.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.990+0000 7fe730592640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe72810d250 0x7fe72819eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:30.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.990+0000 7fe730592640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe728112e30 con 0x7fe728101810 2024-09-11T00:14:30.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.990+0000 7fe730592640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe728112cb0 con 0x7fe72810d250 2024-09-11T00:14:30.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.990+0000 7fe730592640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe728112fb0 con 0x7fe72810a920 2024-09-11T00:14:30.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.990+0000 7fe72e32e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe728101810 0x7fe7281993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:30.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.990+0000 7fe72e32e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe728101810 0x7fe7281993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51428/0 (socket says 172.21.15.78:51428) 2024-09-11T00:14:30.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.990+0000 7fe72e32e640 1 -- 172.21.15.78:0/2914506501 learned_addr learned my addr 172.21.15.78:0/2914506501 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:30.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.990+0000 7fe72db2d640 1 --2- 172.21.15.78:0/2914506501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe72810a920 0x7fe728199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:30.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.990+0000 7fe72e32e640 1 -- 172.21.15.78:0/2914506501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe72810a920 msgr2=0x7fe728199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:30.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.990+0000 7fe72e32e640 1 --2- 172.21.15.78:0/2914506501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe72810a920 0x7fe728199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:30.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.990+0000 7fe72e32e640 1 -- 172.21.15.78:0/2914506501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe72810d250 msgr2=0x7fe72819eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.990+0000 7fe72e32e640 1 --2- 172.21.15.78:0/2914506501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe72810d250 0x7fe72819eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.990+0000 7fe72e32e640 1 -- 172.21.15.78:0/2914506501 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72819f470 con 0x7fe728101810 2024-09-11T00:14:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.990+0000 7fe72e32e640 1 --2- 172.21.15.78:0/2914506501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe728101810 0x7fe7281993c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00b4a0 tx=0x7fe71c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.990+0000 7fe71b7fe640 1 -- 172.21.15.78:0/2914506501 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c014070 con 0x7fe728101810 2024-09-11T00:14:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.990+0000 7fe730592640 1 -- 172.21.15.78:0/2914506501 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe72819f760 con 0x7fe728101810 2024-09-11T00:14:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.990+0000 7fe71b7fe640 1 -- 172.21.15.78:0/2914506501 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe71c010ac0 con 0x7fe728101810 2024-09-11T00:14:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.990+0000 7fe71b7fe640 1 -- 172.21.15.78:0/2914506501 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c017c30 con 0x7fe728101810 2024-09-11T00:14:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.991+0000 7fe730592640 1 -- 172.21.15.78:0/2914506501 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7281a5ff0 con 0x7fe728101810 2024-09-11T00:14:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.992+0000 7fe730592640 1 -- 172.21.15.78:0/2914506501 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe728101c70 con 0x7fe728101810 2024-09-11T00:14:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.993+0000 7fe71b7fe640 1 -- 172.21.15.78:0/2914506501 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7fe71c010610 con 0x7fe728101810 2024-09-11T00:14:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.994+0000 7fe71b7fe640 1 --2- 172.21.15.78:0/2914506501 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe7140b5330 0x7fe7140b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.994+0000 7fe72db2d640 1 --2- 172.21.15.78:0/2914506501 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe7140b5330 0x7fe7140b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.994+0000 7fe71b7fe640 1 -- 172.21.15.78:0/2914506501 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fe71c0e5530 con 0x7fe728101810 2024-09-11T00:14:30.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.994+0000 7fe72db2d640 1 --2- 172.21.15.78:0/2914506501 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe7140b5330 0x7fe7140b77f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe724031440 tx=0x7fe7240095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:30.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:29.997+0000 7fe71b7fe640 1 -- 172.21.15.78:0/2914506501 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe71c0ac410 con 0x7fe728101810 2024-09-11T00:14:30.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:29 smithi078 ceph-mon[30865]: pgmap v260: 97 pgs: 73 active+clean, 12 creating+peering, 12 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 1 op/s 2024-09-11T00:14:30.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:30.174+0000 7fe730592640 1 -- 172.21.15.78:0/2914506501 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe72819a4f0 con 0x7fe728101810 2024-09-11T00:14:30.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:30.175+0000 7fe71b7fe640 1 -- 172.21.15.78:0/2914506501 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22621 (secure 0 0 0) 0x7fe71c0abd10 con 0x7fe728101810 2024-09-11T00:14:30.177 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:14:30.177 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":75,"fsid":"85a53860-6fd1-11ef-bcea-c7b262605968","created":"2024-09-11T00:06:05.704745+0000","modified":"2024-09-11T00:14:26.461780+0000","last_up_change":"2024-09-11T00:13:35.307216+0000","last_in_change":"2024-09-11T00:13:12.730667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:09:47.891696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:22.345345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:24.446029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d260c219-52f2-4e7f-9188-9e66ee01dacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6803","nonce":3736366730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6805","nonce":3736366730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6809","nonce":3736366730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6807","nonce":3736366730}]},"public_addr":"172.21.15.78:6803/3736366730","cluster_addr":"172.21.15.78:6805/3736366730","heartbeat_back_addr":"172.21.15.78:6809/3736366730","heartbeat_front_addr":"172.21.15.78:6807/3736366730","state":["exists","up"]},{"osd":1,"uuid":"d0f286a2-a121-40ee-8134-67ef01b1bc9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6801","nonce":3186321784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6803","nonce":3186321784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6807","nonce":3186321784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6805","nonce":3186321784}]},"public_addr":"172.21.15.112:6801/3186321784","cluster_addr":"172.21.15.112:6803/3186321784","heartbeat_back_addr":"172.21.15.112:6807/3186321784","heartbeat_front_addr":"172.21.15.112:6805/3186321784","state":["exists","up"]},{"osd":2,"uuid":"0eadcce5-12af-4af6-9b4e-159e84454d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6801","nonce":3206386630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6803","nonce":3206386630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6807","nonce":3206386630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6805","nonce":3206386630}]},"public_addr":"172.21.15.138:6801/3206386630","cluster_addr":"172.21.15.138:6803/3206386630","heartbeat_back_addr":"172.21.15.138:6807/3206386630","heartbeat_front_addr":"172.21.15.138:6805/3206386630","state":["exists","up"]},{"osd":3,"uuid":"5f3f683d-6306-43da-8bbd-c103eca442ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6811","nonce":3832405256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6813","nonce":3832405256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6817","nonce":3832405256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6815","nonce":3832405256}]},"public_addr":"172.21.15.78:6811/3832405256","cluster_addr":"172.21.15.78:6813/3832405256","heartbeat_back_addr":"172.21.15.78:6817/3832405256","heartbeat_front_addr":"172.21.15.78:6815/3832405256","state":["exists","up"]},{"osd":4,"uuid":"4575a0a5-821e-4346-84ac-5396042b0550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6809","nonce":2650243435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6811","nonce":2650243435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6815","nonce":2650243435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6813","nonce":2650243435}]},"public_addr":"172.21.15.112:6809/2650243435","cluster_addr":"172.21.15.112:6811/2650243435","heartbeat_back_addr":"172.21.15.112:6815/2650243435","heartbeat_front_addr":"172.21.15.112:6813/2650243435","state":["exists","up"]},{"osd":5,"uuid":"e81eb98f-76eb-4da5-8047-f160888720e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6809","nonce":3033110975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6811","nonce":3033110975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6815","nonce":3033110975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6813","nonce":3033110975}]},"public_addr":"172.21.15.138:6809/3033110975","cluster_addr":"172.21.15.138:6811/3033110975","heartbeat_back_addr":"172.21.15.138:6815/3033110975","heartbeat_front_addr":"172.21.15.138:6813/3033110975","state":["exists","up"]},{"osd":6,"uuid":"7442a091-4dba-45c4-808b-7c3b97087aa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6819","nonce":477087575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6821","nonce":477087575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6825","nonce":477087575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6823","nonce":477087575}]},"public_addr":"172.21.15.78:6819/477087575","cluster_addr":"172.21.15.78:6821/477087575","heartbeat_back_addr":"172.21.15.78:6825/477087575","heartbeat_front_addr":"172.21.15.78:6823/477087575","state":["exists","up"]},{"osd":7,"uuid":"220c1f03-ace9-4dd0-a06d-485b0d2d08bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6817","nonce":1481363296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6819","nonce":1481363296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6823","nonce":1481363296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6821","nonce":1481363296}]},"public_addr":"172.21.15.112:6817/1481363296","cluster_addr":"172.21.15.112:6819/1481363296","heartbeat_back_addr":"172.21.15.112:6823/1481363296","heartbeat_front_addr":"172.21.15.112:6821/1481363296","state":["exists","up"]},{"osd":8,"uuid":"adb6edaa-9a8c-4b0b-aa6a-26dc77a3a7cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6817","nonce":2195149036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6819","nonce":2195149036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6823","nonce":2195149036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6821","nonce":2195149036}]},"public_addr":"172.21.15.138:6817/2195149036","cluster_addr":"172.21.15.138:6819/2195149036","heartbeat_back_addr":"172.21.15.138:6823/2195149036","heartbeat_front_addr":"172.21.15.138:6821/2195149036","state":["exists","up"]},{"osd":9,"uuid":"dd01f408-3712-410e-acbd-c797b7ea5058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6827","nonce":3367249449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6829","nonce":3367249449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6833","nonce":3367249449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6831","nonce":3367249449}]},"public_addr":"172.21.15.78:6827/3367249449","cluster_addr":"172.21.15.78:6829/3367249449","heartbeat_back_addr":"172.21.15.78:6833/3367249449","heartbeat_front_addr":"172.21.15.78:6831/3367249449","state":["exists","up"]},{"osd":10,"uuid":"243c6483-1b0e-49f2-b99c-116d9e9c0617","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6825","nonce":775023408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6827","nonce":775023408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6831","nonce":775023408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6829","nonce":775023408}]},"public_addr":"172.21.15.112:6825/775023408","cluster_addr":"172.21.15.112:6827/775023408","heartbeat_back_addr":"172.21.15.112:6831/775023408","heartbeat_front_addr":"172.21.15.112:6829/775023408","state":["exists","up"]},{"osd":11,"uuid":"fa20ac9e-b5f7-4b3a-bb51-31569f909609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6825","nonce":4046089012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6827","nonce":4046089012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6831","nonce":4046089012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6829","nonce":4046089012}]},"public_addr":"172.21.15.138:6825/4046089012","cluster_addr":"172.21.15.138:6827/4046089012","heartbeat_back_addr":"172.21.15.138:6831/4046089012","heartbeat_front_addr":"172.21.15.138:6829/4046089012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:08:55.896475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:20.695819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:44.785187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:10.858705+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:35.855800+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:01.353037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:27.492985+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:52.860532+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:17.946878+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:43.188966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:08.369978+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:34.192288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6801/2525199237":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/1476776463":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1949658157":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2276853910":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/4205790529":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6800/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/4286825123":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6801/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1304243506":"2024-09-12T00:06:56.062555+0000","172.21.15.78:6800/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1614270050":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6801/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1679390655":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2957982486":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6800/2525199237":"2024-09-12T00:07:55.586578+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:14:30.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:30.177+0000 7fe730592640 1 -- 172.21.15.78:0/2914506501 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe7140b5330 msgr2=0x7fe7140b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:30.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:30.177+0000 7fe730592640 1 --2- 172.21.15.78:0/2914506501 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe7140b5330 0x7fe7140b77f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe724031440 tx=0x7fe7240095f0 comp rx=0 tx=0).stop 2024-09-11T00:14:30.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:30.177+0000 7fe730592640 1 -- 172.21.15.78:0/2914506501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe728101810 msgr2=0x7fe7281993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:30.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:30.177+0000 7fe730592640 1 --2- 172.21.15.78:0/2914506501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe728101810 0x7fe7281993c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00b4a0 tx=0x7fe71c00b960 comp rx=0 tx=0).stop 2024-09-11T00:14:30.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:30.177+0000 7fe730592640 1 -- 172.21.15.78:0/2914506501 shutdown_connections 2024-09-11T00:14:30.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:30.177+0000 7fe730592640 1 --2- 172.21.15.78:0/2914506501 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe7140b5330 0x7fe7140b77f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:30.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:30.177+0000 7fe730592640 1 --2- 172.21.15.78:0/2914506501 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe72810d250 0x7fe72819eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:30.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:30.177+0000 7fe730592640 1 --2- 172.21.15.78:0/2914506501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe72810a920 0x7fe728199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:30.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:30.177+0000 7fe730592640 1 --2- 172.21.15.78:0/2914506501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe728101810 0x7fe7281993c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:30.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:30.177+0000 7fe730592640 1 -- 172.21.15.78:0/2914506501 >> 172.21.15.78:0/2914506501 conn(0x7fe728076f50 msgr2=0x7fe7281005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:30.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:30.177+0000 7fe730592640 1 -- 172.21.15.78:0/2914506501 shutdown_connections 2024-09-11T00:14:30.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:30.177+0000 7fe730592640 1 -- 172.21.15.78:0/2914506501 wait complete. 2024-09-11T00:14:30.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:29 smithi112 ceph-mon[35627]: pgmap v260: 97 pgs: 73 active+clean, 12 creating+peering, 12 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 1 op/s 2024-09-11T00:14:30.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:29 smithi138 ceph-mon[35019]: pgmap v260: 97 pgs: 73 active+clean, 12 creating+peering, 12 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 1 op/s 2024-09-11T00:14:30.878 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-11T00:14:31.126 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:31.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:30 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2914506501' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:14:31.246 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:30 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2914506501' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:14:31.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:30 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2914506501' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:14:31.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.630+0000 7ffa106b7640 1 -- 172.21.15.78:0/466883766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa08102dc0 msgr2=0x7ffa081031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:31.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.630+0000 7ffa106b7640 1 --2- 172.21.15.78:0/466883766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa08102dc0 0x7ffa081031a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ffa04009900 tx=0x7ffa0402a410 comp rx=0 tx=0).stop 2024-09-11T00:14:31.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.630+0000 7ffa106b7640 1 -- 172.21.15.78:0/466883766 shutdown_connections 2024-09-11T00:14:31.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.630+0000 7ffa106b7640 1 --2- 172.21.15.78:0/466883766 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa08109150 0x7ffa0810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:31.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.630+0000 7ffa106b7640 1 --2- 172.21.15.78:0/466883766 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa081087d0 0x7ffa08108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:31.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.630+0000 7ffa106b7640 1 --2- 172.21.15.78:0/466883766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa08102dc0 0x7ffa081031a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:31.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.630+0000 7ffa106b7640 1 -- 172.21.15.78:0/466883766 >> 172.21.15.78:0/466883766 conn(0x7ffa080fe830 msgr2=0x7ffa08100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:31.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.630+0000 7ffa106b7640 1 -- 172.21.15.78:0/466883766 shutdown_connections 2024-09-11T00:14:31.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.630+0000 7ffa106b7640 1 -- 172.21.15.78:0/466883766 wait complete. 2024-09-11T00:14:31.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.631+0000 7ffa106b7640 1 Processor -- start 2024-09-11T00:14:31.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.631+0000 7ffa106b7640 1 -- start start 2024-09-11T00:14:31.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.631+0000 7ffa106b7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa08102dc0 0x7ffa08199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:31.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.631+0000 7ffa106b7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa081087d0 0x7ffa08199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:31.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.631+0000 7ffa106b7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa08109150 0x7ffa0819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:31.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.631+0000 7ffa106b7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ffa08112e10 con 0x7ffa08102dc0 2024-09-11T00:14:31.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.631+0000 7ffa106b7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffa08112c90 con 0x7ffa081087d0 2024-09-11T00:14:31.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.631+0000 7ffa106b7640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ffa08112f90 con 0x7ffa08109150 2024-09-11T00:14:31.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.631+0000 7ffa0e453640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa08102dc0 0x7ffa08199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:31.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.631+0000 7ffa0e453640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa08102dc0 0x7ffa08199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51440/0 (socket says 172.21.15.78:51440) 2024-09-11T00:14:31.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.631+0000 7ffa0e453640 1 -- 172.21.15.78:0/1316818327 learned_addr learned my addr 172.21.15.78:0/1316818327 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:31.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.631+0000 7ffa0e453640 1 -- 172.21.15.78:0/1316818327 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa08109150 msgr2=0x7ffa0819ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:31.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.631+0000 7ffa0e453640 1 --2- 172.21.15.78:0/1316818327 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa08109150 0x7ffa0819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:31.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.631+0000 7ffa0e453640 1 -- 172.21.15.78:0/1316818327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa081087d0 msgr2=0x7ffa08199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:31.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.631+0000 7ffa0e453640 1 --2- 172.21.15.78:0/1316818327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa081087d0 0x7ffa08199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:31.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.631+0000 7ffa0e453640 1 -- 172.21.15.78:0/1316818327 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa0819f3b0 con 0x7ffa08102dc0 2024-09-11T00:14:31.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.632+0000 7ffa0e453640 1 --2- 172.21.15.78:0/1316818327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa08102dc0 0x7ffa08199300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ffa04005940 tx=0x7ffa040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:31.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.632+0000 7ff9ff7fe640 1 -- 172.21.15.78:0/1316818327 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0403f030 con 0x7ffa08102dc0 2024-09-11T00:14:31.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.632+0000 7ffa106b7640 1 -- 172.21.15.78:0/1316818327 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa0819f640 con 0x7ffa08102dc0 2024-09-11T00:14:31.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.632+0000 7ff9ff7fe640 1 -- 172.21.15.78:0/1316818327 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa04003cb0 con 0x7ffa08102dc0 2024-09-11T00:14:31.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.632+0000 7ff9ff7fe640 1 -- 172.21.15.78:0/1316818327 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04035070 con 0x7ffa08102dc0 2024-09-11T00:14:31.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.632+0000 7ffa106b7640 1 -- 172.21.15.78:0/1316818327 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa081a5d60 con 0x7ffa08102dc0 2024-09-11T00:14:31.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.633+0000 7ffa106b7640 1 -- 172.21.15.78:0/1316818327 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa081031a0 con 0x7ffa08102dc0 2024-09-11T00:14:31.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.634+0000 7ff9ff7fe640 1 -- 172.21.15.78:0/1316818327 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7ffa0403bbf0 con 0x7ffa08102dc0 2024-09-11T00:14:31.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.635+0000 7ff9ff7fe640 1 --2- 172.21.15.78:0/1316818327 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff9f40b5330 0x7ff9f40b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:31.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.635+0000 7ffa0dc52640 1 --2- 172.21.15.78:0/1316818327 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff9f40b5330 0x7ff9f40b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:31.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.635+0000 7ff9ff7fe640 1 -- 172.21.15.78:0/1316818327 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7ffa04106840 con 0x7ffa08102dc0 2024-09-11T00:14:31.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.635+0000 7ffa0dc52640 1 --2- 172.21.15.78:0/1316818327 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff9f40b5330 0x7ff9f40b77f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffa08108270 tx=0x7ff9f8006c90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:31.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.639+0000 7ff9ff7fe640 1 -- 172.21.15.78:0/1316818327 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ffa040cd720 con 0x7ffa08102dc0 2024-09-11T00:14:31.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.851+0000 7ffa106b7640 1 -- 172.21.15.78:0/1316818327 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ffa0802e5c0 con 0x7ffa08102dc0 2024-09-11T00:14:31.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.933+0000 7ff9ff7fe640 1 -- 172.21.15.78:0/1316818327 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7ffa040cd020 con 0x7ffa08102dc0 2024-09-11T00:14:31.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.936+0000 7ffa106b7640 1 -- 172.21.15.78:0/1316818327 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff9f40b5330 msgr2=0x7ff9f40b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:31.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.936+0000 7ffa106b7640 1 --2- 172.21.15.78:0/1316818327 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff9f40b5330 0x7ff9f40b77f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffa08108270 tx=0x7ff9f8006c90 comp rx=0 tx=0).stop 2024-09-11T00:14:31.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.936+0000 7ffa106b7640 1 -- 172.21.15.78:0/1316818327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa08102dc0 msgr2=0x7ffa08199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:31.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.936+0000 7ffa106b7640 1 --2- 172.21.15.78:0/1316818327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa08102dc0 0x7ffa08199300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ffa04005940 tx=0x7ffa040042f0 comp rx=0 tx=0).stop 2024-09-11T00:14:31.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.936+0000 7ffa106b7640 1 -- 172.21.15.78:0/1316818327 shutdown_connections 2024-09-11T00:14:31.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.936+0000 7ffa106b7640 1 --2- 172.21.15.78:0/1316818327 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff9f40b5330 0x7ff9f40b77f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:31.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.936+0000 7ffa106b7640 1 --2- 172.21.15.78:0/1316818327 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa08109150 0x7ffa0819ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:31.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.936+0000 7ffa106b7640 1 --2- 172.21.15.78:0/1316818327 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa081087d0 0x7ffa08199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:31.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.936+0000 7ffa106b7640 1 --2- 172.21.15.78:0/1316818327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa08102dc0 0x7ffa08199300 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:31.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.936+0000 7ffa106b7640 1 -- 172.21.15.78:0/1316818327 >> 172.21.15.78:0/1316818327 conn(0x7ffa080fe830 msgr2=0x7ffa08100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:31.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.936+0000 7ffa106b7640 1 -- 172.21.15.78:0/1316818327 shutdown_connections 2024-09-11T00:14:31.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:31.936+0000 7ffa106b7640 1 -- 172.21.15.78:0/1316818327 wait complete. 2024-09-11T00:14:32.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:31 smithi112 ceph-mon[35627]: pgmap v261: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-11T00:14:32.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:31 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1316818327' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-11T00:14:32.232 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 11 00:14:31 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-b[67230]: 2024-09-11T00:14:31.736+0000 7f5350599640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T00:14:32.263 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:31 smithi078 ceph-mon[30865]: pgmap v261: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-11T00:14:32.263 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:31 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1316818327' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-11T00:14:32.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:31 smithi138 ceph-mon[35019]: pgmap v261: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-11T00:14:32.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:31 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1316818327' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-11T00:14:32.599 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-11T00:14:32.599 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-11T00:14:32.846 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:33.218 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:32 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1316818327' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T00:14:33.218 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:32 smithi078 ceph-mon[30865]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T00:14:33.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:32 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1316818327' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T00:14:33.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:32 smithi112 ceph-mon[35627]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T00:14:33.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:32 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1316818327' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T00:14:33.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:32 smithi138 ceph-mon[35019]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T00:14:33.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.299+0000 7f054ea02640 1 -- 172.21.15.78:0/221988894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0548102dc0 msgr2=0x7f05481031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:33.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.299+0000 7f054ea02640 1 --2- 172.21.15.78:0/221988894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0548102dc0 0x7f05481031a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0538009900 tx=0x7f053802a410 comp rx=0 tx=0).stop 2024-09-11T00:14:33.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.300+0000 7f054ea02640 1 -- 172.21.15.78:0/221988894 shutdown_connections 2024-09-11T00:14:33.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.300+0000 7f054ea02640 1 --2- 172.21.15.78:0/221988894 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0548109150 0x7f054810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:33.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.300+0000 7f054ea02640 1 --2- 172.21.15.78:0/221988894 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05481087d0 0x7f0548108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:33.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.300+0000 7f054ea02640 1 --2- 172.21.15.78:0/221988894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0548102dc0 0x7f05481031a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:33.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.300+0000 7f054ea02640 1 -- 172.21.15.78:0/221988894 >> 172.21.15.78:0/221988894 conn(0x7f05480fe830 msgr2=0x7f0548100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:33.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.300+0000 7f054ea02640 1 -- 172.21.15.78:0/221988894 shutdown_connections 2024-09-11T00:14:33.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.300+0000 7f054ea02640 1 -- 172.21.15.78:0/221988894 wait complete. 2024-09-11T00:14:33.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.300+0000 7f054ea02640 1 Processor -- start 2024-09-11T00:14:33.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.300+0000 7f054ea02640 1 -- start start 2024-09-11T00:14:33.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.300+0000 7f054ea02640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0548102dc0 0x7f05480754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:33.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.300+0000 7f054ea02640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05481087d0 0x7f05480759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:33.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.300+0000 7f054ea02640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0548109150 0x7f0548075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:33.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.300+0000 7f054ea02640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0548112e10 con 0x7f0548102dc0 2024-09-11T00:14:33.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.300+0000 7f054ea02640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0548112c90 con 0x7f05481087d0 2024-09-11T00:14:33.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.300+0000 7f054ea02640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0548112f90 con 0x7f0548109150 2024-09-11T00:14:33.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.300+0000 7f0547fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0548102dc0 0x7f05480754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:33.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.300+0000 7f0547fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0548102dc0 0x7f05480754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51460/0 (socket says 172.21.15.78:51460) 2024-09-11T00:14:33.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.300+0000 7f0547fff640 1 -- 172.21.15.78:0/1090434465 learned_addr learned my addr 172.21.15.78:0/1090434465 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:33.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.301+0000 7f054cf9f640 1 --2- 172.21.15.78:0/1090434465 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0548109150 0x7f0548075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:33.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.301+0000 7f053ffff640 1 --2- 172.21.15.78:0/1090434465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05481087d0 0x7f05480759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:33.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.301+0000 7f0547fff640 1 -- 172.21.15.78:0/1090434465 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0548109150 msgr2=0x7f0548075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:33.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.301+0000 7f0547fff640 1 --2- 172.21.15.78:0/1090434465 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0548109150 0x7f0548075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:33.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.301+0000 7f0547fff640 1 -- 172.21.15.78:0/1090434465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05481087d0 msgr2=0x7f05480759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:33.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.301+0000 7f0547fff640 1 --2- 172.21.15.78:0/1090434465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05481087d0 0x7f05480759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:33.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.301+0000 7f0547fff640 1 -- 172.21.15.78:0/1090434465 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05481a76a0 con 0x7f0548102dc0 2024-09-11T00:14:33.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.301+0000 7f053ffff640 1 --2- 172.21.15.78:0/1090434465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05481087d0 0x7f05480759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:33.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.301+0000 7f0547fff640 1 --2- 172.21.15.78:0/1090434465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0548102dc0 0x7f05480754a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0538006010 tx=0x7f05380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:33.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.301+0000 7f0545ffb640 1 -- 172.21.15.78:0/1090434465 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053803f030 con 0x7f0548102dc0 2024-09-11T00:14:33.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.301+0000 7f054ea02640 1 -- 172.21.15.78:0/1090434465 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05481a7930 con 0x7f0548102dc0 2024-09-11T00:14:33.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.301+0000 7f0545ffb640 1 -- 172.21.15.78:0/1090434465 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0538003800 con 0x7f0548102dc0 2024-09-11T00:14:33.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.301+0000 7f0545ffb640 1 -- 172.21.15.78:0/1090434465 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0538035070 con 0x7f0548102dc0 2024-09-11T00:14:33.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.301+0000 7f054ea02640 1 -- 172.21.15.78:0/1090434465 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05481a7ee0 con 0x7f0548102dc0 2024-09-11T00:14:33.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.302+0000 7f054ea02640 1 -- 172.21.15.78:0/1090434465 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05481031a0 con 0x7f0548102dc0 2024-09-11T00:14:33.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.304+0000 7f0545ffb640 1 -- 172.21.15.78:0/1090434465 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f0538031b10 con 0x7f0548102dc0 2024-09-11T00:14:33.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.304+0000 7f0545ffb640 1 --2- 172.21.15.78:0/1090434465 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f05340b5330 0x7f05340b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:33.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.305+0000 7f053ffff640 1 --2- 172.21.15.78:0/1090434465 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f05340b5330 0x7f05340b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:33.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.305+0000 7f0545ffb640 1 -- 172.21.15.78:0/1090434465 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f0538106840 con 0x7f0548102dc0 2024-09-11T00:14:33.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.305+0000 7f053ffff640 1 --2- 172.21.15.78:0/1090434465 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f05340b5330 0x7f05340b77f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0548076f90 tx=0x7f0530008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:33.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.308+0000 7f0545ffb640 1 -- 172.21.15.78:0/1090434465 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f05380cd6c0 con 0x7f0548102dc0 2024-09-11T00:14:33.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.520+0000 7f054ea02640 1 -- 172.21.15.78:0/1090434465 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f054810af90 con 0x7f0548102dc0 2024-09-11T00:14:33.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.940+0000 7f0545ffb640 1 -- 172.21.15.78:0/1090434465 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f05380d4e20 con 0x7f0548102dc0 2024-09-11T00:14:33.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.942+0000 7f054ea02640 1 -- 172.21.15.78:0/1090434465 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f05340b5330 msgr2=0x7f05340b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:33.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.942+0000 7f054ea02640 1 --2- 172.21.15.78:0/1090434465 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f05340b5330 0x7f05340b77f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0548076f90 tx=0x7f0530008040 comp rx=0 tx=0).stop 2024-09-11T00:14:33.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.942+0000 7f054ea02640 1 -- 172.21.15.78:0/1090434465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0548102dc0 msgr2=0x7f05480754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:33.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.942+0000 7f054ea02640 1 --2- 172.21.15.78:0/1090434465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0548102dc0 0x7f05480754a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0538006010 tx=0x7f05380042f0 comp rx=0 tx=0).stop 2024-09-11T00:14:33.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.942+0000 7f054ea02640 1 -- 172.21.15.78:0/1090434465 shutdown_connections 2024-09-11T00:14:33.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.942+0000 7f054ea02640 1 --2- 172.21.15.78:0/1090434465 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f05340b5330 0x7f05340b77f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:33.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.942+0000 7f054ea02640 1 --2- 172.21.15.78:0/1090434465 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0548109150 0x7f0548075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:33.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.942+0000 7f054ea02640 1 --2- 172.21.15.78:0/1090434465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05481087d0 0x7f05480759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:33.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.942+0000 7f054ea02640 1 --2- 172.21.15.78:0/1090434465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0548102dc0 0x7f05480754a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:33.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.942+0000 7f054ea02640 1 -- 172.21.15.78:0/1090434465 >> 172.21.15.78:0/1090434465 conn(0x7f05480fe830 msgr2=0x7f0548100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:33.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.942+0000 7f054ea02640 1 -- 172.21.15.78:0/1090434465 shutdown_connections 2024-09-11T00:14:33.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:33.942+0000 7f054ea02640 1 -- 172.21.15.78:0/1090434465 wait complete. 2024-09-11T00:14:34.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:33 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1090434465' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-11T00:14:34.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:33 smithi112 ceph-mon[35627]: pgmap v262: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-11T00:14:34.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:33 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1090434465' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-11T00:14:34.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:33 smithi138 ceph-mon[35019]: pgmap v262: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-11T00:14:34.313 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:33 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1090434465' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-11T00:14:34.313 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:33 smithi078 ceph-mon[30865]: pgmap v262: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-11T00:14:34.651 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-11T00:14:34.898 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:35.203 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:34 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1090434465' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T00:14:35.203 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:34 smithi078 ceph-mon[30865]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T00:14:35.203 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:34 smithi078 ceph-mon[30865]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-11T00:14:35.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:34 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1090434465' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T00:14:35.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:34 smithi112 ceph-mon[35627]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T00:14:35.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:34 smithi112 ceph-mon[35627]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-11T00:14:35.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:34 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1090434465' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T00:14:35.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:34 smithi138 ceph-mon[35019]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T00:14:35.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:34 smithi138 ceph-mon[35019]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-11T00:14:35.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.390+0000 7f3bbf971640 1 -- 172.21.15.78:0/1939454966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3bb8102dc0 msgr2=0x7f3bb81031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.390+0000 7f3bbf971640 1 --2- 172.21.15.78:0/1939454966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3bb8102dc0 0x7f3bb81031a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4009900 tx=0x7f3bb402a410 comp rx=0 tx=0).stop 2024-09-11T00:14:35.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.390+0000 7f3bbf971640 1 -- 172.21.15.78:0/1939454966 shutdown_connections 2024-09-11T00:14:35.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.390+0000 7f3bbf971640 1 --2- 172.21.15.78:0/1939454966 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3bb8109150 0x7f3bb810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.390+0000 7f3bbf971640 1 --2- 172.21.15.78:0/1939454966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bb81087d0 0x7f3bb8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.390+0000 7f3bbf971640 1 --2- 172.21.15.78:0/1939454966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3bb8102dc0 0x7f3bb81031a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.390+0000 7f3bbf971640 1 -- 172.21.15.78:0/1939454966 >> 172.21.15.78:0/1939454966 conn(0x7f3bb80fe830 msgr2=0x7f3bb8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:35.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.390+0000 7f3bbf971640 1 -- 172.21.15.78:0/1939454966 shutdown_connections 2024-09-11T00:14:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.390+0000 7f3bbf971640 1 -- 172.21.15.78:0/1939454966 wait complete. 2024-09-11T00:14:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.391+0000 7f3bbf971640 1 Processor -- start 2024-09-11T00:14:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.391+0000 7f3bbf971640 1 -- start start 2024-09-11T00:14:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.391+0000 7f3bbf971640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bb8102dc0 0x7f3bb81992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.391+0000 7f3bbf971640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3bb81087d0 0x7f3bb8199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.391+0000 7f3bbf971640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3bb8109150 0x7f3bb819ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.391+0000 7f3bbf971640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb8112e10 con 0x7f3bb81087d0 2024-09-11T00:14:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.391+0000 7f3bbf971640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb8112c90 con 0x7f3bb8102dc0 2024-09-11T00:14:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.391+0000 7f3bbf971640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb8112f90 con 0x7f3bb8109150 2024-09-11T00:14:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.391+0000 7f3bbcf0c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3bb81087d0 0x7f3bb8199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.391+0000 7f3bbcf0c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3bb81087d0 0x7f3bb8199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45986/0 (socket says 172.21.15.78:45986) 2024-09-11T00:14:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.391+0000 7f3bbcf0c640 1 -- 172.21.15.78:0/2052944050 learned_addr learned my addr 172.21.15.78:0/2052944050 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.391+0000 7f3bbdf0e640 1 --2- 172.21.15.78:0/2052944050 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3bb8109150 0x7f3bb819ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.391+0000 7f3bbd70d640 1 --2- 172.21.15.78:0/2052944050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bb8102dc0 0x7f3bb81992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.391+0000 7f3bbcf0c640 1 -- 172.21.15.78:0/2052944050 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3bb8109150 msgr2=0x7f3bb819ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.391+0000 7f3bbcf0c640 1 --2- 172.21.15.78:0/2052944050 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3bb8109150 0x7f3bb819ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.391+0000 7f3bbcf0c640 1 -- 172.21.15.78:0/2052944050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bb8102dc0 msgr2=0x7f3bb81992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.391+0000 7f3bbcf0c640 1 --2- 172.21.15.78:0/2052944050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bb8102dc0 0x7f3bb81992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.391+0000 7f3bbcf0c640 1 -- 172.21.15.78:0/2052944050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb819f390 con 0x7f3bb81087d0 2024-09-11T00:14:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.391+0000 7f3bbdf0e640 1 --2- 172.21.15.78:0/2052944050 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3bb8109150 0x7f3bb819ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.391+0000 7f3bbd70d640 1 --2- 172.21.15.78:0/2052944050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bb8102dc0 0x7f3bb81992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.392+0000 7f3bbcf0c640 1 --2- 172.21.15.78:0/2052944050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3bb81087d0 0x7f3bb8199820 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800b4a0 tx=0x7f3ba800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.392+0000 7f3bae7fc640 1 -- 172.21.15.78:0/2052944050 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8014070 con 0x7f3bb81087d0 2024-09-11T00:14:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.392+0000 7f3bae7fc640 1 -- 172.21.15.78:0/2052944050 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ba8010ac0 con 0x7f3bb81087d0 2024-09-11T00:14:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.392+0000 7f3bbf971640 1 -- 172.21.15.78:0/2052944050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bb819f680 con 0x7f3bb81087d0 2024-09-11T00:14:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.392+0000 7f3bae7fc640 1 -- 172.21.15.78:0/2052944050 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8017c30 con 0x7f3bb81087d0 2024-09-11T00:14:35.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.392+0000 7f3bbf971640 1 -- 172.21.15.78:0/2052944050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bb81a5dc0 con 0x7f3bb81087d0 2024-09-11T00:14:35.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.393+0000 7f3bbf971640 1 -- 172.21.15.78:0/2052944050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bb81031a0 con 0x7f3bb81087d0 2024-09-11T00:14:35.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.394+0000 7f3bae7fc640 1 -- 172.21.15.78:0/2052944050 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f3ba8010610 con 0x7f3bb81087d0 2024-09-11T00:14:35.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.395+0000 7f3bae7fc640 1 --2- 172.21.15.78:0/2052944050 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3ba40b5330 0x7f3ba40b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:35.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.395+0000 7f3bbd70d640 1 --2- 172.21.15.78:0/2052944050 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3ba40b5330 0x7f3ba40b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:35.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.395+0000 7f3bae7fc640 1 -- 172.21.15.78:0/2052944050 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f3ba80e5590 con 0x7f3bb81087d0 2024-09-11T00:14:35.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.395+0000 7f3bbd70d640 1 --2- 172.21.15.78:0/2052944050 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3ba40b5330 0x7f3ba40b77f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4000c00 tx=0x7f3bb4031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:35.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.398+0000 7f3bae7fc640 1 -- 172.21.15.78:0/2052944050 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3ba80ac470 con 0x7f3bb81087d0 2024-09-11T00:14:35.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.613+0000 7f3bbf971640 1 -- 172.21.15.78:0/2052944050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f3bb802e5c0 con 0x7f3bb81087d0 2024-09-11T00:14:35.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.949+0000 7f3bae7fc640 1 -- 172.21.15.78:0/2052944050 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v20) ==== 115+0+0 (secure 0 0 0) 0x7f3ba80abd70 con 0x7f3bb81087d0 2024-09-11T00:14:35.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.952+0000 7f3bbf971640 1 -- 172.21.15.78:0/2052944050 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3ba40b5330 msgr2=0x7f3ba40b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.952+0000 7f3bbf971640 1 --2- 172.21.15.78:0/2052944050 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3ba40b5330 0x7f3ba40b77f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4000c00 tx=0x7f3bb4031400 comp rx=0 tx=0).stop 2024-09-11T00:14:35.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.952+0000 7f3bbf971640 1 -- 172.21.15.78:0/2052944050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3bb81087d0 msgr2=0x7f3bb8199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:35.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.952+0000 7f3bbf971640 1 --2- 172.21.15.78:0/2052944050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3bb81087d0 0x7f3bb8199820 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800b4a0 tx=0x7f3ba800b960 comp rx=0 tx=0).stop 2024-09-11T00:14:35.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.952+0000 7f3bbf971640 1 -- 172.21.15.78:0/2052944050 shutdown_connections 2024-09-11T00:14:35.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.952+0000 7f3bbf971640 1 --2- 172.21.15.78:0/2052944050 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3ba40b5330 0x7f3ba40b77f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.952+0000 7f3bbf971640 1 --2- 172.21.15.78:0/2052944050 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3bb8109150 0x7f3bb819ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.952+0000 7f3bbf971640 1 --2- 172.21.15.78:0/2052944050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3bb81087d0 0x7f3bb8199820 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.952+0000 7f3bbf971640 1 --2- 172.21.15.78:0/2052944050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3bb8102dc0 0x7f3bb81992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:35.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.952+0000 7f3bbf971640 1 -- 172.21.15.78:0/2052944050 >> 172.21.15.78:0/2052944050 conn(0x7f3bb80fe830 msgr2=0x7f3bb8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:35.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.952+0000 7f3bbf971640 1 -- 172.21.15.78:0/2052944050 shutdown_connections 2024-09-11T00:14:35.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:35.952+0000 7f3bbf971640 1 -- 172.21.15.78:0/2052944050 wait complete. 2024-09-11T00:14:36.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:35 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2052944050' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-11T00:14:36.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:35 smithi112 ceph-mon[35627]: pgmap v263: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 314 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-11T00:14:36.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:35 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2052944050' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-11T00:14:36.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:35 smithi138 ceph-mon[35019]: pgmap v263: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 314 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-11T00:14:36.322 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:35 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2052944050' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-11T00:14:36.322 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:35 smithi078 ceph-mon[30865]: pgmap v263: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 314 B/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-11T00:14:36.674 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-11T00:14:36.674 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-11T00:14:36.925 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:37.203 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:36 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2052944050' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T00:14:37.203 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:36 smithi078 ceph-mon[30865]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-11T00:14:37.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:36 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2052944050' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T00:14:37.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:36 smithi112 ceph-mon[35627]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-11T00:14:37.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:36 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2052944050' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T00:14:37.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:36 smithi138 ceph-mon[35019]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-11T00:14:37.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.390+0000 7f32b9b1f640 1 -- 172.21.15.78:0/2331975665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32b4104600 msgr2=0x7f32b410caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:37.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.390+0000 7f32b9b1f640 1 --2- 172.21.15.78:0/2331975665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32b4104600 0x7f32b410caf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f329c009900 tx=0x7f329c02a410 comp rx=0 tx=0).stop 2024-09-11T00:14:37.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.390+0000 7f32b9b1f640 1 -- 172.21.15.78:0/2331975665 shutdown_connections 2024-09-11T00:14:37.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.390+0000 7f32b9b1f640 1 --2- 172.21.15.78:0/2331975665 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32b410d140 0x7f32b410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.390+0000 7f32b9b1f640 1 --2- 172.21.15.78:0/2331975665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32b4104600 0x7f32b410caf0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.390+0000 7f32b9b1f640 1 --2- 172.21.15.78:0/2331975665 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b4103ce0 0x7f32b41040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.390+0000 7f32b9b1f640 1 -- 172.21.15.78:0/2331975665 >> 172.21.15.78:0/2331975665 conn(0x7f32b40fd700 msgr2=0x7f32b40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.390+0000 7f32b9b1f640 1 -- 172.21.15.78:0/2331975665 shutdown_connections 2024-09-11T00:14:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.390+0000 7f32b9b1f640 1 -- 172.21.15.78:0/2331975665 wait complete. 2024-09-11T00:14:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.391+0000 7f32b9b1f640 1 Processor -- start 2024-09-11T00:14:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.391+0000 7f32b9b1f640 1 -- start start 2024-09-11T00:14:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.391+0000 7f32b9b1f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b4103ce0 0x7f32b4199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.391+0000 7f32b9b1f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32b4104600 0x7f32b4199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.391+0000 7f32b9b1f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32b410d140 0x7f32b419ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.391+0000 7f32b9b1f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f32b4112df0 con 0x7f32b410d140 2024-09-11T00:14:37.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.391+0000 7f32b9b1f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f32b4112c70 con 0x7f32b4103ce0 2024-09-11T00:14:37.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.391+0000 7f32b9b1f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f32b4112f70 con 0x7f32b4104600 2024-09-11T00:14:37.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.391+0000 7f32b3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32b410d140 0x7f32b419ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:37.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.391+0000 7f32b3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32b410d140 0x7f32b419ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46006/0 (socket says 172.21.15.78:46006) 2024-09-11T00:14:37.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.391+0000 7f32b3fff640 1 -- 172.21.15.78:0/268064718 learned_addr learned my addr 172.21.15.78:0/268064718 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:37.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.391+0000 7f32aaffd640 1 --2- 172.21.15.78:0/268064718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32b4104600 0x7f32b4199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:37.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.391+0000 7f32b37fe640 1 --2- 172.21.15.78:0/268064718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b4103ce0 0x7f32b4199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:37.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.392+0000 7f32b3fff640 1 -- 172.21.15.78:0/268064718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32b4104600 msgr2=0x7f32b4199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:37.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.392+0000 7f32b3fff640 1 --2- 172.21.15.78:0/268064718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32b4104600 0x7f32b4199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:37.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.392+0000 7f32b3fff640 1 -- 172.21.15.78:0/268064718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b4103ce0 msgr2=0x7f32b4199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:37.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.392+0000 7f32b3fff640 1 --2- 172.21.15.78:0/268064718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b4103ce0 0x7f32b4199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:37.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.392+0000 7f32b3fff640 1 -- 172.21.15.78:0/268064718 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b419f3f0 con 0x7f32b410d140 2024-09-11T00:14:37.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.392+0000 7f32b37fe640 1 --2- 172.21.15.78:0/268064718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b4103ce0 0x7f32b4199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:37.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.392+0000 7f32b3fff640 1 --2- 172.21.15.78:0/268064718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32b410d140 0x7f32b419ec20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00b970 tx=0x7f32ac00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:37.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.392+0000 7f32b17fa640 1 -- 172.21.15.78:0/268064718 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac019070 con 0x7f32b410d140 2024-09-11T00:14:37.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.392+0000 7f32b17fa640 1 -- 172.21.15.78:0/268064718 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32ac014440 con 0x7f32b410d140 2024-09-11T00:14:37.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.392+0000 7f32b9b1f640 1 -- 172.21.15.78:0/268064718 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b419f6e0 con 0x7f32b410d140 2024-09-11T00:14:37.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.392+0000 7f32b17fa640 1 -- 172.21.15.78:0/268064718 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac0075d0 con 0x7f32b410d140 2024-09-11T00:14:37.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.392+0000 7f32b9b1f640 1 -- 172.21.15.78:0/268064718 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b41a5da0 con 0x7f32b410d140 2024-09-11T00:14:37.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.393+0000 7f32b9b1f640 1 -- 172.21.15.78:0/268064718 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b41040c0 con 0x7f32b410d140 2024-09-11T00:14:37.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.394+0000 7f32b17fa640 1 -- 172.21.15.78:0/268064718 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 20) ==== 153267+0+0 (secure 0 0 0) 0x7f32ac00cb40 con 0x7f32b410d140 2024-09-11T00:14:37.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.395+0000 7f32b17fa640 1 --2- 172.21.15.78:0/268064718 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f32a00b5330 0x7f32a00b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:37.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.395+0000 7f32b37fe640 1 --2- 172.21.15.78:0/268064718 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f32a00b5330 0x7f32a00b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:37.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.395+0000 7f32b17fa640 1 -- 172.21.15.78:0/268064718 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f32ac0e5440 con 0x7f32b410d140 2024-09-11T00:14:37.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.395+0000 7f32b37fe640 1 --2- 172.21.15.78:0/268064718 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f32a00b5330 0x7f32a00b77f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f32a400baa0 tx=0x7f32a4005d90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:37.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.399+0000 7f32b17fa640 1 -- 172.21.15.78:0/268064718 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f32ac0ac320 con 0x7f32b410d140 2024-09-11T00:14:37.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.602+0000 7f32b9b1f640 1 -- 172.21.15.78:0/268064718 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f32b40ff310 con 0x7f32a00b5330 2024-09-11T00:14:37.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.622+0000 7f32b17fa640 1 -- 172.21.15.78:0/268064718 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f32b40ff310 con 0x7f32a00b5330 2024-09-11T00:14:37.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.625+0000 7f32b9b1f640 1 -- 172.21.15.78:0/268064718 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f32a00b5330 msgr2=0x7f32a00b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:37.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.625+0000 7f32b9b1f640 1 --2- 172.21.15.78:0/268064718 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f32a00b5330 0x7f32a00b77f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f32a400baa0 tx=0x7f32a4005d90 comp rx=0 tx=0).stop 2024-09-11T00:14:37.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.625+0000 7f32b9b1f640 1 -- 172.21.15.78:0/268064718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32b410d140 msgr2=0x7f32b419ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:37.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.625+0000 7f32b9b1f640 1 --2- 172.21.15.78:0/268064718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32b410d140 0x7f32b419ec20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00b970 tx=0x7f32ac00be30 comp rx=0 tx=0).stop 2024-09-11T00:14:37.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.625+0000 7f32b9b1f640 1 -- 172.21.15.78:0/268064718 shutdown_connections 2024-09-11T00:14:37.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.625+0000 7f32b9b1f640 1 --2- 172.21.15.78:0/268064718 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f32a00b5330 0x7f32a00b77f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:37.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.625+0000 7f32b9b1f640 1 --2- 172.21.15.78:0/268064718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32b410d140 0x7f32b419ec20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:37.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.625+0000 7f32b9b1f640 1 --2- 172.21.15.78:0/268064718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32b4104600 0x7f32b4199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:37.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.625+0000 7f32b9b1f640 1 --2- 172.21.15.78:0/268064718 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f32b4103ce0 0x7f32b4199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:37.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.625+0000 7f32b9b1f640 1 -- 172.21.15.78:0/268064718 >> 172.21.15.78:0/268064718 conn(0x7f32b40fd700 msgr2=0x7f32b410f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:37.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.625+0000 7f32b9b1f640 1 -- 172.21.15.78:0/268064718 shutdown_connections 2024-09-11T00:14:37.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:37.625+0000 7f32b9b1f640 1 -- 172.21.15.78:0/268064718 wait complete. 2024-09-11T00:14:37.960 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:14:37 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: 2024-09-11T00:14:37.607+0000 7f36cbe09640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:14:37.960 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:14:37 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: 2024-09-11T00:14:37.607+0000 7f36cbe09640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:14:37.960 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:14:37 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: 2024-09-11T00:14:37.607+0000 7f36cbe09640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:14:37.960 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:14:37 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: 2024-09-11T00:14:37.607+0000 7f36cbe09640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:14:37.960 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:14:37 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: 2024-09-11T00:14:37.607+0000 7f36cbe09640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:14:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:37 smithi112 ceph-mon[35627]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:37 smithi112 ceph-mon[35627]: pgmap v264: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 666 B/s rd, 1.3 KiB/s wr, 4 op/s 2024-09-11T00:14:38.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:37 smithi138 ceph-mon[35019]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:38.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:37 smithi138 ceph-mon[35019]: pgmap v264: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 666 B/s rd, 1.3 KiB/s wr, 4 op/s 2024-09-11T00:14:38.306 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:37 smithi078 ceph-mon[30865]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:38.306 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:37 smithi078 ceph-mon[30865]: pgmap v264: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 666 B/s rd, 1.3 KiB/s wr, 4 op/s 2024-09-11T00:14:38.334 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-11T00:14:38.578 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:39.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.068+0000 7f7a4c38c640 1 -- 172.21.15.78:0/2598727709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a44103cb0 msgr2=0x7f7a44104090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:39.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.068+0000 7f7a4c38c640 1 --2- 172.21.15.78:0/2598727709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a44103cb0 0x7f7a44104090 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009ca0 tx=0x7f7a3802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.069+0000 7f7a4c38c640 1 -- 172.21.15.78:0/2598727709 shutdown_connections 2024-09-11T00:14:39.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.069+0000 7f7a4c38c640 1 --2- 172.21.15.78:0/2598727709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a4410d110 0x7f7a4410f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.069+0000 7f7a4c38c640 1 --2- 172.21.15.78:0/2598727709 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a441045d0 0x7f7a4410cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.069+0000 7f7a4c38c640 1 --2- 172.21.15.78:0/2598727709 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a44103cb0 0x7f7a44104090 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.069+0000 7f7a4c38c640 1 -- 172.21.15.78:0/2598727709 >> 172.21.15.78:0/2598727709 conn(0x7f7a440fd6d0 msgr2=0x7f7a440ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:39.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.069+0000 7f7a4c38c640 1 -- 172.21.15.78:0/2598727709 shutdown_connections 2024-09-11T00:14:39.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.069+0000 7f7a4c38c640 1 -- 172.21.15.78:0/2598727709 wait complete. 2024-09-11T00:14:39.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.069+0000 7f7a4c38c640 1 Processor -- start 2024-09-11T00:14:39.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.069+0000 7f7a4c38c640 1 -- start start 2024-09-11T00:14:39.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.070+0000 7f7a4c38c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a44103cb0 0x7f7a44199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:39.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.070+0000 7f7a4c38c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a441045d0 0x7f7a441997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:39.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.070+0000 7f7a4c38c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a4410d110 0x7f7a4419eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:39.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.070+0000 7f7a4c38c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7a44112d80 con 0x7f7a441045d0 2024-09-11T00:14:39.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.070+0000 7f7a4c38c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7a44112c00 con 0x7f7a44103cb0 2024-09-11T00:14:39.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.070+0000 7f7a4c38c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7a44112f00 con 0x7f7a4410d110 2024-09-11T00:14:39.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.070+0000 7f7a49927640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a441045d0 0x7f7a441997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:39.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.070+0000 7f7a49927640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a441045d0 0x7f7a441997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46050/0 (socket says 172.21.15.78:46050) 2024-09-11T00:14:39.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.070+0000 7f7a49927640 1 -- 172.21.15.78:0/1265489745 learned_addr learned my addr 172.21.15.78:0/1265489745 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:39.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.070+0000 7f7a4a128640 1 --2- 172.21.15.78:0/1265489745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a44103cb0 0x7f7a44199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:39.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.070+0000 7f7a4a929640 1 --2- 172.21.15.78:0/1265489745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a4410d110 0x7f7a4419eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:39.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.070+0000 7f7a49927640 1 -- 172.21.15.78:0/1265489745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a4410d110 msgr2=0x7f7a4419eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:39.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.070+0000 7f7a49927640 1 --2- 172.21.15.78:0/1265489745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a4410d110 0x7f7a4419eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.070+0000 7f7a49927640 1 -- 172.21.15.78:0/1265489745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a44103cb0 msgr2=0x7f7a44199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:39.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.070+0000 7f7a49927640 1 --2- 172.21.15.78:0/1265489745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a44103cb0 0x7f7a44199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.070+0000 7f7a49927640 1 -- 172.21.15.78:0/1265489745 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4419f340 con 0x7f7a441045d0 2024-09-11T00:14:39.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.070+0000 7f7a4a929640 1 --2- 172.21.15.78:0/1265489745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a4410d110 0x7f7a4419eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:39.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.070+0000 7f7a49927640 1 --2- 172.21.15.78:0/1265489745 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a441045d0 0x7f7a441997d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7a3400d750 tx=0x7f7a3400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:39.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.070+0000 7f7a437fe640 1 -- 172.21.15.78:0/1265489745 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a34017070 con 0x7f7a441045d0 2024-09-11T00:14:39.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.070+0000 7f7a4c38c640 1 -- 172.21.15.78:0/1265489745 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a4419f630 con 0x7f7a441045d0 2024-09-11T00:14:39.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.070+0000 7f7a437fe640 1 -- 172.21.15.78:0/1265489745 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a34004020 con 0x7f7a441045d0 2024-09-11T00:14:39.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.071+0000 7f7a437fe640 1 -- 172.21.15.78:0/1265489745 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a34003c00 con 0x7f7a441045d0 2024-09-11T00:14:39.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.071+0000 7f7a4c38c640 1 -- 172.21.15.78:0/1265489745 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a441a5ec0 con 0x7f7a441045d0 2024-09-11T00:14:39.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.072+0000 7f7a4c38c640 1 -- 172.21.15.78:0/1265489745 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a44104090 con 0x7f7a441045d0 2024-09-11T00:14:39.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.073+0000 7f7a437fe640 1 -- 172.21.15.78:0/1265489745 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f7a34009a30 con 0x7f7a441045d0 2024-09-11T00:14:39.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.074+0000 7f7a437fe640 1 --2- 172.21.15.78:0/1265489745 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7a2c0b53c0 0x7f7a2c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:39.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.074+0000 7f7a4a128640 1 --2- 172.21.15.78:0/1265489745 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7a2c0b53c0 0x7f7a2c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:39.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.074+0000 7f7a437fe640 1 -- 172.21.15.78:0/1265489745 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f7a340e5a90 con 0x7f7a441045d0 2024-09-11T00:14:39.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.074+0000 7f7a4a128640 1 --2- 172.21.15.78:0/1265489745 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7a2c0b53c0 0x7f7a2c0b7880 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009430 tx=0x7f7a38009360 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:39.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.077+0000 7f7a437fe640 1 -- 172.21.15.78:0/1265489745 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7a340ac810 con 0x7f7a441045d0 2024-09-11T00:14:39.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:38 smithi112 ceph-mon[35627]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-09-11T00:14:39.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.278+0000 7f7a4c38c640 1 -- 172.21.15.78:0/1265489745 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f7a44063590 con 0x7f7a2c0b53c0 2024-09-11T00:14:39.280 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:38 smithi078 ceph-mon[30865]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-09-11T00:14:39.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:38 smithi138 ceph-mon[35019]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-09-11T00:14:39.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.303+0000 7f7a437fe640 1 -- 172.21.15.78:0/1265489745 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7a44063590 con 0x7f7a2c0b53c0 2024-09-11T00:14:39.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.305+0000 7f7a4c38c640 1 -- 172.21.15.78:0/1265489745 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7a2c0b53c0 msgr2=0x7f7a2c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:39.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.305+0000 7f7a4c38c640 1 --2- 172.21.15.78:0/1265489745 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7a2c0b53c0 0x7f7a2c0b7880 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009430 tx=0x7f7a38009360 comp rx=0 tx=0).stop 2024-09-11T00:14:39.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.305+0000 7f7a4c38c640 1 -- 172.21.15.78:0/1265489745 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a441045d0 msgr2=0x7f7a441997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:39.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.305+0000 7f7a4c38c640 1 --2- 172.21.15.78:0/1265489745 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a441045d0 0x7f7a441997d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7a3400d750 tx=0x7f7a3400dc10 comp rx=0 tx=0).stop 2024-09-11T00:14:39.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.305+0000 7f7a4c38c640 1 -- 172.21.15.78:0/1265489745 shutdown_connections 2024-09-11T00:14:39.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.305+0000 7f7a4c38c640 1 --2- 172.21.15.78:0/1265489745 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7a2c0b53c0 0x7f7a2c0b7880 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.305+0000 7f7a4c38c640 1 --2- 172.21.15.78:0/1265489745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a4410d110 0x7f7a4419eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.305+0000 7f7a4c38c640 1 --2- 172.21.15.78:0/1265489745 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a441045d0 0x7f7a441997d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.305+0000 7f7a4c38c640 1 --2- 172.21.15.78:0/1265489745 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7a44103cb0 0x7f7a44199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:39.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.305+0000 7f7a4c38c640 1 -- 172.21.15.78:0/1265489745 >> 172.21.15.78:0/1265489745 conn(0x7f7a440fd6d0 msgr2=0x7f7a440fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:39.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.305+0000 7f7a4c38c640 1 -- 172.21.15.78:0/1265489745 shutdown_connections 2024-09-11T00:14:39.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:39.305+0000 7f7a4c38c640 1 -- 172.21.15.78:0/1265489745 wait complete. 2024-09-11T00:14:40.002 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-11T00:14:40.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:39 smithi112 ceph-mon[35627]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:40.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:39 smithi112 ceph-mon[35627]: pgmap v265: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-11T00:14:40.247 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:40.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:39 smithi138 ceph-mon[35019]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:40.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:39 smithi138 ceph-mon[35019]: pgmap v265: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-11T00:14:40.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:39 smithi078 ceph-mon[30865]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:40.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:39 smithi078 ceph-mon[30865]: pgmap v265: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-11T00:14:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.711+0000 7f1763bc2640 1 -- 172.21.15.78:0/4194433622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f175c108060 msgr2=0x7f175c10e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.711+0000 7f1763bc2640 1 --2- 172.21.15.78:0/4194433622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f175c108060 0x7f175c10e860 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1754009ca0 tx=0x7f175402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.711+0000 7f1763bc2640 1 -- 172.21.15.78:0/4194433622 shutdown_connections 2024-09-11T00:14:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.711+0000 7f1763bc2640 1 --2- 172.21.15.78:0/4194433622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f175c108060 0x7f175c10e860 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.711+0000 7f1763bc2640 1 --2- 172.21.15.78:0/4194433622 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f175c1076e0 0x7f175c107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.711+0000 7f1763bc2640 1 --2- 172.21.15.78:0/4194433622 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f175c101cd0 0x7f175c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.711+0000 7f1763bc2640 1 -- 172.21.15.78:0/4194433622 >> 172.21.15.78:0/4194433622 conn(0x7f175c0fd700 msgr2=0x7f175c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.711+0000 7f1763bc2640 1 -- 172.21.15.78:0/4194433622 shutdown_connections 2024-09-11T00:14:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.711+0000 7f1763bc2640 1 -- 172.21.15.78:0/4194433622 wait complete. 2024-09-11T00:14:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.712+0000 7f1763bc2640 1 Processor -- start 2024-09-11T00:14:40.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.712+0000 7f1763bc2640 1 -- start start 2024-09-11T00:14:40.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.712+0000 7f1763bc2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f175c101cd0 0x7f175c1980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.712+0000 7f1763bc2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f175c1076e0 0x7f175c198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.712+0000 7f1763bc2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f175c108060 0x7f175c19d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.712+0000 7f1763bc2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f175c111d20 con 0x7f175c1076e0 2024-09-11T00:14:40.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.712+0000 7f1763bc2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f175c111ba0 con 0x7f175c101cd0 2024-09-11T00:14:40.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.712+0000 7f1763bc2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f175c111ea0 con 0x7f175c108060 2024-09-11T00:14:40.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.712+0000 7f176115d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f175c1076e0 0x7f175c198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.712+0000 7f176195e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f175c101cd0 0x7f175c1980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.712+0000 7f176115d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f175c1076e0 0x7f175c198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46064/0 (socket says 172.21.15.78:46064) 2024-09-11T00:14:40.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.712+0000 7f176115d640 1 -- 172.21.15.78:0/2287782344 learned_addr learned my addr 172.21.15.78:0/2287782344 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:40.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.713+0000 7f176215f640 1 --2- 172.21.15.78:0/2287782344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f175c108060 0x7f175c19d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.713+0000 7f176115d640 1 -- 172.21.15.78:0/2287782344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f175c108060 msgr2=0x7f175c19d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.713+0000 7f176115d640 1 --2- 172.21.15.78:0/2287782344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f175c108060 0x7f175c19d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.713+0000 7f176115d640 1 -- 172.21.15.78:0/2287782344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f175c101cd0 msgr2=0x7f175c1980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.713+0000 7f176115d640 1 --2- 172.21.15.78:0/2287782344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f175c101cd0 0x7f175c1980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.713+0000 7f176115d640 1 -- 172.21.15.78:0/2287782344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175c19e180 con 0x7f175c1076e0 2024-09-11T00:14:40.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.713+0000 7f176195e640 1 --2- 172.21.15.78:0/2287782344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f175c101cd0 0x7f175c1980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:14:40.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.713+0000 7f176115d640 1 --2- 172.21.15.78:0/2287782344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f175c1076e0 0x7f175c198610 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f174c00c920 tx=0x7f174c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.713+0000 7f1752ffd640 1 -- 172.21.15.78:0/2287782344 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c007c70 con 0x7f175c1076e0 2024-09-11T00:14:40.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.713+0000 7f1763bc2640 1 -- 172.21.15.78:0/2287782344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f175c19e470 con 0x7f175c1076e0 2024-09-11T00:14:40.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.713+0000 7f1752ffd640 1 -- 172.21.15.78:0/2287782344 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f174c007e10 con 0x7f175c1076e0 2024-09-11T00:14:40.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.713+0000 7f1752ffd640 1 -- 172.21.15.78:0/2287782344 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c018820 con 0x7f175c1076e0 2024-09-11T00:14:40.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.713+0000 7f1763bc2640 1 -- 172.21.15.78:0/2287782344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f175c1a4d00 con 0x7f175c1076e0 2024-09-11T00:14:40.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.714+0000 7f1763bc2640 1 -- 172.21.15.78:0/2287782344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f175c1020b0 con 0x7f175c1076e0 2024-09-11T00:14:40.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.715+0000 7f1752ffd640 1 -- 172.21.15.78:0/2287782344 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f174c00f450 con 0x7f175c1076e0 2024-09-11T00:14:40.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.716+0000 7f1752ffd640 1 --2- 172.21.15.78:0/2287782344 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f17480b53c0 0x7f17480b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:40.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.716+0000 7f176195e640 1 --2- 172.21.15.78:0/2287782344 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f17480b53c0 0x7f17480b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:40.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.716+0000 7f1752ffd640 1 -- 172.21.15.78:0/2287782344 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f174c0e6180 con 0x7f175c1076e0 2024-09-11T00:14:40.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.717+0000 7f176195e640 1 --2- 172.21.15.78:0/2287782344 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f17480b53c0 0x7f17480b7880 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f175800bfd0 tx=0x7f175800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:40.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.719+0000 7f1752ffd640 1 -- 172.21.15.78:0/2287782344 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f174c014030 con 0x7f175c1076e0 2024-09-11T00:14:40.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.926+0000 7f1763bc2640 1 -- 172.21.15.78:0/2287782344 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f175c104ca0 con 0x7f17480b53c0 2024-09-11T00:14:40.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.931+0000 7f1752ffd640 1 -- 172.21.15.78:0/2287782344 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f175c104ca0 con 0x7f17480b53c0 2024-09-11T00:14:40.932 INFO:teuthology.orchestra.run.smithi078.stdout:/volumes/qa/sv_0/4a77624d-ca3d-4bcc-ae36-2d418887cae8 2024-09-11T00:14:40.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.933+0000 7f1763bc2640 1 -- 172.21.15.78:0/2287782344 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f17480b53c0 msgr2=0x7f17480b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.933+0000 7f1763bc2640 1 --2- 172.21.15.78:0/2287782344 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f17480b53c0 0x7f17480b7880 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f175800bfd0 tx=0x7f175800b390 comp rx=0 tx=0).stop 2024-09-11T00:14:40.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.933+0000 7f1763bc2640 1 -- 172.21.15.78:0/2287782344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f175c1076e0 msgr2=0x7f175c198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:40.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.933+0000 7f1763bc2640 1 --2- 172.21.15.78:0/2287782344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f175c1076e0 0x7f175c198610 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f174c00c920 tx=0x7f174c00cde0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.933+0000 7f1763bc2640 1 -- 172.21.15.78:0/2287782344 shutdown_connections 2024-09-11T00:14:40.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.933+0000 7f1763bc2640 1 --2- 172.21.15.78:0/2287782344 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f17480b53c0 0x7f17480b7880 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.933+0000 7f1763bc2640 1 --2- 172.21.15.78:0/2287782344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f175c108060 0x7f175c19d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.933+0000 7f1763bc2640 1 --2- 172.21.15.78:0/2287782344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f175c1076e0 0x7f175c198610 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.933+0000 7f1763bc2640 1 --2- 172.21.15.78:0/2287782344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f175c101cd0 0x7f175c1980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:40.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.933+0000 7f1763bc2640 1 -- 172.21.15.78:0/2287782344 >> 172.21.15.78:0/2287782344 conn(0x7f175c0fd700 msgr2=0x7f175c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:40.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.933+0000 7f1763bc2640 1 -- 172.21.15.78:0/2287782344 shutdown_connections 2024-09-11T00:14:40.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:40.933+0000 7f1763bc2640 1 -- 172.21.15.78:0/2287782344 wait complete. 2024-09-11T00:14:41.674 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-11T00:14:41.923 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:42.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.435+0000 7fc1fd97f640 1 -- 172.21.15.78:0/2508321070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1f8103ca0 msgr2=0x7fc1f8104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.435+0000 7fc1fd97f640 1 --2- 172.21.15.78:0/2508321070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1f8103ca0 0x7fc1f8104080 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009ca0 tx=0x7fc1e802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.436+0000 7fc1fd97f640 1 -- 172.21.15.78:0/2508321070 shutdown_connections 2024-09-11T00:14:42.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.436+0000 7fc1fd97f640 1 --2- 172.21.15.78:0/2508321070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1f810d100 0x7fc1f810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.436+0000 7fc1fd97f640 1 --2- 172.21.15.78:0/2508321070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1f81045c0 0x7fc1f810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.436+0000 7fc1fd97f640 1 --2- 172.21.15.78:0/2508321070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1f8103ca0 0x7fc1f8104080 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.436+0000 7fc1fd97f640 1 -- 172.21.15.78:0/2508321070 >> 172.21.15.78:0/2508321070 conn(0x7fc1f80fd700 msgr2=0x7fc1f80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:42.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.436+0000 7fc1fd97f640 1 -- 172.21.15.78:0/2508321070 shutdown_connections 2024-09-11T00:14:42.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.436+0000 7fc1fd97f640 1 -- 172.21.15.78:0/2508321070 wait complete. 2024-09-11T00:14:42.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.437+0000 7fc1fd97f640 1 Processor -- start 2024-09-11T00:14:42.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.437+0000 7fc1fd97f640 1 -- start start 2024-09-11T00:14:42.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.437+0000 7fc1fd97f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1f8103ca0 0x7fc1f8199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.437+0000 7fc1fd97f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1f81045c0 0x7fc1f8199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.437+0000 7fc1fd97f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1f810d100 0x7fc1f819eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.437+0000 7fc1fd97f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f8112db0 con 0x7fc1f8103ca0 2024-09-11T00:14:42.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.437+0000 7fc1fd97f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f8112c30 con 0x7fc1f81045c0 2024-09-11T00:14:42.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.437+0000 7fc1fd97f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f8112f30 con 0x7fc1f810d100 2024-09-11T00:14:42.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.437+0000 7fc1f6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1f8103ca0 0x7fc1f8199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.437+0000 7fc1f6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1f8103ca0 0x7fc1f8199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46080/0 (socket says 172.21.15.78:46080) 2024-09-11T00:14:42.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.437+0000 7fc1f6ffd640 1 -- 172.21.15.78:0/4244937890 learned_addr learned my addr 172.21.15.78:0/4244937890 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:42.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.437+0000 7fc1f67fc640 1 --2- 172.21.15.78:0/4244937890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1f81045c0 0x7fc1f8199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.437+0000 7fc1f77fe640 1 --2- 172.21.15.78:0/4244937890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1f810d100 0x7fc1f819eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.438+0000 7fc1f6ffd640 1 -- 172.21.15.78:0/4244937890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1f810d100 msgr2=0x7fc1f819eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.438+0000 7fc1f6ffd640 1 --2- 172.21.15.78:0/4244937890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1f810d100 0x7fc1f819eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.438+0000 7fc1f6ffd640 1 -- 172.21.15.78:0/4244937890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1f81045c0 msgr2=0x7fc1f8199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.438+0000 7fc1f6ffd640 1 --2- 172.21.15.78:0/4244937890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1f81045c0 0x7fc1f8199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.438+0000 7fc1f6ffd640 1 -- 172.21.15.78:0/4244937890 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f819f2f0 con 0x7fc1f8103ca0 2024-09-11T00:14:42.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.438+0000 7fc1f6ffd640 1 --2- 172.21.15.78:0/4244937890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1f8103ca0 0x7fc1f8199240 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc1e802ade0 tx=0x7fc1e8003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:42.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.438+0000 7fc1fc97d640 1 -- 172.21.15.78:0/4244937890 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8003d60 con 0x7fc1f8103ca0 2024-09-11T00:14:42.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.438+0000 7fc1fd97f640 1 -- 172.21.15.78:0/4244937890 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1f819f580 con 0x7fc1f8103ca0 2024-09-11T00:14:42.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.438+0000 7fc1fc97d640 1 -- 172.21.15.78:0/4244937890 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1e80044f0 con 0x7fc1f8103ca0 2024-09-11T00:14:42.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.438+0000 7fc1fc97d640 1 -- 172.21.15.78:0/4244937890 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e802fd10 con 0x7fc1f8103ca0 2024-09-11T00:14:42.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.438+0000 7fc1fd97f640 1 -- 172.21.15.78:0/4244937890 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1f81a5d20 con 0x7fc1f8103ca0 2024-09-11T00:14:42.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.439+0000 7fc1fd97f640 1 -- 172.21.15.78:0/4244937890 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1f8104080 con 0x7fc1f8103ca0 2024-09-11T00:14:42.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.440+0000 7fc1fc97d640 1 -- 172.21.15.78:0/4244937890 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fc1e8004040 con 0x7fc1f8103ca0 2024-09-11T00:14:42.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.441+0000 7fc1fc97d640 1 --2- 172.21.15.78:0/4244937890 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc1e40b53c0 0x7fc1e40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:42.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.441+0000 7fc1f67fc640 1 --2- 172.21.15.78:0/4244937890 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc1e40b53c0 0x7fc1e40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:42.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.441+0000 7fc1fc97d640 1 -- 172.21.15.78:0/4244937890 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fc1e8107230 con 0x7fc1f8103ca0 2024-09-11T00:14:42.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.441+0000 7fc1f67fc640 1 --2- 172.21.15.78:0/4244937890 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc1e40b53c0 0x7fc1e40b7880 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80fff50 tx=0x7fc1e0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:42.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.445+0000 7fc1fc97d640 1 -- 172.21.15.78:0/4244937890 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc1e80cdfb0 con 0x7fc1f8103ca0 2024-09-11T00:14:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.644+0000 7fc1fd97f640 1 -- 172.21.15.78:0/4244937890 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fc1f80ff310 con 0x7fc1e40b53c0 2024-09-11T00:14:42.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.668+0000 7fc1fc97d640 1 -- 172.21.15.78:0/4244937890 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc1f80ff310 con 0x7fc1e40b53c0 2024-09-11T00:14:42.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.670+0000 7fc1fd97f640 1 -- 172.21.15.78:0/4244937890 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc1e40b53c0 msgr2=0x7fc1e40b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.670+0000 7fc1fd97f640 1 --2- 172.21.15.78:0/4244937890 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc1e40b53c0 0x7fc1e40b7880 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80fff50 tx=0x7fc1e0005f90 comp rx=0 tx=0).stop 2024-09-11T00:14:42.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.670+0000 7fc1fd97f640 1 -- 172.21.15.78:0/4244937890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1f8103ca0 msgr2=0x7fc1f8199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:42.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.670+0000 7fc1fd97f640 1 --2- 172.21.15.78:0/4244937890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1f8103ca0 0x7fc1f8199240 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc1e802ade0 tx=0x7fc1e8003970 comp rx=0 tx=0).stop 2024-09-11T00:14:42.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.670+0000 7fc1fd97f640 1 -- 172.21.15.78:0/4244937890 shutdown_connections 2024-09-11T00:14:42.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.670+0000 7fc1fd97f640 1 --2- 172.21.15.78:0/4244937890 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc1e40b53c0 0x7fc1e40b7880 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.670+0000 7fc1fd97f640 1 --2- 172.21.15.78:0/4244937890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1f810d100 0x7fc1f819eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.670+0000 7fc1fd97f640 1 --2- 172.21.15.78:0/4244937890 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc1f81045c0 0x7fc1f8199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.670+0000 7fc1fd97f640 1 --2- 172.21.15.78:0/4244937890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1f8103ca0 0x7fc1f8199240 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:42.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.670+0000 7fc1fd97f640 1 -- 172.21.15.78:0/4244937890 >> 172.21.15.78:0/4244937890 conn(0x7fc1f80fd700 msgr2=0x7fc1f810f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:42.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.670+0000 7fc1fd97f640 1 -- 172.21.15.78:0/4244937890 shutdown_connections 2024-09-11T00:14:42.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:42.670+0000 7fc1fd97f640 1 -- 172.21.15.78:0/4244937890 wait complete. 2024-09-11T00:14:42.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:42 smithi112 ceph-mon[35627]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:42.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:42 smithi112 ceph-mon[35627]: pgmap v266: 97 pgs: 97 active+clean; 599 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.5 KiB/s wr, 5 op/s 2024-09-11T00:14:42.983 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:42 smithi078 ceph-mon[30865]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:42.983 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:42 smithi078 ceph-mon[30865]: pgmap v266: 97 pgs: 97 active+clean; 599 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.5 KiB/s wr, 5 op/s 2024-09-11T00:14:43.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:42 smithi138 ceph-mon[35019]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:43.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:42 smithi138 ceph-mon[35019]: pgmap v266: 97 pgs: 97 active+clean; 599 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.5 KiB/s wr, 5 op/s 2024-09-11T00:14:43.448 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-11T00:14:43.697 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:43.981 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:43 smithi078 ceph-mon[30865]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:43.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:43 smithi112 ceph-mon[35627]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:44.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:43 smithi138 ceph-mon[35019]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:44.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.171+0000 7f1b40657640 1 -- 172.21.15.78:0/1534361601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b38102d90 msgr2=0x7f1b38103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:44.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.171+0000 7f1b40657640 1 --2- 172.21.15.78:0/1534361601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b38102d90 0x7f1b38103170 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009900 tx=0x7f1b3402a410 comp rx=0 tx=0).stop 2024-09-11T00:14:44.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.171+0000 7f1b40657640 1 -- 172.21.15.78:0/1534361601 shutdown_connections 2024-09-11T00:14:44.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.171+0000 7f1b40657640 1 --2- 172.21.15.78:0/1534361601 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b38109120 0x7f1b3810f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.171+0000 7f1b40657640 1 --2- 172.21.15.78:0/1534361601 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b381087a0 0x7f1b38108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.171+0000 7f1b40657640 1 --2- 172.21.15.78:0/1534361601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b38102d90 0x7f1b38103170 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.171+0000 7f1b40657640 1 -- 172.21.15.78:0/1534361601 >> 172.21.15.78:0/1534361601 conn(0x7f1b380fe820 msgr2=0x7f1b38100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:44.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.171+0000 7f1b40657640 1 -- 172.21.15.78:0/1534361601 shutdown_connections 2024-09-11T00:14:44.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.171+0000 7f1b40657640 1 -- 172.21.15.78:0/1534361601 wait complete. 2024-09-11T00:14:44.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.172+0000 7f1b40657640 1 Processor -- start 2024-09-11T00:14:44.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.172+0000 7f1b40657640 1 -- start start 2024-09-11T00:14:44.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.172+0000 7f1b40657640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b38102d90 0x7f1b381993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:44.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.172+0000 7f1b40657640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b381087a0 0x7f1b381998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:44.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.172+0000 7f1b40657640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b38109120 0x7f1b3819ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:44.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.172+0000 7f1b40657640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1b38112e20 con 0x7f1b38109120 2024-09-11T00:14:44.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.172+0000 7f1b40657640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1b38112ca0 con 0x7f1b38102d90 2024-09-11T00:14:44.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.172+0000 7f1b40657640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1b38112fa0 con 0x7f1b381087a0 2024-09-11T00:14:44.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.172+0000 7f1b3ebf4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b38109120 0x7f1b3819ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:44.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.172+0000 7f1b3ebf4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b38109120 0x7f1b3819ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46098/0 (socket says 172.21.15.78:46098) 2024-09-11T00:14:44.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.172+0000 7f1b3ebf4640 1 -- 172.21.15.78:0/2955112259 learned_addr learned my addr 172.21.15.78:0/2955112259 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:44.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.172+0000 7f1b3dbf2640 1 --2- 172.21.15.78:0/2955112259 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b381087a0 0x7f1b381998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:44.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.172+0000 7f1b3e3f3640 1 --2- 172.21.15.78:0/2955112259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b38102d90 0x7f1b381993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:44.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.173+0000 7f1b3ebf4640 1 -- 172.21.15.78:0/2955112259 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b381087a0 msgr2=0x7f1b381998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:44.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.173+0000 7f1b3ebf4640 1 --2- 172.21.15.78:0/2955112259 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b381087a0 0x7f1b381998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.173+0000 7f1b3ebf4640 1 -- 172.21.15.78:0/2955112259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b38102d90 msgr2=0x7f1b381993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:44.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.173+0000 7f1b3ebf4640 1 --2- 172.21.15.78:0/2955112259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b38102d90 0x7f1b381993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.173+0000 7f1b3ebf4640 1 -- 172.21.15.78:0/2955112259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b3819f460 con 0x7f1b38109120 2024-09-11T00:14:44.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.173+0000 7f1b3ebf4640 1 --2- 172.21.15.78:0/2955112259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b38109120 0x7f1b3819ec90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1b3000b970 tx=0x7f1b3000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:44.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.173+0000 7f1b2f7fe640 1 -- 172.21.15.78:0/2955112259 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b30019070 con 0x7f1b38109120 2024-09-11T00:14:44.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.173+0000 7f1b40657640 1 -- 172.21.15.78:0/2955112259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b3819f750 con 0x7f1b38109120 2024-09-11T00:14:44.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.173+0000 7f1b2f7fe640 1 -- 172.21.15.78:0/2955112259 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b30014440 con 0x7f1b38109120 2024-09-11T00:14:44.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.173+0000 7f1b2f7fe640 1 -- 172.21.15.78:0/2955112259 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b300075d0 con 0x7f1b38109120 2024-09-11T00:14:44.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.173+0000 7f1b40657640 1 -- 172.21.15.78:0/2955112259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b381a5e90 con 0x7f1b38109120 2024-09-11T00:14:44.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.174+0000 7f1b40657640 1 -- 172.21.15.78:0/2955112259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b381031f0 con 0x7f1b38109120 2024-09-11T00:14:44.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.175+0000 7f1b2f7fe640 1 -- 172.21.15.78:0/2955112259 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f1b3000cb40 con 0x7f1b38109120 2024-09-11T00:14:44.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.176+0000 7f1b2f7fe640 1 --2- 172.21.15.78:0/2955112259 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1b240b53c0 0x7f1b240b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:44.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.176+0000 7f1b3e3f3640 1 --2- 172.21.15.78:0/2955112259 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1b240b53c0 0x7f1b240b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:44.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.176+0000 7f1b2f7fe640 1 -- 172.21.15.78:0/2955112259 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f1b300e5650 con 0x7f1b38109120 2024-09-11T00:14:44.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.176+0000 7f1b3e3f3640 1 --2- 172.21.15.78:0/2955112259 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1b240b53c0 0x7f1b240b7880 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1b34006010 tx=0x7f1b34000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:44.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.180+0000 7f1b2f7fe640 1 -- 172.21.15.78:0/2955112259 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1b300ac370 con 0x7f1b38109120 2024-09-11T00:14:44.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.384+0000 7f1b40657640 1 -- 172.21.15.78:0/2955112259 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f1b38063590 con 0x7f1b240b53c0 2024-09-11T00:14:44.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.388+0000 7f1b2f7fe640 1 -- 172.21.15.78:0/2955112259 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f1b38063590 con 0x7f1b240b53c0 2024-09-11T00:14:44.390 INFO:teuthology.orchestra.run.smithi078.stdout:/volumes/qa/sv_1/151f39ef-458d-4220-9252-c6728cb0fe29 2024-09-11T00:14:44.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.391+0000 7f1b40657640 1 -- 172.21.15.78:0/2955112259 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1b240b53c0 msgr2=0x7f1b240b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:44.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.391+0000 7f1b40657640 1 --2- 172.21.15.78:0/2955112259 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1b240b53c0 0x7f1b240b7880 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1b34006010 tx=0x7f1b34000bc0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.391+0000 7f1b40657640 1 -- 172.21.15.78:0/2955112259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b38109120 msgr2=0x7f1b3819ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:44.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.391+0000 7f1b40657640 1 --2- 172.21.15.78:0/2955112259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b38109120 0x7f1b3819ec90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1b3000b970 tx=0x7f1b3000be30 comp rx=0 tx=0).stop 2024-09-11T00:14:44.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.391+0000 7f1b40657640 1 -- 172.21.15.78:0/2955112259 shutdown_connections 2024-09-11T00:14:44.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.391+0000 7f1b40657640 1 --2- 172.21.15.78:0/2955112259 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1b240b53c0 0x7f1b240b7880 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.391+0000 7f1b40657640 1 --2- 172.21.15.78:0/2955112259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b38109120 0x7f1b3819ec90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.391+0000 7f1b40657640 1 --2- 172.21.15.78:0/2955112259 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b381087a0 0x7f1b381998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.391+0000 7f1b40657640 1 --2- 172.21.15.78:0/2955112259 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b38102d90 0x7f1b381993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:44.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.391+0000 7f1b40657640 1 -- 172.21.15.78:0/2955112259 >> 172.21.15.78:0/2955112259 conn(0x7f1b380fe820 msgr2=0x7f1b38100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:44.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.391+0000 7f1b40657640 1 -- 172.21.15.78:0/2955112259 shutdown_connections 2024-09-11T00:14:44.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:44.391+0000 7f1b40657640 1 -- 172.21.15.78:0/2955112259 wait complete. 2024-09-11T00:14:44.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:44 smithi112 ceph-mon[35627]: pgmap v267: 97 pgs: 97 active+clean; 599 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.1 KiB/s wr, 2 op/s 2024-09-11T00:14:45.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:44 smithi138 ceph-mon[35019]: pgmap v267: 97 pgs: 97 active+clean; 599 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.1 KiB/s wr, 2 op/s 2024-09-11T00:14:45.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:44 smithi078 ceph-mon[30865]: pgmap v267: 97 pgs: 97 active+clean; 599 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2.1 KiB/s wr, 2 op/s 2024-09-11T00:14:45.147 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:14:45.393 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:45.797 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:45 smithi078 ceph-mon[30865]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:45.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.874+0000 7f5c043ba640 1 -- 172.21.15.78:0/1377628014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bfc109150 msgr2=0x7f5bfc10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:45.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.874+0000 7f5c043ba640 1 --2- 172.21.15.78:0/1377628014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bfc109150 0x7f5bfc10f950 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4009ca0 tx=0x7f5bf402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.874+0000 7f5c043ba640 1 -- 172.21.15.78:0/1377628014 shutdown_connections 2024-09-11T00:14:45.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.874+0000 7f5c043ba640 1 --2- 172.21.15.78:0/1377628014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bfc109150 0x7f5bfc10f950 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.874+0000 7f5c043ba640 1 --2- 172.21.15.78:0/1377628014 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bfc1087d0 0x7f5bfc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.874+0000 7f5c043ba640 1 --2- 172.21.15.78:0/1377628014 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bfc102dc0 0x7f5bfc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.874+0000 7f5c043ba640 1 -- 172.21.15.78:0/1377628014 >> 172.21.15.78:0/1377628014 conn(0x7f5bfc0fe830 msgr2=0x7f5bfc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:45.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.874+0000 7f5c043ba640 1 -- 172.21.15.78:0/1377628014 shutdown_connections 2024-09-11T00:14:45.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.874+0000 7f5c043ba640 1 -- 172.21.15.78:0/1377628014 wait complete. 2024-09-11T00:14:45.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.875+0000 7f5c043ba640 1 Processor -- start 2024-09-11T00:14:45.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.875+0000 7f5c043ba640 1 -- start start 2024-09-11T00:14:45.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.875+0000 7f5c043ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bfc102dc0 0x7f5bfc199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.875+0000 7f5c043ba640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bfc1087d0 0x7f5bfc1997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.875+0000 7f5c043ba640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bfc109150 0x7f5bfc19eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.875+0000 7f5c043ba640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5bfc112e10 con 0x7f5bfc102dc0 2024-09-11T00:14:45.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.875+0000 7f5c043ba640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5bfc112c90 con 0x7f5bfc109150 2024-09-11T00:14:45.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.875+0000 7f5c043ba640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5bfc112f90 con 0x7f5bfc1087d0 2024-09-11T00:14:45.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.875+0000 7f5c02156640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bfc102dc0 0x7f5bfc199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.875+0000 7f5c02156640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bfc102dc0 0x7f5bfc199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55320/0 (socket says 172.21.15.78:55320) 2024-09-11T00:14:45.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.875+0000 7f5c02156640 1 -- 172.21.15.78:0/3440465241 learned_addr learned my addr 172.21.15.78:0/3440465241 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:45.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.875+0000 7f5c02957640 1 --2- 172.21.15.78:0/3440465241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bfc109150 0x7f5bfc19eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.875+0000 7f5c02156640 1 -- 172.21.15.78:0/3440465241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bfc1087d0 msgr2=0x7f5bfc1997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:45.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.875+0000 7f5c01955640 1 --2- 172.21.15.78:0/3440465241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bfc1087d0 0x7f5bfc1997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.875+0000 7f5c02156640 1 --2- 172.21.15.78:0/3440465241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bfc1087d0 0x7f5bfc1997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.875+0000 7f5c02156640 1 -- 172.21.15.78:0/3440465241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bfc109150 msgr2=0x7f5bfc19eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:45.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.875+0000 7f5c02156640 1 --2- 172.21.15.78:0/3440465241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bfc109150 0x7f5bfc19eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:45.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.875+0000 7f5c02156640 1 -- 172.21.15.78:0/3440465241 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bfc19f340 con 0x7f5bfc102dc0 2024-09-11T00:14:45.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.875+0000 7f5c02957640 1 --2- 172.21.15.78:0/3440465241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bfc109150 0x7f5bfc19eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:45.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.875+0000 7f5c01955640 1 --2- 172.21.15.78:0/3440465241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bfc1087d0 0x7f5bfc1997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:45.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.875+0000 7f5c02156640 1 --2- 172.21.15.78:0/3440465241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bfc102dc0 0x7f5bfc199290 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000b4a0 tx=0x7f5bf000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:45.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.876+0000 7f5bef7fe640 1 -- 172.21.15.78:0/3440465241 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0014070 con 0x7f5bfc102dc0 2024-09-11T00:14:45.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.876+0000 7f5c043ba640 1 -- 172.21.15.78:0/3440465241 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bfc19f630 con 0x7f5bfc102dc0 2024-09-11T00:14:45.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.876+0000 7f5bef7fe640 1 -- 172.21.15.78:0/3440465241 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bf0010ac0 con 0x7f5bfc102dc0 2024-09-11T00:14:45.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.876+0000 7f5bef7fe640 1 -- 172.21.15.78:0/3440465241 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0017c30 con 0x7f5bfc102dc0 2024-09-11T00:14:45.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.876+0000 7f5c043ba640 1 -- 172.21.15.78:0/3440465241 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bfc1a5ec0 con 0x7f5bfc102dc0 2024-09-11T00:14:45.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.877+0000 7f5c043ba640 1 -- 172.21.15.78:0/3440465241 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bfc1031a0 con 0x7f5bfc102dc0 2024-09-11T00:14:45.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.878+0000 7f5bef7fe640 1 -- 172.21.15.78:0/3440465241 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f5bf0010610 con 0x7f5bfc102dc0 2024-09-11T00:14:45.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.878+0000 7f5bef7fe640 1 --2- 172.21.15.78:0/3440465241 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5be80b53c0 0x7f5be80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:45.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.879+0000 7f5c01955640 1 --2- 172.21.15.78:0/3440465241 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5be80b53c0 0x7f5be80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:45.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.879+0000 7f5bef7fe640 1 -- 172.21.15.78:0/3440465241 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f5bf00e5710 con 0x7f5bfc102dc0 2024-09-11T00:14:45.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.879+0000 7f5c01955640 1 --2- 172.21.15.78:0/3440465241 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5be80b53c0 0x7f5be80b7880 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc104fe0 tx=0x7f5bf8005d30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:45.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:45.883+0000 7f5bef7fe640 1 -- 172.21.15.78:0/3440465241 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5bf00ac490 con 0x7f5bfc102dc0 2024-09-11T00:14:46.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:45 smithi138 ceph-mon[35019]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:46.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:46.094+0000 7f5c043ba640 1 -- 172.21.15.78:0/3440465241 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5bfc19a3c0 con 0x7f5bfc102dc0 2024-09-11T00:14:46.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:46.095+0000 7f5bef7fe640 1 -- 172.21.15.78:0/3440465241 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f5bf00abd90 con 0x7f5bfc102dc0 2024-09-11T00:14:46.098 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:14:46.098 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:14:46.098 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:14:46.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:46.097+0000 7f5c043ba640 1 -- 172.21.15.78:0/3440465241 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5be80b53c0 msgr2=0x7f5be80b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:46.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:46.097+0000 7f5c043ba640 1 --2- 172.21.15.78:0/3440465241 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5be80b53c0 0x7f5be80b7880 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc104fe0 tx=0x7f5bf8005d30 comp rx=0 tx=0).stop 2024-09-11T00:14:46.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:46.097+0000 7f5c043ba640 1 -- 172.21.15.78:0/3440465241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bfc102dc0 msgr2=0x7f5bfc199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:46.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:46.097+0000 7f5c043ba640 1 --2- 172.21.15.78:0/3440465241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bfc102dc0 0x7f5bfc199290 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000b4a0 tx=0x7f5bf000b960 comp rx=0 tx=0).stop 2024-09-11T00:14:46.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:46.097+0000 7f5c043ba640 1 -- 172.21.15.78:0/3440465241 shutdown_connections 2024-09-11T00:14:46.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:46.097+0000 7f5c043ba640 1 --2- 172.21.15.78:0/3440465241 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5be80b53c0 0x7f5be80b7880 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:46.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:46.097+0000 7f5c043ba640 1 --2- 172.21.15.78:0/3440465241 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5bfc109150 0x7f5bfc19eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:46.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:46.097+0000 7f5c043ba640 1 --2- 172.21.15.78:0/3440465241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bfc1087d0 0x7f5bfc1997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:46.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:46.097+0000 7f5c043ba640 1 --2- 172.21.15.78:0/3440465241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bfc102dc0 0x7f5bfc199290 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:46.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:46.097+0000 7f5c043ba640 1 -- 172.21.15.78:0/3440465241 >> 172.21.15.78:0/3440465241 conn(0x7f5bfc0fe830 msgr2=0x7f5bfc105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:46.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:46.097+0000 7f5c043ba640 1 -- 172.21.15.78:0/3440465241 shutdown_connections 2024-09-11T00:14:46.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:46.097+0000 7f5c043ba640 1 -- 172.21.15.78:0/3440465241 wait complete. 2024-09-11T00:14:46.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:45 smithi112 ceph-mon[35627]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:14:46.832 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:14:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:46 smithi138 ceph-mon[35019]: pgmap v268: 97 pgs: 97 active+clean; 618 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.8 KiB/s wr, 4 op/s 2024-09-11T00:14:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:46 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3440465241' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:14:47.081 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:47.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:46 smithi078 ceph-mon[30865]: pgmap v268: 97 pgs: 97 active+clean; 618 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.8 KiB/s wr, 4 op/s 2024-09-11T00:14:47.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:46 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3440465241' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:14:47.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:46 smithi112 ceph-mon[35627]: pgmap v268: 97 pgs: 97 active+clean; 618 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.8 KiB/s wr, 4 op/s 2024-09-11T00:14:47.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:46 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3440465241' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:14:47.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.543+0000 7f01f2192640 1 -- 172.21.15.78:0/2695311083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01ec102da0 msgr2=0x7f01ec103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:47.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.543+0000 7f01f2192640 1 --2- 172.21.15.78:0/2695311083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01ec102da0 0x7f01ec103180 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f01dc009900 tx=0x7f01dc02a410 comp rx=0 tx=0).stop 2024-09-11T00:14:47.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.543+0000 7f01f2192640 1 -- 172.21.15.78:0/2695311083 shutdown_connections 2024-09-11T00:14:47.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.543+0000 7f01f2192640 1 --2- 172.21.15.78:0/2695311083 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01ec109130 0x7f01ec10f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:47.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.543+0000 7f01f2192640 1 --2- 172.21.15.78:0/2695311083 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01ec1087b0 0x7f01ec108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:47.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.543+0000 7f01f2192640 1 --2- 172.21.15.78:0/2695311083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01ec102da0 0x7f01ec103180 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:47.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.543+0000 7f01f2192640 1 -- 172.21.15.78:0/2695311083 >> 172.21.15.78:0/2695311083 conn(0x7f01ec0fe810 msgr2=0x7f01ec100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:47.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.543+0000 7f01f2192640 1 -- 172.21.15.78:0/2695311083 shutdown_connections 2024-09-11T00:14:47.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.543+0000 7f01f2192640 1 -- 172.21.15.78:0/2695311083 wait complete. 2024-09-11T00:14:47.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.544+0000 7f01f2192640 1 Processor -- start 2024-09-11T00:14:47.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.544+0000 7f01f2192640 1 -- start start 2024-09-11T00:14:47.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.544+0000 7f01f2192640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01ec102da0 0x7f01ec199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:47.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.544+0000 7f01f2192640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01ec1087b0 0x7f01ec199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:47.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.544+0000 7f01f2192640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01ec109130 0x7f01ec19eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:47.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.544+0000 7f01f2192640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f01ec112df0 con 0x7f01ec102da0 2024-09-11T00:14:47.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.544+0000 7f01f2192640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f01ec112c70 con 0x7f01ec1087b0 2024-09-11T00:14:47.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.545+0000 7f01f2192640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f01ec112f70 con 0x7f01ec109130 2024-09-11T00:14:47.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.545+0000 7f01eb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01ec102da0 0x7f01ec199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:47.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.545+0000 7f01eb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01ec102da0 0x7f01ec199220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55336/0 (socket says 172.21.15.78:55336) 2024-09-11T00:14:47.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.545+0000 7f01eb7fe640 1 -- 172.21.15.78:0/2713641216 learned_addr learned my addr 172.21.15.78:0/2713641216 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:47.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.545+0000 7f01ebfff640 1 --2- 172.21.15.78:0/2713641216 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01ec109130 0x7f01ec19eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:47.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.545+0000 7f01eb7fe640 1 -- 172.21.15.78:0/2713641216 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01ec109130 msgr2=0x7f01ec19eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:47.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.545+0000 7f01eb7fe640 1 --2- 172.21.15.78:0/2713641216 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01ec109130 0x7f01ec19eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:47.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.545+0000 7f01eaffd640 1 --2- 172.21.15.78:0/2713641216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01ec1087b0 0x7f01ec199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:47.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.545+0000 7f01eb7fe640 1 -- 172.21.15.78:0/2713641216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01ec1087b0 msgr2=0x7f01ec199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:47.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.545+0000 7f01eb7fe640 1 --2- 172.21.15.78:0/2713641216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01ec1087b0 0x7f01ec199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:47.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.545+0000 7f01eb7fe640 1 -- 172.21.15.78:0/2713641216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01ec19f2d0 con 0x7f01ec102da0 2024-09-11T00:14:47.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.545+0000 7f01ebfff640 1 --2- 172.21.15.78:0/2713641216 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01ec109130 0x7f01ec19eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:47.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.545+0000 7f01eb7fe640 1 --2- 172.21.15.78:0/2713641216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01ec102da0 0x7f01ec199220 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f01dc005940 tx=0x7f01dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:47.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.545+0000 7f01e8ff9640 1 -- 172.21.15.78:0/2713641216 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc03f030 con 0x7f01ec102da0 2024-09-11T00:14:47.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.545+0000 7f01e8ff9640 1 -- 172.21.15.78:0/2713641216 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01dc003cb0 con 0x7f01ec102da0 2024-09-11T00:14:47.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.545+0000 7f01f2192640 1 -- 172.21.15.78:0/2713641216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01ec19f560 con 0x7f01ec102da0 2024-09-11T00:14:47.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.545+0000 7f01e8ff9640 1 -- 172.21.15.78:0/2713641216 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc035070 con 0x7f01ec102da0 2024-09-11T00:14:47.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.545+0000 7f01f2192640 1 -- 172.21.15.78:0/2713641216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01ec1a5c80 con 0x7f01ec102da0 2024-09-11T00:14:47.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.546+0000 7f01f2192640 1 -- 172.21.15.78:0/2713641216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01ec103180 con 0x7f01ec102da0 2024-09-11T00:14:47.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.548+0000 7f01e8ff9640 1 -- 172.21.15.78:0/2713641216 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f01dc03bb50 con 0x7f01ec102da0 2024-09-11T00:14:47.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.548+0000 7f01e8ff9640 1 --2- 172.21.15.78:0/2713641216 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f01d40b53c0 0x7f01d40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:47.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.549+0000 7f01eaffd640 1 --2- 172.21.15.78:0/2713641216 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f01d40b53c0 0x7f01d40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:47.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.549+0000 7f01e8ff9640 1 -- 172.21.15.78:0/2713641216 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f01dc106c50 con 0x7f01ec102da0 2024-09-11T00:14:47.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.549+0000 7f01eaffd640 1 --2- 172.21.15.78:0/2713641216 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f01d40b53c0 0x7f01d40b7880 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f01e0005c40 tx=0x7f01e0005bd0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:47.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.551+0000 7f01e8ff9640 1 -- 172.21.15.78:0/2713641216 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f01dc0cd9d0 con 0x7f01ec102da0 2024-09-11T00:14:47.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.728+0000 7f01f2192640 1 -- 172.21.15.78:0/2713641216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01ec1a5f70 con 0x7f01ec102da0 2024-09-11T00:14:47.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.730+0000 7f01e8ff9640 1 -- 172.21.15.78:0/2713641216 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22621 (secure 0 0 0) 0x7f01dc0cd2d0 con 0x7f01ec102da0 2024-09-11T00:14:47.732 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:14:47.732 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":75,"fsid":"85a53860-6fd1-11ef-bcea-c7b262605968","created":"2024-09-11T00:06:05.704745+0000","modified":"2024-09-11T00:14:26.461780+0000","last_up_change":"2024-09-11T00:13:35.307216+0000","last_in_change":"2024-09-11T00:13:12.730667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:09:47.891696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:22.345345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:24.446029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d260c219-52f2-4e7f-9188-9e66ee01dacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6803","nonce":3736366730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6805","nonce":3736366730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6809","nonce":3736366730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6807","nonce":3736366730}]},"public_addr":"172.21.15.78:6803/3736366730","cluster_addr":"172.21.15.78:6805/3736366730","heartbeat_back_addr":"172.21.15.78:6809/3736366730","heartbeat_front_addr":"172.21.15.78:6807/3736366730","state":["exists","up"]},{"osd":1,"uuid":"d0f286a2-a121-40ee-8134-67ef01b1bc9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6801","nonce":3186321784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6803","nonce":3186321784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6807","nonce":3186321784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6805","nonce":3186321784}]},"public_addr":"172.21.15.112:6801/3186321784","cluster_addr":"172.21.15.112:6803/3186321784","heartbeat_back_addr":"172.21.15.112:6807/3186321784","heartbeat_front_addr":"172.21.15.112:6805/3186321784","state":["exists","up"]},{"osd":2,"uuid":"0eadcce5-12af-4af6-9b4e-159e84454d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6801","nonce":3206386630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6803","nonce":3206386630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6807","nonce":3206386630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6805","nonce":3206386630}]},"public_addr":"172.21.15.138:6801/3206386630","cluster_addr":"172.21.15.138:6803/3206386630","heartbeat_back_addr":"172.21.15.138:6807/3206386630","heartbeat_front_addr":"172.21.15.138:6805/3206386630","state":["exists","up"]},{"osd":3,"uuid":"5f3f683d-6306-43da-8bbd-c103eca442ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6811","nonce":3832405256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6813","nonce":3832405256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6817","nonce":3832405256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6815","nonce":3832405256}]},"public_addr":"172.21.15.78:6811/3832405256","cluster_addr":"172.21.15.78:6813/3832405256","heartbeat_back_addr":"172.21.15.78:6817/3832405256","heartbeat_front_addr":"172.21.15.78:6815/3832405256","state":["exists","up"]},{"osd":4,"uuid":"4575a0a5-821e-4346-84ac-5396042b0550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6809","nonce":2650243435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6811","nonce":2650243435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6815","nonce":2650243435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6813","nonce":2650243435}]},"public_addr":"172.21.15.112:6809/2650243435","cluster_addr":"172.21.15.112:6811/2650243435","heartbeat_back_addr":"172.21.15.112:6815/2650243435","heartbeat_front_addr":"172.21.15.112:6813/2650243435","state":["exists","up"]},{"osd":5,"uuid":"e81eb98f-76eb-4da5-8047-f160888720e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6809","nonce":3033110975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6811","nonce":3033110975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6815","nonce":3033110975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6813","nonce":3033110975}]},"public_addr":"172.21.15.138:6809/3033110975","cluster_addr":"172.21.15.138:6811/3033110975","heartbeat_back_addr":"172.21.15.138:6815/3033110975","heartbeat_front_addr":"172.21.15.138:6813/3033110975","state":["exists","up"]},{"osd":6,"uuid":"7442a091-4dba-45c4-808b-7c3b97087aa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6819","nonce":477087575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6821","nonce":477087575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6825","nonce":477087575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6823","nonce":477087575}]},"public_addr":"172.21.15.78:6819/477087575","cluster_addr":"172.21.15.78:6821/477087575","heartbeat_back_addr":"172.21.15.78:6825/477087575","heartbeat_front_addr":"172.21.15.78:6823/477087575","state":["exists","up"]},{"osd":7,"uuid":"220c1f03-ace9-4dd0-a06d-485b0d2d08bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6817","nonce":1481363296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6819","nonce":1481363296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6823","nonce":1481363296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6821","nonce":1481363296}]},"public_addr":"172.21.15.112:6817/1481363296","cluster_addr":"172.21.15.112:6819/1481363296","heartbeat_back_addr":"172.21.15.112:6823/1481363296","heartbeat_front_addr":"172.21.15.112:6821/1481363296","state":["exists","up"]},{"osd":8,"uuid":"adb6edaa-9a8c-4b0b-aa6a-26dc77a3a7cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6817","nonce":2195149036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6819","nonce":2195149036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6823","nonce":2195149036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6821","nonce":2195149036}]},"public_addr":"172.21.15.138:6817/2195149036","cluster_addr":"172.21.15.138:6819/2195149036","heartbeat_back_addr":"172.21.15.138:6823/2195149036","heartbeat_front_addr":"172.21.15.138:6821/2195149036","state":["exists","up"]},{"osd":9,"uuid":"dd01f408-3712-410e-acbd-c797b7ea5058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6827","nonce":3367249449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6829","nonce":3367249449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6833","nonce":3367249449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6831","nonce":3367249449}]},"public_addr":"172.21.15.78:6827/3367249449","cluster_addr":"172.21.15.78:6829/3367249449","heartbeat_back_addr":"172.21.15.78:6833/3367249449","heartbeat_front_addr":"172.21.15.78:6831/3367249449","state":["exists","up"]},{"osd":10,"uuid":"243c6483-1b0e-49f2-b99c-116d9e9c0617","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6825","nonce":775023408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6827","nonce":775023408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6831","nonce":775023408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6829","nonce":775023408}]},"public_addr":"172.21.15.112:6825/775023408","cluster_addr":"172.21.15.112:6827/775023408","heartbeat_back_addr":"172.21.15.112:6831/775023408","heartbeat_front_addr":"172.21.15.112:6829/775023408","state":["exists","up"]},{"osd":11,"uuid":"fa20ac9e-b5f7-4b3a-bb51-31569f909609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6825","nonce":4046089012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6827","nonce":4046089012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6831","nonce":4046089012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6829","nonce":4046089012}]},"public_addr":"172.21.15.138:6825/4046089012","cluster_addr":"172.21.15.138:6827/4046089012","heartbeat_back_addr":"172.21.15.138:6831/4046089012","heartbeat_front_addr":"172.21.15.138:6829/4046089012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:08:55.896475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:20.695819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:44.785187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:10.858705+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:35.855800+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:01.353037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:27.492985+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:52.860532+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:17.946878+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:43.188966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:08.369978+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:34.192288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6801/2525199237":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/1476776463":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1949658157":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2276853910":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/4205790529":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6800/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/4286825123":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6801/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1304243506":"2024-09-12T00:06:56.062555+0000","172.21.15.78:6800/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1614270050":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6801/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1679390655":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2957982486":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6800/2525199237":"2024-09-12T00:07:55.586578+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:14:47.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.732+0000 7f01f2192640 1 -- 172.21.15.78:0/2713641216 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f01d40b53c0 msgr2=0x7f01d40b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:47.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.732+0000 7f01f2192640 1 --2- 172.21.15.78:0/2713641216 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f01d40b53c0 0x7f01d40b7880 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f01e0005c40 tx=0x7f01e0005bd0 comp rx=0 tx=0).stop 2024-09-11T00:14:47.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.732+0000 7f01f2192640 1 -- 172.21.15.78:0/2713641216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01ec102da0 msgr2=0x7f01ec199220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:47.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.732+0000 7f01f2192640 1 --2- 172.21.15.78:0/2713641216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01ec102da0 0x7f01ec199220 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f01dc005940 tx=0x7f01dc0042f0 comp rx=0 tx=0).stop 2024-09-11T00:14:47.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.732+0000 7f01f2192640 1 -- 172.21.15.78:0/2713641216 shutdown_connections 2024-09-11T00:14:47.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.732+0000 7f01f2192640 1 --2- 172.21.15.78:0/2713641216 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f01d40b53c0 0x7f01d40b7880 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:47.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.732+0000 7f01f2192640 1 --2- 172.21.15.78:0/2713641216 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01ec109130 0x7f01ec19eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:47.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.732+0000 7f01f2192640 1 --2- 172.21.15.78:0/2713641216 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01ec1087b0 0x7f01ec199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:47.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.732+0000 7f01f2192640 1 --2- 172.21.15.78:0/2713641216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01ec102da0 0x7f01ec199220 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:47.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.732+0000 7f01f2192640 1 -- 172.21.15.78:0/2713641216 >> 172.21.15.78:0/2713641216 conn(0x7f01ec0fe810 msgr2=0x7f01ec0fff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:47.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.732+0000 7f01f2192640 1 -- 172.21.15.78:0/2713641216 shutdown_connections 2024-09-11T00:14:47.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:47.732+0000 7f01f2192640 1 -- 172.21.15.78:0/2713641216 wait complete. 2024-09-11T00:14:48.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:47 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2713641216' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:14:48.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:47 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2713641216' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:14:48.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:47 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2713641216' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:14:48.558 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T00:14:48.558 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T00:14:48.802 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:48.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:48 smithi078 ceph-mon[30865]: pgmap v269: 97 pgs: 97 active+clean; 618 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-11T00:14:49.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:48 smithi138 ceph-mon[35019]: pgmap v269: 97 pgs: 97 active+clean; 618 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-11T00:14:49.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:48 smithi112 ceph-mon[35627]: pgmap v269: 97 pgs: 97 active+clean; 618 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-11T00:14:49.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.331+0000 7fe037bc4640 1 -- 172.21.15.78:0/640011329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe030102de0 msgr2=0x7fe0301031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:49.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.331+0000 7fe037bc4640 1 --2- 172.21.15.78:0/640011329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe030102de0 0x7fe0301031c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe028009900 tx=0x7fe02802a410 comp rx=0 tx=0).stop 2024-09-11T00:14:49.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.331+0000 7fe037bc4640 1 -- 172.21.15.78:0/640011329 shutdown_connections 2024-09-11T00:14:49.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.331+0000 7fe037bc4640 1 --2- 172.21.15.78:0/640011329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe030109170 0x7fe03010f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:49.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.331+0000 7fe037bc4640 1 --2- 172.21.15.78:0/640011329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe0301087f0 0x7fe030108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:49.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.331+0000 7fe037bc4640 1 --2- 172.21.15.78:0/640011329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe030102de0 0x7fe0301031c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:49.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.331+0000 7fe037bc4640 1 -- 172.21.15.78:0/640011329 >> 172.21.15.78:0/640011329 conn(0x7fe0300fe830 msgr2=0x7fe030100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:49.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.332+0000 7fe037bc4640 1 -- 172.21.15.78:0/640011329 shutdown_connections 2024-09-11T00:14:49.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.332+0000 7fe037bc4640 1 -- 172.21.15.78:0/640011329 wait complete. 2024-09-11T00:14:49.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.332+0000 7fe037bc4640 1 Processor -- start 2024-09-11T00:14:49.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.332+0000 7fe037bc4640 1 -- start start 2024-09-11T00:14:49.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.332+0000 7fe037bc4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe030102de0 0x7fe030199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:49.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.332+0000 7fe037bc4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0301087f0 0x7fe030199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:49.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.332+0000 7fe037bc4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe030109170 0x7fe03019ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:49.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.332+0000 7fe037bc4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe030112e30 con 0x7fe030109170 2024-09-11T00:14:49.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.332+0000 7fe037bc4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe030112cb0 con 0x7fe030102de0 2024-09-11T00:14:49.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.332+0000 7fe037bc4640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe030112fb0 con 0x7fe0301087f0 2024-09-11T00:14:49.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.332+0000 7fe036161640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe030109170 0x7fe03019ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:49.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.333+0000 7fe036161640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe030109170 0x7fe03019ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55360/0 (socket says 172.21.15.78:55360) 2024-09-11T00:14:49.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.333+0000 7fe036161640 1 -- 172.21.15.78:0/3731997714 learned_addr learned my addr 172.21.15.78:0/3731997714 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:49.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.333+0000 7fe035960640 1 --2- 172.21.15.78:0/3731997714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe030102de0 0x7fe030199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:49.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.333+0000 7fe03515f640 1 --2- 172.21.15.78:0/3731997714 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0301087f0 0x7fe030199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:49.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.333+0000 7fe036161640 1 -- 172.21.15.78:0/3731997714 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0301087f0 msgr2=0x7fe030199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:49.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.333+0000 7fe036161640 1 --2- 172.21.15.78:0/3731997714 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0301087f0 0x7fe030199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:49.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.333+0000 7fe036161640 1 -- 172.21.15.78:0/3731997714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe030102de0 msgr2=0x7fe030199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.333+0000 7fe036161640 1 --2- 172.21.15.78:0/3731997714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe030102de0 0x7fe030199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.333+0000 7fe036161640 1 -- 172.21.15.78:0/3731997714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03019f3b0 con 0x7fe030109170 2024-09-11T00:14:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.333+0000 7fe036161640 1 --2- 172.21.15.78:0/3731997714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe030109170 0x7fe03019ebe0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe02000b970 tx=0x7fe02000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.333+0000 7fe02effd640 1 -- 172.21.15.78:0/3731997714 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe020019070 con 0x7fe030109170 2024-09-11T00:14:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.333+0000 7fe02effd640 1 -- 172.21.15.78:0/3731997714 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe020014440 con 0x7fe030109170 2024-09-11T00:14:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.333+0000 7fe037bc4640 1 -- 172.21.15.78:0/3731997714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe03019f6a0 con 0x7fe030109170 2024-09-11T00:14:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.333+0000 7fe02effd640 1 -- 172.21.15.78:0/3731997714 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0200075d0 con 0x7fe030109170 2024-09-11T00:14:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.333+0000 7fe037bc4640 1 -- 172.21.15.78:0/3731997714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0301a5f30 con 0x7fe030109170 2024-09-11T00:14:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.334+0000 7fe037bc4640 1 -- 172.21.15.78:0/3731997714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0301031c0 con 0x7fe030109170 2024-09-11T00:14:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.335+0000 7fe02effd640 1 -- 172.21.15.78:0/3731997714 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fe02000cb40 con 0x7fe030109170 2024-09-11T00:14:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.336+0000 7fe02effd640 1 --2- 172.21.15.78:0/3731997714 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe0180b5440 0x7fe0180b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.336+0000 7fe035960640 1 --2- 172.21.15.78:0/3731997714 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe0180b5440 0x7fe0180b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.336+0000 7fe02effd640 1 -- 172.21.15.78:0/3731997714 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fe0200e54b0 con 0x7fe030109170 2024-09-11T00:14:49.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.337+0000 7fe035960640 1 --2- 172.21.15.78:0/3731997714 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe0180b5440 0x7fe0180b7900 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe028031440 tx=0x7fe028005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:49.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.340+0000 7fe02effd640 1 -- 172.21.15.78:0/3731997714 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe0200abbe0 con 0x7fe030109170 2024-09-11T00:14:49.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.515+0000 7fe037bc4640 1 -- 172.21.15.78:0/3731997714 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe030063590 con 0x7fe0180b5440 2024-09-11T00:14:49.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.520+0000 7fe02effd640 1 -- 172.21.15.78:0/3731997714 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258781 (secure 0 0 0) 0x7fe030063590 con 0x7fe0180b5440 2024-09-11T00:14:49.524 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:14:49.526 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-11T00:14:49.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.523+0000 7fe037bc4640 1 -- 172.21.15.78:0/3731997714 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe0180b5440 msgr2=0x7fe0180b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:49.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.523+0000 7fe037bc4640 1 --2- 172.21.15.78:0/3731997714 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe0180b5440 0x7fe0180b7900 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe028031440 tx=0x7fe028005b50 comp rx=0 tx=0).stop 2024-09-11T00:14:49.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.523+0000 7fe037bc4640 1 -- 172.21.15.78:0/3731997714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe030109170 msgr2=0x7fe03019ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:49.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.523+0000 7fe037bc4640 1 --2- 172.21.15.78:0/3731997714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe030109170 0x7fe03019ebe0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe02000b970 tx=0x7fe02000be30 comp rx=0 tx=0).stop 2024-09-11T00:14:49.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.523+0000 7fe037bc4640 1 -- 172.21.15.78:0/3731997714 shutdown_connections 2024-09-11T00:14:49.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.523+0000 7fe037bc4640 1 --2- 172.21.15.78:0/3731997714 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe0180b5440 0x7fe0180b7900 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:49.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.523+0000 7fe037bc4640 1 --2- 172.21.15.78:0/3731997714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe030109170 0x7fe03019ebe0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:49.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.523+0000 7fe037bc4640 1 --2- 172.21.15.78:0/3731997714 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0301087f0 0x7fe030199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:49.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.523+0000 7fe037bc4640 1 --2- 172.21.15.78:0/3731997714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe030102de0 0x7fe030199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:49.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.523+0000 7fe037bc4640 1 -- 172.21.15.78:0/3731997714 >> 172.21.15.78:0/3731997714 conn(0x7fe0300fe830 msgr2=0x7fe030100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:49.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.523+0000 7fe037bc4640 1 -- 172.21.15.78:0/3731997714 shutdown_connections 2024-09-11T00:14:49.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:49.523+0000 7fe037bc4640 1 -- 172.21.15.78:0/3731997714 wait complete. 2024-09-11T00:14:50.203 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2024-09-11T00:14:47.670815+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":632463,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":115,"num_read_kb":128,"num_write":193,"num_write_kb":2212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359128,"kb_used_data":9860,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124582696,"statfs":{"total":1151940427776,"available":1151572680704,"internally_reserved":0,"allocated":10096640,"data_stored":6710934,"data_compressed":107730,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39685,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":56,"num_write":25,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003330"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.922502+0000","last_change":"2024-09-11T00:14:25.922805+0000","last_active":"2024-09-11T00:14:26.922502+0000","last_peered":"2024-09-11T00:14:26.922502+0000","last_clean":"2024-09-11T00:14:26.922502+0000","last_became_active":"2024-09-11T00:14:25.922482+0000","last_became_peered":"2024-09-11T00:14:25.922482+0000","last_unstale":"2024-09-11T00:14:26.922502+0000","last_undegraded":"2024-09-11T00:14:26.922502+0000","last_fullsized":"2024-09-11T00:14:26.922502+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:53.209011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940392+0000","last_change":"2024-09-11T00:14:25.920760+0000","last_active":"2024-09-11T00:14:26.940392+0000","last_peered":"2024-09-11T00:14:26.940392+0000","last_clean":"2024-09-11T00:14:26.940392+0000","last_became_active":"2024-09-11T00:14:25.919720+0000","last_became_peered":"2024-09-11T00:14:25.919720+0000","last_unstale":"2024-09-11T00:14:26.940392+0000","last_undegraded":"2024-09-11T00:14:26.940392+0000","last_fullsized":"2024-09-11T00:14:26.940392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:32.491200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940386+0000","last_change":"2024-09-11T00:14:25.928090+0000","last_active":"2024-09-11T00:14:26.940386+0000","last_peered":"2024-09-11T00:14:26.940386+0000","last_clean":"2024-09-11T00:14:26.940386+0000","last_became_active":"2024-09-11T00:14:25.927768+0000","last_became_peered":"2024-09-11T00:14:25.927768+0000","last_unstale":"2024-09-11T00:14:26.940386+0000","last_undegraded":"2024-09-11T00:14:26.940386+0000","last_fullsized":"2024-09-11T00:14:26.940386+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:00.025061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.938281+0000","last_change":"2024-09-11T00:14:25.920077+0000","last_active":"2024-09-11T00:14:26.938281+0000","last_peered":"2024-09-11T00:14:26.938281+0000","last_clean":"2024-09-11T00:14:26.938281+0000","last_became_active":"2024-09-11T00:14:25.919395+0000","last_became_peered":"2024-09-11T00:14:25.919395+0000","last_unstale":"2024-09-11T00:14:26.938281+0000","last_undegraded":"2024-09-11T00:14:26.938281+0000","last_fullsized":"2024-09-11T00:14:26.938281+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:41.441279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940034+0000","last_change":"2024-09-11T00:14:25.917872+0000","last_active":"2024-09-11T00:14:26.940034+0000","last_peered":"2024-09-11T00:14:26.940034+0000","last_clean":"2024-09-11T00:14:26.940034+0000","last_became_active":"2024-09-11T00:14:25.917533+0000","last_became_peered":"2024-09-11T00:14:25.917533+0000","last_unstale":"2024-09-11T00:14:26.940034+0000","last_undegraded":"2024-09-11T00:14:26.940034+0000","last_fullsized":"2024-09-11T00:14:26.940034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:57.051435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.936872+0000","last_change":"2024-09-11T00:14:25.914977+0000","last_active":"2024-09-11T00:14:26.936872+0000","last_peered":"2024-09-11T00:14:26.936872+0000","last_clean":"2024-09-11T00:14:26.936872+0000","last_became_active":"2024-09-11T00:14:25.914543+0000","last_became_peered":"2024-09-11T00:14:25.914543+0000","last_unstale":"2024-09-11T00:14:26.936872+0000","last_undegraded":"2024-09-11T00:14:26.936872+0000","last_fullsized":"2024-09-11T00:14:26.936872+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:45.085347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.924352+0000","last_change":"2024-09-11T00:14:25.928021+0000","last_active":"2024-09-11T00:14:26.924352+0000","last_peered":"2024-09-11T00:14:26.924352+0000","last_clean":"2024-09-11T00:14:26.924352+0000","last_became_active":"2024-09-11T00:14:25.927047+0000","last_became_peered":"2024-09-11T00:14:25.927047+0000","last_unstale":"2024-09-11T00:14:26.924352+0000","last_undegraded":"2024-09-11T00:14:26.924352+0000","last_fullsized":"2024-09-11T00:14:26.924352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:41.442622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.936819+0000","last_change":"2024-09-11T00:14:25.925399+0000","last_active":"2024-09-11T00:14:26.936819+0000","last_peered":"2024-09-11T00:14:26.936819+0000","last_clean":"2024-09-11T00:14:26.936819+0000","last_became_active":"2024-09-11T00:14:25.925097+0000","last_became_peered":"2024-09-11T00:14:25.925097+0000","last_unstale":"2024-09-11T00:14:26.936819+0000","last_undegraded":"2024-09-11T00:14:26.936819+0000","last_fullsized":"2024-09-11T00:14:26.936819+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:36:44.962936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940986+0000","last_change":"2024-09-11T00:14:25.928123+0000","last_active":"2024-09-11T00:14:26.940986+0000","last_peered":"2024-09-11T00:14:26.940986+0000","last_clean":"2024-09-11T00:14:26.940986+0000","last_became_active":"2024-09-11T00:14:25.927826+0000","last_became_peered":"2024-09-11T00:14:25.927826+0000","last_unstale":"2024-09-11T00:14:26.940986+0000","last_undegraded":"2024-09-11T00:14:26.940986+0000","last_fullsized":"2024-09-11T00:14:26.940986+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:44.131708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.938119+0000","last_change":"2024-09-11T00:14:25.920546+0000","last_active":"2024-09-11T00:14:26.938119+0000","last_peered":"2024-09-11T00:14:26.938119+0000","last_clean":"2024-09-11T00:14:26.938119+0000","last_became_active":"2024-09-11T00:14:25.920193+0000","last_became_peered":"2024-09-11T00:14:25.920193+0000","last_unstale":"2024-09-11T00:14:26.938119+0000","last_undegraded":"2024-09-11T00:14:26.938119+0000","last_fullsized":"2024-09-11T00:14:26.938119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:55.027260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.924704+0000","last_change":"2024-09-11T00:14:25.931278+0000","last_active":"2024-09-11T00:14:26.924704+0000","last_peered":"2024-09-11T00:14:26.924704+0000","last_clean":"2024-09-11T00:14:26.924704+0000","last_became_active":"2024-09-11T00:14:25.930964+0000","last_became_peered":"2024-09-11T00:14:25.930964+0000","last_unstale":"2024-09-11T00:14:26.924704+0000","last_undegraded":"2024-09-11T00:14:26.924704+0000","last_fullsized":"2024-09-11T00:14:26.924704+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:06.537737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.938261+0000","last_change":"2024-09-11T00:14:25.919725+0000","last_active":"2024-09-11T00:14:26.938261+0000","last_peered":"2024-09-11T00:14:26.938261+0000","last_clean":"2024-09-11T00:14:26.938261+0000","last_became_active":"2024-09-11T00:14:25.918973+0000","last_became_peered":"2024-09-11T00:14:25.918973+0000","last_unstale":"2024-09-11T00:14:26.938261+0000","last_undegraded":"2024-09-11T00:14:26.938261+0000","last_fullsized":"2024-09-11T00:14:26.938261+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:01:03.076980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.921316+0000","last_change":"2024-09-11T00:14:25.922516+0000","last_active":"2024-09-11T00:14:26.921316+0000","last_peered":"2024-09-11T00:14:26.921316+0000","last_clean":"2024-09-11T00:14:26.921316+0000","last_became_active":"2024-09-11T00:14:25.922198+0000","last_became_peered":"2024-09-11T00:14:25.922198+0000","last_unstale":"2024-09-11T00:14:26.921316+0000","last_undegraded":"2024-09-11T00:14:26.921316+0000","last_fullsized":"2024-09-11T00:14:26.921316+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:26.065492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940151+0000","last_change":"2024-09-11T00:14:25.921663+0000","last_active":"2024-09-11T00:14:26.940151+0000","last_peered":"2024-09-11T00:14:26.940151+0000","last_clean":"2024-09-11T00:14:26.940151+0000","last_became_active":"2024-09-11T00:14:25.921328+0000","last_became_peered":"2024-09-11T00:14:25.921328+0000","last_unstale":"2024-09-11T00:14:26.940151+0000","last_undegraded":"2024-09-11T00:14:26.940151+0000","last_fullsized":"2024-09-11T00:14:26.940151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:04.674811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940057+0000","last_change":"2024-09-11T00:14:25.914856+0000","last_active":"2024-09-11T00:14:26.940057+0000","last_peered":"2024-09-11T00:14:26.940057+0000","last_clean":"2024-09-11T00:14:26.940057+0000","last_became_active":"2024-09-11T00:14:25.914564+0000","last_became_peered":"2024-09-11T00:14:25.914564+0000","last_unstale":"2024-09-11T00:14:26.940057+0000","last_undegraded":"2024-09-11T00:14:26.940057+0000","last_fullsized":"2024-09-11T00:14:26.940057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:59:45.395010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.941086+0000","last_change":"2024-09-11T00:14:25.927202+0000","last_active":"2024-09-11T00:14:26.941086+0000","last_peered":"2024-09-11T00:14:26.941086+0000","last_clean":"2024-09-11T00:14:26.941086+0000","last_became_active":"2024-09-11T00:14:25.926872+0000","last_became_peered":"2024-09-11T00:14:25.926872+0000","last_unstale":"2024-09-11T00:14:26.941086+0000","last_undegraded":"2024-09-11T00:14:26.941086+0000","last_fullsized":"2024-09-11T00:14:26.941086+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:44.409956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.922526+0000","last_change":"2024-09-11T00:14:25.923975+0000","last_active":"2024-09-11T00:14:26.922526+0000","last_peered":"2024-09-11T00:14:26.922526+0000","last_clean":"2024-09-11T00:14:26.922526+0000","last_became_active":"2024-09-11T00:14:25.923666+0000","last_became_peered":"2024-09-11T00:14:25.923666+0000","last_unstale":"2024-09-11T00:14:26.922526+0000","last_undegraded":"2024-09-11T00:14:26.922526+0000","last_fullsized":"2024-09-11T00:14:26.922526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:54.803657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.935629+0000","last_change":"2024-09-11T00:14:25.928083+0000","last_active":"2024-09-11T00:14:26.935629+0000","last_peered":"2024-09-11T00:14:26.935629+0000","last_clean":"2024-09-11T00:14:26.935629+0000","last_became_active":"2024-09-11T00:14:25.927727+0000","last_became_peered":"2024-09-11T00:14:25.927727+0000","last_unstale":"2024-09-11T00:14:26.935629+0000","last_undegraded":"2024-09-11T00:14:26.935629+0000","last_fullsized":"2024-09-11T00:14:26.935629+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:56.721661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937220+0000","last_change":"2024-09-11T00:14:25.910506+0000","last_active":"2024-09-11T00:14:26.937220+0000","last_peered":"2024-09-11T00:14:26.937220+0000","last_clean":"2024-09-11T00:14:26.937220+0000","last_became_active":"2024-09-11T00:14:25.910112+0000","last_became_peered":"2024-09-11T00:14:25.910112+0000","last_unstale":"2024-09-11T00:14:26.937220+0000","last_undegraded":"2024-09-11T00:14:26.937220+0000","last_fullsized":"2024-09-11T00:14:26.937220+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:33:32.698411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.922084+0000","last_change":"2024-09-11T00:14:25.918512+0000","last_active":"2024-09-11T00:14:26.922084+0000","last_peered":"2024-09-11T00:14:26.922084+0000","last_clean":"2024-09-11T00:14:26.922084+0000","last_became_active":"2024-09-11T00:14:25.918191+0000","last_became_peered":"2024-09-11T00:14:25.918191+0000","last_unstale":"2024-09-11T00:14:26.922084+0000","last_undegraded":"2024-09-11T00:14:26.922084+0000","last_fullsized":"2024-09-11T00:14:26.922084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:07:49.588919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.921434+0000","last_change":"2024-09-11T00:14:25.918163+0000","last_active":"2024-09-11T00:14:26.921434+0000","last_peered":"2024-09-11T00:14:26.921434+0000","last_clean":"2024-09-11T00:14:26.921434+0000","last_became_active":"2024-09-11T00:14:25.917851+0000","last_became_peered":"2024-09-11T00:14:25.917851+0000","last_unstale":"2024-09-11T00:14:26.921434+0000","last_undegraded":"2024-09-11T00:14:26.921434+0000","last_fullsized":"2024-09-11T00:14:26.921434+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:11.757881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940669+0000","last_change":"2024-09-11T00:14:25.930503+0000","last_active":"2024-09-11T00:14:26.940669+0000","last_peered":"2024-09-11T00:14:26.940669+0000","last_clean":"2024-09-11T00:14:26.940669+0000","last_became_active":"2024-09-11T00:14:25.930140+0000","last_became_peered":"2024-09-11T00:14:25.930140+0000","last_unstale":"2024-09-11T00:14:26.940669+0000","last_undegraded":"2024-09-11T00:14:26.940669+0000","last_fullsized":"2024-09-11T00:14:26.940669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:43.227373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.936892+0000","last_change":"2024-09-11T00:14:25.916866+0000","last_active":"2024-09-11T00:14:26.936892+0000","last_peered":"2024-09-11T00:14:26.936892+0000","last_clean":"2024-09-11T00:14:26.936892+0000","last_became_active":"2024-09-11T00:14:25.916393+0000","last_became_peered":"2024-09-11T00:14:25.916393+0000","last_unstale":"2024-09-11T00:14:26.936892+0000","last_undegraded":"2024-09-11T00:14:26.936892+0000","last_fullsized":"2024-09-11T00:14:26.936892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:52.697895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937633+0000","last_change":"2024-09-11T00:14:25.918541+0000","last_active":"2024-09-11T00:14:26.937633+0000","last_peered":"2024-09-11T00:14:26.937633+0000","last_clean":"2024-09-11T00:14:26.937633+0000","last_became_active":"2024-09-11T00:14:25.918254+0000","last_became_peered":"2024-09-11T00:14:25.918254+0000","last_unstale":"2024-09-11T00:14:26.937633+0000","last_undegraded":"2024-09-11T00:14:26.937633+0000","last_fullsized":"2024-09-11T00:14:26.937633+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:25.577918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937582+0000","last_change":"2024-09-11T00:14:25.913694+0000","last_active":"2024-09-11T00:14:26.937582+0000","last_peered":"2024-09-11T00:14:26.937582+0000","last_clean":"2024-09-11T00:14:26.937582+0000","last_became_active":"2024-09-11T00:14:25.913405+0000","last_became_peered":"2024-09-11T00:14:25.913405+0000","last_unstale":"2024-09-11T00:14:26.937582+0000","last_undegraded":"2024-09-11T00:14:26.937582+0000","last_fullsized":"2024-09-11T00:14:26.937582+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:24.636698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937370+0000","last_change":"2024-09-11T00:14:25.928598+0000","last_active":"2024-09-11T00:14:26.937370+0000","last_peered":"2024-09-11T00:14:26.937370+0000","last_clean":"2024-09-11T00:14:26.937370+0000","last_became_active":"2024-09-11T00:14:25.928230+0000","last_became_peered":"2024-09-11T00:14:25.928230+0000","last_unstale":"2024-09-11T00:14:26.937370+0000","last_undegraded":"2024-09-11T00:14:26.937370+0000","last_fullsized":"2024-09-11T00:14:26.937370+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:00.820900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.922266+0000","last_change":"2024-09-11T00:14:25.922296+0000","last_active":"2024-09-11T00:14:26.922266+0000","last_peered":"2024-09-11T00:14:26.922266+0000","last_clean":"2024-09-11T00:14:26.922266+0000","last_became_active":"2024-09-11T00:14:25.921188+0000","last_became_peered":"2024-09-11T00:14:25.921188+0000","last_unstale":"2024-09-11T00:14:26.922266+0000","last_undegraded":"2024-09-11T00:14:26.922266+0000","last_fullsized":"2024-09-11T00:14:26.922266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:31.478302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.921356+0000","last_change":"2024-09-11T00:14:25.910201+0000","last_active":"2024-09-11T00:14:26.921356+0000","last_peered":"2024-09-11T00:14:26.921356+0000","last_clean":"2024-09-11T00:14:26.921356+0000","last_became_active":"2024-09-11T00:14:25.909867+0000","last_became_peered":"2024-09-11T00:14:25.909867+0000","last_unstale":"2024-09-11T00:14:26.921356+0000","last_undegraded":"2024-09-11T00:14:26.921356+0000","last_fullsized":"2024-09-11T00:14:26.921356+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:17.445805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940558+0000","last_change":"2024-09-11T00:14:25.914971+0000","last_active":"2024-09-11T00:14:26.940558+0000","last_peered":"2024-09-11T00:14:26.940558+0000","last_clean":"2024-09-11T00:14:26.940558+0000","last_became_active":"2024-09-11T00:14:25.914614+0000","last_became_peered":"2024-09-11T00:14:25.914614+0000","last_unstale":"2024-09-11T00:14:26.940558+0000","last_undegraded":"2024-09-11T00:14:26.940558+0000","last_fullsized":"2024-09-11T00:14:26.940558+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.936776+0000","last_change":"2024-09-11T00:14:25.916006+0000","last_active":"2024-09-11T00:14:26.936776+0000","last_peered":"2024-09-11T00:14:26.936776+0000","last_clean":"2024-09-11T00:14:26.936776+0000","last_became_active":"2024-09-11T00:14:25.915479+0000","last_became_peered":"2024-09-11T00:14:25.915479+0000","last_unstale":"2024-09-11T00:14:26.936776+0000","last_undegraded":"2024-09-11T00:14:26.936776+0000","last_fullsized":"2024-09-11T00:14:26.936776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:42.513673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.939260+0000","last_change":"2024-09-11T00:14:25.925601+0000","last_active":"2024-09-11T00:14:26.939260+0000","last_peered":"2024-09-11T00:14:26.939260+0000","last_clean":"2024-09-11T00:14:26.939260+0000","last_became_active":"2024-09-11T00:14:25.925289+0000","last_became_peered":"2024-09-11T00:14:25.925289+0000","last_unstale":"2024-09-11T00:14:26.939260+0000","last_undegraded":"2024-09-11T00:14:26.939260+0000","last_fullsized":"2024-09-11T00:14:26.939260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:17.324565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.921980+0000","last_change":"2024-09-11T00:14:25.922316+0000","last_active":"2024-09-11T00:14:26.921980+0000","last_peered":"2024-09-11T00:14:26.921980+0000","last_clean":"2024-09-11T00:14:26.921980+0000","last_became_active":"2024-09-11T00:14:25.920991+0000","last_became_peered":"2024-09-11T00:14:25.920991+0000","last_unstale":"2024-09-11T00:14:26.921980+0000","last_undegraded":"2024-09-11T00:14:26.921980+0000","last_fullsized":"2024-09-11T00:14:26.921980+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:36.362500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.936685+0000","last_change":"2024-09-11T00:14:25.919579+0000","last_active":"2024-09-11T00:14:26.936685+0000","last_peered":"2024-09-11T00:14:26.936685+0000","last_clean":"2024-09-11T00:14:26.936685+0000","last_became_active":"2024-09-11T00:14:25.919245+0000","last_became_peered":"2024-09-11T00:14:25.919245+0000","last_unstale":"2024-09-11T00:14:26.936685+0000","last_undegraded":"2024-09-11T00:14:26.936685+0000","last_fullsized":"2024-09-11T00:14:26.936685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:47.885242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937292+0000","last_change":"2024-09-11T00:14:23.917666+0000","last_active":"2024-09-11T00:14:26.937292+0000","last_peered":"2024-09-11T00:14:26.937292+0000","last_clean":"2024-09-11T00:14:26.937292+0000","last_became_active":"2024-09-11T00:14:23.917336+0000","last_became_peered":"2024-09-11T00:14:23.917336+0000","last_unstale":"2024-09-11T00:14:26.937292+0000","last_undegraded":"2024-09-11T00:14:26.937292+0000","last_fullsized":"2024-09-11T00:14:26.937292+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:01:00.649017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937080+0000","last_change":"2024-09-11T00:14:25.921414+0000","last_active":"2024-09-11T00:14:26.937080+0000","last_peered":"2024-09-11T00:14:26.937080+0000","last_clean":"2024-09-11T00:14:26.937080+0000","last_became_active":"2024-09-11T00:14:25.921096+0000","last_became_peered":"2024-09-11T00:14:25.921096+0000","last_unstale":"2024-09-11T00:14:26.937080+0000","last_undegraded":"2024-09-11T00:14:26.937080+0000","last_fullsized":"2024-09-11T00:14:26.937080+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:38:45.938435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937102+0000","last_change":"2024-09-11T00:14:23.913359+0000","last_active":"2024-09-11T00:14:26.937102+0000","last_peered":"2024-09-11T00:14:26.937102+0000","last_clean":"2024-09-11T00:14:26.937102+0000","last_became_active":"2024-09-11T00:14:23.913073+0000","last_became_peered":"2024-09-11T00:14:23.913073+0000","last_unstale":"2024-09-11T00:14:26.937102+0000","last_undegraded":"2024-09-11T00:14:26.937102+0000","last_fullsized":"2024-09-11T00:14:26.937102+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:04.907618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.921404+0000","last_change":"2024-09-11T00:14:23.905723+0000","last_active":"2024-09-11T00:14:26.921404+0000","last_peered":"2024-09-11T00:14:26.921404+0000","last_clean":"2024-09-11T00:14:26.921404+0000","last_became_active":"2024-09-11T00:14:23.905392+0000","last_became_peered":"2024-09-11T00:14:23.905392+0000","last_unstale":"2024-09-11T00:14:26.921404+0000","last_undegraded":"2024-09-11T00:14:26.921404+0000","last_fullsized":"2024-09-11T00:14:26.921404+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:48.603410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937023+0000","last_change":"2024-09-11T00:14:25.915843+0000","last_active":"2024-09-11T00:14:26.937023+0000","last_peered":"2024-09-11T00:14:26.937023+0000","last_clean":"2024-09-11T00:14:26.937023+0000","last_became_active":"2024-09-11T00:14:25.915543+0000","last_became_peered":"2024-09-11T00:14:25.915543+0000","last_unstale":"2024-09-11T00:14:26.937023+0000","last_undegraded":"2024-09-11T00:14:26.937023+0000","last_fullsized":"2024-09-11T00:14:26.937023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:10.781401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.938077+0000","last_change":"2024-09-11T00:14:23.913017+0000","last_active":"2024-09-11T00:14:26.938077+0000","last_peered":"2024-09-11T00:14:26.938077+0000","last_clean":"2024-09-11T00:14:26.938077+0000","last_became_active":"2024-09-11T00:14:23.912674+0000","last_became_peered":"2024-09-11T00:14:23.912674+0000","last_unstale":"2024-09-11T00:14:26.938077+0000","last_undegraded":"2024-09-11T00:14:26.938077+0000","last_fullsized":"2024-09-11T00:14:26.938077+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:22.711358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.935382+0000","last_change":"2024-09-11T00:14:25.917969+0000","last_active":"2024-09-11T00:14:26.935382+0000","last_peered":"2024-09-11T00:14:26.935382+0000","last_clean":"2024-09-11T00:14:26.935382+0000","last_became_active":"2024-09-11T00:14:25.917673+0000","last_became_peered":"2024-09-11T00:14:25.917673+0000","last_unstale":"2024-09-11T00:14:26.935382+0000","last_undegraded":"2024-09-11T00:14:26.935382+0000","last_fullsized":"2024-09-11T00:14:26.935382+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:55:36.992260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937312+0000","last_change":"2024-09-11T00:14:23.915544+0000","last_active":"2024-09-11T00:14:26.937312+0000","last_peered":"2024-09-11T00:14:26.937312+0000","last_clean":"2024-09-11T00:14:26.937312+0000","last_became_active":"2024-09-11T00:14:23.915129+0000","last_became_peered":"2024-09-11T00:14:23.915129+0000","last_unstale":"2024-09-11T00:14:26.937312+0000","last_undegraded":"2024-09-11T00:14:26.937312+0000","last_fullsized":"2024-09-11T00:14:26.937312+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:06.720068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940663+0000","last_change":"2024-09-11T00:14:25.927212+0000","last_active":"2024-09-11T00:14:26.940663+0000","last_peered":"2024-09-11T00:14:26.940663+0000","last_clean":"2024-09-11T00:14:26.940663+0000","last_became_active":"2024-09-11T00:14:25.926875+0000","last_became_peered":"2024-09-11T00:14:25.926875+0000","last_unstale":"2024-09-11T00:14:26.940663+0000","last_undegraded":"2024-09-11T00:14:26.940663+0000","last_fullsized":"2024-09-11T00:14:26.940663+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:06.749494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.924437+0000","last_change":"2024-09-11T00:14:23.907318+0000","last_active":"2024-09-11T00:14:26.924437+0000","last_peered":"2024-09-11T00:14:26.924437+0000","last_clean":"2024-09-11T00:14:26.924437+0000","last_became_active":"2024-09-11T00:14:23.905858+0000","last_became_peered":"2024-09-11T00:14:23.905858+0000","last_unstale":"2024-09-11T00:14:26.924437+0000","last_undegraded":"2024-09-11T00:14:26.924437+0000","last_fullsized":"2024-09-11T00:14:26.924437+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:16.005219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940861+0000","last_change":"2024-09-11T00:14:25.922126+0000","last_active":"2024-09-11T00:14:26.940861+0000","last_peered":"2024-09-11T00:14:26.940861+0000","last_clean":"2024-09-11T00:14:26.940861+0000","last_became_active":"2024-09-11T00:14:25.921801+0000","last_became_peered":"2024-09-11T00:14:25.921801+0000","last_unstale":"2024-09-11T00:14:26.940861+0000","last_undegraded":"2024-09-11T00:14:26.940861+0000","last_fullsized":"2024-09-11T00:14:26.940861+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:06.770343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.944217+0000","last_change":"2024-09-11T00:14:24.083872+0000","last_active":"2024-09-11T00:14:26.944217+0000","last_peered":"2024-09-11T00:14:26.944217+0000","last_clean":"2024-09-11T00:14:26.944217+0000","last_became_active":"2024-09-11T00:14:24.083479+0000","last_became_peered":"2024-09-11T00:14:24.083479+0000","last_unstale":"2024-09-11T00:14:26.944217+0000","last_undegraded":"2024-09-11T00:14:26.944217+0000","last_fullsized":"2024-09-11T00:14:26.944217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:19:30.492828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940936+0000","last_change":"2024-09-11T00:14:25.932281+0000","last_active":"2024-09-11T00:14:26.940936+0000","last_peered":"2024-09-11T00:14:26.940936+0000","last_clean":"2024-09-11T00:14:26.940936+0000","last_became_active":"2024-09-11T00:14:25.931935+0000","last_became_peered":"2024-09-11T00:14:25.931935+0000","last_unstale":"2024-09-11T00:14:26.940936+0000","last_undegraded":"2024-09-11T00:14:26.940936+0000","last_fullsized":"2024-09-11T00:14:26.940936+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:55.166421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'19","reported_seq":66,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:43.973577+0000","last_change":"2024-09-11T00:14:23.909614+0000","last_active":"2024-09-11T00:14:43.973577+0000","last_peered":"2024-09-11T00:14:43.973577+0000","last_clean":"2024-09-11T00:14:43.973577+0000","last_became_active":"2024-09-11T00:14:23.909209+0000","last_became_peered":"2024-09-11T00:14:23.909209+0000","last_unstale":"2024-09-11T00:14:43.973577+0000","last_undegraded":"2024-09-11T00:14:43.973577+0000","last_fullsized":"2024-09-11T00:14:43.973577+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:14.467304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41063,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":53,"num_write":19,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.938782+0000","last_change":"2024-09-11T00:14:25.924008+0000","last_active":"2024-09-11T00:14:26.938782+0000","last_peered":"2024-09-11T00:14:26.938782+0000","last_clean":"2024-09-11T00:14:26.938782+0000","last_became_active":"2024-09-11T00:14:25.923680+0000","last_became_peered":"2024-09-11T00:14:25.923680+0000","last_unstale":"2024-09-11T00:14:26.938782+0000","last_undegraded":"2024-09-11T00:14:26.938782+0000","last_fullsized":"2024-09-11T00:14:26.938782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:27.106405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:27.731957+0000","last_change":"2024-09-11T00:14:23.906908+0000","last_active":"2024-09-11T00:14:27.731957+0000","last_peered":"2024-09-11T00:14:27.731957+0000","last_clean":"2024-09-11T00:14:27.731957+0000","last_became_active":"2024-09-11T00:14:23.906170+0000","last_became_peered":"2024-09-11T00:14:23.906170+0000","last_unstale":"2024-09-11T00:14:27.731957+0000","last_undegraded":"2024-09-11T00:14:27.731957+0000","last_fullsized":"2024-09-11T00:14:27.731957+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:10:27.314551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.921182+0000","last_change":"2024-09-11T00:14:25.917896+0000","last_active":"2024-09-11T00:14:26.921182+0000","last_peered":"2024-09-11T00:14:26.921182+0000","last_clean":"2024-09-11T00:14:26.921182+0000","last_became_active":"2024-09-11T00:14:25.916341+0000","last_became_peered":"2024-09-11T00:14:25.916341+0000","last_unstale":"2024-09-11T00:14:26.921182+0000","last_undegraded":"2024-09-11T00:14:26.921182+0000","last_fullsized":"2024-09-11T00:14:26.921182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:05.723223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.938674+0000","last_change":"2024-09-11T00:14:23.913113+0000","last_active":"2024-09-11T00:14:26.938674+0000","last_peered":"2024-09-11T00:14:26.938674+0000","last_clean":"2024-09-11T00:14:26.938674+0000","last_became_active":"2024-09-11T00:14:23.912791+0000","last_became_peered":"2024-09-11T00:14:23.912791+0000","last_unstale":"2024-09-11T00:14:26.938674+0000","last_undegraded":"2024-09-11T00:14:26.938674+0000","last_fullsized":"2024-09-11T00:14:26.938674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:31.124528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.924750+0000","last_change":"2024-09-11T00:14:25.927511+0000","last_active":"2024-09-11T00:14:26.924750+0000","last_peered":"2024-09-11T00:14:26.924750+0000","last_clean":"2024-09-11T00:14:26.924750+0000","last_became_active":"2024-09-11T00:14:25.927144+0000","last_became_peered":"2024-09-11T00:14:25.927144+0000","last_unstale":"2024-09-11T00:14:26.924750+0000","last_undegraded":"2024-09-11T00:14:26.924750+0000","last_fullsized":"2024-09-11T00:14:26.924750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:35.680110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.936505+0000","last_change":"2024-09-11T00:14:23.906706+0000","last_active":"2024-09-11T00:14:26.936505+0000","last_peered":"2024-09-11T00:14:26.936505+0000","last_clean":"2024-09-11T00:14:26.936505+0000","last_became_active":"2024-09-11T00:14:23.906368+0000","last_became_peered":"2024-09-11T00:14:23.906368+0000","last_unstale":"2024-09-11T00:14:26.936505+0000","last_undegraded":"2024-09-11T00:14:26.936505+0000","last_fullsized":"2024-09-11T00:14:26.936505+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:30:40.798446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.924287+0000","last_change":"2024-09-11T00:14:25.925996+0000","last_active":"2024-09-11T00:14:26.924287+0000","last_peered":"2024-09-11T00:14:26.924287+0000","last_clean":"2024-09-11T00:14:26.924287+0000","last_became_active":"2024-09-11T00:14:25.925653+0000","last_became_peered":"2024-09-11T00:14:25.925653+0000","last_unstale":"2024-09-11T00:14:26.924287+0000","last_undegraded":"2024-09-11T00:14:26.924287+0000","last_fullsized":"2024-09-11T00:14:26.924287+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:50.366666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.946360+0000","last_change":"2024-09-11T00:14:24.083774+0000","last_active":"2024-09-11T00:14:26.946360+0000","last_peered":"2024-09-11T00:14:26.946360+0000","last_clean":"2024-09-11T00:14:26.946360+0000","last_became_active":"2024-09-11T00:14:24.083398+0000","last_became_peered":"2024-09-11T00:14:24.083398+0000","last_unstale":"2024-09-11T00:14:26.946360+0000","last_undegraded":"2024-09-11T00:14:26.946360+0000","last_fullsized":"2024-09-11T00:14:26.946360+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:34.019592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.939158+0000","last_change":"2024-09-11T00:14:25.927171+0000","last_active":"2024-09-11T00:14:26.939158+0000","last_peered":"2024-09-11T00:14:26.939158+0000","last_clean":"2024-09-11T00:14:26.939158+0000","last_became_active":"2024-09-11T00:14:25.926873+0000","last_became_peered":"2024-09-11T00:14:25.926873+0000","last_unstale":"2024-09-11T00:14:26.939158+0000","last_undegraded":"2024-09-11T00:14:26.939158+0000","last_fullsized":"2024-09-11T00:14:26.939158+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:26.042903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.944866+0000","last_change":"2024-09-11T00:14:23.915816+0000","last_active":"2024-09-11T00:14:26.944866+0000","last_peered":"2024-09-11T00:14:26.944866+0000","last_clean":"2024-09-11T00:14:26.944866+0000","last_became_active":"2024-09-11T00:14:23.915305+0000","last_became_peered":"2024-09-11T00:14:23.915305+0000","last_unstale":"2024-09-11T00:14:26.944866+0000","last_undegraded":"2024-09-11T00:14:26.944866+0000","last_fullsized":"2024-09-11T00:14:26.944866+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:34:10.224582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.922295+0000","last_change":"2024-09-11T00:14:25.927502+0000","last_active":"2024-09-11T00:14:26.922295+0000","last_peered":"2024-09-11T00:14:26.922295+0000","last_clean":"2024-09-11T00:14:26.922295+0000","last_became_active":"2024-09-11T00:14:25.927107+0000","last_became_peered":"2024-09-11T00:14:25.927107+0000","last_unstale":"2024-09-11T00:14:26.922295+0000","last_undegraded":"2024-09-11T00:14:26.922295+0000","last_fullsized":"2024-09-11T00:14:26.922295+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:53.974425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940675+0000","last_change":"2024-09-11T00:14:23.904807+0000","last_active":"2024-09-11T00:14:26.940675+0000","last_peered":"2024-09-11T00:14:26.940675+0000","last_clean":"2024-09-11T00:14:26.940675+0000","last_became_active":"2024-09-11T00:14:23.904532+0000","last_became_peered":"2024-09-11T00:14:23.904532+0000","last_unstale":"2024-09-11T00:14:26.940675+0000","last_undegraded":"2024-09-11T00:14:26.940675+0000","last_fullsized":"2024-09-11T00:14:26.940675+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:08.945508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.924663+0000","last_change":"2024-09-11T00:14:25.919548+0000","last_active":"2024-09-11T00:14:26.924663+0000","last_peered":"2024-09-11T00:14:26.924663+0000","last_clean":"2024-09-11T00:14:26.924663+0000","last_became_active":"2024-09-11T00:14:25.919216+0000","last_became_peered":"2024-09-11T00:14:25.919216+0000","last_unstale":"2024-09-11T00:14:26.924663+0000","last_undegraded":"2024-09-11T00:14:26.924663+0000","last_fullsized":"2024-09-11T00:14:26.924663+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:18.318193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.944353+0000","last_change":"2024-09-11T00:14:23.915488+0000","last_active":"2024-09-11T00:14:26.944353+0000","last_peered":"2024-09-11T00:14:26.944353+0000","last_clean":"2024-09-11T00:14:26.944353+0000","last_became_active":"2024-09-11T00:14:23.915147+0000","last_became_peered":"2024-09-11T00:14:23.915147+0000","last_unstale":"2024-09-11T00:14:26.944353+0000","last_undegraded":"2024-09-11T00:14:26.944353+0000","last_fullsized":"2024-09-11T00:14:26.944353+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:04.830225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:29.676987+0000","last_change":"2024-09-11T00:14:25.919774+0000","last_active":"2024-09-11T00:14:29.676987+0000","last_peered":"2024-09-11T00:14:29.676987+0000","last_clean":"2024-09-11T00:14:29.676987+0000","last_became_active":"2024-09-11T00:14:25.919422+0000","last_became_peered":"2024-09-11T00:14:25.919422+0000","last_unstale":"2024-09-11T00:14:29.676987+0000","last_undegraded":"2024-09-11T00:14:29.676987+0000","last_fullsized":"2024-09-11T00:14:29.676987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:03.928972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.938891+0000","last_change":"2024-09-11T00:14:24.082414+0000","last_active":"2024-09-11T00:14:26.938891+0000","last_peered":"2024-09-11T00:14:26.938891+0000","last_clean":"2024-09-11T00:14:26.938891+0000","last_became_active":"2024-09-11T00:14:24.082058+0000","last_became_peered":"2024-09-11T00:14:24.082058+0000","last_unstale":"2024-09-11T00:14:26.938891+0000","last_undegraded":"2024-09-11T00:14:26.938891+0000","last_fullsized":"2024-09-11T00:14:26.938891+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:38.349964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.924958+0000","last_change":"2024-09-11T00:14:25.930116+0000","last_active":"2024-09-11T00:14:26.924958+0000","last_peered":"2024-09-11T00:14:26.924958+0000","last_clean":"2024-09-11T00:14:26.924958+0000","last_became_active":"2024-09-11T00:14:25.929787+0000","last_became_peered":"2024-09-11T00:14:25.929787+0000","last_unstale":"2024-09-11T00:14:26.924958+0000","last_undegraded":"2024-09-11T00:14:26.924958+0000","last_fullsized":"2024-09-11T00:14:26.924958+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:29.655577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.924961+0000","last_change":"2024-09-11T00:13:12.338952+0000","last_active":"2024-09-11T00:14:26.924961+0000","last_peered":"2024-09-11T00:14:26.924961+0000","last_clean":"2024-09-11T00:14:26.924961+0000","last_became_active":"2024-09-11T00:13:12.335030+0000","last_became_peered":"2024-09-11T00:13:12.335030+0000","last_unstale":"2024-09-11T00:14:26.924961+0000","last_undegraded":"2024-09-11T00:14:26.924961+0000","last_fullsized":"2024-09-11T00:14:26.924961+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:09:48.709624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:09:48.709624+0000","last_clean_scrub_stamp":"2024-09-11T00:09:48.709624+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:43.680771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.936761+0000","last_change":"2024-09-11T00:14:23.906794+0000","last_active":"2024-09-11T00:14:26.936761+0000","last_peered":"2024-09-11T00:14:26.936761+0000","last_clean":"2024-09-11T00:14:26.936761+0000","last_became_active":"2024-09-11T00:14:23.906430+0000","last_became_peered":"2024-09-11T00:14:23.906430+0000","last_unstale":"2024-09-11T00:14:26.936761+0000","last_undegraded":"2024-09-11T00:14:26.936761+0000","last_fullsized":"2024-09-11T00:14:26.936761+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:58.804834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937933+0000","last_change":"2024-09-11T00:14:25.928119+0000","last_active":"2024-09-11T00:14:26.937933+0000","last_peered":"2024-09-11T00:14:26.937933+0000","last_clean":"2024-09-11T00:14:26.937933+0000","last_became_active":"2024-09-11T00:14:25.927806+0000","last_became_peered":"2024-09-11T00:14:25.927806+0000","last_unstale":"2024-09-11T00:14:26.937933+0000","last_undegraded":"2024-09-11T00:14:26.937933+0000","last_fullsized":"2024-09-11T00:14:26.937933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:34.630696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.925024+0000","last_change":"2024-09-11T00:14:23.916252+0000","last_active":"2024-09-11T00:14:26.925024+0000","last_peered":"2024-09-11T00:14:26.925024+0000","last_clean":"2024-09-11T00:14:26.925024+0000","last_became_active":"2024-09-11T00:14:23.915905+0000","last_became_peered":"2024-09-11T00:14:23.915905+0000","last_unstale":"2024-09-11T00:14:26.925024+0000","last_undegraded":"2024-09-11T00:14:26.925024+0000","last_fullsized":"2024-09-11T00:14:26.925024+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:02.229067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.921166+0000","last_change":"2024-09-11T00:14:25.910163+0000","last_active":"2024-09-11T00:14:26.921166+0000","last_peered":"2024-09-11T00:14:26.921166+0000","last_clean":"2024-09-11T00:14:26.921166+0000","last_became_active":"2024-09-11T00:14:25.909926+0000","last_became_peered":"2024-09-11T00:14:25.909926+0000","last_unstale":"2024-09-11T00:14:26.921166+0000","last_undegraded":"2024-09-11T00:14:26.921166+0000","last_fullsized":"2024-09-11T00:14:26.921166+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:59:20.915080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.921573+0000","last_change":"2024-09-11T00:14:24.081999+0000","last_active":"2024-09-11T00:14:26.921573+0000","last_peered":"2024-09-11T00:14:26.921573+0000","last_clean":"2024-09-11T00:14:26.921573+0000","last_became_active":"2024-09-11T00:14:24.081664+0000","last_became_peered":"2024-09-11T00:14:24.081664+0000","last_unstale":"2024-09-11T00:14:26.921573+0000","last_undegraded":"2024-09-11T00:14:26.921573+0000","last_fullsized":"2024-09-11T00:14:26.921573+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:22.485256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937865+0000","last_change":"2024-09-11T00:14:25.921319+0000","last_active":"2024-09-11T00:14:26.937865+0000","last_peered":"2024-09-11T00:14:26.937865+0000","last_clean":"2024-09-11T00:14:26.937865+0000","last_became_active":"2024-09-11T00:14:25.921036+0000","last_became_peered":"2024-09-11T00:14:25.921036+0000","last_unstale":"2024-09-11T00:14:26.937865+0000","last_undegraded":"2024-09-11T00:14:26.937865+0000","last_fullsized":"2024-09-11T00:14:26.937865+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:19.036633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.924551+0000","last_change":"2024-09-11T00:14:23.905241+0000","last_active":"2024-09-11T00:14:26.924551+0000","last_peered":"2024-09-11T00:14:26.924551+0000","last_clean":"2024-09-11T00:14:26.924551+0000","last_became_active":"2024-09-11T00:14:23.904833+0000","last_became_peered":"2024-09-11T00:14:23.904833+0000","last_unstale":"2024-09-11T00:14:26.924551+0000","last_undegraded":"2024-09-11T00:14:26.924551+0000","last_fullsized":"2024-09-11T00:14:26.924551+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:44:28.162800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937158+0000","last_change":"2024-09-11T00:14:25.918352+0000","last_active":"2024-09-11T00:14:26.937158+0000","last_peered":"2024-09-11T00:14:26.937158+0000","last_clean":"2024-09-11T00:14:26.937158+0000","last_became_active":"2024-09-11T00:14:25.917918+0000","last_became_peered":"2024-09-11T00:14:25.917918+0000","last_unstale":"2024-09-11T00:14:26.937158+0000","last_undegraded":"2024-09-11T00:14:26.937158+0000","last_fullsized":"2024-09-11T00:14:26.937158+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:11.740062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.935515+0000","last_change":"2024-09-11T00:14:24.083578+0000","last_active":"2024-09-11T00:14:26.935515+0000","last_peered":"2024-09-11T00:14:26.935515+0000","last_clean":"2024-09-11T00:14:26.935515+0000","last_became_active":"2024-09-11T00:14:24.083233+0000","last_became_peered":"2024-09-11T00:14:24.083233+0000","last_unstale":"2024-09-11T00:14:26.935515+0000","last_undegraded":"2024-09-11T00:14:26.935515+0000","last_fullsized":"2024-09-11T00:14:26.935515+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:47.655836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:29.794330+0000","last_change":"2024-09-11T00:14:25.919141+0000","last_active":"2024-09-11T00:14:29.794330+0000","last_peered":"2024-09-11T00:14:29.794330+0000","last_clean":"2024-09-11T00:14:29.794330+0000","last_became_active":"2024-09-11T00:14:25.918791+0000","last_became_peered":"2024-09-11T00:14:25.918791+0000","last_unstale":"2024-09-11T00:14:29.794330+0000","last_undegraded":"2024-09-11T00:14:29.794330+0000","last_fullsized":"2024-09-11T00:14:29.794330+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:32.933462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.939259+0000","last_change":"2024-09-11T00:14:24.082284+0000","last_active":"2024-09-11T00:14:26.939259+0000","last_peered":"2024-09-11T00:14:26.939259+0000","last_clean":"2024-09-11T00:14:26.939259+0000","last_became_active":"2024-09-11T00:14:24.081859+0000","last_became_peered":"2024-09-11T00:14:24.081859+0000","last_unstale":"2024-09-11T00:14:26.939259+0000","last_undegraded":"2024-09-11T00:14:26.939259+0000","last_fullsized":"2024-09-11T00:14:26.939259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:38.881342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.921462+0000","last_change":"2024-09-11T00:14:25.910408+0000","last_active":"2024-09-11T00:14:26.921462+0000","last_peered":"2024-09-11T00:14:26.921462+0000","last_clean":"2024-09-11T00:14:26.921462+0000","last_became_active":"2024-09-11T00:14:25.909447+0000","last_became_peered":"2024-09-11T00:14:25.909447+0000","last_unstale":"2024-09-11T00:14:26.921462+0000","last_undegraded":"2024-09-11T00:14:26.921462+0000","last_fullsized":"2024-09-11T00:14:26.921462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:20:11.249974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'6","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:42.936669+0000","last_change":"2024-09-11T00:14:23.912799+0000","last_active":"2024-09-11T00:14:42.936669+0000","last_peered":"2024-09-11T00:14:42.936669+0000","last_clean":"2024-09-11T00:14:42.936669+0000","last_became_active":"2024-09-11T00:14:23.912440+0000","last_became_peered":"2024-09-11T00:14:23.912440+0000","last_unstale":"2024-09-11T00:14:42.936669+0000","last_undegraded":"2024-09-11T00:14:42.936669+0000","last_fullsized":"2024-09-11T00:14:42.936669+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:31.139405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.938275+0000","last_change":"2024-09-11T00:14:25.920599+0000","last_active":"2024-09-11T00:14:26.938275+0000","last_peered":"2024-09-11T00:14:26.938275+0000","last_clean":"2024-09-11T00:14:26.938275+0000","last_became_active":"2024-09-11T00:14:25.920256+0000","last_became_peered":"2024-09-11T00:14:25.920256+0000","last_unstale":"2024-09-11T00:14:26.938275+0000","last_undegraded":"2024-09-11T00:14:26.938275+0000","last_fullsized":"2024-09-11T00:14:26.938275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:05.347880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.941252+0000","last_change":"2024-09-11T00:14:24.004190+0000","last_active":"2024-09-11T00:14:26.941252+0000","last_peered":"2024-09-11T00:14:26.941252+0000","last_clean":"2024-09-11T00:14:26.941252+0000","last_became_active":"2024-09-11T00:14:24.003842+0000","last_became_peered":"2024-09-11T00:14:24.003842+0000","last_unstale":"2024-09-11T00:14:26.941252+0000","last_undegraded":"2024-09-11T00:14:26.941252+0000","last_fullsized":"2024-09-11T00:14:26.941252+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:43.876046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940592+0000","last_change":"2024-09-11T00:14:25.914850+0000","last_active":"2024-09-11T00:14:26.940592+0000","last_peered":"2024-09-11T00:14:26.940592+0000","last_clean":"2024-09-11T00:14:26.940592+0000","last_became_active":"2024-09-11T00:14:25.914516+0000","last_became_peered":"2024-09-11T00:14:25.914516+0000","last_unstale":"2024-09-11T00:14:26.940592+0000","last_undegraded":"2024-09-11T00:14:26.940592+0000","last_fullsized":"2024-09-11T00:14:26.940592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:13.408335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.941236+0000","last_change":"2024-09-11T00:14:24.082118+0000","last_active":"2024-09-11T00:14:26.941236+0000","last_peered":"2024-09-11T00:14:26.941236+0000","last_clean":"2024-09-11T00:14:26.941236+0000","last_became_active":"2024-09-11T00:14:24.081844+0000","last_became_peered":"2024-09-11T00:14:24.081844+0000","last_unstale":"2024-09-11T00:14:26.941236+0000","last_undegraded":"2024-09-11T00:14:26.941236+0000","last_fullsized":"2024-09-11T00:14:26.941236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:20.827385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.936664+0000","last_change":"2024-09-11T00:14:25.917335+0000","last_active":"2024-09-11T00:14:26.936664+0000","last_peered":"2024-09-11T00:14:26.936664+0000","last_clean":"2024-09-11T00:14:26.936664+0000","last_became_active":"2024-09-11T00:14:25.916942+0000","last_became_peered":"2024-09-11T00:14:25.916942+0000","last_unstale":"2024-09-11T00:14:26.936664+0000","last_undegraded":"2024-09-11T00:14:26.936664+0000","last_fullsized":"2024-09-11T00:14:26.936664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:40.309186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937283+0000","last_change":"2024-09-11T00:14:23.906616+0000","last_active":"2024-09-11T00:14:26.937283+0000","last_peered":"2024-09-11T00:14:26.937283+0000","last_clean":"2024-09-11T00:14:26.937283+0000","last_became_active":"2024-09-11T00:14:23.906259+0000","last_became_peered":"2024-09-11T00:14:23.906259+0000","last_unstale":"2024-09-11T00:14:26.937283+0000","last_undegraded":"2024-09-11T00:14:26.937283+0000","last_fullsized":"2024-09-11T00:14:26.937283+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:01.514398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.922262+0000","last_change":"2024-09-11T00:14:25.925422+0000","last_active":"2024-09-11T00:14:26.922262+0000","last_peered":"2024-09-11T00:14:26.922262+0000","last_clean":"2024-09-11T00:14:26.922262+0000","last_became_active":"2024-09-11T00:14:25.923031+0000","last_became_peered":"2024-09-11T00:14:25.923031+0000","last_unstale":"2024-09-11T00:14:26.922262+0000","last_undegraded":"2024-09-11T00:14:26.922262+0000","last_fullsized":"2024-09-11T00:14:26.922262+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:59:52.217566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937007+0000","last_change":"2024-09-11T00:14:23.913308+0000","last_active":"2024-09-11T00:14:26.937007+0000","last_peered":"2024-09-11T00:14:26.937007+0000","last_clean":"2024-09-11T00:14:26.937007+0000","last_became_active":"2024-09-11T00:14:23.913002+0000","last_became_peered":"2024-09-11T00:14:23.913002+0000","last_unstale":"2024-09-11T00:14:26.937007+0000","last_undegraded":"2024-09-11T00:14:26.937007+0000","last_fullsized":"2024-09-11T00:14:26.937007+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:26:43.571378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937818+0000","last_change":"2024-09-11T00:14:25.917478+0000","last_active":"2024-09-11T00:14:26.937818+0000","last_peered":"2024-09-11T00:14:26.937818+0000","last_clean":"2024-09-11T00:14:26.937818+0000","last_became_active":"2024-09-11T00:14:25.917192+0000","last_became_peered":"2024-09-11T00:14:25.917192+0000","last_unstale":"2024-09-11T00:14:26.937818+0000","last_undegraded":"2024-09-11T00:14:26.937818+0000","last_fullsized":"2024-09-11T00:14:26.937818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:46.695827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.945520+0000","last_change":"2024-09-11T00:14:23.914141+0000","last_active":"2024-09-11T00:14:26.945520+0000","last_peered":"2024-09-11T00:14:26.945520+0000","last_clean":"2024-09-11T00:14:26.945520+0000","last_became_active":"2024-09-11T00:14:23.913757+0000","last_became_peered":"2024-09-11T00:14:23.913757+0000","last_unstale":"2024-09-11T00:14:26.945520+0000","last_undegraded":"2024-09-11T00:14:26.945520+0000","last_fullsized":"2024-09-11T00:14:26.945520+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:54:00.609715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.924710+0000","last_change":"2024-09-11T00:14:25.924950+0000","last_active":"2024-09-11T00:14:26.924710+0000","last_peered":"2024-09-11T00:14:26.924710+0000","last_clean":"2024-09-11T00:14:26.924710+0000","last_became_active":"2024-09-11T00:14:25.924554+0000","last_became_peered":"2024-09-11T00:14:25.924554+0000","last_unstale":"2024-09-11T00:14:26.924710+0000","last_undegraded":"2024-09-11T00:14:26.924710+0000","last_fullsized":"2024-09-11T00:14:26.924710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:29.303384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.938877+0000","last_change":"2024-09-11T00:14:25.930162+0000","last_active":"2024-09-11T00:14:26.938877+0000","last_peered":"2024-09-11T00:14:26.938877+0000","last_clean":"2024-09-11T00:14:26.938877+0000","last_became_active":"2024-09-11T00:14:25.929820+0000","last_became_peered":"2024-09-11T00:14:25.929820+0000","last_unstale":"2024-09-11T00:14:26.938877+0000","last_undegraded":"2024-09-11T00:14:26.938877+0000","last_fullsized":"2024-09-11T00:14:26.938877+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:20:21.384841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.945111+0000","last_change":"2024-09-11T00:14:23.917486+0000","last_active":"2024-09-11T00:14:26.945111+0000","last_peered":"2024-09-11T00:14:26.945111+0000","last_clean":"2024-09-11T00:14:26.945111+0000","last_became_active":"2024-09-11T00:14:23.917150+0000","last_became_peered":"2024-09-11T00:14:23.917150+0000","last_unstale":"2024-09-11T00:14:26.945111+0000","last_undegraded":"2024-09-11T00:14:26.945111+0000","last_fullsized":"2024-09-11T00:14:26.945111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:13:55.687712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940429+0000","last_change":"2024-09-11T00:14:25.932674+0000","last_active":"2024-09-11T00:14:26.940429+0000","last_peered":"2024-09-11T00:14:26.940429+0000","last_clean":"2024-09-11T00:14:26.940429+0000","last_became_active":"2024-09-11T00:14:25.932353+0000","last_became_peered":"2024-09-11T00:14:25.932353+0000","last_unstale":"2024-09-11T00:14:26.940429+0000","last_undegraded":"2024-09-11T00:14:26.940429+0000","last_fullsized":"2024-09-11T00:14:26.940429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:48.721854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.945068+0000","last_change":"2024-09-11T00:14:23.913063+0000","last_active":"2024-09-11T00:14:26.945068+0000","last_peered":"2024-09-11T00:14:26.945068+0000","last_clean":"2024-09-11T00:14:26.945068+0000","last_became_active":"2024-09-11T00:14:23.912688+0000","last_became_peered":"2024-09-11T00:14:23.912688+0000","last_unstale":"2024-09-11T00:14:26.945068+0000","last_undegraded":"2024-09-11T00:14:26.945068+0000","last_fullsized":"2024-09-11T00:14:26.945068+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:35.228733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940787+0000","last_change":"2024-09-11T00:14:25.928099+0000","last_active":"2024-09-11T00:14:26.940787+0000","last_peered":"2024-09-11T00:14:26.940787+0000","last_clean":"2024-09-11T00:14:26.940787+0000","last_became_active":"2024-09-11T00:14:25.927741+0000","last_became_peered":"2024-09-11T00:14:25.927741+0000","last_unstale":"2024-09-11T00:14:26.940787+0000","last_undegraded":"2024-09-11T00:14:26.940787+0000","last_fullsized":"2024-09-11T00:14:26.940787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:12.263180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.941751+0000","last_change":"2024-09-11T00:14:24.082533+0000","last_active":"2024-09-11T00:14:26.941751+0000","last_peered":"2024-09-11T00:14:26.941751+0000","last_clean":"2024-09-11T00:14:26.941751+0000","last_became_active":"2024-09-11T00:14:24.081666+0000","last_became_peered":"2024-09-11T00:14:24.081666+0000","last_unstale":"2024-09-11T00:14:26.941751+0000","last_undegraded":"2024-09-11T00:14:26.941751+0000","last_fullsized":"2024-09-11T00:14:26.941751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:56.485366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.938058+0000","last_change":"2024-09-11T00:14:25.912666+0000","last_active":"2024-09-11T00:14:26.938058+0000","last_peered":"2024-09-11T00:14:26.938058+0000","last_clean":"2024-09-11T00:14:26.938058+0000","last_became_active":"2024-09-11T00:14:25.912370+0000","last_became_peered":"2024-09-11T00:14:25.912370+0000","last_unstale":"2024-09-11T00:14:26.938058+0000","last_undegraded":"2024-09-11T00:14:26.938058+0000","last_fullsized":"2024-09-11T00:14:26.938058+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:44.400265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.945904+0000","last_change":"2024-09-11T00:14:23.914407+0000","last_active":"2024-09-11T00:14:26.945904+0000","last_peered":"2024-09-11T00:14:26.945904+0000","last_clean":"2024-09-11T00:14:26.945904+0000","last_became_active":"2024-09-11T00:14:23.914115+0000","last_became_peered":"2024-09-11T00:14:23.914115+0000","last_unstale":"2024-09-11T00:14:26.945904+0000","last_undegraded":"2024-09-11T00:14:26.945904+0000","last_fullsized":"2024-09-11T00:14:26.945904+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:58.883324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":41861,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":34,"num_read_kb":59,"num_write":68,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":125583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57,"ondisk_log_size":57,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282342,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743441,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":811008,"data_stored":402315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939669,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":1034057,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103195,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":402897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299424,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":402919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495652,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":993382,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659178,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31980,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713172,"statfs":{"total":95995035648,"available":95962288128,"internally_reserved":0,"allocated":815104,"data_stored":402432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855407,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":992982,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018932,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":815104,"data_stored":402337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215160,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":402536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":429294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542210,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":860160,"data_stored":443378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705735,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31984,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713168,"statfs":{"total":95995035648,"available":95962284032,"internally_reserved":0,"allocated":815104,"data_stored":402405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34264,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34264,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34264,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":41063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":41097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":41257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:14:50.208 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T00:14:50.452 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:50.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:50 smithi078 ceph-mon[30865]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:14:50.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:50 smithi078 ceph-mon[30865]: pgmap v270: 97 pgs: 97 active+clean; 618 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-11T00:14:50.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.964+0000 7fb6ca5f6640 1 -- 172.21.15.78:0/4164271875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c41012e0 msgr2=0x7fb6c41016c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:50.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.964+0000 7fb6ca5f6640 1 --2- 172.21.15.78:0/4164271875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c41012e0 0x7fb6c41016c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4009900 tx=0x7fb6b402a410 comp rx=0 tx=0).stop 2024-09-11T00:14:50.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.964+0000 7fb6ca5f6640 1 -- 172.21.15.78:0/4164271875 shutdown_connections 2024-09-11T00:14:50.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.964+0000 7fb6ca5f6640 1 --2- 172.21.15.78:0/4164271875 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6c4105f40 0x7fb6c410f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:50.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.964+0000 7fb6ca5f6640 1 --2- 172.21.15.78:0/4164271875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6c41055a0 0x7fb6c4105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:50.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.964+0000 7fb6ca5f6640 1 --2- 172.21.15.78:0/4164271875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c41012e0 0x7fb6c41016c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:50.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.964+0000 7fb6ca5f6640 1 -- 172.21.15.78:0/4164271875 >> 172.21.15.78:0/4164271875 conn(0x7fb6c4078060 msgr2=0x7fb6c40ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:50.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.964+0000 7fb6ca5f6640 1 -- 172.21.15.78:0/4164271875 shutdown_connections 2024-09-11T00:14:50.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.964+0000 7fb6ca5f6640 1 -- 172.21.15.78:0/4164271875 wait complete. 2024-09-11T00:14:50.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.965+0000 7fb6ca5f6640 1 Processor -- start 2024-09-11T00:14:50.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.965+0000 7fb6ca5f6640 1 -- start start 2024-09-11T00:14:50.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.965+0000 7fb6ca5f6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c41012e0 0x7fb6c4199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:50.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.965+0000 7fb6ca5f6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6c41055a0 0x7fb6c4199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:50.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.965+0000 7fb6ca5f6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6c4105f40 0x7fb6c419ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:50.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.965+0000 7fb6ca5f6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c4112df0 con 0x7fb6c41012e0 2024-09-11T00:14:50.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.965+0000 7fb6ca5f6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c4112c70 con 0x7fb6c4105f40 2024-09-11T00:14:50.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.965+0000 7fb6ca5f6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c4112f70 con 0x7fb6c41055a0 2024-09-11T00:14:50.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.965+0000 7fb6c3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c41012e0 0x7fb6c4199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:50.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.965+0000 7fb6c3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c41012e0 0x7fb6c4199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55376/0 (socket says 172.21.15.78:55376) 2024-09-11T00:14:50.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.965+0000 7fb6c3fff640 1 -- 172.21.15.78:0/3854022005 learned_addr learned my addr 172.21.15.78:0/3854022005 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:50.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.965+0000 7fb6c8b93640 1 --2- 172.21.15.78:0/3854022005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6c4105f40 0x7fb6c419ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:50.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.966+0000 7fb6bbfff640 1 --2- 172.21.15.78:0/3854022005 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6c41055a0 0x7fb6c4199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:50.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.966+0000 7fb6c3fff640 1 -- 172.21.15.78:0/3854022005 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6c41055a0 msgr2=0x7fb6c4199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:50.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.966+0000 7fb6c3fff640 1 --2- 172.21.15.78:0/3854022005 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6c41055a0 0x7fb6c4199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:50.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.966+0000 7fb6c3fff640 1 -- 172.21.15.78:0/3854022005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6c4105f40 msgr2=0x7fb6c419ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:50.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.966+0000 7fb6c3fff640 1 --2- 172.21.15.78:0/3854022005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6c4105f40 0x7fb6c419ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:50.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.966+0000 7fb6c3fff640 1 -- 172.21.15.78:0/3854022005 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c419f3f0 con 0x7fb6c41012e0 2024-09-11T00:14:50.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.966+0000 7fb6c8b93640 1 --2- 172.21.15.78:0/3854022005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6c4105f40 0x7fb6c419ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:50.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.966+0000 7fb6bbfff640 1 --2- 172.21.15.78:0/3854022005 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6c41055a0 0x7fb6c4199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:50.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.966+0000 7fb6c3fff640 1 --2- 172.21.15.78:0/3854022005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c41012e0 0x7fb6c4199340 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4005940 tx=0x7fb6b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:50.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.966+0000 7fb6c1ffb640 1 -- 172.21.15.78:0/3854022005 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b403f030 con 0x7fb6c41012e0 2024-09-11T00:14:50.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.966+0000 7fb6c1ffb640 1 -- 172.21.15.78:0/3854022005 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6b4003cb0 con 0x7fb6c41012e0 2024-09-11T00:14:50.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.966+0000 7fb6ca5f6640 1 -- 172.21.15.78:0/3854022005 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c419f680 con 0x7fb6c41012e0 2024-09-11T00:14:50.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.966+0000 7fb6c1ffb640 1 -- 172.21.15.78:0/3854022005 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4035070 con 0x7fb6c41012e0 2024-09-11T00:14:50.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.966+0000 7fb6ca5f6640 1 -- 172.21.15.78:0/3854022005 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c41a5da0 con 0x7fb6c41012e0 2024-09-11T00:14:50.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.967+0000 7fb6ca5f6640 1 -- 172.21.15.78:0/3854022005 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c41016c0 con 0x7fb6c41012e0 2024-09-11T00:14:50.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.968+0000 7fb6c1ffb640 1 -- 172.21.15.78:0/3854022005 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fb6b403bb50 con 0x7fb6c41012e0 2024-09-11T00:14:50.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.969+0000 7fb6c1ffb640 1 --2- 172.21.15.78:0/3854022005 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb6b00b53c0 0x7fb6b00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:50.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.970+0000 7fb6bbfff640 1 --2- 172.21.15.78:0/3854022005 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb6b00b53c0 0x7fb6b00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:50.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.970+0000 7fb6c1ffb640 1 -- 172.21.15.78:0/3854022005 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fb6b4106cb0 con 0x7fb6c41012e0 2024-09-11T00:14:50.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.970+0000 7fb6bbfff640 1 --2- 172.21.15.78:0/3854022005 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb6b00b53c0 0x7fb6b00b7880 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac006fd0 tx=0x7fb6ac008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:50.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:50.973+0000 7fb6c1ffb640 1 -- 172.21.15.78:0/3854022005 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb6b40cd9d0 con 0x7fb6c41012e0 2024-09-11T00:14:51.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:50 smithi138 ceph-mon[35019]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:14:51.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:50 smithi138 ceph-mon[35019]: pgmap v270: 97 pgs: 97 active+clean; 618 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-11T00:14:51.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:51.145+0000 7fb6ca5f6640 1 -- 172.21.15.78:0/3854022005 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb6c4063590 con 0x7fb6b00b53c0 2024-09-11T00:14:51.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:51.151+0000 7fb6c1ffb640 1 -- 172.21.15.78:0/3854022005 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258781 (secure 0 0 0) 0x7fb6c4063590 con 0x7fb6b00b53c0 2024-09-11T00:14:51.155 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:14:51.156 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-11T00:14:51.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:51.154+0000 7fb6ca5f6640 1 -- 172.21.15.78:0/3854022005 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb6b00b53c0 msgr2=0x7fb6b00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:51.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:51.154+0000 7fb6ca5f6640 1 --2- 172.21.15.78:0/3854022005 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb6b00b53c0 0x7fb6b00b7880 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac006fd0 tx=0x7fb6ac008040 comp rx=0 tx=0).stop 2024-09-11T00:14:51.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:51.154+0000 7fb6ca5f6640 1 -- 172.21.15.78:0/3854022005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c41012e0 msgr2=0x7fb6c4199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:51.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:51.154+0000 7fb6ca5f6640 1 --2- 172.21.15.78:0/3854022005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c41012e0 0x7fb6c4199340 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4005940 tx=0x7fb6b40042f0 comp rx=0 tx=0).stop 2024-09-11T00:14:51.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:51.154+0000 7fb6ca5f6640 1 -- 172.21.15.78:0/3854022005 shutdown_connections 2024-09-11T00:14:51.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:51.154+0000 7fb6ca5f6640 1 --2- 172.21.15.78:0/3854022005 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb6b00b53c0 0x7fb6b00b7880 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:51.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:51.154+0000 7fb6ca5f6640 1 --2- 172.21.15.78:0/3854022005 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6c4105f40 0x7fb6c419ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:51.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:51.154+0000 7fb6ca5f6640 1 --2- 172.21.15.78:0/3854022005 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6c41055a0 0x7fb6c4199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:51.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:51.154+0000 7fb6ca5f6640 1 --2- 172.21.15.78:0/3854022005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c41012e0 0x7fb6c4199340 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:51.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:51.154+0000 7fb6ca5f6640 1 -- 172.21.15.78:0/3854022005 >> 172.21.15.78:0/3854022005 conn(0x7fb6c4078060 msgr2=0x7fb6c4106e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:51.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:51.154+0000 7fb6ca5f6640 1 -- 172.21.15.78:0/3854022005 shutdown_connections 2024-09-11T00:14:51.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:51.154+0000 7fb6ca5f6640 1 -- 172.21.15.78:0/3854022005 wait complete. 2024-09-11T00:14:51.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:50 smithi112 ceph-mon[35627]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:14:51.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:50 smithi112 ceph-mon[35627]: pgmap v270: 97 pgs: 97 active+clean; 618 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-11T00:14:51.780 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":270,"stamp":"2024-09-11T00:14:49.671392+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":632463,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":115,"num_read_kb":128,"num_write":193,"num_write_kb":2212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359168,"kb_used_data":9900,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124582656,"statfs":{"total":1151940427776,"available":1151572639744,"internally_reserved":0,"allocated":10137600,"data_stored":6749373,"data_compressed":107730,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39685,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":52,"num_write":25,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003246"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.922502+0000","last_change":"2024-09-11T00:14:25.922805+0000","last_active":"2024-09-11T00:14:26.922502+0000","last_peered":"2024-09-11T00:14:26.922502+0000","last_clean":"2024-09-11T00:14:26.922502+0000","last_became_active":"2024-09-11T00:14:25.922482+0000","last_became_peered":"2024-09-11T00:14:25.922482+0000","last_unstale":"2024-09-11T00:14:26.922502+0000","last_undegraded":"2024-09-11T00:14:26.922502+0000","last_fullsized":"2024-09-11T00:14:26.922502+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:53.209011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940392+0000","last_change":"2024-09-11T00:14:25.920760+0000","last_active":"2024-09-11T00:14:26.940392+0000","last_peered":"2024-09-11T00:14:26.940392+0000","last_clean":"2024-09-11T00:14:26.940392+0000","last_became_active":"2024-09-11T00:14:25.919720+0000","last_became_peered":"2024-09-11T00:14:25.919720+0000","last_unstale":"2024-09-11T00:14:26.940392+0000","last_undegraded":"2024-09-11T00:14:26.940392+0000","last_fullsized":"2024-09-11T00:14:26.940392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:32.491200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940386+0000","last_change":"2024-09-11T00:14:25.928090+0000","last_active":"2024-09-11T00:14:26.940386+0000","last_peered":"2024-09-11T00:14:26.940386+0000","last_clean":"2024-09-11T00:14:26.940386+0000","last_became_active":"2024-09-11T00:14:25.927768+0000","last_became_peered":"2024-09-11T00:14:25.927768+0000","last_unstale":"2024-09-11T00:14:26.940386+0000","last_undegraded":"2024-09-11T00:14:26.940386+0000","last_fullsized":"2024-09-11T00:14:26.940386+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:00.025061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.938281+0000","last_change":"2024-09-11T00:14:25.920077+0000","last_active":"2024-09-11T00:14:26.938281+0000","last_peered":"2024-09-11T00:14:26.938281+0000","last_clean":"2024-09-11T00:14:26.938281+0000","last_became_active":"2024-09-11T00:14:25.919395+0000","last_became_peered":"2024-09-11T00:14:25.919395+0000","last_unstale":"2024-09-11T00:14:26.938281+0000","last_undegraded":"2024-09-11T00:14:26.938281+0000","last_fullsized":"2024-09-11T00:14:26.938281+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:41.441279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940034+0000","last_change":"2024-09-11T00:14:25.917872+0000","last_active":"2024-09-11T00:14:26.940034+0000","last_peered":"2024-09-11T00:14:26.940034+0000","last_clean":"2024-09-11T00:14:26.940034+0000","last_became_active":"2024-09-11T00:14:25.917533+0000","last_became_peered":"2024-09-11T00:14:25.917533+0000","last_unstale":"2024-09-11T00:14:26.940034+0000","last_undegraded":"2024-09-11T00:14:26.940034+0000","last_fullsized":"2024-09-11T00:14:26.940034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:57.051435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.936872+0000","last_change":"2024-09-11T00:14:25.914977+0000","last_active":"2024-09-11T00:14:26.936872+0000","last_peered":"2024-09-11T00:14:26.936872+0000","last_clean":"2024-09-11T00:14:26.936872+0000","last_became_active":"2024-09-11T00:14:25.914543+0000","last_became_peered":"2024-09-11T00:14:25.914543+0000","last_unstale":"2024-09-11T00:14:26.936872+0000","last_undegraded":"2024-09-11T00:14:26.936872+0000","last_fullsized":"2024-09-11T00:14:26.936872+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:45.085347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.924352+0000","last_change":"2024-09-11T00:14:25.928021+0000","last_active":"2024-09-11T00:14:26.924352+0000","last_peered":"2024-09-11T00:14:26.924352+0000","last_clean":"2024-09-11T00:14:26.924352+0000","last_became_active":"2024-09-11T00:14:25.927047+0000","last_became_peered":"2024-09-11T00:14:25.927047+0000","last_unstale":"2024-09-11T00:14:26.924352+0000","last_undegraded":"2024-09-11T00:14:26.924352+0000","last_fullsized":"2024-09-11T00:14:26.924352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:41.442622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.936819+0000","last_change":"2024-09-11T00:14:25.925399+0000","last_active":"2024-09-11T00:14:26.936819+0000","last_peered":"2024-09-11T00:14:26.936819+0000","last_clean":"2024-09-11T00:14:26.936819+0000","last_became_active":"2024-09-11T00:14:25.925097+0000","last_became_peered":"2024-09-11T00:14:25.925097+0000","last_unstale":"2024-09-11T00:14:26.936819+0000","last_undegraded":"2024-09-11T00:14:26.936819+0000","last_fullsized":"2024-09-11T00:14:26.936819+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:36:44.962936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940986+0000","last_change":"2024-09-11T00:14:25.928123+0000","last_active":"2024-09-11T00:14:26.940986+0000","last_peered":"2024-09-11T00:14:26.940986+0000","last_clean":"2024-09-11T00:14:26.940986+0000","last_became_active":"2024-09-11T00:14:25.927826+0000","last_became_peered":"2024-09-11T00:14:25.927826+0000","last_unstale":"2024-09-11T00:14:26.940986+0000","last_undegraded":"2024-09-11T00:14:26.940986+0000","last_fullsized":"2024-09-11T00:14:26.940986+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:44.131708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.938119+0000","last_change":"2024-09-11T00:14:25.920546+0000","last_active":"2024-09-11T00:14:26.938119+0000","last_peered":"2024-09-11T00:14:26.938119+0000","last_clean":"2024-09-11T00:14:26.938119+0000","last_became_active":"2024-09-11T00:14:25.920193+0000","last_became_peered":"2024-09-11T00:14:25.920193+0000","last_unstale":"2024-09-11T00:14:26.938119+0000","last_undegraded":"2024-09-11T00:14:26.938119+0000","last_fullsized":"2024-09-11T00:14:26.938119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:55.027260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.924704+0000","last_change":"2024-09-11T00:14:25.931278+0000","last_active":"2024-09-11T00:14:26.924704+0000","last_peered":"2024-09-11T00:14:26.924704+0000","last_clean":"2024-09-11T00:14:26.924704+0000","last_became_active":"2024-09-11T00:14:25.930964+0000","last_became_peered":"2024-09-11T00:14:25.930964+0000","last_unstale":"2024-09-11T00:14:26.924704+0000","last_undegraded":"2024-09-11T00:14:26.924704+0000","last_fullsized":"2024-09-11T00:14:26.924704+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:06.537737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.938261+0000","last_change":"2024-09-11T00:14:25.919725+0000","last_active":"2024-09-11T00:14:26.938261+0000","last_peered":"2024-09-11T00:14:26.938261+0000","last_clean":"2024-09-11T00:14:26.938261+0000","last_became_active":"2024-09-11T00:14:25.918973+0000","last_became_peered":"2024-09-11T00:14:25.918973+0000","last_unstale":"2024-09-11T00:14:26.938261+0000","last_undegraded":"2024-09-11T00:14:26.938261+0000","last_fullsized":"2024-09-11T00:14:26.938261+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:01:03.076980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.921316+0000","last_change":"2024-09-11T00:14:25.922516+0000","last_active":"2024-09-11T00:14:26.921316+0000","last_peered":"2024-09-11T00:14:26.921316+0000","last_clean":"2024-09-11T00:14:26.921316+0000","last_became_active":"2024-09-11T00:14:25.922198+0000","last_became_peered":"2024-09-11T00:14:25.922198+0000","last_unstale":"2024-09-11T00:14:26.921316+0000","last_undegraded":"2024-09-11T00:14:26.921316+0000","last_fullsized":"2024-09-11T00:14:26.921316+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:26.065492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940151+0000","last_change":"2024-09-11T00:14:25.921663+0000","last_active":"2024-09-11T00:14:26.940151+0000","last_peered":"2024-09-11T00:14:26.940151+0000","last_clean":"2024-09-11T00:14:26.940151+0000","last_became_active":"2024-09-11T00:14:25.921328+0000","last_became_peered":"2024-09-11T00:14:25.921328+0000","last_unstale":"2024-09-11T00:14:26.940151+0000","last_undegraded":"2024-09-11T00:14:26.940151+0000","last_fullsized":"2024-09-11T00:14:26.940151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:04.674811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940057+0000","last_change":"2024-09-11T00:14:25.914856+0000","last_active":"2024-09-11T00:14:26.940057+0000","last_peered":"2024-09-11T00:14:26.940057+0000","last_clean":"2024-09-11T00:14:26.940057+0000","last_became_active":"2024-09-11T00:14:25.914564+0000","last_became_peered":"2024-09-11T00:14:25.914564+0000","last_unstale":"2024-09-11T00:14:26.940057+0000","last_undegraded":"2024-09-11T00:14:26.940057+0000","last_fullsized":"2024-09-11T00:14:26.940057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:59:45.395010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.941086+0000","last_change":"2024-09-11T00:14:25.927202+0000","last_active":"2024-09-11T00:14:26.941086+0000","last_peered":"2024-09-11T00:14:26.941086+0000","last_clean":"2024-09-11T00:14:26.941086+0000","last_became_active":"2024-09-11T00:14:25.926872+0000","last_became_peered":"2024-09-11T00:14:25.926872+0000","last_unstale":"2024-09-11T00:14:26.941086+0000","last_undegraded":"2024-09-11T00:14:26.941086+0000","last_fullsized":"2024-09-11T00:14:26.941086+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:44.409956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.922526+0000","last_change":"2024-09-11T00:14:25.923975+0000","last_active":"2024-09-11T00:14:26.922526+0000","last_peered":"2024-09-11T00:14:26.922526+0000","last_clean":"2024-09-11T00:14:26.922526+0000","last_became_active":"2024-09-11T00:14:25.923666+0000","last_became_peered":"2024-09-11T00:14:25.923666+0000","last_unstale":"2024-09-11T00:14:26.922526+0000","last_undegraded":"2024-09-11T00:14:26.922526+0000","last_fullsized":"2024-09-11T00:14:26.922526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:54.803657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.935629+0000","last_change":"2024-09-11T00:14:25.928083+0000","last_active":"2024-09-11T00:14:26.935629+0000","last_peered":"2024-09-11T00:14:26.935629+0000","last_clean":"2024-09-11T00:14:26.935629+0000","last_became_active":"2024-09-11T00:14:25.927727+0000","last_became_peered":"2024-09-11T00:14:25.927727+0000","last_unstale":"2024-09-11T00:14:26.935629+0000","last_undegraded":"2024-09-11T00:14:26.935629+0000","last_fullsized":"2024-09-11T00:14:26.935629+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:56.721661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937220+0000","last_change":"2024-09-11T00:14:25.910506+0000","last_active":"2024-09-11T00:14:26.937220+0000","last_peered":"2024-09-11T00:14:26.937220+0000","last_clean":"2024-09-11T00:14:26.937220+0000","last_became_active":"2024-09-11T00:14:25.910112+0000","last_became_peered":"2024-09-11T00:14:25.910112+0000","last_unstale":"2024-09-11T00:14:26.937220+0000","last_undegraded":"2024-09-11T00:14:26.937220+0000","last_fullsized":"2024-09-11T00:14:26.937220+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:33:32.698411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.922084+0000","last_change":"2024-09-11T00:14:25.918512+0000","last_active":"2024-09-11T00:14:26.922084+0000","last_peered":"2024-09-11T00:14:26.922084+0000","last_clean":"2024-09-11T00:14:26.922084+0000","last_became_active":"2024-09-11T00:14:25.918191+0000","last_became_peered":"2024-09-11T00:14:25.918191+0000","last_unstale":"2024-09-11T00:14:26.922084+0000","last_undegraded":"2024-09-11T00:14:26.922084+0000","last_fullsized":"2024-09-11T00:14:26.922084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:07:49.588919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.921434+0000","last_change":"2024-09-11T00:14:25.918163+0000","last_active":"2024-09-11T00:14:26.921434+0000","last_peered":"2024-09-11T00:14:26.921434+0000","last_clean":"2024-09-11T00:14:26.921434+0000","last_became_active":"2024-09-11T00:14:25.917851+0000","last_became_peered":"2024-09-11T00:14:25.917851+0000","last_unstale":"2024-09-11T00:14:26.921434+0000","last_undegraded":"2024-09-11T00:14:26.921434+0000","last_fullsized":"2024-09-11T00:14:26.921434+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:11.757881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940669+0000","last_change":"2024-09-11T00:14:25.930503+0000","last_active":"2024-09-11T00:14:26.940669+0000","last_peered":"2024-09-11T00:14:26.940669+0000","last_clean":"2024-09-11T00:14:26.940669+0000","last_became_active":"2024-09-11T00:14:25.930140+0000","last_became_peered":"2024-09-11T00:14:25.930140+0000","last_unstale":"2024-09-11T00:14:26.940669+0000","last_undegraded":"2024-09-11T00:14:26.940669+0000","last_fullsized":"2024-09-11T00:14:26.940669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:43.227373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.936892+0000","last_change":"2024-09-11T00:14:25.916866+0000","last_active":"2024-09-11T00:14:26.936892+0000","last_peered":"2024-09-11T00:14:26.936892+0000","last_clean":"2024-09-11T00:14:26.936892+0000","last_became_active":"2024-09-11T00:14:25.916393+0000","last_became_peered":"2024-09-11T00:14:25.916393+0000","last_unstale":"2024-09-11T00:14:26.936892+0000","last_undegraded":"2024-09-11T00:14:26.936892+0000","last_fullsized":"2024-09-11T00:14:26.936892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:52.697895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937633+0000","last_change":"2024-09-11T00:14:25.918541+0000","last_active":"2024-09-11T00:14:26.937633+0000","last_peered":"2024-09-11T00:14:26.937633+0000","last_clean":"2024-09-11T00:14:26.937633+0000","last_became_active":"2024-09-11T00:14:25.918254+0000","last_became_peered":"2024-09-11T00:14:25.918254+0000","last_unstale":"2024-09-11T00:14:26.937633+0000","last_undegraded":"2024-09-11T00:14:26.937633+0000","last_fullsized":"2024-09-11T00:14:26.937633+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:31:25.577918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937582+0000","last_change":"2024-09-11T00:14:25.913694+0000","last_active":"2024-09-11T00:14:26.937582+0000","last_peered":"2024-09-11T00:14:26.937582+0000","last_clean":"2024-09-11T00:14:26.937582+0000","last_became_active":"2024-09-11T00:14:25.913405+0000","last_became_peered":"2024-09-11T00:14:25.913405+0000","last_unstale":"2024-09-11T00:14:26.937582+0000","last_undegraded":"2024-09-11T00:14:26.937582+0000","last_fullsized":"2024-09-11T00:14:26.937582+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:24.636698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937370+0000","last_change":"2024-09-11T00:14:25.928598+0000","last_active":"2024-09-11T00:14:26.937370+0000","last_peered":"2024-09-11T00:14:26.937370+0000","last_clean":"2024-09-11T00:14:26.937370+0000","last_became_active":"2024-09-11T00:14:25.928230+0000","last_became_peered":"2024-09-11T00:14:25.928230+0000","last_unstale":"2024-09-11T00:14:26.937370+0000","last_undegraded":"2024-09-11T00:14:26.937370+0000","last_fullsized":"2024-09-11T00:14:26.937370+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:00.820900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.922266+0000","last_change":"2024-09-11T00:14:25.922296+0000","last_active":"2024-09-11T00:14:26.922266+0000","last_peered":"2024-09-11T00:14:26.922266+0000","last_clean":"2024-09-11T00:14:26.922266+0000","last_became_active":"2024-09-11T00:14:25.921188+0000","last_became_peered":"2024-09-11T00:14:25.921188+0000","last_unstale":"2024-09-11T00:14:26.922266+0000","last_undegraded":"2024-09-11T00:14:26.922266+0000","last_fullsized":"2024-09-11T00:14:26.922266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:31.478302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.921356+0000","last_change":"2024-09-11T00:14:25.910201+0000","last_active":"2024-09-11T00:14:26.921356+0000","last_peered":"2024-09-11T00:14:26.921356+0000","last_clean":"2024-09-11T00:14:26.921356+0000","last_became_active":"2024-09-11T00:14:25.909867+0000","last_became_peered":"2024-09-11T00:14:25.909867+0000","last_unstale":"2024-09-11T00:14:26.921356+0000","last_undegraded":"2024-09-11T00:14:26.921356+0000","last_fullsized":"2024-09-11T00:14:26.921356+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:17.445805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940558+0000","last_change":"2024-09-11T00:14:25.914971+0000","last_active":"2024-09-11T00:14:26.940558+0000","last_peered":"2024-09-11T00:14:26.940558+0000","last_clean":"2024-09-11T00:14:26.940558+0000","last_became_active":"2024-09-11T00:14:25.914614+0000","last_became_peered":"2024-09-11T00:14:25.914614+0000","last_unstale":"2024-09-11T00:14:26.940558+0000","last_undegraded":"2024-09-11T00:14:26.940558+0000","last_fullsized":"2024-09-11T00:14:26.940558+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.936776+0000","last_change":"2024-09-11T00:14:25.916006+0000","last_active":"2024-09-11T00:14:26.936776+0000","last_peered":"2024-09-11T00:14:26.936776+0000","last_clean":"2024-09-11T00:14:26.936776+0000","last_became_active":"2024-09-11T00:14:25.915479+0000","last_became_peered":"2024-09-11T00:14:25.915479+0000","last_unstale":"2024-09-11T00:14:26.936776+0000","last_undegraded":"2024-09-11T00:14:26.936776+0000","last_fullsized":"2024-09-11T00:14:26.936776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:42.513673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.939260+0000","last_change":"2024-09-11T00:14:25.925601+0000","last_active":"2024-09-11T00:14:26.939260+0000","last_peered":"2024-09-11T00:14:26.939260+0000","last_clean":"2024-09-11T00:14:26.939260+0000","last_became_active":"2024-09-11T00:14:25.925289+0000","last_became_peered":"2024-09-11T00:14:25.925289+0000","last_unstale":"2024-09-11T00:14:26.939260+0000","last_undegraded":"2024-09-11T00:14:26.939260+0000","last_fullsized":"2024-09-11T00:14:26.939260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:17.324565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.921980+0000","last_change":"2024-09-11T00:14:25.922316+0000","last_active":"2024-09-11T00:14:26.921980+0000","last_peered":"2024-09-11T00:14:26.921980+0000","last_clean":"2024-09-11T00:14:26.921980+0000","last_became_active":"2024-09-11T00:14:25.920991+0000","last_became_peered":"2024-09-11T00:14:25.920991+0000","last_unstale":"2024-09-11T00:14:26.921980+0000","last_undegraded":"2024-09-11T00:14:26.921980+0000","last_fullsized":"2024-09-11T00:14:26.921980+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:36.362500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.936685+0000","last_change":"2024-09-11T00:14:25.919579+0000","last_active":"2024-09-11T00:14:26.936685+0000","last_peered":"2024-09-11T00:14:26.936685+0000","last_clean":"2024-09-11T00:14:26.936685+0000","last_became_active":"2024-09-11T00:14:25.919245+0000","last_became_peered":"2024-09-11T00:14:25.919245+0000","last_unstale":"2024-09-11T00:14:26.936685+0000","last_undegraded":"2024-09-11T00:14:26.936685+0000","last_fullsized":"2024-09-11T00:14:26.936685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:47.885242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937292+0000","last_change":"2024-09-11T00:14:23.917666+0000","last_active":"2024-09-11T00:14:26.937292+0000","last_peered":"2024-09-11T00:14:26.937292+0000","last_clean":"2024-09-11T00:14:26.937292+0000","last_became_active":"2024-09-11T00:14:23.917336+0000","last_became_peered":"2024-09-11T00:14:23.917336+0000","last_unstale":"2024-09-11T00:14:26.937292+0000","last_undegraded":"2024-09-11T00:14:26.937292+0000","last_fullsized":"2024-09-11T00:14:26.937292+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:01:00.649017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937080+0000","last_change":"2024-09-11T00:14:25.921414+0000","last_active":"2024-09-11T00:14:26.937080+0000","last_peered":"2024-09-11T00:14:26.937080+0000","last_clean":"2024-09-11T00:14:26.937080+0000","last_became_active":"2024-09-11T00:14:25.921096+0000","last_became_peered":"2024-09-11T00:14:25.921096+0000","last_unstale":"2024-09-11T00:14:26.937080+0000","last_undegraded":"2024-09-11T00:14:26.937080+0000","last_fullsized":"2024-09-11T00:14:26.937080+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:38:45.938435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937102+0000","last_change":"2024-09-11T00:14:23.913359+0000","last_active":"2024-09-11T00:14:26.937102+0000","last_peered":"2024-09-11T00:14:26.937102+0000","last_clean":"2024-09-11T00:14:26.937102+0000","last_became_active":"2024-09-11T00:14:23.913073+0000","last_became_peered":"2024-09-11T00:14:23.913073+0000","last_unstale":"2024-09-11T00:14:26.937102+0000","last_undegraded":"2024-09-11T00:14:26.937102+0000","last_fullsized":"2024-09-11T00:14:26.937102+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:04.907618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.921404+0000","last_change":"2024-09-11T00:14:23.905723+0000","last_active":"2024-09-11T00:14:26.921404+0000","last_peered":"2024-09-11T00:14:26.921404+0000","last_clean":"2024-09-11T00:14:26.921404+0000","last_became_active":"2024-09-11T00:14:23.905392+0000","last_became_peered":"2024-09-11T00:14:23.905392+0000","last_unstale":"2024-09-11T00:14:26.921404+0000","last_undegraded":"2024-09-11T00:14:26.921404+0000","last_fullsized":"2024-09-11T00:14:26.921404+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:48.603410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937023+0000","last_change":"2024-09-11T00:14:25.915843+0000","last_active":"2024-09-11T00:14:26.937023+0000","last_peered":"2024-09-11T00:14:26.937023+0000","last_clean":"2024-09-11T00:14:26.937023+0000","last_became_active":"2024-09-11T00:14:25.915543+0000","last_became_peered":"2024-09-11T00:14:25.915543+0000","last_unstale":"2024-09-11T00:14:26.937023+0000","last_undegraded":"2024-09-11T00:14:26.937023+0000","last_fullsized":"2024-09-11T00:14:26.937023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:10.781401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.938077+0000","last_change":"2024-09-11T00:14:23.913017+0000","last_active":"2024-09-11T00:14:26.938077+0000","last_peered":"2024-09-11T00:14:26.938077+0000","last_clean":"2024-09-11T00:14:26.938077+0000","last_became_active":"2024-09-11T00:14:23.912674+0000","last_became_peered":"2024-09-11T00:14:23.912674+0000","last_unstale":"2024-09-11T00:14:26.938077+0000","last_undegraded":"2024-09-11T00:14:26.938077+0000","last_fullsized":"2024-09-11T00:14:26.938077+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:22.711358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.935382+0000","last_change":"2024-09-11T00:14:25.917969+0000","last_active":"2024-09-11T00:14:26.935382+0000","last_peered":"2024-09-11T00:14:26.935382+0000","last_clean":"2024-09-11T00:14:26.935382+0000","last_became_active":"2024-09-11T00:14:25.917673+0000","last_became_peered":"2024-09-11T00:14:25.917673+0000","last_unstale":"2024-09-11T00:14:26.935382+0000","last_undegraded":"2024-09-11T00:14:26.935382+0000","last_fullsized":"2024-09-11T00:14:26.935382+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:55:36.992260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937312+0000","last_change":"2024-09-11T00:14:23.915544+0000","last_active":"2024-09-11T00:14:26.937312+0000","last_peered":"2024-09-11T00:14:26.937312+0000","last_clean":"2024-09-11T00:14:26.937312+0000","last_became_active":"2024-09-11T00:14:23.915129+0000","last_became_peered":"2024-09-11T00:14:23.915129+0000","last_unstale":"2024-09-11T00:14:26.937312+0000","last_undegraded":"2024-09-11T00:14:26.937312+0000","last_fullsized":"2024-09-11T00:14:26.937312+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:06.720068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940663+0000","last_change":"2024-09-11T00:14:25.927212+0000","last_active":"2024-09-11T00:14:26.940663+0000","last_peered":"2024-09-11T00:14:26.940663+0000","last_clean":"2024-09-11T00:14:26.940663+0000","last_became_active":"2024-09-11T00:14:25.926875+0000","last_became_peered":"2024-09-11T00:14:25.926875+0000","last_unstale":"2024-09-11T00:14:26.940663+0000","last_undegraded":"2024-09-11T00:14:26.940663+0000","last_fullsized":"2024-09-11T00:14:26.940663+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:06.749494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.924437+0000","last_change":"2024-09-11T00:14:23.907318+0000","last_active":"2024-09-11T00:14:26.924437+0000","last_peered":"2024-09-11T00:14:26.924437+0000","last_clean":"2024-09-11T00:14:26.924437+0000","last_became_active":"2024-09-11T00:14:23.905858+0000","last_became_peered":"2024-09-11T00:14:23.905858+0000","last_unstale":"2024-09-11T00:14:26.924437+0000","last_undegraded":"2024-09-11T00:14:26.924437+0000","last_fullsized":"2024-09-11T00:14:26.924437+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:16.005219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940861+0000","last_change":"2024-09-11T00:14:25.922126+0000","last_active":"2024-09-11T00:14:26.940861+0000","last_peered":"2024-09-11T00:14:26.940861+0000","last_clean":"2024-09-11T00:14:26.940861+0000","last_became_active":"2024-09-11T00:14:25.921801+0000","last_became_peered":"2024-09-11T00:14:25.921801+0000","last_unstale":"2024-09-11T00:14:26.940861+0000","last_undegraded":"2024-09-11T00:14:26.940861+0000","last_fullsized":"2024-09-11T00:14:26.940861+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:06.770343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.944217+0000","last_change":"2024-09-11T00:14:24.083872+0000","last_active":"2024-09-11T00:14:26.944217+0000","last_peered":"2024-09-11T00:14:26.944217+0000","last_clean":"2024-09-11T00:14:26.944217+0000","last_became_active":"2024-09-11T00:14:24.083479+0000","last_became_peered":"2024-09-11T00:14:24.083479+0000","last_unstale":"2024-09-11T00:14:26.944217+0000","last_undegraded":"2024-09-11T00:14:26.944217+0000","last_fullsized":"2024-09-11T00:14:26.944217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:19:30.492828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940936+0000","last_change":"2024-09-11T00:14:25.932281+0000","last_active":"2024-09-11T00:14:26.940936+0000","last_peered":"2024-09-11T00:14:26.940936+0000","last_clean":"2024-09-11T00:14:26.940936+0000","last_became_active":"2024-09-11T00:14:25.931935+0000","last_became_peered":"2024-09-11T00:14:25.931935+0000","last_unstale":"2024-09-11T00:14:26.940936+0000","last_undegraded":"2024-09-11T00:14:26.940936+0000","last_fullsized":"2024-09-11T00:14:26.940936+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:55.166421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'19","reported_seq":66,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:43.973577+0000","last_change":"2024-09-11T00:14:23.909614+0000","last_active":"2024-09-11T00:14:43.973577+0000","last_peered":"2024-09-11T00:14:43.973577+0000","last_clean":"2024-09-11T00:14:43.973577+0000","last_became_active":"2024-09-11T00:14:23.909209+0000","last_became_peered":"2024-09-11T00:14:23.909209+0000","last_unstale":"2024-09-11T00:14:43.973577+0000","last_undegraded":"2024-09-11T00:14:43.973577+0000","last_fullsized":"2024-09-11T00:14:43.973577+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:14.467304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41063,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":53,"num_write":19,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.938782+0000","last_change":"2024-09-11T00:14:25.924008+0000","last_active":"2024-09-11T00:14:26.938782+0000","last_peered":"2024-09-11T00:14:26.938782+0000","last_clean":"2024-09-11T00:14:26.938782+0000","last_became_active":"2024-09-11T00:14:25.923680+0000","last_became_peered":"2024-09-11T00:14:25.923680+0000","last_unstale":"2024-09-11T00:14:26.938782+0000","last_undegraded":"2024-09-11T00:14:26.938782+0000","last_fullsized":"2024-09-11T00:14:26.938782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:27.106405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:27.731957+0000","last_change":"2024-09-11T00:14:23.906908+0000","last_active":"2024-09-11T00:14:27.731957+0000","last_peered":"2024-09-11T00:14:27.731957+0000","last_clean":"2024-09-11T00:14:27.731957+0000","last_became_active":"2024-09-11T00:14:23.906170+0000","last_became_peered":"2024-09-11T00:14:23.906170+0000","last_unstale":"2024-09-11T00:14:27.731957+0000","last_undegraded":"2024-09-11T00:14:27.731957+0000","last_fullsized":"2024-09-11T00:14:27.731957+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:10:27.314551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.921182+0000","last_change":"2024-09-11T00:14:25.917896+0000","last_active":"2024-09-11T00:14:26.921182+0000","last_peered":"2024-09-11T00:14:26.921182+0000","last_clean":"2024-09-11T00:14:26.921182+0000","last_became_active":"2024-09-11T00:14:25.916341+0000","last_became_peered":"2024-09-11T00:14:25.916341+0000","last_unstale":"2024-09-11T00:14:26.921182+0000","last_undegraded":"2024-09-11T00:14:26.921182+0000","last_fullsized":"2024-09-11T00:14:26.921182+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:05.723223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.938674+0000","last_change":"2024-09-11T00:14:23.913113+0000","last_active":"2024-09-11T00:14:26.938674+0000","last_peered":"2024-09-11T00:14:26.938674+0000","last_clean":"2024-09-11T00:14:26.938674+0000","last_became_active":"2024-09-11T00:14:23.912791+0000","last_became_peered":"2024-09-11T00:14:23.912791+0000","last_unstale":"2024-09-11T00:14:26.938674+0000","last_undegraded":"2024-09-11T00:14:26.938674+0000","last_fullsized":"2024-09-11T00:14:26.938674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:31.124528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.924750+0000","last_change":"2024-09-11T00:14:25.927511+0000","last_active":"2024-09-11T00:14:26.924750+0000","last_peered":"2024-09-11T00:14:26.924750+0000","last_clean":"2024-09-11T00:14:26.924750+0000","last_became_active":"2024-09-11T00:14:25.927144+0000","last_became_peered":"2024-09-11T00:14:25.927144+0000","last_unstale":"2024-09-11T00:14:26.924750+0000","last_undegraded":"2024-09-11T00:14:26.924750+0000","last_fullsized":"2024-09-11T00:14:26.924750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:35.680110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.936505+0000","last_change":"2024-09-11T00:14:23.906706+0000","last_active":"2024-09-11T00:14:26.936505+0000","last_peered":"2024-09-11T00:14:26.936505+0000","last_clean":"2024-09-11T00:14:26.936505+0000","last_became_active":"2024-09-11T00:14:23.906368+0000","last_became_peered":"2024-09-11T00:14:23.906368+0000","last_unstale":"2024-09-11T00:14:26.936505+0000","last_undegraded":"2024-09-11T00:14:26.936505+0000","last_fullsized":"2024-09-11T00:14:26.936505+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:30:40.798446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.924287+0000","last_change":"2024-09-11T00:14:25.925996+0000","last_active":"2024-09-11T00:14:26.924287+0000","last_peered":"2024-09-11T00:14:26.924287+0000","last_clean":"2024-09-11T00:14:26.924287+0000","last_became_active":"2024-09-11T00:14:25.925653+0000","last_became_peered":"2024-09-11T00:14:25.925653+0000","last_unstale":"2024-09-11T00:14:26.924287+0000","last_undegraded":"2024-09-11T00:14:26.924287+0000","last_fullsized":"2024-09-11T00:14:26.924287+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:50.366666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.946360+0000","last_change":"2024-09-11T00:14:24.083774+0000","last_active":"2024-09-11T00:14:26.946360+0000","last_peered":"2024-09-11T00:14:26.946360+0000","last_clean":"2024-09-11T00:14:26.946360+0000","last_became_active":"2024-09-11T00:14:24.083398+0000","last_became_peered":"2024-09-11T00:14:24.083398+0000","last_unstale":"2024-09-11T00:14:26.946360+0000","last_undegraded":"2024-09-11T00:14:26.946360+0000","last_fullsized":"2024-09-11T00:14:26.946360+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:34.019592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.939158+0000","last_change":"2024-09-11T00:14:25.927171+0000","last_active":"2024-09-11T00:14:26.939158+0000","last_peered":"2024-09-11T00:14:26.939158+0000","last_clean":"2024-09-11T00:14:26.939158+0000","last_became_active":"2024-09-11T00:14:25.926873+0000","last_became_peered":"2024-09-11T00:14:25.926873+0000","last_unstale":"2024-09-11T00:14:26.939158+0000","last_undegraded":"2024-09-11T00:14:26.939158+0000","last_fullsized":"2024-09-11T00:14:26.939158+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:26.042903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.944866+0000","last_change":"2024-09-11T00:14:23.915816+0000","last_active":"2024-09-11T00:14:26.944866+0000","last_peered":"2024-09-11T00:14:26.944866+0000","last_clean":"2024-09-11T00:14:26.944866+0000","last_became_active":"2024-09-11T00:14:23.915305+0000","last_became_peered":"2024-09-11T00:14:23.915305+0000","last_unstale":"2024-09-11T00:14:26.944866+0000","last_undegraded":"2024-09-11T00:14:26.944866+0000","last_fullsized":"2024-09-11T00:14:26.944866+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:34:10.224582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.922295+0000","last_change":"2024-09-11T00:14:25.927502+0000","last_active":"2024-09-11T00:14:26.922295+0000","last_peered":"2024-09-11T00:14:26.922295+0000","last_clean":"2024-09-11T00:14:26.922295+0000","last_became_active":"2024-09-11T00:14:25.927107+0000","last_became_peered":"2024-09-11T00:14:25.927107+0000","last_unstale":"2024-09-11T00:14:26.922295+0000","last_undegraded":"2024-09-11T00:14:26.922295+0000","last_fullsized":"2024-09-11T00:14:26.922295+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:53.974425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940675+0000","last_change":"2024-09-11T00:14:23.904807+0000","last_active":"2024-09-11T00:14:26.940675+0000","last_peered":"2024-09-11T00:14:26.940675+0000","last_clean":"2024-09-11T00:14:26.940675+0000","last_became_active":"2024-09-11T00:14:23.904532+0000","last_became_peered":"2024-09-11T00:14:23.904532+0000","last_unstale":"2024-09-11T00:14:26.940675+0000","last_undegraded":"2024-09-11T00:14:26.940675+0000","last_fullsized":"2024-09-11T00:14:26.940675+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:08.945508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.924663+0000","last_change":"2024-09-11T00:14:25.919548+0000","last_active":"2024-09-11T00:14:26.924663+0000","last_peered":"2024-09-11T00:14:26.924663+0000","last_clean":"2024-09-11T00:14:26.924663+0000","last_became_active":"2024-09-11T00:14:25.919216+0000","last_became_peered":"2024-09-11T00:14:25.919216+0000","last_unstale":"2024-09-11T00:14:26.924663+0000","last_undegraded":"2024-09-11T00:14:26.924663+0000","last_fullsized":"2024-09-11T00:14:26.924663+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:18.318193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.944353+0000","last_change":"2024-09-11T00:14:23.915488+0000","last_active":"2024-09-11T00:14:26.944353+0000","last_peered":"2024-09-11T00:14:26.944353+0000","last_clean":"2024-09-11T00:14:26.944353+0000","last_became_active":"2024-09-11T00:14:23.915147+0000","last_became_peered":"2024-09-11T00:14:23.915147+0000","last_unstale":"2024-09-11T00:14:26.944353+0000","last_undegraded":"2024-09-11T00:14:26.944353+0000","last_fullsized":"2024-09-11T00:14:26.944353+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:04.830225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:29.676987+0000","last_change":"2024-09-11T00:14:25.919774+0000","last_active":"2024-09-11T00:14:29.676987+0000","last_peered":"2024-09-11T00:14:29.676987+0000","last_clean":"2024-09-11T00:14:29.676987+0000","last_became_active":"2024-09-11T00:14:25.919422+0000","last_became_peered":"2024-09-11T00:14:25.919422+0000","last_unstale":"2024-09-11T00:14:29.676987+0000","last_undegraded":"2024-09-11T00:14:29.676987+0000","last_fullsized":"2024-09-11T00:14:29.676987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:03.928972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.938891+0000","last_change":"2024-09-11T00:14:24.082414+0000","last_active":"2024-09-11T00:14:26.938891+0000","last_peered":"2024-09-11T00:14:26.938891+0000","last_clean":"2024-09-11T00:14:26.938891+0000","last_became_active":"2024-09-11T00:14:24.082058+0000","last_became_peered":"2024-09-11T00:14:24.082058+0000","last_unstale":"2024-09-11T00:14:26.938891+0000","last_undegraded":"2024-09-11T00:14:26.938891+0000","last_fullsized":"2024-09-11T00:14:26.938891+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:38.349964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.924958+0000","last_change":"2024-09-11T00:14:25.930116+0000","last_active":"2024-09-11T00:14:26.924958+0000","last_peered":"2024-09-11T00:14:26.924958+0000","last_clean":"2024-09-11T00:14:26.924958+0000","last_became_active":"2024-09-11T00:14:25.929787+0000","last_became_peered":"2024-09-11T00:14:25.929787+0000","last_unstale":"2024-09-11T00:14:26.924958+0000","last_undegraded":"2024-09-11T00:14:26.924958+0000","last_fullsized":"2024-09-11T00:14:26.924958+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:29.655577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.924961+0000","last_change":"2024-09-11T00:13:12.338952+0000","last_active":"2024-09-11T00:14:26.924961+0000","last_peered":"2024-09-11T00:14:26.924961+0000","last_clean":"2024-09-11T00:14:26.924961+0000","last_became_active":"2024-09-11T00:13:12.335030+0000","last_became_peered":"2024-09-11T00:13:12.335030+0000","last_unstale":"2024-09-11T00:14:26.924961+0000","last_undegraded":"2024-09-11T00:14:26.924961+0000","last_fullsized":"2024-09-11T00:14:26.924961+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:09:48.709624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:09:48.709624+0000","last_clean_scrub_stamp":"2024-09-11T00:09:48.709624+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:43.680771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.936761+0000","last_change":"2024-09-11T00:14:23.906794+0000","last_active":"2024-09-11T00:14:26.936761+0000","last_peered":"2024-09-11T00:14:26.936761+0000","last_clean":"2024-09-11T00:14:26.936761+0000","last_became_active":"2024-09-11T00:14:23.906430+0000","last_became_peered":"2024-09-11T00:14:23.906430+0000","last_unstale":"2024-09-11T00:14:26.936761+0000","last_undegraded":"2024-09-11T00:14:26.936761+0000","last_fullsized":"2024-09-11T00:14:26.936761+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:58.804834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937933+0000","last_change":"2024-09-11T00:14:25.928119+0000","last_active":"2024-09-11T00:14:26.937933+0000","last_peered":"2024-09-11T00:14:26.937933+0000","last_clean":"2024-09-11T00:14:26.937933+0000","last_became_active":"2024-09-11T00:14:25.927806+0000","last_became_peered":"2024-09-11T00:14:25.927806+0000","last_unstale":"2024-09-11T00:14:26.937933+0000","last_undegraded":"2024-09-11T00:14:26.937933+0000","last_fullsized":"2024-09-11T00:14:26.937933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:34.630696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.925024+0000","last_change":"2024-09-11T00:14:23.916252+0000","last_active":"2024-09-11T00:14:26.925024+0000","last_peered":"2024-09-11T00:14:26.925024+0000","last_clean":"2024-09-11T00:14:26.925024+0000","last_became_active":"2024-09-11T00:14:23.915905+0000","last_became_peered":"2024-09-11T00:14:23.915905+0000","last_unstale":"2024-09-11T00:14:26.925024+0000","last_undegraded":"2024-09-11T00:14:26.925024+0000","last_fullsized":"2024-09-11T00:14:26.925024+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:02.229067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.921166+0000","last_change":"2024-09-11T00:14:25.910163+0000","last_active":"2024-09-11T00:14:26.921166+0000","last_peered":"2024-09-11T00:14:26.921166+0000","last_clean":"2024-09-11T00:14:26.921166+0000","last_became_active":"2024-09-11T00:14:25.909926+0000","last_became_peered":"2024-09-11T00:14:25.909926+0000","last_unstale":"2024-09-11T00:14:26.921166+0000","last_undegraded":"2024-09-11T00:14:26.921166+0000","last_fullsized":"2024-09-11T00:14:26.921166+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:59:20.915080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.921573+0000","last_change":"2024-09-11T00:14:24.081999+0000","last_active":"2024-09-11T00:14:26.921573+0000","last_peered":"2024-09-11T00:14:26.921573+0000","last_clean":"2024-09-11T00:14:26.921573+0000","last_became_active":"2024-09-11T00:14:24.081664+0000","last_became_peered":"2024-09-11T00:14:24.081664+0000","last_unstale":"2024-09-11T00:14:26.921573+0000","last_undegraded":"2024-09-11T00:14:26.921573+0000","last_fullsized":"2024-09-11T00:14:26.921573+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:22.485256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937865+0000","last_change":"2024-09-11T00:14:25.921319+0000","last_active":"2024-09-11T00:14:26.937865+0000","last_peered":"2024-09-11T00:14:26.937865+0000","last_clean":"2024-09-11T00:14:26.937865+0000","last_became_active":"2024-09-11T00:14:25.921036+0000","last_became_peered":"2024-09-11T00:14:25.921036+0000","last_unstale":"2024-09-11T00:14:26.937865+0000","last_undegraded":"2024-09-11T00:14:26.937865+0000","last_fullsized":"2024-09-11T00:14:26.937865+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:19.036633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.924551+0000","last_change":"2024-09-11T00:14:23.905241+0000","last_active":"2024-09-11T00:14:26.924551+0000","last_peered":"2024-09-11T00:14:26.924551+0000","last_clean":"2024-09-11T00:14:26.924551+0000","last_became_active":"2024-09-11T00:14:23.904833+0000","last_became_peered":"2024-09-11T00:14:23.904833+0000","last_unstale":"2024-09-11T00:14:26.924551+0000","last_undegraded":"2024-09-11T00:14:26.924551+0000","last_fullsized":"2024-09-11T00:14:26.924551+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:44:28.162800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937158+0000","last_change":"2024-09-11T00:14:25.918352+0000","last_active":"2024-09-11T00:14:26.937158+0000","last_peered":"2024-09-11T00:14:26.937158+0000","last_clean":"2024-09-11T00:14:26.937158+0000","last_became_active":"2024-09-11T00:14:25.917918+0000","last_became_peered":"2024-09-11T00:14:25.917918+0000","last_unstale":"2024-09-11T00:14:26.937158+0000","last_undegraded":"2024-09-11T00:14:26.937158+0000","last_fullsized":"2024-09-11T00:14:26.937158+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:11.740062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.935515+0000","last_change":"2024-09-11T00:14:24.083578+0000","last_active":"2024-09-11T00:14:26.935515+0000","last_peered":"2024-09-11T00:14:26.935515+0000","last_clean":"2024-09-11T00:14:26.935515+0000","last_became_active":"2024-09-11T00:14:24.083233+0000","last_became_peered":"2024-09-11T00:14:24.083233+0000","last_unstale":"2024-09-11T00:14:26.935515+0000","last_undegraded":"2024-09-11T00:14:26.935515+0000","last_fullsized":"2024-09-11T00:14:26.935515+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:47.655836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:29.794330+0000","last_change":"2024-09-11T00:14:25.919141+0000","last_active":"2024-09-11T00:14:29.794330+0000","last_peered":"2024-09-11T00:14:29.794330+0000","last_clean":"2024-09-11T00:14:29.794330+0000","last_became_active":"2024-09-11T00:14:25.918791+0000","last_became_peered":"2024-09-11T00:14:25.918791+0000","last_unstale":"2024-09-11T00:14:29.794330+0000","last_undegraded":"2024-09-11T00:14:29.794330+0000","last_fullsized":"2024-09-11T00:14:29.794330+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:32.933462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.939259+0000","last_change":"2024-09-11T00:14:24.082284+0000","last_active":"2024-09-11T00:14:26.939259+0000","last_peered":"2024-09-11T00:14:26.939259+0000","last_clean":"2024-09-11T00:14:26.939259+0000","last_became_active":"2024-09-11T00:14:24.081859+0000","last_became_peered":"2024-09-11T00:14:24.081859+0000","last_unstale":"2024-09-11T00:14:26.939259+0000","last_undegraded":"2024-09-11T00:14:26.939259+0000","last_fullsized":"2024-09-11T00:14:26.939259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:38.881342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.921462+0000","last_change":"2024-09-11T00:14:25.910408+0000","last_active":"2024-09-11T00:14:26.921462+0000","last_peered":"2024-09-11T00:14:26.921462+0000","last_clean":"2024-09-11T00:14:26.921462+0000","last_became_active":"2024-09-11T00:14:25.909447+0000","last_became_peered":"2024-09-11T00:14:25.909447+0000","last_unstale":"2024-09-11T00:14:26.921462+0000","last_undegraded":"2024-09-11T00:14:26.921462+0000","last_fullsized":"2024-09-11T00:14:26.921462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:20:11.249974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'6","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:42.936669+0000","last_change":"2024-09-11T00:14:23.912799+0000","last_active":"2024-09-11T00:14:42.936669+0000","last_peered":"2024-09-11T00:14:42.936669+0000","last_clean":"2024-09-11T00:14:42.936669+0000","last_became_active":"2024-09-11T00:14:23.912440+0000","last_became_peered":"2024-09-11T00:14:23.912440+0000","last_unstale":"2024-09-11T00:14:42.936669+0000","last_undegraded":"2024-09-11T00:14:42.936669+0000","last_fullsized":"2024-09-11T00:14:42.936669+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:31.139405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.938275+0000","last_change":"2024-09-11T00:14:25.920599+0000","last_active":"2024-09-11T00:14:26.938275+0000","last_peered":"2024-09-11T00:14:26.938275+0000","last_clean":"2024-09-11T00:14:26.938275+0000","last_became_active":"2024-09-11T00:14:25.920256+0000","last_became_peered":"2024-09-11T00:14:25.920256+0000","last_unstale":"2024-09-11T00:14:26.938275+0000","last_undegraded":"2024-09-11T00:14:26.938275+0000","last_fullsized":"2024-09-11T00:14:26.938275+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:05.347880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.941252+0000","last_change":"2024-09-11T00:14:24.004190+0000","last_active":"2024-09-11T00:14:26.941252+0000","last_peered":"2024-09-11T00:14:26.941252+0000","last_clean":"2024-09-11T00:14:26.941252+0000","last_became_active":"2024-09-11T00:14:24.003842+0000","last_became_peered":"2024-09-11T00:14:24.003842+0000","last_unstale":"2024-09-11T00:14:26.941252+0000","last_undegraded":"2024-09-11T00:14:26.941252+0000","last_fullsized":"2024-09-11T00:14:26.941252+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:43.876046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940592+0000","last_change":"2024-09-11T00:14:25.914850+0000","last_active":"2024-09-11T00:14:26.940592+0000","last_peered":"2024-09-11T00:14:26.940592+0000","last_clean":"2024-09-11T00:14:26.940592+0000","last_became_active":"2024-09-11T00:14:25.914516+0000","last_became_peered":"2024-09-11T00:14:25.914516+0000","last_unstale":"2024-09-11T00:14:26.940592+0000","last_undegraded":"2024-09-11T00:14:26.940592+0000","last_fullsized":"2024-09-11T00:14:26.940592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:21:13.408335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.941236+0000","last_change":"2024-09-11T00:14:24.082118+0000","last_active":"2024-09-11T00:14:26.941236+0000","last_peered":"2024-09-11T00:14:26.941236+0000","last_clean":"2024-09-11T00:14:26.941236+0000","last_became_active":"2024-09-11T00:14:24.081844+0000","last_became_peered":"2024-09-11T00:14:24.081844+0000","last_unstale":"2024-09-11T00:14:26.941236+0000","last_undegraded":"2024-09-11T00:14:26.941236+0000","last_fullsized":"2024-09-11T00:14:26.941236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:20.827385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.936664+0000","last_change":"2024-09-11T00:14:25.917335+0000","last_active":"2024-09-11T00:14:26.936664+0000","last_peered":"2024-09-11T00:14:26.936664+0000","last_clean":"2024-09-11T00:14:26.936664+0000","last_became_active":"2024-09-11T00:14:25.916942+0000","last_became_peered":"2024-09-11T00:14:25.916942+0000","last_unstale":"2024-09-11T00:14:26.936664+0000","last_undegraded":"2024-09-11T00:14:26.936664+0000","last_fullsized":"2024-09-11T00:14:26.936664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:40.309186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937283+0000","last_change":"2024-09-11T00:14:23.906616+0000","last_active":"2024-09-11T00:14:26.937283+0000","last_peered":"2024-09-11T00:14:26.937283+0000","last_clean":"2024-09-11T00:14:26.937283+0000","last_became_active":"2024-09-11T00:14:23.906259+0000","last_became_peered":"2024-09-11T00:14:23.906259+0000","last_unstale":"2024-09-11T00:14:26.937283+0000","last_undegraded":"2024-09-11T00:14:26.937283+0000","last_fullsized":"2024-09-11T00:14:26.937283+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:01.514398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.922262+0000","last_change":"2024-09-11T00:14:25.925422+0000","last_active":"2024-09-11T00:14:26.922262+0000","last_peered":"2024-09-11T00:14:26.922262+0000","last_clean":"2024-09-11T00:14:26.922262+0000","last_became_active":"2024-09-11T00:14:25.923031+0000","last_became_peered":"2024-09-11T00:14:25.923031+0000","last_unstale":"2024-09-11T00:14:26.922262+0000","last_undegraded":"2024-09-11T00:14:26.922262+0000","last_fullsized":"2024-09-11T00:14:26.922262+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:59:52.217566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937007+0000","last_change":"2024-09-11T00:14:23.913308+0000","last_active":"2024-09-11T00:14:26.937007+0000","last_peered":"2024-09-11T00:14:26.937007+0000","last_clean":"2024-09-11T00:14:26.937007+0000","last_became_active":"2024-09-11T00:14:23.913002+0000","last_became_peered":"2024-09-11T00:14:23.913002+0000","last_unstale":"2024-09-11T00:14:26.937007+0000","last_undegraded":"2024-09-11T00:14:26.937007+0000","last_fullsized":"2024-09-11T00:14:26.937007+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:26:43.571378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.937818+0000","last_change":"2024-09-11T00:14:25.917478+0000","last_active":"2024-09-11T00:14:26.937818+0000","last_peered":"2024-09-11T00:14:26.937818+0000","last_clean":"2024-09-11T00:14:26.937818+0000","last_became_active":"2024-09-11T00:14:25.917192+0000","last_became_peered":"2024-09-11T00:14:25.917192+0000","last_unstale":"2024-09-11T00:14:26.937818+0000","last_undegraded":"2024-09-11T00:14:26.937818+0000","last_fullsized":"2024-09-11T00:14:26.937818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:46.695827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.945520+0000","last_change":"2024-09-11T00:14:23.914141+0000","last_active":"2024-09-11T00:14:26.945520+0000","last_peered":"2024-09-11T00:14:26.945520+0000","last_clean":"2024-09-11T00:14:26.945520+0000","last_became_active":"2024-09-11T00:14:23.913757+0000","last_became_peered":"2024-09-11T00:14:23.913757+0000","last_unstale":"2024-09-11T00:14:26.945520+0000","last_undegraded":"2024-09-11T00:14:26.945520+0000","last_fullsized":"2024-09-11T00:14:26.945520+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:54:00.609715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.924710+0000","last_change":"2024-09-11T00:14:25.924950+0000","last_active":"2024-09-11T00:14:26.924710+0000","last_peered":"2024-09-11T00:14:26.924710+0000","last_clean":"2024-09-11T00:14:26.924710+0000","last_became_active":"2024-09-11T00:14:25.924554+0000","last_became_peered":"2024-09-11T00:14:25.924554+0000","last_unstale":"2024-09-11T00:14:26.924710+0000","last_undegraded":"2024-09-11T00:14:26.924710+0000","last_fullsized":"2024-09-11T00:14:26.924710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:29.303384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.938877+0000","last_change":"2024-09-11T00:14:25.930162+0000","last_active":"2024-09-11T00:14:26.938877+0000","last_peered":"2024-09-11T00:14:26.938877+0000","last_clean":"2024-09-11T00:14:26.938877+0000","last_became_active":"2024-09-11T00:14:25.929820+0000","last_became_peered":"2024-09-11T00:14:25.929820+0000","last_unstale":"2024-09-11T00:14:26.938877+0000","last_undegraded":"2024-09-11T00:14:26.938877+0000","last_fullsized":"2024-09-11T00:14:26.938877+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:20:21.384841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.945111+0000","last_change":"2024-09-11T00:14:23.917486+0000","last_active":"2024-09-11T00:14:26.945111+0000","last_peered":"2024-09-11T00:14:26.945111+0000","last_clean":"2024-09-11T00:14:26.945111+0000","last_became_active":"2024-09-11T00:14:23.917150+0000","last_became_peered":"2024-09-11T00:14:23.917150+0000","last_unstale":"2024-09-11T00:14:26.945111+0000","last_undegraded":"2024-09-11T00:14:26.945111+0000","last_fullsized":"2024-09-11T00:14:26.945111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:13:55.687712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940429+0000","last_change":"2024-09-11T00:14:25.932674+0000","last_active":"2024-09-11T00:14:26.940429+0000","last_peered":"2024-09-11T00:14:26.940429+0000","last_clean":"2024-09-11T00:14:26.940429+0000","last_became_active":"2024-09-11T00:14:25.932353+0000","last_became_peered":"2024-09-11T00:14:25.932353+0000","last_unstale":"2024-09-11T00:14:26.940429+0000","last_undegraded":"2024-09-11T00:14:26.940429+0000","last_fullsized":"2024-09-11T00:14:26.940429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:48.721854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.945068+0000","last_change":"2024-09-11T00:14:23.913063+0000","last_active":"2024-09-11T00:14:26.945068+0000","last_peered":"2024-09-11T00:14:26.945068+0000","last_clean":"2024-09-11T00:14:26.945068+0000","last_became_active":"2024-09-11T00:14:23.912688+0000","last_became_peered":"2024-09-11T00:14:23.912688+0000","last_unstale":"2024-09-11T00:14:26.945068+0000","last_undegraded":"2024-09-11T00:14:26.945068+0000","last_fullsized":"2024-09-11T00:14:26.945068+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:35.228733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.940787+0000","last_change":"2024-09-11T00:14:25.928099+0000","last_active":"2024-09-11T00:14:26.940787+0000","last_peered":"2024-09-11T00:14:26.940787+0000","last_clean":"2024-09-11T00:14:26.940787+0000","last_became_active":"2024-09-11T00:14:25.927741+0000","last_became_peered":"2024-09-11T00:14:25.927741+0000","last_unstale":"2024-09-11T00:14:26.940787+0000","last_undegraded":"2024-09-11T00:14:26.940787+0000","last_fullsized":"2024-09-11T00:14:26.940787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:12.263180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.941751+0000","last_change":"2024-09-11T00:14:24.082533+0000","last_active":"2024-09-11T00:14:26.941751+0000","last_peered":"2024-09-11T00:14:26.941751+0000","last_clean":"2024-09-11T00:14:26.941751+0000","last_became_active":"2024-09-11T00:14:24.081666+0000","last_became_peered":"2024-09-11T00:14:24.081666+0000","last_unstale":"2024-09-11T00:14:26.941751+0000","last_undegraded":"2024-09-11T00:14:26.941751+0000","last_fullsized":"2024-09-11T00:14:26.941751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:56.485366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.938058+0000","last_change":"2024-09-11T00:14:25.912666+0000","last_active":"2024-09-11T00:14:26.938058+0000","last_peered":"2024-09-11T00:14:26.938058+0000","last_clean":"2024-09-11T00:14:26.938058+0000","last_became_active":"2024-09-11T00:14:25.912370+0000","last_became_peered":"2024-09-11T00:14:25.912370+0000","last_unstale":"2024-09-11T00:14:26.938058+0000","last_undegraded":"2024-09-11T00:14:26.938058+0000","last_fullsized":"2024-09-11T00:14:26.938058+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:44.400265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-11T00:14:26.945904+0000","last_change":"2024-09-11T00:14:23.914407+0000","last_active":"2024-09-11T00:14:26.945904+0000","last_peered":"2024-09-11T00:14:26.945904+0000","last_clean":"2024-09-11T00:14:26.945904+0000","last_became_active":"2024-09-11T00:14:23.914115+0000","last_became_peered":"2024-09-11T00:14:23.914115+0000","last_unstale":"2024-09-11T00:14:26.945904+0000","last_undegraded":"2024-09-11T00:14:26.945904+0000","last_fullsized":"2024-09-11T00:14:26.945904+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:58.883324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":41861,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":34,"num_read_kb":59,"num_write":68,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":149787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57,"ondisk_log_size":57,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282342,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743441,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":811008,"data_stored":402315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939669,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":1034057,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103195,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":402897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299424,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":402919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495652,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":993382,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659178,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31980,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713172,"statfs":{"total":95995035648,"available":95962288128,"internally_reserved":0,"allocated":815104,"data_stored":402432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855408,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":992982,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018933,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":815104,"data_stored":402337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215161,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":827392,"data_stored":402653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":876544,"data_stored":455514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542211,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":872448,"data_stored":455480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705736,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31984,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713168,"statfs":{"total":95995035648,"available":95962284032,"internally_reserved":0,"allocated":815104,"data_stored":402405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34264,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34264,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34264,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":53165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":53199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":41257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:14:51.784 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T00:14:51.784 INFO:tasks.cephadm:Setting up client nodes... 2024-09-11T00:14:51.785 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-11T00:14:52.030 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:52.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.542+0000 7f60196fe640 1 -- 172.21.15.78:0/2083280593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60141087b0 msgr2=0x7f6014108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:52.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.542+0000 7f60196fe640 1 --2- 172.21.15.78:0/2083280593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60141087b0 0x7f6014108bf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6008009900 tx=0x7f600802a410 comp rx=0 tx=0).stop 2024-09-11T00:14:52.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.542+0000 7f60196fe640 1 -- 172.21.15.78:0/2083280593 shutdown_connections 2024-09-11T00:14:52.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.542+0000 7f60196fe640 1 --2- 172.21.15.78:0/2083280593 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6014109130 0x7f601410f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:52.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.542+0000 7f60196fe640 1 --2- 172.21.15.78:0/2083280593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60141087b0 0x7f6014108bf0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:52.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.542+0000 7f60196fe640 1 --2- 172.21.15.78:0/2083280593 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6014102da0 0x7f6014103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:52.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.542+0000 7f60196fe640 1 -- 172.21.15.78:0/2083280593 >> 172.21.15.78:0/2083280593 conn(0x7f60140fe810 msgr2=0x7f6014100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:52.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.542+0000 7f60196fe640 1 -- 172.21.15.78:0/2083280593 shutdown_connections 2024-09-11T00:14:52.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.542+0000 7f60196fe640 1 -- 172.21.15.78:0/2083280593 wait complete. 2024-09-11T00:14:52.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.543+0000 7f60196fe640 1 Processor -- start 2024-09-11T00:14:52.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.543+0000 7f60196fe640 1 -- start start 2024-09-11T00:14:52.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.543+0000 7f60196fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6014102da0 0x7f6014199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:52.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.543+0000 7f60196fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60141087b0 0x7f60141999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:52.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.543+0000 7f60196fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6014109130 0x7f601419ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:52.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.543+0000 7f60196fe640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6014112e30 con 0x7f60141087b0 2024-09-11T00:14:52.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.543+0000 7f60196fe640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6014112cb0 con 0x7f6014109130 2024-09-11T00:14:52.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.543+0000 7f60196fe640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6014112fb0 con 0x7f6014102da0 2024-09-11T00:14:52.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.543+0000 7f60127fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60141087b0 0x7f60141999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:52.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.543+0000 7f60127fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60141087b0 0x7f60141999a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55408/0 (socket says 172.21.15.78:55408) 2024-09-11T00:14:52.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.543+0000 7f60127fc640 1 -- 172.21.15.78:0/2973763070 learned_addr learned my addr 172.21.15.78:0/2973763070 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:52.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.543+0000 7f6012ffd640 1 --2- 172.21.15.78:0/2973763070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6014102da0 0x7f6014199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:52.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.543+0000 7f60127fc640 1 -- 172.21.15.78:0/2973763070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6014102da0 msgr2=0x7f6014199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:52.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.543+0000 7f60127fc640 1 --2- 172.21.15.78:0/2973763070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6014102da0 0x7f6014199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:52.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.543+0000 7f60137fe640 1 --2- 172.21.15.78:0/2973763070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6014109130 0x7f601419ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:52.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.543+0000 7f60127fc640 1 -- 172.21.15.78:0/2973763070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6014109130 msgr2=0x7f601419ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:52.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.543+0000 7f60127fc640 1 --2- 172.21.15.78:0/2973763070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6014109130 0x7f601419ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:52.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.543+0000 7f60127fc640 1 -- 172.21.15.78:0/2973763070 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f601419f510 con 0x7f60141087b0 2024-09-11T00:14:52.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.543+0000 7f6012ffd640 1 --2- 172.21.15.78:0/2973763070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6014102da0 0x7f6014199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:14:52.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.544+0000 7f60127fc640 1 --2- 172.21.15.78:0/2973763070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60141087b0 0x7f60141999a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6008006010 tx=0x7f60080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:52.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.544+0000 7f5ffbfff640 1 -- 172.21.15.78:0/2973763070 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600803f030 con 0x7f60141087b0 2024-09-11T00:14:52.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.544+0000 7f60196fe640 1 -- 172.21.15.78:0/2973763070 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f601419f7a0 con 0x7f60141087b0 2024-09-11T00:14:52.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.544+0000 7f5ffbfff640 1 -- 172.21.15.78:0/2973763070 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6008003800 con 0x7f60141087b0 2024-09-11T00:14:52.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.544+0000 7f5ffbfff640 1 -- 172.21.15.78:0/2973763070 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6008035070 con 0x7f60141087b0 2024-09-11T00:14:52.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.544+0000 7f60196fe640 1 -- 172.21.15.78:0/2973763070 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60141a5ec0 con 0x7f60141087b0 2024-09-11T00:14:52.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.545+0000 7f60196fe640 1 -- 172.21.15.78:0/2973763070 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6014103200 con 0x7f60141087b0 2024-09-11T00:14:52.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.546+0000 7f5ffbfff640 1 -- 172.21.15.78:0/2973763070 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f6008031b10 con 0x7f60141087b0 2024-09-11T00:14:52.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.547+0000 7f5ffbfff640 1 --2- 172.21.15.78:0/2973763070 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5ffc0b53c0 0x7f5ffc0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:52.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.547+0000 7f6012ffd640 1 --2- 172.21.15.78:0/2973763070 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5ffc0b53c0 0x7f5ffc0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:52.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.547+0000 7f5ffbfff640 1 -- 172.21.15.78:0/2973763070 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f6008106a20 con 0x7f60141087b0 2024-09-11T00:14:52.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.547+0000 7f6012ffd640 1 --2- 172.21.15.78:0/2973763070 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5ffc0b53c0 0x7f5ffc0b7880 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6004007eb0 tx=0x7f60040073c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:52.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.550+0000 7f5ffbfff640 1 -- 172.21.15.78:0/2973763070 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f60080cd7a0 con 0x7f60141087b0 2024-09-11T00:14:52.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.791+0000 7f60196fe640 1 -- 172.21.15.78:0/2973763070 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f601419a590 con 0x7f60141087b0 2024-09-11T00:14:52.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.793+0000 7f5ffbfff640 1 -- 172.21.15.78:0/2973763070 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f601419a590 con 0x7f60141087b0 2024-09-11T00:14:52.795 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2024-09-11T00:14:52.795 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQD84OBmpExBLxAAXg8YU5ElRKoTKjxiaXXv/A== 2024-09-11T00:14:52.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.795+0000 7f60196fe640 1 -- 172.21.15.78:0/2973763070 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5ffc0b53c0 msgr2=0x7f5ffc0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:52.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.795+0000 7f60196fe640 1 --2- 172.21.15.78:0/2973763070 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5ffc0b53c0 0x7f5ffc0b7880 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6004007eb0 tx=0x7f60040073c0 comp rx=0 tx=0).stop 2024-09-11T00:14:52.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.795+0000 7f60196fe640 1 -- 172.21.15.78:0/2973763070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60141087b0 msgr2=0x7f60141999a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:52.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.795+0000 7f60196fe640 1 --2- 172.21.15.78:0/2973763070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60141087b0 0x7f60141999a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6008006010 tx=0x7f60080042f0 comp rx=0 tx=0).stop 2024-09-11T00:14:52.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.796+0000 7f60196fe640 1 -- 172.21.15.78:0/2973763070 shutdown_connections 2024-09-11T00:14:52.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.796+0000 7f60196fe640 1 --2- 172.21.15.78:0/2973763070 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5ffc0b53c0 0x7f5ffc0b7880 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:52.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.796+0000 7f60196fe640 1 --2- 172.21.15.78:0/2973763070 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6014109130 0x7f601419ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:52.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.796+0000 7f60196fe640 1 --2- 172.21.15.78:0/2973763070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60141087b0 0x7f60141999a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:52.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.796+0000 7f60196fe640 1 --2- 172.21.15.78:0/2973763070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6014102da0 0x7f6014199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:52.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.796+0000 7f60196fe640 1 -- 172.21.15.78:0/2973763070 >> 172.21.15.78:0/2973763070 conn(0x7f60140fe810 msgr2=0x7f6014100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:52.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.796+0000 7f60196fe640 1 -- 172.21.15.78:0/2973763070 shutdown_connections 2024-09-11T00:14:52.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:52.796+0000 7f60196fe640 1 -- 172.21.15.78:0/2973763070 wait complete. 2024-09-11T00:14:53.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:52 smithi138 ceph-mon[35019]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:14:53.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:52 smithi138 ceph-mon[35019]: pgmap v271: 97 pgs: 97 active+clean; 629 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.3 KiB/s wr, 6 op/s 2024-09-11T00:14:53.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:52 smithi078 ceph-mon[30865]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:14:53.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:52 smithi078 ceph-mon[30865]: pgmap v271: 97 pgs: 97 active+clean; 629 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.3 KiB/s wr, 6 op/s 2024-09-11T00:14:53.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:52 smithi112 ceph-mon[35627]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:14:53.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:52 smithi112 ceph-mon[35627]: pgmap v271: 97 pgs: 97 active+clean; 629 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.3 KiB/s wr, 6 op/s 2024-09-11T00:14:53.453 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-11T00:14:53.454 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-11T00:14:53.454 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T00:14:53.490 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph config log 1 --format=json 2024-09-11T00:14:53.776 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:54.035 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:53 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2973763070' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-11T00:14:54.036 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:53 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2973763070' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T00:14:54.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:53 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2973763070' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-11T00:14:54.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:53 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2973763070' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T00:14:54.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:53 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2973763070' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-11T00:14:54.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:53 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2973763070' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T00:14:54.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.257+0000 7f751c7bc640 1 -- 172.21.15.78:0/4065604250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75141087d0 msgr2=0x7f7514108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:54.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.257+0000 7f751c7bc640 1 --2- 172.21.15.78:0/4065604250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75141087d0 0x7f7514108c10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7504009900 tx=0x7f750402a410 comp rx=0 tx=0).stop 2024-09-11T00:14:54.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.257+0000 7f751c7bc640 1 -- 172.21.15.78:0/4065604250 shutdown_connections 2024-09-11T00:14:54.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.257+0000 7f751c7bc640 1 --2- 172.21.15.78:0/4065604250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7514109150 0x7f751410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.257+0000 7f751c7bc640 1 --2- 172.21.15.78:0/4065604250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75141087d0 0x7f7514108c10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.257+0000 7f751c7bc640 1 --2- 172.21.15.78:0/4065604250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7514102dc0 0x7f75141031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.257+0000 7f751c7bc640 1 -- 172.21.15.78:0/4065604250 >> 172.21.15.78:0/4065604250 conn(0x7f75140fe830 msgr2=0x7f7514100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:54.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.257+0000 7f751c7bc640 1 -- 172.21.15.78:0/4065604250 shutdown_connections 2024-09-11T00:14:54.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.257+0000 7f751c7bc640 1 -- 172.21.15.78:0/4065604250 wait complete. 2024-09-11T00:14:54.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.257+0000 7f751c7bc640 1 Processor -- start 2024-09-11T00:14:54.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.257+0000 7f751c7bc640 1 -- start start 2024-09-11T00:14:54.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.258+0000 7f751c7bc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7514102dc0 0x7f75141992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:54.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.258+0000 7f751c7bc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75141087d0 0x7f7514199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:54.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.258+0000 7f751c7bc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7514109150 0x7f751419ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:54.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.258+0000 7f751c7bc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7514112e10 con 0x7f7514102dc0 2024-09-11T00:14:54.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.258+0000 7f751c7bc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7514112c90 con 0x7f75141087d0 2024-09-11T00:14:54.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.258+0000 7f751c7bc640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7514112f90 con 0x7f7514109150 2024-09-11T00:14:54.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.258+0000 7f751a558640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7514102dc0 0x7f75141992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:54.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.258+0000 7f751a558640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7514102dc0 0x7f75141992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55430/0 (socket says 172.21.15.78:55430) 2024-09-11T00:14:54.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.258+0000 7f751a558640 1 -- 172.21.15.78:0/320106632 learned_addr learned my addr 172.21.15.78:0/320106632 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:54.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.258+0000 7f7519d57640 1 --2- 172.21.15.78:0/320106632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75141087d0 0x7f7514199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:54.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.258+0000 7f751ad59640 1 --2- 172.21.15.78:0/320106632 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7514109150 0x7f751419ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:54.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.258+0000 7f751a558640 1 -- 172.21.15.78:0/320106632 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7514109150 msgr2=0x7f751419ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:54.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.258+0000 7f751a558640 1 --2- 172.21.15.78:0/320106632 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7514109150 0x7f751419ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.258+0000 7f751a558640 1 -- 172.21.15.78:0/320106632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75141087d0 msgr2=0x7f7514199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:54.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.258+0000 7f751a558640 1 --2- 172.21.15.78:0/320106632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75141087d0 0x7f7514199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.258+0000 7f751a558640 1 -- 172.21.15.78:0/320106632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751419f3a0 con 0x7f7514102dc0 2024-09-11T00:14:54.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.258+0000 7f751a558640 1 --2- 172.21.15.78:0/320106632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7514102dc0 0x7f75141992f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f750c00eab0 tx=0x7f750c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:54.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.258+0000 7f750b7fe640 1 -- 172.21.15.78:0/320106632 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c00ce40 con 0x7f7514102dc0 2024-09-11T00:14:54.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.259+0000 7f750b7fe640 1 -- 172.21.15.78:0/320106632 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f750c011920 con 0x7f7514102dc0 2024-09-11T00:14:54.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.259+0000 7f751c7bc640 1 -- 172.21.15.78:0/320106632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f751419f690 con 0x7f7514102dc0 2024-09-11T00:14:54.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.259+0000 7f750b7fe640 1 -- 172.21.15.78:0/320106632 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c010a30 con 0x7f7514102dc0 2024-09-11T00:14:54.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.259+0000 7f751c7bc640 1 -- 172.21.15.78:0/320106632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75141a5f20 con 0x7f7514102dc0 2024-09-11T00:14:54.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.260+0000 7f751c7bc640 1 -- 172.21.15.78:0/320106632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75141031a0 con 0x7f7514102dc0 2024-09-11T00:14:54.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.261+0000 7f750b7fe640 1 -- 172.21.15.78:0/320106632 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f750c00f040 con 0x7f7514102dc0 2024-09-11T00:14:54.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.262+0000 7f750b7fe640 1 --2- 172.21.15.78:0/320106632 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f75000b5440 0x7f75000b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:54.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.262+0000 7f7519d57640 1 --2- 172.21.15.78:0/320106632 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f75000b5440 0x7f75000b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:54.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.262+0000 7f750b7fe640 1 -- 172.21.15.78:0/320106632 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f750c0e5f80 con 0x7f7514102dc0 2024-09-11T00:14:54.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.262+0000 7f7519d57640 1 --2- 172.21.15.78:0/320106632 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f75000b5440 0x7f75000b7900 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7504031440 tx=0x7f7504005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:54.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.265+0000 7f750b7fe640 1 -- 172.21.15.78:0/320106632 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f750c016030 con 0x7f7514102dc0 2024-09-11T00:14:54.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.443+0000 7f751c7bc640 1 -- 172.21.15.78:0/320106632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f751419a420 con 0x7f7514102dc0 2024-09-11T00:14:54.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.444+0000 7f750b7fe640 1 -- 172.21.15.78:0/320106632 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v54) ==== 86+0+133 (secure 0 0 0) 0x7f751419a420 con 0x7f7514102dc0 2024-09-11T00:14:54.445 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:14:54.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.446+0000 7f751c7bc640 1 -- 172.21.15.78:0/320106632 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f75000b5440 msgr2=0x7f75000b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:54.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.446+0000 7f751c7bc640 1 --2- 172.21.15.78:0/320106632 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f75000b5440 0x7f75000b7900 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7504031440 tx=0x7f7504005b50 comp rx=0 tx=0).stop 2024-09-11T00:14:54.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.446+0000 7f751c7bc640 1 -- 172.21.15.78:0/320106632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7514102dc0 msgr2=0x7f75141992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:54.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.446+0000 7f751c7bc640 1 --2- 172.21.15.78:0/320106632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7514102dc0 0x7f75141992f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f750c00eab0 tx=0x7f750c00ef70 comp rx=0 tx=0).stop 2024-09-11T00:14:54.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.446+0000 7f751c7bc640 1 -- 172.21.15.78:0/320106632 shutdown_connections 2024-09-11T00:14:54.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.446+0000 7f751c7bc640 1 --2- 172.21.15.78:0/320106632 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f75000b5440 0x7f75000b7900 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.446+0000 7f751c7bc640 1 --2- 172.21.15.78:0/320106632 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7514109150 0x7f751419ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.446+0000 7f751c7bc640 1 --2- 172.21.15.78:0/320106632 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f75141087d0 0x7f7514199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.446+0000 7f751c7bc640 1 --2- 172.21.15.78:0/320106632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7514102dc0 0x7f75141992f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:54.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.446+0000 7f751c7bc640 1 -- 172.21.15.78:0/320106632 >> 172.21.15.78:0/320106632 conn(0x7f75140fe830 msgr2=0x7f7514100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:54.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.446+0000 7f751c7bc640 1 -- 172.21.15.78:0/320106632 shutdown_connections 2024-09-11T00:14:54.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:54.446+0000 7f751c7bc640 1 -- 172.21.15.78:0/320106632 wait complete. 2024-09-11T00:14:55.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:54 smithi138 ceph-mon[35019]: pgmap v272: 97 pgs: 97 active+clean; 629 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.2 KiB/s wr, 4 op/s 2024-09-11T00:14:55.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:54 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/320106632' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-11T00:14:55.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:54 smithi078 ceph-mon[30865]: pgmap v272: 97 pgs: 97 active+clean; 629 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.2 KiB/s wr, 4 op/s 2024-09-11T00:14:55.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:54 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/320106632' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-11T00:14:55.222 INFO:teuthology.orchestra.run.smithi078.stdout:[{"version":54,"timestamp":"2024-09-11T00:14:16.337899+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-11T00:14:55.222 INFO:tasks.ceph_manager:config epoch is 54 2024-09-11T00:14:55.222 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T00:14:55.223 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-11T00:14:55.223 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-11T00:14:55.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:54 smithi112 ceph-mon[35627]: pgmap v272: 97 pgs: 97 active+clean; 629 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.2 KiB/s wr, 4 op/s 2024-09-11T00:14:55.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:54 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/320106632' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-11T00:14:55.468 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:55.895 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:55 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-11T00:14:55.896 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:55 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-09-11T00:14:55.896 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:55 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6, 5, 9]} : dispatch 2024-09-11T00:14:55.896 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:55 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2024-09-11T00:14:55.896 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:55 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]} : dispatch 2024-09-11T00:14:55.896 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:55 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 8]} : dispatch 2024-09-11T00:14:55.896 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:55 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]} : dispatch 2024-09-11T00:14:55.896 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:55 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]} : dispatch 2024-09-11T00:14:55.896 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:55 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]} : dispatch 2024-09-11T00:14:55.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.974+0000 7f0c667e3640 1 -- 172.21.15.78:0/325709555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c60109130 msgr2=0x7f0c6010f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:55.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.974+0000 7f0c667e3640 1 --2- 172.21.15.78:0/325709555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c60109130 0x7f0c6010f930 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009ca0 tx=0x7f0c5802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.974+0000 7f0c667e3640 1 -- 172.21.15.78:0/325709555 shutdown_connections 2024-09-11T00:14:55.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.974+0000 7f0c667e3640 1 --2- 172.21.15.78:0/325709555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c60109130 0x7f0c6010f930 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.974+0000 7f0c667e3640 1 --2- 172.21.15.78:0/325709555 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c601087b0 0x7f0c60108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.974+0000 7f0c667e3640 1 --2- 172.21.15.78:0/325709555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c60102da0 0x7f0c60103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.974+0000 7f0c667e3640 1 -- 172.21.15.78:0/325709555 >> 172.21.15.78:0/325709555 conn(0x7f0c600fe810 msgr2=0x7f0c60100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:55.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.974+0000 7f0c667e3640 1 -- 172.21.15.78:0/325709555 shutdown_connections 2024-09-11T00:14:55.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.974+0000 7f0c667e3640 1 -- 172.21.15.78:0/325709555 wait complete. 2024-09-11T00:14:55.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.975+0000 7f0c667e3640 1 Processor -- start 2024-09-11T00:14:55.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.975+0000 7f0c667e3640 1 -- start start 2024-09-11T00:14:55.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.975+0000 7f0c667e3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c60102da0 0x7f0c601992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:55.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.975+0000 7f0c667e3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c601087b0 0x7f0c60199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:55.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.975+0000 7f0c667e3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c60109130 0x7f0c6019eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:55.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.975+0000 7f0c667e3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0c60112df0 con 0x7f0c60102da0 2024-09-11T00:14:55.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.975+0000 7f0c667e3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0c60112c70 con 0x7f0c601087b0 2024-09-11T00:14:55.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.975+0000 7f0c667e3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0c60112f70 con 0x7f0c60109130 2024-09-11T00:14:55.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.975+0000 7f0c5ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c60102da0 0x7f0c601992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:55.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.975+0000 7f0c5ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c60102da0 0x7f0c601992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35578/0 (socket says 172.21.15.78:35578) 2024-09-11T00:14:55.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.975+0000 7f0c5ffff640 1 -- 172.21.15.78:0/1911524391 learned_addr learned my addr 172.21.15.78:0/1911524391 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:55.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.975+0000 7f0c64d80640 1 --2- 172.21.15.78:0/1911524391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c60109130 0x7f0c6019eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:55.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.976+0000 7f0c5f7fe640 1 --2- 172.21.15.78:0/1911524391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c601087b0 0x7f0c60199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:55.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.976+0000 7f0c5ffff640 1 -- 172.21.15.78:0/1911524391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c60109130 msgr2=0x7f0c6019eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:55.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.976+0000 7f0c5ffff640 1 --2- 172.21.15.78:0/1911524391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c60109130 0x7f0c6019eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.976+0000 7f0c5ffff640 1 -- 172.21.15.78:0/1911524391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c601087b0 msgr2=0x7f0c60199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:55.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.976+0000 7f0c5ffff640 1 --2- 172.21.15.78:0/1911524391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c601087b0 0x7f0c60199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:55.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.976+0000 7f0c5ffff640 1 -- 172.21.15.78:0/1911524391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6019f370 con 0x7f0c60102da0 2024-09-11T00:14:55.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.976+0000 7f0c64d80640 1 --2- 172.21.15.78:0/1911524391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c60109130 0x7f0c6019eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:55.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.976+0000 7f0c5ffff640 1 --2- 172.21.15.78:0/1911524391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c60102da0 0x7f0c601992c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000c970 tx=0x7f0c5000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:55.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.976+0000 7f0c5d7fa640 1 -- 172.21.15.78:0/1911524391 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50007bb0 con 0x7f0c60102da0 2024-09-11T00:14:55.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.976+0000 7f0c667e3640 1 -- 172.21.15.78:0/1911524391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c6019f660 con 0x7f0c60102da0 2024-09-11T00:14:55.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.976+0000 7f0c5d7fa640 1 -- 172.21.15.78:0/1911524391 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c50007d50 con 0x7f0c60102da0 2024-09-11T00:14:55.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.976+0000 7f0c5d7fa640 1 -- 172.21.15.78:0/1911524391 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5000f450 con 0x7f0c60102da0 2024-09-11T00:14:55.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.976+0000 7f0c667e3640 1 -- 172.21.15.78:0/1911524391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c601a5da0 con 0x7f0c60102da0 2024-09-11T00:14:55.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.977+0000 7f0c667e3640 1 -- 172.21.15.78:0/1911524391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c60103180 con 0x7f0c60102da0 2024-09-11T00:14:55.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.979+0000 7f0c5d7fa640 1 -- 172.21.15.78:0/1911524391 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f0c50004f00 con 0x7f0c60102da0 2024-09-11T00:14:55.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.980+0000 7f0c5d7fa640 1 --2- 172.21.15.78:0/1911524391 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f0c480b53c0 0x7f0c480b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:55.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.980+0000 7f0c5f7fe640 1 --2- 172.21.15.78:0/1911524391 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f0c480b53c0 0x7f0c480b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:55.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.980+0000 7f0c5d7fa640 1 -- 172.21.15.78:0/1911524391 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f0c500e6040 con 0x7f0c60102da0 2024-09-11T00:14:55.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.980+0000 7f0c5f7fe640 1 --2- 172.21.15.78:0/1911524391 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f0c480b53c0 0x7f0c480b7880 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0c60104f60 tx=0x7f0c54008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:55.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:55.983+0000 7f0c5d7fa640 1 -- 172.21.15.78:0/1911524391 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0c50014030 con 0x7f0c60102da0 2024-09-11T00:14:56.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:55 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-11T00:14:56.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:55 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-09-11T00:14:56.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:55 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6, 5, 9]} : dispatch 2024-09-11T00:14:56.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:55 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2024-09-11T00:14:56.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:55 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]} : dispatch 2024-09-11T00:14:56.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:55 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 8]} : dispatch 2024-09-11T00:14:56.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:55 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]} : dispatch 2024-09-11T00:14:56.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:55 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]} : dispatch 2024-09-11T00:14:56.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:55 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]} : dispatch 2024-09-11T00:14:56.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:56.205+0000 7f0c667e3640 1 -- 172.21.15.78:0/1911524391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f0c6019a3f0 con 0x7f0c60102da0 2024-09-11T00:14:56.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:56.210+0000 7f0c5d7fa640 1 -- 172.21.15.78:0/1911524391 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) ==== 74+0+294232 (secure 0 0 0) 0x7f0c6019a3f0 con 0x7f0c60102da0 2024-09-11T00:14:56.215 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:14:56.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:56.214+0000 7f0c667e3640 1 -- 172.21.15.78:0/1911524391 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f0c480b53c0 msgr2=0x7f0c480b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:56.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:56.214+0000 7f0c667e3640 1 --2- 172.21.15.78:0/1911524391 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f0c480b53c0 0x7f0c480b7880 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0c60104f60 tx=0x7f0c54008040 comp rx=0 tx=0).stop 2024-09-11T00:14:56.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:56.214+0000 7f0c667e3640 1 -- 172.21.15.78:0/1911524391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c60102da0 msgr2=0x7f0c601992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:56.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:56.214+0000 7f0c667e3640 1 --2- 172.21.15.78:0/1911524391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c60102da0 0x7f0c601992c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000c970 tx=0x7f0c5000ce30 comp rx=0 tx=0).stop 2024-09-11T00:14:56.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:56.214+0000 7f0c667e3640 1 -- 172.21.15.78:0/1911524391 shutdown_connections 2024-09-11T00:14:56.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:56.214+0000 7f0c667e3640 1 --2- 172.21.15.78:0/1911524391 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f0c480b53c0 0x7f0c480b7880 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:56.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:56.214+0000 7f0c667e3640 1 --2- 172.21.15.78:0/1911524391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c60109130 0x7f0c6019eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:56.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:56.214+0000 7f0c667e3640 1 --2- 172.21.15.78:0/1911524391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c601087b0 0x7f0c60199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:56.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:56.214+0000 7f0c667e3640 1 --2- 172.21.15.78:0/1911524391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c60102da0 0x7f0c601992c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:56.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:56.214+0000 7f0c667e3640 1 -- 172.21.15.78:0/1911524391 >> 172.21.15.78:0/1911524391 conn(0x7f0c600fe810 msgr2=0x7f0c60105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:56.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:56.214+0000 7f0c667e3640 1 -- 172.21.15.78:0/1911524391 shutdown_connections 2024-09-11T00:14:56.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:56.214+0000 7f0c667e3640 1 -- 172.21.15.78:0/1911524391 wait complete. 2024-09-11T00:14:56.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:55 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-11T00:14:56.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:55 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-09-11T00:14:56.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:55 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6, 5, 9]} : dispatch 2024-09-11T00:14:56.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:55 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2024-09-11T00:14:56.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:55 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]} : dispatch 2024-09-11T00:14:56.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:55 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 8]} : dispatch 2024-09-11T00:14:56.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:55 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]} : dispatch 2024-09-11T00:14:56.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:55 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]} : dispatch 2024-09-11T00:14:56.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:55 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]} : dispatch 2024-09-11T00:14:56.968 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:56 smithi078 ceph-mon[30865]: pgmap v273: 97 pgs: 97 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 KiB/s wr, 5 op/s 2024-09-11T00:14:56.968 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:56 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-11T00:14:56.968 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:56 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-11T00:14:56.969 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:56 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6, 5, 9]}]': finished 2024-09-11T00:14:56.969 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:56 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-11T00:14:56.969 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:56 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-09-11T00:14:56.969 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:56 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 8]}]': finished 2024-09-11T00:14:56.969 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:56 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-09-11T00:14:56.969 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:56 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]}]': finished 2024-09-11T00:14:56.969 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:56 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]': finished 2024-09-11T00:14:56.969 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:56 smithi078 ceph-mon[30865]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T00:14:56.969 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:56 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1911524391' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-11T00:14:56.995 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":21,"flags":0,"active_gid":14220,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3195506449},{"type":"v1","addr":"172.21.15.78:6801","nonce":3195506449}]},"active_addr":"172.21.15.78:6801/3195506449","active_change":"2024-09-11T00:07:55.586721+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24145,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24155,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.78:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":1595719137}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":3169381695}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":2896247468}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":3350404179}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":1891960749}]}]} 2024-09-11T00:14:57.002 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-11T00:14:57.002 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-11T00:14:57.002 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:14:57.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:56 smithi138 ceph-mon[35019]: pgmap v273: 97 pgs: 97 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 KiB/s wr, 5 op/s 2024-09-11T00:14:57.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:56 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-11T00:14:57.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:56 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-11T00:14:57.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:56 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6, 5, 9]}]': finished 2024-09-11T00:14:57.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:56 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-11T00:14:57.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:56 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-09-11T00:14:57.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:56 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 8]}]': finished 2024-09-11T00:14:57.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:56 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-09-11T00:14:57.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:56 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]}]': finished 2024-09-11T00:14:57.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:56 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]': finished 2024-09-11T00:14:57.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:56 smithi138 ceph-mon[35019]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T00:14:57.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:56 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1911524391' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-11T00:14:57.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:56 smithi112 ceph-mon[35627]: pgmap v273: 97 pgs: 97 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 KiB/s wr, 5 op/s 2024-09-11T00:14:57.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:56 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-11T00:14:57.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:56 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-11T00:14:57.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:56 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6, 5, 9]}]': finished 2024-09-11T00:14:57.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:56 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-11T00:14:57.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:56 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-09-11T00:14:57.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:56 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 8]}]': finished 2024-09-11T00:14:57.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:56 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-09-11T00:14:57.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:56 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]}]': finished 2024-09-11T00:14:57.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:56 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]': finished 2024-09-11T00:14:57.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:56 smithi112 ceph-mon[35627]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T00:14:57.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:56 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1911524391' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-11T00:14:57.247 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:57.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.707+0000 7f3089c01640 1 -- 172.21.15.78:0/530645173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3084108060 msgr2=0x7f308410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.707+0000 7f3089c01640 1 --2- 172.21.15.78:0/530645173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3084108060 0x7f308410e860 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f307c009ca0 tx=0x7f307c02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.707+0000 7f3089c01640 1 -- 172.21.15.78:0/530645173 shutdown_connections 2024-09-11T00:14:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.707+0000 7f3089c01640 1 --2- 172.21.15.78:0/530645173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3084108060 0x7f308410e860 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.707+0000 7f3089c01640 1 --2- 172.21.15.78:0/530645173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30841076e0 0x7f3084107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.707+0000 7f3089c01640 1 --2- 172.21.15.78:0/530645173 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3084101cd0 0x7f30841020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.707+0000 7f3089c01640 1 -- 172.21.15.78:0/530645173 >> 172.21.15.78:0/530645173 conn(0x7f30840fd700 msgr2=0x7f30840ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.707+0000 7f3089c01640 1 -- 172.21.15.78:0/530645173 shutdown_connections 2024-09-11T00:14:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.707+0000 7f3089c01640 1 -- 172.21.15.78:0/530645173 wait complete. 2024-09-11T00:14:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.707+0000 7f3089c01640 1 Processor -- start 2024-09-11T00:14:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.708+0000 7f3089c01640 1 -- start start 2024-09-11T00:14:57.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.708+0000 7f3089c01640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3084101cd0 0x7f3084199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:57.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.708+0000 7f3089c01640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30841076e0 0x7f30841998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:57.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.708+0000 7f3089c01640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3084108060 0x7f308419ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:57.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.708+0000 7f3089c01640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3084111ce0 con 0x7f3084108060 2024-09-11T00:14:57.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.708+0000 7f3089c01640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3084111b60 con 0x7f3084101cd0 2024-09-11T00:14:57.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.708+0000 7f3089c01640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3084111e60 con 0x7f30841076e0 2024-09-11T00:14:57.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.708+0000 7f3083fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3084108060 0x7f308419ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:57.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.708+0000 7f3083fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3084108060 0x7f308419ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35600/0 (socket says 172.21.15.78:35600) 2024-09-11T00:14:57.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.708+0000 7f3083fff640 1 -- 172.21.15.78:0/2636222804 learned_addr learned my addr 172.21.15.78:0/2636222804 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:57.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.708+0000 7f307bfff640 1 --2- 172.21.15.78:0/2636222804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30841076e0 0x7f30841998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:57.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.708+0000 7f30837fe640 1 --2- 172.21.15.78:0/2636222804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3084101cd0 0x7f3084199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:57.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.708+0000 7f3083fff640 1 -- 172.21.15.78:0/2636222804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30841076e0 msgr2=0x7f30841998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:57.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.708+0000 7f3083fff640 1 --2- 172.21.15.78:0/2636222804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30841076e0 0x7f30841998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.708+0000 7f3083fff640 1 -- 172.21.15.78:0/2636222804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3084101cd0 msgr2=0x7f3084199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:57.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.708+0000 7f3083fff640 1 --2- 172.21.15.78:0/2636222804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3084101cd0 0x7f3084199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.708+0000 7f3083fff640 1 -- 172.21.15.78:0/2636222804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f308419f410 con 0x7f3084108060 2024-09-11T00:14:57.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.708+0000 7f30837fe640 1 --2- 172.21.15.78:0/2636222804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3084101cd0 0x7f3084199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:14:57.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.708+0000 7f3083fff640 1 --2- 172.21.15.78:0/2636222804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3084108060 0x7f308419ec40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f307c005cc0 tx=0x7f307c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:57.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.709+0000 7f30817fa640 1 -- 172.21.15.78:0/2636222804 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c003bf0 con 0x7f3084108060 2024-09-11T00:14:57.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.709+0000 7f30817fa640 1 -- 172.21.15.78:0/2636222804 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f307c003d90 con 0x7f3084108060 2024-09-11T00:14:57.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.709+0000 7f3089c01640 1 -- 172.21.15.78:0/2636222804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f308419f6a0 con 0x7f3084108060 2024-09-11T00:14:57.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.709+0000 7f30817fa640 1 -- 172.21.15.78:0/2636222804 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c02fbc0 con 0x7f3084108060 2024-09-11T00:14:57.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.709+0000 7f3089c01640 1 -- 172.21.15.78:0/2636222804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30841a5dc0 con 0x7f3084108060 2024-09-11T00:14:57.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.710+0000 7f3089c01640 1 -- 172.21.15.78:0/2636222804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30841020b0 con 0x7f3084108060 2024-09-11T00:14:57.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.711+0000 7f30817fa640 1 -- 172.21.15.78:0/2636222804 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f307c004610 con 0x7f3084108060 2024-09-11T00:14:57.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.712+0000 7f30817fa640 1 --2- 172.21.15.78:0/2636222804 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f30700b53c0 0x7f30700b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:57.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.712+0000 7f30837fe640 1 --2- 172.21.15.78:0/2636222804 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f30700b53c0 0x7f30700b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:57.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.712+0000 7f30817fa640 1 -- 172.21.15.78:0/2636222804 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f307c107510 con 0x7f3084108060 2024-09-11T00:14:57.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.712+0000 7f30837fe640 1 --2- 172.21.15.78:0/2636222804 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f30700b53c0 0x7f30700b7880 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f30740058c0 tx=0x7f3074005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:57.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.715+0000 7f30817fa640 1 -- 172.21.15.78:0/2636222804 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f307c0ce190 con 0x7f3084108060 2024-09-11T00:14:57.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.893+0000 7f3089c01640 1 -- 172.21.15.78:0/2636222804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f308410ae50 con 0x7f3084108060 2024-09-11T00:14:57.896 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:57 smithi078 ceph-mon[30865]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T00:14:57.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.895+0000 7f30817fa640 1 -- 172.21.15.78:0/2636222804 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+23171 (secure 0 0 0) 0x7f307c0cda90 con 0x7f3084108060 2024-09-11T00:14:57.897 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:14:57.897 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":77,"fsid":"85a53860-6fd1-11ef-bcea-c7b262605968","created":"2024-09-11T00:06:05.704745+0000","modified":"2024-09-11T00:14:56.755927+0000","last_up_change":"2024-09-11T00:13:35.307216+0000","last_in_change":"2024-09-11T00:13:12.730667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:09:47.891696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:22.345345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:24.446029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d260c219-52f2-4e7f-9188-9e66ee01dacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6803","nonce":3736366730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6805","nonce":3736366730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6809","nonce":3736366730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6807","nonce":3736366730}]},"public_addr":"172.21.15.78:6803/3736366730","cluster_addr":"172.21.15.78:6805/3736366730","heartbeat_back_addr":"172.21.15.78:6809/3736366730","heartbeat_front_addr":"172.21.15.78:6807/3736366730","state":["exists","up"]},{"osd":1,"uuid":"d0f286a2-a121-40ee-8134-67ef01b1bc9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6801","nonce":3186321784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6803","nonce":3186321784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6807","nonce":3186321784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6805","nonce":3186321784}]},"public_addr":"172.21.15.112:6801/3186321784","cluster_addr":"172.21.15.112:6803/3186321784","heartbeat_back_addr":"172.21.15.112:6807/3186321784","heartbeat_front_addr":"172.21.15.112:6805/3186321784","state":["exists","up"]},{"osd":2,"uuid":"0eadcce5-12af-4af6-9b4e-159e84454d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6801","nonce":3206386630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6803","nonce":3206386630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6807","nonce":3206386630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6805","nonce":3206386630}]},"public_addr":"172.21.15.138:6801/3206386630","cluster_addr":"172.21.15.138:6803/3206386630","heartbeat_back_addr":"172.21.15.138:6807/3206386630","heartbeat_front_addr":"172.21.15.138:6805/3206386630","state":["exists","up"]},{"osd":3,"uuid":"5f3f683d-6306-43da-8bbd-c103eca442ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6811","nonce":3832405256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6813","nonce":3832405256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6817","nonce":3832405256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6815","nonce":3832405256}]},"public_addr":"172.21.15.78:6811/3832405256","cluster_addr":"172.21.15.78:6813/3832405256","heartbeat_back_addr":"172.21.15.78:6817/3832405256","heartbeat_front_addr":"172.21.15.78:6815/3832405256","state":["exists","up"]},{"osd":4,"uuid":"4575a0a5-821e-4346-84ac-5396042b0550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6809","nonce":2650243435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6811","nonce":2650243435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6815","nonce":2650243435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6813","nonce":2650243435}]},"public_addr":"172.21.15.112:6809/2650243435","cluster_addr":"172.21.15.112:6811/2650243435","heartbeat_back_addr":"172.21.15.112:6815/2650243435","heartbeat_front_addr":"172.21.15.112:6813/2650243435","state":["exists","up"]},{"osd":5,"uuid":"e81eb98f-76eb-4da5-8047-f160888720e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6809","nonce":3033110975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6811","nonce":3033110975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6815","nonce":3033110975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6813","nonce":3033110975}]},"public_addr":"172.21.15.138:6809/3033110975","cluster_addr":"172.21.15.138:6811/3033110975","heartbeat_back_addr":"172.21.15.138:6815/3033110975","heartbeat_front_addr":"172.21.15.138:6813/3033110975","state":["exists","up"]},{"osd":6,"uuid":"7442a091-4dba-45c4-808b-7c3b97087aa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6819","nonce":477087575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6821","nonce":477087575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6825","nonce":477087575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6823","nonce":477087575}]},"public_addr":"172.21.15.78:6819/477087575","cluster_addr":"172.21.15.78:6821/477087575","heartbeat_back_addr":"172.21.15.78:6825/477087575","heartbeat_front_addr":"172.21.15.78:6823/477087575","state":["exists","up"]},{"osd":7,"uuid":"220c1f03-ace9-4dd0-a06d-485b0d2d08bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6817","nonce":1481363296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6819","nonce":1481363296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6823","nonce":1481363296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6821","nonce":1481363296}]},"public_addr":"172.21.15.112:6817/1481363296","cluster_addr":"172.21.15.112:6819/1481363296","heartbeat_back_addr":"172.21.15.112:6823/1481363296","heartbeat_front_addr":"172.21.15.112:6821/1481363296","state":["exists","up"]},{"osd":8,"uuid":"adb6edaa-9a8c-4b0b-aa6a-26dc77a3a7cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6817","nonce":2195149036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6819","nonce":2195149036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6823","nonce":2195149036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6821","nonce":2195149036}]},"public_addr":"172.21.15.138:6817/2195149036","cluster_addr":"172.21.15.138:6819/2195149036","heartbeat_back_addr":"172.21.15.138:6823/2195149036","heartbeat_front_addr":"172.21.15.138:6821/2195149036","state":["exists","up"]},{"osd":9,"uuid":"dd01f408-3712-410e-acbd-c797b7ea5058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6827","nonce":3367249449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6829","nonce":3367249449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6833","nonce":3367249449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6831","nonce":3367249449}]},"public_addr":"172.21.15.78:6827/3367249449","cluster_addr":"172.21.15.78:6829/3367249449","heartbeat_back_addr":"172.21.15.78:6833/3367249449","heartbeat_front_addr":"172.21.15.78:6831/3367249449","state":["exists","up"]},{"osd":10,"uuid":"243c6483-1b0e-49f2-b99c-116d9e9c0617","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6825","nonce":775023408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6827","nonce":775023408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6831","nonce":775023408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6829","nonce":775023408}]},"public_addr":"172.21.15.112:6825/775023408","cluster_addr":"172.21.15.112:6827/775023408","heartbeat_back_addr":"172.21.15.112:6831/775023408","heartbeat_front_addr":"172.21.15.112:6829/775023408","state":["exists","up"]},{"osd":11,"uuid":"fa20ac9e-b5f7-4b3a-bb51-31569f909609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6825","nonce":4046089012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6827","nonce":4046089012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6831","nonce":4046089012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6829","nonce":4046089012}]},"public_addr":"172.21.15.138:6825/4046089012","cluster_addr":"172.21.15.138:6827/4046089012","heartbeat_back_addr":"172.21.15.138:6831/4046089012","heartbeat_front_addr":"172.21.15.138:6829/4046089012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:08:55.896475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:20.695819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:44.785187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:10.858705+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:35.855800+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:01.353037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:27.492985+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:52.860532+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:17.946878+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:43.188966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:08.369978+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:34.192288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":8}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6801/2525199237":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/1476776463":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1949658157":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2276853910":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/4205790529":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6800/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/4286825123":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6801/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1304243506":"2024-09-12T00:06:56.062555+0000","172.21.15.78:6800/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1614270050":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6801/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1679390655":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2957982486":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6800/2525199237":"2024-09-12T00:07:55.586578+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:14:57.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.897+0000 7f3089c01640 1 -- 172.21.15.78:0/2636222804 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f30700b53c0 msgr2=0x7f30700b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:57.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.897+0000 7f3089c01640 1 --2- 172.21.15.78:0/2636222804 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f30700b53c0 0x7f30700b7880 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f30740058c0 tx=0x7f3074005850 comp rx=0 tx=0).stop 2024-09-11T00:14:57.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.897+0000 7f3089c01640 1 -- 172.21.15.78:0/2636222804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3084108060 msgr2=0x7f308419ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:57.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.897+0000 7f3089c01640 1 --2- 172.21.15.78:0/2636222804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3084108060 0x7f308419ec40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f307c005cc0 tx=0x7f307c02f380 comp rx=0 tx=0).stop 2024-09-11T00:14:57.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.897+0000 7f3089c01640 1 -- 172.21.15.78:0/2636222804 shutdown_connections 2024-09-11T00:14:57.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.897+0000 7f3089c01640 1 --2- 172.21.15.78:0/2636222804 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f30700b53c0 0x7f30700b7880 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.897+0000 7f3089c01640 1 --2- 172.21.15.78:0/2636222804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3084108060 0x7f308419ec40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.897+0000 7f3089c01640 1 --2- 172.21.15.78:0/2636222804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30841076e0 0x7f30841998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.897+0000 7f3089c01640 1 --2- 172.21.15.78:0/2636222804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3084101cd0 0x7f3084199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:57.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.897+0000 7f3089c01640 1 -- 172.21.15.78:0/2636222804 >> 172.21.15.78:0/2636222804 conn(0x7f30840fd700 msgr2=0x7f308406b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:57.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.897+0000 7f3089c01640 1 -- 172.21.15.78:0/2636222804 shutdown_connections 2024-09-11T00:14:57.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:57.897+0000 7f3089c01640 1 -- 172.21.15.78:0/2636222804 wait complete. 2024-09-11T00:14:58.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:57 smithi138 ceph-mon[35019]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T00:14:58.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:57 smithi112 ceph-mon[35627]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T00:14:58.663 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-11T00:14:58.663 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:14:58.909 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:14:59.028 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:58 smithi078 ceph-mon[30865]: pgmap v276: 97 pgs: 2 peering, 95 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.1 KiB/s wr, 4 op/s 2024-09-11T00:14:59.028 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:58 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2636222804' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:14:59.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:58 smithi138 ceph-mon[35019]: pgmap v276: 97 pgs: 2 peering, 95 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.1 KiB/s wr, 4 op/s 2024-09-11T00:14:59.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:58 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2636222804' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:14:59.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:58 smithi112 ceph-mon[35627]: pgmap v276: 97 pgs: 2 peering, 95 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.1 KiB/s wr, 4 op/s 2024-09-11T00:14:59.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:58 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2636222804' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:14:59.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.357+0000 7f851fecf640 1 -- 172.21.15.78:0/1134983053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8518108020 msgr2=0x7f851810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.357+0000 7f851fecf640 1 --2- 172.21.15.78:0/1134983053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8518108020 0x7f851810e820 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8510009ca0 tx=0x7f851002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.357+0000 7f851fecf640 1 -- 172.21.15.78:0/1134983053 shutdown_connections 2024-09-11T00:14:59.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.357+0000 7f851fecf640 1 --2- 172.21.15.78:0/1134983053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8518108020 0x7f851810e820 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.357+0000 7f851fecf640 1 --2- 172.21.15.78:0/1134983053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85181076a0 0x7f8518107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.357+0000 7f851fecf640 1 --2- 172.21.15.78:0/1134983053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8518101c90 0x7f8518102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.357+0000 7f851fecf640 1 -- 172.21.15.78:0/1134983053 >> 172.21.15.78:0/1134983053 conn(0x7f85180fd700 msgr2=0x7f85180ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.357+0000 7f851fecf640 1 -- 172.21.15.78:0/1134983053 shutdown_connections 2024-09-11T00:14:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.357+0000 7f851fecf640 1 -- 172.21.15.78:0/1134983053 wait complete. 2024-09-11T00:14:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.358+0000 7f851fecf640 1 Processor -- start 2024-09-11T00:14:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.358+0000 7f851fecf640 1 -- start start 2024-09-11T00:14:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.358+0000 7f851fecf640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8518101c90 0x7f85181991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.358+0000 7f851fecf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85181076a0 0x7f8518199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.358+0000 7f851fecf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8518108020 0x7f851819eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.358+0000 7f851fecf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8518111ca0 con 0x7f85181076a0 2024-09-11T00:14:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.358+0000 7f851fecf640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8518111b20 con 0x7f8518108020 2024-09-11T00:14:59.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.358+0000 7f851fecf640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8518111e20 con 0x7f8518101c90 2024-09-11T00:14:59.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.358+0000 7f851d46a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85181076a0 0x7f8518199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:59.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.358+0000 7f851d46a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85181076a0 0x7f8518199710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35620/0 (socket says 172.21.15.78:35620) 2024-09-11T00:14:59.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.358+0000 7f851d46a640 1 -- 172.21.15.78:0/4062854925 learned_addr learned my addr 172.21.15.78:0/4062854925 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:14:59.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.358+0000 7f851dc6b640 1 --2- 172.21.15.78:0/4062854925 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8518101c90 0x7f85181991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:59.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.358+0000 7f851e46c640 1 --2- 172.21.15.78:0/4062854925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8518108020 0x7f851819eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:59.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.359+0000 7f851d46a640 1 -- 172.21.15.78:0/4062854925 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8518101c90 msgr2=0x7f85181991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.359+0000 7f851d46a640 1 --2- 172.21.15.78:0/4062854925 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8518101c90 0x7f85181991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.359+0000 7f851d46a640 1 -- 172.21.15.78:0/4062854925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8518108020 msgr2=0x7f851819eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.359+0000 7f851d46a640 1 --2- 172.21.15.78:0/4062854925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8518108020 0x7f851819eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.359+0000 7f851d46a640 1 -- 172.21.15.78:0/4062854925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f851819f280 con 0x7f85181076a0 2024-09-11T00:14:59.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.359+0000 7f851d46a640 1 --2- 172.21.15.78:0/4062854925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85181076a0 0x7f8518199710 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f850800d770 tx=0x7f850800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:59.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.359+0000 7f850effd640 1 -- 172.21.15.78:0/4062854925 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8508017070 con 0x7f85181076a0 2024-09-11T00:14:59.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.359+0000 7f851fecf640 1 -- 172.21.15.78:0/4062854925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f851819f570 con 0x7f85181076a0 2024-09-11T00:14:59.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.359+0000 7f850effd640 1 -- 172.21.15.78:0/4062854925 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85080054d0 con 0x7f85181076a0 2024-09-11T00:14:59.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.359+0000 7f850effd640 1 -- 172.21.15.78:0/4062854925 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8508004c30 con 0x7f85181076a0 2024-09-11T00:14:59.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.359+0000 7f851fecf640 1 -- 172.21.15.78:0/4062854925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85181a5c30 con 0x7f85181076a0 2024-09-11T00:14:59.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.360+0000 7f851fecf640 1 -- 172.21.15.78:0/4062854925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8518102070 con 0x7f85181076a0 2024-09-11T00:14:59.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.361+0000 7f850effd640 1 -- 172.21.15.78:0/4062854925 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f8508004dd0 con 0x7f85181076a0 2024-09-11T00:14:59.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.362+0000 7f850effd640 1 --2- 172.21.15.78:0/4062854925 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f85040b53c0 0x7f85040b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:14:59.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.362+0000 7f851dc6b640 1 --2- 172.21.15.78:0/4062854925 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f85040b53c0 0x7f85040b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:14:59.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.362+0000 7f850effd640 1 -- 172.21.15.78:0/4062854925 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f85080e5e30 con 0x7f85181076a0 2024-09-11T00:14:59.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.363+0000 7f851dc6b640 1 --2- 172.21.15.78:0/4062854925 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f85040b53c0 0x7f85040b7880 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8514005e10 tx=0x7f8514005da0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:14:59.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.365+0000 7f850effd640 1 -- 172.21.15.78:0/4062854925 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f85080acab0 con 0x7f85181076a0 2024-09-11T00:14:59.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.546+0000 7f851fecf640 1 -- 172.21.15.78:0/4062854925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f851819a300 con 0x7f85181076a0 2024-09-11T00:14:59.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.547+0000 7f850effd640 1 -- 172.21.15.78:0/4062854925 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+23171 (secure 0 0 0) 0x7f85080ac3b0 con 0x7f85181076a0 2024-09-11T00:14:59.549 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:14:59.549 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":77,"fsid":"85a53860-6fd1-11ef-bcea-c7b262605968","created":"2024-09-11T00:06:05.704745+0000","modified":"2024-09-11T00:14:56.755927+0000","last_up_change":"2024-09-11T00:13:35.307216+0000","last_in_change":"2024-09-11T00:13:12.730667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:09:47.891696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:22.345345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:24.446029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d260c219-52f2-4e7f-9188-9e66ee01dacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6803","nonce":3736366730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6805","nonce":3736366730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6809","nonce":3736366730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6807","nonce":3736366730}]},"public_addr":"172.21.15.78:6803/3736366730","cluster_addr":"172.21.15.78:6805/3736366730","heartbeat_back_addr":"172.21.15.78:6809/3736366730","heartbeat_front_addr":"172.21.15.78:6807/3736366730","state":["exists","up"]},{"osd":1,"uuid":"d0f286a2-a121-40ee-8134-67ef01b1bc9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6801","nonce":3186321784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6803","nonce":3186321784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6807","nonce":3186321784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6805","nonce":3186321784}]},"public_addr":"172.21.15.112:6801/3186321784","cluster_addr":"172.21.15.112:6803/3186321784","heartbeat_back_addr":"172.21.15.112:6807/3186321784","heartbeat_front_addr":"172.21.15.112:6805/3186321784","state":["exists","up"]},{"osd":2,"uuid":"0eadcce5-12af-4af6-9b4e-159e84454d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6801","nonce":3206386630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6803","nonce":3206386630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6807","nonce":3206386630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6805","nonce":3206386630}]},"public_addr":"172.21.15.138:6801/3206386630","cluster_addr":"172.21.15.138:6803/3206386630","heartbeat_back_addr":"172.21.15.138:6807/3206386630","heartbeat_front_addr":"172.21.15.138:6805/3206386630","state":["exists","up"]},{"osd":3,"uuid":"5f3f683d-6306-43da-8bbd-c103eca442ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6811","nonce":3832405256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6813","nonce":3832405256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6817","nonce":3832405256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6815","nonce":3832405256}]},"public_addr":"172.21.15.78:6811/3832405256","cluster_addr":"172.21.15.78:6813/3832405256","heartbeat_back_addr":"172.21.15.78:6817/3832405256","heartbeat_front_addr":"172.21.15.78:6815/3832405256","state":["exists","up"]},{"osd":4,"uuid":"4575a0a5-821e-4346-84ac-5396042b0550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6809","nonce":2650243435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6811","nonce":2650243435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6815","nonce":2650243435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6813","nonce":2650243435}]},"public_addr":"172.21.15.112:6809/2650243435","cluster_addr":"172.21.15.112:6811/2650243435","heartbeat_back_addr":"172.21.15.112:6815/2650243435","heartbeat_front_addr":"172.21.15.112:6813/2650243435","state":["exists","up"]},{"osd":5,"uuid":"e81eb98f-76eb-4da5-8047-f160888720e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6809","nonce":3033110975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6811","nonce":3033110975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6815","nonce":3033110975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6813","nonce":3033110975}]},"public_addr":"172.21.15.138:6809/3033110975","cluster_addr":"172.21.15.138:6811/3033110975","heartbeat_back_addr":"172.21.15.138:6815/3033110975","heartbeat_front_addr":"172.21.15.138:6813/3033110975","state":["exists","up"]},{"osd":6,"uuid":"7442a091-4dba-45c4-808b-7c3b97087aa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6819","nonce":477087575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6821","nonce":477087575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6825","nonce":477087575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6823","nonce":477087575}]},"public_addr":"172.21.15.78:6819/477087575","cluster_addr":"172.21.15.78:6821/477087575","heartbeat_back_addr":"172.21.15.78:6825/477087575","heartbeat_front_addr":"172.21.15.78:6823/477087575","state":["exists","up"]},{"osd":7,"uuid":"220c1f03-ace9-4dd0-a06d-485b0d2d08bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6817","nonce":1481363296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6819","nonce":1481363296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6823","nonce":1481363296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6821","nonce":1481363296}]},"public_addr":"172.21.15.112:6817/1481363296","cluster_addr":"172.21.15.112:6819/1481363296","heartbeat_back_addr":"172.21.15.112:6823/1481363296","heartbeat_front_addr":"172.21.15.112:6821/1481363296","state":["exists","up"]},{"osd":8,"uuid":"adb6edaa-9a8c-4b0b-aa6a-26dc77a3a7cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6817","nonce":2195149036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6819","nonce":2195149036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6823","nonce":2195149036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6821","nonce":2195149036}]},"public_addr":"172.21.15.138:6817/2195149036","cluster_addr":"172.21.15.138:6819/2195149036","heartbeat_back_addr":"172.21.15.138:6823/2195149036","heartbeat_front_addr":"172.21.15.138:6821/2195149036","state":["exists","up"]},{"osd":9,"uuid":"dd01f408-3712-410e-acbd-c797b7ea5058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6827","nonce":3367249449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6829","nonce":3367249449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6833","nonce":3367249449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6831","nonce":3367249449}]},"public_addr":"172.21.15.78:6827/3367249449","cluster_addr":"172.21.15.78:6829/3367249449","heartbeat_back_addr":"172.21.15.78:6833/3367249449","heartbeat_front_addr":"172.21.15.78:6831/3367249449","state":["exists","up"]},{"osd":10,"uuid":"243c6483-1b0e-49f2-b99c-116d9e9c0617","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6825","nonce":775023408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6827","nonce":775023408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6831","nonce":775023408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6829","nonce":775023408}]},"public_addr":"172.21.15.112:6825/775023408","cluster_addr":"172.21.15.112:6827/775023408","heartbeat_back_addr":"172.21.15.112:6831/775023408","heartbeat_front_addr":"172.21.15.112:6829/775023408","state":["exists","up"]},{"osd":11,"uuid":"fa20ac9e-b5f7-4b3a-bb51-31569f909609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6825","nonce":4046089012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6827","nonce":4046089012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6831","nonce":4046089012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6829","nonce":4046089012}]},"public_addr":"172.21.15.138:6825/4046089012","cluster_addr":"172.21.15.138:6827/4046089012","heartbeat_back_addr":"172.21.15.138:6831/4046089012","heartbeat_front_addr":"172.21.15.138:6829/4046089012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:08:55.896475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:20.695819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:44.785187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:10.858705+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:35.855800+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:01.353037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:27.492985+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:52.860532+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:17.946878+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:43.188966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:08.369978+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:34.192288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":8}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6801/2525199237":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/1476776463":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1949658157":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2276853910":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/4205790529":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6800/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/4286825123":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6801/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1304243506":"2024-09-12T00:06:56.062555+0000","172.21.15.78:6800/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1614270050":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6801/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1679390655":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2957982486":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6800/2525199237":"2024-09-12T00:07:55.586578+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:14:59.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.550+0000 7f851fecf640 1 -- 172.21.15.78:0/4062854925 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f85040b53c0 msgr2=0x7f85040b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.550+0000 7f851fecf640 1 --2- 172.21.15.78:0/4062854925 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f85040b53c0 0x7f85040b7880 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8514005e10 tx=0x7f8514005da0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.550+0000 7f851fecf640 1 -- 172.21.15.78:0/4062854925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85181076a0 msgr2=0x7f8518199710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:14:59.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.550+0000 7f851fecf640 1 --2- 172.21.15.78:0/4062854925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85181076a0 0x7f8518199710 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f850800d770 tx=0x7f850800dc30 comp rx=0 tx=0).stop 2024-09-11T00:14:59.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.550+0000 7f851fecf640 1 -- 172.21.15.78:0/4062854925 shutdown_connections 2024-09-11T00:14:59.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.550+0000 7f851fecf640 1 --2- 172.21.15.78:0/4062854925 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f85040b53c0 0x7f85040b7880 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.550+0000 7f851fecf640 1 --2- 172.21.15.78:0/4062854925 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8518108020 0x7f851819eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.550+0000 7f851fecf640 1 --2- 172.21.15.78:0/4062854925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85181076a0 0x7f8518199710 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.550+0000 7f851fecf640 1 --2- 172.21.15.78:0/4062854925 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8518101c90 0x7f85181991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:14:59.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.550+0000 7f851fecf640 1 -- 172.21.15.78:0/4062854925 >> 172.21.15.78:0/4062854925 conn(0x7f85180fd700 msgr2=0x7f851806acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:14:59.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.550+0000 7f851fecf640 1 -- 172.21.15.78:0/4062854925 shutdown_connections 2024-09-11T00:14:59.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:14:59.550+0000 7f851fecf640 1 -- 172.21.15.78:0/4062854925 wait complete. 2024-09-11T00:14:59.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:14:59 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/4062854925' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:15:00.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:14:59 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/4062854925' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:15:00.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:14:59 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/4062854925' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:15:00.347 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-11T00:15:00.347 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-11T00:15:00.348 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-11T00:15:00.348 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-11T00:15:00.349 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-11T00:15:00.349 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-11T00:15:00.350 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-11T00:15:00.350 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-11T00:15:00.351 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-11T00:15:00.351 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-11T00:15:00.352 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-11T00:15:00.352 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-11T00:15:00.864 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:01.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:00 smithi138 ceph-mon[35019]: pgmap v277: 97 pgs: 2 peering, 95 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 1.1 KiB/s wr, 1 op/s 2024-09-11T00:15:01.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:00 smithi078 ceph-mon[30865]: pgmap v277: 97 pgs: 2 peering, 95 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 1.1 KiB/s wr, 1 op/s 2024-09-11T00:15:01.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:00 smithi112 ceph-mon[35627]: pgmap v277: 97 pgs: 2 peering, 95 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 1.1 KiB/s wr, 1 op/s 2024-09-11T00:15:01.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.442+0000 7eff471dc640 1 -- 172.21.15.78:0/2255032541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff40108020 msgr2=0x7eff4010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:01.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.442+0000 7eff471dc640 1 --2- 172.21.15.78:0/2255032541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff40108020 0x7eff4010e820 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7eff38009ca0 tx=0x7eff3802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.442+0000 7eff471dc640 1 -- 172.21.15.78:0/2255032541 shutdown_connections 2024-09-11T00:15:01.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.442+0000 7eff471dc640 1 --2- 172.21.15.78:0/2255032541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff40108020 0x7eff4010e820 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.442+0000 7eff471dc640 1 --2- 172.21.15.78:0/2255032541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff401076a0 0x7eff40107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.442+0000 7eff471dc640 1 --2- 172.21.15.78:0/2255032541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff40101c90 0x7eff40102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.442+0000 7eff471dc640 1 -- 172.21.15.78:0/2255032541 >> 172.21.15.78:0/2255032541 conn(0x7eff400fd700 msgr2=0x7eff400ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:01.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.442+0000 7eff471dc640 1 -- 172.21.15.78:0/2255032541 shutdown_connections 2024-09-11T00:15:01.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.442+0000 7eff471dc640 1 -- 172.21.15.78:0/2255032541 wait complete. 2024-09-11T00:15:01.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.442+0000 7eff471dc640 1 Processor -- start 2024-09-11T00:15:01.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.442+0000 7eff471dc640 1 -- start start 2024-09-11T00:15:01.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.443+0000 7eff471dc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff40101c90 0x7eff4019a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:01.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.443+0000 7eff471dc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff401076a0 0x7eff4019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:01.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.443+0000 7eff471dc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff40108020 0x7eff4019ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:01.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.443+0000 7eff471dc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7eff40111d20 con 0x7eff40108020 2024-09-11T00:15:01.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.443+0000 7eff471dc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7eff40111ba0 con 0x7eff401076a0 2024-09-11T00:15:01.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.443+0000 7eff471dc640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7eff40111ea0 con 0x7eff40101c90 2024-09-11T00:15:01.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.443+0000 7eff45779640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff40108020 0x7eff4019ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:01.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.443+0000 7eff45779640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff40108020 0x7eff4019ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35646/0 (socket says 172.21.15.78:35646) 2024-09-11T00:15:01.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.443+0000 7eff45779640 1 -- 172.21.15.78:0/887667147 learned_addr learned my addr 172.21.15.78:0/887667147 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:01.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.443+0000 7eff3ffff640 1 --2- 172.21.15.78:0/887667147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff401076a0 0x7eff4019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.443+0000 7eff44f78640 1 --2- 172.21.15.78:0/887667147 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff40101c90 0x7eff4019a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.443+0000 7eff45779640 1 -- 172.21.15.78:0/887667147 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff40101c90 msgr2=0x7eff4019a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.443+0000 7eff45779640 1 --2- 172.21.15.78:0/887667147 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff40101c90 0x7eff4019a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.443+0000 7eff45779640 1 -- 172.21.15.78:0/887667147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff401076a0 msgr2=0x7eff4019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.443+0000 7eff45779640 1 --2- 172.21.15.78:0/887667147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff401076a0 0x7eff4019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.443+0000 7eff45779640 1 -- 172.21.15.78:0/887667147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff401a5590 con 0x7eff40108020 2024-09-11T00:15:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.443+0000 7eff3ffff640 1 --2- 172.21.15.78:0/887667147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff401076a0 0x7eff4019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.443+0000 7eff45779640 1 --2- 172.21.15.78:0/887667147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff40108020 0x7eff4019ac50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7eff38005cc0 tx=0x7eff3802f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:01.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.443+0000 7eff3dffb640 1 -- 172.21.15.78:0/887667147 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38003cf0 con 0x7eff40108020 2024-09-11T00:15:01.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.443+0000 7eff3dffb640 1 -- 172.21.15.78:0/887667147 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff380044f0 con 0x7eff40108020 2024-09-11T00:15:01.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.443+0000 7eff471dc640 1 -- 172.21.15.78:0/887667147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff401a5820 con 0x7eff40108020 2024-09-11T00:15:01.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.443+0000 7eff3dffb640 1 -- 172.21.15.78:0/887667147 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3802fd10 con 0x7eff40108020 2024-09-11T00:15:01.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.444+0000 7eff471dc640 1 -- 172.21.15.78:0/887667147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff401a5de0 con 0x7eff40108020 2024-09-11T00:15:01.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.444+0000 7eff471dc640 1 -- 172.21.15.78:0/887667147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff400638a0 con 0x7eff40108020 2024-09-11T00:15:01.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.446+0000 7eff3dffb640 1 -- 172.21.15.78:0/887667147 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7eff38004040 con 0x7eff40108020 2024-09-11T00:15:01.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.447+0000 7eff3dffb640 1 --2- 172.21.15.78:0/887667147 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7eff300b53c0 0x7eff300b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:01.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.447+0000 7eff44f78640 1 --2- 172.21.15.78:0/887667147 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7eff300b53c0 0x7eff300b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:01.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.447+0000 7eff3dffb640 1 -- 172.21.15.78:0/887667147 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7eff38107760 con 0x7eff40108020 2024-09-11T00:15:01.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.447+0000 7eff3dffb640 1 --2- 172.21.15.78:0/887667147 >> [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730] conn(0x7eff300bf160 0x7eff300c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:01.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.447+0000 7eff3dffb640 1 -- 172.21.15.78:0/887667147 --> [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff38046e70 con 0x7eff300bf160 2024-09-11T00:15:01.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.447+0000 7eff3dffb640 1 -- 172.21.15.78:0/887667147 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7eff38107bb0 con 0x7eff40108020 2024-09-11T00:15:01.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.447+0000 7eff3ffff640 1 --2- 172.21.15.78:0/887667147 >> [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730] conn(0x7eff300bf160 0x7eff300c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:01.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.447+0000 7eff44f78640 1 --2- 172.21.15.78:0/887667147 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7eff300b53c0 0x7eff300b7880 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7eff34009890 tx=0x7eff34008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:01.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.447+0000 7eff3ffff640 1 --2- 172.21.15.78:0/887667147 >> [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730] conn(0x7eff300bf160 0x7eff300c1600 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:01.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.448+0000 7eff3dffb640 1 -- 172.21.15.78:0/887667147 <== osd.0 v2:172.21.15.78:6802/3736366730 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff38046e70 con 0x7eff300bf160 2024-09-11T00:15:01.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.461+0000 7eff471dc640 1 -- 172.21.15.78:0/887667147 --> [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7eff40063d20 con 0x7eff300bf160 2024-09-11T00:15:01.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.462+0000 7eff3dffb640 1 -- 172.21.15.78:0/887667147 <== osd.0 v2:172.21.15.78:6802/3736366730 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7eff40063d20 con 0x7eff300bf160 2024-09-11T00:15:01.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.462+0000 7eff471dc640 1 -- 172.21.15.78:0/887667147 >> [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730] conn(0x7eff300bf160 msgr2=0x7eff300c1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:01.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.462+0000 7eff471dc640 1 --2- 172.21.15.78:0/887667147 >> [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730] conn(0x7eff300bf160 0x7eff300c1600 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:01.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.462+0000 7eff471dc640 1 -- 172.21.15.78:0/887667147 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7eff300b53c0 msgr2=0x7eff300b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.462+0000 7eff471dc640 1 --2- 172.21.15.78:0/887667147 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7eff300b53c0 0x7eff300b7880 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7eff34009890 tx=0x7eff34008040 comp rx=0 tx=0).stop 2024-09-11T00:15:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.462+0000 7eff471dc640 1 -- 172.21.15.78:0/887667147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff40108020 msgr2=0x7eff4019ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.462+0000 7eff471dc640 1 --2- 172.21.15.78:0/887667147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff40108020 0x7eff4019ac50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7eff38005cc0 tx=0x7eff3802f470 comp rx=0 tx=0).stop 2024-09-11T00:15:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.462+0000 7eff45779640 1 -- 172.21.15.78:0/887667147 reap_dead start 2024-09-11T00:15:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.462+0000 7eff471dc640 1 -- 172.21.15.78:0/887667147 shutdown_connections 2024-09-11T00:15:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.462+0000 7eff471dc640 1 -- 172.21.15.78:0/887667147 >> 172.21.15.78:0/887667147 conn(0x7eff400fd700 msgr2=0x7eff400ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.462+0000 7eff471dc640 1 -- 172.21.15.78:0/887667147 shutdown_connections 2024-09-11T00:15:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:01.462+0000 7eff471dc640 1 -- 172.21.15.78:0/887667147 wait complete. 2024-09-11T00:15:02.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:01 smithi078 ceph-mon[30865]: pgmap v278: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 2 op/s; 17 B/s, 0 objects/s recovering 2024-09-11T00:15:02.195 INFO:teuthology.orchestra.run.smithi078.stdout:38654705739 2024-09-11T00:15:02.196 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-11T00:15:02.222 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:02.226 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:02.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:01 smithi112 ceph-mon[35627]: pgmap v278: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 2 op/s; 17 B/s, 0 objects/s recovering 2024-09-11T00:15:02.232 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:01 smithi138 ceph-mon[35019]: pgmap v278: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 2 op/s; 17 B/s, 0 objects/s recovering 2024-09-11T00:15:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:02.314 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:02.543 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:02.543 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:02.544 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:02.546 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:03.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.439+0000 7f14f4823640 1 -- 172.21.15.78:0/3717760427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14f0109130 msgr2=0x7f14f010f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:03.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.439+0000 7f14f4823640 1 --2- 172.21.15.78:0/3717760427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14f0109130 0x7f14f010f930 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f14e8009ca0 tx=0x7f14e802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:03.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.439+0000 7f14f4823640 1 -- 172.21.15.78:0/3717760427 shutdown_connections 2024-09-11T00:15:03.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.439+0000 7f14f4823640 1 --2- 172.21.15.78:0/3717760427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14f0109130 0x7f14f010f930 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:03.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.439+0000 7f14f4823640 1 --2- 172.21.15.78:0/3717760427 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14f01087b0 0x7f14f0108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:03.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.439+0000 7f14f4823640 1 --2- 172.21.15.78:0/3717760427 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14f0102da0 0x7f14f0103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:03.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.439+0000 7f14f4823640 1 -- 172.21.15.78:0/3717760427 >> 172.21.15.78:0/3717760427 conn(0x7f14f00fe850 msgr2=0x7f14f0100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:03.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.439+0000 7f14f4823640 1 -- 172.21.15.78:0/3717760427 shutdown_connections 2024-09-11T00:15:03.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.439+0000 7f14f4823640 1 -- 172.21.15.78:0/3717760427 wait complete. 2024-09-11T00:15:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.440+0000 7f14f4823640 1 Processor -- start 2024-09-11T00:15:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.440+0000 7f14f4823640 1 -- start start 2024-09-11T00:15:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.440+0000 7f14f4823640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14f0102da0 0x7f14f019b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.440+0000 7f14f4823640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14f01087b0 0x7f14f019b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.440+0000 7f14f4823640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14f0109130 0x7f14f01a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.440+0000 7f14f4823640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f14f0112df0 con 0x7f14f0109130 2024-09-11T00:15:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.440+0000 7f14f4823640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f14f0112c70 con 0x7f14f0102da0 2024-09-11T00:15:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.440+0000 7f14f4823640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f14f0112f70 con 0x7f14f01087b0 2024-09-11T00:15:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.440+0000 7f14eed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14f0109130 0x7f14f01a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.440+0000 7f14eed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14f0109130 0x7f14f01a0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35666/0 (socket says 172.21.15.78:35666) 2024-09-11T00:15:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.440+0000 7f14eed9d640 1 -- 172.21.15.78:0/4242613291 learned_addr learned my addr 172.21.15.78:0/4242613291 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:03.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.440+0000 7f14ee59c640 1 --2- 172.21.15.78:0/4242613291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14f0102da0 0x7f14f019b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:03.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.440+0000 7f14edd9b640 1 --2- 172.21.15.78:0/4242613291 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14f01087b0 0x7f14f019b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:03.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.441+0000 7f14eed9d640 1 -- 172.21.15.78:0/4242613291 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14f01087b0 msgr2=0x7f14f019b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:03.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.441+0000 7f14eed9d640 1 --2- 172.21.15.78:0/4242613291 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14f01087b0 0x7f14f019b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:03.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.441+0000 7f14eed9d640 1 -- 172.21.15.78:0/4242613291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14f0102da0 msgr2=0x7f14f019b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:03.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.441+0000 7f14eed9d640 1 --2- 172.21.15.78:0/4242613291 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14f0102da0 0x7f14f019b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:03.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.441+0000 7f14eed9d640 1 -- 172.21.15.78:0/4242613291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f01a14f0 con 0x7f14f0109130 2024-09-11T00:15:03.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.441+0000 7f14eed9d640 1 --2- 172.21.15.78:0/4242613291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14f0109130 0x7f14f01a0d20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f14e8005cc0 tx=0x7f14e802f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:03.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.441+0000 7f14e77fe640 1 -- 172.21.15.78:0/4242613291 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e8003cf0 con 0x7f14f0109130 2024-09-11T00:15:03.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.441+0000 7f14f4823640 1 -- 172.21.15.78:0/4242613291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f01a1780 con 0x7f14f0109130 2024-09-11T00:15:03.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.441+0000 7f14e77fe640 1 -- 172.21.15.78:0/4242613291 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14e80044f0 con 0x7f14f0109130 2024-09-11T00:15:03.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.441+0000 7f14e77fe640 1 -- 172.21.15.78:0/4242613291 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e802fc30 con 0x7f14f0109130 2024-09-11T00:15:03.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.441+0000 7f14f4823640 1 -- 172.21.15.78:0/4242613291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f01a7f20 con 0x7f14f0109130 2024-09-11T00:15:03.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.442+0000 7f14f4823640 1 -- 172.21.15.78:0/4242613291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f14f00638e0 con 0x7f14f0109130 2024-09-11T00:15:03.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.443+0000 7f14e77fe640 1 -- 172.21.15.78:0/4242613291 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f14e8004040 con 0x7f14f0109130 2024-09-11T00:15:03.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.444+0000 7f14e77fe640 1 --2- 172.21.15.78:0/4242613291 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f14dc0b53c0 0x7f14dc0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:03.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.444+0000 7f14ee59c640 1 --2- 172.21.15.78:0/4242613291 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f14dc0b53c0 0x7f14dc0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:03.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.444+0000 7f14e77fe640 1 -- 172.21.15.78:0/4242613291 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f14e8107600 con 0x7f14f0109130 2024-09-11T00:15:03.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.445+0000 7f14e77fe640 1 --2- 172.21.15.78:0/4242613291 >> [v2:172.21.15.138:6824/4046089012,v1:172.21.15.138:6825/4046089012] conn(0x7f14dc0bf160 0x7f14dc0c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:03.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.445+0000 7f14e77fe640 1 -- 172.21.15.78:0/4242613291 --> [v2:172.21.15.138:6824/4046089012,v1:172.21.15.138:6825/4046089012] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14e803fec0 con 0x7f14dc0bf160 2024-09-11T00:15:03.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.445+0000 7f14e77fe640 1 -- 172.21.15.78:0/4242613291 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f14e8107a50 con 0x7f14f0109130 2024-09-11T00:15:03.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.445+0000 7f14ee59c640 1 --2- 172.21.15.78:0/4242613291 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f14dc0b53c0 0x7f14dc0b7880 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f14e000abe0 tx=0x7f14e000a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:03.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.445+0000 7f14edd9b640 1 --2- 172.21.15.78:0/4242613291 >> [v2:172.21.15.138:6824/4046089012,v1:172.21.15.138:6825/4046089012] conn(0x7f14dc0bf160 0x7f14dc0c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:03.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.445+0000 7f14edd9b640 1 --2- 172.21.15.78:0/4242613291 >> [v2:172.21.15.138:6824/4046089012,v1:172.21.15.138:6825/4046089012] conn(0x7f14dc0bf160 0x7f14dc0c1600 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:03.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.446+0000 7f14e77fe640 1 -- 172.21.15.78:0/4242613291 <== osd.11 v2:172.21.15.138:6824/4046089012 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f14e803fec0 con 0x7f14dc0bf160 2024-09-11T00:15:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.459+0000 7f14f4823640 1 -- 172.21.15.78:0/4242613291 --> [v2:172.21.15.138:6824/4046089012,v1:172.21.15.138:6825/4046089012] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f14f0063d60 con 0x7f14dc0bf160 2024-09-11T00:15:03.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.460+0000 7f14e77fe640 1 -- 172.21.15.78:0/4242613291 <== osd.11 v2:172.21.15.138:6824/4046089012 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f14f0063d60 con 0x7f14dc0bf160 2024-09-11T00:15:03.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.460+0000 7f14f4823640 1 -- 172.21.15.78:0/4242613291 >> [v2:172.21.15.138:6824/4046089012,v1:172.21.15.138:6825/4046089012] conn(0x7f14dc0bf160 msgr2=0x7f14dc0c1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:03.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.460+0000 7f14f4823640 1 --2- 172.21.15.78:0/4242613291 >> [v2:172.21.15.138:6824/4046089012,v1:172.21.15.138:6825/4046089012] conn(0x7f14dc0bf160 0x7f14dc0c1600 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:03.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.460+0000 7f14f4823640 1 -- 172.21.15.78:0/4242613291 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f14dc0b53c0 msgr2=0x7f14dc0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:03.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.460+0000 7f14f4823640 1 --2- 172.21.15.78:0/4242613291 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f14dc0b53c0 0x7f14dc0b7880 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f14e000abe0 tx=0x7f14e000a2d0 comp rx=0 tx=0).stop 2024-09-11T00:15:03.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.460+0000 7f14f4823640 1 -- 172.21.15.78:0/4242613291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14f0109130 msgr2=0x7f14f01a0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:03.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.460+0000 7f14f4823640 1 --2- 172.21.15.78:0/4242613291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14f0109130 0x7f14f01a0d20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f14e8005cc0 tx=0x7f14e802f470 comp rx=0 tx=0).stop 2024-09-11T00:15:03.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.460+0000 7f14eed9d640 1 -- 172.21.15.78:0/4242613291 reap_dead start 2024-09-11T00:15:03.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.460+0000 7f14f4823640 1 -- 172.21.15.78:0/4242613291 shutdown_connections 2024-09-11T00:15:03.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.460+0000 7f14f4823640 1 -- 172.21.15.78:0/4242613291 >> 172.21.15.78:0/4242613291 conn(0x7f14f00fe850 msgr2=0x7f14f0101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:03.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.461+0000 7f14f4823640 1 -- 172.21.15.78:0/4242613291 shutdown_connections 2024-09-11T00:15:03.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:03.461+0000 7f14f4823640 1 -- 172.21.15.78:0/4242613291 wait complete. 2024-09-11T00:15:04.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.084+0000 7f44e3713640 1 -- 172.21.15.78:0/3262601079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44dc108020 msgr2=0x7f44dc10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:04.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.084+0000 7f44e3713640 1 --2- 172.21.15.78:0/3262601079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44dc108020 0x7f44dc10e820 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f44d4009860 tx=0x7f44d402a340 comp rx=0 tx=0).stop 2024-09-11T00:15:04.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.084+0000 7f44e3713640 1 -- 172.21.15.78:0/3262601079 shutdown_connections 2024-09-11T00:15:04.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.084+0000 7f44e3713640 1 --2- 172.21.15.78:0/3262601079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44dc108020 0x7f44dc10e820 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.084+0000 7f44e3713640 1 --2- 172.21.15.78:0/3262601079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44dc1076a0 0x7f44dc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.084+0000 7f44e3713640 1 --2- 172.21.15.78:0/3262601079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44dc101c90 0x7f44dc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.084+0000 7f44e3713640 1 -- 172.21.15.78:0/3262601079 >> 172.21.15.78:0/3262601079 conn(0x7f44dc0fd700 msgr2=0x7f44dc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:04.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.084+0000 7f44e3713640 1 -- 172.21.15.78:0/3262601079 shutdown_connections 2024-09-11T00:15:04.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.084+0000 7f44e3713640 1 -- 172.21.15.78:0/3262601079 wait complete. 2024-09-11T00:15:04.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.085+0000 7f44e3713640 1 Processor -- start 2024-09-11T00:15:04.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.085+0000 7f44e3713640 1 -- start start 2024-09-11T00:15:04.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.085+0000 7f44e3713640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44dc101c90 0x7f44dc19a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:04.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.085+0000 7f44e3713640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44dc1076a0 0x7f44dc19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:04.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.085+0000 7f44e3713640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44dc108020 0x7f44dc19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:04.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.085+0000 7f44e3713640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc111ca0 con 0x7f44dc1076a0 2024-09-11T00:15:04.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.085+0000 7f44e3713640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc111b20 con 0x7f44dc108020 2024-09-11T00:15:04.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.085+0000 7f44e3713640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc111e20 con 0x7f44dc101c90 2024-09-11T00:15:04.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.085+0000 7f44e0cae640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44dc1076a0 0x7f44dc19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:04.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.085+0000 7f44e0cae640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44dc1076a0 0x7f44dc19a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35686/0 (socket says 172.21.15.78:35686) 2024-09-11T00:15:04.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.085+0000 7f44e0cae640 1 -- 172.21.15.78:0/2373039344 learned_addr learned my addr 172.21.15.78:0/2373039344 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:04.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.085+0000 7f44e14af640 1 --2- 172.21.15.78:0/2373039344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44dc101c90 0x7f44dc19a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:04.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.086+0000 7f44e1cb0640 1 --2- 172.21.15.78:0/2373039344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44dc108020 0x7f44dc19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:04.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.086+0000 7f44e0cae640 1 -- 172.21.15.78:0/2373039344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44dc101c90 msgr2=0x7f44dc19a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:04.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.086+0000 7f44e0cae640 1 --2- 172.21.15.78:0/2373039344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44dc101c90 0x7f44dc19a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.086+0000 7f44e0cae640 1 -- 172.21.15.78:0/2373039344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44dc108020 msgr2=0x7f44dc19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:04.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.086+0000 7f44e0cae640 1 --2- 172.21.15.78:0/2373039344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44dc108020 0x7f44dc19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.086+0000 7f44e0cae640 1 -- 172.21.15.78:0/2373039344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44dc197e80 con 0x7f44dc1076a0 2024-09-11T00:15:04.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.086+0000 7f44e1cb0640 1 --2- 172.21.15.78:0/2373039344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f44dc108020 0x7f44dc19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:04.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.086+0000 7f44e0cae640 1 --2- 172.21.15.78:0/2373039344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44dc1076a0 0x7f44dc19a5d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f44d000e9f0 tx=0x7f44d000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:04.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.086+0000 7f44da7fc640 1 -- 172.21.15.78:0/2373039344 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d000cd80 con 0x7f44dc1076a0 2024-09-11T00:15:04.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.086+0000 7f44da7fc640 1 -- 172.21.15.78:0/2373039344 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44d00054d0 con 0x7f44dc1076a0 2024-09-11T00:15:04.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.086+0000 7f44e3713640 1 -- 172.21.15.78:0/2373039344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44dc198170 con 0x7f44dc1076a0 2024-09-11T00:15:04.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.086+0000 7f44da7fc640 1 -- 172.21.15.78:0/2373039344 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d0010690 con 0x7f44dc1076a0 2024-09-11T00:15:04.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.086+0000 7f44e3713640 1 -- 172.21.15.78:0/2373039344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44dc1986b0 con 0x7f44dc1076a0 2024-09-11T00:15:04.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.087+0000 7f44e3713640 1 -- 172.21.15.78:0/2373039344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f44c8001060 con 0x7f44dc1076a0 2024-09-11T00:15:04.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.089+0000 7f44da7fc640 1 -- 172.21.15.78:0/2373039344 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f44d00046c0 con 0x7f44dc1076a0 2024-09-11T00:15:04.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.089+0000 7f44da7fc640 1 --2- 172.21.15.78:0/2373039344 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f44c40b5440 0x7f44c40b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:04.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.089+0000 7f44e14af640 1 --2- 172.21.15.78:0/2373039344 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f44c40b5440 0x7f44c40b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:04.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.089+0000 7f44da7fc640 1 -- 172.21.15.78:0/2373039344 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f44d00e6480 con 0x7f44dc1076a0 2024-09-11T00:15:04.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.090+0000 7f44da7fc640 1 --2- 172.21.15.78:0/2373039344 >> [v2:172.21.15.138:6816/2195149036,v1:172.21.15.138:6817/2195149036] conn(0x7f44c40bf1e0 0x7f44c40c1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:04.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.090+0000 7f44da7fc640 1 -- 172.21.15.78:0/2373039344 --> [v2:172.21.15.138:6816/2195149036,v1:172.21.15.138:6817/2195149036] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f44d0015e80 con 0x7f44c40bf1e0 2024-09-11T00:15:04.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.090+0000 7f44da7fc640 1 -- 172.21.15.78:0/2373039344 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f44d00e68d0 con 0x7f44dc1076a0 2024-09-11T00:15:04.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.090+0000 7f44e14af640 1 --2- 172.21.15.78:0/2373039344 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f44c40b5440 0x7f44c40b7900 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f44cc005fd0 tx=0x7f44cc010040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:04.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.090+0000 7f44e1cb0640 1 --2- 172.21.15.78:0/2373039344 >> [v2:172.21.15.138:6816/2195149036,v1:172.21.15.138:6817/2195149036] conn(0x7f44c40bf1e0 0x7f44c40c1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:04.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.090+0000 7f44e1cb0640 1 --2- 172.21.15.78:0/2373039344 >> [v2:172.21.15.138:6816/2195149036,v1:172.21.15.138:6817/2195149036] conn(0x7f44c40bf1e0 0x7f44c40c1680 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:04.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.091+0000 7f44da7fc640 1 -- 172.21.15.78:0/2373039344 <== osd.8 v2:172.21.15.138:6816/2195149036 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f44d0015e80 con 0x7f44c40bf1e0 2024-09-11T00:15:04.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.104+0000 7f44e3713640 1 -- 172.21.15.78:0/2373039344 --> [v2:172.21.15.138:6816/2195149036,v1:172.21.15.138:6817/2195149036] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f44c8002e00 con 0x7f44c40bf1e0 2024-09-11T00:15:04.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.105+0000 7f44da7fc640 1 -- 172.21.15.78:0/2373039344 <== osd.8 v2:172.21.15.138:6816/2195149036 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f44c8002e00 con 0x7f44c40bf1e0 2024-09-11T00:15:04.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.105+0000 7f44e3713640 1 -- 172.21.15.78:0/2373039344 >> [v2:172.21.15.138:6816/2195149036,v1:172.21.15.138:6817/2195149036] conn(0x7f44c40bf1e0 msgr2=0x7f44c40c1680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:04.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.105+0000 7f44e3713640 1 --2- 172.21.15.78:0/2373039344 >> [v2:172.21.15.138:6816/2195149036,v1:172.21.15.138:6817/2195149036] conn(0x7f44c40bf1e0 0x7f44c40c1680 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.106+0000 7f44e3713640 1 -- 172.21.15.78:0/2373039344 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f44c40b5440 msgr2=0x7f44c40b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:04.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.106+0000 7f44e3713640 1 --2- 172.21.15.78:0/2373039344 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f44c40b5440 0x7f44c40b7900 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f44cc005fd0 tx=0x7f44cc010040 comp rx=0 tx=0).stop 2024-09-11T00:15:04.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.106+0000 7f44e3713640 1 -- 172.21.15.78:0/2373039344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44dc1076a0 msgr2=0x7f44dc19a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:04.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.106+0000 7f44e3713640 1 --2- 172.21.15.78:0/2373039344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44dc1076a0 0x7f44dc19a5d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f44d000e9f0 tx=0x7f44d000edf0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.106+0000 7f44e1cb0640 1 -- 172.21.15.78:0/2373039344 reap_dead start 2024-09-11T00:15:04.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.106+0000 7f44e3713640 1 -- 172.21.15.78:0/2373039344 shutdown_connections 2024-09-11T00:15:04.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.106+0000 7f44e3713640 1 -- 172.21.15.78:0/2373039344 >> 172.21.15.78:0/2373039344 conn(0x7f44dc0fd700 msgr2=0x7f44dc0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:04.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.106+0000 7f44e3713640 1 -- 172.21.15.78:0/2373039344 shutdown_connections 2024-09-11T00:15:04.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.106+0000 7f44e3713640 1 -- 172.21.15.78:0/2373039344 wait complete. 2024-09-11T00:15:04.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.487+0000 7fc8c32eb640 1 -- 172.21.15.78:0/3875735121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc108020 msgr2=0x7fc8bc10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:04.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.487+0000 7fc8c32eb640 1 --2- 172.21.15.78:0/3875735121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc108020 0x7fc8bc10e820 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4009ca0 tx=0x7fc8b402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.487+0000 7fc8c32eb640 1 -- 172.21.15.78:0/3875735121 shutdown_connections 2024-09-11T00:15:04.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.487+0000 7fc8c32eb640 1 --2- 172.21.15.78:0/3875735121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc108020 0x7fc8bc10e820 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.487+0000 7fc8c32eb640 1 --2- 172.21.15.78:0/3875735121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8bc1076a0 0x7fc8bc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.487+0000 7fc8c32eb640 1 --2- 172.21.15.78:0/3875735121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8bc101c90 0x7fc8bc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.487+0000 7fc8c32eb640 1 -- 172.21.15.78:0/3875735121 >> 172.21.15.78:0/3875735121 conn(0x7fc8bc0fd6c0 msgr2=0x7fc8bc0ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:04.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.487+0000 7fc8c32eb640 1 -- 172.21.15.78:0/3875735121 shutdown_connections 2024-09-11T00:15:04.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.487+0000 7fc8c32eb640 1 -- 172.21.15.78:0/3875735121 wait complete. 2024-09-11T00:15:04.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.488+0000 7fc8c32eb640 1 Processor -- start 2024-09-11T00:15:04.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.488+0000 7fc8c32eb640 1 -- start start 2024-09-11T00:15:04.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.488+0000 7fc8c32eb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8bc101c90 0x7fc8bc19b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:04.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.488+0000 7fc8c32eb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8bc1076a0 0x7fc8bc19bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:04.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.488+0000 7fc8c32eb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc108020 0x7fc8bc1a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:04.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.488+0000 7fc8c32eb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc111d20 con 0x7fc8bc108020 2024-09-11T00:15:04.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.488+0000 7fc8c32eb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc111ba0 con 0x7fc8bc1076a0 2024-09-11T00:15:04.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.488+0000 7fc8c32eb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc111ea0 con 0x7fc8bc101c90 2024-09-11T00:15:04.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.488+0000 7fc8c1888640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc108020 0x7fc8bc1a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:04.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.488+0000 7fc8c1888640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc108020 0x7fc8bc1a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35730/0 (socket says 172.21.15.78:35730) 2024-09-11T00:15:04.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.488+0000 7fc8c1888640 1 -- 172.21.15.78:0/1787165112 learned_addr learned my addr 172.21.15.78:0/1787165112 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:04.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.488+0000 7fc8c1087640 1 --2- 172.21.15.78:0/1787165112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8bc101c90 0x7fc8bc19b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:04.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.488+0000 7fc8c1888640 1 -- 172.21.15.78:0/1787165112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8bc101c90 msgr2=0x7fc8bc19b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:04.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.488+0000 7fc8c0886640 1 --2- 172.21.15.78:0/1787165112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8bc1076a0 0x7fc8bc19bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:04.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.488+0000 7fc8c1888640 1 --2- 172.21.15.78:0/1787165112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8bc101c90 0x7fc8bc19b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.489+0000 7fc8c1888640 1 -- 172.21.15.78:0/1787165112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8bc1076a0 msgr2=0x7fc8bc19bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:04.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.489+0000 7fc8c1888640 1 --2- 172.21.15.78:0/1787165112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8bc1076a0 0x7fc8bc19bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.489+0000 7fc8c1888640 1 -- 172.21.15.78:0/1787165112 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8bc1a16a0 con 0x7fc8bc108020 2024-09-11T00:15:04.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.489+0000 7fc8c1087640 1 --2- 172.21.15.78:0/1787165112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8bc101c90 0x7fc8bc19b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:04.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.489+0000 7fc8c1888640 1 --2- 172.21.15.78:0/1787165112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc108020 0x7fc8bc1a0ed0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4005cc0 tx=0x7fc8b402f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:04.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.489+0000 7fc8b27fc640 1 -- 172.21.15.78:0/1787165112 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4003cf0 con 0x7fc8bc108020 2024-09-11T00:15:04.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.489+0000 7fc8b27fc640 1 -- 172.21.15.78:0/1787165112 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8b40044f0 con 0x7fc8bc108020 2024-09-11T00:15:04.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.489+0000 7fc8c32eb640 1 -- 172.21.15.78:0/1787165112 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8bc1a1930 con 0x7fc8bc108020 2024-09-11T00:15:04.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.489+0000 7fc8b27fc640 1 -- 172.21.15.78:0/1787165112 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b402fd10 con 0x7fc8bc108020 2024-09-11T00:15:04.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.489+0000 7fc8c32eb640 1 -- 172.21.15.78:0/1787165112 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8bc1a80d0 con 0x7fc8bc108020 2024-09-11T00:15:04.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.490+0000 7fc8c32eb640 1 -- 172.21.15.78:0/1787165112 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc8bc06b7e0 con 0x7fc8bc108020 2024-09-11T00:15:04.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.491+0000 7fc8b27fc640 1 -- 172.21.15.78:0/1787165112 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fc8b4004040 con 0x7fc8bc108020 2024-09-11T00:15:04.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.492+0000 7fc8b27fc640 1 --2- 172.21.15.78:0/1787165112 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc8a80b53c0 0x7fc8a80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:04.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.492+0000 7fc8c1087640 1 --2- 172.21.15.78:0/1787165112 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc8a80b53c0 0x7fc8a80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:04.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.492+0000 7fc8b27fc640 1 -- 172.21.15.78:0/1787165112 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fc8b4107820 con 0x7fc8bc108020 2024-09-11T00:15:04.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.492+0000 7fc8b27fc640 1 --2- 172.21.15.78:0/1787165112 >> [v2:172.21.15.112:6824/775023408,v1:172.21.15.112:6825/775023408] conn(0x7fc8a80bf160 0x7fc8a80c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:04.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.492+0000 7fc8b27fc640 1 -- 172.21.15.78:0/1787165112 --> [v2:172.21.15.112:6824/775023408,v1:172.21.15.112:6825/775023408] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc8b404fe50 con 0x7fc8a80bf160 2024-09-11T00:15:04.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.492+0000 7fc8b27fc640 1 -- 172.21.15.78:0/1787165112 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fc8b4107c70 con 0x7fc8bc108020 2024-09-11T00:15:04.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.492+0000 7fc8c1087640 1 --2- 172.21.15.78:0/1787165112 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc8a80b53c0 0x7fc8a80b7880 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009930 tx=0x7fc8b8008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:04.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.493+0000 7fc8c0886640 1 --2- 172.21.15.78:0/1787165112 >> [v2:172.21.15.112:6824/775023408,v1:172.21.15.112:6825/775023408] conn(0x7fc8a80bf160 0x7fc8a80c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:04.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.493+0000 7fc8c0886640 1 --2- 172.21.15.78:0/1787165112 >> [v2:172.21.15.112:6824/775023408,v1:172.21.15.112:6825/775023408] conn(0x7fc8a80bf160 0x7fc8a80c1600 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:04.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.494+0000 7fc8b27fc640 1 -- 172.21.15.78:0/1787165112 <== osd.10 v2:172.21.15.112:6824/775023408 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc8b404fe50 con 0x7fc8a80bf160 2024-09-11T00:15:04.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.507+0000 7fc8c32eb640 1 -- 172.21.15.78:0/1787165112 --> [v2:172.21.15.112:6824/775023408,v1:172.21.15.112:6825/775023408] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc8bc102f40 con 0x7fc8a80bf160 2024-09-11T00:15:04.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.508+0000 7fc8b27fc640 1 -- 172.21.15.78:0/1787165112 <== osd.10 v2:172.21.15.112:6824/775023408 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc8bc102f40 con 0x7fc8a80bf160 2024-09-11T00:15:04.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.508+0000 7fc8c32eb640 1 -- 172.21.15.78:0/1787165112 >> [v2:172.21.15.112:6824/775023408,v1:172.21.15.112:6825/775023408] conn(0x7fc8a80bf160 msgr2=0x7fc8a80c1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:04.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.508+0000 7fc8c32eb640 1 --2- 172.21.15.78:0/1787165112 >> [v2:172.21.15.112:6824/775023408,v1:172.21.15.112:6825/775023408] conn(0x7fc8a80bf160 0x7fc8a80c1600 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:04.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.508+0000 7fc8c32eb640 1 -- 172.21.15.78:0/1787165112 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc8a80b53c0 msgr2=0x7fc8a80b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:04.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.508+0000 7fc8c32eb640 1 --2- 172.21.15.78:0/1787165112 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc8a80b53c0 0x7fc8a80b7880 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009930 tx=0x7fc8b8008040 comp rx=0 tx=0).stop 2024-09-11T00:15:04.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.508+0000 7fc8c32eb640 1 -- 172.21.15.78:0/1787165112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc108020 msgr2=0x7fc8bc1a0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:04.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.508+0000 7fc8c32eb640 1 --2- 172.21.15.78:0/1787165112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8bc108020 0x7fc8bc1a0ed0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4005cc0 tx=0x7fc8b402f470 comp rx=0 tx=0).stop 2024-09-11T00:15:04.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.508+0000 7fc8c1888640 1 -- 172.21.15.78:0/1787165112 reap_dead start 2024-09-11T00:15:04.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.508+0000 7fc8c32eb640 1 -- 172.21.15.78:0/1787165112 shutdown_connections 2024-09-11T00:15:04.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.508+0000 7fc8c32eb640 1 -- 172.21.15.78:0/1787165112 >> 172.21.15.78:0/1787165112 conn(0x7fc8bc0fd6c0 msgr2=0x7fc8bc104c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:04.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.508+0000 7fc8c32eb640 1 -- 172.21.15.78:0/1787165112 shutdown_connections 2024-09-11T00:15:04.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.508+0000 7fc8c32eb640 1 -- 172.21.15.78:0/1787165112 wait complete. 2024-09-11T00:15:04.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:04 smithi112 ceph-mon[35627]: pgmap v279: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 255 B/s wr, 1 op/s; 17 B/s, 0 objects/s recovering 2024-09-11T00:15:04.999 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:04 smithi078 ceph-mon[30865]: pgmap v279: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 255 B/s wr, 1 op/s; 17 B/s, 0 objects/s recovering 2024-09-11T00:15:05.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:04 smithi138 ceph-mon[35019]: pgmap v279: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 255 B/s wr, 1 op/s; 17 B/s, 0 objects/s recovering 2024-09-11T00:15:05.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.343+0000 7f7dfda60640 1 -- 172.21.15.78:0/2505718147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7df8102dc0 msgr2=0x7f7df81031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:05.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.343+0000 7f7dfda60640 1 --2- 172.21.15.78:0/2505718147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7df8102dc0 0x7f7df81031a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7de8009900 tx=0x7f7de802a410 comp rx=0 tx=0).stop 2024-09-11T00:15:05.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.343+0000 7f7dfda60640 1 -- 172.21.15.78:0/2505718147 shutdown_connections 2024-09-11T00:15:05.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.343+0000 7f7dfda60640 1 --2- 172.21.15.78:0/2505718147 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7df8109150 0x7f7df810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.343+0000 7f7dfda60640 1 --2- 172.21.15.78:0/2505718147 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7df81087d0 0x7f7df8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.343+0000 7f7dfda60640 1 --2- 172.21.15.78:0/2505718147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7df8102dc0 0x7f7df81031a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.343+0000 7f7dfda60640 1 -- 172.21.15.78:0/2505718147 >> 172.21.15.78:0/2505718147 conn(0x7f7df80fe830 msgr2=0x7f7df8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:05.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.343+0000 7f7dfda60640 1 -- 172.21.15.78:0/2505718147 shutdown_connections 2024-09-11T00:15:05.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.343+0000 7f7dfda60640 1 -- 172.21.15.78:0/2505718147 wait complete. 2024-09-11T00:15:05.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.344+0000 7f7dfda60640 1 Processor -- start 2024-09-11T00:15:05.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.344+0000 7f7dfda60640 1 -- start start 2024-09-11T00:15:05.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.344+0000 7f7dfda60640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7df8102dc0 0x7f7df8199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:05.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.344+0000 7f7dfda60640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7df81087d0 0x7f7df8199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:05.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.344+0000 7f7dfda60640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7df8109150 0x7f7df819ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:05.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.344+0000 7f7dfda60640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7df8112e10 con 0x7f7df81087d0 2024-09-11T00:15:05.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.344+0000 7f7dfda60640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7df8112c90 con 0x7f7df8109150 2024-09-11T00:15:05.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.344+0000 7f7dfda60640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7df8112f90 con 0x7f7df8102dc0 2024-09-11T00:15:05.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.344+0000 7f7deffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7df81087d0 0x7f7df8199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:05.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.344+0000 7f7deffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7df81087d0 0x7f7df8199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49282/0 (socket says 172.21.15.78:49282) 2024-09-11T00:15:05.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.344+0000 7f7deffff640 1 -- 172.21.15.78:0/107997227 learned_addr learned my addr 172.21.15.78:0/107997227 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:05.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.344+0000 7f7deffff640 1 -- 172.21.15.78:0/107997227 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7df8102dc0 msgr2=0x7f7df8199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:05.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.344+0000 7f7df6ffd640 1 --2- 172.21.15.78:0/107997227 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7df8102dc0 0x7f7df8199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:05.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.344+0000 7f7deffff640 1 --2- 172.21.15.78:0/107997227 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7df8102dc0 0x7f7df8199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.344+0000 7f7deffff640 1 -- 172.21.15.78:0/107997227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7df8109150 msgr2=0x7f7df819ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:05.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.344+0000 7f7deffff640 1 --2- 172.21.15.78:0/107997227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7df8109150 0x7f7df819ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.344+0000 7f7deffff640 1 -- 172.21.15.78:0/107997227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df819f3d0 con 0x7f7df81087d0 2024-09-11T00:15:05.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.344+0000 7f7df6ffd640 1 --2- 172.21.15.78:0/107997227 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7df8102dc0 0x7f7df8199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:05.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.344+0000 7f7deffff640 1 --2- 172.21.15.78:0/107997227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7df81087d0 0x7f7df8199860 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7de000d770 tx=0x7f7de000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:05.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.345+0000 7f7dfca5e640 1 -- 172.21.15.78:0/107997227 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de0017070 con 0x7f7df81087d0 2024-09-11T00:15:05.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.345+0000 7f7dfca5e640 1 -- 172.21.15.78:0/107997227 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7de00054d0 con 0x7f7df81087d0 2024-09-11T00:15:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.345+0000 7f7dfda60640 1 -- 172.21.15.78:0/107997227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7df819f6c0 con 0x7f7df81087d0 2024-09-11T00:15:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.345+0000 7f7dfca5e640 1 -- 172.21.15.78:0/107997227 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de0004c30 con 0x7f7df81087d0 2024-09-11T00:15:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.345+0000 7f7dfda60640 1 -- 172.21.15.78:0/107997227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7df81a5e00 con 0x7f7df81087d0 2024-09-11T00:15:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.345+0000 7f7dfda60640 1 -- 172.21.15.78:0/107997227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7df80638e0 con 0x7f7df81087d0 2024-09-11T00:15:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.347+0000 7f7dfca5e640 1 -- 172.21.15.78:0/107997227 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f7de0004dd0 con 0x7f7df81087d0 2024-09-11T00:15:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.348+0000 7f7dfca5e640 1 --2- 172.21.15.78:0/107997227 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7de40b5440 0x7f7de40b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.348+0000 7f7df6ffd640 1 --2- 172.21.15.78:0/107997227 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7de40b5440 0x7f7de40b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.348+0000 7f7dfca5e640 1 -- 172.21.15.78:0/107997227 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f7de00e5d90 con 0x7f7df81087d0 2024-09-11T00:15:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.348+0000 7f7dfca5e640 1 --2- 172.21.15.78:0/107997227 >> [v2:172.21.15.112:6808/2650243435,v1:172.21.15.112:6809/2650243435] conn(0x7f7de40bf1e0 0x7f7de40c1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.348+0000 7f7dfca5e640 1 -- 172.21.15.78:0/107997227 --> [v2:172.21.15.112:6808/2650243435,v1:172.21.15.112:6809/2650243435] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7de0021e50 con 0x7f7de40bf1e0 2024-09-11T00:15:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.348+0000 7f7dfca5e640 1 -- 172.21.15.78:0/107997227 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f7de00e61e0 con 0x7f7df81087d0 2024-09-11T00:15:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.348+0000 7f7df6ffd640 1 --2- 172.21.15.78:0/107997227 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7de40b5440 0x7f7de40b7900 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7de8000c00 tx=0x7f7de8031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.349+0000 7f7df77fe640 1 --2- 172.21.15.78:0/107997227 >> [v2:172.21.15.112:6808/2650243435,v1:172.21.15.112:6809/2650243435] conn(0x7f7de40bf1e0 0x7f7de40c1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.349+0000 7f7df77fe640 1 --2- 172.21.15.78:0/107997227 >> [v2:172.21.15.112:6808/2650243435,v1:172.21.15.112:6809/2650243435] conn(0x7f7de40bf1e0 0x7f7de40c1680 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.350+0000 7f7dfca5e640 1 -- 172.21.15.78:0/107997227 <== osd.4 v2:172.21.15.112:6808/2650243435 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7de0021e50 con 0x7f7de40bf1e0 2024-09-11T00:15:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.363+0000 7f7dfda60640 1 -- 172.21.15.78:0/107997227 --> [v2:172.21.15.112:6808/2650243435,v1:172.21.15.112:6809/2650243435] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7df8063d60 con 0x7f7de40bf1e0 2024-09-11T00:15:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.364+0000 7f7dfca5e640 1 -- 172.21.15.78:0/107997227 <== osd.4 v2:172.21.15.112:6808/2650243435 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7df8063d60 con 0x7f7de40bf1e0 2024-09-11T00:15:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.364+0000 7f7dfda60640 1 -- 172.21.15.78:0/107997227 >> [v2:172.21.15.112:6808/2650243435,v1:172.21.15.112:6809/2650243435] conn(0x7f7de40bf1e0 msgr2=0x7f7de40c1680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.364+0000 7f7dfda60640 1 --2- 172.21.15.78:0/107997227 >> [v2:172.21.15.112:6808/2650243435,v1:172.21.15.112:6809/2650243435] conn(0x7f7de40bf1e0 0x7f7de40c1680 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.364+0000 7f7dfda60640 1 -- 172.21.15.78:0/107997227 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7de40b5440 msgr2=0x7f7de40b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.364+0000 7f7dfda60640 1 --2- 172.21.15.78:0/107997227 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7de40b5440 0x7f7de40b7900 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7de8000c00 tx=0x7f7de8031400 comp rx=0 tx=0).stop 2024-09-11T00:15:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.364+0000 7f7dfda60640 1 -- 172.21.15.78:0/107997227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7df81087d0 msgr2=0x7f7df8199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.364+0000 7f7dfda60640 1 --2- 172.21.15.78:0/107997227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7df81087d0 0x7f7df8199860 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7de000d770 tx=0x7f7de000dc30 comp rx=0 tx=0).stop 2024-09-11T00:15:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.364+0000 7f7df77fe640 1 -- 172.21.15.78:0/107997227 reap_dead start 2024-09-11T00:15:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.364+0000 7f7dfda60640 1 -- 172.21.15.78:0/107997227 shutdown_connections 2024-09-11T00:15:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.364+0000 7f7dfda60640 1 -- 172.21.15.78:0/107997227 >> 172.21.15.78:0/107997227 conn(0x7f7df80fe830 msgr2=0x7f7df8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.364+0000 7f7dfda60640 1 -- 172.21.15.78:0/107997227 shutdown_connections 2024-09-11T00:15:05.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:05.364+0000 7f7dfda60640 1 -- 172.21.15.78:0/107997227 wait complete. 2024-09-11T00:15:06.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.354+0000 7f0d64497640 1 -- 172.21.15.78:0/3070063846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d5c104600 msgr2=0x7f0d5c10caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:06.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.354+0000 7f0d64497640 1 --2- 172.21.15.78:0/3070063846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d5c104600 0x7f0d5c10caf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009900 tx=0x7f0d4c02a410 comp rx=0 tx=0).stop 2024-09-11T00:15:06.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.354+0000 7f0d64497640 1 -- 172.21.15.78:0/3070063846 shutdown_connections 2024-09-11T00:15:06.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.354+0000 7f0d64497640 1 --2- 172.21.15.78:0/3070063846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d5c10d140 0x7f0d5c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.354+0000 7f0d64497640 1 --2- 172.21.15.78:0/3070063846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d5c104600 0x7f0d5c10caf0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.354+0000 7f0d64497640 1 --2- 172.21.15.78:0/3070063846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d5c103ce0 0x7f0d5c1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.354+0000 7f0d64497640 1 -- 172.21.15.78:0/3070063846 >> 172.21.15.78:0/3070063846 conn(0x7f0d5c0fd720 msgr2=0x7f0d5c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:06.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.354+0000 7f0d64497640 1 -- 172.21.15.78:0/3070063846 shutdown_connections 2024-09-11T00:15:06.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.354+0000 7f0d64497640 1 -- 172.21.15.78:0/3070063846 wait complete. 2024-09-11T00:15:06.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.355+0000 7f0d64497640 1 Processor -- start 2024-09-11T00:15:06.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.355+0000 7f0d64497640 1 -- start start 2024-09-11T00:15:06.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.355+0000 7f0d64497640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d5c103ce0 0x7f0d5c199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:06.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.355+0000 7f0d64497640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d5c104600 0x7f0d5c199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:06.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.355+0000 7f0d64497640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d5c10d140 0x7f0d5c19edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:06.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.355+0000 7f0d64497640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c112e70 con 0x7f0d5c10d140 2024-09-11T00:15:06.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.355+0000 7f0d64497640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c112cf0 con 0x7f0d5c103ce0 2024-09-11T00:15:06.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.355+0000 7f0d64497640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c112ff0 con 0x7f0d5c104600 2024-09-11T00:15:06.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.355+0000 7f0d62a34640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d5c10d140 0x7f0d5c19edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:06.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.355+0000 7f0d62a34640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d5c10d140 0x7f0d5c19edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35712/0 (socket says 172.21.15.78:35712) 2024-09-11T00:15:06.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.355+0000 7f0d62a34640 1 -- 172.21.15.78:0/4209281955 learned_addr learned my addr 172.21.15.78:0/4209281955 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:06.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.355+0000 7f0d62233640 1 --2- 172.21.15.78:0/4209281955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d5c103ce0 0x7f0d5c199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:06.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.355+0000 7f0d62a34640 1 -- 172.21.15.78:0/4209281955 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d5c104600 msgr2=0x7f0d5c199a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:06.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.355+0000 7f0d62a34640 1 --2- 172.21.15.78:0/4209281955 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d5c104600 0x7f0d5c199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.355+0000 7f0d62a34640 1 -- 172.21.15.78:0/4209281955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d5c103ce0 msgr2=0x7f0d5c199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.355+0000 7f0d62a34640 1 --2- 172.21.15.78:0/4209281955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d5c103ce0 0x7f0d5c199510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.355+0000 7f0d62a34640 1 -- 172.21.15.78:0/4209281955 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5c19f5c0 con 0x7f0d5c10d140 2024-09-11T00:15:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.355+0000 7f0d62233640 1 --2- 172.21.15.78:0/4209281955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d5c103ce0 0x7f0d5c199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.355+0000 7f0d62a34640 1 --2- 172.21.15.78:0/4209281955 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d5c10d140 0x7f0d5c19edf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0d5400b970 tx=0x7f0d5400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.356+0000 7f0d537fe640 1 -- 172.21.15.78:0/4209281955 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54019070 con 0x7f0d5c10d140 2024-09-11T00:15:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.356+0000 7f0d537fe640 1 -- 172.21.15.78:0/4209281955 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d54014440 con 0x7f0d5c10d140 2024-09-11T00:15:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.356+0000 7f0d64497640 1 -- 172.21.15.78:0/4209281955 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d5c19f8b0 con 0x7f0d5c10d140 2024-09-11T00:15:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.356+0000 7f0d537fe640 1 -- 172.21.15.78:0/4209281955 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d540075d0 con 0x7f0d5c10d140 2024-09-11T00:15:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.356+0000 7f0d64497640 1 -- 172.21.15.78:0/4209281955 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d5c1a5f70 con 0x7f0d5c10d140 2024-09-11T00:15:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.356+0000 7f0d64497640 1 -- 172.21.15.78:0/4209281955 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0d5c063860 con 0x7f0d5c10d140 2024-09-11T00:15:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.358+0000 7f0d537fe640 1 -- 172.21.15.78:0/4209281955 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f0d54026050 con 0x7f0d5c10d140 2024-09-11T00:15:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.359+0000 7f0d537fe640 1 --2- 172.21.15.78:0/4209281955 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f0d480b53c0 0x7f0d480b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.359+0000 7f0d62233640 1 --2- 172.21.15.78:0/4209281955 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f0d480b53c0 0x7f0d480b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.359+0000 7f0d537fe640 1 -- 172.21.15.78:0/4209281955 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f0d540e5c10 con 0x7f0d5c10d140 2024-09-11T00:15:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.359+0000 7f0d537fe640 1 --2- 172.21.15.78:0/4209281955 >> [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449] conn(0x7f0d480bf160 0x7f0d480c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.359+0000 7f0d537fe640 1 -- 172.21.15.78:0/4209281955 --> [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0d480c1cd0 con 0x7f0d480bf160 2024-09-11T00:15:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.359+0000 7f0d537fe640 1 -- 172.21.15.78:0/4209281955 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f0d540e6060 con 0x7f0d5c10d140 2024-09-11T00:15:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.359+0000 7f0d61a32640 1 --2- 172.21.15.78:0/4209281955 >> [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449] conn(0x7f0d480bf160 0x7f0d480c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.359+0000 7f0d62233640 1 --2- 172.21.15.78:0/4209281955 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f0d480b53c0 0x7f0d480b7880 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009930 tx=0x7f0d58008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.359+0000 7f0d61a32640 1 --2- 172.21.15.78:0/4209281955 >> [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449] conn(0x7f0d480bf160 0x7f0d480c1600 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.360+0000 7f0d537fe640 1 -- 172.21.15.78:0/4209281955 <== osd.9 v2:172.21.15.78:6826/3367249449 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0d480c1cd0 con 0x7f0d480bf160 2024-09-11T00:15:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.373+0000 7f0d64497640 1 -- 172.21.15.78:0/4209281955 --> [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0d5c063ce0 con 0x7f0d480bf160 2024-09-11T00:15:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.374+0000 7f0d537fe640 1 -- 172.21.15.78:0/4209281955 <== osd.9 v2:172.21.15.78:6826/3367249449 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0d5c063ce0 con 0x7f0d480bf160 2024-09-11T00:15:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.374+0000 7f0d64497640 1 -- 172.21.15.78:0/4209281955 >> [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449] conn(0x7f0d480bf160 msgr2=0x7f0d480c1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.374+0000 7f0d64497640 1 --2- 172.21.15.78:0/4209281955 >> [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449] conn(0x7f0d480bf160 0x7f0d480c1600 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.374+0000 7f0d64497640 1 -- 172.21.15.78:0/4209281955 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f0d480b53c0 msgr2=0x7f0d480b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.374+0000 7f0d64497640 1 --2- 172.21.15.78:0/4209281955 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f0d480b53c0 0x7f0d480b7880 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009930 tx=0x7f0d58008040 comp rx=0 tx=0).stop 2024-09-11T00:15:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.374+0000 7f0d64497640 1 -- 172.21.15.78:0/4209281955 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d5c10d140 msgr2=0x7f0d5c19edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.374+0000 7f0d64497640 1 --2- 172.21.15.78:0/4209281955 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d5c10d140 0x7f0d5c19edf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0d5400b970 tx=0x7f0d5400be30 comp rx=0 tx=0).stop 2024-09-11T00:15:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.374+0000 7f0d62a34640 1 -- 172.21.15.78:0/4209281955 reap_dead start 2024-09-11T00:15:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.374+0000 7f0d64497640 1 -- 172.21.15.78:0/4209281955 shutdown_connections 2024-09-11T00:15:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.374+0000 7f0d64497640 1 -- 172.21.15.78:0/4209281955 >> 172.21.15.78:0/4209281955 conn(0x7f0d5c0fd720 msgr2=0x7f0d5c0fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.374+0000 7f0d64497640 1 -- 172.21.15.78:0/4209281955 shutdown_connections 2024-09-11T00:15:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:04.374+0000 7f0d64497640 1 -- 172.21.15.78:0/4209281955 wait complete. 2024-09-11T00:15:06.943 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:06 smithi078 ceph-mon[30865]: pgmap v280: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 206 B/s wr, 2 op/s; 14 B/s, 0 objects/s recovering 2024-09-11T00:15:07.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:06 smithi138 ceph-mon[35019]: pgmap v280: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 206 B/s wr, 2 op/s; 14 B/s, 0 objects/s recovering 2024-09-11T00:15:07.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:06 smithi112 ceph-mon[35627]: pgmap v280: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 206 B/s wr, 2 op/s; 14 B/s, 0 objects/s recovering 2024-09-11T00:15:07.464 INFO:teuthology.orchestra.run.smithi078.stdout:249108103199 2024-09-11T00:15:07.465 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-11T00:15:07.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.617+0000 7fd69f6d7640 1 -- 172.21.15.78:0/2809536500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd698104550 msgr2=0x7fd69810cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.617+0000 7fd69f6d7640 1 --2- 172.21.15.78:0/2809536500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd698104550 0x7fd69810cb30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd688009900 tx=0x7fd68802a410 comp rx=0 tx=0).stop 2024-09-11T00:15:07.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.617+0000 7fd69f6d7640 1 -- 172.21.15.78:0/2809536500 shutdown_connections 2024-09-11T00:15:07.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.617+0000 7fd69f6d7640 1 --2- 172.21.15.78:0/2809536500 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd69810d100 0x7fd69810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.617+0000 7fd69f6d7640 1 --2- 172.21.15.78:0/2809536500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd698104550 0x7fd69810cb30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.617+0000 7fd69f6d7640 1 --2- 172.21.15.78:0/2809536500 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd698103b50 0x7fd698103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.617+0000 7fd69f6d7640 1 -- 172.21.15.78:0/2809536500 >> 172.21.15.78:0/2809536500 conn(0x7fd6980fd700 msgr2=0x7fd6980ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:07.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.617+0000 7fd69f6d7640 1 -- 172.21.15.78:0/2809536500 shutdown_connections 2024-09-11T00:15:07.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.617+0000 7fd69f6d7640 1 -- 172.21.15.78:0/2809536500 wait complete. 2024-09-11T00:15:07.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.617+0000 7fd69f6d7640 1 Processor -- start 2024-09-11T00:15:07.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.617+0000 7fd69f6d7640 1 -- start start 2024-09-11T00:15:07.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.618+0000 7fd69f6d7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd698103b50 0x7fd698199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.618+0000 7fd69f6d7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd698104550 0x7fd6981998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.618+0000 7fd69f6d7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd69810d100 0x7fd69819ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.618+0000 7fd69f6d7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd698112dc0 con 0x7fd698104550 2024-09-11T00:15:07.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.618+0000 7fd69f6d7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd698112c40 con 0x7fd69810d100 2024-09-11T00:15:07.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.618+0000 7fd69f6d7640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd698112f40 con 0x7fd698103b50 2024-09-11T00:15:07.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.618+0000 7fd69cc72640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd698104550 0x7fd6981998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.618+0000 7fd69cc72640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd698104550 0x7fd6981998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49300/0 (socket says 172.21.15.78:49300) 2024-09-11T00:15:07.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.618+0000 7fd69cc72640 1 -- 172.21.15.78:0/454237503 learned_addr learned my addr 172.21.15.78:0/454237503 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:07.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.618+0000 7fd69cc72640 1 -- 172.21.15.78:0/454237503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd698103b50 msgr2=0x7fd698199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.618+0000 7fd69cc72640 1 --2- 172.21.15.78:0/454237503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd698103b50 0x7fd698199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.618+0000 7fd69cc72640 1 -- 172.21.15.78:0/454237503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd69810d100 msgr2=0x7fd69819ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.618+0000 7fd69cc72640 1 --2- 172.21.15.78:0/454237503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd69810d100 0x7fd69819ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.618+0000 7fd69cc72640 1 -- 172.21.15.78:0/454237503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69819f420 con 0x7fd698104550 2024-09-11T00:15:07.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.618+0000 7fd69cc72640 1 --2- 172.21.15.78:0/454237503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd698104550 0x7fd6981998b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd688005940 tx=0x7fd6880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:07.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.618+0000 7fd68e7fc640 1 -- 172.21.15.78:0/454237503 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68803f030 con 0x7fd698104550 2024-09-11T00:15:07.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.618+0000 7fd68e7fc640 1 -- 172.21.15.78:0/454237503 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd688003cb0 con 0x7fd698104550 2024-09-11T00:15:07.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.618+0000 7fd69f6d7640 1 -- 172.21.15.78:0/454237503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd69819f6b0 con 0x7fd698104550 2024-09-11T00:15:07.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.618+0000 7fd68e7fc640 1 -- 172.21.15.78:0/454237503 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688035070 con 0x7fd698104550 2024-09-11T00:15:07.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.619+0000 7fd69f6d7640 1 -- 172.21.15.78:0/454237503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6981a5dd0 con 0x7fd698104550 2024-09-11T00:15:07.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.619+0000 7fd69f6d7640 1 -- 172.21.15.78:0/454237503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd6980638e0 con 0x7fd698104550 2024-09-11T00:15:07.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.621+0000 7fd68e7fc640 1 -- 172.21.15.78:0/454237503 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fd68803bbf0 con 0x7fd698104550 2024-09-11T00:15:07.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.621+0000 7fd68e7fc640 1 --2- 172.21.15.78:0/454237503 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd6840b53c0 0x7fd6840b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.622+0000 7fd69d473640 1 --2- 172.21.15.78:0/454237503 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd6840b53c0 0x7fd6840b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.622+0000 7fd68e7fc640 1 -- 172.21.15.78:0/454237503 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fd688106e10 con 0x7fd698104550 2024-09-11T00:15:07.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.622+0000 7fd68e7fc640 1 --2- 172.21.15.78:0/454237503 >> [v2:172.21.15.138:6800/3206386630,v1:172.21.15.138:6801/3206386630] conn(0x7fd6840bf160 0x7fd6840c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:07.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.622+0000 7fd68e7fc640 1 -- 172.21.15.78:0/454237503 --> [v2:172.21.15.138:6800/3206386630,v1:172.21.15.138:6801/3206386630] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6840c1cd0 con 0x7fd6840bf160 2024-09-11T00:15:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.622+0000 7fd68e7fc640 1 -- 172.21.15.78:0/454237503 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fd688107260 con 0x7fd698104550 2024-09-11T00:15:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.622+0000 7fd69d473640 1 --2- 172.21.15.78:0/454237503 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd6840b53c0 0x7fd6840b7880 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd694009710 tx=0x7fd694006c90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.622+0000 7fd69dc74640 1 --2- 172.21.15.78:0/454237503 >> [v2:172.21.15.138:6800/3206386630,v1:172.21.15.138:6801/3206386630] conn(0x7fd6840bf160 0x7fd6840c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.623+0000 7fd69dc74640 1 --2- 172.21.15.78:0/454237503 >> [v2:172.21.15.138:6800/3206386630,v1:172.21.15.138:6801/3206386630] conn(0x7fd6840bf160 0x7fd6840c1600 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.623+0000 7fd68e7fc640 1 -- 172.21.15.78:0/454237503 <== osd.2 v2:172.21.15.138:6800/3206386630 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd6840c1cd0 con 0x7fd6840bf160 2024-09-11T00:15:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.637+0000 7fd69f6d7640 1 -- 172.21.15.78:0/454237503 --> [v2:172.21.15.138:6800/3206386630,v1:172.21.15.138:6801/3206386630] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd698063d60 con 0x7fd6840bf160 2024-09-11T00:15:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.637+0000 7fd68e7fc640 1 -- 172.21.15.78:0/454237503 <== osd.2 v2:172.21.15.138:6800/3206386630 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd698063d60 con 0x7fd6840bf160 2024-09-11T00:15:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.638+0000 7fd69f6d7640 1 -- 172.21.15.78:0/454237503 >> [v2:172.21.15.138:6800/3206386630,v1:172.21.15.138:6801/3206386630] conn(0x7fd6840bf160 msgr2=0x7fd6840c1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.638+0000 7fd69f6d7640 1 --2- 172.21.15.78:0/454237503 >> [v2:172.21.15.138:6800/3206386630,v1:172.21.15.138:6801/3206386630] conn(0x7fd6840bf160 0x7fd6840c1600 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.638+0000 7fd69f6d7640 1 -- 172.21.15.78:0/454237503 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd6840b53c0 msgr2=0x7fd6840b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.638+0000 7fd69f6d7640 1 --2- 172.21.15.78:0/454237503 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd6840b53c0 0x7fd6840b7880 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd694009710 tx=0x7fd694006c90 comp rx=0 tx=0).stop 2024-09-11T00:15:07.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.638+0000 7fd69f6d7640 1 -- 172.21.15.78:0/454237503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd698104550 msgr2=0x7fd6981998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:07.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.638+0000 7fd69f6d7640 1 --2- 172.21.15.78:0/454237503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd698104550 0x7fd6981998b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd688005940 tx=0x7fd6880042f0 comp rx=0 tx=0).stop 2024-09-11T00:15:07.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.638+0000 7fd69dc74640 1 -- 172.21.15.78:0/454237503 reap_dead start 2024-09-11T00:15:07.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.638+0000 7fd69f6d7640 1 -- 172.21.15.78:0/454237503 shutdown_connections 2024-09-11T00:15:07.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.638+0000 7fd69f6d7640 1 -- 172.21.15.78:0/454237503 >> 172.21.15.78:0/454237503 conn(0x7fd6980fd700 msgr2=0x7fd6980fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:07.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.638+0000 7fd69f6d7640 1 -- 172.21.15.78:0/454237503 shutdown_connections 2024-09-11T00:15:07.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:07.638+0000 7fd69f6d7640 1 -- 172.21.15.78:0/454237503 wait complete. 2024-09-11T00:15:08.322 INFO:teuthology.orchestra.run.smithi078.stdout:270582939673 2024-09-11T00:15:08.323 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-11T00:15:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.474+0000 7f69a1cdd640 1 -- 172.21.15.78:0/568946326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f699c1018b0 msgr2=0x7f699c101c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.474+0000 7f69a1cdd640 1 --2- 172.21.15.78:0/568946326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f699c1018b0 0x7f699c101c90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f698c009ca0 tx=0x7f698c02a950 comp rx=0 tx=0).stop 2024-09-11T00:15:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.474+0000 7f69a1cdd640 1 -- 172.21.15.78:0/568946326 shutdown_connections 2024-09-11T00:15:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.474+0000 7f69a1cdd640 1 --2- 172.21.15.78:0/568946326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f699c10f460 0x7f699c111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.474+0000 7f69a1cdd640 1 --2- 172.21.15.78:0/568946326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f699c1021d0 0x7f699c10ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.474+0000 7f69a1cdd640 1 --2- 172.21.15.78:0/568946326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f699c1018b0 0x7f699c101c90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.475+0000 7f69a1cdd640 1 -- 172.21.15.78:0/568946326 >> 172.21.15.78:0/568946326 conn(0x7f699c0fd700 msgr2=0x7f699c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.475+0000 7f69a1cdd640 1 -- 172.21.15.78:0/568946326 shutdown_connections 2024-09-11T00:15:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.475+0000 7f69a1cdd640 1 -- 172.21.15.78:0/568946326 wait complete. 2024-09-11T00:15:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.475+0000 7f69a1cdd640 1 Processor -- start 2024-09-11T00:15:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.475+0000 7f69a1cdd640 1 -- start start 2024-09-11T00:15:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.476+0000 7f69a1cdd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f699c1018b0 0x7f699c19b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.476+0000 7f69a1cdd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f699c1021d0 0x7f699c19ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.476+0000 7f69a1cdd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f699c10f460 0x7f699c1a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.476+0000 7f69a1cdd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f699c114fd0 con 0x7f699c10f460 2024-09-11T00:15:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.476+0000 7f69a1cdd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f699c114e50 con 0x7f699c1021d0 2024-09-11T00:15:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.476+0000 7f69a1cdd640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f699c115150 con 0x7f699c1018b0 2024-09-11T00:15:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.476+0000 7f699bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f699c10f460 0x7f699c1a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.476+0000 7f699bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f699c10f460 0x7f699c1a0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49318/0 (socket says 172.21.15.78:49318) 2024-09-11T00:15:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.476+0000 7f699b7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f699c1018b0 0x7f699c19b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.476+0000 7f699bfff640 1 -- 172.21.15.78:0/3034087719 learned_addr learned my addr 172.21.15.78:0/3034087719 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.476+0000 7f699affd640 1 --2- 172.21.15.78:0/3034087719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f699c1021d0 0x7f699c19ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.476+0000 7f699bfff640 1 -- 172.21.15.78:0/3034087719 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f699c1018b0 msgr2=0x7f699c19b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.476+0000 7f699bfff640 1 --2- 172.21.15.78:0/3034087719 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f699c1018b0 0x7f699c19b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.476+0000 7f699bfff640 1 -- 172.21.15.78:0/3034087719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f699c1021d0 msgr2=0x7f699c19ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.476+0000 7f699bfff640 1 --2- 172.21.15.78:0/3034087719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f699c1021d0 0x7f699c19ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.476+0000 7f699bfff640 1 -- 172.21.15.78:0/3034087719 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699c1a1590 con 0x7f699c10f460 2024-09-11T00:15:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.476+0000 7f699bfff640 1 --2- 172.21.15.78:0/3034087719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f699c10f460 0x7f699c1a0dc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f699400d750 tx=0x7f699400db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.476+0000 7f6998ff9640 1 -- 172.21.15.78:0/3034087719 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6994017070 con 0x7f699c10f460 2024-09-11T00:15:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.476+0000 7f6998ff9640 1 -- 172.21.15.78:0/3034087719 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69940097c0 con 0x7f699c10f460 2024-09-11T00:15:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.477+0000 7f69a1cdd640 1 -- 172.21.15.78:0/3034087719 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f699c1a1880 con 0x7f699c10f460 2024-09-11T00:15:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.477+0000 7f6998ff9640 1 -- 172.21.15.78:0/3034087719 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6994004ba0 con 0x7f699c10f460 2024-09-11T00:15:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.477+0000 7f69a1cdd640 1 -- 172.21.15.78:0/3034087719 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f699c1a7fc0 con 0x7f699c10f460 2024-09-11T00:15:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.478+0000 7f69a1cdd640 1 -- 172.21.15.78:0/3034087719 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f699c0638a0 con 0x7f699c10f460 2024-09-11T00:15:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.480+0000 7f6998ff9640 1 -- 172.21.15.78:0/3034087719 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f6994009c90 con 0x7f699c10f460 2024-09-11T00:15:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.481+0000 7f6998ff9640 1 --2- 172.21.15.78:0/3034087719 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f69840b53c0 0x7f69840b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:08.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.481+0000 7f699b7fe640 1 --2- 172.21.15.78:0/3034087719 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f69840b53c0 0x7f69840b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:08.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.481+0000 7f6998ff9640 1 -- 172.21.15.78:0/3034087719 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f69940e5bf0 con 0x7f699c10f460 2024-09-11T00:15:08.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.482+0000 7f6998ff9640 1 --2- 172.21.15.78:0/3034087719 >> [v2:172.21.15.112:6800/3186321784,v1:172.21.15.112:6801/3186321784] conn(0x7f69840bf160 0x7f69840c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:08.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.482+0000 7f6998ff9640 1 -- 172.21.15.78:0/3034087719 --> [v2:172.21.15.112:6800/3186321784,v1:172.21.15.112:6801/3186321784] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6994021e50 con 0x7f69840bf160 2024-09-11T00:15:08.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.482+0000 7f6998ff9640 1 -- 172.21.15.78:0/3034087719 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f69940e6040 con 0x7f699c10f460 2024-09-11T00:15:08.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.482+0000 7f699b7fe640 1 --2- 172.21.15.78:0/3034087719 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f69840b53c0 0x7f69840b7880 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f698c004ad0 tx=0x7f698c004a60 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:08.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.482+0000 7f699affd640 1 --2- 172.21.15.78:0/3034087719 >> [v2:172.21.15.112:6800/3186321784,v1:172.21.15.112:6801/3186321784] conn(0x7f69840bf160 0x7f69840c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:08.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.483+0000 7f699affd640 1 --2- 172.21.15.78:0/3034087719 >> [v2:172.21.15.112:6800/3186321784,v1:172.21.15.112:6801/3186321784] conn(0x7f69840bf160 0x7f69840c1600 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.484+0000 7f6998ff9640 1 -- 172.21.15.78:0/3034087719 <== osd.1 v2:172.21.15.112:6800/3186321784 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6994021e50 con 0x7f69840bf160 2024-09-11T00:15:08.491 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.502+0000 7f69a1cdd640 1 -- 172.21.15.78:0/3034087719 --> [v2:172.21.15.112:6800/3186321784,v1:172.21.15.112:6801/3186321784] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f699c063d20 con 0x7f69840bf160 2024-09-11T00:15:08.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.503+0000 7f6998ff9640 1 -- 172.21.15.78:0/3034087719 <== osd.1 v2:172.21.15.112:6800/3186321784 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f699c063d20 con 0x7f69840bf160 2024-09-11T00:15:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.503+0000 7f69a1cdd640 1 -- 172.21.15.78:0/3034087719 >> [v2:172.21.15.112:6800/3186321784,v1:172.21.15.112:6801/3186321784] conn(0x7f69840bf160 msgr2=0x7f69840c1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.503+0000 7f69a1cdd640 1 --2- 172.21.15.78:0/3034087719 >> [v2:172.21.15.112:6800/3186321784,v1:172.21.15.112:6801/3186321784] conn(0x7f69840bf160 0x7f69840c1600 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.503+0000 7f69a1cdd640 1 -- 172.21.15.78:0/3034087719 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f69840b53c0 msgr2=0x7f69840b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.503+0000 7f69a1cdd640 1 --2- 172.21.15.78:0/3034087719 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f69840b53c0 0x7f69840b7880 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f698c004ad0 tx=0x7f698c004a60 comp rx=0 tx=0).stop 2024-09-11T00:15:08.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.504+0000 7f69a1cdd640 1 -- 172.21.15.78:0/3034087719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f699c10f460 msgr2=0x7f699c1a0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:08.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.504+0000 7f69a1cdd640 1 --2- 172.21.15.78:0/3034087719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f699c10f460 0x7f699c1a0dc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f699400d750 tx=0x7f699400db50 comp rx=0 tx=0).stop 2024-09-11T00:15:08.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.504+0000 7f699bfff640 1 -- 172.21.15.78:0/3034087719 reap_dead start 2024-09-11T00:15:08.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.504+0000 7f69a1cdd640 1 -- 172.21.15.78:0/3034087719 shutdown_connections 2024-09-11T00:15:08.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.504+0000 7f69a1cdd640 1 -- 172.21.15.78:0/3034087719 >> 172.21.15.78:0/3034087719 conn(0x7f699c0fd700 msgr2=0x7f699c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:08.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.504+0000 7f69a1cdd640 1 -- 172.21.15.78:0/3034087719 shutdown_connections 2024-09-11T00:15:08.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:08.504+0000 7f69a1cdd640 1 -- 172.21.15.78:0/3034087719 wait complete. 2024-09-11T00:15:08.959 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:08 smithi078 ceph-mon[30865]: pgmap v281: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 187 B/s wr, 2 op/s; 12 B/s, 0 objects/s recovering 2024-09-11T00:15:09.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:08 smithi138 ceph-mon[35019]: pgmap v281: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 187 B/s wr, 2 op/s; 12 B/s, 0 objects/s recovering 2024-09-11T00:15:09.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:08 smithi112 ceph-mon[35627]: pgmap v281: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 187 B/s wr, 2 op/s; 12 B/s, 0 objects/s recovering 2024-09-11T00:15:09.310 INFO:teuthology.orchestra.run.smithi078.stdout:60129542215 2024-09-11T00:15:09.310 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-11T00:15:09.311 INFO:teuthology.orchestra.run.smithi078.stdout:296352743445 2024-09-11T00:15:09.311 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-11T00:15:09.972 INFO:teuthology.orchestra.run.smithi078.stdout:128849018937 2024-09-11T00:15:09.972 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-11T00:15:10.535 INFO:teuthology.orchestra.run.smithi078.stdout:77309411394 2024-09-11T00:15:10.536 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-11T00:15:10.741 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:10 smithi078 ceph-mon[30865]: pgmap v282: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s; 11 B/s, 0 objects/s recovering 2024-09-11T00:15:11.034 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:10 smithi112 ceph-mon[35627]: pgmap v282: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s; 11 B/s, 0 objects/s recovering 2024-09-11T00:15:11.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:10 smithi138 ceph-mon[35019]: pgmap v282: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s; 11 B/s, 0 objects/s recovering 2024-09-11T00:15:11.716 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:11.743 INFO:teuthology.orchestra.run.smithi078.stdout:223338299428 2024-09-11T00:15:11.743 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-11T00:15:11.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.469+0000 7f38cc745640 1 -- 172.21.15.78:0/383667587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38c41076c0 msgr2=0x7f38c4107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:11.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.469+0000 7f38cc745640 1 --2- 172.21.15.78:0/383667587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38c41076c0 0x7f38c4107b00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f38b4009900 tx=0x7f38b402a410 comp rx=0 tx=0).stop 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.469+0000 7f38cc745640 1 -- 172.21.15.78:0/383667587 shutdown_connections 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.469+0000 7f38cc745640 1 --2- 172.21.15.78:0/383667587 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c4108040 0x7f38c410e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.469+0000 7f38cc745640 1 --2- 172.21.15.78:0/383667587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38c41076c0 0x7f38c4107b00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.469+0000 7f38cc745640 1 --2- 172.21.15.78:0/383667587 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38c4101cb0 0x7f38c4102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.469+0000 7f38cc745640 1 -- 172.21.15.78:0/383667587 >> 172.21.15.78:0/383667587 conn(0x7f38c40fd700 msgr2=0x7f38c40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.469+0000 7f38cc745640 1 -- 172.21.15.78:0/383667587 shutdown_connections 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.469+0000 7f38cc745640 1 -- 172.21.15.78:0/383667587 wait complete. 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.470+0000 7f38cc745640 1 Processor -- start 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.470+0000 7f38cc745640 1 -- start start 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.470+0000 7f38cc745640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38c4101cb0 0x7f38c4199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.470+0000 7f38cc745640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c41076c0 0x7f38c41997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.470+0000 7f38cc745640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38c4108040 0x7f38c419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:11.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.470+0000 7f38cc745640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f38c4111c90 con 0x7f38c4108040 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.470+0000 7f38cc745640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f38c4111b10 con 0x7f38c41076c0 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.470+0000 7f38cc745640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f38c4111e10 con 0x7f38c4101cb0 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.470+0000 7f38cace2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38c4108040 0x7f38c419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.470+0000 7f38cace2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38c4108040 0x7f38c419eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49338/0 (socket says 172.21.15.78:49338) 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.470+0000 7f38cace2640 1 -- 172.21.15.78:0/2607001492 learned_addr learned my addr 172.21.15.78:0/2607001492 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.470+0000 7f38ca4e1640 1 --2- 172.21.15.78:0/2607001492 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38c4101cb0 0x7f38c4199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.471+0000 7f38c9ce0640 1 --2- 172.21.15.78:0/2607001492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c41076c0 0x7f38c41997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.471+0000 7f38cace2640 1 -- 172.21.15.78:0/2607001492 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38c4101cb0 msgr2=0x7f38c4199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.471+0000 7f38cace2640 1 --2- 172.21.15.78:0/2607001492 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38c4101cb0 0x7f38c4199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.471+0000 7f38cace2640 1 -- 172.21.15.78:0/2607001492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c41076c0 msgr2=0x7f38c41997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.471+0000 7f38cace2640 1 --2- 172.21.15.78:0/2607001492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38c41076c0 0x7f38c41997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:11.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.471+0000 7f38cace2640 1 -- 172.21.15.78:0/2607001492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c419f310 con 0x7f38c4108040 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.471+0000 7f38cace2640 1 --2- 172.21.15.78:0/2607001492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38c4108040 0x7f38c419eb40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f38bc00eaa0 tx=0x7f38bc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.471+0000 7f38bb7fe640 1 -- 172.21.15.78:0/2607001492 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00cdb0 con 0x7f38c4108040 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.471+0000 7f38bb7fe640 1 -- 172.21.15.78:0/2607001492 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38bc005020 con 0x7f38c4108040 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.471+0000 7f38cc745640 1 -- 172.21.15.78:0/2607001492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c419f600 con 0x7f38c4108040 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.471+0000 7f38bb7fe640 1 -- 172.21.15.78:0/2607001492 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc0116d0 con 0x7f38c4108040 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.471+0000 7f38cc745640 1 -- 172.21.15.78:0/2607001492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c41a5cc0 con 0x7f38c4108040 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.472+0000 7f38cc745640 1 -- 172.21.15.78:0/2607001492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f38c41047d0 con 0x7f38c4108040 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.473+0000 7f38bb7fe640 1 -- 172.21.15.78:0/2607001492 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f38bc00f040 con 0x7f38c4108040 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.474+0000 7f38bb7fe640 1 --2- 172.21.15.78:0/2607001492 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f38b00b5440 0x7f38b00b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.474+0000 7f38ca4e1640 1 --2- 172.21.15.78:0/2607001492 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f38b00b5440 0x7f38b00b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:11.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.474+0000 7f38bb7fe640 1 -- 172.21.15.78:0/2607001492 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f38bc0e60b0 con 0x7f38c4108040 2024-09-11T00:15:11.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.474+0000 7f38bb7fe640 1 --2- 172.21.15.78:0/2607001492 >> [v2:172.21.15.112:6816/1481363296,v1:172.21.15.112:6817/1481363296] conn(0x7f38b00bf1d0 0x7f38b00c1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:11.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.474+0000 7f38bb7fe640 1 -- 172.21.15.78:0/2607001492 --> [v2:172.21.15.112:6816/1481363296,v1:172.21.15.112:6817/1481363296] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38bc014ec0 con 0x7f38b00bf1d0 2024-09-11T00:15:11.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.474+0000 7f38bb7fe640 1 -- 172.21.15.78:0/2607001492 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f38bc0e6590 con 0x7f38c4108040 2024-09-11T00:15:11.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.474+0000 7f38ca4e1640 1 --2- 172.21.15.78:0/2607001492 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f38b00b5440 0x7f38b00b7900 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f38c0005e10 tx=0x7f38c0005da0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:11.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.475+0000 7f38c9ce0640 1 --2- 172.21.15.78:0/2607001492 >> [v2:172.21.15.112:6816/1481363296,v1:172.21.15.112:6817/1481363296] conn(0x7f38b00bf1d0 0x7f38b00c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:11.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.475+0000 7f38c9ce0640 1 --2- 172.21.15.78:0/2607001492 >> [v2:172.21.15.112:6816/1481363296,v1:172.21.15.112:6817/1481363296] conn(0x7f38b00bf1d0 0x7f38b00c1670 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:11.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.476+0000 7f38bb7fe640 1 -- 172.21.15.78:0/2607001492 <== osd.7 v2:172.21.15.112:6816/1481363296 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f38bc014ec0 con 0x7f38b00bf1d0 2024-09-11T00:15:11.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.489+0000 7f38cc745640 1 -- 172.21.15.78:0/2607001492 --> [v2:172.21.15.112:6816/1481363296,v1:172.21.15.112:6817/1481363296] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f38c4102f60 con 0x7f38b00bf1d0 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.490+0000 7f38bb7fe640 1 -- 172.21.15.78:0/2607001492 <== osd.7 v2:172.21.15.112:6816/1481363296 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f38c4102f60 con 0x7f38b00bf1d0 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.490+0000 7f38cc745640 1 -- 172.21.15.78:0/2607001492 >> [v2:172.21.15.112:6816/1481363296,v1:172.21.15.112:6817/1481363296] conn(0x7f38b00bf1d0 msgr2=0x7f38b00c1670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.490+0000 7f38cc745640 1 --2- 172.21.15.78:0/2607001492 >> [v2:172.21.15.112:6816/1481363296,v1:172.21.15.112:6817/1481363296] conn(0x7f38b00bf1d0 0x7f38b00c1670 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.490+0000 7f38cc745640 1 -- 172.21.15.78:0/2607001492 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f38b00b5440 msgr2=0x7f38b00b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.490+0000 7f38cc745640 1 --2- 172.21.15.78:0/2607001492 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f38b00b5440 0x7f38b00b7900 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f38c0005e10 tx=0x7f38c0005da0 comp rx=0 tx=0).stop 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.490+0000 7f38cc745640 1 -- 172.21.15.78:0/2607001492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38c4108040 msgr2=0x7f38c419eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.490+0000 7f38cc745640 1 --2- 172.21.15.78:0/2607001492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38c4108040 0x7f38c419eb40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f38bc00eaa0 tx=0x7f38bc00ef60 comp rx=0 tx=0).stop 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.490+0000 7f38cace2640 1 -- 172.21.15.78:0/2607001492 reap_dead start 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.490+0000 7f38cc745640 1 -- 172.21.15.78:0/2607001492 shutdown_connections 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.490+0000 7f38cc745640 1 -- 172.21.15.78:0/2607001492 >> 172.21.15.78:0/2607001492 conn(0x7f38c40fd700 msgr2=0x7f38c406b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.490+0000 7f38cc745640 1 -- 172.21.15.78:0/2607001492 shutdown_connections 2024-09-11T00:15:11.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:11.490+0000 7f38cc745640 1 -- 172.21.15.78:0/2607001492 wait complete. 2024-09-11T00:15:12.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.315+0000 7f868a5b9640 1 -- 172.21.15.78:0/2358043729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8684075e00 msgr2=0x7f868410ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.315+0000 7f868a5b9640 1 --2- 172.21.15.78:0/2358043729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8684075e00 0x7f868410ee70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8678009900 tx=0x7f867802a410 comp rx=0 tx=0).stop 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.315+0000 7f868a5b9640 1 -- 172.21.15.78:0/2358043729 shutdown_connections 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.315+0000 7f868a5b9640 1 --2- 172.21.15.78:0/2358043729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f868410f3b0 0x7f86841117a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.315+0000 7f868a5b9640 1 --2- 172.21.15.78:0/2358043729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8684075e00 0x7f868410ee70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.315+0000 7f868a5b9640 1 --2- 172.21.15.78:0/2358043729 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f86840754e0 0x7f86840758c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.315+0000 7f868a5b9640 1 -- 172.21.15.78:0/2358043729 >> 172.21.15.78:0/2358043729 conn(0x7f86840fe830 msgr2=0x7f8684100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.315+0000 7f868a5b9640 1 -- 172.21.15.78:0/2358043729 shutdown_connections 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.315+0000 7f868a5b9640 1 -- 172.21.15.78:0/2358043729 wait complete. 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.316+0000 7f868a5b9640 1 Processor -- start 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.316+0000 7f868a5b9640 1 -- start start 2024-09-11T00:15:12.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.316+0000 7f868a5b9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86840754e0 0x7f868419b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.316+0000 7f868a5b9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8684075e00 0x7f868419b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.316+0000 7f868a5b9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f868410f3b0 0x7f86841a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.316+0000 7f868a5b9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8684114f60 con 0x7f868410f3b0 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.316+0000 7f868a5b9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8684114de0 con 0x7f86840754e0 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.316+0000 7f868a5b9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f86841150e0 con 0x7f8684075e00 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.316+0000 7f8688b56640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f868410f3b0 0x7f86841a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.316+0000 7f8688b56640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f868410f3b0 0x7f86841a0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49354/0 (socket says 172.21.15.78:49354) 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.316+0000 7f8688b56640 1 -- 172.21.15.78:0/669553977 learned_addr learned my addr 172.21.15.78:0/669553977 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.316+0000 7f8683fff640 1 --2- 172.21.15.78:0/669553977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86840754e0 0x7f868419b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.316+0000 7f86837fe640 1 --2- 172.21.15.78:0/669553977 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8684075e00 0x7f868419b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.317+0000 7f8688b56640 1 -- 172.21.15.78:0/669553977 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8684075e00 msgr2=0x7f868419b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.317+0000 7f8688b56640 1 --2- 172.21.15.78:0/669553977 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8684075e00 0x7f868419b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.317+0000 7f8688b56640 1 -- 172.21.15.78:0/669553977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86840754e0 msgr2=0x7f868419b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.317+0000 7f8688b56640 1 --2- 172.21.15.78:0/669553977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f86840754e0 0x7f868419b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.317+0000 7f8688b56640 1 -- 172.21.15.78:0/669553977 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86841a1540 con 0x7f868410f3b0 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.317+0000 7f8688b56640 1 --2- 172.21.15.78:0/669553977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f868410f3b0 0x7f86841a0d70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f867c00e9d0 tx=0x7f867c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.317+0000 7f86817fa640 1 -- 172.21.15.78:0/669553977 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867c00cd80 con 0x7f868410f3b0 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.317+0000 7f868a5b9640 1 -- 172.21.15.78:0/669553977 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86841a1830 con 0x7f868410f3b0 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.317+0000 7f86817fa640 1 -- 172.21.15.78:0/669553977 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f867c005020 con 0x7f868410f3b0 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.317+0000 7f86817fa640 1 -- 172.21.15.78:0/669553977 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867c0116d0 con 0x7f868410f3b0 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.317+0000 7f868a5b9640 1 -- 172.21.15.78:0/669553977 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86841a7ef0 con 0x7f868410f3b0 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.318+0000 7f868a5b9640 1 -- 172.21.15.78:0/669553977 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8684100ea0 con 0x7f868410f3b0 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.319+0000 7f86817fa640 1 -- 172.21.15.78:0/669553977 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f867c00f040 con 0x7f868410f3b0 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.320+0000 7f86817fa640 1 --2- 172.21.15.78:0/669553977 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f866c0b53c0 0x7f866c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.320+0000 7f8683fff640 1 --2- 172.21.15.78:0/669553977 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f866c0b53c0 0x7f866c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:12.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.320+0000 7f86817fa640 1 -- 172.21.15.78:0/669553977 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f867c0e61a0 con 0x7f868410f3b0 2024-09-11T00:15:12.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.320+0000 7f86817fa640 1 --2- 172.21.15.78:0/669553977 >> [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575] conn(0x7f866c0bf160 0x7f866c0c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:12.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.320+0000 7f86817fa640 1 -- 172.21.15.78:0/669553977 --> [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f867c014ec0 con 0x7f866c0bf160 2024-09-11T00:15:12.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.320+0000 7f86817fa640 1 -- 172.21.15.78:0/669553977 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f867c0e65f0 con 0x7f868410f3b0 2024-09-11T00:15:12.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.320+0000 7f86837fe640 1 --2- 172.21.15.78:0/669553977 >> [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575] conn(0x7f866c0bf160 0x7f866c0c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:12.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.320+0000 7f8683fff640 1 --2- 172.21.15.78:0/669553977 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f866c0b53c0 0x7f866c0b7880 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f867400bbe0 tx=0x7f867400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:12.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.321+0000 7f86837fe640 1 --2- 172.21.15.78:0/669553977 >> [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575] conn(0x7f866c0bf160 0x7f866c0c1600 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:12.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.321+0000 7f86817fa640 1 -- 172.21.15.78:0/669553977 <== osd.6 v2:172.21.15.78:6818/477087575 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f867c014ec0 con 0x7f866c0bf160 2024-09-11T00:15:12.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.335+0000 7f868a5b9640 1 -- 172.21.15.78:0/669553977 --> [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f86840769f0 con 0x7f866c0bf160 2024-09-11T00:15:12.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.335+0000 7f86817fa640 1 -- 172.21.15.78:0/669553977 <== osd.6 v2:172.21.15.78:6818/477087575 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f86840769f0 con 0x7f866c0bf160 2024-09-11T00:15:12.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.335+0000 7f868a5b9640 1 -- 172.21.15.78:0/669553977 >> [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575] conn(0x7f866c0bf160 msgr2=0x7f866c0c1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.335+0000 7f868a5b9640 1 --2- 172.21.15.78:0/669553977 >> [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575] conn(0x7f866c0bf160 0x7f866c0c1600 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:12.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.335+0000 7f868a5b9640 1 -- 172.21.15.78:0/669553977 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f866c0b53c0 msgr2=0x7f866c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.335+0000 7f868a5b9640 1 --2- 172.21.15.78:0/669553977 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f866c0b53c0 0x7f866c0b7880 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f867400bbe0 tx=0x7f867400b390 comp rx=0 tx=0).stop 2024-09-11T00:15:12.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.335+0000 7f868a5b9640 1 -- 172.21.15.78:0/669553977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f868410f3b0 msgr2=0x7f86841a0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:12.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.335+0000 7f868a5b9640 1 --2- 172.21.15.78:0/669553977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f868410f3b0 0x7f86841a0d70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f867c00e9d0 tx=0x7f867c00ee90 comp rx=0 tx=0).stop 2024-09-11T00:15:12.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.335+0000 7f8688b56640 1 -- 172.21.15.78:0/669553977 reap_dead start 2024-09-11T00:15:12.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.335+0000 7f868a5b9640 1 -- 172.21.15.78:0/669553977 shutdown_connections 2024-09-11T00:15:12.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.335+0000 7f868a5b9640 1 -- 172.21.15.78:0/669553977 >> 172.21.15.78:0/669553977 conn(0x7f86840fe830 msgr2=0x7f86840ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:12.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.335+0000 7f868a5b9640 1 -- 172.21.15.78:0/669553977 shutdown_connections 2024-09-11T00:15:12.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:12.335+0000 7f868a5b9640 1 -- 172.21.15.78:0/669553977 wait complete. 2024-09-11T00:15:12.993 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:12 smithi078 ceph-mon[30865]: pgmap v283: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s; 11 B/s, 0 objects/s recovering 2024-09-11T00:15:13.030 INFO:teuthology.orchestra.run.smithi078.stdout:176093659184 2024-09-11T00:15:13.031 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-11T00:15:13.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:12 smithi138 ceph-mon[35019]: pgmap v283: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s; 11 B/s, 0 objects/s recovering 2024-09-11T00:15:13.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:12 smithi112 ceph-mon[35627]: pgmap v283: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s; 11 B/s, 0 objects/s recovering 2024-09-11T00:15:13.646 INFO:teuthology.orchestra.run.smithi078.stdout:197568495658 2024-09-11T00:15:13.647 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-11T00:15:13.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.970+0000 7f4dcc451640 1 -- 172.21.15.78:0/3075810207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dc4109150 msgr2=0x7f4dc410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:13.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.970+0000 7f4dcc451640 1 --2- 172.21.15.78:0/3075810207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dc4109150 0x7f4dc410f950 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc009ca0 tx=0x7f4dbc02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:13.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.970+0000 7f4dcc451640 1 -- 172.21.15.78:0/3075810207 shutdown_connections 2024-09-11T00:15:13.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.970+0000 7f4dcc451640 1 --2- 172.21.15.78:0/3075810207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dc4109150 0x7f4dc410f950 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:13.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.970+0000 7f4dcc451640 1 --2- 172.21.15.78:0/3075810207 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4dc41087d0 0x7f4dc4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:13.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.970+0000 7f4dcc451640 1 --2- 172.21.15.78:0/3075810207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dc4102dc0 0x7f4dc41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:13.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.970+0000 7f4dcc451640 1 -- 172.21.15.78:0/3075810207 >> 172.21.15.78:0/3075810207 conn(0x7f4dc40fe830 msgr2=0x7f4dc4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:13.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.970+0000 7f4dcc451640 1 -- 172.21.15.78:0/3075810207 shutdown_connections 2024-09-11T00:15:13.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.970+0000 7f4dcc451640 1 -- 172.21.15.78:0/3075810207 wait complete. 2024-09-11T00:15:13.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.971+0000 7f4dcc451640 1 Processor -- start 2024-09-11T00:15:13.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.971+0000 7f4dcc451640 1 -- start start 2024-09-11T00:15:13.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.971+0000 7f4dcc451640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4dc4102dc0 0x7f4dc4199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:13.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.971+0000 7f4dcc451640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dc41087d0 0x7f4dc4199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:13.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.971+0000 7f4dcc451640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dc4109150 0x7f4dc419eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:13.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.971+0000 7f4dcc451640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc4112e10 con 0x7f4dc41087d0 2024-09-11T00:15:13.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.971+0000 7f4dcc451640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc4112c90 con 0x7f4dc4109150 2024-09-11T00:15:13.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.971+0000 7f4dcc451640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc4112f90 con 0x7f4dc4102dc0 2024-09-11T00:15:13.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.971+0000 7f4dc99ec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dc41087d0 0x7f4dc4199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:13.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.971+0000 7f4dc99ec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dc41087d0 0x7f4dc4199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49370/0 (socket says 172.21.15.78:49370) 2024-09-11T00:15:13.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.971+0000 7f4dc99ec640 1 -- 172.21.15.78:0/438496586 learned_addr learned my addr 172.21.15.78:0/438496586 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:13.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.971+0000 7f4dca9ee640 1 --2- 172.21.15.78:0/438496586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dc4109150 0x7f4dc419eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:14.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.972+0000 7f4dca1ed640 1 --2- 172.21.15.78:0/438496586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4dc4102dc0 0x7f4dc4199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:14.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.972+0000 7f4dc99ec640 1 -- 172.21.15.78:0/438496586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4dc4102dc0 msgr2=0x7f4dc4199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.972+0000 7f4dc99ec640 1 --2- 172.21.15.78:0/438496586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4dc4102dc0 0x7f4dc4199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.972+0000 7f4dc99ec640 1 -- 172.21.15.78:0/438496586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dc4109150 msgr2=0x7f4dc419eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.972+0000 7f4dc99ec640 1 --2- 172.21.15.78:0/438496586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4dc4109150 0x7f4dc419eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.972+0000 7f4dc99ec640 1 -- 172.21.15.78:0/438496586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc419f2f0 con 0x7f4dc41087d0 2024-09-11T00:15:14.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.972+0000 7f4dc99ec640 1 --2- 172.21.15.78:0/438496586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dc41087d0 0x7f4dc4199780 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4db400d950 tx=0x7f4db400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:14.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.972+0000 7f4dbb7fe640 1 -- 172.21.15.78:0/438496586 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db4017030 con 0x7f4dc41087d0 2024-09-11T00:15:14.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.972+0000 7f4dcc451640 1 -- 172.21.15.78:0/438496586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc419f5e0 con 0x7f4dc41087d0 2024-09-11T00:15:14.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.972+0000 7f4dbb7fe640 1 -- 172.21.15.78:0/438496586 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4db4004020 con 0x7f4dc41087d0 2024-09-11T00:15:14.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.972+0000 7f4dbb7fe640 1 -- 172.21.15.78:0/438496586 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db40047a0 con 0x7f4dc41087d0 2024-09-11T00:15:14.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.972+0000 7f4dcc451640 1 -- 172.21.15.78:0/438496586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc41a5ca0 con 0x7f4dc41087d0 2024-09-11T00:15:14.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.973+0000 7f4dcc451640 1 -- 172.21.15.78:0/438496586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4dc41060e0 con 0x7f4dc41087d0 2024-09-11T00:15:14.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.975+0000 7f4dbb7fe640 1 -- 172.21.15.78:0/438496586 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f4db4009a30 con 0x7f4dc41087d0 2024-09-11T00:15:14.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.975+0000 7f4dbb7fe640 1 --2- 172.21.15.78:0/438496586 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4db00b53c0 0x7f4db00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:14.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.975+0000 7f4dca1ed640 1 --2- 172.21.15.78:0/438496586 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4db00b53c0 0x7f4db00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:14.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.975+0000 7f4dbb7fe640 1 -- 172.21.15.78:0/438496586 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f4db40e5e90 con 0x7f4dc41087d0 2024-09-11T00:15:14.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.976+0000 7f4dbb7fe640 1 --2- 172.21.15.78:0/438496586 >> [v2:172.21.15.138:6808/3033110975,v1:172.21.15.138:6809/3033110975] conn(0x7f4db00bf160 0x7f4db00c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:14.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.976+0000 7f4dbb7fe640 1 -- 172.21.15.78:0/438496586 --> [v2:172.21.15.138:6808/3033110975,v1:172.21.15.138:6809/3033110975] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4db00c1cd0 con 0x7f4db00bf160 2024-09-11T00:15:14.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.976+0000 7f4dbb7fe640 1 -- 172.21.15.78:0/438496586 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f4db40e62e0 con 0x7f4dc41087d0 2024-09-11T00:15:14.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.976+0000 7f4dca1ed640 1 --2- 172.21.15.78:0/438496586 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4db00b53c0 0x7f4db00b7880 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000bbe0 tx=0x7f4dc000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:14.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.976+0000 7f4dca9ee640 1 --2- 172.21.15.78:0/438496586 >> [v2:172.21.15.138:6808/3033110975,v1:172.21.15.138:6809/3033110975] conn(0x7f4db00bf160 0x7f4db00c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:14.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.976+0000 7f4dca9ee640 1 --2- 172.21.15.78:0/438496586 >> [v2:172.21.15.138:6808/3033110975,v1:172.21.15.138:6809/3033110975] conn(0x7f4db00bf160 0x7f4db00c1600 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:14.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.977+0000 7f4dbb7fe640 1 -- 172.21.15.78:0/438496586 <== osd.5 v2:172.21.15.138:6808/3033110975 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4db00c1cd0 con 0x7f4db00bf160 2024-09-11T00:15:14.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.990+0000 7f4dcc451640 1 -- 172.21.15.78:0/438496586 --> [v2:172.21.15.138:6808/3033110975,v1:172.21.15.138:6809/3033110975] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4dc4104070 con 0x7f4db00bf160 2024-09-11T00:15:14.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.991+0000 7f4dbb7fe640 1 -- 172.21.15.78:0/438496586 <== osd.5 v2:172.21.15.138:6808/3033110975 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4dc4104070 con 0x7f4db00bf160 2024-09-11T00:15:14.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.991+0000 7f4dcc451640 1 -- 172.21.15.78:0/438496586 >> [v2:172.21.15.138:6808/3033110975,v1:172.21.15.138:6809/3033110975] conn(0x7f4db00bf160 msgr2=0x7f4db00c1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.992+0000 7f4dcc451640 1 --2- 172.21.15.78:0/438496586 >> [v2:172.21.15.138:6808/3033110975,v1:172.21.15.138:6809/3033110975] conn(0x7f4db00bf160 0x7f4db00c1600 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.992+0000 7f4dcc451640 1 -- 172.21.15.78:0/438496586 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4db00b53c0 msgr2=0x7f4db00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.992+0000 7f4dcc451640 1 --2- 172.21.15.78:0/438496586 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4db00b53c0 0x7f4db00b7880 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000bbe0 tx=0x7f4dc000b390 comp rx=0 tx=0).stop 2024-09-11T00:15:14.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.992+0000 7f4dcc451640 1 -- 172.21.15.78:0/438496586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dc41087d0 msgr2=0x7f4dc4199780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.992+0000 7f4dcc451640 1 --2- 172.21.15.78:0/438496586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4dc41087d0 0x7f4dc4199780 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4db400d950 tx=0x7f4db400de10 comp rx=0 tx=0).stop 2024-09-11T00:15:14.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.992+0000 7f4dca9ee640 1 -- 172.21.15.78:0/438496586 reap_dead start 2024-09-11T00:15:14.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.992+0000 7f4dcc451640 1 -- 172.21.15.78:0/438496586 shutdown_connections 2024-09-11T00:15:14.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.992+0000 7f4dcc451640 1 -- 172.21.15.78:0/438496586 >> 172.21.15.78:0/438496586 conn(0x7f4dc40fe830 msgr2=0x7f4dc4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:14.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.992+0000 7f4dcc451640 1 -- 172.21.15.78:0/438496586 shutdown_connections 2024-09-11T00:15:14.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:13.992+0000 7f4dcc451640 1 -- 172.21.15.78:0/438496586 wait complete. 2024-09-11T00:15:14.622 INFO:teuthology.orchestra.run.smithi078.stdout:150323855414 2024-09-11T00:15:14.622 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-11T00:15:14.814 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:14 smithi078 ceph-mon[30865]: pgmap v284: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:14.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.792+0000 7fdf8d2c8640 1 -- 172.21.15.78:0/3932187492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf88108020 msgr2=0x7fdf8810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.792+0000 7fdf8d2c8640 1 --2- 172.21.15.78:0/3932187492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf88108020 0x7fdf8810e820 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009ca0 tx=0x7fdf8002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.792+0000 7fdf8d2c8640 1 -- 172.21.15.78:0/3932187492 shutdown_connections 2024-09-11T00:15:14.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.792+0000 7fdf8d2c8640 1 --2- 172.21.15.78:0/3932187492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf88108020 0x7fdf8810e820 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.792+0000 7fdf8d2c8640 1 --2- 172.21.15.78:0/3932187492 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf881076a0 0x7fdf88107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.792+0000 7fdf8d2c8640 1 --2- 172.21.15.78:0/3932187492 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf88101c90 0x7fdf88102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.792+0000 7fdf8d2c8640 1 -- 172.21.15.78:0/3932187492 >> 172.21.15.78:0/3932187492 conn(0x7fdf880fd700 msgr2=0x7fdf880ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:14.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.792+0000 7fdf8d2c8640 1 -- 172.21.15.78:0/3932187492 shutdown_connections 2024-09-11T00:15:14.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.792+0000 7fdf8d2c8640 1 -- 172.21.15.78:0/3932187492 wait complete. 2024-09-11T00:15:14.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.792+0000 7fdf8d2c8640 1 Processor -- start 2024-09-11T00:15:14.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.793+0000 7fdf8d2c8640 1 -- start start 2024-09-11T00:15:14.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.793+0000 7fdf8d2c8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf88101c90 0x7fdf88199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:14.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.793+0000 7fdf8d2c8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf881076a0 0x7fdf88199a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:14.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.793+0000 7fdf8d2c8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf88108020 0x7fdf8819b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:14.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.793+0000 7fdf8d2c8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdf88111ce0 con 0x7fdf881076a0 2024-09-11T00:15:14.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.793+0000 7fdf8d2c8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdf88111b60 con 0x7fdf88108020 2024-09-11T00:15:14.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.793+0000 7fdf8d2c8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdf88111e60 con 0x7fdf88101c90 2024-09-11T00:15:14.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.793+0000 7fdf867fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf881076a0 0x7fdf88199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:14.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.793+0000 7fdf867fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf881076a0 0x7fdf88199a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44756/0 (socket says 172.21.15.78:44756) 2024-09-11T00:15:14.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.793+0000 7fdf867fc640 1 -- 172.21.15.78:0/3382824612 learned_addr learned my addr 172.21.15.78:0/3382824612 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:14.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.793+0000 7fdf86ffd640 1 --2- 172.21.15.78:0/3382824612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf88101c90 0x7fdf88199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:14.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.793+0000 7fdf877fe640 1 --2- 172.21.15.78:0/3382824612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf88108020 0x7fdf8819b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:14.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.793+0000 7fdf867fc640 1 -- 172.21.15.78:0/3382824612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf88101c90 msgr2=0x7fdf88199530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.793+0000 7fdf867fc640 1 --2- 172.21.15.78:0/3382824612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf88101c90 0x7fdf88199530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.793+0000 7fdf867fc640 1 -- 172.21.15.78:0/3382824612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf88108020 msgr2=0x7fdf8819b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.793+0000 7fdf867fc640 1 --2- 172.21.15.78:0/3382824612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf88108020 0x7fdf8819b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.793+0000 7fdf867fc640 1 -- 172.21.15.78:0/3382824612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf8819c100 con 0x7fdf881076a0 2024-09-11T00:15:14.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.794+0000 7fdf867fc640 1 --2- 172.21.15.78:0/3382824612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf881076a0 0x7fdf88199a70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00d770 tx=0x7fdf7c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:14.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.794+0000 7fdf6ffff640 1 -- 172.21.15.78:0/3382824612 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c017070 con 0x7fdf881076a0 2024-09-11T00:15:14.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.794+0000 7fdf6ffff640 1 -- 172.21.15.78:0/3382824612 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf7c0054d0 con 0x7fdf881076a0 2024-09-11T00:15:14.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.794+0000 7fdf8d2c8640 1 -- 172.21.15.78:0/3382824612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf8819c3f0 con 0x7fdf881076a0 2024-09-11T00:15:14.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.794+0000 7fdf6ffff640 1 -- 172.21.15.78:0/3382824612 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c004d00 con 0x7fdf881076a0 2024-09-11T00:15:14.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.794+0000 7fdf8d2c8640 1 -- 172.21.15.78:0/3382824612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf881a5cf0 con 0x7fdf881076a0 2024-09-11T00:15:14.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.795+0000 7fdf8d2c8640 1 -- 172.21.15.78:0/3382824612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdf880fee40 con 0x7fdf881076a0 2024-09-11T00:15:14.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.796+0000 7fdf6ffff640 1 -- 172.21.15.78:0/3382824612 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fdf7c004ea0 con 0x7fdf881076a0 2024-09-11T00:15:14.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.797+0000 7fdf6ffff640 1 --2- 172.21.15.78:0/3382824612 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdf700b53c0 0x7fdf700b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:14.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.797+0000 7fdf6ffff640 1 -- 172.21.15.78:0/3382824612 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fdf7c0e5e90 con 0x7fdf881076a0 2024-09-11T00:15:14.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.797+0000 7fdf86ffd640 1 --2- 172.21.15.78:0/3382824612 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdf700b53c0 0x7fdf700b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:14.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.797+0000 7fdf6ffff640 1 --2- 172.21.15.78:0/3382824612 >> [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256] conn(0x7fdf700bf150 0x7fdf700c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:14.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.797+0000 7fdf6ffff640 1 -- 172.21.15.78:0/3382824612 --> [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf7c021e50 con 0x7fdf700bf150 2024-09-11T00:15:14.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.797+0000 7fdf6ffff640 1 -- 172.21.15.78:0/3382824612 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fdf7c0e62e0 con 0x7fdf881076a0 2024-09-11T00:15:14.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.797+0000 7fdf877fe640 1 --2- 172.21.15.78:0/3382824612 >> [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256] conn(0x7fdf700bf150 0x7fdf700c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:14.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.798+0000 7fdf86ffd640 1 --2- 172.21.15.78:0/3382824612 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdf700b53c0 0x7fdf700b7880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdf78005fd0 tx=0x7fdf7800b590 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:14.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.798+0000 7fdf877fe640 1 --2- 172.21.15.78:0/3382824612 >> [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256] conn(0x7fdf700bf150 0x7fdf700c15f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:14.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.798+0000 7fdf6ffff640 1 -- 172.21.15.78:0/3382824612 <== osd.3 v2:172.21.15.78:6810/3832405256 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdf7c021e50 con 0x7fdf700bf150 2024-09-11T00:15:14.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.813+0000 7fdf8d2c8640 1 -- 172.21.15.78:0/3382824612 --> [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdf88102f40 con 0x7fdf700bf150 2024-09-11T00:15:14.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.813+0000 7fdf6ffff640 1 -- 172.21.15.78:0/3382824612 <== osd.3 v2:172.21.15.78:6810/3832405256 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdf88102f40 con 0x7fdf700bf150 2024-09-11T00:15:14.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.814+0000 7fdf8d2c8640 1 -- 172.21.15.78:0/3382824612 >> [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256] conn(0x7fdf700bf150 msgr2=0x7fdf700c15f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.814+0000 7fdf8d2c8640 1 --2- 172.21.15.78:0/3382824612 >> [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256] conn(0x7fdf700bf150 0x7fdf700c15f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:14.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.814+0000 7fdf8d2c8640 1 -- 172.21.15.78:0/3382824612 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdf700b53c0 msgr2=0x7fdf700b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.814+0000 7fdf8d2c8640 1 --2- 172.21.15.78:0/3382824612 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdf700b53c0 0x7fdf700b7880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdf78005fd0 tx=0x7fdf7800b590 comp rx=0 tx=0).stop 2024-09-11T00:15:14.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.814+0000 7fdf8d2c8640 1 -- 172.21.15.78:0/3382824612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf881076a0 msgr2=0x7fdf88199a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:14.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.814+0000 7fdf8d2c8640 1 --2- 172.21.15.78:0/3382824612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf881076a0 0x7fdf88199a70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00d770 tx=0x7fdf7c00dc30 comp rx=0 tx=0).stop 2024-09-11T00:15:14.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.814+0000 7fdf877fe640 1 -- 172.21.15.78:0/3382824612 reap_dead start 2024-09-11T00:15:14.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.814+0000 7fdf8d2c8640 1 -- 172.21.15.78:0/3382824612 shutdown_connections 2024-09-11T00:15:14.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.814+0000 7fdf8d2c8640 1 -- 172.21.15.78:0/3382824612 >> 172.21.15.78:0/3382824612 conn(0x7fdf880fd700 msgr2=0x7fdf8806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:14.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.814+0000 7fdf8d2c8640 1 -- 172.21.15.78:0/3382824612 shutdown_connections 2024-09-11T00:15:14.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:14.814+0000 7fdf8d2c8640 1 -- 172.21.15.78:0/3382824612 wait complete. 2024-09-11T00:15:14.829 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:15.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:14 smithi138 ceph-mon[35019]: pgmap v284: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:15.183 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:15.183 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:15.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:14 smithi112 ceph-mon[35627]: pgmap v284: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:16.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.058+0000 7f99109d1640 1 -- 172.21.15.78:0/1116232388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f990c105590 msgr2=0x7f990c1059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:16.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.058+0000 7f99109d1640 1 --2- 172.21.15.78:0/1116232388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f990c105590 0x7f990c1059d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009900 tx=0x7f98fc02a410 comp rx=0 tx=0).stop 2024-09-11T00:15:16.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.058+0000 7f99109d1640 1 -- 172.21.15.78:0/1116232388 shutdown_connections 2024-09-11T00:15:16.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.058+0000 7f99109d1640 1 --2- 172.21.15.78:0/1116232388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f990c105f10 0x7f990c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.058+0000 7f99109d1640 1 --2- 172.21.15.78:0/1116232388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f990c105590 0x7f990c1059d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.058+0000 7f99109d1640 1 --2- 172.21.15.78:0/1116232388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990c1011e0 0x7f990c1015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.058+0000 7f99109d1640 1 -- 172.21.15.78:0/1116232388 >> 172.21.15.78:0/1116232388 conn(0x7f990c078060 msgr2=0x7f990c0ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:16.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.058+0000 7f99109d1640 1 -- 172.21.15.78:0/1116232388 shutdown_connections 2024-09-11T00:15:16.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.058+0000 7f99109d1640 1 -- 172.21.15.78:0/1116232388 wait complete. 2024-09-11T00:15:16.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.059+0000 7f99109d1640 1 Processor -- start 2024-09-11T00:15:16.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.059+0000 7f99109d1640 1 -- start start 2024-09-11T00:15:16.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.059+0000 7f99109d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f990c1011e0 0x7f990c1021b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:16.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.059+0000 7f99109d1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990c105590 0x7f990c1026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:16.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.059+0000 7f99109d1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f990c105f10 0x7f990c102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:16.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.059+0000 7f99109d1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f990c112e10 con 0x7f990c1011e0 2024-09-11T00:15:16.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.059+0000 7f99109d1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f990c112c90 con 0x7f990c105590 2024-09-11T00:15:16.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.059+0000 7f99109d1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f990c112f90 con 0x7f990c105f10 2024-09-11T00:15:16.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.059+0000 7f990a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f990c1011e0 0x7f990c1021b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:16.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.059+0000 7f990a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f990c1011e0 0x7f990c1021b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44776/0 (socket says 172.21.15.78:44776) 2024-09-11T00:15:16.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.059+0000 7f990a59c640 1 -- 172.21.15.78:0/1338350728 learned_addr learned my addr 172.21.15.78:0/1338350728 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:16.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.060+0000 7f9909d9b640 1 --2- 172.21.15.78:0/1338350728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990c105590 0x7f990c1026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:16.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.060+0000 7f990ad9d640 1 --2- 172.21.15.78:0/1338350728 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f990c105f10 0x7f990c102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:16.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.060+0000 7f990a59c640 1 -- 172.21.15.78:0/1338350728 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f990c105f10 msgr2=0x7f990c102c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:16.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.060+0000 7f990a59c640 1 --2- 172.21.15.78:0/1338350728 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f990c105f10 0x7f990c102c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.060+0000 7f990a59c640 1 -- 172.21.15.78:0/1338350728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990c105590 msgr2=0x7f990c1026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:16.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.060+0000 7f990a59c640 1 --2- 172.21.15.78:0/1338350728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990c105590 0x7f990c1026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.060+0000 7f990a59c640 1 -- 172.21.15.78:0/1338350728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990c1a76a0 con 0x7f990c1011e0 2024-09-11T00:15:16.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.060+0000 7f990a59c640 1 --2- 172.21.15.78:0/1338350728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f990c1011e0 0x7f990c1021b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f98f400b4a0 tx=0x7f98f400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:16.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.060+0000 7f99037fe640 1 -- 172.21.15.78:0/1338350728 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f4014070 con 0x7f990c1011e0 2024-09-11T00:15:16.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.060+0000 7f99037fe640 1 -- 172.21.15.78:0/1338350728 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98f4010ac0 con 0x7f990c1011e0 2024-09-11T00:15:16.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.060+0000 7f99109d1640 1 -- 172.21.15.78:0/1338350728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f990c1a7990 con 0x7f990c1011e0 2024-09-11T00:15:16.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.060+0000 7f99037fe640 1 -- 172.21.15.78:0/1338350728 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f4017c30 con 0x7f990c1011e0 2024-09-11T00:15:16.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.060+0000 7f99109d1640 1 -- 172.21.15.78:0/1338350728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f990c1a7f20 con 0x7f990c1011e0 2024-09-11T00:15:16.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.061+0000 7f99109d1640 1 -- 172.21.15.78:0/1338350728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f990c1015c0 con 0x7f990c1011e0 2024-09-11T00:15:16.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.062+0000 7f99037fe640 1 -- 172.21.15.78:0/1338350728 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f98f4010610 con 0x7f990c1011e0 2024-09-11T00:15:16.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.063+0000 7f99037fe640 1 --2- 172.21.15.78:0/1338350728 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f98f80b53c0 0x7f98f80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:16.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.063+0000 7f9909d9b640 1 --2- 172.21.15.78:0/1338350728 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f98f80b53c0 0x7f98f80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:16.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.063+0000 7f99037fe640 1 -- 172.21.15.78:0/1338350728 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f98f40e5790 con 0x7f990c1011e0 2024-09-11T00:15:16.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.064+0000 7f9909d9b640 1 --2- 172.21.15.78:0/1338350728 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f98f80b53c0 0x7f98f80b7880 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f98fc031440 tx=0x7f98fc005e80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:16.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.067+0000 7f99037fe640 1 -- 172.21.15.78:0/1338350728 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f98f40ac410 con 0x7f990c1011e0 2024-09-11T00:15:16.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.247+0000 7f99109d1640 1 -- 172.21.15.78:0/1338350728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f990c02e5c0 con 0x7f990c1011e0 2024-09-11T00:15:16.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.247+0000 7f99037fe640 1 -- 172.21.15.78:0/1338350728 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f98f40abd10 con 0x7f990c1011e0 2024-09-11T00:15:16.249 INFO:teuthology.orchestra.run.smithi078.stdout:176093659185 2024-09-11T00:15:16.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.249+0000 7f99109d1640 1 -- 172.21.15.78:0/1338350728 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f98f80b53c0 msgr2=0x7f98f80b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:16.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.249+0000 7f99109d1640 1 --2- 172.21.15.78:0/1338350728 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f98f80b53c0 0x7f98f80b7880 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f98fc031440 tx=0x7f98fc005e80 comp rx=0 tx=0).stop 2024-09-11T00:15:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.249+0000 7f99109d1640 1 -- 172.21.15.78:0/1338350728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f990c1011e0 msgr2=0x7f990c1021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.249+0000 7f99109d1640 1 --2- 172.21.15.78:0/1338350728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f990c1011e0 0x7f990c1021b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f98f400b4a0 tx=0x7f98f400b960 comp rx=0 tx=0).stop 2024-09-11T00:15:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.250+0000 7f99109d1640 1 -- 172.21.15.78:0/1338350728 shutdown_connections 2024-09-11T00:15:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.250+0000 7f99109d1640 1 --2- 172.21.15.78:0/1338350728 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f98f80b53c0 0x7f98f80b7880 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.250+0000 7f99109d1640 1 --2- 172.21.15.78:0/1338350728 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f990c105f10 0x7f990c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.250+0000 7f99109d1640 1 --2- 172.21.15.78:0/1338350728 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f990c105590 0x7f990c1026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.250+0000 7f99109d1640 1 --2- 172.21.15.78:0/1338350728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f990c1011e0 0x7f990c1021b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.250+0000 7f99109d1640 1 -- 172.21.15.78:0/1338350728 >> 172.21.15.78:0/1338350728 conn(0x7f990c078060 msgr2=0x7f990c108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.250+0000 7f99109d1640 1 -- 172.21.15.78:0/1338350728 shutdown_connections 2024-09-11T00:15:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.250+0000 7f99109d1640 1 -- 172.21.15.78:0/1338350728 wait complete. 2024-09-11T00:15:16.727 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:16.728 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:16.764 INFO:teuthology.orchestra.run.smithi078.stdout:103079215167 2024-09-11T00:15:16.764 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-11T00:15:16.828 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:16 smithi078 ceph-mon[30865]: pgmap v285: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:16.829 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:16 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1338350728' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-11T00:15:16.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.914+0000 7ff3a64a5640 1 -- 172.21.15.78:0/3848509584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3a01076a0 msgr2=0x7ff3a0107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:16.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.914+0000 7ff3a64a5640 1 --2- 172.21.15.78:0/3848509584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3a01076a0 0x7ff3a0107ae0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff388009900 tx=0x7ff38802a410 comp rx=0 tx=0).stop 2024-09-11T00:15:16.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.914+0000 7ff3a64a5640 1 -- 172.21.15.78:0/3848509584 shutdown_connections 2024-09-11T00:15:16.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.915+0000 7ff3a64a5640 1 --2- 172.21.15.78:0/3848509584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3a0108020 0x7ff3a010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.915+0000 7ff3a64a5640 1 --2- 172.21.15.78:0/3848509584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3a01076a0 0x7ff3a0107ae0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.915+0000 7ff3a64a5640 1 --2- 172.21.15.78:0/3848509584 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3a0101c90 0x7ff3a0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.915+0000 7ff3a64a5640 1 -- 172.21.15.78:0/3848509584 >> 172.21.15.78:0/3848509584 conn(0x7ff3a00fd700 msgr2=0x7ff3a00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:16.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.915+0000 7ff3a64a5640 1 -- 172.21.15.78:0/3848509584 shutdown_connections 2024-09-11T00:15:16.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.915+0000 7ff3a64a5640 1 -- 172.21.15.78:0/3848509584 wait complete. 2024-09-11T00:15:16.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.915+0000 7ff3a64a5640 1 Processor -- start 2024-09-11T00:15:16.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.915+0000 7ff3a64a5640 1 -- start start 2024-09-11T00:15:16.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.915+0000 7ff3a64a5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3a0101c90 0x7ff3a0199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:16.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.915+0000 7ff3a64a5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3a01076a0 0x7ff3a0199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:16.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.915+0000 7ff3a64a5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3a0108020 0x7ff3a019ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:16.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.915+0000 7ff3a64a5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a0111ce0 con 0x7ff3a0101c90 2024-09-11T00:15:16.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.915+0000 7ff3a64a5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a0111b60 con 0x7ff3a01076a0 2024-09-11T00:15:16.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.915+0000 7ff3a64a5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a0111e60 con 0x7ff3a0108020 2024-09-11T00:15:16.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.915+0000 7ff39ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3a0101c90 0x7ff3a0199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:16.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.916+0000 7ff39ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3a0101c90 0x7ff3a0199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44802/0 (socket says 172.21.15.78:44802) 2024-09-11T00:15:16.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.916+0000 7ff39ffff640 1 -- 172.21.15.78:0/1835912683 learned_addr learned my addr 172.21.15.78:0/1835912683 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:16.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.916+0000 7ff3a4a42640 1 --2- 172.21.15.78:0/1835912683 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3a0108020 0x7ff3a019ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:16.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.916+0000 7ff397fff640 1 --2- 172.21.15.78:0/1835912683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3a01076a0 0x7ff3a0199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:16.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.916+0000 7ff39ffff640 1 -- 172.21.15.78:0/1835912683 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3a0108020 msgr2=0x7ff3a019ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:16.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.916+0000 7ff39ffff640 1 --2- 172.21.15.78:0/1835912683 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3a0108020 0x7ff3a019ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.916+0000 7ff39ffff640 1 -- 172.21.15.78:0/1835912683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3a01076a0 msgr2=0x7ff3a0199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:16.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.916+0000 7ff39ffff640 1 --2- 172.21.15.78:0/1835912683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3a01076a0 0x7ff3a0199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:16.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.916+0000 7ff39ffff640 1 -- 172.21.15.78:0/1835912683 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a019f3c0 con 0x7ff3a0101c90 2024-09-11T00:15:16.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.916+0000 7ff3a4a42640 1 --2- 172.21.15.78:0/1835912683 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3a0108020 0x7ff3a019ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:16.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.916+0000 7ff397fff640 1 --2- 172.21.15.78:0/1835912683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3a01076a0 0x7ff3a0199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:16.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.916+0000 7ff39ffff640 1 --2- 172.21.15.78:0/1835912683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3a0101c90 0x7ff3a0199310 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff39000d770 tx=0x7ff39000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:16.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.916+0000 7ff39dffb640 1 -- 172.21.15.78:0/1835912683 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff390017070 con 0x7ff3a0101c90 2024-09-11T00:15:16.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.916+0000 7ff3a64a5640 1 -- 172.21.15.78:0/1835912683 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a019f6b0 con 0x7ff3a0101c90 2024-09-11T00:15:16.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.916+0000 7ff39dffb640 1 -- 172.21.15.78:0/1835912683 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3900054d0 con 0x7ff3a0101c90 2024-09-11T00:15:16.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.916+0000 7ff39dffb640 1 -- 172.21.15.78:0/1835912683 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff390004c30 con 0x7ff3a0101c90 2024-09-11T00:15:16.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.916+0000 7ff3a64a5640 1 -- 172.21.15.78:0/1835912683 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a01a5d70 con 0x7ff3a0101c90 2024-09-11T00:15:16.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.917+0000 7ff3a64a5640 1 -- 172.21.15.78:0/1835912683 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3a0102070 con 0x7ff3a0101c90 2024-09-11T00:15:16.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.919+0000 7ff39dffb640 1 -- 172.21.15.78:0/1835912683 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7ff390004dd0 con 0x7ff3a0101c90 2024-09-11T00:15:16.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.920+0000 7ff39dffb640 1 --2- 172.21.15.78:0/1835912683 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff38c0b53c0 0x7ff38c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:16.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.920+0000 7ff397fff640 1 --2- 172.21.15.78:0/1835912683 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff38c0b53c0 0x7ff38c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:16.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.920+0000 7ff39dffb640 1 -- 172.21.15.78:0/1835912683 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ff3900e5e90 con 0x7ff3a0101c90 2024-09-11T00:15:16.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.920+0000 7ff397fff640 1 --2- 172.21.15.78:0/1835912683 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff38c0b53c0 0x7ff38c0b7880 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff388031440 tx=0x7ff388005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:16.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:16.923+0000 7ff39dffb640 1 -- 172.21.15.78:0/1835912683 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff3900acab0 con 0x7ff3a0101c90 2024-09-11T00:15:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:16 smithi138 ceph-mon[35019]: pgmap v285: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:16 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1338350728' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-11T00:15:17.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.110+0000 7ff3a64a5640 1 -- 172.21.15.78:0/1835912683 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7ff3a019a440 con 0x7ff3a0101c90 2024-09-11T00:15:17.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.110+0000 7ff39dffb640 1 -- 172.21.15.78:0/1835912683 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff3a019a440 con 0x7ff3a0101c90 2024-09-11T00:15:17.112 INFO:teuthology.orchestra.run.smithi078.stdout:38654705742 2024-09-11T00:15:17.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.112+0000 7ff3a64a5640 1 -- 172.21.15.78:0/1835912683 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff38c0b53c0 msgr2=0x7ff38c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:17.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.112+0000 7ff3a64a5640 1 --2- 172.21.15.78:0/1835912683 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff38c0b53c0 0x7ff38c0b7880 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff388031440 tx=0x7ff388005a20 comp rx=0 tx=0).stop 2024-09-11T00:15:17.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.112+0000 7ff3a64a5640 1 -- 172.21.15.78:0/1835912683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3a0101c90 msgr2=0x7ff3a0199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:17.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.112+0000 7ff3a64a5640 1 --2- 172.21.15.78:0/1835912683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3a0101c90 0x7ff3a0199310 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff39000d770 tx=0x7ff39000dc30 comp rx=0 tx=0).stop 2024-09-11T00:15:17.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.112+0000 7ff3a64a5640 1 -- 172.21.15.78:0/1835912683 shutdown_connections 2024-09-11T00:15:17.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.112+0000 7ff3a64a5640 1 --2- 172.21.15.78:0/1835912683 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff38c0b53c0 0x7ff38c0b7880 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:17.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.112+0000 7ff3a64a5640 1 --2- 172.21.15.78:0/1835912683 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3a0108020 0x7ff3a019ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:17.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.112+0000 7ff3a64a5640 1 --2- 172.21.15.78:0/1835912683 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3a01076a0 0x7ff3a0199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:17.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.112+0000 7ff3a64a5640 1 --2- 172.21.15.78:0/1835912683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3a0101c90 0x7ff3a0199310 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:17.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.112+0000 7ff3a64a5640 1 -- 172.21.15.78:0/1835912683 >> 172.21.15.78:0/1835912683 conn(0x7ff3a00fd700 msgr2=0x7ff3a006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:17.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.113+0000 7ff3a64a5640 1 -- 172.21.15.78:0/1835912683 shutdown_connections 2024-09-11T00:15:17.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.113+0000 7ff3a64a5640 1 -- 172.21.15.78:0/1835912683 wait complete. 2024-09-11T00:15:17.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:16 smithi112 ceph-mon[35627]: pgmap v285: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:17.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:16 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1338350728' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-11T00:15:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.790+0000 7f23ecd75640 1 -- 172.21.15.78:0/4229146288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23e81087d0 msgr2=0x7f23e8108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.790+0000 7f23ecd75640 1 --2- 172.21.15.78:0/4229146288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23e81087d0 0x7f23e8108c10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009900 tx=0x7f23d802a410 comp rx=0 tx=0).stop 2024-09-11T00:15:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.790+0000 7f23ecd75640 1 -- 172.21.15.78:0/4229146288 shutdown_connections 2024-09-11T00:15:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.790+0000 7f23ecd75640 1 --2- 172.21.15.78:0/4229146288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23e8109150 0x7f23e810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.790+0000 7f23ecd75640 1 --2- 172.21.15.78:0/4229146288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23e81087d0 0x7f23e8108c10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.790+0000 7f23ecd75640 1 --2- 172.21.15.78:0/4229146288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23e8102dc0 0x7f23e81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.790+0000 7f23ecd75640 1 -- 172.21.15.78:0/4229146288 >> 172.21.15.78:0/4229146288 conn(0x7f23e80fe830 msgr2=0x7f23e8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.790+0000 7f23ecd75640 1 -- 172.21.15.78:0/4229146288 shutdown_connections 2024-09-11T00:15:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.790+0000 7f23ecd75640 1 -- 172.21.15.78:0/4229146288 wait complete. 2024-09-11T00:15:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.791+0000 7f23ecd75640 1 Processor -- start 2024-09-11T00:15:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.791+0000 7f23ecd75640 1 -- start start 2024-09-11T00:15:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.791+0000 7f23ecd75640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23e8102dc0 0x7f23e80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.791+0000 7f23ecd75640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23e81087d0 0x7f23e80759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.791+0000 7f23ecd75640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23e8109150 0x7f23e8075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.791+0000 7f23ecd75640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f23e8112e10 con 0x7f23e8109150 2024-09-11T00:15:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.791+0000 7f23ecd75640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f23e8112c90 con 0x7f23e81087d0 2024-09-11T00:15:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.791+0000 7f23ecd75640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f23e8112f90 con 0x7f23e8102dc0 2024-09-11T00:15:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.791+0000 7f23e6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23e8109150 0x7f23e8075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.791+0000 7f23e6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23e8109150 0x7f23e8075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44824/0 (socket says 172.21.15.78:44824) 2024-09-11T00:15:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.791+0000 7f23e6d9d640 1 -- 172.21.15.78:0/2716419778 learned_addr learned my addr 172.21.15.78:0/2716419778 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.791+0000 7f23e659c640 1 --2- 172.21.15.78:0/2716419778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23e8102dc0 0x7f23e80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.791+0000 7f23e5d9b640 1 --2- 172.21.15.78:0/2716419778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23e81087d0 0x7f23e80759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.791+0000 7f23e6d9d640 1 -- 172.21.15.78:0/2716419778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23e8102dc0 msgr2=0x7f23e80754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:17.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.791+0000 7f23e6d9d640 1 --2- 172.21.15.78:0/2716419778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23e8102dc0 0x7f23e80754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:17.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.791+0000 7f23e6d9d640 1 -- 172.21.15.78:0/2716419778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23e81087d0 msgr2=0x7f23e80759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:17.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.791+0000 7f23e6d9d640 1 --2- 172.21.15.78:0/2716419778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23e81087d0 0x7f23e80759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:17.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.791+0000 7f23e6d9d640 1 -- 172.21.15.78:0/2716419778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e81a76c0 con 0x7f23e8109150 2024-09-11T00:15:17.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.791+0000 7f23e659c640 1 --2- 172.21.15.78:0/2716419778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23e8102dc0 0x7f23e80754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:17.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.792+0000 7f23e6d9d640 1 --2- 172.21.15.78:0/2716419778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23e8109150 0x7f23e8075f20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f23e000cce0 tx=0x7f23e000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:17.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.792+0000 7f23d77fe640 1 -- 172.21.15.78:0/2716419778 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e000f450 con 0x7f23e8109150 2024-09-11T00:15:17.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.792+0000 7f23ecd75640 1 -- 172.21.15.78:0/2716419778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e81a79b0 con 0x7f23e8109150 2024-09-11T00:15:17.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.792+0000 7f23d77fe640 1 -- 172.21.15.78:0/2716419778 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23e000faa0 con 0x7f23e8109150 2024-09-11T00:15:17.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.792+0000 7f23d77fe640 1 -- 172.21.15.78:0/2716419778 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e0018b70 con 0x7f23e8109150 2024-09-11T00:15:17.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.792+0000 7f23ecd75640 1 -- 172.21.15.78:0/2716419778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e81a7f40 con 0x7f23e8109150 2024-09-11T00:15:17.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.793+0000 7f23ecd75640 1 -- 172.21.15.78:0/2716419778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e81031a0 con 0x7f23e8109150 2024-09-11T00:15:17.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.794+0000 7f23d77fe640 1 -- 172.21.15.78:0/2716419778 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f23e000f5f0 con 0x7f23e8109150 2024-09-11T00:15:17.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.795+0000 7f23d77fe640 1 --2- 172.21.15.78:0/2716419778 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f23d00b53c0 0x7f23d00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:17.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.795+0000 7f23e659c640 1 --2- 172.21.15.78:0/2716419778 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f23d00b53c0 0x7f23d00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:17.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.795+0000 7f23d77fe640 1 -- 172.21.15.78:0/2716419778 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f23e00e6740 con 0x7f23e8109150 2024-09-11T00:15:17.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.795+0000 7f23e659c640 1 --2- 172.21.15.78:0/2716419778 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f23d00b53c0 0x7f23d00b7880 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009930 tx=0x7f23dc008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:17.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.798+0000 7f23d77fe640 1 -- 172.21.15.78:0/2716419778 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f23e0014030 con 0x7f23e8109150 2024-09-11T00:15:17.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.983+0000 7f23ecd75640 1 -- 172.21.15.78:0/2716419778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f23e802e5c0 con 0x7f23e8109150 2024-09-11T00:15:17.985 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:17 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1835912683' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-11T00:15:17.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.984+0000 7f23d77fe640 1 -- 172.21.15.78:0/2716419778 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f23e00ad450 con 0x7f23e8109150 2024-09-11T00:15:17.986 INFO:teuthology.orchestra.run.smithi078.stdout:60129542217 2024-09-11T00:15:17.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.986+0000 7f23ecd75640 1 -- 172.21.15.78:0/2716419778 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f23d00b53c0 msgr2=0x7f23d00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:17.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.986+0000 7f23ecd75640 1 --2- 172.21.15.78:0/2716419778 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f23d00b53c0 0x7f23d00b7880 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009930 tx=0x7f23dc008040 comp rx=0 tx=0).stop 2024-09-11T00:15:17.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.986+0000 7f23ecd75640 1 -- 172.21.15.78:0/2716419778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23e8109150 msgr2=0x7f23e8075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:17.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.986+0000 7f23ecd75640 1 --2- 172.21.15.78:0/2716419778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23e8109150 0x7f23e8075f20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f23e000cce0 tx=0x7f23e000a620 comp rx=0 tx=0).stop 2024-09-11T00:15:17.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.986+0000 7f23ecd75640 1 -- 172.21.15.78:0/2716419778 shutdown_connections 2024-09-11T00:15:17.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.986+0000 7f23ecd75640 1 --2- 172.21.15.78:0/2716419778 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f23d00b53c0 0x7f23d00b7880 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:17.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.986+0000 7f23ecd75640 1 --2- 172.21.15.78:0/2716419778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23e8109150 0x7f23e8075f20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:17.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.986+0000 7f23ecd75640 1 --2- 172.21.15.78:0/2716419778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f23e81087d0 0x7f23e80759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:17.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.986+0000 7f23ecd75640 1 --2- 172.21.15.78:0/2716419778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23e8102dc0 0x7f23e80754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:17.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.986+0000 7f23ecd75640 1 -- 172.21.15.78:0/2716419778 >> 172.21.15.78:0/2716419778 conn(0x7f23e80fe830 msgr2=0x7f23e8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:17.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.986+0000 7f23ecd75640 1 -- 172.21.15.78:0/2716419778 shutdown_connections 2024-09-11T00:15:17.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:17.986+0000 7f23ecd75640 1 -- 172.21.15.78:0/2716419778 wait complete. 2024-09-11T00:15:18.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:17 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1835912683' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-11T00:15:18.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:17 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1835912683' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-11T00:15:18.266 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659184 got 176093659185 for osd.6 2024-09-11T00:15:18.267 DEBUG:teuthology.parallel:result is None 2024-09-11T00:15:18.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.450+0000 7f26c45e2640 1 -- 172.21.15.78:0/321231103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26bc108020 msgr2=0x7f26bc10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:18.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.450+0000 7f26c45e2640 1 --2- 172.21.15.78:0/321231103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26bc108020 0x7f26bc10e820 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009ca0 tx=0x7f26b402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:18.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.450+0000 7f26c45e2640 1 -- 172.21.15.78:0/321231103 shutdown_connections 2024-09-11T00:15:18.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.450+0000 7f26c45e2640 1 --2- 172.21.15.78:0/321231103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26bc108020 0x7f26bc10e820 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:18.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.450+0000 7f26c45e2640 1 --2- 172.21.15.78:0/321231103 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26bc1076a0 0x7f26bc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:18.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.450+0000 7f26c45e2640 1 --2- 172.21.15.78:0/321231103 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26bc101c90 0x7f26bc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:18.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.450+0000 7f26c45e2640 1 -- 172.21.15.78:0/321231103 >> 172.21.15.78:0/321231103 conn(0x7f26bc0fd6e0 msgr2=0x7f26bc0ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:18.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.450+0000 7f26c45e2640 1 -- 172.21.15.78:0/321231103 shutdown_connections 2024-09-11T00:15:18.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.450+0000 7f26c45e2640 1 -- 172.21.15.78:0/321231103 wait complete. 2024-09-11T00:15:18.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.451+0000 7f26c45e2640 1 Processor -- start 2024-09-11T00:15:18.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.451+0000 7f26c45e2640 1 -- start start 2024-09-11T00:15:18.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.451+0000 7f26c45e2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26bc101c90 0x7f26bc199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:18.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.451+0000 7f26c45e2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26bc1076a0 0x7f26bc199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:18.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.452+0000 7f26c45e2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26bc108020 0x7f26bc19eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:18.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.452+0000 7f26c45e2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc112e00 con 0x7f26bc101c90 2024-09-11T00:15:18.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.452+0000 7f26c45e2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc112c80 con 0x7f26bc1076a0 2024-09-11T00:15:18.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.452+0000 7f26c45e2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc112f80 con 0x7f26bc108020 2024-09-11T00:15:18.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.452+0000 7f26c237e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26bc101c90 0x7f26bc199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:18.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.452+0000 7f26c237e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26bc101c90 0x7f26bc199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44838/0 (socket says 172.21.15.78:44838) 2024-09-11T00:15:18.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.452+0000 7f26c237e640 1 -- 172.21.15.78:0/651448394 learned_addr learned my addr 172.21.15.78:0/651448394 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:18.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.452+0000 7f26c1b7d640 1 --2- 172.21.15.78:0/651448394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26bc1076a0 0x7f26bc199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:18.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.452+0000 7f26c2b7f640 1 --2- 172.21.15.78:0/651448394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26bc108020 0x7f26bc19eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:18.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.452+0000 7f26c237e640 1 -- 172.21.15.78:0/651448394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26bc108020 msgr2=0x7f26bc19eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:18.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.452+0000 7f26c237e640 1 --2- 172.21.15.78:0/651448394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26bc108020 0x7f26bc19eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:18.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.452+0000 7f26c237e640 1 -- 172.21.15.78:0/651448394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26bc1076a0 msgr2=0x7f26bc199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:18.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.452+0000 7f26c237e640 1 --2- 172.21.15.78:0/651448394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26bc1076a0 0x7f26bc199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:18.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.452+0000 7f26c237e640 1 -- 172.21.15.78:0/651448394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26bc19f2e0 con 0x7f26bc101c90 2024-09-11T00:15:18.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.452+0000 7f26c237e640 1 --2- 172.21.15.78:0/651448394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26bc101c90 0x7f26bc199230 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f26b800c970 tx=0x7f26b800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:18.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.452+0000 7f26b37fe640 1 -- 172.21.15.78:0/651448394 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b8007bb0 con 0x7f26bc101c90 2024-09-11T00:15:18.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.452+0000 7f26b37fe640 1 -- 172.21.15.78:0/651448394 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26b8007d50 con 0x7f26bc101c90 2024-09-11T00:15:18.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.452+0000 7f26c45e2640 1 -- 172.21.15.78:0/651448394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26bc19f5d0 con 0x7f26bc101c90 2024-09-11T00:15:18.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.452+0000 7f26b37fe640 1 -- 172.21.15.78:0/651448394 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b800f450 con 0x7f26bc101c90 2024-09-11T00:15:18.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.452+0000 7f26c45e2640 1 -- 172.21.15.78:0/651448394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26bc1a5c90 con 0x7f26bc101c90 2024-09-11T00:15:18.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.453+0000 7f26c45e2640 1 -- 172.21.15.78:0/651448394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26bc102070 con 0x7f26bc101c90 2024-09-11T00:15:18.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.455+0000 7f26b37fe640 1 -- 172.21.15.78:0/651448394 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f26b8004f00 con 0x7f26bc101c90 2024-09-11T00:15:18.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.456+0000 7f26b37fe640 1 --2- 172.21.15.78:0/651448394 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f26a80b53c0 0x7f26a80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:18.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.456+0000 7f26c1b7d640 1 --2- 172.21.15.78:0/651448394 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f26a80b53c0 0x7f26a80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:18.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.456+0000 7f26b37fe640 1 -- 172.21.15.78:0/651448394 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f26b80e5f90 con 0x7f26bc101c90 2024-09-11T00:15:18.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.457+0000 7f26c1b7d640 1 --2- 172.21.15.78:0/651448394 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f26a80b53c0 0x7f26a80b7880 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f26bc1071d0 tx=0x7f26ac00a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:18.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.459+0000 7f26b37fe640 1 -- 172.21.15.78:0/651448394 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f26b8014030 con 0x7f26bc101c90 2024-09-11T00:15:18.490 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:18.490 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:18.491 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:18.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.650+0000 7f26c45e2640 1 -- 172.21.15.78:0/651448394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f26bc1a5ff0 con 0x7f26bc101c90 2024-09-11T00:15:18.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.650+0000 7f26b37fe640 1 -- 172.21.15.78:0/651448394 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f26b80acc10 con 0x7f26bc101c90 2024-09-11T00:15:18.652 INFO:teuthology.orchestra.run.smithi078.stdout:296352743448 2024-09-11T00:15:18.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.652+0000 7f26c45e2640 1 -- 172.21.15.78:0/651448394 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f26a80b53c0 msgr2=0x7f26a80b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:18.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.652+0000 7f26c45e2640 1 --2- 172.21.15.78:0/651448394 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f26a80b53c0 0x7f26a80b7880 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f26bc1071d0 tx=0x7f26ac00a2d0 comp rx=0 tx=0).stop 2024-09-11T00:15:18.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.652+0000 7f26c45e2640 1 -- 172.21.15.78:0/651448394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26bc101c90 msgr2=0x7f26bc199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:18.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.652+0000 7f26c45e2640 1 --2- 172.21.15.78:0/651448394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26bc101c90 0x7f26bc199230 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f26b800c970 tx=0x7f26b800ce30 comp rx=0 tx=0).stop 2024-09-11T00:15:18.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.652+0000 7f26c45e2640 1 -- 172.21.15.78:0/651448394 shutdown_connections 2024-09-11T00:15:18.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.652+0000 7f26c45e2640 1 --2- 172.21.15.78:0/651448394 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f26a80b53c0 0x7f26a80b7880 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:18.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.652+0000 7f26c45e2640 1 --2- 172.21.15.78:0/651448394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26bc108020 0x7f26bc19eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:18.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.652+0000 7f26c45e2640 1 --2- 172.21.15.78:0/651448394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26bc1076a0 0x7f26bc199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:18.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.652+0000 7f26c45e2640 1 --2- 172.21.15.78:0/651448394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26bc101c90 0x7f26bc199230 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:18.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.652+0000 7f26c45e2640 1 -- 172.21.15.78:0/651448394 >> 172.21.15.78:0/651448394 conn(0x7f26bc0fd6e0 msgr2=0x7f26bc0ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:18.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.652+0000 7f26c45e2640 1 -- 172.21.15.78:0/651448394 shutdown_connections 2024-09-11T00:15:18.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:18.652+0000 7f26c45e2640 1 -- 172.21.15.78:0/651448394 wait complete. 2024-09-11T00:15:18.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:18 smithi078 ceph-mon[30865]: pgmap v286: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:18.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:18 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2716419778' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-11T00:15:18.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:18 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/651448394' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-11T00:15:19.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:18 smithi138 ceph-mon[35019]: pgmap v286: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:19.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:18 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2716419778' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-11T00:15:19.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:18 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/651448394' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-11T00:15:19.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:18 smithi112 ceph-mon[35627]: pgmap v286: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:19.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:18 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2716419778' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-11T00:15:19.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:18 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/651448394' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-11T00:15:19.753 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542215 got 60129542217 for osd.1 2024-09-11T00:15:19.754 DEBUG:teuthology.parallel:result is None 2024-09-11T00:15:20.192 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743445 got 296352743448 for osd.11 2024-09-11T00:15:20.192 DEBUG:teuthology.parallel:result is None 2024-09-11T00:15:20.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.788+0000 7f769cf84640 1 -- 172.21.15.78:0/1787013064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7698109140 msgr2=0x7f769810f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:20.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.788+0000 7f769cf84640 1 --2- 172.21.15.78:0/1787013064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7698109140 0x7f769810f940 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7690009ca0 tx=0x7f769002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.788+0000 7f769cf84640 1 -- 172.21.15.78:0/1787013064 shutdown_connections 2024-09-11T00:15:20.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.788+0000 7f769cf84640 1 --2- 172.21.15.78:0/1787013064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7698109140 0x7f769810f940 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.788+0000 7f769cf84640 1 --2- 172.21.15.78:0/1787013064 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76981087c0 0x7f7698108c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.788+0000 7f769cf84640 1 --2- 172.21.15.78:0/1787013064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7698102db0 0x7f7698103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.788+0000 7f769cf84640 1 -- 172.21.15.78:0/1787013064 >> 172.21.15.78:0/1787013064 conn(0x7f76980fe860 msgr2=0x7f7698100c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:20.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.788+0000 7f769cf84640 1 -- 172.21.15.78:0/1787013064 shutdown_connections 2024-09-11T00:15:20.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.788+0000 7f769cf84640 1 -- 172.21.15.78:0/1787013064 wait complete. 2024-09-11T00:15:20.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.789+0000 7f769cf84640 1 Processor -- start 2024-09-11T00:15:20.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.789+0000 7f769cf84640 1 -- start start 2024-09-11T00:15:20.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.789+0000 7f769cf84640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7698102db0 0x7f7698199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.789+0000 7f769cf84640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76981087c0 0x7f76981997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.789+0000 7f769cf84640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7698109140 0x7f769819eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.789+0000 7f769cf84640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7698112e00 con 0x7f76981087c0 2024-09-11T00:15:20.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.789+0000 7f769cf84640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7698112c80 con 0x7f7698102db0 2024-09-11T00:15:20.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.789+0000 7f769cf84640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7698112f80 con 0x7f7698109140 2024-09-11T00:15:20.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.789+0000 7f7695d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76981087c0 0x7f76981997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.789+0000 7f7695d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76981087c0 0x7f76981997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44866/0 (socket says 172.21.15.78:44866) 2024-09-11T00:15:20.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.789+0000 7f7695d9b640 1 -- 172.21.15.78:0/884718219 learned_addr learned my addr 172.21.15.78:0/884718219 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:20.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.789+0000 7f769659c640 1 --2- 172.21.15.78:0/884718219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7698102db0 0x7f7698199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.790+0000 7f7696d9d640 1 --2- 172.21.15.78:0/884718219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7698109140 0x7f769819eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.790+0000 7f7695d9b640 1 -- 172.21.15.78:0/884718219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7698109140 msgr2=0x7f769819eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:20.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.790+0000 7f7695d9b640 1 --2- 172.21.15.78:0/884718219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7698109140 0x7f769819eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.790+0000 7f7695d9b640 1 -- 172.21.15.78:0/884718219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7698102db0 msgr2=0x7f7698199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:20.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.790+0000 7f7695d9b640 1 --2- 172.21.15.78:0/884718219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7698102db0 0x7f7698199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.790+0000 7f7695d9b640 1 -- 172.21.15.78:0/884718219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769819f320 con 0x7f76981087c0 2024-09-11T00:15:20.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.790+0000 7f7695d9b640 1 --2- 172.21.15.78:0/884718219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76981087c0 0x7f76981997b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f768c00b4a0 tx=0x7f768c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:20.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.790+0000 7f76877fe640 1 -- 172.21.15.78:0/884718219 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f768c014070 con 0x7f76981087c0 2024-09-11T00:15:20.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.790+0000 7f76877fe640 1 -- 172.21.15.78:0/884718219 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f768c010ac0 con 0x7f76981087c0 2024-09-11T00:15:20.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.790+0000 7f769cf84640 1 -- 172.21.15.78:0/884718219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f769819f610 con 0x7f76981087c0 2024-09-11T00:15:20.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.790+0000 7f76877fe640 1 -- 172.21.15.78:0/884718219 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f768c017c30 con 0x7f76981087c0 2024-09-11T00:15:20.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.790+0000 7f769cf84640 1 -- 172.21.15.78:0/884718219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76981a5ea0 con 0x7f76981087c0 2024-09-11T00:15:20.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.791+0000 7f769cf84640 1 -- 172.21.15.78:0/884718219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7698103190 con 0x7f76981087c0 2024-09-11T00:15:20.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.793+0000 7f76877fe640 1 -- 172.21.15.78:0/884718219 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f768c010610 con 0x7f76981087c0 2024-09-11T00:15:20.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.794+0000 7f76877fe640 1 --2- 172.21.15.78:0/884718219 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f76800b5440 0x7f76800b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:20.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.794+0000 7f769659c640 1 --2- 172.21.15.78:0/884718219 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f76800b5440 0x7f76800b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:20.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.794+0000 7f76877fe640 1 -- 172.21.15.78:0/884718219 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f768c0e5750 con 0x7f76981087c0 2024-09-11T00:15:20.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.794+0000 7f769659c640 1 --2- 172.21.15.78:0/884718219 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f76800b5440 0x7f76800b7900 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f768800bbe0 tx=0x7f768800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:20.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.796+0000 7f76877fe640 1 -- 172.21.15.78:0/884718219 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f768c0ac370 con 0x7f76981087c0 2024-09-11T00:15:20.901 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:20.901 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:20.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.983+0000 7f769cf84640 1 -- 172.21.15.78:0/884718219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f76981a6140 con 0x7f76981087c0 2024-09-11T00:15:20.986 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:20 smithi078 ceph-mon[30865]: pgmap v287: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:20.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.984+0000 7f76877fe640 1 -- 172.21.15.78:0/884718219 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f768c0abc70 con 0x7f76981087c0 2024-09-11T00:15:20.986 INFO:teuthology.orchestra.run.smithi078.stdout:197568495659 2024-09-11T00:15:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.986+0000 7f769cf84640 1 -- 172.21.15.78:0/884718219 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f76800b5440 msgr2=0x7f76800b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.986+0000 7f769cf84640 1 --2- 172.21.15.78:0/884718219 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f76800b5440 0x7f76800b7900 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f768800bbe0 tx=0x7f768800b390 comp rx=0 tx=0).stop 2024-09-11T00:15:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.986+0000 7f769cf84640 1 -- 172.21.15.78:0/884718219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76981087c0 msgr2=0x7f76981997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.986+0000 7f769cf84640 1 --2- 172.21.15.78:0/884718219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76981087c0 0x7f76981997b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f768c00b4a0 tx=0x7f768c00b960 comp rx=0 tx=0).stop 2024-09-11T00:15:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.986+0000 7f769cf84640 1 -- 172.21.15.78:0/884718219 shutdown_connections 2024-09-11T00:15:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.986+0000 7f769cf84640 1 --2- 172.21.15.78:0/884718219 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f76800b5440 0x7f76800b7900 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.986+0000 7f769cf84640 1 --2- 172.21.15.78:0/884718219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7698109140 0x7f769819eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.986+0000 7f769cf84640 1 --2- 172.21.15.78:0/884718219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76981087c0 0x7f76981997b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.986+0000 7f769cf84640 1 --2- 172.21.15.78:0/884718219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7698102db0 0x7f7698199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.986+0000 7f769cf84640 1 -- 172.21.15.78:0/884718219 >> 172.21.15.78:0/884718219 conn(0x7f76980fe860 msgr2=0x7f7698100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.986+0000 7f769cf84640 1 -- 172.21.15.78:0/884718219 shutdown_connections 2024-09-11T00:15:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.986+0000 7f769cf84640 1 -- 172.21.15.78:0/884718219 wait complete. 2024-09-11T00:15:21.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:20 smithi138 ceph-mon[35019]: pgmap v287: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:21.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:20 smithi112 ceph-mon[35627]: pgmap v287: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:21.355 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705739 got 38654705742 for osd.0 2024-09-11T00:15:21.356 DEBUG:teuthology.parallel:result is None 2024-09-11T00:15:21.858 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:21 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3988869532' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-11T00:15:21.859 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:21 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/884718219' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-11T00:15:22.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:21 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3988869532' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-11T00:15:22.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:21 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/884718219' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-11T00:15:22.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.037+0000 7ff22dd44640 1 -- 172.21.15.78:0/3105982280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff22810d120 msgr2=0x7ff22810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:22.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.037+0000 7ff22dd44640 1 --2- 172.21.15.78:0/3105982280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff22810d120 0x7ff22810f550 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff220009ca0 tx=0x7ff22002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:22.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.037+0000 7ff22dd44640 1 -- 172.21.15.78:0/3105982280 shutdown_connections 2024-09-11T00:15:22.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.037+0000 7ff22dd44640 1 --2- 172.21.15.78:0/3105982280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff22810d120 0x7ff22810f550 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:22.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.037+0000 7ff22dd44640 1 --2- 172.21.15.78:0/3105982280 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff228104570 0x7ff22810cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:22.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.037+0000 7ff22dd44640 1 --2- 172.21.15.78:0/3105982280 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff228103b70 0x7ff228103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:22.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.037+0000 7ff22dd44640 1 -- 172.21.15.78:0/3105982280 >> 172.21.15.78:0/3105982280 conn(0x7ff2280fd700 msgr2=0x7ff2280ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:22.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.037+0000 7ff22dd44640 1 -- 172.21.15.78:0/3105982280 shutdown_connections 2024-09-11T00:15:22.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.037+0000 7ff22dd44640 1 -- 172.21.15.78:0/3105982280 wait complete. 2024-09-11T00:15:22.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.038+0000 7ff22dd44640 1 Processor -- start 2024-09-11T00:15:22.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.038+0000 7ff22dd44640 1 -- start start 2024-09-11T00:15:22.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.038+0000 7ff22dd44640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff228103b70 0x7ff2281019f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:22.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.038+0000 7ff22dd44640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff228104570 0x7ff228101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:22.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.038+0000 7ff22dd44640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff22810d120 0x7ff228102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:22.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.038+0000 7ff22dd44640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff228112da0 con 0x7ff228103b70 2024-09-11T00:15:22.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.038+0000 7ff22dd44640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff228112c20 con 0x7ff228104570 2024-09-11T00:15:22.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.038+0000 7ff22dd44640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff228112f20 con 0x7ff22810d120 2024-09-11T00:15:22.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.039+0000 7ff2277fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff228103b70 0x7ff2281019f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:22.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.039+0000 7ff2277fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff228103b70 0x7ff2281019f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44874/0 (socket says 172.21.15.78:44874) 2024-09-11T00:15:22.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.039+0000 7ff2277fe640 1 -- 172.21.15.78:0/3936314758 learned_addr learned my addr 172.21.15.78:0/3936314758 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:22.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.039+0000 7ff21effd640 1 --2- 172.21.15.78:0/3936314758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff228104570 0x7ff228101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:22.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.039+0000 7ff227fff640 1 --2- 172.21.15.78:0/3936314758 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff22810d120 0x7ff228102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:22.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.039+0000 7ff2277fe640 1 -- 172.21.15.78:0/3936314758 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff22810d120 msgr2=0x7ff228102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:22.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.039+0000 7ff2277fe640 1 --2- 172.21.15.78:0/3936314758 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff22810d120 0x7ff228102470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:22.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.039+0000 7ff2277fe640 1 -- 172.21.15.78:0/3936314758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff228104570 msgr2=0x7ff228101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:22.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.039+0000 7ff2277fe640 1 --2- 172.21.15.78:0/3936314758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff228104570 0x7ff228101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:22.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.039+0000 7ff2277fe640 1 -- 172.21.15.78:0/3936314758 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2281a7670 con 0x7ff228103b70 2024-09-11T00:15:22.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.039+0000 7ff21effd640 1 --2- 172.21.15.78:0/3936314758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff228104570 0x7ff228101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:22.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.039+0000 7ff2277fe640 1 --2- 172.21.15.78:0/3936314758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff228103b70 0x7ff2281019f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff21800b4a0 tx=0x7ff21800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:22.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.039+0000 7ff2257fa640 1 -- 172.21.15.78:0/3936314758 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218014070 con 0x7ff228103b70 2024-09-11T00:15:22.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.039+0000 7ff22dd44640 1 -- 172.21.15.78:0/3936314758 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2281a7960 con 0x7ff228103b70 2024-09-11T00:15:22.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.039+0000 7ff2257fa640 1 -- 172.21.15.78:0/3936314758 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff218010ac0 con 0x7ff228103b70 2024-09-11T00:15:22.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.039+0000 7ff2257fa640 1 -- 172.21.15.78:0/3936314758 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218017c30 con 0x7ff228103b70 2024-09-11T00:15:22.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.039+0000 7ff22dd44640 1 -- 172.21.15.78:0/3936314758 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2281a7ed0 con 0x7ff228103b70 2024-09-11T00:15:22.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.040+0000 7ff22dd44640 1 -- 172.21.15.78:0/3936314758 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff228103f50 con 0x7ff228103b70 2024-09-11T00:15:22.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.042+0000 7ff2257fa640 1 -- 172.21.15.78:0/3936314758 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7ff218010610 con 0x7ff228103b70 2024-09-11T00:15:22.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.043+0000 7ff2257fa640 1 --2- 172.21.15.78:0/3936314758 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff2140b53c0 0x7ff2140b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:22.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.043+0000 7ff21effd640 1 --2- 172.21.15.78:0/3936314758 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff2140b53c0 0x7ff2140b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:22.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.043+0000 7ff2257fa640 1 -- 172.21.15.78:0/3936314758 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ff2180e5930 con 0x7ff228103b70 2024-09-11T00:15:22.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.043+0000 7ff21effd640 1 --2- 172.21.15.78:0/3936314758 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff2140b53c0 0x7ff2140b7880 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff2281034e0 tx=0x7ff210005ec0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:22.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.046+0000 7ff2257fa640 1 -- 172.21.15.78:0/3936314758 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff2180ac550 con 0x7ff228103b70 2024-09-11T00:15:22.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.227+0000 7ff22dd44640 1 -- 172.21.15.78:0/3936314758 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff228102cf0 con 0x7ff228103b70 2024-09-11T00:15:22.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.228+0000 7ff2257fa640 1 -- 172.21.15.78:0/3936314758 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff228102cf0 con 0x7ff228103b70 2024-09-11T00:15:22.229 INFO:teuthology.orchestra.run.smithi078.stdout:150323855415 2024-09-11T00:15:22.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.230+0000 7ff22dd44640 1 -- 172.21.15.78:0/3936314758 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff2140b53c0 msgr2=0x7ff2140b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:22.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.230+0000 7ff22dd44640 1 --2- 172.21.15.78:0/3936314758 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff2140b53c0 0x7ff2140b7880 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff2281034e0 tx=0x7ff210005ec0 comp rx=0 tx=0).stop 2024-09-11T00:15:22.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.230+0000 7ff22dd44640 1 -- 172.21.15.78:0/3936314758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff228103b70 msgr2=0x7ff2281019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:22.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.230+0000 7ff22dd44640 1 --2- 172.21.15.78:0/3936314758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff228103b70 0x7ff2281019f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff21800b4a0 tx=0x7ff21800b960 comp rx=0 tx=0).stop 2024-09-11T00:15:22.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.230+0000 7ff22dd44640 1 -- 172.21.15.78:0/3936314758 shutdown_connections 2024-09-11T00:15:22.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.230+0000 7ff22dd44640 1 --2- 172.21.15.78:0/3936314758 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff2140b53c0 0x7ff2140b7880 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:22.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.230+0000 7ff22dd44640 1 --2- 172.21.15.78:0/3936314758 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff22810d120 0x7ff228102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:22.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.230+0000 7ff22dd44640 1 --2- 172.21.15.78:0/3936314758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff228104570 0x7ff228101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:22.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.230+0000 7ff22dd44640 1 --2- 172.21.15.78:0/3936314758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff228103b70 0x7ff2281019f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:22.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.230+0000 7ff22dd44640 1 -- 172.21.15.78:0/3936314758 >> 172.21.15.78:0/3936314758 conn(0x7ff2280fd700 msgr2=0x7ff22810f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:22.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.230+0000 7ff22dd44640 1 -- 172.21.15.78:0/3936314758 shutdown_connections 2024-09-11T00:15:22.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.230+0000 7ff22dd44640 1 -- 172.21.15.78:0/3936314758 wait complete. 2024-09-11T00:15:22.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:21 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3988869532' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-11T00:15:22.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:21 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/884718219' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-11T00:15:22.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.258+0000 7f1ac0ec4640 1 -- 172.21.15.78:0/1845753753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1abc10d100 msgr2=0x7f1abc10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:22.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.258+0000 7f1ac0ec4640 1 --2- 172.21.15.78:0/1845753753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1abc10d100 0x7f1abc10f560 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009ca0 tx=0x7f1ab402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:22.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.258+0000 7f1ac0ec4640 1 -- 172.21.15.78:0/1845753753 shutdown_connections 2024-09-11T00:15:22.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.258+0000 7f1ac0ec4640 1 --2- 172.21.15.78:0/1845753753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1abc10d100 0x7f1abc10f560 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:22.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.258+0000 7f1ac0ec4640 1 --2- 172.21.15.78:0/1845753753 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1abc1045c0 0x7f1abc10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:22.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.258+0000 7f1ac0ec4640 1 --2- 172.21.15.78:0/1845753753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1abc103ca0 0x7f1abc104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:22.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.258+0000 7f1ac0ec4640 1 -- 172.21.15.78:0/1845753753 >> 172.21.15.78:0/1845753753 conn(0x7f1abc0fd700 msgr2=0x7f1abc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:22.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.258+0000 7f1ac0ec4640 1 -- 172.21.15.78:0/1845753753 shutdown_connections 2024-09-11T00:15:22.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.258+0000 7f1ac0ec4640 1 -- 172.21.15.78:0/1845753753 wait complete. 2024-09-11T00:15:22.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.259+0000 7f1ac0ec4640 1 Processor -- start 2024-09-11T00:15:22.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.259+0000 7f1ac0ec4640 1 -- start start 2024-09-11T00:15:22.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.259+0000 7f1ac0ec4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1abc103ca0 0x7f1abc101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:22.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.260+0000 7f1ac0ec4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1abc1045c0 0x7f1abc101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:22.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.260+0000 7f1ac0ec4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1abc10d100 0x7f1abc1023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:22.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.260+0000 7f1ac0ec4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc112db0 con 0x7f1abc10d100 2024-09-11T00:15:22.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.260+0000 7f1ac0ec4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc112c30 con 0x7f1abc1045c0 2024-09-11T00:15:22.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.260+0000 7f1ac0ec4640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc112f30 con 0x7f1abc103ca0 2024-09-11T00:15:22.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.260+0000 7f1abad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1abc10d100 0x7f1abc1023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:22.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.260+0000 7f1abad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1abc10d100 0x7f1abc1023d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44896/0 (socket says 172.21.15.78:44896) 2024-09-11T00:15:22.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.260+0000 7f1abad9d640 1 -- 172.21.15.78:0/1920230367 learned_addr learned my addr 172.21.15.78:0/1920230367 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:22.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.260+0000 7f1aba59c640 1 --2- 172.21.15.78:0/1920230367 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1abc103ca0 0x7f1abc101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:22.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.260+0000 7f1ab9d9b640 1 --2- 172.21.15.78:0/1920230367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1abc1045c0 0x7f1abc101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:22.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.260+0000 7f1abad9d640 1 -- 172.21.15.78:0/1920230367 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1abc103ca0 msgr2=0x7f1abc101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:22.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.260+0000 7f1abad9d640 1 --2- 172.21.15.78:0/1920230367 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1abc103ca0 0x7f1abc101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:22.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.260+0000 7f1abad9d640 1 -- 172.21.15.78:0/1920230367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1abc1045c0 msgr2=0x7f1abc101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:22.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.260+0000 7f1abad9d640 1 --2- 172.21.15.78:0/1920230367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1abc1045c0 0x7f1abc101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:22.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.260+0000 7f1abad9d640 1 -- 172.21.15.78:0/1920230367 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1abc1a76e0 con 0x7f1abc10d100 2024-09-11T00:15:22.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.260+0000 7f1abad9d640 1 --2- 172.21.15.78:0/1920230367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1abc10d100 0x7f1abc1023d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4005cc0 tx=0x7f1ab402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:22.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.261+0000 7f1aab7fe640 1 -- 172.21.15.78:0/1920230367 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4003bf0 con 0x7f1abc10d100 2024-09-11T00:15:22.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.261+0000 7f1aab7fe640 1 -- 172.21.15.78:0/1920230367 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ab4003d90 con 0x7f1abc10d100 2024-09-11T00:15:22.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.261+0000 7f1aab7fe640 1 -- 172.21.15.78:0/1920230367 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab402fb20 con 0x7f1abc10d100 2024-09-11T00:15:22.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.261+0000 7f1ac0ec4640 1 -- 172.21.15.78:0/1920230367 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1abc1a7970 con 0x7f1abc10d100 2024-09-11T00:15:22.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.261+0000 7f1ac0ec4640 1 -- 172.21.15.78:0/1920230367 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1abc1a7f80 con 0x7f1abc10d100 2024-09-11T00:15:22.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.262+0000 7f1ac0ec4640 1 -- 172.21.15.78:0/1920230367 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1abc104080 con 0x7f1abc10d100 2024-09-11T00:15:22.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.263+0000 7f1aab7fe640 1 -- 172.21.15.78:0/1920230367 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f1ab4004580 con 0x7f1abc10d100 2024-09-11T00:15:22.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.264+0000 7f1aab7fe640 1 --2- 172.21.15.78:0/1920230367 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1aa40b5440 0x7f1aa40b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:22.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.264+0000 7f1aab7fe640 1 -- 172.21.15.78:0/1920230367 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f1ab4107220 con 0x7f1abc10d100 2024-09-11T00:15:22.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.264+0000 7f1aba59c640 1 --2- 172.21.15.78:0/1920230367 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1aa40b5440 0x7f1aa40b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:22.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.265+0000 7f1aba59c640 1 --2- 172.21.15.78:0/1920230367 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1aa40b5440 0x7f1aa40b7900 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009990 tx=0x7f1aac009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:22.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.267+0000 7f1aab7fe640 1 -- 172.21.15.78:0/1920230367 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1ab40cdea0 con 0x7f1abc10d100 2024-09-11T00:15:22.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.448+0000 7f1ac0ec4640 1 -- 172.21.15.78:0/1920230367 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1abc1a8360 con 0x7f1abc10d100 2024-09-11T00:15:22.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.448+0000 7f1aab7fe640 1 -- 172.21.15.78:0/1920230367 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1ab40098b0 con 0x7f1abc10d100 2024-09-11T00:15:22.450 INFO:teuthology.orchestra.run.smithi078.stdout:77309411397 2024-09-11T00:15:22.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.450+0000 7f1ac0ec4640 1 -- 172.21.15.78:0/1920230367 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1aa40b5440 msgr2=0x7f1aa40b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:22.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.450+0000 7f1ac0ec4640 1 --2- 172.21.15.78:0/1920230367 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1aa40b5440 0x7f1aa40b7900 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009990 tx=0x7f1aac009110 comp rx=0 tx=0).stop 2024-09-11T00:15:22.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.450+0000 7f1ac0ec4640 1 -- 172.21.15.78:0/1920230367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1abc10d100 msgr2=0x7f1abc1023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:22.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.450+0000 7f1ac0ec4640 1 --2- 172.21.15.78:0/1920230367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1abc10d100 0x7f1abc1023d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4005cc0 tx=0x7f1ab402f380 comp rx=0 tx=0).stop 2024-09-11T00:15:22.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.451+0000 7f1ac0ec4640 1 -- 172.21.15.78:0/1920230367 shutdown_connections 2024-09-11T00:15:22.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.451+0000 7f1ac0ec4640 1 --2- 172.21.15.78:0/1920230367 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1aa40b5440 0x7f1aa40b7900 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:22.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.451+0000 7f1ac0ec4640 1 --2- 172.21.15.78:0/1920230367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1abc10d100 0x7f1abc1023d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:22.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.451+0000 7f1ac0ec4640 1 --2- 172.21.15.78:0/1920230367 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1abc1045c0 0x7f1abc101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:22.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.451+0000 7f1ac0ec4640 1 --2- 172.21.15.78:0/1920230367 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1abc103ca0 0x7f1abc101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:22.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.451+0000 7f1ac0ec4640 1 -- 172.21.15.78:0/1920230367 >> 172.21.15.78:0/1920230367 conn(0x7f1abc0fd700 msgr2=0x7f1abc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:22.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.451+0000 7f1ac0ec4640 1 -- 172.21.15.78:0/1920230367 shutdown_connections 2024-09-11T00:15:22.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:22.451+0000 7f1ac0ec4640 1 -- 172.21.15.78:0/1920230367 wait complete. 2024-09-11T00:15:22.935 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855414 got 150323855415 for osd.5 2024-09-11T00:15:22.935 DEBUG:teuthology.parallel:result is None 2024-09-11T00:15:23.026 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:22 smithi078 ceph-mon[30865]: pgmap v288: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:23.026 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:22 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3936314758' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-11T00:15:23.026 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:22 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1920230367' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-11T00:15:23.026 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:22 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:15:23.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:22 smithi138 ceph-mon[35019]: pgmap v288: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:23.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:22 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3936314758' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-11T00:15:23.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:22 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1920230367' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-11T00:15:23.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:22 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:15:23.146 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:22 smithi112 ceph-mon[35627]: pgmap v288: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:23.146 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:22 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3936314758' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-11T00:15:23.146 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:22 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1920230367' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-11T00:15:23.146 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:22 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:15:23.876 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495658 got 197568495659 for osd.7 2024-09-11T00:15:23.876 DEBUG:teuthology.parallel:result is None 2024-09-11T00:15:24.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.154+0000 7f68b82f2640 1 -- 172.21.15.78:0/1854368208 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68b0108050 msgr2=0x7f68b010e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:24.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.154+0000 7f68b82f2640 1 --2- 172.21.15.78:0/1854368208 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68b0108050 0x7f68b010e850 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009ca0 tx=0x7f68a802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:24.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.154+0000 7f68b82f2640 1 -- 172.21.15.78:0/1854368208 shutdown_connections 2024-09-11T00:15:24.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.154+0000 7f68b82f2640 1 --2- 172.21.15.78:0/1854368208 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68b0108050 0x7f68b010e850 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:24.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.154+0000 7f68b82f2640 1 --2- 172.21.15.78:0/1854368208 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68b01076d0 0x7f68b0107b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:24.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.154+0000 7f68b82f2640 1 --2- 172.21.15.78:0/1854368208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68b01023d0 0x7f68b01027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:24.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.154+0000 7f68b82f2640 1 -- 172.21.15.78:0/1854368208 >> 172.21.15.78:0/1854368208 conn(0x7f68b0078060 msgr2=0x7f68b00ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:24.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.154+0000 7f68b82f2640 1 -- 172.21.15.78:0/1854368208 shutdown_connections 2024-09-11T00:15:24.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.154+0000 7f68b82f2640 1 -- 172.21.15.78:0/1854368208 wait complete. 2024-09-11T00:15:24.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.154+0000 7f68b82f2640 1 Processor -- start 2024-09-11T00:15:24.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.155+0000 7f68b82f2640 1 -- start start 2024-09-11T00:15:24.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.155+0000 7f68b82f2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68b01023d0 0x7f68b0198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:24.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.155+0000 7f68b82f2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68b01076d0 0x7f68b0198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:24.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.155+0000 7f68b82f2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68b0108050 0x7f68b019da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:24.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.155+0000 7f68b82f2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f68b0111cd0 con 0x7f68b01023d0 2024-09-11T00:15:24.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.155+0000 7f68b82f2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f68b0111b50 con 0x7f68b0108050 2024-09-11T00:15:24.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.155+0000 7f68b82f2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f68b0111e50 con 0x7f68b01076d0 2024-09-11T00:15:24.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.155+0000 7f68b608e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68b01023d0 0x7f68b0198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:24.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.155+0000 7f68b608e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68b01023d0 0x7f68b0198140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44914/0 (socket says 172.21.15.78:44914) 2024-09-11T00:15:24.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.155+0000 7f68b608e640 1 -- 172.21.15.78:0/1638220245 learned_addr learned my addr 172.21.15.78:0/1638220245 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:24.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.155+0000 7f68b588d640 1 --2- 172.21.15.78:0/1638220245 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68b01076d0 0x7f68b0198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:24.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.155+0000 7f68b688f640 1 --2- 172.21.15.78:0/1638220245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68b0108050 0x7f68b019da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:24.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.155+0000 7f68b608e640 1 -- 172.21.15.78:0/1638220245 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68b01076d0 msgr2=0x7f68b0198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:24.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.155+0000 7f68b608e640 1 --2- 172.21.15.78:0/1638220245 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68b01076d0 0x7f68b0198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:24.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.155+0000 7f68b608e640 1 -- 172.21.15.78:0/1638220245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68b0108050 msgr2=0x7f68b019da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:24.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.155+0000 7f68b608e640 1 --2- 172.21.15.78:0/1638220245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68b0108050 0x7f68b019da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:24.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.155+0000 7f68b608e640 1 -- 172.21.15.78:0/1638220245 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b019e1f0 con 0x7f68b01023d0 2024-09-11T00:15:24.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.155+0000 7f68b608e640 1 --2- 172.21.15.78:0/1638220245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68b01023d0 0x7f68b0198140 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00d950 tx=0x7f68ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:24.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.156+0000 7f68a77fe640 1 -- 172.21.15.78:0/1638220245 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ac017030 con 0x7f68b01023d0 2024-09-11T00:15:24.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.156+0000 7f68a77fe640 1 -- 172.21.15.78:0/1638220245 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68ac004020 con 0x7f68b01023d0 2024-09-11T00:15:24.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.156+0000 7f68a77fe640 1 -- 172.21.15.78:0/1638220245 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ac0047a0 con 0x7f68b01023d0 2024-09-11T00:15:24.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.156+0000 7f68b82f2640 1 -- 172.21.15.78:0/1638220245 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b019e4e0 con 0x7f68b01023d0 2024-09-11T00:15:24.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.156+0000 7f68b82f2640 1 -- 172.21.15.78:0/1638220245 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b01a4d70 con 0x7f68b01023d0 2024-09-11T00:15:24.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.157+0000 7f68b82f2640 1 -- 172.21.15.78:0/1638220245 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68b01027b0 con 0x7f68b01023d0 2024-09-11T00:15:24.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.158+0000 7f68a77fe640 1 -- 172.21.15.78:0/1638220245 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f68ac009a30 con 0x7f68b01023d0 2024-09-11T00:15:24.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.159+0000 7f68a77fe640 1 --2- 172.21.15.78:0/1638220245 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f689c0b5440 0x7f689c0b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:24.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.159+0000 7f68b588d640 1 --2- 172.21.15.78:0/1638220245 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f689c0b5440 0x7f689c0b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:24.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.159+0000 7f68a77fe640 1 -- 172.21.15.78:0/1638220245 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f68ac0e5900 con 0x7f68b01023d0 2024-09-11T00:15:24.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.159+0000 7f68b588d640 1 --2- 172.21.15.78:0/1638220245 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f689c0b5440 0x7f689c0b7900 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f68b0103c80 tx=0x7f68a000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:24.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.163+0000 7f68a77fe640 1 -- 172.21.15.78:0/1638220245 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f68ac0ac580 con 0x7f68b01023d0 2024-09-11T00:15:24.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.352+0000 7f68b82f2640 1 -- 172.21.15.78:0/1638220245 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f68b002e5c0 con 0x7f68b01023d0 2024-09-11T00:15:24.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.352+0000 7f68a77fe640 1 -- 172.21.15.78:0/1638220245 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f68ac0abe80 con 0x7f68b01023d0 2024-09-11T00:15:24.354 INFO:teuthology.orchestra.run.smithi078.stdout:223338299432 2024-09-11T00:15:24.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.354+0000 7f68b82f2640 1 -- 172.21.15.78:0/1638220245 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f689c0b5440 msgr2=0x7f689c0b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:24.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.354+0000 7f68b82f2640 1 --2- 172.21.15.78:0/1638220245 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f689c0b5440 0x7f689c0b7900 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f68b0103c80 tx=0x7f68a000b390 comp rx=0 tx=0).stop 2024-09-11T00:15:24.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.354+0000 7f68b82f2640 1 -- 172.21.15.78:0/1638220245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68b01023d0 msgr2=0x7f68b0198140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:24.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.354+0000 7f68b82f2640 1 --2- 172.21.15.78:0/1638220245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68b01023d0 0x7f68b0198140 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00d950 tx=0x7f68ac00de10 comp rx=0 tx=0).stop 2024-09-11T00:15:24.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.354+0000 7f68b82f2640 1 -- 172.21.15.78:0/1638220245 shutdown_connections 2024-09-11T00:15:24.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.354+0000 7f68b82f2640 1 --2- 172.21.15.78:0/1638220245 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f689c0b5440 0x7f689c0b7900 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:24.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.354+0000 7f68b82f2640 1 --2- 172.21.15.78:0/1638220245 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68b0108050 0x7f68b019da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:24.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.354+0000 7f68b82f2640 1 --2- 172.21.15.78:0/1638220245 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68b01076d0 0x7f68b0198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:24.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.354+0000 7f68b82f2640 1 --2- 172.21.15.78:0/1638220245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68b01023d0 0x7f68b0198140 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:24.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.354+0000 7f68b82f2640 1 -- 172.21.15.78:0/1638220245 >> 172.21.15.78:0/1638220245 conn(0x7f68b0078060 msgr2=0x7f68b0105f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:24.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.354+0000 7f68b82f2640 1 -- 172.21.15.78:0/1638220245 shutdown_connections 2024-09-11T00:15:24.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.354+0000 7f68b82f2640 1 -- 172.21.15.78:0/1638220245 wait complete. 2024-09-11T00:15:24.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.383+0000 7f7486589640 1 -- 172.21.15.78:0/3989259964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7480103990 msgr2=0x7f7480103d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:24.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.383+0000 7f7486589640 1 --2- 172.21.15.78:0/3989259964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7480103990 0x7f7480103d70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7470009860 tx=0x7f747002a340 comp rx=0 tx=0).stop 2024-09-11T00:15:24.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.383+0000 7f7486589640 1 -- 172.21.15.78:0/3989259964 shutdown_connections 2024-09-11T00:15:24.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.383+0000 7f7486589640 1 --2- 172.21.15.78:0/3989259964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7480101c10 0x7f74801117e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:24.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.383+0000 7f7486589640 1 --2- 172.21.15.78:0/3989259964 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7480101050 0x7f7480101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:24.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.383+0000 7f7486589640 1 --2- 172.21.15.78:0/3989259964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7480103990 0x7f7480103d70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:24.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.383+0000 7f7486589640 1 -- 172.21.15.78:0/3989259964 >> 172.21.15.78:0/3989259964 conn(0x7f7480078140 msgr2=0x7f74800ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:24.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.383+0000 7f7486589640 1 -- 172.21.15.78:0/3989259964 shutdown_connections 2024-09-11T00:15:24.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.383+0000 7f7486589640 1 -- 172.21.15.78:0/3989259964 wait complete. 2024-09-11T00:15:24.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.384+0000 7f7486589640 1 Processor -- start 2024-09-11T00:15:24.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.384+0000 7f7486589640 1 -- start start 2024-09-11T00:15:24.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.384+0000 7f7486589640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7480101050 0x7f748019b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:24.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.384+0000 7f7486589640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7480101c10 0x7f748019ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:24.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.384+0000 7f7486589640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7480103990 0x7f74801a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:24.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.384+0000 7f7486589640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7480114fb0 con 0x7f7480101c10 2024-09-11T00:15:24.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.384+0000 7f7486589640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7480114e30 con 0x7f7480103990 2024-09-11T00:15:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.384+0000 7f7486589640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7480115130 con 0x7f7480101050 2024-09-11T00:15:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.385+0000 7f747f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7480101c10 0x7f748019ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.385+0000 7f747ffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7480101050 0x7f748019b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.385+0000 7f747f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7480101c10 0x7f748019ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44946/0 (socket says 172.21.15.78:44946) 2024-09-11T00:15:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.385+0000 7f747f7fe640 1 -- 172.21.15.78:0/704979151 learned_addr learned my addr 172.21.15.78:0/704979151 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.385+0000 7f7484b26640 1 --2- 172.21.15.78:0/704979151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7480103990 0x7f74801a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.385+0000 7f7484b26640 1 -- 172.21.15.78:0/704979151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7480101050 msgr2=0x7f748019b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.385+0000 7f7484b26640 1 --2- 172.21.15.78:0/704979151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7480101050 0x7f748019b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.385+0000 7f7484b26640 1 -- 172.21.15.78:0/704979151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7480101c10 msgr2=0x7f748019ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.385+0000 7f7484b26640 1 --2- 172.21.15.78:0/704979151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7480101c10 0x7f748019ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.385+0000 7f7484b26640 1 -- 172.21.15.78:0/704979151 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74801a15d0 con 0x7f7480103990 2024-09-11T00:15:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.385+0000 7f7484b26640 1 --2- 172.21.15.78:0/704979151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7480103990 0x7f74801a0e00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f748006c9c0 tx=0x7f747800c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:24.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.385+0000 7f747d7fa640 1 -- 172.21.15.78:0/704979151 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7478003970 con 0x7f7480103990 2024-09-11T00:15:24.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.385+0000 7f747d7fa640 1 -- 172.21.15.78:0/704979151 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7478004020 con 0x7f7480103990 2024-09-11T00:15:24.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.385+0000 7f747d7fa640 1 -- 172.21.15.78:0/704979151 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747800b7f0 con 0x7f7480103990 2024-09-11T00:15:24.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.385+0000 7f7486589640 1 -- 172.21.15.78:0/704979151 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74801a18c0 con 0x7f7480103990 2024-09-11T00:15:24.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.385+0000 7f7486589640 1 -- 172.21.15.78:0/704979151 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74801a7f80 con 0x7f7480103990 2024-09-11T00:15:24.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.386+0000 7f7486589640 1 -- 172.21.15.78:0/704979151 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7480101490 con 0x7f7480103990 2024-09-11T00:15:24.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.388+0000 7f747d7fa640 1 -- 172.21.15.78:0/704979151 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f747800b040 con 0x7f7480103990 2024-09-11T00:15:24.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.388+0000 7f747d7fa640 1 --2- 172.21.15.78:0/704979151 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f74680b53c0 0x7f74680b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:24.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.388+0000 7f747ffff640 1 --2- 172.21.15.78:0/704979151 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f74680b53c0 0x7f74680b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:24.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.388+0000 7f747d7fa640 1 -- 172.21.15.78:0/704979151 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f74780e5ec0 con 0x7f7480103990 2024-09-11T00:15:24.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.389+0000 7f747ffff640 1 --2- 172.21.15.78:0/704979151 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f74680b53c0 0x7f74680b7880 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f747002a930 tx=0x7f74700058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:24.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.391+0000 7f747d7fa640 1 -- 172.21.15.78:0/704979151 <== mon.2 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f74780acae0 con 0x7f7480103990 2024-09-11T00:15:24.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.571+0000 7f7486589640 1 -- 172.21.15.78:0/704979151 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f74801a81e0 con 0x7f7480103990 2024-09-11T00:15:24.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.571+0000 7f747d7fa640 1 -- 172.21.15.78:0/704979151 <== mon.2 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f7478093090 con 0x7f7480103990 2024-09-11T00:15:24.573 INFO:teuthology.orchestra.run.smithi078.stdout:270582939677 2024-09-11T00:15:24.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.574+0000 7f7486589640 1 -- 172.21.15.78:0/704979151 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f74680b53c0 msgr2=0x7f74680b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:24.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.574+0000 7f7486589640 1 --2- 172.21.15.78:0/704979151 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f74680b53c0 0x7f74680b7880 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f747002a930 tx=0x7f74700058d0 comp rx=0 tx=0).stop 2024-09-11T00:15:24.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.574+0000 7f7486589640 1 -- 172.21.15.78:0/704979151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7480103990 msgr2=0x7f74801a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:24.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.574+0000 7f7486589640 1 --2- 172.21.15.78:0/704979151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7480103990 0x7f74801a0e00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f748006c9c0 tx=0x7f747800c740 comp rx=0 tx=0).stop 2024-09-11T00:15:24.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.574+0000 7f7486589640 1 -- 172.21.15.78:0/704979151 shutdown_connections 2024-09-11T00:15:24.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.574+0000 7f7486589640 1 --2- 172.21.15.78:0/704979151 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f74680b53c0 0x7f74680b7880 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:24.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.574+0000 7f7486589640 1 --2- 172.21.15.78:0/704979151 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7480103990 0x7f74801a0e00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:24.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.574+0000 7f7486589640 1 --2- 172.21.15.78:0/704979151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7480101c10 0x7f748019ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:24.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.574+0000 7f7486589640 1 --2- 172.21.15.78:0/704979151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7480101050 0x7f748019b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:24.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.574+0000 7f7486589640 1 -- 172.21.15.78:0/704979151 >> 172.21.15.78:0/704979151 conn(0x7f7480078140 msgr2=0x7f74800fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:24.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.574+0000 7f7486589640 1 -- 172.21.15.78:0/704979151 shutdown_connections 2024-09-11T00:15:24.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:24.574+0000 7f7486589640 1 -- 172.21.15.78:0/704979151 wait complete. 2024-09-11T00:15:24.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:24 smithi078 ceph-mon[30865]: pgmap v289: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-11T00:15:24.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:24 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:15:24.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:24 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:15:24.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:24 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:15:24.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:24 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:15:24.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:24 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1638220245' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-11T00:15:24.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:24 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/704979151' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-11T00:15:25.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:24 smithi138 ceph-mon[35019]: pgmap v289: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-11T00:15:25.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:24 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:15:25.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:24 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:15:25.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:24 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:15:25.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:24 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:15:25.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:24 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1638220245' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-11T00:15:25.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:24 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/704979151' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-11T00:15:25.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:24 smithi112 ceph-mon[35627]: pgmap v289: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-11T00:15:25.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:24 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:15:25.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:24 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:15:25.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:24 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:15:25.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:24 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:15:25.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:24 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1638220245' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-11T00:15:25.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:24 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/704979151' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-11T00:15:25.295 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939673 got 270582939677 for osd.10 2024-09-11T00:15:25.295 DEBUG:teuthology.parallel:result is None 2024-09-11T00:15:25.693 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299428 got 223338299432 for osd.8 2024-09-11T00:15:25.693 DEBUG:teuthology.parallel:result is None 2024-09-11T00:15:26.373 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411394 got 77309411397 for osd.2 2024-09-11T00:15:26.374 DEBUG:teuthology.parallel:result is None 2024-09-11T00:15:26.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.669+0000 7f229c43a640 1 -- 172.21.15.78:0/1122297822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2294102dc0 msgr2=0x7f22941031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:26.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.669+0000 7f229c43a640 1 --2- 172.21.15.78:0/1122297822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2294102dc0 0x7f22941031a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2290009900 tx=0x7f229002a410 comp rx=0 tx=0).stop 2024-09-11T00:15:26.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.669+0000 7f229c43a640 1 -- 172.21.15.78:0/1122297822 shutdown_connections 2024-09-11T00:15:26.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.669+0000 7f229c43a640 1 --2- 172.21.15.78:0/1122297822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2294109150 0x7f229410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:26.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.669+0000 7f229c43a640 1 --2- 172.21.15.78:0/1122297822 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f22941087d0 0x7f2294108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:26.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.669+0000 7f229c43a640 1 --2- 172.21.15.78:0/1122297822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2294102dc0 0x7f22941031a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:26.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.669+0000 7f229c43a640 1 -- 172.21.15.78:0/1122297822 >> 172.21.15.78:0/1122297822 conn(0x7f22940fe830 msgr2=0x7f2294100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:26.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.669+0000 7f229c43a640 1 -- 172.21.15.78:0/1122297822 shutdown_connections 2024-09-11T00:15:26.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.669+0000 7f229c43a640 1 -- 172.21.15.78:0/1122297822 wait complete. 2024-09-11T00:15:26.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.669+0000 7f229c43a640 1 Processor -- start 2024-09-11T00:15:26.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.669+0000 7f229c43a640 1 -- start start 2024-09-11T00:15:26.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.669+0000 7f229c43a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2294102dc0 0x7f22940754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:26.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.669+0000 7f229c43a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22941087d0 0x7f22940759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:26.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.669+0000 7f229c43a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2294109150 0x7f2294075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:26.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.669+0000 7f229c43a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2294112e10 con 0x7f22941087d0 2024-09-11T00:15:26.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.669+0000 7f229c43a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2294112c90 con 0x7f2294109150 2024-09-11T00:15:26.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.669+0000 7f229c43a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2294112f90 con 0x7f2294102dc0 2024-09-11T00:15:26.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.670+0000 7f22999d5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22941087d0 0x7f22940759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:26.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.670+0000 7f22999d5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22941087d0 0x7f22940759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44852/0 (socket says 172.21.15.78:44852) 2024-09-11T00:15:26.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.670+0000 7f22999d5640 1 -- 172.21.15.78:0/3988869532 learned_addr learned my addr 172.21.15.78:0/3988869532 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:26.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.670+0000 7f229a1d6640 1 --2- 172.21.15.78:0/3988869532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2294102dc0 0x7f22940754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:26.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.670+0000 7f229a9d7640 1 --2- 172.21.15.78:0/3988869532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2294109150 0x7f2294075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:26.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.670+0000 7f22999d5640 1 -- 172.21.15.78:0/3988869532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2294102dc0 msgr2=0x7f22940754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:26.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.670+0000 7f22999d5640 1 --2- 172.21.15.78:0/3988869532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2294102dc0 0x7f22940754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:26.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.670+0000 7f22999d5640 1 -- 172.21.15.78:0/3988869532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2294109150 msgr2=0x7f2294075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:26.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.670+0000 7f22999d5640 1 --2- 172.21.15.78:0/3988869532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2294109150 0x7f2294075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:26.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.670+0000 7f22999d5640 1 -- 172.21.15.78:0/3988869532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22941a76e0 con 0x7f22941087d0 2024-09-11T00:15:26.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.670+0000 7f229a1d6640 1 --2- 172.21.15.78:0/3988869532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2294102dc0 0x7f22940754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:26.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.670+0000 7f229a9d7640 1 --2- 172.21.15.78:0/3988869532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2294109150 0x7f2294075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:26.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.670+0000 7f22999d5640 1 --2- 172.21.15.78:0/3988869532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22941087d0 0x7f22940759e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f228800d950 tx=0x7f228800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:26.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.670+0000 7f22877fe640 1 -- 172.21.15.78:0/3988869532 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288017070 con 0x7f22941087d0 2024-09-11T00:15:26.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.670+0000 7f22877fe640 1 -- 172.21.15.78:0/3988869532 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2288009c30 con 0x7f22941087d0 2024-09-11T00:15:26.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.670+0000 7f229c43a640 1 -- 172.21.15.78:0/3988869532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22941a79d0 con 0x7f22941087d0 2024-09-11T00:15:26.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.670+0000 7f22877fe640 1 -- 172.21.15.78:0/3988869532 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228800f620 con 0x7f22941087d0 2024-09-11T00:15:26.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.670+0000 7f229c43a640 1 -- 172.21.15.78:0/3988869532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22941a7f90 con 0x7f22941087d0 2024-09-11T00:15:26.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.671+0000 7f229c43a640 1 -- 172.21.15.78:0/3988869532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22941031a0 con 0x7f22941087d0 2024-09-11T00:15:26.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.673+0000 7f22877fe640 1 -- 172.21.15.78:0/3988869532 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f2288010460 con 0x7f22941087d0 2024-09-11T00:15:26.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.673+0000 7f22877fe640 1 --2- 172.21.15.78:0/3988869532 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f22800b53c0 0x7f22800b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:26.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.673+0000 7f229a1d6640 1 --2- 172.21.15.78:0/3988869532 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f22800b53c0 0x7f22800b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:26.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.673+0000 7f22877fe640 1 -- 172.21.15.78:0/3988869532 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f22880e5b90 con 0x7f22941087d0 2024-09-11T00:15:26.544 INFO:teuthology.orchestra.run.smithi078.stdout:128849018940 2024-09-11T00:15:26.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.674+0000 7f229a1d6640 1 --2- 172.21.15.78:0/3988869532 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f22800b53c0 0x7f22800b7880 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2290031440 tx=0x7f2290005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:26.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.676+0000 7f22877fe640 1 -- 172.21.15.78:0/3988869532 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f22880ac810 con 0x7f22941087d0 2024-09-11T00:15:26.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.865+0000 7f229c43a640 1 -- 172.21.15.78:0/3988869532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f22940767a0 con 0x7f22941087d0 2024-09-11T00:15:26.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.866+0000 7f22877fe640 1 -- 172.21.15.78:0/3988869532 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f22940767a0 con 0x7f22941087d0 2024-09-11T00:15:26.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.868+0000 7f229c43a640 1 -- 172.21.15.78:0/3988869532 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f22800b53c0 msgr2=0x7f22800b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:26.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.868+0000 7f229c43a640 1 --2- 172.21.15.78:0/3988869532 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f22800b53c0 0x7f22800b7880 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2290031440 tx=0x7f2290005a20 comp rx=0 tx=0).stop 2024-09-11T00:15:26.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.868+0000 7f229c43a640 1 -- 172.21.15.78:0/3988869532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22941087d0 msgr2=0x7f22940759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:26.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.868+0000 7f229c43a640 1 --2- 172.21.15.78:0/3988869532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22941087d0 0x7f22940759e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f228800d950 tx=0x7f228800de10 comp rx=0 tx=0).stop 2024-09-11T00:15:26.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.868+0000 7f229c43a640 1 -- 172.21.15.78:0/3988869532 shutdown_connections 2024-09-11T00:15:26.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.868+0000 7f229c43a640 1 --2- 172.21.15.78:0/3988869532 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f22800b53c0 0x7f22800b7880 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:26.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.868+0000 7f229c43a640 1 --2- 172.21.15.78:0/3988869532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2294109150 0x7f2294075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:26.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.868+0000 7f229c43a640 1 --2- 172.21.15.78:0/3988869532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22941087d0 0x7f22940759e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:26.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.868+0000 7f229c43a640 1 --2- 172.21.15.78:0/3988869532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2294102dc0 0x7f22940754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:26.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.868+0000 7f229c43a640 1 -- 172.21.15.78:0/3988869532 >> 172.21.15.78:0/3988869532 conn(0x7f22940fe830 msgr2=0x7f22940ff120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:26.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.869+0000 7f229c43a640 1 -- 172.21.15.78:0/3988869532 shutdown_connections 2024-09-11T00:15:26.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:20.869+0000 7f229c43a640 1 -- 172.21.15.78:0/3988869532 wait complete. 2024-09-11T00:15:27.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:26 smithi138 ceph-mon[35019]: pgmap v290: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:27.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:26 smithi078 ceph-mon[30865]: pgmap v290: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:27.179 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:27.191 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018937 got 128849018940 for osd.4 2024-09-11T00:15:27.192 DEBUG:teuthology.parallel:result is None 2024-09-11T00:15:27.223 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:27.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:26 smithi112 ceph-mon[35627]: pgmap v290: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:27.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.902+0000 7fa7eaa0e640 1 -- 172.21.15.78:0/3883976390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7e4102dc0 msgr2=0x7fa7e41031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:27.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.902+0000 7fa7eaa0e640 1 --2- 172.21.15.78:0/3883976390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7e4102dc0 0x7fa7e41031a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009900 tx=0x7fa7d402a410 comp rx=0 tx=0).stop 2024-09-11T00:15:27.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.902+0000 7fa7eaa0e640 1 -- 172.21.15.78:0/3883976390 shutdown_connections 2024-09-11T00:15:27.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.902+0000 7fa7eaa0e640 1 --2- 172.21.15.78:0/3883976390 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7e4109150 0x7fa7e410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:27.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.902+0000 7fa7eaa0e640 1 --2- 172.21.15.78:0/3883976390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7e41087d0 0x7fa7e4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:27.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.902+0000 7fa7eaa0e640 1 --2- 172.21.15.78:0/3883976390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7e4102dc0 0x7fa7e41031a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:27.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.902+0000 7fa7eaa0e640 1 -- 172.21.15.78:0/3883976390 >> 172.21.15.78:0/3883976390 conn(0x7fa7e40fe830 msgr2=0x7fa7e4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:27.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.903+0000 7fa7eaa0e640 1 -- 172.21.15.78:0/3883976390 shutdown_connections 2024-09-11T00:15:27.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.903+0000 7fa7eaa0e640 1 -- 172.21.15.78:0/3883976390 wait complete. 2024-09-11T00:15:27.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.903+0000 7fa7eaa0e640 1 Processor -- start 2024-09-11T00:15:27.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.903+0000 7fa7eaa0e640 1 -- start start 2024-09-11T00:15:27.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.903+0000 7fa7eaa0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7e4102dc0 0x7fa7e41992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:27.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.903+0000 7fa7eaa0e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7e41087d0 0x7fa7e4199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:27.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.904+0000 7fa7eaa0e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7e4109150 0x7fa7e419eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:27.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.904+0000 7fa7eaa0e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e4112e10 con 0x7fa7e4102dc0 2024-09-11T00:15:27.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.904+0000 7fa7eaa0e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e4112c90 con 0x7fa7e4109150 2024-09-11T00:15:27.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.904+0000 7fa7eaa0e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e4112f90 con 0x7fa7e41087d0 2024-09-11T00:15:27.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.904+0000 7fa7e3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7e4102dc0 0x7fa7e41992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:27.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.904+0000 7fa7e3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7e4102dc0 0x7fa7e41992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42940/0 (socket says 172.21.15.78:42940) 2024-09-11T00:15:27.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.904+0000 7fa7e3fff640 1 -- 172.21.15.78:0/2785363743 learned_addr learned my addr 172.21.15.78:0/2785363743 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:27.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.904+0000 7fa7e8fab640 1 --2- 172.21.15.78:0/2785363743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7e4109150 0x7fa7e419eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:27.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.904+0000 7fa7e37fe640 1 --2- 172.21.15.78:0/2785363743 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7e41087d0 0x7fa7e4199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:27.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.904+0000 7fa7e3fff640 1 -- 172.21.15.78:0/2785363743 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7e41087d0 msgr2=0x7fa7e4199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:27.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.904+0000 7fa7e3fff640 1 --2- 172.21.15.78:0/2785363743 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7e41087d0 0x7fa7e4199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:27.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.904+0000 7fa7e3fff640 1 -- 172.21.15.78:0/2785363743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7e4109150 msgr2=0x7fa7e419eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:27.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.904+0000 7fa7e3fff640 1 --2- 172.21.15.78:0/2785363743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7e4109150 0x7fa7e419eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:27.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.904+0000 7fa7e3fff640 1 -- 172.21.15.78:0/2785363743 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e419f370 con 0x7fa7e4102dc0 2024-09-11T00:15:27.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.904+0000 7fa7e3fff640 1 --2- 172.21.15.78:0/2785363743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7e4102dc0 0x7fa7e41992c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4005940 tx=0x7fa7d4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:27.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.904+0000 7fa7e17fa640 1 -- 172.21.15.78:0/2785363743 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d403f030 con 0x7fa7e4102dc0 2024-09-11T00:15:27.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.904+0000 7fa7e17fa640 1 -- 172.21.15.78:0/2785363743 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7d4003aa0 con 0x7fa7e4102dc0 2024-09-11T00:15:27.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.904+0000 7fa7eaa0e640 1 -- 172.21.15.78:0/2785363743 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7e419f600 con 0x7fa7e4102dc0 2024-09-11T00:15:27.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.904+0000 7fa7e17fa640 1 -- 172.21.15.78:0/2785363743 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4035070 con 0x7fa7e4102dc0 2024-09-11T00:15:27.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.904+0000 7fa7eaa0e640 1 -- 172.21.15.78:0/2785363743 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7e4075380 con 0x7fa7e4102dc0 2024-09-11T00:15:27.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.905+0000 7fa7eaa0e640 1 -- 172.21.15.78:0/2785363743 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7e41031a0 con 0x7fa7e4102dc0 2024-09-11T00:15:27.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.907+0000 7fa7e17fa640 1 -- 172.21.15.78:0/2785363743 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fa7d403bcc0 con 0x7fa7e4102dc0 2024-09-11T00:15:27.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.908+0000 7fa7e17fa640 1 --2- 172.21.15.78:0/2785363743 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa7cc0b53c0 0x7fa7cc0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:27.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.908+0000 7fa7e37fe640 1 --2- 172.21.15.78:0/2785363743 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa7cc0b53c0 0x7fa7cc0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:27.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.908+0000 7fa7e17fa640 1 -- 172.21.15.78:0/2785363743 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fa7d4106a60 con 0x7fa7e4102dc0 2024-09-11T00:15:27.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.908+0000 7fa7e37fe640 1 --2- 172.21.15.78:0/2785363743 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa7cc0b53c0 0x7fa7cc0b7880 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa7e41082a0 tx=0x7fa7d800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:27.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:27.911+0000 7fa7e17fa640 1 -- 172.21.15.78:0/2785363743 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa7d40cd090 con 0x7fa7e4102dc0 2024-09-11T00:15:28.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:28.092+0000 7fa7eaa0e640 1 -- 172.21.15.78:0/2785363743 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fa7e410af30 con 0x7fa7e4102dc0 2024-09-11T00:15:28.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:28.092+0000 7fa7e17fa640 1 -- 172.21.15.78:0/2785363743 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa7d40d1ac0 con 0x7fa7e4102dc0 2024-09-11T00:15:28.094 INFO:teuthology.orchestra.run.smithi078.stdout:249108103204 2024-09-11T00:15:28.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:28.094+0000 7fa7eaa0e640 1 -- 172.21.15.78:0/2785363743 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa7cc0b53c0 msgr2=0x7fa7cc0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:28.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:28.094+0000 7fa7eaa0e640 1 --2- 172.21.15.78:0/2785363743 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa7cc0b53c0 0x7fa7cc0b7880 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa7e41082a0 tx=0x7fa7d800b390 comp rx=0 tx=0).stop 2024-09-11T00:15:28.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:28.094+0000 7fa7eaa0e640 1 -- 172.21.15.78:0/2785363743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7e4102dc0 msgr2=0x7fa7e41992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:28.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:28.094+0000 7fa7eaa0e640 1 --2- 172.21.15.78:0/2785363743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7e4102dc0 0x7fa7e41992c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4005940 tx=0x7fa7d4004270 comp rx=0 tx=0).stop 2024-09-11T00:15:28.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:28.094+0000 7fa7eaa0e640 1 -- 172.21.15.78:0/2785363743 shutdown_connections 2024-09-11T00:15:28.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:28.094+0000 7fa7eaa0e640 1 --2- 172.21.15.78:0/2785363743 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa7cc0b53c0 0x7fa7cc0b7880 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:28.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:28.094+0000 7fa7eaa0e640 1 --2- 172.21.15.78:0/2785363743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa7e4109150 0x7fa7e419eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:28.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:28.094+0000 7fa7eaa0e640 1 --2- 172.21.15.78:0/2785363743 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa7e41087d0 0x7fa7e4199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:28.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:28.094+0000 7fa7eaa0e640 1 --2- 172.21.15.78:0/2785363743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7e4102dc0 0x7fa7e41992c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:28.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:28.094+0000 7fa7eaa0e640 1 -- 172.21.15.78:0/2785363743 >> 172.21.15.78:0/2785363743 conn(0x7fa7e40fe830 msgr2=0x7fa7e4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:28.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:28.094+0000 7fa7eaa0e640 1 -- 172.21.15.78:0/2785363743 shutdown_connections 2024-09-11T00:15:28.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:28.094+0000 7fa7eaa0e640 1 -- 172.21.15.78:0/2785363743 wait complete. 2024-09-11T00:15:29.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.015+0000 7f88f3588640 1 -- 172.21.15.78:0/3932647190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88ec1076a0 msgr2=0x7f88ec107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:29.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.015+0000 7f88f3588640 1 --2- 172.21.15.78:0/3932647190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88ec1076a0 0x7f88ec107ae0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f88dc009900 tx=0x7f88dc02a410 comp rx=0 tx=0).stop 2024-09-11T00:15:29.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.015+0000 7f88f3588640 1 -- 172.21.15.78:0/3932647190 shutdown_connections 2024-09-11T00:15:29.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.015+0000 7f88f3588640 1 --2- 172.21.15.78:0/3932647190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88ec108020 0x7f88ec10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:29.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.015+0000 7f88f3588640 1 --2- 172.21.15.78:0/3932647190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88ec1076a0 0x7f88ec107ae0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:29.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.015+0000 7f88f3588640 1 --2- 172.21.15.78:0/3932647190 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88ec101c90 0x7f88ec102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:29.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.015+0000 7f88f3588640 1 -- 172.21.15.78:0/3932647190 >> 172.21.15.78:0/3932647190 conn(0x7f88ec0fd700 msgr2=0x7f88ec0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:29.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.015+0000 7f88f3588640 1 -- 172.21.15.78:0/3932647190 shutdown_connections 2024-09-11T00:15:29.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.015+0000 7f88f3588640 1 -- 172.21.15.78:0/3932647190 wait complete. 2024-09-11T00:15:29.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.016+0000 7f88f3588640 1 Processor -- start 2024-09-11T00:15:29.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.016+0000 7f88f3588640 1 -- start start 2024-09-11T00:15:29.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.016+0000 7f88f3588640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88ec101c90 0x7f88ec19a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:29.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.016+0000 7f88f3588640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88ec1076a0 0x7f88ec19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:29.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.016+0000 7f88f3588640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88ec108020 0x7f88ec1a5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:29.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.016+0000 7f88f3588640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec111ce0 con 0x7f88ec108020 2024-09-11T00:15:29.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.016+0000 7f88f3588640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec111b60 con 0x7f88ec101c90 2024-09-11T00:15:29.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.016+0000 7f88f3588640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec111e60 con 0x7f88ec1076a0 2024-09-11T00:15:29.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.017+0000 7f88f1b25640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88ec108020 0x7f88ec1a5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:29.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.017+0000 7f88f1324640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88ec101c90 0x7f88ec19a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:29.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.017+0000 7f88f1b25640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88ec108020 0x7f88ec1a5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42956/0 (socket says 172.21.15.78:42956) 2024-09-11T00:15:29.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.017+0000 7f88f1b25640 1 -- 172.21.15.78:0/2173421365 learned_addr learned my addr 172.21.15.78:0/2173421365 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:29.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.017+0000 7f88f0b23640 1 --2- 172.21.15.78:0/2173421365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88ec1076a0 0x7f88ec19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:29.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.017+0000 7f88f1b25640 1 -- 172.21.15.78:0/2173421365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88ec1076a0 msgr2=0x7f88ec19a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:29.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.017+0000 7f88f1b25640 1 --2- 172.21.15.78:0/2173421365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88ec1076a0 0x7f88ec19a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:29.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.017+0000 7f88f1b25640 1 -- 172.21.15.78:0/2173421365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88ec101c90 msgr2=0x7f88ec19a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:29.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.017+0000 7f88f1b25640 1 --2- 172.21.15.78:0/2173421365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88ec101c90 0x7f88ec19a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:29.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.017+0000 7f88f1b25640 1 -- 172.21.15.78:0/2173421365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ec197e80 con 0x7f88ec108020 2024-09-11T00:15:29.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.017+0000 7f88f1324640 1 --2- 172.21.15.78:0/2173421365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88ec101c90 0x7f88ec19a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:15:29.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.017+0000 7f88f1b25640 1 --2- 172.21.15.78:0/2173421365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88ec108020 0x7f88ec1a5110 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f88e400eaa0 tx=0x7f88e400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:29.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.017+0000 7f88e27fc640 1 -- 172.21.15.78:0/2173421365 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e400cdb0 con 0x7f88ec108020 2024-09-11T00:15:29.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.017+0000 7f88e27fc640 1 -- 172.21.15.78:0/2173421365 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88e4005020 con 0x7f88ec108020 2024-09-11T00:15:29.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.017+0000 7f88e27fc640 1 -- 172.21.15.78:0/2173421365 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e40116d0 con 0x7f88ec108020 2024-09-11T00:15:29.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.017+0000 7f88f3588640 1 -- 172.21.15.78:0/2173421365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ec198170 con 0x7f88ec108020 2024-09-11T00:15:29.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.017+0000 7f88f3588640 1 -- 172.21.15.78:0/2173421365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ec198680 con 0x7f88ec108020 2024-09-11T00:15:29.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.018+0000 7f88f3588640 1 -- 172.21.15.78:0/2173421365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88ec102f40 con 0x7f88ec108020 2024-09-11T00:15:29.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.021+0000 7f88e27fc640 1 -- 172.21.15.78:0/2173421365 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f88e400f040 con 0x7f88ec108020 2024-09-11T00:15:29.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.021+0000 7f88e27fc640 1 --2- 172.21.15.78:0/2173421365 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f88d80b5440 0x7f88d80b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:29.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.021+0000 7f88f1324640 1 --2- 172.21.15.78:0/2173421365 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f88d80b5440 0x7f88d80b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:29.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.021+0000 7f88e27fc640 1 -- 172.21.15.78:0/2173421365 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f88e40e6000 con 0x7f88ec108020 2024-09-11T00:15:29.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.022+0000 7f88f1324640 1 --2- 172.21.15.78:0/2173421365 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f88d80b5440 0x7f88d80b7900 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f88e800bfd0 tx=0x7f88e800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:29.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.025+0000 7f88e27fc640 1 -- 172.21.15.78:0/2173421365 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f88e4016030 con 0x7f88ec108020 2024-09-11T00:15:29.030 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:28 smithi078 ceph-mon[30865]: pgmap v291: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-11T00:15:29.030 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:28 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2785363743' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-11T00:15:29.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:28 smithi138 ceph-mon[35019]: pgmap v291: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-11T00:15:29.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:28 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2785363743' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-11T00:15:29.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.209+0000 7f88f3588640 1 -- 172.21.15.78:0/2173421365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f88ec02e5c0 con 0x7f88ec108020 2024-09-11T00:15:29.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.209+0000 7f88e27fc640 1 -- 172.21.15.78:0/2173421365 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f88e40ac6b0 con 0x7f88ec108020 2024-09-11T00:15:29.211 INFO:teuthology.orchestra.run.smithi078.stdout:103079215169 2024-09-11T00:15:29.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.211+0000 7f88f3588640 1 -- 172.21.15.78:0/2173421365 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f88d80b5440 msgr2=0x7f88d80b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:29.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.211+0000 7f88f3588640 1 --2- 172.21.15.78:0/2173421365 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f88d80b5440 0x7f88d80b7900 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f88e800bfd0 tx=0x7f88e800b390 comp rx=0 tx=0).stop 2024-09-11T00:15:29.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.211+0000 7f88f3588640 1 -- 172.21.15.78:0/2173421365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88ec108020 msgr2=0x7f88ec1a5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:29.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.211+0000 7f88f3588640 1 --2- 172.21.15.78:0/2173421365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88ec108020 0x7f88ec1a5110 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f88e400eaa0 tx=0x7f88e400ef60 comp rx=0 tx=0).stop 2024-09-11T00:15:29.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.211+0000 7f88f3588640 1 -- 172.21.15.78:0/2173421365 shutdown_connections 2024-09-11T00:15:29.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.211+0000 7f88f3588640 1 --2- 172.21.15.78:0/2173421365 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f88d80b5440 0x7f88d80b7900 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:29.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.211+0000 7f88f3588640 1 --2- 172.21.15.78:0/2173421365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88ec108020 0x7f88ec1a5110 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:29.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.211+0000 7f88f3588640 1 --2- 172.21.15.78:0/2173421365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88ec1076a0 0x7f88ec19a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:29.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.211+0000 7f88f3588640 1 --2- 172.21.15.78:0/2173421365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f88ec101c90 0x7f88ec19a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:29.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.211+0000 7f88f3588640 1 -- 172.21.15.78:0/2173421365 >> 172.21.15.78:0/2173421365 conn(0x7f88ec0fd700 msgr2=0x7f88ec0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:29.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.212+0000 7f88f3588640 1 -- 172.21.15.78:0/2173421365 shutdown_connections 2024-09-11T00:15:29.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:29.212+0000 7f88f3588640 1 -- 172.21.15.78:0/2173421365 wait complete. 2024-09-11T00:15:29.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:28 smithi112 ceph-mon[35627]: pgmap v291: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-11T00:15:29.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:28 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2785363743' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-11T00:15:29.568 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103199 got 249108103204 for osd.9 2024-09-11T00:15:29.569 DEBUG:teuthology.parallel:result is None 2024-09-11T00:15:30.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:29 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2173421365' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-11T00:15:30.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:29 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2173421365' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-11T00:15:30.227 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215167 got 103079215169 for osd.3 2024-09-11T00:15:30.227 DEBUG:teuthology.parallel:result is None 2024-09-11T00:15:30.227 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T00:15:30.228 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T00:15:30.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:29 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2173421365' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-11T00:15:30.513 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:30.939 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:30 smithi078 ceph-mon[30865]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-11T00:15:31.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:30 smithi138 ceph-mon[35019]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-11T00:15:31.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.020+0000 7ff744a8c640 1 -- 172.21.15.78:0/2533756296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff740109130 msgr2=0x7ff74010f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:31.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.020+0000 7ff744a8c640 1 --2- 172.21.15.78:0/2533756296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff740109130 0x7ff74010f930 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff738009ca0 tx=0x7ff73802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:31.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.021+0000 7ff744a8c640 1 -- 172.21.15.78:0/2533756296 shutdown_connections 2024-09-11T00:15:31.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.021+0000 7ff744a8c640 1 --2- 172.21.15.78:0/2533756296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff740109130 0x7ff74010f930 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:31.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.021+0000 7ff744a8c640 1 --2- 172.21.15.78:0/2533756296 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7401087b0 0x7ff740108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:31.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.021+0000 7ff744a8c640 1 --2- 172.21.15.78:0/2533756296 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff740102da0 0x7ff740103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:31.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.021+0000 7ff744a8c640 1 -- 172.21.15.78:0/2533756296 >> 172.21.15.78:0/2533756296 conn(0x7ff7400fe850 msgr2=0x7ff740100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.021+0000 7ff744a8c640 1 -- 172.21.15.78:0/2533756296 shutdown_connections 2024-09-11T00:15:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.021+0000 7ff744a8c640 1 -- 172.21.15.78:0/2533756296 wait complete. 2024-09-11T00:15:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.021+0000 7ff744a8c640 1 Processor -- start 2024-09-11T00:15:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.022+0000 7ff744a8c640 1 -- start start 2024-09-11T00:15:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.022+0000 7ff744a8c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff740102da0 0x7ff740199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.022+0000 7ff744a8c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7401087b0 0x7ff7401996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.022+0000 7ff744a8c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff740109130 0x7ff74019ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.022+0000 7ff744a8c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff740112e40 con 0x7ff7401087b0 2024-09-11T00:15:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.022+0000 7ff744a8c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff740112cc0 con 0x7ff740109130 2024-09-11T00:15:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.022+0000 7ff744a8c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff740112fc0 con 0x7ff740102da0 2024-09-11T00:15:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.022+0000 7ff735d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7401087b0 0x7ff7401996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.022+0000 7ff735d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7401087b0 0x7ff7401996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42976/0 (socket says 172.21.15.78:42976) 2024-09-11T00:15:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.022+0000 7ff735d9b640 1 -- 172.21.15.78:0/2391301909 learned_addr learned my addr 172.21.15.78:0/2391301909 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.022+0000 7ff73ed9d640 1 --2- 172.21.15.78:0/2391301909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff740109130 0x7ff74019ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.022+0000 7ff73e59c640 1 --2- 172.21.15.78:0/2391301909 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff740102da0 0x7ff740199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.022+0000 7ff735d9b640 1 -- 172.21.15.78:0/2391301909 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff740102da0 msgr2=0x7ff740199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.022+0000 7ff735d9b640 1 --2- 172.21.15.78:0/2391301909 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff740102da0 0x7ff740199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.022+0000 7ff735d9b640 1 -- 172.21.15.78:0/2391301909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff740109130 msgr2=0x7ff74019ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.022+0000 7ff735d9b640 1 --2- 172.21.15.78:0/2391301909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff740109130 0x7ff74019ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.022+0000 7ff735d9b640 1 -- 172.21.15.78:0/2391301909 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74019f240 con 0x7ff7401087b0 2024-09-11T00:15:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.022+0000 7ff73e59c640 1 --2- 172.21.15.78:0/2391301909 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff740102da0 0x7ff740199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.023+0000 7ff735d9b640 1 --2- 172.21.15.78:0/2391301909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7401087b0 0x7ff7401996d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff72800c920 tx=0x7ff72800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.023+0000 7ff737fff640 1 -- 172.21.15.78:0/2391301909 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff728007c70 con 0x7ff7401087b0 2024-09-11T00:15:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.023+0000 7ff737fff640 1 -- 172.21.15.78:0/2391301909 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff728007e10 con 0x7ff7401087b0 2024-09-11T00:15:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.023+0000 7ff744a8c640 1 -- 172.21.15.78:0/2391301909 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff74019f530 con 0x7ff7401087b0 2024-09-11T00:15:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.023+0000 7ff737fff640 1 -- 172.21.15.78:0/2391301909 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff728018820 con 0x7ff7401087b0 2024-09-11T00:15:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.023+0000 7ff744a8c640 1 -- 172.21.15.78:0/2391301909 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7401a5bf0 con 0x7ff7401087b0 2024-09-11T00:15:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.024+0000 7ff744a8c640 1 -- 172.21.15.78:0/2391301909 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff740103180 con 0x7ff7401087b0 2024-09-11T00:15:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.026+0000 7ff737fff640 1 -- 172.21.15.78:0/2391301909 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7ff72800f450 con 0x7ff7401087b0 2024-09-11T00:15:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.027+0000 7ff737fff640 1 --2- 172.21.15.78:0/2391301909 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff72c0b53c0 0x7ff72c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.027+0000 7ff73e59c640 1 --2- 172.21.15.78:0/2391301909 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff72c0b53c0 0x7ff72c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.027+0000 7ff737fff640 1 -- 172.21.15.78:0/2391301909 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ff7280e6020 con 0x7ff7401087b0 2024-09-11T00:15:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.027+0000 7ff73e59c640 1 --2- 172.21.15.78:0/2391301909 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff72c0b53c0 0x7ff72c0b7880 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff730009b40 tx=0x7ff730005e50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.031+0000 7ff737fff640 1 -- 172.21.15.78:0/2391301909 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff728014030 con 0x7ff7401087b0 2024-09-11T00:15:31.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:30 smithi112 ceph-mon[35627]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-11T00:15:31.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.238+0000 7ff744a8c640 1 -- 172.21.15.78:0/2391301909 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff740105d70 con 0x7ff72c0b53c0 2024-09-11T00:15:31.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.243+0000 7ff737fff640 1 -- 172.21.15.78:0/2391301909 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258889 (secure 0 0 0) 0x7ff740105d70 con 0x7ff72c0b53c0 2024-09-11T00:15:31.247 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:15:31.248 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-11T00:15:31.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.246+0000 7ff744a8c640 1 -- 172.21.15.78:0/2391301909 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff72c0b53c0 msgr2=0x7ff72c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:31.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.246+0000 7ff744a8c640 1 --2- 172.21.15.78:0/2391301909 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff72c0b53c0 0x7ff72c0b7880 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff730009b40 tx=0x7ff730005e50 comp rx=0 tx=0).stop 2024-09-11T00:15:31.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.246+0000 7ff744a8c640 1 -- 172.21.15.78:0/2391301909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7401087b0 msgr2=0x7ff7401996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:31.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.246+0000 7ff744a8c640 1 --2- 172.21.15.78:0/2391301909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7401087b0 0x7ff7401996d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff72800c920 tx=0x7ff72800cde0 comp rx=0 tx=0).stop 2024-09-11T00:15:31.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.246+0000 7ff744a8c640 1 -- 172.21.15.78:0/2391301909 shutdown_connections 2024-09-11T00:15:31.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.246+0000 7ff744a8c640 1 --2- 172.21.15.78:0/2391301909 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff72c0b53c0 0x7ff72c0b7880 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:31.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.246+0000 7ff744a8c640 1 --2- 172.21.15.78:0/2391301909 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff740109130 0x7ff74019ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:31.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.246+0000 7ff744a8c640 1 --2- 172.21.15.78:0/2391301909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7401087b0 0x7ff7401996d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:31.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.246+0000 7ff744a8c640 1 --2- 172.21.15.78:0/2391301909 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff740102da0 0x7ff740199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:31.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.246+0000 7ff744a8c640 1 -- 172.21.15.78:0/2391301909 >> 172.21.15.78:0/2391301909 conn(0x7ff7400fe850 msgr2=0x7ff740101d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:31.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.246+0000 7ff744a8c640 1 -- 172.21.15.78:0/2391301909 shutdown_connections 2024-09-11T00:15:31.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:31.246+0000 7ff744a8c640 1 -- 172.21.15.78:0/2391301909 wait complete. 2024-09-11T00:15:31.937 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-11T00:15:29.681836+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654217,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":195,"num_read_kb":189,"num_write":208,"num_write_kb":2239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951979,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359560,"kb_used_data":10236,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124582264,"statfs":{"total":1151940427776,"available":1151572238336,"internally_reserved":0,"allocated":10481664,"data_stored":7002147,"data_compressed":177246,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003382"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762893+0000","last_change":"2024-09-11T00:14:25.922805+0000","last_active":"2024-09-11T00:14:56.762893+0000","last_peered":"2024-09-11T00:14:56.762893+0000","last_clean":"2024-09-11T00:14:56.762893+0000","last_became_active":"2024-09-11T00:14:25.922482+0000","last_became_peered":"2024-09-11T00:14:25.922482+0000","last_unstale":"2024-09-11T00:14:56.762893+0000","last_undegraded":"2024-09-11T00:14:56.762893+0000","last_fullsized":"2024-09-11T00:14:56.762893+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:53.209011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760452+0000","last_change":"2024-09-11T00:14:25.920760+0000","last_active":"2024-09-11T00:14:56.760452+0000","last_peered":"2024-09-11T00:14:56.760452+0000","last_clean":"2024-09-11T00:14:56.760452+0000","last_became_active":"2024-09-11T00:14:25.919720+0000","last_became_peered":"2024-09-11T00:14:25.919720+0000","last_unstale":"2024-09-11T00:14:56.760452+0000","last_undegraded":"2024-09-11T00:14:56.760452+0000","last_fullsized":"2024-09-11T00:14:56.760452+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:32.491200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760534+0000","last_change":"2024-09-11T00:14:25.928090+0000","last_active":"2024-09-11T00:14:56.760534+0000","last_peered":"2024-09-11T00:14:56.760534+0000","last_clean":"2024-09-11T00:14:56.760534+0000","last_became_active":"2024-09-11T00:14:25.927768+0000","last_became_peered":"2024-09-11T00:14:25.927768+0000","last_unstale":"2024-09-11T00:14:56.760534+0000","last_undegraded":"2024-09-11T00:14:56.760534+0000","last_fullsized":"2024-09-11T00:14:56.760534+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:00.025061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.765277+0000","last_change":"2024-09-11T00:14:25.920077+0000","last_active":"2024-09-11T00:14:56.765277+0000","last_peered":"2024-09-11T00:14:56.765277+0000","last_clean":"2024-09-11T00:14:56.765277+0000","last_became_active":"2024-09-11T00:14:25.919395+0000","last_became_peered":"2024-09-11T00:14:25.919395+0000","last_unstale":"2024-09-11T00:14:56.765277+0000","last_undegraded":"2024-09-11T00:14:56.765277+0000","last_fullsized":"2024-09-11T00:14:56.765277+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:41.441279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.759657+0000","last_change":"2024-09-11T00:14:25.917872+0000","last_active":"2024-09-11T00:14:56.759657+0000","last_peered":"2024-09-11T00:14:56.759657+0000","last_clean":"2024-09-11T00:14:56.759657+0000","last_became_active":"2024-09-11T00:14:25.917533+0000","last_became_peered":"2024-09-11T00:14:25.917533+0000","last_unstale":"2024-09-11T00:14:56.759657+0000","last_undegraded":"2024-09-11T00:14:56.759657+0000","last_fullsized":"2024-09-11T00:14:56.759657+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:57.051435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760425+0000","last_change":"2024-09-11T00:14:25.914977+0000","last_active":"2024-09-11T00:14:56.760425+0000","last_peered":"2024-09-11T00:14:56.760425+0000","last_clean":"2024-09-11T00:14:56.760425+0000","last_became_active":"2024-09-11T00:14:25.914543+0000","last_became_peered":"2024-09-11T00:14:25.914543+0000","last_unstale":"2024-09-11T00:14:56.760425+0000","last_undegraded":"2024-09-11T00:14:56.760425+0000","last_fullsized":"2024-09-11T00:14:56.760425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:45.085347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760412+0000","last_change":"2024-09-11T00:14:25.928021+0000","last_active":"2024-09-11T00:14:56.760412+0000","last_peered":"2024-09-11T00:14:56.760412+0000","last_clean":"2024-09-11T00:14:56.760412+0000","last_became_active":"2024-09-11T00:14:25.927047+0000","last_became_peered":"2024-09-11T00:14:25.927047+0000","last_unstale":"2024-09-11T00:14:56.760412+0000","last_undegraded":"2024-09-11T00:14:56.760412+0000","last_fullsized":"2024-09-11T00:14:56.760412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:41.442622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.758727+0000","last_change":"2024-09-11T00:14:25.925399+0000","last_active":"2024-09-11T00:14:56.758727+0000","last_peered":"2024-09-11T00:14:56.758727+0000","last_clean":"2024-09-11T00:14:56.758727+0000","last_became_active":"2024-09-11T00:14:25.925097+0000","last_became_peered":"2024-09-11T00:14:25.925097+0000","last_unstale":"2024-09-11T00:14:56.758727+0000","last_undegraded":"2024-09-11T00:14:56.758727+0000","last_fullsized":"2024-09-11T00:14:56.758727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:36:44.962936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.841242+0000","last_change":"2024-09-11T00:14:25.928123+0000","last_active":"2024-09-11T00:14:56.841242+0000","last_peered":"2024-09-11T00:14:56.841242+0000","last_clean":"2024-09-11T00:14:56.841242+0000","last_became_active":"2024-09-11T00:14:25.927826+0000","last_became_peered":"2024-09-11T00:14:25.927826+0000","last_unstale":"2024-09-11T00:14:56.841242+0000","last_undegraded":"2024-09-11T00:14:56.841242+0000","last_fullsized":"2024-09-11T00:14:56.841242+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:44.131708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.761912+0000","last_change":"2024-09-11T00:14:25.920546+0000","last_active":"2024-09-11T00:14:56.761912+0000","last_peered":"2024-09-11T00:14:56.761912+0000","last_clean":"2024-09-11T00:14:56.761912+0000","last_became_active":"2024-09-11T00:14:25.920193+0000","last_became_peered":"2024-09-11T00:14:25.920193+0000","last_unstale":"2024-09-11T00:14:56.761912+0000","last_undegraded":"2024-09-11T00:14:56.761912+0000","last_fullsized":"2024-09-11T00:14:56.761912+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:55.027260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.761161+0000","last_change":"2024-09-11T00:14:25.931278+0000","last_active":"2024-09-11T00:14:56.761161+0000","last_peered":"2024-09-11T00:14:56.761161+0000","last_clean":"2024-09-11T00:14:56.761161+0000","last_became_active":"2024-09-11T00:14:25.930964+0000","last_became_peered":"2024-09-11T00:14:25.930964+0000","last_unstale":"2024-09-11T00:14:56.761161+0000","last_undegraded":"2024-09-11T00:14:56.761161+0000","last_fullsized":"2024-09-11T00:14:56.761161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:06.537737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.765319+0000","last_change":"2024-09-11T00:14:25.919725+0000","last_active":"2024-09-11T00:14:56.765319+0000","last_peered":"2024-09-11T00:14:56.765319+0000","last_clean":"2024-09-11T00:14:56.765319+0000","last_became_active":"2024-09-11T00:14:25.918973+0000","last_became_peered":"2024-09-11T00:14:25.918973+0000","last_unstale":"2024-09-11T00:14:56.765319+0000","last_undegraded":"2024-09-11T00:14:56.765319+0000","last_fullsized":"2024-09-11T00:14:56.765319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:01:03.076980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762881+0000","last_change":"2024-09-11T00:14:25.922516+0000","last_active":"2024-09-11T00:14:56.762881+0000","last_peered":"2024-09-11T00:14:56.762881+0000","last_clean":"2024-09-11T00:14:56.762881+0000","last_became_active":"2024-09-11T00:14:25.922198+0000","last_became_peered":"2024-09-11T00:14:25.922198+0000","last_unstale":"2024-09-11T00:14:56.762881+0000","last_undegraded":"2024-09-11T00:14:56.762881+0000","last_fullsized":"2024-09-11T00:14:56.762881+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:26.065492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760353+0000","last_change":"2024-09-11T00:14:25.921663+0000","last_active":"2024-09-11T00:14:56.760353+0000","last_peered":"2024-09-11T00:14:56.760353+0000","last_clean":"2024-09-11T00:14:56.760353+0000","last_became_active":"2024-09-11T00:14:25.921328+0000","last_became_peered":"2024-09-11T00:14:25.921328+0000","last_unstale":"2024-09-11T00:14:56.760353+0000","last_undegraded":"2024-09-11T00:14:56.760353+0000","last_fullsized":"2024-09-11T00:14:56.760353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:04.674811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.842231+0000","last_change":"2024-09-11T00:14:56.842141+0000","last_active":"2024-09-11T00:14:56.842231+0000","last_peered":"2024-09-11T00:14:56.842231+0000","last_clean":"2024-09-11T00:14:56.842231+0000","last_became_active":"2024-09-11T00:14:56.841726+0000","last_became_peered":"2024-09-11T00:14:56.841726+0000","last_unstale":"2024-09-11T00:14:56.842231+0000","last_undegraded":"2024-09-11T00:14:56.842231+0000","last_fullsized":"2024-09-11T00:14:56.842231+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:46.239876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.840803+0000","last_change":"2024-09-11T00:14:25.927202+0000","last_active":"2024-09-11T00:14:56.840803+0000","last_peered":"2024-09-11T00:14:56.840803+0000","last_clean":"2024-09-11T00:14:56.840803+0000","last_became_active":"2024-09-11T00:14:25.926872+0000","last_became_peered":"2024-09-11T00:14:25.926872+0000","last_unstale":"2024-09-11T00:14:56.840803+0000","last_undegraded":"2024-09-11T00:14:56.840803+0000","last_fullsized":"2024-09-11T00:14:56.840803+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:44.409956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762981+0000","last_change":"2024-09-11T00:14:25.923975+0000","last_active":"2024-09-11T00:14:56.762981+0000","last_peered":"2024-09-11T00:14:56.762981+0000","last_clean":"2024-09-11T00:14:56.762981+0000","last_became_active":"2024-09-11T00:14:25.923666+0000","last_became_peered":"2024-09-11T00:14:25.923666+0000","last_unstale":"2024-09-11T00:14:56.762981+0000","last_undegraded":"2024-09-11T00:14:56.762981+0000","last_fullsized":"2024-09-11T00:14:56.762981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:54.803657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762992+0000","last_change":"2024-09-11T00:14:25.928083+0000","last_active":"2024-09-11T00:14:56.762992+0000","last_peered":"2024-09-11T00:14:56.762992+0000","last_clean":"2024-09-11T00:14:56.762992+0000","last_became_active":"2024-09-11T00:14:25.927727+0000","last_became_peered":"2024-09-11T00:14:25.927727+0000","last_unstale":"2024-09-11T00:14:56.762992+0000","last_undegraded":"2024-09-11T00:14:56.762992+0000","last_fullsized":"2024-09-11T00:14:56.762992+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:56.721661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.841007+0000","last_change":"2024-09-11T00:14:25.910506+0000","last_active":"2024-09-11T00:14:56.841007+0000","last_peered":"2024-09-11T00:14:56.841007+0000","last_clean":"2024-09-11T00:14:56.841007+0000","last_became_active":"2024-09-11T00:14:25.910112+0000","last_became_peered":"2024-09-11T00:14:25.910112+0000","last_unstale":"2024-09-11T00:14:56.841007+0000","last_undegraded":"2024-09-11T00:14:56.841007+0000","last_fullsized":"2024-09-11T00:14:56.841007+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:33:32.698411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762084+0000","last_change":"2024-09-11T00:14:25.918512+0000","last_active":"2024-09-11T00:14:56.762084+0000","last_peered":"2024-09-11T00:14:56.762084+0000","last_clean":"2024-09-11T00:14:56.762084+0000","last_became_active":"2024-09-11T00:14:25.918191+0000","last_became_peered":"2024-09-11T00:14:25.918191+0000","last_unstale":"2024-09-11T00:14:56.762084+0000","last_undegraded":"2024-09-11T00:14:56.762084+0000","last_fullsized":"2024-09-11T00:14:56.762084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:07:49.588919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762791+0000","last_change":"2024-09-11T00:14:25.918163+0000","last_active":"2024-09-11T00:14:56.762791+0000","last_peered":"2024-09-11T00:14:56.762791+0000","last_clean":"2024-09-11T00:14:56.762791+0000","last_became_active":"2024-09-11T00:14:25.917851+0000","last_became_peered":"2024-09-11T00:14:25.917851+0000","last_unstale":"2024-09-11T00:14:56.762791+0000","last_undegraded":"2024-09-11T00:14:56.762791+0000","last_fullsized":"2024-09-11T00:14:56.762791+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:11.757881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.840950+0000","last_change":"2024-09-11T00:14:25.930503+0000","last_active":"2024-09-11T00:14:56.840950+0000","last_peered":"2024-09-11T00:14:56.840950+0000","last_clean":"2024-09-11T00:14:56.840950+0000","last_became_active":"2024-09-11T00:14:25.930140+0000","last_became_peered":"2024-09-11T00:14:25.930140+0000","last_unstale":"2024-09-11T00:14:56.840950+0000","last_undegraded":"2024-09-11T00:14:56.840950+0000","last_fullsized":"2024-09-11T00:14:56.840950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:43.227373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.758775+0000","last_change":"2024-09-11T00:14:25.916866+0000","last_active":"2024-09-11T00:14:56.758775+0000","last_peered":"2024-09-11T00:14:56.758775+0000","last_clean":"2024-09-11T00:14:56.758775+0000","last_became_active":"2024-09-11T00:14:25.916393+0000","last_became_peered":"2024-09-11T00:14:25.916393+0000","last_unstale":"2024-09-11T00:14:56.758775+0000","last_undegraded":"2024-09-11T00:14:56.758775+0000","last_fullsized":"2024-09-11T00:14:56.758775+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:52.697895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.766391+0000","last_change":"2024-09-11T00:14:56.764743+0000","last_active":"2024-09-11T00:14:56.766391+0000","last_peered":"2024-09-11T00:14:56.766391+0000","last_clean":"2024-09-11T00:14:56.766391+0000","last_became_active":"2024-09-11T00:14:56.764333+0000","last_became_peered":"2024-09-11T00:14:56.764333+0000","last_unstale":"2024-09-11T00:14:56.766391+0000","last_undegraded":"2024-09-11T00:14:56.766391+0000","last_fullsized":"2024-09-11T00:14:56.766391+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:17:00.307318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,3],"acting":[7,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.759104+0000","last_change":"2024-09-11T00:14:25.913694+0000","last_active":"2024-09-11T00:14:56.759104+0000","last_peered":"2024-09-11T00:14:56.759104+0000","last_clean":"2024-09-11T00:14:56.759104+0000","last_became_active":"2024-09-11T00:14:25.913405+0000","last_became_peered":"2024-09-11T00:14:25.913405+0000","last_unstale":"2024-09-11T00:14:56.759104+0000","last_undegraded":"2024-09-11T00:14:56.759104+0000","last_fullsized":"2024-09-11T00:14:56.759104+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:24.636698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.841146+0000","last_change":"2024-09-11T00:14:25.928598+0000","last_active":"2024-09-11T00:14:56.841146+0000","last_peered":"2024-09-11T00:14:56.841146+0000","last_clean":"2024-09-11T00:14:56.841146+0000","last_became_active":"2024-09-11T00:14:25.928230+0000","last_became_peered":"2024-09-11T00:14:25.928230+0000","last_unstale":"2024-09-11T00:14:56.841146+0000","last_undegraded":"2024-09-11T00:14:56.841146+0000","last_fullsized":"2024-09-11T00:14:56.841146+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:00.820900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762270+0000","last_change":"2024-09-11T00:14:25.922296+0000","last_active":"2024-09-11T00:14:56.762270+0000","last_peered":"2024-09-11T00:14:56.762270+0000","last_clean":"2024-09-11T00:14:56.762270+0000","last_became_active":"2024-09-11T00:14:25.921188+0000","last_became_peered":"2024-09-11T00:14:25.921188+0000","last_unstale":"2024-09-11T00:14:56.762270+0000","last_undegraded":"2024-09-11T00:14:56.762270+0000","last_fullsized":"2024-09-11T00:14:56.762270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:31.478302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762806+0000","last_change":"2024-09-11T00:14:25.910201+0000","last_active":"2024-09-11T00:14:56.762806+0000","last_peered":"2024-09-11T00:14:56.762806+0000","last_clean":"2024-09-11T00:14:56.762806+0000","last_became_active":"2024-09-11T00:14:25.909867+0000","last_became_peered":"2024-09-11T00:14:25.909867+0000","last_unstale":"2024-09-11T00:14:56.762806+0000","last_undegraded":"2024-09-11T00:14:56.762806+0000","last_fullsized":"2024-09-11T00:14:56.762806+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:17.445805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760732+0000","last_change":"2024-09-11T00:14:25.914971+0000","last_active":"2024-09-11T00:14:56.760732+0000","last_peered":"2024-09-11T00:14:56.760732+0000","last_clean":"2024-09-11T00:14:56.760732+0000","last_became_active":"2024-09-11T00:14:25.914614+0000","last_became_peered":"2024-09-11T00:14:25.914614+0000","last_unstale":"2024-09-11T00:14:56.760732+0000","last_undegraded":"2024-09-11T00:14:56.760732+0000","last_fullsized":"2024-09-11T00:14:56.760732+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.840808+0000","last_change":"2024-09-11T00:14:25.916006+0000","last_active":"2024-09-11T00:14:56.840808+0000","last_peered":"2024-09-11T00:14:56.840808+0000","last_clean":"2024-09-11T00:14:56.840808+0000","last_became_active":"2024-09-11T00:14:25.915479+0000","last_became_peered":"2024-09-11T00:14:25.915479+0000","last_unstale":"2024-09-11T00:14:56.840808+0000","last_undegraded":"2024-09-11T00:14:56.840808+0000","last_fullsized":"2024-09-11T00:14:56.840808+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:42.513673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.841141+0000","last_change":"2024-09-11T00:14:25.925601+0000","last_active":"2024-09-11T00:14:56.841141+0000","last_peered":"2024-09-11T00:14:56.841141+0000","last_clean":"2024-09-11T00:14:56.841141+0000","last_became_active":"2024-09-11T00:14:25.925289+0000","last_became_peered":"2024-09-11T00:14:25.925289+0000","last_unstale":"2024-09-11T00:14:56.841141+0000","last_undegraded":"2024-09-11T00:14:56.841141+0000","last_fullsized":"2024-09-11T00:14:56.841141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:17.324565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762043+0000","last_change":"2024-09-11T00:14:25.922316+0000","last_active":"2024-09-11T00:14:56.762043+0000","last_peered":"2024-09-11T00:14:56.762043+0000","last_clean":"2024-09-11T00:14:56.762043+0000","last_became_active":"2024-09-11T00:14:25.920991+0000","last_became_peered":"2024-09-11T00:14:25.920991+0000","last_unstale":"2024-09-11T00:14:56.762043+0000","last_undegraded":"2024-09-11T00:14:56.762043+0000","last_fullsized":"2024-09-11T00:14:56.762043+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:36.362500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.759753+0000","last_change":"2024-09-11T00:14:25.919579+0000","last_active":"2024-09-11T00:14:56.759753+0000","last_peered":"2024-09-11T00:14:56.759753+0000","last_clean":"2024-09-11T00:14:56.759753+0000","last_became_active":"2024-09-11T00:14:25.919245+0000","last_became_peered":"2024-09-11T00:14:25.919245+0000","last_unstale":"2024-09-11T00:14:56.759753+0000","last_undegraded":"2024-09-11T00:14:56.759753+0000","last_fullsized":"2024-09-11T00:14:56.759753+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:47.885242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.767754+0000","last_change":"2024-09-11T00:14:56.767631+0000","last_active":"2024-09-11T00:14:56.767754+0000","last_peered":"2024-09-11T00:14:56.767754+0000","last_clean":"2024-09-11T00:14:56.767754+0000","last_became_active":"2024-09-11T00:14:56.767229+0000","last_became_peered":"2024-09-11T00:14:56.767229+0000","last_unstale":"2024-09-11T00:14:56.767754+0000","last_undegraded":"2024-09-11T00:14:56.767754+0000","last_fullsized":"2024-09-11T00:14:56.767754+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:15.084255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.764619+0000","last_change":"2024-09-11T00:14:25.921414+0000","last_active":"2024-09-11T00:14:56.764619+0000","last_peered":"2024-09-11T00:14:56.764619+0000","last_clean":"2024-09-11T00:14:56.764619+0000","last_became_active":"2024-09-11T00:14:25.921096+0000","last_became_peered":"2024-09-11T00:14:25.921096+0000","last_unstale":"2024-09-11T00:14:56.764619+0000","last_undegraded":"2024-09-11T00:14:56.764619+0000","last_fullsized":"2024-09-11T00:14:56.764619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:38:45.938435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760557+0000","last_change":"2024-09-11T00:14:23.913359+0000","last_active":"2024-09-11T00:14:56.760557+0000","last_peered":"2024-09-11T00:14:56.760557+0000","last_clean":"2024-09-11T00:14:56.760557+0000","last_became_active":"2024-09-11T00:14:23.913073+0000","last_became_peered":"2024-09-11T00:14:23.913073+0000","last_unstale":"2024-09-11T00:14:56.760557+0000","last_undegraded":"2024-09-11T00:14:56.760557+0000","last_fullsized":"2024-09-11T00:14:56.760557+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:04.907618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.763667+0000","last_change":"2024-09-11T00:14:23.905723+0000","last_active":"2024-09-11T00:14:56.763667+0000","last_peered":"2024-09-11T00:14:56.763667+0000","last_clean":"2024-09-11T00:14:56.763667+0000","last_became_active":"2024-09-11T00:14:23.905392+0000","last_became_peered":"2024-09-11T00:14:23.905392+0000","last_unstale":"2024-09-11T00:14:56.763667+0000","last_undegraded":"2024-09-11T00:14:56.763667+0000","last_fullsized":"2024-09-11T00:14:56.763667+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:48.603410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.758833+0000","last_change":"2024-09-11T00:14:25.915843+0000","last_active":"2024-09-11T00:14:56.758833+0000","last_peered":"2024-09-11T00:14:56.758833+0000","last_clean":"2024-09-11T00:14:56.758833+0000","last_became_active":"2024-09-11T00:14:25.915543+0000","last_became_peered":"2024-09-11T00:14:25.915543+0000","last_unstale":"2024-09-11T00:14:56.758833+0000","last_undegraded":"2024-09-11T00:14:56.758833+0000","last_fullsized":"2024-09-11T00:14:56.758833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:10.781401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.764170+0000","last_change":"2024-09-11T00:14:23.913017+0000","last_active":"2024-09-11T00:14:56.764170+0000","last_peered":"2024-09-11T00:14:56.764170+0000","last_clean":"2024-09-11T00:14:56.764170+0000","last_became_active":"2024-09-11T00:14:23.912674+0000","last_became_peered":"2024-09-11T00:14:23.912674+0000","last_unstale":"2024-09-11T00:14:56.764170+0000","last_undegraded":"2024-09-11T00:14:56.764170+0000","last_fullsized":"2024-09-11T00:14:56.764170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:22.711358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762932+0000","last_change":"2024-09-11T00:14:25.917969+0000","last_active":"2024-09-11T00:14:56.762932+0000","last_peered":"2024-09-11T00:14:56.762932+0000","last_clean":"2024-09-11T00:14:56.762932+0000","last_became_active":"2024-09-11T00:14:25.917673+0000","last_became_peered":"2024-09-11T00:14:25.917673+0000","last_unstale":"2024-09-11T00:14:56.762932+0000","last_undegraded":"2024-09-11T00:14:56.762932+0000","last_fullsized":"2024-09-11T00:14:56.762932+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:55:36.992260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.761891+0000","last_change":"2024-09-11T00:14:23.915544+0000","last_active":"2024-09-11T00:14:56.761891+0000","last_peered":"2024-09-11T00:14:56.761891+0000","last_clean":"2024-09-11T00:14:56.761891+0000","last_became_active":"2024-09-11T00:14:23.915129+0000","last_became_peered":"2024-09-11T00:14:23.915129+0000","last_unstale":"2024-09-11T00:14:56.761891+0000","last_undegraded":"2024-09-11T00:14:56.761891+0000","last_fullsized":"2024-09-11T00:14:56.761891+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:06.720068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.841177+0000","last_change":"2024-09-11T00:14:25.927212+0000","last_active":"2024-09-11T00:14:56.841177+0000","last_peered":"2024-09-11T00:14:56.841177+0000","last_clean":"2024-09-11T00:14:56.841177+0000","last_became_active":"2024-09-11T00:14:25.926875+0000","last_became_peered":"2024-09-11T00:14:25.926875+0000","last_unstale":"2024-09-11T00:14:56.841177+0000","last_undegraded":"2024-09-11T00:14:56.841177+0000","last_fullsized":"2024-09-11T00:14:56.841177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:06.749494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.761141+0000","last_change":"2024-09-11T00:14:23.907318+0000","last_active":"2024-09-11T00:14:56.761141+0000","last_peered":"2024-09-11T00:14:56.761141+0000","last_clean":"2024-09-11T00:14:56.761141+0000","last_became_active":"2024-09-11T00:14:23.905858+0000","last_became_peered":"2024-09-11T00:14:23.905858+0000","last_unstale":"2024-09-11T00:14:56.761141+0000","last_undegraded":"2024-09-11T00:14:56.761141+0000","last_fullsized":"2024-09-11T00:14:56.761141+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:16.005219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760807+0000","last_change":"2024-09-11T00:14:25.922126+0000","last_active":"2024-09-11T00:14:56.760807+0000","last_peered":"2024-09-11T00:14:56.760807+0000","last_clean":"2024-09-11T00:14:56.760807+0000","last_became_active":"2024-09-11T00:14:25.921801+0000","last_became_peered":"2024-09-11T00:14:25.921801+0000","last_unstale":"2024-09-11T00:14:56.760807+0000","last_undegraded":"2024-09-11T00:14:56.760807+0000","last_fullsized":"2024-09-11T00:14:56.760807+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:06.770343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.764619+0000","last_change":"2024-09-11T00:14:24.083872+0000","last_active":"2024-09-11T00:14:56.764619+0000","last_peered":"2024-09-11T00:14:56.764619+0000","last_clean":"2024-09-11T00:14:56.764619+0000","last_became_active":"2024-09-11T00:14:24.083479+0000","last_became_peered":"2024-09-11T00:14:24.083479+0000","last_unstale":"2024-09-11T00:14:56.764619+0000","last_undegraded":"2024-09-11T00:14:56.764619+0000","last_fullsized":"2024-09-11T00:14:56.764619+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:19:30.492828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.840947+0000","last_change":"2024-09-11T00:14:25.932281+0000","last_active":"2024-09-11T00:14:56.840947+0000","last_peered":"2024-09-11T00:14:56.840947+0000","last_clean":"2024-09-11T00:14:56.840947+0000","last_became_active":"2024-09-11T00:14:25.931935+0000","last_became_peered":"2024-09-11T00:14:25.931935+0000","last_unstale":"2024-09-11T00:14:56.840947+0000","last_undegraded":"2024-09-11T00:14:56.840947+0000","last_fullsized":"2024-09-11T00:14:56.840947+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:55.166421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'27","reported_seq":159,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:15:23.809633+0000","last_change":"2024-09-11T00:14:23.909614+0000","last_active":"2024-09-11T00:15:23.809633+0000","last_peered":"2024-09-11T00:15:23.809633+0000","last_clean":"2024-09-11T00:15:23.809633+0000","last_became_active":"2024-09-11T00:14:23.909209+0000","last_became_peered":"2024-09-11T00:14:23.909209+0000","last_unstale":"2024-09-11T00:15:23.809633+0000","last_undegraded":"2024-09-11T00:15:23.809633+0000","last_fullsized":"2024-09-11T00:15:23.809633+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:14.467304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62817,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":109,"num_read_kb":115,"num_write":27,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.759991+0000","last_change":"2024-09-11T00:14:25.924008+0000","last_active":"2024-09-11T00:14:56.759991+0000","last_peered":"2024-09-11T00:14:56.759991+0000","last_clean":"2024-09-11T00:14:56.759991+0000","last_became_active":"2024-09-11T00:14:25.923680+0000","last_became_peered":"2024-09-11T00:14:25.923680+0000","last_unstale":"2024-09-11T00:14:56.759991+0000","last_undegraded":"2024-09-11T00:14:56.759991+0000","last_fullsized":"2024-09-11T00:14:56.759991+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:27.106405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.841007+0000","last_change":"2024-09-11T00:14:23.906908+0000","last_active":"2024-09-11T00:14:56.841007+0000","last_peered":"2024-09-11T00:14:56.841007+0000","last_clean":"2024-09-11T00:14:56.841007+0000","last_became_active":"2024-09-11T00:14:23.906170+0000","last_became_peered":"2024-09-11T00:14:23.906170+0000","last_unstale":"2024-09-11T00:14:56.841007+0000","last_undegraded":"2024-09-11T00:14:56.841007+0000","last_fullsized":"2024-09-11T00:14:56.841007+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:10:27.314551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762639+0000","last_change":"2024-09-11T00:14:25.917896+0000","last_active":"2024-09-11T00:14:56.762639+0000","last_peered":"2024-09-11T00:14:56.762639+0000","last_clean":"2024-09-11T00:14:56.762639+0000","last_became_active":"2024-09-11T00:14:25.916341+0000","last_became_peered":"2024-09-11T00:14:25.916341+0000","last_unstale":"2024-09-11T00:14:56.762639+0000","last_undegraded":"2024-09-11T00:14:56.762639+0000","last_fullsized":"2024-09-11T00:14:56.762639+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:05.723223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.764574+0000","last_change":"2024-09-11T00:14:23.913113+0000","last_active":"2024-09-11T00:14:56.764574+0000","last_peered":"2024-09-11T00:14:56.764574+0000","last_clean":"2024-09-11T00:14:56.764574+0000","last_became_active":"2024-09-11T00:14:23.912791+0000","last_became_peered":"2024-09-11T00:14:23.912791+0000","last_unstale":"2024-09-11T00:14:56.764574+0000","last_undegraded":"2024-09-11T00:14:56.764574+0000","last_fullsized":"2024-09-11T00:14:56.764574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:31.124528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.761108+0000","last_change":"2024-09-11T00:14:25.927511+0000","last_active":"2024-09-11T00:14:56.761108+0000","last_peered":"2024-09-11T00:14:56.761108+0000","last_clean":"2024-09-11T00:14:56.761108+0000","last_became_active":"2024-09-11T00:14:25.927144+0000","last_became_peered":"2024-09-11T00:14:25.927144+0000","last_unstale":"2024-09-11T00:14:56.761108+0000","last_undegraded":"2024-09-11T00:14:56.761108+0000","last_fullsized":"2024-09-11T00:14:56.761108+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:35.680110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.765549+0000","last_change":"2024-09-11T00:14:23.906706+0000","last_active":"2024-09-11T00:14:56.765549+0000","last_peered":"2024-09-11T00:14:56.765549+0000","last_clean":"2024-09-11T00:14:56.765549+0000","last_became_active":"2024-09-11T00:14:23.906368+0000","last_became_peered":"2024-09-11T00:14:23.906368+0000","last_unstale":"2024-09-11T00:14:56.765549+0000","last_undegraded":"2024-09-11T00:14:56.765549+0000","last_fullsized":"2024-09-11T00:14:56.765549+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:30:40.798446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760898+0000","last_change":"2024-09-11T00:14:25.925996+0000","last_active":"2024-09-11T00:14:56.760898+0000","last_peered":"2024-09-11T00:14:56.760898+0000","last_clean":"2024-09-11T00:14:56.760898+0000","last_became_active":"2024-09-11T00:14:25.925653+0000","last_became_peered":"2024-09-11T00:14:25.925653+0000","last_unstale":"2024-09-11T00:14:56.760898+0000","last_undegraded":"2024-09-11T00:14:56.760898+0000","last_fullsized":"2024-09-11T00:14:56.760898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:50.366666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.759659+0000","last_change":"2024-09-11T00:14:24.083774+0000","last_active":"2024-09-11T00:14:56.759659+0000","last_peered":"2024-09-11T00:14:56.759659+0000","last_clean":"2024-09-11T00:14:56.759659+0000","last_became_active":"2024-09-11T00:14:24.083398+0000","last_became_peered":"2024-09-11T00:14:24.083398+0000","last_unstale":"2024-09-11T00:14:56.759659+0000","last_undegraded":"2024-09-11T00:14:56.759659+0000","last_fullsized":"2024-09-11T00:14:56.759659+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:34.019592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.764379+0000","last_change":"2024-09-11T00:14:25.927171+0000","last_active":"2024-09-11T00:14:56.764379+0000","last_peered":"2024-09-11T00:14:56.764379+0000","last_clean":"2024-09-11T00:14:56.764379+0000","last_became_active":"2024-09-11T00:14:25.926873+0000","last_became_peered":"2024-09-11T00:14:25.926873+0000","last_unstale":"2024-09-11T00:14:56.764379+0000","last_undegraded":"2024-09-11T00:14:56.764379+0000","last_fullsized":"2024-09-11T00:14:56.764379+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:26.042903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.770383+0000","last_change":"2024-09-11T00:14:56.770315+0000","last_active":"2024-09-11T00:14:56.770383+0000","last_peered":"2024-09-11T00:14:56.770383+0000","last_clean":"2024-09-11T00:14:56.770383+0000","last_became_active":"2024-09-11T00:14:56.767056+0000","last_became_peered":"2024-09-11T00:14:56.767056+0000","last_unstale":"2024-09-11T00:14:56.770383+0000","last_undegraded":"2024-09-11T00:14:56.770383+0000","last_fullsized":"2024-09-11T00:14:56.770383+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:25.136382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.765993+0000","last_change":"2024-09-11T00:14:56.765888+0000","last_active":"2024-09-11T00:14:56.765993+0000","last_peered":"2024-09-11T00:14:56.765993+0000","last_clean":"2024-09-11T00:14:56.765993+0000","last_became_active":"2024-09-11T00:14:56.765508+0000","last_became_peered":"2024-09-11T00:14:56.765508+0000","last_unstale":"2024-09-11T00:14:56.765993+0000","last_undegraded":"2024-09-11T00:14:56.765993+0000","last_fullsized":"2024-09-11T00:14:56.765993+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:10.013207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762966+0000","last_change":"2024-09-11T00:14:23.904807+0000","last_active":"2024-09-11T00:14:56.762966+0000","last_peered":"2024-09-11T00:14:56.762966+0000","last_clean":"2024-09-11T00:14:56.762966+0000","last_became_active":"2024-09-11T00:14:23.904532+0000","last_became_peered":"2024-09-11T00:14:23.904532+0000","last_unstale":"2024-09-11T00:14:56.762966+0000","last_undegraded":"2024-09-11T00:14:56.762966+0000","last_fullsized":"2024-09-11T00:14:56.762966+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:08.945508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.761443+0000","last_change":"2024-09-11T00:14:25.919548+0000","last_active":"2024-09-11T00:14:56.761443+0000","last_peered":"2024-09-11T00:14:56.761443+0000","last_clean":"2024-09-11T00:14:56.761443+0000","last_became_active":"2024-09-11T00:14:25.919216+0000","last_became_peered":"2024-09-11T00:14:25.919216+0000","last_unstale":"2024-09-11T00:14:56.761443+0000","last_undegraded":"2024-09-11T00:14:56.761443+0000","last_fullsized":"2024-09-11T00:14:56.761443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:18.318193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.764850+0000","last_change":"2024-09-11T00:14:23.915488+0000","last_active":"2024-09-11T00:14:56.764850+0000","last_peered":"2024-09-11T00:14:56.764850+0000","last_clean":"2024-09-11T00:14:56.764850+0000","last_became_active":"2024-09-11T00:14:23.915147+0000","last_became_peered":"2024-09-11T00:14:23.915147+0000","last_unstale":"2024-09-11T00:14:56.764850+0000","last_undegraded":"2024-09-11T00:14:56.764850+0000","last_fullsized":"2024-09-11T00:14:56.764850+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:04.830225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.761038+0000","last_change":"2024-09-11T00:14:25.919774+0000","last_active":"2024-09-11T00:14:56.761038+0000","last_peered":"2024-09-11T00:14:56.761038+0000","last_clean":"2024-09-11T00:14:56.761038+0000","last_became_active":"2024-09-11T00:14:25.919422+0000","last_became_peered":"2024-09-11T00:14:25.919422+0000","last_unstale":"2024-09-11T00:14:56.761038+0000","last_undegraded":"2024-09-11T00:14:56.761038+0000","last_fullsized":"2024-09-11T00:14:56.761038+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:03.928972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.841315+0000","last_change":"2024-09-11T00:14:24.082414+0000","last_active":"2024-09-11T00:14:56.841315+0000","last_peered":"2024-09-11T00:14:56.841315+0000","last_clean":"2024-09-11T00:14:56.841315+0000","last_became_active":"2024-09-11T00:14:24.082058+0000","last_became_peered":"2024-09-11T00:14:24.082058+0000","last_unstale":"2024-09-11T00:14:56.841315+0000","last_undegraded":"2024-09-11T00:14:56.841315+0000","last_fullsized":"2024-09-11T00:14:56.841315+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:38.349964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.761158+0000","last_change":"2024-09-11T00:14:25.930116+0000","last_active":"2024-09-11T00:14:56.761158+0000","last_peered":"2024-09-11T00:14:56.761158+0000","last_clean":"2024-09-11T00:14:56.761158+0000","last_became_active":"2024-09-11T00:14:25.929787+0000","last_became_peered":"2024-09-11T00:14:25.929787+0000","last_unstale":"2024-09-11T00:14:56.761158+0000","last_undegraded":"2024-09-11T00:14:56.761158+0000","last_fullsized":"2024-09-11T00:14:56.761158+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:29.655577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.761027+0000","last_change":"2024-09-11T00:13:12.338952+0000","last_active":"2024-09-11T00:14:56.761027+0000","last_peered":"2024-09-11T00:14:56.761027+0000","last_clean":"2024-09-11T00:14:56.761027+0000","last_became_active":"2024-09-11T00:13:12.335030+0000","last_became_peered":"2024-09-11T00:13:12.335030+0000","last_unstale":"2024-09-11T00:14:56.761027+0000","last_undegraded":"2024-09-11T00:14:56.761027+0000","last_fullsized":"2024-09-11T00:14:56.761027+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:09:48.709624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:09:48.709624+0000","last_clean_scrub_stamp":"2024-09-11T00:09:48.709624+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:43.680771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.765948+0000","last_change":"2024-09-11T00:14:23.906794+0000","last_active":"2024-09-11T00:14:56.765948+0000","last_peered":"2024-09-11T00:14:56.765948+0000","last_clean":"2024-09-11T00:14:56.765948+0000","last_became_active":"2024-09-11T00:14:23.906430+0000","last_became_peered":"2024-09-11T00:14:23.906430+0000","last_unstale":"2024-09-11T00:14:56.765948+0000","last_undegraded":"2024-09-11T00:14:56.765948+0000","last_fullsized":"2024-09-11T00:14:56.765948+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:58.804834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.758961+0000","last_change":"2024-09-11T00:14:25.928119+0000","last_active":"2024-09-11T00:14:56.758961+0000","last_peered":"2024-09-11T00:14:56.758961+0000","last_clean":"2024-09-11T00:14:56.758961+0000","last_became_active":"2024-09-11T00:14:25.927806+0000","last_became_peered":"2024-09-11T00:14:25.927806+0000","last_unstale":"2024-09-11T00:14:56.758961+0000","last_undegraded":"2024-09-11T00:14:56.758961+0000","last_fullsized":"2024-09-11T00:14:56.758961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:34.630696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.761017+0000","last_change":"2024-09-11T00:14:23.916252+0000","last_active":"2024-09-11T00:14:56.761017+0000","last_peered":"2024-09-11T00:14:56.761017+0000","last_clean":"2024-09-11T00:14:56.761017+0000","last_became_active":"2024-09-11T00:14:23.915905+0000","last_became_peered":"2024-09-11T00:14:23.915905+0000","last_unstale":"2024-09-11T00:14:56.761017+0000","last_undegraded":"2024-09-11T00:14:56.761017+0000","last_fullsized":"2024-09-11T00:14:56.761017+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:02.229067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.763549+0000","last_change":"2024-09-11T00:14:25.910163+0000","last_active":"2024-09-11T00:14:56.763549+0000","last_peered":"2024-09-11T00:14:56.763549+0000","last_clean":"2024-09-11T00:14:56.763549+0000","last_became_active":"2024-09-11T00:14:25.909926+0000","last_became_peered":"2024-09-11T00:14:25.909926+0000","last_unstale":"2024-09-11T00:14:56.763549+0000","last_undegraded":"2024-09-11T00:14:56.763549+0000","last_fullsized":"2024-09-11T00:14:56.763549+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:59:20.915080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.763738+0000","last_change":"2024-09-11T00:14:24.081999+0000","last_active":"2024-09-11T00:14:56.763738+0000","last_peered":"2024-09-11T00:14:56.763738+0000","last_clean":"2024-09-11T00:14:56.763738+0000","last_became_active":"2024-09-11T00:14:24.081664+0000","last_became_peered":"2024-09-11T00:14:24.081664+0000","last_unstale":"2024-09-11T00:14:56.763738+0000","last_undegraded":"2024-09-11T00:14:56.763738+0000","last_fullsized":"2024-09-11T00:14:56.763738+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:22.485256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.842854+0000","last_change":"2024-09-11T00:14:56.842397+0000","last_active":"2024-09-11T00:14:56.842854+0000","last_peered":"2024-09-11T00:14:56.842854+0000","last_clean":"2024-09-11T00:14:56.842854+0000","last_became_active":"2024-09-11T00:14:56.842017+0000","last_became_peered":"2024-09-11T00:14:56.842017+0000","last_unstale":"2024-09-11T00:14:56.842854+0000","last_undegraded":"2024-09-11T00:14:56.842854+0000","last_fullsized":"2024-09-11T00:14:56.842854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:10.300022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,6],"acting":[9,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760905+0000","last_change":"2024-09-11T00:14:23.905241+0000","last_active":"2024-09-11T00:14:56.760905+0000","last_peered":"2024-09-11T00:14:56.760905+0000","last_clean":"2024-09-11T00:14:56.760905+0000","last_became_active":"2024-09-11T00:14:23.904833+0000","last_became_peered":"2024-09-11T00:14:23.904833+0000","last_unstale":"2024-09-11T00:14:56.760905+0000","last_undegraded":"2024-09-11T00:14:56.760905+0000","last_fullsized":"2024-09-11T00:14:56.760905+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:44:28.162800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.766094+0000","last_change":"2024-09-11T00:14:56.766007+0000","last_active":"2024-09-11T00:14:56.766094+0000","last_peered":"2024-09-11T00:14:56.766094+0000","last_clean":"2024-09-11T00:14:56.766094+0000","last_became_active":"2024-09-11T00:14:56.765515+0000","last_became_peered":"2024-09-11T00:14:56.765515+0000","last_unstale":"2024-09-11T00:14:56.766094+0000","last_undegraded":"2024-09-11T00:14:56.766094+0000","last_fullsized":"2024-09-11T00:14:56.766094+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:31.159084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.763243+0000","last_change":"2024-09-11T00:14:24.083578+0000","last_active":"2024-09-11T00:14:56.763243+0000","last_peered":"2024-09-11T00:14:56.763243+0000","last_clean":"2024-09-11T00:14:56.763243+0000","last_became_active":"2024-09-11T00:14:24.083233+0000","last_became_peered":"2024-09-11T00:14:24.083233+0000","last_unstale":"2024-09-11T00:14:56.763243+0000","last_undegraded":"2024-09-11T00:14:56.763243+0000","last_fullsized":"2024-09-11T00:14:56.763243+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:47.655836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.771539+0000","last_change":"2024-09-11T00:14:56.771471+0000","last_active":"2024-09-11T00:14:56.771539+0000","last_peered":"2024-09-11T00:14:56.771539+0000","last_clean":"2024-09-11T00:14:56.771539+0000","last_became_active":"2024-09-11T00:14:56.764838+0000","last_became_peered":"2024-09-11T00:14:56.764838+0000","last_unstale":"2024-09-11T00:14:56.771539+0000","last_undegraded":"2024-09-11T00:14:56.771539+0000","last_fullsized":"2024-09-11T00:14:56.771539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:24.683423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760123+0000","last_change":"2024-09-11T00:14:24.082284+0000","last_active":"2024-09-11T00:14:56.760123+0000","last_peered":"2024-09-11T00:14:56.760123+0000","last_clean":"2024-09-11T00:14:56.760123+0000","last_became_active":"2024-09-11T00:14:24.081859+0000","last_became_peered":"2024-09-11T00:14:24.081859+0000","last_unstale":"2024-09-11T00:14:56.760123+0000","last_undegraded":"2024-09-11T00:14:56.760123+0000","last_fullsized":"2024-09-11T00:14:56.760123+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:38.881342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762903+0000","last_change":"2024-09-11T00:14:25.910408+0000","last_active":"2024-09-11T00:14:56.762903+0000","last_peered":"2024-09-11T00:14:56.762903+0000","last_clean":"2024-09-11T00:14:56.762903+0000","last_became_active":"2024-09-11T00:14:25.909447+0000","last_became_peered":"2024-09-11T00:14:25.909447+0000","last_unstale":"2024-09-11T00:14:56.762903+0000","last_undegraded":"2024-09-11T00:14:56.762903+0000","last_fullsized":"2024-09-11T00:14:56.762903+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:20:11.249974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'9","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.763086+0000","last_change":"2024-09-11T00:14:23.912799+0000","last_active":"2024-09-11T00:14:56.763086+0000","last_peered":"2024-09-11T00:14:56.763086+0000","last_clean":"2024-09-11T00:14:56.763086+0000","last_became_active":"2024-09-11T00:14:23.912440+0000","last_became_peered":"2024-09-11T00:14:23.912440+0000","last_unstale":"2024-09-11T00:14:56.763086+0000","last_undegraded":"2024-09-11T00:14:56.763086+0000","last_fullsized":"2024-09-11T00:14:56.763086+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:31.139405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.759143+0000","last_change":"2024-09-11T00:14:25.920599+0000","last_active":"2024-09-11T00:14:56.759143+0000","last_peered":"2024-09-11T00:14:56.759143+0000","last_clean":"2024-09-11T00:14:56.759143+0000","last_became_active":"2024-09-11T00:14:25.920256+0000","last_became_peered":"2024-09-11T00:14:25.920256+0000","last_unstale":"2024-09-11T00:14:56.759143+0000","last_undegraded":"2024-09-11T00:14:56.759143+0000","last_fullsized":"2024-09-11T00:14:56.759143+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:05.347880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.765441+0000","last_change":"2024-09-11T00:14:24.004190+0000","last_active":"2024-09-11T00:14:56.765441+0000","last_peered":"2024-09-11T00:14:56.765441+0000","last_clean":"2024-09-11T00:14:56.765441+0000","last_became_active":"2024-09-11T00:14:24.003842+0000","last_became_peered":"2024-09-11T00:14:24.003842+0000","last_unstale":"2024-09-11T00:14:56.765441+0000","last_undegraded":"2024-09-11T00:14:56.765441+0000","last_fullsized":"2024-09-11T00:14:56.765441+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:43.876046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.767159+0000","last_change":"2024-09-11T00:14:56.767088+0000","last_active":"2024-09-11T00:14:56.767159+0000","last_peered":"2024-09-11T00:14:56.767159+0000","last_clean":"2024-09-11T00:14:56.767159+0000","last_became_active":"2024-09-11T00:14:56.766783+0000","last_became_peered":"2024-09-11T00:14:56.766783+0000","last_unstale":"2024-09-11T00:14:56.767159+0000","last_undegraded":"2024-09-11T00:14:56.767159+0000","last_fullsized":"2024-09-11T00:14:56.767159+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:37.407811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,4],"acting":[0,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.840941+0000","last_change":"2024-09-11T00:14:24.082118+0000","last_active":"2024-09-11T00:14:56.840941+0000","last_peered":"2024-09-11T00:14:56.840941+0000","last_clean":"2024-09-11T00:14:56.840941+0000","last_became_active":"2024-09-11T00:14:24.081844+0000","last_became_peered":"2024-09-11T00:14:24.081844+0000","last_unstale":"2024-09-11T00:14:56.840941+0000","last_undegraded":"2024-09-11T00:14:56.840941+0000","last_fullsized":"2024-09-11T00:14:56.840941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:20.827385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.759636+0000","last_change":"2024-09-11T00:14:25.917335+0000","last_active":"2024-09-11T00:14:56.759636+0000","last_peered":"2024-09-11T00:14:56.759636+0000","last_clean":"2024-09-11T00:14:56.759636+0000","last_became_active":"2024-09-11T00:14:25.916942+0000","last_became_peered":"2024-09-11T00:14:25.916942+0000","last_unstale":"2024-09-11T00:14:56.759636+0000","last_undegraded":"2024-09-11T00:14:56.759636+0000","last_fullsized":"2024-09-11T00:14:56.759636+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:40.309186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.758880+0000","last_change":"2024-09-11T00:14:23.906616+0000","last_active":"2024-09-11T00:14:56.758880+0000","last_peered":"2024-09-11T00:14:56.758880+0000","last_clean":"2024-09-11T00:14:56.758880+0000","last_became_active":"2024-09-11T00:14:23.906259+0000","last_became_peered":"2024-09-11T00:14:23.906259+0000","last_unstale":"2024-09-11T00:14:56.758880+0000","last_undegraded":"2024-09-11T00:14:56.758880+0000","last_fullsized":"2024-09-11T00:14:56.758880+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:01.514398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762174+0000","last_change":"2024-09-11T00:14:25.925422+0000","last_active":"2024-09-11T00:14:56.762174+0000","last_peered":"2024-09-11T00:14:56.762174+0000","last_clean":"2024-09-11T00:14:56.762174+0000","last_became_active":"2024-09-11T00:14:25.923031+0000","last_became_peered":"2024-09-11T00:14:25.923031+0000","last_unstale":"2024-09-11T00:14:56.762174+0000","last_undegraded":"2024-09-11T00:14:56.762174+0000","last_fullsized":"2024-09-11T00:14:56.762174+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:59:52.217566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.840820+0000","last_change":"2024-09-11T00:14:23.913308+0000","last_active":"2024-09-11T00:14:56.840820+0000","last_peered":"2024-09-11T00:14:56.840820+0000","last_clean":"2024-09-11T00:14:56.840820+0000","last_became_active":"2024-09-11T00:14:23.913002+0000","last_became_peered":"2024-09-11T00:14:23.913002+0000","last_unstale":"2024-09-11T00:14:56.840820+0000","last_undegraded":"2024-09-11T00:14:56.840820+0000","last_fullsized":"2024-09-11T00:14:56.840820+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:26:43.571378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.758886+0000","last_change":"2024-09-11T00:14:25.917478+0000","last_active":"2024-09-11T00:14:56.758886+0000","last_peered":"2024-09-11T00:14:56.758886+0000","last_clean":"2024-09-11T00:14:56.758886+0000","last_became_active":"2024-09-11T00:14:25.917192+0000","last_became_peered":"2024-09-11T00:14:25.917192+0000","last_unstale":"2024-09-11T00:14:56.758886+0000","last_undegraded":"2024-09-11T00:14:56.758886+0000","last_fullsized":"2024-09-11T00:14:56.758886+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:46.695827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.759828+0000","last_change":"2024-09-11T00:14:23.914141+0000","last_active":"2024-09-11T00:14:56.759828+0000","last_peered":"2024-09-11T00:14:56.759828+0000","last_clean":"2024-09-11T00:14:56.759828+0000","last_became_active":"2024-09-11T00:14:23.913757+0000","last_became_peered":"2024-09-11T00:14:23.913757+0000","last_unstale":"2024-09-11T00:14:56.759828+0000","last_undegraded":"2024-09-11T00:14:56.759828+0000","last_fullsized":"2024-09-11T00:14:56.759828+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:54:00.609715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760810+0000","last_change":"2024-09-11T00:14:25.924950+0000","last_active":"2024-09-11T00:14:56.760810+0000","last_peered":"2024-09-11T00:14:56.760810+0000","last_clean":"2024-09-11T00:14:56.760810+0000","last_became_active":"2024-09-11T00:14:25.924554+0000","last_became_peered":"2024-09-11T00:14:25.924554+0000","last_unstale":"2024-09-11T00:14:56.760810+0000","last_undegraded":"2024-09-11T00:14:56.760810+0000","last_fullsized":"2024-09-11T00:14:56.760810+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:29.303384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.764648+0000","last_change":"2024-09-11T00:14:25.930162+0000","last_active":"2024-09-11T00:14:56.764648+0000","last_peered":"2024-09-11T00:14:56.764648+0000","last_clean":"2024-09-11T00:14:56.764648+0000","last_became_active":"2024-09-11T00:14:25.929820+0000","last_became_peered":"2024-09-11T00:14:25.929820+0000","last_unstale":"2024-09-11T00:14:56.764648+0000","last_undegraded":"2024-09-11T00:14:56.764648+0000","last_fullsized":"2024-09-11T00:14:56.764648+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:20:21.384841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.759996+0000","last_change":"2024-09-11T00:14:23.917486+0000","last_active":"2024-09-11T00:14:56.759996+0000","last_peered":"2024-09-11T00:14:56.759996+0000","last_clean":"2024-09-11T00:14:56.759996+0000","last_became_active":"2024-09-11T00:14:23.917150+0000","last_became_peered":"2024-09-11T00:14:23.917150+0000","last_unstale":"2024-09-11T00:14:56.759996+0000","last_undegraded":"2024-09-11T00:14:56.759996+0000","last_fullsized":"2024-09-11T00:14:56.759996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:13:55.687712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.840910+0000","last_change":"2024-09-11T00:14:25.932674+0000","last_active":"2024-09-11T00:14:56.840910+0000","last_peered":"2024-09-11T00:14:56.840910+0000","last_clean":"2024-09-11T00:14:56.840910+0000","last_became_active":"2024-09-11T00:14:25.932353+0000","last_became_peered":"2024-09-11T00:14:25.932353+0000","last_unstale":"2024-09-11T00:14:56.840910+0000","last_undegraded":"2024-09-11T00:14:56.840910+0000","last_fullsized":"2024-09-11T00:14:56.840910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:48.721854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760062+0000","last_change":"2024-09-11T00:14:23.913063+0000","last_active":"2024-09-11T00:14:56.760062+0000","last_peered":"2024-09-11T00:14:56.760062+0000","last_clean":"2024-09-11T00:14:56.760062+0000","last_became_active":"2024-09-11T00:14:23.912688+0000","last_became_peered":"2024-09-11T00:14:23.912688+0000","last_unstale":"2024-09-11T00:14:56.760062+0000","last_undegraded":"2024-09-11T00:14:56.760062+0000","last_fullsized":"2024-09-11T00:14:56.760062+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:35.228733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760762+0000","last_change":"2024-09-11T00:14:25.928099+0000","last_active":"2024-09-11T00:14:56.760762+0000","last_peered":"2024-09-11T00:14:56.760762+0000","last_clean":"2024-09-11T00:14:56.760762+0000","last_became_active":"2024-09-11T00:14:25.927741+0000","last_became_peered":"2024-09-11T00:14:25.927741+0000","last_unstale":"2024-09-11T00:14:56.760762+0000","last_undegraded":"2024-09-11T00:14:56.760762+0000","last_fullsized":"2024-09-11T00:14:56.760762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:12.263180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.759392+0000","last_change":"2024-09-11T00:14:24.082533+0000","last_active":"2024-09-11T00:14:56.759392+0000","last_peered":"2024-09-11T00:14:56.759392+0000","last_clean":"2024-09-11T00:14:56.759392+0000","last_became_active":"2024-09-11T00:14:24.081666+0000","last_became_peered":"2024-09-11T00:14:24.081666+0000","last_unstale":"2024-09-11T00:14:56.759392+0000","last_undegraded":"2024-09-11T00:14:56.759392+0000","last_fullsized":"2024-09-11T00:14:56.759392+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:56.485366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.759227+0000","last_change":"2024-09-11T00:14:25.912666+0000","last_active":"2024-09-11T00:14:56.759227+0000","last_peered":"2024-09-11T00:14:56.759227+0000","last_clean":"2024-09-11T00:14:56.759227+0000","last_became_active":"2024-09-11T00:14:25.912370+0000","last_became_peered":"2024-09-11T00:14:25.912370+0000","last_unstale":"2024-09-11T00:14:56.759227+0000","last_undegraded":"2024-09-11T00:14:56.759227+0000","last_fullsized":"2024-09-11T00:14:56.759227+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:44.400265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.763142+0000","last_change":"2024-09-11T00:14:23.914407+0000","last_active":"2024-09-11T00:14:56.763142+0000","last_peered":"2024-09-11T00:14:56.763142+0000","last_clean":"2024-09-11T00:14:56.763142+0000","last_became_active":"2024-09-11T00:14:23.914115+0000","last_became_peered":"2024-09-11T00:14:23.914115+0000","last_unstale":"2024-09-11T00:14:56.763142+0000","last_undegraded":"2024-09-11T00:14:56.763142+0000","last_fullsized":"2024-09-11T00:14:56.763142+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:58.883324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63615,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":114,"num_read_kb":120,"num_write":83,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":190845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282342,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743450,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":839680,"data_stored":419980,"data_compressed":5793,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939678,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":974848,"data_stored":1073454,"data_compressed":41703,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103204,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":420657,"data_compressed":5793,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299433,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":839680,"data_stored":420540,"data_compressed":5793,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495661,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":892928,"data_stored":1011025,"data_compressed":41703,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659187,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":839680,"data_stored":420075,"data_compressed":5793,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855417,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":1010625,"data_compressed":41703,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018942,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":839680,"data_stored":419980,"data_compressed":5793,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215170,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":420179,"data_compressed":5793,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":913408,"data_stored":482809,"data_compressed":5793,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542220,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":482775,"data_compressed":5793,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705745,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":839680,"data_stored":420048,"data_compressed":5793,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34264,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34264,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34264,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:15:31.996 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T00:15:32.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:31 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:15:32.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:31 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:15:32.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:31 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:15:32.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:31 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:15:32.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:31 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:15:32.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:31 smithi112 ceph-mon[35627]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:15:32.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:31 smithi112 ceph-mon[35627]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:32.243 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:32.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:31 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:15:32.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:31 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:15:32.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:31 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:15:32.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:31 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:15:32.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:31 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:15:32.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:31 smithi138 ceph-mon[35019]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:15:32.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:31 smithi138 ceph-mon[35019]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:32.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:31 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:15:32.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:31 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:15:32.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:31 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:15:32.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:31 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:15:32.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:31 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:15:32.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:31 smithi078 ceph-mon[30865]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:15:32.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:31 smithi078 ceph-mon[30865]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:32.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.750+0000 7fec724ef640 1 -- 172.21.15.78:0/3882383651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6c101c90 msgr2=0x7fec6c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:32.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.750+0000 7fec724ef640 1 --2- 172.21.15.78:0/3882383651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6c101c90 0x7fec6c102070 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009900 tx=0x7fec5c02a410 comp rx=0 tx=0).stop 2024-09-11T00:15:32.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.750+0000 7fec724ef640 1 -- 172.21.15.78:0/3882383651 shutdown_connections 2024-09-11T00:15:32.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.750+0000 7fec724ef640 1 --2- 172.21.15.78:0/3882383651 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec6c108020 0x7fec6c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:32.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.750+0000 7fec724ef640 1 --2- 172.21.15.78:0/3882383651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec6c1076a0 0x7fec6c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:32.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.750+0000 7fec724ef640 1 --2- 172.21.15.78:0/3882383651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6c101c90 0x7fec6c102070 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:32.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.750+0000 7fec724ef640 1 -- 172.21.15.78:0/3882383651 >> 172.21.15.78:0/3882383651 conn(0x7fec6c0fd700 msgr2=0x7fec6c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:32.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.750+0000 7fec724ef640 1 -- 172.21.15.78:0/3882383651 shutdown_connections 2024-09-11T00:15:32.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.750+0000 7fec724ef640 1 -- 172.21.15.78:0/3882383651 wait complete. 2024-09-11T00:15:32.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.750+0000 7fec724ef640 1 Processor -- start 2024-09-11T00:15:32.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.750+0000 7fec724ef640 1 -- start start 2024-09-11T00:15:32.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.751+0000 7fec724ef640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec6c101c90 0x7fec6c1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:32.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.751+0000 7fec724ef640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6c1076a0 0x7fec6c199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:32.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.751+0000 7fec724ef640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec6c108020 0x7fec6c19ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:32.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.751+0000 7fec724ef640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c111ce0 con 0x7fec6c1076a0 2024-09-11T00:15:32.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.751+0000 7fec724ef640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c111b60 con 0x7fec6c101c90 2024-09-11T00:15:32.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.751+0000 7fec724ef640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c111e60 con 0x7fec6c108020 2024-09-11T00:15:32.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.751+0000 7fec63fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6c1076a0 0x7fec6c199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:32.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.751+0000 7fec63fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6c1076a0 0x7fec6c199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42990/0 (socket says 172.21.15.78:42990) 2024-09-11T00:15:32.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.751+0000 7fec63fff640 1 -- 172.21.15.78:0/2500754591 learned_addr learned my addr 172.21.15.78:0/2500754591 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:32.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.751+0000 7fec6bfff640 1 --2- 172.21.15.78:0/2500754591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec6c101c90 0x7fec6c1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:32.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.751+0000 7fec63fff640 1 -- 172.21.15.78:0/2500754591 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec6c108020 msgr2=0x7fec6c19ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:32.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.751+0000 7fec63fff640 1 --2- 172.21.15.78:0/2500754591 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec6c108020 0x7fec6c19ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:32.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.751+0000 7fec63fff640 1 -- 172.21.15.78:0/2500754591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec6c101c90 msgr2=0x7fec6c1993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:32.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.751+0000 7fec63fff640 1 --2- 172.21.15.78:0/2500754591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec6c101c90 0x7fec6c1993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:32.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.751+0000 7fec63fff640 1 -- 172.21.15.78:0/2500754591 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec6c19f480 con 0x7fec6c1076a0 2024-09-11T00:15:32.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.751+0000 7fec6bfff640 1 --2- 172.21.15.78:0/2500754591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec6c101c90 0x7fec6c1993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:32.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.751+0000 7fec63fff640 1 --2- 172.21.15.78:0/2500754591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6c1076a0 0x7fec6c199910 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fec5400c890 tx=0x7fec5400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:32.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.751+0000 7fec69ffb640 1 -- 172.21.15.78:0/2500754591 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54004220 con 0x7fec6c1076a0 2024-09-11T00:15:32.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.751+0000 7fec724ef640 1 -- 172.21.15.78:0/2500754591 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec6c19f770 con 0x7fec6c1076a0 2024-09-11T00:15:32.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.751+0000 7fec69ffb640 1 -- 172.21.15.78:0/2500754591 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec540043c0 con 0x7fec6c1076a0 2024-09-11T00:15:32.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.751+0000 7fec69ffb640 1 -- 172.21.15.78:0/2500754591 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54004a00 con 0x7fec6c1076a0 2024-09-11T00:15:32.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.751+0000 7fec724ef640 1 -- 172.21.15.78:0/2500754591 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec6c1a5e30 con 0x7fec6c1076a0 2024-09-11T00:15:32.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.752+0000 7fec724ef640 1 -- 172.21.15.78:0/2500754591 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec6c102070 con 0x7fec6c1076a0 2024-09-11T00:15:32.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.754+0000 7fec69ffb640 1 -- 172.21.15.78:0/2500754591 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7fec540079b0 con 0x7fec6c1076a0 2024-09-11T00:15:32.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.754+0000 7fec69ffb640 1 --2- 172.21.15.78:0/2500754591 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fec580b53c0 0x7fec580b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:32.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.754+0000 7fec6bfff640 1 --2- 172.21.15.78:0/2500754591 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fec580b53c0 0x7fec580b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:32.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.755+0000 7fec69ffb640 1 -- 172.21.15.78:0/2500754591 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7fec540e6100 con 0x7fec6c1076a0 2024-09-11T00:15:32.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.755+0000 7fec6bfff640 1 --2- 172.21.15.78:0/2500754591 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fec580b53c0 0x7fec580b7880 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fec5c000c00 tx=0x7fec5c031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:32.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.757+0000 7fec69ffb640 1 -- 172.21.15.78:0/2500754591 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fec54014030 con 0x7fec6c1076a0 2024-09-11T00:15:32.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.929+0000 7fec724ef640 1 -- 172.21.15.78:0/2500754591 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fec6c063590 con 0x7fec580b53c0 2024-09-11T00:15:32.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.935+0000 7fec69ffb640 1 -- 172.21.15.78:0/2500754591 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258890 (secure 0 0 0) 0x7fec6c063590 con 0x7fec580b53c0 2024-09-11T00:15:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:15:32.941 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-11T00:15:32.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.938+0000 7fec724ef640 1 -- 172.21.15.78:0/2500754591 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fec580b53c0 msgr2=0x7fec580b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:32.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.938+0000 7fec724ef640 1 --2- 172.21.15.78:0/2500754591 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fec580b53c0 0x7fec580b7880 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fec5c000c00 tx=0x7fec5c031400 comp rx=0 tx=0).stop 2024-09-11T00:15:32.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.938+0000 7fec724ef640 1 -- 172.21.15.78:0/2500754591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6c1076a0 msgr2=0x7fec6c199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:32.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.938+0000 7fec724ef640 1 --2- 172.21.15.78:0/2500754591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6c1076a0 0x7fec6c199910 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fec5400c890 tx=0x7fec5400cd50 comp rx=0 tx=0).stop 2024-09-11T00:15:32.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.938+0000 7fec724ef640 1 -- 172.21.15.78:0/2500754591 shutdown_connections 2024-09-11T00:15:32.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.938+0000 7fec724ef640 1 --2- 172.21.15.78:0/2500754591 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fec580b53c0 0x7fec580b7880 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:32.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.938+0000 7fec724ef640 1 --2- 172.21.15.78:0/2500754591 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec6c108020 0x7fec6c19ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:32.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.938+0000 7fec724ef640 1 --2- 172.21.15.78:0/2500754591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec6c1076a0 0x7fec6c199910 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:32.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.938+0000 7fec724ef640 1 --2- 172.21.15.78:0/2500754591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec6c101c90 0x7fec6c1993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:32.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.938+0000 7fec724ef640 1 -- 172.21.15.78:0/2500754591 >> 172.21.15.78:0/2500754591 conn(0x7fec6c0fd700 msgr2=0x7fec6c06aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:32.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.938+0000 7fec724ef640 1 -- 172.21.15.78:0/2500754591 shutdown_connections 2024-09-11T00:15:32.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:32.938+0000 7fec724ef640 1 -- 172.21.15.78:0/2500754591 wait complete. 2024-09-11T00:15:33.623 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2024-09-11T00:15:31.682310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654217,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":205,"num_read_kb":194,"num_write":208,"num_write_kb":2239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951979,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359560,"kb_used_data":10236,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124582264,"statfs":{"total":1151940427776,"available":1151572238336,"internally_reserved":0,"allocated":10481664,"data_stored":7002147,"data_compressed":177246,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003315"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762893+0000","last_change":"2024-09-11T00:14:25.922805+0000","last_active":"2024-09-11T00:14:56.762893+0000","last_peered":"2024-09-11T00:14:56.762893+0000","last_clean":"2024-09-11T00:14:56.762893+0000","last_became_active":"2024-09-11T00:14:25.922482+0000","last_became_peered":"2024-09-11T00:14:25.922482+0000","last_unstale":"2024-09-11T00:14:56.762893+0000","last_undegraded":"2024-09-11T00:14:56.762893+0000","last_fullsized":"2024-09-11T00:14:56.762893+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:53.209011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760452+0000","last_change":"2024-09-11T00:14:25.920760+0000","last_active":"2024-09-11T00:14:56.760452+0000","last_peered":"2024-09-11T00:14:56.760452+0000","last_clean":"2024-09-11T00:14:56.760452+0000","last_became_active":"2024-09-11T00:14:25.919720+0000","last_became_peered":"2024-09-11T00:14:25.919720+0000","last_unstale":"2024-09-11T00:14:56.760452+0000","last_undegraded":"2024-09-11T00:14:56.760452+0000","last_fullsized":"2024-09-11T00:14:56.760452+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:32.491200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760534+0000","last_change":"2024-09-11T00:14:25.928090+0000","last_active":"2024-09-11T00:14:56.760534+0000","last_peered":"2024-09-11T00:14:56.760534+0000","last_clean":"2024-09-11T00:14:56.760534+0000","last_became_active":"2024-09-11T00:14:25.927768+0000","last_became_peered":"2024-09-11T00:14:25.927768+0000","last_unstale":"2024-09-11T00:14:56.760534+0000","last_undegraded":"2024-09-11T00:14:56.760534+0000","last_fullsized":"2024-09-11T00:14:56.760534+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:00.025061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.765277+0000","last_change":"2024-09-11T00:14:25.920077+0000","last_active":"2024-09-11T00:14:56.765277+0000","last_peered":"2024-09-11T00:14:56.765277+0000","last_clean":"2024-09-11T00:14:56.765277+0000","last_became_active":"2024-09-11T00:14:25.919395+0000","last_became_peered":"2024-09-11T00:14:25.919395+0000","last_unstale":"2024-09-11T00:14:56.765277+0000","last_undegraded":"2024-09-11T00:14:56.765277+0000","last_fullsized":"2024-09-11T00:14:56.765277+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:41.441279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.759657+0000","last_change":"2024-09-11T00:14:25.917872+0000","last_active":"2024-09-11T00:14:56.759657+0000","last_peered":"2024-09-11T00:14:56.759657+0000","last_clean":"2024-09-11T00:14:56.759657+0000","last_became_active":"2024-09-11T00:14:25.917533+0000","last_became_peered":"2024-09-11T00:14:25.917533+0000","last_unstale":"2024-09-11T00:14:56.759657+0000","last_undegraded":"2024-09-11T00:14:56.759657+0000","last_fullsized":"2024-09-11T00:14:56.759657+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:57.051435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760425+0000","last_change":"2024-09-11T00:14:25.914977+0000","last_active":"2024-09-11T00:14:56.760425+0000","last_peered":"2024-09-11T00:14:56.760425+0000","last_clean":"2024-09-11T00:14:56.760425+0000","last_became_active":"2024-09-11T00:14:25.914543+0000","last_became_peered":"2024-09-11T00:14:25.914543+0000","last_unstale":"2024-09-11T00:14:56.760425+0000","last_undegraded":"2024-09-11T00:14:56.760425+0000","last_fullsized":"2024-09-11T00:14:56.760425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:45.085347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760412+0000","last_change":"2024-09-11T00:14:25.928021+0000","last_active":"2024-09-11T00:14:56.760412+0000","last_peered":"2024-09-11T00:14:56.760412+0000","last_clean":"2024-09-11T00:14:56.760412+0000","last_became_active":"2024-09-11T00:14:25.927047+0000","last_became_peered":"2024-09-11T00:14:25.927047+0000","last_unstale":"2024-09-11T00:14:56.760412+0000","last_undegraded":"2024-09-11T00:14:56.760412+0000","last_fullsized":"2024-09-11T00:14:56.760412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:41.442622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.758727+0000","last_change":"2024-09-11T00:14:25.925399+0000","last_active":"2024-09-11T00:14:56.758727+0000","last_peered":"2024-09-11T00:14:56.758727+0000","last_clean":"2024-09-11T00:14:56.758727+0000","last_became_active":"2024-09-11T00:14:25.925097+0000","last_became_peered":"2024-09-11T00:14:25.925097+0000","last_unstale":"2024-09-11T00:14:56.758727+0000","last_undegraded":"2024-09-11T00:14:56.758727+0000","last_fullsized":"2024-09-11T00:14:56.758727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:36:44.962936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.841242+0000","last_change":"2024-09-11T00:14:25.928123+0000","last_active":"2024-09-11T00:14:56.841242+0000","last_peered":"2024-09-11T00:14:56.841242+0000","last_clean":"2024-09-11T00:14:56.841242+0000","last_became_active":"2024-09-11T00:14:25.927826+0000","last_became_peered":"2024-09-11T00:14:25.927826+0000","last_unstale":"2024-09-11T00:14:56.841242+0000","last_undegraded":"2024-09-11T00:14:56.841242+0000","last_fullsized":"2024-09-11T00:14:56.841242+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:44.131708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.761912+0000","last_change":"2024-09-11T00:14:25.920546+0000","last_active":"2024-09-11T00:14:56.761912+0000","last_peered":"2024-09-11T00:14:56.761912+0000","last_clean":"2024-09-11T00:14:56.761912+0000","last_became_active":"2024-09-11T00:14:25.920193+0000","last_became_peered":"2024-09-11T00:14:25.920193+0000","last_unstale":"2024-09-11T00:14:56.761912+0000","last_undegraded":"2024-09-11T00:14:56.761912+0000","last_fullsized":"2024-09-11T00:14:56.761912+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:55.027260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.761161+0000","last_change":"2024-09-11T00:14:25.931278+0000","last_active":"2024-09-11T00:14:56.761161+0000","last_peered":"2024-09-11T00:14:56.761161+0000","last_clean":"2024-09-11T00:14:56.761161+0000","last_became_active":"2024-09-11T00:14:25.930964+0000","last_became_peered":"2024-09-11T00:14:25.930964+0000","last_unstale":"2024-09-11T00:14:56.761161+0000","last_undegraded":"2024-09-11T00:14:56.761161+0000","last_fullsized":"2024-09-11T00:14:56.761161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:06.537737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.765319+0000","last_change":"2024-09-11T00:14:25.919725+0000","last_active":"2024-09-11T00:14:56.765319+0000","last_peered":"2024-09-11T00:14:56.765319+0000","last_clean":"2024-09-11T00:14:56.765319+0000","last_became_active":"2024-09-11T00:14:25.918973+0000","last_became_peered":"2024-09-11T00:14:25.918973+0000","last_unstale":"2024-09-11T00:14:56.765319+0000","last_undegraded":"2024-09-11T00:14:56.765319+0000","last_fullsized":"2024-09-11T00:14:56.765319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:01:03.076980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762881+0000","last_change":"2024-09-11T00:14:25.922516+0000","last_active":"2024-09-11T00:14:56.762881+0000","last_peered":"2024-09-11T00:14:56.762881+0000","last_clean":"2024-09-11T00:14:56.762881+0000","last_became_active":"2024-09-11T00:14:25.922198+0000","last_became_peered":"2024-09-11T00:14:25.922198+0000","last_unstale":"2024-09-11T00:14:56.762881+0000","last_undegraded":"2024-09-11T00:14:56.762881+0000","last_fullsized":"2024-09-11T00:14:56.762881+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:26.065492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760353+0000","last_change":"2024-09-11T00:14:25.921663+0000","last_active":"2024-09-11T00:14:56.760353+0000","last_peered":"2024-09-11T00:14:56.760353+0000","last_clean":"2024-09-11T00:14:56.760353+0000","last_became_active":"2024-09-11T00:14:25.921328+0000","last_became_peered":"2024-09-11T00:14:25.921328+0000","last_unstale":"2024-09-11T00:14:56.760353+0000","last_undegraded":"2024-09-11T00:14:56.760353+0000","last_fullsized":"2024-09-11T00:14:56.760353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:04.674811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.842231+0000","last_change":"2024-09-11T00:14:56.842141+0000","last_active":"2024-09-11T00:14:56.842231+0000","last_peered":"2024-09-11T00:14:56.842231+0000","last_clean":"2024-09-11T00:14:56.842231+0000","last_became_active":"2024-09-11T00:14:56.841726+0000","last_became_peered":"2024-09-11T00:14:56.841726+0000","last_unstale":"2024-09-11T00:14:56.842231+0000","last_undegraded":"2024-09-11T00:14:56.842231+0000","last_fullsized":"2024-09-11T00:14:56.842231+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:46.239876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.840803+0000","last_change":"2024-09-11T00:14:25.927202+0000","last_active":"2024-09-11T00:14:56.840803+0000","last_peered":"2024-09-11T00:14:56.840803+0000","last_clean":"2024-09-11T00:14:56.840803+0000","last_became_active":"2024-09-11T00:14:25.926872+0000","last_became_peered":"2024-09-11T00:14:25.926872+0000","last_unstale":"2024-09-11T00:14:56.840803+0000","last_undegraded":"2024-09-11T00:14:56.840803+0000","last_fullsized":"2024-09-11T00:14:56.840803+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:44.409956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762981+0000","last_change":"2024-09-11T00:14:25.923975+0000","last_active":"2024-09-11T00:14:56.762981+0000","last_peered":"2024-09-11T00:14:56.762981+0000","last_clean":"2024-09-11T00:14:56.762981+0000","last_became_active":"2024-09-11T00:14:25.923666+0000","last_became_peered":"2024-09-11T00:14:25.923666+0000","last_unstale":"2024-09-11T00:14:56.762981+0000","last_undegraded":"2024-09-11T00:14:56.762981+0000","last_fullsized":"2024-09-11T00:14:56.762981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:54.803657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762992+0000","last_change":"2024-09-11T00:14:25.928083+0000","last_active":"2024-09-11T00:14:56.762992+0000","last_peered":"2024-09-11T00:14:56.762992+0000","last_clean":"2024-09-11T00:14:56.762992+0000","last_became_active":"2024-09-11T00:14:25.927727+0000","last_became_peered":"2024-09-11T00:14:25.927727+0000","last_unstale":"2024-09-11T00:14:56.762992+0000","last_undegraded":"2024-09-11T00:14:56.762992+0000","last_fullsized":"2024-09-11T00:14:56.762992+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:56.721661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.841007+0000","last_change":"2024-09-11T00:14:25.910506+0000","last_active":"2024-09-11T00:14:56.841007+0000","last_peered":"2024-09-11T00:14:56.841007+0000","last_clean":"2024-09-11T00:14:56.841007+0000","last_became_active":"2024-09-11T00:14:25.910112+0000","last_became_peered":"2024-09-11T00:14:25.910112+0000","last_unstale":"2024-09-11T00:14:56.841007+0000","last_undegraded":"2024-09-11T00:14:56.841007+0000","last_fullsized":"2024-09-11T00:14:56.841007+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:33:32.698411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762084+0000","last_change":"2024-09-11T00:14:25.918512+0000","last_active":"2024-09-11T00:14:56.762084+0000","last_peered":"2024-09-11T00:14:56.762084+0000","last_clean":"2024-09-11T00:14:56.762084+0000","last_became_active":"2024-09-11T00:14:25.918191+0000","last_became_peered":"2024-09-11T00:14:25.918191+0000","last_unstale":"2024-09-11T00:14:56.762084+0000","last_undegraded":"2024-09-11T00:14:56.762084+0000","last_fullsized":"2024-09-11T00:14:56.762084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:07:49.588919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762791+0000","last_change":"2024-09-11T00:14:25.918163+0000","last_active":"2024-09-11T00:14:56.762791+0000","last_peered":"2024-09-11T00:14:56.762791+0000","last_clean":"2024-09-11T00:14:56.762791+0000","last_became_active":"2024-09-11T00:14:25.917851+0000","last_became_peered":"2024-09-11T00:14:25.917851+0000","last_unstale":"2024-09-11T00:14:56.762791+0000","last_undegraded":"2024-09-11T00:14:56.762791+0000","last_fullsized":"2024-09-11T00:14:56.762791+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:11.757881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.840950+0000","last_change":"2024-09-11T00:14:25.930503+0000","last_active":"2024-09-11T00:14:56.840950+0000","last_peered":"2024-09-11T00:14:56.840950+0000","last_clean":"2024-09-11T00:14:56.840950+0000","last_became_active":"2024-09-11T00:14:25.930140+0000","last_became_peered":"2024-09-11T00:14:25.930140+0000","last_unstale":"2024-09-11T00:14:56.840950+0000","last_undegraded":"2024-09-11T00:14:56.840950+0000","last_fullsized":"2024-09-11T00:14:56.840950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:43.227373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.758775+0000","last_change":"2024-09-11T00:14:25.916866+0000","last_active":"2024-09-11T00:14:56.758775+0000","last_peered":"2024-09-11T00:14:56.758775+0000","last_clean":"2024-09-11T00:14:56.758775+0000","last_became_active":"2024-09-11T00:14:25.916393+0000","last_became_peered":"2024-09-11T00:14:25.916393+0000","last_unstale":"2024-09-11T00:14:56.758775+0000","last_undegraded":"2024-09-11T00:14:56.758775+0000","last_fullsized":"2024-09-11T00:14:56.758775+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:52.697895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.766391+0000","last_change":"2024-09-11T00:14:56.764743+0000","last_active":"2024-09-11T00:14:56.766391+0000","last_peered":"2024-09-11T00:14:56.766391+0000","last_clean":"2024-09-11T00:14:56.766391+0000","last_became_active":"2024-09-11T00:14:56.764333+0000","last_became_peered":"2024-09-11T00:14:56.764333+0000","last_unstale":"2024-09-11T00:14:56.766391+0000","last_undegraded":"2024-09-11T00:14:56.766391+0000","last_fullsized":"2024-09-11T00:14:56.766391+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:17:00.307318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,3],"acting":[7,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.759104+0000","last_change":"2024-09-11T00:14:25.913694+0000","last_active":"2024-09-11T00:14:56.759104+0000","last_peered":"2024-09-11T00:14:56.759104+0000","last_clean":"2024-09-11T00:14:56.759104+0000","last_became_active":"2024-09-11T00:14:25.913405+0000","last_became_peered":"2024-09-11T00:14:25.913405+0000","last_unstale":"2024-09-11T00:14:56.759104+0000","last_undegraded":"2024-09-11T00:14:56.759104+0000","last_fullsized":"2024-09-11T00:14:56.759104+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:24.636698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.841146+0000","last_change":"2024-09-11T00:14:25.928598+0000","last_active":"2024-09-11T00:14:56.841146+0000","last_peered":"2024-09-11T00:14:56.841146+0000","last_clean":"2024-09-11T00:14:56.841146+0000","last_became_active":"2024-09-11T00:14:25.928230+0000","last_became_peered":"2024-09-11T00:14:25.928230+0000","last_unstale":"2024-09-11T00:14:56.841146+0000","last_undegraded":"2024-09-11T00:14:56.841146+0000","last_fullsized":"2024-09-11T00:14:56.841146+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:00.820900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762270+0000","last_change":"2024-09-11T00:14:25.922296+0000","last_active":"2024-09-11T00:14:56.762270+0000","last_peered":"2024-09-11T00:14:56.762270+0000","last_clean":"2024-09-11T00:14:56.762270+0000","last_became_active":"2024-09-11T00:14:25.921188+0000","last_became_peered":"2024-09-11T00:14:25.921188+0000","last_unstale":"2024-09-11T00:14:56.762270+0000","last_undegraded":"2024-09-11T00:14:56.762270+0000","last_fullsized":"2024-09-11T00:14:56.762270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:31.478302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762806+0000","last_change":"2024-09-11T00:14:25.910201+0000","last_active":"2024-09-11T00:14:56.762806+0000","last_peered":"2024-09-11T00:14:56.762806+0000","last_clean":"2024-09-11T00:14:56.762806+0000","last_became_active":"2024-09-11T00:14:25.909867+0000","last_became_peered":"2024-09-11T00:14:25.909867+0000","last_unstale":"2024-09-11T00:14:56.762806+0000","last_undegraded":"2024-09-11T00:14:56.762806+0000","last_fullsized":"2024-09-11T00:14:56.762806+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:17.445805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760732+0000","last_change":"2024-09-11T00:14:25.914971+0000","last_active":"2024-09-11T00:14:56.760732+0000","last_peered":"2024-09-11T00:14:56.760732+0000","last_clean":"2024-09-11T00:14:56.760732+0000","last_became_active":"2024-09-11T00:14:25.914614+0000","last_became_peered":"2024-09-11T00:14:25.914614+0000","last_unstale":"2024-09-11T00:14:56.760732+0000","last_undegraded":"2024-09-11T00:14:56.760732+0000","last_fullsized":"2024-09-11T00:14:56.760732+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.840808+0000","last_change":"2024-09-11T00:14:25.916006+0000","last_active":"2024-09-11T00:14:56.840808+0000","last_peered":"2024-09-11T00:14:56.840808+0000","last_clean":"2024-09-11T00:14:56.840808+0000","last_became_active":"2024-09-11T00:14:25.915479+0000","last_became_peered":"2024-09-11T00:14:25.915479+0000","last_unstale":"2024-09-11T00:14:56.840808+0000","last_undegraded":"2024-09-11T00:14:56.840808+0000","last_fullsized":"2024-09-11T00:14:56.840808+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:42.513673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.841141+0000","last_change":"2024-09-11T00:14:25.925601+0000","last_active":"2024-09-11T00:14:56.841141+0000","last_peered":"2024-09-11T00:14:56.841141+0000","last_clean":"2024-09-11T00:14:56.841141+0000","last_became_active":"2024-09-11T00:14:25.925289+0000","last_became_peered":"2024-09-11T00:14:25.925289+0000","last_unstale":"2024-09-11T00:14:56.841141+0000","last_undegraded":"2024-09-11T00:14:56.841141+0000","last_fullsized":"2024-09-11T00:14:56.841141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:17.324565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762043+0000","last_change":"2024-09-11T00:14:25.922316+0000","last_active":"2024-09-11T00:14:56.762043+0000","last_peered":"2024-09-11T00:14:56.762043+0000","last_clean":"2024-09-11T00:14:56.762043+0000","last_became_active":"2024-09-11T00:14:25.920991+0000","last_became_peered":"2024-09-11T00:14:25.920991+0000","last_unstale":"2024-09-11T00:14:56.762043+0000","last_undegraded":"2024-09-11T00:14:56.762043+0000","last_fullsized":"2024-09-11T00:14:56.762043+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:36.362500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.759753+0000","last_change":"2024-09-11T00:14:25.919579+0000","last_active":"2024-09-11T00:14:56.759753+0000","last_peered":"2024-09-11T00:14:56.759753+0000","last_clean":"2024-09-11T00:14:56.759753+0000","last_became_active":"2024-09-11T00:14:25.919245+0000","last_became_peered":"2024-09-11T00:14:25.919245+0000","last_unstale":"2024-09-11T00:14:56.759753+0000","last_undegraded":"2024-09-11T00:14:56.759753+0000","last_fullsized":"2024-09-11T00:14:56.759753+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:47.885242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.767754+0000","last_change":"2024-09-11T00:14:56.767631+0000","last_active":"2024-09-11T00:14:56.767754+0000","last_peered":"2024-09-11T00:14:56.767754+0000","last_clean":"2024-09-11T00:14:56.767754+0000","last_became_active":"2024-09-11T00:14:56.767229+0000","last_became_peered":"2024-09-11T00:14:56.767229+0000","last_unstale":"2024-09-11T00:14:56.767754+0000","last_undegraded":"2024-09-11T00:14:56.767754+0000","last_fullsized":"2024-09-11T00:14:56.767754+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:15.084255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.764619+0000","last_change":"2024-09-11T00:14:25.921414+0000","last_active":"2024-09-11T00:14:56.764619+0000","last_peered":"2024-09-11T00:14:56.764619+0000","last_clean":"2024-09-11T00:14:56.764619+0000","last_became_active":"2024-09-11T00:14:25.921096+0000","last_became_peered":"2024-09-11T00:14:25.921096+0000","last_unstale":"2024-09-11T00:14:56.764619+0000","last_undegraded":"2024-09-11T00:14:56.764619+0000","last_fullsized":"2024-09-11T00:14:56.764619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:38:45.938435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760557+0000","last_change":"2024-09-11T00:14:23.913359+0000","last_active":"2024-09-11T00:14:56.760557+0000","last_peered":"2024-09-11T00:14:56.760557+0000","last_clean":"2024-09-11T00:14:56.760557+0000","last_became_active":"2024-09-11T00:14:23.913073+0000","last_became_peered":"2024-09-11T00:14:23.913073+0000","last_unstale":"2024-09-11T00:14:56.760557+0000","last_undegraded":"2024-09-11T00:14:56.760557+0000","last_fullsized":"2024-09-11T00:14:56.760557+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:04.907618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.763667+0000","last_change":"2024-09-11T00:14:23.905723+0000","last_active":"2024-09-11T00:14:56.763667+0000","last_peered":"2024-09-11T00:14:56.763667+0000","last_clean":"2024-09-11T00:14:56.763667+0000","last_became_active":"2024-09-11T00:14:23.905392+0000","last_became_peered":"2024-09-11T00:14:23.905392+0000","last_unstale":"2024-09-11T00:14:56.763667+0000","last_undegraded":"2024-09-11T00:14:56.763667+0000","last_fullsized":"2024-09-11T00:14:56.763667+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:48.603410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.758833+0000","last_change":"2024-09-11T00:14:25.915843+0000","last_active":"2024-09-11T00:14:56.758833+0000","last_peered":"2024-09-11T00:14:56.758833+0000","last_clean":"2024-09-11T00:14:56.758833+0000","last_became_active":"2024-09-11T00:14:25.915543+0000","last_became_peered":"2024-09-11T00:14:25.915543+0000","last_unstale":"2024-09-11T00:14:56.758833+0000","last_undegraded":"2024-09-11T00:14:56.758833+0000","last_fullsized":"2024-09-11T00:14:56.758833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:10.781401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.764170+0000","last_change":"2024-09-11T00:14:23.913017+0000","last_active":"2024-09-11T00:14:56.764170+0000","last_peered":"2024-09-11T00:14:56.764170+0000","last_clean":"2024-09-11T00:14:56.764170+0000","last_became_active":"2024-09-11T00:14:23.912674+0000","last_became_peered":"2024-09-11T00:14:23.912674+0000","last_unstale":"2024-09-11T00:14:56.764170+0000","last_undegraded":"2024-09-11T00:14:56.764170+0000","last_fullsized":"2024-09-11T00:14:56.764170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:22.711358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762932+0000","last_change":"2024-09-11T00:14:25.917969+0000","last_active":"2024-09-11T00:14:56.762932+0000","last_peered":"2024-09-11T00:14:56.762932+0000","last_clean":"2024-09-11T00:14:56.762932+0000","last_became_active":"2024-09-11T00:14:25.917673+0000","last_became_peered":"2024-09-11T00:14:25.917673+0000","last_unstale":"2024-09-11T00:14:56.762932+0000","last_undegraded":"2024-09-11T00:14:56.762932+0000","last_fullsized":"2024-09-11T00:14:56.762932+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:55:36.992260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.761891+0000","last_change":"2024-09-11T00:14:23.915544+0000","last_active":"2024-09-11T00:14:56.761891+0000","last_peered":"2024-09-11T00:14:56.761891+0000","last_clean":"2024-09-11T00:14:56.761891+0000","last_became_active":"2024-09-11T00:14:23.915129+0000","last_became_peered":"2024-09-11T00:14:23.915129+0000","last_unstale":"2024-09-11T00:14:56.761891+0000","last_undegraded":"2024-09-11T00:14:56.761891+0000","last_fullsized":"2024-09-11T00:14:56.761891+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:06.720068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.841177+0000","last_change":"2024-09-11T00:14:25.927212+0000","last_active":"2024-09-11T00:14:56.841177+0000","last_peered":"2024-09-11T00:14:56.841177+0000","last_clean":"2024-09-11T00:14:56.841177+0000","last_became_active":"2024-09-11T00:14:25.926875+0000","last_became_peered":"2024-09-11T00:14:25.926875+0000","last_unstale":"2024-09-11T00:14:56.841177+0000","last_undegraded":"2024-09-11T00:14:56.841177+0000","last_fullsized":"2024-09-11T00:14:56.841177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:06.749494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.761141+0000","last_change":"2024-09-11T00:14:23.907318+0000","last_active":"2024-09-11T00:14:56.761141+0000","last_peered":"2024-09-11T00:14:56.761141+0000","last_clean":"2024-09-11T00:14:56.761141+0000","last_became_active":"2024-09-11T00:14:23.905858+0000","last_became_peered":"2024-09-11T00:14:23.905858+0000","last_unstale":"2024-09-11T00:14:56.761141+0000","last_undegraded":"2024-09-11T00:14:56.761141+0000","last_fullsized":"2024-09-11T00:14:56.761141+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:16.005219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760807+0000","last_change":"2024-09-11T00:14:25.922126+0000","last_active":"2024-09-11T00:14:56.760807+0000","last_peered":"2024-09-11T00:14:56.760807+0000","last_clean":"2024-09-11T00:14:56.760807+0000","last_became_active":"2024-09-11T00:14:25.921801+0000","last_became_peered":"2024-09-11T00:14:25.921801+0000","last_unstale":"2024-09-11T00:14:56.760807+0000","last_undegraded":"2024-09-11T00:14:56.760807+0000","last_fullsized":"2024-09-11T00:14:56.760807+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:06.770343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.764619+0000","last_change":"2024-09-11T00:14:24.083872+0000","last_active":"2024-09-11T00:14:56.764619+0000","last_peered":"2024-09-11T00:14:56.764619+0000","last_clean":"2024-09-11T00:14:56.764619+0000","last_became_active":"2024-09-11T00:14:24.083479+0000","last_became_peered":"2024-09-11T00:14:24.083479+0000","last_unstale":"2024-09-11T00:14:56.764619+0000","last_undegraded":"2024-09-11T00:14:56.764619+0000","last_fullsized":"2024-09-11T00:14:56.764619+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:19:30.492828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.840947+0000","last_change":"2024-09-11T00:14:25.932281+0000","last_active":"2024-09-11T00:14:56.840947+0000","last_peered":"2024-09-11T00:14:56.840947+0000","last_clean":"2024-09-11T00:14:56.840947+0000","last_became_active":"2024-09-11T00:14:25.931935+0000","last_became_peered":"2024-09-11T00:14:25.931935+0000","last_unstale":"2024-09-11T00:14:56.840947+0000","last_undegraded":"2024-09-11T00:14:56.840947+0000","last_fullsized":"2024-09-11T00:14:56.840947+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:55.166421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'27","reported_seq":169,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:15:28.817532+0000","last_change":"2024-09-11T00:14:23.909614+0000","last_active":"2024-09-11T00:15:28.817532+0000","last_peered":"2024-09-11T00:15:28.817532+0000","last_clean":"2024-09-11T00:15:28.817532+0000","last_became_active":"2024-09-11T00:14:23.909209+0000","last_became_peered":"2024-09-11T00:14:23.909209+0000","last_unstale":"2024-09-11T00:15:28.817532+0000","last_undegraded":"2024-09-11T00:15:28.817532+0000","last_fullsized":"2024-09-11T00:15:28.817532+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:14.467304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62817,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":120,"num_write":27,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.759991+0000","last_change":"2024-09-11T00:14:25.924008+0000","last_active":"2024-09-11T00:14:56.759991+0000","last_peered":"2024-09-11T00:14:56.759991+0000","last_clean":"2024-09-11T00:14:56.759991+0000","last_became_active":"2024-09-11T00:14:25.923680+0000","last_became_peered":"2024-09-11T00:14:25.923680+0000","last_unstale":"2024-09-11T00:14:56.759991+0000","last_undegraded":"2024-09-11T00:14:56.759991+0000","last_fullsized":"2024-09-11T00:14:56.759991+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:27.106405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.841007+0000","last_change":"2024-09-11T00:14:23.906908+0000","last_active":"2024-09-11T00:14:56.841007+0000","last_peered":"2024-09-11T00:14:56.841007+0000","last_clean":"2024-09-11T00:14:56.841007+0000","last_became_active":"2024-09-11T00:14:23.906170+0000","last_became_peered":"2024-09-11T00:14:23.906170+0000","last_unstale":"2024-09-11T00:14:56.841007+0000","last_undegraded":"2024-09-11T00:14:56.841007+0000","last_fullsized":"2024-09-11T00:14:56.841007+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:10:27.314551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762639+0000","last_change":"2024-09-11T00:14:25.917896+0000","last_active":"2024-09-11T00:14:56.762639+0000","last_peered":"2024-09-11T00:14:56.762639+0000","last_clean":"2024-09-11T00:14:56.762639+0000","last_became_active":"2024-09-11T00:14:25.916341+0000","last_became_peered":"2024-09-11T00:14:25.916341+0000","last_unstale":"2024-09-11T00:14:56.762639+0000","last_undegraded":"2024-09-11T00:14:56.762639+0000","last_fullsized":"2024-09-11T00:14:56.762639+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:05.723223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.764574+0000","last_change":"2024-09-11T00:14:23.913113+0000","last_active":"2024-09-11T00:14:56.764574+0000","last_peered":"2024-09-11T00:14:56.764574+0000","last_clean":"2024-09-11T00:14:56.764574+0000","last_became_active":"2024-09-11T00:14:23.912791+0000","last_became_peered":"2024-09-11T00:14:23.912791+0000","last_unstale":"2024-09-11T00:14:56.764574+0000","last_undegraded":"2024-09-11T00:14:56.764574+0000","last_fullsized":"2024-09-11T00:14:56.764574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:31.124528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.761108+0000","last_change":"2024-09-11T00:14:25.927511+0000","last_active":"2024-09-11T00:14:56.761108+0000","last_peered":"2024-09-11T00:14:56.761108+0000","last_clean":"2024-09-11T00:14:56.761108+0000","last_became_active":"2024-09-11T00:14:25.927144+0000","last_became_peered":"2024-09-11T00:14:25.927144+0000","last_unstale":"2024-09-11T00:14:56.761108+0000","last_undegraded":"2024-09-11T00:14:56.761108+0000","last_fullsized":"2024-09-11T00:14:56.761108+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:35.680110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.765549+0000","last_change":"2024-09-11T00:14:23.906706+0000","last_active":"2024-09-11T00:14:56.765549+0000","last_peered":"2024-09-11T00:14:56.765549+0000","last_clean":"2024-09-11T00:14:56.765549+0000","last_became_active":"2024-09-11T00:14:23.906368+0000","last_became_peered":"2024-09-11T00:14:23.906368+0000","last_unstale":"2024-09-11T00:14:56.765549+0000","last_undegraded":"2024-09-11T00:14:56.765549+0000","last_fullsized":"2024-09-11T00:14:56.765549+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:30:40.798446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760898+0000","last_change":"2024-09-11T00:14:25.925996+0000","last_active":"2024-09-11T00:14:56.760898+0000","last_peered":"2024-09-11T00:14:56.760898+0000","last_clean":"2024-09-11T00:14:56.760898+0000","last_became_active":"2024-09-11T00:14:25.925653+0000","last_became_peered":"2024-09-11T00:14:25.925653+0000","last_unstale":"2024-09-11T00:14:56.760898+0000","last_undegraded":"2024-09-11T00:14:56.760898+0000","last_fullsized":"2024-09-11T00:14:56.760898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:50.366666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.759659+0000","last_change":"2024-09-11T00:14:24.083774+0000","last_active":"2024-09-11T00:14:56.759659+0000","last_peered":"2024-09-11T00:14:56.759659+0000","last_clean":"2024-09-11T00:14:56.759659+0000","last_became_active":"2024-09-11T00:14:24.083398+0000","last_became_peered":"2024-09-11T00:14:24.083398+0000","last_unstale":"2024-09-11T00:14:56.759659+0000","last_undegraded":"2024-09-11T00:14:56.759659+0000","last_fullsized":"2024-09-11T00:14:56.759659+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:34.019592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.764379+0000","last_change":"2024-09-11T00:14:25.927171+0000","last_active":"2024-09-11T00:14:56.764379+0000","last_peered":"2024-09-11T00:14:56.764379+0000","last_clean":"2024-09-11T00:14:56.764379+0000","last_became_active":"2024-09-11T00:14:25.926873+0000","last_became_peered":"2024-09-11T00:14:25.926873+0000","last_unstale":"2024-09-11T00:14:56.764379+0000","last_undegraded":"2024-09-11T00:14:56.764379+0000","last_fullsized":"2024-09-11T00:14:56.764379+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:26.042903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.770383+0000","last_change":"2024-09-11T00:14:56.770315+0000","last_active":"2024-09-11T00:14:56.770383+0000","last_peered":"2024-09-11T00:14:56.770383+0000","last_clean":"2024-09-11T00:14:56.770383+0000","last_became_active":"2024-09-11T00:14:56.767056+0000","last_became_peered":"2024-09-11T00:14:56.767056+0000","last_unstale":"2024-09-11T00:14:56.770383+0000","last_undegraded":"2024-09-11T00:14:56.770383+0000","last_fullsized":"2024-09-11T00:14:56.770383+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:25.136382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.765993+0000","last_change":"2024-09-11T00:14:56.765888+0000","last_active":"2024-09-11T00:14:56.765993+0000","last_peered":"2024-09-11T00:14:56.765993+0000","last_clean":"2024-09-11T00:14:56.765993+0000","last_became_active":"2024-09-11T00:14:56.765508+0000","last_became_peered":"2024-09-11T00:14:56.765508+0000","last_unstale":"2024-09-11T00:14:56.765993+0000","last_undegraded":"2024-09-11T00:14:56.765993+0000","last_fullsized":"2024-09-11T00:14:56.765993+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:10.013207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762966+0000","last_change":"2024-09-11T00:14:23.904807+0000","last_active":"2024-09-11T00:14:56.762966+0000","last_peered":"2024-09-11T00:14:56.762966+0000","last_clean":"2024-09-11T00:14:56.762966+0000","last_became_active":"2024-09-11T00:14:23.904532+0000","last_became_peered":"2024-09-11T00:14:23.904532+0000","last_unstale":"2024-09-11T00:14:56.762966+0000","last_undegraded":"2024-09-11T00:14:56.762966+0000","last_fullsized":"2024-09-11T00:14:56.762966+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:08.945508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.761443+0000","last_change":"2024-09-11T00:14:25.919548+0000","last_active":"2024-09-11T00:14:56.761443+0000","last_peered":"2024-09-11T00:14:56.761443+0000","last_clean":"2024-09-11T00:14:56.761443+0000","last_became_active":"2024-09-11T00:14:25.919216+0000","last_became_peered":"2024-09-11T00:14:25.919216+0000","last_unstale":"2024-09-11T00:14:56.761443+0000","last_undegraded":"2024-09-11T00:14:56.761443+0000","last_fullsized":"2024-09-11T00:14:56.761443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:18.318193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.764850+0000","last_change":"2024-09-11T00:14:23.915488+0000","last_active":"2024-09-11T00:14:56.764850+0000","last_peered":"2024-09-11T00:14:56.764850+0000","last_clean":"2024-09-11T00:14:56.764850+0000","last_became_active":"2024-09-11T00:14:23.915147+0000","last_became_peered":"2024-09-11T00:14:23.915147+0000","last_unstale":"2024-09-11T00:14:56.764850+0000","last_undegraded":"2024-09-11T00:14:56.764850+0000","last_fullsized":"2024-09-11T00:14:56.764850+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:04.830225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.761038+0000","last_change":"2024-09-11T00:14:25.919774+0000","last_active":"2024-09-11T00:14:56.761038+0000","last_peered":"2024-09-11T00:14:56.761038+0000","last_clean":"2024-09-11T00:14:56.761038+0000","last_became_active":"2024-09-11T00:14:25.919422+0000","last_became_peered":"2024-09-11T00:14:25.919422+0000","last_unstale":"2024-09-11T00:14:56.761038+0000","last_undegraded":"2024-09-11T00:14:56.761038+0000","last_fullsized":"2024-09-11T00:14:56.761038+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:03.928972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.841315+0000","last_change":"2024-09-11T00:14:24.082414+0000","last_active":"2024-09-11T00:14:56.841315+0000","last_peered":"2024-09-11T00:14:56.841315+0000","last_clean":"2024-09-11T00:14:56.841315+0000","last_became_active":"2024-09-11T00:14:24.082058+0000","last_became_peered":"2024-09-11T00:14:24.082058+0000","last_unstale":"2024-09-11T00:14:56.841315+0000","last_undegraded":"2024-09-11T00:14:56.841315+0000","last_fullsized":"2024-09-11T00:14:56.841315+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:38.349964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.761158+0000","last_change":"2024-09-11T00:14:25.930116+0000","last_active":"2024-09-11T00:14:56.761158+0000","last_peered":"2024-09-11T00:14:56.761158+0000","last_clean":"2024-09-11T00:14:56.761158+0000","last_became_active":"2024-09-11T00:14:25.929787+0000","last_became_peered":"2024-09-11T00:14:25.929787+0000","last_unstale":"2024-09-11T00:14:56.761158+0000","last_undegraded":"2024-09-11T00:14:56.761158+0000","last_fullsized":"2024-09-11T00:14:56.761158+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:29.655577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.761027+0000","last_change":"2024-09-11T00:13:12.338952+0000","last_active":"2024-09-11T00:14:56.761027+0000","last_peered":"2024-09-11T00:14:56.761027+0000","last_clean":"2024-09-11T00:14:56.761027+0000","last_became_active":"2024-09-11T00:13:12.335030+0000","last_became_peered":"2024-09-11T00:13:12.335030+0000","last_unstale":"2024-09-11T00:14:56.761027+0000","last_undegraded":"2024-09-11T00:14:56.761027+0000","last_fullsized":"2024-09-11T00:14:56.761027+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:09:48.709624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:09:48.709624+0000","last_clean_scrub_stamp":"2024-09-11T00:09:48.709624+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:43.680771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.765948+0000","last_change":"2024-09-11T00:14:23.906794+0000","last_active":"2024-09-11T00:14:56.765948+0000","last_peered":"2024-09-11T00:14:56.765948+0000","last_clean":"2024-09-11T00:14:56.765948+0000","last_became_active":"2024-09-11T00:14:23.906430+0000","last_became_peered":"2024-09-11T00:14:23.906430+0000","last_unstale":"2024-09-11T00:14:56.765948+0000","last_undegraded":"2024-09-11T00:14:56.765948+0000","last_fullsized":"2024-09-11T00:14:56.765948+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:58.804834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.758961+0000","last_change":"2024-09-11T00:14:25.928119+0000","last_active":"2024-09-11T00:14:56.758961+0000","last_peered":"2024-09-11T00:14:56.758961+0000","last_clean":"2024-09-11T00:14:56.758961+0000","last_became_active":"2024-09-11T00:14:25.927806+0000","last_became_peered":"2024-09-11T00:14:25.927806+0000","last_unstale":"2024-09-11T00:14:56.758961+0000","last_undegraded":"2024-09-11T00:14:56.758961+0000","last_fullsized":"2024-09-11T00:14:56.758961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:34.630696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.761017+0000","last_change":"2024-09-11T00:14:23.916252+0000","last_active":"2024-09-11T00:14:56.761017+0000","last_peered":"2024-09-11T00:14:56.761017+0000","last_clean":"2024-09-11T00:14:56.761017+0000","last_became_active":"2024-09-11T00:14:23.915905+0000","last_became_peered":"2024-09-11T00:14:23.915905+0000","last_unstale":"2024-09-11T00:14:56.761017+0000","last_undegraded":"2024-09-11T00:14:56.761017+0000","last_fullsized":"2024-09-11T00:14:56.761017+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:02.229067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.763549+0000","last_change":"2024-09-11T00:14:25.910163+0000","last_active":"2024-09-11T00:14:56.763549+0000","last_peered":"2024-09-11T00:14:56.763549+0000","last_clean":"2024-09-11T00:14:56.763549+0000","last_became_active":"2024-09-11T00:14:25.909926+0000","last_became_peered":"2024-09-11T00:14:25.909926+0000","last_unstale":"2024-09-11T00:14:56.763549+0000","last_undegraded":"2024-09-11T00:14:56.763549+0000","last_fullsized":"2024-09-11T00:14:56.763549+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:59:20.915080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.763738+0000","last_change":"2024-09-11T00:14:24.081999+0000","last_active":"2024-09-11T00:14:56.763738+0000","last_peered":"2024-09-11T00:14:56.763738+0000","last_clean":"2024-09-11T00:14:56.763738+0000","last_became_active":"2024-09-11T00:14:24.081664+0000","last_became_peered":"2024-09-11T00:14:24.081664+0000","last_unstale":"2024-09-11T00:14:56.763738+0000","last_undegraded":"2024-09-11T00:14:56.763738+0000","last_fullsized":"2024-09-11T00:14:56.763738+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:22.485256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.842854+0000","last_change":"2024-09-11T00:14:56.842397+0000","last_active":"2024-09-11T00:14:56.842854+0000","last_peered":"2024-09-11T00:14:56.842854+0000","last_clean":"2024-09-11T00:14:56.842854+0000","last_became_active":"2024-09-11T00:14:56.842017+0000","last_became_peered":"2024-09-11T00:14:56.842017+0000","last_unstale":"2024-09-11T00:14:56.842854+0000","last_undegraded":"2024-09-11T00:14:56.842854+0000","last_fullsized":"2024-09-11T00:14:56.842854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:10.300022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,6],"acting":[9,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760905+0000","last_change":"2024-09-11T00:14:23.905241+0000","last_active":"2024-09-11T00:14:56.760905+0000","last_peered":"2024-09-11T00:14:56.760905+0000","last_clean":"2024-09-11T00:14:56.760905+0000","last_became_active":"2024-09-11T00:14:23.904833+0000","last_became_peered":"2024-09-11T00:14:23.904833+0000","last_unstale":"2024-09-11T00:14:56.760905+0000","last_undegraded":"2024-09-11T00:14:56.760905+0000","last_fullsized":"2024-09-11T00:14:56.760905+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:44:28.162800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.766094+0000","last_change":"2024-09-11T00:14:56.766007+0000","last_active":"2024-09-11T00:14:56.766094+0000","last_peered":"2024-09-11T00:14:56.766094+0000","last_clean":"2024-09-11T00:14:56.766094+0000","last_became_active":"2024-09-11T00:14:56.765515+0000","last_became_peered":"2024-09-11T00:14:56.765515+0000","last_unstale":"2024-09-11T00:14:56.766094+0000","last_undegraded":"2024-09-11T00:14:56.766094+0000","last_fullsized":"2024-09-11T00:14:56.766094+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:31.159084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.763243+0000","last_change":"2024-09-11T00:14:24.083578+0000","last_active":"2024-09-11T00:14:56.763243+0000","last_peered":"2024-09-11T00:14:56.763243+0000","last_clean":"2024-09-11T00:14:56.763243+0000","last_became_active":"2024-09-11T00:14:24.083233+0000","last_became_peered":"2024-09-11T00:14:24.083233+0000","last_unstale":"2024-09-11T00:14:56.763243+0000","last_undegraded":"2024-09-11T00:14:56.763243+0000","last_fullsized":"2024-09-11T00:14:56.763243+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:47.655836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.771539+0000","last_change":"2024-09-11T00:14:56.771471+0000","last_active":"2024-09-11T00:14:56.771539+0000","last_peered":"2024-09-11T00:14:56.771539+0000","last_clean":"2024-09-11T00:14:56.771539+0000","last_became_active":"2024-09-11T00:14:56.764838+0000","last_became_peered":"2024-09-11T00:14:56.764838+0000","last_unstale":"2024-09-11T00:14:56.771539+0000","last_undegraded":"2024-09-11T00:14:56.771539+0000","last_fullsized":"2024-09-11T00:14:56.771539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:24.683423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760123+0000","last_change":"2024-09-11T00:14:24.082284+0000","last_active":"2024-09-11T00:14:56.760123+0000","last_peered":"2024-09-11T00:14:56.760123+0000","last_clean":"2024-09-11T00:14:56.760123+0000","last_became_active":"2024-09-11T00:14:24.081859+0000","last_became_peered":"2024-09-11T00:14:24.081859+0000","last_unstale":"2024-09-11T00:14:56.760123+0000","last_undegraded":"2024-09-11T00:14:56.760123+0000","last_fullsized":"2024-09-11T00:14:56.760123+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:38.881342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762903+0000","last_change":"2024-09-11T00:14:25.910408+0000","last_active":"2024-09-11T00:14:56.762903+0000","last_peered":"2024-09-11T00:14:56.762903+0000","last_clean":"2024-09-11T00:14:56.762903+0000","last_became_active":"2024-09-11T00:14:25.909447+0000","last_became_peered":"2024-09-11T00:14:25.909447+0000","last_unstale":"2024-09-11T00:14:56.762903+0000","last_undegraded":"2024-09-11T00:14:56.762903+0000","last_fullsized":"2024-09-11T00:14:56.762903+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:20:11.249974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'9","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.763086+0000","last_change":"2024-09-11T00:14:23.912799+0000","last_active":"2024-09-11T00:14:56.763086+0000","last_peered":"2024-09-11T00:14:56.763086+0000","last_clean":"2024-09-11T00:14:56.763086+0000","last_became_active":"2024-09-11T00:14:23.912440+0000","last_became_peered":"2024-09-11T00:14:23.912440+0000","last_unstale":"2024-09-11T00:14:56.763086+0000","last_undegraded":"2024-09-11T00:14:56.763086+0000","last_fullsized":"2024-09-11T00:14:56.763086+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:31.139405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.759143+0000","last_change":"2024-09-11T00:14:25.920599+0000","last_active":"2024-09-11T00:14:56.759143+0000","last_peered":"2024-09-11T00:14:56.759143+0000","last_clean":"2024-09-11T00:14:56.759143+0000","last_became_active":"2024-09-11T00:14:25.920256+0000","last_became_peered":"2024-09-11T00:14:25.920256+0000","last_unstale":"2024-09-11T00:14:56.759143+0000","last_undegraded":"2024-09-11T00:14:56.759143+0000","last_fullsized":"2024-09-11T00:14:56.759143+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:05.347880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.765441+0000","last_change":"2024-09-11T00:14:24.004190+0000","last_active":"2024-09-11T00:14:56.765441+0000","last_peered":"2024-09-11T00:14:56.765441+0000","last_clean":"2024-09-11T00:14:56.765441+0000","last_became_active":"2024-09-11T00:14:24.003842+0000","last_became_peered":"2024-09-11T00:14:24.003842+0000","last_unstale":"2024-09-11T00:14:56.765441+0000","last_undegraded":"2024-09-11T00:14:56.765441+0000","last_fullsized":"2024-09-11T00:14:56.765441+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:43.876046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.767159+0000","last_change":"2024-09-11T00:14:56.767088+0000","last_active":"2024-09-11T00:14:56.767159+0000","last_peered":"2024-09-11T00:14:56.767159+0000","last_clean":"2024-09-11T00:14:56.767159+0000","last_became_active":"2024-09-11T00:14:56.766783+0000","last_became_peered":"2024-09-11T00:14:56.766783+0000","last_unstale":"2024-09-11T00:14:56.767159+0000","last_undegraded":"2024-09-11T00:14:56.767159+0000","last_fullsized":"2024-09-11T00:14:56.767159+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:37.407811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,4],"acting":[0,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.840941+0000","last_change":"2024-09-11T00:14:24.082118+0000","last_active":"2024-09-11T00:14:56.840941+0000","last_peered":"2024-09-11T00:14:56.840941+0000","last_clean":"2024-09-11T00:14:56.840941+0000","last_became_active":"2024-09-11T00:14:24.081844+0000","last_became_peered":"2024-09-11T00:14:24.081844+0000","last_unstale":"2024-09-11T00:14:56.840941+0000","last_undegraded":"2024-09-11T00:14:56.840941+0000","last_fullsized":"2024-09-11T00:14:56.840941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:20.827385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.759636+0000","last_change":"2024-09-11T00:14:25.917335+0000","last_active":"2024-09-11T00:14:56.759636+0000","last_peered":"2024-09-11T00:14:56.759636+0000","last_clean":"2024-09-11T00:14:56.759636+0000","last_became_active":"2024-09-11T00:14:25.916942+0000","last_became_peered":"2024-09-11T00:14:25.916942+0000","last_unstale":"2024-09-11T00:14:56.759636+0000","last_undegraded":"2024-09-11T00:14:56.759636+0000","last_fullsized":"2024-09-11T00:14:56.759636+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:40.309186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.758880+0000","last_change":"2024-09-11T00:14:23.906616+0000","last_active":"2024-09-11T00:14:56.758880+0000","last_peered":"2024-09-11T00:14:56.758880+0000","last_clean":"2024-09-11T00:14:56.758880+0000","last_became_active":"2024-09-11T00:14:23.906259+0000","last_became_peered":"2024-09-11T00:14:23.906259+0000","last_unstale":"2024-09-11T00:14:56.758880+0000","last_undegraded":"2024-09-11T00:14:56.758880+0000","last_fullsized":"2024-09-11T00:14:56.758880+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:01.514398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.762174+0000","last_change":"2024-09-11T00:14:25.925422+0000","last_active":"2024-09-11T00:14:56.762174+0000","last_peered":"2024-09-11T00:14:56.762174+0000","last_clean":"2024-09-11T00:14:56.762174+0000","last_became_active":"2024-09-11T00:14:25.923031+0000","last_became_peered":"2024-09-11T00:14:25.923031+0000","last_unstale":"2024-09-11T00:14:56.762174+0000","last_undegraded":"2024-09-11T00:14:56.762174+0000","last_fullsized":"2024-09-11T00:14:56.762174+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:59:52.217566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.840820+0000","last_change":"2024-09-11T00:14:23.913308+0000","last_active":"2024-09-11T00:14:56.840820+0000","last_peered":"2024-09-11T00:14:56.840820+0000","last_clean":"2024-09-11T00:14:56.840820+0000","last_became_active":"2024-09-11T00:14:23.913002+0000","last_became_peered":"2024-09-11T00:14:23.913002+0000","last_unstale":"2024-09-11T00:14:56.840820+0000","last_undegraded":"2024-09-11T00:14:56.840820+0000","last_fullsized":"2024-09-11T00:14:56.840820+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:26:43.571378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.758886+0000","last_change":"2024-09-11T00:14:25.917478+0000","last_active":"2024-09-11T00:14:56.758886+0000","last_peered":"2024-09-11T00:14:56.758886+0000","last_clean":"2024-09-11T00:14:56.758886+0000","last_became_active":"2024-09-11T00:14:25.917192+0000","last_became_peered":"2024-09-11T00:14:25.917192+0000","last_unstale":"2024-09-11T00:14:56.758886+0000","last_undegraded":"2024-09-11T00:14:56.758886+0000","last_fullsized":"2024-09-11T00:14:56.758886+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:46.695827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.759828+0000","last_change":"2024-09-11T00:14:23.914141+0000","last_active":"2024-09-11T00:14:56.759828+0000","last_peered":"2024-09-11T00:14:56.759828+0000","last_clean":"2024-09-11T00:14:56.759828+0000","last_became_active":"2024-09-11T00:14:23.913757+0000","last_became_peered":"2024-09-11T00:14:23.913757+0000","last_unstale":"2024-09-11T00:14:56.759828+0000","last_undegraded":"2024-09-11T00:14:56.759828+0000","last_fullsized":"2024-09-11T00:14:56.759828+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:54:00.609715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760810+0000","last_change":"2024-09-11T00:14:25.924950+0000","last_active":"2024-09-11T00:14:56.760810+0000","last_peered":"2024-09-11T00:14:56.760810+0000","last_clean":"2024-09-11T00:14:56.760810+0000","last_became_active":"2024-09-11T00:14:25.924554+0000","last_became_peered":"2024-09-11T00:14:25.924554+0000","last_unstale":"2024-09-11T00:14:56.760810+0000","last_undegraded":"2024-09-11T00:14:56.760810+0000","last_fullsized":"2024-09-11T00:14:56.760810+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:29.303384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.764648+0000","last_change":"2024-09-11T00:14:25.930162+0000","last_active":"2024-09-11T00:14:56.764648+0000","last_peered":"2024-09-11T00:14:56.764648+0000","last_clean":"2024-09-11T00:14:56.764648+0000","last_became_active":"2024-09-11T00:14:25.929820+0000","last_became_peered":"2024-09-11T00:14:25.929820+0000","last_unstale":"2024-09-11T00:14:56.764648+0000","last_undegraded":"2024-09-11T00:14:56.764648+0000","last_fullsized":"2024-09-11T00:14:56.764648+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:20:21.384841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.759996+0000","last_change":"2024-09-11T00:14:23.917486+0000","last_active":"2024-09-11T00:14:56.759996+0000","last_peered":"2024-09-11T00:14:56.759996+0000","last_clean":"2024-09-11T00:14:56.759996+0000","last_became_active":"2024-09-11T00:14:23.917150+0000","last_became_peered":"2024-09-11T00:14:23.917150+0000","last_unstale":"2024-09-11T00:14:56.759996+0000","last_undegraded":"2024-09-11T00:14:56.759996+0000","last_fullsized":"2024-09-11T00:14:56.759996+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:13:55.687712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.840910+0000","last_change":"2024-09-11T00:14:25.932674+0000","last_active":"2024-09-11T00:14:56.840910+0000","last_peered":"2024-09-11T00:14:56.840910+0000","last_clean":"2024-09-11T00:14:56.840910+0000","last_became_active":"2024-09-11T00:14:25.932353+0000","last_became_peered":"2024-09-11T00:14:25.932353+0000","last_unstale":"2024-09-11T00:14:56.840910+0000","last_undegraded":"2024-09-11T00:14:56.840910+0000","last_fullsized":"2024-09-11T00:14:56.840910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:48.721854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760062+0000","last_change":"2024-09-11T00:14:23.913063+0000","last_active":"2024-09-11T00:14:56.760062+0000","last_peered":"2024-09-11T00:14:56.760062+0000","last_clean":"2024-09-11T00:14:56.760062+0000","last_became_active":"2024-09-11T00:14:23.912688+0000","last_became_peered":"2024-09-11T00:14:23.912688+0000","last_unstale":"2024-09-11T00:14:56.760062+0000","last_undegraded":"2024-09-11T00:14:56.760062+0000","last_fullsized":"2024-09-11T00:14:56.760062+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:35.228733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.760762+0000","last_change":"2024-09-11T00:14:25.928099+0000","last_active":"2024-09-11T00:14:56.760762+0000","last_peered":"2024-09-11T00:14:56.760762+0000","last_clean":"2024-09-11T00:14:56.760762+0000","last_became_active":"2024-09-11T00:14:25.927741+0000","last_became_peered":"2024-09-11T00:14:25.927741+0000","last_unstale":"2024-09-11T00:14:56.760762+0000","last_undegraded":"2024-09-11T00:14:56.760762+0000","last_fullsized":"2024-09-11T00:14:56.760762+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:12.263180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.759392+0000","last_change":"2024-09-11T00:14:24.082533+0000","last_active":"2024-09-11T00:14:56.759392+0000","last_peered":"2024-09-11T00:14:56.759392+0000","last_clean":"2024-09-11T00:14:56.759392+0000","last_became_active":"2024-09-11T00:14:24.081666+0000","last_became_peered":"2024-09-11T00:14:24.081666+0000","last_unstale":"2024-09-11T00:14:56.759392+0000","last_undegraded":"2024-09-11T00:14:56.759392+0000","last_fullsized":"2024-09-11T00:14:56.759392+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:56.485366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.759227+0000","last_change":"2024-09-11T00:14:25.912666+0000","last_active":"2024-09-11T00:14:56.759227+0000","last_peered":"2024-09-11T00:14:56.759227+0000","last_clean":"2024-09-11T00:14:56.759227+0000","last_became_active":"2024-09-11T00:14:25.912370+0000","last_became_peered":"2024-09-11T00:14:25.912370+0000","last_unstale":"2024-09-11T00:14:56.759227+0000","last_undegraded":"2024-09-11T00:14:56.759227+0000","last_fullsized":"2024-09-11T00:14:56.759227+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:44.400265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-11T00:14:56.763142+0000","last_change":"2024-09-11T00:14:23.914407+0000","last_active":"2024-09-11T00:14:56.763142+0000","last_peered":"2024-09-11T00:14:56.763142+0000","last_clean":"2024-09-11T00:14:56.763142+0000","last_became_active":"2024-09-11T00:14:23.914115+0000","last_became_peered":"2024-09-11T00:14:23.914115+0000","last_unstale":"2024-09-11T00:14:56.763142+0000","last_undegraded":"2024-09-11T00:14:56.763142+0000","last_fullsized":"2024-09-11T00:14:56.763142+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:58.883324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63615,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":124,"num_read_kb":125,"num_write":83,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":190845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282342,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743451,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":839680,"data_stored":419980,"data_compressed":5793,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939679,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":974848,"data_stored":1073454,"data_compressed":41703,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103205,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":420657,"data_compressed":5793,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299434,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":839680,"data_stored":420540,"data_compressed":5793,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495662,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":892928,"data_stored":1011025,"data_compressed":41703,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659188,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":839680,"data_stored":420075,"data_compressed":5793,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855417,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":1010625,"data_compressed":41703,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018942,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":839680,"data_stored":419980,"data_compressed":5793,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215170,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":420179,"data_compressed":5793,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":913408,"data_stored":482809,"data_compressed":5793,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542220,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":482775,"data_compressed":5793,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705745,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":839680,"data_stored":420048,"data_compressed":5793,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34264,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34264,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34264,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:15:33.628 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T00:15:33.628 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T00:15:33.628 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-11T00:15:33.628 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-11T00:15:33.875 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.400+0000 7f52f6053640 1 -- 172.21.15.78:0/11056065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f0108020 msgr2=0x7f52f010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.400+0000 7f52f6053640 1 --2- 172.21.15.78:0/11056065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f0108020 0x7f52f010e820 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f52e8009ca0 tx=0x7f52e802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.400+0000 7f52f6053640 1 -- 172.21.15.78:0/11056065 shutdown_connections 2024-09-11T00:15:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.400+0000 7f52f6053640 1 --2- 172.21.15.78:0/11056065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f0108020 0x7f52f010e820 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.400+0000 7f52f6053640 1 --2- 172.21.15.78:0/11056065 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52f01076a0 0x7f52f0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.400+0000 7f52f6053640 1 --2- 172.21.15.78:0/11056065 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52f0101c90 0x7f52f0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.400+0000 7f52f6053640 1 -- 172.21.15.78:0/11056065 >> 172.21.15.78:0/11056065 conn(0x7f52f00fd700 msgr2=0x7f52f00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.400+0000 7f52f6053640 1 -- 172.21.15.78:0/11056065 shutdown_connections 2024-09-11T00:15:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.400+0000 7f52f6053640 1 -- 172.21.15.78:0/11056065 wait complete. 2024-09-11T00:15:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.401+0000 7f52f6053640 1 Processor -- start 2024-09-11T00:15:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.401+0000 7f52f6053640 1 -- start start 2024-09-11T00:15:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.401+0000 7f52f6053640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52f0101c90 0x7f52f0199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.401+0000 7f52f6053640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f01076a0 0x7f52f0199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.401+0000 7f52f6053640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52f0108020 0x7f52f019ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.401+0000 7f52f6053640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f52f0111d30 con 0x7f52f01076a0 2024-09-11T00:15:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.401+0000 7f52f6053640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f52f0111bb0 con 0x7f52f0108020 2024-09-11T00:15:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.401+0000 7f52f6053640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f52f0111eb0 con 0x7f52f0101c90 2024-09-11T00:15:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.401+0000 7f52e7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f01076a0 0x7f52f0199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.401+0000 7f52e7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f01076a0 0x7f52f0199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43002/0 (socket says 172.21.15.78:43002) 2024-09-11T00:15:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.401+0000 7f52e7fff640 1 -- 172.21.15.78:0/3771166680 learned_addr learned my addr 172.21.15.78:0/3771166680 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.402+0000 7f52ef7fe640 1 --2- 172.21.15.78:0/3771166680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52f0101c90 0x7f52f0199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.402+0000 7f52e7fff640 1 -- 172.21.15.78:0/3771166680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52f0101c90 msgr2=0x7f52f0199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.402+0000 7f52e7fff640 1 --2- 172.21.15.78:0/3771166680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52f0101c90 0x7f52f0199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.402+0000 7f52e7fff640 1 -- 172.21.15.78:0/3771166680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52f0108020 msgr2=0x7f52f019ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.402+0000 7f52e7fff640 1 --2- 172.21.15.78:0/3771166680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52f0108020 0x7f52f019ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.402+0000 7f52e7fff640 1 -- 172.21.15.78:0/3771166680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f019f3e0 con 0x7f52f01076a0 2024-09-11T00:15:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.402+0000 7f52ef7fe640 1 --2- 172.21.15.78:0/3771166680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52f0101c90 0x7f52f0199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.402+0000 7f52e7fff640 1 --2- 172.21.15.78:0/3771166680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f01076a0 0x7f52f0199870 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f52d800b4a0 tx=0x7f52d800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.402+0000 7f52ed7fa640 1 -- 172.21.15.78:0/3771166680 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d8014070 con 0x7f52f01076a0 2024-09-11T00:15:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.402+0000 7f52ed7fa640 1 -- 172.21.15.78:0/3771166680 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52d8010ac0 con 0x7f52f01076a0 2024-09-11T00:15:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.402+0000 7f52f6053640 1 -- 172.21.15.78:0/3771166680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f019f6d0 con 0x7f52f01076a0 2024-09-11T00:15:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.402+0000 7f52ed7fa640 1 -- 172.21.15.78:0/3771166680 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d8017c30 con 0x7f52f01076a0 2024-09-11T00:15:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.402+0000 7f52f6053640 1 -- 172.21.15.78:0/3771166680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f01a5f60 con 0x7f52f01076a0 2024-09-11T00:15:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.403+0000 7f52f6053640 1 -- 172.21.15.78:0/3771166680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52f0102070 con 0x7f52f01076a0 2024-09-11T00:15:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.404+0000 7f52ed7fa640 1 -- 172.21.15.78:0/3771166680 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f52d8010610 con 0x7f52f01076a0 2024-09-11T00:15:34.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.405+0000 7f52ed7fa640 1 --2- 172.21.15.78:0/3771166680 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f52dc0b5440 0x7f52dc0b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:34.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.405+0000 7f52ef7fe640 1 --2- 172.21.15.78:0/3771166680 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f52dc0b5440 0x7f52dc0b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:34.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.405+0000 7f52ed7fa640 1 -- 172.21.15.78:0/3771166680 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f52d80e57a0 con 0x7f52f01076a0 2024-09-11T00:15:34.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.405+0000 7f52ef7fe640 1 --2- 172.21.15.78:0/3771166680 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f52dc0b5440 0x7f52dc0b7900 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f52e00058c0 tx=0x7f52e0005d30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:34.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.408+0000 7f52ed7fa640 1 -- 172.21.15.78:0/3771166680 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f52d80ac420 con 0x7f52f01076a0 2024-09-11T00:15:34.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.624+0000 7f52f6053640 1 -- 172.21.15.78:0/3771166680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f52f01a6250 con 0x7f52f01076a0 2024-09-11T00:15:34.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.625+0000 7f52ed7fa640 1 -- 172.21.15.78:0/3771166680 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f52d80abd20 con 0x7f52f01076a0 2024-09-11T00:15:34.626 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:15:34.626 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T00:15:34.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.627+0000 7f52f6053640 1 -- 172.21.15.78:0/3771166680 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f52dc0b5440 msgr2=0x7f52dc0b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:34.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.627+0000 7f52f6053640 1 --2- 172.21.15.78:0/3771166680 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f52dc0b5440 0x7f52dc0b7900 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f52e00058c0 tx=0x7f52e0005d30 comp rx=0 tx=0).stop 2024-09-11T00:15:34.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.627+0000 7f52f6053640 1 -- 172.21.15.78:0/3771166680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f01076a0 msgr2=0x7f52f0199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:34.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.627+0000 7f52f6053640 1 --2- 172.21.15.78:0/3771166680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f01076a0 0x7f52f0199870 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f52d800b4a0 tx=0x7f52d800b960 comp rx=0 tx=0).stop 2024-09-11T00:15:34.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.627+0000 7f52f6053640 1 -- 172.21.15.78:0/3771166680 shutdown_connections 2024-09-11T00:15:34.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.627+0000 7f52f6053640 1 --2- 172.21.15.78:0/3771166680 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f52dc0b5440 0x7f52dc0b7900 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:34.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.627+0000 7f52f6053640 1 --2- 172.21.15.78:0/3771166680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52f0108020 0x7f52f019ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:34.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.627+0000 7f52f6053640 1 --2- 172.21.15.78:0/3771166680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f01076a0 0x7f52f0199870 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:34.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.627+0000 7f52f6053640 1 --2- 172.21.15.78:0/3771166680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52f0101c90 0x7f52f0199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:34.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.627+0000 7f52f6053640 1 -- 172.21.15.78:0/3771166680 >> 172.21.15.78:0/3771166680 conn(0x7f52f00fd700 msgr2=0x7f52f0100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:34.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.627+0000 7f52f6053640 1 -- 172.21.15.78:0/3771166680 shutdown_connections 2024-09-11T00:15:34.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:34.627+0000 7f52f6053640 1 -- 172.21.15.78:0/3771166680 wait complete. 2024-09-11T00:15:34.943 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:34 smithi078 ceph-mon[30865]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:15:34.943 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:34 smithi078 ceph-mon[30865]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:34.943 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:34 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3771166680' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-11T00:15:35.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:34 smithi138 ceph-mon[35019]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:15:35.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:34 smithi138 ceph-mon[35019]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:35.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:34 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3771166680' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-11T00:15:35.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:34 smithi112 ceph-mon[35627]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:15:35.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:34 smithi112 ceph-mon[35627]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:35.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:34 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3771166680' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-11T00:15:35.272 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-11T00:15:35.273 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:15:35.517 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:36.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.043+0000 7eff0f14a640 1 -- 172.21.15.78:0/3197434825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff081076a0 msgr2=0x7eff08107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:36.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.043+0000 7eff0f14a640 1 --2- 172.21.15.78:0/3197434825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff081076a0 0x7eff08107ae0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efef4009900 tx=0x7efef402a410 comp rx=0 tx=0).stop 2024-09-11T00:15:36.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.043+0000 7eff0f14a640 1 -- 172.21.15.78:0/3197434825 shutdown_connections 2024-09-11T00:15:36.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.043+0000 7eff0f14a640 1 --2- 172.21.15.78:0/3197434825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff08108020 0x7eff0810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:36.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.043+0000 7eff0f14a640 1 --2- 172.21.15.78:0/3197434825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff081076a0 0x7eff08107ae0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:36.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.043+0000 7eff0f14a640 1 --2- 172.21.15.78:0/3197434825 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff08101c90 0x7eff08102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:36.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.043+0000 7eff0f14a640 1 -- 172.21.15.78:0/3197434825 >> 172.21.15.78:0/3197434825 conn(0x7eff080fd700 msgr2=0x7eff080ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:36.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.043+0000 7eff0f14a640 1 -- 172.21.15.78:0/3197434825 shutdown_connections 2024-09-11T00:15:36.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.043+0000 7eff0f14a640 1 -- 172.21.15.78:0/3197434825 wait complete. 2024-09-11T00:15:36.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.044+0000 7eff0f14a640 1 Processor -- start 2024-09-11T00:15:36.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.044+0000 7eff0f14a640 1 -- start start 2024-09-11T00:15:36.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.044+0000 7eff0f14a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff08101c90 0x7eff08199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:36.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.044+0000 7eff0f14a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff081076a0 0x7eff08199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:36.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.044+0000 7eff0f14a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff08108020 0x7eff0819ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:36.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.044+0000 7eff0f14a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7eff08111d20 con 0x7eff081076a0 2024-09-11T00:15:36.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.044+0000 7eff0f14a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7eff08111ba0 con 0x7eff08101c90 2024-09-11T00:15:36.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.044+0000 7eff0f14a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7eff08111ea0 con 0x7eff08108020 2024-09-11T00:15:36.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.044+0000 7eff07fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff081076a0 0x7eff08199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:36.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.044+0000 7eff07fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff081076a0 0x7eff08199960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56558/0 (socket says 172.21.15.78:56558) 2024-09-11T00:15:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.044+0000 7eff07fff640 1 -- 172.21.15.78:0/1878895112 learned_addr learned my addr 172.21.15.78:0/1878895112 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.044+0000 7eff07fff640 1 -- 172.21.15.78:0/1878895112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff08108020 msgr2=0x7eff0819ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.044+0000 7eff07fff640 1 --2- 172.21.15.78:0/1878895112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff08108020 0x7eff0819ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.044+0000 7eff07fff640 1 -- 172.21.15.78:0/1878895112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff08101c90 msgr2=0x7eff08199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.044+0000 7eff0cee6640 1 --2- 172.21.15.78:0/1878895112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff08101c90 0x7eff08199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.044+0000 7eff07fff640 1 --2- 172.21.15.78:0/1878895112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff08101c90 0x7eff08199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.044+0000 7eff07fff640 1 -- 172.21.15.78:0/1878895112 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff0819f4d0 con 0x7eff081076a0 2024-09-11T00:15:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.044+0000 7eff07fff640 1 --2- 172.21.15.78:0/1878895112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff081076a0 0x7eff08199960 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efef4006010 tx=0x7efef40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.044+0000 7eff05ffb640 1 -- 172.21.15.78:0/1878895112 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef403f030 con 0x7eff081076a0 2024-09-11T00:15:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.044+0000 7eff05ffb640 1 -- 172.21.15.78:0/1878895112 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efef4003800 con 0x7eff081076a0 2024-09-11T00:15:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.044+0000 7eff0f14a640 1 -- 172.21.15.78:0/1878895112 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff0819f760 con 0x7eff081076a0 2024-09-11T00:15:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.045+0000 7eff05ffb640 1 -- 172.21.15.78:0/1878895112 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4035070 con 0x7eff081076a0 2024-09-11T00:15:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.045+0000 7eff0f14a640 1 -- 172.21.15.78:0/1878895112 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff081a5e80 con 0x7eff081076a0 2024-09-11T00:15:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.046+0000 7eff0f14a640 1 -- 172.21.15.78:0/1878895112 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff081020f0 con 0x7eff081076a0 2024-09-11T00:15:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.047+0000 7eff05ffb640 1 -- 172.21.15.78:0/1878895112 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7efef4031b10 con 0x7eff081076a0 2024-09-11T00:15:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.048+0000 7eff05ffb640 1 --2- 172.21.15.78:0/1878895112 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efef80b53c0 0x7efef80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.048+0000 7eff0cee6640 1 --2- 172.21.15.78:0/1878895112 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efef80b53c0 0x7efef80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.048+0000 7eff05ffb640 1 -- 172.21.15.78:0/1878895112 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7efef4106b20 con 0x7eff081076a0 2024-09-11T00:15:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.048+0000 7eff0cee6640 1 --2- 172.21.15.78:0/1878895112 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efef80b53c0 0x7efef80b7880 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efefc00a7f0 tx=0x7efefc008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.051+0000 7eff05ffb640 1 -- 172.21.15.78:0/1878895112 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efef40cd7a0 con 0x7eff081076a0 2024-09-11T00:15:36.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.261+0000 7eff0f14a640 1 -- 172.21.15.78:0/1878895112 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff081a61c0 con 0x7eff081076a0 2024-09-11T00:15:36.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.262+0000 7eff05ffb640 1 -- 172.21.15.78:0/1878895112 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7efef40cd0a0 con 0x7eff081076a0 2024-09-11T00:15:36.263 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:15:36.264 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:15:36.264 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:15:36.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.264+0000 7eff0f14a640 1 -- 172.21.15.78:0/1878895112 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efef80b53c0 msgr2=0x7efef80b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:36.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.264+0000 7eff0f14a640 1 --2- 172.21.15.78:0/1878895112 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efef80b53c0 0x7efef80b7880 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efefc00a7f0 tx=0x7efefc008040 comp rx=0 tx=0).stop 2024-09-11T00:15:36.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.264+0000 7eff0f14a640 1 -- 172.21.15.78:0/1878895112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff081076a0 msgr2=0x7eff08199960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:36.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.264+0000 7eff0f14a640 1 --2- 172.21.15.78:0/1878895112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff081076a0 0x7eff08199960 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efef4006010 tx=0x7efef40042f0 comp rx=0 tx=0).stop 2024-09-11T00:15:36.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.264+0000 7eff0f14a640 1 -- 172.21.15.78:0/1878895112 shutdown_connections 2024-09-11T00:15:36.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.264+0000 7eff0f14a640 1 --2- 172.21.15.78:0/1878895112 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efef80b53c0 0x7efef80b7880 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:36.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.264+0000 7eff0f14a640 1 --2- 172.21.15.78:0/1878895112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff08108020 0x7eff0819ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:36.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.264+0000 7eff0f14a640 1 --2- 172.21.15.78:0/1878895112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff081076a0 0x7eff08199960 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:36.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.264+0000 7eff0f14a640 1 --2- 172.21.15.78:0/1878895112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7eff08101c90 0x7eff08199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:36.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.264+0000 7eff0f14a640 1 -- 172.21.15.78:0/1878895112 >> 172.21.15.78:0/1878895112 conn(0x7eff080fd700 msgr2=0x7eff0806ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:36.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.264+0000 7eff0f14a640 1 -- 172.21.15.78:0/1878895112 shutdown_connections 2024-09-11T00:15:36.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:36.264+0000 7eff0f14a640 1 -- 172.21.15.78:0/1878895112 wait complete. 2024-09-11T00:15:36.906 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:15:37.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:36 smithi138 ceph-mon[35019]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:37.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:36 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1878895112' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:37.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:36 smithi078 ceph-mon[30865]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:36 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1878895112' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:37.151 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:37.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:36 smithi112 ceph-mon[35627]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:37.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:36 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1878895112' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:37.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.666+0000 7f85881a4640 1 -- 172.21.15.78:0/3011154483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85801076e0 msgr2=0x7f8580107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:37.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.666+0000 7f85881a4640 1 --2- 172.21.15.78:0/3011154483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85801076e0 0x7f8580107b20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8570009900 tx=0x7f857002a410 comp rx=0 tx=0).stop 2024-09-11T00:15:37.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.666+0000 7f85881a4640 1 -- 172.21.15.78:0/3011154483 shutdown_connections 2024-09-11T00:15:37.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.666+0000 7f85881a4640 1 --2- 172.21.15.78:0/3011154483 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8580108060 0x7f858010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:37.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.666+0000 7f85881a4640 1 --2- 172.21.15.78:0/3011154483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85801076e0 0x7f8580107b20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:37.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.666+0000 7f85881a4640 1 --2- 172.21.15.78:0/3011154483 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8580101cd0 0x7f85801020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:37.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.666+0000 7f85881a4640 1 -- 172.21.15.78:0/3011154483 >> 172.21.15.78:0/3011154483 conn(0x7f85800fd720 msgr2=0x7f85800ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:37.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.666+0000 7f85881a4640 1 -- 172.21.15.78:0/3011154483 shutdown_connections 2024-09-11T00:15:37.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.666+0000 7f85881a4640 1 -- 172.21.15.78:0/3011154483 wait complete. 2024-09-11T00:15:37.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.667+0000 7f85881a4640 1 Processor -- start 2024-09-11T00:15:37.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.667+0000 7f85881a4640 1 -- start start 2024-09-11T00:15:37.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.667+0000 7f85881a4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8580101cd0 0x7f85800fdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:37.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.667+0000 7f85881a4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85801076e0 0x7f85800fe160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:37.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.667+0000 7f85881a4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8580108060 0x7f85800fe6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:37.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.667+0000 7f85881a4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8580111d60 con 0x7f85801076e0 2024-09-11T00:15:37.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.667+0000 7f85881a4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8580111be0 con 0x7f8580108060 2024-09-11T00:15:37.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.667+0000 7f85881a4640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8580111ee0 con 0x7f8580101cd0 2024-09-11T00:15:37.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.667+0000 7f858573f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85801076e0 0x7f85800fe160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:37.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.667+0000 7f858573f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85801076e0 0x7f85800fe160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56568/0 (socket says 172.21.15.78:56568) 2024-09-11T00:15:37.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.667+0000 7f858573f640 1 -- 172.21.15.78:0/465034474 learned_addr learned my addr 172.21.15.78:0/465034474 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:37.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.667+0000 7f8585f40640 1 --2- 172.21.15.78:0/465034474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8580101cd0 0x7f85800fdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:37.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.667+0000 7f858573f640 1 -- 172.21.15.78:0/465034474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8580101cd0 msgr2=0x7f85800fdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:37.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.667+0000 7f858573f640 1 --2- 172.21.15.78:0/465034474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8580101cd0 0x7f85800fdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:37.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.667+0000 7f858573f640 1 -- 172.21.15.78:0/465034474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8580108060 msgr2=0x7f85800fe6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:37.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.667+0000 7f858573f640 1 --2- 172.21.15.78:0/465034474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8580108060 0x7f85800fe6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:37.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.667+0000 7f858573f640 1 -- 172.21.15.78:0/465034474 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85801a7850 con 0x7f85801076e0 2024-09-11T00:15:37.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.668+0000 7f858573f640 1 --2- 172.21.15.78:0/465034474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85801076e0 0x7f85800fe160 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8570006010 tx=0x7f85700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:37.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.668+0000 7f8576ffd640 1 -- 172.21.15.78:0/465034474 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857003f030 con 0x7f85801076e0 2024-09-11T00:15:37.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.668+0000 7f8576ffd640 1 -- 172.21.15.78:0/465034474 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8570003800 con 0x7f85801076e0 2024-09-11T00:15:37.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.668+0000 7f85881a4640 1 -- 172.21.15.78:0/465034474 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85801a7ae0 con 0x7f85801076e0 2024-09-11T00:15:37.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.668+0000 7f8576ffd640 1 -- 172.21.15.78:0/465034474 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8570035070 con 0x7f85801076e0 2024-09-11T00:15:37.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.668+0000 7f85881a4640 1 -- 172.21.15.78:0/465034474 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85801a8040 con 0x7f85801076e0 2024-09-11T00:15:37.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.669+0000 7f85881a4640 1 -- 172.21.15.78:0/465034474 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8580102130 con 0x7f85801076e0 2024-09-11T00:15:37.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.670+0000 7f8576ffd640 1 -- 172.21.15.78:0/465034474 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f8570031b10 con 0x7f85801076e0 2024-09-11T00:15:37.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.671+0000 7f8576ffd640 1 --2- 172.21.15.78:0/465034474 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f856c0b53c0 0x7f856c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:37.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.671+0000 7f8585f40640 1 --2- 172.21.15.78:0/465034474 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f856c0b53c0 0x7f856c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:37.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.671+0000 7f8576ffd640 1 -- 172.21.15.78:0/465034474 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f8570106b20 con 0x7f85801076e0 2024-09-11T00:15:37.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.671+0000 7f8585f40640 1 --2- 172.21.15.78:0/465034474 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f856c0b53c0 0x7f856c0b7880 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f857c009890 tx=0x7f857c008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:37.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.674+0000 7f8576ffd640 1 -- 172.21.15.78:0/465034474 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f85700cd7a0 con 0x7f85801076e0 2024-09-11T00:15:37.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.885+0000 7f85881a4640 1 -- 172.21.15.78:0/465034474 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85801a8410 con 0x7f85801076e0 2024-09-11T00:15:37.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.885+0000 7f8576ffd640 1 -- 172.21.15.78:0/465034474 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f85700cd0a0 con 0x7f85801076e0 2024-09-11T00:15:37.887 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:15:37.887 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:15:37.888 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:15:37.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.888+0000 7f85881a4640 1 -- 172.21.15.78:0/465034474 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f856c0b53c0 msgr2=0x7f856c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:37.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.888+0000 7f85881a4640 1 --2- 172.21.15.78:0/465034474 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f856c0b53c0 0x7f856c0b7880 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f857c009890 tx=0x7f857c008040 comp rx=0 tx=0).stop 2024-09-11T00:15:37.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.888+0000 7f85881a4640 1 -- 172.21.15.78:0/465034474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85801076e0 msgr2=0x7f85800fe160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:37.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.888+0000 7f85881a4640 1 --2- 172.21.15.78:0/465034474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85801076e0 0x7f85800fe160 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8570006010 tx=0x7f85700042f0 comp rx=0 tx=0).stop 2024-09-11T00:15:37.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.888+0000 7f85881a4640 1 -- 172.21.15.78:0/465034474 shutdown_connections 2024-09-11T00:15:37.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.888+0000 7f85881a4640 1 --2- 172.21.15.78:0/465034474 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f856c0b53c0 0x7f856c0b7880 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:37.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.888+0000 7f85881a4640 1 --2- 172.21.15.78:0/465034474 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8580108060 0x7f85800fe6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:37.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.888+0000 7f85881a4640 1 --2- 172.21.15.78:0/465034474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85801076e0 0x7f85800fe160 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:37.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.888+0000 7f85881a4640 1 --2- 172.21.15.78:0/465034474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8580101cd0 0x7f85800fdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:37.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.888+0000 7f85881a4640 1 -- 172.21.15.78:0/465034474 >> 172.21.15.78:0/465034474 conn(0x7f85800fd720 msgr2=0x7f85801006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:37.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.888+0000 7f85881a4640 1 -- 172.21.15.78:0/465034474 shutdown_connections 2024-09-11T00:15:37.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:37.888+0000 7f85881a4640 1 -- 172.21.15.78:0/465034474 wait complete. 2024-09-11T00:15:38.540 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:15:38.784 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:38.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:38 smithi078 ceph-mon[30865]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:38.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:38 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/465034474' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:39.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:38 smithi138 ceph-mon[35019]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:39.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:38 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/465034474' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:39.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:38 smithi112 ceph-mon[35627]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:39.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:38 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/465034474' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:39.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.283+0000 7f7874ef3640 1 -- 172.21.15.78:0/489530933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78701045c0 msgr2=0x7f787010cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:39.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.283+0000 7f7874ef3640 1 --2- 172.21.15.78:0/489530933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78701045c0 0x7f787010cab0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7858009900 tx=0x7f785802a410 comp rx=0 tx=0).stop 2024-09-11T00:15:39.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.284+0000 7f7874ef3640 1 -- 172.21.15.78:0/489530933 shutdown_connections 2024-09-11T00:15:39.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.284+0000 7f7874ef3640 1 --2- 172.21.15.78:0/489530933 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f787010d100 0x7f787010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:39.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.284+0000 7f7874ef3640 1 --2- 172.21.15.78:0/489530933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78701045c0 0x7f787010cab0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:39.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.284+0000 7f7874ef3640 1 --2- 172.21.15.78:0/489530933 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7870103ca0 0x7f7870104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:39.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.284+0000 7f7874ef3640 1 -- 172.21.15.78:0/489530933 >> 172.21.15.78:0/489530933 conn(0x7f78700fd700 msgr2=0x7f78700ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:39.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.284+0000 7f7874ef3640 1 -- 172.21.15.78:0/489530933 shutdown_connections 2024-09-11T00:15:39.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.284+0000 7f7874ef3640 1 -- 172.21.15.78:0/489530933 wait complete. 2024-09-11T00:15:39.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.284+0000 7f7874ef3640 1 Processor -- start 2024-09-11T00:15:39.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.284+0000 7f7874ef3640 1 -- start start 2024-09-11T00:15:39.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.285+0000 7f7874ef3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7870103ca0 0x7f78701992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:39.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.285+0000 7f7874ef3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78701045c0 0x7f78701997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:39.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.285+0000 7f7874ef3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f787010d100 0x7f787019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:39.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.285+0000 7f7874ef3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7870112db0 con 0x7f78701045c0 2024-09-11T00:15:39.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.285+0000 7f7874ef3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7870112c30 con 0x7f787010d100 2024-09-11T00:15:39.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.285+0000 7f7874ef3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7870112f30 con 0x7f7870103ca0 2024-09-11T00:15:39.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.285+0000 7f786dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78701045c0 0x7f78701997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:39.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.285+0000 7f786dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78701045c0 0x7f78701997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56588/0 (socket says 172.21.15.78:56588) 2024-09-11T00:15:39.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.285+0000 7f786dd9b640 1 -- 172.21.15.78:0/1809662092 learned_addr learned my addr 172.21.15.78:0/1809662092 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:39.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.285+0000 7f786ed9d640 1 --2- 172.21.15.78:0/1809662092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f787010d100 0x7f787019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:39.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.285+0000 7f786e59c640 1 --2- 172.21.15.78:0/1809662092 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7870103ca0 0x7f78701992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:39.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.285+0000 7f786dd9b640 1 -- 172.21.15.78:0/1809662092 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7870103ca0 msgr2=0x7f78701992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:39.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.285+0000 7f786dd9b640 1 --2- 172.21.15.78:0/1809662092 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7870103ca0 0x7f78701992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:39.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.285+0000 7f786dd9b640 1 -- 172.21.15.78:0/1809662092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f787010d100 msgr2=0x7f787019eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:39.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.285+0000 7f786dd9b640 1 --2- 172.21.15.78:0/1809662092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f787010d100 0x7f787019eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:39.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.285+0000 7f786dd9b640 1 -- 172.21.15.78:0/1809662092 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787019f350 con 0x7f78701045c0 2024-09-11T00:15:39.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.285+0000 7f786dd9b640 1 --2- 172.21.15.78:0/1809662092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78701045c0 0x7f78701997e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7858004270 tx=0x7f78580042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:39.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.285+0000 7f78677fe640 1 -- 172.21.15.78:0/1809662092 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785803f030 con 0x7f78701045c0 2024-09-11T00:15:39.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.285+0000 7f78677fe640 1 -- 172.21.15.78:0/1809662092 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78580044c0 con 0x7f78701045c0 2024-09-11T00:15:39.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.285+0000 7f78677fe640 1 -- 172.21.15.78:0/1809662092 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7858035070 con 0x7f78701045c0 2024-09-11T00:15:39.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.285+0000 7f7874ef3640 1 -- 172.21.15.78:0/1809662092 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787019f5e0 con 0x7f78701045c0 2024-09-11T00:15:39.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.286+0000 7f7874ef3640 1 -- 172.21.15.78:0/1809662092 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78701a5d00 con 0x7f78701045c0 2024-09-11T00:15:39.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.286+0000 7f7874ef3640 1 -- 172.21.15.78:0/1809662092 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7870104080 con 0x7f78701045c0 2024-09-11T00:15:39.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.288+0000 7f78677fe640 1 -- 172.21.15.78:0/1809662092 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f785803bbe0 con 0x7f78701045c0 2024-09-11T00:15:39.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.289+0000 7f78677fe640 1 --2- 172.21.15.78:0/1809662092 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f785c0b5440 0x7f785c0b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:39.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.289+0000 7f786e59c640 1 --2- 172.21.15.78:0/1809662092 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f785c0b5440 0x7f785c0b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:39.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.289+0000 7f78677fe640 1 -- 172.21.15.78:0/1809662092 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f7858106ad0 con 0x7f78701045c0 2024-09-11T00:15:39.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.290+0000 7f786e59c640 1 --2- 172.21.15.78:0/1809662092 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f785c0b5440 0x7f785c0b7900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7860005e10 tx=0x7f7860005da0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:39.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.292+0000 7f78677fe640 1 -- 172.21.15.78:0/1809662092 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f78580cd6f0 con 0x7f78701045c0 2024-09-11T00:15:39.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.467+0000 7f7874ef3640 1 -- 172.21.15.78:0/1809662092 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78701a6030 con 0x7f78701045c0 2024-09-11T00:15:39.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.468+0000 7f78677fe640 1 -- 172.21.15.78:0/1809662092 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+23171 (secure 0 0 0) 0x7f78580ccff0 con 0x7f78701045c0 2024-09-11T00:15:39.470 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:15:39.470 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":77,"fsid":"85a53860-6fd1-11ef-bcea-c7b262605968","created":"2024-09-11T00:06:05.704745+0000","modified":"2024-09-11T00:14:56.755927+0000","last_up_change":"2024-09-11T00:13:35.307216+0000","last_in_change":"2024-09-11T00:13:12.730667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:09:47.891696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:22.345345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:24.446029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d260c219-52f2-4e7f-9188-9e66ee01dacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6803","nonce":3736366730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6805","nonce":3736366730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6809","nonce":3736366730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6807","nonce":3736366730}]},"public_addr":"172.21.15.78:6803/3736366730","cluster_addr":"172.21.15.78:6805/3736366730","heartbeat_back_addr":"172.21.15.78:6809/3736366730","heartbeat_front_addr":"172.21.15.78:6807/3736366730","state":["exists","up"]},{"osd":1,"uuid":"d0f286a2-a121-40ee-8134-67ef01b1bc9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6801","nonce":3186321784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6803","nonce":3186321784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6807","nonce":3186321784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6805","nonce":3186321784}]},"public_addr":"172.21.15.112:6801/3186321784","cluster_addr":"172.21.15.112:6803/3186321784","heartbeat_back_addr":"172.21.15.112:6807/3186321784","heartbeat_front_addr":"172.21.15.112:6805/3186321784","state":["exists","up"]},{"osd":2,"uuid":"0eadcce5-12af-4af6-9b4e-159e84454d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6801","nonce":3206386630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6803","nonce":3206386630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6807","nonce":3206386630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6805","nonce":3206386630}]},"public_addr":"172.21.15.138:6801/3206386630","cluster_addr":"172.21.15.138:6803/3206386630","heartbeat_back_addr":"172.21.15.138:6807/3206386630","heartbeat_front_addr":"172.21.15.138:6805/3206386630","state":["exists","up"]},{"osd":3,"uuid":"5f3f683d-6306-43da-8bbd-c103eca442ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6811","nonce":3832405256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6813","nonce":3832405256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6817","nonce":3832405256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6815","nonce":3832405256}]},"public_addr":"172.21.15.78:6811/3832405256","cluster_addr":"172.21.15.78:6813/3832405256","heartbeat_back_addr":"172.21.15.78:6817/3832405256","heartbeat_front_addr":"172.21.15.78:6815/3832405256","state":["exists","up"]},{"osd":4,"uuid":"4575a0a5-821e-4346-84ac-5396042b0550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6809","nonce":2650243435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6811","nonce":2650243435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6815","nonce":2650243435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6813","nonce":2650243435}]},"public_addr":"172.21.15.112:6809/2650243435","cluster_addr":"172.21.15.112:6811/2650243435","heartbeat_back_addr":"172.21.15.112:6815/2650243435","heartbeat_front_addr":"172.21.15.112:6813/2650243435","state":["exists","up"]},{"osd":5,"uuid":"e81eb98f-76eb-4da5-8047-f160888720e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6809","nonce":3033110975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6811","nonce":3033110975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6815","nonce":3033110975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6813","nonce":3033110975}]},"public_addr":"172.21.15.138:6809/3033110975","cluster_addr":"172.21.15.138:6811/3033110975","heartbeat_back_addr":"172.21.15.138:6815/3033110975","heartbeat_front_addr":"172.21.15.138:6813/3033110975","state":["exists","up"]},{"osd":6,"uuid":"7442a091-4dba-45c4-808b-7c3b97087aa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6819","nonce":477087575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6821","nonce":477087575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6825","nonce":477087575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6823","nonce":477087575}]},"public_addr":"172.21.15.78:6819/477087575","cluster_addr":"172.21.15.78:6821/477087575","heartbeat_back_addr":"172.21.15.78:6825/477087575","heartbeat_front_addr":"172.21.15.78:6823/477087575","state":["exists","up"]},{"osd":7,"uuid":"220c1f03-ace9-4dd0-a06d-485b0d2d08bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6817","nonce":1481363296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6819","nonce":1481363296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6823","nonce":1481363296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6821","nonce":1481363296}]},"public_addr":"172.21.15.112:6817/1481363296","cluster_addr":"172.21.15.112:6819/1481363296","heartbeat_back_addr":"172.21.15.112:6823/1481363296","heartbeat_front_addr":"172.21.15.112:6821/1481363296","state":["exists","up"]},{"osd":8,"uuid":"adb6edaa-9a8c-4b0b-aa6a-26dc77a3a7cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6817","nonce":2195149036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6819","nonce":2195149036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6823","nonce":2195149036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6821","nonce":2195149036}]},"public_addr":"172.21.15.138:6817/2195149036","cluster_addr":"172.21.15.138:6819/2195149036","heartbeat_back_addr":"172.21.15.138:6823/2195149036","heartbeat_front_addr":"172.21.15.138:6821/2195149036","state":["exists","up"]},{"osd":9,"uuid":"dd01f408-3712-410e-acbd-c797b7ea5058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6827","nonce":3367249449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6829","nonce":3367249449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6833","nonce":3367249449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6831","nonce":3367249449}]},"public_addr":"172.21.15.78:6827/3367249449","cluster_addr":"172.21.15.78:6829/3367249449","heartbeat_back_addr":"172.21.15.78:6833/3367249449","heartbeat_front_addr":"172.21.15.78:6831/3367249449","state":["exists","up"]},{"osd":10,"uuid":"243c6483-1b0e-49f2-b99c-116d9e9c0617","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6825","nonce":775023408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6827","nonce":775023408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6831","nonce":775023408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6829","nonce":775023408}]},"public_addr":"172.21.15.112:6825/775023408","cluster_addr":"172.21.15.112:6827/775023408","heartbeat_back_addr":"172.21.15.112:6831/775023408","heartbeat_front_addr":"172.21.15.112:6829/775023408","state":["exists","up"]},{"osd":11,"uuid":"fa20ac9e-b5f7-4b3a-bb51-31569f909609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6825","nonce":4046089012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6827","nonce":4046089012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6831","nonce":4046089012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6829","nonce":4046089012}]},"public_addr":"172.21.15.138:6825/4046089012","cluster_addr":"172.21.15.138:6827/4046089012","heartbeat_back_addr":"172.21.15.138:6831/4046089012","heartbeat_front_addr":"172.21.15.138:6829/4046089012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:08:55.896475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:20.695819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:44.785187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:10.858705+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:35.855800+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:01.353037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:27.492985+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:52.860532+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:17.946878+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:43.188966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:08.369978+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:34.192288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":8}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6801/2525199237":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/1476776463":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1949658157":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2276853910":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/4205790529":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6800/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/4286825123":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6801/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1304243506":"2024-09-12T00:06:56.062555+0000","172.21.15.78:6800/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1614270050":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6801/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1679390655":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2957982486":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6800/2525199237":"2024-09-12T00:07:55.586578+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:15:39.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.471+0000 7f7874ef3640 1 -- 172.21.15.78:0/1809662092 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f785c0b5440 msgr2=0x7f785c0b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:39.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.471+0000 7f7874ef3640 1 --2- 172.21.15.78:0/1809662092 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f785c0b5440 0x7f785c0b7900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7860005e10 tx=0x7f7860005da0 comp rx=0 tx=0).stop 2024-09-11T00:15:39.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.471+0000 7f7874ef3640 1 -- 172.21.15.78:0/1809662092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78701045c0 msgr2=0x7f78701997e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:39.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.471+0000 7f7874ef3640 1 --2- 172.21.15.78:0/1809662092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78701045c0 0x7f78701997e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7858004270 tx=0x7f78580042a0 comp rx=0 tx=0).stop 2024-09-11T00:15:39.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.471+0000 7f7874ef3640 1 -- 172.21.15.78:0/1809662092 shutdown_connections 2024-09-11T00:15:39.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.471+0000 7f7874ef3640 1 --2- 172.21.15.78:0/1809662092 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f785c0b5440 0x7f785c0b7900 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:39.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.471+0000 7f7874ef3640 1 --2- 172.21.15.78:0/1809662092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f787010d100 0x7f787019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:39.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.471+0000 7f7874ef3640 1 --2- 172.21.15.78:0/1809662092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78701045c0 0x7f78701997e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:39.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.471+0000 7f7874ef3640 1 --2- 172.21.15.78:0/1809662092 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7870103ca0 0x7f78701992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:39.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.471+0000 7f7874ef3640 1 -- 172.21.15.78:0/1809662092 >> 172.21.15.78:0/1809662092 conn(0x7f78700fd700 msgr2=0x7f787010f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:39.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.472+0000 7f7874ef3640 1 -- 172.21.15.78:0/1809662092 shutdown_connections 2024-09-11T00:15:39.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:39.472+0000 7f7874ef3640 1 -- 172.21.15.78:0/1809662092 wait complete. 2024-09-11T00:15:40.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:39 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1809662092' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:15:40.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:39 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1809662092' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:15:40.132 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:15:40.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:39 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1809662092' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:15:40.375 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:40.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.908+0000 7f9b22b4c640 1 -- 172.21.15.78:0/1392217055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b1c103b70 msgr2=0x7f9b1c103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:40.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.908+0000 7f9b22b4c640 1 --2- 172.21.15.78:0/1392217055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b1c103b70 0x7f9b1c103f50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c009ca0 tx=0x7f9b0c02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:40.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.908+0000 7f9b22b4c640 1 -- 172.21.15.78:0/1392217055 shutdown_connections 2024-09-11T00:15:40.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.908+0000 7f9b22b4c640 1 --2- 172.21.15.78:0/1392217055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b1c10d120 0x7f9b1c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:40.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.908+0000 7f9b22b4c640 1 --2- 172.21.15.78:0/1392217055 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b1c104570 0x7f9b1c10cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:40.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.908+0000 7f9b22b4c640 1 --2- 172.21.15.78:0/1392217055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b1c103b70 0x7f9b1c103f50 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:40.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.908+0000 7f9b22b4c640 1 -- 172.21.15.78:0/1392217055 >> 172.21.15.78:0/1392217055 conn(0x7f9b1c0fd700 msgr2=0x7f9b1c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:40.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.908+0000 7f9b22b4c640 1 -- 172.21.15.78:0/1392217055 shutdown_connections 2024-09-11T00:15:40.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.908+0000 7f9b22b4c640 1 -- 172.21.15.78:0/1392217055 wait complete. 2024-09-11T00:15:40.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.909+0000 7f9b22b4c640 1 Processor -- start 2024-09-11T00:15:40.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.909+0000 7f9b22b4c640 1 -- start start 2024-09-11T00:15:40.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.909+0000 7f9b22b4c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b1c103b70 0x7f9b1c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:40.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.909+0000 7f9b22b4c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b1c104570 0x7f9b1c1998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:40.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.909+0000 7f9b22b4c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b1c10d120 0x7f9b1c19ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:40.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.909+0000 7f9b22b4c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1c112da0 con 0x7f9b1c10d120 2024-09-11T00:15:40.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.909+0000 7f9b22b4c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1c112c20 con 0x7f9b1c103b70 2024-09-11T00:15:40.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.909+0000 7f9b22b4c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1c112f20 con 0x7f9b1c104570 2024-09-11T00:15:40.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.910+0000 7f9b210e9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b1c10d120 0x7f9b1c19ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:40.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.910+0000 7f9b210e9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b1c10d120 0x7f9b1c19ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56620/0 (socket says 172.21.15.78:56620) 2024-09-11T00:15:40.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.910+0000 7f9b210e9640 1 -- 172.21.15.78:0/3405535646 learned_addr learned my addr 172.21.15.78:0/3405535646 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:40.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.910+0000 7f9b1bfff640 1 --2- 172.21.15.78:0/3405535646 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b1c104570 0x7f9b1c1998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:40.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.910+0000 7f9b208e8640 1 --2- 172.21.15.78:0/3405535646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b1c103b70 0x7f9b1c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:40.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.910+0000 7f9b210e9640 1 -- 172.21.15.78:0/3405535646 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b1c104570 msgr2=0x7f9b1c1998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:40.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.910+0000 7f9b210e9640 1 --2- 172.21.15.78:0/3405535646 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b1c104570 0x7f9b1c1998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:40.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.910+0000 7f9b210e9640 1 -- 172.21.15.78:0/3405535646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b1c103b70 msgr2=0x7f9b1c199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:40.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.910+0000 7f9b210e9640 1 --2- 172.21.15.78:0/3405535646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b1c103b70 0x7f9b1c199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:40.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.910+0000 7f9b210e9640 1 -- 172.21.15.78:0/3405535646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1c19f420 con 0x7f9b1c10d120 2024-09-11T00:15:40.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.910+0000 7f9b210e9640 1 --2- 172.21.15.78:0/3405535646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b1c10d120 0x7f9b1c19ec50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400e970 tx=0x7f9b1400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:40.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.910+0000 7f9b19ffb640 1 -- 172.21.15.78:0/3405535646 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1400ccc0 con 0x7f9b1c10d120 2024-09-11T00:15:40.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.910+0000 7f9b22b4c640 1 -- 172.21.15.78:0/3405535646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b1c19f710 con 0x7f9b1c10d120 2024-09-11T00:15:40.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.910+0000 7f9b19ffb640 1 -- 172.21.15.78:0/3405535646 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b1400ce60 con 0x7f9b1c10d120 2024-09-11T00:15:40.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.910+0000 7f9b19ffb640 1 -- 172.21.15.78:0/3405535646 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b14010430 con 0x7f9b1c10d120 2024-09-11T00:15:40.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.910+0000 7f9b22b4c640 1 -- 172.21.15.78:0/3405535646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b1c1a5dd0 con 0x7f9b1c10d120 2024-09-11T00:15:40.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.911+0000 7f9b22b4c640 1 -- 172.21.15.78:0/3405535646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b1c103f50 con 0x7f9b1c10d120 2024-09-11T00:15:40.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.912+0000 7f9b19ffb640 1 -- 172.21.15.78:0/3405535646 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f9b14004f20 con 0x7f9b1c10d120 2024-09-11T00:15:40.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.913+0000 7f9b19ffb640 1 --2- 172.21.15.78:0/3405535646 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f9b080b53c0 0x7f9b080b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:40.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.913+0000 7f9b208e8640 1 --2- 172.21.15.78:0/3405535646 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f9b080b53c0 0x7f9b080b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:40.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.914+0000 7f9b19ffb640 1 -- 172.21.15.78:0/3405535646 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f9b140e62d0 con 0x7f9b1c10d120 2024-09-11T00:15:40.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.914+0000 7f9b208e8640 1 --2- 172.21.15.78:0/3405535646 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f9b080b53c0 0x7f9b080b7880 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c000f80 tx=0x7f9b0c005ef0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:40.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:40.917+0000 7f9b19ffb640 1 -- 172.21.15.78:0/3405535646 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9b140acef0 con 0x7f9b1c10d120 2024-09-11T00:15:41.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:40 smithi138 ceph-mon[35019]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:41.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:40 smithi078 ceph-mon[30865]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:41.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:41.130+0000 7f9b22b4c640 1 -- 172.21.15.78:0/3405535646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b1c1a61c0 con 0x7f9b1c10d120 2024-09-11T00:15:41.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:41.130+0000 7f9b19ffb640 1 -- 172.21.15.78:0/3405535646 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f9b140ac7f0 con 0x7f9b1c10d120 2024-09-11T00:15:41.132 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:15:41.132 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:15:41.133 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:15:41.133 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:40 smithi112 ceph-mon[35627]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:41.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:41.133+0000 7f9b22b4c640 1 -- 172.21.15.78:0/3405535646 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f9b080b53c0 msgr2=0x7f9b080b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:41.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:41.133+0000 7f9b22b4c640 1 --2- 172.21.15.78:0/3405535646 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f9b080b53c0 0x7f9b080b7880 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c000f80 tx=0x7f9b0c005ef0 comp rx=0 tx=0).stop 2024-09-11T00:15:41.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:41.133+0000 7f9b22b4c640 1 -- 172.21.15.78:0/3405535646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b1c10d120 msgr2=0x7f9b1c19ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:41.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:41.133+0000 7f9b22b4c640 1 --2- 172.21.15.78:0/3405535646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b1c10d120 0x7f9b1c19ec50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400e970 tx=0x7f9b1400ed70 comp rx=0 tx=0).stop 2024-09-11T00:15:41.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:41.133+0000 7f9b22b4c640 1 -- 172.21.15.78:0/3405535646 shutdown_connections 2024-09-11T00:15:41.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:41.133+0000 7f9b22b4c640 1 --2- 172.21.15.78:0/3405535646 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f9b080b53c0 0x7f9b080b7880 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:41.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:41.133+0000 7f9b22b4c640 1 --2- 172.21.15.78:0/3405535646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b1c10d120 0x7f9b1c19ec50 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:41.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:41.133+0000 7f9b22b4c640 1 --2- 172.21.15.78:0/3405535646 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b1c104570 0x7f9b1c1998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:41.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:41.133+0000 7f9b22b4c640 1 --2- 172.21.15.78:0/3405535646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9b1c103b70 0x7f9b1c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:41.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:41.133+0000 7f9b22b4c640 1 -- 172.21.15.78:0/3405535646 >> 172.21.15.78:0/3405535646 conn(0x7f9b1c0fd700 msgr2=0x7f9b1c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:41.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:41.133+0000 7f9b22b4c640 1 -- 172.21.15.78:0/3405535646 shutdown_connections 2024-09-11T00:15:41.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:41.133+0000 7f9b22b4c640 1 -- 172.21.15.78:0/3405535646 wait complete. 2024-09-11T00:15:41.803 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:41 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3405535646' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:41.830 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T00:14:26.461738+0000', 'modified': '2024-09-11T00:14:35.614720+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24593}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24589': {'gid': 24589, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.138:6839/1175492512', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6838', 'nonce': 1175492512}, {'type': 'v1', 'addr': '172.21.15.138:6839', 'nonce': 1175492512}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24593': {'gid': 24593, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.112:6839/433500133', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6838', 'nonce': 433500133}, {'type': 'v1', 'addr': '172.21.15.112:6839', 'nonce': 433500133}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24593, 'qdb_cluster': [24593]} 2024-09-11T00:15:41.831 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T00:15:41.831 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T00:15:42.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:41 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3405535646' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:42.074 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:42.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:41 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3405535646' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:42.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.591+0000 7f6d9d278640 1 -- 172.21.15.78:0/665589191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d98101c90 msgr2=0x7f6d98102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:42.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.591+0000 7f6d9d278640 1 --2- 172.21.15.78:0/665589191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d98101c90 0x7f6d98102070 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6d90009900 tx=0x7f6d9002a410 comp rx=0 tx=0).stop 2024-09-11T00:15:42.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.591+0000 7f6d9d278640 1 -- 172.21.15.78:0/665589191 shutdown_connections 2024-09-11T00:15:42.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.591+0000 7f6d9d278640 1 --2- 172.21.15.78:0/665589191 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d98108020 0x7f6d9810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.591+0000 7f6d9d278640 1 --2- 172.21.15.78:0/665589191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d981076a0 0x7f6d98107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.591+0000 7f6d9d278640 1 --2- 172.21.15.78:0/665589191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d98101c90 0x7f6d98102070 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.591+0000 7f6d9d278640 1 -- 172.21.15.78:0/665589191 >> 172.21.15.78:0/665589191 conn(0x7f6d980fd700 msgr2=0x7f6d980ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:42.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.591+0000 7f6d9d278640 1 -- 172.21.15.78:0/665589191 shutdown_connections 2024-09-11T00:15:42.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.591+0000 7f6d9d278640 1 -- 172.21.15.78:0/665589191 wait complete. 2024-09-11T00:15:42.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.592+0000 7f6d9d278640 1 Processor -- start 2024-09-11T00:15:42.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.592+0000 7f6d9d278640 1 -- start start 2024-09-11T00:15:42.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.592+0000 7f6d9d278640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d98101c90 0x7f6d98198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:42.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.592+0000 7f6d9d278640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d981076a0 0x7f6d98198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:42.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.592+0000 7f6d9d278640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d98108020 0x7f6d9819d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:42.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.592+0000 7f6d9d278640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6d98111ce0 con 0x7f6d981076a0 2024-09-11T00:15:42.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.592+0000 7f6d9d278640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6d98111b60 con 0x7f6d98108020 2024-09-11T00:15:42.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.592+0000 7f6d9d278640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6d98111e60 con 0x7f6d98101c90 2024-09-11T00:15:42.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.593+0000 7f6d967fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d981076a0 0x7f6d98198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:42.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.593+0000 7f6d967fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d981076a0 0x7f6d98198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56632/0 (socket says 172.21.15.78:56632) 2024-09-11T00:15:42.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.593+0000 7f6d967fc640 1 -- 172.21.15.78:0/456980821 learned_addr learned my addr 172.21.15.78:0/456980821 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:42.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.593+0000 7f6d96ffd640 1 --2- 172.21.15.78:0/456980821 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d98101c90 0x7f6d98198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:42.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.593+0000 7f6d977fe640 1 --2- 172.21.15.78:0/456980821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d98108020 0x7f6d9819d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.593+0000 7f6d967fc640 1 -- 172.21.15.78:0/456980821 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d98101c90 msgr2=0x7f6d98198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.593+0000 7f6d967fc640 1 --2- 172.21.15.78:0/456980821 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d98101c90 0x7f6d98198100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.593+0000 7f6d967fc640 1 -- 172.21.15.78:0/456980821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d98108020 msgr2=0x7f6d9819d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.593+0000 7f6d967fc640 1 --2- 172.21.15.78:0/456980821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d98108020 0x7f6d9819d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.593+0000 7f6d967fc640 1 -- 172.21.15.78:0/456980821 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d9819e1b0 con 0x7f6d981076a0 2024-09-11T00:15:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.593+0000 7f6d977fe640 1 --2- 172.21.15.78:0/456980821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d98108020 0x7f6d9819d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.593+0000 7f6d967fc640 1 --2- 172.21.15.78:0/456980821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d981076a0 0x7f6d98198640 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c007d60 tx=0x7f6d8c00e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.593+0000 7f6d7ffff640 1 -- 172.21.15.78:0/456980821 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c00eb30 con 0x7f6d981076a0 2024-09-11T00:15:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.593+0000 7f6d9d278640 1 -- 172.21.15.78:0/456980821 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d9819e4a0 con 0x7f6d981076a0 2024-09-11T00:15:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.593+0000 7f6d7ffff640 1 -- 172.21.15.78:0/456980821 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d8c00ecd0 con 0x7f6d981076a0 2024-09-11T00:15:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.593+0000 7f6d7ffff640 1 -- 172.21.15.78:0/456980821 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c015650 con 0x7f6d981076a0 2024-09-11T00:15:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.593+0000 7f6d9d278640 1 -- 172.21.15.78:0/456980821 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d9806ac80 con 0x7f6d981076a0 2024-09-11T00:15:42.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.596+0000 7f6d9f64d740 1 Processor -- start 2024-09-11T00:15:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.596+0000 7f6d9f64d740 1 -- start start 2024-09-11T00:15:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.596+0000 7f6d7ffff640 1 -- 172.21.15.78:0/456980821 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f6d8c014070 con 0x7f6d981076a0 2024-09-11T00:15:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.596+0000 7f6d9f64d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df0073d30 0x564df0074110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.596+0000 7f6d9f64d740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564df0074650 0x564df00800a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.596+0000 7f6d9f64d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564df00805e0 0x564df00829d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.596+0000 7f6d9f64d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x564deffebc10 con 0x564df0073d30 2024-09-11T00:15:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.596+0000 7f6d9f64d740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564deffdb040 con 0x564df0074650 2024-09-11T00:15:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.596+0000 7f6d9f64d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564deffdee50 con 0x564df00805e0 2024-09-11T00:15:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.597+0000 7f6d977fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df0073d30 0x564df0074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.597+0000 7f6d977fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df0073d30 0x564df0074110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56638/0 (socket says 172.21.15.78:56638) 2024-09-11T00:15:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.597+0000 7f6d977fe640 1 -- 172.21.15.78:0/945086867 learned_addr learned my addr 172.21.15.78:0/945086867 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:42.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.597+0000 7f6d96ffd640 1 --2- 172.21.15.78:0/945086867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564df0074650 0x564df00800a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:42.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.597+0000 7f6d967fc640 1 --2- 172.21.15.78:0/945086867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564df00805e0 0x564df00829d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:42.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.597+0000 7f6d977fe640 1 -- 172.21.15.78:0/945086867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564df00805e0 msgr2=0x564df00829d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:42.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.597+0000 7f6d977fe640 1 --2- 172.21.15.78:0/945086867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564df00805e0 0x564df00829d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.597+0000 7f6d977fe640 1 -- 172.21.15.78:0/945086867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564df0074650 msgr2=0x564df00800a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:42.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.597+0000 7f6d977fe640 1 --2- 172.21.15.78:0/945086867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564df0074650 0x564df00800a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.597+0000 7f6d977fe640 1 -- 172.21.15.78:0/945086867 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564defd39540 con 0x564df0073d30 2024-09-11T00:15:42.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.597+0000 7f6d967fc640 1 --2- 172.21.15.78:0/945086867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564df00805e0 0x564df00829d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:42.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.597+0000 7f6d977fe640 1 --2- 172.21.15.78:0/945086867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df0073d30 0x564df0074110 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800bd20 tx=0x7f6d8800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1699ba48b2c38cf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:42.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.597+0000 7f6d7ffff640 1 --2- 172.21.15.78:0/456980821 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f6d800b53c0 0x7f6d800b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:42.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.597+0000 7f6d7d7fa640 1 -- 172.21.15.78:0/945086867 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d88015070 con 0x564df0073d30 2024-09-11T00:15:42.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.597+0000 7f6d96ffd640 1 --2- 172.21.15.78:0/456980821 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f6d800b53c0 0x7f6d800b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:42.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.597+0000 7f6d7d7fa640 1 -- 172.21.15.78:0/945086867 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d8800be10 con 0x564df0073d30 2024-09-11T00:15:42.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.597+0000 7f6d7ffff640 1 -- 172.21.15.78:0/456980821 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f6d8c0e74e0 con 0x7f6d981076a0 2024-09-11T00:15:42.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.597+0000 7f6d7d7fa640 1 -- 172.21.15.78:0/945086867 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d88010750 con 0x564df0073d30 2024-09-11T00:15:42.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.598+0000 7f6d9f64d740 1 -- 172.21.15.78:0/945086867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df0073d30 msgr2=0x564df0074110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:42.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.598+0000 7f6d96ffd640 1 --2- 172.21.15.78:0/456980821 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f6d800b53c0 0x7f6d800b7880 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6d90031440 tx=0x7f6d90005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:42.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.598+0000 7f6d9f64d740 1 --2- 172.21.15.78:0/945086867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df0073d30 0x564df0074110 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800bd20 tx=0x7f6d8800f730 comp rx=0 tx=0).stop 2024-09-11T00:15:42.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.598+0000 7f6d9f64d740 1 -- 172.21.15.78:0/945086867 shutdown_connections 2024-09-11T00:15:42.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.598+0000 7f6d9f64d740 1 --2- 172.21.15.78:0/945086867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564df00805e0 0x564df00829d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.598+0000 7f6d9f64d740 1 --2- 172.21.15.78:0/945086867 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564df0074650 0x564df00800a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.598+0000 7f6d9f64d740 1 --2- 172.21.15.78:0/945086867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df0073d30 0x564df0074110 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.598+0000 7f6d9f64d740 1 -- 172.21.15.78:0/945086867 >> 172.21.15.78:0/945086867 conn(0x564df0071b60 msgr2=0x564df0072d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:42.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.598+0000 7f6d9f64d740 1 -- 172.21.15.78:0/945086867 shutdown_connections 2024-09-11T00:15:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.598+0000 7f6d9f64d740 1 -- 172.21.15.78:0/945086867 wait complete. 2024-09-11T00:15:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.599+0000 7f6d9f64d740 1 -- start start 2024-09-11T00:15:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.599+0000 7f6d9f64d740 1 Processor -- start 2024-09-11T00:15:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.599+0000 7f6d9f64d740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564df0073d30 0x564df007d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.599+0000 7f6d9f64d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564df0074650 0x564df007db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.599+0000 7f6d9f64d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df00805e0 0x564df007e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.599+0000 7f6d9f64d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x564defe3c5f0 con 0x564df00805e0 2024-09-11T00:15:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.599+0000 7f6d9f64d740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564deff76010 con 0x564df0073d30 2024-09-11T00:15:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.599+0000 7f6d9f64d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564df0083290 con 0x564df0074650 2024-09-11T00:15:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.599+0000 7f6d9f64d740 10 client.0 _ll_register_callbacks cb 0x564deffd5340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:15:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.599+0000 7f6d977fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df00805e0 0x564df007e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.599+0000 7f6d977fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df00805e0 0x564df007e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56654/0 (socket says 172.21.15.78:56654) 2024-09-11T00:15:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.599+0000 7f6d977fe640 1 -- 172.21.15.78:0/232352548 learned_addr learned my addr 172.21.15.78:0/232352548 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.599+0000 7f6d967fc640 1 --2- 172.21.15.78:0/232352548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564df0074650 0x564df007db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.599+0000 7f6d96ffd640 1 --2- 172.21.15.78:0/232352548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564df0073d30 0x564df007d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.599+0000 7f6d977fe640 1 -- 172.21.15.78:0/232352548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564df0074650 msgr2=0x564df007db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.599+0000 7f6d977fe640 1 --2- 172.21.15.78:0/232352548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564df0074650 0x564df007db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.599+0000 7f6d977fe640 1 -- 172.21.15.78:0/232352548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564df0073d30 msgr2=0x564df007d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.599+0000 7f6d977fe640 1 --2- 172.21.15.78:0/232352548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564df0073d30 0x564df007d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.599+0000 7f6d977fe640 1 -- 172.21.15.78:0/232352548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564deffa3a00 con 0x564df00805e0 2024-09-11T00:15:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.599+0000 7f6d96ffd640 1 --2- 172.21.15.78:0/232352548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564df0073d30 0x564df007d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.599+0000 7f6d977fe640 1 --2- 172.21.15.78:0/232352548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df00805e0 0x564df007e0c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6d88006010 tx=0x7f6d88011670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d67f6fe737369f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:42.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.599+0000 7f6d7aff5640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:15:42.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.600+0000 7f6d7aff5640 1 -- 172.21.15.78:0/232352548 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d88028060 con 0x564df00805e0 2024-09-11T00:15:42.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.600+0000 7f6d7aff5640 1 -- 172.21.15.78:0/232352548 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f6d880119f0 con 0x564df00805e0 2024-09-11T00:15:42.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.600+0000 7f6d9f64d740 1 -- 172.21.15.78:0/232352548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d8800be10 con 0x564df00805e0 2024-09-11T00:15:42.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.600+0000 7f6d7aff5640 1 -- 172.21.15.78:0/232352548 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6d88015070 con 0x564df00805e0 2024-09-11T00:15:42.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.600+0000 7f6d9f64d740 10 client.15135 fetch_fsmap learned FSMap version 20 2024-09-11T00:15:42.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.600+0000 7f6d9f64d740 1 -- 172.21.15.78:0/232352548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564df008eee0 con 0x564df00805e0 2024-09-11T00:15:42.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.600+0000 7f6d7aff5640 1 -- 172.21.15.78:0/232352548 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d8800be10 con 0x564df00805e0 2024-09-11T00:15:42.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.600+0000 7f6d7aff5640 1 -- 172.21.15.78:0/232352548 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6d880049f0 con 0x564df00805e0 2024-09-11T00:15:42.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.600+0000 7f6d9f64d740 10 client.15135 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:15:42.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.600+0000 7f6d9f64d740 10 client.15135 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T00:15:42.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.600+0000 7f6d9f64d740 20 client.15135 populate_metadata read hostname 'smithi078' 2024-09-11T00:15:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.600+0000 7f6d9f64d740 1 --2- 172.21.15.78:0/232352548 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564df0091140 0x564df00925b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.600+0000 7f6d9f64d740 4 client.15135 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:15:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.600+0000 7f6d9f64d740 1 -- 172.21.15.78:0/232352548 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564deffedb60 con 0x564df0091140 2024-09-11T00:15:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.601+0000 7f6d96ffd640 1 --2- 172.21.15.78:0/232352548 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564df0091140 0x564df00925b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.601+0000 7f6d7aff5640 10 client.15135 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:15:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.601+0000 7f6d96ffd640 1 --2- 172.21.15.78:0/232352548 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564df0091140 0x564df00925b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a4d5057aa78ab42 server_cookie=37b12bafc2926d4d in_seq=0 out_seq=0 2024-09-11T00:15:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.602+0000 7f6d7aff5640 1 -- 172.21.15.78:0/232352548 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564deffedb60 con 0x564df0091140 2024-09-11T00:15:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.602+0000 7f6d7aff5640 10 client.15135 handle_command_reply: tid=0 2024-09-11T00:15:42.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.602+0000 7f6d9f64d740 1 client.15135 shutdown 2024-09-11T00:15:42.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.602+0000 7f6d9f64d740 1 -- 172.21.15.78:0/232352548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df00805e0 msgr2=0x564df007e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:42.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.602+0000 7f6d9f64d740 1 --2- 172.21.15.78:0/232352548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df00805e0 0x564df007e0c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6d88006010 tx=0x7f6d88011670 comp rx=0 tx=0).stop 2024-09-11T00:15:42.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.602+0000 7f6d9f64d740 1 -- 172.21.15.78:0/232352548 shutdown_connections 2024-09-11T00:15:42.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.602+0000 7f6d9f64d740 1 --2- 172.21.15.78:0/232352548 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564df0091140 0x564df00925b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.602+0000 7f6d9f64d740 1 --2- 172.21.15.78:0/232352548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df00805e0 0x564df007e0c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.602+0000 7f6d9f64d740 1 --2- 172.21.15.78:0/232352548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564df0074650 0x564df007db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.602+0000 7f6d9f64d740 1 --2- 172.21.15.78:0/232352548 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564df0073d30 0x564df007d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.602+0000 7f6d9f64d740 1 -- 172.21.15.78:0/232352548 >> 172.21.15.78:0/232352548 conn(0x564df0071b60 msgr2=0x564df00776d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.603+0000 7f6d7aff5640 0 client.15135 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:15:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.603+0000 7f6d9f64d740 1 -- 172.21.15.78:0/232352548 shutdown_connections 2024-09-11T00:15:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.603+0000 7f6d9f64d740 1 -- 172.21.15.78:0/232352548 wait complete. 2024-09-11T00:15:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.603+0000 7f6d9f64d740 20 client.15135 trim_cache size 0 max 16384 2024-09-11T00:15:42.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.621+0000 7f6d9f64d740 1 Processor -- start 2024-09-11T00:15:42.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.621+0000 7f6d9f64d740 1 -- start start 2024-09-11T00:15:42.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.621+0000 7f6d9f64d740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564df0073d30 0x564df006cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:42.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.621+0000 7f6d9f64d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df0074650 0x564df0077da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:42.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.621+0000 7f6d9f64d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564df00805e0 0x564df007bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:42.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.621+0000 7f6d9f64d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x564df00908f0 con 0x564df0074650 2024-09-11T00:15:42.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.621+0000 7f6d9f64d740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564df0090fc0 con 0x564df0073d30 2024-09-11T00:15:42.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.621+0000 7f6d9f64d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564df0091690 con 0x564df00805e0 2024-09-11T00:15:42.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.622+0000 7f6d967fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df0074650 0x564df0077da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:42.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.622+0000 7f6d967fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df0074650 0x564df0077da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56668/0 (socket says 172.21.15.78:56668) 2024-09-11T00:15:42.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.622+0000 7f6d967fc640 1 -- 172.21.15.78:0/201711048 learned_addr learned my addr 172.21.15.78:0/201711048 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:42.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.622+0000 7f6d96ffd640 1 --2- 172.21.15.78:0/201711048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564df0073d30 0x564df006cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:42.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.622+0000 7f6d977fe640 1 --2- 172.21.15.78:0/201711048 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564df00805e0 0x564df007bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:42.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.622+0000 7f6d967fc640 1 -- 172.21.15.78:0/201711048 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564df00805e0 msgr2=0x564df007bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:42.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.622+0000 7f6d967fc640 1 --2- 172.21.15.78:0/201711048 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564df00805e0 0x564df007bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.622+0000 7f6d967fc640 1 -- 172.21.15.78:0/201711048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564df0073d30 msgr2=0x564df006cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:42.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.622+0000 7f6d967fc640 1 --2- 172.21.15.78:0/201711048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564df0073d30 0x564df006cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.622+0000 7f6d967fc640 1 -- 172.21.15.78:0/201711048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564df00725e0 con 0x564df0074650 2024-09-11T00:15:42.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.622+0000 7f6d96ffd640 1 --2- 172.21.15.78:0/201711048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564df0073d30 0x564df006cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:42.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.622+0000 7f6d967fc640 1 --2- 172.21.15.78:0/201711048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df0074650 0x564df0077da0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0ad7f0 tx=0x7f6d8c00ab40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf715f5c5af1cf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:42.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.622+0000 7f6d7cff9640 1 -- 172.21.15.78:0/201711048 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c0a9990 con 0x564df0074650 2024-09-11T00:15:42.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.622+0000 7f6d7cff9640 1 -- 172.21.15.78:0/201711048 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d8c0ad600 con 0x564df0074650 2024-09-11T00:15:42.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.622+0000 7f6d7cff9640 1 -- 172.21.15.78:0/201711048 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c0a9260 con 0x564df0074650 2024-09-11T00:15:42.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.623+0000 7f6d9f64d740 1 -- 172.21.15.78:0/201711048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df0074650 msgr2=0x564df0077da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:42.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.623+0000 7f6d9f64d740 1 --2- 172.21.15.78:0/201711048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df0074650 0x564df0077da0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0ad7f0 tx=0x7f6d8c00ab40 comp rx=0 tx=0).stop 2024-09-11T00:15:42.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.623+0000 7f6d9f64d740 1 -- 172.21.15.78:0/201711048 shutdown_connections 2024-09-11T00:15:42.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.623+0000 7f6d9f64d740 1 --2- 172.21.15.78:0/201711048 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564df00805e0 0x564df007bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.623+0000 7f6d9f64d740 1 --2- 172.21.15.78:0/201711048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df0074650 0x564df0077da0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.623+0000 7f6d9f64d740 1 --2- 172.21.15.78:0/201711048 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564df0073d30 0x564df006cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.623+0000 7f6d9f64d740 1 -- 172.21.15.78:0/201711048 >> 172.21.15.78:0/201711048 conn(0x564df0071b60 msgr2=0x564df0078880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:42.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.623+0000 7f6d9f64d740 1 -- 172.21.15.78:0/201711048 shutdown_connections 2024-09-11T00:15:42.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.623+0000 7f6d9f64d740 1 -- 172.21.15.78:0/201711048 wait complete. 2024-09-11T00:15:42.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.623+0000 7f6d9f64d740 1 -- start start 2024-09-11T00:15:42.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.623+0000 7f6d9f64d740 1 Processor -- start 2024-09-11T00:15:42.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.624+0000 7f6d9f64d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df0073d30 0x564df0094a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:42.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.624+0000 7f6d9f64d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564df0074650 0x564df0094f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:42.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.624+0000 7f6d9f64d740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564df00805e0 0x564df0095490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:42.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.624+0000 7f6d9f64d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x564df0092430 con 0x564df0073d30 2024-09-11T00:15:42.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.624+0000 7f6d9f64d740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564df0091d60 con 0x564df00805e0 2024-09-11T00:15:42.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.624+0000 7f6d9f64d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564df0092b00 con 0x564df0074650 2024-09-11T00:15:42.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.624+0000 7f6d9f64d740 10 client.0 _ll_register_callbacks cb 0x7f6d90009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:15:42.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.624+0000 7f6d96ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df0073d30 0x564df0094a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:42.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.624+0000 7f6d96ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df0073d30 0x564df0094a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56680/0 (socket says 172.21.15.78:56680) 2024-09-11T00:15:42.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.624+0000 7f6d96ffd640 1 -- 172.21.15.78:0/1891301489 learned_addr learned my addr 172.21.15.78:0/1891301489 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:42.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.624+0000 7f6d96ffd640 1 -- 172.21.15.78:0/1891301489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564df0074650 msgr2=0x564df0094f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:42.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.624+0000 7f6d96ffd640 1 --2- 172.21.15.78:0/1891301489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564df0074650 0x564df0094f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.624+0000 7f6d96ffd640 1 -- 172.21.15.78:0/1891301489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564df00805e0 msgr2=0x564df0095490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:15:42.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.624+0000 7f6d96ffd640 1 --2- 172.21.15.78:0/1891301489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564df00805e0 0x564df0095490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.624+0000 7f6d96ffd640 1 -- 172.21.15.78:0/1891301489 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564df009a440 con 0x564df0073d30 2024-09-11T00:15:42.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.624+0000 7f6d96ffd640 1 --2- 172.21.15.78:0/1891301489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df0073d30 0x564df0094a10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6d9002a930 tx=0x7f6d90009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58227ea1a0c6e1d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:42.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.624+0000 7f6d7aff5640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:15:42.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.624+0000 7f6d7aff5640 1 -- 172.21.15.78:0/1891301489 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d90035040 con 0x564df0073d30 2024-09-11T00:15:42.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.624+0000 7f6d7aff5640 1 -- 172.21.15.78:0/1891301489 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f6d90004450 con 0x564df0073d30 2024-09-11T00:15:42.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.624+0000 7f6d9f64d740 1 -- 172.21.15.78:0/1891301489 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d8c0ad600 con 0x564df0073d30 2024-09-11T00:15:42.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.625+0000 7f6d7aff5640 1 -- 172.21.15.78:0/1891301489 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6d90005040 con 0x564df0073d30 2024-09-11T00:15:42.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.625+0000 7f6d9f64d740 10 client.15141 fetch_fsmap learned FSMap version 20 2024-09-11T00:15:42.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.625+0000 7f6d9f64d740 1 -- 172.21.15.78:0/1891301489 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564df00fe0a0 con 0x564df0073d30 2024-09-11T00:15:42.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.625+0000 7f6d7aff5640 1 -- 172.21.15.78:0/1891301489 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d8c0ad600 con 0x564df0073d30 2024-09-11T00:15:42.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.625+0000 7f6d7aff5640 1 -- 172.21.15.78:0/1891301489 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f6d900035f0 con 0x564df0073d30 2024-09-11T00:15:42.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.625+0000 7f6d9f64d740 10 client.15141 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:15:42.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.625+0000 7f6d9f64d740 10 client.15141 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T00:15:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.625+0000 7f6d9f64d740 20 client.15141 populate_metadata read hostname 'smithi078' 2024-09-11T00:15:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.625+0000 7f6d9f64d740 1 --2- 172.21.15.78:0/1891301489 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564df0102d70 0x564df0101a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.625+0000 7f6d9f64d740 4 client.15141 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T00:15:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.625+0000 7f6d9f64d740 1 -- 172.21.15.78:0/1891301489 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "status"}) -- 0x564deffe9610 con 0x564df0102d70 2024-09-11T00:15:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.625+0000 7f6d967fc640 1 --2- 172.21.15.78:0/1891301489 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564df0102d70 0x564df0101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.626+0000 7f6d967fc640 1 --2- 172.21.15.78:0/1891301489 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564df0102d70 0x564df0101a80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ae577199247cd4b server_cookie=c424c04881080824 in_seq=0 out_seq=0 2024-09-11T00:15:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.626+0000 7f6d7aff5640 10 client.15141 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:15:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.626+0000 7f6d7aff5640 1 -- 172.21.15.78:0/1891301489 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564deffe9610 con 0x564df0102d70 2024-09-11T00:15:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.626+0000 7f6d7aff5640 10 client.15141 handle_command_reply: tid=0 2024-09-11T00:15:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.626+0000 7f6d9f64d740 1 client.15141 shutdown 2024-09-11T00:15:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.626+0000 7f6d9f64d740 1 -- 172.21.15.78:0/1891301489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df0073d30 msgr2=0x564df0094a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.626+0000 7f6d9f64d740 1 --2- 172.21.15.78:0/1891301489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df0073d30 0x564df0094a10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6d9002a930 tx=0x7f6d90009260 comp rx=0 tx=0).stop 2024-09-11T00:15:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.626+0000 7f6d9f64d740 1 -- 172.21.15.78:0/1891301489 shutdown_connections 2024-09-11T00:15:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.626+0000 7f6d9f64d740 1 --2- 172.21.15.78:0/1891301489 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564df0102d70 0x564df0101a80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.626+0000 7f6d9f64d740 1 --2- 172.21.15.78:0/1891301489 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564df00805e0 0x564df0095490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.626+0000 7f6d9f64d740 1 --2- 172.21.15.78:0/1891301489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564df0074650 0x564df0094f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.626+0000 7f6d9f64d740 1 --2- 172.21.15.78:0/1891301489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564df0073d30 0x564df0094a10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.626+0000 7f6d7aff5640 0 client.15141 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:15:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.626+0000 7f6d9f64d740 1 -- 172.21.15.78:0/1891301489 >> 172.21.15.78:0/1891301489 conn(0x564df0071b60 msgr2=0x564df007ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.626+0000 7f6d9f64d740 1 -- 172.21.15.78:0/1891301489 shutdown_connections 2024-09-11T00:15:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.626+0000 7f6d9f64d740 1 -- 172.21.15.78:0/1891301489 wait complete. 2024-09-11T00:15:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.626+0000 7f6d9f64d740 20 client.15141 trim_cache size 0 max 16384 2024-09-11T00:15:42.643 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:15:42.644 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "85a53860-6fd1-11ef-bcea-c7b262605968", 2024-09-11T00:15:42.644 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2024-09-11T00:15:42.644 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 24593, 2024-09-11T00:15:42.644 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-11T00:15:42.644 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-11T00:15:42.644 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-11T00:15:42.644 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 75.696747857000005, 2024-09-11T00:15:42.644 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 20, 2024-09-11T00:15:42.644 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 77, 2024-09-11T00:15:42.644 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 75, 2024-09-11T00:15:42.644 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 86.425251536999994 2024-09-11T00:15:42.645 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:15:42.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.627+0000 7f6d9d278640 1 -- 172.21.15.78:0/456980821 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f6d800b53c0 msgr2=0x7f6d800b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:42.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.627+0000 7f6d9d278640 1 --2- 172.21.15.78:0/456980821 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f6d800b53c0 0x7f6d800b7880 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6d90031440 tx=0x7f6d90005a20 comp rx=0 tx=0).stop 2024-09-11T00:15:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.627+0000 7f6d9d278640 1 -- 172.21.15.78:0/456980821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d981076a0 msgr2=0x7f6d98198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.627+0000 7f6d9d278640 1 --2- 172.21.15.78:0/456980821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d981076a0 0x7f6d98198640 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c007d60 tx=0x7f6d8c00e420 comp rx=0 tx=0).stop 2024-09-11T00:15:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.627+0000 7f6d9d278640 1 -- 172.21.15.78:0/456980821 shutdown_connections 2024-09-11T00:15:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.627+0000 7f6d9d278640 1 --2- 172.21.15.78:0/456980821 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f6d800b53c0 0x7f6d800b7880 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.627+0000 7f6d9d278640 1 --2- 172.21.15.78:0/456980821 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6d98108020 0x7f6d9819d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.627+0000 7f6d9d278640 1 --2- 172.21.15.78:0/456980821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d981076a0 0x7f6d98198640 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.627+0000 7f6d9d278640 1 --2- 172.21.15.78:0/456980821 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6d98101c90 0x7f6d98198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.627+0000 7f6d9d278640 1 -- 172.21.15.78:0/456980821 >> 172.21.15.78:0/456980821 conn(0x7f6d980fd700 msgr2=0x7f6d980ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.627+0000 7f6d9d278640 1 -- 172.21.15.78:0/456980821 shutdown_connections 2024-09-11T00:15:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:42.627+0000 7f6d9d278640 1 -- 172.21.15.78:0/456980821 wait complete. 2024-09-11T00:15:42.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:42 smithi078 ceph-mon[30865]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:43.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:42 smithi138 ceph-mon[35019]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:43.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:42 smithi112 ceph-mon[35627]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:43.330 INFO:tasks.cephadm:Setup complete, yielding 2024-09-11T00:15:43.330 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T00:15:43.340 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi078.front.sepia.ceph.com 2024-09-11T00:15:43.341 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-11T00:15:43.585 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:44.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.093+0000 7f7b7278a640 1 -- 172.21.15.78:0/1825765747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b6c1087d0 msgr2=0x7f7b6c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:44.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.093+0000 7f7b7278a640 1 --2- 172.21.15.78:0/1825765747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b6c1087d0 0x7f7b6c108c10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7b60009900 tx=0x7f7b6002a410 comp rx=0 tx=0).stop 2024-09-11T00:15:44.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.093+0000 7f7b7278a640 1 -- 172.21.15.78:0/1825765747 shutdown_connections 2024-09-11T00:15:44.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.093+0000 7f7b7278a640 1 --2- 172.21.15.78:0/1825765747 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b6c109150 0x7f7b6c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:44.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.093+0000 7f7b7278a640 1 --2- 172.21.15.78:0/1825765747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b6c1087d0 0x7f7b6c108c10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:44.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.093+0000 7f7b7278a640 1 --2- 172.21.15.78:0/1825765747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6c102dc0 0x7f7b6c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:44.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.093+0000 7f7b7278a640 1 -- 172.21.15.78:0/1825765747 >> 172.21.15.78:0/1825765747 conn(0x7f7b6c0fe830 msgr2=0x7f7b6c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:44.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.093+0000 7f7b7278a640 1 -- 172.21.15.78:0/1825765747 shutdown_connections 2024-09-11T00:15:44.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.093+0000 7f7b7278a640 1 -- 172.21.15.78:0/1825765747 wait complete. 2024-09-11T00:15:44.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.094+0000 7f7b7278a640 1 Processor -- start 2024-09-11T00:15:44.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.094+0000 7f7b7278a640 1 -- start start 2024-09-11T00:15:44.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.094+0000 7f7b7278a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6c102dc0 0x7f7b6c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:44.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.094+0000 7f7b7278a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b6c1087d0 0x7f7b6c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:44.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.094+0000 7f7b7278a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b6c109150 0x7f7b6c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:44.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.094+0000 7f7b7278a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6c112e10 con 0x7f7b6c109150 2024-09-11T00:15:44.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.094+0000 7f7b7278a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6c112c90 con 0x7f7b6c102dc0 2024-09-11T00:15:44.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.094+0000 7f7b7278a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6c112f90 con 0x7f7b6c1087d0 2024-09-11T00:15:44.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.094+0000 7f7b70d27640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b6c109150 0x7f7b6c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:44.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.094+0000 7f7b70d27640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b6c109150 0x7f7b6c075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56698/0 (socket says 172.21.15.78:56698) 2024-09-11T00:15:44.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.094+0000 7f7b70d27640 1 -- 172.21.15.78:0/4157777484 learned_addr learned my addr 172.21.15.78:0/4157777484 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:44.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.095+0000 7f7b6b7fe640 1 --2- 172.21.15.78:0/4157777484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b6c1087d0 0x7f7b6c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:44.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.095+0000 7f7b6bfff640 1 --2- 172.21.15.78:0/4157777484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6c102dc0 0x7f7b6c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:44.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.095+0000 7f7b70d27640 1 -- 172.21.15.78:0/4157777484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b6c1087d0 msgr2=0x7f7b6c0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:44.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.095+0000 7f7b70d27640 1 --2- 172.21.15.78:0/4157777484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b6c1087d0 0x7f7b6c0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:44.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.095+0000 7f7b70d27640 1 -- 172.21.15.78:0/4157777484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6c102dc0 msgr2=0x7f7b6c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:44.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.095+0000 7f7b70d27640 1 --2- 172.21.15.78:0/4157777484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6c102dc0 0x7f7b6c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:44.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.095+0000 7f7b70d27640 1 -- 172.21.15.78:0/4157777484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b6c1a7700 con 0x7f7b6c109150 2024-09-11T00:15:44.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.095+0000 7f7b70d27640 1 --2- 172.21.15.78:0/4157777484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b6c109150 0x7f7b6c075f20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7b64009fd0 tx=0x7f7b6400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:44.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.095+0000 7f7b697fa640 1 -- 172.21.15.78:0/4157777484 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b64017070 con 0x7f7b6c109150 2024-09-11T00:15:44.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.095+0000 7f7b7278a640 1 -- 172.21.15.78:0/4157777484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b6c1a79f0 con 0x7f7b6c109150 2024-09-11T00:15:44.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.095+0000 7f7b697fa640 1 -- 172.21.15.78:0/4157777484 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b64003e20 con 0x7f7b6c109150 2024-09-11T00:15:44.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.095+0000 7f7b697fa640 1 -- 172.21.15.78:0/4157777484 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b64010460 con 0x7f7b6c109150 2024-09-11T00:15:44.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.095+0000 7f7b7278a640 1 -- 172.21.15.78:0/4157777484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b6c1a7f00 con 0x7f7b6c109150 2024-09-11T00:15:44.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.096+0000 7f7b7278a640 1 -- 172.21.15.78:0/4157777484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b6c1031a0 con 0x7f7b6c109150 2024-09-11T00:15:44.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.098+0000 7f7b697fa640 1 -- 172.21.15.78:0/4157777484 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f7b64003970 con 0x7f7b6c109150 2024-09-11T00:15:44.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.099+0000 7f7b697fa640 1 --2- 172.21.15.78:0/4157777484 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7b540b53c0 0x7f7b540b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:44.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.099+0000 7f7b6bfff640 1 --2- 172.21.15.78:0/4157777484 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7b540b53c0 0x7f7b540b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:44.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.099+0000 7f7b697fa640 1 -- 172.21.15.78:0/4157777484 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f7b640e5cf0 con 0x7f7b6c109150 2024-09-11T00:15:44.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.099+0000 7f7b6bfff640 1 --2- 172.21.15.78:0/4157777484 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7b540b53c0 0x7f7b540b7880 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c009890 tx=0x7f7b5c008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:44.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.102+0000 7f7b697fa640 1 -- 172.21.15.78:0/4157777484 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7b640ac910 con 0x7f7b6c109150 2024-09-11T00:15:44.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.291+0000 7f7b7278a640 1 -- 172.21.15.78:0/4157777484 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f7b6c063590 con 0x7f7b540b53c0 2024-09-11T00:15:44.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.292+0000 7f7b697fa640 1 -- 172.21.15.78:0/4157777484 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f7b6c063590 con 0x7f7b540b53c0 2024-09-11T00:15:44.294 INFO:teuthology.orchestra.run.smithi078.stdout:Backend: cephadm 2024-09-11T00:15:44.294 INFO:teuthology.orchestra.run.smithi078.stdout:Available: Yes 2024-09-11T00:15:44.294 INFO:teuthology.orchestra.run.smithi078.stdout:Paused: No 2024-09-11T00:15:44.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.294+0000 7f7b7278a640 1 -- 172.21.15.78:0/4157777484 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7b540b53c0 msgr2=0x7f7b540b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:44.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.294+0000 7f7b7278a640 1 --2- 172.21.15.78:0/4157777484 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7b540b53c0 0x7f7b540b7880 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c009890 tx=0x7f7b5c008040 comp rx=0 tx=0).stop 2024-09-11T00:15:44.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.294+0000 7f7b7278a640 1 -- 172.21.15.78:0/4157777484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b6c109150 msgr2=0x7f7b6c075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:44.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.294+0000 7f7b7278a640 1 --2- 172.21.15.78:0/4157777484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b6c109150 0x7f7b6c075f20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7b64009fd0 tx=0x7f7b6400b260 comp rx=0 tx=0).stop 2024-09-11T00:15:44.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.295+0000 7f7b7278a640 1 -- 172.21.15.78:0/4157777484 shutdown_connections 2024-09-11T00:15:44.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.295+0000 7f7b7278a640 1 --2- 172.21.15.78:0/4157777484 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7b540b53c0 0x7f7b540b7880 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:44.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.295+0000 7f7b7278a640 1 --2- 172.21.15.78:0/4157777484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b6c109150 0x7f7b6c075f20 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:44.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.295+0000 7f7b7278a640 1 --2- 172.21.15.78:0/4157777484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b6c1087d0 0x7f7b6c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:44.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.295+0000 7f7b7278a640 1 --2- 172.21.15.78:0/4157777484 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7b6c102dc0 0x7f7b6c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:44.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.295+0000 7f7b7278a640 1 -- 172.21.15.78:0/4157777484 >> 172.21.15.78:0/4157777484 conn(0x7f7b6c0fe830 msgr2=0x7f7b6c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:44.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.295+0000 7f7b7278a640 1 -- 172.21.15.78:0/4157777484 shutdown_connections 2024-09-11T00:15:44.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:44.295+0000 7f7b7278a640 1 -- 172.21.15.78:0/4157777484 wait complete. 2024-09-11T00:15:44.969 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:44 smithi078 ceph-mon[30865]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:44.971 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-11T00:15:45.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:44 smithi138 ceph-mon[35019]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:45.213 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:45.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:44 smithi112 ceph-mon[35627]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:45.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.709+0000 7ff1e6388640 1 -- 172.21.15.78:0/2790637398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1e0108060 msgr2=0x7ff1e010e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:45.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.709+0000 7ff1e6388640 1 --2- 172.21.15.78:0/2790637398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1e0108060 0x7ff1e010e860 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8009ca0 tx=0x7ff1d802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:45.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.709+0000 7ff1e6388640 1 -- 172.21.15.78:0/2790637398 shutdown_connections 2024-09-11T00:15:45.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.709+0000 7ff1e6388640 1 --2- 172.21.15.78:0/2790637398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1e0108060 0x7ff1e010e860 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:45.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.710+0000 7ff1e6388640 1 --2- 172.21.15.78:0/2790637398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1e01076e0 0x7ff1e0107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:45.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.710+0000 7ff1e6388640 1 --2- 172.21.15.78:0/2790637398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1e0101cd0 0x7ff1e01020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:45.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.710+0000 7ff1e6388640 1 -- 172.21.15.78:0/2790637398 >> 172.21.15.78:0/2790637398 conn(0x7ff1e00fd700 msgr2=0x7ff1e00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:45.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.710+0000 7ff1e6388640 1 -- 172.21.15.78:0/2790637398 shutdown_connections 2024-09-11T00:15:45.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.710+0000 7ff1e6388640 1 -- 172.21.15.78:0/2790637398 wait complete. 2024-09-11T00:15:45.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.710+0000 7ff1e6388640 1 Processor -- start 2024-09-11T00:15:45.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.710+0000 7ff1e6388640 1 -- start start 2024-09-11T00:15:45.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.710+0000 7ff1e6388640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1e0101cd0 0x7ff1e01993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:45.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.710+0000 7ff1e6388640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1e01076e0 0x7ff1e0199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:45.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.710+0000 7ff1e6388640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1e0108060 0x7ff1e019eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:45.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.710+0000 7ff1e6388640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e0111d20 con 0x7ff1e01076e0 2024-09-11T00:15:45.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.710+0000 7ff1e6388640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e0111ba0 con 0x7ff1e0101cd0 2024-09-11T00:15:45.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.710+0000 7ff1e6388640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e0111ea0 con 0x7ff1e0108060 2024-09-11T00:15:45.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.710+0000 7ff1d7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1e01076e0 0x7ff1e0199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:45.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.710+0000 7ff1d7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1e01076e0 0x7ff1e0199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47672/0 (socket says 172.21.15.78:47672) 2024-09-11T00:15:45.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.710+0000 7ff1d7fff640 1 -- 172.21.15.78:0/4104312292 learned_addr learned my addr 172.21.15.78:0/4104312292 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:45.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.711+0000 7ff1dffff640 1 --2- 172.21.15.78:0/4104312292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1e0101cd0 0x7ff1e01993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:45.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.711+0000 7ff1e4925640 1 --2- 172.21.15.78:0/4104312292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1e0108060 0x7ff1e019eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:45.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.711+0000 7ff1d7fff640 1 -- 172.21.15.78:0/4104312292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1e0108060 msgr2=0x7ff1e019eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:45.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.711+0000 7ff1d7fff640 1 --2- 172.21.15.78:0/4104312292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1e0108060 0x7ff1e019eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:45.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.711+0000 7ff1d7fff640 1 -- 172.21.15.78:0/4104312292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1e0101cd0 msgr2=0x7ff1e01993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:45.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.711+0000 7ff1d7fff640 1 --2- 172.21.15.78:0/4104312292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1e0101cd0 0x7ff1e01993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:45.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.711+0000 7ff1d7fff640 1 -- 172.21.15.78:0/4104312292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e019f470 con 0x7ff1e01076e0 2024-09-11T00:15:45.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.711+0000 7ff1d7fff640 1 --2- 172.21.15.78:0/4104312292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1e01076e0 0x7ff1e0199900 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800d770 tx=0x7ff1c800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:45.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.711+0000 7ff1ddffb640 1 -- 172.21.15.78:0/4104312292 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8017070 con 0x7ff1e01076e0 2024-09-11T00:15:45.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.711+0000 7ff1e6388640 1 -- 172.21.15.78:0/4104312292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e019f760 con 0x7ff1e01076e0 2024-09-11T00:15:45.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.711+0000 7ff1ddffb640 1 -- 172.21.15.78:0/4104312292 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1c80054d0 con 0x7ff1e01076e0 2024-09-11T00:15:45.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.711+0000 7ff1ddffb640 1 -- 172.21.15.78:0/4104312292 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8004c30 con 0x7ff1e01076e0 2024-09-11T00:15:45.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.711+0000 7ff1e6388640 1 -- 172.21.15.78:0/4104312292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e01a5e20 con 0x7ff1e01076e0 2024-09-11T00:15:45.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.712+0000 7ff1e6388640 1 -- 172.21.15.78:0/4104312292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1e0102f80 con 0x7ff1e01076e0 2024-09-11T00:15:45.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.714+0000 7ff1ddffb640 1 -- 172.21.15.78:0/4104312292 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7ff1c8004dd0 con 0x7ff1e01076e0 2024-09-11T00:15:45.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.714+0000 7ff1ddffb640 1 --2- 172.21.15.78:0/4104312292 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff1cc0b53c0 0x7ff1cc0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:45.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.714+0000 7ff1dffff640 1 --2- 172.21.15.78:0/4104312292 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff1cc0b53c0 0x7ff1cc0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:45.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.714+0000 7ff1ddffb640 1 -- 172.21.15.78:0/4104312292 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ff1c80e5d80 con 0x7ff1e01076e0 2024-09-11T00:15:45.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.715+0000 7ff1dffff640 1 --2- 172.21.15.78:0/4104312292 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff1cc0b53c0 0x7ff1cc0b7880 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000bbe0 tx=0x7ff1d000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:45.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.717+0000 7ff1ddffb640 1 -- 172.21.15.78:0/4104312292 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff1c80aca00 con 0x7ff1e01076e0 2024-09-11T00:15:45.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.902+0000 7ff1e6388640 1 -- 172.21.15.78:0/4104312292 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff1e0063590 con 0x7ff1cc0b53c0 2024-09-11T00:15:45.904 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:45 smithi078 ceph-mon[30865]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:45.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.915+0000 7ff1ddffb640 1 -- 172.21.15.78:0/4104312292 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7ff1e0063590 con 0x7ff1cc0b53c0 2024-09-11T00:15:45.917 INFO:teuthology.orchestra.run.smithi078.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T00:15:45.917 INFO:teuthology.orchestra.run.smithi078.stdout:mds.a smithi078 running (92s) 15s ago 92s 16.7M - 19.3.0-4854-g8f219c47 589dd18248e4 648cf2d995e6 2024-09-11T00:15:45.918 INFO:teuthology.orchestra.run.smithi078.stdout:mds.b smithi112 running (90s) 21s ago 89s 25.7M - 19.3.0-4854-g8f219c47 589dd18248e4 f257b690f013 2024-09-11T00:15:45.918 INFO:teuthology.orchestra.run.smithi078.stdout:mds.c smithi138 running (104s) 21s ago 103s 13.9M - 19.3.0-4854-g8f219c47 589dd18248e4 5ca828deae51 2024-09-11T00:15:45.918 INFO:teuthology.orchestra.run.smithi078.stdout:mds.d smithi078 running (112s) 15s ago 111s 16.1M - 19.3.0-4854-g8f219c47 589dd18248e4 f7b431cb7153 2024-09-11T00:15:45.918 INFO:teuthology.orchestra.run.smithi078.stdout:mds.e smithi112 running (109s) 21s ago 108s 14.7M - 19.3.0-4854-g8f219c47 589dd18248e4 1413e0deebb9 2024-09-11T00:15:45.918 INFO:teuthology.orchestra.run.smithi078.stdout:mds.f smithi138 running (106s) 21s ago 106s 14.7M - 19.3.0-4854-g8f219c47 589dd18248e4 fcac26eb7958 2024-09-11T00:15:45.919 INFO:teuthology.orchestra.run.smithi078.stdout:mds.g smithi078 running (96s) 15s ago 95s 14.6M - 19.3.0-4854-g8f219c47 589dd18248e4 fe509132061e 2024-09-11T00:15:45.919 INFO:teuthology.orchestra.run.smithi078.stdout:mds.h smithi112 running (101s) 21s ago 101s 15.8M - 19.3.0-4854-g8f219c47 589dd18248e4 24fe572bdc9f 2024-09-11T00:15:45.919 INFO:teuthology.orchestra.run.smithi078.stdout:mds.i smithi138 running (98s) 21s ago 98s 17.6M - 19.3.0-4854-g8f219c47 589dd18248e4 60be5793b80f 2024-09-11T00:15:45.919 INFO:teuthology.orchestra.run.smithi078.stdout:mds.j smithi078 running (115s) 15s ago 115s 14.8M - 19.3.0-4854-g8f219c47 589dd18248e4 080545d92df4 2024-09-11T00:15:45.919 INFO:teuthology.orchestra.run.smithi078.stdout:mds.k smithi112 running (118s) 21s ago 118s 14.8M - 19.3.0-4854-g8f219c47 589dd18248e4 325005625e37 2024-09-11T00:15:45.919 INFO:teuthology.orchestra.run.smithi078.stdout:mds.l smithi138 running (2m) 21s ago 2m 16.6M - 19.3.0-4854-g8f219c47 589dd18248e4 7ed2a552280d 2024-09-11T00:15:45.920 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.x smithi078 *:9283,8765 running (9m) 15s ago 9m 516M - 19.3.0-4854-g8f219c47 589dd18248e4 01d2b57432f8 2024-09-11T00:15:45.920 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.y smithi112 *:8443,8765 running (7m) 21s ago 7m 456M - 19.3.0-4854-g8f219c47 589dd18248e4 aaa7b99388fe 2024-09-11T00:15:45.920 INFO:teuthology.orchestra.run.smithi078.stdout:mgr.z smithi138 *:8443,8765 running (7m) 21s ago 7m 456M - 19.3.0-4854-g8f219c47 589dd18248e4 b8d535b4a3ee 2024-09-11T00:15:45.920 INFO:teuthology.orchestra.run.smithi078.stdout:mon.a smithi078 running (9m) 15s ago 9m 52.0M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 bbe0280c637f 2024-09-11T00:15:45.920 INFO:teuthology.orchestra.run.smithi078.stdout:mon.b smithi112 running (8m) 21s ago 8m 42.6M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 d7e4d59fe83a 2024-09-11T00:15:45.921 INFO:teuthology.orchestra.run.smithi078.stdout:mon.c smithi138 running (8m) 21s ago 8m 42.0M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 6e9b400a21b2 2024-09-11T00:15:45.921 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 smithi078 running (6m) 15s ago 6m 54.9M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 5859532c7167 2024-09-11T00:15:45.921 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 smithi112 running (6m) 21s ago 6m 56.7M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 e587b8fd3afb 2024-09-11T00:15:45.921 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 smithi138 running (6m) 21s ago 6m 58.4M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 30e043e711bc 2024-09-11T00:15:45.921 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 smithi078 running (5m) 15s ago 5m 46.3M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 db42163dd160 2024-09-11T00:15:45.922 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 smithi112 running (5m) 21s ago 5m 41.8M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 bf1fbf1d57dd 2024-09-11T00:15:45.922 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 smithi138 running (4m) 21s ago 4m 44.0M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 3097ff33fa99 2024-09-11T00:15:45.922 INFO:teuthology.orchestra.run.smithi078.stdout:osd.6 smithi078 running (4m) 15s ago 4m 51.7M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 0843a1218180 2024-09-11T00:15:45.922 INFO:teuthology.orchestra.run.smithi078.stdout:osd.7 smithi112 running (4m) 21s ago 3m 53.9M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 68d9f9f86f00 2024-09-11T00:15:45.922 INFO:teuthology.orchestra.run.smithi078.stdout:osd.8 smithi138 running (3m) 21s ago 3m 45.4M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 b902ca867b83 2024-09-11T00:15:45.922 INFO:teuthology.orchestra.run.smithi078.stdout:osd.9 smithi078 running (3m) 15s ago 3m 40.4M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 8779d70562c1 2024-09-11T00:15:45.922 INFO:teuthology.orchestra.run.smithi078.stdout:osd.10 smithi112 running (2m) 21s ago 2m 52.8M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 8165983d2150 2024-09-11T00:15:45.923 INFO:teuthology.orchestra.run.smithi078.stdout:osd.11 smithi138 running (2m) 21s ago 2m 42.7M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 df2c0cb60a3a 2024-09-11T00:15:45.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.917+0000 7ff1e6388640 1 -- 172.21.15.78:0/4104312292 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff1cc0b53c0 msgr2=0x7ff1cc0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:45.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.917+0000 7ff1e6388640 1 --2- 172.21.15.78:0/4104312292 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff1cc0b53c0 0x7ff1cc0b7880 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000bbe0 tx=0x7ff1d000b390 comp rx=0 tx=0).stop 2024-09-11T00:15:45.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.917+0000 7ff1e6388640 1 -- 172.21.15.78:0/4104312292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1e01076e0 msgr2=0x7ff1e0199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:45.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.917+0000 7ff1e6388640 1 --2- 172.21.15.78:0/4104312292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1e01076e0 0x7ff1e0199900 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800d770 tx=0x7ff1c800dc30 comp rx=0 tx=0).stop 2024-09-11T00:15:45.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.917+0000 7ff1e6388640 1 -- 172.21.15.78:0/4104312292 shutdown_connections 2024-09-11T00:15:45.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.917+0000 7ff1e6388640 1 --2- 172.21.15.78:0/4104312292 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff1cc0b53c0 0x7ff1cc0b7880 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:45.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.917+0000 7ff1e6388640 1 --2- 172.21.15.78:0/4104312292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1e0108060 0x7ff1e019eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:45.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.917+0000 7ff1e6388640 1 --2- 172.21.15.78:0/4104312292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1e01076e0 0x7ff1e0199900 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:45.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.917+0000 7ff1e6388640 1 --2- 172.21.15.78:0/4104312292 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1e0101cd0 0x7ff1e01993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:45.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.917+0000 7ff1e6388640 1 -- 172.21.15.78:0/4104312292 >> 172.21.15.78:0/4104312292 conn(0x7ff1e00fd700 msgr2=0x7ff1e006b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:45.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.917+0000 7ff1e6388640 1 -- 172.21.15.78:0/4104312292 shutdown_connections 2024-09-11T00:15:45.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:45.917+0000 7ff1e6388640 1 -- 172.21.15.78:0/4104312292 wait complete. 2024-09-11T00:15:46.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:45 smithi138 ceph-mon[35019]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:46.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:45 smithi112 ceph-mon[35627]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:46.579 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-11T00:15:46.823 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:46.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:46 smithi078 ceph-mon[30865]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:46 smithi138 ceph-mon[35019]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:47.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:46 smithi112 ceph-mon[35627]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:47.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.302+0000 7ffa38300640 1 -- 172.21.15.78:0/1171395098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa30108060 msgr2=0x7ffa3010e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:47.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.302+0000 7ffa38300640 1 --2- 172.21.15.78:0/1171395098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa30108060 0x7ffa3010e860 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009ca0 tx=0x7ffa2802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:47.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.302+0000 7ffa38300640 1 -- 172.21.15.78:0/1171395098 shutdown_connections 2024-09-11T00:15:47.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.302+0000 7ffa38300640 1 --2- 172.21.15.78:0/1171395098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa30108060 0x7ffa3010e860 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:47.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.302+0000 7ffa38300640 1 --2- 172.21.15.78:0/1171395098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa301076e0 0x7ffa30107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:47.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.302+0000 7ffa38300640 1 --2- 172.21.15.78:0/1171395098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa30101cd0 0x7ffa301020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:47.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.302+0000 7ffa38300640 1 -- 172.21.15.78:0/1171395098 >> 172.21.15.78:0/1171395098 conn(0x7ffa300fd700 msgr2=0x7ffa300ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:47.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.302+0000 7ffa38300640 1 -- 172.21.15.78:0/1171395098 shutdown_connections 2024-09-11T00:15:47.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.302+0000 7ffa38300640 1 -- 172.21.15.78:0/1171395098 wait complete. 2024-09-11T00:15:47.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.303+0000 7ffa38300640 1 Processor -- start 2024-09-11T00:15:47.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.303+0000 7ffa38300640 1 -- start start 2024-09-11T00:15:47.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.303+0000 7ffa38300640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa30101cd0 0x7ffa300fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:47.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.303+0000 7ffa38300640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa301076e0 0x7ffa300fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:47.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.303+0000 7ffa38300640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa30108060 0x7ffa300fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:47.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.303+0000 7ffa38300640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ffa30111ce0 con 0x7ffa30101cd0 2024-09-11T00:15:47.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.303+0000 7ffa38300640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffa30111b60 con 0x7ffa30108060 2024-09-11T00:15:47.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.303+0000 7ffa38300640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ffa30111e60 con 0x7ffa301076e0 2024-09-11T00:15:47.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.303+0000 7ffa3609c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa30101cd0 0x7ffa300fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:47.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.303+0000 7ffa3609c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa30101cd0 0x7ffa300fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47686/0 (socket says 172.21.15.78:47686) 2024-09-11T00:15:47.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.303+0000 7ffa3609c640 1 -- 172.21.15.78:0/1762817592 learned_addr learned my addr 172.21.15.78:0/1762817592 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:47.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.303+0000 7ffa3589b640 1 --2- 172.21.15.78:0/1762817592 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa301076e0 0x7ffa300fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:47.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.303+0000 7ffa3689d640 1 --2- 172.21.15.78:0/1762817592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa30108060 0x7ffa300fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:47.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.303+0000 7ffa3609c640 1 -- 172.21.15.78:0/1762817592 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa301076e0 msgr2=0x7ffa300fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.303+0000 7ffa3609c640 1 --2- 172.21.15.78:0/1762817592 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa301076e0 0x7ffa300fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.303+0000 7ffa3609c640 1 -- 172.21.15.78:0/1762817592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa30108060 msgr2=0x7ffa300fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.303+0000 7ffa3609c640 1 --2- 172.21.15.78:0/1762817592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa30108060 0x7ffa300fe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.303+0000 7ffa3609c640 1 -- 172.21.15.78:0/1762817592 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa301a7680 con 0x7ffa30101cd0 2024-09-11T00:15:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.303+0000 7ffa3609c640 1 --2- 172.21.15.78:0/1762817592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa30101cd0 0x7ffa300fdc00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c00c920 tx=0x7ffa2c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.303+0000 7ffa277fe640 1 -- 172.21.15.78:0/1762817592 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c007c70 con 0x7ffa30101cd0 2024-09-11T00:15:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.304+0000 7ffa38300640 1 -- 172.21.15.78:0/1762817592 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa301a7970 con 0x7ffa30101cd0 2024-09-11T00:15:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.304+0000 7ffa277fe640 1 -- 172.21.15.78:0/1762817592 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa2c007e10 con 0x7ffa30101cd0 2024-09-11T00:15:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.304+0000 7ffa277fe640 1 -- 172.21.15.78:0/1762817592 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c018820 con 0x7ffa30101cd0 2024-09-11T00:15:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.304+0000 7ffa38300640 1 -- 172.21.15.78:0/1762817592 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa301a7f00 con 0x7ffa30101cd0 2024-09-11T00:15:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.304+0000 7ffa38300640 1 -- 172.21.15.78:0/1762817592 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa301020b0 con 0x7ffa30101cd0 2024-09-11T00:15:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.306+0000 7ffa277fe640 1 -- 172.21.15.78:0/1762817592 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7ffa2c00f450 con 0x7ffa30101cd0 2024-09-11T00:15:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.307+0000 7ffa277fe640 1 --2- 172.21.15.78:0/1762817592 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ffa1c0b53c0 0x7ffa1c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.307+0000 7ffa3589b640 1 --2- 172.21.15.78:0/1762817592 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ffa1c0b53c0 0x7ffa1c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:47.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.307+0000 7ffa277fe640 1 -- 172.21.15.78:0/1762817592 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ffa2c0e6390 con 0x7ffa30101cd0 2024-09-11T00:15:47.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.308+0000 7ffa3589b640 1 --2- 172.21.15.78:0/1762817592 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ffa1c0b53c0 0x7ffa1c0b7880 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffa20005d80 tx=0x7ffa20005c90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:47.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.310+0000 7ffa277fe640 1 -- 172.21.15.78:0/1762817592 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ffa2c014030 con 0x7ffa30101cd0 2024-09-11T00:15:47.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.494+0000 7ffa38300640 1 -- 172.21.15.78:0/1762817592 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7ffa30063590 con 0x7ffa1c0b53c0 2024-09-11T00:15:47.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.500+0000 7ffa277fe640 1 -- 172.21.15.78:0/1762817592 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7ffa30063590 con 0x7ffa1c0b53c0 2024-09-11T00:15:47.502 INFO:teuthology.orchestra.run.smithi078.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-11T00:15:47.502 INFO:teuthology.orchestra.run.smithi078.stdout:mds.all 12/12 23s ago 2m smithi078=a;smithi078=d;smithi078=g;smithi078=j;smithi112=b;smithi112=e;smithi112=h;smithi112=k;smithi138=c;smithi138=f;smithi138=i;smithi138=l;count:12 2024-09-11T00:15:47.502 INFO:teuthology.orchestra.run.smithi078.stdout:mgr 3/3 23s ago 7m smithi078=x;smithi112=y;smithi138=z;count:3 2024-09-11T00:15:47.502 INFO:teuthology.orchestra.run.smithi078.stdout:mon 3/3 23s ago 8m smithi078:172.21.15.78=a;smithi112:172.21.15.112=b;smithi138:172.21.15.138=c;count:3 2024-09-11T00:15:47.502 INFO:teuthology.orchestra.run.smithi078.stdout:osd 12 23s ago - 2024-09-11T00:15:47.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.502+0000 7ffa38300640 1 -- 172.21.15.78:0/1762817592 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ffa1c0b53c0 msgr2=0x7ffa1c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:47.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.502+0000 7ffa38300640 1 --2- 172.21.15.78:0/1762817592 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ffa1c0b53c0 0x7ffa1c0b7880 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffa20005d80 tx=0x7ffa20005c90 comp rx=0 tx=0).stop 2024-09-11T00:15:47.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.502+0000 7ffa38300640 1 -- 172.21.15.78:0/1762817592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa30101cd0 msgr2=0x7ffa300fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:47.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.502+0000 7ffa38300640 1 --2- 172.21.15.78:0/1762817592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa30101cd0 0x7ffa300fdc00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c00c920 tx=0x7ffa2c00cde0 comp rx=0 tx=0).stop 2024-09-11T00:15:47.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.502+0000 7ffa38300640 1 -- 172.21.15.78:0/1762817592 shutdown_connections 2024-09-11T00:15:47.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.502+0000 7ffa38300640 1 --2- 172.21.15.78:0/1762817592 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ffa1c0b53c0 0x7ffa1c0b7880 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:47.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.502+0000 7ffa38300640 1 --2- 172.21.15.78:0/1762817592 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa30108060 0x7ffa300fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:47.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.502+0000 7ffa38300640 1 --2- 172.21.15.78:0/1762817592 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffa301076e0 0x7ffa300fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:47.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.502+0000 7ffa38300640 1 --2- 172.21.15.78:0/1762817592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa30101cd0 0x7ffa300fdc00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:47.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.502+0000 7ffa38300640 1 -- 172.21.15.78:0/1762817592 >> 172.21.15.78:0/1762817592 conn(0x7ffa300fd700 msgr2=0x7ffa3006b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:47.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.503+0000 7ffa38300640 1 -- 172.21.15.78:0/1762817592 shutdown_connections 2024-09-11T00:15:47.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:47.503+0000 7ffa38300640 1 -- 172.21.15.78:0/1762817592 wait complete. 2024-09-11T00:15:48.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:47 smithi138 ceph-mon[35019]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:48.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:47 smithi078 ceph-mon[30865]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:48.214 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-11T00:15:48.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:47 smithi112 ceph-mon[35627]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:48.459 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:48.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:48 smithi078 ceph-mon[30865]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:48.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:48 smithi078 ceph-mon[30865]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:48.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.935+0000 7f5540ff9640 1 -- 172.21.15.78:0/1506445265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f553c1076a0 msgr2=0x7f553c107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:48.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.935+0000 7f5540ff9640 1 --2- 172.21.15.78:0/1506445265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f553c1076a0 0x7f553c107ae0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5524009900 tx=0x7f552402a410 comp rx=0 tx=0).stop 2024-09-11T00:15:48.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.936+0000 7f5540ff9640 1 -- 172.21.15.78:0/1506445265 shutdown_connections 2024-09-11T00:15:48.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.936+0000 7f5540ff9640 1 --2- 172.21.15.78:0/1506445265 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f553c108020 0x7f553c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:48.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.936+0000 7f5540ff9640 1 --2- 172.21.15.78:0/1506445265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f553c1076a0 0x7f553c107ae0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:48.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.936+0000 7f5540ff9640 1 --2- 172.21.15.78:0/1506445265 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f553c101c90 0x7f553c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:48.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.936+0000 7f5540ff9640 1 -- 172.21.15.78:0/1506445265 >> 172.21.15.78:0/1506445265 conn(0x7f553c0fd700 msgr2=0x7f553c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:48.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.936+0000 7f5540ff9640 1 -- 172.21.15.78:0/1506445265 shutdown_connections 2024-09-11T00:15:48.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.936+0000 7f5540ff9640 1 -- 172.21.15.78:0/1506445265 wait complete. 2024-09-11T00:15:48.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.936+0000 7f5540ff9640 1 Processor -- start 2024-09-11T00:15:48.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.936+0000 7f5540ff9640 1 -- start start 2024-09-11T00:15:48.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.937+0000 7f5540ff9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f553c101c90 0x7f553c197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:48.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.937+0000 7f5540ff9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f553c1076a0 0x7f553c198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:48.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.937+0000 7f5540ff9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f553c108020 0x7f553c198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:48.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.937+0000 7f5540ff9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f553c111ca0 con 0x7f553c101c90 2024-09-11T00:15:48.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.937+0000 7f5540ff9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f553c111b20 con 0x7f553c108020 2024-09-11T00:15:48.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.937+0000 7f5540ff9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f553c111e20 con 0x7f553c1076a0 2024-09-11T00:15:48.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.937+0000 7f553a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f553c101c90 0x7f553c197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:48.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.937+0000 7f553a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f553c101c90 0x7f553c197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47714/0 (socket says 172.21.15.78:47714) 2024-09-11T00:15:48.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.937+0000 7f553a59c640 1 -- 172.21.15.78:0/587237977 learned_addr learned my addr 172.21.15.78:0/587237977 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:48.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.937+0000 7f5539d9b640 1 --2- 172.21.15.78:0/587237977 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f553c1076a0 0x7f553c198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:48.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.937+0000 7f553ad9d640 1 --2- 172.21.15.78:0/587237977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f553c108020 0x7f553c198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:48.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.937+0000 7f553a59c640 1 -- 172.21.15.78:0/587237977 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f553c1076a0 msgr2=0x7f553c198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:48.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.937+0000 7f553a59c640 1 --2- 172.21.15.78:0/587237977 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f553c1076a0 0x7f553c198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:48.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.937+0000 7f553a59c640 1 -- 172.21.15.78:0/587237977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f553c108020 msgr2=0x7f553c198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:48.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.937+0000 7f553a59c640 1 --2- 172.21.15.78:0/587237977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f553c108020 0x7f553c198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:48.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.937+0000 7f553a59c640 1 -- 172.21.15.78:0/587237977 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553c1a76a0 con 0x7f553c101c90 2024-09-11T00:15:48.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.937+0000 7f553a59c640 1 --2- 172.21.15.78:0/587237977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f553c101c90 0x7f553c197ec0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f552c00d950 tx=0x7f552c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:48.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.937+0000 7f55337fe640 1 -- 172.21.15.78:0/587237977 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c017070 con 0x7f553c101c90 2024-09-11T00:15:48.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.937+0000 7f55337fe640 1 -- 172.21.15.78:0/587237977 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f552c009c30 con 0x7f553c101c90 2024-09-11T00:15:48.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.937+0000 7f5540ff9640 1 -- 172.21.15.78:0/587237977 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553c1a7990 con 0x7f553c101c90 2024-09-11T00:15:48.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.937+0000 7f55337fe640 1 -- 172.21.15.78:0/587237977 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c00f620 con 0x7f553c101c90 2024-09-11T00:15:48.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.937+0000 7f5540ff9640 1 -- 172.21.15.78:0/587237977 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f553c1a7ea0 con 0x7f553c101c90 2024-09-11T00:15:48.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.938+0000 7f5540ff9640 1 -- 172.21.15.78:0/587237977 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f553c102070 con 0x7f553c101c90 2024-09-11T00:15:48.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.940+0000 7f55337fe640 1 -- 172.21.15.78:0/587237977 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f552c005030 con 0x7f553c101c90 2024-09-11T00:15:48.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.940+0000 7f55337fe640 1 --2- 172.21.15.78:0/587237977 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f55280b53c0 0x7f55280b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:48.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.941+0000 7f5539d9b640 1 --2- 172.21.15.78:0/587237977 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f55280b53c0 0x7f55280b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:48.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.941+0000 7f55337fe640 1 -- 172.21.15.78:0/587237977 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f552c0e5b70 con 0x7f553c101c90 2024-09-11T00:15:48.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.941+0000 7f5539d9b640 1 --2- 172.21.15.78:0/587237977 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f55280b53c0 0x7f55280b7880 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5524031440 tx=0x7f55240095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:48.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:48.943+0000 7f55337fe640 1 -- 172.21.15.78:0/587237977 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f552c0ac7f0 con 0x7f553c101c90 2024-09-11T00:15:49.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:48 smithi138 ceph-mon[35019]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:49.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:48 smithi138 ceph-mon[35019]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:49.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:49.125+0000 7f5540ff9640 1 -- 172.21.15.78:0/587237977 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f553c02e620 con 0x7f55280b53c0 2024-09-11T00:15:49.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:49.127+0000 7f55337fe640 1 -- 172.21.15.78:0/587237977 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f553c02e620 con 0x7f55280b53c0 2024-09-11T00:15:49.128 INFO:teuthology.orchestra.run.smithi078.stdout:HOST ADDR LABELS STATUS 2024-09-11T00:15:49.128 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078 172.21.15.78 2024-09-11T00:15:49.128 INFO:teuthology.orchestra.run.smithi078.stdout:smithi112 172.21.15.112 2024-09-11T00:15:49.128 INFO:teuthology.orchestra.run.smithi078.stdout:smithi138 172.21.15.138 2024-09-11T00:15:49.128 INFO:teuthology.orchestra.run.smithi078.stdout:3 hosts in cluster 2024-09-11T00:15:49.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:49.130+0000 7f5540ff9640 1 -- 172.21.15.78:0/587237977 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f55280b53c0 msgr2=0x7f55280b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:49.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:49.130+0000 7f5540ff9640 1 --2- 172.21.15.78:0/587237977 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f55280b53c0 0x7f55280b7880 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5524031440 tx=0x7f55240095f0 comp rx=0 tx=0).stop 2024-09-11T00:15:49.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:49.130+0000 7f5540ff9640 1 -- 172.21.15.78:0/587237977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f553c101c90 msgr2=0x7f553c197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:49.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:49.130+0000 7f5540ff9640 1 --2- 172.21.15.78:0/587237977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f553c101c90 0x7f553c197ec0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f552c00d950 tx=0x7f552c00de10 comp rx=0 tx=0).stop 2024-09-11T00:15:49.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:49.130+0000 7f5540ff9640 1 -- 172.21.15.78:0/587237977 shutdown_connections 2024-09-11T00:15:49.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:49.130+0000 7f5540ff9640 1 --2- 172.21.15.78:0/587237977 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f55280b53c0 0x7f55280b7880 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:49.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:49.130+0000 7f5540ff9640 1 --2- 172.21.15.78:0/587237977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f553c108020 0x7f553c198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:49.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:49.130+0000 7f5540ff9640 1 --2- 172.21.15.78:0/587237977 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f553c1076a0 0x7f553c198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:49.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:49.130+0000 7f5540ff9640 1 --2- 172.21.15.78:0/587237977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f553c101c90 0x7f553c197ec0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:49.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:49.130+0000 7f5540ff9640 1 -- 172.21.15.78:0/587237977 >> 172.21.15.78:0/587237977 conn(0x7f553c0fd700 msgr2=0x7f553c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:49.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:49.130+0000 7f5540ff9640 1 -- 172.21.15.78:0/587237977 shutdown_connections 2024-09-11T00:15:49.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:49.130+0000 7f5540ff9640 1 -- 172.21.15.78:0/587237977 wait complete. 2024-09-11T00:15:49.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:48 smithi112 ceph-mon[35627]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:49.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:48 smithi112 ceph-mon[35627]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:49.802 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-11T00:15:50.049 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:50.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.711+0000 7efe5f5b9640 1 -- 172.21.15.78:0/381974719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe581076b0 msgr2=0x7efe58107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:50.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.711+0000 7efe5f5b9640 1 --2- 172.21.15.78:0/381974719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe581076b0 0x7efe58107af0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7efe54009900 tx=0x7efe5402a410 comp rx=0 tx=0).stop 2024-09-11T00:15:50.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.711+0000 7efe5f5b9640 1 -- 172.21.15.78:0/381974719 shutdown_connections 2024-09-11T00:15:50.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.711+0000 7efe5f5b9640 1 --2- 172.21.15.78:0/381974719 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe58108030 0x7efe5810e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:50.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.711+0000 7efe5f5b9640 1 --2- 172.21.15.78:0/381974719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe581076b0 0x7efe58107af0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:50.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.711+0000 7efe5f5b9640 1 --2- 172.21.15.78:0/381974719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe58101ca0 0x7efe58102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:50.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.711+0000 7efe5f5b9640 1 -- 172.21.15.78:0/381974719 >> 172.21.15.78:0/381974719 conn(0x7efe580fd6f0 msgr2=0x7efe580ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:50.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.711+0000 7efe5f5b9640 1 -- 172.21.15.78:0/381974719 shutdown_connections 2024-09-11T00:15:50.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.711+0000 7efe5f5b9640 1 -- 172.21.15.78:0/381974719 wait complete. 2024-09-11T00:15:50.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.711+0000 7efe5f5b9640 1 Processor -- start 2024-09-11T00:15:50.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.711+0000 7efe5f5b9640 1 -- start start 2024-09-11T00:15:50.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.711+0000 7efe5f5b9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe58101ca0 0x7efe58199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:50.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.711+0000 7efe5f5b9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe581076b0 0x7efe58199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:50.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.711+0000 7efe5f5b9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe58108030 0x7efe5819ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:50.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.711+0000 7efe5f5b9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efe58111d30 con 0x7efe581076b0 2024-09-11T00:15:50.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.711+0000 7efe5f5b9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efe58111bb0 con 0x7efe58108030 2024-09-11T00:15:50.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.711+0000 7efe5f5b9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7efe58111eb0 con 0x7efe58101ca0 2024-09-11T00:15:50.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.712+0000 7efe5cb54640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe581076b0 0x7efe58199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:50.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.712+0000 7efe5cb54640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe581076b0 0x7efe58199950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47720/0 (socket says 172.21.15.78:47720) 2024-09-11T00:15:50.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.712+0000 7efe5cb54640 1 -- 172.21.15.78:0/186230540 learned_addr learned my addr 172.21.15.78:0/186230540 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:50.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.712+0000 7efe5d355640 1 --2- 172.21.15.78:0/186230540 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe58101ca0 0x7efe58199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:50.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.712+0000 7efe5db56640 1 --2- 172.21.15.78:0/186230540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe58108030 0x7efe5819ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:50.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.712+0000 7efe5cb54640 1 -- 172.21.15.78:0/186230540 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe58101ca0 msgr2=0x7efe58199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:50.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.712+0000 7efe5cb54640 1 --2- 172.21.15.78:0/186230540 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe58101ca0 0x7efe58199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:50.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.712+0000 7efe5cb54640 1 -- 172.21.15.78:0/186230540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe58108030 msgr2=0x7efe5819ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:50.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.712+0000 7efe5cb54640 1 --2- 172.21.15.78:0/186230540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe58108030 0x7efe5819ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:50.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.712+0000 7efe5cb54640 1 -- 172.21.15.78:0/186230540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe5819f4c0 con 0x7efe581076b0 2024-09-11T00:15:50.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.712+0000 7efe5db56640 1 --2- 172.21.15.78:0/186230540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe58108030 0x7efe5819ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:15:50.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.712+0000 7efe5cb54640 1 --2- 172.21.15.78:0/186230540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe581076b0 0x7efe58199950 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7efe54006010 tx=0x7efe540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:50.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.712+0000 7efe4a7fc640 1 -- 172.21.15.78:0/186230540 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5403f030 con 0x7efe581076b0 2024-09-11T00:15:50.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.712+0000 7efe4a7fc640 1 -- 172.21.15.78:0/186230540 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe54003800 con 0x7efe581076b0 2024-09-11T00:15:50.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.712+0000 7efe5f5b9640 1 -- 172.21.15.78:0/186230540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe5819f750 con 0x7efe581076b0 2024-09-11T00:15:50.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.712+0000 7efe4a7fc640 1 -- 172.21.15.78:0/186230540 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe54035070 con 0x7efe581076b0 2024-09-11T00:15:50.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.712+0000 7efe5f5b9640 1 -- 172.21.15.78:0/186230540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe581a5e70 con 0x7efe581076b0 2024-09-11T00:15:50.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.713+0000 7efe5f5b9640 1 -- 172.21.15.78:0/186230540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe58102100 con 0x7efe581076b0 2024-09-11T00:15:50.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.715+0000 7efe4a7fc640 1 -- 172.21.15.78:0/186230540 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7efe54031b10 con 0x7efe581076b0 2024-09-11T00:15:50.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.715+0000 7efe4a7fc640 1 --2- 172.21.15.78:0/186230540 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efe440b5440 0x7efe440b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:50.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.715+0000 7efe5d355640 1 --2- 172.21.15.78:0/186230540 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efe440b5440 0x7efe440b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:50.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.715+0000 7efe4a7fc640 1 -- 172.21.15.78:0/186230540 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7efe54106ab0 con 0x7efe581076b0 2024-09-11T00:15:50.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.716+0000 7efe5d355640 1 --2- 172.21.15.78:0/186230540 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efe440b5440 0x7efe440b7900 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efe4c009890 tx=0x7efe4c008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:50.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.718+0000 7efe4a7fc640 1 -- 172.21.15.78:0/186230540 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efe540cd730 con 0x7efe581076b0 2024-09-11T00:15:50.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.904+0000 7efe5f5b9640 1 -- 172.21.15.78:0/186230540 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7efe5806b4f0 con 0x7efe440b5440 2024-09-11T00:15:50.906 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:50 smithi078 ceph-mon[30865]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:50.906 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:50 smithi078 ceph-mon[30865]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:50.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.905+0000 7efe4a7fc640 1 -- 172.21.15.78:0/186230540 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7efe5806b4f0 con 0x7efe440b5440 2024-09-11T00:15:50.907 INFO:teuthology.orchestra.run.smithi078.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-11T00:15:50.907 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400QR400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-11T00:15:50.907 INFO:teuthology.orchestra.run.smithi078.stdout:smithi112 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NV400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-11T00:15:50.907 INFO:teuthology.orchestra.run.smithi078.stdout:smithi138 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6161003C400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-11T00:15:50.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.908+0000 7efe5f5b9640 1 -- 172.21.15.78:0/186230540 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efe440b5440 msgr2=0x7efe440b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:50.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.908+0000 7efe5f5b9640 1 --2- 172.21.15.78:0/186230540 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efe440b5440 0x7efe440b7900 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efe4c009890 tx=0x7efe4c008040 comp rx=0 tx=0).stop 2024-09-11T00:15:50.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.908+0000 7efe5f5b9640 1 -- 172.21.15.78:0/186230540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe581076b0 msgr2=0x7efe58199950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:50.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.908+0000 7efe5f5b9640 1 --2- 172.21.15.78:0/186230540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe581076b0 0x7efe58199950 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7efe54006010 tx=0x7efe540042f0 comp rx=0 tx=0).stop 2024-09-11T00:15:50.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.908+0000 7efe5f5b9640 1 -- 172.21.15.78:0/186230540 shutdown_connections 2024-09-11T00:15:50.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.908+0000 7efe5f5b9640 1 --2- 172.21.15.78:0/186230540 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efe440b5440 0x7efe440b7900 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:50.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.908+0000 7efe5f5b9640 1 --2- 172.21.15.78:0/186230540 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efe58108030 0x7efe5819ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:50.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.908+0000 7efe5f5b9640 1 --2- 172.21.15.78:0/186230540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe581076b0 0x7efe58199950 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:50.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.908+0000 7efe5f5b9640 1 --2- 172.21.15.78:0/186230540 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efe58101ca0 0x7efe58199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:50.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.908+0000 7efe5f5b9640 1 -- 172.21.15.78:0/186230540 >> 172.21.15.78:0/186230540 conn(0x7efe580fd6f0 msgr2=0x7efe581006a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:50.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.908+0000 7efe5f5b9640 1 -- 172.21.15.78:0/186230540 shutdown_connections 2024-09-11T00:15:50.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:50.908+0000 7efe5f5b9640 1 -- 172.21.15.78:0/186230540 wait complete. 2024-09-11T00:15:51.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:50 smithi138 ceph-mon[35019]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:51.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:50 smithi138 ceph-mon[35019]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:51.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:50 smithi112 ceph-mon[35627]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:51.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:50 smithi112 ceph-mon[35627]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:51.625 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T00:15:51.644 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi078.front.sepia.ceph.com 2024-09-11T00:15:51.644 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-11T00:15:51.891 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:52.012 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:51 smithi078 ceph-mon[30865]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:52.012 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:51 smithi078 ceph-mon[30865]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:52.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:51 smithi138 ceph-mon[35019]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:52.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:51 smithi138 ceph-mon[35019]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:52.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:51 smithi112 ceph-mon[35627]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:15:52.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:51 smithi112 ceph-mon[35627]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:52.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.402+0000 7f4cdbbf6640 1 -- 172.21.15.78:0/3452744896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cd41087f0 msgr2=0x7f4cd4108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:52.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.402+0000 7f4cdbbf6640 1 --2- 172.21.15.78:0/3452744896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cd41087f0 0x7f4cd4108c30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009900 tx=0x7f4cc402a410 comp rx=0 tx=0).stop 2024-09-11T00:15:52.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.402+0000 7f4cdbbf6640 1 -- 172.21.15.78:0/3452744896 shutdown_connections 2024-09-11T00:15:52.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.402+0000 7f4cdbbf6640 1 --2- 172.21.15.78:0/3452744896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cd4109170 0x7f4cd410f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:52.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.402+0000 7f4cdbbf6640 1 --2- 172.21.15.78:0/3452744896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cd41087f0 0x7f4cd4108c30 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:52.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.402+0000 7f4cdbbf6640 1 --2- 172.21.15.78:0/3452744896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4cd4102de0 0x7f4cd41031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:52.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.402+0000 7f4cdbbf6640 1 -- 172.21.15.78:0/3452744896 >> 172.21.15.78:0/3452744896 conn(0x7f4cd40fe870 msgr2=0x7f4cd4100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:52.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.402+0000 7f4cdbbf6640 1 -- 172.21.15.78:0/3452744896 shutdown_connections 2024-09-11T00:15:52.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.403+0000 7f4cdbbf6640 1 -- 172.21.15.78:0/3452744896 wait complete. 2024-09-11T00:15:52.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.403+0000 7f4cdbbf6640 1 Processor -- start 2024-09-11T00:15:52.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.403+0000 7f4cdbbf6640 1 -- start start 2024-09-11T00:15:52.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.404+0000 7f4cdbbf6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cd4102de0 0x7f4cd4199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:52.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.404+0000 7f4cdbbf6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cd41087f0 0x7f4cd4199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:52.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.404+0000 7f4cdbbf6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4cd4109170 0x7f4cd419ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:52.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.404+0000 7f4cdbbf6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd4112e80 con 0x7f4cd4102de0 2024-09-11T00:15:52.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.404+0000 7f4cdbbf6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd4112d00 con 0x7f4cd4109170 2024-09-11T00:15:52.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.404+0000 7f4cdbbf6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd4113000 con 0x7f4cd41087f0 2024-09-11T00:15:52.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.404+0000 7f4cd9992640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cd4102de0 0x7f4cd4199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:52.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.404+0000 7f4cd9992640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cd4102de0 0x7f4cd4199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47732/0 (socket says 172.21.15.78:47732) 2024-09-11T00:15:52.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.404+0000 7f4cd9992640 1 -- 172.21.15.78:0/1094467926 learned_addr learned my addr 172.21.15.78:0/1094467926 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:52.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.404+0000 7f4cda193640 1 --2- 172.21.15.78:0/1094467926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4cd4109170 0x7f4cd419ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:52.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.404+0000 7f4cd9992640 1 -- 172.21.15.78:0/1094467926 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cd41087f0 msgr2=0x7f4cd4199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:52.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.404+0000 7f4cd9191640 1 --2- 172.21.15.78:0/1094467926 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cd41087f0 0x7f4cd4199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:52.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.404+0000 7f4cd9992640 1 --2- 172.21.15.78:0/1094467926 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cd41087f0 0x7f4cd4199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:52.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.404+0000 7f4cd9992640 1 -- 172.21.15.78:0/1094467926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4cd4109170 msgr2=0x7f4cd419ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:52.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.404+0000 7f4cd9992640 1 --2- 172.21.15.78:0/1094467926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4cd4109170 0x7f4cd419ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:52.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.404+0000 7f4cd9992640 1 -- 172.21.15.78:0/1094467926 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd419f3e0 con 0x7f4cd4102de0 2024-09-11T00:15:52.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.404+0000 7f4cd9992640 1 --2- 172.21.15.78:0/1094467926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cd4102de0 0x7f4cd4199330 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4cd000d950 tx=0x7f4cd000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:52.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.404+0000 7f4ccaffd640 1 -- 172.21.15.78:0/1094467926 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd0017070 con 0x7f4cd4102de0 2024-09-11T00:15:52.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.404+0000 7f4ccaffd640 1 -- 172.21.15.78:0/1094467926 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cd0009c30 con 0x7f4cd4102de0 2024-09-11T00:15:52.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.404+0000 7f4cdbbf6640 1 -- 172.21.15.78:0/1094467926 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd419f6d0 con 0x7f4cd4102de0 2024-09-11T00:15:52.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.404+0000 7f4ccaffd640 1 -- 172.21.15.78:0/1094467926 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd000f620 con 0x7f4cd4102de0 2024-09-11T00:15:52.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.404+0000 7f4cdbbf6640 1 -- 172.21.15.78:0/1094467926 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd41a5e10 con 0x7f4cd4102de0 2024-09-11T00:15:52.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.405+0000 7f4cdbbf6640 1 -- 172.21.15.78:0/1094467926 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd41031c0 con 0x7f4cd4102de0 2024-09-11T00:15:52.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.407+0000 7f4ccaffd640 1 -- 172.21.15.78:0/1094467926 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f4cd0005030 con 0x7f4cd4102de0 2024-09-11T00:15:52.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.407+0000 7f4ccaffd640 1 --2- 172.21.15.78:0/1094467926 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4cc00b53c0 0x7f4cc00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:52.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.407+0000 7f4cd9191640 1 --2- 172.21.15.78:0/1094467926 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4cc00b53c0 0x7f4cc00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:52.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.407+0000 7f4ccaffd640 1 -- 172.21.15.78:0/1094467926 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f4cd00e5b70 con 0x7f4cd4102de0 2024-09-11T00:15:52.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.408+0000 7f4cd9191640 1 --2- 172.21.15.78:0/1094467926 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4cc00b53c0 0x7f4cc00b7880 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4cc402a930 tx=0x7f4cc4005fd0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:52.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.410+0000 7f4ccaffd640 1 -- 172.21.15.78:0/1094467926 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4cd00ac7f0 con 0x7f4cd4102de0 2024-09-11T00:15:52.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.625+0000 7f4cdbbf6640 1 -- 172.21.15.78:0/1094467926 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4cd402e5c0 con 0x7f4cd4102de0 2024-09-11T00:15:52.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.626+0000 7f4ccaffd640 1 -- 172.21.15.78:0/1094467926 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) ==== 76+0+3052 (secure 0 0 0) 0x7f4cd0009de0 con 0x7f4cd4102de0 2024-09-11T00:15:52.628 INFO:teuthology.orchestra.run.smithi078.stdout:e20 2024-09-11T00:15:52.628 INFO:teuthology.orchestra.run.smithi078.stdout:btime 2024-09-11T00:14:35:942737+0000 2024-09-11T00:15:52.628 INFO:teuthology.orchestra.run.smithi078.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:15:52.628 INFO:teuthology.orchestra.run.smithi078.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T00:15:52.628 INFO:teuthology.orchestra.run.smithi078.stdout:legacy client fscid: 1 2024-09-11T00:15:52.628 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:15:52.628 INFO:teuthology.orchestra.run.smithi078.stdout:Filesystem 'cephfs' (1) 2024-09-11T00:15:52.629 INFO:teuthology.orchestra.run.smithi078.stdout:fs_name cephfs 2024-09-11T00:15:52.629 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 20 2024-09-11T00:15:52.629 INFO:teuthology.orchestra.run.smithi078.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-11T00:15:52.629 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-11T00:14:26.461738+0000 2024-09-11T00:15:52.629 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-11T00:14:35.614720+0000 2024-09-11T00:15:52.629 INFO:teuthology.orchestra.run.smithi078.stdout:tableserver 0 2024-09-11T00:15:52.629 INFO:teuthology.orchestra.run.smithi078.stdout:root 0 2024-09-11T00:15:52.629 INFO:teuthology.orchestra.run.smithi078.stdout:session_timeout 300 2024-09-11T00:15:52.629 INFO:teuthology.orchestra.run.smithi078.stdout:session_autoclose 300 2024-09-11T00:15:52.629 INFO:teuthology.orchestra.run.smithi078.stdout:max_file_size 1099511627776 2024-09-11T00:15:52.629 INFO:teuthology.orchestra.run.smithi078.stdout:max_xattr_size 65536 2024-09-11T00:15:52.629 INFO:teuthology.orchestra.run.smithi078.stdout:required_client_features {} 2024-09-11T00:15:52.629 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure 0 2024-09-11T00:15:52.630 INFO:teuthology.orchestra.run.smithi078.stdout:last_failure_osd_epoch 0 2024-09-11T00:15:52.630 INFO:teuthology.orchestra.run.smithi078.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T00:15:52.631 INFO:teuthology.orchestra.run.smithi078.stdout:max_mds 1 2024-09-11T00:15:52.631 INFO:teuthology.orchestra.run.smithi078.stdout:in 0 2024-09-11T00:15:52.631 INFO:teuthology.orchestra.run.smithi078.stdout:up {0=24593} 2024-09-11T00:15:52.631 INFO:teuthology.orchestra.run.smithi078.stdout:failed 2024-09-11T00:15:52.631 INFO:teuthology.orchestra.run.smithi078.stdout:damaged 2024-09-11T00:15:52.631 INFO:teuthology.orchestra.run.smithi078.stdout:stopped 2024-09-11T00:15:52.631 INFO:teuthology.orchestra.run.smithi078.stdout:data_pools [3] 2024-09-11T00:15:52.631 INFO:teuthology.orchestra.run.smithi078.stdout:metadata_pool 2 2024-09-11T00:15:52.631 INFO:teuthology.orchestra.run.smithi078.stdout:inline_data disabled 2024-09-11T00:15:52.631 INFO:teuthology.orchestra.run.smithi078.stdout:balancer 2024-09-11T00:15:52.632 INFO:teuthology.orchestra.run.smithi078.stdout:bal_rank_mask -1 2024-09-11T00:15:52.632 INFO:teuthology.orchestra.run.smithi078.stdout:standby_count_wanted 0 2024-09-11T00:15:52.632 INFO:teuthology.orchestra.run.smithi078.stdout:qdb_cluster leader: 24593 members: 24593 2024-09-11T00:15:52.632 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b{0:24593} state up:active seq 4 addr [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:15:52.632 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.i{0:24589} state up:standby-replay seq 1 addr [v2:172.21.15.138:6838/1175492512,v1:172.21.15.138:6839/1175492512] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:15:52.632 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:15:52.632 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:15:52.632 INFO:teuthology.orchestra.run.smithi078.stdout:Standby daemons: 2024-09-11T00:15:52.632 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:15:52.632 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.j{-1:14703} state up:standby seq 1 addr [v2:172.21.15.78:6834/968608466,v1:172.21.15.78:6835/968608466] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:15:52.632 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d{-1:14715} state up:standby seq 1 addr [v2:172.21.15.78:6836/2804778258,v1:172.21.15.78:6837/2804778258] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:15:52.632 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.g{-1:14775} state up:standby seq 1 addr [v2:172.21.15.78:6838/2754095227,v1:172.21.15.78:6839/2754095227] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:15:52.632 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a{-1:14781} state up:standby seq 1 addr [v2:172.21.15.78:6840/3067187523,v1:172.21.15.78:6841/3067187523] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:15:52.633 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.k{-1:24527} state up:standby seq 1 addr [v2:172.21.15.112:6832/1151759844,v1:172.21.15.112:6833/1151759844] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:15:52.633 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.l{-1:24532} state up:standby seq 1 addr [v2:172.21.15.138:6832/2451542817,v1:172.21.15.138:6833/2451542817] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:15:52.633 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.e{-1:24548} state up:standby seq 1 addr [v2:172.21.15.112:6834/2046327807,v1:172.21.15.112:6835/2046327807] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:15:52.633 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.f{-1:24565} state up:standby seq 1 addr [v2:172.21.15.138:6834/1086283757,v1:172.21.15.138:6835/1086283757] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:15:52.633 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c{-1:24571} state up:standby seq 1 addr [v2:172.21.15.138:6836/3566830955,v1:172.21.15.138:6837/3566830955] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:15:52.633 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.h{-1:24575} state up:standby seq 1 addr [v2:172.21.15.112:6836/3784369511,v1:172.21.15.112:6837/3784369511] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T00:15:52.634 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:15:52.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.628+0000 7f4cdbbf6640 1 -- 172.21.15.78:0/1094467926 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4cc00b53c0 msgr2=0x7f4cc00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:52.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.628+0000 7f4cdbbf6640 1 --2- 172.21.15.78:0/1094467926 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4cc00b53c0 0x7f4cc00b7880 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4cc402a930 tx=0x7f4cc4005fd0 comp rx=0 tx=0).stop 2024-09-11T00:15:52.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.628+0000 7f4cdbbf6640 1 -- 172.21.15.78:0/1094467926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cd4102de0 msgr2=0x7f4cd4199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:52.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.628+0000 7f4cdbbf6640 1 --2- 172.21.15.78:0/1094467926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cd4102de0 0x7f4cd4199330 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4cd000d950 tx=0x7f4cd000de10 comp rx=0 tx=0).stop 2024-09-11T00:15:52.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.628+0000 7f4cdbbf6640 1 -- 172.21.15.78:0/1094467926 shutdown_connections 2024-09-11T00:15:52.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.628+0000 7f4cdbbf6640 1 --2- 172.21.15.78:0/1094467926 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4cc00b53c0 0x7f4cc00b7880 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:52.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.628+0000 7f4cdbbf6640 1 --2- 172.21.15.78:0/1094467926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4cd4109170 0x7f4cd419ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:52.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.628+0000 7f4cdbbf6640 1 --2- 172.21.15.78:0/1094467926 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cd41087f0 0x7f4cd4199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:52.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.628+0000 7f4cdbbf6640 1 --2- 172.21.15.78:0/1094467926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cd4102de0 0x7f4cd4199330 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:52.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.628+0000 7f4cdbbf6640 1 -- 172.21.15.78:0/1094467926 >> 172.21.15.78:0/1094467926 conn(0x7f4cd40fe870 msgr2=0x7f4cd4100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:52.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.628+0000 7f4cdbbf6640 1 -- 172.21.15.78:0/1094467926 shutdown_connections 2024-09-11T00:15:52.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:52.628+0000 7f4cdbbf6640 1 -- 172.21.15.78:0/1094467926 wait complete. 2024-09-11T00:15:52.994 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:52 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1094467926' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:15:53.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:52 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1094467926' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:15:53.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:52 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1094467926' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T00:15:53.332 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-11T00:15:53.578 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:53.974 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:53 smithi078 ceph-mon[30865]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:54.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.052+0000 7ffab8dc2640 1 -- 172.21.15.78:0/3815113177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffab4102dc0 msgr2=0x7ffab41031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.052+0000 7ffab8dc2640 1 --2- 172.21.15.78:0/3815113177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffab4102dc0 0x7ffab41031a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009900 tx=0x7ffaac02a410 comp rx=0 tx=0).stop 2024-09-11T00:15:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.052+0000 7ffab8dc2640 1 -- 172.21.15.78:0/3815113177 shutdown_connections 2024-09-11T00:15:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.052+0000 7ffab8dc2640 1 --2- 172.21.15.78:0/3815113177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffab4109150 0x7ffab410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.052+0000 7ffab8dc2640 1 --2- 172.21.15.78:0/3815113177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffab41087d0 0x7ffab4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.052+0000 7ffab8dc2640 1 --2- 172.21.15.78:0/3815113177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffab4102dc0 0x7ffab41031a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.052+0000 7ffab8dc2640 1 -- 172.21.15.78:0/3815113177 >> 172.21.15.78:0/3815113177 conn(0x7ffab40fe830 msgr2=0x7ffab4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.052+0000 7ffab8dc2640 1 -- 172.21.15.78:0/3815113177 shutdown_connections 2024-09-11T00:15:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.052+0000 7ffab8dc2640 1 -- 172.21.15.78:0/3815113177 wait complete. 2024-09-11T00:15:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.053+0000 7ffab8dc2640 1 Processor -- start 2024-09-11T00:15:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.053+0000 7ffab8dc2640 1 -- start start 2024-09-11T00:15:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.053+0000 7ffab8dc2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffab4102dc0 0x7ffab4199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.053+0000 7ffab8dc2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffab41087d0 0x7ffab4199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.053+0000 7ffab8dc2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffab4109150 0x7ffab419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.053+0000 7ffab8dc2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ffab4112e10 con 0x7ffab41087d0 2024-09-11T00:15:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.053+0000 7ffab8dc2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffab4112c90 con 0x7ffab4102dc0 2024-09-11T00:15:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.053+0000 7ffab8dc2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ffab4112f90 con 0x7ffab4109150 2024-09-11T00:15:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.053+0000 7ffab1d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffab41087d0 0x7ffab4199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.053+0000 7ffab1d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffab41087d0 0x7ffab4199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47746/0 (socket says 172.21.15.78:47746) 2024-09-11T00:15:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.053+0000 7ffab1d9b640 1 -- 172.21.15.78:0/431168279 learned_addr learned my addr 172.21.15.78:0/431168279 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.053+0000 7ffab259c640 1 --2- 172.21.15.78:0/431168279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffab4102dc0 0x7ffab4199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.053+0000 7ffab2d9d640 1 --2- 172.21.15.78:0/431168279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffab4109150 0x7ffab419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.053+0000 7ffab1d9b640 1 -- 172.21.15.78:0/431168279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffab4109150 msgr2=0x7ffab419ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.053+0000 7ffab1d9b640 1 --2- 172.21.15.78:0/431168279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffab4109150 0x7ffab419ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.053+0000 7ffab1d9b640 1 -- 172.21.15.78:0/431168279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffab4102dc0 msgr2=0x7ffab4199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.053+0000 7ffab1d9b640 1 --2- 172.21.15.78:0/431168279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffab4102dc0 0x7ffab4199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.053+0000 7ffab1d9b640 1 -- 172.21.15.78:0/431168279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab419f3b0 con 0x7ffab41087d0 2024-09-11T00:15:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.054+0000 7ffab1d9b640 1 --2- 172.21.15.78:0/431168279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffab41087d0 0x7ffab4199840 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00ba50 tx=0x7ffa9c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.054+0000 7ffaab7fe640 1 -- 172.21.15.78:0/431168279 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c019070 con 0x7ffab41087d0 2024-09-11T00:15:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.054+0000 7ffaab7fe640 1 -- 172.21.15.78:0/431168279 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa9c00cbe0 con 0x7ffab41087d0 2024-09-11T00:15:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.054+0000 7ffaab7fe640 1 -- 172.21.15.78:0/431168279 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c0075d0 con 0x7ffab41087d0 2024-09-11T00:15:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.054+0000 7ffab8dc2640 1 -- 172.21.15.78:0/431168279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab419f6a0 con 0x7ffab41087d0 2024-09-11T00:15:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.054+0000 7ffab8dc2640 1 -- 172.21.15.78:0/431168279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab41a5de0 con 0x7ffab41087d0 2024-09-11T00:15:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.055+0000 7ffab8dc2640 1 -- 172.21.15.78:0/431168279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffab41031a0 con 0x7ffab41087d0 2024-09-11T00:15:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.056+0000 7ffaab7fe640 1 -- 172.21.15.78:0/431168279 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7ffa9c007830 con 0x7ffab41087d0 2024-09-11T00:15:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.057+0000 7ffaab7fe640 1 --2- 172.21.15.78:0/431168279 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ffaa00b53c0 0x7ffaa00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.057+0000 7ffab259c640 1 --2- 172.21.15.78:0/431168279 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ffaa00b53c0 0x7ffaa00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.057+0000 7ffaab7fe640 1 -- 172.21.15.78:0/431168279 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7ffa9c0e5680 con 0x7ffab41087d0 2024-09-11T00:15:54.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.058+0000 7ffab259c640 1 --2- 172.21.15.78:0/431168279 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ffaa00b53c0 0x7ffaa00b7880 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffaac031440 tx=0x7ffaac005e80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:54.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.061+0000 7ffaab7fe640 1 -- 172.21.15.78:0/431168279 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ffa9c0abcb0 con 0x7ffab41087d0 2024-09-11T00:15:54.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:53 smithi112 ceph-mon[35627]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:54.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.237+0000 7ffab8dc2640 1 -- 172.21.15.78:0/431168279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7ffab402e5c0 con 0x7ffab41087d0 2024-09-11T00:15:54.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.238+0000 7ffaab7fe640 1 -- 172.21.15.78:0/431168279 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v77) ==== 56+0+5701 (secure 0 0 0) 0x7ffa9c0b06e0 con 0x7ffab41087d0 2024-09-11T00:15:54.240 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 77 2024-09-11T00:15:54.240 INFO:teuthology.orchestra.run.smithi078.stdout:fsid 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:15:54.240 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-11T00:06:05.704745+0000 2024-09-11T00:15:54.240 INFO:teuthology.orchestra.run.smithi078.stdout:modified 2024-09-11T00:14:56.755927+0000 2024-09-11T00:15:54.240 INFO:teuthology.orchestra.run.smithi078.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-11T00:15:54.240 INFO:teuthology.orchestra.run.smithi078.stdout:crush_version 26 2024-09-11T00:15:54.240 INFO:teuthology.orchestra.run.smithi078.stdout:full_ratio 0.95 2024-09-11T00:15:54.240 INFO:teuthology.orchestra.run.smithi078.stdout:backfillfull_ratio 0.9 2024-09-11T00:15:54.241 INFO:teuthology.orchestra.run.smithi078.stdout:nearfull_ratio 0.85 2024-09-11T00:15:54.241 INFO:teuthology.orchestra.run.smithi078.stdout:require_min_compat_client luminous 2024-09-11T00:15:54.241 INFO:teuthology.orchestra.run.smithi078.stdout:min_compat_client luminous 2024-09-11T00:15:54.241 INFO:teuthology.orchestra.run.smithi078.stdout:require_osd_release squid 2024-09-11T00:15:54.241 INFO:teuthology.orchestra.run.smithi078.stdout:stretch_mode_enabled false 2024-09-11T00:15:54.241 INFO:teuthology.orchestra.run.smithi078.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-11T00:15:54.241 INFO:teuthology.orchestra.run.smithi078.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-11T00:15:54.241 INFO:teuthology.orchestra.run.smithi078.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.69 2024-09-11T00:15:54.241 INFO:teuthology.orchestra.run.smithi078.stdout:max_osd 12 2024-09-11T00:15:54.241 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 up in weight 1 up_from 9 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.78:6802/3736366730,v1:172.21.15.78:6803/3736366730] [v2:172.21.15.78:6804/3736366730,v1:172.21.15.78:6805/3736366730] exists,up d260c219-52f2-4e7f-9188-9e66ee01dacd 2024-09-11T00:15:54.241 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 up in weight 1 up_from 14 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6800/3186321784,v1:172.21.15.112:6801/3186321784] [v2:172.21.15.112:6802/3186321784,v1:172.21.15.112:6803/3186321784] exists,up d0f286a2-a121-40ee-8134-67ef01b1bc9d 2024-09-11T00:15:54.241 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 up in weight 1 up_from 18 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6800/3206386630,v1:172.21.15.138:6801/3206386630] [v2:172.21.15.138:6802/3206386630,v1:172.21.15.138:6803/3206386630] exists,up 0eadcce5-12af-4af6-9b4e-159e84454d8f 2024-09-11T00:15:54.241 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 up in weight 1 up_from 24 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.78:6810/3832405256,v1:172.21.15.78:6811/3832405256] [v2:172.21.15.78:6812/3832405256,v1:172.21.15.78:6813/3832405256] exists,up 5f3f683d-6306-43da-8bbd-c103eca442ae 2024-09-11T00:15:54.242 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 up in weight 1 up_from 30 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6808/2650243435,v1:172.21.15.112:6809/2650243435] [v2:172.21.15.112:6810/2650243435,v1:172.21.15.112:6811/2650243435] exists,up 4575a0a5-821e-4346-84ac-5396042b0550 2024-09-11T00:15:54.242 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 up in weight 1 up_from 35 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6808/3033110975,v1:172.21.15.138:6809/3033110975] [v2:172.21.15.138:6810/3033110975,v1:172.21.15.138:6811/3033110975] exists,up e81eb98f-76eb-4da5-8047-f160888720e8 2024-09-11T00:15:54.242 INFO:teuthology.orchestra.run.smithi078.stdout:osd.6 up in weight 1 up_from 41 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.78:6818/477087575,v1:172.21.15.78:6819/477087575] [v2:172.21.15.78:6820/477087575,v1:172.21.15.78:6821/477087575] exists,up 7442a091-4dba-45c4-808b-7c3b97087aa4 2024-09-11T00:15:54.242 INFO:teuthology.orchestra.run.smithi078.stdout:osd.7 up in weight 1 up_from 46 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6816/1481363296,v1:172.21.15.112:6817/1481363296] [v2:172.21.15.112:6818/1481363296,v1:172.21.15.112:6819/1481363296] exists,up 220c1f03-ace9-4dd0-a06d-485b0d2d08bd 2024-09-11T00:15:54.242 INFO:teuthology.orchestra.run.smithi078.stdout:osd.8 up in weight 1 up_from 52 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6816/2195149036,v1:172.21.15.138:6817/2195149036] [v2:172.21.15.138:6818/2195149036,v1:172.21.15.138:6819/2195149036] exists,up adb6edaa-9a8c-4b0b-aa6a-26dc77a3a7cc 2024-09-11T00:15:54.242 INFO:teuthology.orchestra.run.smithi078.stdout:osd.9 up in weight 1 up_from 58 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.78:6826/3367249449,v1:172.21.15.78:6827/3367249449] [v2:172.21.15.78:6828/3367249449,v1:172.21.15.78:6829/3367249449] exists,up dd01f408-3712-410e-acbd-c797b7ea5058 2024-09-11T00:15:54.242 INFO:teuthology.orchestra.run.smithi078.stdout:osd.10 up in weight 1 up_from 63 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6824/775023408,v1:172.21.15.112:6825/775023408] [v2:172.21.15.112:6826/775023408,v1:172.21.15.112:6827/775023408] exists,up 243c6483-1b0e-49f2-b99c-116d9e9c0617 2024-09-11T00:15:54.242 INFO:teuthology.orchestra.run.smithi078.stdout:osd.11 up in weight 1 up_from 69 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6824/4046089012,v1:172.21.15.138:6825/4046089012] [v2:172.21.15.138:6826/4046089012,v1:172.21.15.138:6827/4046089012] exists,up fa20ac9e-b5f7-4b3a-bb51-31569f909609 2024-09-11T00:15:54.242 INFO:teuthology.orchestra.run.smithi078.stdout:pg_upmap_items 2.f [8,11] 2024-09-11T00:15:54.242 INFO:teuthology.orchestra.run.smithi078.stdout:pg_upmap_items 2.1b [2,4] 2024-09-11T00:15:54.242 INFO:teuthology.orchestra.run.smithi078.stdout:pg_upmap_items 3.0 [4,6,5,9] 2024-09-11T00:15:54.243 INFO:teuthology.orchestra.run.smithi078.stdout:pg_upmap_items 3.3 [4,9] 2024-09-11T00:15:54.243 INFO:teuthology.orchestra.run.smithi078.stdout:pg_upmap_items 3.5 [3,9] 2024-09-11T00:15:54.243 INFO:teuthology.orchestra.run.smithi078.stdout:pg_upmap_items 3.6 [3,8] 2024-09-11T00:15:54.243 INFO:teuthology.orchestra.run.smithi078.stdout:pg_upmap_items 3.e [4,8] 2024-09-11T00:15:54.243 INFO:teuthology.orchestra.run.smithi078.stdout:pg_upmap_items 3.28 [5,7] 2024-09-11T00:15:54.243 INFO:teuthology.orchestra.run.smithi078.stdout:pg_upmap_items 3.31 [4,6] 2024-09-11T00:15:54.243 INFO:teuthology.orchestra.run.smithi078.stdout:blocklist 172.21.15.78:6801/2525199237 expires 2024-09-12T00:07:55.586578+0000 2024-09-11T00:15:54.243 INFO:teuthology.orchestra.run.smithi078.stdout:blocklist 172.21.15.78:0/1476776463 expires 2024-09-12T00:06:32.958575+0000 2024-09-11T00:15:54.243 INFO:teuthology.orchestra.run.smithi078.stdout:blocklist 172.21.15.78:0/1949658157 expires 2024-09-12T00:06:56.062555+0000 2024-09-11T00:15:54.243 INFO:teuthology.orchestra.run.smithi078.stdout:blocklist 172.21.15.78:0/2276853910 expires 2024-09-12T00:07:55.586578+0000 2024-09-11T00:15:54.243 INFO:teuthology.orchestra.run.smithi078.stdout:blocklist 172.21.15.78:0/4205790529 expires 2024-09-12T00:06:32.958575+0000 2024-09-11T00:15:54.243 INFO:teuthology.orchestra.run.smithi078.stdout:blocklist 172.21.15.78:6800/2841116003 expires 2024-09-12T00:06:32.958575+0000 2024-09-11T00:15:54.243 INFO:teuthology.orchestra.run.smithi078.stdout:blocklist 172.21.15.78:0/4286825123 expires 2024-09-12T00:06:32.958575+0000 2024-09-11T00:15:54.244 INFO:teuthology.orchestra.run.smithi078.stdout:blocklist 172.21.15.78:6801/2841116003 expires 2024-09-12T00:06:32.958575+0000 2024-09-11T00:15:54.244 INFO:teuthology.orchestra.run.smithi078.stdout:blocklist 172.21.15.78:0/1304243506 expires 2024-09-12T00:06:56.062555+0000 2024-09-11T00:15:54.244 INFO:teuthology.orchestra.run.smithi078.stdout:blocklist 172.21.15.78:6800/2037182593 expires 2024-09-12T00:06:56.062555+0000 2024-09-11T00:15:54.244 INFO:teuthology.orchestra.run.smithi078.stdout:blocklist 172.21.15.78:0/1614270050 expires 2024-09-12T00:07:55.586578+0000 2024-09-11T00:15:54.244 INFO:teuthology.orchestra.run.smithi078.stdout:blocklist 172.21.15.78:6801/2037182593 expires 2024-09-12T00:06:56.062555+0000 2024-09-11T00:15:54.244 INFO:teuthology.orchestra.run.smithi078.stdout:blocklist 172.21.15.78:0/1679390655 expires 2024-09-12T00:06:56.062555+0000 2024-09-11T00:15:54.244 INFO:teuthology.orchestra.run.smithi078.stdout:blocklist 172.21.15.78:0/2957982486 expires 2024-09-12T00:07:55.586578+0000 2024-09-11T00:15:54.244 INFO:teuthology.orchestra.run.smithi078.stdout:blocklist 172.21.15.78:6800/2525199237 expires 2024-09-12T00:07:55.586578+0000 2024-09-11T00:15:54.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.241+0000 7ffab8dc2640 1 -- 172.21.15.78:0/431168279 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ffaa00b53c0 msgr2=0x7ffaa00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:54.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.241+0000 7ffab8dc2640 1 --2- 172.21.15.78:0/431168279 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ffaa00b53c0 0x7ffaa00b7880 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffaac031440 tx=0x7ffaac005e80 comp rx=0 tx=0).stop 2024-09-11T00:15:54.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.241+0000 7ffab8dc2640 1 -- 172.21.15.78:0/431168279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffab41087d0 msgr2=0x7ffab4199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:54.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.241+0000 7ffab8dc2640 1 --2- 172.21.15.78:0/431168279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffab41087d0 0x7ffab4199840 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00ba50 tx=0x7ffa9c00bf10 comp rx=0 tx=0).stop 2024-09-11T00:15:54.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.241+0000 7ffab8dc2640 1 -- 172.21.15.78:0/431168279 shutdown_connections 2024-09-11T00:15:54.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.241+0000 7ffab8dc2640 1 --2- 172.21.15.78:0/431168279 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ffaa00b53c0 0x7ffaa00b7880 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:54.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.241+0000 7ffab8dc2640 1 --2- 172.21.15.78:0/431168279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ffab4109150 0x7ffab419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:54.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.241+0000 7ffab8dc2640 1 --2- 172.21.15.78:0/431168279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffab41087d0 0x7ffab4199840 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:54.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.241+0000 7ffab8dc2640 1 --2- 172.21.15.78:0/431168279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffab4102dc0 0x7ffab4199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:54.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.241+0000 7ffab8dc2640 1 -- 172.21.15.78:0/431168279 >> 172.21.15.78:0/431168279 conn(0x7ffab40fe830 msgr2=0x7ffab4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:54.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.241+0000 7ffab8dc2640 1 -- 172.21.15.78:0/431168279 shutdown_connections 2024-09-11T00:15:54.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:54.241+0000 7ffab8dc2640 1 -- 172.21.15.78:0/431168279 wait complete. 2024-09-11T00:15:54.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:53 smithi138 ceph-mon[35019]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:15:54.962 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-11T00:15:54.975 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:15:54.998 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:54 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/431168279' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-11T00:15:55.225 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:55.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:54 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/431168279' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-11T00:15:55.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:54 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/431168279' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-11T00:15:55.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.736+0000 7f30ed629640 1 -- 172.21.15.78:0/440687882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e8109150 msgr2=0x7f30e810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:55.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.736+0000 7f30ed629640 1 --2- 172.21.15.78:0/440687882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e8109150 0x7f30e810f950 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f30e0009ca0 tx=0x7f30e002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:15:55.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.736+0000 7f30ed629640 1 -- 172.21.15.78:0/440687882 shutdown_connections 2024-09-11T00:15:55.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.736+0000 7f30ed629640 1 --2- 172.21.15.78:0/440687882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e8109150 0x7f30e810f950 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:55.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.736+0000 7f30ed629640 1 --2- 172.21.15.78:0/440687882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30e81087d0 0x7f30e8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:55.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.736+0000 7f30ed629640 1 --2- 172.21.15.78:0/440687882 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30e8102dc0 0x7f30e81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:55.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.736+0000 7f30ed629640 1 -- 172.21.15.78:0/440687882 >> 172.21.15.78:0/440687882 conn(0x7f30e80fe830 msgr2=0x7f30e8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:55.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.736+0000 7f30ed629640 1 -- 172.21.15.78:0/440687882 shutdown_connections 2024-09-11T00:15:55.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.736+0000 7f30ed629640 1 -- 172.21.15.78:0/440687882 wait complete. 2024-09-11T00:15:55.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.736+0000 7f30ed629640 1 Processor -- start 2024-09-11T00:15:55.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.737+0000 7f30ed629640 1 -- start start 2024-09-11T00:15:55.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.737+0000 7f30ed629640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e8102dc0 0x7f30e81993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:55.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.737+0000 7f30ed629640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30e81087d0 0x7f30e81998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:55.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.737+0000 7f30ed629640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30e8109150 0x7f30e819ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:55.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.737+0000 7f30ed629640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f30e8112e50 con 0x7f30e8102dc0 2024-09-11T00:15:55.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.737+0000 7f30ed629640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f30e8112cd0 con 0x7f30e81087d0 2024-09-11T00:15:55.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.737+0000 7f30ed629640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f30e8112fd0 con 0x7f30e8109150 2024-09-11T00:15:55.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.737+0000 7f30e6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e8102dc0 0x7f30e81993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:55.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.737+0000 7f30e6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e8102dc0 0x7f30e81993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37896/0 (socket says 172.21.15.78:37896) 2024-09-11T00:15:55.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.737+0000 7f30e6ffd640 1 -- 172.21.15.78:0/522241389 learned_addr learned my addr 172.21.15.78:0/522241389 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:55.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.737+0000 7f30de7fc640 1 --2- 172.21.15.78:0/522241389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30e81087d0 0x7f30e81998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:55.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.737+0000 7f30e77fe640 1 --2- 172.21.15.78:0/522241389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30e8109150 0x7f30e819ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:55.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.737+0000 7f30e6ffd640 1 -- 172.21.15.78:0/522241389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30e8109150 msgr2=0x7f30e819ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:55.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.737+0000 7f30e6ffd640 1 --2- 172.21.15.78:0/522241389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30e8109150 0x7f30e819ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:55.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.737+0000 7f30e6ffd640 1 -- 172.21.15.78:0/522241389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30e81087d0 msgr2=0x7f30e81998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:55.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.737+0000 7f30e6ffd640 1 --2- 172.21.15.78:0/522241389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30e81087d0 0x7f30e81998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:55.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.737+0000 7f30e6ffd640 1 -- 172.21.15.78:0/522241389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e819f450 con 0x7f30e8102dc0 2024-09-11T00:15:55.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.737+0000 7f30e77fe640 1 --2- 172.21.15.78:0/522241389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30e8109150 0x7f30e819ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:15:55.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.737+0000 7f30e6ffd640 1 --2- 172.21.15.78:0/522241389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e8102dc0 0x7f30e81993a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f30d800b4a0 tx=0x7f30d800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:55.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.738+0000 7f30e4ff9640 1 -- 172.21.15.78:0/522241389 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d8014070 con 0x7f30e8102dc0 2024-09-11T00:15:55.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.738+0000 7f30e4ff9640 1 -- 172.21.15.78:0/522241389 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30d8010ac0 con 0x7f30e8102dc0 2024-09-11T00:15:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.738+0000 7f30ed629640 1 -- 172.21.15.78:0/522241389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e819f740 con 0x7f30e8102dc0 2024-09-11T00:15:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.738+0000 7f30e4ff9640 1 -- 172.21.15.78:0/522241389 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d8017c30 con 0x7f30e8102dc0 2024-09-11T00:15:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.738+0000 7f30ed629640 1 -- 172.21.15.78:0/522241389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e81a5e80 con 0x7f30e8102dc0 2024-09-11T00:15:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.739+0000 7f30ed629640 1 -- 172.21.15.78:0/522241389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30e8103220 con 0x7f30e8102dc0 2024-09-11T00:15:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.740+0000 7f30e4ff9640 1 -- 172.21.15.78:0/522241389 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f30d8010610 con 0x7f30e8102dc0 2024-09-11T00:15:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.740+0000 7f30e4ff9640 1 --2- 172.21.15.78:0/522241389 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f30d40b53c0 0x7f30d40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.741+0000 7f30de7fc640 1 --2- 172.21.15.78:0/522241389 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f30d40b53c0 0x7f30d40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:55.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.741+0000 7f30e4ff9640 1 -- 172.21.15.78:0/522241389 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8463+0+0 (secure 0 0 0) 0x7f30d80e5840 con 0x7f30e8102dc0 2024-09-11T00:15:55.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.741+0000 7f30de7fc640 1 --2- 172.21.15.78:0/522241389 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f30d40b53c0 0x7f30d40b7880 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f30e81072b0 tx=0x7f30d0008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:55.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.745+0000 7f30e4ff9640 1 -- 172.21.15.78:0/522241389 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f30d80ac4c0 con 0x7f30e8102dc0 2024-09-11T00:15:55.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.988+0000 7f30ed629640 1 -- 172.21.15.78:0/522241389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30e810a9a0 con 0x7f30e8102dc0 2024-09-11T00:15:55.990 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:55 smithi078 ceph-mon[30865]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:55.990 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:55 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-11T00:15:55.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.989+0000 7f30e4ff9640 1 -- 172.21.15.78:0/522241389 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f30d80abdc0 con 0x7f30e8102dc0 2024-09-11T00:15:55.991 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:15:55.991 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:15:55.991 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:15:55.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.991+0000 7f30ed629640 1 -- 172.21.15.78:0/522241389 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f30d40b53c0 msgr2=0x7f30d40b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:55.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.991+0000 7f30ed629640 1 --2- 172.21.15.78:0/522241389 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f30d40b53c0 0x7f30d40b7880 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f30e81072b0 tx=0x7f30d0008040 comp rx=0 tx=0).stop 2024-09-11T00:15:55.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.991+0000 7f30ed629640 1 -- 172.21.15.78:0/522241389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e8102dc0 msgr2=0x7f30e81993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:55.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.991+0000 7f30ed629640 1 --2- 172.21.15.78:0/522241389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e8102dc0 0x7f30e81993a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f30d800b4a0 tx=0x7f30d800b960 comp rx=0 tx=0).stop 2024-09-11T00:15:55.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.991+0000 7f30ed629640 1 -- 172.21.15.78:0/522241389 shutdown_connections 2024-09-11T00:15:55.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.991+0000 7f30ed629640 1 --2- 172.21.15.78:0/522241389 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f30d40b53c0 0x7f30d40b7880 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:55.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.991+0000 7f30ed629640 1 --2- 172.21.15.78:0/522241389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30e8109150 0x7f30e819ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:55.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.991+0000 7f30ed629640 1 --2- 172.21.15.78:0/522241389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f30e81087d0 0x7f30e81998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:55.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.991+0000 7f30ed629640 1 --2- 172.21.15.78:0/522241389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e8102dc0 0x7f30e81993a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:55.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.991+0000 7f30ed629640 1 -- 172.21.15.78:0/522241389 >> 172.21.15.78:0/522241389 conn(0x7f30e80fe830 msgr2=0x7f30e8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:55.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.991+0000 7f30ed629640 1 -- 172.21.15.78:0/522241389 shutdown_connections 2024-09-11T00:15:55.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:55.991+0000 7f30ed629640 1 -- 172.21.15.78:0/522241389 wait complete. 2024-09-11T00:15:56.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:55 smithi112 ceph-mon[35627]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:56.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:55 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-11T00:15:56.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:55 smithi138 ceph-mon[35019]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:56.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:55 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-11T00:15:56.718 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:15:57.009 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:57.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:56 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-11T00:15:57.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:56 smithi078 ceph-mon[30865]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T00:15:57.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:56 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/522241389' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:57.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:56 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-11T00:15:57.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:56 smithi112 ceph-mon[35627]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T00:15:57.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:56 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/522241389' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:57.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:56 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-11T00:15:57.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:56 smithi138 ceph-mon[35019]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T00:15:57.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:56 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/522241389' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:57.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.501+0000 7f9fa14aa640 1 -- 172.21.15.78:0/851981994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f9c101cb0 msgr2=0x7f9f9c102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:57.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.501+0000 7f9fa14aa640 1 --2- 172.21.15.78:0/851981994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f9c101cb0 0x7f9f9c102090 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009900 tx=0x7f9f8c02a410 comp rx=0 tx=0).stop 2024-09-11T00:15:57.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.501+0000 7f9fa14aa640 1 -- 172.21.15.78:0/851981994 shutdown_connections 2024-09-11T00:15:57.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.501+0000 7f9fa14aa640 1 --2- 172.21.15.78:0/851981994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f9c108040 0x7f9f9c10e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:57.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.501+0000 7f9fa14aa640 1 --2- 172.21.15.78:0/851981994 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f9c1076c0 0x7f9f9c107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:57.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.501+0000 7f9fa14aa640 1 --2- 172.21.15.78:0/851981994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f9c101cb0 0x7f9f9c102090 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:57.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.501+0000 7f9fa14aa640 1 -- 172.21.15.78:0/851981994 >> 172.21.15.78:0/851981994 conn(0x7f9f9c0fd700 msgr2=0x7f9f9c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:57.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.501+0000 7f9fa14aa640 1 -- 172.21.15.78:0/851981994 shutdown_connections 2024-09-11T00:15:57.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.501+0000 7f9fa14aa640 1 -- 172.21.15.78:0/851981994 wait complete. 2024-09-11T00:15:57.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.502+0000 7f9fa14aa640 1 Processor -- start 2024-09-11T00:15:57.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.502+0000 7f9fa14aa640 1 -- start start 2024-09-11T00:15:57.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.502+0000 7f9fa14aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f9c101cb0 0x7f9f9c19a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:57.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.502+0000 7f9fa14aa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f9c1076c0 0x7f9f9c19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:57.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.502+0000 7f9fa14aa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f9c108040 0x7f9f9c19ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:57.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.502+0000 7f9fa14aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9c111d00 con 0x7f9f9c101cb0 2024-09-11T00:15:57.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.502+0000 7f9fa14aa640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9c111b80 con 0x7f9f9c1076c0 2024-09-11T00:15:57.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.502+0000 7f9fa14aa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9c111e80 con 0x7f9f9c108040 2024-09-11T00:15:57.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.502+0000 7f9f9affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f9c101cb0 0x7f9f9c19a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:57.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.502+0000 7f9f9affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f9c101cb0 0x7f9f9c19a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37910/0 (socket says 172.21.15.78:37910) 2024-09-11T00:15:57.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.502+0000 7f9f9affd640 1 -- 172.21.15.78:0/1078600201 learned_addr learned my addr 172.21.15.78:0/1078600201 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:57.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.502+0000 7f9f9b7fe640 1 --2- 172.21.15.78:0/1078600201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f9c108040 0x7f9f9c19ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:57.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.502+0000 7f9f9affd640 1 -- 172.21.15.78:0/1078600201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f9c108040 msgr2=0x7f9f9c19ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:57.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.502+0000 7f9f9affd640 1 --2- 172.21.15.78:0/1078600201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f9c108040 0x7f9f9c19ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:57.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.502+0000 7f9f9affd640 1 -- 172.21.15.78:0/1078600201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f9c1076c0 msgr2=0x7f9f9c19a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:57.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.503+0000 7f9f9affd640 1 --2- 172.21.15.78:0/1078600201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f9c1076c0 0x7f9f9c19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:57.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.503+0000 7f9f9affd640 1 -- 172.21.15.78:0/1078600201 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f9c1a5550 con 0x7f9f9c101cb0 2024-09-11T00:15:57.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.503+0000 7f9f9affd640 1 --2- 172.21.15.78:0/1078600201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f9c101cb0 0x7f9f9c19a150 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c005940 tx=0x7f9f8c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:57.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.503+0000 7f9f98ff9640 1 -- 172.21.15.78:0/1078600201 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c03f030 con 0x7f9f9c101cb0 2024-09-11T00:15:57.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.503+0000 7f9fa14aa640 1 -- 172.21.15.78:0/1078600201 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f9c1a57e0 con 0x7f9f9c101cb0 2024-09-11T00:15:57.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.503+0000 7f9f98ff9640 1 -- 172.21.15.78:0/1078600201 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f8c003cb0 con 0x7f9f9c101cb0 2024-09-11T00:15:57.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.503+0000 7f9f98ff9640 1 -- 172.21.15.78:0/1078600201 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c035070 con 0x7f9f9c101cb0 2024-09-11T00:15:57.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.503+0000 7f9fa14aa640 1 -- 172.21.15.78:0/1078600201 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f9c1a5cc0 con 0x7f9f9c101cb0 2024-09-11T00:15:57.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.504+0000 7f9fa14aa640 1 -- 172.21.15.78:0/1078600201 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f9c102090 con 0x7f9f9c101cb0 2024-09-11T00:15:57.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.505+0000 7f9f98ff9640 1 -- 172.21.15.78:0/1078600201 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 21) ==== 153318+0+0 (secure 0 0 0) 0x7f9f8c03bbf0 con 0x7f9f9c101cb0 2024-09-11T00:15:57.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.506+0000 7f9f98ff9640 1 --2- 172.21.15.78:0/1078600201 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f9f880b53c0 0x7f9f880b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:57.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.506+0000 7f9f93fff640 1 --2- 172.21.15.78:0/1078600201 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f9f880b53c0 0x7f9f880b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:57.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.506+0000 7f9f98ff9640 1 -- 172.21.15.78:0/1078600201 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f9f8c106d70 con 0x7f9f9c101cb0 2024-09-11T00:15:57.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.506+0000 7f9f93fff640 1 --2- 172.21.15.78:0/1078600201 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f9f880b53c0 0x7f9f880b7880 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9f84005fd0 tx=0x7f9f84005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:57.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.509+0000 7f9f98ff9640 1 -- 172.21.15.78:0/1078600201 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9f8c0cd9d0 con 0x7f9f9c101cb0 2024-09-11T00:15:57.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.721+0000 7f9fa14aa640 1 -- 172.21.15.78:0/1078600201 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f9c06b8c0 con 0x7f9f9c101cb0 2024-09-11T00:15:57.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.721+0000 7f9f98ff9640 1 -- 172.21.15.78:0/1078600201 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f9f8c0cd2d0 con 0x7f9f9c101cb0 2024-09-11T00:15:57.723 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:15:57.723 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:15:57.724 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:15:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.723+0000 7f9fa14aa640 1 -- 172.21.15.78:0/1078600201 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f9f880b53c0 msgr2=0x7f9f880b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.723+0000 7f9fa14aa640 1 --2- 172.21.15.78:0/1078600201 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f9f880b53c0 0x7f9f880b7880 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9f84005fd0 tx=0x7f9f84005850 comp rx=0 tx=0).stop 2024-09-11T00:15:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.723+0000 7f9fa14aa640 1 -- 172.21.15.78:0/1078600201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f9c101cb0 msgr2=0x7f9f9c19a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.723+0000 7f9fa14aa640 1 --2- 172.21.15.78:0/1078600201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f9c101cb0 0x7f9f9c19a150 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c005940 tx=0x7f9f8c0042f0 comp rx=0 tx=0).stop 2024-09-11T00:15:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.723+0000 7f9fa14aa640 1 -- 172.21.15.78:0/1078600201 shutdown_connections 2024-09-11T00:15:57.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.723+0000 7f9fa14aa640 1 --2- 172.21.15.78:0/1078600201 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f9f880b53c0 0x7f9f880b7880 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:57.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.723+0000 7f9fa14aa640 1 --2- 172.21.15.78:0/1078600201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f9c108040 0x7f9f9c19ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:57.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.723+0000 7f9fa14aa640 1 --2- 172.21.15.78:0/1078600201 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9f9c1076c0 0x7f9f9c19a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:57.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.723+0000 7f9fa14aa640 1 --2- 172.21.15.78:0/1078600201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f9c101cb0 0x7f9f9c19a150 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:57.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.723+0000 7f9fa14aa640 1 -- 172.21.15.78:0/1078600201 >> 172.21.15.78:0/1078600201 conn(0x7f9f9c0fd700 msgr2=0x7f9f9c0fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:57.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.724+0000 7f9fa14aa640 1 -- 172.21.15.78:0/1078600201 shutdown_connections 2024-09-11T00:15:57.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:57.724+0000 7f9fa14aa640 1 -- 172.21.15.78:0/1078600201 wait complete. 2024-09-11T00:15:58.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:57 smithi078 ceph-mon[30865]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T00:15:58.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:57 smithi078 ceph-mon[30865]: pgmap v308: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:58.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:57 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1078600201' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:58.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:57 smithi112 ceph-mon[35627]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T00:15:58.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:57 smithi112 ceph-mon[35627]: pgmap v308: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:58.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:57 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1078600201' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:58.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:57 smithi138 ceph-mon[35019]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T00:15:58.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:57 smithi138 ceph-mon[35019]: pgmap v308: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:15:58.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:57 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1078600201' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:15:58.441 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:15:58.687 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:15:59.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:58 smithi078 ceph-mon[30865]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-11T00:15:59.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:58 smithi078 ceph-mon[30865]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-11T00:15:59.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.193+0000 7f20f69b3640 1 -- 172.21.15.78:0/551797663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f0102dc0 msgr2=0x7f20f01031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:59.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.193+0000 7f20f69b3640 1 --2- 172.21.15.78:0/551797663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f0102dc0 0x7f20f01031a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009900 tx=0x7f20e002a410 comp rx=0 tx=0).stop 2024-09-11T00:15:59.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.193+0000 7f20f69b3640 1 -- 172.21.15.78:0/551797663 shutdown_connections 2024-09-11T00:15:59.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.194+0000 7f20f69b3640 1 --2- 172.21.15.78:0/551797663 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20f0109150 0x7f20f010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:59.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.194+0000 7f20f69b3640 1 --2- 172.21.15.78:0/551797663 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20f01087d0 0x7f20f0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:59.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.194+0000 7f20f69b3640 1 --2- 172.21.15.78:0/551797663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f0102dc0 0x7f20f01031a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:59.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.194+0000 7f20f69b3640 1 -- 172.21.15.78:0/551797663 >> 172.21.15.78:0/551797663 conn(0x7f20f00fe830 msgr2=0x7f20f0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:59.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.194+0000 7f20f69b3640 1 -- 172.21.15.78:0/551797663 shutdown_connections 2024-09-11T00:15:59.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.194+0000 7f20f69b3640 1 -- 172.21.15.78:0/551797663 wait complete. 2024-09-11T00:15:59.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.194+0000 7f20f69b3640 1 Processor -- start 2024-09-11T00:15:59.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.194+0000 7f20f69b3640 1 -- start start 2024-09-11T00:15:59.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.194+0000 7f20f69b3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20f0102dc0 0x7f20f0199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:59.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.194+0000 7f20f69b3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20f01087d0 0x7f20f0199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:59.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.194+0000 7f20f69b3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f0109150 0x7f20f019ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:59.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.194+0000 7f20f69b3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f20f0112e10 con 0x7f20f0109150 2024-09-11T00:15:59.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.194+0000 7f20f69b3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f20f0112c90 con 0x7f20f0102dc0 2024-09-11T00:15:59.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.194+0000 7f20f69b3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f20f0112f90 con 0x7f20f01087d0 2024-09-11T00:15:59.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.194+0000 7f20f4f50640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f0109150 0x7f20f019ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:59.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.194+0000 7f20f4f50640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f0109150 0x7f20f019ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37924/0 (socket says 172.21.15.78:37924) 2024-09-11T00:15:59.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.194+0000 7f20f4f50640 1 -- 172.21.15.78:0/2538274225 learned_addr learned my addr 172.21.15.78:0/2538274225 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:15:59.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.195+0000 7f20e7fff640 1 --2- 172.21.15.78:0/2538274225 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20f01087d0 0x7f20f0199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:59.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.195+0000 7f20effff640 1 --2- 172.21.15.78:0/2538274225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20f0102dc0 0x7f20f0199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:59.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.195+0000 7f20f4f50640 1 -- 172.21.15.78:0/2538274225 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20f01087d0 msgr2=0x7f20f0199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:59.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.195+0000 7f20f4f50640 1 --2- 172.21.15.78:0/2538274225 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20f01087d0 0x7f20f0199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:59.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.195+0000 7f20f4f50640 1 -- 172.21.15.78:0/2538274225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20f0102dc0 msgr2=0x7f20f0199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:59.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.195+0000 7f20f4f50640 1 --2- 172.21.15.78:0/2538274225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20f0102dc0 0x7f20f0199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:59.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.195+0000 7f20f4f50640 1 -- 172.21.15.78:0/2538274225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f019f3b0 con 0x7f20f0109150 2024-09-11T00:15:59.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.195+0000 7f20f4f50640 1 --2- 172.21.15.78:0/2538274225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f0109150 0x7f20f019ebe0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f20e800cad0 tx=0x7f20e800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:59.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.195+0000 7f20edffb640 1 -- 172.21.15.78:0/2538274225 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e800ae20 con 0x7f20f0109150 2024-09-11T00:15:59.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.195+0000 7f20edffb640 1 -- 172.21.15.78:0/2538274225 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20e8005020 con 0x7f20f0109150 2024-09-11T00:15:59.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.195+0000 7f20f69b3640 1 -- 172.21.15.78:0/2538274225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f019f6a0 con 0x7f20f0109150 2024-09-11T00:15:59.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.195+0000 7f20edffb640 1 -- 172.21.15.78:0/2538274225 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e800f6b0 con 0x7f20f0109150 2024-09-11T00:15:59.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.195+0000 7f20f69b3640 1 -- 172.21.15.78:0/2538274225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f01a5d60 con 0x7f20f0109150 2024-09-11T00:15:59.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.196+0000 7f20f69b3640 1 -- 172.21.15.78:0/2538274225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f01031a0 con 0x7f20f0109150 2024-09-11T00:15:59.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.198+0000 7f20edffb640 1 -- 172.21.15.78:0/2538274225 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f20e80054f0 con 0x7f20f0109150 2024-09-11T00:15:59.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.198+0000 7f20edffb640 1 --2- 172.21.15.78:0/2538274225 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f20dc0b5330 0x7f20dc0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:15:59.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.198+0000 7f20effff640 1 --2- 172.21.15.78:0/2538274225 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f20dc0b5330 0x7f20dc0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:15:59.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.198+0000 7f20edffb640 1 -- 172.21.15.78:0/2538274225 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f20e80e5c80 con 0x7f20f0109150 2024-09-11T00:15:59.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.199+0000 7f20effff640 1 --2- 172.21.15.78:0/2538274225 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f20dc0b5330 0x7f20dc0b77f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f20e0031440 tx=0x7f20e0005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:15:59.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.202+0000 7f20edffb640 1 -- 172.21.15.78:0/2538274225 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f20e8014030 con 0x7f20f0109150 2024-09-11T00:15:59.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:58 smithi112 ceph-mon[35627]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-11T00:15:59.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:58 smithi112 ceph-mon[35627]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-11T00:15:59.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:58 smithi138 ceph-mon[35019]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-11T00:15:59.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:58 smithi138 ceph-mon[35019]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-11T00:15:59.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.378+0000 7f20f69b3640 1 -- 172.21.15.78:0/2538274225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20f010a9a0 con 0x7f20f0109150 2024-09-11T00:15:59.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.379+0000 7f20edffb640 1 -- 172.21.15.78:0/2538274225 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+23218 (secure 0 0 0) 0x7f20e80ac3f0 con 0x7f20f0109150 2024-09-11T00:15:59.381 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:15:59.381 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":79,"fsid":"85a53860-6fd1-11ef-bcea-c7b262605968","created":"2024-09-11T00:06:05.704745+0000","modified":"2024-09-11T00:15:56.809478+0000","last_up_change":"2024-09-11T00:13:35.307216+0000","last_in_change":"2024-09-11T00:13:12.730667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:09:47.891696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:22.345345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:24.446029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d260c219-52f2-4e7f-9188-9e66ee01dacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6803","nonce":3736366730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6805","nonce":3736366730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6809","nonce":3736366730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6807","nonce":3736366730}]},"public_addr":"172.21.15.78:6803/3736366730","cluster_addr":"172.21.15.78:6805/3736366730","heartbeat_back_addr":"172.21.15.78:6809/3736366730","heartbeat_front_addr":"172.21.15.78:6807/3736366730","state":["exists","up"]},{"osd":1,"uuid":"d0f286a2-a121-40ee-8134-67ef01b1bc9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6801","nonce":3186321784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6803","nonce":3186321784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6807","nonce":3186321784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6805","nonce":3186321784}]},"public_addr":"172.21.15.112:6801/3186321784","cluster_addr":"172.21.15.112:6803/3186321784","heartbeat_back_addr":"172.21.15.112:6807/3186321784","heartbeat_front_addr":"172.21.15.112:6805/3186321784","state":["exists","up"]},{"osd":2,"uuid":"0eadcce5-12af-4af6-9b4e-159e84454d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6801","nonce":3206386630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6803","nonce":3206386630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6807","nonce":3206386630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6805","nonce":3206386630}]},"public_addr":"172.21.15.138:6801/3206386630","cluster_addr":"172.21.15.138:6803/3206386630","heartbeat_back_addr":"172.21.15.138:6807/3206386630","heartbeat_front_addr":"172.21.15.138:6805/3206386630","state":["exists","up"]},{"osd":3,"uuid":"5f3f683d-6306-43da-8bbd-c103eca442ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6811","nonce":3832405256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6813","nonce":3832405256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6817","nonce":3832405256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6815","nonce":3832405256}]},"public_addr":"172.21.15.78:6811/3832405256","cluster_addr":"172.21.15.78:6813/3832405256","heartbeat_back_addr":"172.21.15.78:6817/3832405256","heartbeat_front_addr":"172.21.15.78:6815/3832405256","state":["exists","up"]},{"osd":4,"uuid":"4575a0a5-821e-4346-84ac-5396042b0550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6809","nonce":2650243435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6811","nonce":2650243435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6815","nonce":2650243435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6813","nonce":2650243435}]},"public_addr":"172.21.15.112:6809/2650243435","cluster_addr":"172.21.15.112:6811/2650243435","heartbeat_back_addr":"172.21.15.112:6815/2650243435","heartbeat_front_addr":"172.21.15.112:6813/2650243435","state":["exists","up"]},{"osd":5,"uuid":"e81eb98f-76eb-4da5-8047-f160888720e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6809","nonce":3033110975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6811","nonce":3033110975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6815","nonce":3033110975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6813","nonce":3033110975}]},"public_addr":"172.21.15.138:6809/3033110975","cluster_addr":"172.21.15.138:6811/3033110975","heartbeat_back_addr":"172.21.15.138:6815/3033110975","heartbeat_front_addr":"172.21.15.138:6813/3033110975","state":["exists","up"]},{"osd":6,"uuid":"7442a091-4dba-45c4-808b-7c3b97087aa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6819","nonce":477087575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6821","nonce":477087575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6825","nonce":477087575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6823","nonce":477087575}]},"public_addr":"172.21.15.78:6819/477087575","cluster_addr":"172.21.15.78:6821/477087575","heartbeat_back_addr":"172.21.15.78:6825/477087575","heartbeat_front_addr":"172.21.15.78:6823/477087575","state":["exists","up"]},{"osd":7,"uuid":"220c1f03-ace9-4dd0-a06d-485b0d2d08bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6817","nonce":1481363296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6819","nonce":1481363296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6823","nonce":1481363296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6821","nonce":1481363296}]},"public_addr":"172.21.15.112:6817/1481363296","cluster_addr":"172.21.15.112:6819/1481363296","heartbeat_back_addr":"172.21.15.112:6823/1481363296","heartbeat_front_addr":"172.21.15.112:6821/1481363296","state":["exists","up"]},{"osd":8,"uuid":"adb6edaa-9a8c-4b0b-aa6a-26dc77a3a7cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6817","nonce":2195149036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6819","nonce":2195149036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6823","nonce":2195149036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6821","nonce":2195149036}]},"public_addr":"172.21.15.138:6817/2195149036","cluster_addr":"172.21.15.138:6819/2195149036","heartbeat_back_addr":"172.21.15.138:6823/2195149036","heartbeat_front_addr":"172.21.15.138:6821/2195149036","state":["exists","up"]},{"osd":9,"uuid":"dd01f408-3712-410e-acbd-c797b7ea5058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6827","nonce":3367249449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6829","nonce":3367249449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6833","nonce":3367249449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6831","nonce":3367249449}]},"public_addr":"172.21.15.78:6827/3367249449","cluster_addr":"172.21.15.78:6829/3367249449","heartbeat_back_addr":"172.21.15.78:6833/3367249449","heartbeat_front_addr":"172.21.15.78:6831/3367249449","state":["exists","up"]},{"osd":10,"uuid":"243c6483-1b0e-49f2-b99c-116d9e9c0617","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6825","nonce":775023408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6827","nonce":775023408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6831","nonce":775023408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6829","nonce":775023408}]},"public_addr":"172.21.15.112:6825/775023408","cluster_addr":"172.21.15.112:6827/775023408","heartbeat_back_addr":"172.21.15.112:6831/775023408","heartbeat_front_addr":"172.21.15.112:6829/775023408","state":["exists","up"]},{"osd":11,"uuid":"fa20ac9e-b5f7-4b3a-bb51-31569f909609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6825","nonce":4046089012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6827","nonce":4046089012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6831","nonce":4046089012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6829","nonce":4046089012}]},"public_addr":"172.21.15.138:6825/4046089012","cluster_addr":"172.21.15.138:6827/4046089012","heartbeat_back_addr":"172.21.15.138:6831/4046089012","heartbeat_front_addr":"172.21.15.138:6829/4046089012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:08:55.896475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:20.695819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:44.785187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:10.858705+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:35.855800+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:01.353037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:27.492985+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:52.860532+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:17.946878+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:43.188966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:08.369978+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:34.192288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":8}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6801/2525199237":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/1476776463":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1949658157":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2276853910":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/4205790529":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6800/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/4286825123":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6801/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1304243506":"2024-09-12T00:06:56.062555+0000","172.21.15.78:6800/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1614270050":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6801/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1679390655":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2957982486":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6800/2525199237":"2024-09-12T00:07:55.586578+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:15:59.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.382+0000 7f20f69b3640 1 -- 172.21.15.78:0/2538274225 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f20dc0b5330 msgr2=0x7f20dc0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:59.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.382+0000 7f20f69b3640 1 --2- 172.21.15.78:0/2538274225 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f20dc0b5330 0x7f20dc0b77f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f20e0031440 tx=0x7f20e0005b50 comp rx=0 tx=0).stop 2024-09-11T00:15:59.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.382+0000 7f20f69b3640 1 -- 172.21.15.78:0/2538274225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f0109150 msgr2=0x7f20f019ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:15:59.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.382+0000 7f20f69b3640 1 --2- 172.21.15.78:0/2538274225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f0109150 0x7f20f019ebe0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f20e800cad0 tx=0x7f20e800cf90 comp rx=0 tx=0).stop 2024-09-11T00:15:59.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.382+0000 7f20f69b3640 1 -- 172.21.15.78:0/2538274225 shutdown_connections 2024-09-11T00:15:59.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.382+0000 7f20f69b3640 1 --2- 172.21.15.78:0/2538274225 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f20dc0b5330 0x7f20dc0b77f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:59.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.382+0000 7f20f69b3640 1 --2- 172.21.15.78:0/2538274225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f0109150 0x7f20f019ebe0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:59.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.382+0000 7f20f69b3640 1 --2- 172.21.15.78:0/2538274225 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20f01087d0 0x7f20f0199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:59.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.382+0000 7f20f69b3640 1 --2- 172.21.15.78:0/2538274225 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f20f0102dc0 0x7f20f0199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:15:59.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.382+0000 7f20f69b3640 1 -- 172.21.15.78:0/2538274225 >> 172.21.15.78:0/2538274225 conn(0x7f20f00fe830 msgr2=0x7f20f0100170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:15:59.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.382+0000 7f20f69b3640 1 -- 172.21.15.78:0/2538274225 shutdown_connections 2024-09-11T00:15:59.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:15:59.382+0000 7f20f69b3640 1 -- 172.21.15.78:0/2538274225 wait complete. 2024-09-11T00:16:00.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:59 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2538274225' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:16:00.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:15:59 smithi078 ceph-mon[30865]: pgmap v309: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-11T00:16:00.184 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T00:14:26.461738+0000', 'modified': '2024-09-11T00:14:35.614720+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24593}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24589': {'gid': 24589, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.138:6839/1175492512', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6838', 'nonce': 1175492512}, {'type': 'v1', 'addr': '172.21.15.138:6839', 'nonce': 1175492512}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24593': {'gid': 24593, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.112:6839/433500133', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6838', 'nonce': 433500133}, {'type': 'v1', 'addr': '172.21.15.112:6839', 'nonce': 433500133}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24593, 'qdb_cluster': [24593]} 2024-09-11T00:16:00.184 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T00:16:00.184 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T00:16:00.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:59 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2538274225' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:16:00.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:15:59 smithi112 ceph-mon[35627]: pgmap v309: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-11T00:16:00.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:59 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2538274225' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:16:00.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:15:59 smithi138 ceph-mon[35019]: pgmap v309: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-11T00:16:00.435 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:16:00.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.948+0000 7f3dda256640 1 -- 172.21.15.78:0/3439681440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dd4107740 msgr2=0x7f3dd4107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:00.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.948+0000 7f3dda256640 1 --2- 172.21.15.78:0/3439681440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dd4107740 0x7f3dd4107b80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009900 tx=0x7f3dc802a410 comp rx=0 tx=0).stop 2024-09-11T00:16:00.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.948+0000 7f3dda256640 1 -- 172.21.15.78:0/3439681440 shutdown_connections 2024-09-11T00:16:00.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.948+0000 7f3dda256640 1 --2- 172.21.15.78:0/3439681440 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dd41080c0 0x7f3dd410e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.948+0000 7f3dda256640 1 --2- 172.21.15.78:0/3439681440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dd4107740 0x7f3dd4107b80 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.948+0000 7f3dda256640 1 --2- 172.21.15.78:0/3439681440 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dd4101d30 0x7f3dd4102110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.948+0000 7f3dda256640 1 -- 172.21.15.78:0/3439681440 >> 172.21.15.78:0/3439681440 conn(0x7f3dd40fd7e0 msgr2=0x7f3dd40ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.948+0000 7f3dda256640 1 -- 172.21.15.78:0/3439681440 shutdown_connections 2024-09-11T00:16:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.948+0000 7f3dda256640 1 -- 172.21.15.78:0/3439681440 wait complete. 2024-09-11T00:16:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.949+0000 7f3dda256640 1 Processor -- start 2024-09-11T00:16:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.949+0000 7f3dda256640 1 -- start start 2024-09-11T00:16:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.949+0000 7f3dda256640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dd4101d30 0x7f3dd419a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.949+0000 7f3dda256640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dd4107740 0x7f3dd419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.949+0000 7f3dda256640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dd41080c0 0x7f3dd419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.949+0000 7f3dda256640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd4111d40 con 0x7f3dd4101d30 2024-09-11T00:16:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.949+0000 7f3dda256640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd4111bc0 con 0x7f3dd4107740 2024-09-11T00:16:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.949+0000 7f3dda256640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd4111ec0 con 0x7f3dd41080c0 2024-09-11T00:16:00.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.949+0000 7f3dd37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dd4101d30 0x7f3dd419a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:00.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.949+0000 7f3dd37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dd4101d30 0x7f3dd419a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37946/0 (socket says 172.21.15.78:37946) 2024-09-11T00:16:00.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.949+0000 7f3dd37fe640 1 -- 172.21.15.78:0/1496913281 learned_addr learned my addr 172.21.15.78:0/1496913281 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:00.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.950+0000 7f3dd3fff640 1 --2- 172.21.15.78:0/1496913281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dd41080c0 0x7f3dd419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:00.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.950+0000 7f3dd2ffd640 1 --2- 172.21.15.78:0/1496913281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dd4107740 0x7f3dd419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:00.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.950+0000 7f3dd37fe640 1 -- 172.21.15.78:0/1496913281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dd41080c0 msgr2=0x7f3dd419abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:00.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.950+0000 7f3dd37fe640 1 --2- 172.21.15.78:0/1496913281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dd41080c0 0x7f3dd419abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.950+0000 7f3dd37fe640 1 -- 172.21.15.78:0/1496913281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dd4107740 msgr2=0x7f3dd419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:00.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.950+0000 7f3dd37fe640 1 --2- 172.21.15.78:0/1496913281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dd4107740 0x7f3dd419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.950+0000 7f3dd37fe640 1 -- 172.21.15.78:0/1496913281 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd41a5530 con 0x7f3dd4101d30 2024-09-11T00:16:00.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.950+0000 7f3dd37fe640 1 --2- 172.21.15.78:0/1496913281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dd4101d30 0x7f3dd419a150 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400d950 tx=0x7f3dc400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:00.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.950+0000 7f3dd0ff9640 1 -- 172.21.15.78:0/1496913281 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4017070 con 0x7f3dd4101d30 2024-09-11T00:16:00.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.950+0000 7f3dd0ff9640 1 -- 172.21.15.78:0/1496913281 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3dc4009c30 con 0x7f3dd4101d30 2024-09-11T00:16:00.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.950+0000 7f3dda256640 1 -- 172.21.15.78:0/1496913281 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd41a5820 con 0x7f3dd4101d30 2024-09-11T00:16:00.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.950+0000 7f3dd0ff9640 1 -- 172.21.15.78:0/1496913281 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc400f620 con 0x7f3dd4101d30 2024-09-11T00:16:00.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.950+0000 7f3dda256640 1 -- 172.21.15.78:0/1496913281 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd41a5d30 con 0x7f3dd4101d30 2024-09-11T00:16:00.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.952+0000 7f3dd0ff9640 1 -- 172.21.15.78:0/1496913281 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f3dc4010460 con 0x7f3dd4101d30 2024-09-11T00:16:00.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.953+0000 7f3ddc62b740 1 Processor -- start 2024-09-11T00:16:00.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.953+0000 7f3ddc62b740 1 -- start start 2024-09-11T00:16:00.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.953+0000 7f3ddc62b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e3851d30 0x5581e3852110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:00.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.953+0000 7f3ddc62b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5581e3852650 0x5581e38624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:00.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.953+0000 7f3ddc62b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581e38629f0 0x5581e3864de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:00.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.953+0000 7f3ddc62b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5581e37c9c10 con 0x5581e3851d30 2024-09-11T00:16:00.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.953+0000 7f3ddc62b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5581e37b9040 con 0x5581e38629f0 2024-09-11T00:16:00.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.953+0000 7f3ddc62b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5581e37bce50 con 0x5581e3852650 2024-09-11T00:16:00.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.953+0000 7f3dd3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e3851d30 0x5581e3852110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:00.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.953+0000 7f3dd3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e3851d30 0x5581e3852110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37956/0 (socket says 172.21.15.78:37956) 2024-09-11T00:16:00.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.953+0000 7f3dd3fff640 1 -- 172.21.15.78:0/3484147944 learned_addr learned my addr 172.21.15.78:0/3484147944 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:00.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.953+0000 7f3dd2ffd640 1 --2- 172.21.15.78:0/3484147944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581e38629f0 0x5581e3864de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:00.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.953+0000 7f3dd3fff640 1 -- 172.21.15.78:0/3484147944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5581e3852650 msgr2=0x5581e38624b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:00.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.953+0000 7f3dd0ff9640 1 --2- 172.21.15.78:0/1496913281 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3dbc0b5330 0x7f3dbc0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:00.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.953+0000 7f3dd37fe640 1 --2- 172.21.15.78:0/3484147944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5581e3852650 0x5581e38624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:00.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.953+0000 7f3dd3fff640 1 --2- 172.21.15.78:0/3484147944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5581e3852650 0x5581e38624b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.954+0000 7f3dd3fff640 1 -- 172.21.15.78:0/3484147944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581e38629f0 msgr2=0x5581e3864de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:00.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.954+0000 7f3dd3fff640 1 --2- 172.21.15.78:0/3484147944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581e38629f0 0x5581e3864de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.954+0000 7f3dd3fff640 1 -- 172.21.15.78:0/3484147944 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581e3517540 con 0x5581e3851d30 2024-09-11T00:16:00.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.954+0000 7f3dd2ffd640 1 --2- 172.21.15.78:0/3484147944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581e38629f0 0x5581e3864de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:16:00.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.954+0000 7f3dd37fe640 1 --2- 172.21.15.78:0/3484147944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5581e3852650 0x5581e38624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:16:00.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.954+0000 7f3dd0ff9640 1 -- 172.21.15.78:0/1496913281 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f3dc40e5970 con 0x7f3dd4101d30 2024-09-11T00:16:00.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.954+0000 7f3dd3fff640 1 --2- 172.21.15.78:0/3484147944 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e3851d30 0x5581e3852110 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc010370 tx=0x7f3dcc010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a575dd8d2499596 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:00.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.954+0000 7f3dd3fff640 1 --2- 172.21.15.78:0/1496913281 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3dbc0b5330 0x7f3dbc0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:00.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.954+0000 7f3db9ffb640 1 -- 172.21.15.78:0/3484147944 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc016070 con 0x5581e3851d30 2024-09-11T00:16:00.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.954+0000 7f3db9ffb640 1 -- 172.21.15.78:0/3484147944 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3dcc01b460 con 0x5581e3851d30 2024-09-11T00:16:00.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.954+0000 7f3db9ffb640 1 -- 172.21.15.78:0/3484147944 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc0116a0 con 0x5581e3851d30 2024-09-11T00:16:00.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.955+0000 7f3ddc62b740 1 -- 172.21.15.78:0/3484147944 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e3851d30 msgr2=0x5581e3852110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:00.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.955+0000 7f3dd3fff640 1 --2- 172.21.15.78:0/1496913281 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3dbc0b5330 0x7f3dbc0b77f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc01a000 tx=0x7f3dcc011dc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:00.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.955+0000 7f3ddc62b740 1 --2- 172.21.15.78:0/3484147944 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e3851d30 0x5581e3852110 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc010370 tx=0x7f3dcc010830 comp rx=0 tx=0).stop 2024-09-11T00:16:00.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.955+0000 7f3ddc62b740 1 -- 172.21.15.78:0/3484147944 shutdown_connections 2024-09-11T00:16:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.955+0000 7f3ddc62b740 1 --2- 172.21.15.78:0/3484147944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581e38629f0 0x5581e3864de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.955+0000 7f3ddc62b740 1 --2- 172.21.15.78:0/3484147944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5581e3852650 0x5581e38624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.955+0000 7f3ddc62b740 1 --2- 172.21.15.78:0/3484147944 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e3851d30 0x5581e3852110 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.955+0000 7f3ddc62b740 1 -- 172.21.15.78:0/3484147944 >> 172.21.15.78:0/3484147944 conn(0x5581e384fb60 msgr2=0x5581e3850d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.955+0000 7f3ddc62b740 1 -- 172.21.15.78:0/3484147944 shutdown_connections 2024-09-11T00:16:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.955+0000 7f3ddc62b740 1 -- 172.21.15.78:0/3484147944 wait complete. 2024-09-11T00:16:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.955+0000 7f3ddc62b740 1 -- start start 2024-09-11T00:16:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.955+0000 7f3ddc62b740 1 Processor -- start 2024-09-11T00:16:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3ddc62b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5581e3851d30 0x5581e385f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3ddc62b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581e3852650 0x5581e385ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3ddc62b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e38629f0 0x5581e3860470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3ddc62b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5581e361a5f0 con 0x5581e38629f0 2024-09-11T00:16:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3ddc62b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5581e3754010 con 0x5581e3852650 2024-09-11T00:16:00.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3ddc62b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5581e38656a0 con 0x5581e3851d30 2024-09-11T00:16:00.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3ddc62b740 10 client.0 _ll_register_callbacks cb 0x5581e37b3340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:16:00.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3dd3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e38629f0 0x5581e3860470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:00.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3dd3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e38629f0 0x5581e3860470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37972/0 (socket says 172.21.15.78:37972) 2024-09-11T00:16:00.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3dd3fff640 1 -- 172.21.15.78:0/1565731031 learned_addr learned my addr 172.21.15.78:0/1565731031 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:00.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3dd37fe640 1 --2- 172.21.15.78:0/1565731031 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5581e3851d30 0x5581e385f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:00.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3dd2ffd640 1 --2- 172.21.15.78:0/1565731031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581e3852650 0x5581e385ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:00.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3dd3fff640 1 -- 172.21.15.78:0/1565731031 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5581e3851d30 msgr2=0x5581e385f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:00.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3dd3fff640 1 --2- 172.21.15.78:0/1565731031 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5581e3851d30 0x5581e385f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3dd3fff640 1 -- 172.21.15.78:0/1565731031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581e3852650 msgr2=0x5581e385ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:00.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3dd3fff640 1 --2- 172.21.15.78:0/1565731031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581e3852650 0x5581e385ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3dd3fff640 1 -- 172.21.15.78:0/1565731031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581e3781a00 con 0x5581e38629f0 2024-09-11T00:16:00.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3dd37fe640 1 --2- 172.21.15.78:0/1565731031 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5581e3851d30 0x5581e385f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:16:00.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3dd3fff640 1 --2- 172.21.15.78:0/1565731031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e38629f0 0x5581e3860470 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0099d0 tx=0x7f3dcc01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2579abba1bb376 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:00.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3db2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:16:00.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3db2ffd640 1 -- 172.21.15.78:0/1565731031 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc035060 con 0x5581e38629f0 2024-09-11T00:16:00.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3ddc62b740 1 -- 172.21.15.78:0/1565731031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dcc01b460 con 0x5581e38629f0 2024-09-11T00:16:00.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.956+0000 7f3db2ffd640 1 -- 172.21.15.78:0/1565731031 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f3dcc0125d0 con 0x5581e38629f0 2024-09-11T00:16:00.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.957+0000 7f3db2ffd640 1 -- 172.21.15.78:0/1565731031 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3dcc016040 con 0x5581e38629f0 2024-09-11T00:16:00.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.957+0000 7f3ddc62b740 10 client.15213 fetch_fsmap learned FSMap version 20 2024-09-11T00:16:00.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.957+0000 7f3ddc62b740 1 -- 172.21.15.78:0/1565731031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5581e3871200 con 0x5581e38629f0 2024-09-11T00:16:00.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.957+0000 7f3db2ffd640 1 -- 172.21.15.78:0/1565731031 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3dcc01b460 con 0x5581e38629f0 2024-09-11T00:16:00.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.957+0000 7f3db2ffd640 1 -- 172.21.15.78:0/1565731031 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3dcc00f040 con 0x5581e38629f0 2024-09-11T00:16:00.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.957+0000 7f3ddc62b740 10 client.15213 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:16:00.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.957+0000 7f3ddc62b740 10 client.15213 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T00:16:00.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.957+0000 7f3ddc62b740 20 client.15213 populate_metadata read hostname 'smithi078' 2024-09-11T00:16:00.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.957+0000 7f3ddc62b740 1 --2- 172.21.15.78:0/1565731031 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5581e38734a0 0x5581e3874910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:00.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.957+0000 7f3ddc62b740 4 client.15213 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:16:00.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.957+0000 7f3ddc62b740 1 -- 172.21.15.78:0/1565731031 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581e37cbb60 con 0x5581e38734a0 2024-09-11T00:16:00.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.957+0000 7f3dd37fe640 1 --2- 172.21.15.78:0/1565731031 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5581e38734a0 0x5581e3874910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:00.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.958+0000 7f3dd37fe640 1 --2- 172.21.15.78:0/1565731031 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5581e38734a0 0x5581e3874910 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb399384f52576dd server_cookie=ce643850f1cd1e9c in_seq=0 out_seq=0 2024-09-11T00:16:00.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.958+0000 7f3db2ffd640 10 client.15213 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:00.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.958+0000 7f3db2ffd640 1 -- 172.21.15.78:0/1565731031 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5581e37cbb60 con 0x5581e38734a0 2024-09-11T00:16:00.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.958+0000 7f3db2ffd640 10 client.15213 handle_command_reply: tid=0 2024-09-11T00:16:00.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.958+0000 7f3ddc62b740 1 client.15213 shutdown 2024-09-11T00:16:00.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.958+0000 7f3ddc62b740 1 -- 172.21.15.78:0/1565731031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e38629f0 msgr2=0x5581e3860470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:00.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.958+0000 7f3ddc62b740 1 --2- 172.21.15.78:0/1565731031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e38629f0 0x5581e3860470 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0099d0 tx=0x7f3dcc01b000 comp rx=0 tx=0).stop 2024-09-11T00:16:00.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.959+0000 7f3ddc62b740 1 -- 172.21.15.78:0/1565731031 shutdown_connections 2024-09-11T00:16:00.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.959+0000 7f3ddc62b740 1 --2- 172.21.15.78:0/1565731031 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5581e38734a0 0x5581e3874910 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.959+0000 7f3ddc62b740 1 --2- 172.21.15.78:0/1565731031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e38629f0 0x5581e3860470 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.959+0000 7f3ddc62b740 1 --2- 172.21.15.78:0/1565731031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581e3852650 0x5581e385ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.959+0000 7f3ddc62b740 1 --2- 172.21.15.78:0/1565731031 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5581e3851d30 0x5581e385f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.959+0000 7f3db2ffd640 0 client.15213 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:00.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.959+0000 7f3ddc62b740 1 -- 172.21.15.78:0/1565731031 >> 172.21.15.78:0/1565731031 conn(0x5581e384fb60 msgr2=0x5581e384ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:00.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.959+0000 7f3ddc62b740 1 -- 172.21.15.78:0/1565731031 shutdown_connections 2024-09-11T00:16:00.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.959+0000 7f3ddc62b740 1 -- 172.21.15.78:0/1565731031 wait complete. 2024-09-11T00:16:00.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.959+0000 7f3ddc62b740 20 client.15213 trim_cache size 0 max 16384 2024-09-11T00:16:00.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.976+0000 7f3ddc62b740 1 Processor -- start 2024-09-11T00:16:00.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.976+0000 7f3ddc62b740 1 -- start start 2024-09-11T00:16:00.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.977+0000 7f3ddc62b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e3851d30 0x5581e384f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:00.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.977+0000 7f3ddc62b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5581e3852650 0x5581e385d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:00.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.977+0000 7f3ddc62b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581e38629f0 0x5581e385ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:00.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.977+0000 7f3ddc62b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5581e3872c50 con 0x5581e3851d30 2024-09-11T00:16:00.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.977+0000 7f3ddc62b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5581e3873320 con 0x5581e38629f0 2024-09-11T00:16:00.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.977+0000 7f3ddc62b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5581e38739f0 con 0x5581e3852650 2024-09-11T00:16:00.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.977+0000 7f3dd37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e3851d30 0x5581e384f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:00.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.977+0000 7f3dd37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e3851d30 0x5581e384f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37980/0 (socket says 172.21.15.78:37980) 2024-09-11T00:16:00.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.977+0000 7f3dd37fe640 1 -- 172.21.15.78:0/1751137047 learned_addr learned my addr 172.21.15.78:0/1751137047 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:00.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.977+0000 7f3dd2ffd640 1 --2- 172.21.15.78:0/1751137047 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5581e3852650 0x5581e385d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:00.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.977+0000 7f3dd37fe640 1 -- 172.21.15.78:0/1751137047 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5581e3852650 msgr2=0x5581e385d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:00.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.977+0000 7f3dd37fe640 1 --2- 172.21.15.78:0/1751137047 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5581e3852650 0x5581e385d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.977+0000 7f3dd37fe640 1 -- 172.21.15.78:0/1751137047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581e38629f0 msgr2=0x5581e385ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:00.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.977+0000 7f3dd37fe640 1 --2- 172.21.15.78:0/1751137047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581e38629f0 0x5581e385ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.977+0000 7f3dd37fe640 1 -- 172.21.15.78:0/1751137047 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581e384b4f0 con 0x5581e3851d30 2024-09-11T00:16:00.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.977+0000 7f3dd37fe640 1 --2- 172.21.15.78:0/1751137047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e3851d30 0x5581e384f4f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40a8650 tx=0x7f3dc40e31e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5f66363ae3da2c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:00.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.977+0000 7f3db97fa640 1 -- 172.21.15.78:0/1751137047 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4020040 con 0x5581e3851d30 2024-09-11T00:16:00.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.977+0000 7f3db97fa640 1 -- 172.21.15.78:0/1751137047 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3dc4091e50 con 0x5581e3851d30 2024-09-11T00:16:00.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.977+0000 7f3db97fa640 1 -- 172.21.15.78:0/1751137047 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc40109e0 con 0x5581e3851d30 2024-09-11T00:16:00.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.978+0000 7f3ddc62b740 1 -- 172.21.15.78:0/1751137047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e3851d30 msgr2=0x5581e384f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:00.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.978+0000 7f3ddc62b740 1 --2- 172.21.15.78:0/1751137047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e3851d30 0x5581e384f4f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40a8650 tx=0x7f3dc40e31e0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.978+0000 7f3ddc62b740 1 -- 172.21.15.78:0/1751137047 shutdown_connections 2024-09-11T00:16:00.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.978+0000 7f3ddc62b740 1 --2- 172.21.15.78:0/1751137047 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581e38629f0 0x5581e385ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.978+0000 7f3ddc62b740 1 --2- 172.21.15.78:0/1751137047 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5581e3852650 0x5581e385d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.978+0000 7f3ddc62b740 1 --2- 172.21.15.78:0/1751137047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e3851d30 0x5581e384f4f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.978+0000 7f3ddc62b740 1 -- 172.21.15.78:0/1751137047 >> 172.21.15.78:0/1751137047 conn(0x5581e384fb60 msgr2=0x5581e3863b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:00.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.978+0000 7f3ddc62b740 1 -- 172.21.15.78:0/1751137047 shutdown_connections 2024-09-11T00:16:00.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.978+0000 7f3ddc62b740 1 -- 172.21.15.78:0/1751137047 wait complete. 2024-09-11T00:16:00.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.978+0000 7f3ddc62b740 1 -- start start 2024-09-11T00:16:00.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.979+0000 7f3ddc62b740 1 Processor -- start 2024-09-11T00:16:00.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.979+0000 7f3ddc62b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5581e3851d30 0x5581e3852d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:00.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.979+0000 7f3ddc62b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581e3852650 0x5581e38532c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:00.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.979+0000 7f3ddc62b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e38629f0 0x5581e3853940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:00.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.979+0000 7f3ddc62b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5581e3874790 con 0x5581e38629f0 2024-09-11T00:16:00.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.979+0000 7f3ddc62b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5581e38740c0 con 0x5581e3852650 2024-09-11T00:16:00.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.979+0000 7f3ddc62b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5581e3874e60 con 0x5581e3851d30 2024-09-11T00:16:00.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.979+0000 7f3ddc62b740 10 client.0 _ll_register_callbacks cb 0x7f3dcc009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:16:00.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.979+0000 7f3dd3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e38629f0 0x5581e3853940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:00.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.979+0000 7f3dd3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e38629f0 0x5581e3853940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37988/0 (socket says 172.21.15.78:37988) 2024-09-11T00:16:00.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.979+0000 7f3dd3fff640 1 -- 172.21.15.78:0/584146079 learned_addr learned my addr 172.21.15.78:0/584146079 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:00.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.979+0000 7f3dd37fe640 1 --2- 172.21.15.78:0/584146079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5581e3851d30 0x5581e3852d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:00.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.979+0000 7f3dd3fff640 1 -- 172.21.15.78:0/584146079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5581e3851d30 msgr2=0x5581e3852d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:00.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.979+0000 7f3dd3fff640 1 --2- 172.21.15.78:0/584146079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5581e3851d30 0x5581e3852d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.979+0000 7f3dd3fff640 1 -- 172.21.15.78:0/584146079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581e3852650 msgr2=0x5581e38532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:00.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.979+0000 7f3dd2ffd640 1 --2- 172.21.15.78:0/584146079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581e3852650 0x5581e38532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:00.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.979+0000 7f3dd3fff640 1 --2- 172.21.15.78:0/584146079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581e3852650 0x5581e38532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.979+0000 7f3dd3fff640 1 -- 172.21.15.78:0/584146079 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581e3854140 con 0x5581e38629f0 2024-09-11T00:16:00.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.979+0000 7f3dd2ffd640 1 --2- 172.21.15.78:0/584146079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581e3852650 0x5581e38532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:16:00.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.979+0000 7f3dd3fff640 1 --2- 172.21.15.78:0/584146079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e38629f0 0x5581e3853940 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009aa0 tx=0x7f3dcc005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fab1fe818d0a57 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:00.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.979+0000 7f3db2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:16:00.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.980+0000 7f3db2ffd640 1 -- 172.21.15.78:0/584146079 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc035030 con 0x5581e38629f0 2024-09-11T00:16:00.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.980+0000 7f3db2ffd640 1 -- 172.21.15.78:0/584146079 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f3dcc0125d0 con 0x5581e38629f0 2024-09-11T00:16:00.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.980+0000 7f3ddc62b740 1 -- 172.21.15.78:0/584146079 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dc4091e50 con 0x5581e38629f0 2024-09-11T00:16:00.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.980+0000 7f3db2ffd640 1 -- 172.21.15.78:0/584146079 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3dcc010d30 con 0x5581e38629f0 2024-09-11T00:16:00.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.980+0000 7f3ddc62b740 10 client.15219 fetch_fsmap learned FSMap version 20 2024-09-11T00:16:00.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.980+0000 7f3ddc62b740 1 -- 172.21.15.78:0/584146079 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5581e387c3e0 con 0x5581e38629f0 2024-09-11T00:16:00.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.980+0000 7f3db2ffd640 1 -- 172.21.15.78:0/584146079 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3dc4091e50 con 0x5581e38629f0 2024-09-11T00:16:00.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.980+0000 7f3db2ffd640 1 -- 172.21.15.78:0/584146079 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3dcc04a020 con 0x5581e38629f0 2024-09-11T00:16:00.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.980+0000 7f3ddc62b740 10 client.15219 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:16:00.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.980+0000 7f3ddc62b740 10 client.15219 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T00:16:00.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.980+0000 7f3ddc62b740 20 client.15219 populate_metadata read hostname 'smithi078' 2024-09-11T00:16:00.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.980+0000 7f3ddc62b740 1 --2- 172.21.15.78:0/584146079 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5581e38e50d0 0x5581e38e3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:00.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.980+0000 7f3ddc62b740 4 client.15219 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T00:16:00.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.980+0000 7f3ddc62b740 1 -- 172.21.15.78:0/584146079 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "status"}) -- 0x5581e37c7610 con 0x5581e38e50d0 2024-09-11T00:16:00.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.981+0000 7f3dd37fe640 1 --2- 172.21.15.78:0/584146079 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5581e38e50d0 0x5581e38e3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:00.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.981+0000 7f3dd37fe640 1 --2- 172.21.15.78:0/584146079 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5581e38e50d0 0x5581e38e3de0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bef671b14f6d82e1 server_cookie=6a3add21d42dc564 in_seq=0 out_seq=0 2024-09-11T00:16:00.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.981+0000 7f3db2ffd640 10 client.15219 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:00.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.981+0000 7f3db2ffd640 1 -- 172.21.15.78:0/584146079 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5581e37c7610 con 0x5581e38e50d0 2024-09-11T00:16:00.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.981+0000 7f3db2ffd640 10 client.15219 handle_command_reply: tid=0 2024-09-11T00:16:00.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.981+0000 7f3ddc62b740 1 client.15219 shutdown 2024-09-11T00:16:00.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.981+0000 7f3ddc62b740 1 -- 172.21.15.78:0/584146079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e38629f0 msgr2=0x5581e3853940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:00.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.981+0000 7f3ddc62b740 1 --2- 172.21.15.78:0/584146079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e38629f0 0x5581e3853940 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009aa0 tx=0x7f3dcc005df0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.981+0000 7f3ddc62b740 1 -- 172.21.15.78:0/584146079 shutdown_connections 2024-09-11T00:16:00.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.981+0000 7f3ddc62b740 1 --2- 172.21.15.78:0/584146079 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5581e38e50d0 0x5581e38e3de0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.981+0000 7f3ddc62b740 1 --2- 172.21.15.78:0/584146079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5581e38629f0 0x5581e3853940 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.981+0000 7f3ddc62b740 1 --2- 172.21.15.78:0/584146079 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5581e3852650 0x5581e38532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.981+0000 7f3ddc62b740 1 --2- 172.21.15.78:0/584146079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5581e3851d30 0x5581e3852d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:00.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.981+0000 7f3db2ffd640 0 client.15219 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:00.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.981+0000 7f3ddc62b740 1 -- 172.21.15.78:0/584146079 >> 172.21.15.78:0/584146079 conn(0x5581e384fb60 msgr2=0x5581e3850bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:00.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.981+0000 7f3ddc62b740 1 -- 172.21.15.78:0/584146079 shutdown_connections 2024-09-11T00:16:00.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.981+0000 7f3ddc62b740 1 -- 172.21.15.78:0/584146079 wait complete. 2024-09-11T00:16:00.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.982+0000 7f3ddc62b740 20 client.15219 trim_cache size 0 max 16384 2024-09-11T00:16:00.998 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:16:00.998 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "85a53860-6fd1-11ef-bcea-c7b262605968", 2024-09-11T00:16:00.998 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2024-09-11T00:16:00.998 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 24593, 2024-09-11T00:16:00.998 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-11T00:16:00.998 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-11T00:16:00.999 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-11T00:16:00.999 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 94.051926170000002, 2024-09-11T00:16:00.999 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 20, 2024-09-11T00:16:00.999 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 79, 2024-09-11T00:16:00.999 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 75, 2024-09-11T00:16:00.999 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 104.780429908 2024-09-11T00:16:00.999 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:16:01.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.982+0000 7f3dda256640 1 -- 172.21.15.78:0/1496913281 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3dbc0b5330 msgr2=0x7f3dbc0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:01.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.982+0000 7f3dda256640 1 --2- 172.21.15.78:0/1496913281 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3dbc0b5330 0x7f3dbc0b77f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc01a000 tx=0x7f3dcc011dc0 comp rx=0 tx=0).stop 2024-09-11T00:16:01.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.982+0000 7f3dda256640 1 -- 172.21.15.78:0/1496913281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dd4101d30 msgr2=0x7f3dd419a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:01.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.982+0000 7f3dda256640 1 --2- 172.21.15.78:0/1496913281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dd4101d30 0x7f3dd419a150 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400d950 tx=0x7f3dc400de10 comp rx=0 tx=0).stop 2024-09-11T00:16:01.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.982+0000 7f3dda256640 1 -- 172.21.15.78:0/1496913281 shutdown_connections 2024-09-11T00:16:01.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.982+0000 7f3dda256640 1 --2- 172.21.15.78:0/1496913281 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3dbc0b5330 0x7f3dbc0b77f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:01.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.982+0000 7f3dda256640 1 --2- 172.21.15.78:0/1496913281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3dd41080c0 0x7f3dd419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:01.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.982+0000 7f3dda256640 1 --2- 172.21.15.78:0/1496913281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3dd4107740 0x7f3dd419a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:01.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.982+0000 7f3dda256640 1 --2- 172.21.15.78:0/1496913281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dd4101d30 0x7f3dd419a150 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:01.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.982+0000 7f3dda256640 1 -- 172.21.15.78:0/1496913281 >> 172.21.15.78:0/1496913281 conn(0x7f3dd40fd7e0 msgr2=0x7f3dd40ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:01.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.982+0000 7f3dda256640 1 -- 172.21.15.78:0/1496913281 shutdown_connections 2024-09-11T00:16:01.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:00.982+0000 7f3dda256640 1 -- 172.21.15.78:0/1496913281 wait complete. 2024-09-11T00:16:01.884 INFO:teuthology.run_tasks:Running task kclient... 2024-09-11T00:16:01.911 INFO:tasks.kclient:Mounting kernel clients... 2024-09-11T00:16:01.911 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-11T00:16:01.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:16:01.912 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-09-11T00:16:01.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:16:01.929 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2024-09-11T00:16:01.997 INFO:teuthology.orchestra.run.smithi078.stderr:Cannot find device "ceph-brx" 2024-09-11T00:16:01.998 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:16:01.998 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-11T00:16:01.998 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T00:16:01.999 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T00:16:01.999 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-11T00:16:02.060 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:01 smithi078 ceph-mon[30865]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-11T00:16:02.060 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:01 smithi078 ceph-mon[30865]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-11T00:16:02.061 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:01 smithi078 ceph-mon[30865]: Cluster is now healthy 2024-09-11T00:16:02.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:01 smithi112 ceph-mon[35627]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-11T00:16:02.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:01 smithi112 ceph-mon[35627]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-11T00:16:02.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:01 smithi112 ceph-mon[35627]: Cluster is now healthy 2024-09-11T00:16:02.284 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:16:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:01 smithi138 ceph-mon[35019]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-11T00:16:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:01 smithi138 ceph-mon[35019]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-11T00:16:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:01 smithi138 ceph-mon[35019]: Cluster is now healthy 2024-09-11T00:16:02.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.812+0000 7f5d40ac2640 1 -- 172.21.15.78:0/2134632529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d3c102dc0 msgr2=0x7f5d3c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:02.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.812+0000 7f5d40ac2640 1 --2- 172.21.15.78:0/2134632529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d3c102dc0 0x7f5d3c1031a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c009900 tx=0x7f5d2c02a410 comp rx=0 tx=0).stop 2024-09-11T00:16:02.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.812+0000 7f5d40ac2640 1 -- 172.21.15.78:0/2134632529 shutdown_connections 2024-09-11T00:16:02.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.812+0000 7f5d40ac2640 1 --2- 172.21.15.78:0/2134632529 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d3c109150 0x7f5d3c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:02.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.812+0000 7f5d40ac2640 1 --2- 172.21.15.78:0/2134632529 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d3c1087d0 0x7f5d3c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:02.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.812+0000 7f5d40ac2640 1 --2- 172.21.15.78:0/2134632529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d3c102dc0 0x7f5d3c1031a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:02.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.812+0000 7f5d40ac2640 1 -- 172.21.15.78:0/2134632529 >> 172.21.15.78:0/2134632529 conn(0x7f5d3c0fe830 msgr2=0x7f5d3c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:02.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.812+0000 7f5d40ac2640 1 -- 172.21.15.78:0/2134632529 shutdown_connections 2024-09-11T00:16:02.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.812+0000 7f5d40ac2640 1 -- 172.21.15.78:0/2134632529 wait complete. 2024-09-11T00:16:02.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.813+0000 7f5d40ac2640 1 Processor -- start 2024-09-11T00:16:02.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.813+0000 7f5d40ac2640 1 -- start start 2024-09-11T00:16:02.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.813+0000 7f5d40ac2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d3c102dc0 0x7f5d3c199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:02.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.813+0000 7f5d40ac2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d3c1087d0 0x7f5d3c1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:02.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.813+0000 7f5d40ac2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d3c109150 0x7f5d3c19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:02.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.813+0000 7f5d40ac2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c112e10 con 0x7f5d3c1087d0 2024-09-11T00:16:02.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.813+0000 7f5d40ac2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c112c90 con 0x7f5d3c102dc0 2024-09-11T00:16:02.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.813+0000 7f5d40ac2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c112f90 con 0x7f5d3c109150 2024-09-11T00:16:02.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.813+0000 7f5d31d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d3c1087d0 0x7f5d3c1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:02.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.813+0000 7f5d31d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d3c1087d0 0x7f5d3c1997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38000/0 (socket says 172.21.15.78:38000) 2024-09-11T00:16:02.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.813+0000 7f5d31d9b640 1 -- 172.21.15.78:0/2860089527 learned_addr learned my addr 172.21.15.78:0/2860089527 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:02.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.813+0000 7f5d3ad9d640 1 --2- 172.21.15.78:0/2860089527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d3c109150 0x7f5d3c19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:02.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.813+0000 7f5d3a59c640 1 --2- 172.21.15.78:0/2860089527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d3c102dc0 0x7f5d3c199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:02.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.813+0000 7f5d31d9b640 1 -- 172.21.15.78:0/2860089527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d3c109150 msgr2=0x7f5d3c19eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:02.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.813+0000 7f5d31d9b640 1 --2- 172.21.15.78:0/2860089527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d3c109150 0x7f5d3c19eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:02.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.813+0000 7f5d31d9b640 1 -- 172.21.15.78:0/2860089527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d3c102dc0 msgr2=0x7f5d3c199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:02.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.813+0000 7f5d31d9b640 1 --2- 172.21.15.78:0/2860089527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d3c102dc0 0x7f5d3c199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:02.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.813+0000 7f5d31d9b640 1 -- 172.21.15.78:0/2860089527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3c19f330 con 0x7f5d3c1087d0 2024-09-11T00:16:02.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.813+0000 7f5d3a59c640 1 --2- 172.21.15.78:0/2860089527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d3c102dc0 0x7f5d3c199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:16:02.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.814+0000 7f5d31d9b640 1 --2- 172.21.15.78:0/2860089527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d3c1087d0 0x7f5d3c1997c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5d2400d950 tx=0x7f5d2400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:02.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.814+0000 7f5d33fff640 1 -- 172.21.15.78:0/2860089527 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24017070 con 0x7f5d3c1087d0 2024-09-11T00:16:02.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.814+0000 7f5d33fff640 1 -- 172.21.15.78:0/2860089527 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d24009c30 con 0x7f5d3c1087d0 2024-09-11T00:16:02.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.814+0000 7f5d40ac2640 1 -- 172.21.15.78:0/2860089527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3c19f620 con 0x7f5d3c1087d0 2024-09-11T00:16:02.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.814+0000 7f5d33fff640 1 -- 172.21.15.78:0/2860089527 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2400f620 con 0x7f5d3c1087d0 2024-09-11T00:16:02.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.814+0000 7f5d40ac2640 1 -- 172.21.15.78:0/2860089527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d3c1a5ce0 con 0x7f5d3c1087d0 2024-09-11T00:16:02.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.815+0000 7f5d40ac2640 1 -- 172.21.15.78:0/2860089527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d3c1031a0 con 0x7f5d3c1087d0 2024-09-11T00:16:02.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.816+0000 7f5d33fff640 1 -- 172.21.15.78:0/2860089527 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f5d24010460 con 0x7f5d3c1087d0 2024-09-11T00:16:02.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.817+0000 7f5d33fff640 1 --2- 172.21.15.78:0/2860089527 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5d280b5330 0x7f5d280b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:02.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.817+0000 7f5d3a59c640 1 --2- 172.21.15.78:0/2860089527 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5d280b5330 0x7f5d280b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:02.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.817+0000 7f5d33fff640 1 -- 172.21.15.78:0/2860089527 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f5d240e5a80 con 0x7f5d3c1087d0 2024-09-11T00:16:02.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.818+0000 7f5d3a59c640 1 --2- 172.21.15.78:0/2860089527 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5d280b5330 0x7f5d280b77f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c031440 tx=0x7f5d2c005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:02.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:02.820+0000 7f5d33fff640 1 -- 172.21.15.78:0/2860089527 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5d240ac7e0 con 0x7f5d3c1087d0 2024-09-11T00:16:03.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:03.034+0000 7f5d40ac2640 1 -- 172.21.15.78:0/2860089527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5d3c1a6060 con 0x7f5d3c1087d0 2024-09-11T00:16:03.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:03.035+0000 7f5d33fff640 1 -- 172.21.15.78:0/2860089527 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) ==== 53+0+73 (secure 0 0 0) 0x7f5d24009de0 con 0x7f5d3c1087d0 2024-09-11T00:16:03.036 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T00:16:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:03.037+0000 7f5d40ac2640 1 -- 172.21.15.78:0/2860089527 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5d280b5330 msgr2=0x7f5d280b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:03.037+0000 7f5d40ac2640 1 --2- 172.21.15.78:0/2860089527 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5d280b5330 0x7f5d280b77f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c031440 tx=0x7f5d2c005a20 comp rx=0 tx=0).stop 2024-09-11T00:16:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:03.037+0000 7f5d40ac2640 1 -- 172.21.15.78:0/2860089527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d3c1087d0 msgr2=0x7f5d3c1997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:03.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:03.037+0000 7f5d40ac2640 1 --2- 172.21.15.78:0/2860089527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d3c1087d0 0x7f5d3c1997c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5d2400d950 tx=0x7f5d2400de10 comp rx=0 tx=0).stop 2024-09-11T00:16:03.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:03.037+0000 7f5d40ac2640 1 -- 172.21.15.78:0/2860089527 shutdown_connections 2024-09-11T00:16:03.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:03.037+0000 7f5d40ac2640 1 --2- 172.21.15.78:0/2860089527 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5d280b5330 0x7f5d280b77f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:03.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:03.037+0000 7f5d40ac2640 1 --2- 172.21.15.78:0/2860089527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d3c109150 0x7f5d3c19eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:03.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:03.037+0000 7f5d40ac2640 1 --2- 172.21.15.78:0/2860089527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d3c1087d0 0x7f5d3c1997c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:03.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:03.037+0000 7f5d40ac2640 1 --2- 172.21.15.78:0/2860089527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d3c102dc0 0x7f5d3c199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:03.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:03.037+0000 7f5d40ac2640 1 -- 172.21.15.78:0/2860089527 >> 172.21.15.78:0/2860089527 conn(0x7f5d3c0fe830 msgr2=0x7f5d3c1000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:03.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:03.037+0000 7f5d40ac2640 1 -- 172.21.15.78:0/2860089527 shutdown_connections 2024-09-11T00:16:03.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:03.037+0000 7f5d40ac2640 1 -- 172.21.15.78:0/2860089527 wait complete. 2024-09-11T00:16:03.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:03 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2860089527' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-11T00:16:03.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:03 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2860089527' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-11T00:16:03.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:03 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2860089527' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-11T00:16:03.851 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T00:16:03.851 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T00:16:03.852 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2024-09-11T00:16:03.852 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T00:16:03.852 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T00:16:03.852 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T00:16:03.852 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T00:16:03.852 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T00:16:03.852 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T00:16:03.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:16:03.852 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2024-09-11T00:16:03.908 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T00:16:03.909 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T00:16:03.909 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T00:16:03.909 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:16:03.909 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2024-09-11T00:16:03.909 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:16:03.909 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:16:03.909 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:16:03.909 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2024-09-11T00:16:03.909 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:16:03.910 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2024-09-11T00:16:03.910 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2024-09-11T00:16:03.910 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T00:16:03.910 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2024-09-11T00:16:03.910 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T00:16:03.910 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2024-09-11T00:16:03.911 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T00:16:03.911 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42185sec preferred_lft 42185sec 2024-09-11T00:16:03.911 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link noprefixroute 2024-09-11T00:16:03.911 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-11T00:16:03.911 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T00:16:03.911 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:16:03.911 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-11T00:16:03.912 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add name ceph-brx type bridge 2024-09-11T00:16:03.912 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr flush dev ceph-brx 2024-09-11T00:16:03.912 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set ceph-brx up 2024-09-11T00:16:03.912 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T00:16:03.912 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-11T00:16:03.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:16:04.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:16:04.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:16:04.111 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T00:16:04.136 INFO:teuthology.orchestra.run.smithi078.stdout:1 2024-09-11T00:16:04.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:16:04.138 DEBUG:teuthology.orchestra.run.smithi078:> route 2024-09-11T00:16:04.211 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2024-09-11T00:16:04.211 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T00:16:04.211 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T00:16:04.211 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T00:16:04.211 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T00:16:04.212 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:16:04.212 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-11T00:16:04.212 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T00:16:04.212 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T00:16:04.212 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T00:16:04.212 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-11T00:16:04.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:16:04.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:04 smithi078 ceph-mon[30865]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 383 B/s wr, 1 op/s 2024-09-11T00:16:04.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:04 smithi112 ceph-mon[35627]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 383 B/s wr, 1 op/s 2024-09-11T00:16:04.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:16:04.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:04 smithi138 ceph-mon[35019]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 383 B/s wr, 1 op/s 2024-09-11T00:16:04.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:16:04.546 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-09-11T00:16:04.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:16:04.561 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list-id 2024-09-11T00:16:04.616 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:16:04.617 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-11T00:16:04.617 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:16:04.617 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-11T00:16:04.617 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-11T00:16:04.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:16:04.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:16:04.733 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-11T00:16:04.734 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:16:04.734 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-11T00:16:04.734 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-11T00:16:04.734 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T00:16:04.734 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-11T00:16:04.734 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-11T00:16:04.734 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-11T00:16:04.734 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-11T00:16:04.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:16:04.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:16:04.862 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T00:16:04.862 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-11T00:16:04.862 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2024-09-11T00:16:04.862 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T00:16:04.862 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-11T00:16:04.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:16:04.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:16:04.938 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:16:04.938 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T00:16:04.962 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T00:16:04.962 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T00:16:04.963 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T00:16:05.018 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-11T00:16:05.018 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-11T00:16:05.018 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/151f39ef-458d-4220-9252-c6728cb0fe29 2024-09-11T00:16:05.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:16:05.018 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/151f39ef-458d-4220-9252-c6728cb0fe29 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-11T00:16:05.117 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-11T00:16:05.117 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-11T00:16:05.117 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-11T00:16:05.238 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-11T00:16:05.238 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-11T00:16:05.238 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-11T00:16:05.238 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.112:3300,172.21.15.138:3300" 2024-09-11T00:16:05.238 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.78:3300,172.21.15.112:3300,172.21.15.138:3300:/volumes/qa/sv_1/151f39ef-458d-4220-9252-c6728cb0fe29 2024-09-11T00:16:05.238 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,key=0,fsid=85a53860-6fd1-11ef-bcea-c7b262605968" will pass to kernel 2024-09-11T00:16:05.239 INFO:teuthology.orchestra.run.smithi078.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T00:16:05.239 INFO:teuthology.orchestra.run.smithi078.stdout: You just mounted a file system that supports labels which does not 2024-09-11T00:16:05.239 INFO:teuthology.orchestra.run.smithi078.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T00:16:05.239 INFO:teuthology.orchestra.run.smithi078.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T00:16:05.239 INFO:teuthology.orchestra.run.smithi078.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T00:16:05.241 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T00:16:05.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:16:05.241 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T00:16:05.267 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T00:16:05.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T00:16:05.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:16:05.365 INFO:teuthology.orchestra.run.smithi078.stdout:client15228 2024-09-11T00:16:05.365 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-11T00:16:05.365 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:16:05.384 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T00:16:05.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T00:16:05.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:16:05.481 INFO:teuthology.orchestra.run.smithi078.stdout:client15228 2024-09-11T00:16:05.482 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T00:16:05.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T00:16:05.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:16:05.538 INFO:teuthology.orchestra.run.smithi078.stdout:client15228 2024-09-11T00:16:05.539 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/85a53860-6fd1-11ef-bcea-c7b262605968.client15228/status') 2024-09-11T00:16:05.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T00:16:05.596 INFO:teuthology.orchestra.run.smithi078.stdout:instance: client.15228 (3)192.168.0.1:0/1209614124 2024-09-11T00:16:05.597 INFO:teuthology.orchestra.run.smithi078.stdout:blocklisted: false 2024-09-11T00:16:05.597 INFO:teuthology.orchestra.run.smithi078.stderr:0+1 records in 2024-09-11T00:16:05.597 INFO:teuthology.orchestra.run.smithi078.stderr:0+1 records out 2024-09-11T00:16:05.597 INFO:teuthology.orchestra.run.smithi078.stderr:70 bytes copied, 2.0507e-05 s, 3.4 MB/s 2024-09-11T00:16:05.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T00:16:05.604 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-11T00:16:05.617 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-11T00:16:05.637 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:16:05.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.737+0000 7f94d6b0e640 1 -- 172.21.15.78:0/673891343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94d01075f0 msgr2=0x7f94d0107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:05.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.737+0000 7f94d6b0e640 1 --2- 172.21.15.78:0/673891343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94d01075f0 0x7f94d0107a30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f94bc009900 tx=0x7f94bc02a410 comp rx=0 tx=0).stop 2024-09-11T00:16:05.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.737+0000 7f94d6b0e640 1 -- 172.21.15.78:0/673891343 shutdown_connections 2024-09-11T00:16:05.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.737+0000 7f94d6b0e640 1 --2- 172.21.15.78:0/673891343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94d0107f70 0x7f94d010e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:05.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.737+0000 7f94d6b0e640 1 --2- 172.21.15.78:0/673891343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94d01075f0 0x7f94d0107a30 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:05.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.737+0000 7f94d6b0e640 1 --2- 172.21.15.78:0/673891343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94d0101bf0 0x7f94d0101fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:05.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.737+0000 7f94d6b0e640 1 -- 172.21.15.78:0/673891343 >> 172.21.15.78:0/673891343 conn(0x7f94d00fd650 msgr2=0x7f94d00ffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:05.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.737+0000 7f94d6b0e640 1 -- 172.21.15.78:0/673891343 shutdown_connections 2024-09-11T00:16:05.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.737+0000 7f94d6b0e640 1 -- 172.21.15.78:0/673891343 wait complete. 2024-09-11T00:16:05.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.737+0000 7f94d6b0e640 1 Processor -- start 2024-09-11T00:16:05.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94d6b0e640 1 -- start start 2024-09-11T00:16:05.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94d6b0e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94d0101bf0 0x7f94d019fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94d6b0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94d01075f0 0x7f94d01a0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94d6b0e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94d0107f70 0x7f94d01a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94d6b0e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f94d0111c30 con 0x7f94d01075f0 2024-09-11T00:16:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94d6b0e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f94d0111ab0 con 0x7f94d0107f70 2024-09-11T00:16:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94d6b0e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f94d0111db0 con 0x7f94d0101bf0 2024-09-11T00:16:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94cffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94d01075f0 0x7f94d01a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:05.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94cffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94d01075f0 0x7f94d01a0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51746/0 (socket says 172.21.15.78:51746) 2024-09-11T00:16:05.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94cffff640 1 -- 172.21.15.78:0/1136210979 learned_addr learned my addr 172.21.15.78:0/1136210979 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:05.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94d50ab640 1 --2- 172.21.15.78:0/1136210979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94d0107f70 0x7f94d01a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:05.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94cffff640 1 -- 172.21.15.78:0/1136210979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94d0101bf0 msgr2=0x7f94d019fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:05.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94d48aa640 1 --2- 172.21.15.78:0/1136210979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94d0101bf0 0x7f94d019fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:05.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94cffff640 1 --2- 172.21.15.78:0/1136210979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94d0101bf0 0x7f94d019fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:05.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94cffff640 1 -- 172.21.15.78:0/1136210979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94d0107f70 msgr2=0x7f94d01a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:05.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94cffff640 1 --2- 172.21.15.78:0/1136210979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94d0107f70 0x7f94d01a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:05.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94cffff640 1 -- 172.21.15.78:0/1136210979 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d01a2690 con 0x7f94d01075f0 2024-09-11T00:16:05.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94d50ab640 1 --2- 172.21.15.78:0/1136210979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94d0107f70 0x7f94d01a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:16:05.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94cffff640 1 --2- 172.21.15.78:0/1136210979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94d01075f0 0x7f94d01a0010 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f94bc005940 tx=0x7f94bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:05.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94cdffb640 1 -- 172.21.15.78:0/1136210979 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94bc03f030 con 0x7f94d01075f0 2024-09-11T00:16:05.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94cdffb640 1 -- 172.21.15.78:0/1136210979 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94bc003cb0 con 0x7f94d01075f0 2024-09-11T00:16:05.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94cdffb640 1 -- 172.21.15.78:0/1136210979 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94bc035070 con 0x7f94d01075f0 2024-09-11T00:16:05.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.738+0000 7f94d6b0e640 1 -- 172.21.15.78:0/1136210979 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d01a2920 con 0x7f94d01075f0 2024-09-11T00:16:05.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.739+0000 7f94d6b0e640 1 -- 172.21.15.78:0/1136210979 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d01ac300 con 0x7f94d01075f0 2024-09-11T00:16:05.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.740+0000 7f94d6b0e640 1 -- 172.21.15.78:0/1136210979 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94d0101fd0 con 0x7f94d01075f0 2024-09-11T00:16:05.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.741+0000 7f94cdffb640 1 -- 172.21.15.78:0/1136210979 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f94bc03bbf0 con 0x7f94d01075f0 2024-09-11T00:16:05.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.742+0000 7f94cdffb640 1 --2- 172.21.15.78:0/1136210979 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f94c00b53b0 0x7f94c00b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:05.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.742+0000 7f94d48aa640 1 --2- 172.21.15.78:0/1136210979 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f94c00b53b0 0x7f94c00b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:05.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.742+0000 7f94cdffb640 1 -- 172.21.15.78:0/1136210979 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f94bc106be0 con 0x7f94d01075f0 2024-09-11T00:16:05.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.742+0000 7f94d48aa640 1 --2- 172.21.15.78:0/1136210979 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f94c00b53b0 0x7f94c00b7870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f94c4005fd0 tx=0x7f94c4005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:05.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.745+0000 7f94cdffb640 1 -- 172.21.15.78:0/1136210979 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f94bc0cd9a0 con 0x7f94d01075f0 2024-09-11T00:16:05.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.922+0000 7f94d6b0e640 1 -- 172.21.15.78:0/1136210979 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94d01ac720 con 0x7f94d01075f0 2024-09-11T00:16:05.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.923+0000 7f94cdffb640 1 -- 172.21.15.78:0/1136210979 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+23218 (secure 0 0 0) 0x7f94bc0cd2a0 con 0x7f94d01075f0 2024-09-11T00:16:05.925 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:16:05.925 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":79,"fsid":"85a53860-6fd1-11ef-bcea-c7b262605968","created":"2024-09-11T00:06:05.704745+0000","modified":"2024-09-11T00:15:56.809478+0000","last_up_change":"2024-09-11T00:13:35.307216+0000","last_in_change":"2024-09-11T00:13:12.730667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:09:47.891696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:22.345345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:24.446029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d260c219-52f2-4e7f-9188-9e66ee01dacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6803","nonce":3736366730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6805","nonce":3736366730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6809","nonce":3736366730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6807","nonce":3736366730}]},"public_addr":"172.21.15.78:6803/3736366730","cluster_addr":"172.21.15.78:6805/3736366730","heartbeat_back_addr":"172.21.15.78:6809/3736366730","heartbeat_front_addr":"172.21.15.78:6807/3736366730","state":["exists","up"]},{"osd":1,"uuid":"d0f286a2-a121-40ee-8134-67ef01b1bc9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6801","nonce":3186321784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6803","nonce":3186321784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6807","nonce":3186321784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6805","nonce":3186321784}]},"public_addr":"172.21.15.112:6801/3186321784","cluster_addr":"172.21.15.112:6803/3186321784","heartbeat_back_addr":"172.21.15.112:6807/3186321784","heartbeat_front_addr":"172.21.15.112:6805/3186321784","state":["exists","up"]},{"osd":2,"uuid":"0eadcce5-12af-4af6-9b4e-159e84454d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6801","nonce":3206386630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6803","nonce":3206386630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6807","nonce":3206386630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6805","nonce":3206386630}]},"public_addr":"172.21.15.138:6801/3206386630","cluster_addr":"172.21.15.138:6803/3206386630","heartbeat_back_addr":"172.21.15.138:6807/3206386630","heartbeat_front_addr":"172.21.15.138:6805/3206386630","state":["exists","up"]},{"osd":3,"uuid":"5f3f683d-6306-43da-8bbd-c103eca442ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6811","nonce":3832405256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6813","nonce":3832405256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6817","nonce":3832405256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6815","nonce":3832405256}]},"public_addr":"172.21.15.78:6811/3832405256","cluster_addr":"172.21.15.78:6813/3832405256","heartbeat_back_addr":"172.21.15.78:6817/3832405256","heartbeat_front_addr":"172.21.15.78:6815/3832405256","state":["exists","up"]},{"osd":4,"uuid":"4575a0a5-821e-4346-84ac-5396042b0550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6809","nonce":2650243435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6811","nonce":2650243435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6815","nonce":2650243435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6813","nonce":2650243435}]},"public_addr":"172.21.15.112:6809/2650243435","cluster_addr":"172.21.15.112:6811/2650243435","heartbeat_back_addr":"172.21.15.112:6815/2650243435","heartbeat_front_addr":"172.21.15.112:6813/2650243435","state":["exists","up"]},{"osd":5,"uuid":"e81eb98f-76eb-4da5-8047-f160888720e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6809","nonce":3033110975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6811","nonce":3033110975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6815","nonce":3033110975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6813","nonce":3033110975}]},"public_addr":"172.21.15.138:6809/3033110975","cluster_addr":"172.21.15.138:6811/3033110975","heartbeat_back_addr":"172.21.15.138:6815/3033110975","heartbeat_front_addr":"172.21.15.138:6813/3033110975","state":["exists","up"]},{"osd":6,"uuid":"7442a091-4dba-45c4-808b-7c3b97087aa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6819","nonce":477087575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6821","nonce":477087575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6825","nonce":477087575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6823","nonce":477087575}]},"public_addr":"172.21.15.78:6819/477087575","cluster_addr":"172.21.15.78:6821/477087575","heartbeat_back_addr":"172.21.15.78:6825/477087575","heartbeat_front_addr":"172.21.15.78:6823/477087575","state":["exists","up"]},{"osd":7,"uuid":"220c1f03-ace9-4dd0-a06d-485b0d2d08bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6817","nonce":1481363296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6819","nonce":1481363296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6823","nonce":1481363296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6821","nonce":1481363296}]},"public_addr":"172.21.15.112:6817/1481363296","cluster_addr":"172.21.15.112:6819/1481363296","heartbeat_back_addr":"172.21.15.112:6823/1481363296","heartbeat_front_addr":"172.21.15.112:6821/1481363296","state":["exists","up"]},{"osd":8,"uuid":"adb6edaa-9a8c-4b0b-aa6a-26dc77a3a7cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6817","nonce":2195149036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6819","nonce":2195149036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6823","nonce":2195149036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6821","nonce":2195149036}]},"public_addr":"172.21.15.138:6817/2195149036","cluster_addr":"172.21.15.138:6819/2195149036","heartbeat_back_addr":"172.21.15.138:6823/2195149036","heartbeat_front_addr":"172.21.15.138:6821/2195149036","state":["exists","up"]},{"osd":9,"uuid":"dd01f408-3712-410e-acbd-c797b7ea5058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6827","nonce":3367249449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6829","nonce":3367249449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6833","nonce":3367249449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6831","nonce":3367249449}]},"public_addr":"172.21.15.78:6827/3367249449","cluster_addr":"172.21.15.78:6829/3367249449","heartbeat_back_addr":"172.21.15.78:6833/3367249449","heartbeat_front_addr":"172.21.15.78:6831/3367249449","state":["exists","up"]},{"osd":10,"uuid":"243c6483-1b0e-49f2-b99c-116d9e9c0617","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6825","nonce":775023408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6827","nonce":775023408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6831","nonce":775023408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6829","nonce":775023408}]},"public_addr":"172.21.15.112:6825/775023408","cluster_addr":"172.21.15.112:6827/775023408","heartbeat_back_addr":"172.21.15.112:6831/775023408","heartbeat_front_addr":"172.21.15.112:6829/775023408","state":["exists","up"]},{"osd":11,"uuid":"fa20ac9e-b5f7-4b3a-bb51-31569f909609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6825","nonce":4046089012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6827","nonce":4046089012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6831","nonce":4046089012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6829","nonce":4046089012}]},"public_addr":"172.21.15.138:6825/4046089012","cluster_addr":"172.21.15.138:6827/4046089012","heartbeat_back_addr":"172.21.15.138:6831/4046089012","heartbeat_front_addr":"172.21.15.138:6829/4046089012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:08:55.896475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:20.695819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:44.785187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:10.858705+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:35.855800+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:01.353037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:27.492985+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:52.860532+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:17.946878+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:43.188966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:08.369978+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:34.192288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":8}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6801/2525199237":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/1476776463":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1949658157":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2276853910":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/4205790529":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6800/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/4286825123":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6801/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1304243506":"2024-09-12T00:06:56.062555+0000","172.21.15.78:6800/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1614270050":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6801/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1679390655":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2957982486":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6800/2525199237":"2024-09-12T00:07:55.586578+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:16:05.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.925+0000 7f94d6b0e640 1 -- 172.21.15.78:0/1136210979 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f94c00b53b0 msgr2=0x7f94c00b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:05.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.925+0000 7f94d6b0e640 1 --2- 172.21.15.78:0/1136210979 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f94c00b53b0 0x7f94c00b7870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f94c4005fd0 tx=0x7f94c4005850 comp rx=0 tx=0).stop 2024-09-11T00:16:05.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.925+0000 7f94d6b0e640 1 -- 172.21.15.78:0/1136210979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94d01075f0 msgr2=0x7f94d01a0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:05.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.925+0000 7f94d6b0e640 1 --2- 172.21.15.78:0/1136210979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94d01075f0 0x7f94d01a0010 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f94bc005940 tx=0x7f94bc0042f0 comp rx=0 tx=0).stop 2024-09-11T00:16:05.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.925+0000 7f94d6b0e640 1 -- 172.21.15.78:0/1136210979 shutdown_connections 2024-09-11T00:16:05.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.925+0000 7f94d6b0e640 1 --2- 172.21.15.78:0/1136210979 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f94c00b53b0 0x7f94c00b7870 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:05.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.925+0000 7f94d6b0e640 1 --2- 172.21.15.78:0/1136210979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94d0107f70 0x7f94d01a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:05.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.925+0000 7f94d6b0e640 1 --2- 172.21.15.78:0/1136210979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94d01075f0 0x7f94d01a0010 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:05.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.925+0000 7f94d6b0e640 1 --2- 172.21.15.78:0/1136210979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94d0101bf0 0x7f94d019fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:05.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.925+0000 7f94d6b0e640 1 -- 172.21.15.78:0/1136210979 >> 172.21.15.78:0/1136210979 conn(0x7f94d00fd650 msgr2=0x7f94d006b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:05.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.926+0000 7f94d6b0e640 1 -- 172.21.15.78:0/1136210979 shutdown_connections 2024-09-11T00:16:05.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:05.926+0000 7f94d6b0e640 1 -- 172.21.15.78:0/1136210979 wait complete. 2024-09-11T00:16:05.939 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T00:09:47.891696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-11T00:14:22.345345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-11T00:14:24.446029+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T00:16:05.939 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T00:16:06.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.040+0000 7f174380c640 1 -- 172.21.15.78:0/525530186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f173c109080 msgr2=0x7f173c10f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.040+0000 7f174380c640 1 --2- 172.21.15.78:0/525530186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f173c109080 0x7f173c10f880 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1734009ca0 tx=0x7f173402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.040+0000 7f174380c640 1 -- 172.21.15.78:0/525530186 shutdown_connections 2024-09-11T00:16:06.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.040+0000 7f174380c640 1 --2- 172.21.15.78:0/525530186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f173c109080 0x7f173c10f880 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.040+0000 7f174380c640 1 --2- 172.21.15.78:0/525530186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f173c108700 0x7f173c108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.040+0000 7f174380c640 1 --2- 172.21.15.78:0/525530186 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f173c102d00 0x7f173c1030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.040+0000 7f174380c640 1 -- 172.21.15.78:0/525530186 >> 172.21.15.78:0/525530186 conn(0x7f173c0fe740 msgr2=0x7f173c100b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:06.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.040+0000 7f174380c640 1 -- 172.21.15.78:0/525530186 shutdown_connections 2024-09-11T00:16:06.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.040+0000 7f174380c640 1 -- 172.21.15.78:0/525530186 wait complete. 2024-09-11T00:16:06.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.041+0000 7f174380c640 1 Processor -- start 2024-09-11T00:16:06.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.041+0000 7f174380c640 1 -- start start 2024-09-11T00:16:06.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.041+0000 7f174380c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f173c102d00 0x7f173c199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.041+0000 7f174380c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f173c108700 0x7f173c199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.041+0000 7f174380c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f173c109080 0x7f173c19ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.041+0000 7f174380c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f173c112d40 con 0x7f173c108700 2024-09-11T00:16:06.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.041+0000 7f174380c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f173c112bc0 con 0x7f173c109080 2024-09-11T00:16:06.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.041+0000 7f174380c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f173c112ec0 con 0x7f173c102d00 2024-09-11T00:16:06.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.041+0000 7f1740da7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f173c108700 0x7f173c199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.041+0000 7f1740da7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f173c108700 0x7f173c199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51766/0 (socket says 172.21.15.78:51766) 2024-09-11T00:16:06.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.041+0000 7f1740da7640 1 -- 172.21.15.78:0/2012774653 learned_addr learned my addr 172.21.15.78:0/2012774653 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:06.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.041+0000 7f1741da9640 1 --2- 172.21.15.78:0/2012774653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f173c109080 0x7f173c19ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.041+0000 7f17415a8640 1 --2- 172.21.15.78:0/2012774653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f173c102d00 0x7f173c199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.041+0000 7f1740da7640 1 -- 172.21.15.78:0/2012774653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f173c102d00 msgr2=0x7f173c199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.041+0000 7f1740da7640 1 --2- 172.21.15.78:0/2012774653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f173c102d00 0x7f173c199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.041+0000 7f1740da7640 1 -- 172.21.15.78:0/2012774653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f173c109080 msgr2=0x7f173c19ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.041+0000 7f1740da7640 1 --2- 172.21.15.78:0/2012774653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f173c109080 0x7f173c19ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.041+0000 7f1740da7640 1 -- 172.21.15.78:0/2012774653 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f173c19f2a0 con 0x7f173c108700 2024-09-11T00:16:06.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.041+0000 7f1740da7640 1 --2- 172.21.15.78:0/2012774653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f173c108700 0x7f173c199740 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f173800b4a0 tx=0x7f173800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:06.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.042+0000 7f172e7fc640 1 -- 172.21.15.78:0/2012774653 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1738014070 con 0x7f173c108700 2024-09-11T00:16:06.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.042+0000 7f172e7fc640 1 -- 172.21.15.78:0/2012774653 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1738010ac0 con 0x7f173c108700 2024-09-11T00:16:06.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.042+0000 7f174380c640 1 -- 172.21.15.78:0/2012774653 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f173c19f590 con 0x7f173c108700 2024-09-11T00:16:06.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.042+0000 7f172e7fc640 1 -- 172.21.15.78:0/2012774653 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1738017c30 con 0x7f173c108700 2024-09-11T00:16:06.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.042+0000 7f174380c640 1 -- 172.21.15.78:0/2012774653 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f173c1a5c50 con 0x7f173c108700 2024-09-11T00:16:06.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.043+0000 7f174380c640 1 -- 172.21.15.78:0/2012774653 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f173c1030e0 con 0x7f173c108700 2024-09-11T00:16:06.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.044+0000 7f172e7fc640 1 -- 172.21.15.78:0/2012774653 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f1738010610 con 0x7f173c108700 2024-09-11T00:16:06.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.044+0000 7f172e7fc640 1 --2- 172.21.15.78:0/2012774653 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f17280b5330 0x7f17280b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.045+0000 7f17415a8640 1 --2- 172.21.15.78:0/2012774653 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f17280b5330 0x7f17280b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.045+0000 7f172e7fc640 1 -- 172.21.15.78:0/2012774653 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f17380e56b0 con 0x7f173c108700 2024-09-11T00:16:06.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.045+0000 7f17415a8640 1 --2- 172.21.15.78:0/2012774653 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f17280b5330 0x7f17280b77f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1730005e10 tx=0x7f1730005da0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:06.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.047+0000 7f172e7fc640 1 -- 172.21.15.78:0/2012774653 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f17380ac470 con 0x7f173c108700 2024-09-11T00:16:06.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.221+0000 7f174380c640 1 -- 172.21.15.78:0/2012774653 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f173c02e5c0 con 0x7f173c108700 2024-09-11T00:16:06.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.221+0000 7f172e7fc640 1 -- 172.21.15.78:0/2012774653 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) ==== 93+0+10 (secure 0 0 0) 0x7f17380abd70 con 0x7f173c108700 2024-09-11T00:16:06.223 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-09-11T00:16:06.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.223+0000 7f174380c640 1 -- 172.21.15.78:0/2012774653 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f17280b5330 msgr2=0x7f17280b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.223+0000 7f174380c640 1 --2- 172.21.15.78:0/2012774653 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f17280b5330 0x7f17280b77f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1730005e10 tx=0x7f1730005da0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.223+0000 7f174380c640 1 -- 172.21.15.78:0/2012774653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f173c108700 msgr2=0x7f173c199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.223+0000 7f174380c640 1 --2- 172.21.15.78:0/2012774653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f173c108700 0x7f173c199740 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f173800b4a0 tx=0x7f173800b960 comp rx=0 tx=0).stop 2024-09-11T00:16:06.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.223+0000 7f174380c640 1 -- 172.21.15.78:0/2012774653 shutdown_connections 2024-09-11T00:16:06.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.223+0000 7f174380c640 1 --2- 172.21.15.78:0/2012774653 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f17280b5330 0x7f17280b77f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.223+0000 7f174380c640 1 --2- 172.21.15.78:0/2012774653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f173c109080 0x7f173c19ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.223+0000 7f174380c640 1 --2- 172.21.15.78:0/2012774653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f173c108700 0x7f173c199740 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.223+0000 7f174380c640 1 --2- 172.21.15.78:0/2012774653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f173c102d00 0x7f173c199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.223+0000 7f174380c640 1 -- 172.21.15.78:0/2012774653 >> 172.21.15.78:0/2012774653 conn(0x7f173c0fe740 msgr2=0x7f173c100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:06.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.223+0000 7f174380c640 1 -- 172.21.15.78:0/2012774653 shutdown_connections 2024-09-11T00:16:06.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.223+0000 7f174380c640 1 -- 172.21.15.78:0/2012774653 wait complete. 2024-09-11T00:16:06.236 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-11T00:16:06.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.337+0000 7faaa11ec640 1 -- 172.21.15.78:0/2740872315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa9c102820 msgr2=0x7faa9c102c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.337+0000 7faaa11ec640 1 --2- 172.21.15.78:0/2740872315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa9c102820 0x7faa9c102c00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7faa8c009900 tx=0x7faa8c02a410 comp rx=0 tx=0).stop 2024-09-11T00:16:06.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.337+0000 7faaa11ec640 1 -- 172.21.15.78:0/2740872315 shutdown_connections 2024-09-11T00:16:06.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.337+0000 7faaa11ec640 1 --2- 172.21.15.78:0/2740872315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa9c108060 0x7faa9c10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.337+0000 7faaa11ec640 1 --2- 172.21.15.78:0/2740872315 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa9c1076e0 0x7faa9c107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.337+0000 7faaa11ec640 1 --2- 172.21.15.78:0/2740872315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa9c102820 0x7faa9c102c00 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.337+0000 7faaa11ec640 1 -- 172.21.15.78:0/2740872315 >> 172.21.15.78:0/2740872315 conn(0x7faa9c076de0 msgr2=0x7faa9c0771f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:06.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.337+0000 7faaa11ec640 1 -- 172.21.15.78:0/2740872315 shutdown_connections 2024-09-11T00:16:06.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.337+0000 7faaa11ec640 1 -- 172.21.15.78:0/2740872315 wait complete. 2024-09-11T00:16:06.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.338+0000 7faaa11ec640 1 Processor -- start 2024-09-11T00:16:06.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.338+0000 7faaa11ec640 1 -- start start 2024-09-11T00:16:06.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.338+0000 7faaa11ec640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa9c102820 0x7faa9c199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.338+0000 7faaa11ec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa9c1076e0 0x7faa9c19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.338+0000 7faaa11ec640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa9c108060 0x7faa9c1a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.338+0000 7faaa11ec640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c111c50 con 0x7faa9c1076e0 2024-09-11T00:16:06.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.338+0000 7faaa11ec640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c111ad0 con 0x7faa9c108060 2024-09-11T00:16:06.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.338+0000 7faaa11ec640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c111dd0 con 0x7faa9c102820 2024-09-11T00:16:06.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.338+0000 7faa9a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa9c1076e0 0x7faa9c19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.338+0000 7faa9a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa9c1076e0 0x7faa9c19a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51784/0 (socket says 172.21.15.78:51784) 2024-09-11T00:16:06.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.338+0000 7faa9a59c640 1 -- 172.21.15.78:0/2871060590 learned_addr learned my addr 172.21.15.78:0/2871060590 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:06.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.338+0000 7faa9ad9d640 1 --2- 172.21.15.78:0/2871060590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa9c102820 0x7faa9c199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.338+0000 7faa9a59c640 1 -- 172.21.15.78:0/2871060590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa9c102820 msgr2=0x7faa9c199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.338+0000 7faa9a59c640 1 --2- 172.21.15.78:0/2871060590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa9c102820 0x7faa9c199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.338+0000 7faa9a59c640 1 -- 172.21.15.78:0/2871060590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa9c108060 msgr2=0x7faa9c1a5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.338+0000 7faa9b59e640 1 --2- 172.21.15.78:0/2871060590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa9c108060 0x7faa9c1a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.339+0000 7faa9a59c640 1 --2- 172.21.15.78:0/2871060590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa9c108060 0x7faa9c1a5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.339+0000 7faa9a59c640 1 -- 172.21.15.78:0/2871060590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9c1a55a0 con 0x7faa9c1076e0 2024-09-11T00:16:06.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.339+0000 7faa9a59c640 1 --2- 172.21.15.78:0/2871060590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa9c1076e0 0x7faa9c19a520 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7faa9000c890 tx=0x7faa9000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:06.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.339+0000 7faa83fff640 1 -- 172.21.15.78:0/2871060590 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa90004220 con 0x7faa9c1076e0 2024-09-11T00:16:06.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.339+0000 7faa83fff640 1 -- 172.21.15.78:0/2871060590 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa900043c0 con 0x7faa9c1076e0 2024-09-11T00:16:06.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.339+0000 7faaa11ec640 1 -- 172.21.15.78:0/2871060590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa9c1a5770 con 0x7faa9c1076e0 2024-09-11T00:16:06.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.339+0000 7faa83fff640 1 -- 172.21.15.78:0/2871060590 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa90004a00 con 0x7faa9c1076e0 2024-09-11T00:16:06.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.339+0000 7faaa11ec640 1 -- 172.21.15.78:0/2871060590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa9c1a5c30 con 0x7faa9c1076e0 2024-09-11T00:16:06.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.340+0000 7faaa11ec640 1 -- 172.21.15.78:0/2871060590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa9c102c00 con 0x7faa9c1076e0 2024-09-11T00:16:06.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.341+0000 7faa83fff640 1 -- 172.21.15.78:0/2871060590 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7faa900079b0 con 0x7faa9c1076e0 2024-09-11T00:16:06.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.342+0000 7faa83fff640 1 --2- 172.21.15.78:0/2871060590 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7faa840b5330 0x7faa840b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.342+0000 7faa9ad9d640 1 --2- 172.21.15.78:0/2871060590 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7faa840b5330 0x7faa840b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.342+0000 7faa83fff640 1 -- 172.21.15.78:0/2871060590 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7faa900e5f30 con 0x7faa9c1076e0 2024-09-11T00:16:06.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.342+0000 7faa9ad9d640 1 --2- 172.21.15.78:0/2871060590 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7faa840b5330 0x7faa840b77f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faa8c031440 tx=0x7faa8c0095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:06.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.345+0000 7faa83fff640 1 -- 172.21.15.78:0/2871060590 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7faa90014030 con 0x7faa9c1076e0 2024-09-11T00:16:06.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.522+0000 7faaa11ec640 1 -- 172.21.15.78:0/2871060590 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7faa9c1a5ef0 con 0x7faa9c1076e0 2024-09-11T00:16:06.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.522+0000 7faa83fff640 1 -- 172.21.15.78:0/2871060590 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) ==== 104+0+11 (secure 0 0 0) 0x7faa900accf0 con 0x7faa9c1076e0 2024-09-11T00:16:06.524 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2024-09-11T00:16:06.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.524+0000 7faaa11ec640 1 -- 172.21.15.78:0/2871060590 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7faa840b5330 msgr2=0x7faa840b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.524+0000 7faaa11ec640 1 --2- 172.21.15.78:0/2871060590 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7faa840b5330 0x7faa840b77f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faa8c031440 tx=0x7faa8c0095f0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.524+0000 7faaa11ec640 1 -- 172.21.15.78:0/2871060590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa9c1076e0 msgr2=0x7faa9c19a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.524+0000 7faaa11ec640 1 --2- 172.21.15.78:0/2871060590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa9c1076e0 0x7faa9c19a520 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7faa9000c890 tx=0x7faa9000cd50 comp rx=0 tx=0).stop 2024-09-11T00:16:06.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.524+0000 7faaa11ec640 1 -- 172.21.15.78:0/2871060590 shutdown_connections 2024-09-11T00:16:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.524+0000 7faaa11ec640 1 --2- 172.21.15.78:0/2871060590 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7faa840b5330 0x7faa840b77f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.524+0000 7faaa11ec640 1 --2- 172.21.15.78:0/2871060590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa9c108060 0x7faa9c1a5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.524+0000 7faaa11ec640 1 --2- 172.21.15.78:0/2871060590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa9c1076e0 0x7faa9c19a520 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.524+0000 7faaa11ec640 1 --2- 172.21.15.78:0/2871060590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faa9c102820 0x7faa9c199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.524+0000 7faaa11ec640 1 -- 172.21.15.78:0/2871060590 >> 172.21.15.78:0/2871060590 conn(0x7faa9c076de0 msgr2=0x7faa9c100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.525+0000 7faaa11ec640 1 -- 172.21.15.78:0/2871060590 shutdown_connections 2024-09-11T00:16:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.525+0000 7faaa11ec640 1 -- 172.21.15.78:0/2871060590 wait complete. 2024-09-11T00:16:06.537 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-11T00:16:06.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.638+0000 7fe4d65ec640 1 -- 172.21.15.78:0/2408764734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4d0109050 msgr2=0x7fe4d010f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.638+0000 7fe4d65ec640 1 --2- 172.21.15.78:0/2408764734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4d0109050 0x7fe4d010f850 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009ca0 tx=0x7fe4c802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.638+0000 7fe4d65ec640 1 -- 172.21.15.78:0/2408764734 shutdown_connections 2024-09-11T00:16:06.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.638+0000 7fe4d65ec640 1 --2- 172.21.15.78:0/2408764734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4d0109050 0x7fe4d010f850 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.638+0000 7fe4d65ec640 1 --2- 172.21.15.78:0/2408764734 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4d01086d0 0x7fe4d0108b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.638+0000 7fe4d65ec640 1 --2- 172.21.15.78:0/2408764734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d0102cd0 0x7fe4d01030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.638+0000 7fe4d65ec640 1 -- 172.21.15.78:0/2408764734 >> 172.21.15.78:0/2408764734 conn(0x7fe4d00fe710 msgr2=0x7fe4d0100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:06.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.638+0000 7fe4d65ec640 1 -- 172.21.15.78:0/2408764734 shutdown_connections 2024-09-11T00:16:06.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.638+0000 7fe4d65ec640 1 -- 172.21.15.78:0/2408764734 wait complete. 2024-09-11T00:16:06.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.639+0000 7fe4d65ec640 1 Processor -- start 2024-09-11T00:16:06.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.639+0000 7fe4d65ec640 1 -- start start 2024-09-11T00:16:06.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.639+0000 7fe4d65ec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4d0102cd0 0x7fe4d0199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.639+0000 7fe4d65ec640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4d01086d0 0x7fe4d01996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.639+0000 7fe4d65ec640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d0109050 0x7fe4d019ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.639+0000 7fe4d65ec640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d0112d10 con 0x7fe4d0102cd0 2024-09-11T00:16:06.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.639+0000 7fe4d65ec640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d0112b90 con 0x7fe4d0109050 2024-09-11T00:16:06.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.639+0000 7fe4d65ec640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d0112e90 con 0x7fe4d01086d0 2024-09-11T00:16:06.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.639+0000 7fe4cffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4d0102cd0 0x7fe4d0199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.639+0000 7fe4cffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4d0102cd0 0x7fe4d0199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51796/0 (socket says 172.21.15.78:51796) 2024-09-11T00:16:06.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.639+0000 7fe4cffff640 1 -- 172.21.15.78:0/3038459289 learned_addr learned my addr 172.21.15.78:0/3038459289 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:06.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.639+0000 7fe4cf7fe640 1 --2- 172.21.15.78:0/3038459289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4d01086d0 0x7fe4d01996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.639+0000 7fe4d4b89640 1 --2- 172.21.15.78:0/3038459289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d0109050 0x7fe4d019ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.639+0000 7fe4cffff640 1 -- 172.21.15.78:0/3038459289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4d01086d0 msgr2=0x7fe4d01996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.639+0000 7fe4cffff640 1 --2- 172.21.15.78:0/3038459289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4d01086d0 0x7fe4d01996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.639+0000 7fe4cffff640 1 -- 172.21.15.78:0/3038459289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d0109050 msgr2=0x7fe4d019ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.639+0000 7fe4cffff640 1 --2- 172.21.15.78:0/3038459289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d0109050 0x7fe4d019ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.639+0000 7fe4cffff640 1 -- 172.21.15.78:0/3038459289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d019f210 con 0x7fe4d0102cd0 2024-09-11T00:16:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.640+0000 7fe4cffff640 1 --2- 172.21.15.78:0/3038459289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4d0102cd0 0x7fe4d0199170 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe4c000c920 tx=0x7fe4c000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.640+0000 7fe4cd7fa640 1 -- 172.21.15.78:0/3038459289 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0007c70 con 0x7fe4d0102cd0 2024-09-11T00:16:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.640+0000 7fe4d65ec640 1 -- 172.21.15.78:0/3038459289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d019f500 con 0x7fe4d0102cd0 2024-09-11T00:16:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.640+0000 7fe4cd7fa640 1 -- 172.21.15.78:0/3038459289 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4c0007e10 con 0x7fe4d0102cd0 2024-09-11T00:16:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.640+0000 7fe4cd7fa640 1 -- 172.21.15.78:0/3038459289 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0018820 con 0x7fe4d0102cd0 2024-09-11T00:16:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.640+0000 7fe4d65ec640 1 -- 172.21.15.78:0/3038459289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d01a5da0 con 0x7fe4d0102cd0 2024-09-11T00:16:06.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.641+0000 7fe4d65ec640 1 -- 172.21.15.78:0/3038459289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4d01030b0 con 0x7fe4d0102cd0 2024-09-11T00:16:06.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.642+0000 7fe4cd7fa640 1 -- 172.21.15.78:0/3038459289 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7fe4c000f450 con 0x7fe4d0102cd0 2024-09-11T00:16:06.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.643+0000 7fe4cd7fa640 1 --2- 172.21.15.78:0/3038459289 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe4b80b5330 0x7fe4b80b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:06.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.643+0000 7fe4cf7fe640 1 --2- 172.21.15.78:0/3038459289 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe4b80b5330 0x7fe4b80b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:06.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.643+0000 7fe4cd7fa640 1 -- 172.21.15.78:0/3038459289 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fe4c00e61b0 con 0x7fe4d0102cd0 2024-09-11T00:16:06.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.643+0000 7fe4cf7fe640 1 --2- 172.21.15.78:0/3038459289 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe4b80b5330 0x7fe4b80b77f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe4d01073d0 tx=0x7fe4c4008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:06.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.646+0000 7fe4cd7fa640 1 -- 172.21.15.78:0/3038459289 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe4c0014030 con 0x7fe4d0102cd0 2024-09-11T00:16:06.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.825+0000 7fe4d65ec640 1 -- 172.21.15.78:0/3038459289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe4d01a6110 con 0x7fe4d0102cd0 2024-09-11T00:16:06.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.826+0000 7fe4cd7fa640 1 -- 172.21.15.78:0/3038459289 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) ==== 100+0+11 (secure 0 0 0) 0x7fe4c00ad000 con 0x7fe4d0102cd0 2024-09-11T00:16:06.827 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2024-09-11T00:16:06.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.828+0000 7fe4d65ec640 1 -- 172.21.15.78:0/3038459289 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe4b80b5330 msgr2=0x7fe4b80b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.828+0000 7fe4d65ec640 1 --2- 172.21.15.78:0/3038459289 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe4b80b5330 0x7fe4b80b77f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe4d01073d0 tx=0x7fe4c4008040 comp rx=0 tx=0).stop 2024-09-11T00:16:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.828+0000 7fe4d65ec640 1 -- 172.21.15.78:0/3038459289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4d0102cd0 msgr2=0x7fe4d0199170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.828+0000 7fe4d65ec640 1 --2- 172.21.15.78:0/3038459289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4d0102cd0 0x7fe4d0199170 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe4c000c920 tx=0x7fe4c000cde0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.828+0000 7fe4d65ec640 1 -- 172.21.15.78:0/3038459289 shutdown_connections 2024-09-11T00:16:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.828+0000 7fe4d65ec640 1 --2- 172.21.15.78:0/3038459289 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe4b80b5330 0x7fe4b80b77f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.828+0000 7fe4d65ec640 1 --2- 172.21.15.78:0/3038459289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe4d0109050 0x7fe4d019ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.828+0000 7fe4d65ec640 1 --2- 172.21.15.78:0/3038459289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4d01086d0 0x7fe4d01996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.828+0000 7fe4d65ec640 1 --2- 172.21.15.78:0/3038459289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4d0102cd0 0x7fe4d0199170 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.828+0000 7fe4d65ec640 1 -- 172.21.15.78:0/3038459289 >> 172.21.15.78:0/3038459289 conn(0x7fe4d00fe710 msgr2=0x7fe4d0100b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.828+0000 7fe4d65ec640 1 -- 172.21.15.78:0/3038459289 shutdown_connections 2024-09-11T00:16:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:06.828+0000 7fe4d65ec640 1 -- 172.21.15.78:0/3038459289 wait complete. 2024-09-11T00:16:06.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:06 smithi078 ceph-mon[30865]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 310 B/s wr, 2 op/s 2024-09-11T00:16:06.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:06 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1136210979' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:16:06.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:06 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2012774653' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T00:16:06.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:06 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2871060590' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-11T00:16:06.840 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-11T00:16:06.841 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:16:07.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:06 smithi138 ceph-mon[35019]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 310 B/s wr, 2 op/s 2024-09-11T00:16:07.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:06 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1136210979' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:16:07.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:06 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2012774653' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T00:16:07.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:06 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2871060590' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-11T00:16:07.086 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:16:07.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:06 smithi112 ceph-mon[35627]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 310 B/s wr, 2 op/s 2024-09-11T00:16:07.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:06 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1136210979' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:16:07.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:06 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2012774653' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T00:16:07.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:06 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2871060590' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-11T00:16:07.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.583+0000 7fdea5082640 1 -- 172.21.15.78:0/1270191434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdea01076c0 msgr2=0x7fdea0107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:07.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.583+0000 7fdea5082640 1 --2- 172.21.15.78:0/1270191434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdea01076c0 0x7fdea0107b00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fde88009900 tx=0x7fde8802a410 comp rx=0 tx=0).stop 2024-09-11T00:16:07.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.583+0000 7fdea5082640 1 -- 172.21.15.78:0/1270191434 shutdown_connections 2024-09-11T00:16:07.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.583+0000 7fdea5082640 1 --2- 172.21.15.78:0/1270191434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdea0108040 0x7fdea010e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.583+0000 7fdea5082640 1 --2- 172.21.15.78:0/1270191434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdea01076c0 0x7fdea0107b00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.583+0000 7fdea5082640 1 --2- 172.21.15.78:0/1270191434 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea0101cb0 0x7fdea0102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.583+0000 7fdea5082640 1 -- 172.21.15.78:0/1270191434 >> 172.21.15.78:0/1270191434 conn(0x7fdea00fd700 msgr2=0x7fdea00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:07.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.583+0000 7fdea5082640 1 -- 172.21.15.78:0/1270191434 shutdown_connections 2024-09-11T00:16:07.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.583+0000 7fdea5082640 1 -- 172.21.15.78:0/1270191434 wait complete. 2024-09-11T00:16:07.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.584+0000 7fdea5082640 1 Processor -- start 2024-09-11T00:16:07.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.584+0000 7fdea5082640 1 -- start start 2024-09-11T00:16:07.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.584+0000 7fdea5082640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea0101cb0 0x7fdea019a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:07.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.584+0000 7fdea5082640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdea01076c0 0x7fdea019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:07.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.584+0000 7fdea5082640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdea0108040 0x7fdea019acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:07.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.584+0000 7fdea5082640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdea0111d40 con 0x7fdea01076c0 2024-09-11T00:16:07.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.584+0000 7fdea5082640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdea0111bc0 con 0x7fdea0101cb0 2024-09-11T00:16:07.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.584+0000 7fdea5082640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdea0111ec0 con 0x7fdea0108040 2024-09-11T00:16:07.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.584+0000 7fde9e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdea01076c0 0x7fdea019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:07.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.584+0000 7fde9e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdea01076c0 0x7fdea019a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51816/0 (socket says 172.21.15.78:51816) 2024-09-11T00:16:07.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.585+0000 7fde9e59c640 1 -- 172.21.15.78:0/2011104231 learned_addr learned my addr 172.21.15.78:0/2011104231 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:07.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.585+0000 7fde9f59e640 1 --2- 172.21.15.78:0/2011104231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdea0108040 0x7fdea019acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:07.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.585+0000 7fde9ed9d640 1 --2- 172.21.15.78:0/2011104231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea0101cb0 0x7fdea019a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:07.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.585+0000 7fde9e59c640 1 -- 172.21.15.78:0/2011104231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdea0108040 msgr2=0x7fdea019acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:07.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.585+0000 7fde9e59c640 1 --2- 172.21.15.78:0/2011104231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdea0108040 0x7fdea019acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.585+0000 7fde9e59c640 1 -- 172.21.15.78:0/2011104231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea0101cb0 msgr2=0x7fdea019a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:07.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.585+0000 7fde9e59c640 1 --2- 172.21.15.78:0/2011104231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea0101cb0 0x7fdea019a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.585+0000 7fde9e59c640 1 -- 172.21.15.78:0/2011104231 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea01a55f0 con 0x7fdea01076c0 2024-09-11T00:16:07.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.585+0000 7fde9e59c640 1 --2- 172.21.15.78:0/2011104231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdea01076c0 0x7fdea019a750 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fde88006010 tx=0x7fde880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:07.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.585+0000 7fde97fff640 1 -- 172.21.15.78:0/2011104231 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8803f030 con 0x7fdea01076c0 2024-09-11T00:16:07.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.585+0000 7fdea5082640 1 -- 172.21.15.78:0/2011104231 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdea01a5880 con 0x7fdea01076c0 2024-09-11T00:16:07.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.585+0000 7fde97fff640 1 -- 172.21.15.78:0/2011104231 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde88003800 con 0x7fdea01076c0 2024-09-11T00:16:07.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.585+0000 7fde97fff640 1 -- 172.21.15.78:0/2011104231 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde88035070 con 0x7fdea01076c0 2024-09-11T00:16:07.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.585+0000 7fdea5082640 1 -- 172.21.15.78:0/2011104231 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdea01a5de0 con 0x7fdea01076c0 2024-09-11T00:16:07.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.586+0000 7fdea5082640 1 -- 172.21.15.78:0/2011104231 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdea0102110 con 0x7fdea01076c0 2024-09-11T00:16:07.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.588+0000 7fde97fff640 1 -- 172.21.15.78:0/2011104231 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7fde88003cb0 con 0x7fdea01076c0 2024-09-11T00:16:07.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.588+0000 7fde97fff640 1 --2- 172.21.15.78:0/2011104231 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fde8c0b5330 0x7fde8c0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:07.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.588+0000 7fde9ed9d640 1 --2- 172.21.15.78:0/2011104231 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fde8c0b5330 0x7fde8c0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:07.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.588+0000 7fde97fff640 1 -- 172.21.15.78:0/2011104231 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fde881065c0 con 0x7fdea01076c0 2024-09-11T00:16:07.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.589+0000 7fde9ed9d640 1 --2- 172.21.15.78:0/2011104231 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fde8c0b5330 0x7fde8c0b77f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fde90009990 tx=0x7fde90009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:07.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.592+0000 7fde97fff640 1 -- 172.21.15.78:0/2011104231 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fde880cd380 con 0x7fdea01076c0 2024-09-11T00:16:07.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.803+0000 7fdea5082640 1 -- 172.21.15.78:0/2011104231 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdea002e5c0 con 0x7fdea01076c0 2024-09-11T00:16:07.806 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:07 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3038459289' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-11T00:16:07.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.804+0000 7fde97fff640 1 -- 172.21.15.78:0/2011104231 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7fde880ccc80 con 0x7fdea01076c0 2024-09-11T00:16:07.806 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:16:07.807 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:16:07.807 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:16:07.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.806+0000 7fdea5082640 1 -- 172.21.15.78:0/2011104231 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fde8c0b5330 msgr2=0x7fde8c0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:07.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.806+0000 7fdea5082640 1 --2- 172.21.15.78:0/2011104231 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fde8c0b5330 0x7fde8c0b77f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fde90009990 tx=0x7fde90009110 comp rx=0 tx=0).stop 2024-09-11T00:16:07.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.806+0000 7fdea5082640 1 -- 172.21.15.78:0/2011104231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdea01076c0 msgr2=0x7fdea019a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:07.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.806+0000 7fdea5082640 1 --2- 172.21.15.78:0/2011104231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdea01076c0 0x7fdea019a750 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fde88006010 tx=0x7fde880042f0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.806+0000 7fdea5082640 1 -- 172.21.15.78:0/2011104231 shutdown_connections 2024-09-11T00:16:07.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.806+0000 7fdea5082640 1 --2- 172.21.15.78:0/2011104231 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fde8c0b5330 0x7fde8c0b77f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.806+0000 7fdea5082640 1 --2- 172.21.15.78:0/2011104231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdea0108040 0x7fdea019acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.806+0000 7fdea5082640 1 --2- 172.21.15.78:0/2011104231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdea01076c0 0x7fdea019a750 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.806+0000 7fdea5082640 1 --2- 172.21.15.78:0/2011104231 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdea0101cb0 0x7fdea019a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:07.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.806+0000 7fdea5082640 1 -- 172.21.15.78:0/2011104231 >> 172.21.15.78:0/2011104231 conn(0x7fdea00fd700 msgr2=0x7fdea00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:07.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.807+0000 7fdea5082640 1 -- 172.21.15.78:0/2011104231 shutdown_connections 2024-09-11T00:16:07.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:07.807+0000 7fdea5082640 1 -- 172.21.15.78:0/2011104231 wait complete. 2024-09-11T00:16:08.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:07 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3038459289' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-11T00:16:08.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:07 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3038459289' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-11T00:16:08.447 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-11T00:16:08.448 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-11T00:16:08.448 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:16:08.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.548+0000 7f85e0710640 1 -- 172.21.15.78:0/2760891805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d81075c0 msgr2=0x7f85d8107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:08.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.548+0000 7f85e0710640 1 --2- 172.21.15.78:0/2760891805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d81075c0 0x7f85d8107a00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f85d4009900 tx=0x7f85d402a410 comp rx=0 tx=0).stop 2024-09-11T00:16:08.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.548+0000 7f85e0710640 1 -- 172.21.15.78:0/2760891805 shutdown_connections 2024-09-11T00:16:08.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.548+0000 7f85e0710640 1 --2- 172.21.15.78:0/2760891805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85d8107f40 0x7f85d810e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.548+0000 7f85e0710640 1 --2- 172.21.15.78:0/2760891805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d81075c0 0x7f85d8107a00 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.548+0000 7f85e0710640 1 --2- 172.21.15.78:0/2760891805 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85d8101fe0 0x7f85d81023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.548+0000 7f85e0710640 1 -- 172.21.15.78:0/2760891805 >> 172.21.15.78:0/2760891805 conn(0x7f85d8077670 msgr2=0x7f85d8077a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:08.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.548+0000 7f85e0710640 1 -- 172.21.15.78:0/2760891805 shutdown_connections 2024-09-11T00:16:08.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.548+0000 7f85e0710640 1 -- 172.21.15.78:0/2760891805 wait complete. 2024-09-11T00:16:08.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.549+0000 7f85e0710640 1 Processor -- start 2024-09-11T00:16:08.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.549+0000 7f85e0710640 1 -- start start 2024-09-11T00:16:08.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.549+0000 7f85e0710640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85d8101fe0 0x7f85d8198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:08.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.549+0000 7f85e0710640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85d81075c0 0x7f85d8198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:08.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.549+0000 7f85e0710640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d8107f40 0x7f85d819da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:08.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.549+0000 7f85e0710640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f85d8111c50 con 0x7f85d8107f40 2024-09-11T00:16:08.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.549+0000 7f85e0710640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f85d8111ad0 con 0x7f85d8101fe0 2024-09-11T00:16:08.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.549+0000 7f85e0710640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f85d8111dd0 con 0x7f85d81075c0 2024-09-11T00:16:08.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.549+0000 7f85decad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d8107f40 0x7f85d819da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:08.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.549+0000 7f85decad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d8107f40 0x7f85d819da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51840/0 (socket says 172.21.15.78:51840) 2024-09-11T00:16:08.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.549+0000 7f85decad640 1 -- 172.21.15.78:0/2902197901 learned_addr learned my addr 172.21.15.78:0/2902197901 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:08.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.549+0000 7f85de4ac640 1 --2- 172.21.15.78:0/2902197901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85d8101fe0 0x7f85d8198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:08.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.549+0000 7f85ddcab640 1 --2- 172.21.15.78:0/2902197901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85d81075c0 0x7f85d8198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:08.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.549+0000 7f85decad640 1 -- 172.21.15.78:0/2902197901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85d81075c0 msgr2=0x7f85d8198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:08.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.549+0000 7f85decad640 1 --2- 172.21.15.78:0/2902197901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85d81075c0 0x7f85d8198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.549+0000 7f85decad640 1 -- 172.21.15.78:0/2902197901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85d8101fe0 msgr2=0x7f85d8198150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:08.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.549+0000 7f85decad640 1 --2- 172.21.15.78:0/2902197901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85d8101fe0 0x7f85d8198150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.549+0000 7f85decad640 1 -- 172.21.15.78:0/2902197901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d819e1f0 con 0x7f85d8107f40 2024-09-11T00:16:08.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.549+0000 7f85de4ac640 1 --2- 172.21.15.78:0/2902197901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85d8101fe0 0x7f85d8198150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:16:08.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.549+0000 7f85decad640 1 --2- 172.21.15.78:0/2902197901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d8107f40 0x7f85d819da20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f85d000b970 tx=0x7f85d000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:08.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.550+0000 7f85cb7fe640 1 -- 172.21.15.78:0/2902197901 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d0019070 con 0x7f85d8107f40 2024-09-11T00:16:08.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.550+0000 7f85cb7fe640 1 -- 172.21.15.78:0/2902197901 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85d0014440 con 0x7f85d8107f40 2024-09-11T00:16:08.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.550+0000 7f85e0710640 1 -- 172.21.15.78:0/2902197901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d819e4e0 con 0x7f85d8107f40 2024-09-11T00:16:08.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.550+0000 7f85cb7fe640 1 -- 172.21.15.78:0/2902197901 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d00075d0 con 0x7f85d8107f40 2024-09-11T00:16:08.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.550+0000 7f85e0710640 1 -- 172.21.15.78:0/2902197901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d81a4ba0 con 0x7f85d8107f40 2024-09-11T00:16:08.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.551+0000 7f85e0710640 1 -- 172.21.15.78:0/2902197901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d81023c0 con 0x7f85d8107f40 2024-09-11T00:16:08.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.552+0000 7f85cb7fe640 1 -- 172.21.15.78:0/2902197901 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f85d000cb40 con 0x7f85d8107f40 2024-09-11T00:16:08.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.552+0000 7f85cb7fe640 1 --2- 172.21.15.78:0/2902197901 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f85c40b5330 0x7f85c40b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:08.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.553+0000 7f85de4ac640 1 --2- 172.21.15.78:0/2902197901 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f85c40b5330 0x7f85c40b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:08.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.553+0000 7f85cb7fe640 1 -- 172.21.15.78:0/2902197901 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f85d00e5a60 con 0x7f85d8107f40 2024-09-11T00:16:08.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.553+0000 7f85de4ac640 1 --2- 172.21.15.78:0/2902197901 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f85c40b5330 0x7f85c40b77f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0058c0 tx=0x7f85cc005ec0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:08.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.555+0000 7f85cb7fe640 1 -- 172.21.15.78:0/2902197901 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f85d00ac820 con 0x7f85d8107f40 2024-09-11T00:16:08.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.732+0000 7f85e0710640 1 -- 172.21.15.78:0/2902197901 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f85d8105c90 con 0x7f85c40b5330 2024-09-11T00:16:08.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.736+0000 7f85cb7fe640 1 -- 172.21.15.78:0/2902197901 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259023 (secure 0 0 0) 0x7f85d8105c90 con 0x7f85c40b5330 2024-09-11T00:16:08.740 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:16:08.742 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-11T00:16:08.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.739+0000 7f85e0710640 1 -- 172.21.15.78:0/2902197901 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f85c40b5330 msgr2=0x7f85c40b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:08.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.739+0000 7f85e0710640 1 --2- 172.21.15.78:0/2902197901 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f85c40b5330 0x7f85c40b77f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0058c0 tx=0x7f85cc005ec0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.739+0000 7f85e0710640 1 -- 172.21.15.78:0/2902197901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d8107f40 msgr2=0x7f85d819da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:08.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.739+0000 7f85e0710640 1 --2- 172.21.15.78:0/2902197901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d8107f40 0x7f85d819da20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f85d000b970 tx=0x7f85d000be30 comp rx=0 tx=0).stop 2024-09-11T00:16:08.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.739+0000 7f85e0710640 1 -- 172.21.15.78:0/2902197901 shutdown_connections 2024-09-11T00:16:08.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.739+0000 7f85e0710640 1 --2- 172.21.15.78:0/2902197901 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f85c40b5330 0x7f85c40b77f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.739+0000 7f85e0710640 1 --2- 172.21.15.78:0/2902197901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d8107f40 0x7f85d819da20 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.739+0000 7f85e0710640 1 --2- 172.21.15.78:0/2902197901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85d81075c0 0x7f85d8198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.739+0000 7f85e0710640 1 --2- 172.21.15.78:0/2902197901 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85d8101fe0 0x7f85d8198150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.739+0000 7f85e0710640 1 -- 172.21.15.78:0/2902197901 >> 172.21.15.78:0/2902197901 conn(0x7f85d8077670 msgr2=0x7f85d8105580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:08.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.739+0000 7f85e0710640 1 -- 172.21.15.78:0/2902197901 shutdown_connections 2024-09-11T00:16:08.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.739+0000 7f85e0710640 1 -- 172.21.15.78:0/2902197901 wait complete. 2024-09-11T00:16:08.752 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-09-11T00:16:07.690890+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654466,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":276,"num_read_kb":230,"num_write":213,"num_write_kb":2242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951979,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":666,"ondisk_log_size":666,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364008,"kb_used_data":10524,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577816,"statfs":{"total":1151940427776,"available":1151567683584,"internally_reserved":0,"allocated":10776576,"data_stored":7211946,"data_compressed":246978,"data_compressed_allocated":331776,"data_compressed_original":2162688,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":11,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.873935"},"pg_stats":[{"pgid":"3.3f","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.825585+0000","last_change":"2024-09-11T00:14:25.922805+0000","last_active":"2024-09-11T00:15:56.825585+0000","last_peered":"2024-09-11T00:15:56.825585+0000","last_clean":"2024-09-11T00:15:56.825585+0000","last_became_active":"2024-09-11T00:14:25.922482+0000","last_became_peered":"2024-09-11T00:14:25.922482+0000","last_unstale":"2024-09-11T00:15:56.825585+0000","last_undegraded":"2024-09-11T00:15:56.825585+0000","last_fullsized":"2024-09-11T00:15:56.825585+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:53.209011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"78'4","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849916+0000","last_change":"2024-09-11T00:14:25.920760+0000","last_active":"2024-09-11T00:15:56.849916+0000","last_peered":"2024-09-11T00:15:56.849916+0000","last_clean":"2024-09-11T00:15:56.849916+0000","last_became_active":"2024-09-11T00:14:25.919720+0000","last_became_peered":"2024-09-11T00:14:25.919720+0000","last_unstale":"2024-09-11T00:15:56.849916+0000","last_undegraded":"2024-09-11T00:15:56.849916+0000","last_fullsized":"2024-09-11T00:15:56.849916+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:32.491200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849839+0000","last_change":"2024-09-11T00:14:25.928090+0000","last_active":"2024-09-11T00:15:56.849839+0000","last_peered":"2024-09-11T00:15:56.849839+0000","last_clean":"2024-09-11T00:15:56.849839+0000","last_became_active":"2024-09-11T00:14:25.927768+0000","last_became_peered":"2024-09-11T00:14:25.927768+0000","last_unstale":"2024-09-11T00:15:56.849839+0000","last_undegraded":"2024-09-11T00:15:56.849839+0000","last_fullsized":"2024-09-11T00:15:56.849839+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:00.025061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.819805+0000","last_change":"2024-09-11T00:14:25.920077+0000","last_active":"2024-09-11T00:15:56.819805+0000","last_peered":"2024-09-11T00:15:56.819805+0000","last_clean":"2024-09-11T00:15:56.819805+0000","last_became_active":"2024-09-11T00:14:25.919395+0000","last_became_peered":"2024-09-11T00:14:25.919395+0000","last_unstale":"2024-09-11T00:15:56.819805+0000","last_undegraded":"2024-09-11T00:15:56.819805+0000","last_fullsized":"2024-09-11T00:15:56.819805+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:41.441279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"78'4","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823354+0000","last_change":"2024-09-11T00:14:25.917872+0000","last_active":"2024-09-11T00:15:56.823354+0000","last_peered":"2024-09-11T00:15:56.823354+0000","last_clean":"2024-09-11T00:15:56.823354+0000","last_became_active":"2024-09-11T00:14:25.917533+0000","last_became_peered":"2024-09-11T00:14:25.917533+0000","last_unstale":"2024-09-11T00:15:56.823354+0000","last_undegraded":"2024-09-11T00:15:56.823354+0000","last_fullsized":"2024-09-11T00:15:56.823354+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:57.051435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"78'6","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848366+0000","last_change":"2024-09-11T00:14:25.914977+0000","last_active":"2024-09-11T00:15:56.848366+0000","last_peered":"2024-09-11T00:15:56.848366+0000","last_clean":"2024-09-11T00:15:56.848366+0000","last_became_active":"2024-09-11T00:14:25.914543+0000","last_became_peered":"2024-09-11T00:14:25.914543+0000","last_unstale":"2024-09-11T00:15:56.848366+0000","last_undegraded":"2024-09-11T00:15:56.848366+0000","last_fullsized":"2024-09-11T00:15:56.848366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:45.085347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"78'5","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847934+0000","last_change":"2024-09-11T00:14:25.928021+0000","last_active":"2024-09-11T00:15:56.847934+0000","last_peered":"2024-09-11T00:15:56.847934+0000","last_clean":"2024-09-11T00:15:56.847934+0000","last_became_active":"2024-09-11T00:14:25.927047+0000","last_became_peered":"2024-09-11T00:14:25.927047+0000","last_unstale":"2024-09-11T00:15:56.847934+0000","last_undegraded":"2024-09-11T00:15:56.847934+0000","last_fullsized":"2024-09-11T00:15:56.847934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:41.442622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847497+0000","last_change":"2024-09-11T00:14:25.925399+0000","last_active":"2024-09-11T00:15:56.847497+0000","last_peered":"2024-09-11T00:15:56.847497+0000","last_clean":"2024-09-11T00:15:56.847497+0000","last_became_active":"2024-09-11T00:14:25.925097+0000","last_became_peered":"2024-09-11T00:14:25.925097+0000","last_unstale":"2024-09-11T00:15:56.847497+0000","last_undegraded":"2024-09-11T00:15:56.847497+0000","last_fullsized":"2024-09-11T00:15:56.847497+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:36:44.962936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"78'11","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848579+0000","last_change":"2024-09-11T00:14:25.928123+0000","last_active":"2024-09-11T00:15:56.848579+0000","last_peered":"2024-09-11T00:15:56.848579+0000","last_clean":"2024-09-11T00:15:56.848579+0000","last_became_active":"2024-09-11T00:14:25.927826+0000","last_became_peered":"2024-09-11T00:14:25.927826+0000","last_unstale":"2024-09-11T00:15:56.848579+0000","last_undegraded":"2024-09-11T00:15:56.848579+0000","last_fullsized":"2024-09-11T00:15:56.848579+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:44.131708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"78'16","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849328+0000","last_change":"2024-09-11T00:14:25.920546+0000","last_active":"2024-09-11T00:15:56.849328+0000","last_peered":"2024-09-11T00:15:56.849328+0000","last_clean":"2024-09-11T00:15:56.849328+0000","last_became_active":"2024-09-11T00:14:25.920193+0000","last_became_peered":"2024-09-11T00:14:25.920193+0000","last_unstale":"2024-09-11T00:15:56.849328+0000","last_undegraded":"2024-09-11T00:15:56.849328+0000","last_fullsized":"2024-09-11T00:15:56.849328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:55.027260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"78'6","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848772+0000","last_change":"2024-09-11T00:14:25.931278+0000","last_active":"2024-09-11T00:15:56.848772+0000","last_peered":"2024-09-11T00:15:56.848772+0000","last_clean":"2024-09-11T00:15:56.848772+0000","last_became_active":"2024-09-11T00:14:25.930964+0000","last_became_peered":"2024-09-11T00:14:25.930964+0000","last_unstale":"2024-09-11T00:15:56.848772+0000","last_undegraded":"2024-09-11T00:15:56.848772+0000","last_fullsized":"2024-09-11T00:15:56.848772+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:06.537737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.819889+0000","last_change":"2024-09-11T00:14:25.919725+0000","last_active":"2024-09-11T00:15:56.819889+0000","last_peered":"2024-09-11T00:15:56.819889+0000","last_clean":"2024-09-11T00:15:56.819889+0000","last_became_active":"2024-09-11T00:14:25.918973+0000","last_became_peered":"2024-09-11T00:14:25.918973+0000","last_unstale":"2024-09-11T00:15:56.819889+0000","last_undegraded":"2024-09-11T00:15:56.819889+0000","last_fullsized":"2024-09-11T00:15:56.819889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:01:03.076980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"78'10","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818573+0000","last_change":"2024-09-11T00:14:25.922516+0000","last_active":"2024-09-11T00:15:56.818573+0000","last_peered":"2024-09-11T00:15:56.818573+0000","last_clean":"2024-09-11T00:15:56.818573+0000","last_became_active":"2024-09-11T00:14:25.922198+0000","last_became_peered":"2024-09-11T00:14:25.922198+0000","last_unstale":"2024-09-11T00:15:56.818573+0000","last_undegraded":"2024-09-11T00:15:56.818573+0000","last_fullsized":"2024-09-11T00:15:56.818573+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:26.065492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849699+0000","last_change":"2024-09-11T00:14:25.921663+0000","last_active":"2024-09-11T00:15:56.849699+0000","last_peered":"2024-09-11T00:15:56.849699+0000","last_clean":"2024-09-11T00:15:56.849699+0000","last_became_active":"2024-09-11T00:14:25.921328+0000","last_became_peered":"2024-09-11T00:14:25.921328+0000","last_unstale":"2024-09-11T00:15:56.849699+0000","last_undegraded":"2024-09-11T00:15:56.849699+0000","last_fullsized":"2024-09-11T00:15:56.849699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:04.674811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"78'7","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849561+0000","last_change":"2024-09-11T00:14:56.842141+0000","last_active":"2024-09-11T00:15:56.849561+0000","last_peered":"2024-09-11T00:15:56.849561+0000","last_clean":"2024-09-11T00:15:56.849561+0000","last_became_active":"2024-09-11T00:14:56.841726+0000","last_became_peered":"2024-09-11T00:14:56.841726+0000","last_unstale":"2024-09-11T00:15:56.849561+0000","last_undegraded":"2024-09-11T00:15:56.849561+0000","last_fullsized":"2024-09-11T00:15:56.849561+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:46.239876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847667+0000","last_change":"2024-09-11T00:14:25.927202+0000","last_active":"2024-09-11T00:15:56.847667+0000","last_peered":"2024-09-11T00:15:56.847667+0000","last_clean":"2024-09-11T00:15:56.847667+0000","last_became_active":"2024-09-11T00:14:25.926872+0000","last_became_peered":"2024-09-11T00:14:25.926872+0000","last_unstale":"2024-09-11T00:15:56.847667+0000","last_undegraded":"2024-09-11T00:15:56.847667+0000","last_fullsized":"2024-09-11T00:15:56.847667+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:44.409956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.825593+0000","last_change":"2024-09-11T00:14:25.923975+0000","last_active":"2024-09-11T00:15:56.825593+0000","last_peered":"2024-09-11T00:15:56.825593+0000","last_clean":"2024-09-11T00:15:56.825593+0000","last_became_active":"2024-09-11T00:14:25.923666+0000","last_became_peered":"2024-09-11T00:14:25.923666+0000","last_unstale":"2024-09-11T00:15:56.825593+0000","last_undegraded":"2024-09-11T00:15:56.825593+0000","last_fullsized":"2024-09-11T00:15:56.825593+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:54.803657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"78'10","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848200+0000","last_change":"2024-09-11T00:14:25.928083+0000","last_active":"2024-09-11T00:15:56.848200+0000","last_peered":"2024-09-11T00:15:56.848200+0000","last_clean":"2024-09-11T00:15:56.848200+0000","last_became_active":"2024-09-11T00:14:25.927727+0000","last_became_peered":"2024-09-11T00:14:25.927727+0000","last_unstale":"2024-09-11T00:15:56.848200+0000","last_undegraded":"2024-09-11T00:15:56.848200+0000","last_fullsized":"2024-09-11T00:15:56.848200+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:56.721661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849076+0000","last_change":"2024-09-11T00:14:25.910506+0000","last_active":"2024-09-11T00:15:56.849076+0000","last_peered":"2024-09-11T00:15:56.849076+0000","last_clean":"2024-09-11T00:15:56.849076+0000","last_became_active":"2024-09-11T00:14:25.910112+0000","last_became_peered":"2024-09-11T00:14:25.910112+0000","last_unstale":"2024-09-11T00:15:56.849076+0000","last_undegraded":"2024-09-11T00:15:56.849076+0000","last_fullsized":"2024-09-11T00:15:56.849076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:33:32.698411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.825200+0000","last_change":"2024-09-11T00:14:25.918512+0000","last_active":"2024-09-11T00:15:56.825200+0000","last_peered":"2024-09-11T00:15:56.825200+0000","last_clean":"2024-09-11T00:15:56.825200+0000","last_became_active":"2024-09-11T00:14:25.918191+0000","last_became_peered":"2024-09-11T00:14:25.918191+0000","last_unstale":"2024-09-11T00:15:56.825200+0000","last_undegraded":"2024-09-11T00:15:56.825200+0000","last_fullsized":"2024-09-11T00:15:56.825200+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:07:49.588919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"78'11","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818666+0000","last_change":"2024-09-11T00:14:25.918163+0000","last_active":"2024-09-11T00:15:56.818666+0000","last_peered":"2024-09-11T00:15:56.818666+0000","last_clean":"2024-09-11T00:15:56.818666+0000","last_became_active":"2024-09-11T00:14:25.917851+0000","last_became_peered":"2024-09-11T00:14:25.917851+0000","last_unstale":"2024-09-11T00:15:56.818666+0000","last_undegraded":"2024-09-11T00:15:56.818666+0000","last_fullsized":"2024-09-11T00:15:56.818666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:11.757881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"78'10","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847863+0000","last_change":"2024-09-11T00:14:25.930503+0000","last_active":"2024-09-11T00:15:56.847863+0000","last_peered":"2024-09-11T00:15:56.847863+0000","last_clean":"2024-09-11T00:15:56.847863+0000","last_became_active":"2024-09-11T00:14:25.930140+0000","last_became_peered":"2024-09-11T00:14:25.930140+0000","last_unstale":"2024-09-11T00:15:56.847863+0000","last_undegraded":"2024-09-11T00:15:56.847863+0000","last_fullsized":"2024-09-11T00:15:56.847863+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:43.227373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847887+0000","last_change":"2024-09-11T00:14:25.916866+0000","last_active":"2024-09-11T00:15:56.847887+0000","last_peered":"2024-09-11T00:15:56.847887+0000","last_clean":"2024-09-11T00:15:56.847887+0000","last_became_active":"2024-09-11T00:14:25.916393+0000","last_became_peered":"2024-09-11T00:14:25.916393+0000","last_unstale":"2024-09-11T00:15:56.847887+0000","last_undegraded":"2024-09-11T00:15:56.847887+0000","last_fullsized":"2024-09-11T00:15:56.847887+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:52.697895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"78'6","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848165+0000","last_change":"2024-09-11T00:14:56.764743+0000","last_active":"2024-09-11T00:15:56.848165+0000","last_peered":"2024-09-11T00:15:56.848165+0000","last_clean":"2024-09-11T00:15:56.848165+0000","last_became_active":"2024-09-11T00:14:56.764333+0000","last_became_peered":"2024-09-11T00:14:56.764333+0000","last_unstale":"2024-09-11T00:15:56.848165+0000","last_undegraded":"2024-09-11T00:15:56.848165+0000","last_fullsized":"2024-09-11T00:15:56.848165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:17:00.307318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,3],"acting":[7,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.27","version":"78'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847641+0000","last_change":"2024-09-11T00:14:25.913694+0000","last_active":"2024-09-11T00:15:56.847641+0000","last_peered":"2024-09-11T00:15:56.847641+0000","last_clean":"2024-09-11T00:15:56.847641+0000","last_became_active":"2024-09-11T00:14:25.913405+0000","last_became_peered":"2024-09-11T00:14:25.913405+0000","last_unstale":"2024-09-11T00:15:56.847641+0000","last_undegraded":"2024-09-11T00:15:56.847641+0000","last_fullsized":"2024-09-11T00:15:56.847641+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:24.636698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"78'15","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848748+0000","last_change":"2024-09-11T00:14:25.928598+0000","last_active":"2024-09-11T00:15:56.848748+0000","last_peered":"2024-09-11T00:15:56.848748+0000","last_clean":"2024-09-11T00:15:56.848748+0000","last_became_active":"2024-09-11T00:14:25.928230+0000","last_became_peered":"2024-09-11T00:14:25.928230+0000","last_unstale":"2024-09-11T00:15:56.848748+0000","last_undegraded":"2024-09-11T00:15:56.848748+0000","last_fullsized":"2024-09-11T00:15:56.848748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:00.820900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"78'6","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.825361+0000","last_change":"2024-09-11T00:14:25.922296+0000","last_active":"2024-09-11T00:15:56.825361+0000","last_peered":"2024-09-11T00:15:56.825361+0000","last_clean":"2024-09-11T00:15:56.825361+0000","last_became_active":"2024-09-11T00:14:25.921188+0000","last_became_peered":"2024-09-11T00:14:25.921188+0000","last_unstale":"2024-09-11T00:15:56.825361+0000","last_undegraded":"2024-09-11T00:15:56.825361+0000","last_fullsized":"2024-09-11T00:15:56.825361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:31.478302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"78'4","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818595+0000","last_change":"2024-09-11T00:14:25.910201+0000","last_active":"2024-09-11T00:15:56.818595+0000","last_peered":"2024-09-11T00:15:56.818595+0000","last_clean":"2024-09-11T00:15:56.818595+0000","last_became_active":"2024-09-11T00:14:25.909867+0000","last_became_peered":"2024-09-11T00:14:25.909867+0000","last_unstale":"2024-09-11T00:15:56.818595+0000","last_undegraded":"2024-09-11T00:15:56.818595+0000","last_fullsized":"2024-09-11T00:15:56.818595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:17.445805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849767+0000","last_change":"2024-09-11T00:14:25.914971+0000","last_active":"2024-09-11T00:15:56.849767+0000","last_peered":"2024-09-11T00:15:56.849767+0000","last_clean":"2024-09-11T00:15:56.849767+0000","last_became_active":"2024-09-11T00:14:25.914614+0000","last_became_peered":"2024-09-11T00:14:25.914614+0000","last_unstale":"2024-09-11T00:15:56.849767+0000","last_undegraded":"2024-09-11T00:15:56.849767+0000","last_fullsized":"2024-09-11T00:15:56.849767+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848188+0000","last_change":"2024-09-11T00:14:25.916006+0000","last_active":"2024-09-11T00:15:56.848188+0000","last_peered":"2024-09-11T00:15:56.848188+0000","last_clean":"2024-09-11T00:15:56.848188+0000","last_became_active":"2024-09-11T00:14:25.915479+0000","last_became_peered":"2024-09-11T00:14:25.915479+0000","last_unstale":"2024-09-11T00:15:56.848188+0000","last_undegraded":"2024-09-11T00:15:56.848188+0000","last_fullsized":"2024-09-11T00:15:56.848188+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:42.513673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"78'12","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848254+0000","last_change":"2024-09-11T00:14:25.925601+0000","last_active":"2024-09-11T00:15:56.848254+0000","last_peered":"2024-09-11T00:15:56.848254+0000","last_clean":"2024-09-11T00:15:56.848254+0000","last_became_active":"2024-09-11T00:14:25.925289+0000","last_became_peered":"2024-09-11T00:14:25.925289+0000","last_unstale":"2024-09-11T00:15:56.848254+0000","last_undegraded":"2024-09-11T00:15:56.848254+0000","last_fullsized":"2024-09-11T00:15:56.848254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:17.324565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.824996+0000","last_change":"2024-09-11T00:14:25.922316+0000","last_active":"2024-09-11T00:15:56.824996+0000","last_peered":"2024-09-11T00:15:56.824996+0000","last_clean":"2024-09-11T00:15:56.824996+0000","last_became_active":"2024-09-11T00:14:25.920991+0000","last_became_peered":"2024-09-11T00:14:25.920991+0000","last_unstale":"2024-09-11T00:15:56.824996+0000","last_undegraded":"2024-09-11T00:15:56.824996+0000","last_fullsized":"2024-09-11T00:15:56.824996+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:36.362500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823283+0000","last_change":"2024-09-11T00:14:25.919579+0000","last_active":"2024-09-11T00:15:56.823283+0000","last_peered":"2024-09-11T00:15:56.823283+0000","last_clean":"2024-09-11T00:15:56.823283+0000","last_became_active":"2024-09-11T00:14:25.919245+0000","last_became_peered":"2024-09-11T00:14:25.919245+0000","last_unstale":"2024-09-11T00:15:56.823283+0000","last_undegraded":"2024-09-11T00:15:56.823283+0000","last_fullsized":"2024-09-11T00:15:56.823283+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:47.885242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847987+0000","last_change":"2024-09-11T00:14:56.767631+0000","last_active":"2024-09-11T00:15:56.847987+0000","last_peered":"2024-09-11T00:15:56.847987+0000","last_clean":"2024-09-11T00:15:56.847987+0000","last_became_active":"2024-09-11T00:14:56.767229+0000","last_became_peered":"2024-09-11T00:14:56.767229+0000","last_unstale":"2024-09-11T00:15:56.847987+0000","last_undegraded":"2024-09-11T00:15:56.847987+0000","last_fullsized":"2024-09-11T00:15:56.847987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:15.084255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847779+0000","last_change":"2024-09-11T00:14:25.921414+0000","last_active":"2024-09-11T00:15:56.847779+0000","last_peered":"2024-09-11T00:15:56.847779+0000","last_clean":"2024-09-11T00:15:56.847779+0000","last_became_active":"2024-09-11T00:14:25.921096+0000","last_became_peered":"2024-09-11T00:14:25.921096+0000","last_unstale":"2024-09-11T00:15:56.847779+0000","last_undegraded":"2024-09-11T00:15:56.847779+0000","last_fullsized":"2024-09-11T00:15:56.847779+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:38:45.938435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848492+0000","last_change":"2024-09-11T00:14:23.913359+0000","last_active":"2024-09-11T00:15:56.848492+0000","last_peered":"2024-09-11T00:15:56.848492+0000","last_clean":"2024-09-11T00:15:56.848492+0000","last_became_active":"2024-09-11T00:14:23.913073+0000","last_became_peered":"2024-09-11T00:14:23.913073+0000","last_unstale":"2024-09-11T00:15:56.848492+0000","last_undegraded":"2024-09-11T00:15:56.848492+0000","last_fullsized":"2024-09-11T00:15:56.848492+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:04.907618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818371+0000","last_change":"2024-09-11T00:14:23.905723+0000","last_active":"2024-09-11T00:15:56.818371+0000","last_peered":"2024-09-11T00:15:56.818371+0000","last_clean":"2024-09-11T00:15:56.818371+0000","last_became_active":"2024-09-11T00:14:23.905392+0000","last_became_peered":"2024-09-11T00:14:23.905392+0000","last_unstale":"2024-09-11T00:15:56.818371+0000","last_undegraded":"2024-09-11T00:15:56.818371+0000","last_fullsized":"2024-09-11T00:15:56.818371+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:48.603410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847597+0000","last_change":"2024-09-11T00:14:25.915843+0000","last_active":"2024-09-11T00:15:56.847597+0000","last_peered":"2024-09-11T00:15:56.847597+0000","last_clean":"2024-09-11T00:15:56.847597+0000","last_became_active":"2024-09-11T00:14:25.915543+0000","last_became_peered":"2024-09-11T00:14:25.915543+0000","last_unstale":"2024-09-11T00:15:56.847597+0000","last_undegraded":"2024-09-11T00:15:56.847597+0000","last_fullsized":"2024-09-11T00:15:56.847597+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:10.781401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847529+0000","last_change":"2024-09-11T00:14:23.913017+0000","last_active":"2024-09-11T00:15:56.847529+0000","last_peered":"2024-09-11T00:15:56.847529+0000","last_clean":"2024-09-11T00:15:56.847529+0000","last_became_active":"2024-09-11T00:14:23.912674+0000","last_became_peered":"2024-09-11T00:14:23.912674+0000","last_unstale":"2024-09-11T00:15:56.847529+0000","last_undegraded":"2024-09-11T00:15:56.847529+0000","last_fullsized":"2024-09-11T00:15:56.847529+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:22.711358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"78'11","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847937+0000","last_change":"2024-09-11T00:14:25.917969+0000","last_active":"2024-09-11T00:15:56.847937+0000","last_peered":"2024-09-11T00:15:56.847937+0000","last_clean":"2024-09-11T00:15:56.847937+0000","last_became_active":"2024-09-11T00:14:25.917673+0000","last_became_peered":"2024-09-11T00:14:25.917673+0000","last_unstale":"2024-09-11T00:15:56.847937+0000","last_undegraded":"2024-09-11T00:15:56.847937+0000","last_fullsized":"2024-09-11T00:15:56.847937+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:55:36.992260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848791+0000","last_change":"2024-09-11T00:14:23.915544+0000","last_active":"2024-09-11T00:15:56.848791+0000","last_peered":"2024-09-11T00:15:56.848791+0000","last_clean":"2024-09-11T00:15:56.848791+0000","last_became_active":"2024-09-11T00:14:23.915129+0000","last_became_peered":"2024-09-11T00:14:23.915129+0000","last_unstale":"2024-09-11T00:15:56.848791+0000","last_undegraded":"2024-09-11T00:15:56.848791+0000","last_fullsized":"2024-09-11T00:15:56.848791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:06.720068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"78'10","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848853+0000","last_change":"2024-09-11T00:14:25.927212+0000","last_active":"2024-09-11T00:15:56.848853+0000","last_peered":"2024-09-11T00:15:56.848853+0000","last_clean":"2024-09-11T00:15:56.848853+0000","last_became_active":"2024-09-11T00:14:25.926875+0000","last_became_peered":"2024-09-11T00:14:25.926875+0000","last_unstale":"2024-09-11T00:15:56.848853+0000","last_undegraded":"2024-09-11T00:15:56.848853+0000","last_fullsized":"2024-09-11T00:15:56.848853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:06.749494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848162+0000","last_change":"2024-09-11T00:14:23.907318+0000","last_active":"2024-09-11T00:15:56.848162+0000","last_peered":"2024-09-11T00:15:56.848162+0000","last_clean":"2024-09-11T00:15:56.848162+0000","last_became_active":"2024-09-11T00:14:23.905858+0000","last_became_peered":"2024-09-11T00:14:23.905858+0000","last_unstale":"2024-09-11T00:15:56.848162+0000","last_undegraded":"2024-09-11T00:15:56.848162+0000","last_fullsized":"2024-09-11T00:15:56.848162+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:16.005219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.850031+0000","last_change":"2024-09-11T00:14:25.922126+0000","last_active":"2024-09-11T00:15:56.850031+0000","last_peered":"2024-09-11T00:15:56.850031+0000","last_clean":"2024-09-11T00:15:56.850031+0000","last_became_active":"2024-09-11T00:14:25.921801+0000","last_became_peered":"2024-09-11T00:14:25.921801+0000","last_unstale":"2024-09-11T00:15:56.850031+0000","last_undegraded":"2024-09-11T00:15:56.850031+0000","last_fullsized":"2024-09-11T00:15:56.850031+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:06.770343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848195+0000","last_change":"2024-09-11T00:14:24.083872+0000","last_active":"2024-09-11T00:15:56.848195+0000","last_peered":"2024-09-11T00:15:56.848195+0000","last_clean":"2024-09-11T00:15:56.848195+0000","last_became_active":"2024-09-11T00:14:24.083479+0000","last_became_peered":"2024-09-11T00:14:24.083479+0000","last_unstale":"2024-09-11T00:15:56.848195+0000","last_undegraded":"2024-09-11T00:15:56.848195+0000","last_fullsized":"2024-09-11T00:15:56.848195+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:19:30.492828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"78'11","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848014+0000","last_change":"2024-09-11T00:14:25.932281+0000","last_active":"2024-09-11T00:15:56.848014+0000","last_peered":"2024-09-11T00:15:56.848014+0000","last_clean":"2024-09-11T00:15:56.848014+0000","last_became_active":"2024-09-11T00:14:25.931935+0000","last_became_peered":"2024-09-11T00:14:25.931935+0000","last_unstale":"2024-09-11T00:15:56.848014+0000","last_undegraded":"2024-09-11T00:15:56.848014+0000","last_fullsized":"2024-09-11T00:15:56.848014+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:55.166421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'30","reported_seq":247,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:16:03.876497+0000","last_change":"2024-09-11T00:14:23.909614+0000","last_active":"2024-09-11T00:16:03.876497+0000","last_peered":"2024-09-11T00:16:03.876497+0000","last_clean":"2024-09-11T00:16:03.876497+0000","last_became_active":"2024-09-11T00:14:23.909209+0000","last_became_peered":"2024-09-11T00:14:23.909209+0000","last_unstale":"2024-09-11T00:16:03.876497+0000","last_undegraded":"2024-09-11T00:16:03.876497+0000","last_fullsized":"2024-09-11T00:16:03.876497+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:14.467304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63066,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":190,"num_read_kb":156,"num_write":30,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"78'6","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823597+0000","last_change":"2024-09-11T00:14:25.924008+0000","last_active":"2024-09-11T00:15:56.823597+0000","last_peered":"2024-09-11T00:15:56.823597+0000","last_clean":"2024-09-11T00:15:56.823597+0000","last_became_active":"2024-09-11T00:14:25.923680+0000","last_became_peered":"2024-09-11T00:14:25.923680+0000","last_unstale":"2024-09-11T00:15:56.823597+0000","last_undegraded":"2024-09-11T00:15:56.823597+0000","last_fullsized":"2024-09-11T00:15:56.823597+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:27.106405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848178+0000","last_change":"2024-09-11T00:14:23.906908+0000","last_active":"2024-09-11T00:15:56.848178+0000","last_peered":"2024-09-11T00:15:56.848178+0000","last_clean":"2024-09-11T00:15:56.848178+0000","last_became_active":"2024-09-11T00:14:23.906170+0000","last_became_peered":"2024-09-11T00:14:23.906170+0000","last_unstale":"2024-09-11T00:15:56.848178+0000","last_undegraded":"2024-09-11T00:15:56.848178+0000","last_fullsized":"2024-09-11T00:15:56.848178+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:10:27.314551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818381+0000","last_change":"2024-09-11T00:14:25.917896+0000","last_active":"2024-09-11T00:15:56.818381+0000","last_peered":"2024-09-11T00:15:56.818381+0000","last_clean":"2024-09-11T00:15:56.818381+0000","last_became_active":"2024-09-11T00:14:25.916341+0000","last_became_peered":"2024-09-11T00:14:25.916341+0000","last_unstale":"2024-09-11T00:15:56.818381+0000","last_undegraded":"2024-09-11T00:15:56.818381+0000","last_fullsized":"2024-09-11T00:15:56.818381+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:05.723223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847711+0000","last_change":"2024-09-11T00:14:23.913113+0000","last_active":"2024-09-11T00:15:56.847711+0000","last_peered":"2024-09-11T00:15:56.847711+0000","last_clean":"2024-09-11T00:15:56.847711+0000","last_became_active":"2024-09-11T00:14:23.912791+0000","last_became_peered":"2024-09-11T00:14:23.912791+0000","last_unstale":"2024-09-11T00:15:56.847711+0000","last_undegraded":"2024-09-11T00:15:56.847711+0000","last_fullsized":"2024-09-11T00:15:56.847711+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:31.124528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"78'15","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848742+0000","last_change":"2024-09-11T00:14:25.927511+0000","last_active":"2024-09-11T00:15:56.848742+0000","last_peered":"2024-09-11T00:15:56.848742+0000","last_clean":"2024-09-11T00:15:56.848742+0000","last_became_active":"2024-09-11T00:14:25.927144+0000","last_became_peered":"2024-09-11T00:14:25.927144+0000","last_unstale":"2024-09-11T00:15:56.848742+0000","last_undegraded":"2024-09-11T00:15:56.848742+0000","last_fullsized":"2024-09-11T00:15:56.848742+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:35.680110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.819722+0000","last_change":"2024-09-11T00:14:23.906706+0000","last_active":"2024-09-11T00:15:56.819722+0000","last_peered":"2024-09-11T00:15:56.819722+0000","last_clean":"2024-09-11T00:15:56.819722+0000","last_became_active":"2024-09-11T00:14:23.906368+0000","last_became_peered":"2024-09-11T00:14:23.906368+0000","last_unstale":"2024-09-11T00:15:56.819722+0000","last_undegraded":"2024-09-11T00:15:56.819722+0000","last_fullsized":"2024-09-11T00:15:56.819722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:30:40.798446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"78'6","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848344+0000","last_change":"2024-09-11T00:14:25.925996+0000","last_active":"2024-09-11T00:15:56.848344+0000","last_peered":"2024-09-11T00:15:56.848344+0000","last_clean":"2024-09-11T00:15:56.848344+0000","last_became_active":"2024-09-11T00:14:25.925653+0000","last_became_peered":"2024-09-11T00:14:25.925653+0000","last_unstale":"2024-09-11T00:15:56.848344+0000","last_undegraded":"2024-09-11T00:15:56.848344+0000","last_fullsized":"2024-09-11T00:15:56.848344+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:50.366666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823271+0000","last_change":"2024-09-11T00:14:24.083774+0000","last_active":"2024-09-11T00:15:56.823271+0000","last_peered":"2024-09-11T00:15:56.823271+0000","last_clean":"2024-09-11T00:15:56.823271+0000","last_became_active":"2024-09-11T00:14:24.083398+0000","last_became_peered":"2024-09-11T00:14:24.083398+0000","last_unstale":"2024-09-11T00:15:56.823271+0000","last_undegraded":"2024-09-11T00:15:56.823271+0000","last_fullsized":"2024-09-11T00:15:56.823271+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:34.019592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"78'6","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847685+0000","last_change":"2024-09-11T00:14:25.927171+0000","last_active":"2024-09-11T00:15:56.847685+0000","last_peered":"2024-09-11T00:15:56.847685+0000","last_clean":"2024-09-11T00:15:56.847685+0000","last_became_active":"2024-09-11T00:14:25.926873+0000","last_became_peered":"2024-09-11T00:14:25.926873+0000","last_unstale":"2024-09-11T00:15:56.847685+0000","last_undegraded":"2024-09-11T00:15:56.847685+0000","last_fullsized":"2024-09-11T00:15:56.847685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:26.042903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.825266+0000","last_change":"2024-09-11T00:14:56.770315+0000","last_active":"2024-09-11T00:15:56.825266+0000","last_peered":"2024-09-11T00:15:56.825266+0000","last_clean":"2024-09-11T00:15:56.825266+0000","last_became_active":"2024-09-11T00:14:56.767056+0000","last_became_peered":"2024-09-11T00:14:56.767056+0000","last_unstale":"2024-09-11T00:15:56.825266+0000","last_undegraded":"2024-09-11T00:15:56.825266+0000","last_fullsized":"2024-09-11T00:15:56.825266+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:25.136382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"78'5","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.825345+0000","last_change":"2024-09-11T00:14:56.765888+0000","last_active":"2024-09-11T00:15:56.825345+0000","last_peered":"2024-09-11T00:15:56.825345+0000","last_clean":"2024-09-11T00:15:56.825345+0000","last_became_active":"2024-09-11T00:14:56.765508+0000","last_became_peered":"2024-09-11T00:14:56.765508+0000","last_unstale":"2024-09-11T00:15:56.825345+0000","last_undegraded":"2024-09-11T00:15:56.825345+0000","last_fullsized":"2024-09-11T00:15:56.825345+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:10.013207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818528+0000","last_change":"2024-09-11T00:14:23.904807+0000","last_active":"2024-09-11T00:15:56.818528+0000","last_peered":"2024-09-11T00:15:56.818528+0000","last_clean":"2024-09-11T00:15:56.818528+0000","last_became_active":"2024-09-11T00:14:23.904532+0000","last_became_peered":"2024-09-11T00:14:23.904532+0000","last_unstale":"2024-09-11T00:15:56.818528+0000","last_undegraded":"2024-09-11T00:15:56.818528+0000","last_fullsized":"2024-09-11T00:15:56.818528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:08.945508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848377+0000","last_change":"2024-09-11T00:14:25.919548+0000","last_active":"2024-09-11T00:15:56.848377+0000","last_peered":"2024-09-11T00:15:56.848377+0000","last_clean":"2024-09-11T00:15:56.848377+0000","last_became_active":"2024-09-11T00:14:25.919216+0000","last_became_peered":"2024-09-11T00:14:25.919216+0000","last_unstale":"2024-09-11T00:15:56.848377+0000","last_undegraded":"2024-09-11T00:15:56.848377+0000","last_fullsized":"2024-09-11T00:15:56.848377+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:18.318193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848300+0000","last_change":"2024-09-11T00:14:23.915488+0000","last_active":"2024-09-11T00:15:56.848300+0000","last_peered":"2024-09-11T00:15:56.848300+0000","last_clean":"2024-09-11T00:15:56.848300+0000","last_became_active":"2024-09-11T00:14:23.915147+0000","last_became_peered":"2024-09-11T00:14:23.915147+0000","last_unstale":"2024-09-11T00:15:56.848300+0000","last_undegraded":"2024-09-11T00:15:56.848300+0000","last_fullsized":"2024-09-11T00:15:56.848300+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:04.830225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848100+0000","last_change":"2024-09-11T00:14:25.919774+0000","last_active":"2024-09-11T00:15:56.848100+0000","last_peered":"2024-09-11T00:15:56.848100+0000","last_clean":"2024-09-11T00:15:56.848100+0000","last_became_active":"2024-09-11T00:14:25.919422+0000","last_became_peered":"2024-09-11T00:14:25.919422+0000","last_unstale":"2024-09-11T00:15:56.848100+0000","last_undegraded":"2024-09-11T00:15:56.848100+0000","last_fullsized":"2024-09-11T00:15:56.848100+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:03.928972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848481+0000","last_change":"2024-09-11T00:14:24.082414+0000","last_active":"2024-09-11T00:15:56.848481+0000","last_peered":"2024-09-11T00:15:56.848481+0000","last_clean":"2024-09-11T00:15:56.848481+0000","last_became_active":"2024-09-11T00:14:24.082058+0000","last_became_peered":"2024-09-11T00:14:24.082058+0000","last_unstale":"2024-09-11T00:15:56.848481+0000","last_undegraded":"2024-09-11T00:15:56.848481+0000","last_fullsized":"2024-09-11T00:15:56.848481+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:38.349964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848689+0000","last_change":"2024-09-11T00:14:25.930116+0000","last_active":"2024-09-11T00:15:56.848689+0000","last_peered":"2024-09-11T00:15:56.848689+0000","last_clean":"2024-09-11T00:15:56.848689+0000","last_became_active":"2024-09-11T00:14:25.929787+0000","last_became_peered":"2024-09-11T00:14:25.929787+0000","last_unstale":"2024-09-11T00:15:56.848689+0000","last_undegraded":"2024-09-11T00:15:56.848689+0000","last_fullsized":"2024-09-11T00:15:56.848689+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:29.655577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848895+0000","last_change":"2024-09-11T00:13:12.338952+0000","last_active":"2024-09-11T00:15:56.848895+0000","last_peered":"2024-09-11T00:15:56.848895+0000","last_clean":"2024-09-11T00:15:56.848895+0000","last_became_active":"2024-09-11T00:13:12.335030+0000","last_became_peered":"2024-09-11T00:13:12.335030+0000","last_unstale":"2024-09-11T00:15:56.848895+0000","last_undegraded":"2024-09-11T00:15:56.848895+0000","last_fullsized":"2024-09-11T00:15:56.848895+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:09:48.709624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:09:48.709624+0000","last_clean_scrub_stamp":"2024-09-11T00:09:48.709624+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:43.680771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.819722+0000","last_change":"2024-09-11T00:14:23.906794+0000","last_active":"2024-09-11T00:15:56.819722+0000","last_peered":"2024-09-11T00:15:56.819722+0000","last_clean":"2024-09-11T00:15:56.819722+0000","last_became_active":"2024-09-11T00:14:23.906430+0000","last_became_peered":"2024-09-11T00:14:23.906430+0000","last_unstale":"2024-09-11T00:15:56.819722+0000","last_undegraded":"2024-09-11T00:15:56.819722+0000","last_fullsized":"2024-09-11T00:15:56.819722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:58.804834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848009+0000","last_change":"2024-09-11T00:14:25.928119+0000","last_active":"2024-09-11T00:15:56.848009+0000","last_peered":"2024-09-11T00:15:56.848009+0000","last_clean":"2024-09-11T00:15:56.848009+0000","last_became_active":"2024-09-11T00:14:25.927806+0000","last_became_peered":"2024-09-11T00:14:25.927806+0000","last_unstale":"2024-09-11T00:15:56.848009+0000","last_undegraded":"2024-09-11T00:15:56.848009+0000","last_fullsized":"2024-09-11T00:15:56.848009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:34.630696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848708+0000","last_change":"2024-09-11T00:14:23.916252+0000","last_active":"2024-09-11T00:15:56.848708+0000","last_peered":"2024-09-11T00:15:56.848708+0000","last_clean":"2024-09-11T00:15:56.848708+0000","last_became_active":"2024-09-11T00:14:23.915905+0000","last_became_peered":"2024-09-11T00:14:23.915905+0000","last_unstale":"2024-09-11T00:15:56.848708+0000","last_undegraded":"2024-09-11T00:15:56.848708+0000","last_fullsized":"2024-09-11T00:15:56.848708+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:02.229067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"78'5","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818332+0000","last_change":"2024-09-11T00:14:25.910163+0000","last_active":"2024-09-11T00:15:56.818332+0000","last_peered":"2024-09-11T00:15:56.818332+0000","last_clean":"2024-09-11T00:15:56.818332+0000","last_became_active":"2024-09-11T00:14:25.909926+0000","last_became_peered":"2024-09-11T00:14:25.909926+0000","last_unstale":"2024-09-11T00:15:56.818332+0000","last_undegraded":"2024-09-11T00:15:56.818332+0000","last_fullsized":"2024-09-11T00:15:56.818332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:59:20.915080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818478+0000","last_change":"2024-09-11T00:14:24.081999+0000","last_active":"2024-09-11T00:15:56.818478+0000","last_peered":"2024-09-11T00:15:56.818478+0000","last_clean":"2024-09-11T00:15:56.818478+0000","last_became_active":"2024-09-11T00:14:24.081664+0000","last_became_peered":"2024-09-11T00:14:24.081664+0000","last_unstale":"2024-09-11T00:15:56.818478+0000","last_undegraded":"2024-09-11T00:15:56.818478+0000","last_fullsized":"2024-09-11T00:15:56.818478+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:22.485256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"78'8","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847323+0000","last_change":"2024-09-11T00:14:56.842397+0000","last_active":"2024-09-11T00:15:56.847323+0000","last_peered":"2024-09-11T00:15:56.847323+0000","last_clean":"2024-09-11T00:15:56.847323+0000","last_became_active":"2024-09-11T00:14:56.842017+0000","last_became_peered":"2024-09-11T00:14:56.842017+0000","last_unstale":"2024-09-11T00:15:56.847323+0000","last_undegraded":"2024-09-11T00:15:56.847323+0000","last_fullsized":"2024-09-11T00:15:56.847323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:10.300022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,6],"acting":[9,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848318+0000","last_change":"2024-09-11T00:14:23.905241+0000","last_active":"2024-09-11T00:15:56.848318+0000","last_peered":"2024-09-11T00:15:56.848318+0000","last_clean":"2024-09-11T00:15:56.848318+0000","last_became_active":"2024-09-11T00:14:23.904833+0000","last_became_peered":"2024-09-11T00:14:23.904833+0000","last_unstale":"2024-09-11T00:15:56.848318+0000","last_undegraded":"2024-09-11T00:15:56.848318+0000","last_fullsized":"2024-09-11T00:15:56.848318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:44:28.162800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"78'7","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849073+0000","last_change":"2024-09-11T00:14:56.766007+0000","last_active":"2024-09-11T00:15:56.849073+0000","last_peered":"2024-09-11T00:15:56.849073+0000","last_clean":"2024-09-11T00:15:56.849073+0000","last_became_active":"2024-09-11T00:14:56.765515+0000","last_became_peered":"2024-09-11T00:14:56.765515+0000","last_unstale":"2024-09-11T00:15:56.849073+0000","last_undegraded":"2024-09-11T00:15:56.849073+0000","last_fullsized":"2024-09-11T00:15:56.849073+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:31.159084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847896+0000","last_change":"2024-09-11T00:14:24.083578+0000","last_active":"2024-09-11T00:15:56.847896+0000","last_peered":"2024-09-11T00:15:56.847896+0000","last_clean":"2024-09-11T00:15:56.847896+0000","last_became_active":"2024-09-11T00:14:24.083233+0000","last_became_peered":"2024-09-11T00:14:24.083233+0000","last_unstale":"2024-09-11T00:15:56.847896+0000","last_undegraded":"2024-09-11T00:15:56.847896+0000","last_fullsized":"2024-09-11T00:15:56.847896+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:47.655836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'5","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848689+0000","last_change":"2024-09-11T00:14:56.771471+0000","last_active":"2024-09-11T00:15:56.848689+0000","last_peered":"2024-09-11T00:15:56.848689+0000","last_clean":"2024-09-11T00:15:56.848689+0000","last_became_active":"2024-09-11T00:14:56.764838+0000","last_became_peered":"2024-09-11T00:14:56.764838+0000","last_unstale":"2024-09-11T00:15:56.848689+0000","last_undegraded":"2024-09-11T00:15:56.848689+0000","last_fullsized":"2024-09-11T00:15:56.848689+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:24.683423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823883+0000","last_change":"2024-09-11T00:14:24.082284+0000","last_active":"2024-09-11T00:15:56.823883+0000","last_peered":"2024-09-11T00:15:56.823883+0000","last_clean":"2024-09-11T00:15:56.823883+0000","last_became_active":"2024-09-11T00:14:24.081859+0000","last_became_peered":"2024-09-11T00:14:24.081859+0000","last_unstale":"2024-09-11T00:15:56.823883+0000","last_undegraded":"2024-09-11T00:15:56.823883+0000","last_fullsized":"2024-09-11T00:15:56.823883+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:38.881342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818600+0000","last_change":"2024-09-11T00:14:25.910408+0000","last_active":"2024-09-11T00:15:56.818600+0000","last_peered":"2024-09-11T00:15:56.818600+0000","last_clean":"2024-09-11T00:15:56.818600+0000","last_became_active":"2024-09-11T00:14:25.909447+0000","last_became_peered":"2024-09-11T00:14:25.909447+0000","last_unstale":"2024-09-11T00:15:56.818600+0000","last_undegraded":"2024-09-11T00:15:56.818600+0000","last_fullsized":"2024-09-11T00:15:56.818600+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:20:11.249974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'10","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848291+0000","last_change":"2024-09-11T00:14:23.912799+0000","last_active":"2024-09-11T00:15:56.848291+0000","last_peered":"2024-09-11T00:15:56.848291+0000","last_clean":"2024-09-11T00:15:56.848291+0000","last_became_active":"2024-09-11T00:14:23.912440+0000","last_became_peered":"2024-09-11T00:14:23.912440+0000","last_unstale":"2024-09-11T00:15:56.848291+0000","last_undegraded":"2024-09-11T00:15:56.848291+0000","last_fullsized":"2024-09-11T00:15:56.848291+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:31.139405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"78'5","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847717+0000","last_change":"2024-09-11T00:14:25.920599+0000","last_active":"2024-09-11T00:15:56.847717+0000","last_peered":"2024-09-11T00:15:56.847717+0000","last_clean":"2024-09-11T00:15:56.847717+0000","last_became_active":"2024-09-11T00:14:25.920256+0000","last_became_peered":"2024-09-11T00:14:25.920256+0000","last_unstale":"2024-09-11T00:15:56.847717+0000","last_undegraded":"2024-09-11T00:15:56.847717+0000","last_fullsized":"2024-09-11T00:15:56.847717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:05.347880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.819941+0000","last_change":"2024-09-11T00:14:24.004190+0000","last_active":"2024-09-11T00:15:56.819941+0000","last_peered":"2024-09-11T00:15:56.819941+0000","last_clean":"2024-09-11T00:15:56.819941+0000","last_became_active":"2024-09-11T00:14:24.003842+0000","last_became_peered":"2024-09-11T00:14:24.003842+0000","last_unstale":"2024-09-11T00:15:56.819941+0000","last_undegraded":"2024-09-11T00:15:56.819941+0000","last_fullsized":"2024-09-11T00:15:56.819941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:43.876046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"78'7","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849915+0000","last_change":"2024-09-11T00:14:56.767088+0000","last_active":"2024-09-11T00:15:56.849915+0000","last_peered":"2024-09-11T00:15:56.849915+0000","last_clean":"2024-09-11T00:15:56.849915+0000","last_became_active":"2024-09-11T00:14:56.766783+0000","last_became_peered":"2024-09-11T00:14:56.766783+0000","last_unstale":"2024-09-11T00:15:56.849915+0000","last_undegraded":"2024-09-11T00:15:56.849915+0000","last_fullsized":"2024-09-11T00:15:56.849915+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:37.407811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,4],"acting":[0,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847890+0000","last_change":"2024-09-11T00:14:24.082118+0000","last_active":"2024-09-11T00:15:56.847890+0000","last_peered":"2024-09-11T00:15:56.847890+0000","last_clean":"2024-09-11T00:15:56.847890+0000","last_became_active":"2024-09-11T00:14:24.081844+0000","last_became_peered":"2024-09-11T00:14:24.081844+0000","last_unstale":"2024-09-11T00:15:56.847890+0000","last_undegraded":"2024-09-11T00:15:56.847890+0000","last_fullsized":"2024-09-11T00:15:56.847890+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:20.827385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"78'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823266+0000","last_change":"2024-09-11T00:14:25.917335+0000","last_active":"2024-09-11T00:15:56.823266+0000","last_peered":"2024-09-11T00:15:56.823266+0000","last_clean":"2024-09-11T00:15:56.823266+0000","last_became_active":"2024-09-11T00:14:25.916942+0000","last_became_peered":"2024-09-11T00:14:25.916942+0000","last_unstale":"2024-09-11T00:15:56.823266+0000","last_undegraded":"2024-09-11T00:15:56.823266+0000","last_fullsized":"2024-09-11T00:15:56.823266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:40.309186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848270+0000","last_change":"2024-09-11T00:14:23.906616+0000","last_active":"2024-09-11T00:15:56.848270+0000","last_peered":"2024-09-11T00:15:56.848270+0000","last_clean":"2024-09-11T00:15:56.848270+0000","last_became_active":"2024-09-11T00:14:23.906259+0000","last_became_peered":"2024-09-11T00:14:23.906259+0000","last_unstale":"2024-09-11T00:15:56.848270+0000","last_undegraded":"2024-09-11T00:15:56.848270+0000","last_fullsized":"2024-09-11T00:15:56.848270+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:01.514398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.825085+0000","last_change":"2024-09-11T00:14:25.925422+0000","last_active":"2024-09-11T00:15:56.825085+0000","last_peered":"2024-09-11T00:15:56.825085+0000","last_clean":"2024-09-11T00:15:56.825085+0000","last_became_active":"2024-09-11T00:14:25.923031+0000","last_became_peered":"2024-09-11T00:14:25.923031+0000","last_unstale":"2024-09-11T00:15:56.825085+0000","last_undegraded":"2024-09-11T00:15:56.825085+0000","last_fullsized":"2024-09-11T00:15:56.825085+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:59:52.217566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849461+0000","last_change":"2024-09-11T00:15:56.849368+0000","last_active":"2024-09-11T00:15:56.849461+0000","last_peered":"2024-09-11T00:15:56.849461+0000","last_clean":"2024-09-11T00:15:56.849461+0000","last_became_active":"2024-09-11T00:15:56.848892+0000","last_became_peered":"2024-09-11T00:15:56.848892+0000","last_unstale":"2024-09-11T00:15:56.849461+0000","last_undegraded":"2024-09-11T00:15:56.849461+0000","last_fullsized":"2024-09-11T00:15:56.849461+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:05.614826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847431+0000","last_change":"2024-09-11T00:14:25.917478+0000","last_active":"2024-09-11T00:15:56.847431+0000","last_peered":"2024-09-11T00:15:56.847431+0000","last_clean":"2024-09-11T00:15:56.847431+0000","last_became_active":"2024-09-11T00:14:25.917192+0000","last_became_peered":"2024-09-11T00:14:25.917192+0000","last_unstale":"2024-09-11T00:15:56.847431+0000","last_undegraded":"2024-09-11T00:15:56.847431+0000","last_fullsized":"2024-09-11T00:15:56.847431+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:46.695827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823387+0000","last_change":"2024-09-11T00:14:23.914141+0000","last_active":"2024-09-11T00:15:56.823387+0000","last_peered":"2024-09-11T00:15:56.823387+0000","last_clean":"2024-09-11T00:15:56.823387+0000","last_became_active":"2024-09-11T00:14:23.913757+0000","last_became_peered":"2024-09-11T00:14:23.913757+0000","last_unstale":"2024-09-11T00:15:56.823387+0000","last_undegraded":"2024-09-11T00:15:56.823387+0000","last_fullsized":"2024-09-11T00:15:56.823387+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:54:00.609715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"78'5","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848074+0000","last_change":"2024-09-11T00:14:25.924950+0000","last_active":"2024-09-11T00:15:56.848074+0000","last_peered":"2024-09-11T00:15:56.848074+0000","last_clean":"2024-09-11T00:15:56.848074+0000","last_became_active":"2024-09-11T00:14:25.924554+0000","last_became_peered":"2024-09-11T00:14:25.924554+0000","last_unstale":"2024-09-11T00:15:56.848074+0000","last_undegraded":"2024-09-11T00:15:56.848074+0000","last_fullsized":"2024-09-11T00:15:56.848074+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:29.303384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"78'15","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848089+0000","last_change":"2024-09-11T00:14:25.930162+0000","last_active":"2024-09-11T00:15:56.848089+0000","last_peered":"2024-09-11T00:15:56.848089+0000","last_clean":"2024-09-11T00:15:56.848089+0000","last_became_active":"2024-09-11T00:14:25.929820+0000","last_became_peered":"2024-09-11T00:14:25.929820+0000","last_unstale":"2024-09-11T00:15:56.848089+0000","last_undegraded":"2024-09-11T00:15:56.848089+0000","last_fullsized":"2024-09-11T00:15:56.848089+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:20:21.384841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823627+0000","last_change":"2024-09-11T00:14:23.917486+0000","last_active":"2024-09-11T00:15:56.823627+0000","last_peered":"2024-09-11T00:15:56.823627+0000","last_clean":"2024-09-11T00:15:56.823627+0000","last_became_active":"2024-09-11T00:14:23.917150+0000","last_became_peered":"2024-09-11T00:14:23.917150+0000","last_unstale":"2024-09-11T00:15:56.823627+0000","last_undegraded":"2024-09-11T00:15:56.823627+0000","last_fullsized":"2024-09-11T00:15:56.823627+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:13:55.687712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848002+0000","last_change":"2024-09-11T00:14:25.932674+0000","last_active":"2024-09-11T00:15:56.848002+0000","last_peered":"2024-09-11T00:15:56.848002+0000","last_clean":"2024-09-11T00:15:56.848002+0000","last_became_active":"2024-09-11T00:14:25.932353+0000","last_became_peered":"2024-09-11T00:14:25.932353+0000","last_unstale":"2024-09-11T00:15:56.848002+0000","last_undegraded":"2024-09-11T00:15:56.848002+0000","last_fullsized":"2024-09-11T00:15:56.848002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:48.721854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823755+0000","last_change":"2024-09-11T00:14:23.913063+0000","last_active":"2024-09-11T00:15:56.823755+0000","last_peered":"2024-09-11T00:15:56.823755+0000","last_clean":"2024-09-11T00:15:56.823755+0000","last_became_active":"2024-09-11T00:14:23.912688+0000","last_became_peered":"2024-09-11T00:14:23.912688+0000","last_unstale":"2024-09-11T00:15:56.823755+0000","last_undegraded":"2024-09-11T00:15:56.823755+0000","last_fullsized":"2024-09-11T00:15:56.823755+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:35.228733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"78'6","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.850017+0000","last_change":"2024-09-11T00:14:25.928099+0000","last_active":"2024-09-11T00:15:56.850017+0000","last_peered":"2024-09-11T00:15:56.850017+0000","last_clean":"2024-09-11T00:15:56.850017+0000","last_became_active":"2024-09-11T00:14:25.927741+0000","last_became_peered":"2024-09-11T00:14:25.927741+0000","last_unstale":"2024-09-11T00:15:56.850017+0000","last_undegraded":"2024-09-11T00:15:56.850017+0000","last_fullsized":"2024-09-11T00:15:56.850017+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:12.263180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848168+0000","last_change":"2024-09-11T00:14:24.082533+0000","last_active":"2024-09-11T00:15:56.848168+0000","last_peered":"2024-09-11T00:15:56.848168+0000","last_clean":"2024-09-11T00:15:56.848168+0000","last_became_active":"2024-09-11T00:14:24.081666+0000","last_became_peered":"2024-09-11T00:14:24.081666+0000","last_unstale":"2024-09-11T00:15:56.848168+0000","last_undegraded":"2024-09-11T00:15:56.848168+0000","last_fullsized":"2024-09-11T00:15:56.848168+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:56.485366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"78'5","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847950+0000","last_change":"2024-09-11T00:14:25.912666+0000","last_active":"2024-09-11T00:15:56.847950+0000","last_peered":"2024-09-11T00:15:56.847950+0000","last_clean":"2024-09-11T00:15:56.847950+0000","last_became_active":"2024-09-11T00:14:25.912370+0000","last_became_peered":"2024-09-11T00:14:25.912370+0000","last_unstale":"2024-09-11T00:15:56.847950+0000","last_undegraded":"2024-09-11T00:15:56.847950+0000","last_fullsized":"2024-09-11T00:15:56.847950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:44.400265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848247+0000","last_change":"2024-09-11T00:14:23.914407+0000","last_active":"2024-09-11T00:15:56.848247+0000","last_peered":"2024-09-11T00:15:56.848247+0000","last_clean":"2024-09-11T00:15:56.848247+0000","last_became_active":"2024-09-11T00:14:23.914115+0000","last_became_peered":"2024-09-11T00:14:23.914115+0000","last_unstale":"2024-09-11T00:15:56.848247+0000","last_undegraded":"2024-09-11T00:15:56.848247+0000","last_fullsized":"2024-09-11T00:15:56.848247+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:58.883324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63864,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":195,"num_read_kb":161,"num_write":88,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":191592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282342,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743458,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":864256,"data_stored":437401,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939686,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":999424,"data_stored":1091124,"data_compressed":47514,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103212,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":868352,"data_stored":438078,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":864256,"data_stored":437961,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495669,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":917504,"data_stored":1028446,"data_compressed":47514,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659195,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":864256,"data_stored":437496,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855424,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":925696,"data_stored":1028046,"data_compressed":47514,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018949,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":864256,"data_stored":437401,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":872448,"data_stored":437600,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":937984,"data_stored":500479,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542227,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":933888,"data_stored":500445,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705752,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":864256,"data_stored":437469,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34264,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34264,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34264,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:16:08.760 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:16:08.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.890+0000 7f94ba43c640 1 -- 172.21.15.78:0/266030755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b4109070 msgr2=0x7f94b410f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:08.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.890+0000 7f94ba43c640 1 --2- 172.21.15.78:0/266030755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b4109070 0x7f94b410f870 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f94ac009ca0 tx=0x7f94ac02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.890+0000 7f94ba43c640 1 -- 172.21.15.78:0/266030755 shutdown_connections 2024-09-11T00:16:08.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.890+0000 7f94ba43c640 1 --2- 172.21.15.78:0/266030755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b4109070 0x7f94b410f870 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.890+0000 7f94ba43c640 1 --2- 172.21.15.78:0/266030755 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94b41086f0 0x7f94b4108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.890+0000 7f94ba43c640 1 --2- 172.21.15.78:0/266030755 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b4102cf0 0x7f94b41030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.890+0000 7f94ba43c640 1 -- 172.21.15.78:0/266030755 >> 172.21.15.78:0/266030755 conn(0x7f94b40fe750 msgr2=0x7f94b4100b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:08.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.890+0000 7f94ba43c640 1 -- 172.21.15.78:0/266030755 shutdown_connections 2024-09-11T00:16:08.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.890+0000 7f94ba43c640 1 -- 172.21.15.78:0/266030755 wait complete. 2024-09-11T00:16:08.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.891+0000 7f94ba43c640 1 Processor -- start 2024-09-11T00:16:08.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.891+0000 7f94ba43c640 1 -- start start 2024-09-11T00:16:08.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.891+0000 7f94ba43c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b4102cf0 0x7f94b4199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:08.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.891+0000 7f94ba43c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b41086f0 0x7f94b41997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:08.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.891+0000 7f94ba43c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94b4109070 0x7f94b419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:08.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.891+0000 7f94ba43c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f94b4112cf0 con 0x7f94b41086f0 2024-09-11T00:16:08.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.891+0000 7f94ba43c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f94b4112b70 con 0x7f94b4102cf0 2024-09-11T00:16:08.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.891+0000 7f94ba43c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f94b4112e70 con 0x7f94b4109070 2024-09-11T00:16:08.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.891+0000 7f94b37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b41086f0 0x7f94b41997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:08.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.891+0000 7f94b37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b41086f0 0x7f94b41997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51864/0 (socket says 172.21.15.78:51864) 2024-09-11T00:16:08.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.892+0000 7f94b37fe640 1 -- 172.21.15.78:0/1170625662 learned_addr learned my addr 172.21.15.78:0/1170625662 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:08.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.892+0000 7f94b89d9640 1 --2- 172.21.15.78:0/1170625662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94b4109070 0x7f94b419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:08.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.892+0000 7f94b3fff640 1 --2- 172.21.15.78:0/1170625662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b4102cf0 0x7f94b4199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:08.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.892+0000 7f94b37fe640 1 -- 172.21.15.78:0/1170625662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94b4109070 msgr2=0x7f94b419eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:08.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.892+0000 7f94b37fe640 1 --2- 172.21.15.78:0/1170625662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94b4109070 0x7f94b419eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.892+0000 7f94b37fe640 1 -- 172.21.15.78:0/1170625662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b4102cf0 msgr2=0x7f94b4199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:08.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.892+0000 7f94b37fe640 1 --2- 172.21.15.78:0/1170625662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b4102cf0 0x7f94b4199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:08.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.892+0000 7f94b37fe640 1 -- 172.21.15.78:0/1170625662 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b419f330 con 0x7f94b41086f0 2024-09-11T00:16:08.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.892+0000 7f94b3fff640 1 --2- 172.21.15.78:0/1170625662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b4102cf0 0x7f94b4199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:16:08.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.892+0000 7f94b37fe640 1 --2- 172.21.15.78:0/1170625662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b41086f0 0x7f94b41997d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f94a800e9f0 tx=0x7f94a800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:08.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.892+0000 7f94b17fa640 1 -- 172.21.15.78:0/1170625662 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a800cd80 con 0x7f94b41086f0 2024-09-11T00:16:08.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.892+0000 7f94b17fa640 1 -- 172.21.15.78:0/1170625662 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94a80054d0 con 0x7f94b41086f0 2024-09-11T00:16:08.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.892+0000 7f94b17fa640 1 -- 172.21.15.78:0/1170625662 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a8010690 con 0x7f94b41086f0 2024-09-11T00:16:08.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.892+0000 7f94ba43c640 1 -- 172.21.15.78:0/1170625662 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b419f620 con 0x7f94b41086f0 2024-09-11T00:16:08.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.892+0000 7f94ba43c640 1 -- 172.21.15.78:0/1170625662 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b41a5ce0 con 0x7f94b41086f0 2024-09-11T00:16:08.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.893+0000 7f94ba43c640 1 -- 172.21.15.78:0/1170625662 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b41030d0 con 0x7f94b41086f0 2024-09-11T00:16:08.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.895+0000 7f94b17fa640 1 -- 172.21.15.78:0/1170625662 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f94a8004e30 con 0x7f94b41086f0 2024-09-11T00:16:08.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.895+0000 7f94b17fa640 1 --2- 172.21.15.78:0/1170625662 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f949c0b53b0 0x7f949c0b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:08.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.895+0000 7f94b3fff640 1 --2- 172.21.15.78:0/1170625662 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f949c0b53b0 0x7f949c0b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:08.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.895+0000 7f94b17fa640 1 -- 172.21.15.78:0/1170625662 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f94a80e62f0 con 0x7f94b41086f0 2024-09-11T00:16:08.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.896+0000 7f94b3fff640 1 --2- 172.21.15.78:0/1170625662 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f949c0b53b0 0x7f949c0b7870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f94a4005fd0 tx=0x7f94a400b5f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:08.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:08.898+0000 7f94b17fa640 1 -- 172.21.15.78:0/1170625662 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f94a8056220 con 0x7f94b41086f0 2024-09-11T00:16:09.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:08 smithi138 ceph-mon[35019]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 282 B/s wr, 2 op/s 2024-09-11T00:16:09.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:08 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2011104231' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:16:09.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.070+0000 7f94ba43c640 1 -- 172.21.15.78:0/1170625662 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f94b4063590 con 0x7f949c0b53b0 2024-09-11T00:16:09.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.074+0000 7f94b17fa640 1 -- 172.21.15.78:0/1170625662 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259023 (secure 0 0 0) 0x7f94b4063590 con 0x7f949c0b53b0 2024-09-11T00:16:09.081 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:16:09.082 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-11T00:16:09.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.078+0000 7f94ba43c640 1 -- 172.21.15.78:0/1170625662 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f949c0b53b0 msgr2=0x7f949c0b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:09.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.078+0000 7f94ba43c640 1 --2- 172.21.15.78:0/1170625662 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f949c0b53b0 0x7f949c0b7870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f94a4005fd0 tx=0x7f94a400b5f0 comp rx=0 tx=0).stop 2024-09-11T00:16:09.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.078+0000 7f94ba43c640 1 -- 172.21.15.78:0/1170625662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b41086f0 msgr2=0x7f94b41997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:09.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.078+0000 7f94ba43c640 1 --2- 172.21.15.78:0/1170625662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b41086f0 0x7f94b41997d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f94a800e9f0 tx=0x7f94a800edf0 comp rx=0 tx=0).stop 2024-09-11T00:16:09.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.078+0000 7f94ba43c640 1 -- 172.21.15.78:0/1170625662 shutdown_connections 2024-09-11T00:16:09.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.078+0000 7f94ba43c640 1 --2- 172.21.15.78:0/1170625662 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f949c0b53b0 0x7f949c0b7870 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:09.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.078+0000 7f94ba43c640 1 --2- 172.21.15.78:0/1170625662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f94b4109070 0x7f94b419eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:09.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.078+0000 7f94ba43c640 1 --2- 172.21.15.78:0/1170625662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b41086f0 0x7f94b41997d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:09.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.078+0000 7f94ba43c640 1 --2- 172.21.15.78:0/1170625662 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f94b4102cf0 0x7f94b4199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:09.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.078+0000 7f94ba43c640 1 -- 172.21.15.78:0/1170625662 >> 172.21.15.78:0/1170625662 conn(0x7f94b40fe750 msgr2=0x7f94b4100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:09.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.078+0000 7f94ba43c640 1 -- 172.21.15.78:0/1170625662 shutdown_connections 2024-09-11T00:16:09.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.078+0000 7f94ba43c640 1 -- 172.21.15.78:0/1170625662 wait complete. 2024-09-11T00:16:09.087 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:08 smithi078 ceph-mon[30865]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 282 B/s wr, 2 op/s 2024-09-11T00:16:09.087 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:08 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2011104231' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:16:09.090 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-09-11T00:16:07.690890+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654466,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":276,"num_read_kb":230,"num_write":213,"num_write_kb":2242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951979,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":666,"ondisk_log_size":666,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364008,"kb_used_data":10524,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577816,"statfs":{"total":1151940427776,"available":1151567683584,"internally_reserved":0,"allocated":10776576,"data_stored":7211946,"data_compressed":246978,"data_compressed_allocated":331776,"data_compressed_original":2162688,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":11,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.873935"},"pg_stats":[{"pgid":"3.3f","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.825585+0000","last_change":"2024-09-11T00:14:25.922805+0000","last_active":"2024-09-11T00:15:56.825585+0000","last_peered":"2024-09-11T00:15:56.825585+0000","last_clean":"2024-09-11T00:15:56.825585+0000","last_became_active":"2024-09-11T00:14:25.922482+0000","last_became_peered":"2024-09-11T00:14:25.922482+0000","last_unstale":"2024-09-11T00:15:56.825585+0000","last_undegraded":"2024-09-11T00:15:56.825585+0000","last_fullsized":"2024-09-11T00:15:56.825585+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:53.209011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"78'4","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849916+0000","last_change":"2024-09-11T00:14:25.920760+0000","last_active":"2024-09-11T00:15:56.849916+0000","last_peered":"2024-09-11T00:15:56.849916+0000","last_clean":"2024-09-11T00:15:56.849916+0000","last_became_active":"2024-09-11T00:14:25.919720+0000","last_became_peered":"2024-09-11T00:14:25.919720+0000","last_unstale":"2024-09-11T00:15:56.849916+0000","last_undegraded":"2024-09-11T00:15:56.849916+0000","last_fullsized":"2024-09-11T00:15:56.849916+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:32.491200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849839+0000","last_change":"2024-09-11T00:14:25.928090+0000","last_active":"2024-09-11T00:15:56.849839+0000","last_peered":"2024-09-11T00:15:56.849839+0000","last_clean":"2024-09-11T00:15:56.849839+0000","last_became_active":"2024-09-11T00:14:25.927768+0000","last_became_peered":"2024-09-11T00:14:25.927768+0000","last_unstale":"2024-09-11T00:15:56.849839+0000","last_undegraded":"2024-09-11T00:15:56.849839+0000","last_fullsized":"2024-09-11T00:15:56.849839+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:00.025061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.819805+0000","last_change":"2024-09-11T00:14:25.920077+0000","last_active":"2024-09-11T00:15:56.819805+0000","last_peered":"2024-09-11T00:15:56.819805+0000","last_clean":"2024-09-11T00:15:56.819805+0000","last_became_active":"2024-09-11T00:14:25.919395+0000","last_became_peered":"2024-09-11T00:14:25.919395+0000","last_unstale":"2024-09-11T00:15:56.819805+0000","last_undegraded":"2024-09-11T00:15:56.819805+0000","last_fullsized":"2024-09-11T00:15:56.819805+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:41.441279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"78'4","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823354+0000","last_change":"2024-09-11T00:14:25.917872+0000","last_active":"2024-09-11T00:15:56.823354+0000","last_peered":"2024-09-11T00:15:56.823354+0000","last_clean":"2024-09-11T00:15:56.823354+0000","last_became_active":"2024-09-11T00:14:25.917533+0000","last_became_peered":"2024-09-11T00:14:25.917533+0000","last_unstale":"2024-09-11T00:15:56.823354+0000","last_undegraded":"2024-09-11T00:15:56.823354+0000","last_fullsized":"2024-09-11T00:15:56.823354+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:57.051435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"78'6","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848366+0000","last_change":"2024-09-11T00:14:25.914977+0000","last_active":"2024-09-11T00:15:56.848366+0000","last_peered":"2024-09-11T00:15:56.848366+0000","last_clean":"2024-09-11T00:15:56.848366+0000","last_became_active":"2024-09-11T00:14:25.914543+0000","last_became_peered":"2024-09-11T00:14:25.914543+0000","last_unstale":"2024-09-11T00:15:56.848366+0000","last_undegraded":"2024-09-11T00:15:56.848366+0000","last_fullsized":"2024-09-11T00:15:56.848366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:45.085347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"78'5","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847934+0000","last_change":"2024-09-11T00:14:25.928021+0000","last_active":"2024-09-11T00:15:56.847934+0000","last_peered":"2024-09-11T00:15:56.847934+0000","last_clean":"2024-09-11T00:15:56.847934+0000","last_became_active":"2024-09-11T00:14:25.927047+0000","last_became_peered":"2024-09-11T00:14:25.927047+0000","last_unstale":"2024-09-11T00:15:56.847934+0000","last_undegraded":"2024-09-11T00:15:56.847934+0000","last_fullsized":"2024-09-11T00:15:56.847934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:41.442622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847497+0000","last_change":"2024-09-11T00:14:25.925399+0000","last_active":"2024-09-11T00:15:56.847497+0000","last_peered":"2024-09-11T00:15:56.847497+0000","last_clean":"2024-09-11T00:15:56.847497+0000","last_became_active":"2024-09-11T00:14:25.925097+0000","last_became_peered":"2024-09-11T00:14:25.925097+0000","last_unstale":"2024-09-11T00:15:56.847497+0000","last_undegraded":"2024-09-11T00:15:56.847497+0000","last_fullsized":"2024-09-11T00:15:56.847497+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:36:44.962936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"78'11","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848579+0000","last_change":"2024-09-11T00:14:25.928123+0000","last_active":"2024-09-11T00:15:56.848579+0000","last_peered":"2024-09-11T00:15:56.848579+0000","last_clean":"2024-09-11T00:15:56.848579+0000","last_became_active":"2024-09-11T00:14:25.927826+0000","last_became_peered":"2024-09-11T00:14:25.927826+0000","last_unstale":"2024-09-11T00:15:56.848579+0000","last_undegraded":"2024-09-11T00:15:56.848579+0000","last_fullsized":"2024-09-11T00:15:56.848579+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:44.131708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"78'16","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849328+0000","last_change":"2024-09-11T00:14:25.920546+0000","last_active":"2024-09-11T00:15:56.849328+0000","last_peered":"2024-09-11T00:15:56.849328+0000","last_clean":"2024-09-11T00:15:56.849328+0000","last_became_active":"2024-09-11T00:14:25.920193+0000","last_became_peered":"2024-09-11T00:14:25.920193+0000","last_unstale":"2024-09-11T00:15:56.849328+0000","last_undegraded":"2024-09-11T00:15:56.849328+0000","last_fullsized":"2024-09-11T00:15:56.849328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:55.027260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"78'6","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848772+0000","last_change":"2024-09-11T00:14:25.931278+0000","last_active":"2024-09-11T00:15:56.848772+0000","last_peered":"2024-09-11T00:15:56.848772+0000","last_clean":"2024-09-11T00:15:56.848772+0000","last_became_active":"2024-09-11T00:14:25.930964+0000","last_became_peered":"2024-09-11T00:14:25.930964+0000","last_unstale":"2024-09-11T00:15:56.848772+0000","last_undegraded":"2024-09-11T00:15:56.848772+0000","last_fullsized":"2024-09-11T00:15:56.848772+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:06.537737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.819889+0000","last_change":"2024-09-11T00:14:25.919725+0000","last_active":"2024-09-11T00:15:56.819889+0000","last_peered":"2024-09-11T00:15:56.819889+0000","last_clean":"2024-09-11T00:15:56.819889+0000","last_became_active":"2024-09-11T00:14:25.918973+0000","last_became_peered":"2024-09-11T00:14:25.918973+0000","last_unstale":"2024-09-11T00:15:56.819889+0000","last_undegraded":"2024-09-11T00:15:56.819889+0000","last_fullsized":"2024-09-11T00:15:56.819889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:01:03.076980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"78'10","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818573+0000","last_change":"2024-09-11T00:14:25.922516+0000","last_active":"2024-09-11T00:15:56.818573+0000","last_peered":"2024-09-11T00:15:56.818573+0000","last_clean":"2024-09-11T00:15:56.818573+0000","last_became_active":"2024-09-11T00:14:25.922198+0000","last_became_peered":"2024-09-11T00:14:25.922198+0000","last_unstale":"2024-09-11T00:15:56.818573+0000","last_undegraded":"2024-09-11T00:15:56.818573+0000","last_fullsized":"2024-09-11T00:15:56.818573+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:26.065492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849699+0000","last_change":"2024-09-11T00:14:25.921663+0000","last_active":"2024-09-11T00:15:56.849699+0000","last_peered":"2024-09-11T00:15:56.849699+0000","last_clean":"2024-09-11T00:15:56.849699+0000","last_became_active":"2024-09-11T00:14:25.921328+0000","last_became_peered":"2024-09-11T00:14:25.921328+0000","last_unstale":"2024-09-11T00:15:56.849699+0000","last_undegraded":"2024-09-11T00:15:56.849699+0000","last_fullsized":"2024-09-11T00:15:56.849699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:04.674811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"78'7","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849561+0000","last_change":"2024-09-11T00:14:56.842141+0000","last_active":"2024-09-11T00:15:56.849561+0000","last_peered":"2024-09-11T00:15:56.849561+0000","last_clean":"2024-09-11T00:15:56.849561+0000","last_became_active":"2024-09-11T00:14:56.841726+0000","last_became_peered":"2024-09-11T00:14:56.841726+0000","last_unstale":"2024-09-11T00:15:56.849561+0000","last_undegraded":"2024-09-11T00:15:56.849561+0000","last_fullsized":"2024-09-11T00:15:56.849561+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:46.239876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847667+0000","last_change":"2024-09-11T00:14:25.927202+0000","last_active":"2024-09-11T00:15:56.847667+0000","last_peered":"2024-09-11T00:15:56.847667+0000","last_clean":"2024-09-11T00:15:56.847667+0000","last_became_active":"2024-09-11T00:14:25.926872+0000","last_became_peered":"2024-09-11T00:14:25.926872+0000","last_unstale":"2024-09-11T00:15:56.847667+0000","last_undegraded":"2024-09-11T00:15:56.847667+0000","last_fullsized":"2024-09-11T00:15:56.847667+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:44.409956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.825593+0000","last_change":"2024-09-11T00:14:25.923975+0000","last_active":"2024-09-11T00:15:56.825593+0000","last_peered":"2024-09-11T00:15:56.825593+0000","last_clean":"2024-09-11T00:15:56.825593+0000","last_became_active":"2024-09-11T00:14:25.923666+0000","last_became_peered":"2024-09-11T00:14:25.923666+0000","last_unstale":"2024-09-11T00:15:56.825593+0000","last_undegraded":"2024-09-11T00:15:56.825593+0000","last_fullsized":"2024-09-11T00:15:56.825593+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:54.803657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"78'10","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848200+0000","last_change":"2024-09-11T00:14:25.928083+0000","last_active":"2024-09-11T00:15:56.848200+0000","last_peered":"2024-09-11T00:15:56.848200+0000","last_clean":"2024-09-11T00:15:56.848200+0000","last_became_active":"2024-09-11T00:14:25.927727+0000","last_became_peered":"2024-09-11T00:14:25.927727+0000","last_unstale":"2024-09-11T00:15:56.848200+0000","last_undegraded":"2024-09-11T00:15:56.848200+0000","last_fullsized":"2024-09-11T00:15:56.848200+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:56.721661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849076+0000","last_change":"2024-09-11T00:14:25.910506+0000","last_active":"2024-09-11T00:15:56.849076+0000","last_peered":"2024-09-11T00:15:56.849076+0000","last_clean":"2024-09-11T00:15:56.849076+0000","last_became_active":"2024-09-11T00:14:25.910112+0000","last_became_peered":"2024-09-11T00:14:25.910112+0000","last_unstale":"2024-09-11T00:15:56.849076+0000","last_undegraded":"2024-09-11T00:15:56.849076+0000","last_fullsized":"2024-09-11T00:15:56.849076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:33:32.698411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.825200+0000","last_change":"2024-09-11T00:14:25.918512+0000","last_active":"2024-09-11T00:15:56.825200+0000","last_peered":"2024-09-11T00:15:56.825200+0000","last_clean":"2024-09-11T00:15:56.825200+0000","last_became_active":"2024-09-11T00:14:25.918191+0000","last_became_peered":"2024-09-11T00:14:25.918191+0000","last_unstale":"2024-09-11T00:15:56.825200+0000","last_undegraded":"2024-09-11T00:15:56.825200+0000","last_fullsized":"2024-09-11T00:15:56.825200+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:07:49.588919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"78'11","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818666+0000","last_change":"2024-09-11T00:14:25.918163+0000","last_active":"2024-09-11T00:15:56.818666+0000","last_peered":"2024-09-11T00:15:56.818666+0000","last_clean":"2024-09-11T00:15:56.818666+0000","last_became_active":"2024-09-11T00:14:25.917851+0000","last_became_peered":"2024-09-11T00:14:25.917851+0000","last_unstale":"2024-09-11T00:15:56.818666+0000","last_undegraded":"2024-09-11T00:15:56.818666+0000","last_fullsized":"2024-09-11T00:15:56.818666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:11.757881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"78'10","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847863+0000","last_change":"2024-09-11T00:14:25.930503+0000","last_active":"2024-09-11T00:15:56.847863+0000","last_peered":"2024-09-11T00:15:56.847863+0000","last_clean":"2024-09-11T00:15:56.847863+0000","last_became_active":"2024-09-11T00:14:25.930140+0000","last_became_peered":"2024-09-11T00:14:25.930140+0000","last_unstale":"2024-09-11T00:15:56.847863+0000","last_undegraded":"2024-09-11T00:15:56.847863+0000","last_fullsized":"2024-09-11T00:15:56.847863+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:43.227373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847887+0000","last_change":"2024-09-11T00:14:25.916866+0000","last_active":"2024-09-11T00:15:56.847887+0000","last_peered":"2024-09-11T00:15:56.847887+0000","last_clean":"2024-09-11T00:15:56.847887+0000","last_became_active":"2024-09-11T00:14:25.916393+0000","last_became_peered":"2024-09-11T00:14:25.916393+0000","last_unstale":"2024-09-11T00:15:56.847887+0000","last_undegraded":"2024-09-11T00:15:56.847887+0000","last_fullsized":"2024-09-11T00:15:56.847887+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:52.697895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"78'6","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848165+0000","last_change":"2024-09-11T00:14:56.764743+0000","last_active":"2024-09-11T00:15:56.848165+0000","last_peered":"2024-09-11T00:15:56.848165+0000","last_clean":"2024-09-11T00:15:56.848165+0000","last_became_active":"2024-09-11T00:14:56.764333+0000","last_became_peered":"2024-09-11T00:14:56.764333+0000","last_unstale":"2024-09-11T00:15:56.848165+0000","last_undegraded":"2024-09-11T00:15:56.848165+0000","last_fullsized":"2024-09-11T00:15:56.848165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:17:00.307318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,3],"acting":[7,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.27","version":"78'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847641+0000","last_change":"2024-09-11T00:14:25.913694+0000","last_active":"2024-09-11T00:15:56.847641+0000","last_peered":"2024-09-11T00:15:56.847641+0000","last_clean":"2024-09-11T00:15:56.847641+0000","last_became_active":"2024-09-11T00:14:25.913405+0000","last_became_peered":"2024-09-11T00:14:25.913405+0000","last_unstale":"2024-09-11T00:15:56.847641+0000","last_undegraded":"2024-09-11T00:15:56.847641+0000","last_fullsized":"2024-09-11T00:15:56.847641+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:24.636698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"78'15","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848748+0000","last_change":"2024-09-11T00:14:25.928598+0000","last_active":"2024-09-11T00:15:56.848748+0000","last_peered":"2024-09-11T00:15:56.848748+0000","last_clean":"2024-09-11T00:15:56.848748+0000","last_became_active":"2024-09-11T00:14:25.928230+0000","last_became_peered":"2024-09-11T00:14:25.928230+0000","last_unstale":"2024-09-11T00:15:56.848748+0000","last_undegraded":"2024-09-11T00:15:56.848748+0000","last_fullsized":"2024-09-11T00:15:56.848748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:00.820900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"78'6","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.825361+0000","last_change":"2024-09-11T00:14:25.922296+0000","last_active":"2024-09-11T00:15:56.825361+0000","last_peered":"2024-09-11T00:15:56.825361+0000","last_clean":"2024-09-11T00:15:56.825361+0000","last_became_active":"2024-09-11T00:14:25.921188+0000","last_became_peered":"2024-09-11T00:14:25.921188+0000","last_unstale":"2024-09-11T00:15:56.825361+0000","last_undegraded":"2024-09-11T00:15:56.825361+0000","last_fullsized":"2024-09-11T00:15:56.825361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:31.478302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"78'4","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818595+0000","last_change":"2024-09-11T00:14:25.910201+0000","last_active":"2024-09-11T00:15:56.818595+0000","last_peered":"2024-09-11T00:15:56.818595+0000","last_clean":"2024-09-11T00:15:56.818595+0000","last_became_active":"2024-09-11T00:14:25.909867+0000","last_became_peered":"2024-09-11T00:14:25.909867+0000","last_unstale":"2024-09-11T00:15:56.818595+0000","last_undegraded":"2024-09-11T00:15:56.818595+0000","last_fullsized":"2024-09-11T00:15:56.818595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:17.445805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849767+0000","last_change":"2024-09-11T00:14:25.914971+0000","last_active":"2024-09-11T00:15:56.849767+0000","last_peered":"2024-09-11T00:15:56.849767+0000","last_clean":"2024-09-11T00:15:56.849767+0000","last_became_active":"2024-09-11T00:14:25.914614+0000","last_became_peered":"2024-09-11T00:14:25.914614+0000","last_unstale":"2024-09-11T00:15:56.849767+0000","last_undegraded":"2024-09-11T00:15:56.849767+0000","last_fullsized":"2024-09-11T00:15:56.849767+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848188+0000","last_change":"2024-09-11T00:14:25.916006+0000","last_active":"2024-09-11T00:15:56.848188+0000","last_peered":"2024-09-11T00:15:56.848188+0000","last_clean":"2024-09-11T00:15:56.848188+0000","last_became_active":"2024-09-11T00:14:25.915479+0000","last_became_peered":"2024-09-11T00:14:25.915479+0000","last_unstale":"2024-09-11T00:15:56.848188+0000","last_undegraded":"2024-09-11T00:15:56.848188+0000","last_fullsized":"2024-09-11T00:15:56.848188+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:42.513673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"78'12","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848254+0000","last_change":"2024-09-11T00:14:25.925601+0000","last_active":"2024-09-11T00:15:56.848254+0000","last_peered":"2024-09-11T00:15:56.848254+0000","last_clean":"2024-09-11T00:15:56.848254+0000","last_became_active":"2024-09-11T00:14:25.925289+0000","last_became_peered":"2024-09-11T00:14:25.925289+0000","last_unstale":"2024-09-11T00:15:56.848254+0000","last_undegraded":"2024-09-11T00:15:56.848254+0000","last_fullsized":"2024-09-11T00:15:56.848254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:17.324565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.824996+0000","last_change":"2024-09-11T00:14:25.922316+0000","last_active":"2024-09-11T00:15:56.824996+0000","last_peered":"2024-09-11T00:15:56.824996+0000","last_clean":"2024-09-11T00:15:56.824996+0000","last_became_active":"2024-09-11T00:14:25.920991+0000","last_became_peered":"2024-09-11T00:14:25.920991+0000","last_unstale":"2024-09-11T00:15:56.824996+0000","last_undegraded":"2024-09-11T00:15:56.824996+0000","last_fullsized":"2024-09-11T00:15:56.824996+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:36.362500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823283+0000","last_change":"2024-09-11T00:14:25.919579+0000","last_active":"2024-09-11T00:15:56.823283+0000","last_peered":"2024-09-11T00:15:56.823283+0000","last_clean":"2024-09-11T00:15:56.823283+0000","last_became_active":"2024-09-11T00:14:25.919245+0000","last_became_peered":"2024-09-11T00:14:25.919245+0000","last_unstale":"2024-09-11T00:15:56.823283+0000","last_undegraded":"2024-09-11T00:15:56.823283+0000","last_fullsized":"2024-09-11T00:15:56.823283+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:47.885242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847987+0000","last_change":"2024-09-11T00:14:56.767631+0000","last_active":"2024-09-11T00:15:56.847987+0000","last_peered":"2024-09-11T00:15:56.847987+0000","last_clean":"2024-09-11T00:15:56.847987+0000","last_became_active":"2024-09-11T00:14:56.767229+0000","last_became_peered":"2024-09-11T00:14:56.767229+0000","last_unstale":"2024-09-11T00:15:56.847987+0000","last_undegraded":"2024-09-11T00:15:56.847987+0000","last_fullsized":"2024-09-11T00:15:56.847987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:15.084255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847779+0000","last_change":"2024-09-11T00:14:25.921414+0000","last_active":"2024-09-11T00:15:56.847779+0000","last_peered":"2024-09-11T00:15:56.847779+0000","last_clean":"2024-09-11T00:15:56.847779+0000","last_became_active":"2024-09-11T00:14:25.921096+0000","last_became_peered":"2024-09-11T00:14:25.921096+0000","last_unstale":"2024-09-11T00:15:56.847779+0000","last_undegraded":"2024-09-11T00:15:56.847779+0000","last_fullsized":"2024-09-11T00:15:56.847779+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:38:45.938435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848492+0000","last_change":"2024-09-11T00:14:23.913359+0000","last_active":"2024-09-11T00:15:56.848492+0000","last_peered":"2024-09-11T00:15:56.848492+0000","last_clean":"2024-09-11T00:15:56.848492+0000","last_became_active":"2024-09-11T00:14:23.913073+0000","last_became_peered":"2024-09-11T00:14:23.913073+0000","last_unstale":"2024-09-11T00:15:56.848492+0000","last_undegraded":"2024-09-11T00:15:56.848492+0000","last_fullsized":"2024-09-11T00:15:56.848492+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:04.907618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818371+0000","last_change":"2024-09-11T00:14:23.905723+0000","last_active":"2024-09-11T00:15:56.818371+0000","last_peered":"2024-09-11T00:15:56.818371+0000","last_clean":"2024-09-11T00:15:56.818371+0000","last_became_active":"2024-09-11T00:14:23.905392+0000","last_became_peered":"2024-09-11T00:14:23.905392+0000","last_unstale":"2024-09-11T00:15:56.818371+0000","last_undegraded":"2024-09-11T00:15:56.818371+0000","last_fullsized":"2024-09-11T00:15:56.818371+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:48.603410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847597+0000","last_change":"2024-09-11T00:14:25.915843+0000","last_active":"2024-09-11T00:15:56.847597+0000","last_peered":"2024-09-11T00:15:56.847597+0000","last_clean":"2024-09-11T00:15:56.847597+0000","last_became_active":"2024-09-11T00:14:25.915543+0000","last_became_peered":"2024-09-11T00:14:25.915543+0000","last_unstale":"2024-09-11T00:15:56.847597+0000","last_undegraded":"2024-09-11T00:15:56.847597+0000","last_fullsized":"2024-09-11T00:15:56.847597+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:10.781401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847529+0000","last_change":"2024-09-11T00:14:23.913017+0000","last_active":"2024-09-11T00:15:56.847529+0000","last_peered":"2024-09-11T00:15:56.847529+0000","last_clean":"2024-09-11T00:15:56.847529+0000","last_became_active":"2024-09-11T00:14:23.912674+0000","last_became_peered":"2024-09-11T00:14:23.912674+0000","last_unstale":"2024-09-11T00:15:56.847529+0000","last_undegraded":"2024-09-11T00:15:56.847529+0000","last_fullsized":"2024-09-11T00:15:56.847529+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:22.711358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"78'11","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847937+0000","last_change":"2024-09-11T00:14:25.917969+0000","last_active":"2024-09-11T00:15:56.847937+0000","last_peered":"2024-09-11T00:15:56.847937+0000","last_clean":"2024-09-11T00:15:56.847937+0000","last_became_active":"2024-09-11T00:14:25.917673+0000","last_became_peered":"2024-09-11T00:14:25.917673+0000","last_unstale":"2024-09-11T00:15:56.847937+0000","last_undegraded":"2024-09-11T00:15:56.847937+0000","last_fullsized":"2024-09-11T00:15:56.847937+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:55:36.992260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848791+0000","last_change":"2024-09-11T00:14:23.915544+0000","last_active":"2024-09-11T00:15:56.848791+0000","last_peered":"2024-09-11T00:15:56.848791+0000","last_clean":"2024-09-11T00:15:56.848791+0000","last_became_active":"2024-09-11T00:14:23.915129+0000","last_became_peered":"2024-09-11T00:14:23.915129+0000","last_unstale":"2024-09-11T00:15:56.848791+0000","last_undegraded":"2024-09-11T00:15:56.848791+0000","last_fullsized":"2024-09-11T00:15:56.848791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:06.720068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"78'10","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848853+0000","last_change":"2024-09-11T00:14:25.927212+0000","last_active":"2024-09-11T00:15:56.848853+0000","last_peered":"2024-09-11T00:15:56.848853+0000","last_clean":"2024-09-11T00:15:56.848853+0000","last_became_active":"2024-09-11T00:14:25.926875+0000","last_became_peered":"2024-09-11T00:14:25.926875+0000","last_unstale":"2024-09-11T00:15:56.848853+0000","last_undegraded":"2024-09-11T00:15:56.848853+0000","last_fullsized":"2024-09-11T00:15:56.848853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:06.749494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848162+0000","last_change":"2024-09-11T00:14:23.907318+0000","last_active":"2024-09-11T00:15:56.848162+0000","last_peered":"2024-09-11T00:15:56.848162+0000","last_clean":"2024-09-11T00:15:56.848162+0000","last_became_active":"2024-09-11T00:14:23.905858+0000","last_became_peered":"2024-09-11T00:14:23.905858+0000","last_unstale":"2024-09-11T00:15:56.848162+0000","last_undegraded":"2024-09-11T00:15:56.848162+0000","last_fullsized":"2024-09-11T00:15:56.848162+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:16.005219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.850031+0000","last_change":"2024-09-11T00:14:25.922126+0000","last_active":"2024-09-11T00:15:56.850031+0000","last_peered":"2024-09-11T00:15:56.850031+0000","last_clean":"2024-09-11T00:15:56.850031+0000","last_became_active":"2024-09-11T00:14:25.921801+0000","last_became_peered":"2024-09-11T00:14:25.921801+0000","last_unstale":"2024-09-11T00:15:56.850031+0000","last_undegraded":"2024-09-11T00:15:56.850031+0000","last_fullsized":"2024-09-11T00:15:56.850031+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:06.770343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848195+0000","last_change":"2024-09-11T00:14:24.083872+0000","last_active":"2024-09-11T00:15:56.848195+0000","last_peered":"2024-09-11T00:15:56.848195+0000","last_clean":"2024-09-11T00:15:56.848195+0000","last_became_active":"2024-09-11T00:14:24.083479+0000","last_became_peered":"2024-09-11T00:14:24.083479+0000","last_unstale":"2024-09-11T00:15:56.848195+0000","last_undegraded":"2024-09-11T00:15:56.848195+0000","last_fullsized":"2024-09-11T00:15:56.848195+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:19:30.492828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"78'11","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848014+0000","last_change":"2024-09-11T00:14:25.932281+0000","last_active":"2024-09-11T00:15:56.848014+0000","last_peered":"2024-09-11T00:15:56.848014+0000","last_clean":"2024-09-11T00:15:56.848014+0000","last_became_active":"2024-09-11T00:14:25.931935+0000","last_became_peered":"2024-09-11T00:14:25.931935+0000","last_unstale":"2024-09-11T00:15:56.848014+0000","last_undegraded":"2024-09-11T00:15:56.848014+0000","last_fullsized":"2024-09-11T00:15:56.848014+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:55.166421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'30","reported_seq":247,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:16:03.876497+0000","last_change":"2024-09-11T00:14:23.909614+0000","last_active":"2024-09-11T00:16:03.876497+0000","last_peered":"2024-09-11T00:16:03.876497+0000","last_clean":"2024-09-11T00:16:03.876497+0000","last_became_active":"2024-09-11T00:14:23.909209+0000","last_became_peered":"2024-09-11T00:14:23.909209+0000","last_unstale":"2024-09-11T00:16:03.876497+0000","last_undegraded":"2024-09-11T00:16:03.876497+0000","last_fullsized":"2024-09-11T00:16:03.876497+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:14.467304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63066,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":190,"num_read_kb":156,"num_write":30,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"78'6","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823597+0000","last_change":"2024-09-11T00:14:25.924008+0000","last_active":"2024-09-11T00:15:56.823597+0000","last_peered":"2024-09-11T00:15:56.823597+0000","last_clean":"2024-09-11T00:15:56.823597+0000","last_became_active":"2024-09-11T00:14:25.923680+0000","last_became_peered":"2024-09-11T00:14:25.923680+0000","last_unstale":"2024-09-11T00:15:56.823597+0000","last_undegraded":"2024-09-11T00:15:56.823597+0000","last_fullsized":"2024-09-11T00:15:56.823597+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:27.106405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848178+0000","last_change":"2024-09-11T00:14:23.906908+0000","last_active":"2024-09-11T00:15:56.848178+0000","last_peered":"2024-09-11T00:15:56.848178+0000","last_clean":"2024-09-11T00:15:56.848178+0000","last_became_active":"2024-09-11T00:14:23.906170+0000","last_became_peered":"2024-09-11T00:14:23.906170+0000","last_unstale":"2024-09-11T00:15:56.848178+0000","last_undegraded":"2024-09-11T00:15:56.848178+0000","last_fullsized":"2024-09-11T00:15:56.848178+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:10:27.314551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818381+0000","last_change":"2024-09-11T00:14:25.917896+0000","last_active":"2024-09-11T00:15:56.818381+0000","last_peered":"2024-09-11T00:15:56.818381+0000","last_clean":"2024-09-11T00:15:56.818381+0000","last_became_active":"2024-09-11T00:14:25.916341+0000","last_became_peered":"2024-09-11T00:14:25.916341+0000","last_unstale":"2024-09-11T00:15:56.818381+0000","last_undegraded":"2024-09-11T00:15:56.818381+0000","last_fullsized":"2024-09-11T00:15:56.818381+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:05.723223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847711+0000","last_change":"2024-09-11T00:14:23.913113+0000","last_active":"2024-09-11T00:15:56.847711+0000","last_peered":"2024-09-11T00:15:56.847711+0000","last_clean":"2024-09-11T00:15:56.847711+0000","last_became_active":"2024-09-11T00:14:23.912791+0000","last_became_peered":"2024-09-11T00:14:23.912791+0000","last_unstale":"2024-09-11T00:15:56.847711+0000","last_undegraded":"2024-09-11T00:15:56.847711+0000","last_fullsized":"2024-09-11T00:15:56.847711+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:31.124528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"78'15","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848742+0000","last_change":"2024-09-11T00:14:25.927511+0000","last_active":"2024-09-11T00:15:56.848742+0000","last_peered":"2024-09-11T00:15:56.848742+0000","last_clean":"2024-09-11T00:15:56.848742+0000","last_became_active":"2024-09-11T00:14:25.927144+0000","last_became_peered":"2024-09-11T00:14:25.927144+0000","last_unstale":"2024-09-11T00:15:56.848742+0000","last_undegraded":"2024-09-11T00:15:56.848742+0000","last_fullsized":"2024-09-11T00:15:56.848742+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:35.680110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.819722+0000","last_change":"2024-09-11T00:14:23.906706+0000","last_active":"2024-09-11T00:15:56.819722+0000","last_peered":"2024-09-11T00:15:56.819722+0000","last_clean":"2024-09-11T00:15:56.819722+0000","last_became_active":"2024-09-11T00:14:23.906368+0000","last_became_peered":"2024-09-11T00:14:23.906368+0000","last_unstale":"2024-09-11T00:15:56.819722+0000","last_undegraded":"2024-09-11T00:15:56.819722+0000","last_fullsized":"2024-09-11T00:15:56.819722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:30:40.798446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"78'6","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848344+0000","last_change":"2024-09-11T00:14:25.925996+0000","last_active":"2024-09-11T00:15:56.848344+0000","last_peered":"2024-09-11T00:15:56.848344+0000","last_clean":"2024-09-11T00:15:56.848344+0000","last_became_active":"2024-09-11T00:14:25.925653+0000","last_became_peered":"2024-09-11T00:14:25.925653+0000","last_unstale":"2024-09-11T00:15:56.848344+0000","last_undegraded":"2024-09-11T00:15:56.848344+0000","last_fullsized":"2024-09-11T00:15:56.848344+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:50.366666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823271+0000","last_change":"2024-09-11T00:14:24.083774+0000","last_active":"2024-09-11T00:15:56.823271+0000","last_peered":"2024-09-11T00:15:56.823271+0000","last_clean":"2024-09-11T00:15:56.823271+0000","last_became_active":"2024-09-11T00:14:24.083398+0000","last_became_peered":"2024-09-11T00:14:24.083398+0000","last_unstale":"2024-09-11T00:15:56.823271+0000","last_undegraded":"2024-09-11T00:15:56.823271+0000","last_fullsized":"2024-09-11T00:15:56.823271+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:34.019592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"78'6","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847685+0000","last_change":"2024-09-11T00:14:25.927171+0000","last_active":"2024-09-11T00:15:56.847685+0000","last_peered":"2024-09-11T00:15:56.847685+0000","last_clean":"2024-09-11T00:15:56.847685+0000","last_became_active":"2024-09-11T00:14:25.926873+0000","last_became_peered":"2024-09-11T00:14:25.926873+0000","last_unstale":"2024-09-11T00:15:56.847685+0000","last_undegraded":"2024-09-11T00:15:56.847685+0000","last_fullsized":"2024-09-11T00:15:56.847685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:26.042903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.825266+0000","last_change":"2024-09-11T00:14:56.770315+0000","last_active":"2024-09-11T00:15:56.825266+0000","last_peered":"2024-09-11T00:15:56.825266+0000","last_clean":"2024-09-11T00:15:56.825266+0000","last_became_active":"2024-09-11T00:14:56.767056+0000","last_became_peered":"2024-09-11T00:14:56.767056+0000","last_unstale":"2024-09-11T00:15:56.825266+0000","last_undegraded":"2024-09-11T00:15:56.825266+0000","last_fullsized":"2024-09-11T00:15:56.825266+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:25.136382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"78'5","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.825345+0000","last_change":"2024-09-11T00:14:56.765888+0000","last_active":"2024-09-11T00:15:56.825345+0000","last_peered":"2024-09-11T00:15:56.825345+0000","last_clean":"2024-09-11T00:15:56.825345+0000","last_became_active":"2024-09-11T00:14:56.765508+0000","last_became_peered":"2024-09-11T00:14:56.765508+0000","last_unstale":"2024-09-11T00:15:56.825345+0000","last_undegraded":"2024-09-11T00:15:56.825345+0000","last_fullsized":"2024-09-11T00:15:56.825345+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:10.013207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818528+0000","last_change":"2024-09-11T00:14:23.904807+0000","last_active":"2024-09-11T00:15:56.818528+0000","last_peered":"2024-09-11T00:15:56.818528+0000","last_clean":"2024-09-11T00:15:56.818528+0000","last_became_active":"2024-09-11T00:14:23.904532+0000","last_became_peered":"2024-09-11T00:14:23.904532+0000","last_unstale":"2024-09-11T00:15:56.818528+0000","last_undegraded":"2024-09-11T00:15:56.818528+0000","last_fullsized":"2024-09-11T00:15:56.818528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:08.945508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848377+0000","last_change":"2024-09-11T00:14:25.919548+0000","last_active":"2024-09-11T00:15:56.848377+0000","last_peered":"2024-09-11T00:15:56.848377+0000","last_clean":"2024-09-11T00:15:56.848377+0000","last_became_active":"2024-09-11T00:14:25.919216+0000","last_became_peered":"2024-09-11T00:14:25.919216+0000","last_unstale":"2024-09-11T00:15:56.848377+0000","last_undegraded":"2024-09-11T00:15:56.848377+0000","last_fullsized":"2024-09-11T00:15:56.848377+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:18.318193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848300+0000","last_change":"2024-09-11T00:14:23.915488+0000","last_active":"2024-09-11T00:15:56.848300+0000","last_peered":"2024-09-11T00:15:56.848300+0000","last_clean":"2024-09-11T00:15:56.848300+0000","last_became_active":"2024-09-11T00:14:23.915147+0000","last_became_peered":"2024-09-11T00:14:23.915147+0000","last_unstale":"2024-09-11T00:15:56.848300+0000","last_undegraded":"2024-09-11T00:15:56.848300+0000","last_fullsized":"2024-09-11T00:15:56.848300+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:04.830225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848100+0000","last_change":"2024-09-11T00:14:25.919774+0000","last_active":"2024-09-11T00:15:56.848100+0000","last_peered":"2024-09-11T00:15:56.848100+0000","last_clean":"2024-09-11T00:15:56.848100+0000","last_became_active":"2024-09-11T00:14:25.919422+0000","last_became_peered":"2024-09-11T00:14:25.919422+0000","last_unstale":"2024-09-11T00:15:56.848100+0000","last_undegraded":"2024-09-11T00:15:56.848100+0000","last_fullsized":"2024-09-11T00:15:56.848100+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:03.928972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848481+0000","last_change":"2024-09-11T00:14:24.082414+0000","last_active":"2024-09-11T00:15:56.848481+0000","last_peered":"2024-09-11T00:15:56.848481+0000","last_clean":"2024-09-11T00:15:56.848481+0000","last_became_active":"2024-09-11T00:14:24.082058+0000","last_became_peered":"2024-09-11T00:14:24.082058+0000","last_unstale":"2024-09-11T00:15:56.848481+0000","last_undegraded":"2024-09-11T00:15:56.848481+0000","last_fullsized":"2024-09-11T00:15:56.848481+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:38.349964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848689+0000","last_change":"2024-09-11T00:14:25.930116+0000","last_active":"2024-09-11T00:15:56.848689+0000","last_peered":"2024-09-11T00:15:56.848689+0000","last_clean":"2024-09-11T00:15:56.848689+0000","last_became_active":"2024-09-11T00:14:25.929787+0000","last_became_peered":"2024-09-11T00:14:25.929787+0000","last_unstale":"2024-09-11T00:15:56.848689+0000","last_undegraded":"2024-09-11T00:15:56.848689+0000","last_fullsized":"2024-09-11T00:15:56.848689+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:29.655577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848895+0000","last_change":"2024-09-11T00:13:12.338952+0000","last_active":"2024-09-11T00:15:56.848895+0000","last_peered":"2024-09-11T00:15:56.848895+0000","last_clean":"2024-09-11T00:15:56.848895+0000","last_became_active":"2024-09-11T00:13:12.335030+0000","last_became_peered":"2024-09-11T00:13:12.335030+0000","last_unstale":"2024-09-11T00:15:56.848895+0000","last_undegraded":"2024-09-11T00:15:56.848895+0000","last_fullsized":"2024-09-11T00:15:56.848895+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:09:48.709624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:09:48.709624+0000","last_clean_scrub_stamp":"2024-09-11T00:09:48.709624+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:43.680771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.819722+0000","last_change":"2024-09-11T00:14:23.906794+0000","last_active":"2024-09-11T00:15:56.819722+0000","last_peered":"2024-09-11T00:15:56.819722+0000","last_clean":"2024-09-11T00:15:56.819722+0000","last_became_active":"2024-09-11T00:14:23.906430+0000","last_became_peered":"2024-09-11T00:14:23.906430+0000","last_unstale":"2024-09-11T00:15:56.819722+0000","last_undegraded":"2024-09-11T00:15:56.819722+0000","last_fullsized":"2024-09-11T00:15:56.819722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:58.804834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848009+0000","last_change":"2024-09-11T00:14:25.928119+0000","last_active":"2024-09-11T00:15:56.848009+0000","last_peered":"2024-09-11T00:15:56.848009+0000","last_clean":"2024-09-11T00:15:56.848009+0000","last_became_active":"2024-09-11T00:14:25.927806+0000","last_became_peered":"2024-09-11T00:14:25.927806+0000","last_unstale":"2024-09-11T00:15:56.848009+0000","last_undegraded":"2024-09-11T00:15:56.848009+0000","last_fullsized":"2024-09-11T00:15:56.848009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:34.630696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848708+0000","last_change":"2024-09-11T00:14:23.916252+0000","last_active":"2024-09-11T00:15:56.848708+0000","last_peered":"2024-09-11T00:15:56.848708+0000","last_clean":"2024-09-11T00:15:56.848708+0000","last_became_active":"2024-09-11T00:14:23.915905+0000","last_became_peered":"2024-09-11T00:14:23.915905+0000","last_unstale":"2024-09-11T00:15:56.848708+0000","last_undegraded":"2024-09-11T00:15:56.848708+0000","last_fullsized":"2024-09-11T00:15:56.848708+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:02.229067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"78'5","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818332+0000","last_change":"2024-09-11T00:14:25.910163+0000","last_active":"2024-09-11T00:15:56.818332+0000","last_peered":"2024-09-11T00:15:56.818332+0000","last_clean":"2024-09-11T00:15:56.818332+0000","last_became_active":"2024-09-11T00:14:25.909926+0000","last_became_peered":"2024-09-11T00:14:25.909926+0000","last_unstale":"2024-09-11T00:15:56.818332+0000","last_undegraded":"2024-09-11T00:15:56.818332+0000","last_fullsized":"2024-09-11T00:15:56.818332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:59:20.915080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818478+0000","last_change":"2024-09-11T00:14:24.081999+0000","last_active":"2024-09-11T00:15:56.818478+0000","last_peered":"2024-09-11T00:15:56.818478+0000","last_clean":"2024-09-11T00:15:56.818478+0000","last_became_active":"2024-09-11T00:14:24.081664+0000","last_became_peered":"2024-09-11T00:14:24.081664+0000","last_unstale":"2024-09-11T00:15:56.818478+0000","last_undegraded":"2024-09-11T00:15:56.818478+0000","last_fullsized":"2024-09-11T00:15:56.818478+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:22.485256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"78'8","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847323+0000","last_change":"2024-09-11T00:14:56.842397+0000","last_active":"2024-09-11T00:15:56.847323+0000","last_peered":"2024-09-11T00:15:56.847323+0000","last_clean":"2024-09-11T00:15:56.847323+0000","last_became_active":"2024-09-11T00:14:56.842017+0000","last_became_peered":"2024-09-11T00:14:56.842017+0000","last_unstale":"2024-09-11T00:15:56.847323+0000","last_undegraded":"2024-09-11T00:15:56.847323+0000","last_fullsized":"2024-09-11T00:15:56.847323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:10.300022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,6],"acting":[9,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848318+0000","last_change":"2024-09-11T00:14:23.905241+0000","last_active":"2024-09-11T00:15:56.848318+0000","last_peered":"2024-09-11T00:15:56.848318+0000","last_clean":"2024-09-11T00:15:56.848318+0000","last_became_active":"2024-09-11T00:14:23.904833+0000","last_became_peered":"2024-09-11T00:14:23.904833+0000","last_unstale":"2024-09-11T00:15:56.848318+0000","last_undegraded":"2024-09-11T00:15:56.848318+0000","last_fullsized":"2024-09-11T00:15:56.848318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:44:28.162800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"78'7","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849073+0000","last_change":"2024-09-11T00:14:56.766007+0000","last_active":"2024-09-11T00:15:56.849073+0000","last_peered":"2024-09-11T00:15:56.849073+0000","last_clean":"2024-09-11T00:15:56.849073+0000","last_became_active":"2024-09-11T00:14:56.765515+0000","last_became_peered":"2024-09-11T00:14:56.765515+0000","last_unstale":"2024-09-11T00:15:56.849073+0000","last_undegraded":"2024-09-11T00:15:56.849073+0000","last_fullsized":"2024-09-11T00:15:56.849073+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:31.159084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847896+0000","last_change":"2024-09-11T00:14:24.083578+0000","last_active":"2024-09-11T00:15:56.847896+0000","last_peered":"2024-09-11T00:15:56.847896+0000","last_clean":"2024-09-11T00:15:56.847896+0000","last_became_active":"2024-09-11T00:14:24.083233+0000","last_became_peered":"2024-09-11T00:14:24.083233+0000","last_unstale":"2024-09-11T00:15:56.847896+0000","last_undegraded":"2024-09-11T00:15:56.847896+0000","last_fullsized":"2024-09-11T00:15:56.847896+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:47.655836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'5","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848689+0000","last_change":"2024-09-11T00:14:56.771471+0000","last_active":"2024-09-11T00:15:56.848689+0000","last_peered":"2024-09-11T00:15:56.848689+0000","last_clean":"2024-09-11T00:15:56.848689+0000","last_became_active":"2024-09-11T00:14:56.764838+0000","last_became_peered":"2024-09-11T00:14:56.764838+0000","last_unstale":"2024-09-11T00:15:56.848689+0000","last_undegraded":"2024-09-11T00:15:56.848689+0000","last_fullsized":"2024-09-11T00:15:56.848689+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:24.683423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823883+0000","last_change":"2024-09-11T00:14:24.082284+0000","last_active":"2024-09-11T00:15:56.823883+0000","last_peered":"2024-09-11T00:15:56.823883+0000","last_clean":"2024-09-11T00:15:56.823883+0000","last_became_active":"2024-09-11T00:14:24.081859+0000","last_became_peered":"2024-09-11T00:14:24.081859+0000","last_unstale":"2024-09-11T00:15:56.823883+0000","last_undegraded":"2024-09-11T00:15:56.823883+0000","last_fullsized":"2024-09-11T00:15:56.823883+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:38.881342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818600+0000","last_change":"2024-09-11T00:14:25.910408+0000","last_active":"2024-09-11T00:15:56.818600+0000","last_peered":"2024-09-11T00:15:56.818600+0000","last_clean":"2024-09-11T00:15:56.818600+0000","last_became_active":"2024-09-11T00:14:25.909447+0000","last_became_peered":"2024-09-11T00:14:25.909447+0000","last_unstale":"2024-09-11T00:15:56.818600+0000","last_undegraded":"2024-09-11T00:15:56.818600+0000","last_fullsized":"2024-09-11T00:15:56.818600+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:20:11.249974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'10","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848291+0000","last_change":"2024-09-11T00:14:23.912799+0000","last_active":"2024-09-11T00:15:56.848291+0000","last_peered":"2024-09-11T00:15:56.848291+0000","last_clean":"2024-09-11T00:15:56.848291+0000","last_became_active":"2024-09-11T00:14:23.912440+0000","last_became_peered":"2024-09-11T00:14:23.912440+0000","last_unstale":"2024-09-11T00:15:56.848291+0000","last_undegraded":"2024-09-11T00:15:56.848291+0000","last_fullsized":"2024-09-11T00:15:56.848291+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:31.139405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"78'5","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847717+0000","last_change":"2024-09-11T00:14:25.920599+0000","last_active":"2024-09-11T00:15:56.847717+0000","last_peered":"2024-09-11T00:15:56.847717+0000","last_clean":"2024-09-11T00:15:56.847717+0000","last_became_active":"2024-09-11T00:14:25.920256+0000","last_became_peered":"2024-09-11T00:14:25.920256+0000","last_unstale":"2024-09-11T00:15:56.847717+0000","last_undegraded":"2024-09-11T00:15:56.847717+0000","last_fullsized":"2024-09-11T00:15:56.847717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:05.347880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.819941+0000","last_change":"2024-09-11T00:14:24.004190+0000","last_active":"2024-09-11T00:15:56.819941+0000","last_peered":"2024-09-11T00:15:56.819941+0000","last_clean":"2024-09-11T00:15:56.819941+0000","last_became_active":"2024-09-11T00:14:24.003842+0000","last_became_peered":"2024-09-11T00:14:24.003842+0000","last_unstale":"2024-09-11T00:15:56.819941+0000","last_undegraded":"2024-09-11T00:15:56.819941+0000","last_fullsized":"2024-09-11T00:15:56.819941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:43.876046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"78'7","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849915+0000","last_change":"2024-09-11T00:14:56.767088+0000","last_active":"2024-09-11T00:15:56.849915+0000","last_peered":"2024-09-11T00:15:56.849915+0000","last_clean":"2024-09-11T00:15:56.849915+0000","last_became_active":"2024-09-11T00:14:56.766783+0000","last_became_peered":"2024-09-11T00:14:56.766783+0000","last_unstale":"2024-09-11T00:15:56.849915+0000","last_undegraded":"2024-09-11T00:15:56.849915+0000","last_fullsized":"2024-09-11T00:15:56.849915+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:37.407811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,4],"acting":[0,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847890+0000","last_change":"2024-09-11T00:14:24.082118+0000","last_active":"2024-09-11T00:15:56.847890+0000","last_peered":"2024-09-11T00:15:56.847890+0000","last_clean":"2024-09-11T00:15:56.847890+0000","last_became_active":"2024-09-11T00:14:24.081844+0000","last_became_peered":"2024-09-11T00:14:24.081844+0000","last_unstale":"2024-09-11T00:15:56.847890+0000","last_undegraded":"2024-09-11T00:15:56.847890+0000","last_fullsized":"2024-09-11T00:15:56.847890+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:20.827385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"78'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823266+0000","last_change":"2024-09-11T00:14:25.917335+0000","last_active":"2024-09-11T00:15:56.823266+0000","last_peered":"2024-09-11T00:15:56.823266+0000","last_clean":"2024-09-11T00:15:56.823266+0000","last_became_active":"2024-09-11T00:14:25.916942+0000","last_became_peered":"2024-09-11T00:14:25.916942+0000","last_unstale":"2024-09-11T00:15:56.823266+0000","last_undegraded":"2024-09-11T00:15:56.823266+0000","last_fullsized":"2024-09-11T00:15:56.823266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:40.309186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848270+0000","last_change":"2024-09-11T00:14:23.906616+0000","last_active":"2024-09-11T00:15:56.848270+0000","last_peered":"2024-09-11T00:15:56.848270+0000","last_clean":"2024-09-11T00:15:56.848270+0000","last_became_active":"2024-09-11T00:14:23.906259+0000","last_became_peered":"2024-09-11T00:14:23.906259+0000","last_unstale":"2024-09-11T00:15:56.848270+0000","last_undegraded":"2024-09-11T00:15:56.848270+0000","last_fullsized":"2024-09-11T00:15:56.848270+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:01.514398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.825085+0000","last_change":"2024-09-11T00:14:25.925422+0000","last_active":"2024-09-11T00:15:56.825085+0000","last_peered":"2024-09-11T00:15:56.825085+0000","last_clean":"2024-09-11T00:15:56.825085+0000","last_became_active":"2024-09-11T00:14:25.923031+0000","last_became_peered":"2024-09-11T00:14:25.923031+0000","last_unstale":"2024-09-11T00:15:56.825085+0000","last_undegraded":"2024-09-11T00:15:56.825085+0000","last_fullsized":"2024-09-11T00:15:56.825085+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:59:52.217566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849461+0000","last_change":"2024-09-11T00:15:56.849368+0000","last_active":"2024-09-11T00:15:56.849461+0000","last_peered":"2024-09-11T00:15:56.849461+0000","last_clean":"2024-09-11T00:15:56.849461+0000","last_became_active":"2024-09-11T00:15:56.848892+0000","last_became_peered":"2024-09-11T00:15:56.848892+0000","last_unstale":"2024-09-11T00:15:56.849461+0000","last_undegraded":"2024-09-11T00:15:56.849461+0000","last_fullsized":"2024-09-11T00:15:56.849461+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:05.614826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847431+0000","last_change":"2024-09-11T00:14:25.917478+0000","last_active":"2024-09-11T00:15:56.847431+0000","last_peered":"2024-09-11T00:15:56.847431+0000","last_clean":"2024-09-11T00:15:56.847431+0000","last_became_active":"2024-09-11T00:14:25.917192+0000","last_became_peered":"2024-09-11T00:14:25.917192+0000","last_unstale":"2024-09-11T00:15:56.847431+0000","last_undegraded":"2024-09-11T00:15:56.847431+0000","last_fullsized":"2024-09-11T00:15:56.847431+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:46.695827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823387+0000","last_change":"2024-09-11T00:14:23.914141+0000","last_active":"2024-09-11T00:15:56.823387+0000","last_peered":"2024-09-11T00:15:56.823387+0000","last_clean":"2024-09-11T00:15:56.823387+0000","last_became_active":"2024-09-11T00:14:23.913757+0000","last_became_peered":"2024-09-11T00:14:23.913757+0000","last_unstale":"2024-09-11T00:15:56.823387+0000","last_undegraded":"2024-09-11T00:15:56.823387+0000","last_fullsized":"2024-09-11T00:15:56.823387+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:54:00.609715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"78'5","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848074+0000","last_change":"2024-09-11T00:14:25.924950+0000","last_active":"2024-09-11T00:15:56.848074+0000","last_peered":"2024-09-11T00:15:56.848074+0000","last_clean":"2024-09-11T00:15:56.848074+0000","last_became_active":"2024-09-11T00:14:25.924554+0000","last_became_peered":"2024-09-11T00:14:25.924554+0000","last_unstale":"2024-09-11T00:15:56.848074+0000","last_undegraded":"2024-09-11T00:15:56.848074+0000","last_fullsized":"2024-09-11T00:15:56.848074+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:29.303384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"78'15","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848089+0000","last_change":"2024-09-11T00:14:25.930162+0000","last_active":"2024-09-11T00:15:56.848089+0000","last_peered":"2024-09-11T00:15:56.848089+0000","last_clean":"2024-09-11T00:15:56.848089+0000","last_became_active":"2024-09-11T00:14:25.929820+0000","last_became_peered":"2024-09-11T00:14:25.929820+0000","last_unstale":"2024-09-11T00:15:56.848089+0000","last_undegraded":"2024-09-11T00:15:56.848089+0000","last_fullsized":"2024-09-11T00:15:56.848089+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:20:21.384841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823627+0000","last_change":"2024-09-11T00:14:23.917486+0000","last_active":"2024-09-11T00:15:56.823627+0000","last_peered":"2024-09-11T00:15:56.823627+0000","last_clean":"2024-09-11T00:15:56.823627+0000","last_became_active":"2024-09-11T00:14:23.917150+0000","last_became_peered":"2024-09-11T00:14:23.917150+0000","last_unstale":"2024-09-11T00:15:56.823627+0000","last_undegraded":"2024-09-11T00:15:56.823627+0000","last_fullsized":"2024-09-11T00:15:56.823627+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:13:55.687712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848002+0000","last_change":"2024-09-11T00:14:25.932674+0000","last_active":"2024-09-11T00:15:56.848002+0000","last_peered":"2024-09-11T00:15:56.848002+0000","last_clean":"2024-09-11T00:15:56.848002+0000","last_became_active":"2024-09-11T00:14:25.932353+0000","last_became_peered":"2024-09-11T00:14:25.932353+0000","last_unstale":"2024-09-11T00:15:56.848002+0000","last_undegraded":"2024-09-11T00:15:56.848002+0000","last_fullsized":"2024-09-11T00:15:56.848002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:48.721854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823755+0000","last_change":"2024-09-11T00:14:23.913063+0000","last_active":"2024-09-11T00:15:56.823755+0000","last_peered":"2024-09-11T00:15:56.823755+0000","last_clean":"2024-09-11T00:15:56.823755+0000","last_became_active":"2024-09-11T00:14:23.912688+0000","last_became_peered":"2024-09-11T00:14:23.912688+0000","last_unstale":"2024-09-11T00:15:56.823755+0000","last_undegraded":"2024-09-11T00:15:56.823755+0000","last_fullsized":"2024-09-11T00:15:56.823755+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:35.228733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"78'6","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.850017+0000","last_change":"2024-09-11T00:14:25.928099+0000","last_active":"2024-09-11T00:15:56.850017+0000","last_peered":"2024-09-11T00:15:56.850017+0000","last_clean":"2024-09-11T00:15:56.850017+0000","last_became_active":"2024-09-11T00:14:25.927741+0000","last_became_peered":"2024-09-11T00:14:25.927741+0000","last_unstale":"2024-09-11T00:15:56.850017+0000","last_undegraded":"2024-09-11T00:15:56.850017+0000","last_fullsized":"2024-09-11T00:15:56.850017+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:12.263180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848168+0000","last_change":"2024-09-11T00:14:24.082533+0000","last_active":"2024-09-11T00:15:56.848168+0000","last_peered":"2024-09-11T00:15:56.848168+0000","last_clean":"2024-09-11T00:15:56.848168+0000","last_became_active":"2024-09-11T00:14:24.081666+0000","last_became_peered":"2024-09-11T00:14:24.081666+0000","last_unstale":"2024-09-11T00:15:56.848168+0000","last_undegraded":"2024-09-11T00:15:56.848168+0000","last_fullsized":"2024-09-11T00:15:56.848168+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:56.485366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"78'5","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847950+0000","last_change":"2024-09-11T00:14:25.912666+0000","last_active":"2024-09-11T00:15:56.847950+0000","last_peered":"2024-09-11T00:15:56.847950+0000","last_clean":"2024-09-11T00:15:56.847950+0000","last_became_active":"2024-09-11T00:14:25.912370+0000","last_became_peered":"2024-09-11T00:14:25.912370+0000","last_unstale":"2024-09-11T00:15:56.847950+0000","last_undegraded":"2024-09-11T00:15:56.847950+0000","last_fullsized":"2024-09-11T00:15:56.847950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:44.400265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848247+0000","last_change":"2024-09-11T00:14:23.914407+0000","last_active":"2024-09-11T00:15:56.848247+0000","last_peered":"2024-09-11T00:15:56.848247+0000","last_clean":"2024-09-11T00:15:56.848247+0000","last_became_active":"2024-09-11T00:14:23.914115+0000","last_became_peered":"2024-09-11T00:14:23.914115+0000","last_unstale":"2024-09-11T00:15:56.848247+0000","last_undegraded":"2024-09-11T00:15:56.848247+0000","last_fullsized":"2024-09-11T00:15:56.848247+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:58.883324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63864,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":195,"num_read_kb":161,"num_write":88,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":191592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282342,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743458,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":864256,"data_stored":437401,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939686,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":999424,"data_stored":1091124,"data_compressed":47514,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103212,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":868352,"data_stored":438078,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":864256,"data_stored":437961,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495669,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":917504,"data_stored":1028446,"data_compressed":47514,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659195,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":864256,"data_stored":437496,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855424,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":925696,"data_stored":1028046,"data_compressed":47514,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018949,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":864256,"data_stored":437401,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":872448,"data_stored":437600,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":937984,"data_stored":500479,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542227,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":933888,"data_stored":500445,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705752,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":864256,"data_stored":437469,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34264,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34264,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34264,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:16:09.095 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-11T00:16:09.095 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T00:16:09.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.228+0000 7f83fadc9640 1 -- 172.21.15.78:0/3368949828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83f4104560 msgr2=0x7f83f410ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:09.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.228+0000 7f83fadc9640 1 --2- 172.21.15.78:0/3368949828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83f4104560 0x7f83f410ca40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009900 tx=0x7f83e002a410 comp rx=0 tx=0).stop 2024-09-11T00:16:09.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.228+0000 7f83fadc9640 1 -- 172.21.15.78:0/3368949828 shutdown_connections 2024-09-11T00:16:09.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.228+0000 7f83fadc9640 1 --2- 172.21.15.78:0/3368949828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83f410d090 0x7f83f410f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:09.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.228+0000 7f83fadc9640 1 --2- 172.21.15.78:0/3368949828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83f4104560 0x7f83f410ca40 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:09.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.228+0000 7f83fadc9640 1 --2- 172.21.15.78:0/3368949828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83f4103c40 0x7f83f4104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:09.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.228+0000 7f83fadc9640 1 -- 172.21.15.78:0/3368949828 >> 172.21.15.78:0/3368949828 conn(0x7f83f40fd650 msgr2=0x7f83f40ffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:09.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.228+0000 7f83fadc9640 1 -- 172.21.15.78:0/3368949828 shutdown_connections 2024-09-11T00:16:09.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.228+0000 7f83fadc9640 1 -- 172.21.15.78:0/3368949828 wait complete. 2024-09-11T00:16:09.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.229+0000 7f83fadc9640 1 Processor -- start 2024-09-11T00:16:09.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.229+0000 7f83fadc9640 1 -- start start 2024-09-11T00:16:09.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.229+0000 7f83fadc9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83f4103c40 0x7f83f4199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:09.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.229+0000 7f83fadc9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83f4104560 0x7f83f41997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:09.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.229+0000 7f83fadc9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83f410d090 0x7f83f419eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:09.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.229+0000 7f83fadc9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f83f4112d20 con 0x7f83f410d090 2024-09-11T00:16:09.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.229+0000 7f83fadc9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f83f4112ba0 con 0x7f83f4103c40 2024-09-11T00:16:09.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.229+0000 7f83fadc9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f83f4112ea0 con 0x7f83f4104560 2024-09-11T00:16:09.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.229+0000 7f83f9366640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83f410d090 0x7f83f419eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:09.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.229+0000 7f83f9366640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83f410d090 0x7f83f419eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51874/0 (socket says 172.21.15.78:51874) 2024-09-11T00:16:09.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.229+0000 7f83f9366640 1 -- 172.21.15.78:0/3722944510 learned_addr learned my addr 172.21.15.78:0/3722944510 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:09.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.229+0000 7f83f8b65640 1 --2- 172.21.15.78:0/3722944510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83f4103c40 0x7f83f4199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:09.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.229+0000 7f83f9366640 1 -- 172.21.15.78:0/3722944510 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83f4104560 msgr2=0x7f83f41997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:09.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.229+0000 7f83f9366640 1 --2- 172.21.15.78:0/3722944510 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83f4104560 0x7f83f41997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:09.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.229+0000 7f83f9366640 1 -- 172.21.15.78:0/3722944510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83f4103c40 msgr2=0x7f83f4199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:09.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.229+0000 7f83f9366640 1 --2- 172.21.15.78:0/3722944510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83f4103c40 0x7f83f4199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:09.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.229+0000 7f83f9366640 1 -- 172.21.15.78:0/3722944510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f419f300 con 0x7f83f410d090 2024-09-11T00:16:09.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.230+0000 7f83f9366640 1 --2- 172.21.15.78:0/3722944510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83f410d090 0x7f83f419eb30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f83ec00eaa0 tx=0x7f83ec00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:09.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.230+0000 7f83f1ffb640 1 -- 172.21.15.78:0/3722944510 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ec00cdb0 con 0x7f83f410d090 2024-09-11T00:16:09.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.230+0000 7f83f1ffb640 1 -- 172.21.15.78:0/3722944510 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83ec005020 con 0x7f83f410d090 2024-09-11T00:16:09.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.230+0000 7f83fadc9640 1 -- 172.21.15.78:0/3722944510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83f419f5f0 con 0x7f83f410d090 2024-09-11T00:16:09.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.230+0000 7f83f1ffb640 1 -- 172.21.15.78:0/3722944510 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ec0116d0 con 0x7f83f410d090 2024-09-11T00:16:09.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.230+0000 7f83fadc9640 1 -- 172.21.15.78:0/3722944510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83f41a5cb0 con 0x7f83f410d090 2024-09-11T00:16:09.235 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:08 smithi112 ceph-mon[35627]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 282 B/s wr, 2 op/s 2024-09-11T00:16:09.236 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:08 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2011104231' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:16:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.231+0000 7f83fadc9640 1 -- 172.21.15.78:0/3722944510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83f4104020 con 0x7f83f410d090 2024-09-11T00:16:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.232+0000 7f83f1ffb640 1 -- 172.21.15.78:0/3722944510 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f83ec00f040 con 0x7f83f410d090 2024-09-11T00:16:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.233+0000 7f83f1ffb640 1 --2- 172.21.15.78:0/3722944510 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f83e40b5330 0x7f83e40b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:09.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.233+0000 7f83f8b65640 1 --2- 172.21.15.78:0/3722944510 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f83e40b5330 0x7f83e40b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:09.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.233+0000 7f83f1ffb640 1 -- 172.21.15.78:0/3722944510 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f83ec0e5ba0 con 0x7f83f410d090 2024-09-11T00:16:09.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.233+0000 7f83f8b65640 1 --2- 172.21.15.78:0/3722944510 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f83e40b5330 0x7f83e40b77f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f83e8005d00 tx=0x7f83e800b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:09.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.237+0000 7f83f1ffb640 1 -- 172.21.15.78:0/3722944510 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f83ec016030 con 0x7f83f410d090 2024-09-11T00:16:09.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.408+0000 7f83fadc9640 1 -- 172.21.15.78:0/3722944510 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f83f4063590 con 0x7f83e40b5330 2024-09-11T00:16:09.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.412+0000 7f83f1ffb640 1 -- 172.21.15.78:0/3722944510 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259023 (secure 0 0 0) 0x7f83f4063590 con 0x7f83e40b5330 2024-09-11T00:16:09.417 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:16:09.418 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-11T00:16:09.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.416+0000 7f83fadc9640 1 -- 172.21.15.78:0/3722944510 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f83e40b5330 msgr2=0x7f83e40b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:09.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.416+0000 7f83fadc9640 1 --2- 172.21.15.78:0/3722944510 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f83e40b5330 0x7f83e40b77f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f83e8005d00 tx=0x7f83e800b410 comp rx=0 tx=0).stop 2024-09-11T00:16:09.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.416+0000 7f83fadc9640 1 -- 172.21.15.78:0/3722944510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83f410d090 msgr2=0x7f83f419eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:09.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.416+0000 7f83fadc9640 1 --2- 172.21.15.78:0/3722944510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83f410d090 0x7f83f419eb30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f83ec00eaa0 tx=0x7f83ec00ef60 comp rx=0 tx=0).stop 2024-09-11T00:16:09.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.416+0000 7f83fadc9640 1 -- 172.21.15.78:0/3722944510 shutdown_connections 2024-09-11T00:16:09.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.416+0000 7f83fadc9640 1 --2- 172.21.15.78:0/3722944510 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f83e40b5330 0x7f83e40b77f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:09.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.416+0000 7f83fadc9640 1 --2- 172.21.15.78:0/3722944510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83f410d090 0x7f83f419eb30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:09.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.416+0000 7f83fadc9640 1 --2- 172.21.15.78:0/3722944510 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83f4104560 0x7f83f41997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:09.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.416+0000 7f83fadc9640 1 --2- 172.21.15.78:0/3722944510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f83f4103c40 0x7f83f4199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.416+0000 7f83fadc9640 1 -- 172.21.15.78:0/3722944510 >> 172.21.15.78:0/3722944510 conn(0x7f83f40fd650 msgr2=0x7f83f40fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.416+0000 7f83fadc9640 1 -- 172.21.15.78:0/3722944510 shutdown_connections 2024-09-11T00:16:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:09.416+0000 7f83fadc9640 1 -- 172.21.15.78:0/3722944510 wait complete. 2024-09-11T00:16:09.429 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-09-11T00:16:07.690890+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654466,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":276,"num_read_kb":230,"num_write":213,"num_write_kb":2242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951979,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":666,"ondisk_log_size":666,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364008,"kb_used_data":10524,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577816,"statfs":{"total":1151940427776,"available":1151567683584,"internally_reserved":0,"allocated":10776576,"data_stored":7211946,"data_compressed":246978,"data_compressed_allocated":331776,"data_compressed_original":2162688,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":11,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.873935"},"pg_stats":[{"pgid":"3.3f","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.825585+0000","last_change":"2024-09-11T00:14:25.922805+0000","last_active":"2024-09-11T00:15:56.825585+0000","last_peered":"2024-09-11T00:15:56.825585+0000","last_clean":"2024-09-11T00:15:56.825585+0000","last_became_active":"2024-09-11T00:14:25.922482+0000","last_became_peered":"2024-09-11T00:14:25.922482+0000","last_unstale":"2024-09-11T00:15:56.825585+0000","last_undegraded":"2024-09-11T00:15:56.825585+0000","last_fullsized":"2024-09-11T00:15:56.825585+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:53.209011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"78'4","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849916+0000","last_change":"2024-09-11T00:14:25.920760+0000","last_active":"2024-09-11T00:15:56.849916+0000","last_peered":"2024-09-11T00:15:56.849916+0000","last_clean":"2024-09-11T00:15:56.849916+0000","last_became_active":"2024-09-11T00:14:25.919720+0000","last_became_peered":"2024-09-11T00:14:25.919720+0000","last_unstale":"2024-09-11T00:15:56.849916+0000","last_undegraded":"2024-09-11T00:15:56.849916+0000","last_fullsized":"2024-09-11T00:15:56.849916+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:32.491200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849839+0000","last_change":"2024-09-11T00:14:25.928090+0000","last_active":"2024-09-11T00:15:56.849839+0000","last_peered":"2024-09-11T00:15:56.849839+0000","last_clean":"2024-09-11T00:15:56.849839+0000","last_became_active":"2024-09-11T00:14:25.927768+0000","last_became_peered":"2024-09-11T00:14:25.927768+0000","last_unstale":"2024-09-11T00:15:56.849839+0000","last_undegraded":"2024-09-11T00:15:56.849839+0000","last_fullsized":"2024-09-11T00:15:56.849839+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:00.025061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.819805+0000","last_change":"2024-09-11T00:14:25.920077+0000","last_active":"2024-09-11T00:15:56.819805+0000","last_peered":"2024-09-11T00:15:56.819805+0000","last_clean":"2024-09-11T00:15:56.819805+0000","last_became_active":"2024-09-11T00:14:25.919395+0000","last_became_peered":"2024-09-11T00:14:25.919395+0000","last_unstale":"2024-09-11T00:15:56.819805+0000","last_undegraded":"2024-09-11T00:15:56.819805+0000","last_fullsized":"2024-09-11T00:15:56.819805+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:41.441279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"78'4","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823354+0000","last_change":"2024-09-11T00:14:25.917872+0000","last_active":"2024-09-11T00:15:56.823354+0000","last_peered":"2024-09-11T00:15:56.823354+0000","last_clean":"2024-09-11T00:15:56.823354+0000","last_became_active":"2024-09-11T00:14:25.917533+0000","last_became_peered":"2024-09-11T00:14:25.917533+0000","last_unstale":"2024-09-11T00:15:56.823354+0000","last_undegraded":"2024-09-11T00:15:56.823354+0000","last_fullsized":"2024-09-11T00:15:56.823354+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:57.051435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"78'6","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848366+0000","last_change":"2024-09-11T00:14:25.914977+0000","last_active":"2024-09-11T00:15:56.848366+0000","last_peered":"2024-09-11T00:15:56.848366+0000","last_clean":"2024-09-11T00:15:56.848366+0000","last_became_active":"2024-09-11T00:14:25.914543+0000","last_became_peered":"2024-09-11T00:14:25.914543+0000","last_unstale":"2024-09-11T00:15:56.848366+0000","last_undegraded":"2024-09-11T00:15:56.848366+0000","last_fullsized":"2024-09-11T00:15:56.848366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:45.085347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"78'5","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847934+0000","last_change":"2024-09-11T00:14:25.928021+0000","last_active":"2024-09-11T00:15:56.847934+0000","last_peered":"2024-09-11T00:15:56.847934+0000","last_clean":"2024-09-11T00:15:56.847934+0000","last_became_active":"2024-09-11T00:14:25.927047+0000","last_became_peered":"2024-09-11T00:14:25.927047+0000","last_unstale":"2024-09-11T00:15:56.847934+0000","last_undegraded":"2024-09-11T00:15:56.847934+0000","last_fullsized":"2024-09-11T00:15:56.847934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:41.442622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847497+0000","last_change":"2024-09-11T00:14:25.925399+0000","last_active":"2024-09-11T00:15:56.847497+0000","last_peered":"2024-09-11T00:15:56.847497+0000","last_clean":"2024-09-11T00:15:56.847497+0000","last_became_active":"2024-09-11T00:14:25.925097+0000","last_became_peered":"2024-09-11T00:14:25.925097+0000","last_unstale":"2024-09-11T00:15:56.847497+0000","last_undegraded":"2024-09-11T00:15:56.847497+0000","last_fullsized":"2024-09-11T00:15:56.847497+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:36:44.962936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"78'11","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848579+0000","last_change":"2024-09-11T00:14:25.928123+0000","last_active":"2024-09-11T00:15:56.848579+0000","last_peered":"2024-09-11T00:15:56.848579+0000","last_clean":"2024-09-11T00:15:56.848579+0000","last_became_active":"2024-09-11T00:14:25.927826+0000","last_became_peered":"2024-09-11T00:14:25.927826+0000","last_unstale":"2024-09-11T00:15:56.848579+0000","last_undegraded":"2024-09-11T00:15:56.848579+0000","last_fullsized":"2024-09-11T00:15:56.848579+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:44.131708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"78'16","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849328+0000","last_change":"2024-09-11T00:14:25.920546+0000","last_active":"2024-09-11T00:15:56.849328+0000","last_peered":"2024-09-11T00:15:56.849328+0000","last_clean":"2024-09-11T00:15:56.849328+0000","last_became_active":"2024-09-11T00:14:25.920193+0000","last_became_peered":"2024-09-11T00:14:25.920193+0000","last_unstale":"2024-09-11T00:15:56.849328+0000","last_undegraded":"2024-09-11T00:15:56.849328+0000","last_fullsized":"2024-09-11T00:15:56.849328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:55.027260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"78'6","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848772+0000","last_change":"2024-09-11T00:14:25.931278+0000","last_active":"2024-09-11T00:15:56.848772+0000","last_peered":"2024-09-11T00:15:56.848772+0000","last_clean":"2024-09-11T00:15:56.848772+0000","last_became_active":"2024-09-11T00:14:25.930964+0000","last_became_peered":"2024-09-11T00:14:25.930964+0000","last_unstale":"2024-09-11T00:15:56.848772+0000","last_undegraded":"2024-09-11T00:15:56.848772+0000","last_fullsized":"2024-09-11T00:15:56.848772+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:06.537737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.819889+0000","last_change":"2024-09-11T00:14:25.919725+0000","last_active":"2024-09-11T00:15:56.819889+0000","last_peered":"2024-09-11T00:15:56.819889+0000","last_clean":"2024-09-11T00:15:56.819889+0000","last_became_active":"2024-09-11T00:14:25.918973+0000","last_became_peered":"2024-09-11T00:14:25.918973+0000","last_unstale":"2024-09-11T00:15:56.819889+0000","last_undegraded":"2024-09-11T00:15:56.819889+0000","last_fullsized":"2024-09-11T00:15:56.819889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:01:03.076980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"78'10","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818573+0000","last_change":"2024-09-11T00:14:25.922516+0000","last_active":"2024-09-11T00:15:56.818573+0000","last_peered":"2024-09-11T00:15:56.818573+0000","last_clean":"2024-09-11T00:15:56.818573+0000","last_became_active":"2024-09-11T00:14:25.922198+0000","last_became_peered":"2024-09-11T00:14:25.922198+0000","last_unstale":"2024-09-11T00:15:56.818573+0000","last_undegraded":"2024-09-11T00:15:56.818573+0000","last_fullsized":"2024-09-11T00:15:56.818573+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:26.065492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849699+0000","last_change":"2024-09-11T00:14:25.921663+0000","last_active":"2024-09-11T00:15:56.849699+0000","last_peered":"2024-09-11T00:15:56.849699+0000","last_clean":"2024-09-11T00:15:56.849699+0000","last_became_active":"2024-09-11T00:14:25.921328+0000","last_became_peered":"2024-09-11T00:14:25.921328+0000","last_unstale":"2024-09-11T00:15:56.849699+0000","last_undegraded":"2024-09-11T00:15:56.849699+0000","last_fullsized":"2024-09-11T00:15:56.849699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:04.674811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"78'7","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849561+0000","last_change":"2024-09-11T00:14:56.842141+0000","last_active":"2024-09-11T00:15:56.849561+0000","last_peered":"2024-09-11T00:15:56.849561+0000","last_clean":"2024-09-11T00:15:56.849561+0000","last_became_active":"2024-09-11T00:14:56.841726+0000","last_became_peered":"2024-09-11T00:14:56.841726+0000","last_unstale":"2024-09-11T00:15:56.849561+0000","last_undegraded":"2024-09-11T00:15:56.849561+0000","last_fullsized":"2024-09-11T00:15:56.849561+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:46.239876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847667+0000","last_change":"2024-09-11T00:14:25.927202+0000","last_active":"2024-09-11T00:15:56.847667+0000","last_peered":"2024-09-11T00:15:56.847667+0000","last_clean":"2024-09-11T00:15:56.847667+0000","last_became_active":"2024-09-11T00:14:25.926872+0000","last_became_peered":"2024-09-11T00:14:25.926872+0000","last_unstale":"2024-09-11T00:15:56.847667+0000","last_undegraded":"2024-09-11T00:15:56.847667+0000","last_fullsized":"2024-09-11T00:15:56.847667+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:44.409956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.825593+0000","last_change":"2024-09-11T00:14:25.923975+0000","last_active":"2024-09-11T00:15:56.825593+0000","last_peered":"2024-09-11T00:15:56.825593+0000","last_clean":"2024-09-11T00:15:56.825593+0000","last_became_active":"2024-09-11T00:14:25.923666+0000","last_became_peered":"2024-09-11T00:14:25.923666+0000","last_unstale":"2024-09-11T00:15:56.825593+0000","last_undegraded":"2024-09-11T00:15:56.825593+0000","last_fullsized":"2024-09-11T00:15:56.825593+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:54.803657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"78'10","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848200+0000","last_change":"2024-09-11T00:14:25.928083+0000","last_active":"2024-09-11T00:15:56.848200+0000","last_peered":"2024-09-11T00:15:56.848200+0000","last_clean":"2024-09-11T00:15:56.848200+0000","last_became_active":"2024-09-11T00:14:25.927727+0000","last_became_peered":"2024-09-11T00:14:25.927727+0000","last_unstale":"2024-09-11T00:15:56.848200+0000","last_undegraded":"2024-09-11T00:15:56.848200+0000","last_fullsized":"2024-09-11T00:15:56.848200+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:56.721661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849076+0000","last_change":"2024-09-11T00:14:25.910506+0000","last_active":"2024-09-11T00:15:56.849076+0000","last_peered":"2024-09-11T00:15:56.849076+0000","last_clean":"2024-09-11T00:15:56.849076+0000","last_became_active":"2024-09-11T00:14:25.910112+0000","last_became_peered":"2024-09-11T00:14:25.910112+0000","last_unstale":"2024-09-11T00:15:56.849076+0000","last_undegraded":"2024-09-11T00:15:56.849076+0000","last_fullsized":"2024-09-11T00:15:56.849076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:33:32.698411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.825200+0000","last_change":"2024-09-11T00:14:25.918512+0000","last_active":"2024-09-11T00:15:56.825200+0000","last_peered":"2024-09-11T00:15:56.825200+0000","last_clean":"2024-09-11T00:15:56.825200+0000","last_became_active":"2024-09-11T00:14:25.918191+0000","last_became_peered":"2024-09-11T00:14:25.918191+0000","last_unstale":"2024-09-11T00:15:56.825200+0000","last_undegraded":"2024-09-11T00:15:56.825200+0000","last_fullsized":"2024-09-11T00:15:56.825200+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:07:49.588919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"78'11","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818666+0000","last_change":"2024-09-11T00:14:25.918163+0000","last_active":"2024-09-11T00:15:56.818666+0000","last_peered":"2024-09-11T00:15:56.818666+0000","last_clean":"2024-09-11T00:15:56.818666+0000","last_became_active":"2024-09-11T00:14:25.917851+0000","last_became_peered":"2024-09-11T00:14:25.917851+0000","last_unstale":"2024-09-11T00:15:56.818666+0000","last_undegraded":"2024-09-11T00:15:56.818666+0000","last_fullsized":"2024-09-11T00:15:56.818666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:11.757881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"78'10","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847863+0000","last_change":"2024-09-11T00:14:25.930503+0000","last_active":"2024-09-11T00:15:56.847863+0000","last_peered":"2024-09-11T00:15:56.847863+0000","last_clean":"2024-09-11T00:15:56.847863+0000","last_became_active":"2024-09-11T00:14:25.930140+0000","last_became_peered":"2024-09-11T00:14:25.930140+0000","last_unstale":"2024-09-11T00:15:56.847863+0000","last_undegraded":"2024-09-11T00:15:56.847863+0000","last_fullsized":"2024-09-11T00:15:56.847863+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:43.227373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847887+0000","last_change":"2024-09-11T00:14:25.916866+0000","last_active":"2024-09-11T00:15:56.847887+0000","last_peered":"2024-09-11T00:15:56.847887+0000","last_clean":"2024-09-11T00:15:56.847887+0000","last_became_active":"2024-09-11T00:14:25.916393+0000","last_became_peered":"2024-09-11T00:14:25.916393+0000","last_unstale":"2024-09-11T00:15:56.847887+0000","last_undegraded":"2024-09-11T00:15:56.847887+0000","last_fullsized":"2024-09-11T00:15:56.847887+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:52.697895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"78'6","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848165+0000","last_change":"2024-09-11T00:14:56.764743+0000","last_active":"2024-09-11T00:15:56.848165+0000","last_peered":"2024-09-11T00:15:56.848165+0000","last_clean":"2024-09-11T00:15:56.848165+0000","last_became_active":"2024-09-11T00:14:56.764333+0000","last_became_peered":"2024-09-11T00:14:56.764333+0000","last_unstale":"2024-09-11T00:15:56.848165+0000","last_undegraded":"2024-09-11T00:15:56.848165+0000","last_fullsized":"2024-09-11T00:15:56.848165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:17:00.307318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,3],"acting":[7,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.27","version":"78'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847641+0000","last_change":"2024-09-11T00:14:25.913694+0000","last_active":"2024-09-11T00:15:56.847641+0000","last_peered":"2024-09-11T00:15:56.847641+0000","last_clean":"2024-09-11T00:15:56.847641+0000","last_became_active":"2024-09-11T00:14:25.913405+0000","last_became_peered":"2024-09-11T00:14:25.913405+0000","last_unstale":"2024-09-11T00:15:56.847641+0000","last_undegraded":"2024-09-11T00:15:56.847641+0000","last_fullsized":"2024-09-11T00:15:56.847641+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:24.636698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"78'15","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848748+0000","last_change":"2024-09-11T00:14:25.928598+0000","last_active":"2024-09-11T00:15:56.848748+0000","last_peered":"2024-09-11T00:15:56.848748+0000","last_clean":"2024-09-11T00:15:56.848748+0000","last_became_active":"2024-09-11T00:14:25.928230+0000","last_became_peered":"2024-09-11T00:14:25.928230+0000","last_unstale":"2024-09-11T00:15:56.848748+0000","last_undegraded":"2024-09-11T00:15:56.848748+0000","last_fullsized":"2024-09-11T00:15:56.848748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:00.820900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"78'6","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.825361+0000","last_change":"2024-09-11T00:14:25.922296+0000","last_active":"2024-09-11T00:15:56.825361+0000","last_peered":"2024-09-11T00:15:56.825361+0000","last_clean":"2024-09-11T00:15:56.825361+0000","last_became_active":"2024-09-11T00:14:25.921188+0000","last_became_peered":"2024-09-11T00:14:25.921188+0000","last_unstale":"2024-09-11T00:15:56.825361+0000","last_undegraded":"2024-09-11T00:15:56.825361+0000","last_fullsized":"2024-09-11T00:15:56.825361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:31.478302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"78'4","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818595+0000","last_change":"2024-09-11T00:14:25.910201+0000","last_active":"2024-09-11T00:15:56.818595+0000","last_peered":"2024-09-11T00:15:56.818595+0000","last_clean":"2024-09-11T00:15:56.818595+0000","last_became_active":"2024-09-11T00:14:25.909867+0000","last_became_peered":"2024-09-11T00:14:25.909867+0000","last_unstale":"2024-09-11T00:15:56.818595+0000","last_undegraded":"2024-09-11T00:15:56.818595+0000","last_fullsized":"2024-09-11T00:15:56.818595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:17.445805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849767+0000","last_change":"2024-09-11T00:14:25.914971+0000","last_active":"2024-09-11T00:15:56.849767+0000","last_peered":"2024-09-11T00:15:56.849767+0000","last_clean":"2024-09-11T00:15:56.849767+0000","last_became_active":"2024-09-11T00:14:25.914614+0000","last_became_peered":"2024-09-11T00:14:25.914614+0000","last_unstale":"2024-09-11T00:15:56.849767+0000","last_undegraded":"2024-09-11T00:15:56.849767+0000","last_fullsized":"2024-09-11T00:15:56.849767+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:12.514798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848188+0000","last_change":"2024-09-11T00:14:25.916006+0000","last_active":"2024-09-11T00:15:56.848188+0000","last_peered":"2024-09-11T00:15:56.848188+0000","last_clean":"2024-09-11T00:15:56.848188+0000","last_became_active":"2024-09-11T00:14:25.915479+0000","last_became_peered":"2024-09-11T00:14:25.915479+0000","last_unstale":"2024-09-11T00:15:56.848188+0000","last_undegraded":"2024-09-11T00:15:56.848188+0000","last_fullsized":"2024-09-11T00:15:56.848188+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:42.513673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"78'12","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848254+0000","last_change":"2024-09-11T00:14:25.925601+0000","last_active":"2024-09-11T00:15:56.848254+0000","last_peered":"2024-09-11T00:15:56.848254+0000","last_clean":"2024-09-11T00:15:56.848254+0000","last_became_active":"2024-09-11T00:14:25.925289+0000","last_became_peered":"2024-09-11T00:14:25.925289+0000","last_unstale":"2024-09-11T00:15:56.848254+0000","last_undegraded":"2024-09-11T00:15:56.848254+0000","last_fullsized":"2024-09-11T00:15:56.848254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:17.324565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.824996+0000","last_change":"2024-09-11T00:14:25.922316+0000","last_active":"2024-09-11T00:15:56.824996+0000","last_peered":"2024-09-11T00:15:56.824996+0000","last_clean":"2024-09-11T00:15:56.824996+0000","last_became_active":"2024-09-11T00:14:25.920991+0000","last_became_peered":"2024-09-11T00:14:25.920991+0000","last_unstale":"2024-09-11T00:15:56.824996+0000","last_undegraded":"2024-09-11T00:15:56.824996+0000","last_fullsized":"2024-09-11T00:15:56.824996+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:36.362500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823283+0000","last_change":"2024-09-11T00:14:25.919579+0000","last_active":"2024-09-11T00:15:56.823283+0000","last_peered":"2024-09-11T00:15:56.823283+0000","last_clean":"2024-09-11T00:15:56.823283+0000","last_became_active":"2024-09-11T00:14:25.919245+0000","last_became_peered":"2024-09-11T00:14:25.919245+0000","last_unstale":"2024-09-11T00:15:56.823283+0000","last_undegraded":"2024-09-11T00:15:56.823283+0000","last_fullsized":"2024-09-11T00:15:56.823283+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:47.885242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'1","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847987+0000","last_change":"2024-09-11T00:14:56.767631+0000","last_active":"2024-09-11T00:15:56.847987+0000","last_peered":"2024-09-11T00:15:56.847987+0000","last_clean":"2024-09-11T00:15:56.847987+0000","last_became_active":"2024-09-11T00:14:56.767229+0000","last_became_peered":"2024-09-11T00:14:56.767229+0000","last_unstale":"2024-09-11T00:15:56.847987+0000","last_undegraded":"2024-09-11T00:15:56.847987+0000","last_fullsized":"2024-09-11T00:15:56.847987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:15.084255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847779+0000","last_change":"2024-09-11T00:14:25.921414+0000","last_active":"2024-09-11T00:15:56.847779+0000","last_peered":"2024-09-11T00:15:56.847779+0000","last_clean":"2024-09-11T00:15:56.847779+0000","last_became_active":"2024-09-11T00:14:25.921096+0000","last_became_peered":"2024-09-11T00:14:25.921096+0000","last_unstale":"2024-09-11T00:15:56.847779+0000","last_undegraded":"2024-09-11T00:15:56.847779+0000","last_fullsized":"2024-09-11T00:15:56.847779+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:38:45.938435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'1","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848492+0000","last_change":"2024-09-11T00:14:23.913359+0000","last_active":"2024-09-11T00:15:56.848492+0000","last_peered":"2024-09-11T00:15:56.848492+0000","last_clean":"2024-09-11T00:15:56.848492+0000","last_became_active":"2024-09-11T00:14:23.913073+0000","last_became_peered":"2024-09-11T00:14:23.913073+0000","last_unstale":"2024-09-11T00:15:56.848492+0000","last_undegraded":"2024-09-11T00:15:56.848492+0000","last_fullsized":"2024-09-11T00:15:56.848492+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:04.907618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818371+0000","last_change":"2024-09-11T00:14:23.905723+0000","last_active":"2024-09-11T00:15:56.818371+0000","last_peered":"2024-09-11T00:15:56.818371+0000","last_clean":"2024-09-11T00:15:56.818371+0000","last_became_active":"2024-09-11T00:14:23.905392+0000","last_became_peered":"2024-09-11T00:14:23.905392+0000","last_unstale":"2024-09-11T00:15:56.818371+0000","last_undegraded":"2024-09-11T00:15:56.818371+0000","last_fullsized":"2024-09-11T00:15:56.818371+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:48.603410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847597+0000","last_change":"2024-09-11T00:14:25.915843+0000","last_active":"2024-09-11T00:15:56.847597+0000","last_peered":"2024-09-11T00:15:56.847597+0000","last_clean":"2024-09-11T00:15:56.847597+0000","last_became_active":"2024-09-11T00:14:25.915543+0000","last_became_peered":"2024-09-11T00:14:25.915543+0000","last_unstale":"2024-09-11T00:15:56.847597+0000","last_undegraded":"2024-09-11T00:15:56.847597+0000","last_fullsized":"2024-09-11T00:15:56.847597+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:10.781401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847529+0000","last_change":"2024-09-11T00:14:23.913017+0000","last_active":"2024-09-11T00:15:56.847529+0000","last_peered":"2024-09-11T00:15:56.847529+0000","last_clean":"2024-09-11T00:15:56.847529+0000","last_became_active":"2024-09-11T00:14:23.912674+0000","last_became_peered":"2024-09-11T00:14:23.912674+0000","last_unstale":"2024-09-11T00:15:56.847529+0000","last_undegraded":"2024-09-11T00:15:56.847529+0000","last_fullsized":"2024-09-11T00:15:56.847529+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:22.711358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"78'11","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847937+0000","last_change":"2024-09-11T00:14:25.917969+0000","last_active":"2024-09-11T00:15:56.847937+0000","last_peered":"2024-09-11T00:15:56.847937+0000","last_clean":"2024-09-11T00:15:56.847937+0000","last_became_active":"2024-09-11T00:14:25.917673+0000","last_became_peered":"2024-09-11T00:14:25.917673+0000","last_unstale":"2024-09-11T00:15:56.847937+0000","last_undegraded":"2024-09-11T00:15:56.847937+0000","last_fullsized":"2024-09-11T00:15:56.847937+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:55:36.992260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848791+0000","last_change":"2024-09-11T00:14:23.915544+0000","last_active":"2024-09-11T00:15:56.848791+0000","last_peered":"2024-09-11T00:15:56.848791+0000","last_clean":"2024-09-11T00:15:56.848791+0000","last_became_active":"2024-09-11T00:14:23.915129+0000","last_became_peered":"2024-09-11T00:14:23.915129+0000","last_unstale":"2024-09-11T00:15:56.848791+0000","last_undegraded":"2024-09-11T00:15:56.848791+0000","last_fullsized":"2024-09-11T00:15:56.848791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:06.720068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"78'10","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848853+0000","last_change":"2024-09-11T00:14:25.927212+0000","last_active":"2024-09-11T00:15:56.848853+0000","last_peered":"2024-09-11T00:15:56.848853+0000","last_clean":"2024-09-11T00:15:56.848853+0000","last_became_active":"2024-09-11T00:14:25.926875+0000","last_became_peered":"2024-09-11T00:14:25.926875+0000","last_unstale":"2024-09-11T00:15:56.848853+0000","last_undegraded":"2024-09-11T00:15:56.848853+0000","last_fullsized":"2024-09-11T00:15:56.848853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:06.749494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848162+0000","last_change":"2024-09-11T00:14:23.907318+0000","last_active":"2024-09-11T00:15:56.848162+0000","last_peered":"2024-09-11T00:15:56.848162+0000","last_clean":"2024-09-11T00:15:56.848162+0000","last_became_active":"2024-09-11T00:14:23.905858+0000","last_became_peered":"2024-09-11T00:14:23.905858+0000","last_unstale":"2024-09-11T00:15:56.848162+0000","last_undegraded":"2024-09-11T00:15:56.848162+0000","last_fullsized":"2024-09-11T00:15:56.848162+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:16.005219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.850031+0000","last_change":"2024-09-11T00:14:25.922126+0000","last_active":"2024-09-11T00:15:56.850031+0000","last_peered":"2024-09-11T00:15:56.850031+0000","last_clean":"2024-09-11T00:15:56.850031+0000","last_became_active":"2024-09-11T00:14:25.921801+0000","last_became_peered":"2024-09-11T00:14:25.921801+0000","last_unstale":"2024-09-11T00:15:56.850031+0000","last_undegraded":"2024-09-11T00:15:56.850031+0000","last_fullsized":"2024-09-11T00:15:56.850031+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:06.770343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'3","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848195+0000","last_change":"2024-09-11T00:14:24.083872+0000","last_active":"2024-09-11T00:15:56.848195+0000","last_peered":"2024-09-11T00:15:56.848195+0000","last_clean":"2024-09-11T00:15:56.848195+0000","last_became_active":"2024-09-11T00:14:24.083479+0000","last_became_peered":"2024-09-11T00:14:24.083479+0000","last_unstale":"2024-09-11T00:15:56.848195+0000","last_undegraded":"2024-09-11T00:15:56.848195+0000","last_fullsized":"2024-09-11T00:15:56.848195+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:19:30.492828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"78'11","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848014+0000","last_change":"2024-09-11T00:14:25.932281+0000","last_active":"2024-09-11T00:15:56.848014+0000","last_peered":"2024-09-11T00:15:56.848014+0000","last_clean":"2024-09-11T00:15:56.848014+0000","last_became_active":"2024-09-11T00:14:25.931935+0000","last_became_peered":"2024-09-11T00:14:25.931935+0000","last_unstale":"2024-09-11T00:15:56.848014+0000","last_undegraded":"2024-09-11T00:15:56.848014+0000","last_fullsized":"2024-09-11T00:15:56.848014+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:55.166421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'30","reported_seq":247,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:16:03.876497+0000","last_change":"2024-09-11T00:14:23.909614+0000","last_active":"2024-09-11T00:16:03.876497+0000","last_peered":"2024-09-11T00:16:03.876497+0000","last_clean":"2024-09-11T00:16:03.876497+0000","last_became_active":"2024-09-11T00:14:23.909209+0000","last_became_peered":"2024-09-11T00:14:23.909209+0000","last_unstale":"2024-09-11T00:16:03.876497+0000","last_undegraded":"2024-09-11T00:16:03.876497+0000","last_fullsized":"2024-09-11T00:16:03.876497+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:14.467304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63066,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":190,"num_read_kb":156,"num_write":30,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"78'6","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823597+0000","last_change":"2024-09-11T00:14:25.924008+0000","last_active":"2024-09-11T00:15:56.823597+0000","last_peered":"2024-09-11T00:15:56.823597+0000","last_clean":"2024-09-11T00:15:56.823597+0000","last_became_active":"2024-09-11T00:14:25.923680+0000","last_became_peered":"2024-09-11T00:14:25.923680+0000","last_unstale":"2024-09-11T00:15:56.823597+0000","last_undegraded":"2024-09-11T00:15:56.823597+0000","last_fullsized":"2024-09-11T00:15:56.823597+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:27.106405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'2","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848178+0000","last_change":"2024-09-11T00:14:23.906908+0000","last_active":"2024-09-11T00:15:56.848178+0000","last_peered":"2024-09-11T00:15:56.848178+0000","last_clean":"2024-09-11T00:15:56.848178+0000","last_became_active":"2024-09-11T00:14:23.906170+0000","last_became_peered":"2024-09-11T00:14:23.906170+0000","last_unstale":"2024-09-11T00:15:56.848178+0000","last_undegraded":"2024-09-11T00:15:56.848178+0000","last_fullsized":"2024-09-11T00:15:56.848178+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:10:27.314551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818381+0000","last_change":"2024-09-11T00:14:25.917896+0000","last_active":"2024-09-11T00:15:56.818381+0000","last_peered":"2024-09-11T00:15:56.818381+0000","last_clean":"2024-09-11T00:15:56.818381+0000","last_became_active":"2024-09-11T00:14:25.916341+0000","last_became_peered":"2024-09-11T00:14:25.916341+0000","last_unstale":"2024-09-11T00:15:56.818381+0000","last_undegraded":"2024-09-11T00:15:56.818381+0000","last_fullsized":"2024-09-11T00:15:56.818381+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:05.723223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847711+0000","last_change":"2024-09-11T00:14:23.913113+0000","last_active":"2024-09-11T00:15:56.847711+0000","last_peered":"2024-09-11T00:15:56.847711+0000","last_clean":"2024-09-11T00:15:56.847711+0000","last_became_active":"2024-09-11T00:14:23.912791+0000","last_became_peered":"2024-09-11T00:14:23.912791+0000","last_unstale":"2024-09-11T00:15:56.847711+0000","last_undegraded":"2024-09-11T00:15:56.847711+0000","last_fullsized":"2024-09-11T00:15:56.847711+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:31.124528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"78'15","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848742+0000","last_change":"2024-09-11T00:14:25.927511+0000","last_active":"2024-09-11T00:15:56.848742+0000","last_peered":"2024-09-11T00:15:56.848742+0000","last_clean":"2024-09-11T00:15:56.848742+0000","last_became_active":"2024-09-11T00:14:25.927144+0000","last_became_peered":"2024-09-11T00:14:25.927144+0000","last_unstale":"2024-09-11T00:15:56.848742+0000","last_undegraded":"2024-09-11T00:15:56.848742+0000","last_fullsized":"2024-09-11T00:15:56.848742+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:35.680110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.819722+0000","last_change":"2024-09-11T00:14:23.906706+0000","last_active":"2024-09-11T00:15:56.819722+0000","last_peered":"2024-09-11T00:15:56.819722+0000","last_clean":"2024-09-11T00:15:56.819722+0000","last_became_active":"2024-09-11T00:14:23.906368+0000","last_became_peered":"2024-09-11T00:14:23.906368+0000","last_unstale":"2024-09-11T00:15:56.819722+0000","last_undegraded":"2024-09-11T00:15:56.819722+0000","last_fullsized":"2024-09-11T00:15:56.819722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:30:40.798446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"78'6","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848344+0000","last_change":"2024-09-11T00:14:25.925996+0000","last_active":"2024-09-11T00:15:56.848344+0000","last_peered":"2024-09-11T00:15:56.848344+0000","last_clean":"2024-09-11T00:15:56.848344+0000","last_became_active":"2024-09-11T00:14:25.925653+0000","last_became_peered":"2024-09-11T00:14:25.925653+0000","last_unstale":"2024-09-11T00:15:56.848344+0000","last_undegraded":"2024-09-11T00:15:56.848344+0000","last_fullsized":"2024-09-11T00:15:56.848344+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:50.366666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'8","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823271+0000","last_change":"2024-09-11T00:14:24.083774+0000","last_active":"2024-09-11T00:15:56.823271+0000","last_peered":"2024-09-11T00:15:56.823271+0000","last_clean":"2024-09-11T00:15:56.823271+0000","last_became_active":"2024-09-11T00:14:24.083398+0000","last_became_peered":"2024-09-11T00:14:24.083398+0000","last_unstale":"2024-09-11T00:15:56.823271+0000","last_undegraded":"2024-09-11T00:15:56.823271+0000","last_fullsized":"2024-09-11T00:15:56.823271+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:34.019592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"78'6","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847685+0000","last_change":"2024-09-11T00:14:25.927171+0000","last_active":"2024-09-11T00:15:56.847685+0000","last_peered":"2024-09-11T00:15:56.847685+0000","last_clean":"2024-09-11T00:15:56.847685+0000","last_became_active":"2024-09-11T00:14:25.926873+0000","last_became_peered":"2024-09-11T00:14:25.926873+0000","last_unstale":"2024-09-11T00:15:56.847685+0000","last_undegraded":"2024-09-11T00:15:56.847685+0000","last_fullsized":"2024-09-11T00:15:56.847685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:26.042903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'1","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.825266+0000","last_change":"2024-09-11T00:14:56.770315+0000","last_active":"2024-09-11T00:15:56.825266+0000","last_peered":"2024-09-11T00:15:56.825266+0000","last_clean":"2024-09-11T00:15:56.825266+0000","last_became_active":"2024-09-11T00:14:56.767056+0000","last_became_peered":"2024-09-11T00:14:56.767056+0000","last_unstale":"2024-09-11T00:15:56.825266+0000","last_undegraded":"2024-09-11T00:15:56.825266+0000","last_fullsized":"2024-09-11T00:15:56.825266+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:25.136382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"78'5","reported_seq":34,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.825345+0000","last_change":"2024-09-11T00:14:56.765888+0000","last_active":"2024-09-11T00:15:56.825345+0000","last_peered":"2024-09-11T00:15:56.825345+0000","last_clean":"2024-09-11T00:15:56.825345+0000","last_became_active":"2024-09-11T00:14:56.765508+0000","last_became_peered":"2024-09-11T00:14:56.765508+0000","last_unstale":"2024-09-11T00:15:56.825345+0000","last_undegraded":"2024-09-11T00:15:56.825345+0000","last_fullsized":"2024-09-11T00:15:56.825345+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:10.013207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818528+0000","last_change":"2024-09-11T00:14:23.904807+0000","last_active":"2024-09-11T00:15:56.818528+0000","last_peered":"2024-09-11T00:15:56.818528+0000","last_clean":"2024-09-11T00:15:56.818528+0000","last_became_active":"2024-09-11T00:14:23.904532+0000","last_became_peered":"2024-09-11T00:14:23.904532+0000","last_unstale":"2024-09-11T00:15:56.818528+0000","last_undegraded":"2024-09-11T00:15:56.818528+0000","last_fullsized":"2024-09-11T00:15:56.818528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:08.945508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848377+0000","last_change":"2024-09-11T00:14:25.919548+0000","last_active":"2024-09-11T00:15:56.848377+0000","last_peered":"2024-09-11T00:15:56.848377+0000","last_clean":"2024-09-11T00:15:56.848377+0000","last_became_active":"2024-09-11T00:14:25.919216+0000","last_became_peered":"2024-09-11T00:14:25.919216+0000","last_unstale":"2024-09-11T00:15:56.848377+0000","last_undegraded":"2024-09-11T00:15:56.848377+0000","last_fullsized":"2024-09-11T00:15:56.848377+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:18.318193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848300+0000","last_change":"2024-09-11T00:14:23.915488+0000","last_active":"2024-09-11T00:15:56.848300+0000","last_peered":"2024-09-11T00:15:56.848300+0000","last_clean":"2024-09-11T00:15:56.848300+0000","last_became_active":"2024-09-11T00:14:23.915147+0000","last_became_peered":"2024-09-11T00:14:23.915147+0000","last_unstale":"2024-09-11T00:15:56.848300+0000","last_undegraded":"2024-09-11T00:15:56.848300+0000","last_fullsized":"2024-09-11T00:15:56.848300+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:04.830225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848100+0000","last_change":"2024-09-11T00:14:25.919774+0000","last_active":"2024-09-11T00:15:56.848100+0000","last_peered":"2024-09-11T00:15:56.848100+0000","last_clean":"2024-09-11T00:15:56.848100+0000","last_became_active":"2024-09-11T00:14:25.919422+0000","last_became_peered":"2024-09-11T00:14:25.919422+0000","last_unstale":"2024-09-11T00:15:56.848100+0000","last_undegraded":"2024-09-11T00:15:56.848100+0000","last_fullsized":"2024-09-11T00:15:56.848100+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:03.928972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848481+0000","last_change":"2024-09-11T00:14:24.082414+0000","last_active":"2024-09-11T00:15:56.848481+0000","last_peered":"2024-09-11T00:15:56.848481+0000","last_clean":"2024-09-11T00:15:56.848481+0000","last_became_active":"2024-09-11T00:14:24.082058+0000","last_became_peered":"2024-09-11T00:14:24.082058+0000","last_unstale":"2024-09-11T00:15:56.848481+0000","last_undegraded":"2024-09-11T00:15:56.848481+0000","last_fullsized":"2024-09-11T00:15:56.848481+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:38.349964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"78'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848689+0000","last_change":"2024-09-11T00:14:25.930116+0000","last_active":"2024-09-11T00:15:56.848689+0000","last_peered":"2024-09-11T00:15:56.848689+0000","last_clean":"2024-09-11T00:15:56.848689+0000","last_became_active":"2024-09-11T00:14:25.929787+0000","last_became_peered":"2024-09-11T00:14:25.929787+0000","last_unstale":"2024-09-11T00:15:56.848689+0000","last_undegraded":"2024-09-11T00:15:56.848689+0000","last_fullsized":"2024-09-11T00:15:56.848689+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:29.655577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":103,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848895+0000","last_change":"2024-09-11T00:13:12.338952+0000","last_active":"2024-09-11T00:15:56.848895+0000","last_peered":"2024-09-11T00:15:56.848895+0000","last_clean":"2024-09-11T00:15:56.848895+0000","last_became_active":"2024-09-11T00:13:12.335030+0000","last_became_peered":"2024-09-11T00:13:12.335030+0000","last_unstale":"2024-09-11T00:15:56.848895+0000","last_undegraded":"2024-09-11T00:15:56.848895+0000","last_fullsized":"2024-09-11T00:15:56.848895+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:09:48.709624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:09:48.709624+0000","last_clean_scrub_stamp":"2024-09-11T00:09:48.709624+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:43.680771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.819722+0000","last_change":"2024-09-11T00:14:23.906794+0000","last_active":"2024-09-11T00:15:56.819722+0000","last_peered":"2024-09-11T00:15:56.819722+0000","last_clean":"2024-09-11T00:15:56.819722+0000","last_became_active":"2024-09-11T00:14:23.906430+0000","last_became_peered":"2024-09-11T00:14:23.906430+0000","last_unstale":"2024-09-11T00:15:56.819722+0000","last_undegraded":"2024-09-11T00:15:56.819722+0000","last_fullsized":"2024-09-11T00:15:56.819722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:41:58.804834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848009+0000","last_change":"2024-09-11T00:14:25.928119+0000","last_active":"2024-09-11T00:15:56.848009+0000","last_peered":"2024-09-11T00:15:56.848009+0000","last_clean":"2024-09-11T00:15:56.848009+0000","last_became_active":"2024-09-11T00:14:25.927806+0000","last_became_peered":"2024-09-11T00:14:25.927806+0000","last_unstale":"2024-09-11T00:15:56.848009+0000","last_undegraded":"2024-09-11T00:15:56.848009+0000","last_fullsized":"2024-09-11T00:15:56.848009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:34.630696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848708+0000","last_change":"2024-09-11T00:14:23.916252+0000","last_active":"2024-09-11T00:15:56.848708+0000","last_peered":"2024-09-11T00:15:56.848708+0000","last_clean":"2024-09-11T00:15:56.848708+0000","last_became_active":"2024-09-11T00:14:23.915905+0000","last_became_peered":"2024-09-11T00:14:23.915905+0000","last_unstale":"2024-09-11T00:15:56.848708+0000","last_undegraded":"2024-09-11T00:15:56.848708+0000","last_fullsized":"2024-09-11T00:15:56.848708+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:54:02.229067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"78'5","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818332+0000","last_change":"2024-09-11T00:14:25.910163+0000","last_active":"2024-09-11T00:15:56.818332+0000","last_peered":"2024-09-11T00:15:56.818332+0000","last_clean":"2024-09-11T00:15:56.818332+0000","last_became_active":"2024-09-11T00:14:25.909926+0000","last_became_peered":"2024-09-11T00:14:25.909926+0000","last_unstale":"2024-09-11T00:15:56.818332+0000","last_undegraded":"2024-09-11T00:15:56.818332+0000","last_fullsized":"2024-09-11T00:15:56.818332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:59:20.915080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818478+0000","last_change":"2024-09-11T00:14:24.081999+0000","last_active":"2024-09-11T00:15:56.818478+0000","last_peered":"2024-09-11T00:15:56.818478+0000","last_clean":"2024-09-11T00:15:56.818478+0000","last_became_active":"2024-09-11T00:14:24.081664+0000","last_became_peered":"2024-09-11T00:14:24.081664+0000","last_unstale":"2024-09-11T00:15:56.818478+0000","last_undegraded":"2024-09-11T00:15:56.818478+0000","last_fullsized":"2024-09-11T00:15:56.818478+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:22.485256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"78'8","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847323+0000","last_change":"2024-09-11T00:14:56.842397+0000","last_active":"2024-09-11T00:15:56.847323+0000","last_peered":"2024-09-11T00:15:56.847323+0000","last_clean":"2024-09-11T00:15:56.847323+0000","last_became_active":"2024-09-11T00:14:56.842017+0000","last_became_peered":"2024-09-11T00:14:56.842017+0000","last_unstale":"2024-09-11T00:15:56.847323+0000","last_undegraded":"2024-09-11T00:15:56.847323+0000","last_fullsized":"2024-09-11T00:15:56.847323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:10.300022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,6],"acting":[9,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848318+0000","last_change":"2024-09-11T00:14:23.905241+0000","last_active":"2024-09-11T00:15:56.848318+0000","last_peered":"2024-09-11T00:15:56.848318+0000","last_clean":"2024-09-11T00:15:56.848318+0000","last_became_active":"2024-09-11T00:14:23.904833+0000","last_became_peered":"2024-09-11T00:14:23.904833+0000","last_unstale":"2024-09-11T00:15:56.848318+0000","last_undegraded":"2024-09-11T00:15:56.848318+0000","last_fullsized":"2024-09-11T00:15:56.848318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:44:28.162800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"78'7","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849073+0000","last_change":"2024-09-11T00:14:56.766007+0000","last_active":"2024-09-11T00:15:56.849073+0000","last_peered":"2024-09-11T00:15:56.849073+0000","last_clean":"2024-09-11T00:15:56.849073+0000","last_became_active":"2024-09-11T00:14:56.765515+0000","last_became_peered":"2024-09-11T00:14:56.765515+0000","last_unstale":"2024-09-11T00:15:56.849073+0000","last_undegraded":"2024-09-11T00:15:56.849073+0000","last_fullsized":"2024-09-11T00:15:56.849073+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:31.159084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847896+0000","last_change":"2024-09-11T00:14:24.083578+0000","last_active":"2024-09-11T00:15:56.847896+0000","last_peered":"2024-09-11T00:15:56.847896+0000","last_clean":"2024-09-11T00:15:56.847896+0000","last_became_active":"2024-09-11T00:14:24.083233+0000","last_became_peered":"2024-09-11T00:14:24.083233+0000","last_unstale":"2024-09-11T00:15:56.847896+0000","last_undegraded":"2024-09-11T00:15:56.847896+0000","last_fullsized":"2024-09-11T00:15:56.847896+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:47.655836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'5","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848689+0000","last_change":"2024-09-11T00:14:56.771471+0000","last_active":"2024-09-11T00:15:56.848689+0000","last_peered":"2024-09-11T00:15:56.848689+0000","last_clean":"2024-09-11T00:15:56.848689+0000","last_became_active":"2024-09-11T00:14:56.764838+0000","last_became_peered":"2024-09-11T00:14:56.764838+0000","last_unstale":"2024-09-11T00:15:56.848689+0000","last_undegraded":"2024-09-11T00:15:56.848689+0000","last_fullsized":"2024-09-11T00:15:56.848689+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:24.683423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823883+0000","last_change":"2024-09-11T00:14:24.082284+0000","last_active":"2024-09-11T00:15:56.823883+0000","last_peered":"2024-09-11T00:15:56.823883+0000","last_clean":"2024-09-11T00:15:56.823883+0000","last_became_active":"2024-09-11T00:14:24.081859+0000","last_became_peered":"2024-09-11T00:14:24.081859+0000","last_unstale":"2024-09-11T00:15:56.823883+0000","last_undegraded":"2024-09-11T00:15:56.823883+0000","last_fullsized":"2024-09-11T00:15:56.823883+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:38.881342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.818600+0000","last_change":"2024-09-11T00:14:25.910408+0000","last_active":"2024-09-11T00:15:56.818600+0000","last_peered":"2024-09-11T00:15:56.818600+0000","last_clean":"2024-09-11T00:15:56.818600+0000","last_became_active":"2024-09-11T00:14:25.909447+0000","last_became_peered":"2024-09-11T00:14:25.909447+0000","last_unstale":"2024-09-11T00:15:56.818600+0000","last_undegraded":"2024-09-11T00:15:56.818600+0000","last_fullsized":"2024-09-11T00:15:56.818600+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:20:11.249974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'10","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848291+0000","last_change":"2024-09-11T00:14:23.912799+0000","last_active":"2024-09-11T00:15:56.848291+0000","last_peered":"2024-09-11T00:15:56.848291+0000","last_clean":"2024-09-11T00:15:56.848291+0000","last_became_active":"2024-09-11T00:14:23.912440+0000","last_became_peered":"2024-09-11T00:14:23.912440+0000","last_unstale":"2024-09-11T00:15:56.848291+0000","last_undegraded":"2024-09-11T00:15:56.848291+0000","last_fullsized":"2024-09-11T00:15:56.848291+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:31.139405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"78'5","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847717+0000","last_change":"2024-09-11T00:14:25.920599+0000","last_active":"2024-09-11T00:15:56.847717+0000","last_peered":"2024-09-11T00:15:56.847717+0000","last_clean":"2024-09-11T00:15:56.847717+0000","last_became_active":"2024-09-11T00:14:25.920256+0000","last_became_peered":"2024-09-11T00:14:25.920256+0000","last_unstale":"2024-09-11T00:15:56.847717+0000","last_undegraded":"2024-09-11T00:15:56.847717+0000","last_fullsized":"2024-09-11T00:15:56.847717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:05.347880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.819941+0000","last_change":"2024-09-11T00:14:24.004190+0000","last_active":"2024-09-11T00:15:56.819941+0000","last_peered":"2024-09-11T00:15:56.819941+0000","last_clean":"2024-09-11T00:15:56.819941+0000","last_became_active":"2024-09-11T00:14:24.003842+0000","last_became_peered":"2024-09-11T00:14:24.003842+0000","last_unstale":"2024-09-11T00:15:56.819941+0000","last_undegraded":"2024-09-11T00:15:56.819941+0000","last_fullsized":"2024-09-11T00:15:56.819941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:43.876046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"78'7","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849915+0000","last_change":"2024-09-11T00:14:56.767088+0000","last_active":"2024-09-11T00:15:56.849915+0000","last_peered":"2024-09-11T00:15:56.849915+0000","last_clean":"2024-09-11T00:15:56.849915+0000","last_became_active":"2024-09-11T00:14:56.766783+0000","last_became_peered":"2024-09-11T00:14:56.766783+0000","last_unstale":"2024-09-11T00:15:56.849915+0000","last_undegraded":"2024-09-11T00:15:56.849915+0000","last_fullsized":"2024-09-11T00:15:56.849915+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:37.407811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,4],"acting":[0,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847890+0000","last_change":"2024-09-11T00:14:24.082118+0000","last_active":"2024-09-11T00:15:56.847890+0000","last_peered":"2024-09-11T00:15:56.847890+0000","last_clean":"2024-09-11T00:15:56.847890+0000","last_became_active":"2024-09-11T00:14:24.081844+0000","last_became_peered":"2024-09-11T00:14:24.081844+0000","last_unstale":"2024-09-11T00:15:56.847890+0000","last_undegraded":"2024-09-11T00:15:56.847890+0000","last_fullsized":"2024-09-11T00:15:56.847890+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:20.827385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"78'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823266+0000","last_change":"2024-09-11T00:14:25.917335+0000","last_active":"2024-09-11T00:15:56.823266+0000","last_peered":"2024-09-11T00:15:56.823266+0000","last_clean":"2024-09-11T00:15:56.823266+0000","last_became_active":"2024-09-11T00:14:25.916942+0000","last_became_peered":"2024-09-11T00:14:25.916942+0000","last_unstale":"2024-09-11T00:15:56.823266+0000","last_undegraded":"2024-09-11T00:15:56.823266+0000","last_fullsized":"2024-09-11T00:15:56.823266+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:40.309186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848270+0000","last_change":"2024-09-11T00:14:23.906616+0000","last_active":"2024-09-11T00:15:56.848270+0000","last_peered":"2024-09-11T00:15:56.848270+0000","last_clean":"2024-09-11T00:15:56.848270+0000","last_became_active":"2024-09-11T00:14:23.906259+0000","last_became_peered":"2024-09-11T00:14:23.906259+0000","last_unstale":"2024-09-11T00:15:56.848270+0000","last_undegraded":"2024-09-11T00:15:56.848270+0000","last_fullsized":"2024-09-11T00:15:56.848270+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:01.514398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.825085+0000","last_change":"2024-09-11T00:14:25.925422+0000","last_active":"2024-09-11T00:15:56.825085+0000","last_peered":"2024-09-11T00:15:56.825085+0000","last_clean":"2024-09-11T00:15:56.825085+0000","last_became_active":"2024-09-11T00:14:25.923031+0000","last_became_peered":"2024-09-11T00:14:25.923031+0000","last_unstale":"2024-09-11T00:15:56.825085+0000","last_undegraded":"2024-09-11T00:15:56.825085+0000","last_fullsized":"2024-09-11T00:15:56.825085+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:59:52.217566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.849461+0000","last_change":"2024-09-11T00:15:56.849368+0000","last_active":"2024-09-11T00:15:56.849461+0000","last_peered":"2024-09-11T00:15:56.849461+0000","last_clean":"2024-09-11T00:15:56.849461+0000","last_became_active":"2024-09-11T00:15:56.848892+0000","last_became_peered":"2024-09-11T00:15:56.848892+0000","last_unstale":"2024-09-11T00:15:56.849461+0000","last_undegraded":"2024-09-11T00:15:56.849461+0000","last_fullsized":"2024-09-11T00:15:56.849461+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:05.614826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"78'8","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847431+0000","last_change":"2024-09-11T00:14:25.917478+0000","last_active":"2024-09-11T00:15:56.847431+0000","last_peered":"2024-09-11T00:15:56.847431+0000","last_clean":"2024-09-11T00:15:56.847431+0000","last_became_active":"2024-09-11T00:14:25.917192+0000","last_became_peered":"2024-09-11T00:14:25.917192+0000","last_unstale":"2024-09-11T00:15:56.847431+0000","last_undegraded":"2024-09-11T00:15:56.847431+0000","last_fullsized":"2024-09-11T00:15:56.847431+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:46.695827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'2","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823387+0000","last_change":"2024-09-11T00:14:23.914141+0000","last_active":"2024-09-11T00:15:56.823387+0000","last_peered":"2024-09-11T00:15:56.823387+0000","last_clean":"2024-09-11T00:15:56.823387+0000","last_became_active":"2024-09-11T00:14:23.913757+0000","last_became_peered":"2024-09-11T00:14:23.913757+0000","last_unstale":"2024-09-11T00:15:56.823387+0000","last_undegraded":"2024-09-11T00:15:56.823387+0000","last_fullsized":"2024-09-11T00:15:56.823387+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:54:00.609715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"78'5","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848074+0000","last_change":"2024-09-11T00:14:25.924950+0000","last_active":"2024-09-11T00:15:56.848074+0000","last_peered":"2024-09-11T00:15:56.848074+0000","last_clean":"2024-09-11T00:15:56.848074+0000","last_became_active":"2024-09-11T00:14:25.924554+0000","last_became_peered":"2024-09-11T00:14:25.924554+0000","last_unstale":"2024-09-11T00:15:56.848074+0000","last_undegraded":"2024-09-11T00:15:56.848074+0000","last_fullsized":"2024-09-11T00:15:56.848074+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:29.303384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"78'15","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848089+0000","last_change":"2024-09-11T00:14:25.930162+0000","last_active":"2024-09-11T00:15:56.848089+0000","last_peered":"2024-09-11T00:15:56.848089+0000","last_clean":"2024-09-11T00:15:56.848089+0000","last_became_active":"2024-09-11T00:14:25.929820+0000","last_became_peered":"2024-09-11T00:14:25.929820+0000","last_unstale":"2024-09-11T00:15:56.848089+0000","last_undegraded":"2024-09-11T00:15:56.848089+0000","last_fullsized":"2024-09-11T00:15:56.848089+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:20:21.384841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823627+0000","last_change":"2024-09-11T00:14:23.917486+0000","last_active":"2024-09-11T00:15:56.823627+0000","last_peered":"2024-09-11T00:15:56.823627+0000","last_clean":"2024-09-11T00:15:56.823627+0000","last_became_active":"2024-09-11T00:14:23.917150+0000","last_became_peered":"2024-09-11T00:14:23.917150+0000","last_unstale":"2024-09-11T00:15:56.823627+0000","last_undegraded":"2024-09-11T00:15:56.823627+0000","last_fullsized":"2024-09-11T00:15:56.823627+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:13:55.687712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"78'9","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848002+0000","last_change":"2024-09-11T00:14:25.932674+0000","last_active":"2024-09-11T00:15:56.848002+0000","last_peered":"2024-09-11T00:15:56.848002+0000","last_clean":"2024-09-11T00:15:56.848002+0000","last_became_active":"2024-09-11T00:14:25.932353+0000","last_became_peered":"2024-09-11T00:14:25.932353+0000","last_unstale":"2024-09-11T00:15:56.848002+0000","last_undegraded":"2024-09-11T00:15:56.848002+0000","last_fullsized":"2024-09-11T00:15:56.848002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:48.721854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'2","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.823755+0000","last_change":"2024-09-11T00:14:23.913063+0000","last_active":"2024-09-11T00:15:56.823755+0000","last_peered":"2024-09-11T00:15:56.823755+0000","last_clean":"2024-09-11T00:15:56.823755+0000","last_became_active":"2024-09-11T00:14:23.912688+0000","last_became_peered":"2024-09-11T00:14:23.912688+0000","last_unstale":"2024-09-11T00:15:56.823755+0000","last_undegraded":"2024-09-11T00:15:56.823755+0000","last_fullsized":"2024-09-11T00:15:56.823755+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:35.228733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"78'6","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.850017+0000","last_change":"2024-09-11T00:14:25.928099+0000","last_active":"2024-09-11T00:15:56.850017+0000","last_peered":"2024-09-11T00:15:56.850017+0000","last_clean":"2024-09-11T00:15:56.850017+0000","last_became_active":"2024-09-11T00:14:25.927741+0000","last_became_peered":"2024-09-11T00:14:25.927741+0000","last_unstale":"2024-09-11T00:15:56.850017+0000","last_undegraded":"2024-09-11T00:15:56.850017+0000","last_fullsized":"2024-09-11T00:15:56.850017+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:12.263180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'1","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848168+0000","last_change":"2024-09-11T00:14:24.082533+0000","last_active":"2024-09-11T00:15:56.848168+0000","last_peered":"2024-09-11T00:15:56.848168+0000","last_clean":"2024-09-11T00:15:56.848168+0000","last_became_active":"2024-09-11T00:14:24.081666+0000","last_became_peered":"2024-09-11T00:14:24.081666+0000","last_unstale":"2024-09-11T00:15:56.848168+0000","last_undegraded":"2024-09-11T00:15:56.848168+0000","last_fullsized":"2024-09-11T00:15:56.848168+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:57:56.485366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"78'5","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.847950+0000","last_change":"2024-09-11T00:14:25.912666+0000","last_active":"2024-09-11T00:15:56.847950+0000","last_peered":"2024-09-11T00:15:56.847950+0000","last_clean":"2024-09-11T00:15:56.847950+0000","last_became_active":"2024-09-11T00:14:25.912370+0000","last_became_peered":"2024-09-11T00:14:25.912370+0000","last_unstale":"2024-09-11T00:15:56.847950+0000","last_undegraded":"2024-09-11T00:15:56.847950+0000","last_fullsized":"2024-09-11T00:15:56.847950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:24.895653+0000","last_clean_scrub_stamp":"2024-09-11T00:14:24.895653+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:44.400265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'4","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-11T00:15:56.848247+0000","last_change":"2024-09-11T00:14:23.914407+0000","last_active":"2024-09-11T00:15:56.848247+0000","last_peered":"2024-09-11T00:15:56.848247+0000","last_clean":"2024-09-11T00:15:56.848247+0000","last_became_active":"2024-09-11T00:14:23.914115+0000","last_became_peered":"2024-09-11T00:14:23.914115+0000","last_unstale":"2024-09-11T00:15:56.848247+0000","last_undegraded":"2024-09-11T00:15:56.848247+0000","last_fullsized":"2024-09-11T00:15:56.848247+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T00:14:22.878190+0000","last_clean_scrub_stamp":"2024-09-11T00:14:22.878190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:58.883324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63864,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":195,"num_read_kb":161,"num_write":88,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":191592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282342,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743458,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":864256,"data_stored":437401,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939686,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":999424,"data_stored":1091124,"data_compressed":47514,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103212,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":868352,"data_stored":438078,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":864256,"data_stored":437961,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495669,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":917504,"data_stored":1028446,"data_compressed":47514,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659195,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":864256,"data_stored":437496,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855424,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":925696,"data_stored":1028046,"data_compressed":47514,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018949,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":864256,"data_stored":437401,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":872448,"data_stored":437600,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":937984,"data_stored":500479,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542227,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":933888,"data_stored":500445,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705752,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":864256,"data_stored":437469,"data_compressed":11604,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34264,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34264,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34264,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35910,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T00:16:09.432 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:16:09.712 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:16:10.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:09 smithi138 ceph-mon[35019]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:16:10.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:09 smithi078 ceph-mon[30865]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:16:10.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.203+0000 7f428a75c640 1 -- 172.21.15.78:0/4087075217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4284102dc0 msgr2=0x7f42841031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:10.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.203+0000 7f428a75c640 1 --2- 172.21.15.78:0/4087075217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4284102dc0 0x7f42841031a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4274009900 tx=0x7f427402a410 comp rx=0 tx=0).stop 2024-09-11T00:16:10.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.203+0000 7f428a75c640 1 -- 172.21.15.78:0/4087075217 shutdown_connections 2024-09-11T00:16:10.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.203+0000 7f428a75c640 1 --2- 172.21.15.78:0/4087075217 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4284109150 0x7f428410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:10.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.203+0000 7f428a75c640 1 --2- 172.21.15.78:0/4087075217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42841087d0 0x7f4284108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:10.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.203+0000 7f428a75c640 1 --2- 172.21.15.78:0/4087075217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4284102dc0 0x7f42841031a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:10.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.203+0000 7f428a75c640 1 -- 172.21.15.78:0/4087075217 >> 172.21.15.78:0/4087075217 conn(0x7f42840fe830 msgr2=0x7f4284100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:10.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.203+0000 7f428a75c640 1 -- 172.21.15.78:0/4087075217 shutdown_connections 2024-09-11T00:16:10.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.203+0000 7f428a75c640 1 -- 172.21.15.78:0/4087075217 wait complete. 2024-09-11T00:16:10.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.204+0000 7f428a75c640 1 Processor -- start 2024-09-11T00:16:10.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.204+0000 7f428a75c640 1 -- start start 2024-09-11T00:16:10.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.204+0000 7f428a75c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4284102dc0 0x7f4284199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:10.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.204+0000 7f428a75c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42841087d0 0x7f4284199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:10.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.204+0000 7f428a75c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4284109150 0x7f428419ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:10.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.204+0000 7f428a75c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4284112e10 con 0x7f4284102dc0 2024-09-11T00:16:10.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.204+0000 7f428a75c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4284112c90 con 0x7f4284109150 2024-09-11T00:16:10.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.204+0000 7f428a75c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4284112f90 con 0x7f42841087d0 2024-09-11T00:16:10.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.204+0000 7f4283fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4284102dc0 0x7f4284199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:10.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.204+0000 7f4283fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4284102dc0 0x7f4284199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51896/0 (socket says 172.21.15.78:51896) 2024-09-11T00:16:10.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.204+0000 7f4283fff640 1 -- 172.21.15.78:0/1995900019 learned_addr learned my addr 172.21.15.78:0/1995900019 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:10.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.205+0000 7f42837fe640 1 --2- 172.21.15.78:0/1995900019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42841087d0 0x7f4284199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:10.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.205+0000 7f4288cf9640 1 --2- 172.21.15.78:0/1995900019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4284109150 0x7f428419ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:10.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.205+0000 7f4283fff640 1 -- 172.21.15.78:0/1995900019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42841087d0 msgr2=0x7f4284199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:10.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.205+0000 7f4283fff640 1 --2- 172.21.15.78:0/1995900019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42841087d0 0x7f4284199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:10.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.205+0000 7f4283fff640 1 -- 172.21.15.78:0/1995900019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4284109150 msgr2=0x7f428419ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:10.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.205+0000 7f4283fff640 1 --2- 172.21.15.78:0/1995900019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4284109150 0x7f428419ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:10.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.205+0000 7f4283fff640 1 -- 172.21.15.78:0/1995900019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428419f3f0 con 0x7f4284102dc0 2024-09-11T00:16:10.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.205+0000 7f4288cf9640 1 --2- 172.21.15.78:0/1995900019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4284109150 0x7f428419ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:16:10.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.205+0000 7f4283fff640 1 --2- 172.21.15.78:0/1995900019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4284102dc0 0x7f4284199340 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4274005940 tx=0x7f42740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:10.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.205+0000 7f42817fa640 1 -- 172.21.15.78:0/1995900019 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427403f030 con 0x7f4284102dc0 2024-09-11T00:16:10.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.205+0000 7f42817fa640 1 -- 172.21.15.78:0/1995900019 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4274003cb0 con 0x7f4284102dc0 2024-09-11T00:16:10.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.205+0000 7f428a75c640 1 -- 172.21.15.78:0/1995900019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f428419f680 con 0x7f4284102dc0 2024-09-11T00:16:10.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.205+0000 7f42817fa640 1 -- 172.21.15.78:0/1995900019 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4274035070 con 0x7f4284102dc0 2024-09-11T00:16:10.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.205+0000 7f428a75c640 1 -- 172.21.15.78:0/1995900019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42841a5da0 con 0x7f4284102dc0 2024-09-11T00:16:10.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.206+0000 7f428a75c640 1 -- 172.21.15.78:0/1995900019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42841031a0 con 0x7f4284102dc0 2024-09-11T00:16:10.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.207+0000 7f42817fa640 1 -- 172.21.15.78:0/1995900019 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f427403bbf0 con 0x7f4284102dc0 2024-09-11T00:16:10.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.208+0000 7f42817fa640 1 --2- 172.21.15.78:0/1995900019 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f426c0b5330 0x7f426c0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:10.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.208+0000 7f42837fe640 1 --2- 172.21.15.78:0/1995900019 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f426c0b5330 0x7f426c0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:10.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.208+0000 7f42817fa640 1 -- 172.21.15.78:0/1995900019 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f4274106be0 con 0x7f4284102dc0 2024-09-11T00:16:10.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.208+0000 7f42837fe640 1 --2- 172.21.15.78:0/1995900019 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f426c0b5330 0x7f426c0b77f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4278005fd0 tx=0x7f4278005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:10.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.211+0000 7f42817fa640 1 -- 172.21.15.78:0/1995900019 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f42740cd9a0 con 0x7f4284102dc0 2024-09-11T00:16:10.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:09 smithi112 ceph-mon[35627]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:16:10.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.424+0000 7f428a75c640 1 -- 172.21.15.78:0/1995900019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f428419a470 con 0x7f4284102dc0 2024-09-11T00:16:10.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.425+0000 7f42817fa640 1 -- 172.21.15.78:0/1995900019 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f42740e2e20 con 0x7f4284102dc0 2024-09-11T00:16:10.427 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:16:10.427 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:16:10.427 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:16:10.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.427+0000 7f428a75c640 1 -- 172.21.15.78:0/1995900019 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f426c0b5330 msgr2=0x7f426c0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:10.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.427+0000 7f428a75c640 1 --2- 172.21.15.78:0/1995900019 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f426c0b5330 0x7f426c0b77f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4278005fd0 tx=0x7f4278005850 comp rx=0 tx=0).stop 2024-09-11T00:16:10.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.427+0000 7f428a75c640 1 -- 172.21.15.78:0/1995900019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4284102dc0 msgr2=0x7f4284199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:10.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.427+0000 7f428a75c640 1 --2- 172.21.15.78:0/1995900019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4284102dc0 0x7f4284199340 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4274005940 tx=0x7f42740042f0 comp rx=0 tx=0).stop 2024-09-11T00:16:10.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.427+0000 7f428a75c640 1 -- 172.21.15.78:0/1995900019 shutdown_connections 2024-09-11T00:16:10.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.427+0000 7f428a75c640 1 --2- 172.21.15.78:0/1995900019 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f426c0b5330 0x7f426c0b77f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:10.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.427+0000 7f428a75c640 1 --2- 172.21.15.78:0/1995900019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4284109150 0x7f428419ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:10.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.427+0000 7f428a75c640 1 --2- 172.21.15.78:0/1995900019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42841087d0 0x7f4284199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:10.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.427+0000 7f428a75c640 1 --2- 172.21.15.78:0/1995900019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4284102dc0 0x7f4284199340 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:10.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.427+0000 7f428a75c640 1 -- 172.21.15.78:0/1995900019 >> 172.21.15.78:0/1995900019 conn(0x7f42840fe830 msgr2=0x7f4284100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:10.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.427+0000 7f428a75c640 1 -- 172.21.15.78:0/1995900019 shutdown_connections 2024-09-11T00:16:10.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:10.428+0000 7f428a75c640 1 -- 172.21.15.78:0/1995900019 wait complete. 2024-09-11T00:16:11.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:10 smithi138 ceph-mon[35019]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:16:11.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:10 smithi138 ceph-mon[35019]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:16:11.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:10 smithi138 ceph-mon[35019]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T00:16:11.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:10 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1995900019' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:16:11.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:10 smithi078 ceph-mon[30865]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:16:11.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:10 smithi078 ceph-mon[30865]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:16:11.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:10 smithi078 ceph-mon[30865]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T00:16:11.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:10 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1995900019' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:16:11.133 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:10 smithi112 ceph-mon[35627]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:16:11.133 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:10 smithi112 ceph-mon[35627]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:16:11.133 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:10 smithi112 ceph-mon[35627]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T00:16:11.133 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:10 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1995900019' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:16:11.275 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:16:11.524 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:16:12.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.042+0000 7f246283f640 1 -- 172.21.15.78:0/1884764831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245c1077d0 msgr2=0x7f245c10dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:12.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.042+0000 7f246283f640 1 --2- 172.21.15.78:0/1884764831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245c1077d0 0x7f245c10dfd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2454009ca0 tx=0x7f245402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:16:12.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.042+0000 7f246283f640 1 -- 172.21.15.78:0/1884764831 shutdown_connections 2024-09-11T00:16:12.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.042+0000 7f246283f640 1 --2- 172.21.15.78:0/1884764831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245c1077d0 0x7f245c10dfd0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:12.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.042+0000 7f246283f640 1 --2- 172.21.15.78:0/1884764831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245c106e50 0x7f245c107290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:12.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.042+0000 7f246283f640 1 --2- 172.21.15.78:0/1884764831 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f245c101440 0x7f245c101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:12.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.042+0000 7f246283f640 1 -- 172.21.15.78:0/1884764831 >> 172.21.15.78:0/1884764831 conn(0x7f245c078060 msgr2=0x7f245c0ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:12.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.042+0000 7f246283f640 1 -- 172.21.15.78:0/1884764831 shutdown_connections 2024-09-11T00:16:12.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.042+0000 7f246283f640 1 -- 172.21.15.78:0/1884764831 wait complete. 2024-09-11T00:16:12.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.043+0000 7f246283f640 1 Processor -- start 2024-09-11T00:16:12.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.043+0000 7f246283f640 1 -- start start 2024-09-11T00:16:12.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.043+0000 7f246283f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f245c101440 0x7f245c10f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:12.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.043+0000 7f246283f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245c106e50 0x7f245c10fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:12.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.043+0000 7f246283f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245c1077d0 0x7f245c110340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:12.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.043+0000 7f246283f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f245c112e00 con 0x7f245c106e50 2024-09-11T00:16:12.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.043+0000 7f246283f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f245c112c80 con 0x7f245c1077d0 2024-09-11T00:16:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.043+0000 7f246283f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f245c112f80 con 0x7f245c101440 2024-09-11T00:16:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.043+0000 7f2453fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245c106e50 0x7f245c10fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.043+0000 7f2453fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245c106e50 0x7f245c10fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51916/0 (socket says 172.21.15.78:51916) 2024-09-11T00:16:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.043+0000 7f2453fff640 1 -- 172.21.15.78:0/2266760307 learned_addr learned my addr 172.21.15.78:0/2266760307 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.043+0000 7f2460ddc640 1 --2- 172.21.15.78:0/2266760307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245c1077d0 0x7f245c110340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.043+0000 7f245bfff640 1 --2- 172.21.15.78:0/2266760307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f245c101440 0x7f245c10f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.043+0000 7f2453fff640 1 -- 172.21.15.78:0/2266760307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f245c101440 msgr2=0x7f245c10f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.043+0000 7f2453fff640 1 --2- 172.21.15.78:0/2266760307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f245c101440 0x7f245c10f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.043+0000 7f2453fff640 1 -- 172.21.15.78:0/2266760307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245c1077d0 msgr2=0x7f245c110340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.043+0000 7f2453fff640 1 --2- 172.21.15.78:0/2266760307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245c1077d0 0x7f245c110340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.043+0000 7f2453fff640 1 -- 172.21.15.78:0/2266760307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245c1a7650 con 0x7f245c106e50 2024-09-11T00:16:12.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.043+0000 7f245bfff640 1 --2- 172.21.15.78:0/2266760307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f245c101440 0x7f245c10f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:16:12.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.044+0000 7f2453fff640 1 --2- 172.21.15.78:0/2266760307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245c106e50 0x7f245c10fe00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f244400e9f0 tx=0x7f244400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:12.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.044+0000 7f2459ffb640 1 -- 172.21.15.78:0/2266760307 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244400cd80 con 0x7f245c106e50 2024-09-11T00:16:12.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.044+0000 7f2459ffb640 1 -- 172.21.15.78:0/2266760307 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24440108e0 con 0x7f245c106e50 2024-09-11T00:16:12.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.044+0000 7f246283f640 1 -- 172.21.15.78:0/2266760307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f245c1a7940 con 0x7f245c106e50 2024-09-11T00:16:12.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.044+0000 7f2459ffb640 1 -- 172.21.15.78:0/2266760307 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2444018980 con 0x7f245c106e50 2024-09-11T00:16:12.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.044+0000 7f246283f640 1 -- 172.21.15.78:0/2266760307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f245c1a7e80 con 0x7f245c106e50 2024-09-11T00:16:12.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.045+0000 7f246283f640 1 -- 172.21.15.78:0/2266760307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f245c101820 con 0x7f245c106e50 2024-09-11T00:16:12.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.046+0000 7f2459ffb640 1 -- 172.21.15.78:0/2266760307 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f2444010430 con 0x7f245c106e50 2024-09-11T00:16:12.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.047+0000 7f2459ffb640 1 --2- 172.21.15.78:0/2266760307 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f24480b5330 0x7f24480b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:12.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.047+0000 7f245bfff640 1 --2- 172.21.15.78:0/2266760307 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f24480b5330 0x7f24480b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:12.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.047+0000 7f2459ffb640 1 -- 172.21.15.78:0/2266760307 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f24440e65e0 con 0x7f245c106e50 2024-09-11T00:16:12.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.048+0000 7f245bfff640 1 --2- 172.21.15.78:0/2266760307 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f24480b5330 0x7f24480b77f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f244c009b40 tx=0x7f244c005e50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:12.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.050+0000 7f2459ffb640 1 -- 172.21.15.78:0/2266760307 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f24440ad3a0 con 0x7f245c106e50 2024-09-11T00:16:12.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.225+0000 7f246283f640 1 -- 172.21.15.78:0/2266760307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f245c1a8210 con 0x7f245c106e50 2024-09-11T00:16:12.229 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:16:12.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.227+0000 7f2459ffb640 1 -- 172.21.15.78:0/2266760307 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+23218 (secure 0 0 0) 0x7f24440acca0 con 0x7f245c106e50 2024-09-11T00:16:12.229 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":79,"fsid":"85a53860-6fd1-11ef-bcea-c7b262605968","created":"2024-09-11T00:06:05.704745+0000","modified":"2024-09-11T00:15:56.809478+0000","last_up_change":"2024-09-11T00:13:35.307216+0000","last_in_change":"2024-09-11T00:13:12.730667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:09:47.891696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:22.345345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:24.446029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d260c219-52f2-4e7f-9188-9e66ee01dacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6803","nonce":3736366730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6805","nonce":3736366730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6809","nonce":3736366730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6807","nonce":3736366730}]},"public_addr":"172.21.15.78:6803/3736366730","cluster_addr":"172.21.15.78:6805/3736366730","heartbeat_back_addr":"172.21.15.78:6809/3736366730","heartbeat_front_addr":"172.21.15.78:6807/3736366730","state":["exists","up"]},{"osd":1,"uuid":"d0f286a2-a121-40ee-8134-67ef01b1bc9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6801","nonce":3186321784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6803","nonce":3186321784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6807","nonce":3186321784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6805","nonce":3186321784}]},"public_addr":"172.21.15.112:6801/3186321784","cluster_addr":"172.21.15.112:6803/3186321784","heartbeat_back_addr":"172.21.15.112:6807/3186321784","heartbeat_front_addr":"172.21.15.112:6805/3186321784","state":["exists","up"]},{"osd":2,"uuid":"0eadcce5-12af-4af6-9b4e-159e84454d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6801","nonce":3206386630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6803","nonce":3206386630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6807","nonce":3206386630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6805","nonce":3206386630}]},"public_addr":"172.21.15.138:6801/3206386630","cluster_addr":"172.21.15.138:6803/3206386630","heartbeat_back_addr":"172.21.15.138:6807/3206386630","heartbeat_front_addr":"172.21.15.138:6805/3206386630","state":["exists","up"]},{"osd":3,"uuid":"5f3f683d-6306-43da-8bbd-c103eca442ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6811","nonce":3832405256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6813","nonce":3832405256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6817","nonce":3832405256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6815","nonce":3832405256}]},"public_addr":"172.21.15.78:6811/3832405256","cluster_addr":"172.21.15.78:6813/3832405256","heartbeat_back_addr":"172.21.15.78:6817/3832405256","heartbeat_front_addr":"172.21.15.78:6815/3832405256","state":["exists","up"]},{"osd":4,"uuid":"4575a0a5-821e-4346-84ac-5396042b0550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6809","nonce":2650243435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6811","nonce":2650243435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6815","nonce":2650243435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6813","nonce":2650243435}]},"public_addr":"172.21.15.112:6809/2650243435","cluster_addr":"172.21.15.112:6811/2650243435","heartbeat_back_addr":"172.21.15.112:6815/2650243435","heartbeat_front_addr":"172.21.15.112:6813/2650243435","state":["exists","up"]},{"osd":5,"uuid":"e81eb98f-76eb-4da5-8047-f160888720e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6809","nonce":3033110975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6811","nonce":3033110975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6815","nonce":3033110975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6813","nonce":3033110975}]},"public_addr":"172.21.15.138:6809/3033110975","cluster_addr":"172.21.15.138:6811/3033110975","heartbeat_back_addr":"172.21.15.138:6815/3033110975","heartbeat_front_addr":"172.21.15.138:6813/3033110975","state":["exists","up"]},{"osd":6,"uuid":"7442a091-4dba-45c4-808b-7c3b97087aa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6819","nonce":477087575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6821","nonce":477087575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6825","nonce":477087575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6823","nonce":477087575}]},"public_addr":"172.21.15.78:6819/477087575","cluster_addr":"172.21.15.78:6821/477087575","heartbeat_back_addr":"172.21.15.78:6825/477087575","heartbeat_front_addr":"172.21.15.78:6823/477087575","state":["exists","up"]},{"osd":7,"uuid":"220c1f03-ace9-4dd0-a06d-485b0d2d08bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6817","nonce":1481363296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6819","nonce":1481363296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6823","nonce":1481363296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6821","nonce":1481363296}]},"public_addr":"172.21.15.112:6817/1481363296","cluster_addr":"172.21.15.112:6819/1481363296","heartbeat_back_addr":"172.21.15.112:6823/1481363296","heartbeat_front_addr":"172.21.15.112:6821/1481363296","state":["exists","up"]},{"osd":8,"uuid":"adb6edaa-9a8c-4b0b-aa6a-26dc77a3a7cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6817","nonce":2195149036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6819","nonce":2195149036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6823","nonce":2195149036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6821","nonce":2195149036}]},"public_addr":"172.21.15.138:6817/2195149036","cluster_addr":"172.21.15.138:6819/2195149036","heartbeat_back_addr":"172.21.15.138:6823/2195149036","heartbeat_front_addr":"172.21.15.138:6821/2195149036","state":["exists","up"]},{"osd":9,"uuid":"dd01f408-3712-410e-acbd-c797b7ea5058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6827","nonce":3367249449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6829","nonce":3367249449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6833","nonce":3367249449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6831","nonce":3367249449}]},"public_addr":"172.21.15.78:6827/3367249449","cluster_addr":"172.21.15.78:6829/3367249449","heartbeat_back_addr":"172.21.15.78:6833/3367249449","heartbeat_front_addr":"172.21.15.78:6831/3367249449","state":["exists","up"]},{"osd":10,"uuid":"243c6483-1b0e-49f2-b99c-116d9e9c0617","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6825","nonce":775023408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6827","nonce":775023408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6831","nonce":775023408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6829","nonce":775023408}]},"public_addr":"172.21.15.112:6825/775023408","cluster_addr":"172.21.15.112:6827/775023408","heartbeat_back_addr":"172.21.15.112:6831/775023408","heartbeat_front_addr":"172.21.15.112:6829/775023408","state":["exists","up"]},{"osd":11,"uuid":"fa20ac9e-b5f7-4b3a-bb51-31569f909609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6825","nonce":4046089012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6827","nonce":4046089012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6831","nonce":4046089012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6829","nonce":4046089012}]},"public_addr":"172.21.15.138:6825/4046089012","cluster_addr":"172.21.15.138:6827/4046089012","heartbeat_back_addr":"172.21.15.138:6831/4046089012","heartbeat_front_addr":"172.21.15.138:6829/4046089012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:08:55.896475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:20.695819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:44.785187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:10.858705+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:35.855800+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:01.353037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:27.492985+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:52.860532+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:17.946878+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:43.188966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:08.369978+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:34.192288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":8}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6801/2525199237":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/1476776463":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1949658157":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2276853910":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/4205790529":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6800/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/4286825123":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6801/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1304243506":"2024-09-12T00:06:56.062555+0000","172.21.15.78:6800/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1614270050":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6801/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1679390655":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2957982486":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6800/2525199237":"2024-09-12T00:07:55.586578+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:16:12.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.230+0000 7f246283f640 1 -- 172.21.15.78:0/2266760307 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f24480b5330 msgr2=0x7f24480b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:12.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.230+0000 7f246283f640 1 --2- 172.21.15.78:0/2266760307 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f24480b5330 0x7f24480b77f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f244c009b40 tx=0x7f244c005e50 comp rx=0 tx=0).stop 2024-09-11T00:16:12.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.230+0000 7f246283f640 1 -- 172.21.15.78:0/2266760307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245c106e50 msgr2=0x7f245c10fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:12.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.230+0000 7f246283f640 1 --2- 172.21.15.78:0/2266760307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245c106e50 0x7f245c10fe00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f244400e9f0 tx=0x7f244400eeb0 comp rx=0 tx=0).stop 2024-09-11T00:16:12.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.230+0000 7f246283f640 1 -- 172.21.15.78:0/2266760307 shutdown_connections 2024-09-11T00:16:12.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.230+0000 7f246283f640 1 --2- 172.21.15.78:0/2266760307 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f24480b5330 0x7f24480b77f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:12.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.230+0000 7f246283f640 1 --2- 172.21.15.78:0/2266760307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245c1077d0 0x7f245c110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:12.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.230+0000 7f246283f640 1 --2- 172.21.15.78:0/2266760307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245c106e50 0x7f245c10fe00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:12.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.230+0000 7f246283f640 1 --2- 172.21.15.78:0/2266760307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f245c101440 0x7f245c10f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:12.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.230+0000 7f246283f640 1 -- 172.21.15.78:0/2266760307 >> 172.21.15.78:0/2266760307 conn(0x7f245c078060 msgr2=0x7f245c104500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:12.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.230+0000 7f246283f640 1 -- 172.21.15.78:0/2266760307 shutdown_connections 2024-09-11T00:16:12.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:12.230+0000 7f246283f640 1 -- 172.21.15.78:0/2266760307 wait complete. 2024-09-11T00:16:13.028 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:12 smithi078 ceph-mon[30865]: pgmap v315: 97 pgs: 97 active+clean; 645 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-11T00:16:13.028 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:12 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2266760307' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:16:13.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:12 smithi138 ceph-mon[35019]: pgmap v315: 97 pgs: 97 active+clean; 645 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-11T00:16:13.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:12 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2266760307' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:16:13.057 DEBUG:tasks.fwd_scrub:Yielding 2024-09-11T00:16:13.057 INFO:teuthology.run_tasks:Running task exec... 2024-09-11T00:16:13.070 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T00:16:13.070 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi078.front.sepia.ceph.com 2024-09-11T00:16:13.070 DEBUG:teuthology.orchestra.run.smithi078:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-11T00:16:13.071 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-11T00:16:13.071 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:16:13.071 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:16:13.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.175+0000 7f59c9b73640 1 -- 172.21.15.78:0/3811449326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c41075d0 msgr2=0x7f59c4107a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:13.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.175+0000 7f59c9b73640 1 --2- 172.21.15.78:0/3811449326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c41075d0 0x7f59c4107a10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009900 tx=0x7f59b802a410 comp rx=0 tx=0).stop 2024-09-11T00:16:13.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.175+0000 7f59c9b73640 1 -- 172.21.15.78:0/3811449326 shutdown_connections 2024-09-11T00:16:13.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.175+0000 7f59c9b73640 1 --2- 172.21.15.78:0/3811449326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c4107f50 0x7f59c410e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.175+0000 7f59c9b73640 1 --2- 172.21.15.78:0/3811449326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c41075d0 0x7f59c4107a10 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.175+0000 7f59c9b73640 1 --2- 172.21.15.78:0/3811449326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59c4101bd0 0x7f59c4101fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.175+0000 7f59c9b73640 1 -- 172.21.15.78:0/3811449326 >> 172.21.15.78:0/3811449326 conn(0x7f59c40fd650 msgr2=0x7f59c40ffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.175+0000 7f59c9b73640 1 -- 172.21.15.78:0/3811449326 shutdown_connections 2024-09-11T00:16:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.176+0000 7f59c9b73640 1 -- 172.21.15.78:0/3811449326 wait complete. 2024-09-11T00:16:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.176+0000 7f59c9b73640 1 Processor -- start 2024-09-11T00:16:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.176+0000 7f59c9b73640 1 -- start start 2024-09-11T00:16:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.176+0000 7f59c9b73640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59c4101bd0 0x7f59c419a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.176+0000 7f59c9b73640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c41075d0 0x7f59c419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.176+0000 7f59c9b73640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c4107f50 0x7f59c419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.176+0000 7f59c9b73640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f59c4111c10 con 0x7f59c41075d0 2024-09-11T00:16:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.176+0000 7f59c9b73640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f59c4111a90 con 0x7f59c4107f50 2024-09-11T00:16:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.176+0000 7f59c9b73640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f59c4111d90 con 0x7f59c4101bd0 2024-09-11T00:16:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.177+0000 7f59c2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c41075d0 0x7f59c419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.177+0000 7f59c2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c41075d0 0x7f59c419a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51928/0 (socket says 172.21.15.78:51928) 2024-09-11T00:16:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.177+0000 7f59c2ffd640 1 -- 172.21.15.78:0/3726863962 learned_addr learned my addr 172.21.15.78:0/3726863962 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.177+0000 7f59c3fff640 1 --2- 172.21.15.78:0/3726863962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c4107f50 0x7f59c419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.177+0000 7f59c37fe640 1 --2- 172.21.15.78:0/3726863962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59c4101bd0 0x7f59c419a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.177+0000 7f59c2ffd640 1 -- 172.21.15.78:0/3726863962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59c4101bd0 msgr2=0x7f59c419a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:13.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.177+0000 7f59c2ffd640 1 --2- 172.21.15.78:0/3726863962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59c4101bd0 0x7f59c419a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.177+0000 7f59c2ffd640 1 -- 172.21.15.78:0/3726863962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c4107f50 msgr2=0x7f59c419ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:13.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.177+0000 7f59c2ffd640 1 --2- 172.21.15.78:0/3726863962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c4107f50 0x7f59c419ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.177+0000 7f59c2ffd640 1 -- 172.21.15.78:0/3726863962 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c41a54c0 con 0x7f59c41075d0 2024-09-11T00:16:13.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.177+0000 7f59c37fe640 1 --2- 172.21.15.78:0/3726863962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59c4101bd0 0x7f59c419a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:16:13.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.177+0000 7f59c2ffd640 1 --2- 172.21.15.78:0/3726863962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c41075d0 0x7f59c419a600 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f59b8005940 tx=0x7f59b80040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:13.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.177+0000 7f59c0ff9640 1 -- 172.21.15.78:0/3726863962 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b803f030 con 0x7f59c41075d0 2024-09-11T00:16:13.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.177+0000 7f59c9b73640 1 -- 172.21.15.78:0/3726863962 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c41a5750 con 0x7f59c41075d0 2024-09-11T00:16:13.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.177+0000 7f59c0ff9640 1 -- 172.21.15.78:0/3726863962 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59b80044c0 con 0x7f59c41075d0 2024-09-11T00:16:13.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.177+0000 7f59c0ff9640 1 -- 172.21.15.78:0/3726863962 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8035070 con 0x7f59c41075d0 2024-09-11T00:16:13.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.177+0000 7f59c9b73640 1 -- 172.21.15.78:0/3726863962 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c41a5c40 con 0x7f59c41075d0 2024-09-11T00:16:13.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.178+0000 7f59c9b73640 1 -- 172.21.15.78:0/3726863962 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59c4101fb0 con 0x7f59c41075d0 2024-09-11T00:16:13.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.181+0000 7f59c0ff9640 1 -- 172.21.15.78:0/3726863962 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7f59b803ba20 con 0x7f59c41075d0 2024-09-11T00:16:13.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.182+0000 7f59c0ff9640 1 --2- 172.21.15.78:0/3726863962 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f59ac0b5330 0x7f59ac0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.182+0000 7f59c37fe640 1 --2- 172.21.15.78:0/3726863962 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f59ac0b5330 0x7f59ac0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.182+0000 7f59c0ff9640 1 -- 172.21.15.78:0/3726863962 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f59b81066b0 con 0x7f59c41075d0 2024-09-11T00:16:13.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.182+0000 7f59c37fe640 1 --2- 172.21.15.78:0/3726863962 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f59ac0b5330 0x7f59ac0b77f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009c20 tx=0x7f59b4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:13.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.183+0000 7f59c0ff9640 1 -- 172.21.15.78:0/3726863962 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f59b80cd470 con 0x7f59c41075d0 2024-09-11T00:16:13.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:12 smithi112 ceph-mon[35627]: pgmap v315: 97 pgs: 97 active+clean; 645 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-11T00:16:13.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:12 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2266760307' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:16:13.330 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:16:13.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.396+0000 7f59c9b73640 1 -- 172.21.15.78:0/3726863962 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f59c4063590 con 0x7f59ac0b5330 2024-09-11T00:16:13.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.547+0000 7f59c0ff9640 1 -- 172.21.15.78:0/3726863962 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f59c4063590 con 0x7f59ac0b5330 2024-09-11T00:16:13.550 INFO:teuthology.orchestra.run.smithi078.stdout:Schedule set for path / 2024-09-11T00:16:13.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.549+0000 7f59c9b73640 1 -- 172.21.15.78:0/3726863962 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f59ac0b5330 msgr2=0x7f59ac0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:13.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.549+0000 7f59c9b73640 1 --2- 172.21.15.78:0/3726863962 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f59ac0b5330 0x7f59ac0b77f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009c20 tx=0x7f59b4005f90 comp rx=0 tx=0).stop 2024-09-11T00:16:13.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.549+0000 7f59c9b73640 1 -- 172.21.15.78:0/3726863962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c41075d0 msgr2=0x7f59c419a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:13.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.549+0000 7f59c9b73640 1 --2- 172.21.15.78:0/3726863962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c41075d0 0x7f59c419a600 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f59b8005940 tx=0x7f59b80040c0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.549+0000 7f59c9b73640 1 -- 172.21.15.78:0/3726863962 shutdown_connections 2024-09-11T00:16:13.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.549+0000 7f59c9b73640 1 --2- 172.21.15.78:0/3726863962 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f59ac0b5330 0x7f59ac0b77f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.549+0000 7f59c9b73640 1 --2- 172.21.15.78:0/3726863962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f59c4107f50 0x7f59c419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.549+0000 7f59c9b73640 1 --2- 172.21.15.78:0/3726863962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c41075d0 0x7f59c419a600 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.549+0000 7f59c9b73640 1 --2- 172.21.15.78:0/3726863962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59c4101bd0 0x7f59c419a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.549+0000 7f59c9b73640 1 -- 172.21.15.78:0/3726863962 >> 172.21.15.78:0/3726863962 conn(0x7f59c40fd650 msgr2=0x7f59c40ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:13.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.550+0000 7f59c9b73640 1 -- 172.21.15.78:0/3726863962 shutdown_connections 2024-09-11T00:16:13.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.550+0000 7f59c9b73640 1 -- 172.21.15.78:0/3726863962 wait complete. 2024-09-11T00:16:13.563 DEBUG:teuthology.orchestra.run.smithi078:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-11T00:16:13.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.665+0000 7faddcad4640 1 -- 172.21.15.78:0/2032004878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd8102cf0 msgr2=0x7fadd81030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:13.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.665+0000 7faddcad4640 1 --2- 172.21.15.78:0/2032004878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd8102cf0 0x7fadd81030d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fadc8009900 tx=0x7fadc802a440 comp rx=0 tx=0).stop 2024-09-11T00:16:13.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.665+0000 7faddcad4640 1 -- 172.21.15.78:0/2032004878 shutdown_connections 2024-09-11T00:16:13.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.665+0000 7faddcad4640 1 --2- 172.21.15.78:0/2032004878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadd8109070 0x7fadd810f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.665+0000 7faddcad4640 1 --2- 172.21.15.78:0/2032004878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadd81086f0 0x7fadd8108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.665+0000 7faddcad4640 1 --2- 172.21.15.78:0/2032004878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd8102cf0 0x7fadd81030d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.665+0000 7faddcad4640 1 -- 172.21.15.78:0/2032004878 >> 172.21.15.78:0/2032004878 conn(0x7fadd80fe730 msgr2=0x7fadd8100b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:13.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.665+0000 7faddcad4640 1 -- 172.21.15.78:0/2032004878 shutdown_connections 2024-09-11T00:16:13.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.665+0000 7faddcad4640 1 -- 172.21.15.78:0/2032004878 wait complete. 2024-09-11T00:16:13.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.666+0000 7faddcad4640 1 Processor -- start 2024-09-11T00:16:13.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.666+0000 7faddcad4640 1 -- start start 2024-09-11T00:16:13.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.666+0000 7faddcad4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadd8102cf0 0x7fadd80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.666+0000 7faddcad4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd81086f0 0x7fadd80759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.666+0000 7faddcad4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadd8109070 0x7fadd8075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.666+0000 7faddcad4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fadd8112dd0 con 0x7fadd81086f0 2024-09-11T00:16:13.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.666+0000 7faddcad4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fadd8112c50 con 0x7fadd8102cf0 2024-09-11T00:16:13.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.666+0000 7faddcad4640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fadd8112f50 con 0x7fadd8109070 2024-09-11T00:16:13.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.666+0000 7fadd5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd81086f0 0x7fadd80759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.666+0000 7fadd5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd81086f0 0x7fadd80759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51964/0 (socket says 172.21.15.78:51964) 2024-09-11T00:16:13.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.666+0000 7fadd5d9b640 1 -- 172.21.15.78:0/496950572 learned_addr learned my addr 172.21.15.78:0/496950572 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:13.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.667+0000 7fadd5d9b640 1 -- 172.21.15.78:0/496950572 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadd8109070 msgr2=0x7fadd8075f20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:16:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.667+0000 7fadd5d9b640 1 --2- 172.21.15.78:0/496950572 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadd8109070 0x7fadd8075f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.667+0000 7fadd5d9b640 1 -- 172.21.15.78:0/496950572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadd8102cf0 msgr2=0x7fadd80754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.667+0000 7fadd5d9b640 1 --2- 172.21.15.78:0/496950572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadd8102cf0 0x7fadd80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.667+0000 7fadd5d9b640 1 -- 172.21.15.78:0/496950572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd81a7870 con 0x7fadd81086f0 2024-09-11T00:16:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.667+0000 7fadd5d9b640 1 --2- 172.21.15.78:0/496950572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd81086f0 0x7fadd80759e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00b450 tx=0x7fadcc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.667+0000 7fadc77fe640 1 -- 172.21.15.78:0/496950572 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc015020 con 0x7fadd81086f0 2024-09-11T00:16:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.667+0000 7faddcad4640 1 -- 172.21.15.78:0/496950572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd81a7b60 con 0x7fadd81086f0 2024-09-11T00:16:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.667+0000 7fadc77fe640 1 -- 172.21.15.78:0/496950572 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadcc011d40 con 0x7fadd81086f0 2024-09-11T00:16:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.667+0000 7fadc77fe640 1 -- 172.21.15.78:0/496950572 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc00f340 con 0x7fadd81086f0 2024-09-11T00:16:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.667+0000 7faddcad4640 1 -- 172.21.15.78:0/496950572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd81a80b0 con 0x7fadd81086f0 2024-09-11T00:16:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.668+0000 7faddcad4640 1 -- 172.21.15.78:0/496950572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd8103150 con 0x7fadd81086f0 2024-09-11T00:16:13.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.669+0000 7fadc77fe640 1 -- 172.21.15.78:0/496950572 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 22) ==== 153267+0+0 (secure 0 0 0) 0x7fadcc011890 con 0x7fadd81086f0 2024-09-11T00:16:13.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.670+0000 7fadc77fe640 1 --2- 172.21.15.78:0/496950572 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fadc00b5330 0x7fadc00b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.670+0000 7fadd659c640 1 --2- 172.21.15.78:0/496950572 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fadc00b5330 0x7fadc00b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.670+0000 7fadc77fe640 1 -- 172.21.15.78:0/496950572 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fadcc0e5e80 con 0x7fadd81086f0 2024-09-11T00:16:13.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.670+0000 7fadd659c640 1 --2- 172.21.15.78:0/496950572 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fadc00b5330 0x7fadc00b77f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fadc80096c0 tx=0x7fadc8031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:13.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.673+0000 7fadc77fe640 1 -- 172.21.15.78:0/496950572 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fadcc01f020 con 0x7fadd81086f0 2024-09-11T00:16:13.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.783+0000 7fadc77fe640 1 -- 172.21.15.78:0/496950572 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 23) ==== 153324+0+0 (secure 0 0 0) 0x7fadcc0a87b0 con 0x7fadd81086f0 2024-09-11T00:16:13.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.835+0000 7f81cc922640 1 -- 172.21.15.78:0/1606818848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81c8109130 msgr2=0x7f81c810f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:13.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.835+0000 7f81cc922640 1 --2- 172.21.15.78:0/1606818848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81c8109130 0x7f81c810f930 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009ca0 tx=0x7f81c002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.835+0000 7f81cc922640 1 -- 172.21.15.78:0/1606818848 shutdown_connections 2024-09-11T00:16:13.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.835+0000 7f81cc922640 1 --2- 172.21.15.78:0/1606818848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81c8109130 0x7f81c810f930 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.835+0000 7f81cc922640 1 --2- 172.21.15.78:0/1606818848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81c81087b0 0x7f81c8108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.835+0000 7f81cc922640 1 --2- 172.21.15.78:0/1606818848 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c8102da0 0x7f81c8103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.835+0000 7f81cc922640 1 -- 172.21.15.78:0/1606818848 >> 172.21.15.78:0/1606818848 conn(0x7f81c80fe850 msgr2=0x7f81c8100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:13.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.836+0000 7f81cc922640 1 -- 172.21.15.78:0/1606818848 shutdown_connections 2024-09-11T00:16:13.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.836+0000 7f81cc922640 1 -- 172.21.15.78:0/1606818848 wait complete. 2024-09-11T00:16:13.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.836+0000 7f81cc922640 1 Processor -- start 2024-09-11T00:16:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.836+0000 7f81cc922640 1 -- start start 2024-09-11T00:16:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.836+0000 7f81cc922640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81c8102da0 0x7f81c81991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.836+0000 7f81cc922640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81c81087b0 0x7f81c8199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.837+0000 7f81cc922640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c8109130 0x7f81c819eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.837+0000 7f81cc922640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f81c8112df0 con 0x7f81c81087b0 2024-09-11T00:16:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.837+0000 7f81cc922640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f81c8112c70 con 0x7f81c8109130 2024-09-11T00:16:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.837+0000 7f81cc922640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f81c8112f70 con 0x7f81c8102da0 2024-09-11T00:16:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.837+0000 7f81c5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81c81087b0 0x7f81c8199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.837+0000 7f81c5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81c81087b0 0x7f81c8199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51972/0 (socket says 172.21.15.78:51972) 2024-09-11T00:16:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.837+0000 7f81c5d9b640 1 -- 172.21.15.78:0/455315772 learned_addr learned my addr 172.21.15.78:0/455315772 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.837+0000 7f81c659c640 1 --2- 172.21.15.78:0/455315772 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81c8102da0 0x7f81c81991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.837+0000 7f81c6d9d640 1 --2- 172.21.15.78:0/455315772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c8109130 0x7f81c819eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.837+0000 7f81c5d9b640 1 -- 172.21.15.78:0/455315772 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81c8102da0 msgr2=0x7f81c81991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.837+0000 7f81c5d9b640 1 --2- 172.21.15.78:0/455315772 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81c8102da0 0x7f81c81991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.837+0000 7f81c5d9b640 1 -- 172.21.15.78:0/455315772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c8109130 msgr2=0x7f81c819eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.837+0000 7f81c5d9b640 1 --2- 172.21.15.78:0/455315772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c8109130 0x7f81c819eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.837+0000 7f81c5d9b640 1 -- 172.21.15.78:0/455315772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c819f290 con 0x7f81c81087b0 2024-09-11T00:16:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.837+0000 7f81c5d9b640 1 --2- 172.21.15.78:0/455315772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81c81087b0 0x7f81c8199720 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f81bc00d950 tx=0x7f81bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.837+0000 7f81b77fe640 1 -- 172.21.15.78:0/455315772 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc017030 con 0x7f81c81087b0 2024-09-11T00:16:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.837+0000 7f81b77fe640 1 -- 172.21.15.78:0/455315772 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81bc004020 con 0x7f81c81087b0 2024-09-11T00:16:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.837+0000 7f81cc922640 1 -- 172.21.15.78:0/455315772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c819f580 con 0x7f81c81087b0 2024-09-11T00:16:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.837+0000 7f81b77fe640 1 -- 172.21.15.78:0/455315772 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc0047a0 con 0x7f81c81087b0 2024-09-11T00:16:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.837+0000 7f81cc922640 1 -- 172.21.15.78:0/455315772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c81a5c40 con 0x7f81c81087b0 2024-09-11T00:16:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.840+0000 7f81b77fe640 1 -- 172.21.15.78:0/455315772 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 23) ==== 153324+0+0 (secure 0 0 0) 0x7f81bc009a30 con 0x7f81c81087b0 2024-09-11T00:16:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.840+0000 7f81cecf7740 1 Processor -- start 2024-09-11T00:16:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.840+0000 7f81cecf7740 1 -- start start 2024-09-11T00:16:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.840+0000 7f81cecf7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5625eed622f0 0x5625eed626d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.840+0000 7f81cecf7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed62c10 0x5625eed6e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.840+0000 7f81cecf7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed6eba0 0x5625eed70f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.840+0000 7f81cecf7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5625eecd4e60 con 0x5625eed6eba0 2024-09-11T00:16:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.840+0000 7f81cecf7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5625eecc4290 con 0x5625eed622f0 2024-09-11T00:16:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.840+0000 7f81cecf7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5625eecc80a0 con 0x5625eed62c10 2024-09-11T00:16:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.841+0000 7f81c5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed6eba0 0x5625eed70f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.841+0000 7f81c659c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed62c10 0x5625eed6e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.841+0000 7f81c659c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed62c10 0x5625eed6e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.78:60266/0 (socket says 172.21.15.78:60266) 2024-09-11T00:16:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.841+0000 7f81c659c640 1 -- 172.21.15.78:0/2152997697 learned_addr learned my addr 172.21.15.78:0/2152997697 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.841+0000 7f81c5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed6eba0 0x5625eed70f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51988/0 (socket says 172.21.15.78:51988) 2024-09-11T00:16:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.841+0000 7f81c6d9d640 1 --2- 172.21.15.78:0/2152997697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5625eed622f0 0x5625eed626d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.841+0000 7f81c659c640 1 -- 172.21.15.78:0/2152997697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5625eed622f0 msgr2=0x5625eed626d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.841+0000 7f81c659c640 1 --2- 172.21.15.78:0/2152997697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5625eed622f0 0x5625eed626d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.841+0000 7f81c659c640 1 -- 172.21.15.78:0/2152997697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed6eba0 msgr2=0x5625eed70f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.841+0000 7f81c659c640 1 --2- 172.21.15.78:0/2152997697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed6eba0 0x5625eed70f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.841+0000 7f81c659c640 1 -- 172.21.15.78:0/2152997697 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625eea22930 con 0x5625eed62c10 2024-09-11T00:16:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.841+0000 7f81c5d9b640 1 --2- 172.21.15.78:0/2152997697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed6eba0 0x5625eed70f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:16:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.841+0000 7f81c659c640 1 --2- 172.21.15.78:0/2152997697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed62c10 0x5625eed6e660 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f81b8009c80 tx=0x7f81b80117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83c792dd37d99c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.841+0000 7f81b77fe640 1 --2- 172.21.15.78:0/455315772 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f81b00b53c0 0x7f81b00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.841+0000 7f81b4ff9640 1 -- 172.21.15.78:0/2152997697 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b8012450 con 0x5625eed62c10 2024-09-11T00:16:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.841+0000 7f81c6d9d640 1 --2- 172.21.15.78:0/455315772 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f81b00b53c0 0x7f81b00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.841+0000 7f81b4ff9640 1 -- 172.21.15.78:0/2152997697 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81b8012aa0 con 0x5625eed62c10 2024-09-11T00:16:13.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.841+0000 7f81b4ff9640 1 -- 172.21.15.78:0/2152997697 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b800fb80 con 0x5625eed62c10 2024-09-11T00:16:13.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.842+0000 7f81b77fe640 1 -- 172.21.15.78:0/455315772 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f81bc0e5a30 con 0x7f81c81087b0 2024-09-11T00:16:13.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.842+0000 7f81c6d9d640 1 --2- 172.21.15.78:0/455315772 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f81b00b53c0 0x7f81b00b7880 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f81c0006010 tx=0x7f81c0009360 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:13.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.842+0000 7f81cecf7740 1 -- 172.21.15.78:0/2152997697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed62c10 msgr2=0x5625eed6e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:13.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.842+0000 7f81cecf7740 1 --2- 172.21.15.78:0/2152997697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed62c10 0x5625eed6e660 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f81b8009c80 tx=0x7f81b80117b0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.842+0000 7f81cecf7740 1 -- 172.21.15.78:0/2152997697 shutdown_connections 2024-09-11T00:16:13.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.842+0000 7f81cecf7740 1 --2- 172.21.15.78:0/2152997697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed6eba0 0x5625eed70f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.842+0000 7f81cecf7740 1 --2- 172.21.15.78:0/2152997697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed62c10 0x5625eed6e660 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.842+0000 7f81cecf7740 1 --2- 172.21.15.78:0/2152997697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5625eed622f0 0x5625eed626d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.842+0000 7f81cecf7740 1 -- 172.21.15.78:0/2152997697 >> 172.21.15.78:0/2152997697 conn(0x5625eed60120 msgr2=0x5625eed612c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:13.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.842+0000 7f81cecf7740 1 -- 172.21.15.78:0/2152997697 shutdown_connections 2024-09-11T00:16:13.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.842+0000 7f81cecf7740 1 -- 172.21.15.78:0/2152997697 wait complete. 2024-09-11T00:16:13.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.843+0000 7f81cecf7740 1 -- start start 2024-09-11T00:16:13.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.843+0000 7f81cecf7740 1 Processor -- start 2024-09-11T00:16:13.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.843+0000 7f81cecf7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed622f0 0x5625eed6bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.843+0000 7f81cecf7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5625eed62c10 0x5625eed6c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.843+0000 7f81cecf7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed6eba0 0x5625eed6c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.843+0000 7f81cecf7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5625eeb25890 con 0x5625eed622f0 2024-09-11T00:16:13.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.843+0000 7f81cecf7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5625eec5ed40 con 0x5625eed62c10 2024-09-11T00:16:13.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.843+0000 7f81cecf7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5625eed71820 con 0x5625eed6eba0 2024-09-11T00:16:13.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.843+0000 7f81c659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed622f0 0x5625eed6bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.843+0000 7f81c659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed622f0 0x5625eed6bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51998/0 (socket says 172.21.15.78:51998) 2024-09-11T00:16:13.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.843+0000 7f81c659c640 1 -- 172.21.15.78:0/2123537387 learned_addr learned my addr 172.21.15.78:0/2123537387 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:13.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.843+0000 7f81cecf7740 10 client.0 _ll_register_callbacks cb 0x5625eecc2c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:16:13.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.843+0000 7f81c6d9d640 1 --2- 172.21.15.78:0/2123537387 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed6eba0 0x5625eed6c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.843+0000 7f81c659c640 1 -- 172.21.15.78:0/2123537387 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed6eba0 msgr2=0x5625eed6c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.844+0000 7f81c659c640 1 --2- 172.21.15.78:0/2123537387 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed6eba0 0x5625eed6c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.844+0000 7f81c659c640 1 -- 172.21.15.78:0/2123537387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5625eed62c10 msgr2=0x5625eed6c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.844+0000 7f81c659c640 1 --2- 172.21.15.78:0/2123537387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5625eed62c10 0x5625eed6c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.844+0000 7f81c659c640 1 -- 172.21.15.78:0/2123537387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625eed7abd0 con 0x5625eed622f0 2024-09-11T00:16:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.844+0000 7f81c659c640 1 --2- 172.21.15.78:0/2123537387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed622f0 0x5625eed6bb00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f81b8000c00 tx=0x7f81b8009fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f51835923c7daaf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.844+0000 7f81adffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:16:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.844+0000 7f81adffb640 1 -- 172.21.15.78:0/2123537387 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b8029020 con 0x5625eed622f0 2024-09-11T00:16:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.844+0000 7f81adffb640 1 -- 172.21.15.78:0/2123537387 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f81b8012660 con 0x5625eed622f0 2024-09-11T00:16:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.844+0000 7f81cecf7740 1 -- 172.21.15.78:0/2123537387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81b8012aa0 con 0x5625eed622f0 2024-09-11T00:16:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.844+0000 7f81adffb640 1 -- 172.21.15.78:0/2123537387 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f81b8034050 con 0x5625eed622f0 2024-09-11T00:16:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.844+0000 7f81cecf7740 10 client.15318 fetch_fsmap learned FSMap version 20 2024-09-11T00:16:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.844+0000 7f81cecf7740 1 -- 172.21.15.78:0/2123537387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5625eed7d560 con 0x5625eed622f0 2024-09-11T00:16:13.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.844+0000 7f81adffb640 1 -- 172.21.15.78:0/2123537387 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81b8012aa0 con 0x5625eed622f0 2024-09-11T00:16:13.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.844+0000 7f81adffb640 1 -- 172.21.15.78:0/2123537387 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f81b80035f0 con 0x5625eed622f0 2024-09-11T00:16:13.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.845+0000 7f81cecf7740 10 client.15318 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:16:13.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.845+0000 7f81cecf7740 10 client.15318 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:16:13.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.845+0000 7f81cecf7740 20 client.15318 populate_metadata read hostname 'smithi078' 2024-09-11T00:16:13.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.845+0000 7f81cecf7740 1 --2- 172.21.15.78:0/2123537387 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5625eed7e9c0 0x5625eed80db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.845+0000 7f81cecf7740 4 client.15318 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:16:13.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.845+0000 7f81cecf7740 1 -- 172.21.15.78:0/2123537387 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625eecd6db0 con 0x5625eed7e9c0 2024-09-11T00:16:13.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.845+0000 7f81c5d9b640 1 --2- 172.21.15.78:0/2123537387 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5625eed7e9c0 0x5625eed80db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.845+0000 7f81c5d9b640 1 --2- 172.21.15.78:0/2123537387 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5625eed7e9c0 0x5625eed80db0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=612760d13bee9b50 server_cookie=dd76713fa033f028 in_seq=0 out_seq=0 2024-09-11T00:16:13.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.845+0000 7f81adffb640 10 client.15318 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:13.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.846+0000 7f81adffb640 1 -- 172.21.15.78:0/2123537387 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5625eecd6db0 con 0x5625eed7e9c0 2024-09-11T00:16:13.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.846+0000 7f81adffb640 10 client.15318 handle_command_reply: tid=0 2024-09-11T00:16:13.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.846+0000 7f81cecf7740 1 client.15318 shutdown 2024-09-11T00:16:13.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.846+0000 7f81cecf7740 1 -- 172.21.15.78:0/2123537387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed622f0 msgr2=0x5625eed6bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:13.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.846+0000 7f81cecf7740 1 --2- 172.21.15.78:0/2123537387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed622f0 0x5625eed6bb00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f81b8000c00 tx=0x7f81b8009fa0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.846+0000 7f81cecf7740 1 -- 172.21.15.78:0/2123537387 shutdown_connections 2024-09-11T00:16:13.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.846+0000 7f81cecf7740 1 --2- 172.21.15.78:0/2123537387 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5625eed7e9c0 0x5625eed80db0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.846+0000 7f81cecf7740 1 --2- 172.21.15.78:0/2123537387 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed6eba0 0x5625eed6c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.846+0000 7f81cecf7740 1 --2- 172.21.15.78:0/2123537387 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5625eed62c10 0x5625eed6c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.846+0000 7f81adffb640 0 client.15318 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:13.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.846+0000 7f81cecf7740 1 --2- 172.21.15.78:0/2123537387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed622f0 0x5625eed6bb00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.846+0000 7f81cecf7740 1 -- 172.21.15.78:0/2123537387 >> 172.21.15.78:0/2123537387 conn(0x5625eed60120 msgr2=0x5625eed65470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:13.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.846+0000 7f81cecf7740 1 -- 172.21.15.78:0/2123537387 shutdown_connections 2024-09-11T00:16:13.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.846+0000 7f81cecf7740 1 -- 172.21.15.78:0/2123537387 wait complete. 2024-09-11T00:16:13.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.846+0000 7f81cecf7740 20 client.15318 trim_cache size 0 max 16384 2024-09-11T00:16:13.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.864+0000 7f81cecf7740 1 Processor -- start 2024-09-11T00:16:13.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.864+0000 7f81cecf7740 1 -- start start 2024-09-11T00:16:13.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.864+0000 7f81cecf7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed622f0 0x5625eed69590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.864+0000 7f81cecf7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5625eed62c10 0x5625eed5af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.864+0000 7f81cecf7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed6eba0 0x5625eed65af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.865+0000 7f81cecf7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f81c81aa530 con 0x5625eed6eba0 2024-09-11T00:16:13.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.865+0000 7f81c6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed6eba0 0x5625eed65af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.865+0000 7f81cecf7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f81c81acdb0 con 0x5625eed62c10 2024-09-11T00:16:13.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.865+0000 7f81cecf7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f81c81aaba0 con 0x5625eed622f0 2024-09-11T00:16:13.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.865+0000 7f81c6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed6eba0 0x5625eed65af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52012/0 (socket says 172.21.15.78:52012) 2024-09-11T00:16:13.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.865+0000 7f81c6d9d640 1 -- 172.21.15.78:0/1973235651 learned_addr learned my addr 172.21.15.78:0/1973235651 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:13.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.865+0000 7f81c659c640 1 --2- 172.21.15.78:0/1973235651 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed622f0 0x5625eed69590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.865+0000 7f81c5d9b640 1 --2- 172.21.15.78:0/1973235651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5625eed62c10 0x5625eed5af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.865+0000 7f81c6d9d640 1 -- 172.21.15.78:0/1973235651 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed622f0 msgr2=0x5625eed69590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:13.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.865+0000 7f81c6d9d640 1 --2- 172.21.15.78:0/1973235651 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed622f0 0x5625eed69590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.865+0000 7f81c6d9d640 1 -- 172.21.15.78:0/1973235651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5625eed62c10 msgr2=0x5625eed5af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:13.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.865+0000 7f81c6d9d640 1 --2- 172.21.15.78:0/1973235651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5625eed62c10 0x5625eed5af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.865+0000 7f81c6d9d640 1 -- 172.21.15.78:0/1973235651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625eed60ba0 con 0x5625eed6eba0 2024-09-11T00:16:13.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.865+0000 7f81c6d9d640 1 --2- 172.21.15.78:0/1973235651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed6eba0 0x5625eed65af0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f81c0031d90 tx=0x7f81c0040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6180ab6d06ec00c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:13.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.865+0000 7f81affff640 1 -- 172.21.15.78:0/1973235651 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c0031e80 con 0x5625eed6eba0 2024-09-11T00:16:13.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.865+0000 7f81affff640 1 -- 172.21.15.78:0/1973235651 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81c0036040 con 0x5625eed6eba0 2024-09-11T00:16:13.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.865+0000 7f81affff640 1 -- 172.21.15.78:0/1973235651 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c00047d0 con 0x5625eed6eba0 2024-09-11T00:16:13.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.866+0000 7f81cecf7740 1 -- 172.21.15.78:0/1973235651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed6eba0 msgr2=0x5625eed65af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:13.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.866+0000 7f81cecf7740 1 --2- 172.21.15.78:0/1973235651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed6eba0 0x5625eed65af0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f81c0031d90 tx=0x7f81c0040000 comp rx=0 tx=0).stop 2024-09-11T00:16:13.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.866+0000 7f81cecf7740 1 -- 172.21.15.78:0/1973235651 shutdown_connections 2024-09-11T00:16:13.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.866+0000 7f81cecf7740 1 --2- 172.21.15.78:0/1973235651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed6eba0 0x5625eed65af0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.866+0000 7f81cecf7740 1 --2- 172.21.15.78:0/1973235651 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5625eed62c10 0x5625eed5af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.866+0000 7f81cecf7740 1 --2- 172.21.15.78:0/1973235651 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed622f0 0x5625eed69590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.866+0000 7f81cecf7740 1 -- 172.21.15.78:0/1973235651 >> 172.21.15.78:0/1973235651 conn(0x5625eed60120 msgr2=0x5625eed653e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:13.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.866+0000 7f81cecf7740 1 -- 172.21.15.78:0/1973235651 shutdown_connections 2024-09-11T00:16:13.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.866+0000 7f81cecf7740 1 -- 172.21.15.78:0/1973235651 wait complete. 2024-09-11T00:16:13.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.867+0000 7f81cecf7740 1 -- start start 2024-09-11T00:16:13.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.867+0000 7f81cecf7740 1 Processor -- start 2024-09-11T00:16:13.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.867+0000 7f81cecf7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed622f0 0x5625eed732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.867+0000 7f81cecf7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5625eed62c10 0x5625eed73870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.867+0000 7f81cecf7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed6eba0 0x5625eedea6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.867+0000 7f81cecf7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f81c81ab270 con 0x5625eed622f0 2024-09-11T00:16:13.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.867+0000 7f81cecf7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f81c81ac6e0 con 0x5625eed62c10 2024-09-11T00:16:13.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.867+0000 7f81cecf7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f81c81ab940 con 0x5625eed6eba0 2024-09-11T00:16:13.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.867+0000 7f81cecf7740 10 client.0 _ll_register_callbacks cb 0x7f81bc0e93b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:16:13.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.867+0000 7f81c659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed622f0 0x5625eed732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.867+0000 7f81c659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed622f0 0x5625eed732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52022/0 (socket says 172.21.15.78:52022) 2024-09-11T00:16:13.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.867+0000 7f81c659c640 1 -- 172.21.15.78:0/2854801400 learned_addr learned my addr 172.21.15.78:0/2854801400 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:13.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.867+0000 7f81c5d9b640 1 --2- 172.21.15.78:0/2854801400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5625eed62c10 0x5625eed73870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.867+0000 7f81c6d9d640 1 --2- 172.21.15.78:0/2854801400 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed6eba0 0x5625eedea6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.868+0000 7f81c659c640 1 -- 172.21.15.78:0/2854801400 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed6eba0 msgr2=0x5625eedea6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:13.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.868+0000 7f81c659c640 1 --2- 172.21.15.78:0/2854801400 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed6eba0 0x5625eedea6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.868+0000 7f81c659c640 1 -- 172.21.15.78:0/2854801400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5625eed62c10 msgr2=0x5625eed73870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:13.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.868+0000 7f81c659c640 1 --2- 172.21.15.78:0/2854801400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5625eed62c10 0x5625eed73870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.868+0000 7f81c659c640 1 -- 172.21.15.78:0/2854801400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625eedeadb0 con 0x5625eed622f0 2024-09-11T00:16:13.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.868+0000 7f81c6d9d640 1 --2- 172.21.15.78:0/2854801400 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed6eba0 0x5625eedea6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:16:13.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.868+0000 7f81c5d9b640 1 --2- 172.21.15.78:0/2854801400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5625eed62c10 0x5625eed73870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:16:13.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.868+0000 7f81c659c640 1 --2- 172.21.15.78:0/2854801400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed622f0 0x5625eed732f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f81b8000c00 tx=0x7f81b8003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0a313748226067 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:13.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.868+0000 7f81adffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:16:13.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.868+0000 7f81adffb640 1 -- 172.21.15.78:0/2854801400 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b803d060 con 0x5625eed622f0 2024-09-11T00:16:13.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.868+0000 7f81adffb640 1 -- 172.21.15.78:0/2854801400 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f81b8005440 con 0x5625eed622f0 2024-09-11T00:16:13.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.868+0000 7f81cecf7740 1 -- 172.21.15.78:0/2854801400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81c0036040 con 0x5625eed622f0 2024-09-11T00:16:13.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.868+0000 7f81adffb640 1 -- 172.21.15.78:0/2854801400 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f81b8029040 con 0x5625eed622f0 2024-09-11T00:16:13.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.868+0000 7f81cecf7740 10 client.15324 fetch_fsmap learned FSMap version 20 2024-09-11T00:16:13.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.868+0000 7f81cecf7740 1 -- 172.21.15.78:0/2854801400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5625eedec0f0 con 0x5625eed622f0 2024-09-11T00:16:13.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.868+0000 7f81adffb640 1 -- 172.21.15.78:0/2854801400 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81c0036040 con 0x5625eed622f0 2024-09-11T00:16:13.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.869+0000 7f81adffb640 1 -- 172.21.15.78:0/2854801400 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f81b8012660 con 0x5625eed622f0 2024-09-11T00:16:13.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.869+0000 7f81cecf7740 10 client.15324 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:16:13.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.869+0000 7f81cecf7740 10 client.15324 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:16:13.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.869+0000 7f81cecf7740 20 client.15324 populate_metadata read hostname 'smithi078' 2024-09-11T00:16:13.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.869+0000 7f81cecf7740 1 --2- 172.21.15.78:0/2854801400 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5625eedec810 0x5625eedeec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:13.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.869+0000 7f81cecf7740 4 client.15324 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:16:13.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.869+0000 7f81cecf7740 1 -- 172.21.15.78:0/2854801400 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5625eecd2860 con 0x5625eedec810 2024-09-11T00:16:13.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.869+0000 7f81c5d9b640 1 --2- 172.21.15.78:0/2854801400 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5625eedec810 0x5625eedeec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:13.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.869+0000 7f81adffb640 10 client.15324 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:13.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.869+0000 7f81c5d9b640 1 --2- 172.21.15.78:0/2854801400 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5625eedec810 0x5625eedeec30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60089f61ac0ea16f server_cookie=cd29fecfcb8b7b10 in_seq=0 out_seq=0 2024-09-11T00:16:13.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.871+0000 7f81adffb640 1 -- 172.21.15.78:0/2854801400 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5625eecd2860 con 0x5625eedec810 2024-09-11T00:16:13.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.871+0000 7f81adffb640 10 client.15324 handle_command_reply: tid=0 2024-09-11T00:16:13.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.871+0000 7f81cecf7740 1 client.15324 shutdown 2024-09-11T00:16:13.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.871+0000 7f81cecf7740 1 -- 172.21.15.78:0/2854801400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed622f0 msgr2=0x5625eed732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:13.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.871+0000 7f81cecf7740 1 --2- 172.21.15.78:0/2854801400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed622f0 0x5625eed732f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f81b8000c00 tx=0x7f81b8003ee0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.871+0000 7f81cecf7740 1 -- 172.21.15.78:0/2854801400 shutdown_connections 2024-09-11T00:16:13.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.871+0000 7f81cecf7740 1 --2- 172.21.15.78:0/2854801400 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5625eedec810 0x5625eedeec30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.871+0000 7f81cecf7740 1 --2- 172.21.15.78:0/2854801400 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5625eed6eba0 0x5625eedea6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.871+0000 7f81cecf7740 1 --2- 172.21.15.78:0/2854801400 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5625eed62c10 0x5625eed73870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.871+0000 7f81cecf7740 1 --2- 172.21.15.78:0/2854801400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5625eed622f0 0x5625eed732f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.871+0000 7f81cecf7740 1 -- 172.21.15.78:0/2854801400 >> 172.21.15.78:0/2854801400 conn(0x5625eed60120 msgr2=0x5625eed61620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:13.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.871+0000 7f81adffb640 0 client.15324 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:13.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.871+0000 7f81cecf7740 1 -- 172.21.15.78:0/2854801400 shutdown_connections 2024-09-11T00:16:13.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.871+0000 7f81cecf7740 1 -- 172.21.15.78:0/2854801400 wait complete. 2024-09-11T00:16:13.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.871+0000 7f81cecf7740 20 client.15324 trim_cache size 0 max 16384 2024-09-11T00:16:13.881 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:16:13.881 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-11T00:16:13.881 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "550cfcf7-9c57-47a1-9ac1-d89a0970cd67", 2024-09-11T00:16:13.881 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-11T00:16:13.881 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:16:13.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.872+0000 7f81cc922640 1 -- 172.21.15.78:0/455315772 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f81b00b53c0 msgr2=0x7f81b00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:13.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.872+0000 7f81cc922640 1 --2- 172.21.15.78:0/455315772 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f81b00b53c0 0x7f81b00b7880 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f81c0006010 tx=0x7f81c0009360 comp rx=0 tx=0).stop 2024-09-11T00:16:13.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.872+0000 7f81cc922640 1 -- 172.21.15.78:0/455315772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81c81087b0 msgr2=0x7f81c8199720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:13.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.872+0000 7f81cc922640 1 --2- 172.21.15.78:0/455315772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81c81087b0 0x7f81c8199720 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f81bc00d950 tx=0x7f81bc00de10 comp rx=0 tx=0).stop 2024-09-11T00:16:13.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.872+0000 7f81cc922640 1 -- 172.21.15.78:0/455315772 shutdown_connections 2024-09-11T00:16:13.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.872+0000 7f81cc922640 1 --2- 172.21.15.78:0/455315772 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f81b00b53c0 0x7f81b00b7880 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.872+0000 7f81cc922640 1 --2- 172.21.15.78:0/455315772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81c8109130 0x7f81c819eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.872+0000 7f81cc922640 1 --2- 172.21.15.78:0/455315772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81c81087b0 0x7f81c8199720 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.872+0000 7f81cc922640 1 --2- 172.21.15.78:0/455315772 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81c8102da0 0x7f81c81991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.872+0000 7f81cc922640 1 -- 172.21.15.78:0/455315772 >> 172.21.15.78:0/455315772 conn(0x7f81c80fe850 msgr2=0x7f81c8100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:13.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.872+0000 7f81cc922640 1 -- 172.21.15.78:0/455315772 shutdown_connections 2024-09-11T00:16:13.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.872+0000 7f81cc922640 1 -- 172.21.15.78:0/455315772 wait complete. 2024-09-11T00:16:13.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.889+0000 7faddcad4640 1 -- 172.21.15.78:0/496950572 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fadd8063590 con 0x7fadc00b5330 2024-09-11T00:16:13.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.942+0000 7fadc77fe640 1 -- 172.21.15.78:0/496950572 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fadd8063590 con 0x7fadc00b5330 2024-09-11T00:16:13.945 INFO:teuthology.orchestra.run.smithi078.stdout:Retention added to path / 2024-09-11T00:16:13.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.944+0000 7faddcad4640 1 -- 172.21.15.78:0/496950572 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fadc00b5330 msgr2=0x7fadc00b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:13.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.944+0000 7faddcad4640 1 --2- 172.21.15.78:0/496950572 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fadc00b5330 0x7fadc00b77f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fadc80096c0 tx=0x7fadc8031400 comp rx=0 tx=0).stop 2024-09-11T00:16:13.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.944+0000 7faddcad4640 1 -- 172.21.15.78:0/496950572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd81086f0 msgr2=0x7fadd80759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:13.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.944+0000 7faddcad4640 1 --2- 172.21.15.78:0/496950572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd81086f0 0x7fadd80759e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00b450 tx=0x7fadcc00b910 comp rx=0 tx=0).stop 2024-09-11T00:16:13.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.944+0000 7faddcad4640 1 -- 172.21.15.78:0/496950572 shutdown_connections 2024-09-11T00:16:13.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.944+0000 7faddcad4640 1 --2- 172.21.15.78:0/496950572 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fadc00b5330 0x7fadc00b77f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.944+0000 7faddcad4640 1 --2- 172.21.15.78:0/496950572 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadd8109070 0x7fadd8075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.944+0000 7faddcad4640 1 --2- 172.21.15.78:0/496950572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd81086f0 0x7fadd80759e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.944+0000 7faddcad4640 1 --2- 172.21.15.78:0/496950572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fadd8102cf0 0x7fadd80754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:13.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.944+0000 7faddcad4640 1 -- 172.21.15.78:0/496950572 >> 172.21.15.78:0/496950572 conn(0x7fadd80fe730 msgr2=0x7fadd8100b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:13.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.944+0000 7faddcad4640 1 -- 172.21.15.78:0/496950572 shutdown_connections 2024-09-11T00:16:13.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:13.944+0000 7faddcad4640 1 -- 172.21.15.78:0/496950572 wait complete. 2024-09-11T00:16:13.958 DEBUG:teuthology.orchestra.run.smithi078:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-11T00:16:14.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.056+0000 7f5a67af6640 1 -- 172.21.15.78:0/771410142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a60107600 msgr2=0x7f5a60107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:14.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.056+0000 7f5a67af6640 1 --2- 172.21.15.78:0/771410142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a60107600 0x7f5a60107a40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009900 tx=0x7f5a5002a410 comp rx=0 tx=0).stop 2024-09-11T00:16:14.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.056+0000 7f5a67af6640 1 -- 172.21.15.78:0/771410142 shutdown_connections 2024-09-11T00:16:14.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.056+0000 7f5a67af6640 1 --2- 172.21.15.78:0/771410142 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a60107f80 0x7f5a6010e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:14.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.056+0000 7f5a67af6640 1 --2- 172.21.15.78:0/771410142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a60107600 0x7f5a60107a40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:14.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.056+0000 7f5a67af6640 1 --2- 172.21.15.78:0/771410142 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a60101c00 0x7f5a60101fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:14.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.056+0000 7f5a67af6640 1 -- 172.21.15.78:0/771410142 >> 172.21.15.78:0/771410142 conn(0x7f5a600fd660 msgr2=0x7f5a600ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:14.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.056+0000 7f5a67af6640 1 -- 172.21.15.78:0/771410142 shutdown_connections 2024-09-11T00:16:14.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.056+0000 7f5a67af6640 1 -- 172.21.15.78:0/771410142 wait complete. 2024-09-11T00:16:14.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.057+0000 7f5a67af6640 1 Processor -- start 2024-09-11T00:16:14.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.057+0000 7f5a67af6640 1 -- start start 2024-09-11T00:16:14.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.057+0000 7f5a67af6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a60101c00 0x7f5a60199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:14.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.057+0000 7f5a67af6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a60107600 0x7f5a60199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:14.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.057+0000 7f5a67af6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a60107f80 0x7f5a6019eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:14.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.057+0000 7f5a67af6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5a60111c10 con 0x7f5a60107f80 2024-09-11T00:16:14.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.057+0000 7f5a67af6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5a60111a90 con 0x7f5a60107600 2024-09-11T00:16:14.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.057+0000 7f5a67af6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5a60111d90 con 0x7f5a60101c00 2024-09-11T00:16:14.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.057+0000 7f5a65892640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a60101c00 0x7f5a60199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:14.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.057+0000 7f5a66093640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a60107f80 0x7f5a6019eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:14.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.057+0000 7f5a65892640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a60101c00 0x7f5a60199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.78:60330/0 (socket says 172.21.15.78:60330) 2024-09-11T00:16:14.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.057+0000 7f5a65892640 1 -- 172.21.15.78:0/2913693797 learned_addr learned my addr 172.21.15.78:0/2913693797 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:14.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.057+0000 7f5a65091640 1 --2- 172.21.15.78:0/2913693797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a60107600 0x7f5a60199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:14.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.057+0000 7f5a66093640 1 -- 172.21.15.78:0/2913693797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a60101c00 msgr2=0x7f5a60199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:14.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.057+0000 7f5a66093640 1 --2- 172.21.15.78:0/2913693797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a60101c00 0x7f5a60199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:14.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.057+0000 7f5a66093640 1 -- 172.21.15.78:0/2913693797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a60107600 msgr2=0x7f5a60199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:14.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.057+0000 7f5a66093640 1 --2- 172.21.15.78:0/2913693797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a60107600 0x7f5a60199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:14.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.057+0000 7f5a66093640 1 -- 172.21.15.78:0/2913693797 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a6019f2d0 con 0x7f5a60107f80 2024-09-11T00:16:14.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.057+0000 7f5a65892640 1 --2- 172.21.15.78:0/2913693797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a60101c00 0x7f5a60199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:16:14.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.058+0000 7f5a66093640 1 --2- 172.21.15.78:0/2913693797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a60107f80 0x7f5a6019eb00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5a58009fd0 tx=0x7f5a5800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:14.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.058+0000 7f5a56ffd640 1 -- 172.21.15.78:0/2913693797 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5800ce20 con 0x7f5a60107f80 2024-09-11T00:16:14.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.058+0000 7f5a56ffd640 1 -- 172.21.15.78:0/2913693797 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a58005020 con 0x7f5a60107f80 2024-09-11T00:16:14.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.058+0000 7f5a67af6640 1 -- 172.21.15.78:0/2913693797 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a6019f5c0 con 0x7f5a60107f80 2024-09-11T00:16:14.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.058+0000 7f5a56ffd640 1 -- 172.21.15.78:0/2913693797 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a58010690 con 0x7f5a60107f80 2024-09-11T00:16:14.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.058+0000 7f5a67af6640 1 -- 172.21.15.78:0/2913693797 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a601a5c80 con 0x7f5a60107f80 2024-09-11T00:16:14.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.059+0000 7f5a67af6640 1 -- 172.21.15.78:0/2913693797 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a60102ea0 con 0x7f5a60107f80 2024-09-11T00:16:14.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.060+0000 7f5a56ffd640 1 -- 172.21.15.78:0/2913693797 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 23) ==== 153324+0+0 (secure 0 0 0) 0x7f5a580054d0 con 0x7f5a60107f80 2024-09-11T00:16:14.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.061+0000 7f5a56ffd640 1 --2- 172.21.15.78:0/2913693797 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5a4c0b53c0 0x7f5a4c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:14.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.061+0000 7f5a65892640 1 --2- 172.21.15.78:0/2913693797 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5a4c0b53c0 0x7f5a4c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:14.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.061+0000 7f5a56ffd640 1 -- 172.21.15.78:0/2913693797 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f5a580e6590 con 0x7f5a60107f80 2024-09-11T00:16:14.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.061+0000 7f5a65892640 1 --2- 172.21.15.78:0/2913693797 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5a4c0b53c0 0x7f5a4c0b7880 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c005fd0 tx=0x7f5a5c00b4a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:14.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.065+0000 7f5a56ffd640 1 -- 172.21.15.78:0/2913693797 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5a580ad1f0 con 0x7f5a60107f80 2024-09-11T00:16:14.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.270+0000 7f5a67af6640 1 -- 172.21.15.78:0/2913693797 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f5a60100230 con 0x7f5a4c0b53c0 2024-09-11T00:16:14.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.276+0000 7f5a56ffd640 1 -- 172.21.15.78:0/2913693797 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f5a60100230 con 0x7f5a4c0b53c0 2024-09-11T00:16:14.279 INFO:teuthology.orchestra.run.smithi078.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-11T00:00:00", "created": "2024-09-11T00:16:13", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-11T00:16:14.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.279+0000 7f5a67af6640 1 -- 172.21.15.78:0/2913693797 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5a4c0b53c0 msgr2=0x7f5a4c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:14.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.279+0000 7f5a67af6640 1 --2- 172.21.15.78:0/2913693797 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5a4c0b53c0 0x7f5a4c0b7880 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c005fd0 tx=0x7f5a5c00b4a0 comp rx=0 tx=0).stop 2024-09-11T00:16:14.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.279+0000 7f5a67af6640 1 -- 172.21.15.78:0/2913693797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a60107f80 msgr2=0x7f5a6019eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:14.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.279+0000 7f5a67af6640 1 --2- 172.21.15.78:0/2913693797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a60107f80 0x7f5a6019eb00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5a58009fd0 tx=0x7f5a5800ef10 comp rx=0 tx=0).stop 2024-09-11T00:16:14.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.279+0000 7f5a67af6640 1 -- 172.21.15.78:0/2913693797 shutdown_connections 2024-09-11T00:16:14.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.279+0000 7f5a67af6640 1 --2- 172.21.15.78:0/2913693797 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5a4c0b53c0 0x7f5a4c0b7880 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:14.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.279+0000 7f5a67af6640 1 --2- 172.21.15.78:0/2913693797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a60107f80 0x7f5a6019eb00 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:14.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.279+0000 7f5a67af6640 1 --2- 172.21.15.78:0/2913693797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5a60107600 0x7f5a60199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:14.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.279+0000 7f5a67af6640 1 --2- 172.21.15.78:0/2913693797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a60101c00 0x7f5a60199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:14.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.279+0000 7f5a67af6640 1 -- 172.21.15.78:0/2913693797 >> 172.21.15.78:0/2913693797 conn(0x7f5a600fd660 msgr2=0x7f5a60104660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:14.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.279+0000 7f5a67af6640 1 -- 172.21.15.78:0/2913693797 shutdown_connections 2024-09-11T00:16:14.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.279+0000 7f5a67af6640 1 -- 172.21.15.78:0/2913693797 wait complete. 2024-09-11T00:16:14.292 DEBUG:teuthology.orchestra.run.smithi078:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-11T00:16:14.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.390+0000 7f24645c2640 1 -- 172.21.15.78:0/3146748678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245c102d80 msgr2=0x7f245c103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:14.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.390+0000 7f24645c2640 1 --2- 172.21.15.78:0/3146748678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245c102d80 0x7f245c103160 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2458009900 tx=0x7f245802a410 comp rx=0 tx=0).stop 2024-09-11T00:16:14.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.390+0000 7f24645c2640 1 -- 172.21.15.78:0/3146748678 shutdown_connections 2024-09-11T00:16:14.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.390+0000 7f24645c2640 1 --2- 172.21.15.78:0/3146748678 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f245c109100 0x7f245c10f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:14.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.390+0000 7f24645c2640 1 --2- 172.21.15.78:0/3146748678 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245c108780 0x7f245c108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:14.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.390+0000 7f24645c2640 1 --2- 172.21.15.78:0/3146748678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245c102d80 0x7f245c103160 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:14.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.390+0000 7f24645c2640 1 -- 172.21.15.78:0/3146748678 >> 172.21.15.78:0/3146748678 conn(0x7f245c0fe7c0 msgr2=0x7f245c100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:14.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.390+0000 7f24645c2640 1 -- 172.21.15.78:0/3146748678 shutdown_connections 2024-09-11T00:16:14.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.390+0000 7f24645c2640 1 -- 172.21.15.78:0/3146748678 wait complete. 2024-09-11T00:16:14.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.391+0000 7f24645c2640 1 Processor -- start 2024-09-11T00:16:14.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.391+0000 7f24645c2640 1 -- start start 2024-09-11T00:16:14.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.391+0000 7f24645c2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245c102d80 0x7f245c199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:14.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.391+0000 7f24645c2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245c108780 0x7f245c1998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:14.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.391+0000 7f24645c2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f245c109100 0x7f245c19ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:14.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.391+0000 7f24645c2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f245c112e20 con 0x7f245c108780 2024-09-11T00:16:14.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.391+0000 7f24645c2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f245c112ca0 con 0x7f245c102d80 2024-09-11T00:16:14.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.391+0000 7f24645c2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f245c112fa0 con 0x7f245c109100 2024-09-11T00:16:14.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.391+0000 7f2461b5d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245c108780 0x7f245c1998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:14.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.391+0000 7f2461b5d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245c108780 0x7f245c1998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52066/0 (socket says 172.21.15.78:52066) 2024-09-11T00:16:14.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.391+0000 7f2461b5d640 1 -- 172.21.15.78:0/324123250 learned_addr learned my addr 172.21.15.78:0/324123250 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:14.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.391+0000 7f2462b5f640 1 --2- 172.21.15.78:0/324123250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f245c109100 0x7f245c19ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:14.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.391+0000 7f246235e640 1 --2- 172.21.15.78:0/324123250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245c102d80 0x7f245c199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.391+0000 7f2461b5d640 1 -- 172.21.15.78:0/324123250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f245c109100 msgr2=0x7f245c19ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.391+0000 7f2461b5d640 1 --2- 172.21.15.78:0/324123250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f245c109100 0x7f245c19ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.391+0000 7f2461b5d640 1 -- 172.21.15.78:0/324123250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245c102d80 msgr2=0x7f245c199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.391+0000 7f2461b5d640 1 --2- 172.21.15.78:0/324123250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245c102d80 0x7f245c199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.391+0000 7f2461b5d640 1 -- 172.21.15.78:0/324123250 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245c19f400 con 0x7f245c108780 2024-09-11T00:16:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.391+0000 7f2462b5f640 1 --2- 172.21.15.78:0/324123250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f245c109100 0x7f245c19ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:16:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.392+0000 7f2461b5d640 1 --2- 172.21.15.78:0/324123250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245c108780 0x7f245c1998a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f244c00b4a0 tx=0x7f244c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.392+0000 7f24537fe640 1 -- 172.21.15.78:0/324123250 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c014070 con 0x7f245c108780 2024-09-11T00:16:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.392+0000 7f24537fe640 1 -- 172.21.15.78:0/324123250 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f244c010ac0 con 0x7f245c108780 2024-09-11T00:16:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.392+0000 7f24645c2640 1 -- 172.21.15.78:0/324123250 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f245c19f6f0 con 0x7f245c108780 2024-09-11T00:16:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.392+0000 7f24537fe640 1 -- 172.21.15.78:0/324123250 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c017c30 con 0x7f245c108780 2024-09-11T00:16:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.392+0000 7f24645c2640 1 -- 172.21.15.78:0/324123250 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f245c1a5e30 con 0x7f245c108780 2024-09-11T00:16:14.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.393+0000 7f24645c2640 1 -- 172.21.15.78:0/324123250 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f245c103160 con 0x7f245c108780 2024-09-11T00:16:14.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.394+0000 7f24537fe640 1 -- 172.21.15.78:0/324123250 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 23) ==== 153324+0+0 (secure 0 0 0) 0x7f244c010610 con 0x7f245c108780 2024-09-11T00:16:14.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.395+0000 7f24537fe640 1 --2- 172.21.15.78:0/324123250 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f24480b53c0 0x7f24480b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:14.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.395+0000 7f246235e640 1 --2- 172.21.15.78:0/324123250 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f24480b53c0 0x7f24480b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:14.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.395+0000 7f24537fe640 1 -- 172.21.15.78:0/324123250 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f244c0e5840 con 0x7f245c108780 2024-09-11T00:16:14.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.395+0000 7f246235e640 1 --2- 172.21.15.78:0/324123250 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f24480b53c0 0x7f24480b7880 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2458006010 tx=0x7f2458000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.398+0000 7f24537fe640 1 -- 172.21.15.78:0/324123250 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f244c0ac440 con 0x7f245c108780 2024-09-11T00:16:14.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.600+0000 7f24645c2640 1 -- 172.21.15.78:0/324123250 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f245c063590 con 0x7f24480b53c0 2024-09-11T00:16:14.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.607+0000 7f24537fe640 1 -- 172.21.15.78:0/324123250 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f245c063590 con 0x7f24480b53c0 2024-09-11T00:16:14.609 INFO:teuthology.orchestra.run.smithi078.stdout:/ 1m 6m3h 2024-09-11T00:16:14.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.609+0000 7f24645c2640 1 -- 172.21.15.78:0/324123250 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f24480b53c0 msgr2=0x7f24480b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:14.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.609+0000 7f24645c2640 1 --2- 172.21.15.78:0/324123250 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f24480b53c0 0x7f24480b7880 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2458006010 tx=0x7f2458000bc0 comp rx=0 tx=0).stop 2024-09-11T00:16:14.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.609+0000 7f24645c2640 1 -- 172.21.15.78:0/324123250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245c108780 msgr2=0x7f245c1998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:14.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.609+0000 7f24645c2640 1 --2- 172.21.15.78:0/324123250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245c108780 0x7f245c1998a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f244c00b4a0 tx=0x7f244c00b960 comp rx=0 tx=0).stop 2024-09-11T00:16:14.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.609+0000 7f24645c2640 1 -- 172.21.15.78:0/324123250 shutdown_connections 2024-09-11T00:16:14.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.609+0000 7f24645c2640 1 --2- 172.21.15.78:0/324123250 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f24480b53c0 0x7f24480b7880 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:14.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.609+0000 7f24645c2640 1 --2- 172.21.15.78:0/324123250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f245c109100 0x7f245c19ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:14.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.609+0000 7f24645c2640 1 --2- 172.21.15.78:0/324123250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f245c108780 0x7f245c1998a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:14.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.609+0000 7f24645c2640 1 --2- 172.21.15.78:0/324123250 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f245c102d80 0x7f245c199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:14.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.609+0000 7f24645c2640 1 -- 172.21.15.78:0/324123250 >> 172.21.15.78:0/324123250 conn(0x7f245c0fe7c0 msgr2=0x7f245c100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:14.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.609+0000 7f24645c2640 1 -- 172.21.15.78:0/324123250 shutdown_connections 2024-09-11T00:16:14.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:14.610+0000 7f24645c2640 1 -- 172.21.15.78:0/324123250 wait complete. 2024-09-11T00:16:14.622 DEBUG:teuthology.orchestra.run.smithi078:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-11T00:16:14.650 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-11T00:16:14.662 INFO:teuthology.run_tasks:Running task workunit... 2024-09-11T00:16:14.680 INFO:tasks.workunit:Pulling workunits from ref 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:16:14.680 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-11T00:16:14.681 INFO:tasks.workunit:timeout=6h 2024-09-11T00:16:14.681 INFO:tasks.workunit:cleanup=True 2024-09-11T00:16:14.681 DEBUG:teuthology.orchestra.run.smithi078:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-11T00:16:14.682 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:16:14.737 INFO:teuthology.orchestra.run.smithi078.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-11T00:16:14.737 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-11T00:16:14.737 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-11T00:16:14.737 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:16:14.738 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-11T00:16:14.738 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-11 00:14:42.649589066 +0000 2024-09-11T00:16:14.738 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-11 00:14:42.649589066 +0000 2024-09-11T00:16:14.738 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-11 00:16:05.263110009 +0000 2024-09-11T00:16:14.738 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-11 00:14:42.649589066 +0000 2024-09-11T00:16:14.738 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-11T00:16:14.738 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-11T00:16:14.808 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:16:14.864 INFO:tasks.workunit.client.0.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-11T00:16:14.975 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:16:15.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:14 smithi138 ceph-mon[35019]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:15.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:14 smithi138 ceph-mon[35019]: pgmap v316: 97 pgs: 97 active+clean; 645 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-11T00:16:15.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:14 smithi138 ceph-mon[35019]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-11T00:16:15.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:14 smithi138 ceph-mon[35019]: scrub queued for path: / 2024-09-11T00:16:15.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:14 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:16:15.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:14 smithi138 ceph-mon[35019]: scrub summary: active paths [/] 2024-09-11T00:16:15.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:14 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:16:15.046 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:14 smithi078 ceph-mon[30865]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:15.047 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:14 smithi078 ceph-mon[30865]: pgmap v316: 97 pgs: 97 active+clean; 645 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-11T00:16:15.047 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:14 smithi078 ceph-mon[30865]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-11T00:16:15.047 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:14 smithi078 ceph-mon[30865]: scrub queued for path: / 2024-09-11T00:16:15.047 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:14 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:16:15.047 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:14 smithi078 ceph-mon[30865]: scrub summary: active paths [/] 2024-09-11T00:16:15.047 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:14 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:16:15.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:14 smithi112 ceph-mon[35627]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:15.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:14 smithi112 ceph-mon[35627]: pgmap v316: 97 pgs: 97 active+clean; 645 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-11T00:16:15.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:14 smithi112 ceph-mon[35627]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-11T00:16:15.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:14 smithi112 ceph-mon[35627]: scrub queued for path: / 2024-09-11T00:16:15.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:14 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:16:15.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:14 smithi112 ceph-mon[35627]: scrub summary: active paths [/] 2024-09-11T00:16:15.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:14 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:16:15.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.514+0000 7fb2d74d4640 1 -- 172.21.15.78:0/3663407834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2d0108020 msgr2=0x7fb2d010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:15.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.514+0000 7fb2d74d4640 1 --2- 172.21.15.78:0/3663407834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2d0108020 0x7fb2d010e820 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009ca0 tx=0x7fb2c802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.514+0000 7fb2d74d4640 1 -- 172.21.15.78:0/3663407834 shutdown_connections 2024-09-11T00:16:15.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.514+0000 7fb2d74d4640 1 --2- 172.21.15.78:0/3663407834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2d0108020 0x7fb2d010e820 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.514+0000 7fb2d74d4640 1 --2- 172.21.15.78:0/3663407834 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2d01076a0 0x7fb2d0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.514+0000 7fb2d74d4640 1 --2- 172.21.15.78:0/3663407834 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2d0101c90 0x7fb2d0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.514+0000 7fb2d74d4640 1 -- 172.21.15.78:0/3663407834 >> 172.21.15.78:0/3663407834 conn(0x7fb2d00fd700 msgr2=0x7fb2d00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:15.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.514+0000 7fb2d74d4640 1 -- 172.21.15.78:0/3663407834 shutdown_connections 2024-09-11T00:16:15.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.514+0000 7fb2d74d4640 1 -- 172.21.15.78:0/3663407834 wait complete. 2024-09-11T00:16:15.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.514+0000 7fb2d74d4640 1 Processor -- start 2024-09-11T00:16:15.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.514+0000 7fb2d74d4640 1 -- start start 2024-09-11T00:16:15.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.515+0000 7fb2d74d4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2d0101c90 0x7fb2d01993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:15.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.515+0000 7fb2d74d4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2d01076a0 0x7fb2d0199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:15.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.515+0000 7fb2d74d4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2d0108020 0x7fb2d019ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:15.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.515+0000 7fb2d74d4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d0111ce0 con 0x7fb2d0101c90 2024-09-11T00:16:15.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.515+0000 7fb2d74d4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d0111b60 con 0x7fb2d01076a0 2024-09-11T00:16:15.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.515+0000 7fb2d74d4640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d0111e60 con 0x7fb2d0108020 2024-09-11T00:16:15.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.515+0000 7fb2d5270640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2d0101c90 0x7fb2d01993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:15.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.515+0000 7fb2d5270640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2d0101c90 0x7fb2d01993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60706/0 (socket says 172.21.15.78:60706) 2024-09-11T00:16:15.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.515+0000 7fb2d5270640 1 -- 172.21.15.78:0/874667877 learned_addr learned my addr 172.21.15.78:0/874667877 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:15.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.515+0000 7fb2d5a71640 1 --2- 172.21.15.78:0/874667877 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2d0108020 0x7fb2d019ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:15.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.515+0000 7fb2d5270640 1 -- 172.21.15.78:0/874667877 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2d0108020 msgr2=0x7fb2d019ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:15.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.515+0000 7fb2d5270640 1 --2- 172.21.15.78:0/874667877 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2d0108020 0x7fb2d019ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.515+0000 7fb2d5270640 1 -- 172.21.15.78:0/874667877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2d01076a0 msgr2=0x7fb2d0199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.515+0000 7fb2d4a6f640 1 --2- 172.21.15.78:0/874667877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2d01076a0 0x7fb2d0199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.515+0000 7fb2d5270640 1 --2- 172.21.15.78:0/874667877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2d01076a0 0x7fb2d0199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.515+0000 7fb2d5270640 1 -- 172.21.15.78:0/874667877 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d019f490 con 0x7fb2d0101c90 2024-09-11T00:16:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.515+0000 7fb2d5270640 1 --2- 172.21.15.78:0/874667877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2d0101c90 0x7fb2d01993e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00b4a0 tx=0x7fb2cc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.515+0000 7fb2c67fc640 1 -- 172.21.15.78:0/874667877 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc014070 con 0x7fb2d0101c90 2024-09-11T00:16:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.515+0000 7fb2c67fc640 1 -- 172.21.15.78:0/874667877 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2cc010ac0 con 0x7fb2d0101c90 2024-09-11T00:16:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.515+0000 7fb2d74d4640 1 -- 172.21.15.78:0/874667877 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d019f780 con 0x7fb2d0101c90 2024-09-11T00:16:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.515+0000 7fb2c67fc640 1 -- 172.21.15.78:0/874667877 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc017c30 con 0x7fb2d0101c90 2024-09-11T00:16:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.515+0000 7fb2d74d4640 1 -- 172.21.15.78:0/874667877 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d01a6010 con 0x7fb2d0101c90 2024-09-11T00:16:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.518+0000 7fb2c67fc640 1 -- 172.21.15.78:0/874667877 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 23) ==== 153324+0+0 (secure 0 0 0) 0x7fb2cc010610 con 0x7fb2d0101c90 2024-09-11T00:16:15.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.518+0000 7fb2d98a9740 1 Processor -- start 2024-09-11T00:16:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.518+0000 7fb2d98a9740 1 -- start start 2024-09-11T00:16:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.518+0000 7fb2d98a9740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55557b2390a0 0x55557b239480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.518+0000 7fb2d98a9740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2399c0 0x55557b245410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.518+0000 7fb2d98a9740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55557b245950 0x55557b247d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.518+0000 7fb2d98a9740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55557b1afe50 con 0x55557b2399c0 2024-09-11T00:16:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.518+0000 7fb2d98a9740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55557b19f280 con 0x55557b245950 2024-09-11T00:16:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.518+0000 7fb2d98a9740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55557b1a3090 con 0x55557b2390a0 2024-09-11T00:16:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.518+0000 7fb2d5270640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2399c0 0x55557b245410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.518+0000 7fb2d5270640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2399c0 0x55557b245410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60712/0 (socket says 172.21.15.78:60712) 2024-09-11T00:16:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.519+0000 7fb2d5270640 1 -- 172.21.15.78:0/2088632016 learned_addr learned my addr 172.21.15.78:0/2088632016 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.519+0000 7fb2d5a71640 1 --2- 172.21.15.78:0/2088632016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55557b2390a0 0x55557b239480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.519+0000 7fb2d4a6f640 1 --2- 172.21.15.78:0/2088632016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55557b245950 0x55557b247d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:15.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.519+0000 7fb2d5270640 1 -- 172.21.15.78:0/2088632016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55557b2390a0 msgr2=0x55557b239480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:15.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.519+0000 7fb2d5270640 1 --2- 172.21.15.78:0/2088632016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55557b2390a0 0x55557b239480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.519+0000 7fb2d5270640 1 -- 172.21.15.78:0/2088632016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55557b245950 msgr2=0x55557b247d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:15.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.519+0000 7fb2d5270640 1 --2- 172.21.15.78:0/2088632016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55557b245950 0x55557b247d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.519+0000 7fb2d5270640 1 -- 172.21.15.78:0/2088632016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55557aefd650 con 0x55557b2399c0 2024-09-11T00:16:15.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.519+0000 7fb2c67fc640 1 --2- 172.21.15.78:0/874667877 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb2bc0b5440 0x7fb2bc0b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:15.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.519+0000 7fb2d5270640 1 --2- 172.21.15.78:0/2088632016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2399c0 0x55557b245410 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc0e2f90 tx=0x7fb2cc0ebcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5adb32c16e57143a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:15.573 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:16:15.573 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:16:15.574 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-11T00:16:15.574 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:16:15.574 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:16:15.574 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "550cfcf7-9c57-47a1-9ac1-d89a0970cd67", 2024-09-11T00:16:15.574 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-11T00:16:15.574 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:16:15.574 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:16:15.574 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:16:15.574 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:16:15.574 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:16:15.574 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:16:15.574 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:16:15.574 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:16:15.575 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:16:15.575 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:16:15.575 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:16:15.575 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:16:15.575 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:16:15.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.519+0000 7fb2d5a71640 1 --2- 172.21.15.78:0/874667877 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb2bc0b5440 0x7fb2bc0b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:15.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.519+0000 7fb2c67fc640 1 -- 172.21.15.78:0/874667877 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fb2cc0e57a0 con 0x7fb2d0101c90 2024-09-11T00:16:15.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.519+0000 7fb2bb7fe640 1 -- 172.21.15.78:0/2088632016 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc0a8350 con 0x55557b2399c0 2024-09-11T00:16:15.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.519+0000 7fb2bb7fe640 1 -- 172.21.15.78:0/2088632016 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2cc017360 con 0x55557b2399c0 2024-09-11T00:16:15.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.519+0000 7fb2bb7fe640 1 -- 172.21.15.78:0/2088632016 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc0ab470 con 0x55557b2399c0 2024-09-11T00:16:15.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.520+0000 7fb2d98a9740 1 -- 172.21.15.78:0/2088632016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2399c0 msgr2=0x55557b245410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:15.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.520+0000 7fb2d5a71640 1 --2- 172.21.15.78:0/874667877 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb2bc0b5440 0x7fb2bc0b7900 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8006010 tx=0x7fb2c802f400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:15.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.520+0000 7fb2d98a9740 1 --2- 172.21.15.78:0/2088632016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2399c0 0x55557b245410 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc0e2f90 tx=0x7fb2cc0ebcb0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.520+0000 7fb2d98a9740 1 -- 172.21.15.78:0/2088632016 shutdown_connections 2024-09-11T00:16:15.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.520+0000 7fb2d98a9740 1 --2- 172.21.15.78:0/2088632016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55557b245950 0x55557b247d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.520+0000 7fb2d98a9740 1 --2- 172.21.15.78:0/2088632016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2399c0 0x55557b245410 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.520+0000 7fb2d98a9740 1 --2- 172.21.15.78:0/2088632016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55557b2390a0 0x55557b239480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.520+0000 7fb2d98a9740 1 -- 172.21.15.78:0/2088632016 >> 172.21.15.78:0/2088632016 conn(0x55557b236ed0 msgr2=0x55557b238070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:15.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.520+0000 7fb2d98a9740 1 -- 172.21.15.78:0/2088632016 shutdown_connections 2024-09-11T00:16:15.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.520+0000 7fb2d98a9740 1 -- 172.21.15.78:0/2088632016 wait complete. 2024-09-11T00:16:15.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.520+0000 7fb2d98a9740 1 -- start start 2024-09-11T00:16:15.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.521+0000 7fb2d98a9740 1 Processor -- start 2024-09-11T00:16:15.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.521+0000 7fb2d98a9740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2390a0 0x55557b2451f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:15.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.521+0000 7fb2d98a9740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55557b2399c0 0x55557b242640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:15.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.521+0000 7fb2d98a9740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55557b245950 0x55557b242c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:15.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.521+0000 7fb2d98a9740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55557b000700 con 0x55557b2390a0 2024-09-11T00:16:15.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.521+0000 7fb2d98a9740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55557b13a110 con 0x55557b2399c0 2024-09-11T00:16:15.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.521+0000 7fb2d98a9740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55557b2485d0 con 0x55557b245950 2024-09-11T00:16:15.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.521+0000 7fb2d98a9740 10 client.0 _ll_register_callbacks cb 0x55557b153990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:16:15.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.521+0000 7fb2d5270640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2390a0 0x55557b2451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:15.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.521+0000 7fb2d5270640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2390a0 0x55557b2451f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60728/0 (socket says 172.21.15.78:60728) 2024-09-11T00:16:15.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.521+0000 7fb2d5270640 1 -- 172.21.15.78:0/2438601449 learned_addr learned my addr 172.21.15.78:0/2438601449 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:15.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.521+0000 7fb2d5a71640 1 --2- 172.21.15.78:0/2438601449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55557b245950 0x55557b242c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:15.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.521+0000 7fb2d4a6f640 1 --2- 172.21.15.78:0/2438601449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55557b2399c0 0x55557b242640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:15.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.521+0000 7fb2d5270640 1 -- 172.21.15.78:0/2438601449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55557b245950 msgr2=0x55557b242c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:15.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.521+0000 7fb2d5270640 1 --2- 172.21.15.78:0/2438601449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55557b245950 0x55557b242c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.521+0000 7fb2d5270640 1 -- 172.21.15.78:0/2438601449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55557b2399c0 msgr2=0x55557b242640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:15.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.521+0000 7fb2d5270640 1 --2- 172.21.15.78:0/2438601449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55557b2399c0 0x55557b242640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.521+0000 7fb2d5270640 1 -- 172.21.15.78:0/2438601449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55557b167c40 con 0x55557b2390a0 2024-09-11T00:16:15.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.521+0000 7fb2d4a6f640 1 --2- 172.21.15.78:0/2438601449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55557b2399c0 0x55557b242640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:16:15.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.522+0000 7fb2d5270640 1 --2- 172.21.15.78:0/2438601449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2390a0 0x55557b2451f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00bfd0 tx=0x7fb2cc0e34d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf3f46200962aff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:15.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.522+0000 7fb2b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:16:15.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.522+0000 7fb2b8ff9640 1 -- 172.21.15.78:0/2438601449 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc01e030 con 0x55557b2390a0 2024-09-11T00:16:15.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.522+0000 7fb2b8ff9640 1 -- 172.21.15.78:0/2438601449 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fb2cc010c70 con 0x55557b2390a0 2024-09-11T00:16:15.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.522+0000 7fb2d98a9740 1 -- 172.21.15.78:0/2438601449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55557b1b1da0 con 0x55557b2390a0 2024-09-11T00:16:15.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.522+0000 7fb2b8ff9640 1 -- 172.21.15.78:0/2438601449 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb2cc0ab650 con 0x55557b2390a0 2024-09-11T00:16:15.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.522+0000 7fb2d98a9740 10 client.15348 fetch_fsmap learned FSMap version 20 2024-09-11T00:16:15.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.522+0000 7fb2d98a9740 1 -- 172.21.15.78:0/2438601449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55557b253ef0 con 0x55557b2390a0 2024-09-11T00:16:15.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.522+0000 7fb2b8ff9640 1 -- 172.21.15.78:0/2438601449 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55557b1b1da0 con 0x55557b2390a0 2024-09-11T00:16:15.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.522+0000 7fb2b8ff9640 1 -- 172.21.15.78:0/2438601449 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb2cc0abf60 con 0x55557b2390a0 2024-09-11T00:16:15.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.522+0000 7fb2d98a9740 10 client.15348 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:16:15.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.522+0000 7fb2d98a9740 10 client.15348 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:16:15.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.522+0000 7fb2d98a9740 20 client.15348 populate_metadata read hostname 'smithi078' 2024-09-11T00:16:15.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.522+0000 7fb2d98a9740 1 --2- 172.21.15.78:0/2438601449 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55557b255240 0x55557b257630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:15.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.522+0000 7fb2d98a9740 4 client.15348 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:16:15.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.522+0000 7fb2d98a9740 1 -- 172.21.15.78:0/2438601449 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55557b1ad850 con 0x55557b255240 2024-09-11T00:16:15.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.523+0000 7fb2d4a6f640 1 --2- 172.21.15.78:0/2438601449 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55557b255240 0x55557b257630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:15.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.523+0000 7fb2d4a6f640 1 --2- 172.21.15.78:0/2438601449 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55557b255240 0x55557b257630 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84662c9a0e5e05de server_cookie=451904c246abf38d in_seq=0 out_seq=0 2024-09-11T00:16:15.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.523+0000 7fb2b8ff9640 10 client.15348 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:15.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.524+0000 7fb2b8ff9640 1 -- 172.21.15.78:0/2438601449 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55557b1ad850 con 0x55557b255240 2024-09-11T00:16:15.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.524+0000 7fb2b8ff9640 10 client.15348 handle_command_reply: tid=0 2024-09-11T00:16:15.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.524+0000 7fb2d98a9740 1 client.15348 shutdown 2024-09-11T00:16:15.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.524+0000 7fb2d98a9740 1 -- 172.21.15.78:0/2438601449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2390a0 msgr2=0x55557b2451f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:15.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.524+0000 7fb2d98a9740 1 --2- 172.21.15.78:0/2438601449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2390a0 0x55557b2451f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00bfd0 tx=0x7fb2cc0e34d0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.524+0000 7fb2d98a9740 1 -- 172.21.15.78:0/2438601449 shutdown_connections 2024-09-11T00:16:15.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.524+0000 7fb2d98a9740 1 --2- 172.21.15.78:0/2438601449 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55557b255240 0x55557b257630 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.524+0000 7fb2d98a9740 1 --2- 172.21.15.78:0/2438601449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55557b245950 0x55557b242c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.524+0000 7fb2d98a9740 1 --2- 172.21.15.78:0/2438601449 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55557b2399c0 0x55557b242640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.524+0000 7fb2b8ff9640 0 client.15348 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:15.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.524+0000 7fb2d98a9740 1 --2- 172.21.15.78:0/2438601449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2390a0 0x55557b2451f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.524+0000 7fb2d98a9740 1 -- 172.21.15.78:0/2438601449 >> 172.21.15.78:0/2438601449 conn(0x55557b236ed0 msgr2=0x55557b23ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:15.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.524+0000 7fb2d98a9740 1 -- 172.21.15.78:0/2438601449 shutdown_connections 2024-09-11T00:16:15.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.524+0000 7fb2d98a9740 1 -- 172.21.15.78:0/2438601449 wait complete. 2024-09-11T00:16:15.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.524+0000 7fb2d98a9740 20 client.15348 trim_cache size 0 max 16384 2024-09-11T00:16:15.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.541+0000 7fb2d98a9740 1 Processor -- start 2024-09-11T00:16:15.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.541+0000 7fb2d98a9740 1 -- start start 2024-09-11T00:16:15.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.541+0000 7fb2d98a9740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55557b2390a0 0x55557b238680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:15.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.541+0000 7fb2d98a9740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2399c0 0x55557b246d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:15.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.541+0000 7fb2d98a9740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55557b245950 0x55557b247280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:15.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.541+0000 7fb2d98a9740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d01ac810 con 0x55557b2399c0 2024-09-11T00:16:15.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.541+0000 7fb2d98a9740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d01af090 con 0x55557b2390a0 2024-09-11T00:16:15.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.541+0000 7fb2d98a9740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d01ace80 con 0x55557b245950 2024-09-11T00:16:15.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.541+0000 7fb2d4a6f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2399c0 0x55557b246d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:15.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.541+0000 7fb2d4a6f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2399c0 0x55557b246d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60744/0 (socket says 172.21.15.78:60744) 2024-09-11T00:16:15.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.541+0000 7fb2d4a6f640 1 -- 172.21.15.78:0/2668978702 learned_addr learned my addr 172.21.15.78:0/2668978702 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:15.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.542+0000 7fb2d4a6f640 1 -- 172.21.15.78:0/2668978702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55557b245950 msgr2=0x55557b247280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:15.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.542+0000 7fb2d4a6f640 1 --2- 172.21.15.78:0/2668978702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55557b245950 0x55557b247280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.542+0000 7fb2d4a6f640 1 -- 172.21.15.78:0/2668978702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55557b2390a0 msgr2=0x55557b238680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:15.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.542+0000 7fb2d4a6f640 1 --2- 172.21.15.78:0/2668978702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55557b2390a0 0x55557b238680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.542+0000 7fb2d4a6f640 1 -- 172.21.15.78:0/2668978702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55557b237950 con 0x55557b2399c0 2024-09-11T00:16:15.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.542+0000 7fb2d4a6f640 1 --2- 172.21.15.78:0/2668978702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2399c0 0x55557b246d40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x55557b13a1d0 tx=0x7fb2c000f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329486359f9ce325 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:15.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.542+0000 7fb2baffd640 1 -- 172.21.15.78:0/2668978702 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0023440 con 0x55557b2399c0 2024-09-11T00:16:15.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.542+0000 7fb2baffd640 1 -- 172.21.15.78:0/2668978702 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2c001b860 con 0x55557b2399c0 2024-09-11T00:16:15.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.542+0000 7fb2baffd640 1 -- 172.21.15.78:0/2668978702 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c00117e0 con 0x55557b2399c0 2024-09-11T00:16:15.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.542+0000 7fb2d98a9740 1 -- 172.21.15.78:0/2668978702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2399c0 msgr2=0x55557b246d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:15.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.542+0000 7fb2d98a9740 1 --2- 172.21.15.78:0/2668978702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2399c0 0x55557b246d40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x55557b13a1d0 tx=0x7fb2c000f410 comp rx=0 tx=0).stop 2024-09-11T00:16:15.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.543+0000 7fb2d98a9740 1 -- 172.21.15.78:0/2668978702 shutdown_connections 2024-09-11T00:16:15.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.543+0000 7fb2d98a9740 1 --2- 172.21.15.78:0/2668978702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55557b245950 0x55557b247280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.543+0000 7fb2d98a9740 1 --2- 172.21.15.78:0/2668978702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2399c0 0x55557b246d40 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.543+0000 7fb2d98a9740 1 --2- 172.21.15.78:0/2668978702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55557b2390a0 0x55557b238680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.543+0000 7fb2d98a9740 1 -- 172.21.15.78:0/2668978702 >> 172.21.15.78:0/2668978702 conn(0x55557b236ed0 msgr2=0x55557b237f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:15.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.543+0000 7fb2d98a9740 1 -- 172.21.15.78:0/2668978702 shutdown_connections 2024-09-11T00:16:15.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.543+0000 7fb2d98a9740 1 -- 172.21.15.78:0/2668978702 wait complete. 2024-09-11T00:16:15.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.543+0000 7fb2d98a9740 1 -- start start 2024-09-11T00:16:15.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.543+0000 7fb2d98a9740 1 Processor -- start 2024-09-11T00:16:15.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.543+0000 7fb2d98a9740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2390a0 0x55557b257110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:15.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.543+0000 7fb2d98a9740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55557b2399c0 0x55557b257690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:15.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.543+0000 7fb2d98a9740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55557b245950 0x55557b2baec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:15.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.543+0000 7fb2d98a9740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d01ad550 con 0x55557b2390a0 2024-09-11T00:16:15.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.543+0000 7fb2d98a9740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d01ae9c0 con 0x55557b2399c0 2024-09-11T00:16:15.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.543+0000 7fb2d98a9740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d01adc20 con 0x55557b245950 2024-09-11T00:16:15.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.543+0000 7fb2d98a9740 10 client.0 _ll_register_callbacks cb 0x7fb2cc0eba70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:16:15.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.543+0000 7fb2d5270640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2390a0 0x55557b257110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:15.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.543+0000 7fb2d5270640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2390a0 0x55557b257110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60758/0 (socket says 172.21.15.78:60758) 2024-09-11T00:16:15.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.543+0000 7fb2d5270640 1 -- 172.21.15.78:0/101117677 learned_addr learned my addr 172.21.15.78:0/101117677 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:15.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.544+0000 7fb2d4a6f640 1 --2- 172.21.15.78:0/101117677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55557b2399c0 0x55557b257690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:15.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.544+0000 7fb2d5a71640 1 --2- 172.21.15.78:0/101117677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55557b245950 0x55557b2baec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:15.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.544+0000 7fb2d5270640 1 -- 172.21.15.78:0/101117677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55557b245950 msgr2=0x55557b2baec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:15.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.544+0000 7fb2d5270640 1 --2- 172.21.15.78:0/101117677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55557b245950 0x55557b2baec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.544+0000 7fb2d5270640 1 -- 172.21.15.78:0/101117677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55557b2399c0 msgr2=0x55557b257690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:15.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.544+0000 7fb2d5270640 1 --2- 172.21.15.78:0/101117677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55557b2399c0 0x55557b257690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.544+0000 7fb2d5270640 1 -- 172.21.15.78:0/101117677 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55557b2bb5d0 con 0x55557b2390a0 2024-09-11T00:16:15.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.544+0000 7fb2d5a71640 1 --2- 172.21.15.78:0/101117677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55557b245950 0x55557b2baec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:16:15.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.544+0000 7fb2d5270640 1 --2- 172.21.15.78:0/101117677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2390a0 0x55557b257110 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc0e3080 tx=0x7fb2cc0ebb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3790e24133a9a7bb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:15.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.544+0000 7fb2b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:16:15.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.544+0000 7fb2b8ff9640 1 -- 172.21.15.78:0/101117677 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc01e060 con 0x55557b2390a0 2024-09-11T00:16:15.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.544+0000 7fb2b8ff9640 1 -- 172.21.15.78:0/101117677 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fb2cc0abf60 con 0x55557b2390a0 2024-09-11T00:16:15.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.544+0000 7fb2d98a9740 1 -- 172.21.15.78:0/101117677 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2c001b860 con 0x55557b2390a0 2024-09-11T00:16:15.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.544+0000 7fb2b8ff9640 1 -- 172.21.15.78:0/101117677 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb2cc0abad0 con 0x55557b2390a0 2024-09-11T00:16:15.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.544+0000 7fb2d98a9740 10 client.15354 fetch_fsmap learned FSMap version 20 2024-09-11T00:16:15.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.544+0000 7fb2d98a9740 1 -- 172.21.15.78:0/101117677 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55557b2c2a70 con 0x55557b2390a0 2024-09-11T00:16:15.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.544+0000 7fb2b8ff9640 1 -- 172.21.15.78:0/101117677 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2c001b860 con 0x55557b2390a0 2024-09-11T00:16:15.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.545+0000 7fb2b8ff9640 1 -- 172.21.15.78:0/101117677 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb2cc0b4e00 con 0x55557b2390a0 2024-09-11T00:16:15.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.545+0000 7fb2d98a9740 10 client.15354 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:16:15.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.545+0000 7fb2d98a9740 10 client.15354 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:16:15.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.545+0000 7fb2d98a9740 20 client.15354 populate_metadata read hostname 'smithi078' 2024-09-11T00:16:15.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.545+0000 7fb2d98a9740 1 --2- 172.21.15.78:0/101117677 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55557b2c3020 0x55557b2c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:15.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.545+0000 7fb2d98a9740 4 client.15354 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:16:15.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.545+0000 7fb2d98a9740 1 -- 172.21.15.78:0/101117677 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55557b1aac80 con 0x55557b2c3020 2024-09-11T00:16:15.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.545+0000 7fb2d4a6f640 1 --2- 172.21.15.78:0/101117677 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55557b2c3020 0x55557b2c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:15.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.545+0000 7fb2b8ff9640 10 client.15354 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:15.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.545+0000 7fb2d4a6f640 1 --2- 172.21.15.78:0/101117677 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55557b2c3020 0x55557b2c5440 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4ad76555db469ad server_cookie=d770a8ad6ce4f821 in_seq=0 out_seq=0 2024-09-11T00:16:15.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.546+0000 7fb2b8ff9640 1 -- 172.21.15.78:0/101117677 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x55557b1aac80 con 0x55557b2c3020 2024-09-11T00:16:15.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.546+0000 7fb2b8ff9640 10 client.15354 handle_command_reply: tid=0 2024-09-11T00:16:15.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.546+0000 7fb2d98a9740 1 client.15354 shutdown 2024-09-11T00:16:15.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.546+0000 7fb2d98a9740 1 -- 172.21.15.78:0/101117677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2390a0 msgr2=0x55557b257110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:15.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.546+0000 7fb2d98a9740 1 --2- 172.21.15.78:0/101117677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2390a0 0x55557b257110 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc0e3080 tx=0x7fb2cc0ebb20 comp rx=0 tx=0).stop 2024-09-11T00:16:15.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.546+0000 7fb2d98a9740 1 -- 172.21.15.78:0/101117677 shutdown_connections 2024-09-11T00:16:15.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.546+0000 7fb2d98a9740 1 --2- 172.21.15.78:0/101117677 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55557b2c3020 0x55557b2c5440 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.546+0000 7fb2d98a9740 1 --2- 172.21.15.78:0/101117677 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55557b245950 0x55557b2baec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.546+0000 7fb2d98a9740 1 --2- 172.21.15.78:0/101117677 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55557b2399c0 0x55557b257690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.546+0000 7fb2d98a9740 1 --2- 172.21.15.78:0/101117677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55557b2390a0 0x55557b257110 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.546+0000 7fb2d98a9740 1 -- 172.21.15.78:0/101117677 >> 172.21.15.78:0/101117677 conn(0x55557b236ed0 msgr2=0x55557b235700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:15.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.546+0000 7fb2b8ff9640 0 client.15354 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:15.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.546+0000 7fb2d98a9740 1 -- 172.21.15.78:0/101117677 shutdown_connections 2024-09-11T00:16:15.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.546+0000 7fb2d98a9740 1 -- 172.21.15.78:0/101117677 wait complete. 2024-09-11T00:16:15.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.546+0000 7fb2d98a9740 20 client.15354 trim_cache size 0 max 16384 2024-09-11T00:16:15.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.546+0000 7fb2d74d4640 1 -- 172.21.15.78:0/874667877 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb2bc0b5440 msgr2=0x7fb2bc0b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:15.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.547+0000 7fb2d74d4640 1 --2- 172.21.15.78:0/874667877 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb2bc0b5440 0x7fb2bc0b7900 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8006010 tx=0x7fb2c802f400 comp rx=0 tx=0).stop 2024-09-11T00:16:15.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.547+0000 7fb2d74d4640 1 -- 172.21.15.78:0/874667877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2d0101c90 msgr2=0x7fb2d01993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:15.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.547+0000 7fb2d74d4640 1 --2- 172.21.15.78:0/874667877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2d0101c90 0x7fb2d01993e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00b4a0 tx=0x7fb2cc00b960 comp rx=0 tx=0).stop 2024-09-11T00:16:15.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.547+0000 7fb2d74d4640 1 -- 172.21.15.78:0/874667877 shutdown_connections 2024-09-11T00:16:15.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.547+0000 7fb2d74d4640 1 --2- 172.21.15.78:0/874667877 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb2bc0b5440 0x7fb2bc0b7900 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.547+0000 7fb2d74d4640 1 --2- 172.21.15.78:0/874667877 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2d0108020 0x7fb2d019ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.547+0000 7fb2d74d4640 1 --2- 172.21.15.78:0/874667877 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2d01076a0 0x7fb2d0199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.547+0000 7fb2d74d4640 1 --2- 172.21.15.78:0/874667877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2d0101c90 0x7fb2d01993e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:15.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.547+0000 7fb2d74d4640 1 -- 172.21.15.78:0/874667877 >> 172.21.15.78:0/874667877 conn(0x7fb2d00fd700 msgr2=0x7fb2d006adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:15.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.547+0000 7fb2d74d4640 1 -- 172.21.15.78:0/874667877 shutdown_connections 2024-09-11T00:16:15.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:15.547+0000 7fb2d74d4640 1 -- 172.21.15.78:0/874667877 wait complete. 2024-09-11T00:16:16.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:15 smithi138 ceph-mon[35019]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:16.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:15 smithi138 ceph-mon[35019]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:16.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:15 smithi138 ceph-mon[35019]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:16.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:15 smithi078 ceph-mon[30865]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:16.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:15 smithi078 ceph-mon[30865]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:16.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:15 smithi078 ceph-mon[30865]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:16.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:15 smithi112 ceph-mon[35627]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:16.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:15 smithi112 ceph-mon[35627]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:16.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:15 smithi112 ceph-mon[35627]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:16:16.337 INFO:tasks.cephfs.filesystem:scrub status for tag:550cfcf7-9c57-47a1-9ac1-d89a0970cd67 - {'path': '/', 'tag': '550cfcf7-9c57-47a1-9ac1-d89a0970cd67', 'options': 'recursive,force'} 2024-09-11T00:16:17.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:16 smithi138 ceph-mon[35019]: pgmap v317: 97 pgs: 97 active+clean; 1.0 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 63 KiB/s wr, 9 op/s 2024-09-11T00:16:17.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:16 smithi138 ceph-mon[35019]: scrub summary: idle 2024-09-11T00:16:17.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:16 smithi078 ceph-mon[30865]: pgmap v317: 97 pgs: 97 active+clean; 1.0 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 63 KiB/s wr, 9 op/s 2024-09-11T00:16:17.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:16 smithi078 ceph-mon[30865]: scrub summary: idle 2024-09-11T00:16:17.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:16 smithi112 ceph-mon[35627]: pgmap v317: 97 pgs: 97 active+clean; 1.0 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 63 KiB/s wr, 9 op/s 2024-09-11T00:16:17.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:16 smithi112 ceph-mon[35627]: scrub summary: idle 2024-09-11T00:16:18.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:17 smithi112 ceph-mon[35627]: pgmap v318: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 164 KiB/s wr, 47 op/s 2024-09-11T00:16:18.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:17 smithi138 ceph-mon[35019]: pgmap v318: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 164 KiB/s wr, 47 op/s 2024-09-11T00:16:18.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:17 smithi078 ceph-mon[30865]: pgmap v318: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 164 KiB/s wr, 47 op/s 2024-09-11T00:16:21.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:20 smithi138 ceph-mon[35019]: pgmap v319: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 175 KiB/s wr, 49 op/s 2024-09-11T00:16:21.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:20 smithi078 ceph-mon[30865]: pgmap v319: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 175 KiB/s wr, 49 op/s 2024-09-11T00:16:21.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:20 smithi112 ceph-mon[35627]: pgmap v319: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 175 KiB/s wr, 49 op/s 2024-09-11T00:16:23.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:22 smithi138 ceph-mon[35019]: pgmap v320: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 50 op/s 2024-09-11T00:16:23.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:22 smithi078 ceph-mon[30865]: pgmap v320: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 50 op/s 2024-09-11T00:16:23.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:22 smithi112 ceph-mon[35627]: pgmap v320: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 50 op/s 2024-09-11T00:16:25.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:24 smithi138 ceph-mon[35019]: pgmap v321: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 175 KiB/s wr, 48 op/s 2024-09-11T00:16:25.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:24 smithi078 ceph-mon[30865]: pgmap v321: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 175 KiB/s wr, 48 op/s 2024-09-11T00:16:25.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:24 smithi112 ceph-mon[35627]: pgmap v321: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 175 KiB/s wr, 48 op/s 2024-09-11T00:16:27.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:26 smithi138 ceph-mon[35019]: pgmap v322: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 49 op/s 2024-09-11T00:16:27.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:26 smithi078 ceph-mon[30865]: pgmap v322: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 49 op/s 2024-09-11T00:16:27.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:26 smithi112 ceph-mon[35627]: pgmap v322: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 49 op/s 2024-09-11T00:16:29.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:28 smithi138 ceph-mon[35019]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 113 KiB/s wr, 41 op/s 2024-09-11T00:16:29.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:28 smithi078 ceph-mon[30865]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 113 KiB/s wr, 41 op/s 2024-09-11T00:16:29.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:28 smithi112 ceph-mon[35627]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 113 KiB/s wr, 41 op/s 2024-09-11T00:16:31.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:30 smithi138 ceph-mon[35019]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 11 KiB/s wr, 3 op/s 2024-09-11T00:16:31.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:30 smithi078 ceph-mon[30865]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 11 KiB/s wr, 3 op/s 2024-09-11T00:16:31.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:30 smithi112 ceph-mon[35627]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 11 KiB/s wr, 3 op/s 2024-09-11T00:16:32.033 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:31 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:16:32.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:31 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:16:32.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:31 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:16:33.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:32 smithi138 ceph-mon[35019]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-11T00:16:33.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:32 smithi078 ceph-mon[30865]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-11T00:16:33.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:32 smithi112 ceph-mon[35627]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-11T00:16:34.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:33 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:16:34.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:33 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:16:34.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:33 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:16:34.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:33 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:16:34.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:33 smithi078 ceph-mon[30865]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:16:34.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:33 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:16:34.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:33 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:16:34.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:33 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:16:34.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:33 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:16:34.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:33 smithi112 ceph-mon[35627]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:16:34.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:33 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:16:34.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:33 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:16:34.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:33 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:16:34.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:33 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:16:34.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:33 smithi138 ceph-mon[35019]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:16:37.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:36 smithi138 ceph-mon[35019]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:16:37.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:16:37.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:16:37.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:16:37.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:16:37.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:16:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:36 smithi078 ceph-mon[30865]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:16:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:16:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:16:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:16:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:16:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:16:37.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:36 smithi112 ceph-mon[35627]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:16:37.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:16:37.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:16:37.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:16:37.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:16:37.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:16:39.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:38 smithi138 ceph-mon[35019]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:16:39.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:38 smithi078 ceph-mon[30865]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:16:39.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:38 smithi112 ceph-mon[35627]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:16:41.034 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:40 smithi112 ceph-mon[35627]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:16:41.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:40 smithi138 ceph-mon[35019]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:16:41.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:40 smithi078 ceph-mon[30865]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:16:43.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:42 smithi138 ceph-mon[35019]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:16:43.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:42 smithi078 ceph-mon[30865]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:16:43.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:42 smithi112 ceph-mon[35627]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:16:45.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:44 smithi138 ceph-mon[35019]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:16:45.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:44 smithi078 ceph-mon[30865]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:16:45.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:44 smithi112 ceph-mon[35627]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:16:46.338 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:16:46.627 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:16:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:46 smithi138 ceph-mon[35019]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:16:47.059 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:46 smithi078 ceph-mon[30865]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:16:47.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.188+0000 7ff2c69a7640 1 -- 172.21.15.78:0/3100699698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2c0108780 msgr2=0x7ff2c0108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:47.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.188+0000 7ff2c69a7640 1 --2- 172.21.15.78:0/3100699698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2c0108780 0x7ff2c0108be0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009900 tx=0x7ff2b402a410 comp rx=0 tx=0).stop 2024-09-11T00:16:47.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.188+0000 7ff2c69a7640 1 -- 172.21.15.78:0/3100699698 shutdown_connections 2024-09-11T00:16:47.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.188+0000 7ff2c69a7640 1 --2- 172.21.15.78:0/3100699698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2c0109120 0x7ff2c010f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.188+0000 7ff2c69a7640 1 --2- 172.21.15.78:0/3100699698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2c0108780 0x7ff2c0108be0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.188+0000 7ff2c69a7640 1 --2- 172.21.15.78:0/3100699698 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2c0101330 0x7ff2c0101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.188+0000 7ff2c69a7640 1 -- 172.21.15.78:0/3100699698 >> 172.21.15.78:0/3100699698 conn(0x7ff2c0078140 msgr2=0x7ff2c00ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:47.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.189+0000 7ff2c69a7640 1 -- 172.21.15.78:0/3100699698 shutdown_connections 2024-09-11T00:16:47.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.189+0000 7ff2c69a7640 1 -- 172.21.15.78:0/3100699698 wait complete. 2024-09-11T00:16:47.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.190+0000 7ff2c69a7640 1 Processor -- start 2024-09-11T00:16:47.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.190+0000 7ff2c69a7640 1 -- start start 2024-09-11T00:16:47.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.190+0000 7ff2c69a7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2c0101330 0x7ff2c01022a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:47.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.190+0000 7ff2c69a7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2c0109120 0x7ff2c01027e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:47.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.190+0000 7ff2c69a7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2c0102d20 0x7ff2c01a76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:47.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.190+0000 7ff2c69a7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c0112e30 con 0x7ff2c0102d20 2024-09-11T00:16:47.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.190+0000 7ff2c69a7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c0112cb0 con 0x7ff2c0109120 2024-09-11T00:16:47.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.190+0000 7ff2c69a7640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c0112fb0 con 0x7ff2c0101330 2024-09-11T00:16:47.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.190+0000 7ff2c4f44640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2c0102d20 0x7ff2c01a76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:47.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.190+0000 7ff2c4f44640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2c0102d20 0x7ff2c01a76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38758/0 (socket says 172.21.15.78:38758) 2024-09-11T00:16:47.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.190+0000 7ff2c4f44640 1 -- 172.21.15.78:0/1555309977 learned_addr learned my addr 172.21.15.78:0/1555309977 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:47.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.191+0000 7ff2bffff640 1 --2- 172.21.15.78:0/1555309977 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2c0101330 0x7ff2c01022a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:47.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.191+0000 7ff2bf7fe640 1 --2- 172.21.15.78:0/1555309977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2c0109120 0x7ff2c01027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:47.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.191+0000 7ff2c4f44640 1 -- 172.21.15.78:0/1555309977 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2c0101330 msgr2=0x7ff2c01022a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:47.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.191+0000 7ff2c4f44640 1 --2- 172.21.15.78:0/1555309977 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2c0101330 0x7ff2c01022a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.191+0000 7ff2c4f44640 1 -- 172.21.15.78:0/1555309977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2c0109120 msgr2=0x7ff2c01027e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:47.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.191+0000 7ff2c4f44640 1 --2- 172.21.15.78:0/1555309977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2c0109120 0x7ff2c01027e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.191+0000 7ff2c4f44640 1 -- 172.21.15.78:0/1555309977 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c01a7d30 con 0x7ff2c0102d20 2024-09-11T00:16:47.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.191+0000 7ff2c4f44640 1 --2- 172.21.15.78:0/1555309977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2c0102d20 0x7ff2c01a76c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800da40 tx=0x7ff2b800df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:47.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.191+0000 7ff2bd7fa640 1 -- 172.21.15.78:0/1555309977 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8017070 con 0x7ff2c0102d20 2024-09-11T00:16:47.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.192+0000 7ff2bd7fa640 1 -- 172.21.15.78:0/1555309977 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b8003e20 con 0x7ff2c0102d20 2024-09-11T00:16:47.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.192+0000 7ff2c69a7640 1 -- 172.21.15.78:0/1555309977 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c01a7fc0 con 0x7ff2c0102d20 2024-09-11T00:16:47.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.192+0000 7ff2bd7fa640 1 -- 172.21.15.78:0/1555309977 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8017070 con 0x7ff2c0102d20 2024-09-11T00:16:47.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.192+0000 7ff2c69a7640 1 -- 172.21.15.78:0/1555309977 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c01a8480 con 0x7ff2c0102d20 2024-09-11T00:16:47.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.195+0000 7ff2c8d7c740 1 Processor -- start 2024-09-11T00:16:47.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.195+0000 7ff2bd7fa640 1 -- 172.21.15.78:0/1555309977 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 23) ==== 153324+0+0 (secure 0 0 0) 0x7ff2b8023060 con 0x7ff2c0102d20 2024-09-11T00:16:47.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.196+0000 7ff2c8d7c740 1 -- start start 2024-09-11T00:16:47.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.196+0000 7ff2c8d7c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3e480 0x56521da3e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:47.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.196+0000 7ff2c8d7c740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56521da3eda0 0x56521da53000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:47.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.196+0000 7ff2c8d7c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56521da53540 0x56521da55930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:47.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.196+0000 7ff2c8d7c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56521d9b4e50 con 0x56521da3e480 2024-09-11T00:16:47.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.196+0000 7ff2c8d7c740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56521d9a4280 con 0x56521da3eda0 2024-09-11T00:16:47.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.196+0000 7ff2c8d7c740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56521d9a8090 con 0x56521da53540 2024-09-11T00:16:47.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.196+0000 7ff2bf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3e480 0x56521da3e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:47.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.196+0000 7ff2bf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3e480 0x56521da3e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38768/0 (socket says 172.21.15.78:38768) 2024-09-11T00:16:47.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.196+0000 7ff2bf7fe640 1 -- 172.21.15.78:0/1645523505 learned_addr learned my addr 172.21.15.78:0/1645523505 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:47.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.196+0000 7ff2bffff640 1 --2- 172.21.15.78:0/1645523505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56521da3eda0 0x56521da53000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:47.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.197+0000 7ff2bf7fe640 1 --2- 172.21.15.78:0/1645523505 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56521da53540 0x56521da55930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:47.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.197+0000 7ff2bffff640 1 -- 172.21.15.78:0/1645523505 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56521da53540 msgr2=0x56521da55930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:47.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.197+0000 7ff2bd7fa640 1 --2- 172.21.15.78:0/1555309977 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff2a80b55f0 0x7ff2a80b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:47.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.197+0000 7ff2bd7fa640 1 -- 172.21.15.78:0/1555309977 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7ff2b80e51b0 con 0x7ff2c0102d20 2024-09-11T00:16:47.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.197+0000 7ff2bffff640 1 --2- 172.21.15.78:0/1645523505 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56521da53540 0x56521da55930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.197+0000 7ff2bffff640 1 -- 172.21.15.78:0/1645523505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3e480 msgr2=0x56521da3e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:47.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.197+0000 7ff2bffff640 1 --2- 172.21.15.78:0/1645523505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3e480 0x56521da3e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.198+0000 7ff2bffff640 1 -- 172.21.15.78:0/1645523505 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56521d702650 con 0x56521da3eda0 2024-09-11T00:16:47.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.198+0000 7ff2c4f44640 1 --2- 172.21.15.78:0/1555309977 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff2a80b55f0 0x7ff2a80b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:47.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.198+0000 7ff2bffff640 1 --2- 172.21.15.78:0/1645523505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56521da3eda0 0x56521da53000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0009b70 tx=0x7ff2b00117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68fb313d62d06835 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:47.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.198+0000 7ff2a67fc640 1 -- 172.21.15.78:0/1645523505 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0009e60 con 0x56521da3eda0 2024-09-11T00:16:47.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.198+0000 7ff2a67fc640 1 -- 172.21.15.78:0/1645523505 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b0012900 con 0x56521da3eda0 2024-09-11T00:16:47.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.198+0000 7ff2a67fc640 1 -- 172.21.15.78:0/1645523505 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b000fb20 con 0x56521da3eda0 2024-09-11T00:16:47.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.199+0000 7ff2bf7fe640 1 --2- 172.21.15.78:0/1645523505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3e480 0x56521da3e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:16:47.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.199+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/1645523505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56521da3eda0 msgr2=0x56521da53000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:47.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.199+0000 7ff2c4f44640 1 --2- 172.21.15.78:0/1555309977 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff2a80b55f0 0x7ff2a80b7ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80099b0 tx=0x7ff2b8004a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:47.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.199+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/1645523505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56521da3eda0 0x56521da53000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0009b70 tx=0x7ff2b00117b0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.199+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/1645523505 shutdown_connections 2024-09-11T00:16:47.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.199+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/1645523505 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56521da53540 0x56521da55930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.199+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/1645523505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56521da3eda0 0x56521da53000 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.199+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/1645523505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3e480 0x56521da3e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.199+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/1645523505 >> 172.21.15.78:0/1645523505 conn(0x56521da3c2b0 msgr2=0x56521da3d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:47.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.199+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/1645523505 shutdown_connections 2024-09-11T00:16:47.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.199+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/1645523505 wait complete. 2024-09-11T00:16:47.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.200+0000 7ff2c8d7c740 1 -- start start 2024-09-11T00:16:47.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.200+0000 7ff2c8d7c740 1 Processor -- start 2024-09-11T00:16:47.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.201+0000 7ff2c8d7c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3e480 0x56521da52d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:47.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.201+0000 7ff2c8d7c740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56521da3eda0 0x56521da50150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:47.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.201+0000 7ff2c8d7c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56521da53540 0x56521da50690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:47.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.201+0000 7ff2c8d7c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56521d805700 con 0x56521da3e480 2024-09-11T00:16:47.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.201+0000 7ff2c8d7c740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56521d93f110 con 0x56521da3eda0 2024-09-11T00:16:47.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.201+0000 7ff2c8d7c740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56521da561c0 con 0x56521da53540 2024-09-11T00:16:47.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.201+0000 7ff2c8d7c740 10 client.0 _ll_register_callbacks cb 0x56521d958990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:16:47.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.201+0000 7ff2bf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3e480 0x56521da52d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:47.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.201+0000 7ff2bf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3e480 0x56521da52d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38782/0 (socket says 172.21.15.78:38782) 2024-09-11T00:16:47.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.201+0000 7ff2bf7fe640 1 -- 172.21.15.78:0/3524865574 learned_addr learned my addr 172.21.15.78:0/3524865574 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:47.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.201+0000 7ff2bffff640 1 --2- 172.21.15.78:0/3524865574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56521da3eda0 0x56521da50150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:47.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.201+0000 7ff2bf7fe640 1 --2- 172.21.15.78:0/3524865574 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56521da53540 0x56521da50690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:47.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.201+0000 7ff2bf7fe640 1 -- 172.21.15.78:0/3524865574 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56521da53540 msgr2=0x56521da50690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:47.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.201+0000 7ff2bf7fe640 1 --2- 172.21.15.78:0/3524865574 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56521da53540 0x56521da50690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.201+0000 7ff2bf7fe640 1 -- 172.21.15.78:0/3524865574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56521da3eda0 msgr2=0x56521da50150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:47.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.201+0000 7ff2bf7fe640 1 --2- 172.21.15.78:0/3524865574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56521da3eda0 0x56521da50150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.201+0000 7ff2bf7fe640 1 -- 172.21.15.78:0/3524865574 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56521d96cc40 con 0x56521da3e480 2024-09-11T00:16:47.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.202+0000 7ff2bf7fe640 1 --2- 172.21.15.78:0/3524865574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3e480 0x56521da52d00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009900 tx=0x7ff2b4005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3341272aa7e0c9a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:47.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.202+0000 7ff29f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:16:47.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.202+0000 7ff29f7fe640 1 -- 172.21.15.78:0/3524865574 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4035040 con 0x56521da3e480 2024-09-11T00:16:47.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.202+0000 7ff29f7fe640 1 -- 172.21.15.78:0/3524865574 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7ff2b4004950 con 0x56521da3e480 2024-09-11T00:16:47.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.202+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/3524865574 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2b0012900 con 0x56521da3e480 2024-09-11T00:16:47.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.202+0000 7ff29f7fe640 1 -- 172.21.15.78:0/3524865574 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff2b4050050 con 0x56521da3e480 2024-09-11T00:16:47.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.202+0000 7ff2c8d7c740 10 client.15366 fetch_fsmap learned FSMap version 20 2024-09-11T00:16:47.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.202+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/3524865574 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56521da61a10 con 0x56521da3e480 2024-09-11T00:16:47.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.203+0000 7ff29f7fe640 1 -- 172.21.15.78:0/3524865574 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b0012900 con 0x56521da3e480 2024-09-11T00:16:47.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.203+0000 7ff29f7fe640 1 -- 172.21.15.78:0/3524865574 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff2b403d480 con 0x56521da3e480 2024-09-11T00:16:47.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.203+0000 7ff2c8d7c740 10 client.15366 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:16:47.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.203+0000 7ff2c8d7c740 10 client.15366 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:16:47.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.203+0000 7ff2c8d7c740 20 client.15366 populate_metadata read hostname 'smithi078' 2024-09-11T00:16:47.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.203+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/3524865574 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56521da62ee0 0x56521da65340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:47.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.203+0000 7ff2c8d7c740 4 client.15366 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:16:47.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.203+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/3524865574 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56521d9b6da0 con 0x56521da62ee0 2024-09-11T00:16:47.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.203+0000 7ff2bffff640 1 --2- 172.21.15.78:0/3524865574 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56521da62ee0 0x56521da65340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:47.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.204+0000 7ff2bffff640 1 --2- 172.21.15.78:0/3524865574 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56521da62ee0 0x56521da65340 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=937abc2aefc6c840 server_cookie=ba3a11ce0be85bc2 in_seq=0 out_seq=0 2024-09-11T00:16:47.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.204+0000 7ff29f7fe640 10 client.15366 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:47.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.205+0000 7ff29f7fe640 1 -- 172.21.15.78:0/3524865574 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56521d9b6da0 con 0x56521da62ee0 2024-09-11T00:16:47.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.205+0000 7ff29f7fe640 10 client.15366 handle_command_reply: tid=0 2024-09-11T00:16:47.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.205+0000 7ff2c8d7c740 1 client.15366 shutdown 2024-09-11T00:16:47.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.205+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/3524865574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3e480 msgr2=0x56521da52d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:47.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.205+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/3524865574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3e480 0x56521da52d00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009900 tx=0x7ff2b4005b50 comp rx=0 tx=0).stop 2024-09-11T00:16:47.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.205+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/3524865574 shutdown_connections 2024-09-11T00:16:47.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.205+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/3524865574 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56521da62ee0 0x56521da65340 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.205+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/3524865574 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56521da53540 0x56521da50690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.205+0000 7ff29f7fe640 0 client.15366 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:47.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.205+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/3524865574 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56521da3eda0 0x56521da50150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.205+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/3524865574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3e480 0x56521da52d00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.205+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/3524865574 >> 172.21.15.78:0/3524865574 conn(0x56521da3c2b0 msgr2=0x56521da41e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:47.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.205+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/3524865574 shutdown_connections 2024-09-11T00:16:47.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.205+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/3524865574 wait complete. 2024-09-11T00:16:47.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.205+0000 7ff2c8d7c740 20 client.15366 trim_cache size 0 max 16384 2024-09-11T00:16:47.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:46 smithi112 ceph-mon[35627]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:16:47.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.239+0000 7ff2c8d7c740 1 Processor -- start 2024-09-11T00:16:47.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.239+0000 7ff2c8d7c740 1 -- start start 2024-09-11T00:16:47.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.240+0000 7ff2c8d7c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56521da3e480 0x56521da55950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:47.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.240+0000 7ff2c8d7c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3eda0 0x56521da372d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:47.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.240+0000 7ff2bffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3eda0 0x56521da372d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:47.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.240+0000 7ff2bffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3eda0 0x56521da372d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38786/0 (socket says 172.21.15.78:38786) 2024-09-11T00:16:47.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.240+0000 7ff2bffff640 1 -- 172.21.15.78:0/3059717937 learned_addr learned my addr 172.21.15.78:0/3059717937 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:47.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.240+0000 7ff2bf7fe640 1 --2- 172.21.15.78:0/3059717937 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56521da3e480 0x56521da55950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:47.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.240+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/3059717937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56521da53540 0x56521da6ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:47.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.240+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/3059717937 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c01aaa20 con 0x56521da3eda0 2024-09-11T00:16:47.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.240+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/3059717937 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c01ad2a0 con 0x56521da53540 2024-09-11T00:16:47.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.240+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/3059717937 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c01ab090 con 0x56521da3e480 2024-09-11T00:16:47.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.240+0000 7ff2bf7fe640 1 -- 172.21.15.78:0/3059717937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56521da53540 msgr2=0x56521da6ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:47.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.240+0000 7ff2bf7fe640 1 --2- 172.21.15.78:0/3059717937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56521da53540 0x56521da6ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.240+0000 7ff2bf7fe640 1 -- 172.21.15.78:0/3059717937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3eda0 msgr2=0x56521da372d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:47.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.240+0000 7ff2bf7fe640 1 --2- 172.21.15.78:0/3059717937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3eda0 0x56521da372d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.240+0000 7ff2bf7fe640 1 -- 172.21.15.78:0/3059717937 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56521da3ebd0 con 0x56521da3e480 2024-09-11T00:16:47.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.241+0000 7ff2bf7fe640 1 --2- 172.21.15.78:0/3059717937 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56521da3e480 0x56521da55950 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff2b403d9e0 tx=0x7ff2b402a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e7fa434e1ed59ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:47.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.241+0000 7ff2a5ffb640 1 -- 172.21.15.78:0/3059717937 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4059070 con 0x56521da3e480 2024-09-11T00:16:47.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.241+0000 7ff2a5ffb640 1 -- 172.21.15.78:0/3059717937 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b4009520 con 0x56521da3e480 2024-09-11T00:16:47.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.241+0000 7ff2a5ffb640 1 -- 172.21.15.78:0/3059717937 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4035040 con 0x56521da3e480 2024-09-11T00:16:47.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.242+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/3059717937 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56521da3e480 msgr2=0x56521da55950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:47.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.242+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/3059717937 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56521da3e480 0x56521da55950 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff2b403d9e0 tx=0x7ff2b402a410 comp rx=0 tx=0).stop 2024-09-11T00:16:47.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.242+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/3059717937 shutdown_connections 2024-09-11T00:16:47.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.242+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/3059717937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56521da53540 0x56521da6ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.242+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/3059717937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3eda0 0x56521da372d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.242+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/3059717937 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56521da3e480 0x56521da55950 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.242+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/3059717937 >> 172.21.15.78:0/3059717937 conn(0x56521da3c2b0 msgr2=0x56521da55240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:47.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.242+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/3059717937 shutdown_connections 2024-09-11T00:16:47.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.242+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/3059717937 wait complete. 2024-09-11T00:16:47.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.243+0000 7ff2c8d7c740 1 -- start start 2024-09-11T00:16:47.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.243+0000 7ff2c8d7c740 1 Processor -- start 2024-09-11T00:16:47.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.243+0000 7ff2c8d7c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3e480 0x56521da5b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:47.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.244+0000 7ff2bf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3e480 0x56521da5b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:47.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.244+0000 7ff2bf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3e480 0x56521da5b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38788/0 (socket says 172.21.15.78:38788) 2024-09-11T00:16:47.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.244+0000 7ff2bf7fe640 1 -- 172.21.15.78:0/1267844473 learned_addr learned my addr 172.21.15.78:0/1267844473 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:47.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.244+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/1267844473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56521da3eda0 0x56521da5bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:47.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.244+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/1267844473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56521da53540 0x56521da58460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:47.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.244+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/1267844473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c01ab760 con 0x56521da3e480 2024-09-11T00:16:47.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.244+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/1267844473 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c01acbd0 con 0x56521da53540 2024-09-11T00:16:47.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.244+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/1267844473 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c01abe30 con 0x56521da3eda0 2024-09-11T00:16:47.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.244+0000 7ff2bffff640 1 --2- 172.21.15.78:0/1267844473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56521da3eda0 0x56521da5bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:47.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.244+0000 7ff2c8d7c740 10 client.0 _ll_register_callbacks cb 0x7ff2b4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:16:47.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.244+0000 7ff2bf7fe640 1 -- 172.21.15.78:0/1267844473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56521da3eda0 msgr2=0x56521da5bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:47.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.244+0000 7ff2bf7fe640 1 --2- 172.21.15.78:0/1267844473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56521da3eda0 0x56521da5bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.244+0000 7ff2bf7fe640 1 -- 172.21.15.78:0/1267844473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56521da53540 msgr2=0x56521da58460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:47.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.244+0000 7ff2bf7fe640 1 --2- 172.21.15.78:0/1267844473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56521da53540 0x56521da58460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.244+0000 7ff2bf7fe640 1 -- 172.21.15.78:0/1267844473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56521da58c40 con 0x56521da3e480 2024-09-11T00:16:47.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.245+0000 7ff2bf7fe640 1 --2- 172.21.15.78:0/1267844473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3e480 0x56521da5b690 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4005ec0 tx=0x7ff2b4005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94818ae5b7883c5c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:47.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.245+0000 7ff29f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:16:47.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.245+0000 7ff29f7fe640 1 -- 172.21.15.78:0/1267844473 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4059030 con 0x56521da3e480 2024-09-11T00:16:47.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.245+0000 7ff29f7fe640 1 -- 172.21.15.78:0/1267844473 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7ff2b40055c0 con 0x56521da3e480 2024-09-11T00:16:47.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.245+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/1267844473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2b4009520 con 0x56521da3e480 2024-09-11T00:16:47.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.245+0000 7ff29f7fe640 1 -- 172.21.15.78:0/1267844473 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff2b4004950 con 0x56521da3e480 2024-09-11T00:16:47.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.245+0000 7ff2c8d7c740 10 client.15372 fetch_fsmap learned FSMap version 20 2024-09-11T00:16:47.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.245+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/1267844473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56521dad08f0 con 0x56521da3e480 2024-09-11T00:16:47.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.246+0000 7ff29f7fe640 1 -- 172.21.15.78:0/1267844473 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b4009520 con 0x56521da3e480 2024-09-11T00:16:47.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.246+0000 7ff29f7fe640 1 -- 172.21.15.78:0/1267844473 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff2b4065020 con 0x56521da3e480 2024-09-11T00:16:47.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.246+0000 7ff2c8d7c740 10 client.15372 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:16:47.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.246+0000 7ff2c8d7c740 10 client.15372 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:16:47.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.246+0000 7ff2c8d7c740 20 client.15372 populate_metadata read hostname 'smithi078' 2024-09-11T00:16:47.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.246+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/1267844473 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56521da62ee0 0x56521dad2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:47.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.246+0000 7ff2c8d7c740 4 client.15372 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:16:47.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.246+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/1267844473 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56521d9b2850 con 0x56521da62ee0 2024-09-11T00:16:47.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.247+0000 7ff2bffff640 1 --2- 172.21.15.78:0/1267844473 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56521da62ee0 0x56521dad2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:47.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.247+0000 7ff2bffff640 1 --2- 172.21.15.78:0/1267844473 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56521da62ee0 0x56521dad2e10 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0cb8ec9a4ec1b77 server_cookie=6906fadc6e650d37 in_seq=0 out_seq=0 2024-09-11T00:16:47.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.247+0000 7ff29f7fe640 10 client.15372 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:47.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.247+0000 7ff29f7fe640 1 -- 172.21.15.78:0/1267844473 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x56521d9b2850 con 0x56521da62ee0 2024-09-11T00:16:47.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.247+0000 7ff29f7fe640 10 client.15372 handle_command_reply: tid=0 2024-09-11T00:16:47.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.247+0000 7ff2c8d7c740 1 client.15372 shutdown 2024-09-11T00:16:47.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.247+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/1267844473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3e480 msgr2=0x56521da5b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:47.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.247+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/1267844473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3e480 0x56521da5b690 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4005ec0 tx=0x7ff2b4005be0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.248+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/1267844473 shutdown_connections 2024-09-11T00:16:47.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.248+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/1267844473 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56521da62ee0 0x56521dad2e10 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.248+0000 7ff29f7fe640 0 client.15372 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:47.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.248+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/1267844473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56521da53540 0x56521da58460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.248+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/1267844473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56521da3eda0 0x56521da5bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.248+0000 7ff2c8d7c740 1 --2- 172.21.15.78:0/1267844473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56521da3e480 0x56521da5b690 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.248+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/1267844473 >> 172.21.15.78:0/1267844473 conn(0x56521da3c2b0 msgr2=0x56521da51780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:47.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.248+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/1267844473 shutdown_connections 2024-09-11T00:16:47.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.248+0000 7ff2c8d7c740 1 -- 172.21.15.78:0/1267844473 wait complete. 2024-09-11T00:16:47.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.248+0000 7ff2c8d7c740 20 client.15372 trim_cache size 0 max 16384 2024-09-11T00:16:47.253 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:16:47.253 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-11T00:16:47.253 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {}, 2024-09-11T00:16:47.253 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:16:47.253 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:16:47.254 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:16:47.254 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:16:47.254 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:16:47.254 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:16:47.254 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:16:47.254 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:16:47.254 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:16:47.254 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:16:47.254 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:16:47.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.249+0000 7ff2c69a7640 1 -- 172.21.15.78:0/1555309977 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff2a80b55f0 msgr2=0x7ff2a80b7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:47.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.249+0000 7ff2c69a7640 1 --2- 172.21.15.78:0/1555309977 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff2a80b55f0 0x7ff2a80b7ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80099b0 tx=0x7ff2b8004a40 comp rx=0 tx=0).stop 2024-09-11T00:16:47.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.249+0000 7ff2c69a7640 1 -- 172.21.15.78:0/1555309977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2c0102d20 msgr2=0x7ff2c01a76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:47.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.249+0000 7ff2c69a7640 1 --2- 172.21.15.78:0/1555309977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2c0102d20 0x7ff2c01a76c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800da40 tx=0x7ff2b800df00 comp rx=0 tx=0).stop 2024-09-11T00:16:47.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.249+0000 7ff2c69a7640 1 -- 172.21.15.78:0/1555309977 shutdown_connections 2024-09-11T00:16:47.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.249+0000 7ff2c69a7640 1 --2- 172.21.15.78:0/1555309977 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff2a80b55f0 0x7ff2a80b7ab0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.249+0000 7ff2c69a7640 1 --2- 172.21.15.78:0/1555309977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2c0102d20 0x7ff2c01a76c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.249+0000 7ff2c69a7640 1 --2- 172.21.15.78:0/1555309977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2c0109120 0x7ff2c01027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.249+0000 7ff2c69a7640 1 --2- 172.21.15.78:0/1555309977 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2c0101330 0x7ff2c01022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:47.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.249+0000 7ff2c69a7640 1 -- 172.21.15.78:0/1555309977 >> 172.21.15.78:0/1555309977 conn(0x7ff2c0078140 msgr2=0x7ff2c00ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:47.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.249+0000 7ff2c69a7640 1 -- 172.21.15.78:0/1555309977 shutdown_connections 2024-09-11T00:16:47.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:47.249+0000 7ff2c69a7640 1 -- 172.21.15.78:0/1555309977 wait complete. 2024-09-11T00:16:48.221 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:16:48.222 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:16:48.510 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:16:48.897 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:48 smithi078 ceph-mon[30865]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:16:49.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:48 smithi138 ceph-mon[35019]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:16:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.065+0000 7f91181ac640 1 -- 172.21.15.78:0/780551038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9110103ca0 msgr2=0x7f9110104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.065+0000 7f91181ac640 1 --2- 172.21.15.78:0/780551038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9110103ca0 0x7f9110104080 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f910c009900 tx=0x7f910c02a410 comp rx=0 tx=0).stop 2024-09-11T00:16:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.065+0000 7f91181ac640 1 -- 172.21.15.78:0/780551038 shutdown_connections 2024-09-11T00:16:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.065+0000 7f91181ac640 1 --2- 172.21.15.78:0/780551038 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f911010d100 0x7f911010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.065+0000 7f91181ac640 1 --2- 172.21.15.78:0/780551038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91101045c0 0x7f911010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.065+0000 7f91181ac640 1 --2- 172.21.15.78:0/780551038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9110103ca0 0x7f9110104080 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.065+0000 7f91181ac640 1 -- 172.21.15.78:0/780551038 >> 172.21.15.78:0/780551038 conn(0x7f91100fd700 msgr2=0x7f91100ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:49.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.065+0000 7f91181ac640 1 -- 172.21.15.78:0/780551038 shutdown_connections 2024-09-11T00:16:49.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.065+0000 7f91181ac640 1 -- 172.21.15.78:0/780551038 wait complete. 2024-09-11T00:16:49.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.065+0000 7f91181ac640 1 Processor -- start 2024-09-11T00:16:49.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.066+0000 7f91181ac640 1 -- start start 2024-09-11T00:16:49.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.066+0000 7f91181ac640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9110103ca0 0x7f9110101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:49.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.066+0000 7f91181ac640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91101045c0 0x7f9110101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:49.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.066+0000 7f91181ac640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f911010d100 0x7f91101023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:49.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.066+0000 7f91181ac640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9110112d70 con 0x7f9110103ca0 2024-09-11T00:16:49.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.066+0000 7f91181ac640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9110112bf0 con 0x7f911010d100 2024-09-11T00:16:49.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.066+0000 7f91181ac640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9110112ef0 con 0x7f91101045c0 2024-09-11T00:16:49.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.066+0000 7f9115f48640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9110103ca0 0x7f9110101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:49.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.066+0000 7f9115f48640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9110103ca0 0x7f9110101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38798/0 (socket says 172.21.15.78:38798) 2024-09-11T00:16:49.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.066+0000 7f9115f48640 1 -- 172.21.15.78:0/99744134 learned_addr learned my addr 172.21.15.78:0/99744134 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:49.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.066+0000 7f9116749640 1 --2- 172.21.15.78:0/99744134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f911010d100 0x7f91101023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:49.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.066+0000 7f9115747640 1 --2- 172.21.15.78:0/99744134 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91101045c0 0x7f9110101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:49.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.066+0000 7f9115f48640 1 -- 172.21.15.78:0/99744134 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91101045c0 msgr2=0x7f9110101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:49.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.066+0000 7f9115f48640 1 --2- 172.21.15.78:0/99744134 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91101045c0 0x7f9110101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:49.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.066+0000 7f9115f48640 1 -- 172.21.15.78:0/99744134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f911010d100 msgr2=0x7f91101023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:49.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.066+0000 7f9115f48640 1 --2- 172.21.15.78:0/99744134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f911010d100 0x7f91101023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:49.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.066+0000 7f9115f48640 1 -- 172.21.15.78:0/99744134 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91101a76a0 con 0x7f9110103ca0 2024-09-11T00:16:49.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.066+0000 7f9116749640 1 --2- 172.21.15.78:0/99744134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f911010d100 0x7f91101023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:16:49.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.067+0000 7f9115f48640 1 --2- 172.21.15.78:0/99744134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9110103ca0 0x7f9110101950 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f910c005940 tx=0x7f910c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:49.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.067+0000 7f9106ffd640 1 -- 172.21.15.78:0/99744134 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910c03f030 con 0x7f9110103ca0 2024-09-11T00:16:49.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.067+0000 7f9106ffd640 1 -- 172.21.15.78:0/99744134 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f910c003cb0 con 0x7f9110103ca0 2024-09-11T00:16:49.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.067+0000 7f9106ffd640 1 -- 172.21.15.78:0/99744134 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910c035070 con 0x7f9110103ca0 2024-09-11T00:16:49.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.067+0000 7f91181ac640 1 -- 172.21.15.78:0/99744134 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91101a7930 con 0x7f9110103ca0 2024-09-11T00:16:49.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.068+0000 7f91181ac640 1 -- 172.21.15.78:0/99744134 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91101a7dc0 con 0x7f9110103ca0 2024-09-11T00:16:49.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.069+0000 7f91181ac640 1 -- 172.21.15.78:0/99744134 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9110104080 con 0x7f9110103ca0 2024-09-11T00:16:49.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.071+0000 7f9106ffd640 1 -- 172.21.15.78:0/99744134 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 23) ==== 153324+0+0 (secure 0 0 0) 0x7f910c04c070 con 0x7f9110103ca0 2024-09-11T00:16:49.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.072+0000 7f9106ffd640 1 --2- 172.21.15.78:0/99744134 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f90fc0b54c0 0x7f90fc0b7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:49.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.072+0000 7f9115747640 1 --2- 172.21.15.78:0/99744134 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f90fc0b54c0 0x7f90fc0b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:49.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.072+0000 7f9106ffd640 1 -- 172.21.15.78:0/99744134 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f910c1069e0 con 0x7f9110103ca0 2024-09-11T00:16:49.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.073+0000 7f9115747640 1 --2- 172.21.15.78:0/99744134 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f90fc0b54c0 0x7f90fc0b7980 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f91000058c0 tx=0x7f9100005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:49.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.078+0000 7f9106ffd640 1 -- 172.21.15.78:0/99744134 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f910c049020 con 0x7f9110103ca0 2024-09-11T00:16:49.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:48 smithi112 ceph-mon[35627]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:16:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.454+0000 7f91181ac640 1 -- 172.21.15.78:0/99744134 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9110102c50 con 0x7f9110103ca0 2024-09-11T00:16:49.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.455+0000 7f9106ffd640 1 -- 172.21.15.78:0/99744134 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f910c0cd5e0 con 0x7f9110103ca0 2024-09-11T00:16:49.457 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:16:49.457 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:16:49.457 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:16:49.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.457+0000 7f91181ac640 1 -- 172.21.15.78:0/99744134 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f90fc0b54c0 msgr2=0x7f90fc0b7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:49.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.457+0000 7f91181ac640 1 --2- 172.21.15.78:0/99744134 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f90fc0b54c0 0x7f90fc0b7980 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f91000058c0 tx=0x7f9100005850 comp rx=0 tx=0).stop 2024-09-11T00:16:49.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.457+0000 7f91181ac640 1 -- 172.21.15.78:0/99744134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9110103ca0 msgr2=0x7f9110101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.457+0000 7f91181ac640 1 --2- 172.21.15.78:0/99744134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9110103ca0 0x7f9110101950 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f910c005940 tx=0x7f910c0042f0 comp rx=0 tx=0).stop 2024-09-11T00:16:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.457+0000 7f91181ac640 1 -- 172.21.15.78:0/99744134 shutdown_connections 2024-09-11T00:16:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.457+0000 7f91181ac640 1 --2- 172.21.15.78:0/99744134 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f90fc0b54c0 0x7f90fc0b7980 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.457+0000 7f91181ac640 1 --2- 172.21.15.78:0/99744134 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f911010d100 0x7f91101023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.457+0000 7f91181ac640 1 --2- 172.21.15.78:0/99744134 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91101045c0 0x7f9110101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.457+0000 7f91181ac640 1 --2- 172.21.15.78:0/99744134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9110103ca0 0x7f9110101950 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:49.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.457+0000 7f91181ac640 1 -- 172.21.15.78:0/99744134 >> 172.21.15.78:0/99744134 conn(0x7f91100fd700 msgr2=0x7f91100fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:49.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.457+0000 7f91181ac640 1 -- 172.21.15.78:0/99744134 shutdown_connections 2024-09-11T00:16:49.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:49.457+0000 7f91181ac640 1 -- 172.21.15.78:0/99744134 wait complete. 2024-09-11T00:16:50.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:49 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/99744134' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:16:50.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:49 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/99744134' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:16:50.189 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:16:50.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:49 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/99744134' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:16:50.478 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:16:50.920 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:50 smithi078 ceph-mon[30865]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:16:51.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.040+0000 7f335f189640 1 -- 172.21.15.78:0/900331185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33581076a0 msgr2=0x7f3358107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:51.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.040+0000 7f335f189640 1 --2- 172.21.15.78:0/900331185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33581076a0 0x7f3358107ae0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3344009900 tx=0x7f334402a410 comp rx=0 tx=0).stop 2024-09-11T00:16:51.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.040+0000 7f335f189640 1 -- 172.21.15.78:0/900331185 shutdown_connections 2024-09-11T00:16:51.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.040+0000 7f335f189640 1 --2- 172.21.15.78:0/900331185 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3358108020 0x7f335810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.040+0000 7f335f189640 1 --2- 172.21.15.78:0/900331185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33581076a0 0x7f3358107ae0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.040+0000 7f335f189640 1 --2- 172.21.15.78:0/900331185 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3358101c90 0x7f3358102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.040+0000 7f335f189640 1 -- 172.21.15.78:0/900331185 >> 172.21.15.78:0/900331185 conn(0x7f33580fd700 msgr2=0x7f33580ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:51.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.040+0000 7f335f189640 1 -- 172.21.15.78:0/900331185 shutdown_connections 2024-09-11T00:16:51.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.040+0000 7f335f189640 1 -- 172.21.15.78:0/900331185 wait complete. 2024-09-11T00:16:51.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:50 smithi138 ceph-mon[35019]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:16:51.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.042+0000 7f335f189640 1 Processor -- start 2024-09-11T00:16:51.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.042+0000 7f335f189640 1 -- start start 2024-09-11T00:16:51.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.042+0000 7f335f189640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3358101c90 0x7f3358198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:51.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.042+0000 7f335f189640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33581076a0 0x7f3358198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:51.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.042+0000 7f335f189640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3358108020 0x7f335819da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:51.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.042+0000 7f335cf25640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3358101c90 0x7f3358198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:51.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.042+0000 7f335f189640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3358111ce0 con 0x7f3358101c90 2024-09-11T00:16:51.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.042+0000 7f335f189640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3358111b60 con 0x7f33581076a0 2024-09-11T00:16:51.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.042+0000 7f335cf25640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3358101c90 0x7f3358198150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38818/0 (socket says 172.21.15.78:38818) 2024-09-11T00:16:51.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.042+0000 7f335cf25640 1 -- 172.21.15.78:0/791467436 learned_addr learned my addr 172.21.15.78:0/791467436 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:51.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.042+0000 7f335f189640 1 -- 172.21.15.78:0/791467436 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3358111e60 con 0x7f3358108020 2024-09-11T00:16:51.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.043+0000 7f335d726640 1 --2- 172.21.15.78:0/791467436 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3358108020 0x7f335819da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:51.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.043+0000 7f335cf25640 1 -- 172.21.15.78:0/791467436 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3358108020 msgr2=0x7f335819da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:51.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.043+0000 7f335cf25640 1 --2- 172.21.15.78:0/791467436 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3358108020 0x7f335819da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.043+0000 7f335cf25640 1 -- 172.21.15.78:0/791467436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33581076a0 msgr2=0x7f3358198690 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T00:16:51.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.043+0000 7f335cf25640 1 --2- 172.21.15.78:0/791467436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33581076a0 0x7f3358198690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.043+0000 7f335cf25640 1 -- 172.21.15.78:0/791467436 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335819e200 con 0x7f3358101c90 2024-09-11T00:16:51.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.043+0000 7f335d726640 1 --2- 172.21.15.78:0/791467436 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3358108020 0x7f335819da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:16:51.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.043+0000 7f335cf25640 1 --2- 172.21.15.78:0/791467436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3358101c90 0x7f3358198150 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f334c00d950 tx=0x7f334c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:51.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.043+0000 7f3355ffb640 1 -- 172.21.15.78:0/791467436 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c017030 con 0x7f3358101c90 2024-09-11T00:16:51.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.043+0000 7f3355ffb640 1 -- 172.21.15.78:0/791467436 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f334c004020 con 0x7f3358101c90 2024-09-11T00:16:51.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.043+0000 7f335f189640 1 -- 172.21.15.78:0/791467436 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f335819e4f0 con 0x7f3358101c90 2024-09-11T00:16:51.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.043+0000 7f3355ffb640 1 -- 172.21.15.78:0/791467436 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c003c70 con 0x7f3358101c90 2024-09-11T00:16:51.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.044+0000 7f335f189640 1 -- 172.21.15.78:0/791467436 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33581a4bb0 con 0x7f3358101c90 2024-09-11T00:16:51.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.046+0000 7f3355ffb640 1 -- 172.21.15.78:0/791467436 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 23) ==== 153324+0+0 (secure 0 0 0) 0x7f334c009a30 con 0x7f3358101c90 2024-09-11T00:16:51.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.047+0000 7f3355ffb640 1 --2- 172.21.15.78:0/791467436 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f33480b5510 0x7f33480b79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:51.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.047+0000 7f3355ffb640 1 -- 172.21.15.78:0/791467436 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f334c0e5780 con 0x7f3358101c90 2024-09-11T00:16:51.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.047+0000 7f3357fff640 1 --2- 172.21.15.78:0/791467436 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f33480b5510 0x7f33480b79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:51.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.048+0000 7f3357fff640 1 --2- 172.21.15.78:0/791467436 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f33480b5510 0x7f33480b79d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f334402a930 tx=0x7f3344000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:51.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.048+0000 7f336155e740 1 Processor -- start 2024-09-11T00:16:51.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.048+0000 7f336155e740 1 -- start start 2024-09-11T00:16:51.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.048+0000 7f336155e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d2b81544d0 0x55d2b81548b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:51.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.048+0000 7f336155e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2b8154df0 0x55d2b8160840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:51.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.048+0000 7f336155e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b8160d80 0x55d2b8163170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:51.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.049+0000 7f336155e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55d2b80caea0 con 0x55d2b8160d80 2024-09-11T00:16:51.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.049+0000 7f336155e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d2b80ba2d0 con 0x55d2b8154df0 2024-09-11T00:16:51.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.049+0000 7f336155e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55d2b80be0e0 con 0x55d2b81544d0 2024-09-11T00:16:51.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.049+0000 7f335d726640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b8160d80 0x55d2b8163170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:51.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.049+0000 7f3357fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2b8154df0 0x55d2b8160840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:51.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.049+0000 7f335d726640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b8160d80 0x55d2b8163170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38820/0 (socket says 172.21.15.78:38820) 2024-09-11T00:16:51.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.049+0000 7f335d726640 1 -- 172.21.15.78:0/1610022514 learned_addr learned my addr 172.21.15.78:0/1610022514 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:51.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.049+0000 7f335cf25640 1 --2- 172.21.15.78:0/1610022514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d2b81544d0 0x55d2b81548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:51.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.049+0000 7f335d726640 1 -- 172.21.15.78:0/1610022514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d2b81544d0 msgr2=0x55d2b81548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:51.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.049+0000 7f335d726640 1 --2- 172.21.15.78:0/1610022514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d2b81544d0 0x55d2b81548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.049+0000 7f335d726640 1 -- 172.21.15.78:0/1610022514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2b8154df0 msgr2=0x55d2b8160840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:51.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.049+0000 7f335d726640 1 --2- 172.21.15.78:0/1610022514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2b8154df0 0x55d2b8160840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.049+0000 7f335d726640 1 -- 172.21.15.78:0/1610022514 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2b7e18650 con 0x55d2b8160d80 2024-09-11T00:16:51.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.049+0000 7f335d726640 1 --2- 172.21.15.78:0/1610022514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b8160d80 0x55d2b8163170 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3350007e60 tx=0x7f335000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f45dccbca45eec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.049+0000 7f3342ffd640 1 -- 172.21.15.78:0/1610022514 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3350014070 con 0x55d2b8160d80 2024-09-11T00:16:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.050+0000 7f3342ffd640 1 -- 172.21.15.78:0/1610022514 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3350004d20 con 0x55d2b8160d80 2024-09-11T00:16:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.050+0000 7f3342ffd640 1 -- 172.21.15.78:0/1610022514 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3350005480 con 0x55d2b8160d80 2024-09-11T00:16:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.050+0000 7f336155e740 1 -- 172.21.15.78:0/1610022514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b8160d80 msgr2=0x55d2b8163170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.051+0000 7f336155e740 1 --2- 172.21.15.78:0/1610022514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b8160d80 0x55d2b8163170 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3350007e60 tx=0x7f335000e720 comp rx=0 tx=0).stop 2024-09-11T00:16:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.051+0000 7f336155e740 1 -- 172.21.15.78:0/1610022514 shutdown_connections 2024-09-11T00:16:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.051+0000 7f336155e740 1 --2- 172.21.15.78:0/1610022514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b8160d80 0x55d2b8163170 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.051+0000 7f336155e740 1 --2- 172.21.15.78:0/1610022514 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2b8154df0 0x55d2b8160840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.051+0000 7f336155e740 1 --2- 172.21.15.78:0/1610022514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d2b81544d0 0x55d2b81548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.051+0000 7f336155e740 1 -- 172.21.15.78:0/1610022514 >> 172.21.15.78:0/1610022514 conn(0x55d2b8152300 msgr2=0x55d2b81534a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:51.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.051+0000 7f336155e740 1 -- 172.21.15.78:0/1610022514 shutdown_connections 2024-09-11T00:16:51.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.051+0000 7f336155e740 1 -- 172.21.15.78:0/1610022514 wait complete. 2024-09-11T00:16:51.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.051+0000 7f336155e740 1 -- start start 2024-09-11T00:16:51.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.051+0000 7f336155e740 1 Processor -- start 2024-09-11T00:16:51.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.052+0000 7f336155e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2b81544d0 0x55d2b81606a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:51.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.052+0000 7f336155e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d2b8154df0 0x55d2b815daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:51.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.052+0000 7f336155e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b8160d80 0x55d2b815e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:51.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.052+0000 7f336155e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55d2b7f1b700 con 0x55d2b8160d80 2024-09-11T00:16:51.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.052+0000 7f336155e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d2b8055160 con 0x55d2b81544d0 2024-09-11T00:16:51.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.052+0000 7f336155e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55d2b8163a00 con 0x55d2b8154df0 2024-09-11T00:16:51.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.052+0000 7f335d726640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b8160d80 0x55d2b815e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:51.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.052+0000 7f335d726640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b8160d80 0x55d2b815e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38824/0 (socket says 172.21.15.78:38824) 2024-09-11T00:16:51.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.052+0000 7f335d726640 1 -- 172.21.15.78:0/766380729 learned_addr learned my addr 172.21.15.78:0/766380729 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:51.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.053+0000 7f3357fff640 1 --2- 172.21.15.78:0/766380729 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d2b8154df0 0x55d2b815daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:51.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.053+0000 7f335cf25640 1 --2- 172.21.15.78:0/766380729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2b81544d0 0x55d2b81606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:51.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.053+0000 7f336155e740 10 client.0 _ll_register_callbacks cb 0x55d2b806e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:16:51.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.053+0000 7f335d726640 1 -- 172.21.15.78:0/766380729 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d2b8154df0 msgr2=0x55d2b815daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:51.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.053+0000 7f335d726640 1 --2- 172.21.15.78:0/766380729 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d2b8154df0 0x55d2b815daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.053+0000 7f335d726640 1 -- 172.21.15.78:0/766380729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2b81544d0 msgr2=0x55d2b81606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:51.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.053+0000 7f335d726640 1 --2- 172.21.15.78:0/766380729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2b81544d0 0x55d2b81606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.053+0000 7f335d726640 1 -- 172.21.15.78:0/766380729 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2b8082c90 con 0x55d2b8160d80 2024-09-11T00:16:51.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.053+0000 7f3357fff640 1 --2- 172.21.15.78:0/766380729 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d2b8154df0 0x55d2b815daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:16:51.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.053+0000 7f335d726640 1 --2- 172.21.15.78:0/766380729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b8160d80 0x55d2b815e120 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f33500072e0 tx=0x7f33500073c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79767bfabde5913 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:51.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.053+0000 7f3337fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:16:51.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.053+0000 7f3337fff640 1 -- 172.21.15.78:0/766380729 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3350027060 con 0x55d2b8160d80 2024-09-11T00:16:51.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.053+0000 7f3337fff640 1 -- 172.21.15.78:0/766380729 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f3350010640 con 0x55d2b8160d80 2024-09-11T00:16:51.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.053+0000 7f336155e740 1 -- 172.21.15.78:0/766380729 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3350004d20 con 0x55d2b8160d80 2024-09-11T00:16:51.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.054+0000 7f3337fff640 1 -- 172.21.15.78:0/766380729 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3350014070 con 0x55d2b8160d80 2024-09-11T00:16:51.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.054+0000 7f336155e740 10 client.15390 fetch_fsmap learned FSMap version 20 2024-09-11T00:16:51.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.054+0000 7f336155e740 1 -- 172.21.15.78:0/766380729 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d2b816f340 con 0x55d2b8160d80 2024-09-11T00:16:51.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.054+0000 7f3337fff640 1 -- 172.21.15.78:0/766380729 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3350004d20 con 0x55d2b8160d80 2024-09-11T00:16:51.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.054+0000 7f3337fff640 1 -- 172.21.15.78:0/766380729 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f33500055a0 con 0x55d2b8160d80 2024-09-11T00:16:51.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.054+0000 7f336155e740 10 client.15390 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:16:51.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.054+0000 7f336155e740 10 client.15390 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:16:51.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.054+0000 7f336155e740 20 client.15390 populate_metadata read hostname 'smithi078' 2024-09-11T00:16:51.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.054+0000 7f336155e740 1 --2- 172.21.15.78:0/766380729 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55d2b8170740 0x55d2b8172b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:51.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.054+0000 7f336155e740 4 client.15390 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:16:51.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.054+0000 7f336155e740 1 -- 172.21.15.78:0/766380729 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2b80ccdf0 con 0x55d2b8170740 2024-09-11T00:16:51.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.055+0000 7f335cf25640 1 --2- 172.21.15.78:0/766380729 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55d2b8170740 0x55d2b8172b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:51.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.055+0000 7f335cf25640 1 --2- 172.21.15.78:0/766380729 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55d2b8170740 0x55d2b8172b30 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be3864345796a4fc server_cookie=fc3d6cf55886f456 in_seq=0 out_seq=0 2024-09-11T00:16:51.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.055+0000 7f3337fff640 10 client.15390 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:51.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.056+0000 7f3337fff640 1 -- 172.21.15.78:0/766380729 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d2b80ccdf0 con 0x55d2b8170740 2024-09-11T00:16:51.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.056+0000 7f3337fff640 10 client.15390 handle_command_reply: tid=0 2024-09-11T00:16:51.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.056+0000 7f336155e740 1 client.15390 shutdown 2024-09-11T00:16:51.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.056+0000 7f336155e740 1 -- 172.21.15.78:0/766380729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b8160d80 msgr2=0x55d2b815e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:51.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.056+0000 7f336155e740 1 --2- 172.21.15.78:0/766380729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b8160d80 0x55d2b815e120 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f33500072e0 tx=0x7f33500073c0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.056+0000 7f336155e740 1 -- 172.21.15.78:0/766380729 shutdown_connections 2024-09-11T00:16:51.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.056+0000 7f336155e740 1 --2- 172.21.15.78:0/766380729 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55d2b8170740 0x55d2b8172b30 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.056+0000 7f336155e740 1 --2- 172.21.15.78:0/766380729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b8160d80 0x55d2b815e120 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.056+0000 7f3337fff640 0 client.15390 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:51.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.056+0000 7f336155e740 1 --2- 172.21.15.78:0/766380729 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d2b8154df0 0x55d2b815daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.056+0000 7f336155e740 1 --2- 172.21.15.78:0/766380729 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2b81544d0 0x55d2b81606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.056+0000 7f336155e740 1 -- 172.21.15.78:0/766380729 >> 172.21.15.78:0/766380729 conn(0x55d2b8152300 msgr2=0x55d2b8157ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:51.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.056+0000 7f336155e740 1 -- 172.21.15.78:0/766380729 shutdown_connections 2024-09-11T00:16:51.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.056+0000 7f336155e740 1 -- 172.21.15.78:0/766380729 wait complete. 2024-09-11T00:16:51.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.056+0000 7f336155e740 20 client.15390 trim_cache size 0 max 16384 2024-09-11T00:16:51.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.081+0000 7f336155e740 1 Processor -- start 2024-09-11T00:16:51.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.081+0000 7f336155e740 1 -- start start 2024-09-11T00:16:51.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.082+0000 7f336155e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b81544d0 0x55d2b816cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:51.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.082+0000 7f336155e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2b8154df0 0x55d2b8162170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:51.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.082+0000 7f336155e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d2b8160d80 0x55d2b81626b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:51.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.082+0000 7f336155e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f33581ae8e0 con 0x55d2b81544d0 2024-09-11T00:16:51.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.082+0000 7f336155e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f33581b1160 con 0x55d2b8154df0 2024-09-11T00:16:51.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.082+0000 7f336155e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f33581aef50 con 0x55d2b8160d80 2024-09-11T00:16:51.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.082+0000 7f335cf25640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b81544d0 0x55d2b816cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:51.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.082+0000 7f335cf25640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b81544d0 0x55d2b816cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38828/0 (socket says 172.21.15.78:38828) 2024-09-11T00:16:51.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.082+0000 7f335cf25640 1 -- 172.21.15.78:0/175309700 learned_addr learned my addr 172.21.15.78:0/175309700 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:51.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.082+0000 7f3357fff640 1 --2- 172.21.15.78:0/175309700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2b8154df0 0x55d2b8162170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:51.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.082+0000 7f335d726640 1 --2- 172.21.15.78:0/175309700 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d2b8160d80 0x55d2b81626b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:51.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.082+0000 7f335cf25640 1 -- 172.21.15.78:0/175309700 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d2b8160d80 msgr2=0x55d2b81626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:51.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.082+0000 7f335cf25640 1 --2- 172.21.15.78:0/175309700 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d2b8160d80 0x55d2b81626b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.082+0000 7f335cf25640 1 -- 172.21.15.78:0/175309700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2b8154df0 msgr2=0x55d2b8162170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:51.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.082+0000 7f335cf25640 1 --2- 172.21.15.78:0/175309700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2b8154df0 0x55d2b8162170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.082+0000 7f335cf25640 1 -- 172.21.15.78:0/175309700 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2b815d8a0 con 0x55d2b81544d0 2024-09-11T00:16:51.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.082+0000 7f335cf25640 1 --2- 172.21.15.78:0/175309700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b81544d0 0x55d2b816cc30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f334c0abcf0 tx=0x7f334c0e5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a262f9f996a0752 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:51.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.082+0000 7f33427fc640 1 -- 172.21.15.78:0/175309700 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c0b0840 con 0x55d2b81544d0 2024-09-11T00:16:51.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.083+0000 7f33427fc640 1 -- 172.21.15.78:0/175309700 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f334c0b52f0 con 0x55d2b81544d0 2024-09-11T00:16:51.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.083+0000 7f33427fc640 1 -- 172.21.15.78:0/175309700 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c0b3bc0 con 0x55d2b81544d0 2024-09-11T00:16:51.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.083+0000 7f336155e740 1 -- 172.21.15.78:0/175309700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b81544d0 msgr2=0x55d2b816cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:51.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.083+0000 7f336155e740 1 --2- 172.21.15.78:0/175309700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b81544d0 0x55d2b816cc30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f334c0abcf0 tx=0x7f334c0e5040 comp rx=0 tx=0).stop 2024-09-11T00:16:51.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.083+0000 7f336155e740 1 -- 172.21.15.78:0/175309700 shutdown_connections 2024-09-11T00:16:51.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.083+0000 7f336155e740 1 --2- 172.21.15.78:0/175309700 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d2b8160d80 0x55d2b81626b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.083+0000 7f336155e740 1 --2- 172.21.15.78:0/175309700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2b8154df0 0x55d2b8162170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.083+0000 7f336155e740 1 --2- 172.21.15.78:0/175309700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b81544d0 0x55d2b816cc30 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.083+0000 7f336155e740 1 -- 172.21.15.78:0/175309700 >> 172.21.15.78:0/175309700 conn(0x55d2b8152300 msgr2=0x55d2b815dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:51.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.083+0000 7f336155e740 1 -- 172.21.15.78:0/175309700 shutdown_connections 2024-09-11T00:16:51.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.084+0000 7f336155e740 1 -- 172.21.15.78:0/175309700 wait complete. 2024-09-11T00:16:51.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.084+0000 7f336155e740 1 -- start start 2024-09-11T00:16:51.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.084+0000 7f336155e740 1 Processor -- start 2024-09-11T00:16:51.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.084+0000 7f336155e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2b81544d0 0x55d2b81780a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:51.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.084+0000 7f336155e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b8154df0 0x55d2b81785e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:51.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.084+0000 7f336155e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d2b8160d80 0x55d2b8178b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:51.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.084+0000 7f336155e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f33581af620 con 0x55d2b8154df0 2024-09-11T00:16:51.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.084+0000 7f336155e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f33581b0a90 con 0x55d2b81544d0 2024-09-11T00:16:51.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.084+0000 7f336155e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f33581afcf0 con 0x55d2b8160d80 2024-09-11T00:16:51.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.084+0000 7f336155e740 10 client.0 _ll_register_callbacks cb 0x7f3344009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:16:51.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.085+0000 7f335cf25640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2b81544d0 0x55d2b81780a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.085+0000 7f335cf25640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2b81544d0 0x55d2b81780a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.78:36168/0 (socket says 172.21.15.78:36168) 2024-09-11T00:16:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.085+0000 7f335d726640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d2b8160d80 0x55d2b8178b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.085+0000 7f335cf25640 1 -- 172.21.15.78:0/3809507372 learned_addr learned my addr 172.21.15.78:0/3809507372 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.085+0000 7f3357fff640 1 --2- 172.21.15.78:0/3809507372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b8154df0 0x55d2b81785e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.085+0000 7f335cf25640 1 -- 172.21.15.78:0/3809507372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d2b8160d80 msgr2=0x55d2b8178b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.085+0000 7f335cf25640 1 --2- 172.21.15.78:0/3809507372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d2b8160d80 0x55d2b8178b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.085+0000 7f335cf25640 1 -- 172.21.15.78:0/3809507372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b8154df0 msgr2=0x55d2b81785e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.085+0000 7f335cf25640 1 --2- 172.21.15.78:0/3809507372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b8154df0 0x55d2b81785e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.085+0000 7f335cf25640 1 -- 172.21.15.78:0/3809507372 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2b81683c0 con 0x55d2b81544d0 2024-09-11T00:16:51.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.085+0000 7f335d726640 1 --2- 172.21.15.78:0/3809507372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d2b8160d80 0x55d2b8178b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:16:51.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.085+0000 7f3357fff640 1 --2- 172.21.15.78:0/3809507372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b8154df0 0x55d2b81785e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:16:51.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.085+0000 7f335cf25640 1 --2- 172.21.15.78:0/3809507372 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2b81544d0 0x55d2b81780a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f334c0aba10 tx=0x7f334c0abee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbee58d50a5e1ea7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:51.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.085+0000 7f3337fff640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-11T00:16:51.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.085+0000 7f3337fff640 1 -- 172.21.15.78:0/3809507372 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c0c5020 con 0x55d2b81544d0 2024-09-11T00:16:51.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.085+0000 7f336155e740 1 -- 172.21.15.78:0/3809507372 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f334c0b52f0 con 0x55d2b81544d0 2024-09-11T00:16:51.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.086+0000 7f3337fff640 1 -- 172.21.15.78:0/3809507372 <== mon.2 v2:172.21.15.112:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f334c0041d0 con 0x55d2b81544d0 2024-09-11T00:16:51.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.086+0000 7f3337fff640 1 -- 172.21.15.78:0/3809507372 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f334c0b0840 con 0x55d2b81544d0 2024-09-11T00:16:51.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.086+0000 7f336155e740 10 client.24932 fetch_fsmap learned FSMap version 20 2024-09-11T00:16:51.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.086+0000 7f336155e740 1 -- 172.21.15.78:0/3809507372 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d2b81e5f00 con 0x55d2b81544d0 2024-09-11T00:16:51.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.086+0000 7f3337fff640 1 -- 172.21.15.78:0/3809507372 <== mon.2 v2:172.21.15.112:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f334c0b52f0 con 0x55d2b81544d0 2024-09-11T00:16:51.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.086+0000 7f3337fff640 1 -- 172.21.15.78:0/3809507372 <== mon.2 v2:172.21.15.112:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f334c0a77d0 con 0x55d2b81544d0 2024-09-11T00:16:51.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.086+0000 7f336155e740 10 client.24932 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:16:51.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.086+0000 7f336155e740 10 client.24932 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:16:51.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.086+0000 7f336155e740 20 client.24932 populate_metadata read hostname 'smithi078' 2024-09-11T00:16:51.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.086+0000 7f336155e740 1 --2- 172.21.15.78:0/3809507372 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55d2b8170740 0x55d2b81e8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:51.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.086+0000 7f336155e740 4 client.24932 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:16:51.095 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-11T00:16:51.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.086+0000 7f336155e740 1 -- 172.21.15.78:0/3809507372 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d2b80c88a0 con 0x55d2b8170740 2024-09-11T00:16:51.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.087+0000 7f3357fff640 1 --2- 172.21.15.78:0/3809507372 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55d2b8170740 0x55d2b81e8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:51.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.087+0000 7f3357fff640 1 --2- 172.21.15.78:0/3809507372 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55d2b8170740 0x55d2b81e8500 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16248dd69b261bde server_cookie=1b4f0aefd772570a in_seq=0 out_seq=0 2024-09-11T00:16:51.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.087+0000 7f3337fff640 10 client.24932 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:51.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.087+0000 7f3337fff640 1 -- 172.21.15.78:0/3809507372 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d2b80c88a0 con 0x55d2b8170740 2024-09-11T00:16:51.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.087+0000 7f3337fff640 10 client.24932 handle_command_reply: tid=0 2024-09-11T00:16:51.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.087+0000 7f336155e740 1 client.24932 shutdown 2024-09-11T00:16:51.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.087+0000 7f336155e740 1 -- 172.21.15.78:0/3809507372 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2b81544d0 msgr2=0x55d2b81780a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:51.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.087+0000 7f336155e740 1 --2- 172.21.15.78:0/3809507372 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2b81544d0 0x55d2b81780a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f334c0aba10 tx=0x7f334c0abee0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.087+0000 7f336155e740 1 -- 172.21.15.78:0/3809507372 shutdown_connections 2024-09-11T00:16:51.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.087+0000 7f336155e740 1 --2- 172.21.15.78:0/3809507372 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55d2b8170740 0x55d2b81e8500 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.087+0000 7f3337fff640 0 client.24932 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:51.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.087+0000 7f336155e740 1 --2- 172.21.15.78:0/3809507372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d2b8160d80 0x55d2b8178b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.087+0000 7f336155e740 1 --2- 172.21.15.78:0/3809507372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d2b8154df0 0x55d2b81785e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.087+0000 7f336155e740 1 --2- 172.21.15.78:0/3809507372 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d2b81544d0 0x55d2b81780a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.087+0000 7f336155e740 1 -- 172.21.15.78:0/3809507372 >> 172.21.15.78:0/3809507372 conn(0x55d2b8152300 msgr2=0x55d2b8150c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:51.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.088+0000 7f336155e740 1 -- 172.21.15.78:0/3809507372 shutdown_connections 2024-09-11T00:16:51.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.088+0000 7f336155e740 1 -- 172.21.15.78:0/3809507372 wait complete. 2024-09-11T00:16:51.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.088+0000 7f336155e740 20 client.24932 trim_cache size 0 max 16384 2024-09-11T00:16:51.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.088+0000 7f335f189640 1 -- 172.21.15.78:0/791467436 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f33480b5510 msgr2=0x7f33480b79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:51.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.088+0000 7f335f189640 1 --2- 172.21.15.78:0/791467436 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f33480b5510 0x7f33480b79d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f334402a930 tx=0x7f3344000bc0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.088+0000 7f335f189640 1 -- 172.21.15.78:0/791467436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3358101c90 msgr2=0x7f3358198150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:51.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.088+0000 7f335f189640 1 --2- 172.21.15.78:0/791467436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3358101c90 0x7f3358198150 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f334c00d950 tx=0x7f334c00de10 comp rx=0 tx=0).stop 2024-09-11T00:16:51.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.088+0000 7f335f189640 1 -- 172.21.15.78:0/791467436 shutdown_connections 2024-09-11T00:16:51.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.088+0000 7f335f189640 1 --2- 172.21.15.78:0/791467436 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f33480b5510 0x7f33480b79d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.088+0000 7f335f189640 1 --2- 172.21.15.78:0/791467436 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3358108020 0x7f335819da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.088+0000 7f335f189640 1 --2- 172.21.15.78:0/791467436 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33581076a0 0x7f3358198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.088+0000 7f335f189640 1 --2- 172.21.15.78:0/791467436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3358101c90 0x7f3358198150 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:51.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.088+0000 7f335f189640 1 -- 172.21.15.78:0/791467436 >> 172.21.15.78:0/791467436 conn(0x7f33580fd700 msgr2=0x7f33580ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:51.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.089+0000 7f335f189640 1 -- 172.21.15.78:0/791467436 shutdown_connections 2024-09-11T00:16:51.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:51.089+0000 7f335f189640 1 -- 172.21.15.78:0/791467436 wait complete. 2024-09-11T00:16:51.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:50 smithi112 ceph-mon[35627]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:16:52.890 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:16:52.891 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:16:53.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:52 smithi138 ceph-mon[35019]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-11T00:16:53.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:52 smithi078 ceph-mon[30865]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-11T00:16:53.185 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:16:53.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:52 smithi112 ceph-mon[35627]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-11T00:16:53.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.772+0000 7feedddc3640 1 -- 172.21.15.78:0/3571248838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feed8103b70 msgr2=0x7feed8103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:53.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.772+0000 7feedddc3640 1 --2- 172.21.15.78:0/3571248838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feed8103b70 0x7feed8103f50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7feec8009900 tx=0x7feec802a410 comp rx=0 tx=0).stop 2024-09-11T00:16:53.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.772+0000 7feedddc3640 1 -- 172.21.15.78:0/3571248838 shutdown_connections 2024-09-11T00:16:53.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.772+0000 7feedddc3640 1 --2- 172.21.15.78:0/3571248838 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feed810d120 0x7feed810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.772+0000 7feedddc3640 1 --2- 172.21.15.78:0/3571248838 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feed8104570 0x7feed810cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.772+0000 7feedddc3640 1 --2- 172.21.15.78:0/3571248838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feed8103b70 0x7feed8103f50 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.772+0000 7feedddc3640 1 -- 172.21.15.78:0/3571248838 >> 172.21.15.78:0/3571248838 conn(0x7feed80fd700 msgr2=0x7feed80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:53.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.772+0000 7feedddc3640 1 -- 172.21.15.78:0/3571248838 shutdown_connections 2024-09-11T00:16:53.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.772+0000 7feedddc3640 1 -- 172.21.15.78:0/3571248838 wait complete. 2024-09-11T00:16:53.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.773+0000 7feedddc3640 1 Processor -- start 2024-09-11T00:16:53.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.773+0000 7feedddc3640 1 -- start start 2024-09-11T00:16:53.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.774+0000 7feedddc3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feed8103b70 0x7feed8199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:53.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.774+0000 7feedddc3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feed8104570 0x7feed81997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:53.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.774+0000 7feed6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feed8104570 0x7feed81997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:53.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.774+0000 7feed6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feed8104570 0x7feed81997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38854/0 (socket says 172.21.15.78:38854) 2024-09-11T00:16:53.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.774+0000 7feed6ffd640 1 -- 172.21.15.78:0/1307413936 learned_addr learned my addr 172.21.15.78:0/1307413936 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:53.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.774+0000 7feedddc3640 1 --2- 172.21.15.78:0/1307413936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feed810d120 0x7feed819eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:53.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.774+0000 7feed77fe640 1 --2- 172.21.15.78:0/1307413936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feed8103b70 0x7feed8199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:53.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.774+0000 7feedddc3640 1 -- 172.21.15.78:0/1307413936 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7feed8112d60 con 0x7feed8104570 2024-09-11T00:16:53.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.774+0000 7feedddc3640 1 -- 172.21.15.78:0/1307413936 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feed8112be0 con 0x7feed8103b70 2024-09-11T00:16:53.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.774+0000 7feedddc3640 1 -- 172.21.15.78:0/1307413936 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7feed8112ee0 con 0x7feed810d120 2024-09-11T00:16:53.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.774+0000 7feed7fff640 1 --2- 172.21.15.78:0/1307413936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feed810d120 0x7feed819eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:53.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.775+0000 7feed6ffd640 1 -- 172.21.15.78:0/1307413936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feed810d120 msgr2=0x7feed819eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:53.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.775+0000 7feed6ffd640 1 --2- 172.21.15.78:0/1307413936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feed810d120 0x7feed819eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.775+0000 7feed6ffd640 1 -- 172.21.15.78:0/1307413936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feed8103b70 msgr2=0x7feed8199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:53.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.775+0000 7feed6ffd640 1 --2- 172.21.15.78:0/1307413936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feed8103b70 0x7feed8199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.775+0000 7feed6ffd640 1 -- 172.21.15.78:0/1307413936 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed819f320 con 0x7feed8104570 2024-09-11T00:16:53.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.775+0000 7feed6ffd640 1 --2- 172.21.15.78:0/1307413936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feed8104570 0x7feed81997b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7feecc00d770 tx=0x7feecc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:53.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.775+0000 7feed4ff9640 1 -- 172.21.15.78:0/1307413936 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc017070 con 0x7feed8104570 2024-09-11T00:16:53.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.775+0000 7feed4ff9640 1 -- 172.21.15.78:0/1307413936 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feecc0054d0 con 0x7feed8104570 2024-09-11T00:16:53.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.775+0000 7feedddc3640 1 -- 172.21.15.78:0/1307413936 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feed819f610 con 0x7feed8104570 2024-09-11T00:16:53.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.775+0000 7feed4ff9640 1 -- 172.21.15.78:0/1307413936 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc004c30 con 0x7feed8104570 2024-09-11T00:16:53.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.775+0000 7feedddc3640 1 -- 172.21.15.78:0/1307413936 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feed81018d0 con 0x7feed8104570 2024-09-11T00:16:53.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.779+0000 7feee0198740 1 Processor -- start 2024-09-11T00:16:53.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.779+0000 7feee0198740 1 -- start start 2024-09-11T00:16:53.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.779+0000 7feee0198740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc7a6f0 0x55799fc7aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:53.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.779+0000 7feee0198740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc7b010 0x55799fc86a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:53.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.779+0000 7feee0198740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc86fa0 0x55799fc89390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:53.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.779+0000 7feee0198740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55799fbe8e60 con 0x55799fc86fa0 2024-09-11T00:16:53.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.779+0000 7feee0198740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55799fbd8290 con 0x55799fc7b010 2024-09-11T00:16:53.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.779+0000 7feee0198740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55799fbdc0a0 con 0x55799fc7a6f0 2024-09-11T00:16:53.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.780+0000 7feed7fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc7a6f0 0x55799fc7aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:53.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.780+0000 7feed7fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc7a6f0 0x55799fc7aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.78:60002/0 (socket says 172.21.15.78:60002) 2024-09-11T00:16:53.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.780+0000 7feed7fff640 1 -- 172.21.15.78:0/2440766977 learned_addr learned my addr 172.21.15.78:0/2440766977 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:53.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.780+0000 7feed77fe640 1 --2- 172.21.15.78:0/2440766977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc7b010 0x55799fc86a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:53.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.780+0000 7feed4ff9640 1 -- 172.21.15.78:0/1307413936 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 23) ==== 153324+0+0 (secure 0 0 0) 0x7feecc004e10 con 0x7feed8104570 2024-09-11T00:16:53.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.780+0000 7feed6ffd640 1 --2- 172.21.15.78:0/2440766977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc86fa0 0x55799fc89390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:53.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.780+0000 7feed7fff640 1 -- 172.21.15.78:0/2440766977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc7b010 msgr2=0x55799fc86a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:53.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.780+0000 7feed7fff640 1 --2- 172.21.15.78:0/2440766977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc7b010 0x55799fc86a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.780+0000 7feed7fff640 1 -- 172.21.15.78:0/2440766977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc86fa0 msgr2=0x55799fc89390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:53.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.780+0000 7feed7fff640 1 --2- 172.21.15.78:0/2440766977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc86fa0 0x55799fc89390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.780+0000 7feed7fff640 1 -- 172.21.15.78:0/2440766977 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55799f936930 con 0x55799fc7a6f0 2024-09-11T00:16:53.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.780+0000 7feed6ffd640 1 --2- 172.21.15.78:0/2440766977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc86fa0 0x55799fc89390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:16:53.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.780+0000 7feed77fe640 1 --2- 172.21.15.78:0/2440766977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc7b010 0x55799fc86a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:16:53.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.780+0000 7feed7fff640 1 --2- 172.21.15.78:0/2440766977 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc7a6f0 0x55799fc7aad0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7feed0010370 tx=0x7feed0010830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcd3048a1054fe6a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:53.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.781+0000 7feed4ff9640 1 --2- 172.21.15.78:0/1307413936 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7feec00b53c0 0x7feec00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:53.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.781+0000 7feed4ff9640 1 -- 172.21.15.78:0/1307413936 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7feecc0e5970 con 0x7feed8104570 2024-09-11T00:16:53.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.781+0000 7feed77fe640 1 --2- 172.21.15.78:0/1307413936 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7feec00b53c0 0x7feec00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:53.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.782+0000 7feed77fe640 1 --2- 172.21.15.78:0/1307413936 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7feec00b53c0 0x7feec00b7880 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7feec8031440 tx=0x7feec8005c00 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:53.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.782+0000 7feebdffb640 1 -- 172.21.15.78:0/2440766977 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed0016070 con 0x55799fc7a6f0 2024-09-11T00:16:53.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.782+0000 7feebdffb640 1 -- 172.21.15.78:0/2440766977 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feed0004d20 con 0x55799fc7a6f0 2024-09-11T00:16:53.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.782+0000 7feebdffb640 1 -- 172.21.15.78:0/2440766977 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed0005350 con 0x55799fc7a6f0 2024-09-11T00:16:53.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.783+0000 7feee0198740 1 -- 172.21.15.78:0/2440766977 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc7a6f0 msgr2=0x55799fc7aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:53.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.783+0000 7feee0198740 1 --2- 172.21.15.78:0/2440766977 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc7a6f0 0x55799fc7aad0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7feed0010370 tx=0x7feed0010830 comp rx=0 tx=0).stop 2024-09-11T00:16:53.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.783+0000 7feee0198740 1 -- 172.21.15.78:0/2440766977 shutdown_connections 2024-09-11T00:16:53.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.783+0000 7feee0198740 1 --2- 172.21.15.78:0/2440766977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc86fa0 0x55799fc89390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.783+0000 7feee0198740 1 --2- 172.21.15.78:0/2440766977 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc7b010 0x55799fc86a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.783+0000 7feee0198740 1 --2- 172.21.15.78:0/2440766977 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc7a6f0 0x55799fc7aad0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.783+0000 7feee0198740 1 -- 172.21.15.78:0/2440766977 >> 172.21.15.78:0/2440766977 conn(0x55799fc78520 msgr2=0x55799fc796c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:53.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.783+0000 7feee0198740 1 -- 172.21.15.78:0/2440766977 shutdown_connections 2024-09-11T00:16:53.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.783+0000 7feee0198740 1 -- 172.21.15.78:0/2440766977 wait complete. 2024-09-11T00:16:53.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.784+0000 7feee0198740 1 -- start start 2024-09-11T00:16:53.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.784+0000 7feee0198740 1 Processor -- start 2024-09-11T00:16:53.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.784+0000 7feee0198740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc7a6f0 0x55799fc83fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:53.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.784+0000 7feee0198740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc7b010 0x55799fc844f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:53.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.785+0000 7feee0198740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc86fa0 0x55799fc84a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:53.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.785+0000 7feee0198740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55799fa39890 con 0x55799fc7b010 2024-09-11T00:16:53.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.785+0000 7feee0198740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55799fb72d40 con 0x55799fc7a6f0 2024-09-11T00:16:53.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.785+0000 7feee0198740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55799fc89c20 con 0x55799fc86fa0 2024-09-11T00:16:53.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.785+0000 7feed6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc7b010 0x55799fc844f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:53.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.785+0000 7feee0198740 10 client.0 _ll_register_callbacks cb 0x55799fbd6c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:16:53.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.785+0000 7feed77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc7a6f0 0x55799fc83fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:53.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.785+0000 7feed77fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc7a6f0 0x55799fc83fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.78:36204/0 (socket says 172.21.15.78:36204) 2024-09-11T00:16:53.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.785+0000 7feed77fe640 1 -- 172.21.15.78:0/1128395982 learned_addr learned my addr 172.21.15.78:0/1128395982 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:53.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.785+0000 7feed7fff640 1 --2- 172.21.15.78:0/1128395982 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc86fa0 0x55799fc84a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:53.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.785+0000 7feed77fe640 1 -- 172.21.15.78:0/1128395982 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc86fa0 msgr2=0x55799fc84a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:53.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.785+0000 7feed77fe640 1 --2- 172.21.15.78:0/1128395982 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc86fa0 0x55799fc84a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.785+0000 7feed77fe640 1 -- 172.21.15.78:0/1128395982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc7b010 msgr2=0x55799fc844f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:53.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.785+0000 7feed77fe640 1 --2- 172.21.15.78:0/1128395982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc7b010 0x55799fc844f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.785+0000 7feed77fe640 1 -- 172.21.15.78:0/1128395982 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55799fc93050 con 0x55799fc7a6f0 2024-09-11T00:16:53.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.785+0000 7feed77fe640 1 --2- 172.21.15.78:0/1128395982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc7a6f0 0x55799fc83fb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feec8009900 tx=0x7feec8009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60b94c0ac77b05fe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:53.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.785+0000 7feeb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-11T00:16:53.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.786+0000 7feeb6ffd640 1 -- 172.21.15.78:0/1128395982 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec804c070 con 0x55799fc7a6f0 2024-09-11T00:16:53.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.786+0000 7feee0198740 1 -- 172.21.15.78:0/1128395982 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feed0004d20 con 0x55799fc7a6f0 2024-09-11T00:16:53.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.786+0000 7feeb6ffd640 1 -- 172.21.15.78:0/1128395982 <== mon.2 v2:172.21.15.112:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7feec8005030 con 0x55799fc7a6f0 2024-09-11T00:16:53.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.786+0000 7feeb6ffd640 1 -- 172.21.15.78:0/1128395982 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7feec8056050 con 0x55799fc7a6f0 2024-09-11T00:16:53.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.786+0000 7feee0198740 10 client.24944 fetch_fsmap learned FSMap version 20 2024-09-11T00:16:53.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.786+0000 7feee0198740 1 -- 172.21.15.78:0/1128395982 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55799fc95a00 con 0x55799fc7a6f0 2024-09-11T00:16:53.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.787+0000 7feeb6ffd640 1 -- 172.21.15.78:0/1128395982 <== mon.2 v2:172.21.15.112:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feed0004d20 con 0x55799fc7a6f0 2024-09-11T00:16:53.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.787+0000 7feeb6ffd640 1 -- 172.21.15.78:0/1128395982 <== mon.2 v2:172.21.15.112:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7feec80035f0 con 0x55799fc7a6f0 2024-09-11T00:16:53.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.787+0000 7feee0198740 10 client.24944 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:16:53.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.787+0000 7feee0198740 10 client.24944 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:16:53.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.787+0000 7feee0198740 20 client.24944 populate_metadata read hostname 'smithi078' 2024-09-11T00:16:53.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.787+0000 7feee0198740 1 --2- 172.21.15.78:0/1128395982 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55799fc96f60 0x55799fc993c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:53.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.787+0000 7feee0198740 4 client.24944 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:16:53.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.787+0000 7feee0198740 1 -- 172.21.15.78:0/1128395982 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55799fbeadb0 con 0x55799fc96f60 2024-09-11T00:16:53.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.787+0000 7feed6ffd640 1 --2- 172.21.15.78:0/1128395982 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55799fc96f60 0x55799fc993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:53.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.788+0000 7feed6ffd640 1 --2- 172.21.15.78:0/1128395982 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55799fc96f60 0x55799fc993c0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85b3450de22a3316 server_cookie=57e7d3f08a78b5c9 in_seq=0 out_seq=0 2024-09-11T00:16:53.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.788+0000 7feeb6ffd640 10 client.24944 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:53.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.788+0000 7feeb6ffd640 1 -- 172.21.15.78:0/1128395982 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55799fbeadb0 con 0x55799fc96f60 2024-09-11T00:16:53.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.788+0000 7feeb6ffd640 10 client.24944 handle_command_reply: tid=0 2024-09-11T00:16:53.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.788+0000 7feee0198740 1 client.24944 shutdown 2024-09-11T00:16:53.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.789+0000 7feee0198740 1 -- 172.21.15.78:0/1128395982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc7a6f0 msgr2=0x55799fc83fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:53.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.789+0000 7feee0198740 1 --2- 172.21.15.78:0/1128395982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc7a6f0 0x55799fc83fb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feec8009900 tx=0x7feec8009260 comp rx=0 tx=0).stop 2024-09-11T00:16:53.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.789+0000 7feee0198740 1 -- 172.21.15.78:0/1128395982 shutdown_connections 2024-09-11T00:16:53.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.789+0000 7feee0198740 1 --2- 172.21.15.78:0/1128395982 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55799fc96f60 0x55799fc993c0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.789+0000 7feee0198740 1 --2- 172.21.15.78:0/1128395982 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc86fa0 0x55799fc84a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.789+0000 7feeb6ffd640 0 client.24944 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:53.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.789+0000 7feee0198740 1 --2- 172.21.15.78:0/1128395982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc7b010 0x55799fc844f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.789+0000 7feee0198740 1 --2- 172.21.15.78:0/1128395982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc7a6f0 0x55799fc83fb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.789+0000 7feee0198740 1 -- 172.21.15.78:0/1128395982 >> 172.21.15.78:0/1128395982 conn(0x55799fc78520 msgr2=0x55799fc7d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:53.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.789+0000 7feee0198740 1 -- 172.21.15.78:0/1128395982 shutdown_connections 2024-09-11T00:16:53.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.789+0000 7feee0198740 1 -- 172.21.15.78:0/1128395982 wait complete. 2024-09-11T00:16:53.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.789+0000 7feee0198740 20 client.24944 trim_cache size 0 max 16384 2024-09-11T00:16:53.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.822+0000 7feee0198740 1 Processor -- start 2024-09-11T00:16:53.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.822+0000 7feee0198740 1 -- start start 2024-09-11T00:16:53.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.823+0000 7feee0198740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc7a6f0 0x55799fc6ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:53.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.823+0000 7feee0198740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc7b010 0x55799fc84690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:53.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.823+0000 7feee0198740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc86fa0 0x55799fc811c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:53.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.823+0000 7feee0198740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7feed81aa480 con 0x55799fc7b010 2024-09-11T00:16:53.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.823+0000 7feee0198740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feed81acd00 con 0x55799fc86fa0 2024-09-11T00:16:53.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.823+0000 7feee0198740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7feed81aaaf0 con 0x55799fc7a6f0 2024-09-11T00:16:53.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.823+0000 7feed77fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc7a6f0 0x55799fc6ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:53.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.823+0000 7feed77fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc7a6f0 0x55799fc6ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.78:60026/0 (socket says 172.21.15.78:60026) 2024-09-11T00:16:53.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.823+0000 7feed6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc7b010 0x55799fc84690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:53.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.823+0000 7feed77fe640 1 -- 172.21.15.78:0/2118788311 learned_addr learned my addr 172.21.15.78:0/2118788311 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:53.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.823+0000 7feed7fff640 1 --2- 172.21.15.78:0/2118788311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc86fa0 0x55799fc811c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:53.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.824+0000 7feed77fe640 1 -- 172.21.15.78:0/2118788311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc86fa0 msgr2=0x55799fc811c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:53.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.824+0000 7feed77fe640 1 --2- 172.21.15.78:0/2118788311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc86fa0 0x55799fc811c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.824+0000 7feed77fe640 1 -- 172.21.15.78:0/2118788311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc7b010 msgr2=0x55799fc84690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:53.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.824+0000 7feed77fe640 1 --2- 172.21.15.78:0/2118788311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc7b010 0x55799fc84690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.824+0000 7feed77fe640 1 -- 172.21.15.78:0/2118788311 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55799fc86790 con 0x55799fc7a6f0 2024-09-11T00:16:53.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.824+0000 7feed6ffd640 1 --2- 172.21.15.78:0/2118788311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc7b010 0x55799fc84690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:16:53.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.824+0000 7feed77fe640 1 --2- 172.21.15.78:0/2118788311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc7a6f0 0x55799fc6ef70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feec8003b60 tx=0x7feec8004550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9aa8494252249ee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:53.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.824+0000 7feebd7fa640 1 -- 172.21.15.78:0/2118788311 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec804c070 con 0x55799fc7a6f0 2024-09-11T00:16:53.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.824+0000 7feebd7fa640 1 -- 172.21.15.78:0/2118788311 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feec80054e0 con 0x55799fc7a6f0 2024-09-11T00:16:53.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.824+0000 7feebd7fa640 1 -- 172.21.15.78:0/2118788311 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8035040 con 0x55799fc7a6f0 2024-09-11T00:16:53.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.825+0000 7feee0198740 1 -- 172.21.15.78:0/2118788311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc7a6f0 msgr2=0x55799fc6ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:53.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.825+0000 7feee0198740 1 --2- 172.21.15.78:0/2118788311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc7a6f0 0x55799fc6ef70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feec8003b60 tx=0x7feec8004550 comp rx=0 tx=0).stop 2024-09-11T00:16:53.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.825+0000 7feee0198740 1 -- 172.21.15.78:0/2118788311 shutdown_connections 2024-09-11T00:16:53.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.825+0000 7feee0198740 1 --2- 172.21.15.78:0/2118788311 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc86fa0 0x55799fc811c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.825+0000 7feee0198740 1 --2- 172.21.15.78:0/2118788311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc7b010 0x55799fc84690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.825+0000 7feee0198740 1 --2- 172.21.15.78:0/2118788311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc7a6f0 0x55799fc6ef70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.825+0000 7feee0198740 1 -- 172.21.15.78:0/2118788311 >> 172.21.15.78:0/2118788311 conn(0x55799fc78520 msgr2=0x55799fc83f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:53.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.825+0000 7feee0198740 1 -- 172.21.15.78:0/2118788311 shutdown_connections 2024-09-11T00:16:53.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.825+0000 7feee0198740 1 -- 172.21.15.78:0/2118788311 wait complete. 2024-09-11T00:16:53.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.826+0000 7feee0198740 1 -- start start 2024-09-11T00:16:53.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.826+0000 7feee0198740 1 Processor -- start 2024-09-11T00:16:53.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.826+0000 7feee0198740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc7a6f0 0x55799fc8f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:53.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.826+0000 7feee0198740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc7b010 0x55799fc8bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:53.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.826+0000 7feee0198740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc86fa0 0x55799fc8c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:53.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.826+0000 7feee0198740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7feed81ab1c0 con 0x55799fc7a6f0 2024-09-11T00:16:53.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.826+0000 7feed77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc7a6f0 0x55799fc8f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:53.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.826+0000 7feed77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc7a6f0 0x55799fc8f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38898/0 (socket says 172.21.15.78:38898) 2024-09-11T00:16:53.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.826+0000 7feed77fe640 1 -- 172.21.15.78:0/4048038073 learned_addr learned my addr 172.21.15.78:0/4048038073 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:53.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.826+0000 7feee0198740 1 -- 172.21.15.78:0/4048038073 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feed81ac630 con 0x55799fc86fa0 2024-09-11T00:16:53.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.826+0000 7feee0198740 1 -- 172.21.15.78:0/4048038073 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7feed81ab890 con 0x55799fc7b010 2024-09-11T00:16:53.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.827+0000 7feee0198740 10 client.0 _ll_register_callbacks cb 0x7feec802ab10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:16:53.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.827+0000 7feed6ffd640 1 --2- 172.21.15.78:0/4048038073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc7b010 0x55799fc8bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:53.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.827+0000 7feed7fff640 1 --2- 172.21.15.78:0/4048038073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc86fa0 0x55799fc8c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:53.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.827+0000 7feed77fe640 1 -- 172.21.15.78:0/4048038073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc7b010 msgr2=0x55799fc8bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:53.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.827+0000 7feed77fe640 1 --2- 172.21.15.78:0/4048038073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc7b010 0x55799fc8bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.827+0000 7feed77fe640 1 -- 172.21.15.78:0/4048038073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc86fa0 msgr2=0x55799fc8c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:53.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.827+0000 7feed77fe640 1 --2- 172.21.15.78:0/4048038073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc86fa0 0x55799fc8c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.827+0000 7feed77fe640 1 -- 172.21.15.78:0/4048038073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55799fc8c910 con 0x55799fc7a6f0 2024-09-11T00:16:53.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.827+0000 7feed77fe640 1 --2- 172.21.15.78:0/4048038073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc7a6f0 0x55799fc8f620 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7feec8003fd0 tx=0x7feec8003660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235ff2f2530eb789 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:53.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.827+0000 7feeb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:16:53.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.827+0000 7feeb6ffd640 1 -- 172.21.15.78:0/4048038073 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec804c040 con 0x55799fc7a6f0 2024-09-11T00:16:53.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.827+0000 7feeb6ffd640 1 -- 172.21.15.78:0/4048038073 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7feec8051650 con 0x55799fc7a6f0 2024-09-11T00:16:53.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.827+0000 7feee0198740 1 -- 172.21.15.78:0/4048038073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feec80054e0 con 0x55799fc7a6f0 2024-09-11T00:16:53.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.828+0000 7feeb6ffd640 1 -- 172.21.15.78:0/4048038073 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7feec8051850 con 0x55799fc7a6f0 2024-09-11T00:16:53.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.828+0000 7feee0198740 10 client.15411 fetch_fsmap learned FSMap version 20 2024-09-11T00:16:53.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.828+0000 7feee0198740 1 -- 172.21.15.78:0/4048038073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55799fd04f10 con 0x55799fc7a6f0 2024-09-11T00:16:53.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.828+0000 7feeb6ffd640 1 -- 172.21.15.78:0/4048038073 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feec80054e0 con 0x55799fc7a6f0 2024-09-11T00:16:53.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.828+0000 7feeb6ffd640 1 -- 172.21.15.78:0/4048038073 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7feec8063070 con 0x55799fc7a6f0 2024-09-11T00:16:53.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.828+0000 7feee0198740 10 client.15411 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:16:53.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.828+0000 7feee0198740 10 client.15411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:16:53.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.828+0000 7feee0198740 20 client.15411 populate_metadata read hostname 'smithi078' 2024-09-11T00:16:53.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.828+0000 7feee0198740 1 --2- 172.21.15.78:0/4048038073 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55799fc96f60 0x55799fd07590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:53.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.828+0000 7feee0198740 4 client.15411 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:16:53.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.828+0000 7feee0198740 1 -- 172.21.15.78:0/4048038073 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55799fbe6860 con 0x55799fc96f60 2024-09-11T00:16:53.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.828+0000 7feed6ffd640 1 --2- 172.21.15.78:0/4048038073 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55799fc96f60 0x55799fd07590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:53.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.829+0000 7feeb6ffd640 10 client.15411 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:53.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.829+0000 7feed6ffd640 1 --2- 172.21.15.78:0/4048038073 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55799fc96f60 0x55799fd07590 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=748acf4db8369656 server_cookie=faaf19a310bfa564 in_seq=0 out_seq=0 2024-09-11T00:16:53.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.831+0000 7feeb6ffd640 1 -- 172.21.15.78:0/4048038073 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55799fbe6860 con 0x55799fc96f60 2024-09-11T00:16:53.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.831+0000 7feeb6ffd640 10 client.15411 handle_command_reply: tid=0 2024-09-11T00:16:53.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.831+0000 7feee0198740 1 client.15411 shutdown 2024-09-11T00:16:53.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.831+0000 7feee0198740 1 -- 172.21.15.78:0/4048038073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc7a6f0 msgr2=0x55799fc8f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:53.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.831+0000 7feee0198740 1 --2- 172.21.15.78:0/4048038073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc7a6f0 0x55799fc8f620 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7feec8003fd0 tx=0x7feec8003660 comp rx=0 tx=0).stop 2024-09-11T00:16:53.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.831+0000 7feee0198740 1 -- 172.21.15.78:0/4048038073 shutdown_connections 2024-09-11T00:16:53.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.831+0000 7feee0198740 1 --2- 172.21.15.78:0/4048038073 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55799fc96f60 0x55799fd07590 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.831+0000 7feeb6ffd640 0 client.15411 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:53.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.831+0000 7feee0198740 1 --2- 172.21.15.78:0/4048038073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55799fc86fa0 0x55799fc8c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.831+0000 7feee0198740 1 --2- 172.21.15.78:0/4048038073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55799fc7b010 0x55799fc8bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.831+0000 7feee0198740 1 --2- 172.21.15.78:0/4048038073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55799fc7a6f0 0x55799fc8f620 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.831+0000 7feee0198740 1 -- 172.21.15.78:0/4048038073 >> 172.21.15.78:0/4048038073 conn(0x55799fc78520 msgr2=0x55799fc6ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:53.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.831+0000 7feee0198740 1 -- 172.21.15.78:0/4048038073 shutdown_connections 2024-09-11T00:16:53.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.832+0000 7feee0198740 1 -- 172.21.15.78:0/4048038073 wait complete. 2024-09-11T00:16:53.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.832+0000 7feee0198740 20 client.15411 trim_cache size 0 max 16384 2024-09-11T00:16:53.835 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:16:53.835 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-11T00:16:53.835 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "6289bc2a-a628-43bc-9b8b-2559c2c49db7", 2024-09-11T00:16:53.836 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-11T00:16:53.836 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:16:53.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.832+0000 7feedddc3640 1 -- 172.21.15.78:0/1307413936 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7feec00b53c0 msgr2=0x7feec00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:53.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.832+0000 7feedddc3640 1 --2- 172.21.15.78:0/1307413936 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7feec00b53c0 0x7feec00b7880 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7feec8031440 tx=0x7feec8005c00 comp rx=0 tx=0).stop 2024-09-11T00:16:53.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.833+0000 7feedddc3640 1 -- 172.21.15.78:0/1307413936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feed8104570 msgr2=0x7feed81997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:53.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.833+0000 7feedddc3640 1 --2- 172.21.15.78:0/1307413936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feed8104570 0x7feed81997b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7feecc00d770 tx=0x7feecc00dc30 comp rx=0 tx=0).stop 2024-09-11T00:16:53.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.833+0000 7feedddc3640 1 -- 172.21.15.78:0/1307413936 shutdown_connections 2024-09-11T00:16:53.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.833+0000 7feedddc3640 1 --2- 172.21.15.78:0/1307413936 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7feec00b53c0 0x7feec00b7880 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.833+0000 7feedddc3640 1 --2- 172.21.15.78:0/1307413936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feed810d120 0x7feed819eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.833+0000 7feedddc3640 1 --2- 172.21.15.78:0/1307413936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feed8104570 0x7feed81997b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.833+0000 7feedddc3640 1 --2- 172.21.15.78:0/1307413936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feed8103b70 0x7feed8199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:53.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.833+0000 7feedddc3640 1 -- 172.21.15.78:0/1307413936 >> 172.21.15.78:0/1307413936 conn(0x7feed80fd700 msgr2=0x7feed80fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:53.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.833+0000 7feedddc3640 1 -- 172.21.15.78:0/1307413936 shutdown_connections 2024-09-11T00:16:53.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:53.833+0000 7feedddc3640 1 -- 172.21.15.78:0/1307413936 wait complete. 2024-09-11T00:16:54.546 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:16:54.783 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:54 smithi078 ceph-mon[30865]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 682 B/s wr, 1 op/s 2024-09-11T00:16:54.783 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:54 smithi078 ceph-mon[30865]: scrub queued for path: / 2024-09-11T00:16:54.784 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:54 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:16:54.784 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:54 smithi078 ceph-mon[30865]: scrub summary: active paths [/] 2024-09-11T00:16:54.784 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:54 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:16:54.843 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:16:55.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:54 smithi138 ceph-mon[35019]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 682 B/s wr, 1 op/s 2024-09-11T00:16:55.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:54 smithi138 ceph-mon[35019]: scrub queued for path: / 2024-09-11T00:16:55.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:54 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:16:55.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:54 smithi138 ceph-mon[35019]: scrub summary: active paths [/] 2024-09-11T00:16:55.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:54 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:16:55.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:54 smithi112 ceph-mon[35627]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 682 B/s wr, 1 op/s 2024-09-11T00:16:55.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:54 smithi112 ceph-mon[35627]: scrub queued for path: / 2024-09-11T00:16:55.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:54 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:16:55.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:54 smithi112 ceph-mon[35627]: scrub summary: active paths [/] 2024-09-11T00:16:55.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:54 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:16:55.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.417+0000 7f520dcfe640 1 -- 172.21.15.78:0/3628752145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5208108020 msgr2=0x7f520810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:55.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.417+0000 7f520dcfe640 1 --2- 172.21.15.78:0/3628752145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5208108020 0x7f520810e820 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5200009ca0 tx=0x7f520002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.417+0000 7f520dcfe640 1 -- 172.21.15.78:0/3628752145 shutdown_connections 2024-09-11T00:16:55.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.417+0000 7f520dcfe640 1 --2- 172.21.15.78:0/3628752145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5208108020 0x7f520810e820 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.417+0000 7f520dcfe640 1 --2- 172.21.15.78:0/3628752145 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52081076a0 0x7f5208107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.417+0000 7f520dcfe640 1 --2- 172.21.15.78:0/3628752145 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5208101c90 0x7f5208102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.417+0000 7f520dcfe640 1 -- 172.21.15.78:0/3628752145 >> 172.21.15.78:0/3628752145 conn(0x7f52080fd700 msgr2=0x7f52080ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:55.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.417+0000 7f520dcfe640 1 -- 172.21.15.78:0/3628752145 shutdown_connections 2024-09-11T00:16:55.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.417+0000 7f520dcfe640 1 -- 172.21.15.78:0/3628752145 wait complete. 2024-09-11T00:16:55.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.418+0000 7f520dcfe640 1 Processor -- start 2024-09-11T00:16:55.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.418+0000 7f520dcfe640 1 -- start start 2024-09-11T00:16:55.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.418+0000 7f520dcfe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5208101c90 0x7f52081982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:55.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.418+0000 7f520dcfe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52081076a0 0x7f52081987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:55.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.418+0000 7f520dcfe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5208108020 0x7f520819db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:55.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.418+0000 7f520dcfe640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5208111d20 con 0x7f5208101c90 2024-09-11T00:16:55.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.418+0000 7f520dcfe640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5208111ba0 con 0x7f52081076a0 2024-09-11T00:16:55.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.418+0000 7f520dcfe640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5208111ea0 con 0x7f5208108020 2024-09-11T00:16:55.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.419+0000 7f5207fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5208108020 0x7f520819db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:55.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.419+0000 7f5207fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5208108020 0x7f520819db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.78:57380/0 (socket says 172.21.15.78:57380) 2024-09-11T00:16:55.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.419+0000 7f5207fff640 1 -- 172.21.15.78:0/761418467 learned_addr learned my addr 172.21.15.78:0/761418467 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:55.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.419+0000 7f52077fe640 1 --2- 172.21.15.78:0/761418467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5208101c90 0x7f52081982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:55.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.419+0000 7f5206ffd640 1 --2- 172.21.15.78:0/761418467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52081076a0 0x7f52081987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:55.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.419+0000 7f5207fff640 1 -- 172.21.15.78:0/761418467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52081076a0 msgr2=0x7f52081987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:55.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.419+0000 7f5207fff640 1 --2- 172.21.15.78:0/761418467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52081076a0 0x7f52081987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.419+0000 7f5207fff640 1 -- 172.21.15.78:0/761418467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5208101c90 msgr2=0x7f52081982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:55.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.419+0000 7f5207fff640 1 --2- 172.21.15.78:0/761418467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5208101c90 0x7f52081982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.419+0000 7f5207fff640 1 -- 172.21.15.78:0/761418467 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f520819e360 con 0x7f5208108020 2024-09-11T00:16:55.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.419+0000 7f52077fe640 1 --2- 172.21.15.78:0/761418467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5208101c90 0x7f52081982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:16:55.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.420+0000 7f5207fff640 1 --2- 172.21.15.78:0/761418467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5208108020 0x7f520819db90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5200005cc0 tx=0x7f520002f470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:55.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.420+0000 7f5204ff9640 1 -- 172.21.15.78:0/761418467 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5200003cf0 con 0x7f5208108020 2024-09-11T00:16:55.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.420+0000 7f5204ff9640 1 -- 172.21.15.78:0/761418467 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52000044f0 con 0x7f5208108020 2024-09-11T00:16:55.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.420+0000 7f520dcfe640 1 -- 172.21.15.78:0/761418467 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f520819e5f0 con 0x7f5208108020 2024-09-11T00:16:55.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.420+0000 7f5204ff9640 1 -- 172.21.15.78:0/761418467 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520002fc30 con 0x7f5208108020 2024-09-11T00:16:55.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.420+0000 7f520dcfe640 1 -- 172.21.15.78:0/761418467 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f520806ab30 con 0x7f5208108020 2024-09-11T00:16:55.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.423+0000 7f5204ff9640 1 -- 172.21.15.78:0/761418467 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 23) ==== 153324+0+0 (secure 0 0 0) 0x7f5200004040 con 0x7f5208108020 2024-09-11T00:16:55.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.423+0000 7f52100d3740 1 Processor -- start 2024-09-11T00:16:55.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.423+0000 7f52100d3740 1 -- start start 2024-09-11T00:16:55.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.423+0000 7f52100d3740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5592007af480 0x5592007af860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:55.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.423+0000 7f52100d3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007afda0 0x5592007c4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:55.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.423+0000 7f52100d3740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007c4540 0x5592007c6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:55.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.423+0000 7f52100d3740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x559200725e50 con 0x5592007c4540 2024-09-11T00:16:55.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.423+0000 7f52100d3740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559200715280 con 0x5592007af480 2024-09-11T00:16:55.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.423+0000 7f52100d3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x559200719090 con 0x5592007afda0 2024-09-11T00:16:55.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.424+0000 7f52077fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007afda0 0x5592007c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.424+0000 7f52077fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007afda0 0x5592007c4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.78:57394/0 (socket says 172.21.15.78:57394) 2024-09-11T00:16:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.424+0000 7f52077fe640 1 -- 172.21.15.78:0/1299383146 learned_addr learned my addr 172.21.15.78:0/1299383146 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.424+0000 7f5206ffd640 1 --2- 172.21.15.78:0/1299383146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5592007af480 0x5592007af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.424+0000 7f5204ff9640 1 --2- 172.21.15.78:0/761418467 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f51f00b53c0 0x7f51f00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.424+0000 7f52077fe640 1 -- 172.21.15.78:0/1299383146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5592007af480 msgr2=0x5592007af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.424+0000 7f52077fe640 1 --2- 172.21.15.78:0/1299383146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5592007af480 0x5592007af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.424+0000 7f5206ffd640 1 --2- 172.21.15.78:0/1299383146 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007c4540 0x5592007c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.424+0000 7f52077fe640 1 -- 172.21.15.78:0/1299383146 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007c4540 msgr2=0x5592007c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.424+0000 7f52077fe640 1 --2- 172.21.15.78:0/1299383146 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007c4540 0x5592007c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.424+0000 7f52077fe640 1 -- 172.21.15.78:0/1299383146 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559200473650 con 0x5592007afda0 2024-09-11T00:16:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.424+0000 7f5206ffd640 1 --2- 172.21.15.78:0/1299383146 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007c4540 0x5592007c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:16:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.424+0000 7f5204ff9640 1 -- 172.21.15.78:0/761418467 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f5200107480 con 0x7f5208108020 2024-09-11T00:16:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.425+0000 7f5207fff640 1 --2- 172.21.15.78:0/761418467 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f51f00b53c0 0x7f51f00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:55.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.425+0000 7f5207fff640 1 --2- 172.21.15.78:0/761418467 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f51f00b53c0 0x7f51f00b7880 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f52000c9f90 tx=0x7f52000095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:55.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.425+0000 7f52077fe640 1 --2- 172.21.15.78:0/1299383146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007afda0 0x5592007c4000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009e70 tx=0x7f51f800e5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23ca11ea3f9493a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:55.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.425+0000 7f51edffb640 1 -- 172.21.15.78:0/1299383146 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f8017070 con 0x5592007afda0 2024-09-11T00:16:55.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.426+0000 7f51edffb640 1 -- 172.21.15.78:0/1299383146 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51f8013920 con 0x5592007afda0 2024-09-11T00:16:55.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.426+0000 7f51edffb640 1 -- 172.21.15.78:0/1299383146 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f8012930 con 0x5592007afda0 2024-09-11T00:16:55.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.426+0000 7f52100d3740 1 -- 172.21.15.78:0/1299383146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007afda0 msgr2=0x5592007c4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.426+0000 7f52100d3740 1 --2- 172.21.15.78:0/1299383146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007afda0 0x5592007c4000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009e70 tx=0x7f51f800e5a0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.426+0000 7f52100d3740 1 -- 172.21.15.78:0/1299383146 shutdown_connections 2024-09-11T00:16:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.426+0000 7f52100d3740 1 --2- 172.21.15.78:0/1299383146 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007c4540 0x5592007c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.426+0000 7f52100d3740 1 --2- 172.21.15.78:0/1299383146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007afda0 0x5592007c4000 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.426+0000 7f52100d3740 1 --2- 172.21.15.78:0/1299383146 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5592007af480 0x5592007af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.426+0000 7f52100d3740 1 -- 172.21.15.78:0/1299383146 >> 172.21.15.78:0/1299383146 conn(0x5592007ad2b0 msgr2=0x5592007ae450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.426+0000 7f52100d3740 1 -- 172.21.15.78:0/1299383146 shutdown_connections 2024-09-11T00:16:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.426+0000 7f52100d3740 1 -- 172.21.15.78:0/1299383146 wait complete. 2024-09-11T00:16:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.427+0000 7f52100d3740 1 -- start start 2024-09-11T00:16:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.427+0000 7f52100d3740 1 Processor -- start 2024-09-11T00:16:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.427+0000 7f52100d3740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007af480 0x5592007c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.427+0000 7f52100d3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007afda0 0x5592007c1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.427+0000 7f52100d3740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5592007c4540 0x5592007c1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.427+0000 7f52100d3740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x559200576700 con 0x5592007af480 2024-09-11T00:16:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.427+0000 7f52100d3740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5592006b0110 con 0x5592007c4540 2024-09-11T00:16:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.427+0000 7f52100d3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5592007c71c0 con 0x5592007afda0 2024-09-11T00:16:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.428+0000 7f5206ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007af480 0x5592007c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.428+0000 7f52100d3740 10 client.0 _ll_register_callbacks cb 0x5592006c9990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:16:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.428+0000 7f5206ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007af480 0x5592007c3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40678/0 (socket says 172.21.15.78:40678) 2024-09-11T00:16:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.428+0000 7f5206ffd640 1 -- 172.21.15.78:0/4150056354 learned_addr learned my addr 172.21.15.78:0/4150056354 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.428+0000 7f5206ffd640 1 --2- 172.21.15.78:0/4150056354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5592007c4540 0x5592007c1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.428+0000 7f52077fe640 1 --2- 172.21.15.78:0/4150056354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007afda0 0x5592007c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.428+0000 7f5206ffd640 1 -- 172.21.15.78:0/4150056354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007afda0 msgr2=0x5592007c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.428+0000 7f5206ffd640 1 --2- 172.21.15.78:0/4150056354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007afda0 0x5592007c1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.428+0000 7f5206ffd640 1 -- 172.21.15.78:0/4150056354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5592007c4540 msgr2=0x5592007c1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.428+0000 7f5206ffd640 1 --2- 172.21.15.78:0/4150056354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5592007c4540 0x5592007c1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.428+0000 7f5206ffd640 1 -- 172.21.15.78:0/4150056354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592006ddc40 con 0x5592007af480 2024-09-11T00:16:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.428+0000 7f5206ffd640 1 --2- 172.21.15.78:0/4150056354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007af480 0x5592007c3db0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f51fc019f90 tx=0x7f51fc009590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=333ce875fa904bf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.428+0000 7f51e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:16:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.428+0000 7f51e6ffd640 1 -- 172.21.15.78:0/4150056354 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51fc019220 con 0x5592007af480 2024-09-11T00:16:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.428+0000 7f51e6ffd640 1 -- 172.21.15.78:0/4150056354 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f51fc018450 con 0x5592007af480 2024-09-11T00:16:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.429+0000 7f52100d3740 1 -- 172.21.15.78:0/4150056354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51f8013920 con 0x5592007af480 2024-09-11T00:16:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.429+0000 7f51e6ffd640 1 -- 172.21.15.78:0/4150056354 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f51fc018650 con 0x5592007af480 2024-09-11T00:16:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.429+0000 7f52100d3740 10 client.15420 fetch_fsmap learned FSMap version 20 2024-09-11T00:16:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.429+0000 7f52100d3740 1 -- 172.21.15.78:0/4150056354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5592007d2a40 con 0x5592007af480 2024-09-11T00:16:55.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.429+0000 7f51e6ffd640 1 -- 172.21.15.78:0/4150056354 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51f8013920 con 0x5592007af480 2024-09-11T00:16:55.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.429+0000 7f51e6ffd640 1 -- 172.21.15.78:0/4150056354 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f51fc015640 con 0x5592007af480 2024-09-11T00:16:55.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.429+0000 7f52100d3740 10 client.15420 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:16:55.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.429+0000 7f52100d3740 10 client.15420 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:16:55.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.429+0000 7f52100d3740 20 client.15420 populate_metadata read hostname 'smithi078' 2024-09-11T00:16:55.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.429+0000 7f52100d3740 1 --2- 172.21.15.78:0/4150056354 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5592007d3f50 0x5592007d6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:55.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.429+0000 7f52100d3740 4 client.15420 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:16:55.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.429+0000 7f52100d3740 1 -- 172.21.15.78:0/4150056354 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559200727da0 con 0x5592007d3f50 2024-09-11T00:16:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.430+0000 7f52077fe640 1 --2- 172.21.15.78:0/4150056354 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5592007d3f50 0x5592007d6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.430+0000 7f52077fe640 1 --2- 172.21.15.78:0/4150056354 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5592007d3f50 0x5592007d6340 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30783c27098a0d4a server_cookie=288881ee11f305ac in_seq=0 out_seq=0 2024-09-11T00:16:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.430+0000 7f51e6ffd640 10 client.15420 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.431+0000 7f51e6ffd640 1 -- 172.21.15.78:0/4150056354 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559200727da0 con 0x5592007d3f50 2024-09-11T00:16:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.431+0000 7f51e6ffd640 10 client.15420 handle_command_reply: tid=0 2024-09-11T00:16:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.431+0000 7f52100d3740 1 client.15420 shutdown 2024-09-11T00:16:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.431+0000 7f52100d3740 1 -- 172.21.15.78:0/4150056354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007af480 msgr2=0x5592007c3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.431+0000 7f52100d3740 1 --2- 172.21.15.78:0/4150056354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007af480 0x5592007c3db0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f51fc019f90 tx=0x7f51fc009590 comp rx=0 tx=0).stop 2024-09-11T00:16:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.431+0000 7f52100d3740 1 -- 172.21.15.78:0/4150056354 shutdown_connections 2024-09-11T00:16:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.431+0000 7f52100d3740 1 --2- 172.21.15.78:0/4150056354 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5592007d3f50 0x5592007d6340 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.431+0000 7f52100d3740 1 --2- 172.21.15.78:0/4150056354 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5592007c4540 0x5592007c1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.431+0000 7f52100d3740 1 --2- 172.21.15.78:0/4150056354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007afda0 0x5592007c1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.431+0000 7f52100d3740 1 --2- 172.21.15.78:0/4150056354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007af480 0x5592007c3db0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.431+0000 7f52100d3740 1 -- 172.21.15.78:0/4150056354 >> 172.21.15.78:0/4150056354 conn(0x5592007ad2b0 msgr2=0x5592007b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:55.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.431+0000 7f51e6ffd640 0 client.15420 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:55.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.432+0000 7f52100d3740 1 -- 172.21.15.78:0/4150056354 shutdown_connections 2024-09-11T00:16:55.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.432+0000 7f52100d3740 1 -- 172.21.15.78:0/4150056354 wait complete. 2024-09-11T00:16:55.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.432+0000 7f52100d3740 20 client.15420 trim_cache size 0 max 16384 2024-09-11T00:16:55.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.449+0000 7f52100d3740 1 Processor -- start 2024-09-11T00:16:55.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.449+0000 7f52100d3740 1 -- start start 2024-09-11T00:16:55.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.450+0000 7f52100d3740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007af480 0x5592007d03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:55.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.450+0000 7f52100d3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007afda0 0x5592007a82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:55.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.450+0000 7f52100d3740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5592007c4540 0x5592007bfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:55.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.450+0000 7f52100d3740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f52081aa600 con 0x5592007af480 2024-09-11T00:16:55.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.450+0000 7f52100d3740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f52081ace80 con 0x5592007c4540 2024-09-11T00:16:55.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.450+0000 7f52100d3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f52081aac70 con 0x5592007afda0 2024-09-11T00:16:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.450+0000 7f52077fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007afda0 0x5592007a82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.450+0000 7f5206ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007af480 0x5592007d03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.450+0000 7f52077fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007afda0 0x5592007a82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.78:57408/0 (socket says 172.21.15.78:57408) 2024-09-11T00:16:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.450+0000 7f52077fe640 1 -- 172.21.15.78:0/2486002326 learned_addr learned my addr 172.21.15.78:0/2486002326 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.450+0000 7f5206ffd640 1 -- 172.21.15.78:0/2486002326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007afda0 msgr2=0x5592007a82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.450+0000 7f5206ffd640 1 --2- 172.21.15.78:0/2486002326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007afda0 0x5592007a82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.450+0000 7f5206ffd640 1 -- 172.21.15.78:0/2486002326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5592007c4540 msgr2=0x5592007bfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.450+0000 7f5206ffd640 1 --2- 172.21.15.78:0/2486002326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5592007c4540 0x5592007bfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.450+0000 7f5206ffd640 1 -- 172.21.15.78:0/2486002326 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592007adf90 con 0x5592007af480 2024-09-11T00:16:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.450+0000 7f5206ffd640 1 --2- 172.21.15.78:0/2486002326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007af480 0x5592007d03f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f51fc019900 tx=0x7f51fc009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278d043f97f064b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.451+0000 7f51ed7fa640 1 -- 172.21.15.78:0/2486002326 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51fc028030 con 0x5592007af480 2024-09-11T00:16:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.451+0000 7f51ed7fa640 1 -- 172.21.15.78:0/2486002326 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51fc018450 con 0x5592007af480 2024-09-11T00:16:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.451+0000 7f51ed7fa640 1 -- 172.21.15.78:0/2486002326 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51fc02c500 con 0x5592007af480 2024-09-11T00:16:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.452+0000 7f52100d3740 1 -- 172.21.15.78:0/2486002326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007af480 msgr2=0x5592007d03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.452+0000 7f52100d3740 1 --2- 172.21.15.78:0/2486002326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007af480 0x5592007d03f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f51fc019900 tx=0x7f51fc009c40 comp rx=0 tx=0).stop 2024-09-11T00:16:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.452+0000 7f52100d3740 1 -- 172.21.15.78:0/2486002326 shutdown_connections 2024-09-11T00:16:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.452+0000 7f52100d3740 1 --2- 172.21.15.78:0/2486002326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5592007c4540 0x5592007bfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.452+0000 7f52100d3740 1 --2- 172.21.15.78:0/2486002326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007afda0 0x5592007a82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.452+0000 7f52100d3740 1 --2- 172.21.15.78:0/2486002326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007af480 0x5592007d03f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.452+0000 7f52100d3740 1 -- 172.21.15.78:0/2486002326 >> 172.21.15.78:0/2486002326 conn(0x5592007ad2b0 msgr2=0x5592007c6300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.452+0000 7f52100d3740 1 -- 172.21.15.78:0/2486002326 shutdown_connections 2024-09-11T00:16:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.452+0000 7f52100d3740 1 -- 172.21.15.78:0/2486002326 wait complete. 2024-09-11T00:16:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.452+0000 7f52100d3740 1 -- start start 2024-09-11T00:16:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.452+0000 7f52100d3740 1 Processor -- start 2024-09-11T00:16:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.453+0000 7f52100d3740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5592007af480 0x5592007dbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.453+0000 7f52100d3740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007afda0 0x5592007dc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.453+0000 7f52100d3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007c4540 0x5592007dc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.453+0000 7f52100d3740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f52081ab340 con 0x5592007afda0 2024-09-11T00:16:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.453+0000 7f52100d3740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f52081ac7b0 con 0x5592007af480 2024-09-11T00:16:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.453+0000 7f52100d3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f52081aba10 con 0x5592007c4540 2024-09-11T00:16:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.453+0000 7f52100d3740 10 client.0 _ll_register_callbacks cb 0x7f51fc009970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:16:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.453+0000 7f52077fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007afda0 0x5592007dc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.453+0000 7f5206ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5592007af480 0x5592007dbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.453+0000 7f52077fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007afda0 0x5592007dc000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40708/0 (socket says 172.21.15.78:40708) 2024-09-11T00:16:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.453+0000 7f52077fe640 1 -- 172.21.15.78:0/2583795389 learned_addr learned my addr 172.21.15.78:0/2583795389 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:16:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.453+0000 7f5206ffd640 1 --2- 172.21.15.78:0/2583795389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007c4540 0x5592007dc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.453+0000 7f5206ffd640 1 -- 172.21.15.78:0/2583795389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007c4540 msgr2=0x5592007dc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.453+0000 7f5206ffd640 1 --2- 172.21.15.78:0/2583795389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007c4540 0x5592007dc540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.453+0000 7f5206ffd640 1 -- 172.21.15.78:0/2583795389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007afda0 msgr2=0x5592007dc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:16:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.453+0000 7f5206ffd640 1 --2- 172.21.15.78:0/2583795389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007afda0 0x5592007dc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.453+0000 7f5206ffd640 1 -- 172.21.15.78:0/2583795389 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55920083fe30 con 0x5592007af480 2024-09-11T00:16:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.454+0000 7f5206ffd640 1 --2- 172.21.15.78:0/2583795389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5592007af480 0x5592007dbac0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f51fc015c00 tx=0x7f51fc019f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebf6368133138876 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:16:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.454+0000 7f51e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-11T00:16:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.454+0000 7f51e6ffd640 1 -- 172.21.15.78:0/2583795389 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51fc028040 con 0x5592007af480 2024-09-11T00:16:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.454+0000 7f51e6ffd640 1 -- 172.21.15.78:0/2583795389 <== mon.2 v2:172.21.15.112:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f51fc009a20 con 0x5592007af480 2024-09-11T00:16:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.454+0000 7f52100d3740 1 -- 172.21.15.78:0/2583795389 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51fc018450 con 0x5592007af480 2024-09-11T00:16:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.454+0000 7f51e6ffd640 1 -- 172.21.15.78:0/2583795389 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f51fc015c80 con 0x5592007af480 2024-09-11T00:16:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.454+0000 7f52100d3740 10 client.24959 fetch_fsmap learned FSMap version 20 2024-09-11T00:16:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.454+0000 7f52100d3740 1 -- 172.21.15.78:0/2583795389 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559200841120 con 0x5592007af480 2024-09-11T00:16:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.455+0000 7f51e6ffd640 1 -- 172.21.15.78:0/2583795389 <== mon.2 v2:172.21.15.112:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51fc018450 con 0x5592007af480 2024-09-11T00:16:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.455+0000 7f51e6ffd640 1 -- 172.21.15.78:0/2583795389 <== mon.2 v2:172.21.15.112:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f51fc035a60 con 0x5592007af480 2024-09-11T00:16:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.455+0000 7f52100d3740 10 client.24959 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:16:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.455+0000 7f52100d3740 10 client.24959 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:16:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.455+0000 7f52100d3740 20 client.24959 populate_metadata read hostname 'smithi078' 2024-09-11T00:16:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.455+0000 7f52100d3740 1 --2- 172.21.15.78:0/2583795389 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x559200841720 0x559200843b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:16:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.455+0000 7f52100d3740 4 client.24959 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:16:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.455+0000 7f52100d3740 1 -- 172.21.15.78:0/2583795389 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559200723850 con 0x559200841720 2024-09-11T00:16:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.455+0000 7f52077fe640 1 --2- 172.21.15.78:0/2583795389 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x559200841720 0x559200843b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:16:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.456+0000 7f52077fe640 1 --2- 172.21.15.78:0/2583795389 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x559200841720 0x559200843b10 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed67f5035271632b server_cookie=f37c42e8f82c5e3e in_seq=0 out_seq=0 2024-09-11T00:16:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.456+0000 7f51e6ffd640 10 client.24959 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.456+0000 7f51e6ffd640 1 -- 172.21.15.78:0/2583795389 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x559200723850 con 0x559200841720 2024-09-11T00:16:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.456+0000 7f51e6ffd640 10 client.24959 handle_command_reply: tid=0 2024-09-11T00:16:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.456+0000 7f52100d3740 1 client.24959 shutdown 2024-09-11T00:16:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.456+0000 7f52100d3740 1 -- 172.21.15.78:0/2583795389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5592007af480 msgr2=0x5592007dbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.456+0000 7f52100d3740 1 --2- 172.21.15.78:0/2583795389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5592007af480 0x5592007dbac0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f51fc015c00 tx=0x7f51fc019f20 comp rx=0 tx=0).stop 2024-09-11T00:16:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.456+0000 7f52100d3740 1 -- 172.21.15.78:0/2583795389 shutdown_connections 2024-09-11T00:16:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.456+0000 7f52100d3740 1 --2- 172.21.15.78:0/2583795389 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x559200841720 0x559200843b10 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.456+0000 7f52100d3740 1 --2- 172.21.15.78:0/2583795389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5592007c4540 0x5592007dc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.456+0000 7f52100d3740 1 --2- 172.21.15.78:0/2583795389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5592007afda0 0x5592007dc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.456+0000 7f52100d3740 1 --2- 172.21.15.78:0/2583795389 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5592007af480 0x5592007dbac0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.456+0000 7f52100d3740 1 -- 172.21.15.78:0/2583795389 >> 172.21.15.78:0/2583795389 conn(0x5592007ad2b0 msgr2=0x5592007bfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:55.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.457+0000 7f51e6ffd640 0 client.24959 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:16:55.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.457+0000 7f52100d3740 1 -- 172.21.15.78:0/2583795389 shutdown_connections 2024-09-11T00:16:55.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.457+0000 7f52100d3740 1 -- 172.21.15.78:0/2583795389 wait complete. 2024-09-11T00:16:55.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.457+0000 7f52100d3740 20 client.24959 trim_cache size 0 max 16384 2024-09-11T00:16:55.462 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:16:55.462 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:16:55.462 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-11T00:16:55.462 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:16:55.463 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:16:55.463 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "6289bc2a-a628-43bc-9b8b-2559c2c49db7", 2024-09-11T00:16:55.463 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-11T00:16:55.463 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:16:55.463 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:16:55.463 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:16:55.463 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:16:55.463 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:16:55.463 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:16:55.463 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:16:55.463 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:16:55.463 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:16:55.463 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:16:55.464 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:16:55.464 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:16:55.464 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:16:55.464 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:16:55.464 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:16:55.464 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:16:55.464 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:16:55.464 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:16:55.464 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:16:55.464 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:16:55.464 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:16:55.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.457+0000 7f520dcfe640 1 -- 172.21.15.78:0/761418467 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f51f00b53c0 msgr2=0x7f51f00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:55.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.457+0000 7f520dcfe640 1 --2- 172.21.15.78:0/761418467 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f51f00b53c0 0x7f51f00b7880 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f52000c9f90 tx=0x7f52000095c0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.457+0000 7f520dcfe640 1 -- 172.21.15.78:0/761418467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5208108020 msgr2=0x7f520819db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:16:55.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.457+0000 7f520dcfe640 1 --2- 172.21.15.78:0/761418467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5208108020 0x7f520819db90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5200005cc0 tx=0x7f520002f470 comp rx=0 tx=0).stop 2024-09-11T00:16:55.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.458+0000 7f520dcfe640 1 -- 172.21.15.78:0/761418467 shutdown_connections 2024-09-11T00:16:55.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.458+0000 7f520dcfe640 1 --2- 172.21.15.78:0/761418467 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f51f00b53c0 0x7f51f00b7880 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.458+0000 7f520dcfe640 1 --2- 172.21.15.78:0/761418467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5208108020 0x7f520819db90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.458+0000 7f520dcfe640 1 --2- 172.21.15.78:0/761418467 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f52081076a0 0x7f52081987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.458+0000 7f520dcfe640 1 --2- 172.21.15.78:0/761418467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5208101c90 0x7f52081982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:16:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.458+0000 7f520dcfe640 1 -- 172.21.15.78:0/761418467 >> 172.21.15.78:0/761418467 conn(0x7f52080fd700 msgr2=0x7f52080ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:16:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.458+0000 7f520dcfe640 1 -- 172.21.15.78:0/761418467 shutdown_connections 2024-09-11T00:16:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:16:55.458+0000 7f520dcfe640 1 -- 172.21.15.78:0/761418467 wait complete. 2024-09-11T00:16:56.162 INFO:tasks.cephfs.filesystem:scrub status for tag:6289bc2a-a628-43bc-9b8b-2559c2c49db7 - {'path': '/', 'tag': '6289bc2a-a628-43bc-9b8b-2559c2c49db7', 'options': 'recursive,force'} 2024-09-11T00:16:57.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:56 smithi138 ceph-mon[35019]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-11T00:16:57.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:56 smithi138 ceph-mon[35019]: scrub summary: idle 2024-09-11T00:16:57.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:56 smithi078 ceph-mon[30865]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-11T00:16:57.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:56 smithi078 ceph-mon[30865]: scrub summary: idle 2024-09-11T00:16:57.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:56 smithi112 ceph-mon[35627]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-11T00:16:57.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:56 smithi112 ceph-mon[35627]: scrub summary: idle 2024-09-11T00:16:59.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:58 smithi138 ceph-mon[35019]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-11T00:16:59.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:58 smithi078 ceph-mon[30865]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-11T00:16:59.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:58 smithi112 ceph-mon[35627]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-11T00:17:00.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:16:59 smithi112 ceph-mon[35627]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-11T00:17:00.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:16:59 smithi138 ceph-mon[35019]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-11T00:17:00.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:16:59 smithi078 ceph-mon[30865]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-11T00:17:01.334 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:17:00 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: 2024-09-11T00:17:00.954+0000 7f36b11da640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:17:01.334 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:17:00 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: 2024-09-11T00:17:00.954+0000 7f36b11da640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:17:01.334 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:17:00 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: 2024-09-11T00:17:00.954+0000 7f36b11da640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:17:01.334 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:17:00 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: 2024-09-11T00:17:00.954+0000 7f36b11da640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:17:01.334 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:17:00 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: 2024-09-11T00:17:00.954+0000 7f36b11da640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T00:17:03.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:02 smithi138 ceph-mon[35019]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-11T00:17:03.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:02 smithi078 ceph-mon[30865]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-11T00:17:03.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:02 smithi112 ceph-mon[35627]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-11T00:17:04.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:03 smithi138 ceph-mon[35019]: mgrmap e24: x(active, since 9m), standbys: z, y 2024-09-11T00:17:04.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:03 smithi078 ceph-mon[30865]: mgrmap e24: x(active, since 9m), standbys: z, y 2024-09-11T00:17:04.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:03 smithi112 ceph-mon[35627]: mgrmap e24: x(active, since 9m), standbys: z, y 2024-09-11T00:17:05.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:04 smithi138 ceph-mon[35019]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-11T00:17:05.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:04 smithi078 ceph-mon[30865]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-11T00:17:05.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:04 smithi112 ceph-mon[35627]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-11T00:17:06.440 INFO:tasks.workunit.client.0.smithi078.stderr:Note: switching to '8f219c476cb4f26fc5719c661c0323719a45cb30'. 2024-09-11T00:17:06.440 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-11T00:17:06.440 INFO:tasks.workunit.client.0.smithi078.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-11T00:17:06.440 INFO:tasks.workunit.client.0.smithi078.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-11T00:17:06.440 INFO:tasks.workunit.client.0.smithi078.stderr:state without impacting any branches by switching back to a branch. 2024-09-11T00:17:06.440 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-11T00:17:06.440 INFO:tasks.workunit.client.0.smithi078.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-11T00:17:06.441 INFO:tasks.workunit.client.0.smithi078.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-11T00:17:06.441 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-11T00:17:06.441 INFO:tasks.workunit.client.0.smithi078.stderr: git switch -c 2024-09-11T00:17:06.441 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-11T00:17:06.441 INFO:tasks.workunit.client.0.smithi078.stderr:Or undo this operation with: 2024-09-11T00:17:06.441 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-11T00:17:06.441 INFO:tasks.workunit.client.0.smithi078.stderr: git switch - 2024-09-11T00:17:06.441 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-11T00:17:06.442 INFO:tasks.workunit.client.0.smithi078.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-11T00:17:06.442 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-11T00:17:06.442 INFO:tasks.workunit.client.0.smithi078.stderr:HEAD is now at 8f219c476cb Merge branch 'mgr-vol-mod-disable' of https://github.com/rishabh-d-dave/ceph into wip-hemanth-testing-2024-09-10-0723 2024-09-11T00:17:06.444 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-11T00:17:06.466 INFO:tasks.workunit.client.0.smithi078.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-11T00:17:06.469 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T00:17:06.469 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-11T00:17:07.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:06 smithi138 ceph-mon[35019]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-11T00:17:07.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:06 smithi078 ceph-mon[30865]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-11T00:17:07.131 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-11T00:17:07.206 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-11T00:17:07.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:06 smithi112 ceph-mon[35627]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-11T00:17:07.247 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T00:17:07.248 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T00:17:07.249 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-11T00:17:07.287 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T00:17:07.290 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-11T00:17:07.290 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-11T00:17:07.346 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-11T00:17:07.348 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-11T00:17:07.348 DEBUG:teuthology.orchestra.run.smithi078:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8f219c476cb4f26fc5719c661c0323719a45cb30 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-11T00:17:07.407 INFO:tasks.workunit.client.0.smithi078.stderr:+ mkdir -p fsstress 2024-09-11T00:17:07.409 INFO:tasks.workunit.client.0.smithi078.stderr:+ pushd fsstress 2024-09-11T00:17:07.409 INFO:tasks.workunit.client.0.smithi078.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-11T00:17:07.409 INFO:tasks.workunit.client.0.smithi078.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-11T00:17:07.941 INFO:tasks.workunit.client.0.smithi078.stderr:+ tar xzf ltp-full.tgz 2024-09-11T00:17:09.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:08 smithi138 ceph-mon[35019]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:17:09.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:08 smithi078 ceph-mon[30865]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:17:09.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:08 smithi112 ceph-mon[35627]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:17:11.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:10 smithi078 ceph-mon[30865]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:17:11.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:10 smithi112 ceph-mon[35627]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:17:11.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:10 smithi138 ceph-mon[35019]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:17:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:11 smithi078 ceph-mon[30865]: pgmap v345: 97 pgs: 97 active+clean; 4.5 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 310 KiB/s wr, 19 op/s 2024-09-11T00:17:12.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:11 smithi112 ceph-mon[35627]: pgmap v345: 97 pgs: 97 active+clean; 4.5 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 310 KiB/s wr, 19 op/s 2024-09-11T00:17:12.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:11 smithi138 ceph-mon[35019]: pgmap v345: 97 pgs: 97 active+clean; 4.5 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 310 KiB/s wr, 19 op/s 2024-09-11T00:17:15.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:14 smithi138 ceph-mon[35019]: pgmap v346: 97 pgs: 97 active+clean; 6.2 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 476 KiB/s wr, 48 op/s 2024-09-11T00:17:15.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:14 smithi078 ceph-mon[30865]: pgmap v346: 97 pgs: 97 active+clean; 6.2 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 476 KiB/s wr, 48 op/s 2024-09-11T00:17:15.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:14 smithi112 ceph-mon[35627]: pgmap v346: 97 pgs: 97 active+clean; 6.2 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 476 KiB/s wr, 48 op/s 2024-09-11T00:17:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:16 smithi138 ceph-mon[35019]: pgmap v347: 97 pgs: 97 active+clean; 23 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 1.9 MiB/s wr, 149 op/s 2024-09-11T00:17:17.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:16 smithi078 ceph-mon[30865]: pgmap v347: 97 pgs: 97 active+clean; 23 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 1.9 MiB/s wr, 149 op/s 2024-09-11T00:17:17.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:16 smithi112 ceph-mon[35627]: pgmap v347: 97 pgs: 97 active+clean; 23 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 1.9 MiB/s wr, 149 op/s 2024-09-11T00:17:19.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:18 smithi138 ceph-mon[35019]: pgmap v348: 97 pgs: 97 active+clean; 30 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 989 KiB/s rd, 2.5 MiB/s wr, 194 op/s 2024-09-11T00:17:19.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:18 smithi078 ceph-mon[30865]: pgmap v348: 97 pgs: 97 active+clean; 30 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 989 KiB/s rd, 2.5 MiB/s wr, 194 op/s 2024-09-11T00:17:19.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:18 smithi112 ceph-mon[35627]: pgmap v348: 97 pgs: 97 active+clean; 30 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 989 KiB/s rd, 2.5 MiB/s wr, 194 op/s 2024-09-11T00:17:21.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:20 smithi138 ceph-mon[35019]: pgmap v349: 97 pgs: 97 active+clean; 34 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.9 MiB/s wr, 226 op/s 2024-09-11T00:17:21.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:20 smithi078 ceph-mon[30865]: pgmap v349: 97 pgs: 97 active+clean; 34 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.9 MiB/s wr, 226 op/s 2024-09-11T00:17:21.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:20 smithi112 ceph-mon[35627]: pgmap v349: 97 pgs: 97 active+clean; 34 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.9 MiB/s wr, 226 op/s 2024-09-11T00:17:23.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:22 smithi138 ceph-mon[35019]: pgmap v350: 97 pgs: 97 active+clean; 37 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 236 op/s 2024-09-11T00:17:23.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:22 smithi078 ceph-mon[30865]: pgmap v350: 97 pgs: 97 active+clean; 37 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 236 op/s 2024-09-11T00:17:23.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:22 smithi112 ceph-mon[35627]: pgmap v350: 97 pgs: 97 active+clean; 37 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 236 op/s 2024-09-11T00:17:25.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:24 smithi138 ceph-mon[35019]: pgmap v351: 97 pgs: 97 active+clean; 37 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 233 op/s 2024-09-11T00:17:25.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:24 smithi078 ceph-mon[30865]: pgmap v351: 97 pgs: 97 active+clean; 37 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 233 op/s 2024-09-11T00:17:25.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:24 smithi112 ceph-mon[35627]: pgmap v351: 97 pgs: 97 active+clean; 37 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 233 op/s 2024-09-11T00:17:26.163 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:17:26.433 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:17:26.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:26 smithi078 ceph-mon[30865]: pgmap v352: 97 pgs: 97 active+clean; 41 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 209 op/s 2024-09-11T00:17:26.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.951+0000 7f89a19b9640 1 -- 172.21.15.78:0/3128799415 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f899c1045c0 msgr2=0x7f899c10cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:26.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.951+0000 7f89a19b9640 1 --2- 172.21.15.78:0/3128799415 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f899c1045c0 0x7f899c10cab0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8990009900 tx=0x7f899002a410 comp rx=0 tx=0).stop 2024-09-11T00:17:26.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.951+0000 7f89a19b9640 1 -- 172.21.15.78:0/3128799415 shutdown_connections 2024-09-11T00:17:26.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.951+0000 7f89a19b9640 1 --2- 172.21.15.78:0/3128799415 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f899c10d100 0x7f899c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.951+0000 7f89a19b9640 1 --2- 172.21.15.78:0/3128799415 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f899c1045c0 0x7f899c10cab0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.951+0000 7f89a19b9640 1 --2- 172.21.15.78:0/3128799415 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f899c103ca0 0x7f899c104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.951+0000 7f89a19b9640 1 -- 172.21.15.78:0/3128799415 >> 172.21.15.78:0/3128799415 conn(0x7f899c0fd700 msgr2=0x7f899c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:26.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.951+0000 7f89a19b9640 1 -- 172.21.15.78:0/3128799415 shutdown_connections 2024-09-11T00:17:26.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.951+0000 7f89a19b9640 1 -- 172.21.15.78:0/3128799415 wait complete. 2024-09-11T00:17:26.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.951+0000 7f89a19b9640 1 Processor -- start 2024-09-11T00:17:26.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.952+0000 7f89a19b9640 1 -- start start 2024-09-11T00:17:26.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.952+0000 7f89a19b9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f899c103ca0 0x7f899c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:26.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.952+0000 7f89a19b9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f899c1045c0 0x7f899c199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:26.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.952+0000 7f89a19b9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f899c10d100 0x7f899c19ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.952+0000 7f89a19b9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f899c112d70 con 0x7f899c10d100 2024-09-11T00:17:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.952+0000 7f89a19b9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f899c112bf0 con 0x7f899c103ca0 2024-09-11T00:17:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.952+0000 7f89a19b9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f899c112ef0 con 0x7f899c1045c0 2024-09-11T00:17:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.952+0000 7f899b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f899c10d100 0x7f899c19ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.952+0000 7f899affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f899c103ca0 0x7f899c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.952+0000 7f899b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f899c10d100 0x7f899c19ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49104/0 (socket says 172.21.15.78:49104) 2024-09-11T00:17:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.952+0000 7f899b7fe640 1 -- 172.21.15.78:0/3791316295 learned_addr learned my addr 172.21.15.78:0/3791316295 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:17:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.952+0000 7f899a7fc640 1 --2- 172.21.15.78:0/3791316295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f899c1045c0 0x7f899c199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.952+0000 7f899b7fe640 1 -- 172.21.15.78:0/3791316295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f899c1045c0 msgr2=0x7f899c199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.952+0000 7f899b7fe640 1 --2- 172.21.15.78:0/3791316295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f899c1045c0 0x7f899c199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.952+0000 7f899b7fe640 1 -- 172.21.15.78:0/3791316295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f899c103ca0 msgr2=0x7f899c1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:26.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.952+0000 7f899b7fe640 1 --2- 172.21.15.78:0/3791316295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f899c103ca0 0x7f899c1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.952+0000 7f899b7fe640 1 -- 172.21.15.78:0/3791316295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899c19f390 con 0x7f899c10d100 2024-09-11T00:17:26.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.952+0000 7f899a7fc640 1 --2- 172.21.15.78:0/3791316295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f899c1045c0 0x7f899c199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:17:26.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.952+0000 7f899affd640 1 --2- 172.21.15.78:0/3791316295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f899c103ca0 0x7f899c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:17:26.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.953+0000 7f899b7fe640 1 --2- 172.21.15.78:0/3791316295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f899c10d100 0x7f899c19ebc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8994009fd0 tx=0x7f899400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:26.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.953+0000 7f89a09b7640 1 -- 172.21.15.78:0/3791316295 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8994017070 con 0x7f899c10d100 2024-09-11T00:17:26.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.953+0000 7f89a19b9640 1 -- 172.21.15.78:0/3791316295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f899c19f680 con 0x7f899c10d100 2024-09-11T00:17:26.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.953+0000 7f89a09b7640 1 -- 172.21.15.78:0/3791316295 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8994003e20 con 0x7f899c10d100 2024-09-11T00:17:26.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.953+0000 7f89a09b7640 1 -- 172.21.15.78:0/3791316295 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8994010460 con 0x7f899c10d100 2024-09-11T00:17:26.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.953+0000 7f89a19b9640 1 -- 172.21.15.78:0/3791316295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f899c1a5d40 con 0x7f899c10d100 2024-09-11T00:17:26.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.956+0000 7f89a09b7640 1 -- 172.21.15.78:0/3791316295 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f89940106e0 con 0x7f899c10d100 2024-09-11T00:17:26.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.956+0000 7f89a3d8e740 1 Processor -- start 2024-09-11T00:17:26.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.956+0000 7f89a3d8e740 1 -- start start 2024-09-11T00:17:26.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.956+0000 7f89a3d8e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b41e480 0x564f1b41e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:26.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.956+0000 7f89a3d8e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41eda0 0x564f1b42a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:26.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.956+0000 7f89a3d8e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b42ad30 0x564f1b42d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:26.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.956+0000 7f89a3d8e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x564f1b394e50 con 0x564f1b41e480 2024-09-11T00:17:26.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.956+0000 7f89a3d8e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564f1b384280 con 0x564f1b42ad30 2024-09-11T00:17:26.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.956+0000 7f89a3d8e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564f1b388090 con 0x564f1b41eda0 2024-09-11T00:17:26.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.956+0000 7f899a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b41e480 0x564f1b41e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:26.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.956+0000 7f899a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b41e480 0x564f1b41e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49112/0 (socket says 172.21.15.78:49112) 2024-09-11T00:17:26.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.956+0000 7f899a7fc640 1 -- 172.21.15.78:0/913115026 learned_addr learned my addr 172.21.15.78:0/913115026 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:17:26.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.956+0000 7f899a7fc640 1 --2- 172.21.15.78:0/913115026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b42ad30 0x564f1b42d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:26.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.956+0000 7f899affd640 1 --2- 172.21.15.78:0/913115026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41eda0 0x564f1b42a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:26.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.957+0000 7f89a09b7640 1 --2- 172.21.15.78:0/3791316295 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f89840b5450 0x7f89840b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:26.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.957+0000 7f899a7fc640 1 -- 172.21.15.78:0/913115026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41eda0 msgr2=0x564f1b42a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:26.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.957+0000 7f899a7fc640 1 --2- 172.21.15.78:0/913115026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41eda0 0x564f1b42a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.957+0000 7f899a7fc640 1 -- 172.21.15.78:0/913115026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b42ad30 msgr2=0x564f1b42d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:26.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.957+0000 7f899a7fc640 1 --2- 172.21.15.78:0/913115026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b42ad30 0x564f1b42d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.957+0000 7f899a7fc640 1 -- 172.21.15.78:0/913115026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f1b0e2650 con 0x564f1b41e480 2024-09-11T00:17:26.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.957+0000 7f89a09b7640 1 -- 172.21.15.78:0/3791316295 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f89940e5db0 con 0x7f899c10d100 2024-09-11T00:17:26.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.957+0000 7f899b7fe640 1 --2- 172.21.15.78:0/3791316295 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f89840b5450 0x7f89840b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:26.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.957+0000 7f899a7fc640 1 --2- 172.21.15.78:0/913115026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b41e480 0x564f1b41e860 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8990000c00 tx=0x7f8990005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=342fd2c20eaceae8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:26.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.957+0000 7f8981ffb640 1 -- 172.21.15.78:0/913115026 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8990035070 con 0x564f1b41e480 2024-09-11T00:17:26.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.957+0000 7f8981ffb640 1 -- 172.21.15.78:0/913115026 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8990005070 con 0x564f1b41e480 2024-09-11T00:17:26.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.957+0000 7f8981ffb640 1 -- 172.21.15.78:0/913115026 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89900044e0 con 0x564f1b41e480 2024-09-11T00:17:26.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.958+0000 7f89a3d8e740 1 -- 172.21.15.78:0/913115026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b41e480 msgr2=0x564f1b41e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:26.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.958+0000 7f89a3d8e740 1 --2- 172.21.15.78:0/913115026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b41e480 0x564f1b41e860 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8990000c00 tx=0x7f8990005bc0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.958+0000 7f899b7fe640 1 --2- 172.21.15.78:0/3791316295 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f89840b5450 0x7f89840b7910 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f89940a8820 tx=0x7f8994004020 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:26.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.958+0000 7f89a3d8e740 1 -- 172.21.15.78:0/913115026 shutdown_connections 2024-09-11T00:17:26.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.958+0000 7f89a3d8e740 1 --2- 172.21.15.78:0/913115026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b42ad30 0x564f1b42d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.958+0000 7f89a3d8e740 1 --2- 172.21.15.78:0/913115026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41eda0 0x564f1b42a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.958+0000 7f89a3d8e740 1 --2- 172.21.15.78:0/913115026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b41e480 0x564f1b41e860 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.958+0000 7f89a3d8e740 1 -- 172.21.15.78:0/913115026 >> 172.21.15.78:0/913115026 conn(0x564f1b41c2b0 msgr2=0x564f1b41d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:26.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.958+0000 7f89a3d8e740 1 -- 172.21.15.78:0/913115026 shutdown_connections 2024-09-11T00:17:26.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.958+0000 7f89a3d8e740 1 -- 172.21.15.78:0/913115026 wait complete. 2024-09-11T00:17:26.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.959+0000 7f89a3d8e740 1 -- start start 2024-09-11T00:17:26.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.959+0000 7f89a3d8e740 1 Processor -- start 2024-09-11T00:17:26.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.959+0000 7f89a3d8e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41e480 0x564f1b42a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:26.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.959+0000 7f89a3d8e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b41eda0 0x564f1b427a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:26.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.959+0000 7f89a3d8e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b42ad30 0x564f1b4280c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:26.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.959+0000 7f89a3d8e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x564f1b1e5700 con 0x564f1b42ad30 2024-09-11T00:17:26.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.959+0000 7f89a3d8e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564f1b31f110 con 0x564f1b41eda0 2024-09-11T00:17:26.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.959+0000 7f89a3d8e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564f1b42d950 con 0x564f1b41e480 2024-09-11T00:17:26.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.959+0000 7f89a3d8e740 10 client.0 _ll_register_callbacks cb 0x564f1b338990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:17:26.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.959+0000 7f899affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b41eda0 0x564f1b427a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:26.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.959+0000 7f899a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b42ad30 0x564f1b4280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:26.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.959+0000 7f899affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b41eda0 0x564f1b427a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.78:56738/0 (socket says 172.21.15.78:56738) 2024-09-11T00:17:26.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.959+0000 7f899affd640 1 -- 172.21.15.78:0/1286314697 learned_addr learned my addr 172.21.15.78:0/1286314697 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:17:26.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.959+0000 7f899a7fc640 1 --2- 172.21.15.78:0/1286314697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41e480 0x564f1b42a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:26.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.960+0000 7f899affd640 1 -- 172.21.15.78:0/1286314697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41e480 msgr2=0x564f1b42a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:26.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.960+0000 7f899affd640 1 --2- 172.21.15.78:0/1286314697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41e480 0x564f1b42a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.960+0000 7f899affd640 1 -- 172.21.15.78:0/1286314697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b42ad30 msgr2=0x564f1b4280c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:26.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.960+0000 7f899affd640 1 --2- 172.21.15.78:0/1286314697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b42ad30 0x564f1b4280c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.960+0000 7f899affd640 1 -- 172.21.15.78:0/1286314697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f1b34cc40 con 0x564f1b41eda0 2024-09-11T00:17:26.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.960+0000 7f899a7fc640 1 --2- 172.21.15.78:0/1286314697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41e480 0x564f1b42a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:17:26.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.960+0000 7f899affd640 1 --2- 172.21.15.78:0/1286314697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b41eda0 0x564f1b427a90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f898c012d20 tx=0x7f898c00f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc573d15957cb8be server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:26.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.960+0000 7f897affd640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-11T00:17:26.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.960+0000 7f897affd640 1 -- 172.21.15.78:0/1286314697 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c0120d0 con 0x564f1b41eda0 2024-09-11T00:17:26.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.960+0000 7f89a3d8e740 1 -- 172.21.15.78:0/1286314697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8990005070 con 0x564f1b41eda0 2024-09-11T00:17:26.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.960+0000 7f897affd640 1 -- 172.21.15.78:0/1286314697 <== mon.2 v2:172.21.15.112:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f898c010430 con 0x564f1b41eda0 2024-09-11T00:17:26.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.960+0000 7f897affd640 1 -- 172.21.15.78:0/1286314697 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f898c012270 con 0x564f1b41eda0 2024-09-11T00:17:26.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.961+0000 7f89a3d8e740 10 client.24977 fetch_fsmap learned FSMap version 20 2024-09-11T00:17:26.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.961+0000 7f89a3d8e740 1 -- 172.21.15.78:0/1286314697 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564f1b439390 con 0x564f1b41eda0 2024-09-11T00:17:26.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.961+0000 7f897affd640 1 -- 172.21.15.78:0/1286314697 <== mon.2 v2:172.21.15.112:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8990005070 con 0x564f1b41eda0 2024-09-11T00:17:26.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.961+0000 7f897affd640 1 -- 172.21.15.78:0/1286314697 <== mon.2 v2:172.21.15.112:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f898c023070 con 0x564f1b41eda0 2024-09-11T00:17:26.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.961+0000 7f89a3d8e740 10 client.24977 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:17:26.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.961+0000 7f89a3d8e740 10 client.24977 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:17:26.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.961+0000 7f89a3d8e740 20 client.24977 populate_metadata read hostname 'smithi078' 2024-09-11T00:17:26.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.961+0000 7f89a3d8e740 1 --2- 172.21.15.78:0/1286314697 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564f1b43a860 0x564f1b43cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:26.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.961+0000 7f89a3d8e740 4 client.24977 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:17:26.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.961+0000 7f89a3d8e740 1 -- 172.21.15.78:0/1286314697 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f1b396da0 con 0x564f1b43a860 2024-09-11T00:17:26.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.961+0000 7f899a7fc640 1 --2- 172.21.15.78:0/1286314697 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564f1b43a860 0x564f1b43cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:26.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.962+0000 7f897affd640 10 client.24977 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:17:26.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.962+0000 7f899a7fc640 1 --2- 172.21.15.78:0/1286314697 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564f1b43a860 0x564f1b43cc50 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ced5f7dcc7b32189 server_cookie=9467fcd01c6fe7e5 in_seq=0 out_seq=0 2024-09-11T00:17:26.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.962+0000 7f897affd640 1 -- 172.21.15.78:0/1286314697 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564f1b396da0 con 0x564f1b43a860 2024-09-11T00:17:26.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.962+0000 7f897affd640 10 client.24977 handle_command_reply: tid=0 2024-09-11T00:17:26.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.962+0000 7f89a3d8e740 1 client.24977 shutdown 2024-09-11T00:17:26.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.963+0000 7f89a3d8e740 1 -- 172.21.15.78:0/1286314697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b41eda0 msgr2=0x564f1b427a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:26.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.963+0000 7f89a3d8e740 1 --2- 172.21.15.78:0/1286314697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b41eda0 0x564f1b427a90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f898c012d20 tx=0x7f898c00f790 comp rx=0 tx=0).stop 2024-09-11T00:17:26.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.963+0000 7f89a3d8e740 1 -- 172.21.15.78:0/1286314697 shutdown_connections 2024-09-11T00:17:26.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.963+0000 7f89a3d8e740 1 --2- 172.21.15.78:0/1286314697 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564f1b43a860 0x564f1b43cc50 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.963+0000 7f89a3d8e740 1 --2- 172.21.15.78:0/1286314697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b42ad30 0x564f1b4280c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.963+0000 7f89a3d8e740 1 --2- 172.21.15.78:0/1286314697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b41eda0 0x564f1b427a90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.963+0000 7f897affd640 0 client.24977 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:17:26.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.963+0000 7f89a3d8e740 1 --2- 172.21.15.78:0/1286314697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41e480 0x564f1b42a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.963+0000 7f89a3d8e740 1 -- 172.21.15.78:0/1286314697 >> 172.21.15.78:0/1286314697 conn(0x564f1b41c2b0 msgr2=0x564f1b421e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:26.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.963+0000 7f89a3d8e740 1 -- 172.21.15.78:0/1286314697 shutdown_connections 2024-09-11T00:17:26.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.963+0000 7f89a3d8e740 1 -- 172.21.15.78:0/1286314697 wait complete. 2024-09-11T00:17:26.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.963+0000 7f89a3d8e740 20 client.24977 trim_cache size 0 max 16384 2024-09-11T00:17:26.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.983+0000 7f89a3d8e740 1 Processor -- start 2024-09-11T00:17:26.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.983+0000 7f89a3d8e740 1 -- start start 2024-09-11T00:17:26.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.983+0000 7f89a3d8e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b41e480 0x564f1b4172d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:26.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.983+0000 7f89a3d8e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41eda0 0x564f1b41bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:26.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.983+0000 7f89a3d8e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b42ad30 0x564f1b42c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:26.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.983+0000 7f89a3d8e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f899c1ac6f0 con 0x564f1b41e480 2024-09-11T00:17:26.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.983+0000 7f89a3d8e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f899c1aef70 con 0x564f1b42ad30 2024-09-11T00:17:26.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.983+0000 7f89a3d8e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f899c1acd60 con 0x564f1b41eda0 2024-09-11T00:17:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.983+0000 7f899a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b41e480 0x564f1b4172d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.983+0000 7f899a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b41e480 0x564f1b4172d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49140/0 (socket says 172.21.15.78:49140) 2024-09-11T00:17:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.983+0000 7f899a7fc640 1 -- 172.21.15.78:0/1650247513 learned_addr learned my addr 172.21.15.78:0/1650247513 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:17:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.984+0000 7f899affd640 1 --2- 172.21.15.78:0/1650247513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41eda0 0x564f1b41bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.984+0000 7f899a7fc640 1 --2- 172.21.15.78:0/1650247513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b42ad30 0x564f1b42c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.984+0000 7f899a7fc640 1 -- 172.21.15.78:0/1650247513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41eda0 msgr2=0x564f1b41bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.984+0000 7f899a7fc640 1 --2- 172.21.15.78:0/1650247513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41eda0 0x564f1b41bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.984+0000 7f899a7fc640 1 -- 172.21.15.78:0/1650247513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b42ad30 msgr2=0x564f1b42c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.984+0000 7f899a7fc640 1 --2- 172.21.15.78:0/1650247513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b42ad30 0x564f1b42c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.984+0000 7f899a7fc640 1 -- 172.21.15.78:0/1650247513 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f1b41d670 con 0x564f1b41e480 2024-09-11T00:17:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.984+0000 7f899affd640 1 --2- 172.21.15.78:0/1650247513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41eda0 0x564f1b41bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:17:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.984+0000 7f899a7fc640 1 --2- 172.21.15.78:0/1650247513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b41e480 0x564f1b4172d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f89900316b0 tx=0x7f8990032ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f7ca67c4378b94 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.984+0000 7f89817fa640 1 -- 172.21.15.78:0/1650247513 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8990035040 con 0x564f1b41e480 2024-09-11T00:17:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.984+0000 7f89817fa640 1 -- 172.21.15.78:0/1650247513 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8990004030 con 0x564f1b41e480 2024-09-11T00:17:26.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.984+0000 7f89817fa640 1 -- 172.21.15.78:0/1650247513 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8990005300 con 0x564f1b41e480 2024-09-11T00:17:26.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.985+0000 7f89a3d8e740 1 -- 172.21.15.78:0/1650247513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b41e480 msgr2=0x564f1b4172d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:26.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.985+0000 7f89a3d8e740 1 --2- 172.21.15.78:0/1650247513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b41e480 0x564f1b4172d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f89900316b0 tx=0x7f8990032ba0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.985+0000 7f89a3d8e740 1 -- 172.21.15.78:0/1650247513 shutdown_connections 2024-09-11T00:17:26.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.985+0000 7f89a3d8e740 1 --2- 172.21.15.78:0/1650247513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b42ad30 0x564f1b42c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.985+0000 7f89a3d8e740 1 --2- 172.21.15.78:0/1650247513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41eda0 0x564f1b41bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.985+0000 7f89a3d8e740 1 --2- 172.21.15.78:0/1650247513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b41e480 0x564f1b4172d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.985+0000 7f89a3d8e740 1 -- 172.21.15.78:0/1650247513 >> 172.21.15.78:0/1650247513 conn(0x564f1b41c2b0 msgr2=0x564f1b426310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:26.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.985+0000 7f89a3d8e740 1 -- 172.21.15.78:0/1650247513 shutdown_connections 2024-09-11T00:17:26.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.985+0000 7f89a3d8e740 1 -- 172.21.15.78:0/1650247513 wait complete. 2024-09-11T00:17:26.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.986+0000 7f89a3d8e740 1 -- start start 2024-09-11T00:17:26.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.986+0000 7f89a3d8e740 1 Processor -- start 2024-09-11T00:17:26.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.986+0000 7f89a3d8e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41e480 0x564f1b4330f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:26.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.986+0000 7f89a3d8e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b41eda0 0x564f1b42dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:26.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.986+0000 7f89a3d8e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b42ad30 0x564f1b42e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.986+0000 7f89a3d8e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f899c1ad430 con 0x564f1b42ad30 2024-09-11T00:17:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.986+0000 7f89a3d8e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f899c1ae8a0 con 0x564f1b41eda0 2024-09-11T00:17:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.986+0000 7f89a3d8e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f899c1adb00 con 0x564f1b41e480 2024-09-11T00:17:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.986+0000 7f89a3d8e740 10 client.0 _ll_register_callbacks cb 0x7f898c009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:17:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.986+0000 7f899affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b41eda0 0x564f1b42dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.986+0000 7f899affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b41eda0 0x564f1b42dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.78:56756/0 (socket says 172.21.15.78:56756) 2024-09-11T00:17:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.986+0000 7f899affd640 1 -- 172.21.15.78:0/3390195698 learned_addr learned my addr 172.21.15.78:0/3390195698 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:17:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.986+0000 7f899a7fc640 1 --2- 172.21.15.78:0/3390195698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b42ad30 0x564f1b42e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.986+0000 7f899a7fc640 1 --2- 172.21.15.78:0/3390195698 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41e480 0x564f1b4330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.987+0000 7f899affd640 1 -- 172.21.15.78:0/3390195698 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41e480 msgr2=0x564f1b4330f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.987+0000 7f899affd640 1 --2- 172.21.15.78:0/3390195698 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41e480 0x564f1b4330f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.987+0000 7f899affd640 1 -- 172.21.15.78:0/3390195698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b42ad30 msgr2=0x564f1b42e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:26.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.987+0000 7f899affd640 1 --2- 172.21.15.78:0/3390195698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b42ad30 0x564f1b42e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.987+0000 7f899affd640 1 -- 172.21.15.78:0/3390195698 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f1b42e680 con 0x564f1b41eda0 2024-09-11T00:17:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.987+0000 7f899a7fc640 1 --2- 172.21.15.78:0/3390195698 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41e480 0x564f1b4330f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:17:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.987+0000 7f899affd640 1 --2- 172.21.15.78:0/3390195698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b41eda0 0x564f1b42dbd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x564f1b41cdf0 tx=0x7f898c01c6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e28a5c534940e380 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.987+0000 7f897affd640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-11T00:17:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.987+0000 7f897affd640 1 -- 172.21.15.78:0/3390195698 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c030060 con 0x564f1b41eda0 2024-09-11T00:17:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.987+0000 7f89a3d8e740 1 -- 172.21.15.78:0/3390195698 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8990004030 con 0x564f1b41eda0 2024-09-11T00:17:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.987+0000 7f897affd640 1 -- 172.21.15.78:0/3390195698 <== mon.2 v2:172.21.15.112:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f898c012860 con 0x564f1b41eda0 2024-09-11T00:17:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.987+0000 7f897affd640 1 -- 172.21.15.78:0/3390195698 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f898c005250 con 0x564f1b41eda0 2024-09-11T00:17:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.987+0000 7f89a3d8e740 10 client.24983 fetch_fsmap learned FSMap version 20 2024-09-11T00:17:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.987+0000 7f89a3d8e740 1 -- 172.21.15.78:0/3390195698 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564f1b4a84a0 con 0x564f1b41eda0 2024-09-11T00:17:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.988+0000 7f897affd640 1 -- 172.21.15.78:0/3390195698 <== mon.2 v2:172.21.15.112:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8990004030 con 0x564f1b41eda0 2024-09-11T00:17:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.988+0000 7f897affd640 1 -- 172.21.15.78:0/3390195698 <== mon.2 v2:172.21.15.112:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f898c023040 con 0x564f1b41eda0 2024-09-11T00:17:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.988+0000 7f89a3d8e740 10 client.24983 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:17:26.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.988+0000 7f89a3d8e740 10 client.24983 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:17:26.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.988+0000 7f89a3d8e740 20 client.24983 populate_metadata read hostname 'smithi078' 2024-09-11T00:17:26.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.988+0000 7f89a3d8e740 1 --2- 172.21.15.78:0/3390195698 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564f1b4a8c10 0x564f1b4ab030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:26.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.988+0000 7f89a3d8e740 4 client.24983 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:17:26.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.988+0000 7f89a3d8e740 1 -- 172.21.15.78:0/3390195698 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564f1b392850 con 0x564f1b4a8c10 2024-09-11T00:17:26.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.988+0000 7f899a7fc640 1 --2- 172.21.15.78:0/3390195698 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564f1b4a8c10 0x564f1b4ab030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:26.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.988+0000 7f899a7fc640 1 --2- 172.21.15.78:0/3390195698 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564f1b4a8c10 0x564f1b4ab030 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41f02ce57667736d server_cookie=e556dbf2bdac68fa in_seq=0 out_seq=0 2024-09-11T00:17:26.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.988+0000 7f897affd640 10 client.24983 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:17:26.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.989+0000 7f897affd640 1 -- 172.21.15.78:0/3390195698 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x564f1b392850 con 0x564f1b4a8c10 2024-09-11T00:17:26.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.989+0000 7f897affd640 10 client.24983 handle_command_reply: tid=0 2024-09-11T00:17:26.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.989+0000 7f89a3d8e740 1 client.24983 shutdown 2024-09-11T00:17:26.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.989+0000 7f89a3d8e740 1 -- 172.21.15.78:0/3390195698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b41eda0 msgr2=0x564f1b42dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:26.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.989+0000 7f89a3d8e740 1 --2- 172.21.15.78:0/3390195698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b41eda0 0x564f1b42dbd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x564f1b41cdf0 tx=0x7f898c01c6d0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.989+0000 7f89a3d8e740 1 -- 172.21.15.78:0/3390195698 shutdown_connections 2024-09-11T00:17:26.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.989+0000 7f89a3d8e740 1 --2- 172.21.15.78:0/3390195698 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564f1b4a8c10 0x564f1b4ab030 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.989+0000 7f89a3d8e740 1 --2- 172.21.15.78:0/3390195698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564f1b42ad30 0x564f1b42e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.989+0000 7f89a3d8e740 1 --2- 172.21.15.78:0/3390195698 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564f1b41eda0 0x564f1b42dbd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.989+0000 7f897affd640 0 client.24983 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:17:26.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.989+0000 7f89a3d8e740 1 --2- 172.21.15.78:0/3390195698 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564f1b41e480 0x564f1b4330f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.989+0000 7f89a3d8e740 1 -- 172.21.15.78:0/3390195698 >> 172.21.15.78:0/3390195698 conn(0x564f1b41c2b0 msgr2=0x564f1b4290c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:26.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.989+0000 7f89a3d8e740 1 -- 172.21.15.78:0/3390195698 shutdown_connections 2024-09-11T00:17:26.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.990+0000 7f89a3d8e740 1 -- 172.21.15.78:0/3390195698 wait complete. 2024-09-11T00:17:26.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.990+0000 7f89a3d8e740 20 client.24983 trim_cache size 0 max 16384 2024-09-11T00:17:26.996 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:17:26.996 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-11T00:17:26.996 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {}, 2024-09-11T00:17:26.996 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:17:26.996 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:17:26.996 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:17:26.996 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:17:26.997 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:17:26.997 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:17:26.997 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:17:26.997 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:17:26.997 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:17:26.997 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:17:26.997 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:17:26.997 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:17:26.997 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:17:26.997 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:17:26.997 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:17:26.997 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:17:26.997 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:17:26.997 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:17:26.997 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:17:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.990+0000 7f89a19b9640 1 -- 172.21.15.78:0/3791316295 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f89840b5450 msgr2=0x7f89840b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.990+0000 7f89a19b9640 1 --2- 172.21.15.78:0/3791316295 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f89840b5450 0x7f89840b7910 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f89940a8820 tx=0x7f8994004020 comp rx=0 tx=0).stop 2024-09-11T00:17:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.990+0000 7f89a19b9640 1 -- 172.21.15.78:0/3791316295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f899c10d100 msgr2=0x7f899c19ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.990+0000 7f89a19b9640 1 --2- 172.21.15.78:0/3791316295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f899c10d100 0x7f899c19ebc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8994009fd0 tx=0x7f899400b260 comp rx=0 tx=0).stop 2024-09-11T00:17:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.990+0000 7f89a19b9640 1 -- 172.21.15.78:0/3791316295 shutdown_connections 2024-09-11T00:17:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.990+0000 7f89a19b9640 1 --2- 172.21.15.78:0/3791316295 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f89840b5450 0x7f89840b7910 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.990+0000 7f89a19b9640 1 --2- 172.21.15.78:0/3791316295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f899c10d100 0x7f899c19ebc0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.990+0000 7f89a19b9640 1 --2- 172.21.15.78:0/3791316295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f899c1045c0 0x7f899c199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.990+0000 7f89a19b9640 1 --2- 172.21.15.78:0/3791316295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f899c103ca0 0x7f899c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:26.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.990+0000 7f89a19b9640 1 -- 172.21.15.78:0/3791316295 >> 172.21.15.78:0/3791316295 conn(0x7f899c0fd700 msgr2=0x7f899c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:26.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.990+0000 7f89a19b9640 1 -- 172.21.15.78:0/3791316295 shutdown_connections 2024-09-11T00:17:26.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:26.990+0000 7f89a19b9640 1 -- 172.21.15.78:0/3791316295 wait complete. 2024-09-11T00:17:27.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:26 smithi138 ceph-mon[35019]: pgmap v352: 97 pgs: 97 active+clean; 41 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 209 op/s 2024-09-11T00:17:27.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:26 smithi112 ceph-mon[35627]: pgmap v352: 97 pgs: 97 active+clean; 41 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 209 op/s 2024-09-11T00:17:27.838 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:17:27.839 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:17:28.119 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:17:28.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.656+0000 7f21a2860640 1 -- 172.21.15.78:0/704440143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f219c109170 msgr2=0x7f219c10f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:28.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.656+0000 7f21a2860640 1 --2- 172.21.15.78:0/704440143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f219c109170 0x7f219c10f970 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2194009ca0 tx=0x7f219402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:17:28.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.656+0000 7f21a2860640 1 -- 172.21.15.78:0/704440143 shutdown_connections 2024-09-11T00:17:28.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.656+0000 7f21a2860640 1 --2- 172.21.15.78:0/704440143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f219c109170 0x7f219c10f970 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:28.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.656+0000 7f21a2860640 1 --2- 172.21.15.78:0/704440143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f219c1087f0 0x7f219c108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:28.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.656+0000 7f21a2860640 1 --2- 172.21.15.78:0/704440143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f219c102de0 0x7f219c1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:28.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.656+0000 7f21a2860640 1 -- 172.21.15.78:0/704440143 >> 172.21.15.78:0/704440143 conn(0x7f219c0fe830 msgr2=0x7f219c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:28.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.656+0000 7f21a2860640 1 -- 172.21.15.78:0/704440143 shutdown_connections 2024-09-11T00:17:28.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.656+0000 7f21a2860640 1 -- 172.21.15.78:0/704440143 wait complete. 2024-09-11T00:17:28.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.657+0000 7f21a2860640 1 Processor -- start 2024-09-11T00:17:28.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.657+0000 7f21a2860640 1 -- start start 2024-09-11T00:17:28.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.657+0000 7f21a2860640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f219c102de0 0x7f219c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:28.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.657+0000 7f21a2860640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f219c1087f0 0x7f219c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:28.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.657+0000 7f21a2860640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f219c109170 0x7f219c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:28.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.657+0000 7f21a2860640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f219c112df0 con 0x7f219c109170 2024-09-11T00:17:28.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.657+0000 7f21a2860640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f219c112c70 con 0x7f219c1087f0 2024-09-11T00:17:28.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.657+0000 7f21a2860640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f219c112f70 con 0x7f219c102de0 2024-09-11T00:17:28.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.657+0000 7f21a0dfd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f219c109170 0x7f219c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:28.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.657+0000 7f21a0dfd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f219c109170 0x7f219c075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49170/0 (socket says 172.21.15.78:49170) 2024-09-11T00:17:28.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.657+0000 7f219b7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f219c1087f0 0x7f219c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:28.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.657+0000 7f21a0dfd640 1 -- 172.21.15.78:0/2044005680 learned_addr learned my addr 172.21.15.78:0/2044005680 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:17:28.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.657+0000 7f219bfff640 1 --2- 172.21.15.78:0/2044005680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f219c102de0 0x7f219c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:28.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.658+0000 7f219b7fe640 1 -- 172.21.15.78:0/2044005680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f219c102de0 msgr2=0x7f219c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:28.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.658+0000 7f219b7fe640 1 --2- 172.21.15.78:0/2044005680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f219c102de0 0x7f219c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:28.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.658+0000 7f219b7fe640 1 -- 172.21.15.78:0/2044005680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f219c109170 msgr2=0x7f219c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:28.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.658+0000 7f219b7fe640 1 --2- 172.21.15.78:0/2044005680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f219c109170 0x7f219c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:28.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.658+0000 7f219b7fe640 1 -- 172.21.15.78:0/2044005680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219c1a76c0 con 0x7f219c1087f0 2024-09-11T00:17:28.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.658+0000 7f21a0dfd640 1 --2- 172.21.15.78:0/2044005680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f219c109170 0x7f219c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:17:28.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.658+0000 7f219b7fe640 1 --2- 172.21.15.78:0/2044005680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f219c1087f0 0x7f219c0759e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2190005fd0 tx=0x7f219000dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:28.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.658+0000 7f21997fa640 1 -- 172.21.15.78:0/2044005680 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2190009c30 con 0x7f219c1087f0 2024-09-11T00:17:28.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.658+0000 7f21a2860640 1 -- 172.21.15.78:0/2044005680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f219c1a79b0 con 0x7f219c1087f0 2024-09-11T00:17:28.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.658+0000 7f21997fa640 1 -- 172.21.15.78:0/2044005680 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2190009dd0 con 0x7f219c1087f0 2024-09-11T00:17:28.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.658+0000 7f21997fa640 1 -- 172.21.15.78:0/2044005680 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2190010460 con 0x7f219c1087f0 2024-09-11T00:17:28.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.658+0000 7f21a2860640 1 -- 172.21.15.78:0/2044005680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f219c1a7ef0 con 0x7f219c1087f0 2024-09-11T00:17:28.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.659+0000 7f21a2860640 1 -- 172.21.15.78:0/2044005680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f219c1031c0 con 0x7f219c1087f0 2024-09-11T00:17:28.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.661+0000 7f21997fa640 1 -- 172.21.15.78:0/2044005680 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f2190003e80 con 0x7f219c1087f0 2024-09-11T00:17:28.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.661+0000 7f21997fa640 1 --2- 172.21.15.78:0/2044005680 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f21840b5450 0x7f21840b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:28.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.661+0000 7f219bfff640 1 --2- 172.21.15.78:0/2044005680 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f21840b5450 0x7f21840b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.662+0000 7f21997fa640 1 -- 172.21.15.78:0/2044005680 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f21900e5e60 con 0x7f219c1087f0 2024-09-11T00:17:28.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.662+0000 7f219bfff640 1 --2- 172.21.15.78:0/2044005680 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f21840b5450 0x7f21840b7910 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f218c0058c0 tx=0x7f218c00a250 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:28.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.664+0000 7f21997fa640 1 -- 172.21.15.78:0/2044005680 <== mon.2 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2190017020 con 0x7f219c1087f0 2024-09-11T00:17:28.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:28 smithi078 ceph-mon[30865]: pgmap v353: 97 pgs: 97 active+clean; 41 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 109 op/s 2024-09-11T00:17:28.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.899+0000 7f21a2860640 1 -- 172.21.15.78:0/2044005680 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f219c02e5c0 con 0x7f219c1087f0 2024-09-11T00:17:28.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.900+0000 7f21997fa640 1 -- 172.21.15.78:0/2044005680 <== mon.2 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f21900c1e20 con 0x7f219c1087f0 2024-09-11T00:17:28.901 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:17:28.902 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:17:29.109 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:17:29.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.902+0000 7f21a2860640 1 -- 172.21.15.78:0/2044005680 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f21840b5450 msgr2=0x7f21840b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:29.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.902+0000 7f21a2860640 1 --2- 172.21.15.78:0/2044005680 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f21840b5450 0x7f21840b7910 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f218c0058c0 tx=0x7f218c00a250 comp rx=0 tx=0).stop 2024-09-11T00:17:29.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.902+0000 7f21a2860640 1 -- 172.21.15.78:0/2044005680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f219c1087f0 msgr2=0x7f219c0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:29.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.902+0000 7f21a2860640 1 --2- 172.21.15.78:0/2044005680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f219c1087f0 0x7f219c0759e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2190005fd0 tx=0x7f219000dde0 comp rx=0 tx=0).stop 2024-09-11T00:17:29.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.902+0000 7f21a2860640 1 -- 172.21.15.78:0/2044005680 shutdown_connections 2024-09-11T00:17:29.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.902+0000 7f21a2860640 1 --2- 172.21.15.78:0/2044005680 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f21840b5450 0x7f21840b7910 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:29.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.902+0000 7f21a2860640 1 --2- 172.21.15.78:0/2044005680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f219c109170 0x7f219c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:29.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.902+0000 7f21a2860640 1 --2- 172.21.15.78:0/2044005680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f219c1087f0 0x7f219c0759e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:29.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.902+0000 7f21a2860640 1 --2- 172.21.15.78:0/2044005680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f219c102de0 0x7f219c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:29.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.902+0000 7f21a2860640 1 -- 172.21.15.78:0/2044005680 >> 172.21.15.78:0/2044005680 conn(0x7f219c0fe830 msgr2=0x7f219c0ff120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:29.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.902+0000 7f21a2860640 1 -- 172.21.15.78:0/2044005680 shutdown_connections 2024-09-11T00:17:29.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:28.902+0000 7f21a2860640 1 -- 172.21.15.78:0/2044005680 wait complete. 2024-09-11T00:17:29.111 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:28 smithi138 ceph-mon[35019]: pgmap v353: 97 pgs: 97 active+clean; 41 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 109 op/s 2024-09-11T00:17:29.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:28 smithi112 ceph-mon[35627]: pgmap v353: 97 pgs: 97 active+clean; 41 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 109 op/s 2024-09-11T00:17:29.721 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:17:30.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:29 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2044005680' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:17:30.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:29 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2044005680' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:17:30.246 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:17:30.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:29 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2044005680' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:17:31.081 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:30 smithi078 ceph-mon[30865]: pgmap v354: 97 pgs: 97 active+clean; 43 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 1.2 MiB/s wr, 62 op/s 2024-09-11T00:17:31.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.815+0000 7f5e742ac640 1 -- 172.21.15.78:0/768786315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e6c101c90 msgr2=0x7f5e6c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:31.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.815+0000 7f5e742ac640 1 --2- 172.21.15.78:0/768786315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e6c101c90 0x7f5e6c102070 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009900 tx=0x7f5e6802a410 comp rx=0 tx=0).stop 2024-09-11T00:17:31.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.815+0000 7f5e742ac640 1 -- 172.21.15.78:0/768786315 shutdown_connections 2024-09-11T00:17:31.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.815+0000 7f5e742ac640 1 --2- 172.21.15.78:0/768786315 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e6c108020 0x7f5e6c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.815+0000 7f5e742ac640 1 --2- 172.21.15.78:0/768786315 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e6c1076a0 0x7f5e6c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.815+0000 7f5e742ac640 1 --2- 172.21.15.78:0/768786315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e6c101c90 0x7f5e6c102070 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.815+0000 7f5e742ac640 1 -- 172.21.15.78:0/768786315 >> 172.21.15.78:0/768786315 conn(0x7f5e6c0fd700 msgr2=0x7f5e6c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:31.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.815+0000 7f5e742ac640 1 -- 172.21.15.78:0/768786315 shutdown_connections 2024-09-11T00:17:31.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.815+0000 7f5e742ac640 1 -- 172.21.15.78:0/768786315 wait complete. 2024-09-11T00:17:31.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.816+0000 7f5e742ac640 1 Processor -- start 2024-09-11T00:17:31.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.816+0000 7f5e742ac640 1 -- start start 2024-09-11T00:17:31.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.816+0000 7f5e742ac640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e6c101c90 0x7f5e6c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:31.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.816+0000 7f5e742ac640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e6c1076a0 0x7f5e6c1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:31.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.816+0000 7f5e742ac640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e6c108020 0x7f5e6c19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:31.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.816+0000 7f5e742ac640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6c111ce0 con 0x7f5e6c108020 2024-09-11T00:17:31.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.816+0000 7f5e742ac640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6c111b60 con 0x7f5e6c101c90 2024-09-11T00:17:31.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.816+0000 7f5e742ac640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6c111e60 con 0x7f5e6c1076a0 2024-09-11T00:17:31.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.816+0000 7f5e72048640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e6c101c90 0x7f5e6c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:31.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.816+0000 7f5e72849640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e6c108020 0x7f5e6c19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:31.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.816+0000 7f5e72048640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e6c101c90 0x7f5e6c1992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.78:56794/0 (socket says 172.21.15.78:56794) 2024-09-11T00:17:31.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.816+0000 7f5e72048640 1 -- 172.21.15.78:0/1575172088 learned_addr learned my addr 172.21.15.78:0/1575172088 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:17:31.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.816+0000 7f5e71847640 1 --2- 172.21.15.78:0/1575172088 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e6c1076a0 0x7f5e6c1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:31.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.817+0000 7f5e72048640 1 -- 172.21.15.78:0/1575172088 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e6c1076a0 msgr2=0x7f5e6c1997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:31.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.817+0000 7f5e72048640 1 --2- 172.21.15.78:0/1575172088 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e6c1076a0 0x7f5e6c1997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.817+0000 7f5e72048640 1 -- 172.21.15.78:0/1575172088 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e6c108020 msgr2=0x7f5e6c19eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:31.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.817+0000 7f5e72048640 1 --2- 172.21.15.78:0/1575172088 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e6c108020 0x7f5e6c19eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.817+0000 7f5e72048640 1 -- 172.21.15.78:0/1575172088 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e6c19f360 con 0x7f5e6c101c90 2024-09-11T00:17:31.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.817+0000 7f5e72849640 1 --2- 172.21.15.78:0/1575172088 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e6c108020 0x7f5e6c19eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:17:31.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.817+0000 7f5e72048640 1 --2- 172.21.15.78:0/1575172088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e6c101c90 0x7f5e6c1992b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5e68005940 tx=0x7f5e68004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:31.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.817+0000 7f5e637fe640 1 -- 172.21.15.78:0/1575172088 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6803f030 con 0x7f5e6c101c90 2024-09-11T00:17:31.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.817+0000 7f5e637fe640 1 -- 172.21.15.78:0/1575172088 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e68003aa0 con 0x7f5e6c101c90 2024-09-11T00:17:31.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.817+0000 7f5e742ac640 1 -- 172.21.15.78:0/1575172088 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e6c19f5f0 con 0x7f5e6c101c90 2024-09-11T00:17:31.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.817+0000 7f5e637fe640 1 -- 172.21.15.78:0/1575172088 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e68035070 con 0x7f5e6c101c90 2024-09-11T00:17:31.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.817+0000 7f5e742ac640 1 -- 172.21.15.78:0/1575172088 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e6c1a5d10 con 0x7f5e6c101c90 2024-09-11T00:17:31.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.819+0000 7f5e637fe640 1 -- 172.21.15.78:0/1575172088 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f5e6803bce0 con 0x7f5e6c101c90 2024-09-11T00:17:31.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.820+0000 7f5e76681740 1 Processor -- start 2024-09-11T00:17:31.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.820+0000 7f5e76681740 1 -- start start 2024-09-11T00:17:31.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.820+0000 7f5e76681740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560a930bb4d0 0x560a930bb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:31.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.820+0000 7f5e76681740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930bbdf0 0x560a930c7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:31.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.820+0000 7f5e76681740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a930c7d80 0x560a930ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:31.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.820+0000 7f5e76681740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x560a93031ea0 con 0x560a930bbdf0 2024-09-11T00:17:31.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.820+0000 7f5e76681740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560a930212d0 con 0x560a930bb4d0 2024-09-11T00:17:31.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.820+0000 7f5e76681740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x560a930250e0 con 0x560a930c7d80 2024-09-11T00:17:31.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.820+0000 7f5e72048640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930bbdf0 0x560a930c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:31.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.820+0000 7f5e72849640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560a930bb4d0 0x560a930bb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:31.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.820+0000 7f5e72849640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560a930bb4d0 0x560a930bb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.78:56810/0 (socket says 172.21.15.78:56810) 2024-09-11T00:17:31.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.820+0000 7f5e72849640 1 -- 172.21.15.78:0/1793567770 learned_addr learned my addr 172.21.15.78:0/1793567770 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:17:31.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.820+0000 7f5e71847640 1 --2- 172.21.15.78:0/1793567770 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a930c7d80 0x560a930ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:31.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.820+0000 7f5e72849640 1 -- 172.21.15.78:0/1793567770 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a930c7d80 msgr2=0x560a930ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:31.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.820+0000 7f5e72849640 1 --2- 172.21.15.78:0/1793567770 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a930c7d80 0x560a930ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.820+0000 7f5e72849640 1 -- 172.21.15.78:0/1793567770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930bbdf0 msgr2=0x560a930c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:31.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.820+0000 7f5e72849640 1 --2- 172.21.15.78:0/1793567770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930bbdf0 0x560a930c7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.820+0000 7f5e72849640 1 -- 172.21.15.78:0/1793567770 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a92d7f650 con 0x560a930bb4d0 2024-09-11T00:17:31.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.820+0000 7f5e637fe640 1 --2- 172.21.15.78:0/1575172088 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5e580b5450 0x7f5e580b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:31.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.820+0000 7f5e72048640 1 --2- 172.21.15.78:0/1793567770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930bbdf0 0x560a930c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:17:31.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.821+0000 7f5e72048640 1 --2- 172.21.15.78:0/1575172088 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5e580b5450 0x7f5e580b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:31.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.821+0000 7f5e72849640 1 --2- 172.21.15.78:0/1793567770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560a930bb4d0 0x560a930bb8b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400f760 tx=0x7f5e6400fc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e567c5e86a6fe6c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:31.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.821+0000 7f5e637fe640 1 -- 172.21.15.78:0/1575172088 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f5e68106990 con 0x7f5e6c101c90 2024-09-11T00:17:31.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.821+0000 7f5e60de6640 1 -- 172.21.15.78:0/1793567770 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e64003b70 con 0x560a930bb4d0 2024-09-11T00:17:31.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.821+0000 7f5e60de6640 1 -- 172.21.15.78:0/1793567770 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e6400ddd0 con 0x560a930bb4d0 2024-09-11T00:17:31.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.821+0000 7f5e60de6640 1 -- 172.21.15.78:0/1793567770 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e640047a0 con 0x560a930bb4d0 2024-09-11T00:17:31.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.822+0000 7f5e76681740 1 -- 172.21.15.78:0/1793567770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560a930bb4d0 msgr2=0x560a930bb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:31.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.822+0000 7f5e76681740 1 --2- 172.21.15.78:0/1793567770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560a930bb4d0 0x560a930bb8b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400f760 tx=0x7f5e6400fc20 comp rx=0 tx=0).stop 2024-09-11T00:17:31.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.822+0000 7f5e72048640 1 --2- 172.21.15.78:0/1575172088 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5e580b5450 0x7f5e580b7910 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x560a930ba1e0 tx=0x7f5e6810c530 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:31.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.822+0000 7f5e76681740 1 -- 172.21.15.78:0/1793567770 shutdown_connections 2024-09-11T00:17:31.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.822+0000 7f5e76681740 1 --2- 172.21.15.78:0/1793567770 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a930c7d80 0x560a930ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.822+0000 7f5e76681740 1 --2- 172.21.15.78:0/1793567770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930bbdf0 0x560a930c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.822+0000 7f5e76681740 1 --2- 172.21.15.78:0/1793567770 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560a930bb4d0 0x560a930bb8b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.822+0000 7f5e76681740 1 -- 172.21.15.78:0/1793567770 >> 172.21.15.78:0/1793567770 conn(0x560a930b9300 msgr2=0x560a930ba4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:31.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.822+0000 7f5e76681740 1 -- 172.21.15.78:0/1793567770 shutdown_connections 2024-09-11T00:17:31.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.822+0000 7f5e76681740 1 -- 172.21.15.78:0/1793567770 wait complete. 2024-09-11T00:17:31.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.822+0000 7f5e76681740 1 -- start start 2024-09-11T00:17:31.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.822+0000 7f5e76681740 1 Processor -- start 2024-09-11T00:17:31.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.822+0000 7f5e76681740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560a930bb4d0 0x560a930c7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:31.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.822+0000 7f5e76681740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930bbdf0 0x560a930c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:31.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.822+0000 7f5e76681740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a930c7d80 0x560a930c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:31.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.822+0000 7f5e76681740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x560a92e82700 con 0x560a930bbdf0 2024-09-11T00:17:31.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.822+0000 7f5e76681740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560a92fbc160 con 0x560a930bb4d0 2024-09-11T00:17:31.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.822+0000 7f5e76681740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x560a930caa00 con 0x560a930c7d80 2024-09-11T00:17:31.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.822+0000 7f5e76681740 10 client.0 _ll_register_callbacks cb 0x560a92fd59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:17:31.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.822+0000 7f5e71847640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930bbdf0 0x560a930c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:31.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.823+0000 7f5e71847640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930bbdf0 0x560a930c4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49204/0 (socket says 172.21.15.78:49204) 2024-09-11T00:17:31.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.823+0000 7f5e72849640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560a930bb4d0 0x560a930c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:31.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.823+0000 7f5e71847640 1 -- 172.21.15.78:0/849109503 learned_addr learned my addr 172.21.15.78:0/849109503 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:17:31.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.823+0000 7f5e72849640 1 --2- 172.21.15.78:0/849109503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a930c7d80 0x560a930c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:31.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.823+0000 7f5e71847640 1 -- 172.21.15.78:0/849109503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a930c7d80 msgr2=0x560a930c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:31.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.823+0000 7f5e71847640 1 --2- 172.21.15.78:0/849109503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a930c7d80 0x560a930c50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.823+0000 7f5e71847640 1 -- 172.21.15.78:0/849109503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560a930bb4d0 msgr2=0x560a930c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:31.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.823+0000 7f5e71847640 1 --2- 172.21.15.78:0/849109503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560a930bb4d0 0x560a930c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.823+0000 7f5e71847640 1 -- 172.21.15.78:0/849109503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a92fe9c90 con 0x560a930bbdf0 2024-09-11T00:17:31.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.823+0000 7f5e72849640 1 --2- 172.21.15.78:0/849109503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a930c7d80 0x560a930c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:17:31.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.823+0000 7f5e71847640 1 --2- 172.21.15.78:0/849109503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930bbdf0 0x560a930c4ac0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c013710 tx=0x7f5e5c013bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad9300ac660a318 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:31.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.823+0000 7f5e55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:17:31.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.823+0000 7f5e55ffb640 1 -- 172.21.15.78:0/849109503 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c020060 con 0x560a930bbdf0 2024-09-11T00:17:31.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.823+0000 7f5e76681740 1 -- 172.21.15.78:0/849109503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e6400ddd0 con 0x560a930bbdf0 2024-09-11T00:17:31.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.823+0000 7f5e55ffb640 1 -- 172.21.15.78:0/849109503 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f5e5c011dd0 con 0x560a930bbdf0 2024-09-11T00:17:31.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.823+0000 7f5e55ffb640 1 -- 172.21.15.78:0/849109503 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5e5c01b430 con 0x560a930bbdf0 2024-09-11T00:17:31.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.823+0000 7f5e76681740 10 client.15468 fetch_fsmap learned FSMap version 20 2024-09-11T00:17:31.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.823+0000 7f5e76681740 1 -- 172.21.15.78:0/849109503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560a930d6390 con 0x560a930bbdf0 2024-09-11T00:17:31.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.823+0000 7f5e55ffb640 1 -- 172.21.15.78:0/849109503 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e6400ddd0 con 0x560a930bbdf0 2024-09-11T00:17:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.824+0000 7f5e55ffb640 1 -- 172.21.15.78:0/849109503 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5e5c00e440 con 0x560a930bbdf0 2024-09-11T00:17:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.824+0000 7f5e76681740 10 client.15468 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:17:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.824+0000 7f5e76681740 10 client.15468 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:17:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.824+0000 7f5e76681740 20 client.15468 populate_metadata read hostname 'smithi078' 2024-09-11T00:17:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.824+0000 7f5e76681740 1 --2- 172.21.15.78:0/849109503 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560a930d7850 0x560a930d9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.824+0000 7f5e76681740 4 client.15468 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:17:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.824+0000 7f5e76681740 1 -- 172.21.15.78:0/849109503 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a93033df0 con 0x560a930d7850 2024-09-11T00:17:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.824+0000 7f5e72849640 1 --2- 172.21.15.78:0/849109503 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560a930d7850 0x560a930d9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.824+0000 7f5e55ffb640 10 client.15468 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:17:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.824+0000 7f5e72849640 1 --2- 172.21.15.78:0/849109503 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560a930d7850 0x560a930d9ca0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c7773d8fad038a3 server_cookie=6dfd520fec39a1b1 in_seq=0 out_seq=0 2024-09-11T00:17:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.827+0000 7f5e55ffb640 1 -- 172.21.15.78:0/849109503 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560a93033df0 con 0x560a930d7850 2024-09-11T00:17:31.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.827+0000 7f5e55ffb640 10 client.15468 handle_command_reply: tid=0 2024-09-11T00:17:31.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.827+0000 7f5e76681740 1 client.15468 shutdown 2024-09-11T00:17:31.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.827+0000 7f5e76681740 1 -- 172.21.15.78:0/849109503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930bbdf0 msgr2=0x560a930c4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:31.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.827+0000 7f5e76681740 1 --2- 172.21.15.78:0/849109503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930bbdf0 0x560a930c4ac0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c013710 tx=0x7f5e5c013bd0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.827+0000 7f5e76681740 1 -- 172.21.15.78:0/849109503 shutdown_connections 2024-09-11T00:17:31.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.827+0000 7f5e76681740 1 --2- 172.21.15.78:0/849109503 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560a930d7850 0x560a930d9ca0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.827+0000 7f5e76681740 1 --2- 172.21.15.78:0/849109503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a930c7d80 0x560a930c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.827+0000 7f5e76681740 1 --2- 172.21.15.78:0/849109503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930bbdf0 0x560a930c4ac0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.827+0000 7f5e55ffb640 0 client.15468 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:17:31.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.827+0000 7f5e76681740 1 --2- 172.21.15.78:0/849109503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560a930bb4d0 0x560a930c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.827+0000 7f5e76681740 1 -- 172.21.15.78:0/849109503 >> 172.21.15.78:0/849109503 conn(0x560a930b9300 msgr2=0x560a930beea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:31.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.827+0000 7f5e76681740 1 -- 172.21.15.78:0/849109503 shutdown_connections 2024-09-11T00:17:31.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.827+0000 7f5e76681740 1 -- 172.21.15.78:0/849109503 wait complete. 2024-09-11T00:17:31.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.827+0000 7f5e76681740 20 client.15468 trim_cache size 0 max 16384 2024-09-11T00:17:31.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.840+0000 7f5e76681740 1 Processor -- start 2024-09-11T00:17:31.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.840+0000 7f5e76681740 1 -- start start 2024-09-11T00:17:31.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.840+0000 7f5e76681740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560a930bb4d0 0x560a930d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:31.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.840+0000 7f5e76681740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a930bbdf0 0x560a930c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:31.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.840+0000 7f5e76681740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930c7d80 0x560a930c2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:31.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.840+0000 7f5e76681740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6c1ac700 con 0x560a930c7d80 2024-09-11T00:17:31.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.840+0000 7f5e76681740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6c1aef80 con 0x560a930bb4d0 2024-09-11T00:17:31.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.840+0000 7f5e76681740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6c1acd70 con 0x560a930bbdf0 2024-09-11T00:17:31.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.840+0000 7f5e72849640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930c7d80 0x560a930c2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:31.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.840+0000 7f5e72849640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930c7d80 0x560a930c2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49208/0 (socket says 172.21.15.78:49208) 2024-09-11T00:17:31.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.840+0000 7f5e72849640 1 -- 172.21.15.78:0/2703896027 learned_addr learned my addr 172.21.15.78:0/2703896027 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:17:31.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.840+0000 7f5e72849640 1 --2- 172.21.15.78:0/2703896027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560a930bb4d0 0x560a930d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:31.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.840+0000 7f5e71847640 1 --2- 172.21.15.78:0/2703896027 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a930bbdf0 0x560a930c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:31.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.841+0000 7f5e72849640 1 -- 172.21.15.78:0/2703896027 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a930bbdf0 msgr2=0x560a930c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:31.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.841+0000 7f5e72849640 1 --2- 172.21.15.78:0/2703896027 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a930bbdf0 0x560a930c1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.841+0000 7f5e72849640 1 -- 172.21.15.78:0/2703896027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560a930bb4d0 msgr2=0x560a930d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:31.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.841+0000 7f5e72849640 1 --2- 172.21.15.78:0/2703896027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560a930bb4d0 0x560a930d3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.841+0000 7f5e72849640 1 -- 172.21.15.78:0/2703896027 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a930bbc20 con 0x560a930c7d80 2024-09-11T00:17:31.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.841+0000 7f5e71847640 1 --2- 172.21.15.78:0/2703896027 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a930bbdf0 0x560a930c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:17:31.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.841+0000 7f5e72849640 1 --2- 172.21.15.78:0/2703896027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930c7d80 0x560a930c2210 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400af90 tx=0x7f5e64004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ab1512db3e3d53 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:31.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.841+0000 7f5e57fff640 1 -- 172.21.15.78:0/2703896027 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e64004700 con 0x560a930c7d80 2024-09-11T00:17:31.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.841+0000 7f5e57fff640 1 -- 172.21.15.78:0/2703896027 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e64003970 con 0x560a930c7d80 2024-09-11T00:17:31.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.841+0000 7f5e57fff640 1 -- 172.21.15.78:0/2703896027 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6400dbf0 con 0x560a930c7d80 2024-09-11T00:17:31.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.841+0000 7f5e76681740 1 -- 172.21.15.78:0/2703896027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930c7d80 msgr2=0x560a930c2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:31.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.841+0000 7f5e76681740 1 --2- 172.21.15.78:0/2703896027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930c7d80 0x560a930c2210 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400af90 tx=0x7f5e64004340 comp rx=0 tx=0).stop 2024-09-11T00:17:31.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.841+0000 7f5e76681740 1 -- 172.21.15.78:0/2703896027 shutdown_connections 2024-09-11T00:17:31.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.841+0000 7f5e76681740 1 --2- 172.21.15.78:0/2703896027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930c7d80 0x560a930c2210 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.841+0000 7f5e76681740 1 --2- 172.21.15.78:0/2703896027 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a930bbdf0 0x560a930c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.841+0000 7f5e76681740 1 --2- 172.21.15.78:0/2703896027 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560a930bb4d0 0x560a930d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.841+0000 7f5e76681740 1 -- 172.21.15.78:0/2703896027 >> 172.21.15.78:0/2703896027 conn(0x560a930b9300 msgr2=0x560a930c3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:31.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.842+0000 7f5e76681740 1 -- 172.21.15.78:0/2703896027 shutdown_connections 2024-09-11T00:17:31.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.842+0000 7f5e76681740 1 -- 172.21.15.78:0/2703896027 wait complete. 2024-09-11T00:17:31.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.842+0000 7f5e76681740 1 -- start start 2024-09-11T00:17:31.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.842+0000 7f5e76681740 1 Processor -- start 2024-09-11T00:17:31.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.842+0000 7f5e76681740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560a930bb4d0 0x560a930d0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:31.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.842+0000 7f5e76681740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930bbdf0 0x560a930d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:31.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.842+0000 7f5e76681740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a930c7d80 0x560a930cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:31.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.842+0000 7f5e76681740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6c1ad440 con 0x560a930bbdf0 2024-09-11T00:17:31.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.842+0000 7f5e76681740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6c1ae8b0 con 0x560a930bb4d0 2024-09-11T00:17:31.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.842+0000 7f5e76681740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6c1adb10 con 0x560a930c7d80 2024-09-11T00:17:31.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.842+0000 7f5e76681740 10 client.0 _ll_register_callbacks cb 0x7f5e5c0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:17:31.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.842+0000 7f5e71847640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930bbdf0 0x560a930d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:31.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.842+0000 7f5e71847640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930bbdf0 0x560a930d06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49222/0 (socket says 172.21.15.78:49222) 2024-09-11T00:17:31.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.842+0000 7f5e71847640 1 -- 172.21.15.78:0/2812244567 learned_addr learned my addr 172.21.15.78:0/2812244567 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:17:31.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.842+0000 7f5e72849640 1 --2- 172.21.15.78:0/2812244567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560a930bb4d0 0x560a930d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:31.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.842+0000 7f5e72849640 1 --2- 172.21.15.78:0/2812244567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a930c7d80 0x560a930cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:31.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.842+0000 7f5e71847640 1 -- 172.21.15.78:0/2812244567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a930c7d80 msgr2=0x560a930cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:31.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.843+0000 7f5e71847640 1 --2- 172.21.15.78:0/2812244567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a930c7d80 0x560a930cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.843+0000 7f5e71847640 1 -- 172.21.15.78:0/2812244567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560a930bb4d0 msgr2=0x560a930d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:31.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.843+0000 7f5e71847640 1 --2- 172.21.15.78:0/2812244567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560a930bb4d0 0x560a930d0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.843+0000 7f5e71847640 1 -- 172.21.15.78:0/2812244567 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a930cd0c0 con 0x560a930bbdf0 2024-09-11T00:17:31.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.843+0000 7f5e71847640 1 --2- 172.21.15.78:0/2812244567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930bbdf0 0x560a930d06b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c016020 tx=0x7f5e5c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b621e83bffacc4f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:31.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.843+0000 7f5e55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:17:31.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.843+0000 7f5e55ffb640 1 -- 172.21.15.78:0/2812244567 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c032060 con 0x560a930bbdf0 2024-09-11T00:17:31.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.843+0000 7f5e55ffb640 1 -- 172.21.15.78:0/2812244567 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f5e5c011dd0 con 0x560a930bbdf0 2024-09-11T00:17:31.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.843+0000 7f5e76681740 1 -- 172.21.15.78:0/2812244567 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e64003970 con 0x560a930bbdf0 2024-09-11T00:17:31.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.843+0000 7f5e55ffb640 1 -- 172.21.15.78:0/2812244567 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5e5c020020 con 0x560a930bbdf0 2024-09-11T00:17:31.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.843+0000 7f5e76681740 10 client.15474 fetch_fsmap learned FSMap version 20 2024-09-11T00:17:31.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.843+0000 7f5e76681740 1 -- 172.21.15.78:0/2812244567 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560a93145510 con 0x560a930bbdf0 2024-09-11T00:17:31.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.843+0000 7f5e55ffb640 1 -- 172.21.15.78:0/2812244567 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e64003970 con 0x560a930bbdf0 2024-09-11T00:17:31.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.843+0000 7f5e55ffb640 1 -- 172.21.15.78:0/2812244567 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5e5c003b70 con 0x560a930bbdf0 2024-09-11T00:17:31.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.843+0000 7f5e76681740 10 client.15474 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:17:31.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.843+0000 7f5e76681740 10 client.15474 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:17:31.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.843+0000 7f5e76681740 20 client.15474 populate_metadata read hostname 'smithi078' 2024-09-11T00:17:31.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.843+0000 7f5e76681740 1 --2- 172.21.15.78:0/2812244567 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560a93145c30 0x560a93148050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:31.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.844+0000 7f5e76681740 4 client.15474 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:17:31.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.844+0000 7f5e76681740 1 -- 172.21.15.78:0/2812244567 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560a9302f8a0 con 0x560a93145c30 2024-09-11T00:17:31.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.844+0000 7f5e72849640 1 --2- 172.21.15.78:0/2812244567 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560a93145c30 0x560a93148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:31.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.844+0000 7f5e55ffb640 10 client.15474 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:17:31.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.844+0000 7f5e72849640 1 --2- 172.21.15.78:0/2812244567 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560a93145c30 0x560a93148050 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4eef1d552d5931f server_cookie=1d3451ee370d1a0d in_seq=0 out_seq=0 2024-09-11T00:17:31.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.847+0000 7f5e55ffb640 1 -- 172.21.15.78:0/2812244567 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560a9302f8a0 con 0x560a93145c30 2024-09-11T00:17:31.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.847+0000 7f5e55ffb640 10 client.15474 handle_command_reply: tid=0 2024-09-11T00:17:31.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.847+0000 7f5e76681740 1 client.15474 shutdown 2024-09-11T00:17:31.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.847+0000 7f5e76681740 1 -- 172.21.15.78:0/2812244567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930bbdf0 msgr2=0x560a930d06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:31.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.847+0000 7f5e76681740 1 --2- 172.21.15.78:0/2812244567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930bbdf0 0x560a930d06b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c016020 tx=0x7f5e5c00eef0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.847+0000 7f5e76681740 1 -- 172.21.15.78:0/2812244567 shutdown_connections 2024-09-11T00:17:31.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.847+0000 7f5e76681740 1 --2- 172.21.15.78:0/2812244567 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560a93145c30 0x560a93148050 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.848+0000 7f5e76681740 1 --2- 172.21.15.78:0/2812244567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a930c7d80 0x560a930cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.848+0000 7f5e76681740 1 --2- 172.21.15.78:0/2812244567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560a930bbdf0 0x560a930d06b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.100 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-11T00:17:31.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.848+0000 7f5e76681740 1 --2- 172.21.15.78:0/2812244567 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560a930bb4d0 0x560a930d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.848+0000 7f5e55ffb640 0 client.15474 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:17:31.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.848+0000 7f5e76681740 1 -- 172.21.15.78:0/2812244567 >> 172.21.15.78:0/2812244567 conn(0x560a930b9300 msgr2=0x560a930c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:31.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.848+0000 7f5e76681740 1 -- 172.21.15.78:0/2812244567 shutdown_connections 2024-09-11T00:17:31.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.848+0000 7f5e76681740 1 -- 172.21.15.78:0/2812244567 wait complete. 2024-09-11T00:17:31.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.848+0000 7f5e76681740 20 client.15474 trim_cache size 0 max 16384 2024-09-11T00:17:31.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.848+0000 7f5e742ac640 1 -- 172.21.15.78:0/1575172088 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5e580b5450 msgr2=0x7f5e580b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:31.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.848+0000 7f5e742ac640 1 --2- 172.21.15.78:0/1575172088 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5e580b5450 0x7f5e580b7910 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x560a930ba1e0 tx=0x7f5e6810c530 comp rx=0 tx=0).stop 2024-09-11T00:17:31.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.848+0000 7f5e742ac640 1 -- 172.21.15.78:0/1575172088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e6c101c90 msgr2=0x7f5e6c1992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:31.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.848+0000 7f5e742ac640 1 --2- 172.21.15.78:0/1575172088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e6c101c90 0x7f5e6c1992b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5e68005940 tx=0x7f5e68004270 comp rx=0 tx=0).stop 2024-09-11T00:17:31.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.848+0000 7f5e742ac640 1 -- 172.21.15.78:0/1575172088 shutdown_connections 2024-09-11T00:17:31.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.848+0000 7f5e742ac640 1 --2- 172.21.15.78:0/1575172088 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5e580b5450 0x7f5e580b7910 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.848+0000 7f5e742ac640 1 --2- 172.21.15.78:0/1575172088 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e6c108020 0x7f5e6c19eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.848+0000 7f5e742ac640 1 --2- 172.21.15.78:0/1575172088 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e6c1076a0 0x7f5e6c1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.848+0000 7f5e742ac640 1 --2- 172.21.15.78:0/1575172088 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5e6c101c90 0x7f5e6c1992b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:31.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.848+0000 7f5e742ac640 1 -- 172.21.15.78:0/1575172088 >> 172.21.15.78:0/1575172088 conn(0x7f5e6c0fd700 msgr2=0x7f5e6c06adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:31.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.848+0000 7f5e742ac640 1 -- 172.21.15.78:0/1575172088 shutdown_connections 2024-09-11T00:17:31.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:30.848+0000 7f5e742ac640 1 -- 172.21.15.78:0/1575172088 wait complete. 2024-09-11T00:17:31.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:30 smithi112 ceph-mon[35627]: pgmap v354: 97 pgs: 97 active+clean; 43 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 1.2 MiB/s wr, 62 op/s 2024-09-11T00:17:31.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:30 smithi138 ceph-mon[35019]: pgmap v354: 97 pgs: 97 active+clean; 43 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 1.2 MiB/s wr, 62 op/s 2024-09-11T00:17:32.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:31 smithi078 ceph-mon[30865]: pgmap v355: 97 pgs: 97 active+clean; 56 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 2.0 MiB/s wr, 165 op/s 2024-09-11T00:17:32.231 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:31 smithi112 ceph-mon[35627]: pgmap v355: 97 pgs: 97 active+clean; 56 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 2.0 MiB/s wr, 165 op/s 2024-09-11T00:17:32.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:31 smithi138 ceph-mon[35019]: pgmap v355: 97 pgs: 97 active+clean; 56 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 2.0 MiB/s wr, 165 op/s 2024-09-11T00:17:32.966 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:17:32.967 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:17:33.236 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:17:33.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.737+0000 7f3dc050d640 1 -- 172.21.15.78:0/240275356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3db8103ca0 msgr2=0x7f3db8104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:33.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.737+0000 7f3dc050d640 1 --2- 172.21.15.78:0/240275356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3db8103ca0 0x7f3db8104080 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009ca0 tx=0x7f3db402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.737+0000 7f3dc050d640 1 -- 172.21.15.78:0/240275356 shutdown_connections 2024-09-11T00:17:33.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.737+0000 7f3dc050d640 1 --2- 172.21.15.78:0/240275356 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3db810d100 0x7f3db810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.737+0000 7f3dc050d640 1 --2- 172.21.15.78:0/240275356 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3db81045c0 0x7f3db810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.737+0000 7f3dc050d640 1 --2- 172.21.15.78:0/240275356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3db8103ca0 0x7f3db8104080 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.737+0000 7f3dc050d640 1 -- 172.21.15.78:0/240275356 >> 172.21.15.78:0/240275356 conn(0x7f3db80fd700 msgr2=0x7f3db80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:33.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.737+0000 7f3dc050d640 1 -- 172.21.15.78:0/240275356 shutdown_connections 2024-09-11T00:17:33.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.737+0000 7f3dc050d640 1 -- 172.21.15.78:0/240275356 wait complete. 2024-09-11T00:17:33.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.737+0000 7f3dc050d640 1 Processor -- start 2024-09-11T00:17:33.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.737+0000 7f3dc050d640 1 -- start start 2024-09-11T00:17:33.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.738+0000 7f3dc050d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3db8103ca0 0x7f3db8101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:33.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.738+0000 7f3dc050d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3db81045c0 0x7f3db8101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:33.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.738+0000 7f3dc050d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3db810d100 0x7f3db81023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:33.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.738+0000 7f3dc050d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3db8112d70 con 0x7f3db8103ca0 2024-09-11T00:17:33.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.738+0000 7f3dc050d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3db8112bf0 con 0x7f3db81045c0 2024-09-11T00:17:33.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.738+0000 7f3dc050d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3db8112ef0 con 0x7f3db810d100 2024-09-11T00:17:33.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.738+0000 7f3dbe2a9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3db8103ca0 0x7f3db8101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:33.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.738+0000 7f3dbe2a9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3db8103ca0 0x7f3db8101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49240/0 (socket says 172.21.15.78:49240) 2024-09-11T00:17:33.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.738+0000 7f3dbe2a9640 1 -- 172.21.15.78:0/2592940051 learned_addr learned my addr 172.21.15.78:0/2592940051 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:17:33.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.738+0000 7f3dbdaa8640 1 --2- 172.21.15.78:0/2592940051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3db81045c0 0x7f3db8101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:33.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.738+0000 7f3dbeaaa640 1 --2- 172.21.15.78:0/2592940051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3db810d100 0x7f3db81023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:33.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.738+0000 7f3dbe2a9640 1 -- 172.21.15.78:0/2592940051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3db810d100 msgr2=0x7f3db81023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:33.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.738+0000 7f3dbe2a9640 1 --2- 172.21.15.78:0/2592940051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3db810d100 0x7f3db81023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.738+0000 7f3dbe2a9640 1 -- 172.21.15.78:0/2592940051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3db81045c0 msgr2=0x7f3db8101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:33.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.738+0000 7f3dbe2a9640 1 --2- 172.21.15.78:0/2592940051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3db81045c0 0x7f3db8101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.738+0000 7f3dbe2a9640 1 -- 172.21.15.78:0/2592940051 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db81a76c0 con 0x7f3db8103ca0 2024-09-11T00:17:33.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.738+0000 7f3dbdaa8640 1 --2- 172.21.15.78:0/2592940051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3db81045c0 0x7f3db8101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:17:33.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.738+0000 7f3dbe2a9640 1 --2- 172.21.15.78:0/2592940051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3db8103ca0 0x7f3db8101950 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3db402ade0 tx=0x7f3db4031770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:33.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.738+0000 7f3daf7fe640 1 -- 172.21.15.78:0/2592940051 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db4003b70 con 0x7f3db8103ca0 2024-09-11T00:17:33.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.738+0000 7f3daf7fe640 1 -- 172.21.15.78:0/2592940051 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3db4003d10 con 0x7f3db8103ca0 2024-09-11T00:17:33.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.738+0000 7f3dc050d640 1 -- 172.21.15.78:0/2592940051 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3db81a7950 con 0x7f3db8103ca0 2024-09-11T00:17:33.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.738+0000 7f3daf7fe640 1 -- 172.21.15.78:0/2592940051 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db402fa50 con 0x7f3db8103ca0 2024-09-11T00:17:33.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.739+0000 7f3dc050d640 1 -- 172.21.15.78:0/2592940051 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3db81a7ee0 con 0x7f3db8103ca0 2024-09-11T00:17:33.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.741+0000 7f3dc28e2740 1 Processor -- start 2024-09-11T00:17:33.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.741+0000 7f3dc28e2740 1 -- start start 2024-09-11T00:17:33.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.741+0000 7f3dc28e2740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca34ee0 0x55fbdca352c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:33.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.741+0000 7f3dc28e2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fbdca35800 0x55fbdca41250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:33.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.741+0000 7f3dc28e2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca41790 0x55fbdca43b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:33.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.741+0000 7f3dc28e2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55fbdc9abe60 con 0x55fbdca41790 2024-09-11T00:17:33.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.741+0000 7f3dc28e2740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fbdc99b290 con 0x55fbdca34ee0 2024-09-11T00:17:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.741+0000 7f3dc28e2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55fbdc99f0a0 con 0x55fbdca35800 2024-09-11T00:17:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.741+0000 7f3daf7fe640 1 -- 172.21.15.78:0/2592940051 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f3db4004580 con 0x7f3db8103ca0 2024-09-11T00:17:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.741+0000 7f3dbeaaa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca34ee0 0x55fbdca352c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.741+0000 7f3dbdaa8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca41790 0x55fbdca43b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.741+0000 7f3dbeaaa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca34ee0 0x55fbdca352c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.78:56854/0 (socket says 172.21.15.78:56854) 2024-09-11T00:17:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.741+0000 7f3dbeaaa640 1 -- 172.21.15.78:0/3061241365 learned_addr learned my addr 172.21.15.78:0/3061241365 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:17:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.742+0000 7f3dbe2a9640 1 --2- 172.21.15.78:0/3061241365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fbdca35800 0x55fbdca41250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.742+0000 7f3dbeaaa640 1 -- 172.21.15.78:0/3061241365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fbdca35800 msgr2=0x55fbdca41250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.742+0000 7f3dbeaaa640 1 --2- 172.21.15.78:0/3061241365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fbdca35800 0x55fbdca41250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.742+0000 7f3dbeaaa640 1 -- 172.21.15.78:0/3061241365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca41790 msgr2=0x55fbdca43b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.742+0000 7f3dbeaaa640 1 --2- 172.21.15.78:0/3061241365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca41790 0x55fbdca43b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.742+0000 7f3dbeaaa640 1 -- 172.21.15.78:0/3061241365 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbdc6f9930 con 0x55fbdca34ee0 2024-09-11T00:17:33.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.742+0000 7f3dbeaaa640 1 --2- 172.21.15.78:0/3061241365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca34ee0 0x55fbdca352c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3db000b680 tx=0x7f3db000bb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=391eb823bb1c644c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:33.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.742+0000 7f3dacff9640 1 -- 172.21.15.78:0/3061241365 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db0003bd0 con 0x55fbdca34ee0 2024-09-11T00:17:33.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.742+0000 7f3dacff9640 1 -- 172.21.15.78:0/3061241365 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3db0015070 con 0x55fbdca34ee0 2024-09-11T00:17:33.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.742+0000 7f3dacff9640 1 -- 172.21.15.78:0/3061241365 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db0010680 con 0x55fbdca34ee0 2024-09-11T00:17:33.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.742+0000 7f3daf7fe640 1 --2- 172.21.15.78:0/2592940051 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3da40b54d0 0x7f3da40b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:33.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.742+0000 7f3dbe2a9640 1 --2- 172.21.15.78:0/2592940051 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3da40b54d0 0x7f3da40b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:33.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.742+0000 7f3daf7fe640 1 -- 172.21.15.78:0/2592940051 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f3db41070b0 con 0x7f3db8103ca0 2024-09-11T00:17:33.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.743+0000 7f3dbe2a9640 1 --2- 172.21.15.78:0/2592940051 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3da40b54d0 0x7f3da40b7990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3db4104970 tx=0x7f3db40095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:33.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.743+0000 7f3dc28e2740 1 -- 172.21.15.78:0/3061241365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca34ee0 msgr2=0x55fbdca352c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:33.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.743+0000 7f3dc28e2740 1 --2- 172.21.15.78:0/3061241365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca34ee0 0x55fbdca352c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3db000b680 tx=0x7f3db000bb40 comp rx=0 tx=0).stop 2024-09-11T00:17:33.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.743+0000 7f3dc28e2740 1 -- 172.21.15.78:0/3061241365 shutdown_connections 2024-09-11T00:17:33.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.743+0000 7f3dc28e2740 1 --2- 172.21.15.78:0/3061241365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca41790 0x55fbdca43b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.743+0000 7f3dc28e2740 1 --2- 172.21.15.78:0/3061241365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fbdca35800 0x55fbdca41250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.743+0000 7f3dc28e2740 1 --2- 172.21.15.78:0/3061241365 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca34ee0 0x55fbdca352c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.743+0000 7f3dc28e2740 1 -- 172.21.15.78:0/3061241365 >> 172.21.15.78:0/3061241365 conn(0x55fbdca32d10 msgr2=0x55fbdca33eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:33.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.743+0000 7f3dc28e2740 1 -- 172.21.15.78:0/3061241365 shutdown_connections 2024-09-11T00:17:33.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.743+0000 7f3dc28e2740 1 -- 172.21.15.78:0/3061241365 wait complete. 2024-09-11T00:17:33.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.743+0000 7f3dc28e2740 1 -- start start 2024-09-11T00:17:33.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.744+0000 7f3dc28e2740 1 Processor -- start 2024-09-11T00:17:33.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.744+0000 7f3dc28e2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fbdca34ee0 0x55fbdca3e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:33.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.744+0000 7f3dc28e2740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca35800 0x55fbdca3ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:33.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.744+0000 7f3dc28e2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca41790 0x55fbdca3f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:33.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.744+0000 7f3dc28e2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55fbdc7fc890 con 0x55fbdca41790 2024-09-11T00:17:33.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.744+0000 7f3dc28e2740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fbdc935d40 con 0x55fbdca35800 2024-09-11T00:17:33.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.744+0000 7f3dc28e2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55fbdca44440 con 0x55fbdca34ee0 2024-09-11T00:17:33.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.744+0000 7f3dc28e2740 10 client.0 _ll_register_callbacks cb 0x55fbdc999c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:17:33.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.744+0000 7f3dbdaa8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca35800 0x55fbdca3ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:33.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.744+0000 7f3dbeaaa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fbdca34ee0 0x55fbdca3e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:33.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.744+0000 7f3dbdaa8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca35800 0x55fbdca3ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.78:56858/0 (socket says 172.21.15.78:56858) 2024-09-11T00:17:33.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.744+0000 7f3dbdaa8640 1 -- 172.21.15.78:0/1349373627 learned_addr learned my addr 172.21.15.78:0/1349373627 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:17:33.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.744+0000 7f3dbeaaa640 1 --2- 172.21.15.78:0/1349373627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca41790 0x55fbdca3f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:33.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.744+0000 7f3dbdaa8640 1 -- 172.21.15.78:0/1349373627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fbdca34ee0 msgr2=0x55fbdca3e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:33.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.744+0000 7f3dbdaa8640 1 --2- 172.21.15.78:0/1349373627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fbdca34ee0 0x55fbdca3e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.744+0000 7f3dbdaa8640 1 -- 172.21.15.78:0/1349373627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca41790 msgr2=0x55fbdca3f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:33.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.744+0000 7f3dbdaa8640 1 --2- 172.21.15.78:0/1349373627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca41790 0x55fbdca3f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.744+0000 7f3dbdaa8640 1 -- 172.21.15.78:0/1349373627 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbdca4d820 con 0x55fbdca35800 2024-09-11T00:17:33.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.745+0000 7f3dbdaa8640 1 --2- 172.21.15.78:0/1349373627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca35800 0x55fbdca3ec50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3da8012d20 tx=0x7f3da800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f329c496a9c31fe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:33.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.745+0000 7f3da1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-11T00:17:33.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.745+0000 7f3da1ffb640 1 -- 172.21.15.78:0/1349373627 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da8012110 con 0x55fbdca35800 2024-09-11T00:17:33.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.745+0000 7f3dc28e2740 1 -- 172.21.15.78:0/1349373627 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3db0015070 con 0x55fbdca35800 2024-09-11T00:17:33.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.745+0000 7f3da1ffb640 1 -- 172.21.15.78:0/1349373627 <== mon.2 v2:172.21.15.112:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f3da8004030 con 0x55fbdca35800 2024-09-11T00:17:33.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.745+0000 7f3da1ffb640 1 -- 172.21.15.78:0/1349373627 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3da80122b0 con 0x55fbdca35800 2024-09-11T00:17:33.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.745+0000 7f3dc28e2740 10 client.25019 fetch_fsmap learned FSMap version 20 2024-09-11T00:17:33.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.745+0000 7f3dc28e2740 1 -- 172.21.15.78:0/1349373627 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55fbdca50210 con 0x55fbdca35800 2024-09-11T00:17:33.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.745+0000 7f3da1ffb640 1 -- 172.21.15.78:0/1349373627 <== mon.2 v2:172.21.15.112:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3db0015070 con 0x55fbdca35800 2024-09-11T00:17:33.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.745+0000 7f3da1ffb640 1 -- 172.21.15.78:0/1349373627 <== mon.2 v2:172.21.15.112:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3da8010430 con 0x55fbdca35800 2024-09-11T00:17:33.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.745+0000 7f3dc28e2740 10 client.25019 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:17:33.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.745+0000 7f3dc28e2740 10 client.25019 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:17:33.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.745+0000 7f3dc28e2740 20 client.25019 populate_metadata read hostname 'smithi078' 2024-09-11T00:17:33.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.745+0000 7f3dc28e2740 1 --2- 172.21.15.78:0/1349373627 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fbdca51720 0x55fbdca53b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:33.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.745+0000 7f3dc28e2740 4 client.25019 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:17:33.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.745+0000 7f3dc28e2740 1 -- 172.21.15.78:0/1349373627 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbdc9addb0 con 0x55fbdca51720 2024-09-11T00:17:33.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.746+0000 7f3dbeaaa640 1 --2- 172.21.15.78:0/1349373627 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fbdca51720 0x55fbdca53b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:33.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.746+0000 7f3da1ffb640 10 client.25019 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:17:33.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.746+0000 7f3dbeaaa640 1 --2- 172.21.15.78:0/1349373627 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fbdca51720 0x55fbdca53b40 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76c525cd3756d7fa server_cookie=30502d45fe589d17 in_seq=0 out_seq=0 2024-09-11T00:17:33.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.747+0000 7f3da1ffb640 1 -- 172.21.15.78:0/1349373627 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fbdc9addb0 con 0x55fbdca51720 2024-09-11T00:17:33.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.747+0000 7f3da1ffb640 10 client.25019 handle_command_reply: tid=0 2024-09-11T00:17:33.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.747+0000 7f3dc28e2740 1 client.25019 shutdown 2024-09-11T00:17:33.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.747+0000 7f3dc28e2740 1 -- 172.21.15.78:0/1349373627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca35800 msgr2=0x55fbdca3ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:33.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.747+0000 7f3dc28e2740 1 --2- 172.21.15.78:0/1349373627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca35800 0x55fbdca3ec50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3da8012d20 tx=0x7f3da800f790 comp rx=0 tx=0).stop 2024-09-11T00:17:33.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.747+0000 7f3dc28e2740 1 -- 172.21.15.78:0/1349373627 shutdown_connections 2024-09-11T00:17:33.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.747+0000 7f3dc28e2740 1 --2- 172.21.15.78:0/1349373627 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fbdca51720 0x55fbdca53b40 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.747+0000 7f3dc28e2740 1 --2- 172.21.15.78:0/1349373627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca41790 0x55fbdca3f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.747+0000 7f3da1ffb640 0 client.25019 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:17:33.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.747+0000 7f3dc28e2740 1 --2- 172.21.15.78:0/1349373627 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca35800 0x55fbdca3ec50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.747+0000 7f3dc28e2740 1 --2- 172.21.15.78:0/1349373627 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fbdca34ee0 0x55fbdca3e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.747+0000 7f3dc28e2740 1 -- 172.21.15.78:0/1349373627 >> 172.21.15.78:0/1349373627 conn(0x55fbdca32d10 msgr2=0x55fbdca31f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:33.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.747+0000 7f3dc28e2740 1 -- 172.21.15.78:0/1349373627 shutdown_connections 2024-09-11T00:17:33.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.747+0000 7f3dc28e2740 1 -- 172.21.15.78:0/1349373627 wait complete. 2024-09-11T00:17:33.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.747+0000 7f3dc28e2740 20 client.25019 trim_cache size 0 max 16384 2024-09-11T00:17:33.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.766+0000 7f3dc28e2740 1 Processor -- start 2024-09-11T00:17:33.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.766+0000 7f3dc28e2740 1 -- start start 2024-09-11T00:17:33.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.766+0000 7f3dc28e2740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca34ee0 0x55fbdca3dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:33.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.766+0000 7f3dc28e2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca35800 0x55fbdca40450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:33.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.766+0000 7f3dc28e2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fbdca41790 0x55fbdca3b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:33.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.766+0000 7f3dc28e2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3db81ae8e0 con 0x55fbdca35800 2024-09-11T00:17:33.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.766+0000 7f3dc28e2740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3db81b1160 con 0x55fbdca34ee0 2024-09-11T00:17:33.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.766+0000 7f3dc28e2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3db81aef50 con 0x55fbdca41790 2024-09-11T00:17:33.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.766+0000 7f3dbdaa8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca35800 0x55fbdca40450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:33.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.766+0000 7f3dbdaa8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca35800 0x55fbdca40450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49260/0 (socket says 172.21.15.78:49260) 2024-09-11T00:17:33.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.766+0000 7f3dbdaa8640 1 -- 172.21.15.78:0/4083608374 learned_addr learned my addr 172.21.15.78:0/4083608374 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:17:33.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.766+0000 7f3dbeaaa640 1 --2- 172.21.15.78:0/4083608374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca34ee0 0x55fbdca3dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:33.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.766+0000 7f3dbeaaa640 1 --2- 172.21.15.78:0/4083608374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fbdca41790 0x55fbdca3b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:33.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.766+0000 7f3dbdaa8640 1 -- 172.21.15.78:0/4083608374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fbdca41790 msgr2=0x55fbdca3b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:33.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.766+0000 7f3dbdaa8640 1 --2- 172.21.15.78:0/4083608374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fbdca41790 0x55fbdca3b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.766+0000 7f3dbdaa8640 1 -- 172.21.15.78:0/4083608374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca34ee0 msgr2=0x55fbdca3dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:33.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.766+0000 7f3dbdaa8640 1 --2- 172.21.15.78:0/4083608374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca34ee0 0x55fbdca3dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.766+0000 7f3dbdaa8640 1 -- 172.21.15.78:0/4083608374 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbdca32b40 con 0x55fbdca35800 2024-09-11T00:17:33.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.767+0000 7f3dbdaa8640 1 --2- 172.21.15.78:0/4083608374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca35800 0x55fbdca40450 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3da80108d0 tx=0x7f3da8009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93f913b93b53f80 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:33.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.767+0000 7f3da3fff640 1 -- 172.21.15.78:0/4083608374 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da8029030 con 0x55fbdca35800 2024-09-11T00:17:33.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.767+0000 7f3da3fff640 1 -- 172.21.15.78:0/4083608374 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3da800fe80 con 0x55fbdca35800 2024-09-11T00:17:33.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.767+0000 7f3da3fff640 1 -- 172.21.15.78:0/4083608374 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da80053e0 con 0x55fbdca35800 2024-09-11T00:17:33.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.768+0000 7f3dc28e2740 1 -- 172.21.15.78:0/4083608374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca35800 msgr2=0x55fbdca40450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:33.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.768+0000 7f3dc28e2740 1 --2- 172.21.15.78:0/4083608374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca35800 0x55fbdca40450 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3da80108d0 tx=0x7f3da8009fd0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.768+0000 7f3dc28e2740 1 -- 172.21.15.78:0/4083608374 shutdown_connections 2024-09-11T00:17:33.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.768+0000 7f3dc28e2740 1 --2- 172.21.15.78:0/4083608374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fbdca41790 0x55fbdca3b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.768+0000 7f3dc28e2740 1 --2- 172.21.15.78:0/4083608374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca35800 0x55fbdca40450 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.768+0000 7f3dc28e2740 1 --2- 172.21.15.78:0/4083608374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca34ee0 0x55fbdca3dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.768+0000 7f3dc28e2740 1 -- 172.21.15.78:0/4083608374 >> 172.21.15.78:0/4083608374 conn(0x55fbdca32d10 msgr2=0x55fbdca3fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:33.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.768+0000 7f3dc28e2740 1 -- 172.21.15.78:0/4083608374 shutdown_connections 2024-09-11T00:17:33.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.768+0000 7f3dc28e2740 1 -- 172.21.15.78:0/4083608374 wait complete. 2024-09-11T00:17:33.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.768+0000 7f3dc28e2740 1 -- start start 2024-09-11T00:17:33.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.768+0000 7f3dc28e2740 1 Processor -- start 2024-09-11T00:17:33.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.768+0000 7f3dc28e2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fbdca34ee0 0x55fbdca46260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:33.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.768+0000 7f3dc28e2740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca35800 0x55fbdca46800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:33.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.768+0000 7f3dc28e2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca41790 0x55fbdcab7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:33.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.768+0000 7f3dc28e2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3db81af620 con 0x55fbdca41790 2024-09-11T00:17:33.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.768+0000 7f3dc28e2740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3db81b0a90 con 0x55fbdca35800 2024-09-11T00:17:33.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.768+0000 7f3dc28e2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3db81afcf0 con 0x55fbdca34ee0 2024-09-11T00:17:33.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.768+0000 7f3dc28e2740 10 client.0 _ll_register_callbacks cb 0x7f3da8009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:17:33.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.769+0000 7f3dbdaa8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca35800 0x55fbdca46800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:33.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.769+0000 7f3dbeaaa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca41790 0x55fbdcab7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:33.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.769+0000 7f3dbeaaa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca41790 0x55fbdcab7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49270/0 (socket says 172.21.15.78:49270) 2024-09-11T00:17:33.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.769+0000 7f3dbdaa8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca35800 0x55fbdca46800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.78:56878/0 (socket says 172.21.15.78:56878) 2024-09-11T00:17:33.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.769+0000 7f3dbeaaa640 1 -- 172.21.15.78:0/1906514040 learned_addr learned my addr 172.21.15.78:0/1906514040 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:17:33.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.769+0000 7f3dbeaaa640 1 --2- 172.21.15.78:0/1906514040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fbdca34ee0 0x55fbdca46260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:33.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.769+0000 7f3dbeaaa640 1 -- 172.21.15.78:0/1906514040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fbdca34ee0 msgr2=0x55fbdca46260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:33.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.769+0000 7f3dbeaaa640 1 --2- 172.21.15.78:0/1906514040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fbdca34ee0 0x55fbdca46260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.769+0000 7f3dbeaaa640 1 -- 172.21.15.78:0/1906514040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca35800 msgr2=0x55fbdca46800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:33.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.769+0000 7f3dbeaaa640 1 --2- 172.21.15.78:0/1906514040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca35800 0x55fbdca46800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.769+0000 7f3dbeaaa640 1 -- 172.21.15.78:0/1906514040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbdca39430 con 0x55fbdca41790 2024-09-11T00:17:33.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.769+0000 7f3dbdaa8640 1 --2- 172.21.15.78:0/1906514040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca35800 0x55fbdca46800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:17:33.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.769+0000 7f3dbeaaa640 1 --2- 172.21.15.78:0/1906514040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca41790 0x55fbdcab7770 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3db0011c10 tx=0x7f3db000bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d773cb668902c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:33.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.769+0000 7f3da1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:17:33.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.769+0000 7f3da1ffb640 1 -- 172.21.15.78:0/1906514040 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db0023040 con 0x55fbdca41790 2024-09-11T00:17:33.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.769+0000 7f3da1ffb640 1 -- 172.21.15.78:0/1906514040 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f3db0011890 con 0x55fbdca41790 2024-09-11T00:17:33.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.769+0000 7f3dc28e2740 1 -- 172.21.15.78:0/1906514040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fbdc9a9860 con 0x55fbdca41790 2024-09-11T00:17:33.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.769+0000 7f3da1ffb640 1 -- 172.21.15.78:0/1906514040 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3db0005020 con 0x55fbdca41790 2024-09-11T00:17:33.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.769+0000 7f3dc28e2740 10 client.15492 fetch_fsmap learned FSMap version 20 2024-09-11T00:17:33.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.769+0000 7f3dc28e2740 1 -- 172.21.15.78:0/1906514040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55fbdcabf190 con 0x55fbdca41790 2024-09-11T00:17:33.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.770+0000 7f3da1ffb640 1 -- 172.21.15.78:0/1906514040 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55fbdc9a9860 con 0x55fbdca41790 2024-09-11T00:17:33.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.770+0000 7f3da1ffb640 1 -- 172.21.15.78:0/1906514040 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3db002b470 con 0x55fbdca41790 2024-09-11T00:17:33.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.770+0000 7f3dc28e2740 10 client.15492 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:17:33.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.770+0000 7f3dc28e2740 10 client.15492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:17:33.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.770+0000 7f3dc28e2740 20 client.15492 populate_metadata read hostname 'smithi078' 2024-09-11T00:17:33.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.770+0000 7f3dc28e2740 1 --2- 172.21.15.78:0/1906514040 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fbdca51720 0x55fbdcac17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:33.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.770+0000 7f3dc28e2740 4 client.15492 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:17:33.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.770+0000 7f3dc28e2740 1 -- 172.21.15.78:0/1906514040 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fbdc9a6c90 con 0x55fbdca51720 2024-09-11T00:17:33.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.770+0000 7f3dbdaa8640 1 --2- 172.21.15.78:0/1906514040 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fbdca51720 0x55fbdcac17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:33.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.770+0000 7f3da1ffb640 10 client.15492 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:17:33.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.770+0000 7f3dbdaa8640 1 --2- 172.21.15.78:0/1906514040 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fbdca51720 0x55fbdcac17e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5574158c9a967e5d server_cookie=b9691b0b613b7f33 in_seq=0 out_seq=0 2024-09-11T00:17:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.895+0000 7f3da1ffb640 1 -- 172.21.15.78:0/1906514040 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fbdc9a6c90 con 0x55fbdca51720 2024-09-11T00:17:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.895+0000 7f3da1ffb640 10 client.15492 handle_command_reply: tid=0 2024-09-11T00:17:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.895+0000 7f3dc28e2740 1 client.15492 shutdown 2024-09-11T00:17:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.895+0000 7f3dc28e2740 1 -- 172.21.15.78:0/1906514040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca41790 msgr2=0x55fbdcab7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.895+0000 7f3dc28e2740 1 --2- 172.21.15.78:0/1906514040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca41790 0x55fbdcab7770 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3db0011c10 tx=0x7f3db000bb40 comp rx=0 tx=0).stop 2024-09-11T00:17:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.896+0000 7f3dc28e2740 1 -- 172.21.15.78:0/1906514040 shutdown_connections 2024-09-11T00:17:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.896+0000 7f3dc28e2740 1 --2- 172.21.15.78:0/1906514040 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fbdca51720 0x55fbdcac17e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.896+0000 7f3dc28e2740 1 --2- 172.21.15.78:0/1906514040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fbdca41790 0x55fbdcab7770 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.896+0000 7f3dc28e2740 1 --2- 172.21.15.78:0/1906514040 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fbdca35800 0x55fbdca46800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.896+0000 7f3dc28e2740 1 --2- 172.21.15.78:0/1906514040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fbdca34ee0 0x55fbdca46260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.896+0000 7f3da1ffb640 0 client.15492 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:17:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.896+0000 7f3dc28e2740 1 -- 172.21.15.78:0/1906514040 >> 172.21.15.78:0/1906514040 conn(0x55fbdca32d10 msgr2=0x55fbdca4ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.896+0000 7f3dc28e2740 1 -- 172.21.15.78:0/1906514040 shutdown_connections 2024-09-11T00:17:33.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.896+0000 7f3dc28e2740 1 -- 172.21.15.78:0/1906514040 wait complete. 2024-09-11T00:17:33.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.896+0000 7f3dc28e2740 20 client.15492 trim_cache size 0 max 16384 2024-09-11T00:17:33.899 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:17:33.899 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-11T00:17:33.899 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "7d270da9-0d55-460a-8497-50641dd07117", 2024-09-11T00:17:33.899 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-11T00:17:33.899 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:17:33.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.896+0000 7f3dc050d640 1 -- 172.21.15.78:0/2592940051 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3da40b54d0 msgr2=0x7f3da40b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:33.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.896+0000 7f3dc050d640 1 --2- 172.21.15.78:0/2592940051 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3da40b54d0 0x7f3da40b7990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3db4104970 tx=0x7f3db40095c0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.896+0000 7f3dc050d640 1 -- 172.21.15.78:0/2592940051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3db8103ca0 msgr2=0x7f3db8101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:33.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.896+0000 7f3dc050d640 1 --2- 172.21.15.78:0/2592940051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3db8103ca0 0x7f3db8101950 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3db402ade0 tx=0x7f3db4031770 comp rx=0 tx=0).stop 2024-09-11T00:17:33.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.897+0000 7f3dc050d640 1 -- 172.21.15.78:0/2592940051 shutdown_connections 2024-09-11T00:17:33.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.897+0000 7f3dc050d640 1 --2- 172.21.15.78:0/2592940051 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3da40b54d0 0x7f3da40b7990 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.897+0000 7f3dc050d640 1 --2- 172.21.15.78:0/2592940051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3db810d100 0x7f3db81023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.897+0000 7f3dc050d640 1 --2- 172.21.15.78:0/2592940051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3db81045c0 0x7f3db8101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.897+0000 7f3dc050d640 1 --2- 172.21.15.78:0/2592940051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3db8103ca0 0x7f3db8101950 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:33.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.897+0000 7f3dc050d640 1 -- 172.21.15.78:0/2592940051 >> 172.21.15.78:0/2592940051 conn(0x7f3db80fd700 msgr2=0x7f3db80fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:33.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.897+0000 7f3dc050d640 1 -- 172.21.15.78:0/2592940051 shutdown_connections 2024-09-11T00:17:33.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:33.897+0000 7f3dc050d640 1 -- 172.21.15.78:0/2592940051 wait complete. 2024-09-11T00:17:34.758 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:17:35.019 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:17:35.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:34 smithi138 ceph-mon[35019]: pgmap v356: 97 pgs: 97 active+clean; 67 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 2.7 MiB/s wr, 315 op/s 2024-09-11T00:17:35.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:34 smithi138 ceph-mon[35019]: scrub queued for path: / 2024-09-11T00:17:35.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:34 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:17:35.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:34 smithi138 ceph-mon[35019]: scrub summary: active paths [/] 2024-09-11T00:17:35.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:34 smithi078 ceph-mon[30865]: pgmap v356: 97 pgs: 97 active+clean; 67 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 2.7 MiB/s wr, 315 op/s 2024-09-11T00:17:35.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:34 smithi078 ceph-mon[30865]: scrub queued for path: / 2024-09-11T00:17:35.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:34 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:17:35.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:34 smithi078 ceph-mon[30865]: scrub summary: active paths [/] 2024-09-11T00:17:35.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:34 smithi112 ceph-mon[35627]: pgmap v356: 97 pgs: 97 active+clean; 67 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 2.7 MiB/s wr, 315 op/s 2024-09-11T00:17:35.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:34 smithi112 ceph-mon[35627]: scrub queued for path: / 2024-09-11T00:17:35.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:34 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:17:35.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:34 smithi112 ceph-mon[35627]: scrub summary: active paths [/] 2024-09-11T00:17:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.536+0000 7fd6fec93640 1 -- 172.21.15.78:0/3568485782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6f8103b60 msgr2=0x7fd6f8103f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.536+0000 7fd6fec93640 1 --2- 172.21.15.78:0/3568485782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6f8103b60 0x7fd6f8103f40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4009900 tx=0x7fd6f402a410 comp rx=0 tx=0).stop 2024-09-11T00:17:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.536+0000 7fd6fec93640 1 -- 172.21.15.78:0/3568485782 shutdown_connections 2024-09-11T00:17:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.536+0000 7fd6fec93640 1 --2- 172.21.15.78:0/3568485782 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6f810d110 0x7fd6f810f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.536+0000 7fd6fec93640 1 --2- 172.21.15.78:0/3568485782 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6f8104560 0x7fd6f810cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.536+0000 7fd6fec93640 1 --2- 172.21.15.78:0/3568485782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6f8103b60 0x7fd6f8103f40 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.536+0000 7fd6fec93640 1 -- 172.21.15.78:0/3568485782 >> 172.21.15.78:0/3568485782 conn(0x7fd6f80fd750 msgr2=0x7fd6f80ffb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.536+0000 7fd6fec93640 1 -- 172.21.15.78:0/3568485782 shutdown_connections 2024-09-11T00:17:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.536+0000 7fd6fec93640 1 -- 172.21.15.78:0/3568485782 wait complete. 2024-09-11T00:17:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.537+0000 7fd6fec93640 1 Processor -- start 2024-09-11T00:17:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.537+0000 7fd6fec93640 1 -- start start 2024-09-11T00:17:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.537+0000 7fd6fec93640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6f8103b60 0x7fd6f81019e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.537+0000 7fd6fec93640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6f8104560 0x7fd6f8101f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.537+0000 7fd6fec93640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6f810d110 0x7fd6f8102460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.537+0000 7fd6fec93640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f8112dd0 con 0x7fd6f8104560 2024-09-11T00:17:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.537+0000 7fd6fec93640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f8112c50 con 0x7fd6f8103b60 2024-09-11T00:17:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.537+0000 7fd6fec93640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f8112f50 con 0x7fd6f810d110 2024-09-11T00:17:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.537+0000 7fd6effff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6f8104560 0x7fd6f8101f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.537+0000 7fd6effff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6f8104560 0x7fd6f8101f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55406/0 (socket says 172.21.15.78:55406) 2024-09-11T00:17:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.537+0000 7fd6effff640 1 -- 172.21.15.78:0/1780770282 learned_addr learned my addr 172.21.15.78:0/1780770282 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:17:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.537+0000 7fd6fca2f640 1 --2- 172.21.15.78:0/1780770282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6f8103b60 0x7fd6f81019e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.537+0000 7fd6fd230640 1 --2- 172.21.15.78:0/1780770282 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6f810d110 0x7fd6f8102460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.537+0000 7fd6effff640 1 -- 172.21.15.78:0/1780770282 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6f810d110 msgr2=0x7fd6f8102460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.537+0000 7fd6effff640 1 --2- 172.21.15.78:0/1780770282 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6f810d110 0x7fd6f8102460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.537+0000 7fd6effff640 1 -- 172.21.15.78:0/1780770282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6f8103b60 msgr2=0x7fd6f81019e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.537+0000 7fd6effff640 1 --2- 172.21.15.78:0/1780770282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6f8103b60 0x7fd6f81019e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.537+0000 7fd6effff640 1 -- 172.21.15.78:0/1780770282 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f81a77c0 con 0x7fd6f8104560 2024-09-11T00:17:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.537+0000 7fd6fca2f640 1 --2- 172.21.15.78:0/1780770282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6f8103b60 0x7fd6f81019e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:17:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.537+0000 7fd6fd230640 1 --2- 172.21.15.78:0/1780770282 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6f810d110 0x7fd6f8102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:17:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.538+0000 7fd6effff640 1 --2- 172.21.15.78:0/1780770282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6f8104560 0x7fd6f8101f20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800b4a0 tx=0x7fd6e800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.538+0000 7fd6edffb640 1 -- 172.21.15.78:0/1780770282 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8014070 con 0x7fd6f8104560 2024-09-11T00:17:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.538+0000 7fd6edffb640 1 -- 172.21.15.78:0/1780770282 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6e8010ac0 con 0x7fd6f8104560 2024-09-11T00:17:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.538+0000 7fd6fec93640 1 -- 172.21.15.78:0/1780770282 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f81a7ab0 con 0x7fd6f8104560 2024-09-11T00:17:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.538+0000 7fd6edffb640 1 -- 172.21.15.78:0/1780770282 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8017c30 con 0x7fd6f8104560 2024-09-11T00:17:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.538+0000 7fd6fec93640 1 -- 172.21.15.78:0/1780770282 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f81a7ff0 con 0x7fd6f8104560 2024-09-11T00:17:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.541+0000 7fd6edffb640 1 -- 172.21.15.78:0/1780770282 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fd6e8010610 con 0x7fd6f8104560 2024-09-11T00:17:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.541+0000 7fd701068740 1 Processor -- start 2024-09-11T00:17:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.541+0000 7fd701068740 1 -- start start 2024-09-11T00:17:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.541+0000 7fd701068740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3a480 0x55ff5fd3a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.541+0000 7fd701068740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff5fd3ada0 0x55ff5fd467f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:35.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.541+0000 7fd701068740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff5fd46d30 0x55ff5fd49120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.541+0000 7fd701068740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ff5fcb0e50 con 0x55ff5fd3a480 2024-09-11T00:17:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.541+0000 7fd701068740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ff5fca0280 con 0x55ff5fd46d30 2024-09-11T00:17:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.541+0000 7fd701068740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55ff5fca4090 con 0x55ff5fd3ada0 2024-09-11T00:17:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.542+0000 7fd6fd230640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3a480 0x55ff5fd3a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.542+0000 7fd6fd230640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3a480 0x55ff5fd3a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55418/0 (socket says 172.21.15.78:55418) 2024-09-11T00:17:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.542+0000 7fd6fd230640 1 -- 172.21.15.78:0/788719277 learned_addr learned my addr 172.21.15.78:0/788719277 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:17:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.542+0000 7fd6effff640 1 --2- 172.21.15.78:0/788719277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff5fd46d30 0x55ff5fd49120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.542+0000 7fd6fca2f640 1 --2- 172.21.15.78:0/788719277 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff5fd3ada0 0x55ff5fd467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.542+0000 7fd6fd230640 1 -- 172.21.15.78:0/788719277 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff5fd3ada0 msgr2=0x55ff5fd467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.542+0000 7fd6fd230640 1 --2- 172.21.15.78:0/788719277 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff5fd3ada0 0x55ff5fd467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.542+0000 7fd6fd230640 1 -- 172.21.15.78:0/788719277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff5fd46d30 msgr2=0x55ff5fd49120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.542+0000 7fd6fd230640 1 --2- 172.21.15.78:0/788719277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff5fd46d30 0x55ff5fd49120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.542+0000 7fd6fd230640 1 -- 172.21.15.78:0/788719277 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff5f9fe650 con 0x55ff5fd3a480 2024-09-11T00:17:35.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.542+0000 7fd6edffb640 1 --2- 172.21.15.78:0/1780770282 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd6e00b5450 0x7fd6e00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:35.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.542+0000 7fd6fd230640 1 --2- 172.21.15.78:0/788719277 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3a480 0x55ff5fd3a860 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0010480 tx=0x7fd6f0010940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144557e25804a56b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:35.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.542+0000 7fd6fca2f640 1 --2- 172.21.15.78:0/1780770282 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd6e00b5450 0x7fd6e00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:35.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.542+0000 7fd6edffb640 1 -- 172.21.15.78:0/1780770282 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fd6e80e5960 con 0x7fd6f8104560 2024-09-11T00:17:35.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.542+0000 7fd6deffd640 1 -- 172.21.15.78:0/788719277 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0017070 con 0x55ff5fd3a480 2024-09-11T00:17:35.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.543+0000 7fd6deffd640 1 -- 172.21.15.78:0/788719277 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6f0003b70 con 0x55ff5fd3a480 2024-09-11T00:17:35.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.543+0000 7fd6deffd640 1 -- 172.21.15.78:0/788719277 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f00118d0 con 0x55ff5fd3a480 2024-09-11T00:17:35.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.543+0000 7fd701068740 1 -- 172.21.15.78:0/788719277 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3a480 msgr2=0x55ff5fd3a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:35.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.543+0000 7fd701068740 1 --2- 172.21.15.78:0/788719277 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3a480 0x55ff5fd3a860 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0010480 tx=0x7fd6f0010940 comp rx=0 tx=0).stop 2024-09-11T00:17:35.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.543+0000 7fd6fca2f640 1 --2- 172.21.15.78:0/1780770282 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd6e00b5450 0x7fd6e00b7910 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4031440 tx=0x7fd6f40058b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:35.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.543+0000 7fd701068740 1 -- 172.21.15.78:0/788719277 shutdown_connections 2024-09-11T00:17:35.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.543+0000 7fd701068740 1 --2- 172.21.15.78:0/788719277 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff5fd46d30 0x55ff5fd49120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.543+0000 7fd701068740 1 --2- 172.21.15.78:0/788719277 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff5fd3ada0 0x55ff5fd467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.543+0000 7fd701068740 1 --2- 172.21.15.78:0/788719277 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3a480 0x55ff5fd3a860 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.543+0000 7fd701068740 1 -- 172.21.15.78:0/788719277 >> 172.21.15.78:0/788719277 conn(0x55ff5fd382b0 msgr2=0x55ff5fd39450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:35.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.543+0000 7fd701068740 1 -- 172.21.15.78:0/788719277 shutdown_connections 2024-09-11T00:17:35.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.543+0000 7fd701068740 1 -- 172.21.15.78:0/788719277 wait complete. 2024-09-11T00:17:35.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.544+0000 7fd701068740 1 -- start start 2024-09-11T00:17:35.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.544+0000 7fd701068740 1 Processor -- start 2024-09-11T00:17:35.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.544+0000 7fd701068740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff5fd3a480 0x55ff5fd46660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:35.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.544+0000 7fd701068740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3ada0 0x55ff5fd43ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:35.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.544+0000 7fd701068740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff5fd46d30 0x55ff5fd44130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:35.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.544+0000 7fd701068740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ff5fb01700 con 0x55ff5fd3ada0 2024-09-11T00:17:35.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.544+0000 7fd701068740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ff5fc3b110 con 0x55ff5fd3a480 2024-09-11T00:17:35.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.544+0000 7fd701068740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55ff5fd499b0 con 0x55ff5fd46d30 2024-09-11T00:17:35.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.544+0000 7fd701068740 10 client.0 _ll_register_callbacks cb 0x55ff5fc54990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:17:35.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.544+0000 7fd6fca2f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff5fd3a480 0x55ff5fd46660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:35.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.544+0000 7fd6effff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3ada0 0x55ff5fd43ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:35.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.544+0000 7fd6fca2f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff5fd3a480 0x55ff5fd46660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.78:45864/0 (socket says 172.21.15.78:45864) 2024-09-11T00:17:35.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.544+0000 7fd6fca2f640 1 -- 172.21.15.78:0/326852797 learned_addr learned my addr 172.21.15.78:0/326852797 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:17:35.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.545+0000 7fd6fd230640 1 --2- 172.21.15.78:0/326852797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff5fd46d30 0x55ff5fd44130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:35.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.545+0000 7fd6effff640 1 -- 172.21.15.78:0/326852797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff5fd46d30 msgr2=0x55ff5fd44130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:35.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.545+0000 7fd6effff640 1 --2- 172.21.15.78:0/326852797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff5fd46d30 0x55ff5fd44130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.545+0000 7fd6effff640 1 -- 172.21.15.78:0/326852797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff5fd3a480 msgr2=0x55ff5fd46660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:35.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.545+0000 7fd6effff640 1 --2- 172.21.15.78:0/326852797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff5fd3a480 0x55ff5fd46660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.545+0000 7fd6effff640 1 -- 172.21.15.78:0/326852797 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff5fc68c40 con 0x55ff5fd3ada0 2024-09-11T00:17:35.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.545+0000 7fd6fca2f640 1 --2- 172.21.15.78:0/326852797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff5fd3a480 0x55ff5fd46660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:17:35.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.545+0000 7fd6effff640 1 --2- 172.21.15.78:0/326852797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3ada0 0x55ff5fd43ab0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80e30d0 tx=0x7fd6e80a8450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c0d2115f3c16f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:35.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.545+0000 7fd6d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:17:35.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.545+0000 7fd6d7fff640 1 -- 172.21.15.78:0/326852797 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e801e070 con 0x55ff5fd3ada0 2024-09-11T00:17:35.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.545+0000 7fd6d7fff640 1 -- 172.21.15.78:0/326852797 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fd6e80a8070 con 0x55ff5fd3ada0 2024-09-11T00:17:35.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.545+0000 7fd701068740 1 -- 172.21.15.78:0/326852797 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6f0003b70 con 0x55ff5fd3ada0 2024-09-11T00:17:35.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.545+0000 7fd6d7fff640 1 -- 172.21.15.78:0/326852797 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd6e80ab750 con 0x55ff5fd3ada0 2024-09-11T00:17:35.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.545+0000 7fd701068740 10 client.15504 fetch_fsmap learned FSMap version 20 2024-09-11T00:17:35.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.545+0000 7fd701068740 1 -- 172.21.15.78:0/326852797 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ff5fd55380 con 0x55ff5fd3ada0 2024-09-11T00:17:35.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.545+0000 7fd6d7fff640 1 -- 172.21.15.78:0/326852797 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6e80af080 con 0x55ff5fd3ada0 2024-09-11T00:17:35.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.546+0000 7fd6d7fff640 1 -- 172.21.15.78:0/326852797 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd6e8091bd0 con 0x55ff5fd3ada0 2024-09-11T00:17:35.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.546+0000 7fd701068740 10 client.15504 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:17:35.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.546+0000 7fd701068740 10 client.15504 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:17:35.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.546+0000 7fd701068740 20 client.15504 populate_metadata read hostname 'smithi078' 2024-09-11T00:17:35.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.546+0000 7fd701068740 1 --2- 172.21.15.78:0/326852797 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ff5fd56840 0x55ff5fd58c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:35.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.546+0000 7fd701068740 4 client.15504 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:17:35.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.546+0000 7fd701068740 1 -- 172.21.15.78:0/326852797 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff5fcb2da0 con 0x55ff5fd56840 2024-09-11T00:17:35.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.546+0000 7fd6fca2f640 1 --2- 172.21.15.78:0/326852797 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ff5fd56840 0x55ff5fd58c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:35.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.546+0000 7fd6fca2f640 1 --2- 172.21.15.78:0/326852797 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ff5fd56840 0x55ff5fd58c30 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c81575e9518dae13 server_cookie=3c73bd12b33621cd in_seq=0 out_seq=0 2024-09-11T00:17:35.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.546+0000 7fd6d7fff640 10 client.15504 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:17:35.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.549+0000 7fd6d7fff640 1 -- 172.21.15.78:0/326852797 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ff5fcb2da0 con 0x55ff5fd56840 2024-09-11T00:17:35.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.549+0000 7fd6d7fff640 10 client.15504 handle_command_reply: tid=0 2024-09-11T00:17:35.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.549+0000 7fd701068740 1 client.15504 shutdown 2024-09-11T00:17:35.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.550+0000 7fd701068740 1 -- 172.21.15.78:0/326852797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3ada0 msgr2=0x55ff5fd43ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:35.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.550+0000 7fd701068740 1 --2- 172.21.15.78:0/326852797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3ada0 0x55ff5fd43ab0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80e30d0 tx=0x7fd6e80a8450 comp rx=0 tx=0).stop 2024-09-11T00:17:35.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.550+0000 7fd701068740 1 -- 172.21.15.78:0/326852797 shutdown_connections 2024-09-11T00:17:35.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.550+0000 7fd701068740 1 --2- 172.21.15.78:0/326852797 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ff5fd56840 0x55ff5fd58c30 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.550+0000 7fd6d7fff640 0 client.15504 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:17:35.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.550+0000 7fd701068740 1 --2- 172.21.15.78:0/326852797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff5fd46d30 0x55ff5fd44130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.550+0000 7fd701068740 1 --2- 172.21.15.78:0/326852797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3ada0 0x55ff5fd43ab0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.550+0000 7fd701068740 1 --2- 172.21.15.78:0/326852797 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff5fd3a480 0x55ff5fd46660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.550+0000 7fd701068740 1 -- 172.21.15.78:0/326852797 >> 172.21.15.78:0/326852797 conn(0x55ff5fd382b0 msgr2=0x55ff5fd3de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:35.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.550+0000 7fd701068740 1 -- 172.21.15.78:0/326852797 shutdown_connections 2024-09-11T00:17:35.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.550+0000 7fd701068740 1 -- 172.21.15.78:0/326852797 wait complete. 2024-09-11T00:17:35.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.550+0000 7fd701068740 20 client.15504 trim_cache size 0 max 16384 2024-09-11T00:17:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.569+0000 7fd701068740 1 Processor -- start 2024-09-11T00:17:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.569+0000 7fd701068740 1 -- start start 2024-09-11T00:17:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.569+0000 7fd701068740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff5fd3a480 0x55ff5fd39a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.569+0000 7fd701068740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3ada0 0x55ff5fd52be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.569+0000 7fd701068740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff5fd46d30 0x55ff5fd332d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.569+0000 7fd701068740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f81ae9f0 con 0x55ff5fd3ada0 2024-09-11T00:17:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.569+0000 7fd701068740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f81b1270 con 0x55ff5fd46d30 2024-09-11T00:17:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.569+0000 7fd701068740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f81af060 con 0x55ff5fd3a480 2024-09-11T00:17:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.570+0000 7fd6effff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3ada0 0x55ff5fd52be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.570+0000 7fd6effff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3ada0 0x55ff5fd52be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55432/0 (socket says 172.21.15.78:55432) 2024-09-11T00:17:35.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.570+0000 7fd6effff640 1 -- 172.21.15.78:0/642971874 learned_addr learned my addr 172.21.15.78:0/642971874 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:17:35.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.570+0000 7fd6fca2f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff5fd3a480 0x55ff5fd39a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:35.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.570+0000 7fd6fd230640 1 --2- 172.21.15.78:0/642971874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff5fd46d30 0x55ff5fd332d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:35.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.570+0000 7fd6effff640 1 -- 172.21.15.78:0/642971874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff5fd3a480 msgr2=0x55ff5fd39a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:35.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.570+0000 7fd6effff640 1 --2- 172.21.15.78:0/642971874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff5fd3a480 0x55ff5fd39a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.570+0000 7fd6effff640 1 -- 172.21.15.78:0/642971874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff5fd46d30 msgr2=0x55ff5fd332d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:35.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.570+0000 7fd6effff640 1 --2- 172.21.15.78:0/642971874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff5fd46d30 0x55ff5fd332d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.570+0000 7fd6effff640 1 -- 172.21.15.78:0/642971874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff5fd42a10 con 0x55ff5fd3ada0 2024-09-11T00:17:35.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.570+0000 7fd6effff640 1 --2- 172.21.15.78:0/642971874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3ada0 0x55ff5fd52be0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800b470 tx=0x7fd6e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666fb347c5091a7c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:35.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.570+0000 7fd6de7fc640 1 -- 172.21.15.78:0/642971874 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e801e070 con 0x55ff5fd3ada0 2024-09-11T00:17:35.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.570+0000 7fd6de7fc640 1 -- 172.21.15.78:0/642971874 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6f0003b70 con 0x55ff5fd3ada0 2024-09-11T00:17:35.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.570+0000 7fd6de7fc640 1 -- 172.21.15.78:0/642971874 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e80092b0 con 0x55ff5fd3ada0 2024-09-11T00:17:35.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.571+0000 7fd701068740 1 -- 172.21.15.78:0/642971874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3ada0 msgr2=0x55ff5fd52be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:35.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.571+0000 7fd701068740 1 --2- 172.21.15.78:0/642971874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3ada0 0x55ff5fd52be0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800b470 tx=0x7fd6e80046c0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.571+0000 7fd701068740 1 -- 172.21.15.78:0/642971874 shutdown_connections 2024-09-11T00:17:35.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.571+0000 7fd701068740 1 --2- 172.21.15.78:0/642971874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff5fd46d30 0x55ff5fd332d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.571+0000 7fd701068740 1 --2- 172.21.15.78:0/642971874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3ada0 0x55ff5fd52be0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.571+0000 7fd701068740 1 --2- 172.21.15.78:0/642971874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff5fd3a480 0x55ff5fd39a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.571+0000 7fd701068740 1 -- 172.21.15.78:0/642971874 >> 172.21.15.78:0/642971874 conn(0x55ff5fd382b0 msgr2=0x55ff5fd39370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.571+0000 7fd701068740 1 -- 172.21.15.78:0/642971874 shutdown_connections 2024-09-11T00:17:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.571+0000 7fd701068740 1 -- 172.21.15.78:0/642971874 wait complete. 2024-09-11T00:17:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.571+0000 7fd701068740 1 -- start start 2024-09-11T00:17:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.572+0000 7fd701068740 1 Processor -- start 2024-09-11T00:17:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.572+0000 7fd701068740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff5fd3a480 0x55ff5fd4f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.572+0000 7fd701068740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3ada0 0x55ff5fd4cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.572+0000 7fd701068740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff5fd46d30 0x55ff5fd4d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.572+0000 7fd701068740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f81af730 con 0x55ff5fd3ada0 2024-09-11T00:17:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.572+0000 7fd701068740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f81b0ba0 con 0x55ff5fd46d30 2024-09-11T00:17:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.572+0000 7fd701068740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f81afe00 con 0x55ff5fd3a480 2024-09-11T00:17:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.572+0000 7fd701068740 10 client.0 _ll_register_callbacks cb 0x7fd6e80eb240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:17:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.572+0000 7fd6effff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3ada0 0x55ff5fd4cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.572+0000 7fd6effff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3ada0 0x55ff5fd4cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55434/0 (socket says 172.21.15.78:55434) 2024-09-11T00:17:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.572+0000 7fd6effff640 1 -- 172.21.15.78:0/3231756019 learned_addr learned my addr 172.21.15.78:0/3231756019 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:17:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.572+0000 7fd6fca2f640 1 --2- 172.21.15.78:0/3231756019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff5fd3a480 0x55ff5fd4f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.572+0000 7fd6fd230640 1 --2- 172.21.15.78:0/3231756019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff5fd46d30 0x55ff5fd4d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.572+0000 7fd6effff640 1 -- 172.21.15.78:0/3231756019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff5fd3a480 msgr2=0x55ff5fd4f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.572+0000 7fd6effff640 1 --2- 172.21.15.78:0/3231756019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff5fd3a480 0x55ff5fd4f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.572+0000 7fd6effff640 1 -- 172.21.15.78:0/3231756019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff5fd46d30 msgr2=0x55ff5fd4d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:17:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.572+0000 7fd6effff640 1 --2- 172.21.15.78:0/3231756019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff5fd46d30 0x55ff5fd4d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.572+0000 7fd6effff640 1 -- 172.21.15.78:0/3231756019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff5fd4d7a0 con 0x55ff5fd3ada0 2024-09-11T00:17:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.573+0000 7fd6effff640 1 --2- 172.21.15.78:0/3231756019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3ada0 0x55ff5fd4cc70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80a9070 tx=0x7fd6e800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481b0158a97ffda4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:17:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.573+0000 7fd6d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:17:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.573+0000 7fd6d7fff640 1 -- 172.21.15.78:0/3231756019 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e801e070 con 0x55ff5fd3ada0 2024-09-11T00:17:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.573+0000 7fd6d7fff640 1 -- 172.21.15.78:0/3231756019 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fd6e80b4f00 con 0x55ff5fd3ada0 2024-09-11T00:17:35.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.573+0000 7fd701068740 1 -- 172.21.15.78:0/3231756019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6f0003b70 con 0x55ff5fd3ada0 2024-09-11T00:17:35.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.573+0000 7fd6d7fff640 1 -- 172.21.15.78:0/3231756019 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd6e80ab570 con 0x55ff5fd3ada0 2024-09-11T00:17:35.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.573+0000 7fd701068740 10 client.15510 fetch_fsmap learned FSMap version 20 2024-09-11T00:17:35.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.573+0000 7fd701068740 1 -- 172.21.15.78:0/3231756019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ff5fdc44c0 con 0x55ff5fd3ada0 2024-09-11T00:17:35.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.573+0000 7fd6d7fff640 1 -- 172.21.15.78:0/3231756019 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6f0003b70 con 0x55ff5fd3ada0 2024-09-11T00:17:35.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.573+0000 7fd6d7fff640 1 -- 172.21.15.78:0/3231756019 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd6e80a7750 con 0x55ff5fd3ada0 2024-09-11T00:17:35.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.573+0000 7fd701068740 10 client.15510 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:17:35.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.573+0000 7fd701068740 10 client.15510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:17:35.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.573+0000 7fd701068740 20 client.15510 populate_metadata read hostname 'smithi078' 2024-09-11T00:17:35.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.573+0000 7fd701068740 1 --2- 172.21.15.78:0/3231756019 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ff5fd56840 0x55ff5fdc6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:17:35.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.573+0000 7fd701068740 4 client.15510 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:17:35.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.573+0000 7fd701068740 1 -- 172.21.15.78:0/3231756019 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ff5fcae850 con 0x55ff5fd56840 2024-09-11T00:17:35.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.574+0000 7fd6fca2f640 1 --2- 172.21.15.78:0/3231756019 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ff5fd56840 0x55ff5fdc6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:17:35.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.574+0000 7fd6fca2f640 1 --2- 172.21.15.78:0/3231756019 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ff5fd56840 0x55ff5fdc6a60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b191d23ef2c9853 server_cookie=cff8478daa657d37 in_seq=0 out_seq=0 2024-09-11T00:17:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.574+0000 7fd6d7fff640 10 client.15510 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:17:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.578+0000 7fd6d7fff640 1 -- 172.21.15.78:0/3231756019 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1147 (crc 0 0 0) 0x55ff5fcae850 con 0x55ff5fd56840 2024-09-11T00:17:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.578+0000 7fd6d7fff640 10 client.15510 handle_command_reply: tid=0 2024-09-11T00:17:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.578+0000 7fd701068740 1 client.15510 shutdown 2024-09-11T00:17:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.578+0000 7fd701068740 1 -- 172.21.15.78:0/3231756019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3ada0 msgr2=0x55ff5fd4cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.578+0000 7fd701068740 1 --2- 172.21.15.78:0/3231756019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3ada0 0x55ff5fd4cc70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80a9070 tx=0x7fd6e800bf90 comp rx=0 tx=0).stop 2024-09-11T00:17:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.578+0000 7fd701068740 1 -- 172.21.15.78:0/3231756019 shutdown_connections 2024-09-11T00:17:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.578+0000 7fd701068740 1 --2- 172.21.15.78:0/3231756019 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ff5fd56840 0x55ff5fdc6a60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.578+0000 7fd701068740 1 --2- 172.21.15.78:0/3231756019 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff5fd46d30 0x55ff5fd4d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.578+0000 7fd701068740 1 --2- 172.21.15.78:0/3231756019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff5fd3ada0 0x55ff5fd4cc70 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.578+0000 7fd701068740 1 --2- 172.21.15.78:0/3231756019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff5fd3a480 0x55ff5fd4f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.578+0000 7fd6d7fff640 0 client.15510 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:17:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.578+0000 7fd701068740 1 -- 172.21.15.78:0/3231756019 >> 172.21.15.78:0/3231756019 conn(0x55ff5fd382b0 msgr2=0x55ff5fd450e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.578+0000 7fd701068740 1 -- 172.21.15.78:0/3231756019 shutdown_connections 2024-09-11T00:17:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.578+0000 7fd701068740 1 -- 172.21.15.78:0/3231756019 wait complete. 2024-09-11T00:17:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.578+0000 7fd701068740 20 client.15510 trim_cache size 0 max 16384 2024-09-11T00:17:35.582 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:17:35.582 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "scrub active (1233 inodes in the stack)", 2024-09-11T00:17:35.582 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-11T00:17:35.582 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:17:35.582 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:17:35.582 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "7d270da9-0d55-460a-8497-50641dd07117", 2024-09-11T00:17:35.582 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-11T00:17:35.583 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:17:35.583 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:17:35.583 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:17:35.583 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:17:35.583 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:17:35.583 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:17:35.583 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:17:35.583 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:17:35.583 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:17:35.583 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:17:35.583 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:17:35.583 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:17:35.583 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:17:35.583 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:17:35.583 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:17:35.584 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:17:35.584 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:17:35.584 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:17:35.584 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:17:35.584 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:17:35.584 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:17:35.584 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:17:35.584 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:17:35.584 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:17:35.584 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:17:35.584 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:17:35.584 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:17:35.584 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:17:35.584 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:17:35.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.579+0000 7fd6fec93640 1 -- 172.21.15.78:0/1780770282 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd6e00b5450 msgr2=0x7fd6e00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:35.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.579+0000 7fd6fec93640 1 --2- 172.21.15.78:0/1780770282 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd6e00b5450 0x7fd6e00b7910 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4031440 tx=0x7fd6f40058b0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.579+0000 7fd6fec93640 1 -- 172.21.15.78:0/1780770282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6f8104560 msgr2=0x7fd6f8101f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:17:35.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.579+0000 7fd6fec93640 1 --2- 172.21.15.78:0/1780770282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6f8104560 0x7fd6f8101f20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800b4a0 tx=0x7fd6e800b960 comp rx=0 tx=0).stop 2024-09-11T00:17:35.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.579+0000 7fd6fec93640 1 -- 172.21.15.78:0/1780770282 shutdown_connections 2024-09-11T00:17:35.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.579+0000 7fd6fec93640 1 --2- 172.21.15.78:0/1780770282 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd6e00b5450 0x7fd6e00b7910 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.579+0000 7fd6fec93640 1 --2- 172.21.15.78:0/1780770282 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd6f810d110 0x7fd6f8102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.579+0000 7fd6fec93640 1 --2- 172.21.15.78:0/1780770282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6f8104560 0x7fd6f8101f20 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.579+0000 7fd6fec93640 1 --2- 172.21.15.78:0/1780770282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd6f8103b60 0x7fd6f81019e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:17:35.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.579+0000 7fd6fec93640 1 -- 172.21.15.78:0/1780770282 >> 172.21.15.78:0/1780770282 conn(0x7fd6f80fd750 msgr2=0x7fd6f80fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:17:35.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.579+0000 7fd6fec93640 1 -- 172.21.15.78:0/1780770282 shutdown_connections 2024-09-11T00:17:35.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:17:35.579+0000 7fd6fec93640 1 -- 172.21.15.78:0/1780770282 wait complete. 2024-09-11T00:17:36.378 INFO:tasks.cephfs.filesystem:scrub status for tag:7d270da9-0d55-460a-8497-50641dd07117 - {'path': '/', 'tag': '7d270da9-0d55-460a-8497-50641dd07117', 'options': 'recursive,force'} 2024-09-11T00:17:37.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:36 smithi138 ceph-mon[35019]: pgmap v357: 97 pgs: 97 active+clean; 84 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.2 MiB/s wr, 538 op/s 2024-09-11T00:17:37.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:17:37.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:17:37.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:17:37.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:17:37.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:36 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:17:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:36 smithi078 ceph-mon[30865]: pgmap v357: 97 pgs: 97 active+clean; 84 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.2 MiB/s wr, 538 op/s 2024-09-11T00:17:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:17:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:17:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:17:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:17:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:36 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:17:37.215 INFO:tasks.workunit.client.0.smithi078.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-11T00:17:37.215 INFO:tasks.workunit.client.0.smithi078.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-11T00:17:37.215 INFO:tasks.workunit.client.0.smithi078.stderr:+ make 2024-09-11T00:17:37.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:36 smithi112 ceph-mon[35627]: pgmap v357: 97 pgs: 97 active+clean; 84 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.2 MiB/s wr, 538 op/s 2024-09-11T00:17:37.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:17:37.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:17:37.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:17:37.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:17:37.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:36 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:17:37.264 INFO:tasks.workunit.client.0.smithi078.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-11T00:17:37.589 INFO:tasks.workunit.client.0.smithi078.stderr:++ readlink -f fsstress 2024-09-11T00:17:37.590 INFO:tasks.workunit.client.0.smithi078.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-11T00:17:37.590 INFO:tasks.workunit.client.0.smithi078.stderr:+ popd 2024-09-11T00:17:37.590 INFO:tasks.workunit.client.0.smithi078.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-11T00:17:37.591 INFO:tasks.workunit.client.0.smithi078.stderr:+ popd 2024-09-11T00:17:37.591 INFO:tasks.workunit.client.0.smithi078.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-11T00:17:37.591 INFO:tasks.workunit.client.0.smithi078.stderr:++ mktemp -d -p . 2024-09-11T00:17:37.605 INFO:tasks.workunit.client.0.smithi078.stderr:+ T=./tmp.zqjqjc0zll 2024-09-11T00:17:37.605 INFO:tasks.workunit.client.0.smithi078.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.zqjqjc0zll -l 1 -n 1000 -p 10 -v 2024-09-11T00:17:37.621 INFO:tasks.workunit.client.0.smithi078.stdout:seed = 1726585287 2024-09-11T00:17:37.656 INFO:tasks.workunit.client.0.smithi078.stdout:0/0: write - no filename 2024-09-11T00:17:37.656 INFO:tasks.workunit.client.0.smithi078.stdout:0/1: write - no filename 2024-09-11T00:17:37.656 INFO:tasks.workunit.client.0.smithi078.stdout:0/2: dread - no filename 2024-09-11T00:17:37.656 INFO:tasks.workunit.client.0.smithi078.stdout:0/3: rename - no filename 2024-09-11T00:17:37.657 INFO:tasks.workunit.client.0.smithi078.stdout:0/4: write - no filename 2024-09-11T00:17:37.672 INFO:tasks.workunit.client.0.smithi078.stdout:1/0: truncate - no filename 2024-09-11T00:17:37.672 INFO:tasks.workunit.client.0.smithi078.stdout:1/1: dread - no filename 2024-09-11T00:17:37.672 INFO:tasks.workunit.client.0.smithi078.stdout:1/2: dwrite - no filename 2024-09-11T00:17:37.672 INFO:tasks.workunit.client.0.smithi078.stdout:1/3: fdatasync - no filename 2024-09-11T00:17:37.672 INFO:tasks.workunit.client.0.smithi078.stdout:1/4: dread - no filename 2024-09-11T00:17:37.672 INFO:tasks.workunit.client.0.smithi078.stdout:1/5: dread - no filename 2024-09-11T00:17:37.673 INFO:tasks.workunit.client.0.smithi078.stdout:1/6: write - no filename 2024-09-11T00:17:37.673 INFO:tasks.workunit.client.0.smithi078.stdout:1/7: fsync - no filename 2024-09-11T00:17:37.673 INFO:tasks.workunit.client.0.smithi078.stdout:1/8: dread - no filename 2024-09-11T00:17:37.673 INFO:tasks.workunit.client.0.smithi078.stdout:1/9: truncate - no filename 2024-09-11T00:17:37.673 INFO:tasks.workunit.client.0.smithi078.stdout:0/5: mknod c0 0 2024-09-11T00:17:37.673 INFO:tasks.workunit.client.0.smithi078.stdout:0/6: fdatasync - no filename 2024-09-11T00:17:37.691 INFO:tasks.workunit.client.0.smithi078.stdout:2/0: stat - no entries 2024-09-11T00:17:37.691 INFO:tasks.workunit.client.0.smithi078.stdout:2/1: chown . 1 1 2024-09-11T00:17:37.692 INFO:tasks.workunit.client.0.smithi078.stdout:1/10: mkdir d0 0 2024-09-11T00:17:37.692 INFO:tasks.workunit.client.0.smithi078.stdout:1/11: write - no filename 2024-09-11T00:17:37.694 INFO:tasks.workunit.client.0.smithi078.stdout:0/7: rename c0 to c1 0 2024-09-11T00:17:37.694 INFO:tasks.workunit.client.0.smithi078.stdout:0/8: dread - no filename 2024-09-11T00:17:37.694 INFO:tasks.workunit.client.0.smithi078.stdout:0/9: dwrite - no filename 2024-09-11T00:17:37.694 INFO:tasks.workunit.client.0.smithi078.stdout:0/10: chown c1 38 1 2024-09-11T00:17:37.695 INFO:tasks.workunit.client.0.smithi078.stdout:0/11: read - no filename 2024-09-11T00:17:37.716 INFO:tasks.workunit.client.0.smithi078.stdout:2/2: mkdir d0 0 2024-09-11T00:17:37.716 INFO:tasks.workunit.client.0.smithi078.stdout:2/3: chown d0 781271 1 2024-09-11T00:17:37.716 INFO:tasks.workunit.client.0.smithi078.stdout:2/4: dread - no filename 2024-09-11T00:17:37.716 INFO:tasks.workunit.client.0.smithi078.stdout:2/5: dwrite - no filename 2024-09-11T00:17:37.717 INFO:tasks.workunit.client.0.smithi078.stdout:2/6: readlink - no filename 2024-09-11T00:17:37.717 INFO:tasks.workunit.client.0.smithi078.stdout:1/12: rmdir d0 0 2024-09-11T00:17:37.718 INFO:tasks.workunit.client.0.smithi078.stdout:1/13: dwrite - no filename 2024-09-11T00:17:37.718 INFO:tasks.workunit.client.0.smithi078.stdout:1/14: chown . 1 1 2024-09-11T00:17:37.719 INFO:tasks.workunit.client.0.smithi078.stdout:0/12: mkdir d2 0 2024-09-11T00:17:37.737 INFO:tasks.workunit.client.0.smithi078.stdout:4/0: write - no filename 2024-09-11T00:17:37.737 INFO:tasks.workunit.client.0.smithi078.stdout:4/1: write - no filename 2024-09-11T00:17:37.738 INFO:tasks.workunit.client.0.smithi078.stdout:4/2: write - no filename 2024-09-11T00:17:37.738 INFO:tasks.workunit.client.0.smithi078.stdout:4/3: write - no filename 2024-09-11T00:17:37.738 INFO:tasks.workunit.client.0.smithi078.stdout:3/0: mkdir d0 0 2024-09-11T00:17:37.738 INFO:tasks.workunit.client.0.smithi078.stdout:3/1: dread - no filename 2024-09-11T00:17:37.738 INFO:tasks.workunit.client.0.smithi078.stdout:3/2: chown d0 0 1 2024-09-11T00:17:37.739 INFO:tasks.workunit.client.0.smithi078.stdout:3/3: readlink - no filename 2024-09-11T00:17:37.739 INFO:tasks.workunit.client.0.smithi078.stdout:3/4: chown d0 0 1 2024-09-11T00:17:37.740 INFO:tasks.workunit.client.0.smithi078.stdout:2/7: mkdir d0/d1 0 2024-09-11T00:17:37.741 INFO:tasks.workunit.client.0.smithi078.stdout:1/15: symlink l1 0 2024-09-11T00:17:37.743 INFO:tasks.workunit.client.0.smithi078.stdout:0/13: mkdir d2/d3 0 2024-09-11T00:17:37.743 INFO:tasks.workunit.client.0.smithi078.stdout:0/14: write - no filename 2024-09-11T00:17:37.744 INFO:tasks.workunit.client.0.smithi078.stdout:0/15: fsync - no filename 2024-09-11T00:17:37.765 INFO:tasks.workunit.client.0.smithi078.stdout:5/0: unlink - no file 2024-09-11T00:17:37.765 INFO:tasks.workunit.client.0.smithi078.stdout:5/1: dread - no filename 2024-09-11T00:17:37.765 INFO:tasks.workunit.client.0.smithi078.stdout:5/2: link - no file 2024-09-11T00:17:37.771 INFO:tasks.workunit.client.0.smithi078.stdout:4/4: creat f0 x:0 0 0 2024-09-11T00:17:37.771 INFO:tasks.workunit.client.0.smithi078.stdout:2/8: mknod d0/d1/c2 0 2024-09-11T00:17:37.772 INFO:tasks.workunit.client.0.smithi078.stdout:1/16: creat f2 x:0 0 0 2024-09-11T00:17:37.772 INFO:tasks.workunit.client.0.smithi078.stdout:3/5: mknod d0/c1 0 2024-09-11T00:17:37.772 INFO:tasks.workunit.client.0.smithi078.stdout:3/6: chown d0 137 1 2024-09-11T00:17:37.772 INFO:tasks.workunit.client.0.smithi078.stdout:3/7: fsync - no filename 2024-09-11T00:17:37.772 INFO:tasks.workunit.client.0.smithi078.stdout:4/5: write f0 [1036494,78740] 0 2024-09-11T00:17:37.772 INFO:tasks.workunit.client.0.smithi078.stdout:4/6: stat f0 0 2024-09-11T00:17:37.772 INFO:tasks.workunit.client.0.smithi078.stdout:4/7: truncate f0 1253719 0 2024-09-11T00:17:37.784 INFO:tasks.workunit.client.0.smithi078.stdout:0/16: unlink c1 0 2024-09-11T00:17:37.785 INFO:tasks.workunit.client.0.smithi078.stdout:0/17: dread - no filename 2024-09-11T00:17:37.785 INFO:tasks.workunit.client.0.smithi078.stdout:0/18: dwrite - no filename 2024-09-11T00:17:37.785 INFO:tasks.workunit.client.0.smithi078.stdout:0/19: dwrite - no filename 2024-09-11T00:17:37.785 INFO:tasks.workunit.client.0.smithi078.stdout:0/20: chown d2/d3 0 1 2024-09-11T00:17:37.785 INFO:tasks.workunit.client.0.smithi078.stdout:0/21: write - no filename 2024-09-11T00:17:37.807 INFO:tasks.workunit.client.0.smithi078.stdout:2/9: symlink d0/l3 0 2024-09-11T00:17:37.808 INFO:tasks.workunit.client.0.smithi078.stdout:3/8: creat d0/f2 x:0 0 0 2024-09-11T00:17:37.809 INFO:tasks.workunit.client.0.smithi078.stdout:4/8: rename f0 to f1 0 2024-09-11T00:17:37.810 INFO:tasks.workunit.client.0.smithi078.stdout:4/9: truncate f1 2145772 0 2024-09-11T00:17:37.812 INFO:tasks.workunit.client.0.smithi078.stdout:0/22: creat d2/f4 x:0 0 0 2024-09-11T00:17:37.813 INFO:tasks.workunit.client.0.smithi078.stdout:0/23: truncate d2/f4 534484 0 2024-09-11T00:17:37.813 INFO:tasks.workunit.client.0.smithi078.stdout:0/24: write d2/f4 [1548638,51814] 0 2024-09-11T00:17:37.832 INFO:tasks.workunit.client.0.smithi078.stdout:2/10: unlink d0/l3 0 2024-09-11T00:17:37.832 INFO:tasks.workunit.client.0.smithi078.stdout:2/11: read - no filename 2024-09-11T00:17:37.834 INFO:tasks.workunit.client.0.smithi078.stdout:4/10: creat f2 x:0 0 0 2024-09-11T00:17:37.845 INFO:tasks.workunit.client.0.smithi078.stdout:2/12: creat d0/d1/f4 x:0 0 0 2024-09-11T00:17:37.851 INFO:tasks.workunit.client.0.smithi078.stdout:2/13: creat d0/d1/f5 x:0 0 0 2024-09-11T00:17:37.857 INFO:tasks.workunit.client.0.smithi078.stdout:2/14: mkdir d0/d1/d6 0 2024-09-11T00:17:37.857 INFO:tasks.workunit.client.0.smithi078.stdout:2/15: truncate d0/d1/f4 851920 0 2024-09-11T00:17:37.857 INFO:tasks.workunit.client.0.smithi078.stdout:2/16: truncate d0/d1/f5 117384 0 2024-09-11T00:17:37.882 INFO:tasks.workunit.client.0.smithi078.stdout:1/17: fsync f2 0 2024-09-11T00:17:37.945 INFO:tasks.workunit.client.0.smithi078.stdout:1/18: dwrite f2 [0,4194304] 0 2024-09-11T00:17:37.970 INFO:tasks.workunit.client.0.smithi078.stdout:2/17: dwrite d0/d1/f4 [0,4194304] 0 2024-09-11T00:17:37.990 INFO:tasks.workunit.client.0.smithi078.stdout:0/25: dwrite d2/f4 [0,4194304] 0 2024-09-11T00:17:37.993 INFO:tasks.workunit.client.0.smithi078.stdout:1/19: dwrite f2 [0,4194304] 0 2024-09-11T00:17:37.993 INFO:tasks.workunit.client.0.smithi078.stdout:1/20: fsync f2 0 2024-09-11T00:17:37.993 INFO:tasks.workunit.client.0.smithi078.stdout:1/21: stat f2 0 2024-09-11T00:17:37.993 INFO:tasks.workunit.client.0.smithi078.stdout:1/22: chown f2 1 1 2024-09-11T00:17:38.040 INFO:tasks.workunit.client.0.smithi078.stdout:3/9: dwrite d0/f2 [0,4194304] 0 2024-09-11T00:17:38.054 INFO:tasks.workunit.client.0.smithi078.stdout:7/0: stat - no entries 2024-09-11T00:17:38.054 INFO:tasks.workunit.client.0.smithi078.stdout:6/0: rename - no filename 2024-09-11T00:17:38.054 INFO:tasks.workunit.client.0.smithi078.stdout:8/0: stat - no entries 2024-09-11T00:17:38.055 INFO:tasks.workunit.client.0.smithi078.stdout:6/1: dread - no filename 2024-09-11T00:17:38.055 INFO:tasks.workunit.client.0.smithi078.stdout:8/1: rename - no filename 2024-09-11T00:17:38.055 INFO:tasks.workunit.client.0.smithi078.stdout:6/2: stat - no entries 2024-09-11T00:17:38.055 INFO:tasks.workunit.client.0.smithi078.stdout:9/0: rmdir - no directory 2024-09-11T00:17:38.057 INFO:tasks.workunit.client.0.smithi078.stdout:3/10: dwrite d0/f2 [0,4194304] 0 2024-09-11T00:17:38.057 INFO:tasks.workunit.client.0.smithi078.stdout:3/11: chown d0/c1 0 1 2024-09-11T00:17:38.060 INFO:tasks.workunit.client.0.smithi078.stdout:4/11: dread f1 [0,4194304] 0 2024-09-11T00:17:38.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:37 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:17:38.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:37 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:17:38.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:37 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:17:38.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:37 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:17:38.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:37 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:17:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:37 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:17:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:37 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:17:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:37 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:17:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:37 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:17:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:37 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:17:38.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:37 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:17:38.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:37 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:17:38.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:37 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:17:38.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:37 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:17:38.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:37 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:17:38.724 INFO:tasks.workunit.client.0.smithi078.stdout:0/26: creat d2/d3/f5 x:0 0 0 2024-09-11T00:17:38.738 INFO:tasks.workunit.client.0.smithi078.stdout:0/27: dread d2/f4 [0,4194304] 0 2024-09-11T00:17:38.745 INFO:tasks.workunit.client.0.smithi078.stdout:1/23: mkdir d3 0 2024-09-11T00:17:38.752 INFO:tasks.workunit.client.0.smithi078.stdout:1/24: dread f2 [0,4194304] 0 2024-09-11T00:17:38.752 INFO:tasks.workunit.client.0.smithi078.stdout:1/25: chown d3 1 1 2024-09-11T00:17:38.754 INFO:tasks.workunit.client.0.smithi078.stdout:1/26: dread f2 [0,4194304] 0 2024-09-11T00:17:38.992 INFO:tasks.workunit.client.0.smithi078.stdout:7/1: mkdir d0 0 2024-09-11T00:17:38.993 INFO:tasks.workunit.client.0.smithi078.stdout:7/2: link - no file 2024-09-11T00:17:38.993 INFO:tasks.workunit.client.0.smithi078.stdout:8/2: symlink l0 0 2024-09-11T00:17:38.994 INFO:tasks.workunit.client.0.smithi078.stdout:9/1: symlink l0 0 2024-09-11T00:17:39.002 INFO:tasks.workunit.client.0.smithi078.stdout:3/12: creat d0/f3 x:0 0 0 2024-09-11T00:17:39.006 INFO:tasks.workunit.client.0.smithi078.stdout:4/12: rename f1 to f3 0 2024-09-11T00:17:39.018 INFO:tasks.workunit.client.0.smithi078.stdout:3/13: dwrite d0/f2 [0,4194304] 0 2024-09-11T00:17:39.034 INFO:tasks.workunit.client.0.smithi078.stdout:3/14: dwrite d0/f2 [0,4194304] 0 2024-09-11T00:17:39.035 INFO:tasks.workunit.client.0.smithi078.stdout:4/13: dwrite f2 [0,4194304] 0 2024-09-11T00:17:39.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:38 smithi078 ceph-mon[30865]: pgmap v358: 97 pgs: 97 active+clean; 88 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 538 op/s 2024-09-11T00:17:39.193 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:38 smithi138 ceph-mon[35019]: pgmap v358: 97 pgs: 97 active+clean; 88 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 538 op/s 2024-09-11T00:17:39.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:38 smithi112 ceph-mon[35627]: pgmap v358: 97 pgs: 97 active+clean; 88 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 538 op/s 2024-09-11T00:17:39.240 INFO:tasks.workunit.client.0.smithi078.stdout:2/18: truncate d0/d1/f4 2068913 0 2024-09-11T00:17:39.242 INFO:tasks.workunit.client.0.smithi078.stdout:0/28: getdents d2/d3 0 2024-09-11T00:17:39.243 INFO:tasks.workunit.client.0.smithi078.stdout:1/27: mkdir d3/d4 0 2024-09-11T00:17:40.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:39 smithi078 ceph-mon[30865]: pgmap v359: 97 pgs: 97 active+clean; 114 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.8 MiB/s wr, 675 op/s 2024-09-11T00:17:40.131 INFO:tasks.workunit.client.0.smithi078.stdout:7/3: creat d0/f1 x:0 0 0 2024-09-11T00:17:40.132 INFO:tasks.workunit.client.0.smithi078.stdout:8/3: creat f1 x:0 0 0 2024-09-11T00:17:40.132 INFO:tasks.workunit.client.0.smithi078.stdout:8/4: chown l0 1 1 2024-09-11T00:17:40.132 INFO:tasks.workunit.client.0.smithi078.stdout:8/5: readlink l0 0 2024-09-11T00:17:40.145 INFO:tasks.workunit.client.0.smithi078.stdout:8/6: dwrite f1 [0,4194304] 0 2024-09-11T00:17:40.150 INFO:tasks.workunit.client.0.smithi078.stdout:3/15: mknod d0/c4 0 2024-09-11T00:17:40.153 INFO:tasks.workunit.client.0.smithi078.stdout:4/14: link f2 f4 0 2024-09-11T00:17:40.156 INFO:tasks.workunit.client.0.smithi078.stdout:4/15: write f3 [536498,58164] 0 2024-09-11T00:17:40.168 INFO:tasks.workunit.client.0.smithi078.stdout:3/16: dwrite d0/f3 [0,4194304] 0 2024-09-11T00:17:40.172 INFO:tasks.workunit.client.0.smithi078.stdout:4/16: dwrite f3 [0,4194304] 0 2024-09-11T00:17:40.173 INFO:tasks.workunit.client.0.smithi078.stdout:4/17: rmdir - no directory 2024-09-11T00:17:40.182 INFO:tasks.workunit.client.0.smithi078.stdout:4/18: write f2 [2976809,23821] 0 2024-09-11T00:17:40.191 INFO:tasks.workunit.client.0.smithi078.stdout:4/19: dread f3 [0,4194304] 0 2024-09-11T00:17:40.231 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:39 smithi112 ceph-mon[35627]: pgmap v359: 97 pgs: 97 active+clean; 114 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.8 MiB/s wr, 675 op/s 2024-09-11T00:17:40.292 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:39 smithi138 ceph-mon[35019]: pgmap v359: 97 pgs: 97 active+clean; 114 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.8 MiB/s wr, 675 op/s 2024-09-11T00:17:40.405 INFO:tasks.workunit.client.0.smithi078.stdout:1/28: truncate f2 157457 0 2024-09-11T00:17:40.860 INFO:tasks.workunit.client.0.smithi078.stdout:1/29: dread f2 [0,4194304] 0 2024-09-11T00:17:40.861 INFO:tasks.workunit.client.0.smithi078.stdout:1/30: write f2 [487822,96943] 0 2024-09-11T00:17:40.861 INFO:tasks.workunit.client.0.smithi078.stdout:1/31: write f2 [1572313,7632] 0 2024-09-11T00:17:40.861 INFO:tasks.workunit.client.0.smithi078.stdout:1/32: chown f2 10 1 2024-09-11T00:17:40.861 INFO:tasks.workunit.client.0.smithi078.stdout:1/33: chown d3/d4 388183 1 2024-09-11T00:17:40.972 INFO:tasks.workunit.client.0.smithi078.stdout:7/4: mknod d0/c2 0 2024-09-11T00:17:40.974 INFO:tasks.workunit.client.0.smithi078.stdout:8/7: creat f2 x:0 0 0 2024-09-11T00:17:40.977 INFO:tasks.workunit.client.0.smithi078.stdout:3/17: creat d0/f5 x:0 0 0 2024-09-11T00:17:40.979 INFO:tasks.workunit.client.0.smithi078.stdout:4/20: symlink l5 0 2024-09-11T00:17:40.980 INFO:tasks.workunit.client.0.smithi078.stdout:2/19: truncate d0/d1/f4 803754 0 2024-09-11T00:17:40.990 INFO:tasks.workunit.client.0.smithi078.stdout:3/18: dwrite d0/f3 [0,4194304] 0 2024-09-11T00:17:40.990 INFO:tasks.workunit.client.0.smithi078.stdout:3/19: chown d0/c1 40 1 2024-09-11T00:17:41.071 INFO:tasks.workunit.client.0.smithi078.stdout:7/5: mkdir d0/d3 0 2024-09-11T00:17:41.079 INFO:tasks.workunit.client.0.smithi078.stdout:4/21: unlink l5 0 2024-09-11T00:17:41.080 INFO:tasks.workunit.client.0.smithi078.stdout:2/20: symlink d0/l7 0 2024-09-11T00:17:41.087 INFO:tasks.workunit.client.0.smithi078.stdout:7/6: dwrite d0/f1 [0,4194304] 0 2024-09-11T00:17:41.087 INFO:tasks.workunit.client.0.smithi078.stdout:7/7: readlink - no filename 2024-09-11T00:17:41.189 INFO:tasks.workunit.client.0.smithi078.stdout:4/22: creat f6 x:0 0 0 2024-09-11T00:17:41.189 INFO:tasks.workunit.client.0.smithi078.stdout:4/23: readlink - no filename 2024-09-11T00:17:41.189 INFO:tasks.workunit.client.0.smithi078.stdout:4/24: write f6 [289654,61459] 0 2024-09-11T00:17:41.189 INFO:tasks.workunit.client.0.smithi078.stdout:4/25: write f6 [661331,26205] 0 2024-09-11T00:17:41.191 INFO:tasks.workunit.client.0.smithi078.stdout:2/21: mkdir d0/d1/d8 0 2024-09-11T00:17:41.317 INFO:tasks.workunit.client.0.smithi078.stdout:4/26: symlink l7 0 2024-09-11T00:17:41.323 INFO:tasks.workunit.client.0.smithi078.stdout:2/22: write d0/d1/f4 [333500,95233] 0 2024-09-11T00:17:41.324 INFO:tasks.workunit.client.0.smithi078.stdout:2/23: readlink d0/l7 0 2024-09-11T00:17:41.324 INFO:tasks.workunit.client.0.smithi078.stdout:5/3: sync 2024-09-11T00:17:41.324 INFO:tasks.workunit.client.0.smithi078.stdout:6/3: sync 2024-09-11T00:17:41.324 INFO:tasks.workunit.client.0.smithi078.stdout:6/4: dwrite - no filename 2024-09-11T00:17:41.324 INFO:tasks.workunit.client.0.smithi078.stdout:0/29: sync 2024-09-11T00:17:41.325 INFO:tasks.workunit.client.0.smithi078.stdout:9/2: sync 2024-09-11T00:17:41.325 INFO:tasks.workunit.client.0.smithi078.stdout:9/3: dwrite - no filename 2024-09-11T00:17:41.331 INFO:tasks.workunit.client.0.smithi078.stdout:1/34: truncate f2 1215398 0 2024-09-11T00:17:41.334 INFO:tasks.workunit.client.0.smithi078.stdout:4/27: dwrite f4 [4194304,4194304] 0 2024-09-11T00:17:41.334 INFO:tasks.workunit.client.0.smithi078.stdout:4/28: fdatasync f4 0 2024-09-11T00:17:41.348 INFO:tasks.workunit.client.0.smithi078.stdout:7/8: truncate d0/f1 3741443 0 2024-09-11T00:17:41.352 INFO:tasks.workunit.client.0.smithi078.stdout:4/29: dwrite f4 [0,4194304] 0 2024-09-11T00:17:41.362 INFO:tasks.workunit.client.0.smithi078.stdout:4/30: dread f2 [4194304,4194304] 0 2024-09-11T00:17:41.395 INFO:tasks.workunit.client.0.smithi078.stdout:8/8: sync 2024-09-11T00:17:41.396 INFO:tasks.workunit.client.0.smithi078.stdout:3/20: sync 2024-09-11T00:17:41.396 INFO:tasks.workunit.client.0.smithi078.stdout:3/21: write d0/f3 [5205306,25013] 0 2024-09-11T00:17:41.396 INFO:tasks.workunit.client.0.smithi078.stdout:3/22: fdatasync d0/f5 0 2024-09-11T00:17:41.435 INFO:tasks.workunit.client.0.smithi078.stdout:2/24: rename d0/d1/f5 to d0/d1/d6/f9 0 2024-09-11T00:17:41.437 INFO:tasks.workunit.client.0.smithi078.stdout:6/5: mkdir d0 0 2024-09-11T00:17:41.437 INFO:tasks.workunit.client.0.smithi078.stdout:6/6: readlink - no filename 2024-09-11T00:17:41.438 INFO:tasks.workunit.client.0.smithi078.stdout:0/30: symlink d2/d3/l6 0 2024-09-11T00:17:41.439 INFO:tasks.workunit.client.0.smithi078.stdout:5/4: creat f0 x:0 0 0 2024-09-11T00:17:41.456 INFO:tasks.workunit.client.0.smithi078.stdout:4/31: mknod c8 0 2024-09-11T00:17:41.459 INFO:tasks.workunit.client.0.smithi078.stdout:0/31: dwrite d2/d3/f5 [0,4194304] 0 2024-09-11T00:17:41.460 INFO:tasks.workunit.client.0.smithi078.stdout:5/5: dwrite f0 [0,4194304] 0 2024-09-11T00:17:41.474 INFO:tasks.workunit.client.0.smithi078.stdout:8/9: mknod c3 0 2024-09-11T00:17:41.475 INFO:tasks.workunit.client.0.smithi078.stdout:3/23: truncate d0/f2 3192862 0 2024-09-11T00:17:41.504 INFO:tasks.workunit.client.0.smithi078.stdout:3/24: fsync d0/f2 0 2024-09-11T00:17:41.516 INFO:tasks.workunit.client.0.smithi078.stdout:2/25: creat d0/d1/fa x:0 0 0 2024-09-11T00:17:41.519 INFO:tasks.workunit.client.0.smithi078.stdout:6/7: mkdir d0/d1 0 2024-09-11T00:17:41.519 INFO:tasks.workunit.client.0.smithi078.stdout:6/8: chown d0/d1 35 1 2024-09-11T00:17:41.531 INFO:tasks.workunit.client.0.smithi078.stdout:7/9: truncate d0/f1 4298627 0 2024-09-11T00:17:41.533 INFO:tasks.workunit.client.0.smithi078.stdout:2/26: dwrite d0/d1/fa [0,4194304] 0 2024-09-11T00:17:41.533 INFO:tasks.workunit.client.0.smithi078.stdout:4/32: creat f9 x:0 0 0 2024-09-11T00:17:41.533 INFO:tasks.workunit.client.0.smithi078.stdout:4/33: fsync f6 0 2024-09-11T00:17:41.533 INFO:tasks.workunit.client.0.smithi078.stdout:2/27: write d0/d1/d6/f9 [6453,53756] 0 2024-09-11T00:17:41.533 INFO:tasks.workunit.client.0.smithi078.stdout:2/28: fsync d0/d1/f4 0 2024-09-11T00:17:41.533 INFO:tasks.workunit.client.0.smithi078.stdout:2/29: readlink d0/l7 0 2024-09-11T00:17:41.535 INFO:tasks.workunit.client.0.smithi078.stdout:0/32: mkdir d2/d3/d7 0 2024-09-11T00:17:41.535 INFO:tasks.workunit.client.0.smithi078.stdout:0/33: rename d2/d3 to d2/d3/d7/d8 22 2024-09-11T00:17:41.540 INFO:tasks.workunit.client.0.smithi078.stdout:5/6: creat f1 x:0 0 0 2024-09-11T00:17:41.553 INFO:tasks.workunit.client.0.smithi078.stdout:8/10: getdents . 0 2024-09-11T00:17:41.576 INFO:tasks.workunit.client.0.smithi078.stdout:3/25: creat d0/f6 x:0 0 0 2024-09-11T00:17:41.584 INFO:tasks.workunit.client.0.smithi078.stdout:9/4: sync 2024-09-11T00:17:41.584 INFO:tasks.workunit.client.0.smithi078.stdout:9/5: dread - no filename 2024-09-11T00:17:41.584 INFO:tasks.workunit.client.0.smithi078.stdout:1/35: sync 2024-09-11T00:17:41.584 INFO:tasks.workunit.client.0.smithi078.stdout:9/6: rmdir - no directory 2024-09-11T00:17:41.584 INFO:tasks.workunit.client.0.smithi078.stdout:1/36: write f2 [1507122,125947] 0 2024-09-11T00:17:41.585 INFO:tasks.workunit.client.0.smithi078.stdout:1/37: write f2 [1706386,92819] 0 2024-09-11T00:17:41.591 INFO:tasks.workunit.client.0.smithi078.stdout:6/9: creat d0/d1/f2 x:0 0 0 2024-09-11T00:17:41.597 INFO:tasks.workunit.client.0.smithi078.stdout:1/38: dwrite f2 [0,4194304] 0 2024-09-11T00:17:41.600 INFO:tasks.workunit.client.0.smithi078.stdout:7/10: creat d0/f4 x:0 0 0 2024-09-11T00:17:41.603 INFO:tasks.workunit.client.0.smithi078.stdout:4/34: creat fa x:0 0 0 2024-09-11T00:17:41.604 INFO:tasks.workunit.client.0.smithi078.stdout:4/35: fdatasync f3 0 2024-09-11T00:17:41.608 INFO:tasks.workunit.client.0.smithi078.stdout:0/34: mknod d2/c9 0 2024-09-11T00:17:41.615 INFO:tasks.workunit.client.0.smithi078.stdout:4/36: dread f4 [0,4194304] 0 2024-09-11T00:17:41.616 INFO:tasks.workunit.client.0.smithi078.stdout:5/7: mknod c2 0 2024-09-11T00:17:41.616 INFO:tasks.workunit.client.0.smithi078.stdout:5/8: truncate f1 1003437 0 2024-09-11T00:17:41.619 INFO:tasks.workunit.client.0.smithi078.stdout:7/11: dwrite d0/f1 [0,4194304] 0 2024-09-11T00:17:41.619 INFO:tasks.workunit.client.0.smithi078.stdout:7/12: readlink - no filename 2024-09-11T00:17:41.620 INFO:tasks.workunit.client.0.smithi078.stdout:7/13: readlink - no filename 2024-09-11T00:17:41.623 INFO:tasks.workunit.client.0.smithi078.stdout:0/35: write d2/d3/f5 [3688997,69516] 0 2024-09-11T00:17:41.623 INFO:tasks.workunit.client.0.smithi078.stdout:0/36: chown d2/c9 4555034 1 2024-09-11T00:17:41.627 INFO:tasks.workunit.client.0.smithi078.stdout:8/11: truncate f1 1393509 0 2024-09-11T00:17:41.632 INFO:tasks.workunit.client.0.smithi078.stdout:5/9: dwrite f0 [0,4194304] 0 2024-09-11T00:17:41.632 INFO:tasks.workunit.client.0.smithi078.stdout:5/10: fsync f1 0 2024-09-11T00:17:41.634 INFO:tasks.workunit.client.0.smithi078.stdout:7/14: dwrite d0/f4 [0,4194304] 0 2024-09-11T00:17:41.635 INFO:tasks.workunit.client.0.smithi078.stdout:0/37: write d2/f4 [4020535,91872] 0 2024-09-11T00:17:41.635 INFO:tasks.workunit.client.0.smithi078.stdout:0/38: readlink d2/d3/l6 0 2024-09-11T00:17:41.640 INFO:tasks.workunit.client.0.smithi078.stdout:8/12: write f1 [2429145,91169] 0 2024-09-11T00:17:41.640 INFO:tasks.workunit.client.0.smithi078.stdout:8/13: write f2 [75217,76606] 0 2024-09-11T00:17:41.641 INFO:tasks.workunit.client.0.smithi078.stdout:3/26: truncate d0/f3 3141699 0 2024-09-11T00:17:41.645 INFO:tasks.workunit.client.0.smithi078.stdout:9/7: getdents . 0 2024-09-11T00:17:41.650 INFO:tasks.workunit.client.0.smithi078.stdout:6/10: mkdir d0/d3 0 2024-09-11T00:17:41.654 INFO:tasks.workunit.client.0.smithi078.stdout:8/14: dwrite f1 [0,4194304] 0 2024-09-11T00:17:41.656 INFO:tasks.workunit.client.0.smithi078.stdout:8/15: fsync f2 0 2024-09-11T00:17:41.656 INFO:tasks.workunit.client.0.smithi078.stdout:8/16: readlink l0 0 2024-09-11T00:17:41.656 INFO:tasks.workunit.client.0.smithi078.stdout:8/17: chown f2 4 1 2024-09-11T00:17:41.659 INFO:tasks.workunit.client.0.smithi078.stdout:1/39: link l1 d3/l5 0 2024-09-11T00:17:41.678 INFO:tasks.workunit.client.0.smithi078.stdout:4/37: mknod cb 0 2024-09-11T00:17:41.678 INFO:tasks.workunit.client.0.smithi078.stdout:4/38: chown f9 5854 1 2024-09-11T00:17:41.692 INFO:tasks.workunit.client.0.smithi078.stdout:4/39: dwrite f4 [0,4194304] 0 2024-09-11T00:17:41.699 INFO:tasks.workunit.client.0.smithi078.stdout:7/15: mknod d0/d3/c5 0 2024-09-11T00:17:41.708 INFO:tasks.workunit.client.0.smithi078.stdout:7/16: write d0/f4 [3369789,69851] 0 2024-09-11T00:17:41.708 INFO:tasks.workunit.client.0.smithi078.stdout:3/27: unlink d0/c1 0 2024-09-11T00:17:41.713 INFO:tasks.workunit.client.0.smithi078.stdout:9/8: link l0 l1 0 2024-09-11T00:17:41.713 INFO:tasks.workunit.client.0.smithi078.stdout:9/9: fsync - no filename 2024-09-11T00:17:41.718 INFO:tasks.workunit.client.0.smithi078.stdout:6/11: symlink d0/d3/l4 0 2024-09-11T00:17:41.724 INFO:tasks.workunit.client.0.smithi078.stdout:7/17: dwrite d0/f1 [0,4194304] 0 2024-09-11T00:17:41.725 INFO:tasks.workunit.client.0.smithi078.stdout:7/18: write d0/f4 [4325507,90350] 0 2024-09-11T00:17:41.728 INFO:tasks.workunit.client.0.smithi078.stdout:8/18: unlink l0 0 2024-09-11T00:17:41.731 INFO:tasks.workunit.client.0.smithi078.stdout:1/40: creat d3/d4/f6 x:0 0 0 2024-09-11T00:17:41.732 INFO:tasks.workunit.client.0.smithi078.stdout:1/41: rename d3/d4 to d3/d4/d7 22 2024-09-11T00:17:41.732 INFO:tasks.workunit.client.0.smithi078.stdout:1/42: fsync f2 0 2024-09-11T00:17:41.743 INFO:tasks.workunit.client.0.smithi078.stdout:8/19: dwrite f2 [0,4194304] 0 2024-09-11T00:17:41.760 INFO:tasks.workunit.client.0.smithi078.stdout:4/40: getdents . 0 2024-09-11T00:17:41.763 INFO:tasks.workunit.client.0.smithi078.stdout:5/11: truncate f0 2479054 0 2024-09-11T00:17:41.772 INFO:tasks.workunit.client.0.smithi078.stdout:0/39: truncate d2/d3/f5 649322 0 2024-09-11T00:17:41.779 INFO:tasks.workunit.client.0.smithi078.stdout:3/28: mkdir d0/d7 0 2024-09-11T00:17:41.783 INFO:tasks.workunit.client.0.smithi078.stdout:9/10: creat f2 x:0 0 0 2024-09-11T00:17:41.783 INFO:tasks.workunit.client.0.smithi078.stdout:9/11: chown f2 0 1 2024-09-11T00:17:41.783 INFO:tasks.workunit.client.0.smithi078.stdout:9/12: fdatasync f2 0 2024-09-11T00:17:41.789 INFO:tasks.workunit.client.0.smithi078.stdout:6/12: link d0/d3/l4 d0/l5 0 2024-09-11T00:17:41.789 INFO:tasks.workunit.client.0.smithi078.stdout:6/13: write d0/d1/f2 [589454,45613] 0 2024-09-11T00:17:41.794 INFO:tasks.workunit.client.0.smithi078.stdout:6/14: dread d0/d1/f2 [0,4194304] 0 2024-09-11T00:17:41.794 INFO:tasks.workunit.client.0.smithi078.stdout:7/19: rmdir d0 39 2024-09-11T00:17:41.795 INFO:tasks.workunit.client.0.smithi078.stdout:7/20: chown d0/c2 2008 1 2024-09-11T00:17:41.795 INFO:tasks.workunit.client.0.smithi078.stdout:7/21: fsync d0/f1 0 2024-09-11T00:17:41.796 INFO:tasks.workunit.client.0.smithi078.stdout:6/15: dread d0/d1/f2 [0,4194304] 0 2024-09-11T00:17:41.797 INFO:tasks.workunit.client.0.smithi078.stdout:6/16: chown d0/d3 7605539 1 2024-09-11T00:17:41.801 INFO:tasks.workunit.client.0.smithi078.stdout:2/30: sync 2024-09-11T00:17:41.801 INFO:tasks.workunit.client.0.smithi078.stdout:1/43: creat d3/d4/f8 x:0 0 0 2024-09-11T00:17:41.809 INFO:tasks.workunit.client.0.smithi078.stdout:8/20: creat f4 x:0 0 0 2024-09-11T00:17:41.815 INFO:tasks.workunit.client.0.smithi078.stdout:2/31: dwrite d0/d1/d6/f9 [0,4194304] 0 2024-09-11T00:17:41.815 INFO:tasks.workunit.client.0.smithi078.stdout:2/32: read d0/d1/f4 [379985,42828] 0 2024-09-11T00:17:41.816 INFO:tasks.workunit.client.0.smithi078.stdout:0/40: dwrite d2/d3/f5 [0,4194304] 0 2024-09-11T00:17:41.820 INFO:tasks.workunit.client.0.smithi078.stdout:4/41: mkdir dc 0 2024-09-11T00:17:41.821 INFO:tasks.workunit.client.0.smithi078.stdout:4/42: write f9 [230873,79660] 0 2024-09-11T00:17:41.824 INFO:tasks.workunit.client.0.smithi078.stdout:4/43: dread f6 [0,4194304] 0 2024-09-11T00:17:41.824 INFO:tasks.workunit.client.0.smithi078.stdout:2/33: dread d0/d1/d6/f9 [0,4194304] 0 2024-09-11T00:17:41.834 INFO:tasks.workunit.client.0.smithi078.stdout:3/29: creat d0/f8 x:0 0 0 2024-09-11T00:17:41.839 INFO:tasks.workunit.client.0.smithi078.stdout:3/30: read d0/f2 [1886244,129432] 0 2024-09-11T00:17:41.839 INFO:tasks.workunit.client.0.smithi078.stdout:3/31: chown d0/f6 113083 1 2024-09-11T00:17:41.839 INFO:tasks.workunit.client.0.smithi078.stdout:3/32: fsync d0/f3 0 2024-09-11T00:17:41.839 INFO:tasks.workunit.client.0.smithi078.stdout:9/13: creat f3 x:0 0 0 2024-09-11T00:17:41.850 INFO:tasks.workunit.client.0.smithi078.stdout:7/22: mknod d0/c6 0 2024-09-11T00:17:41.850 INFO:tasks.workunit.client.0.smithi078.stdout:7/23: fdatasync d0/f4 0 2024-09-11T00:17:41.853 INFO:tasks.workunit.client.0.smithi078.stdout:6/17: symlink d0/d3/l6 0 2024-09-11T00:17:41.853 INFO:tasks.workunit.client.0.smithi078.stdout:6/18: fdatasync d0/d1/f2 0 2024-09-11T00:17:41.856 INFO:tasks.workunit.client.0.smithi078.stdout:1/44: creat d3/f9 x:0 0 0 2024-09-11T00:17:41.856 INFO:tasks.workunit.client.0.smithi078.stdout:1/45: write d3/d4/f6 [267425,52990] 0 2024-09-11T00:17:41.856 INFO:tasks.workunit.client.0.smithi078.stdout:1/46: dread - d3/f9 zero size 2024-09-11T00:17:41.862 INFO:tasks.workunit.client.0.smithi078.stdout:8/21: mknod c5 0 2024-09-11T00:17:41.862 INFO:tasks.workunit.client.0.smithi078.stdout:8/22: chown c5 14825 1 2024-09-11T00:17:41.862 INFO:tasks.workunit.client.0.smithi078.stdout:8/23: rmdir - no directory 2024-09-11T00:17:41.866 INFO:tasks.workunit.client.0.smithi078.stdout:7/24: dwrite d0/f4 [0,4194304] 0 2024-09-11T00:17:41.866 INFO:tasks.workunit.client.0.smithi078.stdout:7/25: stat d0/c2 0 2024-09-11T00:17:41.869 INFO:tasks.workunit.client.0.smithi078.stdout:0/41: truncate d2/f4 3172802 0 2024-09-11T00:17:41.875 INFO:tasks.workunit.client.0.smithi078.stdout:5/12: rename f0 to f3 0 2024-09-11T00:17:41.877 INFO:tasks.workunit.client.0.smithi078.stdout:2/34: creat d0/fb x:0 0 0 2024-09-11T00:17:41.882 INFO:tasks.workunit.client.0.smithi078.stdout:7/26: dwrite d0/f1 [0,4194304] 0 2024-09-11T00:17:41.891 INFO:tasks.workunit.client.0.smithi078.stdout:9/14: creat f4 x:0 0 0 2024-09-11T00:17:41.892 INFO:tasks.workunit.client.0.smithi078.stdout:3/33: mknod d0/c9 0 2024-09-11T00:17:41.892 INFO:tasks.workunit.client.0.smithi078.stdout:3/34: rename d0/d7 to d0/d7/da 22 2024-09-11T00:17:41.903 INFO:tasks.workunit.client.0.smithi078.stdout:6/19: mkdir d0/d1/d7 0 2024-09-11T00:17:41.905 INFO:tasks.workunit.client.0.smithi078.stdout:1/47: getdents d3 0 2024-09-11T00:17:41.913 INFO:tasks.workunit.client.0.smithi078.stdout:8/24: truncate f1 3223750 0 2024-09-11T00:17:41.921 INFO:tasks.workunit.client.0.smithi078.stdout:0/42: creat d2/d3/d7/fa x:0 0 0 2024-09-11T00:17:41.924 INFO:tasks.workunit.client.0.smithi078.stdout:5/13: getdents . 0 2024-09-11T00:17:41.928 INFO:tasks.workunit.client.0.smithi078.stdout:2/35: creat d0/fc x:0 0 0 2024-09-11T00:17:41.931 INFO:tasks.workunit.client.0.smithi078.stdout:2/36: dread d0/d1/d6/f9 [0,4194304] 0 2024-09-11T00:17:41.931 INFO:tasks.workunit.client.0.smithi078.stdout:2/37: fsync d0/d1/f4 0 2024-09-11T00:17:41.931 INFO:tasks.workunit.client.0.smithi078.stdout:2/38: write d0/fb [376586,130932] 0 2024-09-11T00:17:41.934 INFO:tasks.workunit.client.0.smithi078.stdout:7/27: creat d0/f7 x:0 0 0 2024-09-11T00:17:41.942 INFO:tasks.workunit.client.0.smithi078.stdout:7/28: dread d0/f1 [0,4194304] 0 2024-09-11T00:17:41.945 INFO:tasks.workunit.client.0.smithi078.stdout:7/29: dread d0/f1 [0,4194304] 0 2024-09-11T00:17:41.947 INFO:tasks.workunit.client.0.smithi078.stdout:3/35: mkdir d0/db 0 2024-09-11T00:17:41.947 INFO:tasks.workunit.client.0.smithi078.stdout:3/36: chown d0/c4 9460433 1 2024-09-11T00:17:41.950 INFO:tasks.workunit.client.0.smithi078.stdout:8/25: dwrite f1 [0,4194304] 0 2024-09-11T00:17:41.951 INFO:tasks.workunit.client.0.smithi078.stdout:7/30: write d0/f4 [2573780,29555] 0 2024-09-11T00:17:41.951 INFO:tasks.workunit.client.0.smithi078.stdout:7/31: write d0/f7 [1045736,93867] 0 2024-09-11T00:17:41.959 INFO:tasks.workunit.client.0.smithi078.stdout:6/20: getdents d0 0 2024-09-11T00:17:41.962 INFO:tasks.workunit.client.0.smithi078.stdout:1/48: rename d3/d4/f6 to d3/d4/fa 0 2024-09-11T00:17:41.962 INFO:tasks.workunit.client.0.smithi078.stdout:1/49: chown d3 99411 1 2024-09-11T00:17:41.963 INFO:tasks.workunit.client.0.smithi078.stdout:1/50: dread - d3/f9 zero size 2024-09-11T00:17:41.975 INFO:tasks.workunit.client.0.smithi078.stdout:0/43: getdents d2/d3/d7 0 2024-09-11T00:17:41.976 INFO:tasks.workunit.client.0.smithi078.stdout:5/14: rename c2 to c4 0 2024-09-11T00:17:41.976 INFO:tasks.workunit.client.0.smithi078.stdout:5/15: stat f1 0 2024-09-11T00:17:41.977 INFO:tasks.workunit.client.0.smithi078.stdout:5/16: write f1 [1674644,7352] 0 2024-09-11T00:17:41.983 INFO:tasks.workunit.client.0.smithi078.stdout:2/39: creat d0/fd x:0 0 0 2024-09-11T00:17:41.983 INFO:tasks.workunit.client.0.smithi078.stdout:2/40: read d0/d1/f4 [513802,10568] 0 2024-09-11T00:17:41.987 INFO:tasks.workunit.client.0.smithi078.stdout:4/44: sync 2024-09-11T00:17:41.987 INFO:tasks.workunit.client.0.smithi078.stdout:4/45: fdatasync f9 0 2024-09-11T00:17:41.987 INFO:tasks.workunit.client.0.smithi078.stdout:4/46: stat cb 0 2024-09-11T00:17:41.997 INFO:tasks.workunit.client.0.smithi078.stdout:3/37: creat d0/d7/fc x:0 0 0 2024-09-11T00:17:42.002 INFO:tasks.workunit.client.0.smithi078.stdout:7/32: rename d0/c2 to d0/c8 0 2024-09-11T00:17:42.016 INFO:tasks.workunit.client.0.smithi078.stdout:6/21: creat d0/f8 x:0 0 0 2024-09-11T00:17:42.017 INFO:tasks.workunit.client.0.smithi078.stdout:1/51: mkdir d3/d4/db 0 2024-09-11T00:17:42.017 INFO:tasks.workunit.client.0.smithi078.stdout:1/52: dread - d3/f9 zero size 2024-09-11T00:17:42.017 INFO:tasks.workunit.client.0.smithi078.stdout:1/53: write d3/d4/fa [449815,31190] 0 2024-09-11T00:17:42.022 INFO:tasks.workunit.client.0.smithi078.stdout:1/54: dread d3/d4/fa [0,4194304] 0 2024-09-11T00:17:42.029 INFO:tasks.workunit.client.0.smithi078.stdout:0/44: getdents d2/d3 0 2024-09-11T00:17:42.031 INFO:tasks.workunit.client.0.smithi078.stdout:5/17: mkdir d5 0 2024-09-11T00:17:42.040 INFO:tasks.workunit.client.0.smithi078.stdout:2/41: creat d0/d1/fe x:0 0 0 2024-09-11T00:17:42.043 INFO:tasks.workunit.client.0.smithi078.stdout:2/42: dread d0/d1/d6/f9 [0,4194304] 0 2024-09-11T00:17:42.044 INFO:tasks.workunit.client.0.smithi078.stdout:4/47: link fa dc/fd 0 2024-09-11T00:17:42.045 INFO:tasks.workunit.client.0.smithi078.stdout:0/45: dwrite d2/d3/f5 [0,4194304] 0 2024-09-11T00:17:42.053 INFO:tasks.workunit.client.0.smithi078.stdout:9/15: rename l0 to l5 0 2024-09-11T00:17:42.053 INFO:tasks.workunit.client.0.smithi078.stdout:9/16: dread - f2 zero size 2024-09-11T00:17:42.053 INFO:tasks.workunit.client.0.smithi078.stdout:4/48: dread f4 [0,4194304] 0 2024-09-11T00:17:42.056 INFO:tasks.workunit.client.0.smithi078.stdout:3/38: unlink d0/c9 0 2024-09-11T00:17:42.061 INFO:tasks.workunit.client.0.smithi078.stdout:7/33: creat d0/d3/f9 x:0 0 0 2024-09-11T00:17:42.079 INFO:tasks.workunit.client.0.smithi078.stdout:1/55: creat d3/fc x:0 0 0 2024-09-11T00:17:42.080 INFO:tasks.workunit.client.0.smithi078.stdout:1/56: read d3/d4/fa [173716,114461] 0 2024-09-11T00:17:42.080 INFO:tasks.workunit.client.0.smithi078.stdout:1/57: fsync f2 0 2024-09-11T00:17:42.080 INFO:tasks.workunit.client.0.smithi078.stdout:1/58: rename d3 to d3/d4/dd 22 2024-09-11T00:17:42.080 INFO:tasks.workunit.client.0.smithi078.stdout:1/59: fsync d3/f9 0 2024-09-11T00:17:42.080 INFO:tasks.workunit.client.0.smithi078.stdout:1/60: fsync d3/f9 0 2024-09-11T00:17:42.082 INFO:tasks.workunit.client.0.smithi078.stdout:5/18: rmdir d5 0 2024-09-11T00:17:42.086 INFO:tasks.workunit.client.0.smithi078.stdout:1/61: read f2 [3488692,14128] 0 2024-09-11T00:17:42.089 INFO:tasks.workunit.client.0.smithi078.stdout:2/43: rmdir d0/d1/d6 39 2024-09-11T00:17:42.089 INFO:tasks.workunit.client.0.smithi078.stdout:2/44: fdatasync d0/fc 0 2024-09-11T00:17:42.093 INFO:tasks.workunit.client.0.smithi078.stdout:0/46: mknod d2/d3/d7/cb 0 2024-09-11T00:17:42.093 INFO:tasks.workunit.client.0.smithi078.stdout:0/47: truncate d2/d3/d7/fa 952243 0 2024-09-11T00:17:42.094 INFO:tasks.workunit.client.0.smithi078.stdout:2/45: write d0/d1/d6/f9 [466153,70865] 0 2024-09-11T00:17:42.102 INFO:tasks.workunit.client.0.smithi078.stdout:4/49: link f2 dc/fe 0 2024-09-11T00:17:42.102 INFO:tasks.workunit.client.0.smithi078.stdout:4/50: readlink l7 0 2024-09-11T00:17:42.107 INFO:tasks.workunit.client.0.smithi078.stdout:3/39: creat d0/d7/fd x:0 0 0 2024-09-11T00:17:42.113 INFO:tasks.workunit.client.0.smithi078.stdout:7/34: unlink d0/f7 0 2024-09-11T00:17:42.113 INFO:tasks.workunit.client.0.smithi078.stdout:7/35: chown d0/d3/f9 11441956 1 2024-09-11T00:17:42.113 INFO:tasks.workunit.client.0.smithi078.stdout:7/36: read - d0/d3/f9 zero size 2024-09-11T00:17:42.113 INFO:tasks.workunit.client.0.smithi078.stdout:7/37: fsync d0/d3/f9 0 2024-09-11T00:17:42.119 INFO:tasks.workunit.client.0.smithi078.stdout:2/46: dwrite d0/d1/f4 [0,4194304] 0 2024-09-11T00:17:42.125 INFO:tasks.workunit.client.0.smithi078.stdout:6/22: rmdir d0/d1/d7 0 2024-09-11T00:17:42.125 INFO:tasks.workunit.client.0.smithi078.stdout:6/23: dread - d0/f8 zero size 2024-09-11T00:17:42.125 INFO:tasks.workunit.client.0.smithi078.stdout:2/47: dread d0/d1/f4 [0,4194304] 0 2024-09-11T00:17:42.126 INFO:tasks.workunit.client.0.smithi078.stdout:2/48: chown d0/fd 25 1 2024-09-11T00:17:42.126 INFO:tasks.workunit.client.0.smithi078.stdout:8/26: sync 2024-09-11T00:17:42.131 INFO:tasks.workunit.client.0.smithi078.stdout:4/51: dwrite f9 [0,4194304] 0 2024-09-11T00:17:42.131 INFO:tasks.workunit.client.0.smithi078.stdout:3/40: dwrite d0/f6 [0,4194304] 0 2024-09-11T00:17:42.132 INFO:tasks.workunit.client.0.smithi078.stdout:3/41: stat d0/c4 0 2024-09-11T00:17:42.141 INFO:tasks.workunit.client.0.smithi078.stdout:5/19: unlink f3 0 2024-09-11T00:17:42.141 INFO:tasks.workunit.client.0.smithi078.stdout:5/20: chown c4 7 1 2024-09-11T00:17:42.141 INFO:tasks.workunit.client.0.smithi078.stdout:5/21: rmdir - no directory 2024-09-11T00:17:42.147 INFO:tasks.workunit.client.0.smithi078.stdout:1/62: mknod d3/d4/ce 0 2024-09-11T00:17:42.148 INFO:tasks.workunit.client.0.smithi078.stdout:1/63: write d3/fc [714245,12118] 0 2024-09-11T00:17:42.157 INFO:tasks.workunit.client.0.smithi078.stdout:0/48: mkdir d2/d3/d7/dc 0 2024-09-11T00:17:42.157 INFO:tasks.workunit.client.0.smithi078.stdout:0/49: getdents d2/d3/d7/dc 0 2024-09-11T00:17:42.160 INFO:tasks.workunit.client.0.smithi078.stdout:1/64: dwrite d3/d4/f8 [0,4194304] 0 2024-09-11T00:17:42.160 INFO:tasks.workunit.client.0.smithi078.stdout:1/65: fdatasync d3/d4/fa 0 2024-09-11T00:17:42.164 INFO:tasks.workunit.client.0.smithi078.stdout:9/17: symlink l6 0 2024-09-11T00:17:42.170 INFO:tasks.workunit.client.0.smithi078.stdout:0/50: dwrite d2/f4 [0,4194304] 0 2024-09-11T00:17:42.182 INFO:tasks.workunit.client.0.smithi078.stdout:8/27: creat f6 x:0 0 0 2024-09-11T00:17:42.187 INFO:tasks.workunit.client.0.smithi078.stdout:4/52: creat dc/ff x:0 0 0 2024-09-11T00:17:42.200 INFO:tasks.workunit.client.0.smithi078.stdout:5/22: creat f6 x:0 0 0 2024-09-11T00:17:42.200 INFO:tasks.workunit.client.0.smithi078.stdout:5/23: readlink - no filename 2024-09-11T00:17:42.200 INFO:tasks.workunit.client.0.smithi078.stdout:5/24: chown f6 61494033 1 2024-09-11T00:17:42.219 INFO:tasks.workunit.client.0.smithi078.stdout:1/66: unlink l1 0 2024-09-11T00:17:42.228 INFO:tasks.workunit.client.0.smithi078.stdout:0/51: mknod d2/d3/cd 0 2024-09-11T00:17:42.240 INFO:tasks.workunit.client.0.smithi078.stdout:6/24: rename d0/d3 to d0/d1/d9 0 2024-09-11T00:17:42.240 INFO:tasks.workunit.client.0.smithi078.stdout:6/25: chown d0/d1/d9/l6 124223 1 2024-09-11T00:17:42.240 INFO:tasks.workunit.client.0.smithi078.stdout:6/26: write d0/d1/f2 [629398,61048] 0 2024-09-11T00:17:42.240 INFO:tasks.workunit.client.0.smithi078.stdout:6/27: write d0/f8 [48101,3395] 0 2024-09-11T00:17:42.241 INFO:tasks.workunit.client.0.smithi078.stdout:8/28: creat f7 x:0 0 0 2024-09-11T00:17:42.260 INFO:tasks.workunit.client.0.smithi078.stdout:5/25: mkdir d7 0 2024-09-11T00:17:42.278 INFO:tasks.workunit.client.0.smithi078.stdout:9/18: rename f3 to f7 0 2024-09-11T00:17:42.278 INFO:tasks.workunit.client.0.smithi078.stdout:9/19: read - f4 zero size 2024-09-11T00:17:42.279 INFO:tasks.workunit.client.0.smithi078.stdout:9/20: write f2 [671342,54522] 0 2024-09-11T00:17:42.283 INFO:tasks.workunit.client.0.smithi078.stdout:7/38: sync 2024-09-11T00:17:42.286 INFO:tasks.workunit.client.0.smithi078.stdout:7/39: dread d0/f4 [0,4194304] 0 2024-09-11T00:17:42.290 INFO:tasks.workunit.client.0.smithi078.stdout:1/67: rename d3/d4/fa to d3/d4/db/ff 0 2024-09-11T00:17:42.292 INFO:tasks.workunit.client.0.smithi078.stdout:6/28: symlink d0/d1/la 0 2024-09-11T00:17:42.292 INFO:tasks.workunit.client.0.smithi078.stdout:6/29: write d0/f8 [673221,102454] 0 2024-09-11T00:17:42.293 INFO:tasks.workunit.client.0.smithi078.stdout:8/29: symlink l8 0 2024-09-11T00:17:42.307 INFO:tasks.workunit.client.0.smithi078.stdout:8/30: dwrite f7 [0,4194304] 0 2024-09-11T00:17:42.314 INFO:tasks.workunit.client.0.smithi078.stdout:5/26: mkdir d7/d8 0 2024-09-11T00:17:42.314 INFO:tasks.workunit.client.0.smithi078.stdout:5/27: readlink - no filename 2024-09-11T00:17:42.314 INFO:tasks.workunit.client.0.smithi078.stdout:5/28: fsync f1 0 2024-09-11T00:17:42.314 INFO:tasks.workunit.client.0.smithi078.stdout:5/29: truncate f6 676896 0 2024-09-11T00:17:42.321 INFO:tasks.workunit.client.0.smithi078.stdout:5/30: dread f1 [0,4194304] 0 2024-09-11T00:17:42.325 INFO:tasks.workunit.client.0.smithi078.stdout:8/31: dwrite f4 [0,4194304] 0 2024-09-11T00:17:42.325 INFO:tasks.workunit.client.0.smithi078.stdout:8/32: write f6 [196321,111385] 0 2024-09-11T00:17:42.329 INFO:tasks.workunit.client.0.smithi078.stdout:9/21: unlink l5 0 2024-09-11T00:17:42.329 INFO:tasks.workunit.client.0.smithi078.stdout:9/22: fsync f4 0 2024-09-11T00:17:42.342 INFO:tasks.workunit.client.0.smithi078.stdout:7/40: rename d0/f1 to d0/fa 0 2024-09-11T00:17:42.344 INFO:tasks.workunit.client.0.smithi078.stdout:9/23: dwrite f7 [0,4194304] 0 2024-09-11T00:17:42.347 INFO:tasks.workunit.client.0.smithi078.stdout:1/68: chown d3/l5 25 1 2024-09-11T00:17:42.361 INFO:tasks.workunit.client.0.smithi078.stdout:9/24: dwrite f7 [0,4194304] 0 2024-09-11T00:17:42.383 INFO:tasks.workunit.client.0.smithi078.stdout:5/31: getdents d7 0 2024-09-11T00:17:42.383 INFO:tasks.workunit.client.0.smithi078.stdout:5/32: getdents d7/d8 0 2024-09-11T00:17:42.385 INFO:tasks.workunit.client.0.smithi078.stdout:3/42: sync 2024-09-11T00:17:42.385 INFO:tasks.workunit.client.0.smithi078.stdout:2/49: sync 2024-09-11T00:17:42.385 INFO:tasks.workunit.client.0.smithi078.stdout:3/43: fdatasync d0/f8 0 2024-09-11T00:17:42.386 INFO:tasks.workunit.client.0.smithi078.stdout:2/50: fsync d0/d1/f4 0 2024-09-11T00:17:42.386 INFO:tasks.workunit.client.0.smithi078.stdout:2/51: chown d0/fd 42953 1 2024-09-11T00:17:42.387 INFO:tasks.workunit.client.0.smithi078.stdout:8/33: rename c5 to c9 0 2024-09-11T00:17:42.387 INFO:tasks.workunit.client.0.smithi078.stdout:8/34: truncate f2 4699902 0 2024-09-11T00:17:42.392 INFO:tasks.workunit.client.0.smithi078.stdout:2/52: write d0/d1/fa [3663493,36191] 0 2024-09-11T00:17:42.392 INFO:tasks.workunit.client.0.smithi078.stdout:2/53: stat d0/fc 0 2024-09-11T00:17:42.392 INFO:tasks.workunit.client.0.smithi078.stdout:2/54: chown d0/fc 6857 1 2024-09-11T00:17:42.392 INFO:tasks.workunit.client.0.smithi078.stdout:2/55: write d0/d1/fe [241028,52907] 0 2024-09-11T00:17:42.392 INFO:tasks.workunit.client.0.smithi078.stdout:2/56: truncate d0/fc 128465 0 2024-09-11T00:17:42.393 INFO:tasks.workunit.client.0.smithi078.stdout:2/57: rename d0/d1/d6 to d0/d1/d6/df 22 2024-09-11T00:17:42.398 INFO:tasks.workunit.client.0.smithi078.stdout:7/41: getdents d0/d3 0 2024-09-11T00:17:42.402 INFO:tasks.workunit.client.0.smithi078.stdout:4/53: sync 2024-09-11T00:17:42.402 INFO:tasks.workunit.client.0.smithi078.stdout:0/52: sync 2024-09-11T00:17:42.402 INFO:tasks.workunit.client.0.smithi078.stdout:4/54: chown f4 30895155 1 2024-09-11T00:17:42.403 INFO:tasks.workunit.client.0.smithi078.stdout:8/35: dwrite f7 [0,4194304] 0 2024-09-11T00:17:42.410 INFO:tasks.workunit.client.0.smithi078.stdout:6/30: mknod d0/cb 0 2024-09-11T00:17:42.414 INFO:tasks.workunit.client.0.smithi078.stdout:1/69: write d3/d4/f8 [163882,34489] 0 2024-09-11T00:17:42.427 INFO:tasks.workunit.client.0.smithi078.stdout:6/31: dwrite d0/d1/f2 [0,4194304] 0 2024-09-11T00:17:42.429 INFO:tasks.workunit.client.0.smithi078.stdout:6/32: fdatasync d0/f8 0 2024-09-11T00:17:42.430 INFO:tasks.workunit.client.0.smithi078.stdout:6/33: write d0/f8 [650506,54854] 0 2024-09-11T00:17:42.450 INFO:tasks.workunit.client.0.smithi078.stdout:5/33: mkdir d7/d8/d9 0 2024-09-11T00:17:42.455 INFO:tasks.workunit.client.0.smithi078.stdout:3/44: unlink d0/f5 0 2024-09-11T00:17:42.461 INFO:tasks.workunit.client.0.smithi078.stdout:2/58: link d0/d1/c2 d0/c10 0 2024-09-11T00:17:42.461 INFO:tasks.workunit.client.0.smithi078.stdout:2/59: dread - d0/fd zero size 2024-09-11T00:17:42.466 INFO:tasks.workunit.client.0.smithi078.stdout:5/34: dwrite f6 [0,4194304] 0 2024-09-11T00:17:42.467 INFO:tasks.workunit.client.0.smithi078.stdout:7/42: truncate d0/fa 2608653 0 2024-09-11T00:17:42.467 INFO:tasks.workunit.client.0.smithi078.stdout:7/43: write d0/f4 [1903063,115094] 0 2024-09-11T00:17:42.470 INFO:tasks.workunit.client.0.smithi078.stdout:4/55: rmdir dc 39 2024-09-11T00:17:42.471 INFO:tasks.workunit.client.0.smithi078.stdout:0/53: symlink d2/d3/d7/dc/le 0 2024-09-11T00:17:42.471 INFO:tasks.workunit.client.0.smithi078.stdout:0/54: write d2/f4 [4713465,6681] 0 2024-09-11T00:17:42.473 INFO:tasks.workunit.client.0.smithi078.stdout:5/35: dread f6 [0,4194304] 0 2024-09-11T00:17:42.473 INFO:tasks.workunit.client.0.smithi078.stdout:5/36: getdents d7 0 2024-09-11T00:17:42.474 INFO:tasks.workunit.client.0.smithi078.stdout:8/36: mkdir da 0 2024-09-11T00:17:42.474 INFO:tasks.workunit.client.0.smithi078.stdout:8/37: write f2 [4804515,3754] 0 2024-09-11T00:17:42.475 INFO:tasks.workunit.client.0.smithi078.stdout:5/37: dread f6 [0,4194304] 0 2024-09-11T00:17:42.479 INFO:tasks.workunit.client.0.smithi078.stdout:5/38: dread f1 [0,4194304] 0 2024-09-11T00:17:42.487 INFO:tasks.workunit.client.0.smithi078.stdout:9/25: mknod c8 0 2024-09-11T00:17:42.495 INFO:tasks.workunit.client.0.smithi078.stdout:6/34: creat d0/fc x:0 0 0 2024-09-11T00:17:42.495 INFO:tasks.workunit.client.0.smithi078.stdout:6/35: write d0/fc [159677,78089] 0 2024-09-11T00:17:42.517 INFO:tasks.workunit.client.0.smithi078.stdout:3/45: creat d0/d7/fe x:0 0 0 2024-09-11T00:17:42.517 INFO:tasks.workunit.client.0.smithi078.stdout:3/46: stat d0/f3 0 2024-09-11T00:17:42.526 INFO:tasks.workunit.client.0.smithi078.stdout:2/60: mkdir d0/d1/d11 0 2024-09-11T00:17:42.537 INFO:tasks.workunit.client.0.smithi078.stdout:7/44: unlink d0/d3/f9 0 2024-09-11T00:17:42.537 INFO:tasks.workunit.client.0.smithi078.stdout:7/45: write d0/f4 [5442192,50748] 0 2024-09-11T00:17:42.543 INFO:tasks.workunit.client.0.smithi078.stdout:4/56: rmdir dc 39 2024-09-11T00:17:42.543 INFO:tasks.workunit.client.0.smithi078.stdout:7/46: dread d0/f4 [0,4194304] 0 2024-09-11T00:17:42.544 INFO:tasks.workunit.client.0.smithi078.stdout:0/55: mknod d2/d3/d7/cf 0 2024-09-11T00:17:42.549 INFO:tasks.workunit.client.0.smithi078.stdout:8/38: unlink f1 0 2024-09-11T00:17:42.549 INFO:tasks.workunit.client.0.smithi078.stdout:8/39: getdents da 0 2024-09-11T00:17:42.555 INFO:tasks.workunit.client.0.smithi078.stdout:0/56: dread d2/f4 [0,4194304] 0 2024-09-11T00:17:42.562 INFO:tasks.workunit.client.0.smithi078.stdout:1/70: symlink d3/l10 0 2024-09-11T00:17:42.563 INFO:tasks.workunit.client.0.smithi078.stdout:5/39: mknod d7/d8/d9/ca 0 2024-09-11T00:17:42.566 INFO:tasks.workunit.client.0.smithi078.stdout:8/40: dread f7 [0,4194304] 0 2024-09-11T00:17:42.567 INFO:tasks.workunit.client.0.smithi078.stdout:8/41: getdents da 0 2024-09-11T00:17:42.570 INFO:tasks.workunit.client.0.smithi078.stdout:9/26: write f4 [247678,32913] 0 2024-09-11T00:17:42.574 INFO:tasks.workunit.client.0.smithi078.stdout:6/36: symlink d0/d1/d9/ld 0 2024-09-11T00:17:42.593 INFO:tasks.workunit.client.0.smithi078.stdout:3/47: mknod d0/d7/cf 0 2024-09-11T00:17:42.593 INFO:tasks.workunit.client.0.smithi078.stdout:3/48: chown d0/f8 217088 1 2024-09-11T00:17:42.604 INFO:tasks.workunit.client.0.smithi078.stdout:2/61: creat d0/d1/d8/f12 x:0 0 0 2024-09-11T00:17:42.624 INFO:tasks.workunit.client.0.smithi078.stdout:4/57: mkdir dc/d10 0 2024-09-11T00:17:42.626 INFO:tasks.workunit.client.0.smithi078.stdout:7/47: mkdir d0/d3/db 0 2024-09-11T00:17:42.628 INFO:tasks.workunit.client.0.smithi078.stdout:7/48: dread d0/fa [0,4194304] 0 2024-09-11T00:17:42.643 INFO:tasks.workunit.client.0.smithi078.stdout:5/40: rmdir d7/d8 39 2024-09-11T00:17:42.659 INFO:tasks.workunit.client.0.smithi078.stdout:1/71: dwrite d3/f9 [0,4194304] 0 2024-09-11T00:17:42.661 INFO:tasks.workunit.client.0.smithi078.stdout:6/37: creat d0/d1/fe x:0 0 0 2024-09-11T00:17:42.661 INFO:tasks.workunit.client.0.smithi078.stdout:6/38: readlink d0/d1/d9/l6 0 2024-09-11T00:17:42.683 INFO:tasks.workunit.client.0.smithi078.stdout:3/49: creat d0/f10 x:0 0 0 2024-09-11T00:17:42.691 INFO:tasks.workunit.client.0.smithi078.stdout:2/62: unlink d0/d1/fa 0 2024-09-11T00:17:42.692 INFO:tasks.workunit.client.0.smithi078.stdout:2/63: read d0/d1/d6/f9 [3323824,65216] 0 2024-09-11T00:17:42.710 INFO:tasks.workunit.client.0.smithi078.stdout:4/58: unlink f2 0 2024-09-11T00:17:42.718 INFO:tasks.workunit.client.0.smithi078.stdout:7/49: rename d0/d3/c5 to d0/d3/db/cc 0 2024-09-11T00:17:42.725 INFO:tasks.workunit.client.0.smithi078.stdout:0/57: truncate d2/f4 679539 0 2024-09-11T00:17:42.725 INFO:tasks.workunit.client.0.smithi078.stdout:0/58: readlink d2/d3/d7/dc/le 0 2024-09-11T00:17:42.725 INFO:tasks.workunit.client.0.smithi078.stdout:0/59: chown d2/d3/cd 4411 1 2024-09-11T00:17:42.725 INFO:tasks.workunit.client.0.smithi078.stdout:0/60: fdatasync d2/f4 0 2024-09-11T00:17:42.726 INFO:tasks.workunit.client.0.smithi078.stdout:0/61: stat d2/d3/d7/dc 0 2024-09-11T00:17:42.746 INFO:tasks.workunit.client.0.smithi078.stdout:8/42: sync 2024-09-11T00:17:42.747 INFO:tasks.workunit.client.0.smithi078.stdout:9/27: symlink l9 0 2024-09-11T00:17:42.756 INFO:tasks.workunit.client.0.smithi078.stdout:1/72: rmdir d3/d4 39 2024-09-11T00:17:42.780 INFO:tasks.workunit.client.0.smithi078.stdout:3/50: mkdir d0/d11 0 2024-09-11T00:17:42.786 INFO:tasks.workunit.client.0.smithi078.stdout:2/64: symlink d0/d1/d8/l13 0 2024-09-11T00:17:42.802 INFO:tasks.workunit.client.0.smithi078.stdout:3/51: dwrite d0/f8 [0,4194304] 0 2024-09-11T00:17:42.809 INFO:tasks.workunit.client.0.smithi078.stdout:7/50: mkdir d0/d3/db/dd 0 2024-09-11T00:17:42.816 INFO:tasks.workunit.client.0.smithi078.stdout:3/52: write d0/f8 [3772998,34211] 0 2024-09-11T00:17:42.816 INFO:tasks.workunit.client.0.smithi078.stdout:3/53: truncate d0/d7/fd 526538 0 2024-09-11T00:17:42.816 INFO:tasks.workunit.client.0.smithi078.stdout:3/54: read d0/d7/fd [53791,71442] 0 2024-09-11T00:17:42.816 INFO:tasks.workunit.client.0.smithi078.stdout:3/55: readlink - no filename 2024-09-11T00:17:42.817 INFO:tasks.workunit.client.0.smithi078.stdout:0/62: unlink d2/d3/f5 0 2024-09-11T00:17:42.819 INFO:tasks.workunit.client.0.smithi078.stdout:0/63: dread d2/f4 [0,4194304] 0 2024-09-11T00:17:42.841 INFO:tasks.workunit.client.0.smithi078.stdout:8/43: mknod da/cb 0 2024-09-11T00:17:42.841 INFO:tasks.workunit.client.0.smithi078.stdout:5/41: sync 2024-09-11T00:17:42.843 INFO:tasks.workunit.client.0.smithi078.stdout:9/28: creat fa x:0 0 0 2024-09-11T00:17:42.845 INFO:tasks.workunit.client.0.smithi078.stdout:5/42: dread f1 [0,4194304] 0 2024-09-11T00:17:42.850 INFO:tasks.workunit.client.0.smithi078.stdout:8/44: write f2 [179342,56545] 0 2024-09-11T00:17:42.861 INFO:tasks.workunit.client.0.smithi078.stdout:6/39: link d0/l5 d0/d1/lf 0 2024-09-11T00:17:42.861 INFO:tasks.workunit.client.0.smithi078.stdout:6/40: chown d0/d1/fe 27690 1 2024-09-11T00:17:42.861 INFO:tasks.workunit.client.0.smithi078.stdout:6/41: fsync d0/d1/f2 0 2024-09-11T00:17:42.866 INFO:tasks.workunit.client.0.smithi078.stdout:8/45: dwrite f4 [0,4194304] 0 2024-09-11T00:17:42.868 INFO:tasks.workunit.client.0.smithi078.stdout:8/46: fdatasync f2 0 2024-09-11T00:17:42.883 INFO:tasks.workunit.client.0.smithi078.stdout:8/47: dwrite f6 [0,4194304] 0 2024-09-11T00:17:42.884 INFO:tasks.workunit.client.0.smithi078.stdout:4/59: sync 2024-09-11T00:17:42.885 INFO:tasks.workunit.client.0.smithi078.stdout:2/65: getdents d0 0 2024-09-11T00:17:42.885 INFO:tasks.workunit.client.0.smithi078.stdout:2/66: chown d0 0 1 2024-09-11T00:17:42.885 INFO:tasks.workunit.client.0.smithi078.stdout:2/67: fdatasync d0/d1/d8/f12 0 2024-09-11T00:17:42.898 INFO:tasks.workunit.client.0.smithi078.stdout:8/48: dwrite f4 [0,4194304] 0 2024-09-11T00:17:42.913 INFO:tasks.workunit.client.0.smithi078.stdout:7/51: creat d0/d3/db/dd/fe x:0 0 0 2024-09-11T00:17:42.913 INFO:tasks.workunit.client.0.smithi078.stdout:7/52: chown d0/c8 1292364 1 2024-09-11T00:17:42.915 INFO:tasks.workunit.client.0.smithi078.stdout:8/49: dwrite f2 [0,4194304] 0 2024-09-11T00:17:42.921 INFO:tasks.workunit.client.0.smithi078.stdout:3/56: unlink d0/d7/fc 0 2024-09-11T00:17:42.921 INFO:tasks.workunit.client.0.smithi078.stdout:3/57: write d0/d7/fe [114697,115700] 0 2024-09-11T00:17:42.924 INFO:tasks.workunit.client.0.smithi078.stdout:0/64: rename d2/d3/d7/cb to d2/d3/c10 0 2024-09-11T00:17:42.925 INFO:tasks.workunit.client.0.smithi078.stdout:0/65: dread d2/d3/d7/fa [0,4194304] 0 2024-09-11T00:17:42.925 INFO:tasks.workunit.client.0.smithi078.stdout:0/66: write d2/d3/d7/fa [1396341,59692] 0 2024-09-11T00:17:42.947 INFO:tasks.workunit.client.0.smithi078.stdout:5/43: creat d7/d8/d9/fb x:0 0 0 2024-09-11T00:17:42.953 INFO:tasks.workunit.client.0.smithi078.stdout:9/29: write f7 [2390339,35484] 0 2024-09-11T00:17:42.955 INFO:tasks.workunit.client.0.smithi078.stdout:1/73: symlink d3/l11 0 2024-09-11T00:17:42.956 INFO:tasks.workunit.client.0.smithi078.stdout:1/74: write d3/d4/db/ff [251048,100152] 0 2024-09-11T00:17:42.956 INFO:tasks.workunit.client.0.smithi078.stdout:1/75: chown d3/d4 2300427 1 2024-09-11T00:17:42.962 INFO:tasks.workunit.client.0.smithi078.stdout:6/42: creat d0/f10 x:0 0 0 2024-09-11T00:17:42.984 INFO:tasks.workunit.client.0.smithi078.stdout:2/68: rmdir d0/d1/d8 39 2024-09-11T00:17:43.000 INFO:tasks.workunit.client.0.smithi078.stdout:4/60: dwrite dc/fd [0,4194304] 0 2024-09-11T00:17:43.014 INFO:tasks.workunit.client.0.smithi078.stdout:7/53: rename d0/d3 to d0/df 0 2024-09-11T00:17:43.017 INFO:tasks.workunit.client.0.smithi078.stdout:8/50: creat da/fc x:0 0 0 2024-09-11T00:17:43.018 INFO:tasks.workunit.client.0.smithi078.stdout:7/54: dread d0/f4 [0,4194304] 0 2024-09-11T00:17:43.018 INFO:tasks.workunit.client.0.smithi078.stdout:7/55: fsync d0/f4 0 2024-09-11T00:17:43.023 INFO:tasks.workunit.client.0.smithi078.stdout:3/58: mknod d0/db/c12 0 2024-09-11T00:17:43.028 INFO:tasks.workunit.client.0.smithi078.stdout:0/67: symlink d2/d3/d7/dc/l11 0 2024-09-11T00:17:43.033 INFO:tasks.workunit.client.0.smithi078.stdout:7/56: dwrite d0/f4 [4194304,4194304] 0 2024-09-11T00:17:43.036 INFO:tasks.workunit.client.0.smithi078.stdout:3/59: dwrite d0/d7/fe [0,4194304] 0 2024-09-11T00:17:43.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:42 smithi138 ceph-mon[35019]: pgmap v360: 97 pgs: 97 active+clean; 136 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.1 MiB/s wr, 731 op/s 2024-09-11T00:17:43.052 INFO:tasks.workunit.client.0.smithi078.stdout:5/44: rename c4 to d7/d8/cc 0 2024-09-11T00:17:43.059 INFO:tasks.workunit.client.0.smithi078.stdout:9/30: creat fb x:0 0 0 2024-09-11T00:17:43.063 INFO:tasks.workunit.client.0.smithi078.stdout:1/76: creat d3/d4/f12 x:0 0 0 2024-09-11T00:17:43.071 INFO:tasks.workunit.client.0.smithi078.stdout:6/43: unlink d0/d1/la 0 2024-09-11T00:17:43.071 INFO:tasks.workunit.client.0.smithi078.stdout:6/44: fsync d0/d1/fe 0 2024-09-11T00:17:43.071 INFO:tasks.workunit.client.0.smithi078.stdout:6/45: write d0/d1/f2 [4443226,78356] 0 2024-09-11T00:17:43.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:42 smithi078 ceph-mon[30865]: pgmap v360: 97 pgs: 97 active+clean; 136 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.1 MiB/s wr, 731 op/s 2024-09-11T00:17:43.124 INFO:tasks.workunit.client.0.smithi078.stdout:4/61: dwrite f3 [0,4194304] 0 2024-09-11T00:17:43.128 INFO:tasks.workunit.client.0.smithi078.stdout:8/51: mknod da/cd 0 2024-09-11T00:17:43.128 INFO:tasks.workunit.client.0.smithi078.stdout:8/52: dread - da/fc zero size 2024-09-11T00:17:43.138 INFO:tasks.workunit.client.0.smithi078.stdout:4/62: dwrite f3 [4194304,4194304] 0 2024-09-11T00:17:43.142 INFO:tasks.workunit.client.0.smithi078.stdout:0/68: mknod d2/d3/c12 0 2024-09-11T00:17:43.147 INFO:tasks.workunit.client.0.smithi078.stdout:7/57: symlink d0/df/db/dd/l10 0 2024-09-11T00:17:43.149 INFO:tasks.workunit.client.0.smithi078.stdout:3/60: mkdir d0/d13 0 2024-09-11T00:17:43.159 INFO:tasks.workunit.client.0.smithi078.stdout:3/61: dread d0/f6 [0,4194304] 0 2024-09-11T00:17:43.159 INFO:tasks.workunit.client.0.smithi078.stdout:3/62: chown d0/db 6237 1 2024-09-11T00:17:43.162 INFO:tasks.workunit.client.0.smithi078.stdout:7/58: dwrite d0/fa [0,4194304] 0 2024-09-11T00:17:43.162 INFO:tasks.workunit.client.0.smithi078.stdout:7/59: readlink d0/df/db/dd/l10 0 2024-09-11T00:17:43.163 INFO:tasks.workunit.client.0.smithi078.stdout:5/45: mknod d7/d8/d9/cd 0 2024-09-11T00:17:43.173 INFO:tasks.workunit.client.0.smithi078.stdout:1/77: symlink d3/d4/db/l13 0 2024-09-11T00:17:43.173 INFO:tasks.workunit.client.0.smithi078.stdout:1/78: fdatasync d3/d4/f12 0 2024-09-11T00:17:43.173 INFO:tasks.workunit.client.0.smithi078.stdout:1/79: write d3/d4/db/ff [603311,89674] 0 2024-09-11T00:17:43.173 INFO:tasks.workunit.client.0.smithi078.stdout:1/80: write d3/d4/f12 [183856,106969] 0 2024-09-11T00:17:43.180 INFO:tasks.workunit.client.0.smithi078.stdout:6/46: creat d0/f11 x:0 0 0 2024-09-11T00:17:43.180 INFO:tasks.workunit.client.0.smithi078.stdout:6/47: write d0/d1/fe [925392,79714] 0 2024-09-11T00:17:43.180 INFO:tasks.workunit.client.0.smithi078.stdout:6/48: stat d0/d1/d9 0 2024-09-11T00:17:43.180 INFO:tasks.workunit.client.0.smithi078.stdout:6/49: chown d0/cb 344813 1 2024-09-11T00:17:43.180 INFO:tasks.workunit.client.0.smithi078.stdout:6/50: fdatasync d0/f11 0 2024-09-11T00:17:43.182 INFO:tasks.workunit.client.0.smithi078.stdout:6/51: fsync d0/d1/fe 0 2024-09-11T00:17:43.215 INFO:tasks.workunit.client.0.smithi078.stdout:2/69: sync 2024-09-11T00:17:43.215 INFO:tasks.workunit.client.0.smithi078.stdout:2/70: dread - d0/fd zero size 2024-09-11T00:17:43.231 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:42 smithi112 ceph-mon[35627]: pgmap v360: 97 pgs: 97 active+clean; 136 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.1 MiB/s wr, 731 op/s 2024-09-11T00:17:43.233 INFO:tasks.workunit.client.0.smithi078.stdout:8/53: creat da/fe x:0 0 0 2024-09-11T00:17:43.247 INFO:tasks.workunit.client.0.smithi078.stdout:0/69: getdents d2/d3/d7/dc 0 2024-09-11T00:17:43.255 INFO:tasks.workunit.client.0.smithi078.stdout:4/63: dread fa [0,4194304] 0 2024-09-11T00:17:43.265 INFO:tasks.workunit.client.0.smithi078.stdout:3/63: creat d0/d13/f14 x:0 0 0 2024-09-11T00:17:43.270 INFO:tasks.workunit.client.0.smithi078.stdout:5/46: mkdir d7/d8/de 0 2024-09-11T00:17:43.271 INFO:tasks.workunit.client.0.smithi078.stdout:5/47: getdents d7/d8/de 0 2024-09-11T00:17:43.279 INFO:tasks.workunit.client.0.smithi078.stdout:9/31: mkdir dc 0 2024-09-11T00:17:43.284 INFO:tasks.workunit.client.0.smithi078.stdout:5/48: dwrite f6 [0,4194304] 0 2024-09-11T00:17:43.340 INFO:tasks.workunit.client.0.smithi078.stdout:8/54: getdents da 0 2024-09-11T00:17:43.359 INFO:tasks.workunit.client.0.smithi078.stdout:4/64: readlink l7 0 2024-09-11T00:17:43.364 INFO:tasks.workunit.client.0.smithi078.stdout:4/65: write fa [3971223,9828] 0 2024-09-11T00:17:43.367 INFO:tasks.workunit.client.0.smithi078.stdout:3/64: symlink d0/d7/l15 0 2024-09-11T00:17:43.381 INFO:tasks.workunit.client.0.smithi078.stdout:9/32: chown l1 1321106854 1 2024-09-11T00:17:43.386 INFO:tasks.workunit.client.0.smithi078.stdout:1/81: mknod d3/c14 0 2024-09-11T00:17:43.386 INFO:tasks.workunit.client.0.smithi078.stdout:1/82: write d3/d4/db/ff [399032,45] 0 2024-09-11T00:17:43.386 INFO:tasks.workunit.client.0.smithi078.stdout:1/83: fsync f2 0 2024-09-11T00:17:43.394 INFO:tasks.workunit.client.0.smithi078.stdout:6/52: rename d0/d1/d9/l6 to d0/l12 0 2024-09-11T00:17:43.402 INFO:tasks.workunit.client.0.smithi078.stdout:1/84: dwrite d3/d4/f12 [0,4194304] 0 2024-09-11T00:17:43.418 INFO:tasks.workunit.client.0.smithi078.stdout:1/85: dwrite d3/f9 [0,4194304] 0 2024-09-11T00:17:43.423 INFO:tasks.workunit.client.0.smithi078.stdout:0/70: sync 2024-09-11T00:17:43.423 INFO:tasks.workunit.client.0.smithi078.stdout:7/60: sync 2024-09-11T00:17:43.423 INFO:tasks.workunit.client.0.smithi078.stdout:2/71: sync 2024-09-11T00:17:43.424 INFO:tasks.workunit.client.0.smithi078.stdout:0/71: stat d2/d3/d7/dc/le 0 2024-09-11T00:17:43.441 INFO:tasks.workunit.client.0.smithi078.stdout:1/86: dwrite d3/f9 [0,4194304] 0 2024-09-11T00:17:43.443 INFO:tasks.workunit.client.0.smithi078.stdout:2/72: dwrite d0/d1/d6/f9 [0,4194304] 0 2024-09-11T00:17:43.443 INFO:tasks.workunit.client.0.smithi078.stdout:2/73: write d0/d1/d8/f12 [115421,110565] 0 2024-09-11T00:17:43.445 INFO:tasks.workunit.client.0.smithi078.stdout:8/55: creat da/ff x:0 0 0 2024-09-11T00:17:43.445 INFO:tasks.workunit.client.0.smithi078.stdout:8/56: chown f6 673 1 2024-09-11T00:17:43.445 INFO:tasks.workunit.client.0.smithi078.stdout:7/61: dwrite d0/f4 [4194304,4194304] 0 2024-09-11T00:17:43.445 INFO:tasks.workunit.client.0.smithi078.stdout:7/62: readlink d0/df/db/dd/l10 0 2024-09-11T00:17:43.460 INFO:tasks.workunit.client.0.smithi078.stdout:2/74: dwrite d0/d1/d8/f12 [0,4194304] 0 2024-09-11T00:17:43.473 INFO:tasks.workunit.client.0.smithi078.stdout:4/66: creat dc/f11 x:0 0 0 2024-09-11T00:17:43.478 INFO:tasks.workunit.client.0.smithi078.stdout:3/65: rmdir d0/d11 0 2024-09-11T00:17:43.478 INFO:tasks.workunit.client.0.smithi078.stdout:3/66: write d0/f2 [4098776,57075] 0 2024-09-11T00:17:43.478 INFO:tasks.workunit.client.0.smithi078.stdout:3/67: write d0/d13/f14 [224538,108497] 0 2024-09-11T00:17:43.491 INFO:tasks.workunit.client.0.smithi078.stdout:9/33: symlink dc/ld 0 2024-09-11T00:17:43.492 INFO:tasks.workunit.client.0.smithi078.stdout:9/34: stat dc/ld 0 2024-09-11T00:17:43.502 INFO:tasks.workunit.client.0.smithi078.stdout:5/49: rename f1 to d7/d8/de/ff 0 2024-09-11T00:17:43.508 INFO:tasks.workunit.client.0.smithi078.stdout:5/50: dread f6 [0,4194304] 0 2024-09-11T00:17:43.533 INFO:tasks.workunit.client.0.smithi078.stdout:0/72: creat d2/d3/d7/f13 x:0 0 0 2024-09-11T00:17:43.550 INFO:tasks.workunit.client.0.smithi078.stdout:1/87: symlink d3/d4/l15 0 2024-09-11T00:17:43.555 INFO:tasks.workunit.client.0.smithi078.stdout:1/88: dread d3/d4/db/ff [0,4194304] 0 2024-09-11T00:17:43.555 INFO:tasks.workunit.client.0.smithi078.stdout:1/89: read f2 [813989,107478] 0 2024-09-11T00:17:43.556 INFO:tasks.workunit.client.0.smithi078.stdout:8/57: creat da/f10 x:0 0 0 2024-09-11T00:17:43.560 INFO:tasks.workunit.client.0.smithi078.stdout:7/63: unlink d0/fa 0 2024-09-11T00:17:43.560 INFO:tasks.workunit.client.0.smithi078.stdout:7/64: chown d0/c8 7210564 1 2024-09-11T00:17:43.560 INFO:tasks.workunit.client.0.smithi078.stdout:7/65: readlink d0/df/db/dd/l10 0 2024-09-11T00:17:43.568 INFO:tasks.workunit.client.0.smithi078.stdout:1/90: dwrite d3/f9 [4194304,4194304] 0 2024-09-11T00:17:43.568 INFO:tasks.workunit.client.0.smithi078.stdout:1/91: chown d3/d4/db/l13 177642 1 2024-09-11T00:17:43.568 INFO:tasks.workunit.client.0.smithi078.stdout:1/92: chown d3 1550 1 2024-09-11T00:17:43.579 INFO:tasks.workunit.client.0.smithi078.stdout:2/75: symlink d0/d1/d8/l14 0 2024-09-11T00:17:43.591 INFO:tasks.workunit.client.0.smithi078.stdout:4/67: rmdir dc 39 2024-09-11T00:17:43.596 INFO:tasks.workunit.client.0.smithi078.stdout:3/68: mknod d0/c16 0 2024-09-11T00:17:43.607 INFO:tasks.workunit.client.0.smithi078.stdout:4/68: dwrite f3 [4194304,4194304] 0 2024-09-11T00:17:43.613 INFO:tasks.workunit.client.0.smithi078.stdout:9/35: mkdir dc/de 0 2024-09-11T00:17:43.614 INFO:tasks.workunit.client.0.smithi078.stdout:9/36: dread f4 [0,4194304] 0 2024-09-11T00:17:43.614 INFO:tasks.workunit.client.0.smithi078.stdout:9/37: dread - fb zero size 2024-09-11T00:17:43.623 INFO:tasks.workunit.client.0.smithi078.stdout:6/53: symlink d0/l13 0 2024-09-11T00:17:43.630 INFO:tasks.workunit.client.0.smithi078.stdout:9/38: dwrite f7 [4194304,4194304] 0 2024-09-11T00:17:43.631 INFO:tasks.workunit.client.0.smithi078.stdout:5/51: creat d7/d8/de/f10 x:0 0 0 2024-09-11T00:17:43.654 INFO:tasks.workunit.client.0.smithi078.stdout:0/73: creat d2/d3/d7/f14 x:0 0 0 2024-09-11T00:17:43.677 INFO:tasks.workunit.client.0.smithi078.stdout:8/58: mknod da/c11 0 2024-09-11T00:17:43.680 INFO:tasks.workunit.client.0.smithi078.stdout:7/66: rename d0/df/db/dd to d0/d11 0 2024-09-11T00:17:43.680 INFO:tasks.workunit.client.0.smithi078.stdout:7/67: readlink d0/d11/l10 0 2024-09-11T00:17:43.689 INFO:tasks.workunit.client.0.smithi078.stdout:8/59: dwrite da/fc [0,4194304] 0 2024-09-11T00:17:43.689 INFO:tasks.workunit.client.0.smithi078.stdout:8/60: chown da/fe 125684 1 2024-09-11T00:17:43.691 INFO:tasks.workunit.client.0.smithi078.stdout:1/93: link d3/d4/db/l13 d3/d4/l16 0 2024-09-11T00:17:43.691 INFO:tasks.workunit.client.0.smithi078.stdout:1/94: stat d3/d4/f8 0 2024-09-11T00:17:43.696 INFO:tasks.workunit.client.0.smithi078.stdout:1/95: dread d3/d4/f8 [0,4194304] 0 2024-09-11T00:17:43.696 INFO:tasks.workunit.client.0.smithi078.stdout:1/96: chown d3 1493 1 2024-09-11T00:17:43.701 INFO:tasks.workunit.client.0.smithi078.stdout:2/76: creat d0/d1/d6/f15 x:0 0 0 2024-09-11T00:17:43.708 INFO:tasks.workunit.client.0.smithi078.stdout:2/77: write d0/d1/d8/f12 [3263335,84770] 0 2024-09-11T00:17:43.708 INFO:tasks.workunit.client.0.smithi078.stdout:2/78: stat d0 0 2024-09-11T00:17:43.708 INFO:tasks.workunit.client.0.smithi078.stdout:2/79: write d0/d1/fe [429089,28188] 0 2024-09-11T00:17:43.716 INFO:tasks.workunit.client.0.smithi078.stdout:3/69: creat d0/d7/f17 x:0 0 0 2024-09-11T00:17:43.717 INFO:tasks.workunit.client.0.smithi078.stdout:3/70: chown d0/d7/fe 1 1 2024-09-11T00:17:43.717 INFO:tasks.workunit.client.0.smithi078.stdout:3/71: fsync d0/f10 0 2024-09-11T00:17:43.729 INFO:tasks.workunit.client.0.smithi078.stdout:2/80: dwrite d0/d1/d6/f15 [0,4194304] 0 2024-09-11T00:17:43.729 INFO:tasks.workunit.client.0.smithi078.stdout:2/81: getdents d0 0 2024-09-11T00:17:43.742 INFO:tasks.workunit.client.0.smithi078.stdout:2/82: dwrite d0/d1/d6/f9 [0,4194304] 0 2024-09-11T00:17:43.744 INFO:tasks.workunit.client.0.smithi078.stdout:6/54: mknod d0/d1/c14 0 2024-09-11T00:17:43.752 INFO:tasks.workunit.client.0.smithi078.stdout:9/39: symlink dc/lf 0 2024-09-11T00:17:43.754 INFO:tasks.workunit.client.0.smithi078.stdout:5/52: creat d7/d8/de/f11 x:0 0 0 2024-09-11T00:17:43.754 INFO:tasks.workunit.client.0.smithi078.stdout:5/53: write d7/d8/de/f10 [548407,32425] 0 2024-09-11T00:17:43.799 INFO:tasks.workunit.client.0.smithi078.stdout:7/68: mknod d0/df/db/c12 0 2024-09-11T00:17:43.799 INFO:tasks.workunit.client.0.smithi078.stdout:7/69: write d0/d11/fe [588635,48084] 0 2024-09-11T00:17:43.799 INFO:tasks.workunit.client.0.smithi078.stdout:7/70: truncate d0/d11/fe 1437618 0 2024-09-11T00:17:43.799 INFO:tasks.workunit.client.0.smithi078.stdout:7/71: write d0/f4 [1342786,112632] 0 2024-09-11T00:17:43.816 INFO:tasks.workunit.client.0.smithi078.stdout:1/97: unlink d3/l11 0 2024-09-11T00:17:43.833 INFO:tasks.workunit.client.0.smithi078.stdout:3/72: mkdir d0/d7/d18 0 2024-09-11T00:17:43.834 INFO:tasks.workunit.client.0.smithi078.stdout:3/73: dread d0/d7/fd [0,4194304] 0 2024-09-11T00:17:43.841 INFO:tasks.workunit.client.0.smithi078.stdout:4/69: unlink f9 0 2024-09-11T00:17:43.856 INFO:tasks.workunit.client.0.smithi078.stdout:2/83: creat d0/d1/d6/f16 x:0 0 0 2024-09-11T00:17:43.859 INFO:tasks.workunit.client.0.smithi078.stdout:6/55: link d0/d1/fe d0/d1/d9/f15 0 2024-09-11T00:17:43.869 INFO:tasks.workunit.client.0.smithi078.stdout:9/40: truncate f2 1459933 0 2024-09-11T00:17:43.869 INFO:tasks.workunit.client.0.smithi078.stdout:9/41: write f4 [396966,29629] 0 2024-09-11T00:17:43.871 INFO:tasks.workunit.client.0.smithi078.stdout:5/54: rmdir d7/d8/d9 39 2024-09-11T00:17:43.871 INFO:tasks.workunit.client.0.smithi078.stdout:5/55: rename d7/d8 to d7/d8/d9/d12 22 2024-09-11T00:17:43.875 INFO:tasks.workunit.client.0.smithi078.stdout:5/56: dread d7/d8/de/ff [0,4194304] 0 2024-09-11T00:17:43.875 INFO:tasks.workunit.client.0.smithi078.stdout:5/57: chown d7/d8/d9/cd 401 1 2024-09-11T00:17:43.893 INFO:tasks.workunit.client.0.smithi078.stdout:0/74: link d2/d3/d7/f14 d2/d3/d7/f15 0 2024-09-11T00:17:43.925 INFO:tasks.workunit.client.0.smithi078.stdout:8/61: truncate da/fc 1301124 0 2024-09-11T00:17:43.925 INFO:tasks.workunit.client.0.smithi078.stdout:8/62: write da/f10 [307113,7996] 0 2024-09-11T00:17:43.925 INFO:tasks.workunit.client.0.smithi078.stdout:8/63: write da/fe [607544,73046] 0 2024-09-11T00:17:43.925 INFO:tasks.workunit.client.0.smithi078.stdout:8/64: readlink l8 0 2024-09-11T00:17:43.925 INFO:tasks.workunit.client.0.smithi078.stdout:8/65: write f7 [4385167,129808] 0 2024-09-11T00:17:43.934 INFO:tasks.workunit.client.0.smithi078.stdout:1/98: creat d3/f17 x:0 0 0 2024-09-11T00:17:43.934 INFO:tasks.workunit.client.0.smithi078.stdout:1/99: fdatasync f2 0 2024-09-11T00:17:43.951 INFO:tasks.workunit.client.0.smithi078.stdout:1/100: dwrite d3/f17 [0,4194304] 0 2024-09-11T00:17:43.952 INFO:tasks.workunit.client.0.smithi078.stdout:3/74: creat d0/d7/d18/f19 x:0 0 0 2024-09-11T00:17:43.960 INFO:tasks.workunit.client.0.smithi078.stdout:4/70: creat dc/d10/f12 x:0 0 0 2024-09-11T00:17:43.964 INFO:tasks.workunit.client.0.smithi078.stdout:3/75: dwrite d0/d7/d18/f19 [0,4194304] 0 2024-09-11T00:17:43.965 INFO:tasks.workunit.client.0.smithi078.stdout:3/76: write d0/d7/fd [887514,50544] 0 2024-09-11T00:17:43.969 INFO:tasks.workunit.client.0.smithi078.stdout:4/71: dread fa [0,4194304] 0 2024-09-11T00:17:43.977 INFO:tasks.workunit.client.0.smithi078.stdout:2/84: mknod d0/d1/c17 0 2024-09-11T00:17:43.978 INFO:tasks.workunit.client.0.smithi078.stdout:2/85: dread d0/fc [0,4194304] 0 2024-09-11T00:17:43.978 INFO:tasks.workunit.client.0.smithi078.stdout:2/86: write d0/d1/d8/f12 [404836,125911] 0 2024-09-11T00:17:43.978 INFO:tasks.workunit.client.0.smithi078.stdout:2/87: write d0/fc [192706,39575] 0 2024-09-11T00:17:43.979 INFO:tasks.workunit.client.0.smithi078.stdout:2/88: fsync d0/fd 0 2024-09-11T00:17:43.981 INFO:tasks.workunit.client.0.smithi078.stdout:6/56: creat d0/d1/d9/f16 x:0 0 0 2024-09-11T00:17:43.988 INFO:tasks.workunit.client.0.smithi078.stdout:2/89: read d0/d1/d6/f15 [110204,53344] 0 2024-09-11T00:17:43.988 INFO:tasks.workunit.client.0.smithi078.stdout:2/90: getdents d0 0 2024-09-11T00:17:43.988 INFO:tasks.workunit.client.0.smithi078.stdout:2/91: fdatasync d0/d1/d6/f16 0 2024-09-11T00:17:43.988 INFO:tasks.workunit.client.0.smithi078.stdout:2/92: read d0/fc [58309,50819] 0 2024-09-11T00:17:43.989 INFO:tasks.workunit.client.0.smithi078.stdout:9/42: mknod dc/c10 0 2024-09-11T00:17:43.994 INFO:tasks.workunit.client.0.smithi078.stdout:6/57: dwrite d0/f10 [0,4194304] 0 2024-09-11T00:17:43.998 INFO:tasks.workunit.client.0.smithi078.stdout:5/58: mkdir d7/d8/d13 0 2024-09-11T00:17:44.008 INFO:tasks.workunit.client.0.smithi078.stdout:9/43: dwrite f4 [0,4194304] 0 2024-09-11T00:17:44.020 INFO:tasks.workunit.client.0.smithi078.stdout:0/75: creat d2/f16 x:0 0 0 2024-09-11T00:17:44.024 INFO:tasks.workunit.client.0.smithi078.stdout:9/44: dwrite fa [0,4194304] 0 2024-09-11T00:17:44.042 INFO:tasks.workunit.client.0.smithi078.stdout:9/45: dwrite f4 [0,4194304] 0 2024-09-11T00:17:44.042 INFO:tasks.workunit.client.0.smithi078.stdout:9/46: fdatasync fb 0 2024-09-11T00:17:44.047 INFO:tasks.workunit.client.0.smithi078.stdout:0/76: dwrite d2/d3/d7/f13 [0,4194304] 0 2024-09-11T00:17:44.067 INFO:tasks.workunit.client.0.smithi078.stdout:8/66: link da/f10 da/f12 0 2024-09-11T00:17:44.077 INFO:tasks.workunit.client.0.smithi078.stdout:7/72: truncate d0/d11/fe 661385 0 2024-09-11T00:17:44.092 INFO:tasks.workunit.client.0.smithi078.stdout:1/101: getdents d3/d4 0 2024-09-11T00:17:44.094 INFO:tasks.workunit.client.0.smithi078.stdout:7/73: dwrite d0/f4 [0,4194304] 0 2024-09-11T00:17:44.107 INFO:tasks.workunit.client.0.smithi078.stdout:3/77: mkdir d0/d1a 0 2024-09-11T00:17:44.112 INFO:tasks.workunit.client.0.smithi078.stdout:4/72: creat dc/d10/f13 x:0 0 0 2024-09-11T00:17:44.127 INFO:tasks.workunit.client.0.smithi078.stdout:2/93: mknod d0/d1/c18 0 2024-09-11T00:17:44.135 INFO:tasks.workunit.client.0.smithi078.stdout:6/58: mkdir d0/d1/d9/d17 0 2024-09-11T00:17:44.135 INFO:tasks.workunit.client.0.smithi078.stdout:6/59: fdatasync d0/fc 0 2024-09-11T00:17:44.135 INFO:tasks.workunit.client.0.smithi078.stdout:6/60: chown d0/l13 378382722 1 2024-09-11T00:17:44.180 INFO:tasks.workunit.client.0.smithi078.stdout:9/47: unlink l1 0 2024-09-11T00:17:44.186 INFO:tasks.workunit.client.0.smithi078.stdout:0/77: link d2/d3/d7/dc/le d2/d3/d7/dc/l17 0 2024-09-11T00:17:44.206 INFO:tasks.workunit.client.0.smithi078.stdout:8/67: mkdir da/d13 0 2024-09-11T00:17:44.222 INFO:tasks.workunit.client.0.smithi078.stdout:8/68: dwrite f6 [0,4194304] 0 2024-09-11T00:17:44.233 INFO:tasks.workunit.client.0.smithi078.stdout:1/102: creat d3/d4/f18 x:0 0 0 2024-09-11T00:17:44.233 INFO:tasks.workunit.client.0.smithi078.stdout:1/103: fdatasync d3/d4/f12 0 2024-09-11T00:17:44.236 INFO:tasks.workunit.client.0.smithi078.stdout:7/74: creat d0/d11/f13 x:0 0 0 2024-09-11T00:17:44.248 INFO:tasks.workunit.client.0.smithi078.stdout:1/104: dwrite d3/d4/db/ff [0,4194304] 0 2024-09-11T00:17:44.253 INFO:tasks.workunit.client.0.smithi078.stdout:3/78: rename d0/d13 to d0/d7/d18/d1b 0 2024-09-11T00:17:44.259 INFO:tasks.workunit.client.0.smithi078.stdout:4/73: creat dc/d10/f14 x:0 0 0 2024-09-11T00:17:44.276 INFO:tasks.workunit.client.0.smithi078.stdout:5/59: sync 2024-09-11T00:17:44.279 INFO:tasks.workunit.client.0.smithi078.stdout:6/61: creat d0/d1/f18 x:0 0 0 2024-09-11T00:17:44.280 INFO:tasks.workunit.client.0.smithi078.stdout:6/62: dread - d0/d1/d9/f16 zero size 2024-09-11T00:17:44.280 INFO:tasks.workunit.client.0.smithi078.stdout:6/63: readlink d0/d1/lf 0 2024-09-11T00:17:44.280 INFO:tasks.workunit.client.0.smithi078.stdout:6/64: chown d0/l13 21896157 1 2024-09-11T00:17:44.317 INFO:tasks.workunit.client.0.smithi078.stdout:9/48: creat dc/de/f11 x:0 0 0 2024-09-11T00:17:44.326 INFO:tasks.workunit.client.0.smithi078.stdout:0/78: link d2/d3/c10 d2/d3/d7/c18 0 2024-09-11T00:17:44.335 INFO:tasks.workunit.client.0.smithi078.stdout:0/79: write d2/d3/d7/f13 [3705041,120104] 0 2024-09-11T00:17:44.350 INFO:tasks.workunit.client.0.smithi078.stdout:8/69: link f7 da/f14 0 2024-09-11T00:17:44.363 INFO:tasks.workunit.client.0.smithi078.stdout:7/75: mkdir d0/d11/d14 0 2024-09-11T00:17:44.375 INFO:tasks.workunit.client.0.smithi078.stdout:1/105: creat d3/d4/f19 x:0 0 0 2024-09-11T00:17:44.379 INFO:tasks.workunit.client.0.smithi078.stdout:3/79: rmdir d0/db 39 2024-09-11T00:17:44.379 INFO:tasks.workunit.client.0.smithi078.stdout:3/80: dread - d0/f10 zero size 2024-09-11T00:17:44.385 INFO:tasks.workunit.client.0.smithi078.stdout:4/74: creat dc/d10/f15 x:0 0 0 2024-09-11T00:17:44.400 INFO:tasks.workunit.client.0.smithi078.stdout:2/94: truncate d0/d1/d8/f12 1184129 0 2024-09-11T00:17:44.402 INFO:tasks.workunit.client.0.smithi078.stdout:5/60: symlink d7/d8/d9/l14 0 2024-09-11T00:17:44.402 INFO:tasks.workunit.client.0.smithi078.stdout:5/61: write d7/d8/de/f11 [588994,59168] 0 2024-09-11T00:17:44.406 INFO:tasks.workunit.client.0.smithi078.stdout:6/65: symlink d0/d1/d9/d17/l19 0 2024-09-11T00:17:44.406 INFO:tasks.workunit.client.0.smithi078.stdout:6/66: write d0/d1/d9/f15 [1604383,16365] 0 2024-09-11T00:17:44.443 INFO:tasks.workunit.client.0.smithi078.stdout:9/49: rmdir dc 39 2024-09-11T00:17:44.462 INFO:tasks.workunit.client.0.smithi078.stdout:0/80: mknod d2/c19 0 2024-09-11T00:17:44.462 INFO:tasks.workunit.client.0.smithi078.stdout:0/81: truncate d2/d3/d7/fa 2337575 0 2024-09-11T00:17:44.462 INFO:tasks.workunit.client.0.smithi078.stdout:0/82: write d2/f16 [635457,127948] 0 2024-09-11T00:17:44.476 INFO:tasks.workunit.client.0.smithi078.stdout:8/70: mknod da/c15 0 2024-09-11T00:17:44.508 INFO:tasks.workunit.client.0.smithi078.stdout:3/81: symlink d0/db/l1c 0 2024-09-11T00:17:44.509 INFO:tasks.workunit.client.0.smithi078.stdout:3/82: dread d0/d7/fd [0,4194304] 0 2024-09-11T00:17:44.509 INFO:tasks.workunit.client.0.smithi078.stdout:3/83: chown d0/d7/fd 5880 1 2024-09-11T00:17:44.509 INFO:tasks.workunit.client.0.smithi078.stdout:3/84: stat d0/c4 0 2024-09-11T00:17:44.509 INFO:tasks.workunit.client.0.smithi078.stdout:3/85: fdatasync d0/f8 0 2024-09-11T00:17:44.513 INFO:tasks.workunit.client.0.smithi078.stdout:4/75: mknod dc/c16 0 2024-09-11T00:17:44.513 INFO:tasks.workunit.client.0.smithi078.stdout:4/76: truncate dc/f11 383959 0 2024-09-11T00:17:44.514 INFO:tasks.workunit.client.0.smithi078.stdout:4/77: dread dc/f11 [0,4194304] 0 2024-09-11T00:17:44.514 INFO:tasks.workunit.client.0.smithi078.stdout:4/78: chown dc/fe 2 1 2024-09-11T00:17:44.514 INFO:tasks.workunit.client.0.smithi078.stdout:4/79: chown dc/fe 52995241 1 2024-09-11T00:17:44.516 INFO:tasks.workunit.client.0.smithi078.stdout:3/86: dread d0/f3 [0,4194304] 0 2024-09-11T00:17:44.527 INFO:tasks.workunit.client.0.smithi078.stdout:2/95: mkdir d0/d19 0 2024-09-11T00:17:44.527 INFO:tasks.workunit.client.0.smithi078.stdout:2/96: write d0/fc [823228,60190] 0 2024-09-11T00:17:44.527 INFO:tasks.workunit.client.0.smithi078.stdout:2/97: stat d0/d1/d8/f12 0 2024-09-11T00:17:44.529 INFO:tasks.workunit.client.0.smithi078.stdout:3/87: dwrite d0/d7/fd [0,4194304] 0 2024-09-11T00:17:44.534 INFO:tasks.workunit.client.0.smithi078.stdout:6/67: creat d0/f1a x:0 0 0 2024-09-11T00:17:44.534 INFO:tasks.workunit.client.0.smithi078.stdout:6/68: truncate d0/d1/d9/f16 704797 0 2024-09-11T00:17:44.539 INFO:tasks.workunit.client.0.smithi078.stdout:3/88: dread d0/d7/d18/f19 [0,4194304] 0 2024-09-11T00:17:44.568 INFO:tasks.workunit.client.0.smithi078.stdout:9/50: truncate f7 8207246 0 2024-09-11T00:17:44.576 INFO:tasks.workunit.client.0.smithi078.stdout:7/76: sync 2024-09-11T00:17:44.602 INFO:tasks.workunit.client.0.smithi078.stdout:8/71: truncate f4 2957252 0 2024-09-11T00:17:44.627 INFO:tasks.workunit.client.0.smithi078.stdout:1/106: rename d3/d4/db to d3/d1a 0 2024-09-11T00:17:44.634 INFO:tasks.workunit.client.0.smithi078.stdout:4/80: fsync f6 0 2024-09-11T00:17:44.634 INFO:tasks.workunit.client.0.smithi078.stdout:4/81: chown dc/d10/f12 4036232 1 2024-09-11T00:17:44.646 INFO:tasks.workunit.client.0.smithi078.stdout:2/98: creat d0/d19/f1a x:0 0 0 2024-09-11T00:17:44.655 INFO:tasks.workunit.client.0.smithi078.stdout:6/69: mkdir d0/d1/d1b 0 2024-09-11T00:17:44.655 INFO:tasks.workunit.client.0.smithi078.stdout:6/70: chown d0/d1/d9/f15 816755 1 2024-09-11T00:17:44.659 INFO:tasks.workunit.client.0.smithi078.stdout:3/89: mknod d0/d7/d18/d1b/c1d 0 2024-09-11T00:17:44.662 INFO:tasks.workunit.client.0.smithi078.stdout:0/83: sync 2024-09-11T00:17:44.678 INFO:tasks.workunit.client.0.smithi078.stdout:9/51: rename dc/de to dc/d12 0 2024-09-11T00:17:44.685 INFO:tasks.workunit.client.0.smithi078.stdout:7/77: creat d0/df/db/f15 x:0 0 0 2024-09-11T00:17:44.704 INFO:tasks.workunit.client.0.smithi078.stdout:8/72: mknod da/d13/c16 0 2024-09-11T00:17:44.704 INFO:tasks.workunit.client.0.smithi078.stdout:8/73: readlink l8 0 2024-09-11T00:17:44.709 INFO:tasks.workunit.client.0.smithi078.stdout:8/74: write f7 [339822,91529] 0 2024-09-11T00:17:44.710 INFO:tasks.workunit.client.0.smithi078.stdout:8/75: truncate f7 4535512 0 2024-09-11T00:17:44.719 INFO:tasks.workunit.client.0.smithi078.stdout:5/62: rename d7/d8/cc to d7/c15 0 2024-09-11T00:17:44.720 INFO:tasks.workunit.client.0.smithi078.stdout:1/107: symlink d3/d1a/l1b 0 2024-09-11T00:17:44.748 INFO:tasks.workunit.client.0.smithi078.stdout:2/99: mkdir d0/d1/d11/d1b 0 2024-09-11T00:17:44.756 INFO:tasks.workunit.client.0.smithi078.stdout:6/71: creat d0/d1/d9/d17/f1c x:0 0 0 2024-09-11T00:17:44.761 INFO:tasks.workunit.client.0.smithi078.stdout:3/90: mkdir d0/d1a/d1e 0 2024-09-11T00:17:44.765 INFO:tasks.workunit.client.0.smithi078.stdout:0/84: truncate d2/d3/d7/f13 3814300 0 2024-09-11T00:17:44.768 INFO:tasks.workunit.client.0.smithi078.stdout:0/85: read d2/f4 [239816,43024] 0 2024-09-11T00:17:44.774 INFO:tasks.workunit.client.0.smithi078.stdout:6/72: dwrite d0/f11 [0,4194304] 0 2024-09-11T00:17:44.774 INFO:tasks.workunit.client.0.smithi078.stdout:6/73: fdatasync d0/d1/d9/f16 0 2024-09-11T00:17:44.780 INFO:tasks.workunit.client.0.smithi078.stdout:6/74: write d0/f10 [755074,56591] 0 2024-09-11T00:17:44.792 INFO:tasks.workunit.client.0.smithi078.stdout:9/52: getdents dc 0 2024-09-11T00:17:44.806 INFO:tasks.workunit.client.0.smithi078.stdout:9/53: dwrite fa [0,4194304] 0 2024-09-11T00:17:44.813 INFO:tasks.workunit.client.0.smithi078.stdout:9/54: dread f4 [0,4194304] 0 2024-09-11T00:17:44.840 INFO:tasks.workunit.client.0.smithi078.stdout:8/76: creat da/f17 x:0 0 0 2024-09-11T00:17:44.859 INFO:tasks.workunit.client.0.smithi078.stdout:5/63: symlink d7/d8/l16 0 2024-09-11T00:17:44.860 INFO:tasks.workunit.client.0.smithi078.stdout:1/108: creat d3/f1c x:0 0 0 2024-09-11T00:17:44.860 INFO:tasks.workunit.client.0.smithi078.stdout:1/109: write d3/d1a/ff [4984814,40551] 0 2024-09-11T00:17:44.865 INFO:tasks.workunit.client.0.smithi078.stdout:1/110: dread d3/d4/f8 [0,4194304] 0 2024-09-11T00:17:44.876 INFO:tasks.workunit.client.0.smithi078.stdout:4/82: truncate dc/fe 6210699 0 2024-09-11T00:17:44.876 INFO:tasks.workunit.client.0.smithi078.stdout:4/83: truncate dc/ff 81577 0 2024-09-11T00:17:44.877 INFO:tasks.workunit.client.0.smithi078.stdout:1/111: dwrite d3/f1c [0,4194304] 0 2024-09-11T00:17:44.899 INFO:tasks.workunit.client.0.smithi078.stdout:7/78: sync 2024-09-11T00:17:44.899 INFO:tasks.workunit.client.0.smithi078.stdout:2/100: creat d0/f1c x:0 0 0 2024-09-11T00:17:44.933 INFO:tasks.workunit.client.0.smithi078.stdout:3/91: creat d0/f1f x:0 0 0 2024-09-11T00:17:44.940 INFO:tasks.workunit.client.0.smithi078.stdout:0/86: creat d2/d3/d7/dc/f1a x:0 0 0 2024-09-11T00:17:44.940 INFO:tasks.workunit.client.0.smithi078.stdout:0/87: truncate d2/d3/d7/fa 2406818 0 2024-09-11T00:17:44.963 INFO:tasks.workunit.client.0.smithi078.stdout:6/75: getdents d0/d1 0 2024-09-11T00:17:44.977 INFO:tasks.workunit.client.0.smithi078.stdout:6/76: dwrite d0/f1a [0,4194304] 0 2024-09-11T00:17:45.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:44 smithi138 ceph-mon[35019]: pgmap v361: 97 pgs: 97 active+clean; 170 MiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 12 MiB/s wr, 680 op/s 2024-09-11T00:17:45.075 INFO:tasks.workunit.client.0.smithi078.stdout:8/77: mknod da/c18 0 2024-09-11T00:17:45.075 INFO:tasks.workunit.client.0.smithi078.stdout:8/78: write da/fe [616121,60235] 0 2024-09-11T00:17:45.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:44 smithi078 ceph-mon[30865]: pgmap v361: 97 pgs: 97 active+clean; 170 MiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 12 MiB/s wr, 680 op/s 2024-09-11T00:17:45.108 INFO:tasks.workunit.client.0.smithi078.stdout:5/64: rename d7/d8/d9/cd to d7/d8/d13/c17 0 2024-09-11T00:17:45.144 INFO:tasks.workunit.client.0.smithi078.stdout:4/84: truncate dc/fd 2792662 0 2024-09-11T00:17:45.177 INFO:tasks.workunit.client.0.smithi078.stdout:7/79: creat d0/d11/d14/f16 x:0 0 0 2024-09-11T00:17:45.178 INFO:tasks.workunit.client.0.smithi078.stdout:2/101: creat d0/d1/d8/f1d x:0 0 0 2024-09-11T00:17:45.178 INFO:tasks.workunit.client.0.smithi078.stdout:2/102: chown d0/d1/d8/f12 125 1 2024-09-11T00:17:45.178 INFO:tasks.workunit.client.0.smithi078.stdout:7/80: dread d0/d11/fe [0,4194304] 0 2024-09-11T00:17:45.191 INFO:tasks.workunit.client.0.smithi078.stdout:7/81: dwrite d0/df/db/f15 [0,4194304] 0 2024-09-11T00:17:45.208 INFO:tasks.workunit.client.0.smithi078.stdout:7/82: dwrite d0/d11/d14/f16 [0,4194304] 0 2024-09-11T00:17:45.226 INFO:tasks.workunit.client.0.smithi078.stdout:0/88: creat d2/d3/f1b x:0 0 0 2024-09-11T00:17:45.226 INFO:tasks.workunit.client.0.smithi078.stdout:0/89: dread - d2/d3/d7/f14 zero size 2024-09-11T00:17:45.226 INFO:tasks.workunit.client.0.smithi078.stdout:0/90: readlink d2/d3/d7/dc/l17 0 2024-09-11T00:17:45.228 INFO:tasks.workunit.client.0.smithi078.stdout:0/91: dread d2/f4 [0,4194304] 0 2024-09-11T00:17:45.231 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:44 smithi112 ceph-mon[35627]: pgmap v361: 97 pgs: 97 active+clean; 170 MiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 12 MiB/s wr, 680 op/s 2024-09-11T00:17:45.244 INFO:tasks.workunit.client.0.smithi078.stdout:0/92: dwrite d2/d3/d7/f13 [0,4194304] 0 2024-09-11T00:17:45.264 INFO:tasks.workunit.client.0.smithi078.stdout:6/77: mknod d0/d1/d1b/c1d 0 2024-09-11T00:17:45.264 INFO:tasks.workunit.client.0.smithi078.stdout:6/78: write d0/d1/f2 [5175094,125051] 0 2024-09-11T00:17:45.317 INFO:tasks.workunit.client.0.smithi078.stdout:9/55: unlink l6 0 2024-09-11T00:17:45.334 INFO:tasks.workunit.client.0.smithi078.stdout:9/56: dwrite f7 [4194304,4194304] 0 2024-09-11T00:17:45.335 INFO:tasks.workunit.client.0.smithi078.stdout:9/57: write f2 [1117103,97414] 0 2024-09-11T00:17:45.335 INFO:tasks.workunit.client.0.smithi078.stdout:9/58: truncate dc/d12/f11 941396 0 2024-09-11T00:17:45.347 INFO:tasks.workunit.client.0.smithi078.stdout:9/59: dread f7 [4194304,4194304] 0 2024-09-11T00:17:45.363 INFO:tasks.workunit.client.0.smithi078.stdout:9/60: dwrite f4 [0,4194304] 0 2024-09-11T00:17:45.374 INFO:tasks.workunit.client.0.smithi078.stdout:8/79: mkdir da/d13/d19 0 2024-09-11T00:17:45.389 INFO:tasks.workunit.client.0.smithi078.stdout:8/80: dwrite da/f12 [0,4194304] 0 2024-09-11T00:17:45.397 INFO:tasks.workunit.client.0.smithi078.stdout:8/81: write f6 [2764560,125677] 0 2024-09-11T00:17:45.397 INFO:tasks.workunit.client.0.smithi078.stdout:8/82: read da/fe [166812,31973] 0 2024-09-11T00:17:45.411 INFO:tasks.workunit.client.0.smithi078.stdout:3/92: rename d0/db/l1c to d0/d7/d18/d1b/l20 0 2024-09-11T00:17:45.411 INFO:tasks.workunit.client.0.smithi078.stdout:3/93: chown d0/db 54383519 1 2024-09-11T00:17:45.412 INFO:tasks.workunit.client.0.smithi078.stdout:5/65: symlink d7/d8/de/l18 0 2024-09-11T00:17:45.412 INFO:tasks.workunit.client.0.smithi078.stdout:5/66: chown d7/d8/d9/l14 307767513 1 2024-09-11T00:17:45.412 INFO:tasks.workunit.client.0.smithi078.stdout:5/67: chown d7/d8/l16 248319656 1 2024-09-11T00:17:45.418 INFO:tasks.workunit.client.0.smithi078.stdout:5/68: write d7/d8/de/ff [678276,120502] 0 2024-09-11T00:17:45.421 INFO:tasks.workunit.client.0.smithi078.stdout:3/94: read d0/d7/d18/f19 [853231,97660] 0 2024-09-11T00:17:45.471 INFO:tasks.workunit.client.0.smithi078.stdout:4/85: mkdir dc/d17 0 2024-09-11T00:17:45.471 INFO:tasks.workunit.client.0.smithi078.stdout:4/86: write dc/fd [9167,94528] 0 2024-09-11T00:17:45.471 INFO:tasks.workunit.client.0.smithi078.stdout:4/87: dread - dc/d10/f15 zero size 2024-09-11T00:17:45.475 INFO:tasks.workunit.client.0.smithi078.stdout:1/112: mknod d3/c1d 0 2024-09-11T00:17:45.525 INFO:tasks.workunit.client.0.smithi078.stdout:2/103: mkdir d0/d1/d11/d1b/d1e 0 2024-09-11T00:17:45.576 INFO:tasks.workunit.client.0.smithi078.stdout:7/83: creat d0/d11/f17 x:0 0 0 2024-09-11T00:17:45.578 INFO:tasks.workunit.client.0.smithi078.stdout:7/84: dread d0/d11/fe [0,4194304] 0 2024-09-11T00:17:45.587 INFO:tasks.workunit.client.0.smithi078.stdout:7/85: read d0/d11/d14/f16 [3906567,11] 0 2024-09-11T00:17:45.589 INFO:tasks.workunit.client.0.smithi078.stdout:7/86: dread d0/d11/fe [0,4194304] 0 2024-09-11T00:17:45.589 INFO:tasks.workunit.client.0.smithi078.stdout:7/87: rename d0/df/db to d0/df/db/d18 22 2024-09-11T00:17:45.589 INFO:tasks.workunit.client.0.smithi078.stdout:7/88: write d0/d11/fe [1289896,42714] 0 2024-09-11T00:17:45.590 INFO:tasks.workunit.client.0.smithi078.stdout:7/89: stat d0/df/db/f15 0 2024-09-11T00:17:45.628 INFO:tasks.workunit.client.0.smithi078.stdout:0/93: creat d2/d3/d7/dc/f1c x:0 0 0 2024-09-11T00:17:45.866 INFO:tasks.workunit.client.0.smithi078.stdout:3/95: mknod d0/db/c21 0 2024-09-11T00:17:45.866 INFO:tasks.workunit.client.0.smithi078.stdout:3/96: truncate d0/f6 4602882 0 2024-09-11T00:17:45.866 INFO:tasks.workunit.client.0.smithi078.stdout:3/97: write d0/f1f [452953,123138] 0 2024-09-11T00:17:45.866 INFO:tasks.workunit.client.0.smithi078.stdout:3/98: chown d0/d7/fe 2 1 2024-09-11T00:17:45.866 INFO:tasks.workunit.client.0.smithi078.stdout:3/99: write d0/d7/fe [4456762,42636] 0 2024-09-11T00:17:45.866 INFO:tasks.workunit.client.0.smithi078.stdout:3/100: chown d0/d7/cf 23 1 2024-09-11T00:17:45.951 INFO:tasks.workunit.client.0.smithi078.stdout:1/113: creat d3/f1e x:0 0 0 2024-09-11T00:17:46.120 INFO:tasks.workunit.client.0.smithi078.stdout:7/90: unlink d0/c8 0 2024-09-11T00:17:46.136 INFO:tasks.workunit.client.0.smithi078.stdout:7/91: dwrite d0/d11/fe [0,4194304] 0 2024-09-11T00:17:46.252 INFO:tasks.workunit.client.0.smithi078.stdout:6/79: symlink d0/l1e 0 2024-09-11T00:17:46.253 INFO:tasks.workunit.client.0.smithi078.stdout:6/80: read d0/d1/d9/f15 [1496546,34697] 0 2024-09-11T00:17:46.416 INFO:tasks.workunit.client.0.smithi078.stdout:9/61: truncate f2 746093 0 2024-09-11T00:17:46.499 INFO:tasks.workunit.client.0.smithi078.stdout:8/83: truncate da/f12 3748283 0 2024-09-11T00:17:46.507 INFO:tasks.workunit.client.0.smithi078.stdout:5/69: sync 2024-09-11T00:17:46.508 INFO:tasks.workunit.client.0.smithi078.stdout:2/104: sync 2024-09-11T00:17:46.508 INFO:tasks.workunit.client.0.smithi078.stdout:0/94: sync 2024-09-11T00:17:46.512 INFO:tasks.workunit.client.0.smithi078.stdout:5/70: dread d7/d8/de/f10 [0,4194304] 0 2024-09-11T00:17:46.512 INFO:tasks.workunit.client.0.smithi078.stdout:5/71: readlink d7/d8/l16 0 2024-09-11T00:17:46.512 INFO:tasks.workunit.client.0.smithi078.stdout:5/72: truncate d7/d8/d9/fb 389144 0 2024-09-11T00:17:46.516 INFO:tasks.workunit.client.0.smithi078.stdout:8/84: dwrite f6 [0,4194304] 0 2024-09-11T00:17:46.523 INFO:tasks.workunit.client.0.smithi078.stdout:8/85: write f6 [2256392,96119] 0 2024-09-11T00:17:46.544 INFO:tasks.workunit.client.0.smithi078.stdout:3/101: unlink d0/d7/d18/f19 0 2024-09-11T00:17:46.639 INFO:tasks.workunit.client.0.smithi078.stdout:4/88: unlink f4 0 2024-09-11T00:17:46.639 INFO:tasks.workunit.client.0.smithi078.stdout:4/89: write dc/d10/f13 [374656,33922] 0 2024-09-11T00:17:46.684 INFO:tasks.workunit.client.0.smithi078.stdout:1/114: sync 2024-09-11T00:17:46.690 INFO:tasks.workunit.client.0.smithi078.stdout:1/115: dread d3/f1c [0,4194304] 0 2024-09-11T00:17:46.918 INFO:tasks.workunit.client.0.smithi078.stdout:7/92: symlink d0/l19 0 2024-09-11T00:17:46.965 INFO:tasks.workunit.client.0.smithi078.stdout:7/93: dwrite d0/d11/d14/f16 [0,4194304] 0 2024-09-11T00:17:46.974 INFO:tasks.workunit.client.0.smithi078.stdout:7/94: dread d0/d11/fe [0,4194304] 0 2024-09-11T00:17:47.024 INFO:tasks.workunit.client.0.smithi078.stdout:6/81: link d0/d1/d9/f15 d0/d1/f1f 0 2024-09-11T00:17:47.026 INFO:tasks.workunit.client.0.smithi078.stdout:6/82: dread d0/d1/f1f [0,4194304] 0 2024-09-11T00:17:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:46 smithi138 ceph-mon[35019]: pgmap v362: 97 pgs: 97 active+clean; 241 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 21 MiB/s wr, 613 op/s 2024-09-11T00:17:47.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:46 smithi078 ceph-mon[30865]: pgmap v362: 97 pgs: 97 active+clean; 241 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 21 MiB/s wr, 613 op/s 2024-09-11T00:17:47.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:46 smithi112 ceph-mon[35627]: pgmap v362: 97 pgs: 97 active+clean; 241 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 21 MiB/s wr, 613 op/s 2024-09-11T00:17:47.328 INFO:tasks.workunit.client.0.smithi078.stdout:2/105: creat d0/d1/f1f x:0 0 0 2024-09-11T00:17:47.329 INFO:tasks.workunit.client.0.smithi078.stdout:0/95: creat d2/f1d x:0 0 0 2024-09-11T00:17:47.329 INFO:tasks.workunit.client.0.smithi078.stdout:0/96: dread - d2/f1d zero size 2024-09-11T00:17:47.348 INFO:tasks.workunit.client.0.smithi078.stdout:8/86: creat da/d13/d19/f1a x:0 0 0 2024-09-11T00:17:47.353 INFO:tasks.workunit.client.0.smithi078.stdout:8/87: dread f4 [0,4194304] 0 2024-09-11T00:17:47.424 INFO:tasks.workunit.client.0.smithi078.stdout:5/73: sync 2024-09-11T00:17:47.425 INFO:tasks.workunit.client.0.smithi078.stdout:3/102: sync 2024-09-11T00:17:47.425 INFO:tasks.workunit.client.0.smithi078.stdout:5/74: stat d7/d8/d13 0 2024-09-11T00:17:47.425 INFO:tasks.workunit.client.0.smithi078.stdout:9/62: sync 2024-09-11T00:17:47.543 INFO:tasks.workunit.client.0.smithi078.stdout:4/90: sync 2024-09-11T00:17:47.640 INFO:tasks.workunit.client.0.smithi078.stdout:1/116: dwrite d3/fc [0,4194304] 0 2024-09-11T00:17:48.030 INFO:tasks.workunit.client.0.smithi078.stdout:7/95: mkdir d0/d11/d1a 0 2024-09-11T00:17:48.106 INFO:tasks.workunit.client.0.smithi078.stdout:6/83: mknod d0/d1/c20 0 2024-09-11T00:17:48.590 INFO:tasks.workunit.client.0.smithi078.stdout:2/106: creat d0/d1/d11/d1b/f20 x:0 0 0 2024-09-11T00:17:48.590 INFO:tasks.workunit.client.0.smithi078.stdout:2/107: chown d0/d1/d11/d1b 722 1 2024-09-11T00:17:48.590 INFO:tasks.workunit.client.0.smithi078.stdout:2/108: fdatasync d0/d1/f1f 0 2024-09-11T00:17:48.590 INFO:tasks.workunit.client.0.smithi078.stdout:2/109: write d0/d1/d6/f16 [300238,4291] 0 2024-09-11T00:17:48.591 INFO:tasks.workunit.client.0.smithi078.stdout:0/97: symlink d2/l1e 0 2024-09-11T00:17:48.598 INFO:tasks.workunit.client.0.smithi078.stdout:2/110: read d0/d1/d6/f9 [2344472,45163] 0 2024-09-11T00:17:48.608 INFO:tasks.workunit.client.0.smithi078.stdout:0/98: dwrite d2/f16 [0,4194304] 0 2024-09-11T00:17:48.608 INFO:tasks.workunit.client.0.smithi078.stdout:0/99: fsync d2/d3/d7/f15 0 2024-09-11T00:17:48.622 INFO:tasks.workunit.client.0.smithi078.stdout:0/100: dwrite d2/d3/d7/fa [0,4194304] 0 2024-09-11T00:17:48.623 INFO:tasks.workunit.client.0.smithi078.stdout:0/101: write d2/d3/d7/f15 [425641,106487] 0 2024-09-11T00:17:48.643 INFO:tasks.workunit.client.0.smithi078.stdout:8/88: mkdir da/d13/d1b 0 2024-09-11T00:17:48.643 INFO:tasks.workunit.client.0.smithi078.stdout:8/89: fdatasync f2 0 2024-09-11T00:17:48.776 INFO:tasks.workunit.client.0.smithi078.stdout:3/103: creat d0/db/f22 x:0 0 0 2024-09-11T00:17:48.776 INFO:tasks.workunit.client.0.smithi078.stdout:5/75: creat d7/d8/de/f19 x:0 0 0 2024-09-11T00:17:48.777 INFO:tasks.workunit.client.0.smithi078.stdout:5/76: truncate d7/d8/de/ff 2084411 0 2024-09-11T00:17:48.777 INFO:tasks.workunit.client.0.smithi078.stdout:5/77: chown d7/d8/l16 1 1 2024-09-11T00:17:49.016 INFO:tasks.workunit.client.0.smithi078.stdout:4/91: unlink l7 0 2024-09-11T00:17:49.042 INFO:tasks.workunit.client.0.smithi078.stdout:9/63: sync 2024-09-11T00:17:49.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:48 smithi138 ceph-mon[35019]: pgmap v363: 97 pgs: 97 active+clean; 268 MiB data, 723 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 25 MiB/s wr, 397 op/s 2024-09-11T00:17:49.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:48 smithi078 ceph-mon[30865]: pgmap v363: 97 pgs: 97 active+clean; 268 MiB data, 723 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 25 MiB/s wr, 397 op/s 2024-09-11T00:17:49.202 INFO:tasks.workunit.client.0.smithi078.stdout:1/117: unlink d3/d4/ce 0 2024-09-11T00:17:49.202 INFO:tasks.workunit.client.0.smithi078.stdout:1/118: read f2 [3225288,130062] 0 2024-09-11T00:17:49.231 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:48 smithi112 ceph-mon[35627]: pgmap v363: 97 pgs: 97 active+clean; 268 MiB data, 723 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 25 MiB/s wr, 397 op/s 2024-09-11T00:17:49.873 INFO:tasks.workunit.client.0.smithi078.stdout:7/96: mkdir d0/df/db/d1b 0 2024-09-11T00:17:49.874 INFO:tasks.workunit.client.0.smithi078.stdout:7/97: readlink d0/d11/l10 0 2024-09-11T00:17:49.874 INFO:tasks.workunit.client.0.smithi078.stdout:7/98: dread - d0/d11/f13 zero size 2024-09-11T00:17:49.883 INFO:tasks.workunit.client.0.smithi078.stdout:7/99: dwrite d0/df/db/f15 [0,4194304] 0 2024-09-11T00:17:50.047 INFO:tasks.workunit.client.0.smithi078.stdout:6/84: link d0/f1a d0/d1/d1b/f21 0 2024-09-11T00:17:50.048 INFO:tasks.workunit.client.0.smithi078.stdout:6/85: dread d0/d1/d9/f16 [0,4194304] 0 2024-09-11T00:17:50.965 INFO:tasks.workunit.client.0.smithi078.stdout:2/111: getdents d0/d1/d6 0 2024-09-11T00:17:51.009 INFO:tasks.workunit.client.0.smithi078.stdout:0/102: creat d2/d3/d7/dc/f1f x:0 0 0 2024-09-11T00:17:51.035 INFO:tasks.workunit.client.0.smithi078.stdout:8/90: getdents da/d13/d19 0 2024-09-11T00:17:51.041 INFO:tasks.workunit.client.0.smithi078.stdout:8/91: dread f7 [0,4194304] 0 2024-09-11T00:17:51.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:50 smithi138 ceph-mon[35019]: pgmap v364: 97 pgs: 97 active+clean; 317 MiB data, 759 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 35 MiB/s wr, 495 op/s 2024-09-11T00:17:51.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:50 smithi078 ceph-mon[30865]: pgmap v364: 97 pgs: 97 active+clean; 317 MiB data, 759 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 35 MiB/s wr, 495 op/s 2024-09-11T00:17:51.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:50 smithi112 ceph-mon[35627]: pgmap v364: 97 pgs: 97 active+clean; 317 MiB data, 759 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 35 MiB/s wr, 495 op/s 2024-09-11T00:17:51.283 INFO:tasks.workunit.client.0.smithi078.stdout:3/104: mkdir d0/d7/d23 0 2024-09-11T00:17:51.283 INFO:tasks.workunit.client.0.smithi078.stdout:3/105: fdatasync d0/d7/fd 0 2024-09-11T00:17:51.283 INFO:tasks.workunit.client.0.smithi078.stdout:3/106: readlink d0/d7/l15 0 2024-09-11T00:17:51.295 INFO:tasks.workunit.client.0.smithi078.stdout:3/107: dwrite d0/d7/fe [0,4194304] 0 2024-09-11T00:17:51.295 INFO:tasks.workunit.client.0.smithi078.stdout:3/108: chown d0/db/f22 7743869 1 2024-09-11T00:17:51.311 INFO:tasks.workunit.client.0.smithi078.stdout:3/109: dwrite d0/f6 [0,4194304] 0 2024-09-11T00:17:51.311 INFO:tasks.workunit.client.0.smithi078.stdout:3/110: write d0/f6 [4410208,15951] 0 2024-09-11T00:17:51.422 INFO:tasks.workunit.client.0.smithi078.stdout:5/78: sync 2024-09-11T00:17:51.437 INFO:tasks.workunit.client.0.smithi078.stdout:5/79: dwrite d7/d8/de/ff [0,4194304] 0 2024-09-11T00:17:51.477 INFO:tasks.workunit.client.0.smithi078.stdout:4/92: stat dc/d10/f14 0 2024-09-11T00:17:51.489 INFO:tasks.workunit.client.0.smithi078.stdout:9/64: creat dc/d12/f13 x:0 0 0 2024-09-11T00:17:51.609 INFO:tasks.workunit.client.0.smithi078.stdout:1/119: link d3/d1a/ff d3/d4/f1f 0 2024-09-11T00:17:52.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:51 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:17:52.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:51 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:17:52.094 INFO:tasks.workunit.client.0.smithi078.stdout:7/100: stat d0/df/db/cc 0 2024-09-11T00:17:52.095 INFO:tasks.workunit.client.0.smithi078.stdout:7/101: write d0/df/db/f15 [5139315,82967] 0 2024-09-11T00:17:52.095 INFO:tasks.workunit.client.0.smithi078.stdout:7/102: write d0/d11/d14/f16 [4625772,119272] 0 2024-09-11T00:17:52.187 INFO:tasks.workunit.client.0.smithi078.stdout:6/86: truncate d0/f10 3677245 0 2024-09-11T00:17:52.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:51 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:17:52.868 INFO:tasks.workunit.client.0.smithi078.stdout:2/112: rename d0/d1/d6/f9 to d0/d1/d8/f21 0 2024-09-11T00:17:52.868 INFO:tasks.workunit.client.0.smithi078.stdout:2/113: dread - d0/fd zero size 2024-09-11T00:17:52.868 INFO:tasks.workunit.client.0.smithi078.stdout:2/114: chown d0/fc 76968923 1 2024-09-11T00:17:52.873 INFO:tasks.workunit.client.0.smithi078.stdout:2/115: write d0/d1/f4 [2813618,93033] 0 2024-09-11T00:17:52.873 INFO:tasks.workunit.client.0.smithi078.stdout:2/116: write d0/d1/d8/f1d [887669,9482] 0 2024-09-11T00:17:52.874 INFO:tasks.workunit.client.0.smithi078.stdout:2/117: dread d0/d1/fe [0,4194304] 0 2024-09-11T00:17:52.885 INFO:tasks.workunit.client.0.smithi078.stdout:2/118: dwrite d0/fd [0,4194304] 0 2024-09-11T00:17:52.886 INFO:tasks.workunit.client.0.smithi078.stdout:0/103: mknod d2/d3/d7/dc/c20 0 2024-09-11T00:17:52.886 INFO:tasks.workunit.client.0.smithi078.stdout:0/104: readlink d2/d3/d7/dc/le 0 2024-09-11T00:17:52.886 INFO:tasks.workunit.client.0.smithi078.stdout:0/105: read d2/f4 [306272,44752] 0 2024-09-11T00:17:52.895 INFO:tasks.workunit.client.0.smithi078.stdout:8/92: mkdir da/d1c 0 2024-09-11T00:17:52.964 INFO:tasks.workunit.client.0.smithi078.stdout:3/111: mknod d0/d7/d18/d1b/c24 0 2024-09-11T00:17:53.015 INFO:tasks.workunit.client.0.smithi078.stdout:5/80: symlink d7/l1a 0 2024-09-11T00:17:53.037 INFO:tasks.workunit.client.0.smithi078.stdout:4/93: creat dc/d10/f18 x:0 0 0 2024-09-11T00:17:53.042 INFO:tasks.workunit.client.0.smithi078.stdout:9/65: truncate f2 516530 0 2024-09-11T00:17:53.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:52 smithi138 ceph-mon[35019]: pgmap v365: 97 pgs: 97 active+clean; 317 MiB data, 761 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 33 MiB/s wr, 359 op/s 2024-09-11T00:17:53.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:52 smithi078 ceph-mon[30865]: pgmap v365: 97 pgs: 97 active+clean; 317 MiB data, 761 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 33 MiB/s wr, 359 op/s 2024-09-11T00:17:53.087 INFO:tasks.workunit.client.0.smithi078.stdout:1/120: sync 2024-09-11T00:17:53.087 INFO:tasks.workunit.client.0.smithi078.stdout:1/121: stat d3/f1e 0 2024-09-11T00:17:53.112 INFO:tasks.workunit.client.0.smithi078.stdout:1/122: dwrite d3/d4/f1f [0,4194304] 0 2024-09-11T00:17:53.127 INFO:tasks.workunit.client.0.smithi078.stdout:1/123: dwrite d3/f1e [0,4194304] 0 2024-09-11T00:17:53.161 INFO:tasks.workunit.client.0.smithi078.stdout:7/103: link d0/f4 d0/df/f1c 0 2024-09-11T00:17:53.184 INFO:tasks.workunit.client.0.smithi078.stdout:6/87: creat d0/d1/d9/f22 x:0 0 0 2024-09-11T00:17:53.184 INFO:tasks.workunit.client.0.smithi078.stdout:6/88: chown d0/d1/f18 7 1 2024-09-11T00:17:53.186 INFO:tasks.workunit.client.0.smithi078.stdout:6/89: dread d0/d1/f1f [0,4194304] 0 2024-09-11T00:17:53.186 INFO:tasks.workunit.client.0.smithi078.stdout:6/90: chown d0/fc 24 1 2024-09-11T00:17:53.198 INFO:tasks.workunit.client.0.smithi078.stdout:6/91: dwrite d0/d1/d9/f22 [0,4194304] 0 2024-09-11T00:17:53.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:52 smithi112 ceph-mon[35627]: pgmap v365: 97 pgs: 97 active+clean; 317 MiB data, 761 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 33 MiB/s wr, 359 op/s 2024-09-11T00:17:53.352 INFO:tasks.workunit.client.0.smithi078.stdout:2/119: mknod d0/d1/d11/c22 0 2024-09-11T00:17:53.353 INFO:tasks.workunit.client.0.smithi078.stdout:0/106: unlink d2/d3/c10 0 2024-09-11T00:17:53.353 INFO:tasks.workunit.client.0.smithi078.stdout:0/107: fdatasync d2/f1d 0 2024-09-11T00:17:53.354 INFO:tasks.workunit.client.0.smithi078.stdout:3/112: mknod d0/d7/d23/c25 0 2024-09-11T00:17:53.354 INFO:tasks.workunit.client.0.smithi078.stdout:3/113: write d0/d7/f17 [969839,29411] 0 2024-09-11T00:17:53.354 INFO:tasks.workunit.client.0.smithi078.stdout:3/114: write d0/f8 [3180262,4497] 0 2024-09-11T00:17:53.355 INFO:tasks.workunit.client.0.smithi078.stdout:5/81: mknod d7/d8/d9/c1b 0 2024-09-11T00:17:53.355 INFO:tasks.workunit.client.0.smithi078.stdout:4/94: creat dc/d10/f19 x:0 0 0 2024-09-11T00:17:53.356 INFO:tasks.workunit.client.0.smithi078.stdout:9/66: rmdir dc 39 2024-09-11T00:17:53.360 INFO:tasks.workunit.client.0.smithi078.stdout:7/104: rename d0/d11 to d0/df/db/d1b/d1d 0 2024-09-11T00:17:53.361 INFO:tasks.workunit.client.0.smithi078.stdout:6/92: mknod d0/d1/d9/d17/c23 0 2024-09-11T00:17:53.361 INFO:tasks.workunit.client.0.smithi078.stdout:0/108: getdents d2 0 2024-09-11T00:17:53.362 INFO:tasks.workunit.client.0.smithi078.stdout:3/115: creat d0/d7/f26 x:0 0 0 2024-09-11T00:17:53.362 INFO:tasks.workunit.client.0.smithi078.stdout:5/82: mkdir d7/d8/d9/d1c 0 2024-09-11T00:17:53.363 INFO:tasks.workunit.client.0.smithi078.stdout:4/95: rename dc/d10/f19 to dc/d10/f1a 0 2024-09-11T00:17:53.365 INFO:tasks.workunit.client.0.smithi078.stdout:9/67: creat dc/f14 x:0 0 0 2024-09-11T00:17:53.366 INFO:tasks.workunit.client.0.smithi078.stdout:1/124: link d3/l5 d3/l20 0 2024-09-11T00:17:53.366 INFO:tasks.workunit.client.0.smithi078.stdout:2/120: dwrite d0/d1/f4 [4194304,4194304] 0 2024-09-11T00:17:53.368 INFO:tasks.workunit.client.0.smithi078.stdout:7/105: unlink d0/df/db/d1b/d1d/d14/f16 0 2024-09-11T00:17:53.369 INFO:tasks.workunit.client.0.smithi078.stdout:6/93: link d0/f1a d0/d1/d9/f24 0 2024-09-11T00:17:53.370 INFO:tasks.workunit.client.0.smithi078.stdout:0/109: rmdir d2/d3/d7 39 2024-09-11T00:17:53.370 INFO:tasks.workunit.client.0.smithi078.stdout:1/125: dread f2 [0,4194304] 0 2024-09-11T00:17:53.370 INFO:tasks.workunit.client.0.smithi078.stdout:1/126: chown d3/f17 159 1 2024-09-11T00:17:53.371 INFO:tasks.workunit.client.0.smithi078.stdout:3/116: rename d0/db to d0/d7/d18/d1b/d27 0 2024-09-11T00:17:53.372 INFO:tasks.workunit.client.0.smithi078.stdout:5/83: mkdir d7/d8/d13/d1d 0 2024-09-11T00:17:53.374 INFO:tasks.workunit.client.0.smithi078.stdout:4/96: unlink dc/d10/f13 0 2024-09-11T00:17:53.374 INFO:tasks.workunit.client.0.smithi078.stdout:4/97: fdatasync dc/d10/f15 0 2024-09-11T00:17:53.375 INFO:tasks.workunit.client.0.smithi078.stdout:2/121: creat d0/d1/d11/d1b/d1e/f23 x:0 0 0 2024-09-11T00:17:53.377 INFO:tasks.workunit.client.0.smithi078.stdout:7/106: link d0/df/db/d1b/d1d/f17 d0/f1e 0 2024-09-11T00:17:53.377 INFO:tasks.workunit.client.0.smithi078.stdout:7/107: write d0/df/db/d1b/d1d/f13 [673219,26409] 0 2024-09-11T00:17:53.377 INFO:tasks.workunit.client.0.smithi078.stdout:8/93: sync 2024-09-11T00:17:53.377 INFO:tasks.workunit.client.0.smithi078.stdout:7/108: write d0/df/db/d1b/d1d/f13 [294320,91107] 0 2024-09-11T00:17:53.378 INFO:tasks.workunit.client.0.smithi078.stdout:6/94: rename d0/d1/d9/d17/l19 to d0/d1/d9/d17/l25 0 2024-09-11T00:17:53.378 INFO:tasks.workunit.client.0.smithi078.stdout:6/95: fsync d0/d1/d9/f16 0 2024-09-11T00:17:53.379 INFO:tasks.workunit.client.0.smithi078.stdout:0/110: mknod d2/d3/d7/dc/c21 0 2024-09-11T00:17:53.380 INFO:tasks.workunit.client.0.smithi078.stdout:9/68: rename c8 to dc/d12/c15 0 2024-09-11T00:17:53.380 INFO:tasks.workunit.client.0.smithi078.stdout:9/69: readlink dc/lf 0 2024-09-11T00:17:53.380 INFO:tasks.workunit.client.0.smithi078.stdout:9/70: fdatasync dc/d12/f11 0 2024-09-11T00:17:53.383 INFO:tasks.workunit.client.0.smithi078.stdout:2/122: dread d0/d1/d8/f12 [0,4194304] 0 2024-09-11T00:17:53.383 INFO:tasks.workunit.client.0.smithi078.stdout:4/98: getdents dc 0 2024-09-11T00:17:53.384 INFO:tasks.workunit.client.0.smithi078.stdout:7/109: dread d0/df/db/d1b/d1d/f13 [0,4194304] 0 2024-09-11T00:17:53.384 INFO:tasks.workunit.client.0.smithi078.stdout:8/94: creat da/d13/d1b/f1d x:0 0 0 2024-09-11T00:17:53.385 INFO:tasks.workunit.client.0.smithi078.stdout:6/96: unlink d0/f11 0 2024-09-11T00:17:53.386 INFO:tasks.workunit.client.0.smithi078.stdout:0/111: creat d2/d3/f22 x:0 0 0 2024-09-11T00:17:53.388 INFO:tasks.workunit.client.0.smithi078.stdout:9/71: creat dc/f16 x:0 0 0 2024-09-11T00:17:53.388 INFO:tasks.workunit.client.0.smithi078.stdout:8/95: write f4 [1508274,34909] 0 2024-09-11T00:17:53.390 INFO:tasks.workunit.client.0.smithi078.stdout:2/123: write d0/d1/d6/f15 [2056378,124297] 0 2024-09-11T00:17:53.391 INFO:tasks.workunit.client.0.smithi078.stdout:4/99: mkdir dc/d17/d1b 0 2024-09-11T00:17:53.392 INFO:tasks.workunit.client.0.smithi078.stdout:5/84: dwrite d7/d8/de/f19 [0,4194304] 0 2024-09-11T00:17:53.392 INFO:tasks.workunit.client.0.smithi078.stdout:7/110: symlink d0/df/l1f 0 2024-09-11T00:17:53.395 INFO:tasks.workunit.client.0.smithi078.stdout:8/96: mkdir da/d1c/d1e 0 2024-09-11T00:17:53.396 INFO:tasks.workunit.client.0.smithi078.stdout:3/117: getdents d0/d7/d18/d1b 0 2024-09-11T00:17:53.397 INFO:tasks.workunit.client.0.smithi078.stdout:2/124: creat d0/d1/d11/f24 x:0 0 0 2024-09-11T00:17:53.401 INFO:tasks.workunit.client.0.smithi078.stdout:0/112: mkdir d2/d3/d7/dc/d23 0 2024-09-11T00:17:53.404 INFO:tasks.workunit.client.0.smithi078.stdout:6/97: dwrite d0/d1/d9/f15 [0,4194304] 0 2024-09-11T00:17:53.405 INFO:tasks.workunit.client.0.smithi078.stdout:8/97: mknod da/d1c/c1f 0 2024-09-11T00:17:53.405 INFO:tasks.workunit.client.0.smithi078.stdout:8/98: write da/f14 [652317,13873] 0 2024-09-11T00:17:53.405 INFO:tasks.workunit.client.0.smithi078.stdout:3/118: creat d0/d7/d18/d1b/d27/f28 x:0 0 0 2024-09-11T00:17:53.405 INFO:tasks.workunit.client.0.smithi078.stdout:3/119: write d0/d7/d18/d1b/f14 [683459,107972] 0 2024-09-11T00:17:53.406 INFO:tasks.workunit.client.0.smithi078.stdout:2/125: mknod d0/c25 0 2024-09-11T00:17:53.406 INFO:tasks.workunit.client.0.smithi078.stdout:2/126: stat d0/d1/d8 0 2024-09-11T00:17:53.408 INFO:tasks.workunit.client.0.smithi078.stdout:3/120: dread d0/f1f [0,4194304] 0 2024-09-11T00:17:53.408 INFO:tasks.workunit.client.0.smithi078.stdout:3/121: chown d0/d7/d18/d1b/f14 2165400 1 2024-09-11T00:17:53.408 INFO:tasks.workunit.client.0.smithi078.stdout:0/113: creat d2/d3/d7/dc/f24 x:0 0 0 2024-09-11T00:17:53.409 INFO:tasks.workunit.client.0.smithi078.stdout:9/72: dwrite dc/f16 [0,4194304] 0 2024-09-11T00:17:53.412 INFO:tasks.workunit.client.0.smithi078.stdout:4/100: dwrite fa [0,4194304] 0 2024-09-11T00:17:53.412 INFO:tasks.workunit.client.0.smithi078.stdout:4/101: truncate dc/d10/f12 61853 0 2024-09-11T00:17:53.412 INFO:tasks.workunit.client.0.smithi078.stdout:8/99: truncate f6 2876958 0 2024-09-11T00:17:53.413 INFO:tasks.workunit.client.0.smithi078.stdout:2/127: mknod d0/c26 0 2024-09-11T00:17:53.415 INFO:tasks.workunit.client.0.smithi078.stdout:8/100: dread da/fe [0,4194304] 0 2024-09-11T00:17:53.416 INFO:tasks.workunit.client.0.smithi078.stdout:9/73: creat dc/d12/f17 x:0 0 0 2024-09-11T00:17:53.417 INFO:tasks.workunit.client.0.smithi078.stdout:5/85: truncate d7/d8/de/f19 1377780 0 2024-09-11T00:17:53.417 INFO:tasks.workunit.client.0.smithi078.stdout:6/98: write d0/f1a [961478,53425] 0 2024-09-11T00:17:53.417 INFO:tasks.workunit.client.0.smithi078.stdout:6/99: write d0/d1/d9/d17/f1c [141959,13626] 0 2024-09-11T00:17:53.418 INFO:tasks.workunit.client.0.smithi078.stdout:4/102: unlink dc/fe 0 2024-09-11T00:17:53.420 INFO:tasks.workunit.client.0.smithi078.stdout:2/128: creat d0/d1/f27 x:0 0 0 2024-09-11T00:17:53.420 INFO:tasks.workunit.client.0.smithi078.stdout:2/129: truncate d0/d1/d8/f12 1598576 0 2024-09-11T00:17:53.422 INFO:tasks.workunit.client.0.smithi078.stdout:8/101: symlink da/l20 0 2024-09-11T00:17:53.424 INFO:tasks.workunit.client.0.smithi078.stdout:5/86: mkdir d7/d8/d9/d1c/d1e 0 2024-09-11T00:17:53.427 INFO:tasks.workunit.client.0.smithi078.stdout:4/103: symlink dc/d10/l1c 0 2024-09-11T00:17:53.428 INFO:tasks.workunit.client.0.smithi078.stdout:2/130: creat d0/d19/f28 x:0 0 0 2024-09-11T00:17:53.429 INFO:tasks.workunit.client.0.smithi078.stdout:4/104: mkdir dc/d1d 0 2024-09-11T00:17:53.431 INFO:tasks.workunit.client.0.smithi078.stdout:2/131: rename d0/d19/f28 to d0/d1/d8/f29 0 2024-09-11T00:17:53.432 INFO:tasks.workunit.client.0.smithi078.stdout:4/105: creat dc/f1e x:0 0 0 2024-09-11T00:17:53.434 INFO:tasks.workunit.client.0.smithi078.stdout:9/74: write fa [244696,129098] 0 2024-09-11T00:17:53.434 INFO:tasks.workunit.client.0.smithi078.stdout:2/132: mknod d0/d1/d11/c2a 0 2024-09-11T00:17:53.435 INFO:tasks.workunit.client.0.smithi078.stdout:5/87: dread d7/d8/de/f11 [0,4194304] 0 2024-09-11T00:17:53.436 INFO:tasks.workunit.client.0.smithi078.stdout:0/114: dwrite d2/d3/d7/fa [4194304,4194304] 0 2024-09-11T00:17:53.436 INFO:tasks.workunit.client.0.smithi078.stdout:3/122: dwrite d0/d7/d18/d1b/f14 [0,4194304] 0 2024-09-11T00:17:53.436 INFO:tasks.workunit.client.0.smithi078.stdout:3/123: truncate d0/d7/fe 4895558 0 2024-09-11T00:17:53.437 INFO:tasks.workunit.client.0.smithi078.stdout:2/133: mknod d0/d19/c2b 0 2024-09-11T00:17:53.438 INFO:tasks.workunit.client.0.smithi078.stdout:5/88: creat d7/f1f x:0 0 0 2024-09-11T00:17:53.439 INFO:tasks.workunit.client.0.smithi078.stdout:0/115: mknod d2/d3/d7/dc/c25 0 2024-09-11T00:17:53.440 INFO:tasks.workunit.client.0.smithi078.stdout:8/102: dwrite da/f17 [0,4194304] 0 2024-09-11T00:17:53.441 INFO:tasks.workunit.client.0.smithi078.stdout:9/75: unlink dc/f16 0 2024-09-11T00:17:53.442 INFO:tasks.workunit.client.0.smithi078.stdout:2/134: link d0/d1/f27 d0/d19/f2c 0 2024-09-11T00:17:53.444 INFO:tasks.workunit.client.0.smithi078.stdout:5/89: link d7/d8/de/ff d7/d8/d9/d1c/d1e/f20 0 2024-09-11T00:17:53.444 INFO:tasks.workunit.client.0.smithi078.stdout:5/90: fdatasync d7/f1f 0 2024-09-11T00:17:53.446 INFO:tasks.workunit.client.0.smithi078.stdout:0/116: link d2/d3/d7/dc/c20 d2/c26 0 2024-09-11T00:17:53.449 INFO:tasks.workunit.client.0.smithi078.stdout:6/100: dread d0/d1/d1b/f21 [0,4194304] 0 2024-09-11T00:17:53.449 INFO:tasks.workunit.client.0.smithi078.stdout:8/103: creat da/f21 x:0 0 0 2024-09-11T00:17:53.450 INFO:tasks.workunit.client.0.smithi078.stdout:8/104: read - da/ff zero size 2024-09-11T00:17:53.450 INFO:tasks.workunit.client.0.smithi078.stdout:0/117: symlink d2/d3/d7/dc/d23/l27 0 2024-09-11T00:17:53.455 INFO:tasks.workunit.client.0.smithi078.stdout:3/124: dwrite d0/d7/f17 [0,4194304] 0 2024-09-11T00:17:53.459 INFO:tasks.workunit.client.0.smithi078.stdout:8/105: dread f6 [0,4194304] 0 2024-09-11T00:17:53.461 INFO:tasks.workunit.client.0.smithi078.stdout:2/135: dread d0/fd [0,4194304] 0 2024-09-11T00:17:53.461 INFO:tasks.workunit.client.0.smithi078.stdout:2/136: stat d0/d1/c2 0 2024-09-11T00:17:53.462 INFO:tasks.workunit.client.0.smithi078.stdout:2/137: chown d0/d1/fe 4370778 1 2024-09-11T00:17:53.462 INFO:tasks.workunit.client.0.smithi078.stdout:4/106: dwrite dc/d10/f18 [0,4194304] 0 2024-09-11T00:17:53.462 INFO:tasks.workunit.client.0.smithi078.stdout:2/138: write d0/d1/f27 [166707,59366] 0 2024-09-11T00:17:53.462 INFO:tasks.workunit.client.0.smithi078.stdout:8/106: mknod da/d1c/d1e/c22 0 2024-09-11T00:17:53.468 INFO:tasks.workunit.client.0.smithi078.stdout:2/139: rename d0/fb to d0/d1/d11/f2d 0 2024-09-11T00:17:53.468 INFO:tasks.workunit.client.0.smithi078.stdout:9/76: dwrite f7 [4194304,4194304] 0 2024-09-11T00:17:53.468 INFO:tasks.workunit.client.0.smithi078.stdout:8/107: unlink da/d13/d1b/f1d 0 2024-09-11T00:17:53.471 INFO:tasks.workunit.client.0.smithi078.stdout:9/77: link fa dc/d12/f18 0 2024-09-11T00:17:53.472 INFO:tasks.workunit.client.0.smithi078.stdout:8/108: truncate f4 2719989 0 2024-09-11T00:17:53.472 INFO:tasks.workunit.client.0.smithi078.stdout:9/78: truncate dc/d12/f11 616174 0 2024-09-11T00:17:53.474 INFO:tasks.workunit.client.0.smithi078.stdout:8/109: creat da/d13/d1b/f23 x:0 0 0 2024-09-11T00:17:53.475 INFO:tasks.workunit.client.0.smithi078.stdout:6/101: dwrite d0/f8 [0,4194304] 0 2024-09-11T00:17:53.477 INFO:tasks.workunit.client.0.smithi078.stdout:8/110: mkdir da/d13/d1b/d24 0 2024-09-11T00:17:53.478 INFO:tasks.workunit.client.0.smithi078.stdout:0/118: dwrite d2/f1d [0,4194304] 0 2024-09-11T00:17:53.478 INFO:tasks.workunit.client.0.smithi078.stdout:0/119: chown d2/d3/d7/dc/f1c 32326248 1 2024-09-11T00:17:53.478 INFO:tasks.workunit.client.0.smithi078.stdout:0/120: write d2/f4 [1604696,88242] 0 2024-09-11T00:17:53.482 INFO:tasks.workunit.client.0.smithi078.stdout:0/121: symlink d2/d3/d7/dc/l28 0 2024-09-11T00:17:53.483 INFO:tasks.workunit.client.0.smithi078.stdout:0/122: write d2/d3/d7/dc/f24 [127418,84171] 0 2024-09-11T00:17:53.483 INFO:tasks.workunit.client.0.smithi078.stdout:2/140: getdents d0 0 2024-09-11T00:17:53.484 INFO:tasks.workunit.client.0.smithi078.stdout:2/141: chown d0 0 1 2024-09-11T00:17:53.485 INFO:tasks.workunit.client.0.smithi078.stdout:6/102: link d0/d1/d9/d17/l25 d0/l26 0 2024-09-11T00:17:53.485 INFO:tasks.workunit.client.0.smithi078.stdout:3/125: dwrite d0/f1f [0,4194304] 0 2024-09-11T00:17:53.488 INFO:tasks.workunit.client.0.smithi078.stdout:0/123: chown d2/d3/d7/c18 96372 1 2024-09-11T00:17:53.489 INFO:tasks.workunit.client.0.smithi078.stdout:6/103: unlink d0/l13 0 2024-09-11T00:17:53.492 INFO:tasks.workunit.client.0.smithi078.stdout:4/107: dwrite dc/d10/f18 [0,4194304] 0 2024-09-11T00:17:53.493 INFO:tasks.workunit.client.0.smithi078.stdout:3/126: symlink d0/d1a/l29 0 2024-09-11T00:17:53.494 INFO:tasks.workunit.client.0.smithi078.stdout:6/104: getdents d0/d1/d9 0 2024-09-11T00:17:53.494 INFO:tasks.workunit.client.0.smithi078.stdout:4/108: mkdir dc/d10/d1f 0 2024-09-11T00:17:53.495 INFO:tasks.workunit.client.0.smithi078.stdout:3/127: symlink d0/d7/d23/l2a 0 2024-09-11T00:17:53.497 INFO:tasks.workunit.client.0.smithi078.stdout:9/79: dwrite fb [0,4194304] 0 2024-09-11T00:17:53.500 INFO:tasks.workunit.client.0.smithi078.stdout:9/80: mknod dc/d12/c19 0 2024-09-11T00:17:53.500 INFO:tasks.workunit.client.0.smithi078.stdout:4/109: creat dc/d10/d1f/f20 x:0 0 0 2024-09-11T00:17:53.501 INFO:tasks.workunit.client.0.smithi078.stdout:9/81: chown fb 163169 1 2024-09-11T00:17:53.502 INFO:tasks.workunit.client.0.smithi078.stdout:6/105: link d0/l5 d0/l27 0 2024-09-11T00:17:53.503 INFO:tasks.workunit.client.0.smithi078.stdout:8/111: dwrite da/ff [0,4194304] 0 2024-09-11T00:17:53.504 INFO:tasks.workunit.client.0.smithi078.stdout:6/106: truncate d0/fc 167826 0 2024-09-11T00:17:53.504 INFO:tasks.workunit.client.0.smithi078.stdout:6/107: chown d0/d1/d9/f15 28654 1 2024-09-11T00:17:53.504 INFO:tasks.workunit.client.0.smithi078.stdout:6/108: stat d0/d1/d1b/c1d 0 2024-09-11T00:17:53.515 INFO:tasks.workunit.client.0.smithi078.stdout:0/124: dwrite d2/f16 [4194304,4194304] 0 2024-09-11T00:17:53.515 INFO:tasks.workunit.client.0.smithi078.stdout:0/125: chown d2/c26 744 1 2024-09-11T00:17:53.515 INFO:tasks.workunit.client.0.smithi078.stdout:2/142: dwrite d0/d1/f4 [4194304,4194304] 0 2024-09-11T00:17:53.520 INFO:tasks.workunit.client.0.smithi078.stdout:0/126: mknod d2/c29 0 2024-09-11T00:17:53.521 INFO:tasks.workunit.client.0.smithi078.stdout:6/109: dread d0/d1/d9/f22 [0,4194304] 0 2024-09-11T00:17:53.521 INFO:tasks.workunit.client.0.smithi078.stdout:3/128: dwrite d0/d7/f17 [4194304,4194304] 0 2024-09-11T00:17:53.522 INFO:tasks.workunit.client.0.smithi078.stdout:0/127: read d2/f4 [664977,86570] 0 2024-09-11T00:17:53.524 INFO:tasks.workunit.client.0.smithi078.stdout:2/143: unlink d0/fd 0 2024-09-11T00:17:53.526 INFO:tasks.workunit.client.0.smithi078.stdout:2/144: dread d0/d1/d8/f12 [0,4194304] 0 2024-09-11T00:17:53.526 INFO:tasks.workunit.client.0.smithi078.stdout:2/145: dread - d0/d19/f1a zero size 2024-09-11T00:17:53.527 INFO:tasks.workunit.client.0.smithi078.stdout:6/110: rmdir d0/d1/d9 39 2024-09-11T00:17:53.529 INFO:tasks.workunit.client.0.smithi078.stdout:3/129: rmdir d0/d7/d18/d1b/d27 39 2024-09-11T00:17:53.529 INFO:tasks.workunit.client.0.smithi078.stdout:3/130: truncate d0/f10 238229 0 2024-09-11T00:17:53.529 INFO:tasks.workunit.client.0.smithi078.stdout:3/131: write d0/d7/d18/d1b/d27/f28 [913773,64475] 0 2024-09-11T00:17:53.530 INFO:tasks.workunit.client.0.smithi078.stdout:3/132: mknod d0/d7/d23/c2b 0 2024-09-11T00:17:53.530 INFO:tasks.workunit.client.0.smithi078.stdout:3/133: getdents d0/d1a/d1e 0 2024-09-11T00:17:53.531 INFO:tasks.workunit.client.0.smithi078.stdout:4/110: dwrite dc/d10/d1f/f20 [0,4194304] 0 2024-09-11T00:17:53.531 INFO:tasks.workunit.client.0.smithi078.stdout:4/111: fsync dc/d10/f14 0 2024-09-11T00:17:53.532 INFO:tasks.workunit.client.0.smithi078.stdout:3/134: symlink d0/d1a/d1e/l2c 0 2024-09-11T00:17:53.532 INFO:tasks.workunit.client.0.smithi078.stdout:3/135: write d0/d7/d18/d1b/f14 [4397968,8288] 0 2024-09-11T00:17:53.533 INFO:tasks.workunit.client.0.smithi078.stdout:8/112: dwrite da/fc [0,4194304] 0 2024-09-11T00:17:53.533 INFO:tasks.workunit.client.0.smithi078.stdout:8/113: chown da/f10 485742434 1 2024-09-11T00:17:53.542 INFO:tasks.workunit.client.0.smithi078.stdout:8/114: dread da/ff [0,4194304] 0 2024-09-11T00:17:53.543 INFO:tasks.workunit.client.0.smithi078.stdout:8/115: creat da/d13/d19/f25 x:0 0 0 2024-09-11T00:17:53.545 INFO:tasks.workunit.client.0.smithi078.stdout:8/116: link da/cd da/d1c/c26 0 2024-09-11T00:17:53.550 INFO:tasks.workunit.client.0.smithi078.stdout:3/136: fdatasync d0/d7/d18/d1b/d27/f28 0 2024-09-11T00:17:53.552 INFO:tasks.workunit.client.0.smithi078.stdout:3/137: creat d0/d7/d23/f2d x:0 0 0 2024-09-11T00:17:53.553 INFO:tasks.workunit.client.0.smithi078.stdout:6/111: dwrite d0/d1/d9/d17/f1c [0,4194304] 0 2024-09-11T00:17:53.554 INFO:tasks.workunit.client.0.smithi078.stdout:3/138: mkdir d0/d7/d18/d1b/d27/d2e 0 2024-09-11T00:17:53.554 INFO:tasks.workunit.client.0.smithi078.stdout:3/139: write d0/d7/d18/d1b/d27/f22 [632816,126791] 0 2024-09-11T00:17:53.554 INFO:tasks.workunit.client.0.smithi078.stdout:6/112: dread d0/d1/d9/f16 [0,4194304] 0 2024-09-11T00:17:53.554 INFO:tasks.workunit.client.0.smithi078.stdout:0/128: dwrite d2/d3/f22 [0,4194304] 0 2024-09-11T00:17:53.555 INFO:tasks.workunit.client.0.smithi078.stdout:6/113: mknod d0/d1/d9/d17/c28 0 2024-09-11T00:17:53.556 INFO:tasks.workunit.client.0.smithi078.stdout:4/112: dwrite f3 [0,4194304] 0 2024-09-11T00:17:53.559 INFO:tasks.workunit.client.0.smithi078.stdout:2/146: dwrite d0/d19/f2c [0,4194304] 0 2024-09-11T00:17:53.559 INFO:tasks.workunit.client.0.smithi078.stdout:2/147: chown d0/d1/d8/f29 1649657 1 2024-09-11T00:17:53.560 INFO:tasks.workunit.client.0.smithi078.stdout:6/114: symlink d0/d1/l29 0 2024-09-11T00:17:53.563 INFO:tasks.workunit.client.0.smithi078.stdout:0/129: truncate d2/d3/d7/f13 1832767 0 2024-09-11T00:17:53.563 INFO:tasks.workunit.client.0.smithi078.stdout:4/113: read f3 [7591830,43567] 0 2024-09-11T00:17:53.564 INFO:tasks.workunit.client.0.smithi078.stdout:8/117: write da/fc [1154986,21784] 0 2024-09-11T00:17:53.564 INFO:tasks.workunit.client.0.smithi078.stdout:6/115: link d0/l26 d0/d1/d9/l2a 0 2024-09-11T00:17:53.566 INFO:tasks.workunit.client.0.smithi078.stdout:0/130: mkdir d2/d2a 0 2024-09-11T00:17:53.566 INFO:tasks.workunit.client.0.smithi078.stdout:0/131: chown d2/d3/d7/f13 161878737 1 2024-09-11T00:17:53.566 INFO:tasks.workunit.client.0.smithi078.stdout:4/114: symlink dc/d17/l21 0 2024-09-11T00:17:53.567 INFO:tasks.workunit.client.0.smithi078.stdout:8/118: creat da/d13/d1b/d24/f27 x:0 0 0 2024-09-11T00:17:53.568 INFO:tasks.workunit.client.0.smithi078.stdout:8/119: write f7 [3676809,43390] 0 2024-09-11T00:17:53.568 INFO:tasks.workunit.client.0.smithi078.stdout:6/116: mkdir d0/d1/d9/d2b 0 2024-09-11T00:17:53.570 INFO:tasks.workunit.client.0.smithi078.stdout:0/132: creat d2/d3/d7/f2b x:0 0 0 2024-09-11T00:17:53.570 INFO:tasks.workunit.client.0.smithi078.stdout:0/133: write d2/d3/d7/f2b [317949,79108] 0 2024-09-11T00:17:53.570 INFO:tasks.workunit.client.0.smithi078.stdout:4/115: chown c8 7539666 1 2024-09-11T00:17:53.571 INFO:tasks.workunit.client.0.smithi078.stdout:3/140: dwrite d0/d7/fd [0,4194304] 0 2024-09-11T00:17:53.572 INFO:tasks.workunit.client.0.smithi078.stdout:8/120: truncate f6 954612 0 2024-09-11T00:17:53.572 INFO:tasks.workunit.client.0.smithi078.stdout:4/116: dread dc/ff [0,4194304] 0 2024-09-11T00:17:53.572 INFO:tasks.workunit.client.0.smithi078.stdout:4/117: readlink dc/d17/l21 0 2024-09-11T00:17:53.572 INFO:tasks.workunit.client.0.smithi078.stdout:6/117: unlink d0/d1/l29 0 2024-09-11T00:17:53.573 INFO:tasks.workunit.client.0.smithi078.stdout:0/134: rmdir d2/d3 39 2024-09-11T00:17:53.575 INFO:tasks.workunit.client.0.smithi078.stdout:4/118: rename dc/d10/f15 to dc/d17/f22 0 2024-09-11T00:17:53.576 INFO:tasks.workunit.client.0.smithi078.stdout:8/121: mkdir da/d13/d28 0 2024-09-11T00:17:53.576 INFO:tasks.workunit.client.0.smithi078.stdout:8/122: write da/fe [416943,11338] 0 2024-09-11T00:17:53.576 INFO:tasks.workunit.client.0.smithi078.stdout:8/123: write f4 [578050,65707] 0 2024-09-11T00:17:53.578 INFO:tasks.workunit.client.0.smithi078.stdout:4/119: creat dc/d10/d1f/f23 x:0 0 0 2024-09-11T00:17:53.579 INFO:tasks.workunit.client.0.smithi078.stdout:2/148: dwrite d0/d1/d11/d1b/f20 [0,4194304] 0 2024-09-11T00:17:53.579 INFO:tasks.workunit.client.0.smithi078.stdout:6/118: write d0/d1/d9/f15 [2054472,57080] 0 2024-09-11T00:17:53.581 INFO:tasks.workunit.client.0.smithi078.stdout:2/149: mknod d0/d1/d11/d1b/c2e 0 2024-09-11T00:17:53.582 INFO:tasks.workunit.client.0.smithi078.stdout:6/119: rmdir d0/d1/d9/d2b 0 2024-09-11T00:17:53.589 INFO:tasks.workunit.client.0.smithi078.stdout:8/124: dread da/f14 [0,4194304] 0 2024-09-11T00:17:53.591 INFO:tasks.workunit.client.0.smithi078.stdout:8/125: rmdir da/d13 39 2024-09-11T00:17:53.591 INFO:tasks.workunit.client.0.smithi078.stdout:0/135: dwrite d2/d3/f1b [0,4194304] 0 2024-09-11T00:17:53.592 INFO:tasks.workunit.client.0.smithi078.stdout:6/120: write d0/f8 [1796449,8059] 0 2024-09-11T00:17:53.592 INFO:tasks.workunit.client.0.smithi078.stdout:8/126: rename da/cb to da/d1c/d1e/c29 0 2024-09-11T00:17:53.592 INFO:tasks.workunit.client.0.smithi078.stdout:8/127: read f4 [1782525,128064] 0 2024-09-11T00:17:53.595 INFO:tasks.workunit.client.0.smithi078.stdout:1/127: sync 2024-09-11T00:17:53.595 INFO:tasks.workunit.client.0.smithi078.stdout:1/128: stat d3/d4/f12 0 2024-09-11T00:17:53.596 INFO:tasks.workunit.client.0.smithi078.stdout:2/150: dread d0/d1/f27 [0,4194304] 0 2024-09-11T00:17:53.596 INFO:tasks.workunit.client.0.smithi078.stdout:2/151: write d0/d1/d6/f15 [198538,42521] 0 2024-09-11T00:17:53.596 INFO:tasks.workunit.client.0.smithi078.stdout:2/152: dread - d0/f1c zero size 2024-09-11T00:17:53.597 INFO:tasks.workunit.client.0.smithi078.stdout:6/121: mkdir d0/d1/d2c 0 2024-09-11T00:17:53.597 INFO:tasks.workunit.client.0.smithi078.stdout:8/128: creat da/f2a x:0 0 0 2024-09-11T00:17:53.597 INFO:tasks.workunit.client.0.smithi078.stdout:8/129: chown da/d13/d28 26376699 1 2024-09-11T00:17:53.598 INFO:tasks.workunit.client.0.smithi078.stdout:2/153: creat d0/d1/d11/d1b/d1e/f2f x:0 0 0 2024-09-11T00:17:53.598 INFO:tasks.workunit.client.0.smithi078.stdout:2/154: chown d0/d1/d11/d1b/c2e 1703400 1 2024-09-11T00:17:53.599 INFO:tasks.workunit.client.0.smithi078.stdout:6/122: link d0/f10 d0/d1/f2d 0 2024-09-11T00:17:53.600 INFO:tasks.workunit.client.0.smithi078.stdout:4/120: getdents dc/d10/d1f 0 2024-09-11T00:17:53.600 INFO:tasks.workunit.client.0.smithi078.stdout:8/130: symlink da/l2b 0 2024-09-11T00:17:53.601 INFO:tasks.workunit.client.0.smithi078.stdout:2/155: truncate d0/d1/d6/f16 978091 0 2024-09-11T00:17:53.602 INFO:tasks.workunit.client.0.smithi078.stdout:4/121: link dc/d10/l1c dc/d10/l24 0 2024-09-11T00:17:53.603 INFO:tasks.workunit.client.0.smithi078.stdout:8/131: rmdir da/d13/d19 39 2024-09-11T00:17:53.604 INFO:tasks.workunit.client.0.smithi078.stdout:2/156: rmdir d0/d19 39 2024-09-11T00:17:53.606 INFO:tasks.workunit.client.0.smithi078.stdout:2/157: creat d0/d1/d8/f30 x:0 0 0 2024-09-11T00:17:53.606 INFO:tasks.workunit.client.0.smithi078.stdout:2/158: mkdir d0/d31 0 2024-09-11T00:17:53.607 INFO:tasks.workunit.client.0.smithi078.stdout:6/123: dread d0/d1/f1f [0,4194304] 0 2024-09-11T00:17:53.608 INFO:tasks.workunit.client.0.smithi078.stdout:0/136: write d2/d3/f1b [4571461,130203] 0 2024-09-11T00:17:53.608 INFO:tasks.workunit.client.0.smithi078.stdout:0/137: write d2/d3/d7/dc/f24 [375708,34492] 0 2024-09-11T00:17:53.608 INFO:tasks.workunit.client.0.smithi078.stdout:0/138: readlink d2/d3/d7/dc/le 0 2024-09-11T00:17:53.608 INFO:tasks.workunit.client.0.smithi078.stdout:6/124: link d0/d1/d9/f16 d0/d1/d1b/f2e 0 2024-09-11T00:17:53.609 INFO:tasks.workunit.client.0.smithi078.stdout:0/139: mkdir d2/d2a/d2c 0 2024-09-11T00:17:53.610 INFO:tasks.workunit.client.0.smithi078.stdout:6/125: creat d0/d1/f2f x:0 0 0 2024-09-11T00:17:53.611 INFO:tasks.workunit.client.0.smithi078.stdout:0/140: link d2/d3/d7/dc/f1c d2/f2d 0 2024-09-11T00:17:53.612 INFO:tasks.workunit.client.0.smithi078.stdout:1/129: dwrite d3/f17 [0,4194304] 0 2024-09-11T00:17:53.613 INFO:tasks.workunit.client.0.smithi078.stdout:6/126: creat d0/d1/f30 x:0 0 0 2024-09-11T00:17:53.613 INFO:tasks.workunit.client.0.smithi078.stdout:6/127: write d0/d1/f2 [5612835,118355] 0 2024-09-11T00:17:53.614 INFO:tasks.workunit.client.0.smithi078.stdout:2/159: write d0/d1/d11/d1b/f20 [857298,109946] 0 2024-09-11T00:17:53.617 INFO:tasks.workunit.client.0.smithi078.stdout:8/132: write f2 [3142343,5151] 0 2024-09-11T00:17:53.617 INFO:tasks.workunit.client.0.smithi078.stdout:8/133: fsync da/f21 0 2024-09-11T00:17:53.619 INFO:tasks.workunit.client.0.smithi078.stdout:2/160: creat d0/d1/d8/f32 x:0 0 0 2024-09-11T00:17:53.619 INFO:tasks.workunit.client.0.smithi078.stdout:2/161: chown d0/d1/c17 166 1 2024-09-11T00:17:53.619 INFO:tasks.workunit.client.0.smithi078.stdout:2/162: write d0/d1/d11/f2d [395191,6044] 0 2024-09-11T00:17:53.619 INFO:tasks.workunit.client.0.smithi078.stdout:2/163: chown d0/d31 215778 1 2024-09-11T00:17:53.619 INFO:tasks.workunit.client.0.smithi078.stdout:4/122: dwrite f6 [0,4194304] 0 2024-09-11T00:17:53.619 INFO:tasks.workunit.client.0.smithi078.stdout:4/123: stat dc/ff 0 2024-09-11T00:17:53.620 INFO:tasks.workunit.client.0.smithi078.stdout:4/124: write dc/ff [661648,55667] 0 2024-09-11T00:17:53.620 INFO:tasks.workunit.client.0.smithi078.stdout:4/125: chown f3 0 1 2024-09-11T00:17:53.620 INFO:tasks.workunit.client.0.smithi078.stdout:6/128: link d0/d1/d9/f22 d0/f31 0 2024-09-11T00:17:53.621 INFO:tasks.workunit.client.0.smithi078.stdout:6/129: readlink d0/l12 0 2024-09-11T00:17:53.622 INFO:tasks.workunit.client.0.smithi078.stdout:2/164: mkdir d0/d1/d33 0 2024-09-11T00:17:53.625 INFO:tasks.workunit.client.0.smithi078.stdout:6/130: rename d0/d1/d9/f22 to d0/d1/f32 0 2024-09-11T00:17:53.625 INFO:tasks.workunit.client.0.smithi078.stdout:2/165: mknod d0/d1/d11/d1b/c34 0 2024-09-11T00:17:53.626 INFO:tasks.workunit.client.0.smithi078.stdout:2/166: creat d0/d1/d11/d1b/d1e/f35 x:0 0 0 2024-09-11T00:17:53.628 INFO:tasks.workunit.client.0.smithi078.stdout:2/167: link d0/d1/d11/d1b/d1e/f35 d0/d1/d11/f36 0 2024-09-11T00:17:53.632 INFO:tasks.workunit.client.0.smithi078.stdout:2/168: write d0/d1/d8/f1d [382020,110428] 0 2024-09-11T00:17:53.632 INFO:tasks.workunit.client.0.smithi078.stdout:2/169: truncate d0/d19/f1a 750188 0 2024-09-11T00:17:53.633 INFO:tasks.workunit.client.0.smithi078.stdout:0/141: dwrite d2/d3/d7/fa [4194304,4194304] 0 2024-09-11T00:17:53.636 INFO:tasks.workunit.client.0.smithi078.stdout:8/134: dwrite da/d13/d19/f25 [0,4194304] 0 2024-09-11T00:17:53.637 INFO:tasks.workunit.client.0.smithi078.stdout:1/130: dwrite f2 [4194304,4194304] 0 2024-09-11T00:17:53.640 INFO:tasks.workunit.client.0.smithi078.stdout:0/142: unlink d2/d3/d7/dc/d23/l27 0 2024-09-11T00:17:53.643 INFO:tasks.workunit.client.0.smithi078.stdout:4/126: dwrite dc/d10/f18 [0,4194304] 0 2024-09-11T00:17:53.644 INFO:tasks.workunit.client.0.smithi078.stdout:8/135: rename da/d13/d19/f25 to da/d13/f2c 0 2024-09-11T00:17:53.644 INFO:tasks.workunit.client.0.smithi078.stdout:8/136: write da/d13/d19/f1a [126112,58638] 0 2024-09-11T00:17:53.645 INFO:tasks.workunit.client.0.smithi078.stdout:1/131: mkdir d3/d1a/d21 0 2024-09-11T00:17:53.647 INFO:tasks.workunit.client.0.smithi078.stdout:2/170: link d0/d1/d11/d1b/d1e/f2f d0/d1/d6/f37 0 2024-09-11T00:17:53.647 INFO:tasks.workunit.client.0.smithi078.stdout:2/171: chown d0/d19/f1a 1249745 1 2024-09-11T00:17:53.647 INFO:tasks.workunit.client.0.smithi078.stdout:2/172: fsync d0/fc 0 2024-09-11T00:17:53.649 INFO:tasks.workunit.client.0.smithi078.stdout:0/143: mknod d2/d3/d7/dc/d23/c2e 0 2024-09-11T00:17:53.650 INFO:tasks.workunit.client.0.smithi078.stdout:4/127: creat dc/f25 x:0 0 0 2024-09-11T00:17:53.651 INFO:tasks.workunit.client.0.smithi078.stdout:1/132: creat d3/d1a/d21/f22 x:0 0 0 2024-09-11T00:17:53.651 INFO:tasks.workunit.client.0.smithi078.stdout:8/137: write da/f10 [1948011,87572] 0 2024-09-11T00:17:53.651 INFO:tasks.workunit.client.0.smithi078.stdout:6/131: write d0/fc [819410,114270] 0 2024-09-11T00:17:53.652 INFO:tasks.workunit.client.0.smithi078.stdout:2/173: mkdir d0/d31/d38 0 2024-09-11T00:17:53.654 INFO:tasks.workunit.client.0.smithi078.stdout:0/144: creat d2/d2a/f2f x:0 0 0 2024-09-11T00:17:53.654 INFO:tasks.workunit.client.0.smithi078.stdout:0/145: chown d2/f16 45281301 1 2024-09-11T00:17:53.655 INFO:tasks.workunit.client.0.smithi078.stdout:1/133: link d3/c14 d3/d1a/d21/c23 0 2024-09-11T00:17:53.655 INFO:tasks.workunit.client.0.smithi078.stdout:1/134: dread - d3/d4/f18 zero size 2024-09-11T00:17:53.655 INFO:tasks.workunit.client.0.smithi078.stdout:1/135: dread - d3/d4/f18 zero size 2024-09-11T00:17:53.656 INFO:tasks.workunit.client.0.smithi078.stdout:2/174: creat d0/d1/d6/f39 x:0 0 0 2024-09-11T00:17:53.659 INFO:tasks.workunit.client.0.smithi078.stdout:0/146: mknod d2/d2a/c30 0 2024-09-11T00:17:53.660 INFO:tasks.workunit.client.0.smithi078.stdout:1/136: unlink d3/d4/f12 0 2024-09-11T00:17:53.660 INFO:tasks.workunit.client.0.smithi078.stdout:6/132: mkdir d0/d33 0 2024-09-11T00:17:53.662 INFO:tasks.workunit.client.0.smithi078.stdout:2/175: unlink d0/d1/d11/d1b/d1e/f23 0 2024-09-11T00:17:53.662 INFO:tasks.workunit.client.0.smithi078.stdout:2/176: truncate d0/d1/d11/f2d 1518662 0 2024-09-11T00:17:53.664 INFO:tasks.workunit.client.0.smithi078.stdout:6/133: rename d0/f10 to d0/d33/f34 0 2024-09-11T00:17:53.667 INFO:tasks.workunit.client.0.smithi078.stdout:6/134: symlink d0/d1/d2c/l35 0 2024-09-11T00:17:53.667 INFO:tasks.workunit.client.0.smithi078.stdout:6/135: fdatasync d0/d33/f34 0 2024-09-11T00:17:53.671 INFO:tasks.workunit.client.0.smithi078.stdout:1/137: write d3/f9 [6611542,125143] 0 2024-09-11T00:17:53.672 INFO:tasks.workunit.client.0.smithi078.stdout:1/138: creat d3/d1a/d21/f24 x:0 0 0 2024-09-11T00:17:53.673 INFO:tasks.workunit.client.0.smithi078.stdout:4/128: dwrite f3 [4194304,4194304] 0 2024-09-11T00:17:53.674 INFO:tasks.workunit.client.0.smithi078.stdout:1/139: truncate d3/d1a/ff 4185146 0 2024-09-11T00:17:53.676 INFO:tasks.workunit.client.0.smithi078.stdout:4/129: mknod dc/d17/c26 0 2024-09-11T00:17:53.677 INFO:tasks.workunit.client.0.smithi078.stdout:0/147: dwrite d2/d3/d7/dc/f24 [0,4194304] 0 2024-09-11T00:17:53.677 INFO:tasks.workunit.client.0.smithi078.stdout:4/130: mknod dc/d10/c27 0 2024-09-11T00:17:53.680 INFO:tasks.workunit.client.0.smithi078.stdout:0/148: creat d2/d3/d7/dc/f31 x:0 0 0 2024-09-11T00:17:53.681 INFO:tasks.workunit.client.0.smithi078.stdout:6/136: dwrite d0/d1/d9/f15 [0,4194304] 0 2024-09-11T00:17:53.685 INFO:tasks.workunit.client.0.smithi078.stdout:2/177: truncate d0/d19/f1a 621145 0 2024-09-11T00:17:53.685 INFO:tasks.workunit.client.0.smithi078.stdout:2/178: write d0/d1/d11/d1b/f20 [2892418,128359] 0 2024-09-11T00:17:53.685 INFO:tasks.workunit.client.0.smithi078.stdout:2/179: chown d0/c26 466 1 2024-09-11T00:17:53.687 INFO:tasks.workunit.client.0.smithi078.stdout:4/131: read dc/d10/d1f/f20 [2711594,125268] 0 2024-09-11T00:17:53.687 INFO:tasks.workunit.client.0.smithi078.stdout:4/132: getdents dc/d10/d1f 0 2024-09-11T00:17:53.687 INFO:tasks.workunit.client.0.smithi078.stdout:2/180: mkdir d0/d31/d3a 0 2024-09-11T00:17:53.688 INFO:tasks.workunit.client.0.smithi078.stdout:2/181: mkdir d0/d1/d3b 0 2024-09-11T00:17:53.689 INFO:tasks.workunit.client.0.smithi078.stdout:1/140: dread d3/f17 [0,4194304] 0 2024-09-11T00:17:53.690 INFO:tasks.workunit.client.0.smithi078.stdout:1/141: readlink d3/d4/l15 0 2024-09-11T00:17:53.691 INFO:tasks.workunit.client.0.smithi078.stdout:6/137: dread d0/d1/d9/d17/f1c [0,4194304] 0 2024-09-11T00:17:53.700 INFO:tasks.workunit.client.0.smithi078.stdout:1/142: read d3/d4/f1f [1922210,72691] 0 2024-09-11T00:17:53.702 INFO:tasks.workunit.client.0.smithi078.stdout:1/143: creat d3/d4/f25 x:0 0 0 2024-09-11T00:17:53.703 INFO:tasks.workunit.client.0.smithi078.stdout:1/144: symlink d3/d1a/d21/l26 0 2024-09-11T00:17:53.708 INFO:tasks.workunit.client.0.smithi078.stdout:4/133: dread dc/fd [0,4194304] 0 2024-09-11T00:17:53.708 INFO:tasks.workunit.client.0.smithi078.stdout:4/134: truncate f6 4502563 0 2024-09-11T00:17:53.708 INFO:tasks.workunit.client.0.smithi078.stdout:0/149: dwrite d2/d3/d7/f2b [0,4194304] 0 2024-09-11T00:17:53.708 INFO:tasks.workunit.client.0.smithi078.stdout:0/150: dread - d2/d3/d7/dc/f1c zero size 2024-09-11T00:17:53.710 INFO:tasks.workunit.client.0.smithi078.stdout:4/135: creat dc/d17/d1b/f28 x:0 0 0 2024-09-11T00:17:53.711 INFO:tasks.workunit.client.0.smithi078.stdout:1/145: write d3/f9 [3184618,50597] 0 2024-09-11T00:17:53.712 INFO:tasks.workunit.client.0.smithi078.stdout:1/146: creat d3/d4/f27 x:0 0 0 2024-09-11T00:17:53.713 INFO:tasks.workunit.client.0.smithi078.stdout:2/182: dwrite d0/d1/d11/d1b/d1e/f2f [0,4194304] 0 2024-09-11T00:17:53.715 INFO:tasks.workunit.client.0.smithi078.stdout:2/183: mkdir d0/d1/d3c 0 2024-09-11T00:17:53.716 INFO:tasks.workunit.client.0.smithi078.stdout:6/138: dwrite d0/d1/d9/d17/f1c [0,4194304] 0 2024-09-11T00:17:53.717 INFO:tasks.workunit.client.0.smithi078.stdout:2/184: mkdir d0/d19/d3d 0 2024-09-11T00:17:53.717 INFO:tasks.workunit.client.0.smithi078.stdout:6/139: write d0/fc [696498,110077] 0 2024-09-11T00:17:53.719 INFO:tasks.workunit.client.0.smithi078.stdout:2/185: creat d0/d31/d3a/f3e x:0 0 0 2024-09-11T00:17:53.720 INFO:tasks.workunit.client.0.smithi078.stdout:6/140: mknod d0/d1/d1b/c36 0 2024-09-11T00:17:53.721 INFO:tasks.workunit.client.0.smithi078.stdout:6/141: creat d0/d33/f37 x:0 0 0 2024-09-11T00:17:53.723 INFO:tasks.workunit.client.0.smithi078.stdout:6/142: mknod d0/d1/c38 0 2024-09-11T00:17:53.726 INFO:tasks.workunit.client.0.smithi078.stdout:6/143: rename d0/d1/f18 to d0/d1/f39 0 2024-09-11T00:17:53.726 INFO:tasks.workunit.client.0.smithi078.stdout:6/144: chown d0/d1/f2 21 1 2024-09-11T00:17:53.727 INFO:tasks.workunit.client.0.smithi078.stdout:1/147: rename d3/d4 to d3/d28 0 2024-09-11T00:17:53.728 INFO:tasks.workunit.client.0.smithi078.stdout:6/145: symlink d0/d1/d9/l3a 0 2024-09-11T00:17:53.728 INFO:tasks.workunit.client.0.smithi078.stdout:6/146: write d0/d33/f37 [722966,122899] 0 2024-09-11T00:17:53.732 INFO:tasks.workunit.client.0.smithi078.stdout:1/148: mkdir d3/d29 0 2024-09-11T00:17:53.735 INFO:tasks.workunit.client.0.smithi078.stdout:1/149: symlink d3/d28/l2a 0 2024-09-11T00:17:53.735 INFO:tasks.workunit.client.0.smithi078.stdout:1/150: write d3/d1a/d21/f22 [141556,7297] 0 2024-09-11T00:17:53.735 INFO:tasks.workunit.client.0.smithi078.stdout:1/151: dread - d3/d28/f19 zero size 2024-09-11T00:17:53.741 INFO:tasks.workunit.client.0.smithi078.stdout:1/152: dread d3/fc [0,4194304] 0 2024-09-11T00:17:53.741 INFO:tasks.workunit.client.0.smithi078.stdout:1/153: fdatasync d3/d1a/ff 0 2024-09-11T00:17:53.742 INFO:tasks.workunit.client.0.smithi078.stdout:1/154: creat d3/d1a/d21/f2b x:0 0 0 2024-09-11T00:17:53.743 INFO:tasks.workunit.client.0.smithi078.stdout:1/155: truncate d3/d1a/ff 1692579 0 2024-09-11T00:17:53.744 INFO:tasks.workunit.client.0.smithi078.stdout:1/156: creat d3/d1a/d21/f2c x:0 0 0 2024-09-11T00:17:53.746 INFO:tasks.workunit.client.0.smithi078.stdout:1/157: creat d3/d1a/f2d x:0 0 0 2024-09-11T00:17:53.746 INFO:tasks.workunit.client.0.smithi078.stdout:1/158: write d3/d1a/d21/f2c [369237,11914] 0 2024-09-11T00:17:53.746 INFO:tasks.workunit.client.0.smithi078.stdout:1/159: dread - d3/d28/f27 zero size 2024-09-11T00:17:53.746 INFO:tasks.workunit.client.0.smithi078.stdout:1/160: creat d3/d29/f2e x:0 0 0 2024-09-11T00:17:53.750 INFO:tasks.workunit.client.0.smithi078.stdout:1/161: write d3/d28/f1f [1102706,82794] 0 2024-09-11T00:17:53.750 INFO:tasks.workunit.client.0.smithi078.stdout:1/162: write d3/d1a/d21/f22 [1141705,127154] 0 2024-09-11T00:17:53.750 INFO:tasks.workunit.client.0.smithi078.stdout:1/163: chown d3/d28/f8 13 1 2024-09-11T00:17:53.751 INFO:tasks.workunit.client.0.smithi078.stdout:1/164: creat d3/d1a/d21/f2f x:0 0 0 2024-09-11T00:17:53.765 INFO:tasks.workunit.client.0.smithi078.stdout:7/111: sync 2024-09-11T00:17:53.766 INFO:tasks.workunit.client.0.smithi078.stdout:7/112: mknod d0/df/c20 0 2024-09-11T00:17:53.766 INFO:tasks.workunit.client.0.smithi078.stdout:7/113: chown d0/df/db/d1b/d1d/l10 27 1 2024-09-11T00:17:53.767 INFO:tasks.workunit.client.0.smithi078.stdout:7/114: symlink d0/df/db/l21 0 2024-09-11T00:17:53.767 INFO:tasks.workunit.client.0.smithi078.stdout:7/115: chown d0/f4 243 1 2024-09-11T00:17:53.767 INFO:tasks.workunit.client.0.smithi078.stdout:7/116: write d0/df/db/d1b/d1d/f13 [280162,34014] 0 2024-09-11T00:17:53.767 INFO:tasks.workunit.client.0.smithi078.stdout:7/117: truncate d0/f1e 1010175 0 2024-09-11T00:17:53.767 INFO:tasks.workunit.client.0.smithi078.stdout:1/165: dwrite d3/d28/f19 [0,4194304] 0 2024-09-11T00:17:53.768 INFO:tasks.workunit.client.0.smithi078.stdout:7/118: symlink d0/df/db/d1b/d1d/d14/l22 0 2024-09-11T00:17:53.769 INFO:tasks.workunit.client.0.smithi078.stdout:1/166: symlink d3/d29/l30 0 2024-09-11T00:17:53.769 INFO:tasks.workunit.client.0.smithi078.stdout:0/151: dread d2/d3/d7/dc/f24 [0,4194304] 0 2024-09-11T00:17:53.769 INFO:tasks.workunit.client.0.smithi078.stdout:6/147: dwrite d0/d33/f34 [0,4194304] 0 2024-09-11T00:17:53.769 INFO:tasks.workunit.client.0.smithi078.stdout:7/119: rmdir d0 39 2024-09-11T00:17:53.770 INFO:tasks.workunit.client.0.smithi078.stdout:1/167: mknod d3/d1a/d21/c31 0 2024-09-11T00:17:53.771 INFO:tasks.workunit.client.0.smithi078.stdout:6/148: creat d0/f3b x:0 0 0 2024-09-11T00:17:53.771 INFO:tasks.workunit.client.0.smithi078.stdout:7/120: truncate d0/f4 2202959 0 2024-09-11T00:17:53.773 INFO:tasks.workunit.client.0.smithi078.stdout:6/149: creat d0/f3c x:0 0 0 2024-09-11T00:17:53.773 INFO:tasks.workunit.client.0.smithi078.stdout:6/150: truncate d0/d1/f39 900170 0 2024-09-11T00:17:53.776 INFO:tasks.workunit.client.0.smithi078.stdout:0/152: dread d2/d3/f22 [0,4194304] 0 2024-09-11T00:17:53.787 INFO:tasks.workunit.client.0.smithi078.stdout:1/168: dwrite d3/fc [4194304,4194304] 0 2024-09-11T00:17:53.788 INFO:tasks.workunit.client.0.smithi078.stdout:6/151: dwrite d0/d33/f34 [0,4194304] 0 2024-09-11T00:17:53.788 INFO:tasks.workunit.client.0.smithi078.stdout:1/169: mknod d3/d28/c32 0 2024-09-11T00:17:53.788 INFO:tasks.workunit.client.0.smithi078.stdout:1/170: fdatasync d3/f1e 0 2024-09-11T00:17:53.789 INFO:tasks.workunit.client.0.smithi078.stdout:6/152: creat d0/d33/f3d x:0 0 0 2024-09-11T00:17:53.790 INFO:tasks.workunit.client.0.smithi078.stdout:1/171: creat d3/d1a/f33 x:0 0 0 2024-09-11T00:17:53.801 INFO:tasks.workunit.client.0.smithi078.stdout:7/121: dwrite d0/df/f1c [0,4194304] 0 2024-09-11T00:17:53.801 INFO:tasks.workunit.client.0.smithi078.stdout:7/122: chown d0 932652743 1 2024-09-11T00:17:53.801 INFO:tasks.workunit.client.0.smithi078.stdout:6/153: write d0/f31 [2671343,40464] 0 2024-09-11T00:17:53.802 INFO:tasks.workunit.client.0.smithi078.stdout:7/123: symlink d0/l23 0 2024-09-11T00:17:53.803 INFO:tasks.workunit.client.0.smithi078.stdout:6/154: getdents d0/d1/d2c 0 2024-09-11T00:17:53.805 INFO:tasks.workunit.client.0.smithi078.stdout:7/124: creat d0/df/f24 x:0 0 0 2024-09-11T00:17:53.805 INFO:tasks.workunit.client.0.smithi078.stdout:6/155: symlink d0/d1/d9/d17/l3e 0 2024-09-11T00:17:53.806 INFO:tasks.workunit.client.0.smithi078.stdout:6/156: write d0/fc [565215,98519] 0 2024-09-11T00:17:53.806 INFO:tasks.workunit.client.0.smithi078.stdout:7/125: symlink d0/df/db/d1b/d1d/l25 0 2024-09-11T00:17:53.807 INFO:tasks.workunit.client.0.smithi078.stdout:6/157: mknod d0/d1/d2c/c3f 0 2024-09-11T00:17:53.808 INFO:tasks.workunit.client.0.smithi078.stdout:7/126: mknod d0/df/c26 0 2024-09-11T00:17:53.808 INFO:tasks.workunit.client.0.smithi078.stdout:6/158: creat d0/d1/d1b/f40 x:0 0 0 2024-09-11T00:17:53.810 INFO:tasks.workunit.client.0.smithi078.stdout:0/153: dwrite d2/d3/d7/f13 [0,4194304] 0 2024-09-11T00:17:53.810 INFO:tasks.workunit.client.0.smithi078.stdout:1/172: dwrite d3/f17 [4194304,4194304] 0 2024-09-11T00:17:53.812 INFO:tasks.workunit.client.0.smithi078.stdout:0/154: creat d2/d2a/d2c/f32 x:0 0 0 2024-09-11T00:17:53.812 INFO:tasks.workunit.client.0.smithi078.stdout:0/155: truncate d2/d3/d7/dc/f1a 504719 0 2024-09-11T00:17:53.812 INFO:tasks.workunit.client.0.smithi078.stdout:1/173: stat d3/c14 0 2024-09-11T00:17:53.813 INFO:tasks.workunit.client.0.smithi078.stdout:0/156: getdents d2/d3/d7/dc 0 2024-09-11T00:17:53.813 INFO:tasks.workunit.client.0.smithi078.stdout:0/157: write d2/d3/d7/dc/f31 [4143,13593] 0 2024-09-11T00:17:53.814 INFO:tasks.workunit.client.0.smithi078.stdout:0/158: write d2/d2a/d2c/f32 [1024253,117809] 0 2024-09-11T00:17:53.814 INFO:tasks.workunit.client.0.smithi078.stdout:0/159: read d2/d3/d7/dc/f1a [338629,126460] 0 2024-09-11T00:17:53.814 INFO:tasks.workunit.client.0.smithi078.stdout:0/160: truncate d2/d2a/f2f 419652 0 2024-09-11T00:17:53.815 INFO:tasks.workunit.client.0.smithi078.stdout:1/174: rename d3/d28/f19 to d3/d29/f34 0 2024-09-11T00:17:53.816 INFO:tasks.workunit.client.0.smithi078.stdout:1/175: stat d3/l20 0 2024-09-11T00:17:53.816 INFO:tasks.workunit.client.0.smithi078.stdout:1/176: fdatasync d3/d28/f8 0 2024-09-11T00:17:53.818 INFO:tasks.workunit.client.0.smithi078.stdout:1/177: mkdir d3/d1a/d35 0 2024-09-11T00:17:53.818 INFO:tasks.workunit.client.0.smithi078.stdout:0/161: dread d2/d3/d7/f15 [0,4194304] 0 2024-09-11T00:17:53.818 INFO:tasks.workunit.client.0.smithi078.stdout:0/162: truncate d2/d3/d7/dc/f1a 1257148 0 2024-09-11T00:17:53.818 INFO:tasks.workunit.client.0.smithi078.stdout:0/163: stat d2/d3/d7 0 2024-09-11T00:17:53.818 INFO:tasks.workunit.client.0.smithi078.stdout:0/164: stat d2/l1e 0 2024-09-11T00:17:53.818 INFO:tasks.workunit.client.0.smithi078.stdout:0/165: fsync d2/d3/d7/fa 0 2024-09-11T00:17:53.818 INFO:tasks.workunit.client.0.smithi078.stdout:0/166: truncate d2/d3/d7/dc/f24 5187375 0 2024-09-11T00:17:53.819 INFO:tasks.workunit.client.0.smithi078.stdout:6/159: dread d0/d1/d9/f15 [0,4194304] 0 2024-09-11T00:17:53.819 INFO:tasks.workunit.client.0.smithi078.stdout:1/178: unlink d3/d1a/d21/f2b 0 2024-09-11T00:17:53.819 INFO:tasks.workunit.client.0.smithi078.stdout:1/179: stat d3/f1c 0 2024-09-11T00:17:53.821 INFO:tasks.workunit.client.0.smithi078.stdout:6/160: creat d0/d1/f41 x:0 0 0 2024-09-11T00:17:53.821 INFO:tasks.workunit.client.0.smithi078.stdout:6/161: fdatasync d0/f1a 0 2024-09-11T00:17:53.821 INFO:tasks.workunit.client.0.smithi078.stdout:6/162: truncate d0/d1/f41 203624 0 2024-09-11T00:17:53.822 INFO:tasks.workunit.client.0.smithi078.stdout:1/180: rename d3/d28/l16 to d3/d1a/d21/l36 0 2024-09-11T00:17:53.822 INFO:tasks.workunit.client.0.smithi078.stdout:1/181: truncate d3/d1a/f2d 500977 0 2024-09-11T00:17:53.822 INFO:tasks.workunit.client.0.smithi078.stdout:1/182: write d3/d28/f1f [2549939,79918] 0 2024-09-11T00:17:53.825 INFO:tasks.workunit.client.0.smithi078.stdout:1/183: dread d3/fc [0,4194304] 0 2024-09-11T00:17:53.826 INFO:tasks.workunit.client.0.smithi078.stdout:7/127: dwrite d0/df/f1c [0,4194304] 0 2024-09-11T00:17:53.826 INFO:tasks.workunit.client.0.smithi078.stdout:7/128: chown d0/df/db/cc 33 1 2024-09-11T00:17:53.826 INFO:tasks.workunit.client.0.smithi078.stdout:1/184: symlink d3/d29/l37 0 2024-09-11T00:17:53.832 INFO:tasks.workunit.client.0.smithi078.stdout:6/163: truncate d0/d33/f37 44027 0 2024-09-11T00:17:53.840 INFO:tasks.workunit.client.0.smithi078.stdout:0/167: dwrite d2/f16 [4194304,4194304] 0 2024-09-11T00:17:53.841 INFO:tasks.workunit.client.0.smithi078.stdout:7/129: dwrite d0/df/db/d1b/d1d/fe [4194304,4194304] 0 2024-09-11T00:17:53.842 INFO:tasks.workunit.client.0.smithi078.stdout:1/185: write d3/f17 [30943,99121] 0 2024-09-11T00:17:53.843 INFO:tasks.workunit.client.0.smithi078.stdout:0/168: symlink d2/l33 0 2024-09-11T00:17:53.843 INFO:tasks.workunit.client.0.smithi078.stdout:0/169: readlink d2/l33 0 2024-09-11T00:17:53.844 INFO:tasks.workunit.client.0.smithi078.stdout:6/164: dread d0/d1/d1b/f21 [0,4194304] 0 2024-09-11T00:17:53.844 INFO:tasks.workunit.client.0.smithi078.stdout:6/165: write d0/f3c [906027,73556] 0 2024-09-11T00:17:53.853 INFO:tasks.workunit.client.0.smithi078.stdout:7/130: rename d0/f4 to d0/df/db/d1b/f27 0 2024-09-11T00:17:53.854 INFO:tasks.workunit.client.0.smithi078.stdout:0/170: mknod d2/d3/d7/dc/c34 0 2024-09-11T00:17:53.856 INFO:tasks.workunit.client.0.smithi078.stdout:7/131: rename d0/df/db/d1b/d1d/d1a to d0/df/db/d1b/d28 0 2024-09-11T00:17:53.857 INFO:tasks.workunit.client.0.smithi078.stdout:0/171: mkdir d2/d2a/d2c/d35 0 2024-09-11T00:17:53.858 INFO:tasks.workunit.client.0.smithi078.stdout:6/166: mknod d0/c42 0 2024-09-11T00:17:53.859 INFO:tasks.workunit.client.0.smithi078.stdout:7/132: creat d0/f29 x:0 0 0 2024-09-11T00:17:53.859 INFO:tasks.workunit.client.0.smithi078.stdout:7/133: stat d0/df/db/d1b 0 2024-09-11T00:17:53.859 INFO:tasks.workunit.client.0.smithi078.stdout:7/134: truncate d0/f29 668897 0 2024-09-11T00:17:53.859 INFO:tasks.workunit.client.0.smithi078.stdout:1/186: dwrite d3/d1a/d21/f24 [0,4194304] 0 2024-09-11T00:17:53.860 INFO:tasks.workunit.client.0.smithi078.stdout:0/172: symlink d2/d2a/d2c/d35/l36 0 2024-09-11T00:17:53.860 INFO:tasks.workunit.client.0.smithi078.stdout:6/167: symlink d0/d1/d1b/l43 0 2024-09-11T00:17:53.861 INFO:tasks.workunit.client.0.smithi078.stdout:7/135: creat d0/df/db/d1b/d1d/d14/f2a x:0 0 0 2024-09-11T00:17:53.863 INFO:tasks.workunit.client.0.smithi078.stdout:7/136: dread d0/df/db/d1b/d1d/f13 [0,4194304] 0 2024-09-11T00:17:53.863 INFO:tasks.workunit.client.0.smithi078.stdout:1/187: creat d3/d1a/d35/f38 x:0 0 0 2024-09-11T00:17:53.864 INFO:tasks.workunit.client.0.smithi078.stdout:9/82: sync 2024-09-11T00:17:53.864 INFO:tasks.workunit.client.0.smithi078.stdout:5/91: sync 2024-09-11T00:17:53.864 INFO:tasks.workunit.client.0.smithi078.stdout:3/141: sync 2024-09-11T00:17:53.865 INFO:tasks.workunit.client.0.smithi078.stdout:6/168: creat d0/d1/d1b/f44 x:0 0 0 2024-09-11T00:17:53.865 INFO:tasks.workunit.client.0.smithi078.stdout:1/188: mkdir d3/d28/d39 0 2024-09-11T00:17:53.866 INFO:tasks.workunit.client.0.smithi078.stdout:5/92: creat d7/d8/de/f21 x:0 0 0 2024-09-11T00:17:53.866 INFO:tasks.workunit.client.0.smithi078.stdout:9/83: symlink dc/l1a 0 2024-09-11T00:17:53.867 INFO:tasks.workunit.client.0.smithi078.stdout:1/189: read d3/d1a/d21/f2c [128630,48225] 0 2024-09-11T00:17:53.867 INFO:tasks.workunit.client.0.smithi078.stdout:1/190: write d3/f9 [5621925,127173] 0 2024-09-11T00:17:53.869 INFO:tasks.workunit.client.0.smithi078.stdout:6/169: creat d0/d1/d1b/f45 x:0 0 0 2024-09-11T00:17:53.869 INFO:tasks.workunit.client.0.smithi078.stdout:6/170: stat d0/d33/f34 0 2024-09-11T00:17:53.869 INFO:tasks.workunit.client.0.smithi078.stdout:6/171: stat d0/fc 0 2024-09-11T00:17:53.869 INFO:tasks.workunit.client.0.smithi078.stdout:6/172: fdatasync d0/f3b 0 2024-09-11T00:17:53.870 INFO:tasks.workunit.client.0.smithi078.stdout:5/93: mkdir d7/d8/d13/d22 0 2024-09-11T00:17:53.870 INFO:tasks.workunit.client.0.smithi078.stdout:1/191: creat d3/d1a/d35/f3a x:0 0 0 2024-09-11T00:17:53.873 INFO:tasks.workunit.client.0.smithi078.stdout:5/94: mknod d7/d8/de/c23 0 2024-09-11T00:17:53.874 INFO:tasks.workunit.client.0.smithi078.stdout:1/192: creat d3/d28/d39/f3b x:0 0 0 2024-09-11T00:17:53.874 INFO:tasks.workunit.client.0.smithi078.stdout:6/173: rename d0/d1/d9/d17/c23 to d0/c46 0 2024-09-11T00:17:53.875 INFO:tasks.workunit.client.0.smithi078.stdout:1/193: symlink d3/d1a/d21/l3c 0 2024-09-11T00:17:53.877 INFO:tasks.workunit.client.0.smithi078.stdout:5/95: rename d7/d8/d9 to d7/d8/d13/d1d/d24 0 2024-09-11T00:17:53.878 INFO:tasks.workunit.client.0.smithi078.stdout:6/174: symlink d0/d1/d2c/l47 0 2024-09-11T00:17:53.878 INFO:tasks.workunit.client.0.smithi078.stdout:6/175: stat d0/d1/d1b 0 2024-09-11T00:17:53.878 INFO:tasks.workunit.client.0.smithi078.stdout:6/176: chown d0/d1/c14 3 1 2024-09-11T00:17:53.878 INFO:tasks.workunit.client.0.smithi078.stdout:5/96: mkdir d7/d8/d13/d22/d25 0 2024-09-11T00:17:53.883 INFO:tasks.workunit.client.0.smithi078.stdout:6/177: dread d0/fc [0,4194304] 0 2024-09-11T00:17:53.883 INFO:tasks.workunit.client.0.smithi078.stdout:6/178: write d0/fc [1431451,72667] 0 2024-09-11T00:17:53.884 INFO:tasks.workunit.client.0.smithi078.stdout:6/179: chown d0/d1/d2c/l35 96 1 2024-09-11T00:17:53.889 INFO:tasks.workunit.client.0.smithi078.stdout:0/173: dwrite d2/d3/d7/dc/f1c [0,4194304] 0 2024-09-11T00:17:53.892 INFO:tasks.workunit.client.0.smithi078.stdout:0/174: symlink d2/d3/d7/dc/d23/l37 0 2024-09-11T00:17:53.892 INFO:tasks.workunit.client.0.smithi078.stdout:0/175: creat d2/d3/d7/dc/f38 x:0 0 0 2024-09-11T00:17:53.893 INFO:tasks.workunit.client.0.smithi078.stdout:0/176: chown d2/c26 20 1 2024-09-11T00:17:53.897 INFO:tasks.workunit.client.0.smithi078.stdout:7/137: dwrite d0/f29 [0,4194304] 0 2024-09-11T00:17:53.897 INFO:tasks.workunit.client.0.smithi078.stdout:7/138: readlink d0/l23 0 2024-09-11T00:17:53.897 INFO:tasks.workunit.client.0.smithi078.stdout:7/139: fsync d0/df/db/d1b/d1d/fe 0 2024-09-11T00:17:53.899 INFO:tasks.workunit.client.0.smithi078.stdout:6/180: truncate d0/fc 1121019 0 2024-09-11T00:17:53.899 INFO:tasks.workunit.client.0.smithi078.stdout:3/142: dwrite d0/d7/fe [0,4194304] 0 2024-09-11T00:17:53.901 INFO:tasks.workunit.client.0.smithi078.stdout:7/140: truncate d0/df/db/d1b/d1d/fe 3511785 0 2024-09-11T00:17:53.901 INFO:tasks.workunit.client.0.smithi078.stdout:7/141: fsync d0/df/db/d1b/d1d/d14/f2a 0 2024-09-11T00:17:53.901 INFO:tasks.workunit.client.0.smithi078.stdout:7/142: fdatasync d0/df/db/d1b/f27 0 2024-09-11T00:17:53.902 INFO:tasks.workunit.client.0.smithi078.stdout:6/181: truncate d0/d1/d9/f24 1082248 0 2024-09-11T00:17:53.903 INFO:tasks.workunit.client.0.smithi078.stdout:3/143: truncate d0/d7/d18/d1b/d27/f28 514838 0 2024-09-11T00:17:53.903 INFO:tasks.workunit.client.0.smithi078.stdout:5/97: dwrite d7/d8/d13/d1d/d24/d1c/d1e/f20 [4194304,4194304] 0 2024-09-11T00:17:53.903 INFO:tasks.workunit.client.0.smithi078.stdout:7/143: symlink d0/df/db/l2b 0 2024-09-11T00:17:53.905 INFO:tasks.workunit.client.0.smithi078.stdout:5/98: mkdir d7/d8/d13/d1d/d24/d1c/d1e/d26 0 2024-09-11T00:17:53.906 INFO:tasks.workunit.client.0.smithi078.stdout:5/99: mknod d7/d8/d13/d1d/d24/d1c/c27 0 2024-09-11T00:17:53.909 INFO:tasks.workunit.client.0.smithi078.stdout:1/194: dwrite d3/d28/f1f [0,4194304] 0 2024-09-11T00:17:53.914 INFO:tasks.workunit.client.0.smithi078.stdout:1/195: write d3/fc [3173368,15191] 0 2024-09-11T00:17:53.915 INFO:tasks.workunit.client.0.smithi078.stdout:1/196: mknod d3/d1a/d35/c3d 0 2024-09-11T00:17:53.916 INFO:tasks.workunit.client.0.smithi078.stdout:6/182: write d0/fc [925446,90369] 0 2024-09-11T00:17:53.916 INFO:tasks.workunit.client.0.smithi078.stdout:6/183: truncate d0/d1/f2f 774164 0 2024-09-11T00:17:53.916 INFO:tasks.workunit.client.0.smithi078.stdout:6/184: fdatasync d0/d1/d9/f16 0 2024-09-11T00:17:53.917 INFO:tasks.workunit.client.0.smithi078.stdout:5/100: rename d7/d8/d13/d1d to d7/d8/d13/d22/d25/d28 0 2024-09-11T00:17:53.917 INFO:tasks.workunit.client.0.smithi078.stdout:5/101: truncate d7/d8/de/f11 1214706 0 2024-09-11T00:17:53.917 INFO:tasks.workunit.client.0.smithi078.stdout:7/144: read d0/df/db/f15 [637777,97888] 0 2024-09-11T00:17:53.919 INFO:tasks.workunit.client.0.smithi078.stdout:6/185: unlink d0/d1/d1b/f40 0 2024-09-11T00:17:53.920 INFO:tasks.workunit.client.0.smithi078.stdout:3/144: dwrite d0/f2 [0,4194304] 0 2024-09-11T00:17:53.920 INFO:tasks.workunit.client.0.smithi078.stdout:3/145: fdatasync d0/f8 0 2024-09-11T00:17:53.920 INFO:tasks.workunit.client.0.smithi078.stdout:5/102: mknod d7/d8/d13/c29 0 2024-09-11T00:17:53.922 INFO:tasks.workunit.client.0.smithi078.stdout:9/84: dwrite dc/d12/f13 [0,4194304] 0 2024-09-11T00:17:53.922 INFO:tasks.workunit.client.0.smithi078.stdout:6/186: rename d0/f1a to d0/d33/f48 0 2024-09-11T00:17:53.922 INFO:tasks.workunit.client.0.smithi078.stdout:6/187: write d0/f3c [1242953,34531] 0 2024-09-11T00:17:53.923 INFO:tasks.workunit.client.0.smithi078.stdout:5/103: mkdir d7/d8/d13/d22/d25/d28/d24/d1c/d1e/d26/d2a 0 2024-09-11T00:17:53.932 INFO:tasks.workunit.client.0.smithi078.stdout:9/85: link dc/ld dc/d12/l1b 0 2024-09-11T00:17:53.932 INFO:tasks.workunit.client.0.smithi078.stdout:6/188: mknod d0/d1/d1b/c49 0 2024-09-11T00:17:53.933 INFO:tasks.workunit.client.0.smithi078.stdout:6/189: write d0/d1/d9/f16 [108607,97314] 0 2024-09-11T00:17:53.934 INFO:tasks.workunit.client.0.smithi078.stdout:6/190: fsync d0/d1/fe 0 2024-09-11T00:17:53.934 INFO:tasks.workunit.client.0.smithi078.stdout:1/197: dwrite d3/d28/f27 [0,4194304] 0 2024-09-11T00:17:53.934 INFO:tasks.workunit.client.0.smithi078.stdout:1/198: stat d3/d1a/ff 0 2024-09-11T00:17:53.936 INFO:tasks.workunit.client.0.smithi078.stdout:9/86: rename dc/d12/f18 to dc/f1c 0 2024-09-11T00:17:53.937 INFO:tasks.workunit.client.0.smithi078.stdout:6/191: fsync d0/d1/d1b/f21 0 2024-09-11T00:17:53.937 INFO:tasks.workunit.client.0.smithi078.stdout:6/192: stat d0/d1/d1b/l43 0 2024-09-11T00:17:53.937 INFO:tasks.workunit.client.0.smithi078.stdout:5/104: dread d7/d8/d13/d22/d25/d28/d24/d1c/d1e/f20 [0,4194304] 0 2024-09-11T00:17:53.941 INFO:tasks.workunit.client.0.smithi078.stdout:1/199: dread d3/d28/f27 [0,4194304] 0 2024-09-11T00:17:53.942 INFO:tasks.workunit.client.0.smithi078.stdout:6/193: rename d0/d1/d1b/f44 to d0/d1/d9/f4a 0 2024-09-11T00:17:53.942 INFO:tasks.workunit.client.0.smithi078.stdout:3/146: dwrite d0/f2 [0,4194304] 0 2024-09-11T00:17:53.943 INFO:tasks.workunit.client.0.smithi078.stdout:5/105: unlink d7/d8/de/f19 0 2024-09-11T00:17:53.943 INFO:tasks.workunit.client.0.smithi078.stdout:5/106: rename d7/d8 to d7/d8/d13/d22/d25/d28/d2b 22 2024-09-11T00:17:53.944 INFO:tasks.workunit.client.0.smithi078.stdout:1/200: mknod d3/d1a/d21/c3e 0 2024-09-11T00:17:53.945 INFO:tasks.workunit.client.0.smithi078.stdout:6/194: truncate d0/d33/f37 16623 0 2024-09-11T00:17:53.945 INFO:tasks.workunit.client.0.smithi078.stdout:6/195: chown d0/l26 46976582 1 2024-09-11T00:17:53.945 INFO:tasks.workunit.client.0.smithi078.stdout:6/196: readlink d0/d1/d9/l2a 0 2024-09-11T00:17:53.946 INFO:tasks.workunit.client.0.smithi078.stdout:1/201: creat d3/d1a/d35/f3f x:0 0 0 2024-09-11T00:17:53.946 INFO:tasks.workunit.client.0.smithi078.stdout:8/138: sync 2024-09-11T00:17:53.946 INFO:tasks.workunit.client.0.smithi078.stdout:8/139: chown da/d1c/c26 36266840 1 2024-09-11T00:17:53.947 INFO:tasks.workunit.client.0.smithi078.stdout:8/140: stat da/d1c 0 2024-09-11T00:17:53.947 INFO:tasks.workunit.client.0.smithi078.stdout:8/141: stat da/f14 0 2024-09-11T00:17:53.947 INFO:tasks.workunit.client.0.smithi078.stdout:8/142: fdatasync da/d13/d19/f1a 0 2024-09-11T00:17:53.947 INFO:tasks.workunit.client.0.smithi078.stdout:5/107: dread d7/d8/de/f10 [0,4194304] 0 2024-09-11T00:17:53.948 INFO:tasks.workunit.client.0.smithi078.stdout:8/143: rename c3 to da/d13/d1b/d24/c2d 0 2024-09-11T00:17:53.948 INFO:tasks.workunit.client.0.smithi078.stdout:8/144: fdatasync da/fe 0 2024-09-11T00:17:53.950 INFO:tasks.workunit.client.0.smithi078.stdout:5/108: mkdir d7/d8/de/d2c 0 2024-09-11T00:17:53.951 INFO:tasks.workunit.client.0.smithi078.stdout:8/145: creat da/d13/d1b/f2e x:0 0 0 2024-09-11T00:17:53.951 INFO:tasks.workunit.client.0.smithi078.stdout:8/146: chown da/l2b 15 1 2024-09-11T00:17:53.952 INFO:tasks.workunit.client.0.smithi078.stdout:1/202: dread d3/d1a/d21/f22 [0,4194304] 0 2024-09-11T00:17:53.952 INFO:tasks.workunit.client.0.smithi078.stdout:1/203: truncate d3/d1a/d35/f38 317824 0 2024-09-11T00:17:53.953 INFO:tasks.workunit.client.0.smithi078.stdout:9/87: dread dc/d12/f13 [0,4194304] 0 2024-09-11T00:17:53.953 INFO:tasks.workunit.client.0.smithi078.stdout:9/88: readlink dc/l1a 0 2024-09-11T00:17:53.953 INFO:tasks.workunit.client.0.smithi078.stdout:9/89: truncate dc/d12/f17 103585 0 2024-09-11T00:17:53.953 INFO:tasks.workunit.client.0.smithi078.stdout:9/90: chown fb 515 1 2024-09-11T00:17:53.953 INFO:tasks.workunit.client.0.smithi078.stdout:8/147: creat da/f2f x:0 0 0 2024-09-11T00:17:53.954 INFO:tasks.workunit.client.0.smithi078.stdout:1/204: creat d3/f40 x:0 0 0 2024-09-11T00:17:53.954 INFO:tasks.workunit.client.0.smithi078.stdout:1/205: readlink d3/d1a/d21/l26 0 2024-09-11T00:17:53.954 INFO:tasks.workunit.client.0.smithi078.stdout:7/145: dwrite d0/f1e [0,4194304] 0 2024-09-11T00:17:53.956 INFO:tasks.workunit.client.0.smithi078.stdout:8/148: rename da/f21 to da/f30 0 2024-09-11T00:17:53.956 INFO:tasks.workunit.client.0.smithi078.stdout:8/149: write da/f12 [4537059,128116] 0 2024-09-11T00:17:53.956 INFO:tasks.workunit.client.0.smithi078.stdout:8/150: chown da/d1c/d1e/c22 6092 1 2024-09-11T00:17:53.957 INFO:tasks.workunit.client.0.smithi078.stdout:8/151: write da/fe [870095,22915] 0 2024-09-11T00:17:53.957 INFO:tasks.workunit.client.0.smithi078.stdout:8/152: truncate da/d13/d19/f1a 1082630 0 2024-09-11T00:17:53.957 INFO:tasks.workunit.client.0.smithi078.stdout:1/206: mknod d3/d28/d39/c41 0 2024-09-11T00:17:53.957 INFO:tasks.workunit.client.0.smithi078.stdout:1/207: read d3/d28/f8 [53025,85243] 0 2024-09-11T00:17:53.959 INFO:tasks.workunit.client.0.smithi078.stdout:7/146: rmdir d0/df/db/d1b/d1d 39 2024-09-11T00:17:53.960 INFO:tasks.workunit.client.0.smithi078.stdout:8/153: creat da/d13/f31 x:0 0 0 2024-09-11T00:17:53.962 INFO:tasks.workunit.client.0.smithi078.stdout:1/208: rename d3/c1d to d3/d1a/d21/c42 0 2024-09-11T00:17:53.965 INFO:tasks.workunit.client.0.smithi078.stdout:8/154: creat da/d13/d28/f32 x:0 0 0 2024-09-11T00:17:53.968 INFO:tasks.workunit.client.0.smithi078.stdout:8/155: symlink da/d1c/l33 0 2024-09-11T00:17:53.968 INFO:tasks.workunit.client.0.smithi078.stdout:8/156: write da/f10 [4247894,38599] 0 2024-09-11T00:17:53.969 INFO:tasks.workunit.client.0.smithi078.stdout:8/157: truncate da/d13/f2c 5040067 0 2024-09-11T00:17:53.969 INFO:tasks.workunit.client.0.smithi078.stdout:3/147: dwrite d0/f6 [0,4194304] 0 2024-09-11T00:17:53.969 INFO:tasks.workunit.client.0.smithi078.stdout:3/148: stat d0/d7/d18/d1b/f14 0 2024-09-11T00:17:53.970 INFO:tasks.workunit.client.0.smithi078.stdout:3/149: write d0/d7/d23/f2d [642055,111300] 0 2024-09-11T00:17:53.975 INFO:tasks.workunit.client.0.smithi078.stdout:3/150: mknod d0/d1a/d1e/c2f 0 2024-09-11T00:17:53.975 INFO:tasks.workunit.client.0.smithi078.stdout:3/151: chown d0/d7/d18/d1b 250513 1 2024-09-11T00:17:53.975 INFO:tasks.workunit.client.0.smithi078.stdout:5/109: dwrite d7/d8/de/ff [4194304,4194304] 0 2024-09-11T00:17:53.976 INFO:tasks.workunit.client.0.smithi078.stdout:5/110: readlink d7/d8/de/l18 0 2024-09-11T00:17:53.978 INFO:tasks.workunit.client.0.smithi078.stdout:7/147: write d0/f1e [4546060,58138] 0 2024-09-11T00:17:53.981 INFO:tasks.workunit.client.0.smithi078.stdout:3/152: write d0/f2 [755876,6244] 0 2024-09-11T00:17:53.981 INFO:tasks.workunit.client.0.smithi078.stdout:3/153: readlink d0/d7/d23/l2a 0 2024-09-11T00:17:53.982 INFO:tasks.workunit.client.0.smithi078.stdout:5/111: creat d7/d8/d13/d22/f2d x:0 0 0 2024-09-11T00:17:53.983 INFO:tasks.workunit.client.0.smithi078.stdout:6/197: dwrite d0/d33/f37 [0,4194304] 0 2024-09-11T00:17:53.983 INFO:tasks.workunit.client.0.smithi078.stdout:6/198: readlink d0/d1/d2c/l47 0 2024-09-11T00:17:53.983 INFO:tasks.workunit.client.0.smithi078.stdout:6/199: chown d0/d1/d1b 15393 1 2024-09-11T00:17:53.983 INFO:tasks.workunit.client.0.smithi078.stdout:6/200: dread - d0/d1/d9/f4a zero size 2024-09-11T00:17:53.983 INFO:tasks.workunit.client.0.smithi078.stdout:7/148: creat d0/df/db/d1b/d1d/f2c x:0 0 0 2024-09-11T00:17:53.983 INFO:tasks.workunit.client.0.smithi078.stdout:7/149: readlink d0/l23 0 2024-09-11T00:17:53.984 INFO:tasks.workunit.client.0.smithi078.stdout:5/112: dread d7/d8/de/f10 [0,4194304] 0 2024-09-11T00:17:53.985 INFO:tasks.workunit.client.0.smithi078.stdout:5/113: write d7/f1f [531140,43092] 0 2024-09-11T00:17:53.986 INFO:tasks.workunit.client.0.smithi078.stdout:6/201: rename d0/d1/d9/d17/c28 to d0/c4b 0 2024-09-11T00:17:53.986 INFO:tasks.workunit.client.0.smithi078.stdout:6/202: fsync d0/d33/f37 0 2024-09-11T00:17:53.986 INFO:tasks.workunit.client.0.smithi078.stdout:6/203: write d0/d1/d9/f4a [907573,600] 0 2024-09-11T00:17:53.986 INFO:tasks.workunit.client.0.smithi078.stdout:5/114: unlink d7/d8/d13/d22/d25/d28/d24/d1c/c27 0 2024-09-11T00:17:53.986 INFO:tasks.workunit.client.0.smithi078.stdout:5/115: chown d7/d8/d13/d22/d25/d28/d24/d1c/d1e/d26/d2a 49657064 1 2024-09-11T00:17:53.987 INFO:tasks.workunit.client.0.smithi078.stdout:7/150: rename d0/df/db/d1b/d1d/d14/l22 to d0/df/db/d1b/d1d/l2d 0 2024-09-11T00:17:53.989 INFO:tasks.workunit.client.0.smithi078.stdout:7/151: creat d0/df/db/f2e x:0 0 0 2024-09-11T00:17:53.990 INFO:tasks.workunit.client.0.smithi078.stdout:7/152: mkdir d0/df/db/d2f 0 2024-09-11T00:17:53.990 INFO:tasks.workunit.client.0.smithi078.stdout:7/153: readlink d0/df/db/l2b 0 2024-09-11T00:17:53.990 INFO:tasks.workunit.client.0.smithi078.stdout:9/91: dwrite dc/d12/f17 [0,4194304] 0 2024-09-11T00:17:53.991 INFO:tasks.workunit.client.0.smithi078.stdout:9/92: write fb [5082475,51298] 0 2024-09-11T00:17:53.995 INFO:tasks.workunit.client.0.smithi078.stdout:8/158: dwrite da/f2a [0,4194304] 0 2024-09-11T00:17:53.995 INFO:tasks.workunit.client.0.smithi078.stdout:8/159: read da/f14 [1750662,53757] 0 2024-09-11T00:17:53.995 INFO:tasks.workunit.client.0.smithi078.stdout:8/160: truncate da/f30 97595 0 2024-09-11T00:17:53.996 INFO:tasks.workunit.client.0.smithi078.stdout:9/93: mknod dc/d12/c1d 0 2024-09-11T00:17:53.996 INFO:tasks.workunit.client.0.smithi078.stdout:9/94: write f4 [4288516,39349] 0 2024-09-11T00:17:53.997 INFO:tasks.workunit.client.0.smithi078.stdout:5/116: dread d7/d8/d13/d22/d25/d28/d24/d1c/d1e/f20 [0,4194304] 0 2024-09-11T00:17:53.998 INFO:tasks.workunit.client.0.smithi078.stdout:9/95: creat dc/f1e x:0 0 0 2024-09-11T00:17:54.000 INFO:tasks.workunit.client.0.smithi078.stdout:5/117: creat d7/d8/d13/d22/d25/d28/d24/d1c/f2e x:0 0 0 2024-09-11T00:17:54.001 INFO:tasks.workunit.client.0.smithi078.stdout:3/154: dwrite d0/f3 [0,4194304] 0 2024-09-11T00:17:54.002 INFO:tasks.workunit.client.0.smithi078.stdout:5/118: mknod d7/d8/de/c2f 0 2024-09-11T00:17:54.002 INFO:tasks.workunit.client.0.smithi078.stdout:5/119: truncate d7/d8/de/ff 9331937 0 2024-09-11T00:17:54.002 INFO:tasks.workunit.client.0.smithi078.stdout:5/120: fsync d7/d8/de/f11 0 2024-09-11T00:17:54.003 INFO:tasks.workunit.client.0.smithi078.stdout:3/155: dread d0/d7/d18/d1b/d27/f28 [0,4194304] 0 2024-09-11T00:17:54.005 INFO:tasks.workunit.client.0.smithi078.stdout:3/156: rename d0/d7/fe to d0/d1a/d1e/f30 0 2024-09-11T00:17:54.007 INFO:tasks.workunit.client.0.smithi078.stdout:2/186: sync 2024-09-11T00:17:54.007 INFO:tasks.workunit.client.0.smithi078.stdout:4/136: sync 2024-09-11T00:17:54.007 INFO:tasks.workunit.client.0.smithi078.stdout:2/187: truncate d0/d31/d3a/f3e 583281 0 2024-09-11T00:17:54.008 INFO:tasks.workunit.client.0.smithi078.stdout:6/204: dwrite d0/d1/f32 [0,4194304] 0 2024-09-11T00:17:54.008 INFO:tasks.workunit.client.0.smithi078.stdout:6/205: fsync d0/d1/d9/f15 0 2024-09-11T00:17:54.008 INFO:tasks.workunit.client.0.smithi078.stdout:7/154: dwrite d0/df/db/f2e [0,4194304] 0 2024-09-11T00:17:54.008 INFO:tasks.workunit.client.0.smithi078.stdout:7/155: truncate d0/df/db/d1b/d1d/f2c 109826 0 2024-09-11T00:17:54.009 INFO:tasks.workunit.client.0.smithi078.stdout:9/96: getdents dc 0 2024-09-11T00:17:54.009 INFO:tasks.workunit.client.0.smithi078.stdout:2/188: dread d0/d1/fe [0,4194304] 0 2024-09-11T00:17:54.010 INFO:tasks.workunit.client.0.smithi078.stdout:6/206: unlink d0/d1/lf 0 2024-09-11T00:17:54.010 INFO:tasks.workunit.client.0.smithi078.stdout:6/207: stat d0/d1/d2c 0 2024-09-11T00:17:54.011 INFO:tasks.workunit.client.0.smithi078.stdout:9/97: mknod dc/d12/c1f 0 2024-09-11T00:17:54.013 INFO:tasks.workunit.client.0.smithi078.stdout:6/208: symlink d0/d33/l4c 0 2024-09-11T00:17:54.014 INFO:tasks.workunit.client.0.smithi078.stdout:6/209: rmdir d0/d1/d1b 39 2024-09-11T00:17:54.016 INFO:tasks.workunit.client.0.smithi078.stdout:6/210: rmdir d0/d1 39 2024-09-11T00:17:54.016 INFO:tasks.workunit.client.0.smithi078.stdout:7/156: dread d0/df/db/f2e [0,4194304] 0 2024-09-11T00:17:54.017 INFO:tasks.workunit.client.0.smithi078.stdout:6/211: symlink d0/d1/d9/l4d 0 2024-09-11T00:17:54.018 INFO:tasks.workunit.client.0.smithi078.stdout:7/157: rename d0/df/db/d1b to d0/df/db/d30 0 2024-09-11T00:17:54.020 INFO:tasks.workunit.client.0.smithi078.stdout:6/212: creat d0/d33/f4e x:0 0 0 2024-09-11T00:17:54.024 INFO:tasks.workunit.client.0.smithi078.stdout:5/121: dwrite d7/d8/d13/d22/f2d [0,4194304] 0 2024-09-11T00:17:54.031 INFO:tasks.workunit.client.0.smithi078.stdout:4/137: dwrite f6 [0,4194304] 0 2024-09-11T00:17:54.032 INFO:tasks.workunit.client.0.smithi078.stdout:3/157: dwrite d0/d7/d23/f2d [0,4194304] 0 2024-09-11T00:17:54.034 INFO:tasks.workunit.client.0.smithi078.stdout:9/98: dwrite fb [4194304,4194304] 0 2024-09-11T00:17:54.035 INFO:tasks.workunit.client.0.smithi078.stdout:3/158: mknod d0/d1a/c31 0 2024-09-11T00:17:54.035 INFO:tasks.workunit.client.0.smithi078.stdout:3/159: dread - d0/d7/f26 zero size 2024-09-11T00:17:54.037 INFO:tasks.workunit.client.0.smithi078.stdout:9/99: rmdir dc/d12 39 2024-09-11T00:17:54.039 INFO:tasks.workunit.client.0.smithi078.stdout:9/100: mkdir dc/d12/d20 0 2024-09-11T00:17:54.039 INFO:tasks.workunit.client.0.smithi078.stdout:9/101: chown dc/d12/c1f 16077 1 2024-09-11T00:17:54.039 INFO:tasks.workunit.client.0.smithi078.stdout:9/102: readlink dc/lf 0 2024-09-11T00:17:54.040 INFO:tasks.workunit.client.0.smithi078.stdout:7/158: dwrite d0/df/db/f2e [0,4194304] 0 2024-09-11T00:17:54.043 INFO:tasks.workunit.client.0.smithi078.stdout:3/160: write d0/f10 [520251,66027] 0 2024-09-11T00:17:54.043 INFO:tasks.workunit.client.0.smithi078.stdout:3/161: write d0/d7/d18/d1b/d27/f22 [1058277,62856] 0 2024-09-11T00:17:54.045 INFO:tasks.workunit.client.0.smithi078.stdout:9/103: link dc/d12/c1d dc/d12/c21 0 2024-09-11T00:17:54.045 INFO:tasks.workunit.client.0.smithi078.stdout:9/104: chown dc/d12/c19 733 1 2024-09-11T00:17:54.045 INFO:tasks.workunit.client.0.smithi078.stdout:9/105: chown dc/d12/d20 0 1 2024-09-11T00:17:54.046 INFO:tasks.workunit.client.0.smithi078.stdout:7/159: symlink d0/df/db/d30/d28/l31 0 2024-09-11T00:17:54.047 INFO:tasks.workunit.client.0.smithi078.stdout:3/162: creat d0/d7/d18/d1b/d27/f32 x:0 0 0 2024-09-11T00:17:54.048 INFO:tasks.workunit.client.0.smithi078.stdout:9/106: creat dc/d12/d20/f22 x:0 0 0 2024-09-11T00:17:54.052 INFO:tasks.workunit.client.0.smithi078.stdout:4/138: dread f6 [0,4194304] 0 2024-09-11T00:17:54.052 INFO:tasks.workunit.client.0.smithi078.stdout:4/139: write dc/d10/f1a [925342,1908] 0 2024-09-11T00:17:54.053 INFO:tasks.workunit.client.0.smithi078.stdout:5/122: dwrite d7/d8/d13/d22/d25/d28/d24/d1c/f2e [0,4194304] 0 2024-09-11T00:17:54.054 INFO:tasks.workunit.client.0.smithi078.stdout:9/107: rename dc/d12/c21 to dc/d12/c23 0 2024-09-11T00:17:54.054 INFO:tasks.workunit.client.0.smithi078.stdout:9/108: chown fb 1905 1 2024-09-11T00:17:54.054 INFO:tasks.workunit.client.0.smithi078.stdout:7/160: truncate d0/df/db/f2e 3850921 0 2024-09-11T00:17:54.055 INFO:tasks.workunit.client.0.smithi078.stdout:4/140: mknod dc/d10/d1f/c29 0 2024-09-11T00:17:54.058 INFO:tasks.workunit.client.0.smithi078.stdout:9/109: mkdir dc/d12/d24 0 2024-09-11T00:17:54.059 INFO:tasks.workunit.client.0.smithi078.stdout:7/161: mkdir d0/df/db/d32 0 2024-09-11T00:17:54.060 INFO:tasks.workunit.client.0.smithi078.stdout:6/213: dread d0/d1/f32 [0,4194304] 0 2024-09-11T00:17:54.060 INFO:tasks.workunit.client.0.smithi078.stdout:2/189: dwrite d0/d1/d8/f21 [4194304,4194304] 0 2024-09-11T00:17:54.060 INFO:tasks.workunit.client.0.smithi078.stdout:6/214: truncate d0/d1/d1b/f2e 1420646 0 2024-09-11T00:17:54.060 INFO:tasks.workunit.client.0.smithi078.stdout:4/141: truncate fa 509337 0 2024-09-11T00:17:54.061 INFO:tasks.workunit.client.0.smithi078.stdout:6/215: read d0/f3c [1162585,77240] 0 2024-09-11T00:17:54.063 INFO:tasks.workunit.client.0.smithi078.stdout:9/110: rename dc/lf to dc/l25 0 2024-09-11T00:17:54.063 INFO:tasks.workunit.client.0.smithi078.stdout:5/123: dread d7/d8/de/ff [4194304,4194304] 0 2024-09-11T00:17:54.065 INFO:tasks.workunit.client.0.smithi078.stdout:2/190: mknod d0/d31/d3a/c3f 0 2024-09-11T00:17:54.065 INFO:tasks.workunit.client.0.smithi078.stdout:4/142: truncate dc/d10/f12 175845 0 2024-09-11T00:17:54.066 INFO:tasks.workunit.client.0.smithi078.stdout:9/111: rename dc/d12/d20/f22 to dc/d12/f26 0 2024-09-11T00:17:54.067 INFO:tasks.workunit.client.0.smithi078.stdout:3/163: dwrite d0/d7/f26 [0,4194304] 0 2024-09-11T00:17:54.067 INFO:tasks.workunit.client.0.smithi078.stdout:5/124: unlink d7/d8/d13/d22/d25/d28/d24/l14 0 2024-09-11T00:17:54.068 INFO:tasks.workunit.client.0.smithi078.stdout:7/162: dread d0/df/db/d30/d1d/f17 [0,4194304] 0 2024-09-11T00:17:54.068 INFO:tasks.workunit.client.0.smithi078.stdout:7/163: truncate d0/df/db/d30/d1d/d14/f2a 701411 0 2024-09-11T00:17:54.071 INFO:tasks.workunit.client.0.smithi078.stdout:2/191: mkdir d0/d1/d3c/d40 0 2024-09-11T00:17:54.072 INFO:tasks.workunit.client.0.smithi078.stdout:4/143: symlink dc/d17/l2a 0 2024-09-11T00:17:54.072 INFO:tasks.workunit.client.0.smithi078.stdout:4/144: chown fa 207640 1 2024-09-11T00:17:54.072 INFO:tasks.workunit.client.0.smithi078.stdout:4/145: write dc/d10/f18 [4947908,118808] 0 2024-09-11T00:17:54.072 INFO:tasks.workunit.client.0.smithi078.stdout:4/146: truncate dc/f1e 393188 0 2024-09-11T00:17:54.073 INFO:tasks.workunit.client.0.smithi078.stdout:9/112: symlink dc/d12/l27 0 2024-09-11T00:17:54.073 INFO:tasks.workunit.client.0.smithi078.stdout:9/113: write fa [1246772,10020] 0 2024-09-11T00:17:54.074 INFO:tasks.workunit.client.0.smithi078.stdout:3/164: link d0/d7/d18/d1b/d27/f22 d0/d7/d18/f33 0 2024-09-11T00:17:54.075 INFO:tasks.workunit.client.0.smithi078.stdout:5/125: mknod d7/d8/d13/d22/d25/d28/d24/d1c/d1e/d26/c30 0 2024-09-11T00:17:54.076 INFO:tasks.workunit.client.0.smithi078.stdout:7/164: creat d0/df/f33 x:0 0 0 2024-09-11T00:17:54.076 INFO:tasks.workunit.client.0.smithi078.stdout:5/126: dread d7/d8/de/f10 [0,4194304] 0 2024-09-11T00:17:54.077 INFO:tasks.workunit.client.0.smithi078.stdout:5/127: fsync d7/d8/de/f11 0 2024-09-11T00:17:54.077 INFO:tasks.workunit.client.0.smithi078.stdout:2/192: mknod d0/d1/d3b/c41 0 2024-09-11T00:17:54.077 INFO:tasks.workunit.client.0.smithi078.stdout:2/193: fsync d0/d1/d11/d1b/d1e/f2f 0 2024-09-11T00:17:54.078 INFO:tasks.workunit.client.0.smithi078.stdout:4/147: link dc/f1e dc/d10/f2b 0 2024-09-11T00:17:54.079 INFO:tasks.workunit.client.0.smithi078.stdout:9/114: creat dc/d12/d24/f28 x:0 0 0 2024-09-11T00:17:54.079 INFO:tasks.workunit.client.0.smithi078.stdout:9/115: chown dc/f1c 95295 1 2024-09-11T00:17:54.081 INFO:tasks.workunit.client.0.smithi078.stdout:3/165: rename d0/d7/d18/d1b/d27/d2e to d0/d7/d18/d1b/d34 0 2024-09-11T00:17:54.084 INFO:tasks.workunit.client.0.smithi078.stdout:4/148: creat dc/d1d/f2c x:0 0 0 2024-09-11T00:17:54.084 INFO:tasks.workunit.client.0.smithi078.stdout:4/149: truncate dc/d1d/f2c 41663 0 2024-09-11T00:17:54.085 INFO:tasks.workunit.client.0.smithi078.stdout:9/116: creat dc/f29 x:0 0 0 2024-09-11T00:17:54.086 INFO:tasks.workunit.client.0.smithi078.stdout:2/194: link d0/c26 d0/d1/d6/c42 0 2024-09-11T00:17:54.086 INFO:tasks.workunit.client.0.smithi078.stdout:2/195: stat d0/d1/d8/f21 0 2024-09-11T00:17:54.087 INFO:tasks.workunit.client.0.smithi078.stdout:4/150: creat dc/f2d x:0 0 0 2024-09-11T00:17:54.091 INFO:tasks.workunit.client.0.smithi078.stdout:2/196: unlink d0/d1/d11/d1b/f20 0 2024-09-11T00:17:54.091 INFO:tasks.workunit.client.0.smithi078.stdout:5/128: dwrite f6 [0,4194304] 0 2024-09-11T00:17:54.092 INFO:tasks.workunit.client.0.smithi078.stdout:7/165: rename d0/df to d0/d34 0 2024-09-11T00:17:54.092 INFO:tasks.workunit.client.0.smithi078.stdout:7/166: chown d0/d34/db/d30/d1d 107 1 2024-09-11T00:17:54.092 INFO:tasks.workunit.client.0.smithi078.stdout:4/151: creat dc/d1d/f2e x:0 0 0 2024-09-11T00:17:54.093 INFO:tasks.workunit.client.0.smithi078.stdout:9/117: dread dc/d12/f13 [0,4194304] 0 2024-09-11T00:17:54.093 INFO:tasks.workunit.client.0.smithi078.stdout:2/197: mknod d0/d31/d3a/c43 0 2024-09-11T00:17:54.101 INFO:tasks.workunit.client.0.smithi078.stdout:5/129: creat d7/d8/d13/d22/d25/d28/f31 x:0 0 0 2024-09-11T00:17:54.101 INFO:tasks.workunit.client.0.smithi078.stdout:5/130: chown f6 934 1 2024-09-11T00:17:54.101 INFO:tasks.workunit.client.0.smithi078.stdout:5/131: rename d7/d8/d13/d22/d25/d28/d24/d1c/d1e to d7/d8/d13/d22/d25/d28/d24/d1c/d1e/d26/d32 22 2024-09-11T00:17:54.101 INFO:tasks.workunit.client.0.smithi078.stdout:7/167: mkdir d0/d34/db/d30/d28/d35 0 2024-09-11T00:17:54.101 INFO:tasks.workunit.client.0.smithi078.stdout:7/168: chown d0/d34/db/d30/d1d/f13 16 1 2024-09-11T00:17:54.101 INFO:tasks.workunit.client.0.smithi078.stdout:4/152: creat dc/d10/d1f/f2f x:0 0 0 2024-09-11T00:17:54.101 INFO:tasks.workunit.client.0.smithi078.stdout:4/153: write dc/d17/f22 [513176,130767] 0 2024-09-11T00:17:54.101 INFO:tasks.workunit.client.0.smithi078.stdout:7/169: creat d0/f36 x:0 0 0 2024-09-11T00:17:54.102 INFO:tasks.workunit.client.0.smithi078.stdout:4/154: symlink dc/d17/d1b/l30 0 2024-09-11T00:17:54.102 INFO:tasks.workunit.client.0.smithi078.stdout:4/155: dread dc/d10/f2b [0,4194304] 0 2024-09-11T00:17:54.102 INFO:tasks.workunit.client.0.smithi078.stdout:4/156: write dc/f1e [391857,106485] 0 2024-09-11T00:17:54.104 INFO:tasks.workunit.client.0.smithi078.stdout:4/157: dread dc/ff [0,4194304] 0 2024-09-11T00:17:54.104 INFO:tasks.workunit.client.0.smithi078.stdout:7/170: rename d0/d34/db/d30/d1d/l25 to d0/d34/db/d30/d28/d35/l37 0 2024-09-11T00:17:54.106 INFO:tasks.workunit.client.0.smithi078.stdout:7/171: unlink d0/d34/f1c 0 2024-09-11T00:17:54.106 INFO:tasks.workunit.client.0.smithi078.stdout:7/172: write d0/d34/f33 [772450,115399] 0 2024-09-11T00:17:54.107 INFO:tasks.workunit.client.0.smithi078.stdout:7/173: write d0/d34/db/d30/f27 [5109130,111058] 0 2024-09-11T00:17:54.109 INFO:tasks.workunit.client.0.smithi078.stdout:7/174: truncate d0/d34/db/f15 5216648 0 2024-09-11T00:17:54.111 INFO:tasks.workunit.client.0.smithi078.stdout:2/198: dwrite d0/d1/fe [0,4194304] 0 2024-09-11T00:17:54.111 INFO:tasks.workunit.client.0.smithi078.stdout:2/199: write d0/d1/d8/f1d [291584,97725] 0 2024-09-11T00:17:54.111 INFO:tasks.workunit.client.0.smithi078.stdout:2/200: truncate d0/d1/d8/f32 71270 0 2024-09-11T00:17:54.111 INFO:tasks.workunit.client.0.smithi078.stdout:0/177: sync 2024-09-11T00:17:54.111 INFO:tasks.workunit.client.0.smithi078.stdout:0/178: write d2/d3/d7/dc/f1a [2297850,67706] 0 2024-09-11T00:17:54.114 INFO:tasks.workunit.client.0.smithi078.stdout:2/201: dread d0/d1/d6/f16 [0,4194304] 0 2024-09-11T00:17:54.114 INFO:tasks.workunit.client.0.smithi078.stdout:2/202: chown d0/d1/d8/f29 200 1 2024-09-11T00:17:54.115 INFO:tasks.workunit.client.0.smithi078.stdout:4/158: write dc/d10/f18 [3726771,51641] 0 2024-09-11T00:17:54.116 INFO:tasks.workunit.client.0.smithi078.stdout:4/159: write dc/d10/f14 [29136,85089] 0 2024-09-11T00:17:54.116 INFO:tasks.workunit.client.0.smithi078.stdout:4/160: read dc/f1e [74012,118676] 0 2024-09-11T00:17:54.116 INFO:tasks.workunit.client.0.smithi078.stdout:9/118: dwrite f7 [4194304,4194304] 0 2024-09-11T00:17:54.116 INFO:tasks.workunit.client.0.smithi078.stdout:4/161: symlink dc/d1d/l31 0 2024-09-11T00:17:54.126 INFO:tasks.workunit.client.0.smithi078.stdout:2/203: dread d0/d1/d11/d1b/d1e/f2f [0,4194304] 0 2024-09-11T00:17:54.126 INFO:tasks.workunit.client.0.smithi078.stdout:2/204: getdents d0/d1/d33 0 2024-09-11T00:17:54.126 INFO:tasks.workunit.client.0.smithi078.stdout:2/205: fdatasync d0/d1/f4 0 2024-09-11T00:17:54.126 INFO:tasks.workunit.client.0.smithi078.stdout:2/206: write d0/d1/d11/f2d [2474390,29063] 0 2024-09-11T00:17:54.127 INFO:tasks.workunit.client.0.smithi078.stdout:2/207: creat d0/d1/d11/f44 x:0 0 0 2024-09-11T00:17:54.128 INFO:tasks.workunit.client.0.smithi078.stdout:4/162: dread f3 [0,4194304] 0 2024-09-11T00:17:54.129 INFO:tasks.workunit.client.0.smithi078.stdout:2/208: link d0/d1/d8/f12 d0/d1/d3c/f45 0 2024-09-11T00:17:54.131 INFO:tasks.workunit.client.0.smithi078.stdout:4/163: unlink dc/d10/f12 0 2024-09-11T00:17:54.132 INFO:tasks.workunit.client.0.smithi078.stdout:2/209: creat d0/d1/f46 x:0 0 0 2024-09-11T00:17:54.132 INFO:tasks.workunit.client.0.smithi078.stdout:2/210: write d0/f1c [58219,109471] 0 2024-09-11T00:17:54.133 INFO:tasks.workunit.client.0.smithi078.stdout:2/211: dread - d0/d1/d11/f36 zero size 2024-09-11T00:17:54.133 INFO:tasks.workunit.client.0.smithi078.stdout:2/212: truncate d0/d1/d11/f44 96355 0 2024-09-11T00:17:54.134 INFO:tasks.workunit.client.0.smithi078.stdout:4/164: unlink dc/d10/f18 0 2024-09-11T00:17:54.136 INFO:tasks.workunit.client.0.smithi078.stdout:2/213: rename d0/d1/d11/f36 to d0/d1/d8/f47 0 2024-09-11T00:17:54.137 INFO:tasks.workunit.client.0.smithi078.stdout:4/165: symlink dc/d17/d1b/l32 0 2024-09-11T00:17:54.139 INFO:tasks.workunit.client.0.smithi078.stdout:4/166: mkdir dc/d17/d1b/d33 0 2024-09-11T00:17:54.139 INFO:tasks.workunit.client.0.smithi078.stdout:4/167: stat dc/d1d/f2e 0 2024-09-11T00:17:54.140 INFO:tasks.workunit.client.0.smithi078.stdout:4/168: dread dc/d1d/f2c [0,4194304] 0 2024-09-11T00:17:54.140 INFO:tasks.workunit.client.0.smithi078.stdout:4/169: write dc/f25 [896858,9422] 0 2024-09-11T00:17:54.141 INFO:tasks.workunit.client.0.smithi078.stdout:4/170: creat dc/d17/f34 x:0 0 0 2024-09-11T00:17:54.142 INFO:tasks.workunit.client.0.smithi078.stdout:4/171: creat dc/d10/d1f/f35 x:0 0 0 2024-09-11T00:17:54.143 INFO:tasks.workunit.client.0.smithi078.stdout:4/172: mknod dc/d17/c36 0 2024-09-11T00:17:54.152 INFO:tasks.workunit.client.0.smithi078.stdout:2/214: dwrite d0/d1/d8/f32 [0,4194304] 0 2024-09-11T00:17:54.152 INFO:tasks.workunit.client.0.smithi078.stdout:2/215: readlink d0/d1/d8/l13 0 2024-09-11T00:17:54.160 INFO:tasks.workunit.client.0.smithi078.stdout:5/132: dwrite d7/d8/d13/d22/f2d [0,4194304] 0 2024-09-11T00:17:54.160 INFO:tasks.workunit.client.0.smithi078.stdout:5/133: write d7/d8/d13/d22/d25/d28/f31 [405718,67496] 0 2024-09-11T00:17:54.162 INFO:tasks.workunit.client.0.smithi078.stdout:2/216: write d0/d1/fe [1618976,1033] 0 2024-09-11T00:17:54.163 INFO:tasks.workunit.client.0.smithi078.stdout:4/173: dwrite dc/d10/d1f/f35 [0,4194304] 0 2024-09-11T00:17:54.164 INFO:tasks.workunit.client.0.smithi078.stdout:2/217: dread d0/fc [0,4194304] 0 2024-09-11T00:17:54.164 INFO:tasks.workunit.client.0.smithi078.stdout:5/134: rename d7/d8/d13 to d7/d8/d33 0 2024-09-11T00:17:54.166 INFO:tasks.workunit.client.0.smithi078.stdout:0/179: dread d2/f2d [0,4194304] 0 2024-09-11T00:17:54.169 INFO:tasks.workunit.client.0.smithi078.stdout:7/175: dread d0/d34/db/d30/f27 [0,4194304] 0 2024-09-11T00:17:54.169 INFO:tasks.workunit.client.0.smithi078.stdout:7/176: write d0/d34/db/d30/d1d/f2c [358138,45153] 0 2024-09-11T00:17:54.169 INFO:tasks.workunit.client.0.smithi078.stdout:7/177: chown d0/d34/f33 0 1 2024-09-11T00:17:54.170 INFO:tasks.workunit.client.0.smithi078.stdout:9/119: dwrite dc/f1c [4194304,4194304] 0 2024-09-11T00:17:54.176 INFO:tasks.workunit.client.0.smithi078.stdout:4/174: symlink dc/d1d/l37 0 2024-09-11T00:17:54.178 INFO:tasks.workunit.client.0.smithi078.stdout:2/218: truncate d0/d31/d3a/f3e 352728 0 2024-09-11T00:17:54.179 INFO:tasks.workunit.client.0.smithi078.stdout:5/135: symlink d7/d8/d33/d22/d25/d28/l34 0 2024-09-11T00:17:54.179 INFO:tasks.workunit.client.0.smithi078.stdout:5/136: fdatasync d7/f1f 0 2024-09-11T00:17:54.179 INFO:tasks.workunit.client.0.smithi078.stdout:5/137: chown d7/d8/d33/d22/d25/d28/f31 48 1 2024-09-11T00:17:54.181 INFO:tasks.workunit.client.0.smithi078.stdout:0/180: link d2/c19 d2/d3/d7/dc/c39 0 2024-09-11T00:17:54.183 INFO:tasks.workunit.client.0.smithi078.stdout:7/178: rmdir d0/d34/db/d2f 0 2024-09-11T00:17:54.185 INFO:tasks.workunit.client.0.smithi078.stdout:9/120: dwrite dc/f1c [0,4194304] 0 2024-09-11T00:17:54.185 INFO:tasks.workunit.client.0.smithi078.stdout:9/121: chown dc/d12 106710120 1 2024-09-11T00:17:54.186 INFO:tasks.workunit.client.0.smithi078.stdout:4/175: mknod dc/d17/c38 0 2024-09-11T00:17:54.186 INFO:tasks.workunit.client.0.smithi078.stdout:4/176: write dc/d10/d1f/f20 [332502,7557] 0 2024-09-11T00:17:54.187 INFO:tasks.workunit.client.0.smithi078.stdout:0/181: chown d2/d3/d7/cf 130034746 1 2024-09-11T00:17:54.189 INFO:tasks.workunit.client.0.smithi078.stdout:5/138: dread d7/d8/d33/d22/d25/d28/d24/d1c/f2e [0,4194304] 0 2024-09-11T00:17:54.189 INFO:tasks.workunit.client.0.smithi078.stdout:7/179: read d0/d34/db/f2e [285892,46357] 0 2024-09-11T00:17:54.189 INFO:tasks.workunit.client.0.smithi078.stdout:7/180: write d0/d34/f24 [637405,117700] 0 2024-09-11T00:17:54.190 INFO:tasks.workunit.client.0.smithi078.stdout:4/177: creat dc/f39 x:0 0 0 2024-09-11T00:17:54.192 INFO:tasks.workunit.client.0.smithi078.stdout:7/181: dread d0/d34/db/d30/d1d/f13 [0,4194304] 0 2024-09-11T00:17:54.192 INFO:tasks.workunit.client.0.smithi078.stdout:2/219: rename d0/d1/d8/f32 to d0/d1/d6/f48 0 2024-09-11T00:17:54.192 INFO:tasks.workunit.client.0.smithi078.stdout:2/220: dread - d0/d1/f1f zero size 2024-09-11T00:17:54.193 INFO:tasks.workunit.client.0.smithi078.stdout:2/221: fsync d0/d1/d8/f12 0 2024-09-11T00:17:54.194 INFO:tasks.workunit.client.0.smithi078.stdout:0/182: link d2/d2a/d2c/d35/l36 d2/d2a/d2c/d35/l3a 0 2024-09-11T00:17:54.195 INFO:tasks.workunit.client.0.smithi078.stdout:5/139: creat d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d26/d2a/f35 x:0 0 0 2024-09-11T00:17:54.196 INFO:tasks.workunit.client.0.smithi078.stdout:4/178: mkdir dc/d17/d1b/d3a 0 2024-09-11T00:17:54.196 INFO:tasks.workunit.client.0.smithi078.stdout:5/140: write d7/d8/de/f11 [979014,122765] 0 2024-09-11T00:17:54.197 INFO:tasks.workunit.client.0.smithi078.stdout:7/182: symlink d0/d34/db/l38 0 2024-09-11T00:17:54.197 INFO:tasks.workunit.client.0.smithi078.stdout:7/183: chown d0/d34/db/d32 10 1 2024-09-11T00:17:54.198 INFO:tasks.workunit.client.0.smithi078.stdout:4/179: mkdir dc/d17/d1b/d3a/d3b 0 2024-09-11T00:17:54.198 INFO:tasks.workunit.client.0.smithi078.stdout:0/183: dread d2/d3/f22 [0,4194304] 0 2024-09-11T00:17:54.198 INFO:tasks.workunit.client.0.smithi078.stdout:4/180: readlink dc/d1d/l37 0 2024-09-11T00:17:54.198 INFO:tasks.workunit.client.0.smithi078.stdout:4/181: chown dc/fd 645657872 1 2024-09-11T00:17:54.198 INFO:tasks.workunit.client.0.smithi078.stdout:4/182: fsync dc/f11 0 2024-09-11T00:17:54.199 INFO:tasks.workunit.client.0.smithi078.stdout:5/141: mknod d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d26/c36 0 2024-09-11T00:17:54.200 INFO:tasks.workunit.client.0.smithi078.stdout:0/184: creat d2/d3/d7/f3b x:0 0 0 2024-09-11T00:17:54.201 INFO:tasks.workunit.client.0.smithi078.stdout:4/183: mkdir dc/d10/d3c 0 2024-09-11T00:17:54.203 INFO:tasks.workunit.client.0.smithi078.stdout:4/184: creat dc/d10/f3d x:0 0 0 2024-09-11T00:17:54.206 INFO:tasks.workunit.client.0.smithi078.stdout:9/122: dwrite dc/f1e [0,4194304] 0 2024-09-11T00:17:54.206 INFO:tasks.workunit.client.0.smithi078.stdout:0/185: write d2/d3/d7/dc/f1c [1303366,45762] 0 2024-09-11T00:17:54.208 INFO:tasks.workunit.client.0.smithi078.stdout:9/123: symlink dc/d12/l2a 0 2024-09-11T00:17:54.212 INFO:tasks.workunit.client.0.smithi078.stdout:0/186: write d2/d3/d7/f14 [109771,16420] 0 2024-09-11T00:17:54.213 INFO:tasks.workunit.client.0.smithi078.stdout:0/187: mknod d2/d3/c3c 0 2024-09-11T00:17:54.213 INFO:tasks.workunit.client.0.smithi078.stdout:0/188: readlink d2/l33 0 2024-09-11T00:17:54.216 INFO:tasks.workunit.client.0.smithi078.stdout:0/189: rename d2/d2a/d2c/d35/l3a to d2/d3/l3d 0 2024-09-11T00:17:54.217 INFO:tasks.workunit.client.0.smithi078.stdout:0/190: stat d2/d3/d7/dc/l11 0 2024-09-11T00:17:54.217 INFO:tasks.workunit.client.0.smithi078.stdout:0/191: rename d2 to d2/d3/d3e 22 2024-09-11T00:17:54.217 INFO:tasks.workunit.client.0.smithi078.stdout:0/192: write d2/d3/d7/dc/f31 [26894,131034] 0 2024-09-11T00:17:54.217 INFO:tasks.workunit.client.0.smithi078.stdout:7/184: dwrite d0/d34/db/f15 [0,4194304] 0 2024-09-11T00:17:54.218 INFO:tasks.workunit.client.0.smithi078.stdout:0/193: symlink d2/d2a/l3f 0 2024-09-11T00:17:54.218 INFO:tasks.workunit.client.0.smithi078.stdout:0/194: chown d2/d3/d7/f3b 11242092 1 2024-09-11T00:17:54.219 INFO:tasks.workunit.client.0.smithi078.stdout:2/222: dwrite d0/d1/d8/f1d [0,4194304] 0 2024-09-11T00:17:54.220 INFO:tasks.workunit.client.0.smithi078.stdout:8/161: sync 2024-09-11T00:17:54.220 INFO:tasks.workunit.client.0.smithi078.stdout:1/209: sync 2024-09-11T00:17:54.220 INFO:tasks.workunit.client.0.smithi078.stdout:8/162: fsync f2 0 2024-09-11T00:17:54.220 INFO:tasks.workunit.client.0.smithi078.stdout:7/185: link d0/d34/db/f2e d0/d34/db/d30/d1d/f39 0 2024-09-11T00:17:54.223 INFO:tasks.workunit.client.0.smithi078.stdout:8/163: creat da/d13/d1b/f34 x:0 0 0 2024-09-11T00:17:54.223 INFO:tasks.workunit.client.0.smithi078.stdout:8/164: chown da/d13/c16 198222437 1 2024-09-11T00:17:54.225 INFO:tasks.workunit.client.0.smithi078.stdout:7/186: link d0/f36 d0/d34/db/d32/f3a 0 2024-09-11T00:17:54.226 INFO:tasks.workunit.client.0.smithi078.stdout:5/142: dwrite d7/d8/d33/d22/d25/d28/d24/d1c/f2e [0,4194304] 0 2024-09-11T00:17:54.229 INFO:tasks.workunit.client.0.smithi078.stdout:7/187: symlink d0/d34/db/d30/d28/l3b 0 2024-09-11T00:17:54.230 INFO:tasks.workunit.client.0.smithi078.stdout:0/195: rename d2/d3/d7/dc/f1c to d2/d3/d7/f40 0 2024-09-11T00:17:54.232 INFO:tasks.workunit.client.0.smithi078.stdout:9/124: dread fa [0,4194304] 0 2024-09-11T00:17:54.232 INFO:tasks.workunit.client.0.smithi078.stdout:5/143: mknod d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d26/c37 0 2024-09-11T00:17:54.233 INFO:tasks.workunit.client.0.smithi078.stdout:7/188: symlink d0/d34/l3c 0 2024-09-11T00:17:54.233 INFO:tasks.workunit.client.0.smithi078.stdout:7/189: chown d0/d34/db/c12 2 1 2024-09-11T00:17:54.234 INFO:tasks.workunit.client.0.smithi078.stdout:9/125: rename l9 to dc/l2b 0 2024-09-11T00:17:54.235 INFO:tasks.workunit.client.0.smithi078.stdout:5/144: mknod d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d26/d2a/c38 0 2024-09-11T00:17:54.236 INFO:tasks.workunit.client.0.smithi078.stdout:7/190: mknod d0/d34/c3d 0 2024-09-11T00:17:54.236 INFO:tasks.workunit.client.0.smithi078.stdout:4/185: dwrite f6 [0,4194304] 0 2024-09-11T00:17:54.236 INFO:tasks.workunit.client.0.smithi078.stdout:4/186: readlink dc/d1d/l37 0 2024-09-11T00:17:54.236 INFO:tasks.workunit.client.0.smithi078.stdout:4/187: fdatasync fa 0 2024-09-11T00:17:54.236 INFO:tasks.workunit.client.0.smithi078.stdout:9/126: truncate dc/d12/f13 2525401 0 2024-09-11T00:17:54.237 INFO:tasks.workunit.client.0.smithi078.stdout:7/191: write d0/d34/db/f15 [4830411,64337] 0 2024-09-11T00:17:54.238 INFO:tasks.workunit.client.0.smithi078.stdout:5/145: link d7/d8/de/c2f d7/d8/c39 0 2024-09-11T00:17:54.238 INFO:tasks.workunit.client.0.smithi078.stdout:0/196: dread d2/f2d [0,4194304] 0 2024-09-11T00:17:54.241 INFO:tasks.workunit.client.0.smithi078.stdout:1/210: dwrite f2 [0,4194304] 0 2024-09-11T00:17:54.242 INFO:tasks.workunit.client.0.smithi078.stdout:1/211: chown d3 10 1 2024-09-11T00:17:54.242 INFO:tasks.workunit.client.0.smithi078.stdout:2/223: dwrite d0/d1/d6/f37 [4194304,4194304] 0 2024-09-11T00:17:54.243 INFO:tasks.workunit.client.0.smithi078.stdout:8/165: dwrite da/f10 [4194304,4194304] 0 2024-09-11T00:17:54.244 INFO:tasks.workunit.client.0.smithi078.stdout:1/212: dread d3/f1c [0,4194304] 0 2024-09-11T00:17:54.244 INFO:tasks.workunit.client.0.smithi078.stdout:1/213: fdatasync d3/d1a/d35/f3f 0 2024-09-11T00:17:54.244 INFO:tasks.workunit.client.0.smithi078.stdout:1/214: write d3/d1a/f33 [83409,128212] 0 2024-09-11T00:17:54.245 INFO:tasks.workunit.client.0.smithi078.stdout:4/188: link dc/f1e dc/d17/d1b/d3a/d3b/f3e 0 2024-09-11T00:17:54.245 INFO:tasks.workunit.client.0.smithi078.stdout:4/189: readlink dc/d1d/l37 0 2024-09-11T00:17:54.246 INFO:tasks.workunit.client.0.smithi078.stdout:9/127: creat dc/f2c x:0 0 0 2024-09-11T00:17:54.246 INFO:tasks.workunit.client.0.smithi078.stdout:9/128: fsync dc/d12/f11 0 2024-09-11T00:17:54.246 INFO:tasks.workunit.client.0.smithi078.stdout:7/192: creat d0/d34/db/d30/f3e x:0 0 0 2024-09-11T00:17:54.247 INFO:tasks.workunit.client.0.smithi078.stdout:9/129: dread dc/d12/f11 [0,4194304] 0 2024-09-11T00:17:54.247 INFO:tasks.workunit.client.0.smithi078.stdout:9/130: chown dc/d12/f17 11 1 2024-09-11T00:17:54.247 INFO:tasks.workunit.client.0.smithi078.stdout:0/197: mknod d2/d2a/d2c/c41 0 2024-09-11T00:17:54.249 INFO:tasks.workunit.client.0.smithi078.stdout:2/224: mknod d0/d1/d11/d1b/c49 0 2024-09-11T00:17:54.250 INFO:tasks.workunit.client.0.smithi078.stdout:8/166: truncate da/fc 2456668 0 2024-09-11T00:17:54.252 INFO:tasks.workunit.client.0.smithi078.stdout:1/215: mknod d3/d28/c43 0 2024-09-11T00:17:54.252 INFO:tasks.workunit.client.0.smithi078.stdout:1/216: truncate d3/d1a/ff 4955216 0 2024-09-11T00:17:54.253 INFO:tasks.workunit.client.0.smithi078.stdout:4/190: creat dc/d17/f3f x:0 0 0 2024-09-11T00:17:54.254 INFO:tasks.workunit.client.0.smithi078.stdout:5/146: dwrite d7/d8/de/ff [0,4194304] 0 2024-09-11T00:17:54.254 INFO:tasks.workunit.client.0.smithi078.stdout:7/193: unlink d0/d34/l3c 0 2024-09-11T00:17:54.254 INFO:tasks.workunit.client.0.smithi078.stdout:7/194: write d0/d34/db/f2e [1606623,50983] 0 2024-09-11T00:17:54.256 INFO:tasks.workunit.client.0.smithi078.stdout:9/131: mknod dc/c2d 0 2024-09-11T00:17:54.257 INFO:tasks.workunit.client.0.smithi078.stdout:9/132: fdatasync dc/d12/f26 0 2024-09-11T00:17:54.257 INFO:tasks.workunit.client.0.smithi078.stdout:9/133: chown dc/l25 1380725083 1 2024-09-11T00:17:54.257 INFO:tasks.workunit.client.0.smithi078.stdout:9/134: fdatasync dc/d12/f13 0 2024-09-11T00:17:54.259 INFO:tasks.workunit.client.0.smithi078.stdout:0/198: unlink d2/d3/d7/dc/f1f 0 2024-09-11T00:17:54.260 INFO:tasks.workunit.client.0.smithi078.stdout:1/217: getdents d3/d29 0 2024-09-11T00:17:54.260 INFO:tasks.workunit.client.0.smithi078.stdout:1/218: chown d3/d1a/d35/f3f 885 1 2024-09-11T00:17:54.260 INFO:tasks.workunit.client.0.smithi078.stdout:6/216: sync 2024-09-11T00:17:54.261 INFO:tasks.workunit.client.0.smithi078.stdout:5/147: creat d7/d8/d33/d22/d25/f3a x:0 0 0 2024-09-11T00:17:54.261 INFO:tasks.workunit.client.0.smithi078.stdout:7/195: rmdir d0 39 2024-09-11T00:17:54.263 INFO:tasks.workunit.client.0.smithi078.stdout:1/219: unlink d3/d28/d39/f3b 0 2024-09-11T00:17:54.263 INFO:tasks.workunit.client.0.smithi078.stdout:1/220: fdatasync d3/d1a/d35/f3f 0 2024-09-11T00:17:54.263 INFO:tasks.workunit.client.0.smithi078.stdout:1/221: fsync d3/d28/f8 0 2024-09-11T00:17:54.265 INFO:tasks.workunit.client.0.smithi078.stdout:6/217: rename d0/d1/f2d to d0/d33/f4f 0 2024-09-11T00:17:54.266 INFO:tasks.workunit.client.0.smithi078.stdout:5/148: rename d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d26/c30 to d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d26/c3b 0 2024-09-11T00:17:54.266 INFO:tasks.workunit.client.0.smithi078.stdout:8/167: write da/f17 [1145394,60703] 0 2024-09-11T00:17:54.267 INFO:tasks.workunit.client.0.smithi078.stdout:6/218: creat d0/d1/d1b/f50 x:0 0 0 2024-09-11T00:17:54.268 INFO:tasks.workunit.client.0.smithi078.stdout:6/219: chown d0/d1/d9/d17/l3e 7209 1 2024-09-11T00:17:54.271 INFO:tasks.workunit.client.0.smithi078.stdout:2/225: dwrite d0/d19/f1a [0,4194304] 0 2024-09-11T00:17:54.272 INFO:tasks.workunit.client.0.smithi078.stdout:1/222: dread d3/d29/f34 [0,4194304] 0 2024-09-11T00:17:54.272 INFO:tasks.workunit.client.0.smithi078.stdout:1/223: read - d3/d28/f18 zero size 2024-09-11T00:17:54.272 INFO:tasks.workunit.client.0.smithi078.stdout:1/224: fsync d3/f1e 0 2024-09-11T00:17:54.273 INFO:tasks.workunit.client.0.smithi078.stdout:8/168: rename da/f17 to da/d13/d19/f35 0 2024-09-11T00:17:54.274 INFO:tasks.workunit.client.0.smithi078.stdout:7/196: read d0/d34/db/d30/d1d/fe [391296,68107] 0 2024-09-11T00:17:54.275 INFO:tasks.workunit.client.0.smithi078.stdout:6/220: link d0/l12 d0/d1/d1b/l51 0 2024-09-11T00:17:54.277 INFO:tasks.workunit.client.0.smithi078.stdout:0/199: dread d2/d2a/d2c/f32 [0,4194304] 0 2024-09-11T00:17:54.278 INFO:tasks.workunit.client.0.smithi078.stdout:0/200: dread d2/d3/d7/dc/f24 [4194304,4194304] 0 2024-09-11T00:17:54.279 INFO:tasks.workunit.client.0.smithi078.stdout:2/226: creat d0/d31/d3a/f4a x:0 0 0 2024-09-11T00:17:54.280 INFO:tasks.workunit.client.0.smithi078.stdout:2/227: truncate d0/d31/d3a/f4a 529768 0 2024-09-11T00:17:54.280 INFO:tasks.workunit.client.0.smithi078.stdout:2/228: chown d0/d1/d6/f48 32324 1 2024-09-11T00:17:54.281 INFO:tasks.workunit.client.0.smithi078.stdout:4/191: dwrite dc/d10/d1f/f20 [0,4194304] 0 2024-09-11T00:17:54.281 INFO:tasks.workunit.client.0.smithi078.stdout:7/197: getdents d0 0 2024-09-11T00:17:54.282 INFO:tasks.workunit.client.0.smithi078.stdout:4/192: chown dc/d10/d1f/f35 61 1 2024-09-11T00:17:54.283 INFO:tasks.workunit.client.0.smithi078.stdout:0/201: getdents d2 0 2024-09-11T00:17:54.284 INFO:tasks.workunit.client.0.smithi078.stdout:8/169: dread da/f12 [0,4194304] 0 2024-09-11T00:17:54.284 INFO:tasks.workunit.client.0.smithi078.stdout:8/170: write da/d13/d1b/f2e [573862,96087] 0 2024-09-11T00:17:54.286 INFO:tasks.workunit.client.0.smithi078.stdout:1/225: read d3/d28/f1f [3940040,92113] 0 2024-09-11T00:17:54.286 INFO:tasks.workunit.client.0.smithi078.stdout:2/229: rename d0/f1c to d0/d31/d38/f4b 0 2024-09-11T00:17:54.286 INFO:tasks.workunit.client.0.smithi078.stdout:2/230: stat d0/d1/d11/d1b/d1e/f35 0 2024-09-11T00:17:54.288 INFO:tasks.workunit.client.0.smithi078.stdout:9/135: dwrite f7 [4194304,4194304] 0 2024-09-11T00:17:54.288 INFO:tasks.workunit.client.0.smithi078.stdout:9/136: truncate dc/f29 421017 0 2024-09-11T00:17:54.289 INFO:tasks.workunit.client.0.smithi078.stdout:8/171: creat da/d13/d1b/f36 x:0 0 0 2024-09-11T00:17:54.290 INFO:tasks.workunit.client.0.smithi078.stdout:0/202: dread d2/f1d [0,4194304] 0 2024-09-11T00:17:54.290 INFO:tasks.workunit.client.0.smithi078.stdout:0/203: chown d2/d2a/d2c/d35/l36 1547 1 2024-09-11T00:17:54.292 INFO:tasks.workunit.client.0.smithi078.stdout:1/226: rename d3/d1a/d35/f38 to d3/d1a/d21/f44 0 2024-09-11T00:17:54.292 INFO:tasks.workunit.client.0.smithi078.stdout:1/227: write d3/d28/f18 [887312,102219] 0 2024-09-11T00:17:54.296 INFO:tasks.workunit.client.0.smithi078.stdout:0/204: dread d2/d2a/d2c/f32 [0,4194304] 0 2024-09-11T00:17:54.301 INFO:tasks.workunit.client.0.smithi078.stdout:9/137: symlink dc/d12/d20/l2e 0 2024-09-11T00:17:54.303 INFO:tasks.workunit.client.0.smithi078.stdout:2/231: rename d0/l7 to d0/d1/d11/d1b/d1e/l4c 0 2024-09-11T00:17:54.304 INFO:tasks.workunit.client.0.smithi078.stdout:9/138: rmdir dc 39 2024-09-11T00:17:54.307 INFO:tasks.workunit.client.0.smithi078.stdout:2/232: creat d0/d1/d33/f4d x:0 0 0 2024-09-11T00:17:54.309 INFO:tasks.workunit.client.0.smithi078.stdout:2/233: link d0/d1/d33/f4d d0/d1/d3b/f4e 0 2024-09-11T00:17:54.311 INFO:tasks.workunit.client.0.smithi078.stdout:2/234: creat d0/d1/d8/f4f x:0 0 0 2024-09-11T00:17:54.311 INFO:tasks.workunit.client.0.smithi078.stdout:6/221: dwrite d0/d33/f37 [0,4194304] 0 2024-09-11T00:17:54.312 INFO:tasks.workunit.client.0.smithi078.stdout:2/235: mkdir d0/d1/d3c/d40/d50 0 2024-09-11T00:17:54.312 INFO:tasks.workunit.client.0.smithi078.stdout:2/236: chown d0/d1/d3b/f4e 493389 1 2024-09-11T00:17:54.312 INFO:tasks.workunit.client.0.smithi078.stdout:2/237: readlink d0/d1/d11/d1b/d1e/l4c 0 2024-09-11T00:17:54.312 INFO:tasks.workunit.client.0.smithi078.stdout:2/238: write d0/d31/d3a/f4a [892017,59629] 0 2024-09-11T00:17:54.312 INFO:tasks.workunit.client.0.smithi078.stdout:2/239: rmdir d0/d1/d11 39 2024-09-11T00:17:54.313 INFO:tasks.workunit.client.0.smithi078.stdout:7/198: dwrite d0/d34/db/d30/d1d/fe [0,4194304] 0 2024-09-11T00:17:54.314 INFO:tasks.workunit.client.0.smithi078.stdout:2/240: mkdir d0/d31/d3a/d51 0 2024-09-11T00:17:54.315 INFO:tasks.workunit.client.0.smithi078.stdout:0/205: dwrite d2/d3/f1b [0,4194304] 0 2024-09-11T00:17:54.316 INFO:tasks.workunit.client.0.smithi078.stdout:8/172: dwrite da/d13/d19/f1a [0,4194304] 0 2024-09-11T00:17:54.318 INFO:tasks.workunit.client.0.smithi078.stdout:8/173: mkdir da/d13/d1b/d37 0 2024-09-11T00:17:54.318 INFO:tasks.workunit.client.0.smithi078.stdout:4/193: dwrite dc/d1d/f2c [0,4194304] 0 2024-09-11T00:17:54.319 INFO:tasks.workunit.client.0.smithi078.stdout:8/174: creat da/d1c/f38 x:0 0 0 2024-09-11T00:17:54.319 INFO:tasks.workunit.client.0.smithi078.stdout:2/241: dread d0/d1/f4 [0,4194304] 0 2024-09-11T00:17:54.319 INFO:tasks.workunit.client.0.smithi078.stdout:2/242: write d0/d1/d11/f24 [319898,7202] 0 2024-09-11T00:17:54.319 INFO:tasks.workunit.client.0.smithi078.stdout:8/175: write da/d13/d1b/d24/f27 [390648,50038] 0 2024-09-11T00:17:54.319 INFO:tasks.workunit.client.0.smithi078.stdout:4/194: write dc/ff [652706,89671] 0 2024-09-11T00:17:54.322 INFO:tasks.workunit.client.0.smithi078.stdout:1/228: rename d3/d1a/d35 to d3/d29/d45 0 2024-09-11T00:17:54.323 INFO:tasks.workunit.client.0.smithi078.stdout:2/243: mkdir d0/d1/d6/d52 0 2024-09-11T00:17:54.324 INFO:tasks.workunit.client.0.smithi078.stdout:6/222: rename d0/d33/f34 to d0/d1/f52 0 2024-09-11T00:17:54.325 INFO:tasks.workunit.client.0.smithi078.stdout:1/229: mknod d3/d29/c46 0 2024-09-11T00:17:54.326 INFO:tasks.workunit.client.0.smithi078.stdout:2/244: mkdir d0/d1/d53 0 2024-09-11T00:17:54.329 INFO:tasks.workunit.client.0.smithi078.stdout:7/199: rename d0/d34/db/d30/d28/d35 to d0/d3f 0 2024-09-11T00:17:54.330 INFO:tasks.workunit.client.0.smithi078.stdout:6/223: mkdir d0/d1/d53 0 2024-09-11T00:17:54.330 INFO:tasks.workunit.client.0.smithi078.stdout:3/166: sync 2024-09-11T00:17:54.331 INFO:tasks.workunit.client.0.smithi078.stdout:4/195: rename dc/d17/d1b to dc/d10/d40 0 2024-09-11T00:17:54.332 INFO:tasks.workunit.client.0.smithi078.stdout:7/200: mknod d0/d34/db/d30/c40 0 2024-09-11T00:17:54.335 INFO:tasks.workunit.client.0.smithi078.stdout:6/224: mkdir d0/d1/d9/d54 0 2024-09-11T00:17:54.336 INFO:tasks.workunit.client.0.smithi078.stdout:6/225: symlink d0/d1/d9/d54/l55 0 2024-09-11T00:17:54.336 INFO:tasks.workunit.client.0.smithi078.stdout:6/226: fsync d0/fc 0 2024-09-11T00:17:54.337 INFO:tasks.workunit.client.0.smithi078.stdout:8/176: dwrite da/f2a [0,4194304] 0 2024-09-11T00:17:54.337 INFO:tasks.workunit.client.0.smithi078.stdout:8/177: write da/f14 [3199254,107812] 0 2024-09-11T00:17:54.338 INFO:tasks.workunit.client.0.smithi078.stdout:6/227: creat d0/d1/d2c/f56 x:0 0 0 2024-09-11T00:17:54.338 INFO:tasks.workunit.client.0.smithi078.stdout:6/228: truncate d0/d33/f3d 804195 0 2024-09-11T00:17:54.338 INFO:tasks.workunit.client.0.smithi078.stdout:6/229: fsync d0/d1/d9/f4a 0 2024-09-11T00:17:54.340 INFO:tasks.workunit.client.0.smithi078.stdout:8/178: dread da/d13/d1b/f2e [0,4194304] 0 2024-09-11T00:17:54.340 INFO:tasks.workunit.client.0.smithi078.stdout:6/230: mknod d0/d33/c57 0 2024-09-11T00:17:54.340 INFO:tasks.workunit.client.0.smithi078.stdout:6/231: fsync d0/d33/f48 0 2024-09-11T00:17:54.340 INFO:tasks.workunit.client.0.smithi078.stdout:6/232: dread - d0/d1/d2c/f56 zero size 2024-09-11T00:17:54.340 INFO:tasks.workunit.client.0.smithi078.stdout:8/179: getdents da/d13/d28 0 2024-09-11T00:17:54.341 INFO:tasks.workunit.client.0.smithi078.stdout:6/233: creat d0/d1/d9/d17/f58 x:0 0 0 2024-09-11T00:17:54.342 INFO:tasks.workunit.client.0.smithi078.stdout:3/167: write d0/d7/d23/f2d [1527261,39832] 0 2024-09-11T00:17:54.342 INFO:tasks.workunit.client.0.smithi078.stdout:3/168: stat d0/d7/d18/d1b/c1d 0 2024-09-11T00:17:54.342 INFO:tasks.workunit.client.0.smithi078.stdout:3/169: chown d0/d7/d18/d1b/d27/f22 888579 1 2024-09-11T00:17:54.342 INFO:tasks.workunit.client.0.smithi078.stdout:3/170: chown d0/d7/d18 14859221 1 2024-09-11T00:17:54.346 INFO:tasks.workunit.client.0.smithi078.stdout:1/230: dwrite d3/f40 [0,4194304] 0 2024-09-11T00:17:54.346 INFO:tasks.workunit.client.0.smithi078.stdout:1/231: chown d3/d28/f1f 211960673 1 2024-09-11T00:17:54.346 INFO:tasks.workunit.client.0.smithi078.stdout:7/201: dwrite d0/d34/f24 [0,4194304] 0 2024-09-11T00:17:54.346 INFO:tasks.workunit.client.0.smithi078.stdout:7/202: fdatasync d0/d34/db/f2e 0 2024-09-11T00:17:54.347 INFO:tasks.workunit.client.0.smithi078.stdout:7/203: write d0/f36 [389240,5419] 0 2024-09-11T00:17:54.347 INFO:tasks.workunit.client.0.smithi078.stdout:8/180: dread da/d13/f2c [0,4194304] 0 2024-09-11T00:17:54.348 INFO:tasks.workunit.client.0.smithi078.stdout:7/204: creat d0/d34/db/d30/d1d/d14/f41 x:0 0 0 2024-09-11T00:17:54.349 INFO:tasks.workunit.client.0.smithi078.stdout:8/181: symlink da/d13/d28/l39 0 2024-09-11T00:17:54.349 INFO:tasks.workunit.client.0.smithi078.stdout:8/182: fdatasync da/fe 0 2024-09-11T00:17:54.349 INFO:tasks.workunit.client.0.smithi078.stdout:8/183: dread - da/d13/d28/f32 zero size 2024-09-11T00:17:54.349 INFO:tasks.workunit.client.0.smithi078.stdout:3/171: write d0/d7/f17 [5571849,62048] 0 2024-09-11T00:17:54.349 INFO:tasks.workunit.client.0.smithi078.stdout:1/232: dread d3/f1c [0,4194304] 0 2024-09-11T00:17:54.349 INFO:tasks.workunit.client.0.smithi078.stdout:1/233: write d3/f17 [2621187,107103] 0 2024-09-11T00:17:54.353 INFO:tasks.workunit.client.0.smithi078.stdout:6/234: dwrite d0/d1/f32 [0,4194304] 0 2024-09-11T00:17:54.355 INFO:tasks.workunit.client.0.smithi078.stdout:7/205: symlink d0/d34/db/d30/d1d/d14/l42 0 2024-09-11T00:17:54.355 INFO:tasks.workunit.client.0.smithi078.stdout:3/172: mknod d0/d7/d18/d1b/d34/c35 0 2024-09-11T00:17:54.355 INFO:tasks.workunit.client.0.smithi078.stdout:1/234: rename d3/d1a/d21/c31 to d3/d29/c47 0 2024-09-11T00:17:54.355 INFO:tasks.workunit.client.0.smithi078.stdout:3/173: chown d0/d7/d18/d1b 373586642 1 2024-09-11T00:17:54.356 INFO:tasks.workunit.client.0.smithi078.stdout:6/235: mkdir d0/d1/d9/d59 0 2024-09-11T00:17:54.357 INFO:tasks.workunit.client.0.smithi078.stdout:7/206: truncate d0/f29 867336 0 2024-09-11T00:17:54.358 INFO:tasks.workunit.client.0.smithi078.stdout:3/174: getdents d0/d7/d18/d1b 0 2024-09-11T00:17:54.358 INFO:tasks.workunit.client.0.smithi078.stdout:3/175: fsync d0/f10 0 2024-09-11T00:17:54.358 INFO:tasks.workunit.client.0.smithi078.stdout:3/176: readlink d0/d7/d23/l2a 0 2024-09-11T00:17:54.359 INFO:tasks.workunit.client.0.smithi078.stdout:6/236: creat d0/f5a x:0 0 0 2024-09-11T00:17:54.361 INFO:tasks.workunit.client.0.smithi078.stdout:3/177: rename d0/d7/f26 to d0/f36 0 2024-09-11T00:17:54.361 INFO:tasks.workunit.client.0.smithi078.stdout:7/207: write d0/d34/db/d30/f27 [2485431,76852] 0 2024-09-11T00:17:54.361 INFO:tasks.workunit.client.0.smithi078.stdout:7/208: write d0/d34/db/d30/d1d/d14/f41 [395468,72003] 0 2024-09-11T00:17:54.362 INFO:tasks.workunit.client.0.smithi078.stdout:6/237: mknod d0/d1/c5b 0 2024-09-11T00:17:54.362 INFO:tasks.workunit.client.0.smithi078.stdout:6/238: stat d0/d1/d9/f15 0 2024-09-11T00:17:54.363 INFO:tasks.workunit.client.0.smithi078.stdout:3/178: mknod d0/d1a/c37 0 2024-09-11T00:17:54.366 INFO:tasks.workunit.client.0.smithi078.stdout:7/209: dread d0/d34/db/d30/d1d/d14/f41 [0,4194304] 0 2024-09-11T00:17:54.366 INFO:tasks.workunit.client.0.smithi078.stdout:7/210: chown d0/d34/c26 2 1 2024-09-11T00:17:54.367 INFO:tasks.workunit.client.0.smithi078.stdout:7/211: creat d0/f43 x:0 0 0 2024-09-11T00:17:54.367 INFO:tasks.workunit.client.0.smithi078.stdout:7/212: chown d0/d3f 681992 1 2024-09-11T00:17:54.367 INFO:tasks.workunit.client.0.smithi078.stdout:8/184: dwrite da/d13/d1b/f34 [0,4194304] 0 2024-09-11T00:17:54.367 INFO:tasks.workunit.client.0.smithi078.stdout:8/185: dread - da/f2f zero size 2024-09-11T00:17:54.368 INFO:tasks.workunit.client.0.smithi078.stdout:7/213: creat d0/d34/db/d30/d28/f44 x:0 0 0 2024-09-11T00:17:54.369 INFO:tasks.workunit.client.0.smithi078.stdout:1/235: dread d3/d1a/d21/f24 [0,4194304] 0 2024-09-11T00:17:54.372 INFO:tasks.workunit.client.0.smithi078.stdout:8/186: getdents da/d1c/d1e 0 2024-09-11T00:17:54.372 INFO:tasks.workunit.client.0.smithi078.stdout:8/187: dread - da/f2f zero size 2024-09-11T00:17:54.372 INFO:tasks.workunit.client.0.smithi078.stdout:8/188: chown da/d13/d1b/d24 165 1 2024-09-11T00:17:54.372 INFO:tasks.workunit.client.0.smithi078.stdout:8/189: write da/f2f [218449,27151] 0 2024-09-11T00:17:54.374 INFO:tasks.workunit.client.0.smithi078.stdout:1/236: symlink d3/d1a/l48 0 2024-09-11T00:17:54.375 INFO:tasks.workunit.client.0.smithi078.stdout:1/237: stat d3/d1a 0 2024-09-11T00:17:54.375 INFO:tasks.workunit.client.0.smithi078.stdout:1/238: read d3/d1a/ff [1096569,19795] 0 2024-09-11T00:17:54.375 INFO:tasks.workunit.client.0.smithi078.stdout:8/190: mkdir da/d13/d28/d3a 0 2024-09-11T00:17:54.375 INFO:tasks.workunit.client.0.smithi078.stdout:8/191: fsync da/d1c/f38 0 2024-09-11T00:17:54.377 INFO:tasks.workunit.client.0.smithi078.stdout:6/239: dwrite d0/f3c [0,4194304] 0 2024-09-11T00:17:54.380 INFO:tasks.workunit.client.0.smithi078.stdout:3/179: dwrite d0/d1a/d1e/f30 [0,4194304] 0 2024-09-11T00:17:54.380 INFO:tasks.workunit.client.0.smithi078.stdout:1/239: rename d3/l10 to d3/d1a/l49 0 2024-09-11T00:17:54.381 INFO:tasks.workunit.client.0.smithi078.stdout:8/192: mkdir da/d13/d28/d3a/d3b 0 2024-09-11T00:17:54.381 INFO:tasks.workunit.client.0.smithi078.stdout:8/193: stat f7 0 2024-09-11T00:17:54.383 INFO:tasks.workunit.client.0.smithi078.stdout:6/240: getdents d0/d1/d9/d54 0 2024-09-11T00:17:54.386 INFO:tasks.workunit.client.0.smithi078.stdout:3/180: creat d0/d7/d18/d1b/f38 x:0 0 0 2024-09-11T00:17:54.386 INFO:tasks.workunit.client.0.smithi078.stdout:3/181: truncate d0/f36 4700079 0 2024-09-11T00:17:54.388 INFO:tasks.workunit.client.0.smithi078.stdout:1/240: unlink d3/d28/l2a 0 2024-09-11T00:17:54.388 INFO:tasks.workunit.client.0.smithi078.stdout:1/241: truncate d3/d1a/d21/f2f 1028968 0 2024-09-11T00:17:54.388 INFO:tasks.workunit.client.0.smithi078.stdout:1/242: read d3/f17 [2407824,87436] 0 2024-09-11T00:17:54.389 INFO:tasks.workunit.client.0.smithi078.stdout:6/241: unlink d0/d1/d2c/c3f 0 2024-09-11T00:17:54.391 INFO:tasks.workunit.client.0.smithi078.stdout:3/182: mkdir d0/d39 0 2024-09-11T00:17:54.391 INFO:tasks.workunit.client.0.smithi078.stdout:7/214: dwrite d0/f36 [0,4194304] 0 2024-09-11T00:17:54.391 INFO:tasks.workunit.client.0.smithi078.stdout:1/243: mkdir d3/d1a/d21/d4a 0 2024-09-11T00:17:54.392 INFO:tasks.workunit.client.0.smithi078.stdout:8/194: getdents da/d13/d28 0 2024-09-11T00:17:54.393 INFO:tasks.workunit.client.0.smithi078.stdout:6/242: getdents d0/d33 0 2024-09-11T00:17:54.394 INFO:tasks.workunit.client.0.smithi078.stdout:3/183: creat d0/d1a/d1e/f3a x:0 0 0 2024-09-11T00:17:54.395 INFO:tasks.workunit.client.0.smithi078.stdout:7/215: mkdir d0/d34/db/d30/d1d/d14/d45 0 2024-09-11T00:17:54.395 INFO:tasks.workunit.client.0.smithi078.stdout:7/216: fdatasync d0/d34/db/d30/d1d/f39 0 2024-09-11T00:17:54.395 INFO:tasks.workunit.client.0.smithi078.stdout:1/244: creat d3/d1a/d21/f4b x:0 0 0 2024-09-11T00:17:54.395 INFO:tasks.workunit.client.0.smithi078.stdout:1/245: write d3/d1a/d21/f22 [2182893,62794] 0 2024-09-11T00:17:54.396 INFO:tasks.workunit.client.0.smithi078.stdout:8/195: creat da/d13/d1b/f3c x:0 0 0 2024-09-11T00:17:54.397 INFO:tasks.workunit.client.0.smithi078.stdout:6/243: creat d0/d1/d9/f5c x:0 0 0 2024-09-11T00:17:54.399 INFO:tasks.workunit.client.0.smithi078.stdout:1/246: rename d3/d1a/d21/l3c to d3/d1a/d21/l4c 0 2024-09-11T00:17:54.399 INFO:tasks.workunit.client.0.smithi078.stdout:6/244: dread d0/d1/f41 [0,4194304] 0 2024-09-11T00:17:54.400 INFO:tasks.workunit.client.0.smithi078.stdout:6/245: dread d0/d1/f41 [0,4194304] 0 2024-09-11T00:17:54.400 INFO:tasks.workunit.client.0.smithi078.stdout:1/247: write d3/d1a/d21/f22 [518157,129284] 0 2024-09-11T00:17:54.400 INFO:tasks.workunit.client.0.smithi078.stdout:8/196: unlink da/d13/d28/f32 0 2024-09-11T00:17:54.401 INFO:tasks.workunit.client.0.smithi078.stdout:6/246: rmdir d0/d1/d2c 39 2024-09-11T00:17:54.402 INFO:tasks.workunit.client.0.smithi078.stdout:1/248: truncate d3/f17 6370488 0 2024-09-11T00:17:54.403 INFO:tasks.workunit.client.0.smithi078.stdout:8/197: creat da/d13/d28/d3a/d3b/f3d x:0 0 0 2024-09-11T00:17:54.403 INFO:tasks.workunit.client.0.smithi078.stdout:8/198: fdatasync da/d13/f2c 0 2024-09-11T00:17:54.403 INFO:tasks.workunit.client.0.smithi078.stdout:3/184: write d0/d7/d18/d1b/f14 [3247649,4553] 0 2024-09-11T00:17:54.404 INFO:tasks.workunit.client.0.smithi078.stdout:3/185: chown d0/d7/d18 126241 1 2024-09-11T00:17:54.404 INFO:tasks.workunit.client.0.smithi078.stdout:3/186: chown d0/d7/d18 15820733 1 2024-09-11T00:17:54.404 INFO:tasks.workunit.client.0.smithi078.stdout:1/249: link d3/d1a/d21/c23 d3/d28/c4d 0 2024-09-11T00:17:54.405 INFO:tasks.workunit.client.0.smithi078.stdout:8/199: symlink da/d13/l3e 0 2024-09-11T00:17:54.408 INFO:tasks.workunit.client.0.smithi078.stdout:3/187: unlink d0/f6 0 2024-09-11T00:17:54.410 INFO:tasks.workunit.client.0.smithi078.stdout:8/200: mknod da/d13/d19/c3f 0 2024-09-11T00:17:54.413 INFO:tasks.workunit.client.0.smithi078.stdout:3/188: creat d0/d1a/f3b x:0 0 0 2024-09-11T00:17:54.413 INFO:tasks.workunit.client.0.smithi078.stdout:3/189: write d0/d7/d18/d1b/d27/f28 [1443652,59217] 0 2024-09-11T00:17:54.413 INFO:tasks.workunit.client.0.smithi078.stdout:3/190: write d0/f10 [956377,106965] 0 2024-09-11T00:17:54.415 INFO:tasks.workunit.client.0.smithi078.stdout:8/201: dread da/d13/d1b/f2e [0,4194304] 0 2024-09-11T00:17:54.415 INFO:tasks.workunit.client.0.smithi078.stdout:8/202: write da/f14 [745022,4550] 0 2024-09-11T00:17:54.415 INFO:tasks.workunit.client.0.smithi078.stdout:8/203: stat da/d13/d1b/d24 0 2024-09-11T00:17:54.415 INFO:tasks.workunit.client.0.smithi078.stdout:8/204: dread - da/d13/d28/d3a/d3b/f3d zero size 2024-09-11T00:17:54.418 INFO:tasks.workunit.client.0.smithi078.stdout:3/191: rename d0/d7/d18/f33 to d0/f3c 0 2024-09-11T00:17:54.418 INFO:tasks.workunit.client.0.smithi078.stdout:8/205: creat da/d13/d28/d3a/f40 x:0 0 0 2024-09-11T00:17:54.419 INFO:tasks.workunit.client.0.smithi078.stdout:8/206: dread da/f30 [0,4194304] 0 2024-09-11T00:17:54.421 INFO:tasks.workunit.client.0.smithi078.stdout:8/207: truncate da/f10 3785532 0 2024-09-11T00:17:54.422 INFO:tasks.workunit.client.0.smithi078.stdout:3/192: dread d0/f2 [0,4194304] 0 2024-09-11T00:17:54.422 INFO:tasks.workunit.client.0.smithi078.stdout:1/250: dwrite d3/d1a/d21/f24 [0,4194304] 0 2024-09-11T00:17:54.422 INFO:tasks.workunit.client.0.smithi078.stdout:1/251: chown d3/d1a/d21 48779329 1 2024-09-11T00:17:54.422 INFO:tasks.workunit.client.0.smithi078.stdout:3/193: write d0/d1a/f3b [1048215,126502] 0 2024-09-11T00:17:54.422 INFO:tasks.workunit.client.0.smithi078.stdout:3/194: readlink d0/d1a/l29 0 2024-09-11T00:17:54.422 INFO:tasks.workunit.client.0.smithi078.stdout:3/195: readlink d0/d7/l15 0 2024-09-11T00:17:54.424 INFO:tasks.workunit.client.0.smithi078.stdout:1/252: mkdir d3/d28/d4e 0 2024-09-11T00:17:54.424 INFO:tasks.workunit.client.0.smithi078.stdout:1/253: chown d3/d29/f2e 1 1 2024-09-11T00:17:54.426 INFO:tasks.workunit.client.0.smithi078.stdout:6/247: dwrite d0/d1/f2f [0,4194304] 0 2024-09-11T00:17:54.426 INFO:tasks.workunit.client.0.smithi078.stdout:3/196: creat d0/d7/d18/d1b/d27/f3d x:0 0 0 2024-09-11T00:17:54.426 INFO:tasks.workunit.client.0.smithi078.stdout:3/197: read d0/f8 [2527744,70443] 0 2024-09-11T00:17:54.426 INFO:tasks.workunit.client.0.smithi078.stdout:8/208: dread da/fc [0,4194304] 0 2024-09-11T00:17:54.426 INFO:tasks.workunit.client.0.smithi078.stdout:8/209: chown da/d13/d1b/d37 1 1 2024-09-11T00:17:54.426 INFO:tasks.workunit.client.0.smithi078.stdout:8/210: truncate da/fe 1932464 0 2024-09-11T00:17:54.432 INFO:tasks.workunit.client.0.smithi078.stdout:1/254: symlink d3/d29/l4f 0 2024-09-11T00:17:54.435 INFO:tasks.workunit.client.0.smithi078.stdout:6/248: mknod d0/d33/c5d 0 2024-09-11T00:17:54.436 INFO:tasks.workunit.client.0.smithi078.stdout:8/211: creat da/d13/d1b/f41 x:0 0 0 2024-09-11T00:17:54.436 INFO:tasks.workunit.client.0.smithi078.stdout:8/212: dread - da/d13/d1b/f36 zero size 2024-09-11T00:17:54.436 INFO:tasks.workunit.client.0.smithi078.stdout:8/213: fsync da/d13/d19/f35 0 2024-09-11T00:17:54.437 INFO:tasks.workunit.client.0.smithi078.stdout:1/255: creat d3/d29/f50 x:0 0 0 2024-09-11T00:17:54.438 INFO:tasks.workunit.client.0.smithi078.stdout:1/256: creat d3/d28/d39/f51 x:0 0 0 2024-09-11T00:17:54.438 INFO:tasks.workunit.client.0.smithi078.stdout:1/257: fsync d3/d28/f18 0 2024-09-11T00:17:54.438 INFO:tasks.workunit.client.0.smithi078.stdout:6/249: dread d0/d1/f1f [0,4194304] 0 2024-09-11T00:17:54.439 INFO:tasks.workunit.client.0.smithi078.stdout:1/258: creat d3/d29/d45/f52 x:0 0 0 2024-09-11T00:17:54.439 INFO:tasks.workunit.client.0.smithi078.stdout:6/250: mkdir d0/d1/d9/d17/d5e 0 2024-09-11T00:17:54.441 INFO:tasks.workunit.client.0.smithi078.stdout:6/251: rename d0/cb to d0/d1/d1b/c5f 0 2024-09-11T00:17:54.444 INFO:tasks.workunit.client.0.smithi078.stdout:3/198: dwrite d0/d7/d18/d1b/f38 [0,4194304] 0 2024-09-11T00:17:54.444 INFO:tasks.workunit.client.0.smithi078.stdout:3/199: readlink d0/d7/l15 0 2024-09-11T00:17:54.444 INFO:tasks.workunit.client.0.smithi078.stdout:3/200: fdatasync d0/d1a/d1e/f3a 0 2024-09-11T00:17:54.444 INFO:tasks.workunit.client.0.smithi078.stdout:3/201: fdatasync d0/d7/d18/d1b/d27/f32 0 2024-09-11T00:17:54.447 INFO:tasks.workunit.client.0.smithi078.stdout:3/202: mkdir d0/d7/d18/d1b/d34/d3e 0 2024-09-11T00:17:54.447 INFO:tasks.workunit.client.0.smithi078.stdout:3/203: fsync d0/d1a/d1e/f3a 0 2024-09-11T00:17:54.454 INFO:tasks.workunit.client.0.smithi078.stdout:1/259: dwrite d3/d28/f27 [0,4194304] 0 2024-09-11T00:17:54.455 INFO:tasks.workunit.client.0.smithi078.stdout:8/214: dwrite da/d13/d1b/d24/f27 [0,4194304] 0 2024-09-11T00:17:54.455 INFO:tasks.workunit.client.0.smithi078.stdout:8/215: stat da/f14 0 2024-09-11T00:17:54.457 INFO:tasks.workunit.client.0.smithi078.stdout:8/216: symlink da/d13/d1b/l42 0 2024-09-11T00:17:54.459 INFO:tasks.workunit.client.0.smithi078.stdout:8/217: creat da/d13/d28/f43 x:0 0 0 2024-09-11T00:17:54.459 INFO:tasks.workunit.client.0.smithi078.stdout:8/218: stat da/d13/d1b/l42 0 2024-09-11T00:17:54.459 INFO:tasks.workunit.client.0.smithi078.stdout:8/219: mknod da/d1c/c44 0 2024-09-11T00:17:54.460 INFO:tasks.workunit.client.0.smithi078.stdout:8/220: symlink da/d13/d28/l45 0 2024-09-11T00:17:54.460 INFO:tasks.workunit.client.0.smithi078.stdout:1/260: read d3/f1e [3302858,42427] 0 2024-09-11T00:17:54.461 INFO:tasks.workunit.client.0.smithi078.stdout:3/204: dwrite d0/d7/d18/d1b/d27/f22 [0,4194304] 0 2024-09-11T00:17:54.461 INFO:tasks.workunit.client.0.smithi078.stdout:8/221: symlink da/d13/d28/d3a/l46 0 2024-09-11T00:17:54.461 INFO:tasks.workunit.client.0.smithi078.stdout:1/261: getdents d3 0 2024-09-11T00:17:54.464 INFO:tasks.workunit.client.0.smithi078.stdout:8/222: mknod da/d13/d28/c47 0 2024-09-11T00:17:54.466 INFO:tasks.workunit.client.0.smithi078.stdout:1/262: unlink d3/d1a/l1b 0 2024-09-11T00:17:54.467 INFO:tasks.workunit.client.0.smithi078.stdout:8/223: unlink da/ff 0 2024-09-11T00:17:54.468 INFO:tasks.workunit.client.0.smithi078.stdout:8/224: fsync f2 0 2024-09-11T00:17:54.468 INFO:tasks.workunit.client.0.smithi078.stdout:1/263: symlink d3/d1a/d21/d4a/l53 0 2024-09-11T00:17:54.468 INFO:tasks.workunit.client.0.smithi078.stdout:1/264: chown d3/d28/d4e 119 1 2024-09-11T00:17:54.469 INFO:tasks.workunit.client.0.smithi078.stdout:3/205: dread d0/f1f [0,4194304] 0 2024-09-11T00:17:54.469 INFO:tasks.workunit.client.0.smithi078.stdout:8/225: rmdir da/d13 39 2024-09-11T00:17:54.469 INFO:tasks.workunit.client.0.smithi078.stdout:8/226: write da/d13/f31 [399915,124534] 0 2024-09-11T00:17:54.469 INFO:tasks.workunit.client.0.smithi078.stdout:8/227: dread - da/d13/d28/f43 zero size 2024-09-11T00:17:54.470 INFO:tasks.workunit.client.0.smithi078.stdout:8/228: read da/d13/d1b/f2e [431639,77511] 0 2024-09-11T00:17:54.471 INFO:tasks.workunit.client.0.smithi078.stdout:8/229: mknod da/c48 0 2024-09-11T00:17:54.473 INFO:tasks.workunit.client.0.smithi078.stdout:1/265: getdents d3/d1a 0 2024-09-11T00:17:54.474 INFO:tasks.workunit.client.0.smithi078.stdout:1/266: mknod d3/d29/d45/c54 0 2024-09-11T00:17:54.474 INFO:tasks.workunit.client.0.smithi078.stdout:1/267: truncate d3/d29/d45/f52 154105 0 2024-09-11T00:17:54.475 INFO:tasks.workunit.client.0.smithi078.stdout:1/268: write d3/d1a/d21/f2f [30687,9403] 0 2024-09-11T00:17:54.476 INFO:tasks.workunit.client.0.smithi078.stdout:1/269: rename d3/d29/l30 to d3/l55 0 2024-09-11T00:17:54.477 INFO:tasks.workunit.client.0.smithi078.stdout:1/270: truncate d3/d1a/d21/f24 2330148 0 2024-09-11T00:17:54.477 INFO:tasks.workunit.client.0.smithi078.stdout:1/271: creat d3/d29/d45/f56 x:0 0 0 2024-09-11T00:17:54.478 INFO:tasks.workunit.client.0.smithi078.stdout:1/272: readlink d3/l55 0 2024-09-11T00:17:54.479 INFO:tasks.workunit.client.0.smithi078.stdout:8/230: dread da/d13/d19/f35 [0,4194304] 0 2024-09-11T00:17:54.479 INFO:tasks.workunit.client.0.smithi078.stdout:8/231: chown da/l2b 492 1 2024-09-11T00:17:54.480 INFO:tasks.workunit.client.0.smithi078.stdout:8/232: rename da/c18 to da/d13/c49 0 2024-09-11T00:17:54.481 INFO:tasks.workunit.client.0.smithi078.stdout:8/233: creat da/d13/d1b/f4a x:0 0 0 2024-09-11T00:17:54.482 INFO:tasks.workunit.client.0.smithi078.stdout:8/234: truncate da/d13/d28/d3a/f40 948811 0 2024-09-11T00:17:54.482 INFO:tasks.workunit.client.0.smithi078.stdout:8/235: mkdir da/d13/d28/d3a/d4b 0 2024-09-11T00:17:54.484 INFO:tasks.workunit.client.0.smithi078.stdout:8/236: mkdir da/d1c/d4c 0 2024-09-11T00:17:54.484 INFO:tasks.workunit.client.0.smithi078.stdout:8/237: truncate da/d13/d28/f43 212534 0 2024-09-11T00:17:54.484 INFO:tasks.workunit.client.0.smithi078.stdout:1/273: truncate d3/d1a/d21/f2f 1026249 0 2024-09-11T00:17:54.487 INFO:tasks.workunit.client.0.smithi078.stdout:1/274: link d3/d1a/ff d3/d1a/d21/f57 0 2024-09-11T00:17:54.487 INFO:tasks.workunit.client.0.smithi078.stdout:1/275: readlink d3/d1a/d21/l26 0 2024-09-11T00:17:54.487 INFO:tasks.workunit.client.0.smithi078.stdout:1/276: readlink d3/l20 0 2024-09-11T00:17:54.487 INFO:tasks.workunit.client.0.smithi078.stdout:1/277: fdatasync d3/d29/d45/f3a 0 2024-09-11T00:17:54.487 INFO:tasks.workunit.client.0.smithi078.stdout:1/278: fsync d3/d1a/d21/f4b 0 2024-09-11T00:17:54.493 INFO:tasks.workunit.client.0.smithi078.stdout:8/238: write da/f2a [4174098,98885] 0 2024-09-11T00:17:54.493 INFO:tasks.workunit.client.0.smithi078.stdout:1/279: dread d3/d28/f27 [0,4194304] 0 2024-09-11T00:17:54.496 INFO:tasks.workunit.client.0.smithi078.stdout:1/280: dread d3/d1a/d21/f22 [0,4194304] 0 2024-09-11T00:17:54.560 INFO:tasks.workunit.client.0.smithi078.stdout:1/281: creat d3/d28/d4e/f58 x:0 0 0 2024-09-11T00:17:54.560 INFO:tasks.workunit.client.0.smithi078.stdout:1/282: write d3/f1c [2969881,71905] 0 2024-09-11T00:17:54.560 INFO:tasks.workunit.client.0.smithi078.stdout:1/283: symlink d3/d28/d39/l59 0 2024-09-11T00:17:54.560 INFO:tasks.workunit.client.0.smithi078.stdout:1/284: write d3/d1a/d21/f57 [1457788,36878] 0 2024-09-11T00:17:54.561 INFO:tasks.workunit.client.0.smithi078.stdout:1/285: rmdir d3/d29/d45 39 2024-09-11T00:17:54.561 INFO:tasks.workunit.client.0.smithi078.stdout:1/286: creat d3/d1a/d21/f5a x:0 0 0 2024-09-11T00:17:54.561 INFO:tasks.workunit.client.0.smithi078.stdout:1/287: dread d3/d1a/d21/f44 [0,4194304] 0 2024-09-11T00:17:54.561 INFO:tasks.workunit.client.0.smithi078.stdout:8/239: dwrite f2 [0,4194304] 0 2024-09-11T00:17:54.561 INFO:tasks.workunit.client.0.smithi078.stdout:8/240: read da/f2a [2350963,48491] 0 2024-09-11T00:17:54.561 INFO:tasks.workunit.client.0.smithi078.stdout:8/241: unlink da/d13/d28/f43 0 2024-09-11T00:17:54.561 INFO:tasks.workunit.client.0.smithi078.stdout:8/242: mknod da/d13/d1b/c4d 0 2024-09-11T00:17:54.561 INFO:tasks.workunit.client.0.smithi078.stdout:1/288: write f2 [6917450,99534] 0 2024-09-11T00:17:54.561 INFO:tasks.workunit.client.0.smithi078.stdout:1/289: read - d3/d29/d45/f3f zero size 2024-09-11T00:17:54.561 INFO:tasks.workunit.client.0.smithi078.stdout:0/206: sync 2024-09-11T00:17:54.561 INFO:tasks.workunit.client.0.smithi078.stdout:9/139: sync 2024-09-11T00:17:54.561 INFO:tasks.workunit.client.0.smithi078.stdout:5/149: sync 2024-09-11T00:17:54.561 INFO:tasks.workunit.client.0.smithi078.stdout:9/140: chown dc/d12/c1f 18031 1 2024-09-11T00:17:54.561 INFO:tasks.workunit.client.0.smithi078.stdout:0/207: rename d2/d3/d7/dc to d2/d2a/d2c/d42 0 2024-09-11T00:17:54.562 INFO:tasks.workunit.client.0.smithi078.stdout:9/141: symlink dc/d12/l2f 0 2024-09-11T00:17:54.562 INFO:tasks.workunit.client.0.smithi078.stdout:8/243: dwrite da/fe [0,4194304] 0 2024-09-11T00:17:54.562 INFO:tasks.workunit.client.0.smithi078.stdout:0/208: unlink d2/d2a/l3f 0 2024-09-11T00:17:54.562 INFO:tasks.workunit.client.0.smithi078.stdout:9/142: unlink dc/d12/f13 0 2024-09-11T00:17:54.562 INFO:tasks.workunit.client.0.smithi078.stdout:8/244: mkdir da/d13/d1b/d4e 0 2024-09-11T00:17:54.562 INFO:tasks.workunit.client.0.smithi078.stdout:8/245: chown da/d1c/d1e 22 1 2024-09-11T00:17:54.562 INFO:tasks.workunit.client.0.smithi078.stdout:8/246: read - da/d13/d28/d3a/d3b/f3d zero size 2024-09-11T00:17:54.562 INFO:tasks.workunit.client.0.smithi078.stdout:8/247: fdatasync da/d13/d19/f1a 0 2024-09-11T00:17:54.562 INFO:tasks.workunit.client.0.smithi078.stdout:8/248: chown da/d13/d1b/f41 641619717 1 2024-09-11T00:17:54.562 INFO:tasks.workunit.client.0.smithi078.stdout:8/249: dread - da/d13/d1b/f36 zero size 2024-09-11T00:17:54.562 INFO:tasks.workunit.client.0.smithi078.stdout:8/250: chown da/d13/f31 4 1 2024-09-11T00:17:54.562 INFO:tasks.workunit.client.0.smithi078.stdout:0/209: symlink d2/d2a/d2c/d42/d23/l43 0 2024-09-11T00:17:54.562 INFO:tasks.workunit.client.0.smithi078.stdout:0/210: write d2/d3/f1b [4976411,102262] 0 2024-09-11T00:17:54.562 INFO:tasks.workunit.client.0.smithi078.stdout:0/211: chown d2/d3/d7/cf 1125305650 1 2024-09-11T00:17:54.563 INFO:tasks.workunit.client.0.smithi078.stdout:0/212: chown d2/d2a/d2c/d42/d23/l43 1904772592 1 2024-09-11T00:17:54.563 INFO:tasks.workunit.client.0.smithi078.stdout:0/213: stat d2/d3/d7/f2b 0 2024-09-11T00:17:54.563 INFO:tasks.workunit.client.0.smithi078.stdout:5/150: dread d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f20 [4194304,4194304] 0 2024-09-11T00:17:54.563 INFO:tasks.workunit.client.0.smithi078.stdout:9/143: rmdir dc 39 2024-09-11T00:17:54.563 INFO:tasks.workunit.client.0.smithi078.stdout:9/144: readlink dc/ld 0 2024-09-11T00:17:54.563 INFO:tasks.workunit.client.0.smithi078.stdout:5/151: creat d7/d8/d33/d22/d25/d28/f3c x:0 0 0 2024-09-11T00:17:54.563 INFO:tasks.workunit.client.0.smithi078.stdout:5/152: truncate d7/d8/de/f11 1248926 0 2024-09-11T00:17:54.563 INFO:tasks.workunit.client.0.smithi078.stdout:9/145: mkdir dc/d12/d20/d30 0 2024-09-11T00:17:54.563 INFO:tasks.workunit.client.0.smithi078.stdout:9/146: dread - dc/d12/f26 zero size 2024-09-11T00:17:54.563 INFO:tasks.workunit.client.0.smithi078.stdout:9/147: dread dc/f29 [0,4194304] 0 2024-09-11T00:17:54.563 INFO:tasks.workunit.client.0.smithi078.stdout:0/214: symlink d2/d3/d7/l44 0 2024-09-11T00:17:54.563 INFO:tasks.workunit.client.0.smithi078.stdout:5/153: creat d7/d8/f3d x:0 0 0 2024-09-11T00:17:54.563 INFO:tasks.workunit.client.0.smithi078.stdout:5/154: chown d7 123134052 1 2024-09-11T00:17:54.563 INFO:tasks.workunit.client.0.smithi078.stdout:5/155: stat d7/d8/de/d2c 0 2024-09-11T00:17:54.564 INFO:tasks.workunit.client.0.smithi078.stdout:9/148: rmdir dc/d12/d24 39 2024-09-11T00:17:54.564 INFO:tasks.workunit.client.0.smithi078.stdout:0/215: mknod d2/c45 0 2024-09-11T00:17:54.564 INFO:tasks.workunit.client.0.smithi078.stdout:1/290: dwrite d3/d28/d39/f51 [0,4194304] 0 2024-09-11T00:17:54.564 INFO:tasks.workunit.client.0.smithi078.stdout:1/291: write d3/d29/d45/f52 [473952,114941] 0 2024-09-11T00:17:54.564 INFO:tasks.workunit.client.0.smithi078.stdout:5/156: unlink d7/d8/d33/d22/d25/d28/f3c 0 2024-09-11T00:17:54.564 INFO:tasks.workunit.client.0.smithi078.stdout:5/157: rename d7/d8/d33 to d7/d8/d33/d22/d25/d28/d3e 22 2024-09-11T00:17:54.564 INFO:tasks.workunit.client.0.smithi078.stdout:9/149: symlink dc/d12/d20/d30/l31 0 2024-09-11T00:17:54.564 INFO:tasks.workunit.client.0.smithi078.stdout:0/216: creat d2/d2a/d2c/d35/f46 x:0 0 0 2024-09-11T00:17:54.564 INFO:tasks.workunit.client.0.smithi078.stdout:0/217: fsync d2/d2a/d2c/d42/f24 0 2024-09-11T00:17:54.564 INFO:tasks.workunit.client.0.smithi078.stdout:1/292: unlink d3/d28/c4d 0 2024-09-11T00:17:54.564 INFO:tasks.workunit.client.0.smithi078.stdout:1/293: dread - d3/d29/f50 zero size 2024-09-11T00:17:54.564 INFO:tasks.workunit.client.0.smithi078.stdout:5/158: symlink d7/d8/d33/d22/d25/d28/d24/d1c/l3f 0 2024-09-11T00:17:54.564 INFO:tasks.workunit.client.0.smithi078.stdout:1/294: dread d3/d1a/f33 [0,4194304] 0 2024-09-11T00:17:54.564 INFO:tasks.workunit.client.0.smithi078.stdout:0/218: rename d2/d2a/d2c/f32 to d2/d3/f47 0 2024-09-11T00:17:54.565 INFO:tasks.workunit.client.0.smithi078.stdout:8/251: dwrite da/d13/f31 [0,4194304] 0 2024-09-11T00:17:54.565 INFO:tasks.workunit.client.0.smithi078.stdout:8/252: truncate da/d13/d1b/f4a 995982 0 2024-09-11T00:17:54.565 INFO:tasks.workunit.client.0.smithi078.stdout:5/159: link d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d26/c3b d7/d8/de/c40 0 2024-09-11T00:17:54.565 INFO:tasks.workunit.client.0.smithi078.stdout:8/253: symlink da/d13/d1b/d24/l4f 0 2024-09-11T00:17:54.565 INFO:tasks.workunit.client.0.smithi078.stdout:8/254: truncate da/d13/d1b/f36 714830 0 2024-09-11T00:17:54.565 INFO:tasks.workunit.client.0.smithi078.stdout:9/150: getdents dc/d12/d20/d30 0 2024-09-11T00:17:54.565 INFO:tasks.workunit.client.0.smithi078.stdout:5/160: link d7/d8/d33/d22/f2d d7/d8/d33/d22/d25/d28/f41 0 2024-09-11T00:17:54.565 INFO:tasks.workunit.client.0.smithi078.stdout:1/295: dread d3/d28/d39/f51 [0,4194304] 0 2024-09-11T00:17:54.565 INFO:tasks.workunit.client.0.smithi078.stdout:8/255: rename da/f12 to da/d13/f50 0 2024-09-11T00:17:54.565 INFO:tasks.workunit.client.0.smithi078.stdout:9/151: creat dc/d12/d20/f32 x:0 0 0 2024-09-11T00:17:54.565 INFO:tasks.workunit.client.0.smithi078.stdout:9/152: readlink dc/d12/d20/d30/l31 0 2024-09-11T00:17:54.565 INFO:tasks.workunit.client.0.smithi078.stdout:5/161: symlink d7/d8/l42 0 2024-09-11T00:17:54.565 INFO:tasks.workunit.client.0.smithi078.stdout:5/162: readlink d7/l1a 0 2024-09-11T00:17:54.565 INFO:tasks.workunit.client.0.smithi078.stdout:5/163: chown d7/d8/d33/d22/d25/d28/d24/d1c 12368964 1 2024-09-11T00:17:54.566 INFO:tasks.workunit.client.0.smithi078.stdout:8/256: symlink da/l51 0 2024-09-11T00:17:54.567 INFO:tasks.workunit.client.0.smithi078.stdout:9/153: mknod dc/d12/c33 0 2024-09-11T00:17:54.567 INFO:tasks.workunit.client.0.smithi078.stdout:1/296: write f2 [3552120,39982] 0 2024-09-11T00:17:54.567 INFO:tasks.workunit.client.0.smithi078.stdout:0/219: dwrite d2/d3/f47 [0,4194304] 0 2024-09-11T00:17:54.567 INFO:tasks.workunit.client.0.smithi078.stdout:5/164: rmdir d7/d8/d33/d22/d25/d28/d24/d1c/d1e 39 2024-09-11T00:17:54.567 INFO:tasks.workunit.client.0.smithi078.stdout:5/165: write d7/d8/de/f21 [142486,69402] 0 2024-09-11T00:17:54.567 INFO:tasks.workunit.client.0.smithi078.stdout:8/257: link da/d13/d19/f35 da/d13/d19/f52 0 2024-09-11T00:17:54.567 INFO:tasks.workunit.client.0.smithi078.stdout:9/154: truncate fa 5005240 0 2024-09-11T00:17:54.574 INFO:tasks.workunit.client.0.smithi078.stdout:0/220: creat d2/d2a/d2c/d42/d23/f48 x:0 0 0 2024-09-11T00:17:54.574 INFO:tasks.workunit.client.0.smithi078.stdout:9/155: dread f7 [4194304,4194304] 0 2024-09-11T00:17:54.574 INFO:tasks.workunit.client.0.smithi078.stdout:5/166: rmdir d7/d8 39 2024-09-11T00:17:54.574 INFO:tasks.workunit.client.0.smithi078.stdout:1/297: dwrite d3/d1a/d21/f24 [0,4194304] 0 2024-09-11T00:17:54.576 INFO:tasks.workunit.client.0.smithi078.stdout:8/258: getdents da/d13/d1b 0 2024-09-11T00:17:54.576 INFO:tasks.workunit.client.0.smithi078.stdout:8/259: stat da/d13/d19/f35 0 2024-09-11T00:17:54.576 INFO:tasks.workunit.client.0.smithi078.stdout:8/260: chown da/c11 77476 1 2024-09-11T00:17:54.577 INFO:tasks.workunit.client.0.smithi078.stdout:5/167: mknod d7/c43 0 2024-09-11T00:17:54.579 INFO:tasks.workunit.client.0.smithi078.stdout:1/298: link d3/l20 d3/d1a/l5b 0 2024-09-11T00:17:54.580 INFO:tasks.workunit.client.0.smithi078.stdout:1/299: mknod d3/d28/d39/c5c 0 2024-09-11T00:17:54.580 INFO:tasks.workunit.client.0.smithi078.stdout:1/300: read - d3/d29/f2e zero size 2024-09-11T00:17:54.580 INFO:tasks.workunit.client.0.smithi078.stdout:1/301: chown d3/f17 15206907 1 2024-09-11T00:17:54.582 INFO:tasks.workunit.client.0.smithi078.stdout:4/196: sync 2024-09-11T00:17:54.582 INFO:tasks.workunit.client.0.smithi078.stdout:2/245: sync 2024-09-11T00:17:54.585 INFO:tasks.workunit.client.0.smithi078.stdout:0/221: write d2/f16 [3250849,106753] 0 2024-09-11T00:17:54.587 INFO:tasks.workunit.client.0.smithi078.stdout:0/222: creat d2/d2a/d2c/d42/d23/f49 x:0 0 0 2024-09-11T00:17:54.595 INFO:tasks.workunit.client.0.smithi078.stdout:5/168: read f6 [3394559,130215] 0 2024-09-11T00:17:54.598 INFO:tasks.workunit.client.0.smithi078.stdout:8/261: dwrite f6 [0,4194304] 0 2024-09-11T00:17:54.598 INFO:tasks.workunit.client.0.smithi078.stdout:8/262: chown da/d13/d1b/d24/l4f 55604184 1 2024-09-11T00:17:54.602 INFO:tasks.workunit.client.0.smithi078.stdout:8/263: rmdir da/d1c 39 2024-09-11T00:17:54.604 INFO:tasks.workunit.client.0.smithi078.stdout:1/302: dwrite d3/fc [8388608,4194304] 0 2024-09-11T00:17:54.604 INFO:tasks.workunit.client.0.smithi078.stdout:3/206: sync 2024-09-11T00:17:54.604 INFO:tasks.workunit.client.0.smithi078.stdout:7/217: sync 2024-09-11T00:17:54.605 INFO:tasks.workunit.client.0.smithi078.stdout:6/252: sync 2024-09-11T00:17:54.605 INFO:tasks.workunit.client.0.smithi078.stdout:7/218: truncate d0/f43 111067 0 2024-09-11T00:17:54.605 INFO:tasks.workunit.client.0.smithi078.stdout:5/169: write d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f20 [7930176,116582] 0 2024-09-11T00:17:54.605 INFO:tasks.workunit.client.0.smithi078.stdout:6/253: mknod d0/d1/d1b/c60 0 2024-09-11T00:17:54.605 INFO:tasks.workunit.client.0.smithi078.stdout:3/207: symlink d0/d7/d18/d1b/d34/d3e/l3f 0 2024-09-11T00:17:54.607 INFO:tasks.workunit.client.0.smithi078.stdout:8/264: dread da/d13/d1b/f2e [0,4194304] 0 2024-09-11T00:17:54.607 INFO:tasks.workunit.client.0.smithi078.stdout:8/265: stat da/d13/d19/f52 0 2024-09-11T00:17:54.607 INFO:tasks.workunit.client.0.smithi078.stdout:7/219: mknod d0/d34/c46 0 2024-09-11T00:17:54.607 INFO:tasks.workunit.client.0.smithi078.stdout:6/254: creat d0/f61 x:0 0 0 2024-09-11T00:17:54.609 INFO:tasks.workunit.client.0.smithi078.stdout:8/266: mkdir da/d13/d1b/d53 0 2024-09-11T00:17:54.609 INFO:tasks.workunit.client.0.smithi078.stdout:5/170: dread d7/f1f [0,4194304] 0 2024-09-11T00:17:54.609 INFO:tasks.workunit.client.0.smithi078.stdout:5/171: fdatasync d7/d8/d33/d22/d25/d28/d24/d1c/f2e 0 2024-09-11T00:17:54.609 INFO:tasks.workunit.client.0.smithi078.stdout:7/220: creat d0/d34/db/f47 x:0 0 0 2024-09-11T00:17:54.609 INFO:tasks.workunit.client.0.smithi078.stdout:7/221: truncate d0/d34/f33 1166169 0 2024-09-11T00:17:54.609 INFO:tasks.workunit.client.0.smithi078.stdout:6/255: mknod d0/d1/d9/c62 0 2024-09-11T00:17:54.610 INFO:tasks.workunit.client.0.smithi078.stdout:8/267: mknod da/d13/d28/d3a/c54 0 2024-09-11T00:17:54.610 INFO:tasks.workunit.client.0.smithi078.stdout:8/268: chown da/d13/c49 34617 1 2024-09-11T00:17:54.611 INFO:tasks.workunit.client.0.smithi078.stdout:8/269: chown da/d1c/d4c 453288 1 2024-09-11T00:17:54.611 INFO:tasks.workunit.client.0.smithi078.stdout:8/270: chown da/d1c/f38 512360 1 2024-09-11T00:17:54.611 INFO:tasks.workunit.client.0.smithi078.stdout:8/271: dread - da/d1c/f38 zero size 2024-09-11T00:17:54.611 INFO:tasks.workunit.client.0.smithi078.stdout:5/172: creat d7/d8/d33/d22/d25/d28/d24/f44 x:0 0 0 2024-09-11T00:17:54.613 INFO:tasks.workunit.client.0.smithi078.stdout:8/272: rename da/d13/d1b/f41 to da/d1c/d1e/f55 0 2024-09-11T00:17:54.613 INFO:tasks.workunit.client.0.smithi078.stdout:8/273: fsync da/d13/f50 0 2024-09-11T00:17:54.613 INFO:tasks.workunit.client.0.smithi078.stdout:5/173: creat d7/d8/d33/d22/d25/f45 x:0 0 0 2024-09-11T00:17:54.614 INFO:tasks.workunit.client.0.smithi078.stdout:8/274: mkdir da/d13/d28/d56 0 2024-09-11T00:17:54.615 INFO:tasks.workunit.client.0.smithi078.stdout:5/174: symlink d7/d8/d33/d22/l46 0 2024-09-11T00:17:54.615 INFO:tasks.workunit.client.0.smithi078.stdout:5/175: fsync d7/d8/d33/d22/d25/d28/d24/fb 0 2024-09-11T00:17:54.616 INFO:tasks.workunit.client.0.smithi078.stdout:8/275: creat da/d13/d28/d3a/d3b/f57 x:0 0 0 2024-09-11T00:17:54.618 INFO:tasks.workunit.client.0.smithi078.stdout:2/246: dwrite d0/d19/f2c [4194304,4194304] 0 2024-09-11T00:17:54.618 INFO:tasks.workunit.client.0.smithi078.stdout:0/223: dwrite d2/d3/d7/f40 [0,4194304] 0 2024-09-11T00:17:54.619 INFO:tasks.workunit.client.0.smithi078.stdout:7/222: write d0/d34/db/d30/d1d/fe [2370337,121309] 0 2024-09-11T00:17:54.619 INFO:tasks.workunit.client.0.smithi078.stdout:7/223: write d0/d34/db/d30/d1d/f13 [366827,40638] 0 2024-09-11T00:17:54.620 INFO:tasks.workunit.client.0.smithi078.stdout:8/276: write da/f2f [187146,93585] 0 2024-09-11T00:17:54.620 INFO:tasks.workunit.client.0.smithi078.stdout:8/277: write da/d13/d28/d3a/d3b/f57 [69445,112685] 0 2024-09-11T00:17:54.620 INFO:tasks.workunit.client.0.smithi078.stdout:8/278: fdatasync da/d13/d1b/f4a 0 2024-09-11T00:17:54.620 INFO:tasks.workunit.client.0.smithi078.stdout:8/279: write da/f10 [1605042,58290] 0 2024-09-11T00:17:54.620 INFO:tasks.workunit.client.0.smithi078.stdout:2/247: rmdir d0/d31 39 2024-09-11T00:17:54.621 INFO:tasks.workunit.client.0.smithi078.stdout:4/197: dwrite dc/f39 [0,4194304] 0 2024-09-11T00:17:54.621 INFO:tasks.workunit.client.0.smithi078.stdout:3/208: write d0/d7/d18/d1b/f38 [1121480,126812] 0 2024-09-11T00:17:54.621 INFO:tasks.workunit.client.0.smithi078.stdout:0/224: link d2/c9 d2/d2a/d2c/d35/c4a 0 2024-09-11T00:17:54.621 INFO:tasks.workunit.client.0.smithi078.stdout:0/225: chown d2/d3/c12 1 1 2024-09-11T00:17:54.625 INFO:tasks.workunit.client.0.smithi078.stdout:8/280: rename da/d1c/l33 to da/d1c/d1e/l58 0 2024-09-11T00:17:54.625 INFO:tasks.workunit.client.0.smithi078.stdout:7/224: write d0/d34/db/f15 [1128931,15151] 0 2024-09-11T00:17:54.629 INFO:tasks.workunit.client.0.smithi078.stdout:1/303: dwrite d3/f9 [4194304,4194304] 0 2024-09-11T00:17:54.630 INFO:tasks.workunit.client.0.smithi078.stdout:2/248: rename d0/d19/f1a to d0/d1/f54 0 2024-09-11T00:17:54.630 INFO:tasks.workunit.client.0.smithi078.stdout:2/249: write d0/d1/d8/f12 [405041,66087] 0 2024-09-11T00:17:54.632 INFO:tasks.workunit.client.0.smithi078.stdout:7/225: link d0/d34/db/d30/d1d/f17 d0/d34/db/f48 0 2024-09-11T00:17:54.633 INFO:tasks.workunit.client.0.smithi078.stdout:1/304: link d3/d1a/ff d3/d29/f5d 0 2024-09-11T00:17:54.634 INFO:tasks.workunit.client.0.smithi078.stdout:3/209: rename d0/d7/f17 to d0/d7/d18/f40 0 2024-09-11T00:17:54.635 INFO:tasks.workunit.client.0.smithi078.stdout:2/250: mknod d0/c55 0 2024-09-11T00:17:54.635 INFO:tasks.workunit.client.0.smithi078.stdout:2/251: chown d0/d1/d11 101290726 1 2024-09-11T00:17:54.636 INFO:tasks.workunit.client.0.smithi078.stdout:1/305: dread d3/f1e [0,4194304] 0 2024-09-11T00:17:54.636 INFO:tasks.workunit.client.0.smithi078.stdout:1/306: chown d3/d28/d39 1503 1 2024-09-11T00:17:54.637 INFO:tasks.workunit.client.0.smithi078.stdout:6/256: dwrite d0/fc [0,4194304] 0 2024-09-11T00:17:54.638 INFO:tasks.workunit.client.0.smithi078.stdout:6/257: chown d0/f61 0 1 2024-09-11T00:17:54.638 INFO:tasks.workunit.client.0.smithi078.stdout:4/198: dwrite dc/d17/f34 [0,4194304] 0 2024-09-11T00:17:54.639 INFO:tasks.workunit.client.0.smithi078.stdout:3/210: symlink d0/d7/l41 0 2024-09-11T00:17:54.641 INFO:tasks.workunit.client.0.smithi078.stdout:2/252: mknod d0/d1/d3c/c56 0 2024-09-11T00:17:54.641 INFO:tasks.workunit.client.0.smithi078.stdout:2/253: write d0/d1/d8/f29 [215918,96742] 0 2024-09-11T00:17:54.645 INFO:tasks.workunit.client.0.smithi078.stdout:8/281: rename da/d13/d28/d3a/d3b to da/d13/d1b/d59 0 2024-09-11T00:17:54.645 INFO:tasks.workunit.client.0.smithi078.stdout:0/226: dwrite d2/d3/d7/f2b [4194304,4194304] 0 2024-09-11T00:17:54.645 INFO:tasks.workunit.client.0.smithi078.stdout:8/282: write da/d13/d1b/d59/f57 [783821,114580] 0 2024-09-11T00:17:54.649 INFO:tasks.workunit.client.0.smithi078.stdout:4/199: creat dc/d1d/f41 x:0 0 0 2024-09-11T00:17:54.654 INFO:tasks.workunit.client.0.smithi078.stdout:7/226: dwrite d0/d34/db/f48 [0,4194304] 0 2024-09-11T00:17:54.656 INFO:tasks.workunit.client.0.smithi078.stdout:8/283: dread da/f10 [0,4194304] 0 2024-09-11T00:17:54.657 INFO:tasks.workunit.client.0.smithi078.stdout:0/227: symlink d2/d2a/d2c/l4b 0 2024-09-11T00:17:54.658 INFO:tasks.workunit.client.0.smithi078.stdout:0/228: truncate d2/d3/d7/f15 650736 0 2024-09-11T00:17:54.658 INFO:tasks.workunit.client.0.smithi078.stdout:4/200: symlink dc/d10/d40/d3a/d3b/l42 0 2024-09-11T00:17:54.660 INFO:tasks.workunit.client.0.smithi078.stdout:3/211: dwrite d0/d7/d18/d1b/d27/f32 [0,4194304] 0 2024-09-11T00:17:54.660 INFO:tasks.workunit.client.0.smithi078.stdout:3/212: read d0/d7/d18/d1b/f38 [2658040,63746] 0 2024-09-11T00:17:54.660 INFO:tasks.workunit.client.0.smithi078.stdout:3/213: rename d0 to d0/d42 22 2024-09-11T00:17:54.661 INFO:tasks.workunit.client.0.smithi078.stdout:7/227: write d0/d34/db/d32/f3a [3295530,128298] 0 2024-09-11T00:17:54.661 INFO:tasks.workunit.client.0.smithi078.stdout:0/229: symlink d2/d2a/l4c 0 2024-09-11T00:17:54.663 INFO:tasks.workunit.client.0.smithi078.stdout:1/307: dwrite d3/fc [4194304,4194304] 0 2024-09-11T00:17:54.663 INFO:tasks.workunit.client.0.smithi078.stdout:1/308: fsync d3/d1a/d21/f22 0 2024-09-11T00:17:54.663 INFO:tasks.workunit.client.0.smithi078.stdout:4/201: getdents dc 0 2024-09-11T00:17:54.665 INFO:tasks.workunit.client.0.smithi078.stdout:3/214: mknod d0/d1a/d1e/c43 0 2024-09-11T00:17:54.666 INFO:tasks.workunit.client.0.smithi078.stdout:8/284: read da/fe [941219,16700] 0 2024-09-11T00:17:54.666 INFO:tasks.workunit.client.0.smithi078.stdout:7/228: getdents d0 0 2024-09-11T00:17:54.666 INFO:tasks.workunit.client.0.smithi078.stdout:7/229: stat d0/d34/f33 0 2024-09-11T00:17:54.667 INFO:tasks.workunit.client.0.smithi078.stdout:0/230: symlink d2/d2a/d2c/l4d 0 2024-09-11T00:17:54.667 INFO:tasks.workunit.client.0.smithi078.stdout:0/231: stat d2/d2a/l4c 0 2024-09-11T00:17:54.668 INFO:tasks.workunit.client.0.smithi078.stdout:4/202: mknod dc/d10/d40/d33/c43 0 2024-09-11T00:17:54.669 INFO:tasks.workunit.client.0.smithi078.stdout:4/203: truncate dc/d10/f14 357196 0 2024-09-11T00:17:54.669 INFO:tasks.workunit.client.0.smithi078.stdout:3/215: getdents d0/d7/d18/d1b 0 2024-09-11T00:17:54.670 INFO:tasks.workunit.client.0.smithi078.stdout:8/285: creat da/d13/d1b/d37/f5a x:0 0 0 2024-09-11T00:17:54.670 INFO:tasks.workunit.client.0.smithi078.stdout:7/230: rmdir d0/d34/db 39 2024-09-11T00:17:54.671 INFO:tasks.workunit.client.0.smithi078.stdout:4/204: creat dc/d17/f44 x:0 0 0 2024-09-11T00:17:54.672 INFO:tasks.workunit.client.0.smithi078.stdout:3/216: getdents d0/d7/d18/d1b/d27 0 2024-09-11T00:17:54.673 INFO:tasks.workunit.client.0.smithi078.stdout:8/286: rmdir da 39 2024-09-11T00:17:54.674 INFO:tasks.workunit.client.0.smithi078.stdout:2/254: truncate d0/d1/f27 6443593 0 2024-09-11T00:17:54.674 INFO:tasks.workunit.client.0.smithi078.stdout:7/231: rmdir d0/d34 39 2024-09-11T00:17:54.674 INFO:tasks.workunit.client.0.smithi078.stdout:7/232: chown d0/d34/db/d30/f27 101 1 2024-09-11T00:17:54.675 INFO:tasks.workunit.client.0.smithi078.stdout:7/233: chown d0/d34/db/d30/d1d/f17 26544835 1 2024-09-11T00:17:54.675 INFO:tasks.workunit.client.0.smithi078.stdout:7/234: fdatasync d0/d34/db/d30/f3e 0 2024-09-11T00:17:54.676 INFO:tasks.workunit.client.0.smithi078.stdout:4/205: unlink dc/d10/d1f/c29 0 2024-09-11T00:17:54.677 INFO:tasks.workunit.client.0.smithi078.stdout:4/206: chown dc/d1d/f41 4 1 2024-09-11T00:17:54.677 INFO:tasks.workunit.client.0.smithi078.stdout:4/207: chown dc/d10/d1f/f35 461005 1 2024-09-11T00:17:54.677 INFO:tasks.workunit.client.0.smithi078.stdout:4/208: chown dc/d10/d40/f28 146303 1 2024-09-11T00:17:54.677 INFO:tasks.workunit.client.0.smithi078.stdout:7/235: read d0/d34/db/d30/d1d/d14/f2a [242539,63481] 0 2024-09-11T00:17:54.677 INFO:tasks.workunit.client.0.smithi078.stdout:4/209: write dc/d10/f1a [1042064,128362] 0 2024-09-11T00:17:54.677 INFO:tasks.workunit.client.0.smithi078.stdout:8/287: rmdir da/d1c/d1e 39 2024-09-11T00:17:54.678 INFO:tasks.workunit.client.0.smithi078.stdout:2/255: symlink d0/d19/l57 0 2024-09-11T00:17:54.678 INFO:tasks.workunit.client.0.smithi078.stdout:2/256: fsync d0/d1/d6/f15 0 2024-09-11T00:17:54.678 INFO:tasks.workunit.client.0.smithi078.stdout:4/210: getdents dc/d10/d40 0 2024-09-11T00:17:54.679 INFO:tasks.workunit.client.0.smithi078.stdout:7/236: symlink d0/d34/db/d30/d28/l49 0 2024-09-11T00:17:54.680 INFO:tasks.workunit.client.0.smithi078.stdout:3/217: read d0/f36 [1986656,46123] 0 2024-09-11T00:17:54.680 INFO:tasks.workunit.client.0.smithi078.stdout:3/218: chown d0/f2 3 1 2024-09-11T00:17:54.680 INFO:tasks.workunit.client.0.smithi078.stdout:3/219: fdatasync d0/f3c 0 2024-09-11T00:17:54.681 INFO:tasks.workunit.client.0.smithi078.stdout:8/288: mknod da/d13/d1b/c5b 0 2024-09-11T00:17:54.681 INFO:tasks.workunit.client.0.smithi078.stdout:7/237: symlink d0/l4a 0 2024-09-11T00:17:54.681 INFO:tasks.workunit.client.0.smithi078.stdout:1/309: dwrite d3/d28/f1f [0,4194304] 0 2024-09-11T00:17:54.683 INFO:tasks.workunit.client.0.smithi078.stdout:3/220: mknod d0/d1a/d1e/c44 0 2024-09-11T00:17:54.683 INFO:tasks.workunit.client.0.smithi078.stdout:3/221: readlink d0/d7/l15 0 2024-09-11T00:17:54.683 INFO:tasks.workunit.client.0.smithi078.stdout:3/222: write d0/d7/d18/d1b/d27/f3d [22295,114229] 0 2024-09-11T00:17:54.684 INFO:tasks.workunit.client.0.smithi078.stdout:7/238: symlink d0/d34/db/d30/l4b 0 2024-09-11T00:17:54.684 INFO:tasks.workunit.client.0.smithi078.stdout:7/239: write d0/f43 [706481,101040] 0 2024-09-11T00:17:54.684 INFO:tasks.workunit.client.0.smithi078.stdout:7/240: chown d0/d34/db/d30/c40 209484 1 2024-09-11T00:17:54.685 INFO:tasks.workunit.client.0.smithi078.stdout:1/310: mknod d3/d28/d39/c5e 0 2024-09-11T00:17:54.685 INFO:tasks.workunit.client.0.smithi078.stdout:1/311: stat d3/f17 0 2024-09-11T00:17:54.685 INFO:tasks.workunit.client.0.smithi078.stdout:3/223: getdents d0/d7/d18/d1b/d34/d3e 0 2024-09-11T00:17:54.686 INFO:tasks.workunit.client.0.smithi078.stdout:3/224: readlink d0/d1a/d1e/l2c 0 2024-09-11T00:17:54.686 INFO:tasks.workunit.client.0.smithi078.stdout:0/232: dwrite d2/f1d [0,4194304] 0 2024-09-11T00:17:54.688 INFO:tasks.workunit.client.0.smithi078.stdout:3/225: unlink d0/d7/d18/d1b/d34/c35 0 2024-09-11T00:17:54.690 INFO:tasks.workunit.client.0.smithi078.stdout:0/233: symlink d2/d2a/d2c/d35/l4e 0 2024-09-11T00:17:54.690 INFO:tasks.workunit.client.0.smithi078.stdout:0/234: readlink d2/l33 0 2024-09-11T00:17:54.690 INFO:tasks.workunit.client.0.smithi078.stdout:0/235: stat d2/d2a/d2c/d42/c20 0 2024-09-11T00:17:54.690 INFO:tasks.workunit.client.0.smithi078.stdout:3/226: symlink d0/d7/d18/d1b/d34/l45 0 2024-09-11T00:17:54.691 INFO:tasks.workunit.client.0.smithi078.stdout:3/227: write d0/d1a/d1e/f30 [5685740,73725] 0 2024-09-11T00:17:54.691 INFO:tasks.workunit.client.0.smithi078.stdout:2/257: dread d0/d1/d8/f21 [4194304,4194304] 0 2024-09-11T00:17:54.692 INFO:tasks.workunit.client.0.smithi078.stdout:3/228: mkdir d0/d7/d46 0 2024-09-11T00:17:54.692 INFO:tasks.workunit.client.0.smithi078.stdout:2/258: dread d0/fc [0,4194304] 0 2024-09-11T00:17:54.694 INFO:tasks.workunit.client.0.smithi078.stdout:2/259: creat d0/d31/d3a/d51/f58 x:0 0 0 2024-09-11T00:17:54.695 INFO:tasks.workunit.client.0.smithi078.stdout:0/236: write d2/d2a/d2c/d42/f24 [1084082,25328] 0 2024-09-11T00:17:54.695 INFO:tasks.workunit.client.0.smithi078.stdout:2/260: mknod d0/d1/d6/d52/c59 0 2024-09-11T00:17:54.698 INFO:tasks.workunit.client.0.smithi078.stdout:4/211: dwrite dc/f39 [0,4194304] 0 2024-09-11T00:17:54.698 INFO:tasks.workunit.client.0.smithi078.stdout:8/289: dread f2 [0,4194304] 0 2024-09-11T00:17:54.699 INFO:tasks.workunit.client.0.smithi078.stdout:8/290: write da/f30 [1119823,127095] 0 2024-09-11T00:17:54.699 INFO:tasks.workunit.client.0.smithi078.stdout:2/261: creat d0/d1/d3c/f5a x:0 0 0 2024-09-11T00:17:54.700 INFO:tasks.workunit.client.0.smithi078.stdout:1/312: rename d3/d28 to d3/d29/d5f 0 2024-09-11T00:17:54.701 INFO:tasks.workunit.client.0.smithi078.stdout:4/212: creat dc/d10/d40/d3a/d3b/f45 x:0 0 0 2024-09-11T00:17:54.701 INFO:tasks.workunit.client.0.smithi078.stdout:8/291: mknod da/d1c/d1e/c5c 0 2024-09-11T00:17:54.702 INFO:tasks.workunit.client.0.smithi078.stdout:8/292: readlink da/d13/l3e 0 2024-09-11T00:17:54.702 INFO:tasks.workunit.client.0.smithi078.stdout:2/262: rmdir d0/d1/d6/d52 39 2024-09-11T00:17:54.703 INFO:tasks.workunit.client.0.smithi078.stdout:3/229: write d0/d7/d18/d1b/d27/f22 [2412465,81627] 0 2024-09-11T00:17:54.704 INFO:tasks.workunit.client.0.smithi078.stdout:1/313: creat d3/d29/d45/f60 x:0 0 0 2024-09-11T00:17:54.704 INFO:tasks.workunit.client.0.smithi078.stdout:1/314: chown d3/d1a/l48 872 1 2024-09-11T00:17:54.704 INFO:tasks.workunit.client.0.smithi078.stdout:1/315: chown d3/d29/f5d 991 1 2024-09-11T00:17:54.704 INFO:tasks.workunit.client.0.smithi078.stdout:4/213: mkdir dc/d10/d40/d3a/d46 0 2024-09-11T00:17:54.705 INFO:tasks.workunit.client.0.smithi078.stdout:2/263: symlink d0/l5b 0 2024-09-11T00:17:54.707 INFO:tasks.workunit.client.0.smithi078.stdout:0/237: dwrite d2/d3/d7/f3b [0,4194304] 0 2024-09-11T00:17:54.707 INFO:tasks.workunit.client.0.smithi078.stdout:7/241: dwrite d0/d34/db/f48 [0,4194304] 0 2024-09-11T00:17:54.707 INFO:tasks.workunit.client.0.smithi078.stdout:1/316: mkdir d3/d29/d5f/d39/d61 0 2024-09-11T00:17:54.708 INFO:tasks.workunit.client.0.smithi078.stdout:3/230: dread d0/d1a/f3b [0,4194304] 0 2024-09-11T00:17:54.709 INFO:tasks.workunit.client.0.smithi078.stdout:3/231: write d0/f1f [4228138,49571] 0 2024-09-11T00:17:54.709 INFO:tasks.workunit.client.0.smithi078.stdout:2/264: rename d0/d1/d11/d1b/d1e/f35 to d0/d1/d3b/f5c 0 2024-09-11T00:17:54.717 INFO:tasks.workunit.client.0.smithi078.stdout:8/293: dread da/d13/d1b/d24/f27 [0,4194304] 0 2024-09-11T00:17:54.717 INFO:tasks.workunit.client.0.smithi078.stdout:0/238: mkdir d2/d3/d4f 0 2024-09-11T00:17:54.717 INFO:tasks.workunit.client.0.smithi078.stdout:0/239: write d2/d2a/d2c/d42/d23/f48 [590422,60754] 0 2024-09-11T00:17:54.718 INFO:tasks.workunit.client.0.smithi078.stdout:2/265: dread d0/d1/d3c/f45 [0,4194304] 0 2024-09-11T00:17:54.724 INFO:tasks.workunit.client.0.smithi078.stdout:1/317: getdents d3/d29 0 2024-09-11T00:17:54.729 INFO:tasks.workunit.client.0.smithi078.stdout:0/240: creat d2/d3/d7/f50 x:0 0 0 2024-09-11T00:17:54.729 INFO:tasks.workunit.client.0.smithi078.stdout:4/214: dwrite dc/d10/d40/d3a/d3b/f45 [0,4194304] 0 2024-09-11T00:17:54.729 INFO:tasks.workunit.client.0.smithi078.stdout:7/242: dwrite d0/f43 [0,4194304] 0 2024-09-11T00:17:54.730 INFO:tasks.workunit.client.0.smithi078.stdout:7/243: readlink d0/d34/db/l21 0 2024-09-11T00:17:54.730 INFO:tasks.workunit.client.0.smithi078.stdout:4/215: write dc/d17/f22 [197376,33499] 0 2024-09-11T00:17:54.730 INFO:tasks.workunit.client.0.smithi078.stdout:2/266: rmdir d0/d1 39 2024-09-11T00:17:54.730 INFO:tasks.workunit.client.0.smithi078.stdout:3/232: dwrite d0/d1a/d1e/f30 [0,4194304] 0 2024-09-11T00:17:54.731 INFO:tasks.workunit.client.0.smithi078.stdout:1/318: symlink d3/d29/d5f/l62 0 2024-09-11T00:17:54.732 INFO:tasks.workunit.client.0.smithi078.stdout:1/319: write d3/d1a/d21/f5a [960841,93789] 0 2024-09-11T00:17:54.732 INFO:tasks.workunit.client.0.smithi078.stdout:1/320: fdatasync d3/d29/d45/f3f 0 2024-09-11T00:17:54.736 INFO:tasks.workunit.client.0.smithi078.stdout:7/244: unlink d0/d34/db/f48 0 2024-09-11T00:17:54.736 INFO:tasks.workunit.client.0.smithi078.stdout:4/216: rmdir dc/d10/d1f 39 2024-09-11T00:17:54.738 INFO:tasks.workunit.client.0.smithi078.stdout:2/267: link d0/fc d0/d19/f5d 0 2024-09-11T00:17:54.738 INFO:tasks.workunit.client.0.smithi078.stdout:2/268: truncate d0/d1/d3b/f4e 137040 0 2024-09-11T00:17:54.738 INFO:tasks.workunit.client.0.smithi078.stdout:4/217: dread dc/d10/f14 [0,4194304] 0 2024-09-11T00:17:54.739 INFO:tasks.workunit.client.0.smithi078.stdout:3/233: mknod d0/d1a/d1e/c47 0 2024-09-11T00:17:54.740 INFO:tasks.workunit.client.0.smithi078.stdout:1/321: creat d3/d29/d5f/d39/f63 x:0 0 0 2024-09-11T00:17:54.741 INFO:tasks.workunit.client.0.smithi078.stdout:4/218: mkdir dc/d10/d40/d3a/d46/d47 0 2024-09-11T00:17:54.741 INFO:tasks.workunit.client.0.smithi078.stdout:3/234: creat d0/d7/d46/f48 x:0 0 0 2024-09-11T00:17:54.742 INFO:tasks.workunit.client.0.smithi078.stdout:1/322: creat d3/d29/f64 x:0 0 0 2024-09-11T00:17:54.743 INFO:tasks.workunit.client.0.smithi078.stdout:4/219: symlink dc/d10/d40/d33/l48 0 2024-09-11T00:17:54.744 INFO:tasks.workunit.client.0.smithi078.stdout:1/323: unlink d3/d29/d5f/d4e/f58 0 2024-09-11T00:17:54.745 INFO:tasks.workunit.client.0.smithi078.stdout:4/220: symlink dc/d10/l49 0 2024-09-11T00:17:54.745 INFO:tasks.workunit.client.0.smithi078.stdout:4/221: rename dc/d10 to dc/d10/d3c/d4a 22 2024-09-11T00:17:54.747 INFO:tasks.workunit.client.0.smithi078.stdout:1/324: link d3/d1a/d21/f5a d3/d1a/d21/d4a/f65 0 2024-09-11T00:17:54.748 INFO:tasks.workunit.client.0.smithi078.stdout:3/235: read d0/d1a/f3b [913065,50837] 0 2024-09-11T00:17:54.749 INFO:tasks.workunit.client.0.smithi078.stdout:3/236: fdatasync d0/d7/d18/d1b/f14 0 2024-09-11T00:17:54.752 INFO:tasks.workunit.client.0.smithi078.stdout:3/237: rename d0/d7/d18/d1b/f14 to d0/d7/d18/d1b/d34/f49 0 2024-09-11T00:17:54.752 INFO:tasks.workunit.client.0.smithi078.stdout:3/238: chown d0/d7/d18/d1b/d34 17009 1 2024-09-11T00:17:54.752 INFO:tasks.workunit.client.0.smithi078.stdout:3/239: stat d0/d1a/d1e 0 2024-09-11T00:17:54.754 INFO:tasks.workunit.client.0.smithi078.stdout:3/240: symlink d0/d7/d18/d1b/d34/d3e/l4a 0 2024-09-11T00:17:54.754 INFO:tasks.workunit.client.0.smithi078.stdout:3/241: rename d0/d7/d18 to d0/d7/d18/d1b/d34/d3e/d4b 22 2024-09-11T00:17:54.755 INFO:tasks.workunit.client.0.smithi078.stdout:3/242: write d0/d1a/f3b [1397557,92307] 0 2024-09-11T00:17:54.756 INFO:tasks.workunit.client.0.smithi078.stdout:7/245: dwrite d0/d34/db/d30/f27 [4194304,4194304] 0 2024-09-11T00:17:54.756 INFO:tasks.workunit.client.0.smithi078.stdout:7/246: write d0/d34/db/d30/f3e [675480,46677] 0 2024-09-11T00:17:54.756 INFO:tasks.workunit.client.0.smithi078.stdout:7/247: fsync d0/d34/f24 0 2024-09-11T00:17:54.756 INFO:tasks.workunit.client.0.smithi078.stdout:3/243: creat d0/d7/d18/f4c x:0 0 0 2024-09-11T00:17:54.758 INFO:tasks.workunit.client.0.smithi078.stdout:7/248: rename d0/d34/db/d30/d28/l31 to d0/d3f/l4c 0 2024-09-11T00:17:54.759 INFO:tasks.workunit.client.0.smithi078.stdout:3/244: creat d0/d39/f4d x:0 0 0 2024-09-11T00:17:54.759 INFO:tasks.workunit.client.0.smithi078.stdout:3/245: fdatasync d0/f8 0 2024-09-11T00:17:54.759 INFO:tasks.workunit.client.0.smithi078.stdout:4/222: write dc/d10/d1f/f35 [4059053,77265] 0 2024-09-11T00:17:54.760 INFO:tasks.workunit.client.0.smithi078.stdout:1/325: dread d3/d1a/ff [0,4194304] 0 2024-09-11T00:17:54.760 INFO:tasks.workunit.client.0.smithi078.stdout:7/249: mknod d0/d34/db/d30/d1d/c4d 0 2024-09-11T00:17:54.761 INFO:tasks.workunit.client.0.smithi078.stdout:1/326: creat d3/d1a/d21/d4a/f66 x:0 0 0 2024-09-11T00:17:54.761 INFO:tasks.workunit.client.0.smithi078.stdout:2/269: dwrite d0/d1/f1f [0,4194304] 0 2024-09-11T00:17:54.761 INFO:tasks.workunit.client.0.smithi078.stdout:1/327: write d3/d1a/d21/f2f [1924538,19988] 0 2024-09-11T00:17:54.763 INFO:tasks.workunit.client.0.smithi078.stdout:1/328: unlink d3/d1a/d21/f5a 0 2024-09-11T00:17:54.763 INFO:tasks.workunit.client.0.smithi078.stdout:1/329: readlink d3/l20 0 2024-09-11T00:17:54.763 INFO:tasks.workunit.client.0.smithi078.stdout:1/330: truncate d3/d29/f64 40675 0 2024-09-11T00:17:54.763 INFO:tasks.workunit.client.0.smithi078.stdout:2/270: symlink d0/d31/d38/l5e 0 2024-09-11T00:17:54.763 INFO:tasks.workunit.client.0.smithi078.stdout:2/271: truncate d0/d1/d8/f4f 539722 0 2024-09-11T00:17:54.764 INFO:tasks.workunit.client.0.smithi078.stdout:1/331: symlink d3/d1a/d21/d4a/l67 0 2024-09-11T00:17:54.764 INFO:tasks.workunit.client.0.smithi078.stdout:1/332: chown d3/d1a/d21/d4a/f66 2 1 2024-09-11T00:17:54.765 INFO:tasks.workunit.client.0.smithi078.stdout:1/333: dread - d3/d29/d5f/d39/f63 zero size 2024-09-11T00:17:54.766 INFO:tasks.workunit.client.0.smithi078.stdout:2/272: dread d0/d1/d3c/f45 [0,4194304] 0 2024-09-11T00:17:54.766 INFO:tasks.workunit.client.0.smithi078.stdout:2/273: write d0/d1/f46 [599318,106029] 0 2024-09-11T00:17:54.775 INFO:tasks.workunit.client.0.smithi078.stdout:3/246: write d0/d7/d18/d1b/d27/f32 [3706224,88086] 0 2024-09-11T00:17:54.781 INFO:tasks.workunit.client.0.smithi078.stdout:4/223: dread dc/f39 [0,4194304] 0 2024-09-11T00:17:54.782 INFO:tasks.workunit.client.0.smithi078.stdout:4/224: getdents dc/d10 0 2024-09-11T00:17:54.782 INFO:tasks.workunit.client.0.smithi078.stdout:4/225: dread - dc/d17/f44 zero size 2024-09-11T00:17:54.783 INFO:tasks.workunit.client.0.smithi078.stdout:4/226: mknod dc/d10/d40/d3a/d46/c4b 0 2024-09-11T00:17:54.784 INFO:tasks.workunit.client.0.smithi078.stdout:7/250: dwrite d0/d34/db/f15 [0,4194304] 0 2024-09-11T00:17:54.785 INFO:tasks.workunit.client.0.smithi078.stdout:4/227: rename dc/d1d to dc/d10/d40/d3a/d4c 0 2024-09-11T00:17:54.786 INFO:tasks.workunit.client.0.smithi078.stdout:7/251: mknod d0/d3f/c4e 0 2024-09-11T00:17:54.786 INFO:tasks.workunit.client.0.smithi078.stdout:7/252: fsync d0/d34/db/d30/d1d/d14/f41 0 2024-09-11T00:17:54.786 INFO:tasks.workunit.client.0.smithi078.stdout:7/253: readlink d0/d34/db/l2b 0 2024-09-11T00:17:54.787 INFO:tasks.workunit.client.0.smithi078.stdout:1/334: dwrite d3/d29/d45/f52 [0,4194304] 0 2024-09-11T00:17:54.788 INFO:tasks.workunit.client.0.smithi078.stdout:1/335: write d3/d1a/f33 [637711,70654] 0 2024-09-11T00:17:54.788 INFO:tasks.workunit.client.0.smithi078.stdout:4/228: mknod dc/d10/d40/d3a/d46/c4d 0 2024-09-11T00:17:54.789 INFO:tasks.workunit.client.0.smithi078.stdout:7/254: creat d0/d34/db/d30/d1d/d14/f4f x:0 0 0 2024-09-11T00:17:54.789 INFO:tasks.workunit.client.0.smithi078.stdout:7/255: fsync d0/f29 0 2024-09-11T00:17:54.789 INFO:tasks.workunit.client.0.smithi078.stdout:2/274: dwrite d0/d1/d8/f4f [0,4194304] 0 2024-09-11T00:17:54.791 INFO:tasks.workunit.client.0.smithi078.stdout:1/336: rename d3/d1a/l48 to d3/d29/d5f/l68 0 2024-09-11T00:17:54.792 INFO:tasks.workunit.client.0.smithi078.stdout:7/256: creat d0/f50 x:0 0 0 2024-09-11T00:17:54.793 INFO:tasks.workunit.client.0.smithi078.stdout:7/257: dread - d0/f50 zero size 2024-09-11T00:17:54.793 INFO:tasks.workunit.client.0.smithi078.stdout:7/258: truncate d0/f50 747613 0 2024-09-11T00:17:54.793 INFO:tasks.workunit.client.0.smithi078.stdout:7/259: chown d0/d34/c20 5175 1 2024-09-11T00:17:54.793 INFO:tasks.workunit.client.0.smithi078.stdout:7/260: fdatasync d0/d34/db/d30/d1d/f39 0 2024-09-11T00:17:54.793 INFO:tasks.workunit.client.0.smithi078.stdout:7/261: write d0/d34/db/d30/d1d/d14/f41 [1025825,43384] 0 2024-09-11T00:17:54.793 INFO:tasks.workunit.client.0.smithi078.stdout:3/247: dwrite d0/f3c [0,4194304] 0 2024-09-11T00:17:54.794 INFO:tasks.workunit.client.0.smithi078.stdout:3/248: chown d0/d7/d18/d1b/l20 11 1 2024-09-11T00:17:54.799 INFO:tasks.workunit.client.0.smithi078.stdout:2/275: dread d0/d1/d8/f1d [0,4194304] 0 2024-09-11T00:17:54.804 INFO:tasks.workunit.client.0.smithi078.stdout:7/262: truncate d0/d34/db/d30/d1d/f17 2192195 0 2024-09-11T00:17:54.804 INFO:tasks.workunit.client.0.smithi078.stdout:4/229: dwrite dc/d10/d40/d3a/d3b/f45 [0,4194304] 0 2024-09-11T00:17:54.806 INFO:tasks.workunit.client.0.smithi078.stdout:2/276: getdents d0/d1/d11/d1b/d1e 0 2024-09-11T00:17:54.806 INFO:tasks.workunit.client.0.smithi078.stdout:2/277: chown d0/d1/f1f 32551092 1 2024-09-11T00:17:54.806 INFO:tasks.workunit.client.0.smithi078.stdout:2/278: write d0/d1/d3b/f4e [1063002,62288] 0 2024-09-11T00:17:54.807 INFO:tasks.workunit.client.0.smithi078.stdout:7/263: creat d0/d34/db/f51 x:0 0 0 2024-09-11T00:17:54.808 INFO:tasks.workunit.client.0.smithi078.stdout:4/230: symlink dc/l4e 0 2024-09-11T00:17:54.809 INFO:tasks.workunit.client.0.smithi078.stdout:2/279: mkdir d0/d1/d33/d5f 0 2024-09-11T00:17:54.809 INFO:tasks.workunit.client.0.smithi078.stdout:2/280: chown d0/l5b 7636 1 2024-09-11T00:17:54.810 INFO:tasks.workunit.client.0.smithi078.stdout:1/337: dwrite d3/d1a/f33 [0,4194304] 0 2024-09-11T00:17:54.810 INFO:tasks.workunit.client.0.smithi078.stdout:1/338: fsync d3/d29/f64 0 2024-09-11T00:17:54.810 INFO:tasks.workunit.client.0.smithi078.stdout:7/264: creat d0/d34/db/d30/f52 x:0 0 0 2024-09-11T00:17:54.811 INFO:tasks.workunit.client.0.smithi078.stdout:4/231: symlink dc/d10/d3c/l4f 0 2024-09-11T00:17:54.814 INFO:tasks.workunit.client.0.smithi078.stdout:4/232: mkdir dc/d10/d40/d3a/d3b/d50 0 2024-09-11T00:17:54.816 INFO:tasks.workunit.client.0.smithi078.stdout:2/281: dread d0/d1/d8/f21 [4194304,4194304] 0 2024-09-11T00:17:54.819 INFO:tasks.workunit.client.0.smithi078.stdout:4/233: creat dc/d17/f51 x:0 0 0 2024-09-11T00:17:54.819 INFO:tasks.workunit.client.0.smithi078.stdout:1/339: write d3/fc [6122397,80952] 0 2024-09-11T00:17:54.820 INFO:tasks.workunit.client.0.smithi078.stdout:2/282: mkdir d0/d1/d11/d60 0 2024-09-11T00:17:54.820 INFO:tasks.workunit.client.0.smithi078.stdout:7/265: getdents d0/d34/db 0 2024-09-11T00:17:54.821 INFO:tasks.workunit.client.0.smithi078.stdout:1/340: dread d3/d29/d5f/f18 [0,4194304] 0 2024-09-11T00:17:54.822 INFO:tasks.workunit.client.0.smithi078.stdout:4/234: mknod dc/d10/d40/d3a/d3b/c52 0 2024-09-11T00:17:54.822 INFO:tasks.workunit.client.0.smithi078.stdout:4/235: fsync dc/ff 0 2024-09-11T00:17:54.822 INFO:tasks.workunit.client.0.smithi078.stdout:4/236: truncate dc/d10/d40/f28 450997 0 2024-09-11T00:17:54.822 INFO:tasks.workunit.client.0.smithi078.stdout:1/341: creat d3/d1a/d21/d4a/f69 x:0 0 0 2024-09-11T00:17:54.823 INFO:tasks.workunit.client.0.smithi078.stdout:4/237: creat dc/d10/d1f/f53 x:0 0 0 2024-09-11T00:17:54.824 INFO:tasks.workunit.client.0.smithi078.stdout:1/342: mknod d3/d29/d45/c6a 0 2024-09-11T00:17:54.825 INFO:tasks.workunit.client.0.smithi078.stdout:2/283: dread d0/d1/fe [0,4194304] 0 2024-09-11T00:17:54.827 INFO:tasks.workunit.client.0.smithi078.stdout:9/156: sync 2024-09-11T00:17:54.828 INFO:tasks.workunit.client.0.smithi078.stdout:9/157: unlink dc/d12/l1b 0 2024-09-11T00:17:54.829 INFO:tasks.workunit.client.0.smithi078.stdout:2/284: dread d0/d1/f46 [0,4194304] 0 2024-09-11T00:17:54.829 INFO:tasks.workunit.client.0.smithi078.stdout:2/285: fdatasync d0/d1/d11/f24 0 2024-09-11T00:17:54.829 INFO:tasks.workunit.client.0.smithi078.stdout:9/158: rmdir dc/d12/d20 39 2024-09-11T00:17:54.830 INFO:tasks.workunit.client.0.smithi078.stdout:9/159: symlink dc/d12/l34 0 2024-09-11T00:17:54.833 INFO:tasks.workunit.client.0.smithi078.stdout:9/160: getdents dc/d12 0 2024-09-11T00:17:54.834 INFO:tasks.workunit.client.0.smithi078.stdout:9/161: mkdir dc/d12/d35 0 2024-09-11T00:17:54.836 INFO:tasks.workunit.client.0.smithi078.stdout:9/162: mknod dc/d12/c36 0 2024-09-11T00:17:54.836 INFO:tasks.workunit.client.0.smithi078.stdout:7/266: dwrite d0/d34/db/d30/d1d/f2c [0,4194304] 0 2024-09-11T00:17:54.836 INFO:tasks.workunit.client.0.smithi078.stdout:7/267: write d0/d34/db/f47 [1008415,79025] 0 2024-09-11T00:17:54.840 INFO:tasks.workunit.client.0.smithi078.stdout:9/163: rename dc/d12/l2f to dc/d12/d20/d30/l37 0 2024-09-11T00:17:54.844 INFO:tasks.workunit.client.0.smithi078.stdout:2/286: dwrite d0/d1/d8/f30 [0,4194304] 0 2024-09-11T00:17:54.852 INFO:tasks.workunit.client.0.smithi078.stdout:4/238: dwrite dc/d10/d1f/f23 [0,4194304] 0 2024-09-11T00:17:54.853 INFO:tasks.workunit.client.0.smithi078.stdout:4/239: rmdir dc/d10/d3c 39 2024-09-11T00:17:54.858 INFO:tasks.workunit.client.0.smithi078.stdout:7/268: dwrite d0/f36 [0,4194304] 0 2024-09-11T00:17:54.858 INFO:tasks.workunit.client.0.smithi078.stdout:7/269: chown d0/d34/db/d30/d1d/f13 0 1 2024-09-11T00:17:54.866 INFO:tasks.workunit.client.0.smithi078.stdout:4/240: dwrite dc/d10/d40/d3a/d3b/f3e [0,4194304] 0 2024-09-11T00:17:54.869 INFO:tasks.workunit.client.0.smithi078.stdout:4/241: unlink dc/d17/f44 0 2024-09-11T00:17:54.869 INFO:tasks.workunit.client.0.smithi078.stdout:9/164: dwrite dc/d12/d20/f32 [0,4194304] 0 2024-09-11T00:17:54.870 INFO:tasks.workunit.client.0.smithi078.stdout:9/165: readlink dc/l25 0 2024-09-11T00:17:54.870 INFO:tasks.workunit.client.0.smithi078.stdout:9/166: chown dc/c2d 1 1 2024-09-11T00:17:54.870 INFO:tasks.workunit.client.0.smithi078.stdout:9/167: fdatasync dc/d12/d20/f32 0 2024-09-11T00:17:54.870 INFO:tasks.workunit.client.0.smithi078.stdout:4/242: mkdir dc/d54 0 2024-09-11T00:17:54.871 INFO:tasks.workunit.client.0.smithi078.stdout:2/287: dwrite d0/d1/d11/f24 [0,4194304] 0 2024-09-11T00:17:54.877 INFO:tasks.workunit.client.0.smithi078.stdout:7/270: dwrite d0/d34/db/d30/d28/f44 [0,4194304] 0 2024-09-11T00:17:54.878 INFO:tasks.workunit.client.0.smithi078.stdout:9/168: creat dc/f38 x:0 0 0 2024-09-11T00:17:54.880 INFO:tasks.workunit.client.0.smithi078.stdout:7/271: creat d0/d34/db/d30/f53 x:0 0 0 2024-09-11T00:17:54.880 INFO:tasks.workunit.client.0.smithi078.stdout:9/169: creat dc/d12/d35/f39 x:0 0 0 2024-09-11T00:17:54.882 INFO:tasks.workunit.client.0.smithi078.stdout:7/272: mknod d0/d34/db/d30/c54 0 2024-09-11T00:17:54.885 INFO:tasks.workunit.client.0.smithi078.stdout:4/243: dwrite dc/ff [0,4194304] 0 2024-09-11T00:17:54.887 INFO:tasks.workunit.client.0.smithi078.stdout:4/244: mknod dc/d10/d40/d33/c55 0 2024-09-11T00:17:54.887 INFO:tasks.workunit.client.0.smithi078.stdout:4/245: rename dc/d10/d40 to dc/d10/d40/d3a/d3b/d50/d56 22 2024-09-11T00:17:54.889 INFO:tasks.workunit.client.0.smithi078.stdout:4/246: dread dc/fd [0,4194304] 0 2024-09-11T00:17:54.889 INFO:tasks.workunit.client.0.smithi078.stdout:4/247: chown c8 27011944 1 2024-09-11T00:17:54.889 INFO:tasks.workunit.client.0.smithi078.stdout:4/248: write dc/d10/d40/d3a/d4c/f41 [656850,26951] 0 2024-09-11T00:17:54.890 INFO:tasks.workunit.client.0.smithi078.stdout:4/249: mknod dc/d10/d40/d33/c57 0 2024-09-11T00:17:54.892 INFO:tasks.workunit.client.0.smithi078.stdout:4/250: unlink dc/d10/l24 0 2024-09-11T00:17:54.893 INFO:tasks.workunit.client.0.smithi078.stdout:2/288: dwrite d0/d1/f4 [4194304,4194304] 0 2024-09-11T00:17:54.894 INFO:tasks.workunit.client.0.smithi078.stdout:2/289: truncate d0/d19/f2c 5944694 0 2024-09-11T00:17:54.894 INFO:tasks.workunit.client.0.smithi078.stdout:2/290: truncate d0/d1/d3b/f4e 1985840 0 2024-09-11T00:17:54.898 INFO:tasks.workunit.client.0.smithi078.stdout:9/170: dread dc/f1c [0,4194304] 0 2024-09-11T00:17:54.898 INFO:tasks.workunit.client.0.smithi078.stdout:7/273: dwrite d0/d34/db/d30/d1d/d14/f4f [0,4194304] 0 2024-09-11T00:17:54.898 INFO:tasks.workunit.client.0.smithi078.stdout:7/274: chown d0/d34/db/d30/d28/l3b 95137196 1 2024-09-11T00:17:54.899 INFO:tasks.workunit.client.0.smithi078.stdout:9/171: mkdir dc/d12/d20/d3a 0 2024-09-11T00:17:54.902 INFO:tasks.workunit.client.0.smithi078.stdout:4/251: write f6 [315248,20569] 0 2024-09-11T00:17:54.902 INFO:tasks.workunit.client.0.smithi078.stdout:4/252: truncate fa 923765 0 2024-09-11T00:17:54.904 INFO:tasks.workunit.client.0.smithi078.stdout:4/253: read dc/f11 [351474,4558] 0 2024-09-11T00:17:54.911 INFO:tasks.workunit.client.0.smithi078.stdout:4/254: dread dc/d10/d40/d3a/d3b/f3e [0,4194304] 0 2024-09-11T00:17:54.913 INFO:tasks.workunit.client.0.smithi078.stdout:4/255: rename dc/d10/d40/d33/c57 to dc/d10/d40/c58 0 2024-09-11T00:17:54.913 INFO:tasks.workunit.client.0.smithi078.stdout:4/256: fdatasync dc/d10/d40/d3a/d3b/f45 0 2024-09-11T00:17:54.913 INFO:tasks.workunit.client.0.smithi078.stdout:9/172: dwrite dc/f14 [0,4194304] 0 2024-09-11T00:17:54.914 INFO:tasks.workunit.client.0.smithi078.stdout:4/257: mkdir dc/d10/d40/d3a/d46/d59 0 2024-09-11T00:17:54.914 INFO:tasks.workunit.client.0.smithi078.stdout:4/258: chown dc/d17/l21 6 1 2024-09-11T00:17:54.916 INFO:tasks.workunit.client.0.smithi078.stdout:7/275: dwrite d0/d34/db/d30/d1d/d14/f4f [0,4194304] 0 2024-09-11T00:17:54.916 INFO:tasks.workunit.client.0.smithi078.stdout:7/276: fdatasync d0/d34/db/f51 0 2024-09-11T00:17:54.920 INFO:tasks.workunit.client.0.smithi078.stdout:7/277: creat d0/f55 x:0 0 0 2024-09-11T00:17:54.920 INFO:tasks.workunit.client.0.smithi078.stdout:7/278: fsync d0/d34/db/d30/f53 0 2024-09-11T00:17:54.925 INFO:tasks.workunit.client.0.smithi078.stdout:4/259: dread dc/d17/f34 [0,4194304] 0 2024-09-11T00:17:54.926 INFO:tasks.workunit.client.0.smithi078.stdout:9/173: write dc/d12/f17 [1007042,39901] 0 2024-09-11T00:17:54.926 INFO:tasks.workunit.client.0.smithi078.stdout:4/260: mknod dc/d10/d40/d33/c5a 0 2024-09-11T00:17:54.927 INFO:tasks.workunit.client.0.smithi078.stdout:4/261: rename dc/d10/d40/d3a/d4c/f2c to dc/d10/d1f/f5b 0 2024-09-11T00:17:54.929 INFO:tasks.workunit.client.0.smithi078.stdout:9/174: creat dc/d12/d24/f3b x:0 0 0 2024-09-11T00:17:54.929 INFO:tasks.workunit.client.0.smithi078.stdout:4/262: write dc/fd [62670,96551] 0 2024-09-11T00:17:54.929 INFO:tasks.workunit.client.0.smithi078.stdout:4/263: write dc/d10/d1f/f2f [1045957,11929] 0 2024-09-11T00:17:54.929 INFO:tasks.workunit.client.0.smithi078.stdout:9/175: mknod dc/d12/d20/c3c 0 2024-09-11T00:17:54.929 INFO:tasks.workunit.client.0.smithi078.stdout:9/176: stat dc/d12/d20/d30/l37 0 2024-09-11T00:17:54.935 INFO:tasks.workunit.client.0.smithi078.stdout:9/177: write f2 [1502167,57009] 0 2024-09-11T00:17:54.936 INFO:tasks.workunit.client.0.smithi078.stdout:9/178: creat dc/d12/d20/d30/f3d x:0 0 0 2024-09-11T00:17:54.937 INFO:tasks.workunit.client.0.smithi078.stdout:9/179: getdents dc/d12 0 2024-09-11T00:17:54.937 INFO:tasks.workunit.client.0.smithi078.stdout:9/180: truncate f7 8741825 0 2024-09-11T00:17:54.937 INFO:tasks.workunit.client.0.smithi078.stdout:9/181: chown dc/d12/c36 95658638 1 2024-09-11T00:17:54.938 INFO:tasks.workunit.client.0.smithi078.stdout:4/264: read dc/d10/d1f/f23 [2998551,15444] 0 2024-09-11T00:17:54.939 INFO:tasks.workunit.client.0.smithi078.stdout:4/265: mknod dc/d10/d40/d3a/d46/d59/c5c 0 2024-09-11T00:17:54.939 INFO:tasks.workunit.client.0.smithi078.stdout:4/266: write dc/d10/d1f/f20 [4654931,8242] 0 2024-09-11T00:17:54.940 INFO:tasks.workunit.client.0.smithi078.stdout:4/267: unlink dc/d17/c26 0 2024-09-11T00:17:54.940 INFO:tasks.workunit.client.0.smithi078.stdout:4/268: fsync dc/d10/d40/d3a/d4c/f2e 0 2024-09-11T00:17:54.941 INFO:tasks.workunit.client.0.smithi078.stdout:4/269: mkdir dc/d10/d40/d3a/d3b/d5d 0 2024-09-11T00:17:54.941 INFO:tasks.workunit.client.0.smithi078.stdout:4/270: stat dc/d10/d40/d33/c43 0 2024-09-11T00:17:54.941 INFO:tasks.workunit.client.0.smithi078.stdout:4/271: truncate dc/d10/f2b 1098473 0 2024-09-11T00:17:54.952 INFO:tasks.workunit.client.0.smithi078.stdout:7/279: write d0/d34/db/f15 [489605,91483] 0 2024-09-11T00:17:54.953 INFO:tasks.workunit.client.0.smithi078.stdout:7/280: rmdir d0/d34/db/d30 39 2024-09-11T00:17:54.953 INFO:tasks.workunit.client.0.smithi078.stdout:7/281: chown d0/d34/db/l38 71090262 1 2024-09-11T00:17:54.953 INFO:tasks.workunit.client.0.smithi078.stdout:4/272: write dc/d10/d1f/f20 [1778661,51909] 0 2024-09-11T00:17:54.954 INFO:tasks.workunit.client.0.smithi078.stdout:7/282: truncate d0/d34/db/d30/d1d/d14/f41 151410 0 2024-09-11T00:17:54.957 INFO:tasks.workunit.client.0.smithi078.stdout:7/283: dread d0/d34/f33 [0,4194304] 0 2024-09-11T00:17:54.957 INFO:tasks.workunit.client.0.smithi078.stdout:9/182: dwrite dc/d12/d20/d30/f3d [0,4194304] 0 2024-09-11T00:17:54.957 INFO:tasks.workunit.client.0.smithi078.stdout:4/273: mknod dc/d10/d40/d3a/d4c/c5e 0 2024-09-11T00:17:54.957 INFO:tasks.workunit.client.0.smithi078.stdout:4/274: dread - dc/f2d zero size 2024-09-11T00:17:54.957 INFO:tasks.workunit.client.0.smithi078.stdout:4/275: stat dc/d10/d40/d3a/d46/c4d 0 2024-09-11T00:17:54.957 INFO:tasks.workunit.client.0.smithi078.stdout:4/276: dread - dc/d10/f3d zero size 2024-09-11T00:17:54.958 INFO:tasks.workunit.client.0.smithi078.stdout:4/277: dread dc/d10/d40/f28 [0,4194304] 0 2024-09-11T00:17:54.958 INFO:tasks.workunit.client.0.smithi078.stdout:4/278: write dc/d10/d40/d3a/d4c/f2e [553137,68221] 0 2024-09-11T00:17:54.961 INFO:tasks.workunit.client.0.smithi078.stdout:7/284: symlink d0/d34/db/d30/d1d/d14/d45/l56 0 2024-09-11T00:17:54.962 INFO:tasks.workunit.client.0.smithi078.stdout:9/183: mkdir dc/d12/d24/d3e 0 2024-09-11T00:17:54.965 INFO:tasks.workunit.client.0.smithi078.stdout:9/184: rename dc/d12/d24/f28 to dc/d12/d20/d30/f3f 0 2024-09-11T00:17:54.965 INFO:tasks.workunit.client.0.smithi078.stdout:9/185: write f7 [143147,57085] 0 2024-09-11T00:17:54.966 INFO:tasks.workunit.client.0.smithi078.stdout:9/186: mknod dc/d12/d20/c40 0 2024-09-11T00:17:54.966 INFO:tasks.workunit.client.0.smithi078.stdout:9/187: readlink dc/d12/l2a 0 2024-09-11T00:17:54.966 INFO:tasks.workunit.client.0.smithi078.stdout:9/188: getdents dc/d12/d24/d3e 0 2024-09-11T00:17:54.974 INFO:tasks.workunit.client.0.smithi078.stdout:7/285: dwrite d0/d34/db/d30/f52 [0,4194304] 0 2024-09-11T00:17:54.974 INFO:tasks.workunit.client.0.smithi078.stdout:9/189: dread fa [0,4194304] 0 2024-09-11T00:17:54.980 INFO:tasks.workunit.client.0.smithi078.stdout:7/286: write d0/d34/db/d30/d1d/f17 [1837088,64489] 0 2024-09-11T00:17:54.981 INFO:tasks.workunit.client.0.smithi078.stdout:7/287: getdents d0/d34/db/d30 0 2024-09-11T00:17:54.982 INFO:tasks.workunit.client.0.smithi078.stdout:7/288: mkdir d0/d34/d57 0 2024-09-11T00:17:54.982 INFO:tasks.workunit.client.0.smithi078.stdout:7/289: stat d0/d34/db/l21 0 2024-09-11T00:17:54.982 INFO:tasks.workunit.client.0.smithi078.stdout:7/290: stat d0/d34 0 2024-09-11T00:17:54.983 INFO:tasks.workunit.client.0.smithi078.stdout:9/190: write fb [7188914,48260] 0 2024-09-11T00:17:54.984 INFO:tasks.workunit.client.0.smithi078.stdout:9/191: symlink dc/d12/d20/d30/l41 0 2024-09-11T00:17:54.984 INFO:tasks.workunit.client.0.smithi078.stdout:9/192: stat dc/d12/d35 0 2024-09-11T00:17:54.984 INFO:tasks.workunit.client.0.smithi078.stdout:9/193: creat dc/d12/d24/d3e/f42 x:0 0 0 2024-09-11T00:17:54.985 INFO:tasks.workunit.client.0.smithi078.stdout:9/194: read f7 [3233101,31058] 0 2024-09-11T00:17:54.985 INFO:tasks.workunit.client.0.smithi078.stdout:9/195: getdents dc/d12 0 2024-09-11T00:17:54.997 INFO:tasks.workunit.client.0.smithi078.stdout:7/291: dwrite d0/d34/db/d30/d1d/d14/f2a [0,4194304] 0 2024-09-11T00:17:54.998 INFO:tasks.workunit.client.0.smithi078.stdout:5/176: sync 2024-09-11T00:17:54.998 INFO:tasks.workunit.client.0.smithi078.stdout:6/258: sync 2024-09-11T00:17:54.998 INFO:tasks.workunit.client.0.smithi078.stdout:6/259: write d0/d1/d1b/f2e [2157458,82198] 0 2024-09-11T00:17:54.999 INFO:tasks.workunit.client.0.smithi078.stdout:7/292: link d0/d34/c20 d0/d34/db/d30/d1d/d14/c58 0 2024-09-11T00:17:54.999 INFO:tasks.workunit.client.0.smithi078.stdout:6/260: creat d0/d1/d9/f63 x:0 0 0 2024-09-11T00:17:55.000 INFO:tasks.workunit.client.0.smithi078.stdout:7/293: creat d0/d34/db/d30/d1d/f59 x:0 0 0 2024-09-11T00:17:55.008 INFO:tasks.workunit.client.0.smithi078.stdout:6/261: write d0/f3c [948478,12725] 0 2024-09-11T00:17:55.008 INFO:tasks.workunit.client.0.smithi078.stdout:6/262: chown d0/d1/d1b/f45 21173487 1 2024-09-11T00:17:55.010 INFO:tasks.workunit.client.0.smithi078.stdout:6/263: rename d0/d1/fe to d0/d1/d9/d59/f64 0 2024-09-11T00:17:55.011 INFO:tasks.workunit.client.0.smithi078.stdout:6/264: rename d0/d1/d1b/f2e to d0/d1/d9/d59/f65 0 2024-09-11T00:17:55.012 INFO:tasks.workunit.client.0.smithi078.stdout:6/265: unlink d0/d1/d9/f63 0 2024-09-11T00:17:55.012 INFO:tasks.workunit.client.0.smithi078.stdout:5/177: write d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f20 [357747,104827] 0 2024-09-11T00:17:55.013 INFO:tasks.workunit.client.0.smithi078.stdout:5/178: rmdir d7/d8/d33/d22 39 2024-09-11T00:17:55.014 INFO:tasks.workunit.client.0.smithi078.stdout:6/266: mkdir d0/d66 0 2024-09-11T00:17:55.014 INFO:tasks.workunit.client.0.smithi078.stdout:5/179: mkdir d7/d8/d47 0 2024-09-11T00:17:55.015 INFO:tasks.workunit.client.0.smithi078.stdout:5/180: mknod d7/d8/d33/d22/d25/c48 0 2024-09-11T00:17:55.016 INFO:tasks.workunit.client.0.smithi078.stdout:5/181: truncate d7/d8/d33/d22/d25/d28/f41 5044962 0 2024-09-11T00:17:55.016 INFO:tasks.workunit.client.0.smithi078.stdout:5/182: write d7/d8/de/ff [4625078,12149] 0 2024-09-11T00:17:55.016 INFO:tasks.workunit.client.0.smithi078.stdout:5/183: write d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f20 [8046627,52258] 0 2024-09-11T00:17:55.016 INFO:tasks.workunit.client.0.smithi078.stdout:5/184: symlink d7/d8/d33/d22/d25/d28/d24/d1c/d1e/l49 0 2024-09-11T00:17:55.019 INFO:tasks.workunit.client.0.smithi078.stdout:6/267: getdents d0/d1/d9/d59 0 2024-09-11T00:17:55.020 INFO:tasks.workunit.client.0.smithi078.stdout:6/268: chown d0/d1/d9/d59 2039476263 1 2024-09-11T00:17:55.033 INFO:tasks.workunit.client.0.smithi078.stdout:7/294: dwrite d0/d34/db/d30/d1d/f13 [0,4194304] 0 2024-09-11T00:17:55.033 INFO:tasks.workunit.client.0.smithi078.stdout:7/295: write d0/d34/db/f15 [3193588,84105] 0 2024-09-11T00:17:55.035 INFO:tasks.workunit.client.0.smithi078.stdout:7/296: creat d0/d34/db/f5a x:0 0 0 2024-09-11T00:17:55.036 INFO:tasks.workunit.client.0.smithi078.stdout:7/297: dread - d0/d34/db/f5a zero size 2024-09-11T00:17:55.038 INFO:tasks.workunit.client.0.smithi078.stdout:5/185: dwrite d7/d8/d33/d22/d25/d28/d24/fb [0,4194304] 0 2024-09-11T00:17:55.038 INFO:tasks.workunit.client.0.smithi078.stdout:7/298: dread d0/d34/db/f47 [0,4194304] 0 2024-09-11T00:17:55.038 INFO:tasks.workunit.client.0.smithi078.stdout:7/299: write d0/f1e [2846778,71101] 0 2024-09-11T00:17:55.039 INFO:tasks.workunit.client.0.smithi078.stdout:5/186: write d7/d8/de/f10 [509159,28897] 0 2024-09-11T00:17:55.040 INFO:tasks.workunit.client.0.smithi078.stdout:6/269: dwrite d0/d1/d9/f24 [0,4194304] 0 2024-09-11T00:17:55.041 INFO:tasks.workunit.client.0.smithi078.stdout:5/187: creat d7/d8/de/f4a x:0 0 0 2024-09-11T00:17:55.041 INFO:tasks.workunit.client.0.smithi078.stdout:5/188: write d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d26/d2a/f35 [740315,70146] 0 2024-09-11T00:17:55.042 INFO:tasks.workunit.client.0.smithi078.stdout:6/270: rename d0/d33/f4e to d0/d1/d2c/f67 0 2024-09-11T00:17:55.042 INFO:tasks.workunit.client.0.smithi078.stdout:6/271: dread - d0/d1/d1b/f50 zero size 2024-09-11T00:17:55.042 INFO:tasks.workunit.client.0.smithi078.stdout:6/272: write d0/f31 [4975033,91406] 0 2024-09-11T00:17:55.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:54 smithi138 ceph-mon[35019]: pgmap v366: 97 pgs: 97 active+clean; 324 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 32 MiB/s wr, 302 op/s 2024-09-11T00:17:55.043 INFO:tasks.workunit.client.0.smithi078.stdout:5/189: getdents d7 0 2024-09-11T00:17:55.044 INFO:tasks.workunit.client.0.smithi078.stdout:5/190: creat d7/d8/d33/d22/d25/f4b x:0 0 0 2024-09-11T00:17:55.045 INFO:tasks.workunit.client.0.smithi078.stdout:5/191: mknod d7/d8/d47/c4c 0 2024-09-11T00:17:55.045 INFO:tasks.workunit.client.0.smithi078.stdout:5/192: dread - d7/d8/f3d zero size 2024-09-11T00:17:55.045 INFO:tasks.workunit.client.0.smithi078.stdout:5/193: creat d7/d8/d33/d22/d25/d28/d24/f4d x:0 0 0 2024-09-11T00:17:55.047 INFO:tasks.workunit.client.0.smithi078.stdout:5/194: rename d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d26/c37 to d7/d8/c4e 0 2024-09-11T00:17:55.047 INFO:tasks.workunit.client.0.smithi078.stdout:7/300: read d0/d34/db/d30/d1d/f13 [3671906,52504] 0 2024-09-11T00:17:55.048 INFO:tasks.workunit.client.0.smithi078.stdout:5/195: unlink d7/d8/de/c23 0 2024-09-11T00:17:55.048 INFO:tasks.workunit.client.0.smithi078.stdout:7/301: symlink d0/d34/db/d30/l5b 0 2024-09-11T00:17:55.049 INFO:tasks.workunit.client.0.smithi078.stdout:7/302: stat d0/l19 0 2024-09-11T00:17:55.049 INFO:tasks.workunit.client.0.smithi078.stdout:7/303: fdatasync d0/f50 0 2024-09-11T00:17:55.049 INFO:tasks.workunit.client.0.smithi078.stdout:7/304: creat d0/d34/db/f5c x:0 0 0 2024-09-11T00:17:55.051 INFO:tasks.workunit.client.0.smithi078.stdout:7/305: creat d0/d34/db/d30/d1d/d14/f5d x:0 0 0 2024-09-11T00:17:55.052 INFO:tasks.workunit.client.0.smithi078.stdout:7/306: truncate d0/d34/db/f15 2208355 0 2024-09-11T00:17:55.053 INFO:tasks.workunit.client.0.smithi078.stdout:7/307: mknod d0/d34/db/d32/c5e 0 2024-09-11T00:17:55.057 INFO:tasks.workunit.client.0.smithi078.stdout:5/196: getdents d7/d8/de 0 2024-09-11T00:17:55.057 INFO:tasks.workunit.client.0.smithi078.stdout:6/273: dwrite d0/d1/d2c/f56 [0,4194304] 0 2024-09-11T00:17:55.058 INFO:tasks.workunit.client.0.smithi078.stdout:6/274: chown d0/d33/f48 0 1 2024-09-11T00:17:55.060 INFO:tasks.workunit.client.0.smithi078.stdout:5/197: mknod d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d26/c4f 0 2024-09-11T00:17:55.060 INFO:tasks.workunit.client.0.smithi078.stdout:5/198: read f6 [1150211,83450] 0 2024-09-11T00:17:55.060 INFO:tasks.workunit.client.0.smithi078.stdout:5/199: chown d7/d8/c39 611336356 1 2024-09-11T00:17:55.060 INFO:tasks.workunit.client.0.smithi078.stdout:5/200: write d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f20 [4819428,77338] 0 2024-09-11T00:17:55.061 INFO:tasks.workunit.client.0.smithi078.stdout:5/201: fdatasync d7/d8/d33/d22/d25/f3a 0 2024-09-11T00:17:55.062 INFO:tasks.workunit.client.0.smithi078.stdout:6/275: creat d0/f68 x:0 0 0 2024-09-11T00:17:55.065 INFO:tasks.workunit.client.0.smithi078.stdout:5/202: creat d7/d8/d33/d22/d25/d28/d24/f50 x:0 0 0 2024-09-11T00:17:55.066 INFO:tasks.workunit.client.0.smithi078.stdout:6/276: symlink d0/d1/d9/d17/d5e/l69 0 2024-09-11T00:17:55.067 INFO:tasks.workunit.client.0.smithi078.stdout:5/203: mkdir d7/d8/d33/d22/d51 0 2024-09-11T00:17:55.068 INFO:tasks.workunit.client.0.smithi078.stdout:6/277: rename d0/d1/d1b/l51 to d0/d1/d2c/l6a 0 2024-09-11T00:17:55.071 INFO:tasks.workunit.client.0.smithi078.stdout:5/204: unlink d7/d8/de/c2f 0 2024-09-11T00:17:55.071 INFO:tasks.workunit.client.0.smithi078.stdout:5/205: chown d7/d8/d33/d22/d25/d28/d24 36 1 2024-09-11T00:17:55.071 INFO:tasks.workunit.client.0.smithi078.stdout:5/206: chown d7/f1f 0 1 2024-09-11T00:17:55.074 INFO:tasks.workunit.client.0.smithi078.stdout:5/207: mkdir d7/d8/d47/d52 0 2024-09-11T00:17:55.074 INFO:tasks.workunit.client.0.smithi078.stdout:5/208: read - d7/d8/f3d zero size 2024-09-11T00:17:55.077 INFO:tasks.workunit.client.0.smithi078.stdout:5/209: truncate d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d26/d2a/f35 525043 0 2024-09-11T00:17:55.077 INFO:tasks.workunit.client.0.smithi078.stdout:5/210: chown d7/d8/de/c40 8370935 1 2024-09-11T00:17:55.078 INFO:tasks.workunit.client.0.smithi078.stdout:5/211: mknod d7/d8/d33/d22/c53 0 2024-09-11T00:17:55.078 INFO:tasks.workunit.client.0.smithi078.stdout:5/212: stat d7/d8/d33/d22/d25/d28/d24/f50 0 2024-09-11T00:17:55.080 INFO:tasks.workunit.client.0.smithi078.stdout:6/278: dwrite d0/f3b [0,4194304] 0 2024-09-11T00:17:55.080 INFO:tasks.workunit.client.0.smithi078.stdout:5/213: rename d7/d8/d33/d22/d25/d28/l34 to d7/d8/d33/d22/d25/l54 0 2024-09-11T00:17:55.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:54 smithi078 ceph-mon[30865]: pgmap v366: 97 pgs: 97 active+clean; 324 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 32 MiB/s wr, 302 op/s 2024-09-11T00:17:55.084 INFO:tasks.workunit.client.0.smithi078.stdout:5/214: write d7/d8/d33/d22/d25/f3a [304382,118931] 0 2024-09-11T00:17:55.086 INFO:tasks.workunit.client.0.smithi078.stdout:6/279: dread d0/d33/f4f [0,4194304] 0 2024-09-11T00:17:55.097 INFO:tasks.workunit.client.0.smithi078.stdout:6/280: dwrite d0/d1/f32 [0,4194304] 0 2024-09-11T00:17:55.097 INFO:tasks.workunit.client.0.smithi078.stdout:6/281: readlink d0/d1/d9/ld 0 2024-09-11T00:17:55.098 INFO:tasks.workunit.client.0.smithi078.stdout:6/282: mkdir d0/d1/d2c/d6b 0 2024-09-11T00:17:55.099 INFO:tasks.workunit.client.0.smithi078.stdout:6/283: mknod d0/d1/d1b/c6c 0 2024-09-11T00:17:55.100 INFO:tasks.workunit.client.0.smithi078.stdout:6/284: creat d0/d1/d1b/f6d x:0 0 0 2024-09-11T00:17:55.102 INFO:tasks.workunit.client.0.smithi078.stdout:6/285: rename d0/d1/d9/d59/f65 to d0/d1/d9/d54/f6e 0 2024-09-11T00:17:55.103 INFO:tasks.workunit.client.0.smithi078.stdout:6/286: mknod d0/c6f 0 2024-09-11T00:17:55.112 INFO:tasks.workunit.client.0.smithi078.stdout:6/287: dread d0/d33/f48 [0,4194304] 0 2024-09-11T00:17:55.113 INFO:tasks.workunit.client.0.smithi078.stdout:6/288: dread - d0/d1/f30 zero size 2024-09-11T00:17:55.113 INFO:tasks.workunit.client.0.smithi078.stdout:6/289: symlink d0/d1/d2c/l70 0 2024-09-11T00:17:55.113 INFO:tasks.workunit.client.0.smithi078.stdout:6/290: chown d0/d1/f32 3 1 2024-09-11T00:17:55.114 INFO:tasks.workunit.client.0.smithi078.stdout:8/294: sync 2024-09-11T00:17:55.115 INFO:tasks.workunit.client.0.smithi078.stdout:0/241: sync 2024-09-11T00:17:55.115 INFO:tasks.workunit.client.0.smithi078.stdout:0/242: chown d2/c9 8 1 2024-09-11T00:17:55.115 INFO:tasks.workunit.client.0.smithi078.stdout:0/243: chown d2/d3/d7/f15 2304393 1 2024-09-11T00:17:55.115 INFO:tasks.workunit.client.0.smithi078.stdout:6/291: dread d0/d1/d9/f4a [0,4194304] 0 2024-09-11T00:17:55.115 INFO:tasks.workunit.client.0.smithi078.stdout:0/244: mknod d2/d2a/c51 0 2024-09-11T00:17:55.115 INFO:tasks.workunit.client.0.smithi078.stdout:0/245: stat d2/d2a 0 2024-09-11T00:17:55.116 INFO:tasks.workunit.client.0.smithi078.stdout:6/292: creat d0/d1/f71 x:0 0 0 2024-09-11T00:17:55.117 INFO:tasks.workunit.client.0.smithi078.stdout:0/246: getdents d2/d2a/d2c/d35 0 2024-09-11T00:17:55.118 INFO:tasks.workunit.client.0.smithi078.stdout:6/293: rmdir d0/d1/d1b 39 2024-09-11T00:17:55.118 INFO:tasks.workunit.client.0.smithi078.stdout:0/247: mknod d2/d2a/d2c/d35/c52 0 2024-09-11T00:17:55.120 INFO:tasks.workunit.client.0.smithi078.stdout:6/294: mkdir d0/d1/d53/d72 0 2024-09-11T00:17:55.121 INFO:tasks.workunit.client.0.smithi078.stdout:6/295: dread d0/d1/d9/f4a [0,4194304] 0 2024-09-11T00:17:55.124 INFO:tasks.workunit.client.0.smithi078.stdout:6/296: link d0/d1/d9/f4a d0/d1/d1b/f73 0 2024-09-11T00:17:55.125 INFO:tasks.workunit.client.0.smithi078.stdout:8/295: write da/d13/d19/f1a [2201764,40354] 0 2024-09-11T00:17:55.125 INFO:tasks.workunit.client.0.smithi078.stdout:6/297: unlink d0/d1/d1b/c5f 0 2024-09-11T00:17:55.125 INFO:tasks.workunit.client.0.smithi078.stdout:8/296: mknod da/d1c/d1e/c5d 0 2024-09-11T00:17:55.125 INFO:tasks.workunit.client.0.smithi078.stdout:8/297: read f7 [867053,42850] 0 2024-09-11T00:17:55.126 INFO:tasks.workunit.client.0.smithi078.stdout:8/298: dread da/d13/d1b/f4a [0,4194304] 0 2024-09-11T00:17:55.127 INFO:tasks.workunit.client.0.smithi078.stdout:6/298: rename d0/d1/d2c to d0/d1/d9/d59/d74 0 2024-09-11T00:17:55.127 INFO:tasks.workunit.client.0.smithi078.stdout:6/299: fdatasync d0/d1/d1b/f45 0 2024-09-11T00:17:55.127 INFO:tasks.workunit.client.0.smithi078.stdout:6/300: chown d0/d1/d9/d17/f58 167 1 2024-09-11T00:17:55.127 INFO:tasks.workunit.client.0.smithi078.stdout:8/299: mknod da/d13/d1b/d4e/c5e 0 2024-09-11T00:17:55.129 INFO:tasks.workunit.client.0.smithi078.stdout:6/301: dread d0/d1/f39 [0,4194304] 0 2024-09-11T00:17:55.129 INFO:tasks.workunit.client.0.smithi078.stdout:8/300: truncate da/fe 483596 0 2024-09-11T00:17:55.130 INFO:tasks.workunit.client.0.smithi078.stdout:8/301: dread da/d13/d28/d3a/f40 [0,4194304] 0 2024-09-11T00:17:55.130 INFO:tasks.workunit.client.0.smithi078.stdout:8/302: readlink da/d1c/d1e/l58 0 2024-09-11T00:17:55.130 INFO:tasks.workunit.client.0.smithi078.stdout:6/302: creat d0/d1/f75 x:0 0 0 2024-09-11T00:17:55.131 INFO:tasks.workunit.client.0.smithi078.stdout:6/303: dread - d0/d1/d9/d59/d74/f67 zero size 2024-09-11T00:17:55.131 INFO:tasks.workunit.client.0.smithi078.stdout:8/303: mkdir da/d13/d28/d5f 0 2024-09-11T00:17:55.133 INFO:tasks.workunit.client.0.smithi078.stdout:8/304: rmdir da/d1c/d1e 39 2024-09-11T00:17:55.133 INFO:tasks.workunit.client.0.smithi078.stdout:8/305: chown da/d13/d19/f1a 0 1 2024-09-11T00:17:55.134 INFO:tasks.workunit.client.0.smithi078.stdout:0/248: dwrite d2/d2a/d2c/d42/f1a [0,4194304] 0 2024-09-11T00:17:55.134 INFO:tasks.workunit.client.0.smithi078.stdout:6/304: link d0/d1/d9/d17/f1c d0/f76 0 2024-09-11T00:17:55.135 INFO:tasks.workunit.client.0.smithi078.stdout:6/305: fsync d0/d1/d9/f4a 0 2024-09-11T00:17:55.136 INFO:tasks.workunit.client.0.smithi078.stdout:0/249: mknod d2/d2a/c53 0 2024-09-11T00:17:55.136 INFO:tasks.workunit.client.0.smithi078.stdout:0/250: write d2/d2a/d2c/d42/f38 [125928,45521] 0 2024-09-11T00:17:55.136 INFO:tasks.workunit.client.0.smithi078.stdout:0/251: stat d2/f2d 0 2024-09-11T00:17:55.136 INFO:tasks.workunit.client.0.smithi078.stdout:6/306: unlink d0/d1/f1f 0 2024-09-11T00:17:55.138 INFO:tasks.workunit.client.0.smithi078.stdout:6/307: creat d0/d1/d9/d17/d5e/f77 x:0 0 0 2024-09-11T00:17:55.156 INFO:tasks.workunit.client.0.smithi078.stdout:8/306: dwrite da/f2f [0,4194304] 0 2024-09-11T00:17:55.159 INFO:tasks.workunit.client.0.smithi078.stdout:0/252: dwrite d2/d3/d7/f14 [0,4194304] 0 2024-09-11T00:17:55.163 INFO:tasks.workunit.client.0.smithi078.stdout:0/253: creat d2/d3/f54 x:0 0 0 2024-09-11T00:17:55.164 INFO:tasks.workunit.client.0.smithi078.stdout:6/308: dwrite d0/d1/d9/f24 [0,4194304] 0 2024-09-11T00:17:55.164 INFO:tasks.workunit.client.0.smithi078.stdout:0/254: rmdir d2/d2a/d2c 39 2024-09-11T00:17:55.165 INFO:tasks.workunit.client.0.smithi078.stdout:0/255: truncate d2/d3/f47 3820668 0 2024-09-11T00:17:55.172 INFO:tasks.workunit.client.0.smithi078.stdout:0/256: write d2/f1d [2489720,114868] 0 2024-09-11T00:17:55.174 INFO:tasks.workunit.client.0.smithi078.stdout:8/307: dwrite da/d13/d1b/f3c [0,4194304] 0 2024-09-11T00:17:55.178 INFO:tasks.workunit.client.0.smithi078.stdout:3/249: sync 2024-09-11T00:17:55.178 INFO:tasks.workunit.client.0.smithi078.stdout:3/250: truncate d0/d7/d46/f48 959494 0 2024-09-11T00:17:55.179 INFO:tasks.workunit.client.0.smithi078.stdout:3/251: creat d0/d7/f4e x:0 0 0 2024-09-11T00:17:55.180 INFO:tasks.workunit.client.0.smithi078.stdout:3/252: creat d0/d1a/f4f x:0 0 0 2024-09-11T00:17:55.181 INFO:tasks.workunit.client.0.smithi078.stdout:3/253: creat d0/d7/d18/d1b/f50 x:0 0 0 2024-09-11T00:17:55.195 INFO:tasks.workunit.client.0.smithi078.stdout:0/257: dwrite d2/d3/d7/f40 [4194304,4194304] 0 2024-09-11T00:17:55.196 INFO:tasks.workunit.client.0.smithi078.stdout:8/308: dwrite da/fe [0,4194304] 0 2024-09-11T00:17:55.199 INFO:tasks.workunit.client.0.smithi078.stdout:0/258: creat d2/d2a/d2c/f55 x:0 0 0 2024-09-11T00:17:55.200 INFO:tasks.workunit.client.0.smithi078.stdout:0/259: mkdir d2/d2a/d2c/d42/d23/d56 0 2024-09-11T00:17:55.200 INFO:tasks.workunit.client.0.smithi078.stdout:0/260: chown d2/d2a/d2c/d42/d23/c2e 15 1 2024-09-11T00:17:55.202 INFO:tasks.workunit.client.0.smithi078.stdout:0/261: mkdir d2/d57 0 2024-09-11T00:17:55.202 INFO:tasks.workunit.client.0.smithi078.stdout:0/262: truncate d2/d3/f54 168854 0 2024-09-11T00:17:55.202 INFO:tasks.workunit.client.0.smithi078.stdout:0/263: dread - d2/d3/d7/f50 zero size 2024-09-11T00:17:55.211 INFO:tasks.workunit.client.0.smithi078.stdout:8/309: dwrite da/fc [0,4194304] 0 2024-09-11T00:17:55.211 INFO:tasks.workunit.client.0.smithi078.stdout:8/310: chown da/d13/d1b/d59/f3d 468439347 1 2024-09-11T00:17:55.212 INFO:tasks.workunit.client.0.smithi078.stdout:8/311: truncate da/d13/f31 2835333 0 2024-09-11T00:17:55.212 INFO:tasks.workunit.client.0.smithi078.stdout:8/312: write da/d13/d19/f52 [3753801,7779] 0 2024-09-11T00:17:55.216 INFO:tasks.workunit.client.0.smithi078.stdout:0/264: dwrite d2/d3/d7/f3b [0,4194304] 0 2024-09-11T00:17:55.217 INFO:tasks.workunit.client.0.smithi078.stdout:0/265: rename d2/d3/l3d to d2/d2a/d2c/d42/l58 0 2024-09-11T00:17:55.231 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:54 smithi112 ceph-mon[35627]: pgmap v366: 97 pgs: 97 active+clean; 324 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 32 MiB/s wr, 302 op/s 2024-09-11T00:17:55.297 INFO:tasks.workunit.client.0.smithi078.stdout:1/343: sync 2024-09-11T00:17:55.297 INFO:tasks.workunit.client.0.smithi078.stdout:2/291: sync 2024-09-11T00:17:55.298 INFO:tasks.workunit.client.0.smithi078.stdout:1/344: creat d3/d1a/f6b x:0 0 0 2024-09-11T00:17:55.298 INFO:tasks.workunit.client.0.smithi078.stdout:1/345: write d3/d1a/d21/d4a/f69 [949874,25746] 0 2024-09-11T00:17:55.298 INFO:tasks.workunit.client.0.smithi078.stdout:1/346: dread - d3/d29/d45/f60 zero size 2024-09-11T00:17:55.298 INFO:tasks.workunit.client.0.smithi078.stdout:2/292: dread d0/d1/d8/f29 [0,4194304] 0 2024-09-11T00:17:55.299 INFO:tasks.workunit.client.0.smithi078.stdout:1/347: unlink d3/d29/d45/c3d 0 2024-09-11T00:17:55.300 INFO:tasks.workunit.client.0.smithi078.stdout:2/293: mknod d0/d31/d38/c61 0 2024-09-11T00:17:55.300 INFO:tasks.workunit.client.0.smithi078.stdout:1/348: mknod d3/d29/d5f/c6c 0 2024-09-11T00:17:55.301 INFO:tasks.workunit.client.0.smithi078.stdout:1/349: write d3/d1a/ff [4709762,80089] 0 2024-09-11T00:17:55.301 INFO:tasks.workunit.client.0.smithi078.stdout:1/350: write d3/d29/f50 [521007,16056] 0 2024-09-11T00:17:55.301 INFO:tasks.workunit.client.0.smithi078.stdout:1/351: write d3/f1e [4648508,18022] 0 2024-09-11T00:17:55.307 INFO:tasks.workunit.client.0.smithi078.stdout:1/352: dread d3/d29/d5f/f8 [0,4194304] 0 2024-09-11T00:17:55.314 INFO:tasks.workunit.client.0.smithi078.stdout:1/353: dread d3/d29/d45/f52 [0,4194304] 0 2024-09-11T00:17:55.319 INFO:tasks.workunit.client.0.smithi078.stdout:1/354: dread d3/d29/d5f/f8 [0,4194304] 0 2024-09-11T00:17:55.334 INFO:tasks.workunit.client.0.smithi078.stdout:1/355: dwrite d3/d29/f34 [0,4194304] 0 2024-09-11T00:17:55.349 INFO:tasks.workunit.client.0.smithi078.stdout:1/356: dwrite d3/d29/d45/f3f [0,4194304] 0 2024-09-11T00:17:55.349 INFO:tasks.workunit.client.0.smithi078.stdout:7/308: sync 2024-09-11T00:17:55.349 INFO:tasks.workunit.client.0.smithi078.stdout:5/215: sync 2024-09-11T00:17:55.349 INFO:tasks.workunit.client.0.smithi078.stdout:4/279: sync 2024-09-11T00:17:55.349 INFO:tasks.workunit.client.0.smithi078.stdout:7/309: stat d0/d34/c46 0 2024-09-11T00:17:55.349 INFO:tasks.workunit.client.0.smithi078.stdout:6/309: sync 2024-09-11T00:17:55.349 INFO:tasks.workunit.client.0.smithi078.stdout:9/196: sync 2024-09-11T00:17:55.349 INFO:tasks.workunit.client.0.smithi078.stdout:6/310: read - d0/d1/d9/d59/d74/f67 zero size 2024-09-11T00:17:55.351 INFO:tasks.workunit.client.0.smithi078.stdout:1/357: creat d3/d29/d45/f6d x:0 0 0 2024-09-11T00:17:55.351 INFO:tasks.workunit.client.0.smithi078.stdout:1/358: write d3/d29/d45/f60 [796667,106780] 0 2024-09-11T00:17:55.352 INFO:tasks.workunit.client.0.smithi078.stdout:6/311: truncate d0/d1/f39 1871116 0 2024-09-11T00:17:55.353 INFO:tasks.workunit.client.0.smithi078.stdout:1/359: mknod d3/d29/d5f/c6e 0 2024-09-11T00:17:55.354 INFO:tasks.workunit.client.0.smithi078.stdout:5/216: rename d7/d8/c4e to d7/d8/d33/d22/c55 0 2024-09-11T00:17:55.355 INFO:tasks.workunit.client.0.smithi078.stdout:6/312: symlink d0/d1/d9/d54/l78 0 2024-09-11T00:17:55.356 INFO:tasks.workunit.client.0.smithi078.stdout:1/360: creat d3/d29/d5f/d39/f6f x:0 0 0 2024-09-11T00:17:55.357 INFO:tasks.workunit.client.0.smithi078.stdout:1/361: chown d3/l55 44 1 2024-09-11T00:17:55.358 INFO:tasks.workunit.client.0.smithi078.stdout:1/362: creat d3/d29/d45/f70 x:0 0 0 2024-09-11T00:17:55.359 INFO:tasks.workunit.client.0.smithi078.stdout:5/217: rename d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d26 to d7/d8/d56 0 2024-09-11T00:17:55.360 INFO:tasks.workunit.client.0.smithi078.stdout:1/363: creat d3/f71 x:0 0 0 2024-09-11T00:17:55.362 INFO:tasks.workunit.client.0.smithi078.stdout:5/218: dread d7/d8/de/ff [8388608,4194304] 0 2024-09-11T00:17:55.363 INFO:tasks.workunit.client.0.smithi078.stdout:1/364: mknod d3/d1a/d21/d4a/c72 0 2024-09-11T00:17:55.363 INFO:tasks.workunit.client.0.smithi078.stdout:1/365: chown d3/l55 16 1 2024-09-11T00:17:55.365 INFO:tasks.workunit.client.0.smithi078.stdout:1/366: link d3/d29/l4f d3/d29/d5f/d4e/l73 0 2024-09-11T00:17:55.368 INFO:tasks.workunit.client.0.smithi078.stdout:9/197: dwrite dc/d12/f17 [4194304,4194304] 0 2024-09-11T00:17:55.368 INFO:tasks.workunit.client.0.smithi078.stdout:9/198: chown dc/c10 6 1 2024-09-11T00:17:55.368 INFO:tasks.workunit.client.0.smithi078.stdout:9/199: write dc/f2c [370365,112965] 0 2024-09-11T00:17:55.370 INFO:tasks.workunit.client.0.smithi078.stdout:9/200: creat dc/f43 x:0 0 0 2024-09-11T00:17:55.372 INFO:tasks.workunit.client.0.smithi078.stdout:9/201: mkdir dc/d12/d44 0 2024-09-11T00:17:55.372 INFO:tasks.workunit.client.0.smithi078.stdout:9/202: truncate dc/f38 634475 0 2024-09-11T00:17:55.372 INFO:tasks.workunit.client.0.smithi078.stdout:9/203: chown dc 11022 1 2024-09-11T00:17:55.373 INFO:tasks.workunit.client.0.smithi078.stdout:7/310: dwrite d0/d34/f24 [4194304,4194304] 0 2024-09-11T00:17:55.374 INFO:tasks.workunit.client.0.smithi078.stdout:6/313: dwrite d0/d1/f52 [0,4194304] 0 2024-09-11T00:17:55.375 INFO:tasks.workunit.client.0.smithi078.stdout:9/204: creat dc/d12/d24/d3e/f45 x:0 0 0 2024-09-11T00:17:55.376 INFO:tasks.workunit.client.0.smithi078.stdout:4/280: dwrite dc/f39 [0,4194304] 0 2024-09-11T00:17:55.376 INFO:tasks.workunit.client.0.smithi078.stdout:4/281: write dc/d17/f3f [54084,53195] 0 2024-09-11T00:17:55.376 INFO:tasks.workunit.client.0.smithi078.stdout:4/282: write dc/fd [223844,54573] 0 2024-09-11T00:17:55.379 INFO:tasks.workunit.client.0.smithi078.stdout:7/311: unlink d0/d34/db/d30/d1d/d14/c58 0 2024-09-11T00:17:55.380 INFO:tasks.workunit.client.0.smithi078.stdout:6/314: creat d0/d1/f79 x:0 0 0 2024-09-11T00:17:55.384 INFO:tasks.workunit.client.0.smithi078.stdout:4/283: truncate dc/d10/d1f/f5b 1652576 0 2024-09-11T00:17:55.386 INFO:tasks.workunit.client.0.smithi078.stdout:6/315: creat d0/f7a x:0 0 0 2024-09-11T00:17:55.386 INFO:tasks.workunit.client.0.smithi078.stdout:6/316: write d0/d1/d1b/f6d [917,37758] 0 2024-09-11T00:17:55.386 INFO:tasks.workunit.client.0.smithi078.stdout:6/317: read - d0/d1/d9/d17/d5e/f77 zero size 2024-09-11T00:17:55.386 INFO:tasks.workunit.client.0.smithi078.stdout:6/318: stat d0/d1/d9/d17/f1c 0 2024-09-11T00:17:55.386 INFO:tasks.workunit.client.0.smithi078.stdout:1/367: dwrite d3/d29/d5f/d39/f6f [0,4194304] 0 2024-09-11T00:17:55.386 INFO:tasks.workunit.client.0.smithi078.stdout:1/368: stat d3/d1a/f6b 0 2024-09-11T00:17:55.386 INFO:tasks.workunit.client.0.smithi078.stdout:5/219: dwrite d7/d8/de/ff [4194304,4194304] 0 2024-09-11T00:17:55.390 INFO:tasks.workunit.client.0.smithi078.stdout:4/284: rename dc/d10/f2b to dc/d10/d40/d3a/d46/d59/f5f 0 2024-09-11T00:17:55.391 INFO:tasks.workunit.client.0.smithi078.stdout:4/285: chown dc/d10/d40/d3a/d4c/f41 1487017133 1 2024-09-11T00:17:55.396 INFO:tasks.workunit.client.0.smithi078.stdout:9/205: dwrite f7 [4194304,4194304] 0 2024-09-11T00:17:55.397 INFO:tasks.workunit.client.0.smithi078.stdout:4/286: symlink dc/d10/d40/d3a/d3b/d5d/l60 0 2024-09-11T00:17:55.397 INFO:tasks.workunit.client.0.smithi078.stdout:9/206: write dc/f38 [213237,130986] 0 2024-09-11T00:17:55.397 INFO:tasks.workunit.client.0.smithi078.stdout:9/207: chown dc/d12/c23 102570425 1 2024-09-11T00:17:55.397 INFO:tasks.workunit.client.0.smithi078.stdout:1/369: symlink d3/d1a/d21/d4a/l74 0 2024-09-11T00:17:55.398 INFO:tasks.workunit.client.0.smithi078.stdout:4/287: mknod dc/d10/d40/d3a/d46/d47/c61 0 2024-09-11T00:17:55.400 INFO:tasks.workunit.client.0.smithi078.stdout:4/288: symlink dc/d10/d40/d3a/d4c/l62 0 2024-09-11T00:17:55.401 INFO:tasks.workunit.client.0.smithi078.stdout:5/220: dwrite d7/d8/d33/d22/d25/f45 [0,4194304] 0 2024-09-11T00:17:55.402 INFO:tasks.workunit.client.0.smithi078.stdout:4/289: link dc/d10/d1f/f23 dc/d17/f63 0 2024-09-11T00:17:55.408 INFO:tasks.workunit.client.0.smithi078.stdout:4/290: truncate dc/d10/f1a 23010 0 2024-09-11T00:17:55.409 INFO:tasks.workunit.client.0.smithi078.stdout:4/291: symlink dc/l64 0 2024-09-11T00:17:55.414 INFO:tasks.workunit.client.0.smithi078.stdout:9/208: dwrite f7 [4194304,4194304] 0 2024-09-11T00:17:55.415 INFO:tasks.workunit.client.0.smithi078.stdout:4/292: rename dc/d17 to dc/d10/d40/d3a/d65 0 2024-09-11T00:17:55.416 INFO:tasks.workunit.client.0.smithi078.stdout:1/370: dwrite d3/d1a/d21/d4a/f65 [0,4194304] 0 2024-09-11T00:17:55.416 INFO:tasks.workunit.client.0.smithi078.stdout:4/293: creat dc/d10/d40/d3a/d46/d59/f66 x:0 0 0 2024-09-11T00:17:55.418 INFO:tasks.workunit.client.0.smithi078.stdout:9/209: mkdir dc/d12/d46 0 2024-09-11T00:17:55.419 INFO:tasks.workunit.client.0.smithi078.stdout:0/266: sync 2024-09-11T00:17:55.421 INFO:tasks.workunit.client.0.smithi078.stdout:4/294: creat dc/d10/d3c/f67 x:0 0 0 2024-09-11T00:17:55.423 INFO:tasks.workunit.client.0.smithi078.stdout:9/210: unlink dc/d12/l27 0 2024-09-11T00:17:55.423 INFO:tasks.workunit.client.0.smithi078.stdout:8/313: sync 2024-09-11T00:17:55.423 INFO:tasks.workunit.client.0.smithi078.stdout:3/254: sync 2024-09-11T00:17:55.423 INFO:tasks.workunit.client.0.smithi078.stdout:8/314: readlink da/d13/d28/l45 0 2024-09-11T00:17:55.424 INFO:tasks.workunit.client.0.smithi078.stdout:5/221: dwrite d7/d8/d33/d22/d25/d28/d24/f44 [0,4194304] 0 2024-09-11T00:17:55.424 INFO:tasks.workunit.client.0.smithi078.stdout:4/295: mkdir dc/d10/d1f/d68 0 2024-09-11T00:17:55.426 INFO:tasks.workunit.client.0.smithi078.stdout:9/211: creat dc/d12/d24/f47 x:0 0 0 2024-09-11T00:17:55.426 INFO:tasks.workunit.client.0.smithi078.stdout:9/212: write dc/d12/d24/d3e/f45 [85242,53125] 0 2024-09-11T00:17:55.426 INFO:tasks.workunit.client.0.smithi078.stdout:9/213: stat dc/f14 0 2024-09-11T00:17:55.426 INFO:tasks.workunit.client.0.smithi078.stdout:9/214: write dc/d12/d20/d30/f3f [219005,124590] 0 2024-09-11T00:17:55.428 INFO:tasks.workunit.client.0.smithi078.stdout:3/255: symlink d0/d7/d18/d1b/d34/l51 0 2024-09-11T00:17:55.428 INFO:tasks.workunit.client.0.smithi078.stdout:3/256: stat d0/d7/d18/d1b/d34 0 2024-09-11T00:17:55.429 INFO:tasks.workunit.client.0.smithi078.stdout:0/267: rename d2/d3 to d2/d2a/d2c/d35/d59 0 2024-09-11T00:17:55.432 INFO:tasks.workunit.client.0.smithi078.stdout:5/222: symlink d7/d8/d33/d22/d25/d28/d24/l57 0 2024-09-11T00:17:55.433 INFO:tasks.workunit.client.0.smithi078.stdout:4/296: mkdir dc/d10/d69 0 2024-09-11T00:17:55.434 INFO:tasks.workunit.client.0.smithi078.stdout:9/215: creat dc/d12/d24/d3e/f48 x:0 0 0 2024-09-11T00:17:55.436 INFO:tasks.workunit.client.0.smithi078.stdout:3/257: creat d0/d1a/f52 x:0 0 0 2024-09-11T00:17:55.438 INFO:tasks.workunit.client.0.smithi078.stdout:3/258: dread d0/f10 [0,4194304] 0 2024-09-11T00:17:55.438 INFO:tasks.workunit.client.0.smithi078.stdout:3/259: write d0/d1a/f3b [2105520,41377] 0 2024-09-11T00:17:55.438 INFO:tasks.workunit.client.0.smithi078.stdout:3/260: chown d0/f36 0 1 2024-09-11T00:17:55.439 INFO:tasks.workunit.client.0.smithi078.stdout:8/315: rename da/d13/d28/d56 to da/d1c/d60 0 2024-09-11T00:17:55.439 INFO:tasks.workunit.client.0.smithi078.stdout:8/316: chown da/d13/d1b/f4a 875744 1 2024-09-11T00:17:55.440 INFO:tasks.workunit.client.0.smithi078.stdout:4/297: symlink dc/d10/d40/d3a/d4c/l6a 0 2024-09-11T00:17:55.441 INFO:tasks.workunit.client.0.smithi078.stdout:4/298: chown dc/d10/d40/d33/c55 56 1 2024-09-11T00:17:55.441 INFO:tasks.workunit.client.0.smithi078.stdout:4/299: chown dc/d10/d40/d3a/d46/d59/c5c 2135860 1 2024-09-11T00:17:55.442 INFO:tasks.workunit.client.0.smithi078.stdout:4/300: write dc/d10/d40/d3a/d4c/f2e [491755,70942] 0 2024-09-11T00:17:55.442 INFO:tasks.workunit.client.0.smithi078.stdout:4/301: chown dc/d10/d40/d3a/d46 1 1 2024-09-11T00:17:55.444 INFO:tasks.workunit.client.0.smithi078.stdout:0/268: rename d2/d2a/l4c to d2/l5a 0 2024-09-11T00:17:55.445 INFO:tasks.workunit.client.0.smithi078.stdout:5/223: dwrite d7/d8/d33/d22/d25/d28/f41 [4194304,4194304] 0 2024-09-11T00:17:55.446 INFO:tasks.workunit.client.0.smithi078.stdout:8/317: symlink da/d13/d28/d5f/l61 0 2024-09-11T00:17:55.448 INFO:tasks.workunit.client.0.smithi078.stdout:4/302: unlink dc/d10/f1a 0 2024-09-11T00:17:55.450 INFO:tasks.workunit.client.0.smithi078.stdout:4/303: creat dc/d10/d40/d3a/d46/f6b x:0 0 0 2024-09-11T00:17:55.451 INFO:tasks.workunit.client.0.smithi078.stdout:3/261: dwrite d0/d1a/f4f [0,4194304] 0 2024-09-11T00:17:55.452 INFO:tasks.workunit.client.0.smithi078.stdout:8/318: read da/d13/d1b/f34 [1890140,118670] 0 2024-09-11T00:17:55.452 INFO:tasks.workunit.client.0.smithi078.stdout:9/216: rename dc/d12/d24/d3e/f48 to dc/d12/f49 0 2024-09-11T00:17:55.455 INFO:tasks.workunit.client.0.smithi078.stdout:4/304: read dc/d10/d1f/f5b [162861,21623] 0 2024-09-11T00:17:55.455 INFO:tasks.workunit.client.0.smithi078.stdout:8/319: mkdir da/d13/d1b/d24/d62 0 2024-09-11T00:17:55.457 INFO:tasks.workunit.client.0.smithi078.stdout:9/217: symlink dc/d12/d24/d3e/l4a 0 2024-09-11T00:17:55.457 INFO:tasks.workunit.client.0.smithi078.stdout:4/305: dread fa [0,4194304] 0 2024-09-11T00:17:55.457 INFO:tasks.workunit.client.0.smithi078.stdout:4/306: fdatasync dc/ff 0 2024-09-11T00:17:55.460 INFO:tasks.workunit.client.0.smithi078.stdout:0/269: dwrite d2/d2a/d2c/d35/d59/d7/f50 [0,4194304] 0 2024-09-11T00:17:55.462 INFO:tasks.workunit.client.0.smithi078.stdout:8/320: mkdir da/d13/d1b/d53/d63 0 2024-09-11T00:17:55.463 INFO:tasks.workunit.client.0.smithi078.stdout:9/218: truncate dc/d12/f11 357851 0 2024-09-11T00:17:55.465 INFO:tasks.workunit.client.0.smithi078.stdout:4/307: truncate f3 7483695 0 2024-09-11T00:17:55.465 INFO:tasks.workunit.client.0.smithi078.stdout:4/308: fdatasync fa 0 2024-09-11T00:17:55.465 INFO:tasks.workunit.client.0.smithi078.stdout:4/309: truncate dc/d10/d40/d3a/d46/d59/f5f 1960973 0 2024-09-11T00:17:55.465 INFO:tasks.workunit.client.0.smithi078.stdout:4/310: readlink dc/d10/d40/d3a/d3b/d5d/l60 0 2024-09-11T00:17:55.468 INFO:tasks.workunit.client.0.smithi078.stdout:5/224: dwrite d7/f1f [0,4194304] 0 2024-09-11T00:17:55.468 INFO:tasks.workunit.client.0.smithi078.stdout:5/225: stat d7/d8/d33/c29 0 2024-09-11T00:17:55.468 INFO:tasks.workunit.client.0.smithi078.stdout:0/270: unlink d2/d2a/c53 0 2024-09-11T00:17:55.469 INFO:tasks.workunit.client.0.smithi078.stdout:8/321: rmdir da/d13/d1b/d24 39 2024-09-11T00:17:55.470 INFO:tasks.workunit.client.0.smithi078.stdout:8/322: write f4 [709900,718] 0 2024-09-11T00:17:55.471 INFO:tasks.workunit.client.0.smithi078.stdout:9/219: creat dc/d12/d20/d30/f4b x:0 0 0 2024-09-11T00:17:55.471 INFO:tasks.workunit.client.0.smithi078.stdout:9/220: dread - dc/d12/f49 zero size 2024-09-11T00:17:55.472 INFO:tasks.workunit.client.0.smithi078.stdout:4/311: mknod dc/d10/d40/d3a/d65/c6c 0 2024-09-11T00:17:55.475 INFO:tasks.workunit.client.0.smithi078.stdout:5/226: creat d7/d8/d33/d22/d51/f58 x:0 0 0 2024-09-11T00:17:55.476 INFO:tasks.workunit.client.0.smithi078.stdout:8/323: truncate da/d13/f2c 248271 0 2024-09-11T00:17:55.477 INFO:tasks.workunit.client.0.smithi078.stdout:4/312: getdents dc/d10/d40/d33 0 2024-09-11T00:17:55.477 INFO:tasks.workunit.client.0.smithi078.stdout:0/271: dread d2/d2a/d2c/d35/d59/d7/f14 [0,4194304] 0 2024-09-11T00:17:55.477 INFO:tasks.workunit.client.0.smithi078.stdout:0/272: chown d2/d2a/d2c/d35/d59/d7/f40 85547 1 2024-09-11T00:17:55.479 INFO:tasks.workunit.client.0.smithi078.stdout:8/324: mknod da/d13/d28/d5f/c64 0 2024-09-11T00:17:55.479 INFO:tasks.workunit.client.0.smithi078.stdout:8/325: truncate da/d1c/f38 910548 0 2024-09-11T00:17:55.479 INFO:tasks.workunit.client.0.smithi078.stdout:0/273: rmdir d2/d2a/d2c 39 2024-09-11T00:17:55.479 INFO:tasks.workunit.client.0.smithi078.stdout:0/274: truncate d2/d2a/d2c/d42/f38 496332 0 2024-09-11T00:17:55.480 INFO:tasks.workunit.client.0.smithi078.stdout:0/275: creat d2/d2a/d2c/d35/d59/f5b x:0 0 0 2024-09-11T00:17:55.480 INFO:tasks.workunit.client.0.smithi078.stdout:0/276: chown d2/d2a/d2c/d35/d59/f22 3462 1 2024-09-11T00:17:55.481 INFO:tasks.workunit.client.0.smithi078.stdout:0/277: creat d2/d2a/d2c/d42/f5c x:0 0 0 2024-09-11T00:17:55.490 INFO:tasks.workunit.client.0.smithi078.stdout:9/221: dwrite dc/d12/d20/d30/f4b [0,4194304] 0 2024-09-11T00:17:55.490 INFO:tasks.workunit.client.0.smithi078.stdout:9/222: write dc/f43 [266208,113186] 0 2024-09-11T00:17:55.495 INFO:tasks.workunit.client.0.smithi078.stdout:9/223: mknod dc/d12/d20/d30/c4c 0 2024-09-11T00:17:55.495 INFO:tasks.workunit.client.0.smithi078.stdout:9/224: chown dc/d12/d20/c3c 6251 1 2024-09-11T00:17:55.498 INFO:tasks.workunit.client.0.smithi078.stdout:0/278: read d2/d2a/d2c/d35/d59/f47 [2858545,76990] 0 2024-09-11T00:17:55.498 INFO:tasks.workunit.client.0.smithi078.stdout:5/227: dwrite d7/d8/d33/d22/d51/f58 [0,4194304] 0 2024-09-11T00:17:55.498 INFO:tasks.workunit.client.0.smithi078.stdout:5/228: fdatasync d7/d8/d33/d22/d25/f4b 0 2024-09-11T00:17:55.498 INFO:tasks.workunit.client.0.smithi078.stdout:0/279: write d2/d2a/d2c/d35/d59/f1b [5338685,112791] 0 2024-09-11T00:17:55.498 INFO:tasks.workunit.client.0.smithi078.stdout:4/313: dwrite dc/d10/d40/d3a/d4c/f2e [0,4194304] 0 2024-09-11T00:17:55.500 INFO:tasks.workunit.client.0.smithi078.stdout:4/314: dread dc/fd [0,4194304] 0 2024-09-11T00:17:55.501 INFO:tasks.workunit.client.0.smithi078.stdout:5/229: link d7/d8/d33/d22/d25/d28/d24/fb d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f59 0 2024-09-11T00:17:55.502 INFO:tasks.workunit.client.0.smithi078.stdout:8/326: dwrite f2 [0,4194304] 0 2024-09-11T00:17:55.503 INFO:tasks.workunit.client.0.smithi078.stdout:9/225: write f4 [3826386,111057] 0 2024-09-11T00:17:55.506 INFO:tasks.workunit.client.0.smithi078.stdout:4/315: mkdir dc/d10/d6d 0 2024-09-11T00:17:55.507 INFO:tasks.workunit.client.0.smithi078.stdout:8/327: mknod da/d13/d28/d5f/c65 0 2024-09-11T00:17:55.508 INFO:tasks.workunit.client.0.smithi078.stdout:9/226: mknod dc/d12/d20/c4d 0 2024-09-11T00:17:55.509 INFO:tasks.workunit.client.0.smithi078.stdout:4/316: mkdir dc/d10/d3c/d6e 0 2024-09-11T00:17:55.510 INFO:tasks.workunit.client.0.smithi078.stdout:9/227: link dc/d12/c1f dc/d12/d20/d30/c4e 0 2024-09-11T00:17:55.511 INFO:tasks.workunit.client.0.smithi078.stdout:4/317: rmdir dc/d10/d6d 0 2024-09-11T00:17:55.512 INFO:tasks.workunit.client.0.smithi078.stdout:9/228: creat dc/d12/d20/f4f x:0 0 0 2024-09-11T00:17:55.513 INFO:tasks.workunit.client.0.smithi078.stdout:4/318: unlink dc/d10/d40/d3a/d65/c6c 0 2024-09-11T00:17:55.513 INFO:tasks.workunit.client.0.smithi078.stdout:4/319: chown dc/d10/d3c/d6e 1 1 2024-09-11T00:17:55.514 INFO:tasks.workunit.client.0.smithi078.stdout:9/229: mkdir dc/d12/d20/d50 0 2024-09-11T00:17:55.514 INFO:tasks.workunit.client.0.smithi078.stdout:9/230: chown dc/d12/d20/f32 78738 1 2024-09-11T00:17:55.514 INFO:tasks.workunit.client.0.smithi078.stdout:8/328: dread da/f14 [0,4194304] 0 2024-09-11T00:17:55.514 INFO:tasks.workunit.client.0.smithi078.stdout:8/329: chown da/f10 851718130 1 2024-09-11T00:17:55.514 INFO:tasks.workunit.client.0.smithi078.stdout:2/294: sync 2024-09-11T00:17:55.515 INFO:tasks.workunit.client.0.smithi078.stdout:9/231: read dc/d12/d20/d30/f3f [210786,57583] 0 2024-09-11T00:17:55.515 INFO:tasks.workunit.client.0.smithi078.stdout:4/320: rmdir dc/d10/d40/d3a 39 2024-09-11T00:17:55.515 INFO:tasks.workunit.client.0.smithi078.stdout:4/321: write dc/d10/d40/d3a/d46/d59/f66 [378052,84279] 0 2024-09-11T00:17:55.515 INFO:tasks.workunit.client.0.smithi078.stdout:4/322: chown dc/d10/d40/d33 12151 1 2024-09-11T00:17:55.516 INFO:tasks.workunit.client.0.smithi078.stdout:8/330: mkdir da/d13/d1b/d4e/d66 0 2024-09-11T00:17:55.516 INFO:tasks.workunit.client.0.smithi078.stdout:2/295: truncate d0/d31/d3a/f4a 710659 0 2024-09-11T00:17:55.517 INFO:tasks.workunit.client.0.smithi078.stdout:9/232: unlink dc/d12/f49 0 2024-09-11T00:17:55.519 INFO:tasks.workunit.client.0.smithi078.stdout:8/331: rename f4 to da/d1c/d60/f67 0 2024-09-11T00:17:55.521 INFO:tasks.workunit.client.0.smithi078.stdout:2/296: creat d0/d19/d3d/f62 x:0 0 0 2024-09-11T00:17:55.523 INFO:tasks.workunit.client.0.smithi078.stdout:9/233: rmdir dc/d12/d20/d3a 0 2024-09-11T00:17:55.523 INFO:tasks.workunit.client.0.smithi078.stdout:9/234: chown dc/d12/d20/f32 225596720 1 2024-09-11T00:17:55.523 INFO:tasks.workunit.client.0.smithi078.stdout:9/235: getdents dc/d12/d44 0 2024-09-11T00:17:55.524 INFO:tasks.workunit.client.0.smithi078.stdout:8/332: mkdir da/d13/d1b/d59/d68 0 2024-09-11T00:17:55.526 INFO:tasks.workunit.client.0.smithi078.stdout:2/297: symlink d0/d1/d11/d1b/d1e/l63 0 2024-09-11T00:17:55.526 INFO:tasks.workunit.client.0.smithi078.stdout:2/298: fsync d0/d31/d3a/d51/f58 0 2024-09-11T00:17:55.528 INFO:tasks.workunit.client.0.smithi078.stdout:8/333: creat da/d13/d1b/d24/d62/f69 x:0 0 0 2024-09-11T00:17:55.528 INFO:tasks.workunit.client.0.smithi078.stdout:8/334: truncate da/d13/d1b/f4a 1348497 0 2024-09-11T00:17:55.528 INFO:tasks.workunit.client.0.smithi078.stdout:8/335: fdatasync da/d13/d1b/f34 0 2024-09-11T00:17:55.528 INFO:tasks.workunit.client.0.smithi078.stdout:4/323: dwrite dc/d10/d40/f28 [0,4194304] 0 2024-09-11T00:17:55.532 INFO:tasks.workunit.client.0.smithi078.stdout:4/324: creat dc/d10/d40/d3a/d46/f6f x:0 0 0 2024-09-11T00:17:55.537 INFO:tasks.workunit.client.0.smithi078.stdout:4/325: mknod dc/d10/d40/d3a/d46/c70 0 2024-09-11T00:17:55.537 INFO:tasks.workunit.client.0.smithi078.stdout:4/326: write dc/d10/d40/d3a/d46/d59/f5f [2590227,61066] 0 2024-09-11T00:17:55.537 INFO:tasks.workunit.client.0.smithi078.stdout:4/327: truncate dc/fd 1487836 0 2024-09-11T00:17:55.537 INFO:tasks.workunit.client.0.smithi078.stdout:4/328: getdents dc/d10/d40/d3a/d4c 0 2024-09-11T00:17:55.537 INFO:tasks.workunit.client.0.smithi078.stdout:4/329: mknod dc/d10/d69/c71 0 2024-09-11T00:17:55.539 INFO:tasks.workunit.client.0.smithi078.stdout:4/330: mkdir dc/d10/d69/d72 0 2024-09-11T00:17:55.540 INFO:tasks.workunit.client.0.smithi078.stdout:4/331: creat dc/d10/d40/d3a/d3b/d5d/f73 x:0 0 0 2024-09-11T00:17:55.545 INFO:tasks.workunit.client.0.smithi078.stdout:9/236: dwrite dc/f43 [0,4194304] 0 2024-09-11T00:17:55.546 INFO:tasks.workunit.client.0.smithi078.stdout:4/332: dread dc/d10/d40/d3a/d4c/f2e [0,4194304] 0 2024-09-11T00:17:55.546 INFO:tasks.workunit.client.0.smithi078.stdout:4/333: truncate dc/d10/d40/d3a/d4c/f2e 4272107 0 2024-09-11T00:17:55.548 INFO:tasks.workunit.client.0.smithi078.stdout:9/237: mkdir dc/d12/d46/d51 0 2024-09-11T00:17:55.548 INFO:tasks.workunit.client.0.smithi078.stdout:9/238: fdatasync dc/d12/d20/f32 0 2024-09-11T00:17:55.548 INFO:tasks.workunit.client.0.smithi078.stdout:9/239: read - dc/d12/d24/f47 zero size 2024-09-11T00:17:55.548 INFO:tasks.workunit.client.0.smithi078.stdout:4/334: mknod dc/d10/d40/d3a/c74 0 2024-09-11T00:17:55.549 INFO:tasks.workunit.client.0.smithi078.stdout:4/335: chown dc/d10/d69/c71 317 1 2024-09-11T00:17:55.549 INFO:tasks.workunit.client.0.smithi078.stdout:9/240: symlink dc/d12/d35/l52 0 2024-09-11T00:17:55.550 INFO:tasks.workunit.client.0.smithi078.stdout:9/241: rename dc/d12/d20/d30/f3f to dc/d12/d46/d51/f53 0 2024-09-11T00:17:55.552 INFO:tasks.workunit.client.0.smithi078.stdout:9/242: dread dc/f38 [0,4194304] 0 2024-09-11T00:17:55.552 INFO:tasks.workunit.client.0.smithi078.stdout:9/243: readlink dc/d12/d20/d30/l31 0 2024-09-11T00:17:55.553 INFO:tasks.workunit.client.0.smithi078.stdout:2/299: dwrite d0/d1/d8/f4f [0,4194304] 0 2024-09-11T00:17:55.554 INFO:tasks.workunit.client.0.smithi078.stdout:8/336: dwrite da/d13/d1b/f23 [0,4194304] 0 2024-09-11T00:17:55.554 INFO:tasks.workunit.client.0.smithi078.stdout:4/336: write dc/ff [3908819,108230] 0 2024-09-11T00:17:55.557 INFO:tasks.workunit.client.0.smithi078.stdout:2/300: unlink d0/d31/d3a/c3f 0 2024-09-11T00:17:55.557 INFO:tasks.workunit.client.0.smithi078.stdout:2/301: chown d0/d1/d8/l13 3 1 2024-09-11T00:17:55.558 INFO:tasks.workunit.client.0.smithi078.stdout:4/337: mknod dc/d10/d1f/c75 0 2024-09-11T00:17:55.559 INFO:tasks.workunit.client.0.smithi078.stdout:2/302: creat d0/d31/d38/f64 x:0 0 0 2024-09-11T00:17:55.570 INFO:tasks.workunit.client.0.smithi078.stdout:8/337: dread da/d13/d19/f52 [0,4194304] 0 2024-09-11T00:17:55.570 INFO:tasks.workunit.client.0.smithi078.stdout:9/244: dwrite dc/f2c [0,4194304] 0 2024-09-11T00:17:55.573 INFO:tasks.workunit.client.0.smithi078.stdout:8/338: mknod da/d13/d1b/d4e/d66/c6a 0 2024-09-11T00:17:55.576 INFO:tasks.workunit.client.0.smithi078.stdout:9/245: write dc/f43 [1772099,27279] 0 2024-09-11T00:17:55.576 INFO:tasks.workunit.client.0.smithi078.stdout:4/338: dwrite dc/d10/d40/d3a/d4c/f41 [0,4194304] 0 2024-09-11T00:17:55.576 INFO:tasks.workunit.client.0.smithi078.stdout:4/339: write f6 [289721,108893] 0 2024-09-11T00:17:55.578 INFO:tasks.workunit.client.0.smithi078.stdout:4/340: rmdir dc/d10/d40/d3a/d46/d59 39 2024-09-11T00:17:55.578 INFO:tasks.workunit.client.0.smithi078.stdout:4/341: stat dc/d10/d40/d3a/d46/d47 0 2024-09-11T00:17:55.579 INFO:tasks.workunit.client.0.smithi078.stdout:9/246: mkdir dc/d12/d54 0 2024-09-11T00:17:55.580 INFO:tasks.workunit.client.0.smithi078.stdout:2/303: dwrite d0/d1/d6/f37 [0,4194304] 0 2024-09-11T00:17:55.581 INFO:tasks.workunit.client.0.smithi078.stdout:2/304: stat d0/d1/d11/d1b/d1e 0 2024-09-11T00:17:55.582 INFO:tasks.workunit.client.0.smithi078.stdout:2/305: unlink d0/d19/l57 0 2024-09-11T00:17:55.582 INFO:tasks.workunit.client.0.smithi078.stdout:2/306: chown d0/c10 3152 1 2024-09-11T00:17:55.582 INFO:tasks.workunit.client.0.smithi078.stdout:2/307: chown d0/d1/c17 385793928 1 2024-09-11T00:17:55.586 INFO:tasks.workunit.client.0.smithi078.stdout:2/308: write d0/d19/f2c [4937448,75606] 0 2024-09-11T00:17:55.586 INFO:tasks.workunit.client.0.smithi078.stdout:2/309: stat d0/d1/f54 0 2024-09-11T00:17:55.588 INFO:tasks.workunit.client.0.smithi078.stdout:2/310: link d0/d1/d11/f44 d0/d1/d53/f65 0 2024-09-11T00:17:55.589 INFO:tasks.workunit.client.0.smithi078.stdout:4/342: dread dc/d10/d1f/f20 [0,4194304] 0 2024-09-11T00:17:55.589 INFO:tasks.workunit.client.0.smithi078.stdout:4/343: read dc/d10/d1f/f23 [3301561,113894] 0 2024-09-11T00:17:55.589 INFO:tasks.workunit.client.0.smithi078.stdout:4/344: getdents dc/d54 0 2024-09-11T00:17:55.590 INFO:tasks.workunit.client.0.smithi078.stdout:2/311: symlink d0/d1/d6/l66 0 2024-09-11T00:17:55.590 INFO:tasks.workunit.client.0.smithi078.stdout:2/312: write d0/d1/d6/f39 [305541,126662] 0 2024-09-11T00:17:55.595 INFO:tasks.workunit.client.0.smithi078.stdout:8/339: dwrite da/fe [0,4194304] 0 2024-09-11T00:17:55.603 INFO:tasks.workunit.client.0.smithi078.stdout:9/247: dwrite f7 [4194304,4194304] 0 2024-09-11T00:17:55.603 INFO:tasks.workunit.client.0.smithi078.stdout:4/345: dwrite dc/d10/d40/d3a/d4c/f2e [4194304,4194304] 0 2024-09-11T00:17:55.606 INFO:tasks.workunit.client.0.smithi078.stdout:8/340: write da/f2f [1213683,107401] 0 2024-09-11T00:17:55.606 INFO:tasks.workunit.client.0.smithi078.stdout:9/248: mknod dc/c55 0 2024-09-11T00:17:55.606 INFO:tasks.workunit.client.0.smithi078.stdout:9/249: getdents dc/d12/d54 0 2024-09-11T00:17:55.607 INFO:tasks.workunit.client.0.smithi078.stdout:4/346: creat dc/d10/d1f/f76 x:0 0 0 2024-09-11T00:17:55.607 INFO:tasks.workunit.client.0.smithi078.stdout:4/347: fdatasync dc/d10/d40/d3a/d65/f51 0 2024-09-11T00:17:55.607 INFO:tasks.workunit.client.0.smithi078.stdout:8/341: symlink da/d13/d28/d3a/d4b/l6b 0 2024-09-11T00:17:55.609 INFO:tasks.workunit.client.0.smithi078.stdout:9/250: rename dc/d12/f26 to dc/d12/d20/f56 0 2024-09-11T00:17:55.610 INFO:tasks.workunit.client.0.smithi078.stdout:9/251: truncate dc/d12/f17 8085549 0 2024-09-11T00:17:55.615 INFO:tasks.workunit.client.0.smithi078.stdout:6/319: sync 2024-09-11T00:17:55.615 INFO:tasks.workunit.client.0.smithi078.stdout:7/312: sync 2024-09-11T00:17:55.615 INFO:tasks.workunit.client.0.smithi078.stdout:7/313: write d0/d34/db/d30/d1d/d14/f41 [930604,81741] 0 2024-09-11T00:17:55.615 INFO:tasks.workunit.client.0.smithi078.stdout:7/314: dread - d0/f55 zero size 2024-09-11T00:17:55.616 INFO:tasks.workunit.client.0.smithi078.stdout:2/313: dwrite d0/d1/d53/f65 [0,4194304] 0 2024-09-11T00:17:55.616 INFO:tasks.workunit.client.0.smithi078.stdout:6/320: symlink d0/d1/l7b 0 2024-09-11T00:17:55.617 INFO:tasks.workunit.client.0.smithi078.stdout:7/315: rmdir d0/d34/db/d30/d28 39 2024-09-11T00:17:55.617 INFO:tasks.workunit.client.0.smithi078.stdout:7/316: write d0/d34/db/f51 [947675,70298] 0 2024-09-11T00:17:55.619 INFO:tasks.workunit.client.0.smithi078.stdout:2/314: mkdir d0/d67 0 2024-09-11T00:17:55.621 INFO:tasks.workunit.client.0.smithi078.stdout:2/315: mknod d0/d1/c68 0 2024-09-11T00:17:55.623 INFO:tasks.workunit.client.0.smithi078.stdout:6/321: read d0/d1/f41 [125598,5005] 0 2024-09-11T00:17:55.623 INFO:tasks.workunit.client.0.smithi078.stdout:6/322: dread - d0/f5a zero size 2024-09-11T00:17:55.623 INFO:tasks.workunit.client.0.smithi078.stdout:6/323: write d0/f5a [418800,9819] 0 2024-09-11T00:17:55.623 INFO:tasks.workunit.client.0.smithi078.stdout:6/324: fdatasync d0/f3c 0 2024-09-11T00:17:55.624 INFO:tasks.workunit.client.0.smithi078.stdout:6/325: dread d0/d1/d9/f4a [0,4194304] 0 2024-09-11T00:17:55.624 INFO:tasks.workunit.client.0.smithi078.stdout:6/326: write d0/f7a [98566,103679] 0 2024-09-11T00:17:55.625 INFO:tasks.workunit.client.0.smithi078.stdout:6/327: chown d0/d33/f3d 14396 1 2024-09-11T00:17:55.631 INFO:tasks.workunit.client.0.smithi078.stdout:4/348: dwrite dc/fd [0,4194304] 0 2024-09-11T00:17:55.631 INFO:tasks.workunit.client.0.smithi078.stdout:2/316: dread d0/d1/d11/f24 [0,4194304] 0 2024-09-11T00:17:55.633 INFO:tasks.workunit.client.0.smithi078.stdout:9/252: dwrite dc/f14 [0,4194304] 0 2024-09-11T00:17:55.633 INFO:tasks.workunit.client.0.smithi078.stdout:4/349: rename dc/d10/d1f/f23 to dc/d10/d40/d3a/d46/d59/f77 0 2024-09-11T00:17:55.634 INFO:tasks.workunit.client.0.smithi078.stdout:4/350: creat dc/d10/d40/d3a/d3b/d5d/f78 x:0 0 0 2024-09-11T00:17:55.634 INFO:tasks.workunit.client.0.smithi078.stdout:4/351: write dc/ff [2219501,35978] 0 2024-09-11T00:17:55.634 INFO:tasks.workunit.client.0.smithi078.stdout:4/352: stat dc/d10/d40/d3a/d46/f6f 0 2024-09-11T00:17:55.634 INFO:tasks.workunit.client.0.smithi078.stdout:4/353: chown dc/d10/d40/d3a/d65/l21 301 1 2024-09-11T00:17:55.634 INFO:tasks.workunit.client.0.smithi078.stdout:4/354: write f6 [1147284,27968] 0 2024-09-11T00:17:55.634 INFO:tasks.workunit.client.0.smithi078.stdout:4/355: creat dc/d10/d69/d72/f79 x:0 0 0 2024-09-11T00:17:55.641 INFO:tasks.workunit.client.0.smithi078.stdout:9/253: write dc/d12/d20/d30/f4b [155475,91746] 0 2024-09-11T00:17:55.641 INFO:tasks.workunit.client.0.smithi078.stdout:9/254: chown dc/f1e 15 1 2024-09-11T00:17:55.641 INFO:tasks.workunit.client.0.smithi078.stdout:9/255: write dc/d12/d24/f3b [130158,22977] 0 2024-09-11T00:17:55.643 INFO:tasks.workunit.client.0.smithi078.stdout:4/356: dread dc/d10/d40/d3a/d3b/f45 [0,4194304] 0 2024-09-11T00:17:55.649 INFO:tasks.workunit.client.0.smithi078.stdout:8/342: dwrite da/d13/d1b/d59/f3d [0,4194304] 0 2024-09-11T00:17:55.649 INFO:tasks.workunit.client.0.smithi078.stdout:8/343: chown da/cd 30335943 1 2024-09-11T00:17:55.649 INFO:tasks.workunit.client.0.smithi078.stdout:8/344: readlink da/d13/d28/l45 0 2024-09-11T00:17:55.650 INFO:tasks.workunit.client.0.smithi078.stdout:4/357: truncate dc/d10/d40/d3a/d4c/f2e 758243 0 2024-09-11T00:17:55.650 INFO:tasks.workunit.client.0.smithi078.stdout:4/358: dread - dc/d10/d40/d3a/d46/f6f zero size 2024-09-11T00:17:55.650 INFO:tasks.workunit.client.0.smithi078.stdout:4/359: readlink dc/d10/d40/d3a/d4c/l6a 0 2024-09-11T00:17:55.650 INFO:tasks.workunit.client.0.smithi078.stdout:4/360: chown dc/d10/d40/d3a/d3b/d5d 2230 1 2024-09-11T00:17:55.652 INFO:tasks.workunit.client.0.smithi078.stdout:8/345: mknod da/d13/d1b/d53/d63/c6c 0 2024-09-11T00:17:55.652 INFO:tasks.workunit.client.0.smithi078.stdout:8/346: write da/d1c/d60/f67 [3543058,82012] 0 2024-09-11T00:17:55.652 INFO:tasks.workunit.client.0.smithi078.stdout:8/347: stat da/d13/d1b/f4a 0 2024-09-11T00:17:55.652 INFO:tasks.workunit.client.0.smithi078.stdout:8/348: stat da/d1c/d4c 0 2024-09-11T00:17:55.652 INFO:tasks.workunit.client.0.smithi078.stdout:8/349: chown da/d13/d1b/d24/c2d 18699757 1 2024-09-11T00:17:55.652 INFO:tasks.workunit.client.0.smithi078.stdout:6/328: dwrite d0/d1/d9/d59/f64 [4194304,4194304] 0 2024-09-11T00:17:55.653 INFO:tasks.workunit.client.0.smithi078.stdout:2/317: dwrite d0/d1/d3c/f45 [0,4194304] 0 2024-09-11T00:17:55.654 INFO:tasks.workunit.client.0.smithi078.stdout:8/350: symlink da/d13/d1b/d37/l6d 0 2024-09-11T00:17:55.654 INFO:tasks.workunit.client.0.smithi078.stdout:8/351: write da/d13/d1b/f36 [1444518,64516] 0 2024-09-11T00:17:55.657 INFO:tasks.workunit.client.0.smithi078.stdout:2/318: creat d0/d1/d11/f69 x:0 0 0 2024-09-11T00:17:55.659 INFO:tasks.workunit.client.0.smithi078.stdout:6/329: rename d0/d1/f30 to d0/f7c 0 2024-09-11T00:17:55.660 INFO:tasks.workunit.client.0.smithi078.stdout:6/330: read d0/f5a [58680,90456] 0 2024-09-11T00:17:55.661 INFO:tasks.workunit.client.0.smithi078.stdout:8/352: rename da/d13/d19/f1a to da/f6e 0 2024-09-11T00:17:55.663 INFO:tasks.workunit.client.0.smithi078.stdout:6/331: symlink d0/d1/d9/l7d 0 2024-09-11T00:17:55.663 INFO:tasks.workunit.client.0.smithi078.stdout:1/371: sync 2024-09-11T00:17:55.664 INFO:tasks.workunit.client.0.smithi078.stdout:3/262: sync 2024-09-11T00:17:55.664 INFO:tasks.workunit.client.0.smithi078.stdout:3/263: stat d0/d1a/c37 0 2024-09-11T00:17:55.664 INFO:tasks.workunit.client.0.smithi078.stdout:3/264: write d0/d7/d18/d1b/d34/f49 [2220764,81160] 0 2024-09-11T00:17:55.664 INFO:tasks.workunit.client.0.smithi078.stdout:3/265: read d0/f2 [3259117,66684] 0 2024-09-11T00:17:55.664 INFO:tasks.workunit.client.0.smithi078.stdout:9/256: dwrite dc/f1e [0,4194304] 0 2024-09-11T00:17:55.665 INFO:tasks.workunit.client.0.smithi078.stdout:9/257: fdatasync dc/f2c 0 2024-09-11T00:17:55.665 INFO:tasks.workunit.client.0.smithi078.stdout:9/258: truncate dc/d12/d24/d3e/f42 684733 0 2024-09-11T00:17:55.665 INFO:tasks.workunit.client.0.smithi078.stdout:9/259: fdatasync dc/f1c 0 2024-09-11T00:17:55.666 INFO:tasks.workunit.client.0.smithi078.stdout:3/266: rename d0/d7/d18/d1b/c24 to d0/d7/d18/d1b/c53 0 2024-09-11T00:17:55.668 INFO:tasks.workunit.client.0.smithi078.stdout:1/372: dread f2 [4194304,4194304] 0 2024-09-11T00:17:55.669 INFO:tasks.workunit.client.0.smithi078.stdout:1/373: truncate d3/f40 1348836 0 2024-09-11T00:17:55.671 INFO:tasks.workunit.client.0.smithi078.stdout:4/361: dwrite dc/f39 [0,4194304] 0 2024-09-11T00:17:55.671 INFO:tasks.workunit.client.0.smithi078.stdout:4/362: readlink dc/d10/d40/d3a/d3b/l42 0 2024-09-11T00:17:55.671 INFO:tasks.workunit.client.0.smithi078.stdout:9/260: read dc/f1e [2079047,58894] 0 2024-09-11T00:17:55.672 INFO:tasks.workunit.client.0.smithi078.stdout:1/374: mknod d3/d29/d5f/d4e/c75 0 2024-09-11T00:17:55.672 INFO:tasks.workunit.client.0.smithi078.stdout:1/375: write d3/d1a/ff [5228209,52742] 0 2024-09-11T00:17:55.675 INFO:tasks.workunit.client.0.smithi078.stdout:4/363: symlink dc/d10/d40/d3a/d46/d47/l7a 0 2024-09-11T00:17:55.676 INFO:tasks.workunit.client.0.smithi078.stdout:2/319: dwrite d0/d31/d38/f4b [0,4194304] 0 2024-09-11T00:17:55.678 INFO:tasks.workunit.client.0.smithi078.stdout:1/376: truncate d3/d1a/d21/d4a/f69 67249 0 2024-09-11T00:17:55.679 INFO:tasks.workunit.client.0.smithi078.stdout:8/353: dwrite da/d13/d1b/f2e [0,4194304] 0 2024-09-11T00:17:55.681 INFO:tasks.workunit.client.0.smithi078.stdout:6/332: dread d0/d1/f2 [0,4194304] 0 2024-09-11T00:17:55.684 INFO:tasks.workunit.client.0.smithi078.stdout:4/364: mkdir dc/d10/d40/d3a/d65/d7b 0 2024-09-11T00:17:55.684 INFO:tasks.workunit.client.0.smithi078.stdout:1/377: link d3/f1c d3/d29/f76 0 2024-09-11T00:17:55.684 INFO:tasks.workunit.client.0.smithi078.stdout:1/378: chown d3/d29/d5f/f8 1295389 1 2024-09-11T00:17:55.688 INFO:tasks.workunit.client.0.smithi078.stdout:4/365: rmdir dc/d10/d40/d3a/d46 39 2024-09-11T00:17:55.689 INFO:tasks.workunit.client.0.smithi078.stdout:1/379: truncate f2 1638697 0 2024-09-11T00:17:55.690 INFO:tasks.workunit.client.0.smithi078.stdout:1/380: fdatasync d3/d29/d45/f3a 0 2024-09-11T00:17:55.692 INFO:tasks.workunit.client.0.smithi078.stdout:2/320: write d0/d1/f1f [4121597,85662] 0 2024-09-11T00:17:55.692 INFO:tasks.workunit.client.0.smithi078.stdout:6/333: dread d0/d1/d1b/f6d [0,4194304] 0 2024-09-11T00:17:55.693 INFO:tasks.workunit.client.0.smithi078.stdout:3/267: dwrite d0/d1a/d1e/f3a [0,4194304] 0 2024-09-11T00:17:55.694 INFO:tasks.workunit.client.0.smithi078.stdout:1/381: creat d3/d29/d45/f77 x:0 0 0 2024-09-11T00:17:55.694 INFO:tasks.workunit.client.0.smithi078.stdout:1/382: fsync d3/d29/d5f/f18 0 2024-09-11T00:17:55.695 INFO:tasks.workunit.client.0.smithi078.stdout:2/321: creat d0/d31/d38/f6a x:0 0 0 2024-09-11T00:17:55.697 INFO:tasks.workunit.client.0.smithi078.stdout:6/334: link d0/d1/d9/d17/l25 d0/d1/d53/l7e 0 2024-09-11T00:17:55.697 INFO:tasks.workunit.client.0.smithi078.stdout:8/354: dwrite da/d1c/d60/f67 [0,4194304] 0 2024-09-11T00:17:55.700 INFO:tasks.workunit.client.0.smithi078.stdout:3/268: rename d0/f3 to d0/d1a/d1e/f54 0 2024-09-11T00:17:55.701 INFO:tasks.workunit.client.0.smithi078.stdout:3/269: mknod d0/d7/d18/d1b/d34/d3e/c55 0 2024-09-11T00:17:55.702 INFO:tasks.workunit.client.0.smithi078.stdout:2/322: rename d0/d1/d3c/c56 to d0/c6b 0 2024-09-11T00:17:55.704 INFO:tasks.workunit.client.0.smithi078.stdout:6/335: rename d0/f7c to d0/d66/f7f 0 2024-09-11T00:17:55.704 INFO:tasks.workunit.client.0.smithi078.stdout:2/323: creat d0/d1/d33/d5f/f6c x:0 0 0 2024-09-11T00:17:55.706 INFO:tasks.workunit.client.0.smithi078.stdout:8/355: rename da/d13/d28/l39 to da/d13/d19/l6f 0 2024-09-11T00:17:55.706 INFO:tasks.workunit.client.0.smithi078.stdout:8/356: chown da/d13/d1b/d59/f3d 8 1 2024-09-11T00:17:55.709 INFO:tasks.workunit.client.0.smithi078.stdout:2/324: creat d0/d1/d11/d1b/f6d x:0 0 0 2024-09-11T00:17:55.709 INFO:tasks.workunit.client.0.smithi078.stdout:4/366: dwrite dc/d10/d1f/f76 [0,4194304] 0 2024-09-11T00:17:55.709 INFO:tasks.workunit.client.0.smithi078.stdout:8/357: mknod da/d1c/d1e/c70 0 2024-09-11T00:17:55.710 INFO:tasks.workunit.client.0.smithi078.stdout:8/358: chown f7 493931 1 2024-09-11T00:17:55.710 INFO:tasks.workunit.client.0.smithi078.stdout:8/359: write da/f2f [1968435,71434] 0 2024-09-11T00:17:55.710 INFO:tasks.workunit.client.0.smithi078.stdout:6/336: symlink d0/l80 0 2024-09-11T00:17:55.710 INFO:tasks.workunit.client.0.smithi078.stdout:6/337: stat d0/d33/f37 0 2024-09-11T00:17:55.711 INFO:tasks.workunit.client.0.smithi078.stdout:2/325: link d0/d1/d3c/f45 d0/d1/d8/f6e 0 2024-09-11T00:17:55.716 INFO:tasks.workunit.client.0.smithi078.stdout:1/383: dwrite d3/d1a/d21/f2f [0,4194304] 0 2024-09-11T00:17:55.718 INFO:tasks.workunit.client.0.smithi078.stdout:6/338: creat d0/d1/d9/d59/f81 x:0 0 0 2024-09-11T00:17:55.718 INFO:tasks.workunit.client.0.smithi078.stdout:6/339: chown d0/l1e 0 1 2024-09-11T00:17:55.718 INFO:tasks.workunit.client.0.smithi078.stdout:6/340: write d0/d66/f7f [822403,109742] 0 2024-09-11T00:17:55.719 INFO:tasks.workunit.client.0.smithi078.stdout:2/326: mkdir d0/d1/d6f 0 2024-09-11T00:17:55.720 INFO:tasks.workunit.client.0.smithi078.stdout:1/384: dread d3/d29/d45/f60 [0,4194304] 0 2024-09-11T00:17:55.720 INFO:tasks.workunit.client.0.smithi078.stdout:2/327: dread d0/d1/d6/f39 [0,4194304] 0 2024-09-11T00:17:55.720 INFO:tasks.workunit.client.0.smithi078.stdout:4/367: rename cb to dc/d10/d40/d33/c7c 0 2024-09-11T00:17:55.723 INFO:tasks.workunit.client.0.smithi078.stdout:1/385: getdents d3/d29 0 2024-09-11T00:17:55.724 INFO:tasks.workunit.client.0.smithi078.stdout:2/328: symlink d0/d1/d3b/l70 0 2024-09-11T00:17:55.725 INFO:tasks.workunit.client.0.smithi078.stdout:4/368: creat dc/d10/d69/f7d x:0 0 0 2024-09-11T00:17:55.727 INFO:tasks.workunit.client.0.smithi078.stdout:1/386: link d3/d29/d5f/l62 d3/d1a/l78 0 2024-09-11T00:17:55.727 INFO:tasks.workunit.client.0.smithi078.stdout:8/360: dwrite da/d13/f50 [0,4194304] 0 2024-09-11T00:17:55.728 INFO:tasks.workunit.client.0.smithi078.stdout:4/369: symlink dc/d10/d69/d72/l7e 0 2024-09-11T00:17:55.729 INFO:tasks.workunit.client.0.smithi078.stdout:6/341: dread d0/d1/d1b/f21 [0,4194304] 0 2024-09-11T00:17:55.729 INFO:tasks.workunit.client.0.smithi078.stdout:6/342: write d0/d1/d9/d17/f58 [336649,27451] 0 2024-09-11T00:17:55.729 INFO:tasks.workunit.client.0.smithi078.stdout:1/387: getdents d3/d29/d5f/d4e 0 2024-09-11T00:17:55.730 INFO:tasks.workunit.client.0.smithi078.stdout:8/361: mknod da/d13/d1b/d59/d68/c71 0 2024-09-11T00:17:55.731 INFO:tasks.workunit.client.0.smithi078.stdout:8/362: symlink da/d13/d1b/d37/l72 0 2024-09-11T00:17:55.733 INFO:tasks.workunit.client.0.smithi078.stdout:1/388: dread d3/f40 [0,4194304] 0 2024-09-11T00:17:55.734 INFO:tasks.workunit.client.0.smithi078.stdout:1/389: readlink d3/d29/d5f/d39/l59 0 2024-09-11T00:17:55.734 INFO:tasks.workunit.client.0.smithi078.stdout:8/363: write da/d13/d1b/d59/f57 [734786,30878] 0 2024-09-11T00:17:55.734 INFO:tasks.workunit.client.0.smithi078.stdout:1/390: creat d3/d29/d5f/d39/d61/f79 x:0 0 0 2024-09-11T00:17:55.735 INFO:tasks.workunit.client.0.smithi078.stdout:8/364: getdents da/d13/d28/d3a 0 2024-09-11T00:17:55.735 INFO:tasks.workunit.client.0.smithi078.stdout:1/391: fsync d3/d1a/d21/d4a/f66 0 2024-09-11T00:17:55.737 INFO:tasks.workunit.client.0.smithi078.stdout:1/392: unlink d3/d1a/d21/f44 0 2024-09-11T00:17:55.738 INFO:tasks.workunit.client.0.smithi078.stdout:6/343: read d0/d1/d1b/f21 [3305196,104248] 0 2024-09-11T00:17:55.741 INFO:tasks.workunit.client.0.smithi078.stdout:1/393: symlink d3/l7a 0 2024-09-11T00:17:55.741 INFO:tasks.workunit.client.0.smithi078.stdout:1/394: chown d3/d29/f50 43959 1 2024-09-11T00:17:55.741 INFO:tasks.workunit.client.0.smithi078.stdout:1/395: write d3/d29/d5f/d39/f63 [293375,15573] 0 2024-09-11T00:17:55.741 INFO:tasks.workunit.client.0.smithi078.stdout:6/344: getdents d0/d1/d9/d54 0 2024-09-11T00:17:55.742 INFO:tasks.workunit.client.0.smithi078.stdout:8/365: dread da/f6e [0,4194304] 0 2024-09-11T00:17:55.742 INFO:tasks.workunit.client.0.smithi078.stdout:1/396: rename d3/d1a/d21/d4a/l67 to d3/d29/d5f/d39/l7b 0 2024-09-11T00:17:55.743 INFO:tasks.workunit.client.0.smithi078.stdout:8/366: rename da/d1c/d1e/c70 to da/d13/d1b/d4e/d66/c73 0 2024-09-11T00:17:55.743 INFO:tasks.workunit.client.0.smithi078.stdout:8/367: stat da/d13/d28 0 2024-09-11T00:17:55.744 INFO:tasks.workunit.client.0.smithi078.stdout:1/397: rename d3/d29/d5f/l15 to d3/l7c 0 2024-09-11T00:17:55.745 INFO:tasks.workunit.client.0.smithi078.stdout:1/398: write d3/d1a/d21/f4b [792380,56643] 0 2024-09-11T00:17:55.745 INFO:tasks.workunit.client.0.smithi078.stdout:8/368: symlink da/d1c/d1e/l74 0 2024-09-11T00:17:55.747 INFO:tasks.workunit.client.0.smithi078.stdout:1/399: symlink d3/d1a/d21/l7d 0 2024-09-11T00:17:55.749 INFO:tasks.workunit.client.0.smithi078.stdout:8/369: link c9 da/d1c/d4c/c75 0 2024-09-11T00:17:55.750 INFO:tasks.workunit.client.0.smithi078.stdout:8/370: dread da/d13/d1b/f4a [0,4194304] 0 2024-09-11T00:17:55.750 INFO:tasks.workunit.client.0.smithi078.stdout:1/400: link d3/d1a/d21/d4a/f65 d3/d29/f7e 0 2024-09-11T00:17:55.752 INFO:tasks.workunit.client.0.smithi078.stdout:1/401: creat d3/d1a/d21/d4a/f7f x:0 0 0 2024-09-11T00:17:55.753 INFO:tasks.workunit.client.0.smithi078.stdout:1/402: symlink d3/d29/l80 0 2024-09-11T00:17:55.755 INFO:tasks.workunit.client.0.smithi078.stdout:1/403: truncate d3/d29/d5f/d39/f6f 4048446 0 2024-09-11T00:17:55.757 INFO:tasks.workunit.client.0.smithi078.stdout:6/345: dwrite d0/d66/f7f [0,4194304] 0 2024-09-11T00:17:55.757 INFO:tasks.workunit.client.0.smithi078.stdout:0/280: sync 2024-09-11T00:17:55.757 INFO:tasks.workunit.client.0.smithi078.stdout:5/230: sync 2024-09-11T00:17:55.757 INFO:tasks.workunit.client.0.smithi078.stdout:5/231: fsync d7/f1f 0 2024-09-11T00:17:55.759 INFO:tasks.workunit.client.0.smithi078.stdout:0/281: symlink d2/l5d 0 2024-09-11T00:17:55.760 INFO:tasks.workunit.client.0.smithi078.stdout:5/232: mknod d7/d8/d33/d22/d25/d28/c5a 0 2024-09-11T00:17:55.767 INFO:tasks.workunit.client.0.smithi078.stdout:6/346: read d0/d33/f37 [3739391,14174] 0 2024-09-11T00:17:55.768 INFO:tasks.workunit.client.0.smithi078.stdout:8/371: dwrite da/d13/d1b/f3c [0,4194304] 0 2024-09-11T00:17:55.769 INFO:tasks.workunit.client.0.smithi078.stdout:6/347: mknod d0/d1/d9/d54/c82 0 2024-09-11T00:17:55.778 INFO:tasks.workunit.client.0.smithi078.stdout:1/404: dwrite d3/d1a/d21/d4a/f7f [0,4194304] 0 2024-09-11T00:17:55.779 INFO:tasks.workunit.client.0.smithi078.stdout:8/372: dread da/d13/d1b/f23 [0,4194304] 0 2024-09-11T00:17:55.779 INFO:tasks.workunit.client.0.smithi078.stdout:8/373: chown da/l20 130631 1 2024-09-11T00:17:55.779 INFO:tasks.workunit.client.0.smithi078.stdout:1/405: creat d3/f81 x:0 0 0 2024-09-11T00:17:55.780 INFO:tasks.workunit.client.0.smithi078.stdout:1/406: creat d3/d1a/f82 x:0 0 0 2024-09-11T00:17:55.780 INFO:tasks.workunit.client.0.smithi078.stdout:1/407: write d3/f40 [2271990,17285] 0 2024-09-11T00:17:55.780 INFO:tasks.workunit.client.0.smithi078.stdout:1/408: write d3/d29/f5d [5356591,67638] 0 2024-09-11T00:17:55.780 INFO:tasks.workunit.client.0.smithi078.stdout:1/409: truncate d3/d29/f2e 453446 0 2024-09-11T00:17:55.781 INFO:tasks.workunit.client.0.smithi078.stdout:1/410: symlink d3/d29/d45/l83 0 2024-09-11T00:17:55.782 INFO:tasks.workunit.client.0.smithi078.stdout:1/411: mknod d3/d1a/d21/c84 0 2024-09-11T00:17:55.784 INFO:tasks.workunit.client.0.smithi078.stdout:1/412: dread d3/d1a/d21/f2c [0,4194304] 0 2024-09-11T00:17:55.785 INFO:tasks.workunit.client.0.smithi078.stdout:0/282: dwrite d2/d2a/d2c/d35/d59/f47 [0,4194304] 0 2024-09-11T00:17:55.787 INFO:tasks.workunit.client.0.smithi078.stdout:0/283: mkdir d2/d2a/d2c/d5e 0 2024-09-11T00:17:55.788 INFO:tasks.workunit.client.0.smithi078.stdout:5/233: dwrite d7/d8/d33/d22/d25/f45 [0,4194304] 0 2024-09-11T00:17:55.788 INFO:tasks.workunit.client.0.smithi078.stdout:0/284: creat d2/d2a/d2c/d42/d23/f5f x:0 0 0 2024-09-11T00:17:55.788 INFO:tasks.workunit.client.0.smithi078.stdout:6/348: dwrite d0/d1/d9/d59/d74/f67 [0,4194304] 0 2024-09-11T00:17:55.789 INFO:tasks.workunit.client.0.smithi078.stdout:6/349: readlink d0/d1/d9/d54/l55 0 2024-09-11T00:17:55.789 INFO:tasks.workunit.client.0.smithi078.stdout:5/234: truncate d7/d8/de/ff 6469782 0 2024-09-11T00:17:55.790 INFO:tasks.workunit.client.0.smithi078.stdout:0/285: write d2/d2a/d2c/d35/f46 [937299,127150] 0 2024-09-11T00:17:55.792 INFO:tasks.workunit.client.0.smithi078.stdout:6/350: getdents d0/d1/d9 0 2024-09-11T00:17:55.792 INFO:tasks.workunit.client.0.smithi078.stdout:6/351: chown d0/d1/d9/d59 173286 1 2024-09-11T00:17:55.793 INFO:tasks.workunit.client.0.smithi078.stdout:5/235: mkdir d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d5b 0 2024-09-11T00:17:55.795 INFO:tasks.workunit.client.0.smithi078.stdout:1/413: dread d3/d29/d45/f3f [0,4194304] 0 2024-09-11T00:17:55.797 INFO:tasks.workunit.client.0.smithi078.stdout:1/414: getdents d3/d29/d5f/d39 0 2024-09-11T00:17:55.797 INFO:tasks.workunit.client.0.smithi078.stdout:1/415: fdatasync d3/f40 0 2024-09-11T00:17:55.797 INFO:tasks.workunit.client.0.smithi078.stdout:1/416: chown d3/d29/d5f/d39/f63 3 1 2024-09-11T00:17:55.799 INFO:tasks.workunit.client.0.smithi078.stdout:0/286: write d2/d2a/d2c/d35/d59/d7/f2b [8253391,1826] 0 2024-09-11T00:17:55.802 INFO:tasks.workunit.client.0.smithi078.stdout:0/287: creat d2/d2a/d2c/d42/d23/d56/f60 x:0 0 0 2024-09-11T00:17:55.810 INFO:tasks.workunit.client.0.smithi078.stdout:5/236: dread d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f20 [0,4194304] 0 2024-09-11T00:17:55.811 INFO:tasks.workunit.client.0.smithi078.stdout:5/237: symlink d7/d8/de/l5c 0 2024-09-11T00:17:55.812 INFO:tasks.workunit.client.0.smithi078.stdout:1/417: dwrite d3/d1a/f2d [0,4194304] 0 2024-09-11T00:17:55.812 INFO:tasks.workunit.client.0.smithi078.stdout:5/238: creat d7/d8/d56/f5d x:0 0 0 2024-09-11T00:17:55.816 INFO:tasks.workunit.client.0.smithi078.stdout:5/239: rename d7/d8/de/f21 to d7/d8/d33/d22/d25/f5e 0 2024-09-11T00:17:55.817 INFO:tasks.workunit.client.0.smithi078.stdout:5/240: creat d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f5f x:0 0 0 2024-09-11T00:17:55.818 INFO:tasks.workunit.client.0.smithi078.stdout:1/418: dread d3/d29/d5f/f8 [0,4194304] 0 2024-09-11T00:17:55.819 INFO:tasks.workunit.client.0.smithi078.stdout:5/241: symlink d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d5b/l60 0 2024-09-11T00:17:55.824 INFO:tasks.workunit.client.0.smithi078.stdout:1/419: dread d3/d29/f34 [0,4194304] 0 2024-09-11T00:17:55.826 INFO:tasks.workunit.client.0.smithi078.stdout:1/420: truncate d3/f9 1893558 0 2024-09-11T00:17:55.831 INFO:tasks.workunit.client.0.smithi078.stdout:5/242: dwrite d7/d8/d33/d22/d25/d28/d24/f50 [0,4194304] 0 2024-09-11T00:17:55.833 INFO:tasks.workunit.client.0.smithi078.stdout:5/243: mknod d7/d8/d56/c61 0 2024-09-11T00:17:55.843 INFO:tasks.workunit.client.0.smithi078.stdout:7/317: sync 2024-09-11T00:17:55.844 INFO:tasks.workunit.client.0.smithi078.stdout:9/261: sync 2024-09-11T00:17:55.844 INFO:tasks.workunit.client.0.smithi078.stdout:7/318: stat d0/d34/l1f 0 2024-09-11T00:17:55.844 INFO:tasks.workunit.client.0.smithi078.stdout:9/262: readlink dc/d12/d20/d30/l41 0 2024-09-11T00:17:55.844 INFO:tasks.workunit.client.0.smithi078.stdout:7/319: fdatasync d0/d34/f24 0 2024-09-11T00:17:55.844 INFO:tasks.workunit.client.0.smithi078.stdout:1/421: dwrite d3/d29/d5f/f25 [0,4194304] 0 2024-09-11T00:17:55.846 INFO:tasks.workunit.client.0.smithi078.stdout:9/263: creat dc/d12/d54/f57 x:0 0 0 2024-09-11T00:17:55.847 INFO:tasks.workunit.client.0.smithi078.stdout:1/422: mkdir d3/d1a/d21/d4a/d85 0 2024-09-11T00:17:55.854 INFO:tasks.workunit.client.0.smithi078.stdout:5/244: dwrite d7/d8/d33/d22/d25/d28/d24/f44 [0,4194304] 0 2024-09-11T00:17:55.854 INFO:tasks.workunit.client.0.smithi078.stdout:5/245: write d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f20 [1565352,53205] 0 2024-09-11T00:17:55.854 INFO:tasks.workunit.client.0.smithi078.stdout:5/246: write d7/d8/d33/d22/d25/f5e [237653,101384] 0 2024-09-11T00:17:55.854 INFO:tasks.workunit.client.0.smithi078.stdout:5/247: dread - d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f5f zero size 2024-09-11T00:17:55.855 INFO:tasks.workunit.client.0.smithi078.stdout:5/248: read d7/d8/d33/d22/d25/f5e [150047,64539] 0 2024-09-11T00:17:55.855 INFO:tasks.workunit.client.0.smithi078.stdout:5/249: dread - d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f5f zero size 2024-09-11T00:17:55.855 INFO:tasks.workunit.client.0.smithi078.stdout:9/264: dread dc/d12/d20/f32 [0,4194304] 0 2024-09-11T00:17:55.855 INFO:tasks.workunit.client.0.smithi078.stdout:9/265: write f4 [3178718,17030] 0 2024-09-11T00:17:55.856 INFO:tasks.workunit.client.0.smithi078.stdout:1/423: read d3/d29/d5f/d39/f6f [1596639,79258] 0 2024-09-11T00:17:55.857 INFO:tasks.workunit.client.0.smithi078.stdout:7/320: dwrite d0/d34/db/f15 [0,4194304] 0 2024-09-11T00:17:55.857 INFO:tasks.workunit.client.0.smithi078.stdout:9/266: rename dc/d12/d44 to dc/d12/d20/d58 0 2024-09-11T00:17:55.858 INFO:tasks.workunit.client.0.smithi078.stdout:9/267: rename dc/l25 to dc/d12/d54/l59 0 2024-09-11T00:17:55.859 INFO:tasks.workunit.client.0.smithi078.stdout:9/268: mkdir dc/d12/d20/d58/d5a 0 2024-09-11T00:17:55.862 INFO:tasks.workunit.client.0.smithi078.stdout:9/269: dread f2 [0,4194304] 0 2024-09-11T00:17:55.864 INFO:tasks.workunit.client.0.smithi078.stdout:7/321: truncate d0/d34/db/f15 393684 0 2024-09-11T00:17:55.869 INFO:tasks.workunit.client.0.smithi078.stdout:9/270: dread fb [0,4194304] 0 2024-09-11T00:17:55.869 INFO:tasks.workunit.client.0.smithi078.stdout:9/271: truncate dc/d12/d24/d3e/f42 1647255 0 2024-09-11T00:17:55.870 INFO:tasks.workunit.client.0.smithi078.stdout:9/272: mkdir dc/d12/d20/d58/d5b 0 2024-09-11T00:17:55.870 INFO:tasks.workunit.client.0.smithi078.stdout:9/273: write dc/d12/d24/f3b [202891,123499] 0 2024-09-11T00:17:55.871 INFO:tasks.workunit.client.0.smithi078.stdout:9/274: mknod dc/d12/d20/d58/d5b/c5c 0 2024-09-11T00:17:55.871 INFO:tasks.workunit.client.0.smithi078.stdout:9/275: readlink dc/d12/d20/d30/l41 0 2024-09-11T00:17:55.872 INFO:tasks.workunit.client.0.smithi078.stdout:9/276: truncate f2 2462873 0 2024-09-11T00:17:55.873 INFO:tasks.workunit.client.0.smithi078.stdout:9/277: mknod dc/d12/d35/c5d 0 2024-09-11T00:17:55.873 INFO:tasks.workunit.client.0.smithi078.stdout:9/278: write dc/f1e [3742935,124019] 0 2024-09-11T00:17:55.873 INFO:tasks.workunit.client.0.smithi078.stdout:9/279: read - dc/d12/d20/f4f zero size 2024-09-11T00:17:55.873 INFO:tasks.workunit.client.0.smithi078.stdout:5/250: dwrite d7/d8/d33/d22/d25/d28/d24/f4d [0,4194304] 0 2024-09-11T00:17:55.873 INFO:tasks.workunit.client.0.smithi078.stdout:5/251: chown d7/d8/d33/d22/d25/f4b 5525 1 2024-09-11T00:17:55.873 INFO:tasks.workunit.client.0.smithi078.stdout:9/280: getdents dc/d12/d46 0 2024-09-11T00:17:55.874 INFO:tasks.workunit.client.0.smithi078.stdout:9/281: chown dc/d12/d20/d30/l41 506147178 1 2024-09-11T00:17:55.875 INFO:tasks.workunit.client.0.smithi078.stdout:5/252: truncate d7/d8/d33/d22/d25/d28/d24/d1c/f2e 3592944 0 2024-09-11T00:17:55.876 INFO:tasks.workunit.client.0.smithi078.stdout:9/282: symlink dc/d12/d20/l5e 0 2024-09-11T00:17:55.878 INFO:tasks.workunit.client.0.smithi078.stdout:7/322: read d0/d34/db/d30/d1d/f2c [3776526,60063] 0 2024-09-11T00:17:55.878 INFO:tasks.workunit.client.0.smithi078.stdout:7/323: chown d0/d34/c26 690 1 2024-09-11T00:17:55.878 INFO:tasks.workunit.client.0.smithi078.stdout:1/424: dwrite d3/d29/f5d [0,4194304] 0 2024-09-11T00:17:55.878 INFO:tasks.workunit.client.0.smithi078.stdout:9/283: link dc/c55 dc/d12/d20/d30/c5f 0 2024-09-11T00:17:55.878 INFO:tasks.workunit.client.0.smithi078.stdout:9/284: write dc/d12/d24/f3b [915427,75121] 0 2024-09-11T00:17:55.889 INFO:tasks.workunit.client.0.smithi078.stdout:9/285: dread f7 [4194304,4194304] 0 2024-09-11T00:17:55.889 INFO:tasks.workunit.client.0.smithi078.stdout:9/286: stat dc/d12/d20/d50 0 2024-09-11T00:17:55.889 INFO:tasks.workunit.client.0.smithi078.stdout:9/287: chown dc/ld 224 1 2024-09-11T00:17:55.890 INFO:tasks.workunit.client.0.smithi078.stdout:9/288: creat dc/d12/d24/d3e/f60 x:0 0 0 2024-09-11T00:17:55.891 INFO:tasks.workunit.client.0.smithi078.stdout:9/289: creat dc/d12/d20/f61 x:0 0 0 2024-09-11T00:17:55.892 INFO:tasks.workunit.client.0.smithi078.stdout:9/290: symlink dc/d12/d46/d51/l62 0 2024-09-11T00:17:55.892 INFO:tasks.workunit.client.0.smithi078.stdout:9/291: mknod dc/d12/d35/c63 0 2024-09-11T00:17:55.894 INFO:tasks.workunit.client.0.smithi078.stdout:9/292: creat dc/d12/f64 x:0 0 0 2024-09-11T00:17:55.894 INFO:tasks.workunit.client.0.smithi078.stdout:7/324: dwrite d0/d34/db/d30/f3e [0,4194304] 0 2024-09-11T00:17:55.897 INFO:tasks.workunit.client.0.smithi078.stdout:7/325: mknod d0/d3f/c5f 0 2024-09-11T00:17:55.911 INFO:tasks.workunit.client.0.smithi078.stdout:9/293: dwrite dc/f38 [0,4194304] 0 2024-09-11T00:17:55.911 INFO:tasks.workunit.client.0.smithi078.stdout:9/294: dread - dc/d12/f64 zero size 2024-09-11T00:17:55.913 INFO:tasks.workunit.client.0.smithi078.stdout:7/326: dwrite d0/d34/db/d30/d1d/f2c [0,4194304] 0 2024-09-11T00:17:55.914 INFO:tasks.workunit.client.0.smithi078.stdout:7/327: unlink d0/d3f/c5f 0 2024-09-11T00:17:55.915 INFO:tasks.workunit.client.0.smithi078.stdout:7/328: getdents d0/d34/db/d30/d1d 0 2024-09-11T00:17:55.915 INFO:tasks.workunit.client.0.smithi078.stdout:7/329: truncate d0/f43 2821603 0 2024-09-11T00:17:55.916 INFO:tasks.workunit.client.0.smithi078.stdout:7/330: creat d0/d3f/f60 x:0 0 0 2024-09-11T00:17:55.916 INFO:tasks.workunit.client.0.smithi078.stdout:7/331: write d0/d34/db/d30/d1d/f39 [584584,85888] 0 2024-09-11T00:17:55.917 INFO:tasks.workunit.client.0.smithi078.stdout:7/332: creat d0/d34/db/d30/d28/f61 x:0 0 0 2024-09-11T00:17:55.918 INFO:tasks.workunit.client.0.smithi078.stdout:7/333: mkdir d0/d34/db/d30/d1d/d14/d62 0 2024-09-11T00:17:55.924 INFO:tasks.workunit.client.0.smithi078.stdout:7/334: write d0/d34/db/d32/f3a [1537770,85802] 0 2024-09-11T00:17:55.925 INFO:tasks.workunit.client.0.smithi078.stdout:7/335: creat d0/f63 x:0 0 0 2024-09-11T00:17:55.928 INFO:tasks.workunit.client.0.smithi078.stdout:7/336: truncate d0/d34/db/d32/f3a 372969 0 2024-09-11T00:17:55.949 INFO:tasks.workunit.client.0.smithi078.stdout:3/270: sync 2024-09-11T00:17:55.949 INFO:tasks.workunit.client.0.smithi078.stdout:2/329: sync 2024-09-11T00:17:55.949 INFO:tasks.workunit.client.0.smithi078.stdout:2/330: fdatasync d0/fc 0 2024-09-11T00:17:55.950 INFO:tasks.workunit.client.0.smithi078.stdout:3/271: rmdir d0/d1a 39 2024-09-11T00:17:55.950 INFO:tasks.workunit.client.0.smithi078.stdout:2/331: truncate d0/d1/d3c/f45 2264977 0 2024-09-11T00:17:55.952 INFO:tasks.workunit.client.0.smithi078.stdout:3/272: creat d0/d7/d18/d1b/f56 x:0 0 0 2024-09-11T00:17:55.953 INFO:tasks.workunit.client.0.smithi078.stdout:2/332: rename d0/d1/d3c/f5a to d0/d1/d11/f71 0 2024-09-11T00:17:55.953 INFO:tasks.workunit.client.0.smithi078.stdout:2/333: chown d0/d1/f27 397008 1 2024-09-11T00:17:55.954 INFO:tasks.workunit.client.0.smithi078.stdout:2/334: symlink d0/d19/l72 0 2024-09-11T00:17:55.956 INFO:tasks.workunit.client.0.smithi078.stdout:3/273: dread d0/f36 [0,4194304] 0 2024-09-11T00:17:55.956 INFO:tasks.workunit.client.0.smithi078.stdout:3/274: write d0/d7/d18/d1b/d27/f32 [1729042,75922] 0 2024-09-11T00:17:55.958 INFO:tasks.workunit.client.0.smithi078.stdout:3/275: dread d0/d7/d18/d1b/d27/f28 [0,4194304] 0 2024-09-11T00:17:55.959 INFO:tasks.workunit.client.0.smithi078.stdout:3/276: creat d0/d39/f57 x:0 0 0 2024-09-11T00:17:55.960 INFO:tasks.workunit.client.0.smithi078.stdout:3/277: symlink d0/d7/d18/l58 0 2024-09-11T00:17:55.961 INFO:tasks.workunit.client.0.smithi078.stdout:3/278: creat d0/d7/d18/d1b/d27/f59 x:0 0 0 2024-09-11T00:17:55.961 INFO:tasks.workunit.client.0.smithi078.stdout:3/279: symlink d0/d7/d23/l5a 0 2024-09-11T00:17:55.964 INFO:tasks.workunit.client.0.smithi078.stdout:2/335: write d0/d1/d53/f65 [1333749,103914] 0 2024-09-11T00:17:55.966 INFO:tasks.workunit.client.0.smithi078.stdout:2/336: creat d0/d1/d33/d5f/f73 x:0 0 0 2024-09-11T00:17:55.966 INFO:tasks.workunit.client.0.smithi078.stdout:2/337: getdents d0/d1/d3c 0 2024-09-11T00:17:55.967 INFO:tasks.workunit.client.0.smithi078.stdout:2/338: truncate d0/d1/d8/f29 239147 0 2024-09-11T00:17:55.967 INFO:tasks.workunit.client.0.smithi078.stdout:2/339: stat d0/c10 0 2024-09-11T00:17:55.967 INFO:tasks.workunit.client.0.smithi078.stdout:2/340: chown d0/c25 1 1 2024-09-11T00:17:55.968 INFO:tasks.workunit.client.0.smithi078.stdout:2/341: truncate d0/d19/f2c 198032 0 2024-09-11T00:17:55.968 INFO:tasks.workunit.client.0.smithi078.stdout:2/342: chown d0/d1/d53 59 1 2024-09-11T00:17:55.969 INFO:tasks.workunit.client.0.smithi078.stdout:3/280: dread d0/f1f [0,4194304] 0 2024-09-11T00:17:55.970 INFO:tasks.workunit.client.0.smithi078.stdout:2/343: mknod d0/d1/c74 0 2024-09-11T00:17:55.970 INFO:tasks.workunit.client.0.smithi078.stdout:2/344: creat d0/d67/f75 x:0 0 0 2024-09-11T00:17:55.972 INFO:tasks.workunit.client.0.smithi078.stdout:2/345: symlink d0/d1/d11/d1b/l76 0 2024-09-11T00:17:55.972 INFO:tasks.workunit.client.0.smithi078.stdout:2/346: write d0/d1/d33/d5f/f6c [728307,99273] 0 2024-09-11T00:17:55.974 INFO:tasks.workunit.client.0.smithi078.stdout:3/281: dread d0/d7/d18/f40 [0,4194304] 0 2024-09-11T00:17:55.976 INFO:tasks.workunit.client.0.smithi078.stdout:3/282: creat d0/d7/d46/f5b x:0 0 0 2024-09-11T00:17:55.976 INFO:tasks.workunit.client.0.smithi078.stdout:3/283: write d0/d7/f4e [358041,60211] 0 2024-09-11T00:17:55.976 INFO:tasks.workunit.client.0.smithi078.stdout:2/347: dread d0/d1/d8/f29 [0,4194304] 0 2024-09-11T00:17:55.976 INFO:tasks.workunit.client.0.smithi078.stdout:2/348: fdatasync d0/d1/d11/d1b/f6d 0 2024-09-11T00:17:55.976 INFO:tasks.workunit.client.0.smithi078.stdout:2/349: write d0/d1/f1f [2682767,56936] 0 2024-09-11T00:17:55.976 INFO:tasks.workunit.client.0.smithi078.stdout:3/284: mknod d0/d39/c5c 0 2024-09-11T00:17:55.985 INFO:tasks.workunit.client.0.smithi078.stdout:3/285: dread d0/d7/d18/d1b/d34/f49 [0,4194304] 0 2024-09-11T00:17:55.994 INFO:tasks.workunit.client.0.smithi078.stdout:3/286: dread d0/d7/d18/d1b/d27/f32 [0,4194304] 0 2024-09-11T00:17:55.994 INFO:tasks.workunit.client.0.smithi078.stdout:3/287: fdatasync d0/d7/f4e 0 2024-09-11T00:17:55.994 INFO:tasks.workunit.client.0.smithi078.stdout:3/288: rmdir d0/d7/d18/d1b/d27 39 2024-09-11T00:17:55.994 INFO:tasks.workunit.client.0.smithi078.stdout:3/289: truncate d0/d7/d18/f4c 661771 0 2024-09-11T00:17:55.995 INFO:tasks.workunit.client.0.smithi078.stdout:3/290: write d0/d39/f57 [774023,92017] 0 2024-09-11T00:17:55.995 INFO:tasks.workunit.client.0.smithi078.stdout:3/291: truncate d0/f2 2502862 0 2024-09-11T00:17:55.997 INFO:tasks.workunit.client.0.smithi078.stdout:3/292: creat d0/d7/d18/d1b/d34/d3e/f5d x:0 0 0 2024-09-11T00:17:55.998 INFO:tasks.workunit.client.0.smithi078.stdout:3/293: creat d0/d7/d46/f5e x:0 0 0 2024-09-11T00:17:55.998 INFO:tasks.workunit.client.0.smithi078.stdout:3/294: read - d0/d7/d46/f5b zero size 2024-09-11T00:17:55.998 INFO:tasks.workunit.client.0.smithi078.stdout:3/295: truncate d0/d7/d18/d1b/f38 3986054 0 2024-09-11T00:17:55.998 INFO:tasks.workunit.client.0.smithi078.stdout:3/296: fsync d0/f36 0 2024-09-11T00:17:55.999 INFO:tasks.workunit.client.0.smithi078.stdout:3/297: chown d0/d7/d18/f4c 178745 1 2024-09-11T00:17:56.020 INFO:tasks.workunit.client.0.smithi078.stdout:3/298: dwrite d0/f8 [0,4194304] 0 2024-09-11T00:17:56.020 INFO:tasks.workunit.client.0.smithi078.stdout:3/299: chown d0/d7/d18/d1b/d34/d3e/l4a 2620595 1 2024-09-11T00:17:56.022 INFO:tasks.workunit.client.0.smithi078.stdout:3/300: unlink d0/d7/d18/d1b/d34/d3e/l3f 0 2024-09-11T00:17:56.022 INFO:tasks.workunit.client.0.smithi078.stdout:3/301: stat d0/d39/c5c 0 2024-09-11T00:17:56.023 INFO:tasks.workunit.client.0.smithi078.stdout:3/302: creat d0/d7/d18/d1b/d34/d3e/f5f x:0 0 0 2024-09-11T00:17:56.023 INFO:tasks.workunit.client.0.smithi078.stdout:3/303: read d0/d7/d23/f2d [949591,59092] 0 2024-09-11T00:17:56.023 INFO:tasks.workunit.client.0.smithi078.stdout:3/304: mkdir d0/d7/d18/d1b/d34/d60 0 2024-09-11T00:17:56.029 INFO:tasks.workunit.client.0.smithi078.stdout:3/305: dread d0/d7/d18/d1b/f38 [0,4194304] 0 2024-09-11T00:17:56.029 INFO:tasks.workunit.client.0.smithi078.stdout:3/306: chown d0/d1a/d1e/c2f 57239 1 2024-09-11T00:17:56.032 INFO:tasks.workunit.client.0.smithi078.stdout:3/307: dread d0/d7/d18/f40 [0,4194304] 0 2024-09-11T00:17:56.033 INFO:tasks.workunit.client.0.smithi078.stdout:3/308: creat d0/d7/d18/f61 x:0 0 0 2024-09-11T00:17:56.042 INFO:tasks.workunit.client.0.smithi078.stdout:3/309: dread d0/d7/d18/d1b/d27/f32 [0,4194304] 0 2024-09-11T00:17:56.043 INFO:tasks.workunit.client.0.smithi078.stdout:3/310: creat d0/f62 x:0 0 0 2024-09-11T00:17:56.043 INFO:tasks.workunit.client.0.smithi078.stdout:3/311: chown d0/d7/d23/c2b 220 1 2024-09-11T00:17:56.043 INFO:tasks.workunit.client.0.smithi078.stdout:3/312: chown d0/d7/d23/l2a 5046 1 2024-09-11T00:17:56.044 INFO:tasks.workunit.client.0.smithi078.stdout:3/313: creat d0/d7/d18/d1b/d34/f63 x:0 0 0 2024-09-11T00:17:56.047 INFO:tasks.workunit.client.0.smithi078.stdout:3/314: creat d0/d1a/d1e/f64 x:0 0 0 2024-09-11T00:17:56.047 INFO:tasks.workunit.client.0.smithi078.stdout:3/315: readlink d0/d7/d18/d1b/d34/d3e/l4a 0 2024-09-11T00:17:56.047 INFO:tasks.workunit.client.0.smithi078.stdout:3/316: fsync d0/d7/d18/d1b/f56 0 2024-09-11T00:17:56.047 INFO:tasks.workunit.client.0.smithi078.stdout:3/317: dread - d0/d1a/d1e/f64 zero size 2024-09-11T00:17:56.048 INFO:tasks.workunit.client.0.smithi078.stdout:3/318: creat d0/f65 x:0 0 0 2024-09-11T00:17:56.070 INFO:tasks.workunit.client.0.smithi078.stdout:8/374: sync 2024-09-11T00:17:56.070 INFO:tasks.workunit.client.0.smithi078.stdout:4/370: sync 2024-09-11T00:17:56.070 INFO:tasks.workunit.client.0.smithi078.stdout:8/375: truncate da/d13/f2c 313693 0 2024-09-11T00:17:56.070 INFO:tasks.workunit.client.0.smithi078.stdout:8/376: rmdir da/d13/d28 39 2024-09-11T00:17:56.070 INFO:tasks.workunit.client.0.smithi078.stdout:8/377: fdatasync da/d13/d1b/d24/d62/f69 0 2024-09-11T00:17:56.071 INFO:tasks.workunit.client.0.smithi078.stdout:4/371: symlink dc/l7f 0 2024-09-11T00:17:56.073 INFO:tasks.workunit.client.0.smithi078.stdout:8/378: link l8 da/d13/d1b/d59/l76 0 2024-09-11T00:17:56.075 INFO:tasks.workunit.client.0.smithi078.stdout:4/372: unlink dc/d10/d40/d3a/d3b/c52 0 2024-09-11T00:17:56.076 INFO:tasks.workunit.client.0.smithi078.stdout:4/373: chown dc/d10/d40/d3a/d3b/d5d/l60 6681396 1 2024-09-11T00:17:56.076 INFO:tasks.workunit.client.0.smithi078.stdout:8/379: truncate da/f6e 1459400 0 2024-09-11T00:17:56.077 INFO:tasks.workunit.client.0.smithi078.stdout:4/374: creat dc/d10/d3c/f80 x:0 0 0 2024-09-11T00:17:56.079 INFO:tasks.workunit.client.0.smithi078.stdout:4/375: creat dc/d10/d40/d33/f81 x:0 0 0 2024-09-11T00:17:56.079 INFO:tasks.workunit.client.0.smithi078.stdout:4/376: truncate dc/d10/d69/d72/f79 61600 0 2024-09-11T00:17:56.079 INFO:tasks.workunit.client.0.smithi078.stdout:4/377: dread - dc/f2d zero size 2024-09-11T00:17:56.079 INFO:tasks.workunit.client.0.smithi078.stdout:4/378: fdatasync f3 0 2024-09-11T00:17:56.079 INFO:tasks.workunit.client.0.smithi078.stdout:4/379: write dc/d10/d3c/f67 [153213,29478] 0 2024-09-11T00:17:56.079 INFO:tasks.workunit.client.0.smithi078.stdout:4/380: dread - dc/d10/d40/d3a/d65/f51 zero size 2024-09-11T00:17:56.093 INFO:tasks.workunit.client.0.smithi078.stdout:8/380: dwrite da/f30 [0,4194304] 0 2024-09-11T00:17:56.095 INFO:tasks.workunit.client.0.smithi078.stdout:8/381: getdents da/d13/d28/d5f 0 2024-09-11T00:17:56.096 INFO:tasks.workunit.client.0.smithi078.stdout:8/382: getdents da/d13/d1b/d53/d63 0 2024-09-11T00:17:56.096 INFO:tasks.workunit.client.0.smithi078.stdout:8/383: getdents da/d13/d28/d5f 0 2024-09-11T00:17:56.107 INFO:tasks.workunit.client.0.smithi078.stdout:8/384: dwrite da/d13/d28/d3a/f40 [0,4194304] 0 2024-09-11T00:17:56.107 INFO:tasks.workunit.client.0.smithi078.stdout:8/385: readlink da/d13/d1b/d37/l72 0 2024-09-11T00:17:56.107 INFO:tasks.workunit.client.0.smithi078.stdout:8/386: chown da/l51 1 1 2024-09-11T00:17:56.109 INFO:tasks.workunit.client.0.smithi078.stdout:8/387: mknod da/d13/d19/c77 0 2024-09-11T00:17:56.114 INFO:tasks.workunit.client.0.smithi078.stdout:8/388: write da/d13/d1b/d24/f27 [3379576,29475] 0 2024-09-11T00:17:56.128 INFO:tasks.workunit.client.0.smithi078.stdout:8/389: dwrite da/f2a [4194304,4194304] 0 2024-09-11T00:17:56.129 INFO:tasks.workunit.client.0.smithi078.stdout:8/390: readlink da/d13/d1b/d24/l4f 0 2024-09-11T00:17:56.172 INFO:tasks.workunit.client.0.smithi078.stdout:6/352: sync 2024-09-11T00:17:56.172 INFO:tasks.workunit.client.0.smithi078.stdout:6/353: chown d0/d1/d9/d59/d74 106609 1 2024-09-11T00:17:56.172 INFO:tasks.workunit.client.0.smithi078.stdout:6/354: truncate d0/d1/d9/f16 3049408 0 2024-09-11T00:17:56.173 INFO:tasks.workunit.client.0.smithi078.stdout:6/355: mkdir d0/d1/d9/d54/d83 0 2024-09-11T00:17:56.185 INFO:tasks.workunit.client.0.smithi078.stdout:6/356: dread d0/d66/f7f [0,4194304] 0 2024-09-11T00:17:56.185 INFO:tasks.workunit.client.0.smithi078.stdout:6/357: mknod d0/d33/c84 0 2024-09-11T00:17:56.186 INFO:tasks.workunit.client.0.smithi078.stdout:6/358: creat d0/d1/d9/d17/d5e/f85 x:0 0 0 2024-09-11T00:17:56.187 INFO:tasks.workunit.client.0.smithi078.stdout:6/359: chown d0/d33/f37 74 1 2024-09-11T00:17:56.187 INFO:tasks.workunit.client.0.smithi078.stdout:6/360: stat d0/d33/c5d 0 2024-09-11T00:17:56.187 INFO:tasks.workunit.client.0.smithi078.stdout:6/361: write d0/d1/d9/d17/d5e/f77 [335263,30763] 0 2024-09-11T00:17:56.187 INFO:tasks.workunit.client.0.smithi078.stdout:6/362: write d0/d1/f71 [909500,109295] 0 2024-09-11T00:17:56.187 INFO:tasks.workunit.client.0.smithi078.stdout:6/363: creat d0/d1/d9/d59/d74/f86 x:0 0 0 2024-09-11T00:17:56.190 INFO:tasks.workunit.client.0.smithi078.stdout:6/364: getdents d0/d1/d9/d17/d5e 0 2024-09-11T00:17:56.192 INFO:tasks.workunit.client.0.smithi078.stdout:6/365: unlink d0/d1/f2 0 2024-09-11T00:17:56.207 INFO:tasks.workunit.client.0.smithi078.stdout:6/366: dwrite d0/d66/f7f [0,4194304] 0 2024-09-11T00:17:56.215 INFO:tasks.workunit.client.0.smithi078.stdout:6/367: read d0/f76 [1485500,55353] 0 2024-09-11T00:17:56.215 INFO:tasks.workunit.client.0.smithi078.stdout:6/368: fsync d0/f3b 0 2024-09-11T00:17:56.215 INFO:tasks.workunit.client.0.smithi078.stdout:6/369: fsync d0/d1/d9/d59/f64 0 2024-09-11T00:17:56.215 INFO:tasks.workunit.client.0.smithi078.stdout:6/370: dread - d0/d1/d1b/f45 zero size 2024-09-11T00:17:56.215 INFO:tasks.workunit.client.0.smithi078.stdout:6/371: chown d0/d1/f75 3245 1 2024-09-11T00:17:56.230 INFO:tasks.workunit.client.0.smithi078.stdout:6/372: dwrite d0/f7a [0,4194304] 0 2024-09-11T00:17:56.230 INFO:tasks.workunit.client.0.smithi078.stdout:6/373: chown d0/d33/c57 2590785 1 2024-09-11T00:17:56.230 INFO:tasks.workunit.client.0.smithi078.stdout:6/374: truncate d0/f5a 845747 0 2024-09-11T00:17:56.246 INFO:tasks.workunit.client.0.smithi078.stdout:6/375: mknod d0/d1/d9/d59/c87 0 2024-09-11T00:17:56.246 INFO:tasks.workunit.client.0.smithi078.stdout:6/376: stat d0/d1/f32 0 2024-09-11T00:17:56.251 INFO:tasks.workunit.client.0.smithi078.stdout:6/377: creat d0/d1/d53/f88 x:0 0 0 2024-09-11T00:17:56.254 INFO:tasks.workunit.client.0.smithi078.stdout:6/378: symlink d0/l89 0 2024-09-11T00:17:56.255 INFO:tasks.workunit.client.0.smithi078.stdout:6/379: mknod d0/d1/d53/d72/c8a 0 2024-09-11T00:17:56.257 INFO:tasks.workunit.client.0.smithi078.stdout:6/380: unlink d0/f3c 0 2024-09-11T00:17:56.270 INFO:tasks.workunit.client.0.smithi078.stdout:0/288: sync 2024-09-11T00:17:56.270 INFO:tasks.workunit.client.0.smithi078.stdout:9/295: sync 2024-09-11T00:17:56.270 INFO:tasks.workunit.client.0.smithi078.stdout:1/425: sync 2024-09-11T00:17:56.271 INFO:tasks.workunit.client.0.smithi078.stdout:5/253: sync 2024-09-11T00:17:56.271 INFO:tasks.workunit.client.0.smithi078.stdout:5/254: write d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f20 [561722,64738] 0 2024-09-11T00:17:56.272 INFO:tasks.workunit.client.0.smithi078.stdout:9/296: creat dc/f65 x:0 0 0 2024-09-11T00:17:56.272 INFO:tasks.workunit.client.0.smithi078.stdout:9/297: readlink dc/l1a 0 2024-09-11T00:17:56.273 INFO:tasks.workunit.client.0.smithi078.stdout:1/426: getdents d3/d29/d5f/d39/d61 0 2024-09-11T00:17:56.273 INFO:tasks.workunit.client.0.smithi078.stdout:1/427: stat d3/d29/d5f/d39/c41 0 2024-09-11T00:17:56.273 INFO:tasks.workunit.client.0.smithi078.stdout:1/428: fsync d3/f81 0 2024-09-11T00:17:56.273 INFO:tasks.workunit.client.0.smithi078.stdout:0/289: dread d2/d2a/d2c/d35/d59/f22 [0,4194304] 0 2024-09-11T00:17:56.273 INFO:tasks.workunit.client.0.smithi078.stdout:1/429: write d3/d29/f50 [132304,124253] 0 2024-09-11T00:17:56.274 INFO:tasks.workunit.client.0.smithi078.stdout:5/255: mkdir d7/d8/de/d2c/d62 0 2024-09-11T00:17:56.274 INFO:tasks.workunit.client.0.smithi078.stdout:5/256: fsync d7/d8/de/f10 0 2024-09-11T00:17:56.276 INFO:tasks.workunit.client.0.smithi078.stdout:9/298: rename dc/d12/d20/f56 to dc/d12/d35/f66 0 2024-09-11T00:17:56.276 INFO:tasks.workunit.client.0.smithi078.stdout:9/299: fsync dc/f29 0 2024-09-11T00:17:56.278 INFO:tasks.workunit.client.0.smithi078.stdout:1/430: creat d3/d29/d5f/d4e/f86 x:0 0 0 2024-09-11T00:17:56.280 INFO:tasks.workunit.client.0.smithi078.stdout:5/257: rmdir d7/d8/d33/d22/d25/d28/d24/d1c/d1e 39 2024-09-11T00:17:56.281 INFO:tasks.workunit.client.0.smithi078.stdout:2/350: sync 2024-09-11T00:17:56.281 INFO:tasks.workunit.client.0.smithi078.stdout:7/337: sync 2024-09-11T00:17:56.281 INFO:tasks.workunit.client.0.smithi078.stdout:7/338: readlink d0/d34/db/d30/l5b 0 2024-09-11T00:17:56.283 INFO:tasks.workunit.client.0.smithi078.stdout:9/300: write dc/d12/d20/d30/f3d [2851325,108450] 0 2024-09-11T00:17:56.283 INFO:tasks.workunit.client.0.smithi078.stdout:9/301: dread - dc/d12/d24/f47 zero size 2024-09-11T00:17:56.283 INFO:tasks.workunit.client.0.smithi078.stdout:9/302: readlink dc/d12/d20/l2e 0 2024-09-11T00:17:56.283 INFO:tasks.workunit.client.0.smithi078.stdout:5/258: creat d7/d8/de/d2c/f63 x:0 0 0 2024-09-11T00:17:56.283 INFO:tasks.workunit.client.0.smithi078.stdout:5/259: chown d7/d8/d33/d22/d25/d28/d24/ca 387648781 1 2024-09-11T00:17:56.284 INFO:tasks.workunit.client.0.smithi078.stdout:2/351: rmdir d0/d1/d33 39 2024-09-11T00:17:56.284 INFO:tasks.workunit.client.0.smithi078.stdout:2/352: write d0/d1/d33/d5f/f6c [820293,72393] 0 2024-09-11T00:17:56.286 INFO:tasks.workunit.client.0.smithi078.stdout:7/339: link d0/d34/db/d30/d1d/l2d d0/d34/db/d30/d1d/d14/d62/l64 0 2024-09-11T00:17:56.287 INFO:tasks.workunit.client.0.smithi078.stdout:1/431: mknod d3/d1a/d21/d4a/c87 0 2024-09-11T00:17:56.291 INFO:tasks.workunit.client.0.smithi078.stdout:9/303: creat dc/d12/d35/f67 x:0 0 0 2024-09-11T00:17:56.292 INFO:tasks.workunit.client.0.smithi078.stdout:5/260: symlink d7/l64 0 2024-09-11T00:17:56.292 INFO:tasks.workunit.client.0.smithi078.stdout:6/381: read d0/f3b [3206400,45073] 0 2024-09-11T00:17:56.292 INFO:tasks.workunit.client.0.smithi078.stdout:6/382: dread - d0/d1/d9/d59/f81 zero size 2024-09-11T00:17:56.294 INFO:tasks.workunit.client.0.smithi078.stdout:7/340: dread d0/d34/db/d30/d1d/f17 [0,4194304] 0 2024-09-11T00:17:56.294 INFO:tasks.workunit.client.0.smithi078.stdout:7/341: dread - d0/d34/db/d30/d1d/d14/f5d zero size 2024-09-11T00:17:56.294 INFO:tasks.workunit.client.0.smithi078.stdout:7/342: dread - d0/d3f/f60 zero size 2024-09-11T00:17:56.294 INFO:tasks.workunit.client.0.smithi078.stdout:7/343: truncate d0/d34/db/f5a 156224 0 2024-09-11T00:17:56.294 INFO:tasks.workunit.client.0.smithi078.stdout:7/344: readlink d0/d34/db/l21 0 2024-09-11T00:17:56.294 INFO:tasks.workunit.client.0.smithi078.stdout:7/345: chown d0/d34/db/d30/d1d/f17 28736 1 2024-09-11T00:17:56.294 INFO:tasks.workunit.client.0.smithi078.stdout:7/346: readlink d0/d3f/l37 0 2024-09-11T00:17:56.294 INFO:tasks.workunit.client.0.smithi078.stdout:7/347: dread - d0/d34/db/f5c zero size 2024-09-11T00:17:56.295 INFO:tasks.workunit.client.0.smithi078.stdout:5/261: rename d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d5b/l60 to d7/d8/de/d2c/l65 0 2024-09-11T00:17:56.295 INFO:tasks.workunit.client.0.smithi078.stdout:4/381: sync 2024-09-11T00:17:56.295 INFO:tasks.workunit.client.0.smithi078.stdout:8/391: sync 2024-09-11T00:17:56.295 INFO:tasks.workunit.client.0.smithi078.stdout:4/382: readlink dc/l4e 0 2024-09-11T00:17:56.295 INFO:tasks.workunit.client.0.smithi078.stdout:8/392: readlink da/d13/d1b/l42 0 2024-09-11T00:17:56.295 INFO:tasks.workunit.client.0.smithi078.stdout:8/393: fsync da/fe 0 2024-09-11T00:17:56.295 INFO:tasks.workunit.client.0.smithi078.stdout:8/394: fdatasync da/fe 0 2024-09-11T00:17:56.295 INFO:tasks.workunit.client.0.smithi078.stdout:3/319: sync 2024-09-11T00:17:56.295 INFO:tasks.workunit.client.0.smithi078.stdout:0/290: dwrite d2/d2a/d2c/d35/d59/d7/f40 [4194304,4194304] 0 2024-09-11T00:17:56.297 INFO:tasks.workunit.client.0.smithi078.stdout:7/348: unlink d0/d34/c46 0 2024-09-11T00:17:56.297 INFO:tasks.workunit.client.0.smithi078.stdout:7/349: truncate d0/d34/db/d30/d1d/f13 5178059 0 2024-09-11T00:17:56.297 INFO:tasks.workunit.client.0.smithi078.stdout:7/350: fdatasync d0/d34/db/d30/d1d/f2c 0 2024-09-11T00:17:56.297 INFO:tasks.workunit.client.0.smithi078.stdout:5/262: readlink d7/d8/l42 0 2024-09-11T00:17:56.300 INFO:tasks.workunit.client.0.smithi078.stdout:8/395: unlink da/f6e 0 2024-09-11T00:17:56.301 INFO:tasks.workunit.client.0.smithi078.stdout:3/320: creat d0/d7/d46/f66 x:0 0 0 2024-09-11T00:17:56.303 INFO:tasks.workunit.client.0.smithi078.stdout:0/291: getdents d2/d2a/d2c/d35/d59/d7 0 2024-09-11T00:17:56.307 INFO:tasks.workunit.client.0.smithi078.stdout:7/351: mkdir d0/d34/d65 0 2024-09-11T00:17:56.307 INFO:tasks.workunit.client.0.smithi078.stdout:7/352: stat d0/d34/db/d30/d1d/c4d 0 2024-09-11T00:17:56.307 INFO:tasks.workunit.client.0.smithi078.stdout:7/353: chown d0/d34/l1f 7103 1 2024-09-11T00:17:56.312 INFO:tasks.workunit.client.0.smithi078.stdout:7/354: unlink d0/d34/db/f15 0 2024-09-11T00:17:56.313 INFO:tasks.workunit.client.0.smithi078.stdout:8/396: dread da/d13/f50 [0,4194304] 0 2024-09-11T00:17:56.314 INFO:tasks.workunit.client.0.smithi078.stdout:8/397: write da/d13/d1b/f34 [1560546,17715] 0 2024-09-11T00:17:56.314 INFO:tasks.workunit.client.0.smithi078.stdout:5/263: mkdir d7/d8/d47/d66 0 2024-09-11T00:17:56.314 INFO:tasks.workunit.client.0.smithi078.stdout:5/264: stat d7/d8/de/d2c/f63 0 2024-09-11T00:17:56.315 INFO:tasks.workunit.client.0.smithi078.stdout:7/355: rename d0/d34/db/d30/d1d/c4d to d0/d34/db/d32/c66 0 2024-09-11T00:17:56.316 INFO:tasks.workunit.client.0.smithi078.stdout:4/383: dwrite dc/f25 [0,4194304] 0 2024-09-11T00:17:56.318 INFO:tasks.workunit.client.0.smithi078.stdout:8/398: creat da/d1c/f78 x:0 0 0 2024-09-11T00:17:56.318 INFO:tasks.workunit.client.0.smithi078.stdout:8/399: fsync da/d13/d1b/f4a 0 2024-09-11T00:17:56.318 INFO:tasks.workunit.client.0.smithi078.stdout:8/400: readlink da/d13/d19/l6f 0 2024-09-11T00:17:56.319 INFO:tasks.workunit.client.0.smithi078.stdout:5/265: mknod d7/d8/d33/d22/d25/c67 0 2024-09-11T00:17:56.319 INFO:tasks.workunit.client.0.smithi078.stdout:5/266: chown d7/d8/de/f10 8771520 1 2024-09-11T00:17:56.319 INFO:tasks.workunit.client.0.smithi078.stdout:7/356: write d0/d34/db/f51 [743344,125432] 0 2024-09-11T00:17:56.319 INFO:tasks.workunit.client.0.smithi078.stdout:2/353: dwrite d0/d1/d8/f1d [0,4194304] 0 2024-09-11T00:17:56.319 INFO:tasks.workunit.client.0.smithi078.stdout:2/354: read - d0/d1/d8/f47 zero size 2024-09-11T00:17:56.321 INFO:tasks.workunit.client.0.smithi078.stdout:1/432: dwrite d3/f17 [4194304,4194304] 0 2024-09-11T00:17:56.321 INFO:tasks.workunit.client.0.smithi078.stdout:1/433: stat d3/d1a/d21/f2c 0 2024-09-11T00:17:56.323 INFO:tasks.workunit.client.0.smithi078.stdout:4/384: mknod dc/d10/d1f/c82 0 2024-09-11T00:17:56.323 INFO:tasks.workunit.client.0.smithi078.stdout:2/355: dread d0/d1/d3b/f4e [0,4194304] 0 2024-09-11T00:17:56.323 INFO:tasks.workunit.client.0.smithi078.stdout:2/356: chown d0/d1/d6/f16 407586934 1 2024-09-11T00:17:56.324 INFO:tasks.workunit.client.0.smithi078.stdout:9/304: dwrite dc/d12/d35/f66 [0,4194304] 0 2024-09-11T00:17:56.324 INFO:tasks.workunit.client.0.smithi078.stdout:3/321: write d0/f8 [939115,100197] 0 2024-09-11T00:17:56.324 INFO:tasks.workunit.client.0.smithi078.stdout:9/305: write f2 [2928741,23120] 0 2024-09-11T00:17:56.324 INFO:tasks.workunit.client.0.smithi078.stdout:8/401: truncate da/d13/d1b/f2e 771730 0 2024-09-11T00:17:56.324 INFO:tasks.workunit.client.0.smithi078.stdout:8/402: fdatasync da/d13/d28/d3a/f40 0 2024-09-11T00:17:56.325 INFO:tasks.workunit.client.0.smithi078.stdout:7/357: creat d0/d34/db/d30/d28/f67 x:0 0 0 2024-09-11T00:17:56.326 INFO:tasks.workunit.client.0.smithi078.stdout:1/434: rmdir d3/d1a 39 2024-09-11T00:17:56.326 INFO:tasks.workunit.client.0.smithi078.stdout:1/435: getdents d3/d29/d5f/d39 0 2024-09-11T00:17:56.326 INFO:tasks.workunit.client.0.smithi078.stdout:0/292: dwrite d2/d2a/d2c/d35/d59/d7/f40 [0,4194304] 0 2024-09-11T00:17:56.328 INFO:tasks.workunit.client.0.smithi078.stdout:4/385: mkdir dc/d83 0 2024-09-11T00:17:56.328 INFO:tasks.workunit.client.0.smithi078.stdout:4/386: fdatasync dc/d10/d40/d3a/d4c/f41 0 2024-09-11T00:17:56.329 INFO:tasks.workunit.client.0.smithi078.stdout:2/357: link d0/d1/d6/d52/c59 d0/d1/d11/c77 0 2024-09-11T00:17:56.330 INFO:tasks.workunit.client.0.smithi078.stdout:6/383: dwrite d0/d1/f2f [4194304,4194304] 0 2024-09-11T00:17:56.330 INFO:tasks.workunit.client.0.smithi078.stdout:6/384: write d0/f76 [3633128,13655] 0 2024-09-11T00:17:56.332 INFO:tasks.workunit.client.0.smithi078.stdout:3/322: getdents d0/d7/d18/d1b/d34 0 2024-09-11T00:17:56.333 INFO:tasks.workunit.client.0.smithi078.stdout:6/385: dread d0/d1/f71 [0,4194304] 0 2024-09-11T00:17:56.334 INFO:tasks.workunit.client.0.smithi078.stdout:8/403: getdents da/d13/d28/d3a/d4b 0 2024-09-11T00:17:56.336 INFO:tasks.workunit.client.0.smithi078.stdout:7/358: mknod d0/d34/db/d32/c68 0 2024-09-11T00:17:56.336 INFO:tasks.workunit.client.0.smithi078.stdout:7/359: write d0/d34/db/d30/d1d/f59 [953090,123291] 0 2024-09-11T00:17:56.337 INFO:tasks.workunit.client.0.smithi078.stdout:4/387: creat dc/d10/d40/d33/f84 x:0 0 0 2024-09-11T00:17:56.337 INFO:tasks.workunit.client.0.smithi078.stdout:4/388: write dc/d10/d40/d33/f84 [767586,97845] 0 2024-09-11T00:17:56.337 INFO:tasks.workunit.client.0.smithi078.stdout:4/389: dread - dc/d10/d3c/f80 zero size 2024-09-11T00:17:56.337 INFO:tasks.workunit.client.0.smithi078.stdout:4/390: chown dc/d10/d1f/f5b 3224080 1 2024-09-11T00:17:56.338 INFO:tasks.workunit.client.0.smithi078.stdout:4/391: read dc/d10/d1f/f35 [3780411,52632] 0 2024-09-11T00:17:56.338 INFO:tasks.workunit.client.0.smithi078.stdout:2/358: symlink d0/l78 0 2024-09-11T00:17:56.341 INFO:tasks.workunit.client.0.smithi078.stdout:3/323: mknod d0/d7/d18/d1b/d34/d3e/c67 0 2024-09-11T00:17:56.343 INFO:tasks.workunit.client.0.smithi078.stdout:6/386: creat d0/d33/f8b x:0 0 0 2024-09-11T00:17:56.343 INFO:tasks.workunit.client.0.smithi078.stdout:6/387: chown d0/d1/d9/d17/d5e/l69 11533 1 2024-09-11T00:17:56.344 INFO:tasks.workunit.client.0.smithi078.stdout:8/404: mkdir da/d13/d1b/d4e/d66/d79 0 2024-09-11T00:17:56.344 INFO:tasks.workunit.client.0.smithi078.stdout:8/405: truncate da/d13/d1b/f4a 2252065 0 2024-09-11T00:17:56.344 INFO:tasks.workunit.client.0.smithi078.stdout:5/267: dwrite d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f59 [0,4194304] 0 2024-09-11T00:17:56.347 INFO:tasks.workunit.client.0.smithi078.stdout:4/392: mknod dc/d10/d1f/c85 0 2024-09-11T00:17:56.347 INFO:tasks.workunit.client.0.smithi078.stdout:9/306: dread dc/f2c [0,4194304] 0 2024-09-11T00:17:56.347 INFO:tasks.workunit.client.0.smithi078.stdout:9/307: write dc/f2c [4280988,73227] 0 2024-09-11T00:17:56.348 INFO:tasks.workunit.client.0.smithi078.stdout:3/324: symlink d0/d7/d18/d1b/l68 0 2024-09-11T00:17:56.354 INFO:tasks.workunit.client.0.smithi078.stdout:5/268: rename d7/l64 to d7/l68 0 2024-09-11T00:17:56.354 INFO:tasks.workunit.client.0.smithi078.stdout:8/406: read da/d13/d1b/f23 [2243828,75411] 0 2024-09-11T00:17:56.354 INFO:tasks.workunit.client.0.smithi078.stdout:4/393: link dc/fd dc/d10/f86 0 2024-09-11T00:17:56.354 INFO:tasks.workunit.client.0.smithi078.stdout:9/308: dread dc/d12/d24/f3b [0,4194304] 0 2024-09-11T00:17:56.354 INFO:tasks.workunit.client.0.smithi078.stdout:9/309: write dc/d12/d54/f57 [499432,36484] 0 2024-09-11T00:17:56.354 INFO:tasks.workunit.client.0.smithi078.stdout:9/310: read f4 [1897988,33379] 0 2024-09-11T00:17:56.354 INFO:tasks.workunit.client.0.smithi078.stdout:9/311: fdatasync dc/d12/d46/d51/f53 0 2024-09-11T00:17:56.354 INFO:tasks.workunit.client.0.smithi078.stdout:5/269: creat d7/d8/de/f69 x:0 0 0 2024-09-11T00:17:56.355 INFO:tasks.workunit.client.0.smithi078.stdout:8/407: mkdir da/d7a 0 2024-09-11T00:17:56.355 INFO:tasks.workunit.client.0.smithi078.stdout:5/270: mkdir d7/d8/d33/d22/d25/d6a 0 2024-09-11T00:17:56.355 INFO:tasks.workunit.client.0.smithi078.stdout:0/293: dwrite d2/f2d [0,4194304] 0 2024-09-11T00:17:56.355 INFO:tasks.workunit.client.0.smithi078.stdout:4/394: dread dc/d10/d1f/f5b [0,4194304] 0 2024-09-11T00:17:56.356 INFO:tasks.workunit.client.0.smithi078.stdout:2/359: dwrite d0/d1/d11/f69 [0,4194304] 0 2024-09-11T00:17:56.356 INFO:tasks.workunit.client.0.smithi078.stdout:8/408: mkdir da/d13/d28/d7b 0 2024-09-11T00:17:56.357 INFO:tasks.workunit.client.0.smithi078.stdout:8/409: read da/d13/d1b/f23 [1539383,16447] 0 2024-09-11T00:17:56.358 INFO:tasks.workunit.client.0.smithi078.stdout:5/271: unlink d7/d8/d33/d22/d25/f4b 0 2024-09-11T00:17:56.358 INFO:tasks.workunit.client.0.smithi078.stdout:5/272: dread - d7/d8/d56/f5d zero size 2024-09-11T00:17:56.358 INFO:tasks.workunit.client.0.smithi078.stdout:0/294: mkdir d2/d2a/d2c/d35/d59/d4f/d61 0 2024-09-11T00:17:56.359 INFO:tasks.workunit.client.0.smithi078.stdout:4/395: mknod dc/d83/c87 0 2024-09-11T00:17:56.361 INFO:tasks.workunit.client.0.smithi078.stdout:7/360: getdents d0/d34/db/d30/d28 0 2024-09-11T00:17:56.364 INFO:tasks.workunit.client.0.smithi078.stdout:5/273: rename d7/f1f to d7/d8/d33/d22/d25/d6a/f6b 0 2024-09-11T00:17:56.365 INFO:tasks.workunit.client.0.smithi078.stdout:0/295: symlink d2/d2a/d2c/d35/d59/l62 0 2024-09-11T00:17:56.366 INFO:tasks.workunit.client.0.smithi078.stdout:8/410: dread f7 [0,4194304] 0 2024-09-11T00:17:56.366 INFO:tasks.workunit.client.0.smithi078.stdout:8/411: write da/fc [4502843,94283] 0 2024-09-11T00:17:56.366 INFO:tasks.workunit.client.0.smithi078.stdout:7/361: link d0/d34/db/d30/d28/l49 d0/d34/db/l69 0 2024-09-11T00:17:56.367 INFO:tasks.workunit.client.0.smithi078.stdout:8/412: creat da/d1c/f7c x:0 0 0 2024-09-11T00:17:56.367 INFO:tasks.workunit.client.0.smithi078.stdout:8/413: chown f7 793563 1 2024-09-11T00:17:56.368 INFO:tasks.workunit.client.0.smithi078.stdout:4/396: read dc/d10/d40/d3a/d4c/f41 [3776610,95890] 0 2024-09-11T00:17:56.368 INFO:tasks.workunit.client.0.smithi078.stdout:4/397: stat dc/d10/d1f/f76 0 2024-09-11T00:17:56.368 INFO:tasks.workunit.client.0.smithi078.stdout:4/398: write dc/d10/d1f/f35 [3445696,9682] 0 2024-09-11T00:17:56.369 INFO:tasks.workunit.client.0.smithi078.stdout:7/362: creat d0/d34/db/d30/d28/f6a x:0 0 0 2024-09-11T00:17:56.369 INFO:tasks.workunit.client.0.smithi078.stdout:0/296: write d2/d2a/d2c/d35/d59/f22 [1321444,99806] 0 2024-09-11T00:17:56.369 INFO:tasks.workunit.client.0.smithi078.stdout:0/297: stat d2/d2a/d2c/d35/d59/l62 0 2024-09-11T00:17:56.370 INFO:tasks.workunit.client.0.smithi078.stdout:8/414: unlink da/d13/d1b/f34 0 2024-09-11T00:17:56.370 INFO:tasks.workunit.client.0.smithi078.stdout:9/312: dwrite dc/f38 [0,4194304] 0 2024-09-11T00:17:56.371 INFO:tasks.workunit.client.0.smithi078.stdout:4/399: symlink dc/d10/d40/d3a/d46/l88 0 2024-09-11T00:17:56.371 INFO:tasks.workunit.client.0.smithi078.stdout:4/400: fdatasync dc/d10/d40/d3a/d65/f34 0 2024-09-11T00:17:56.374 INFO:tasks.workunit.client.0.smithi078.stdout:7/363: rename d0/d34/db/d32/c5e to d0/d34/db/d30/d1d/c6b 0 2024-09-11T00:17:56.375 INFO:tasks.workunit.client.0.smithi078.stdout:3/325: getdents d0/d7/d18/d1b/d34/d3e 0 2024-09-11T00:17:56.375 INFO:tasks.workunit.client.0.smithi078.stdout:1/436: dwrite d3/d29/d45/f52 [0,4194304] 0 2024-09-11T00:17:56.376 INFO:tasks.workunit.client.0.smithi078.stdout:0/298: creat d2/d2a/d2c/d42/f63 x:0 0 0 2024-09-11T00:17:56.378 INFO:tasks.workunit.client.0.smithi078.stdout:6/388: dwrite d0/d1/d9/f5c [0,4194304] 0 2024-09-11T00:17:56.378 INFO:tasks.workunit.client.0.smithi078.stdout:6/389: write d0/d1/d9/d59/d74/f86 [1017623,125053] 0 2024-09-11T00:17:56.378 INFO:tasks.workunit.client.0.smithi078.stdout:9/313: mkdir dc/d12/d20/d58/d5b/d68 0 2024-09-11T00:17:56.379 INFO:tasks.workunit.client.0.smithi078.stdout:3/326: mknod d0/d7/d18/d1b/d34/d60/c69 0 2024-09-11T00:17:56.381 INFO:tasks.workunit.client.0.smithi078.stdout:7/364: symlink d0/d34/db/d30/d1d/d14/d62/l6c 0 2024-09-11T00:17:56.381 INFO:tasks.workunit.client.0.smithi078.stdout:7/365: fdatasync d0/d34/f24 0 2024-09-11T00:17:56.381 INFO:tasks.workunit.client.0.smithi078.stdout:7/366: chown d0/d34/db/d30/d1d/f2c 0 1 2024-09-11T00:17:56.382 INFO:tasks.workunit.client.0.smithi078.stdout:2/360: dwrite d0/d1/d8/f21 [4194304,4194304] 0 2024-09-11T00:17:56.382 INFO:tasks.workunit.client.0.smithi078.stdout:1/437: mkdir d3/d1a/d21/d88 0 2024-09-11T00:17:56.386 INFO:tasks.workunit.client.0.smithi078.stdout:6/390: mkdir d0/d33/d8c 0 2024-09-11T00:17:56.387 INFO:tasks.workunit.client.0.smithi078.stdout:7/367: write d0/d34/db/d30/d1d/d14/f2a [351193,99223] 0 2024-09-11T00:17:56.388 INFO:tasks.workunit.client.0.smithi078.stdout:9/314: symlink dc/d12/d35/l69 0 2024-09-11T00:17:56.390 INFO:tasks.workunit.client.0.smithi078.stdout:3/327: creat d0/d7/d23/f6a x:0 0 0 2024-09-11T00:17:56.391 INFO:tasks.workunit.client.0.smithi078.stdout:7/368: mkdir d0/d34/d6d 0 2024-09-11T00:17:56.391 INFO:tasks.workunit.client.0.smithi078.stdout:7/369: read d0/d34/db/f47 [1015075,31706] 0 2024-09-11T00:17:56.393 INFO:tasks.workunit.client.0.smithi078.stdout:9/315: fsync dc/d12/d20/d30/f3d 0 2024-09-11T00:17:56.395 INFO:tasks.workunit.client.0.smithi078.stdout:7/370: rename d0/d34/db/d30/l5b to d0/d34/db/d30/d1d/d14/d62/l6e 0 2024-09-11T00:17:56.395 INFO:tasks.workunit.client.0.smithi078.stdout:8/415: dwrite da/fe [4194304,4194304] 0 2024-09-11T00:17:56.397 INFO:tasks.workunit.client.0.smithi078.stdout:5/274: dwrite d7/d8/de/f4a [0,4194304] 0 2024-09-11T00:17:56.398 INFO:tasks.workunit.client.0.smithi078.stdout:5/275: stat d7/d8 0 2024-09-11T00:17:56.398 INFO:tasks.workunit.client.0.smithi078.stdout:5/276: write d7/d8/de/f69 [724904,34361] 0 2024-09-11T00:17:56.402 INFO:tasks.workunit.client.0.smithi078.stdout:8/416: mkdir da/d13/d1b/d7d 0 2024-09-11T00:17:56.402 INFO:tasks.workunit.client.0.smithi078.stdout:8/417: readlink da/d13/d1b/d24/l4f 0 2024-09-11T00:17:56.405 INFO:tasks.workunit.client.0.smithi078.stdout:1/438: read d3/d1a/d21/f2f [2425378,100260] 0 2024-09-11T00:17:56.405 INFO:tasks.workunit.client.0.smithi078.stdout:1/439: stat d3/d29/f7e 0 2024-09-11T00:17:56.409 INFO:tasks.workunit.client.0.smithi078.stdout:6/391: dread d0/f3b [0,4194304] 0 2024-09-11T00:17:56.412 INFO:tasks.workunit.client.0.smithi078.stdout:5/277: truncate d7/d8/d33/d22/d51/f58 667713 0 2024-09-11T00:17:56.414 INFO:tasks.workunit.client.0.smithi078.stdout:8/418: creat da/d13/d1b/d37/f7e x:0 0 0 2024-09-11T00:17:56.414 INFO:tasks.workunit.client.0.smithi078.stdout:8/419: write da/d1c/f78 [714667,92297] 0 2024-09-11T00:17:56.416 INFO:tasks.workunit.client.0.smithi078.stdout:2/361: dwrite d0/d1/d33/f4d [0,4194304] 0 2024-09-11T00:17:56.416 INFO:tasks.workunit.client.0.smithi078.stdout:5/278: dread d7/d8/d33/d22/d25/f5e [0,4194304] 0 2024-09-11T00:17:56.416 INFO:tasks.workunit.client.0.smithi078.stdout:5/279: stat d7/d8/de/c40 0 2024-09-11T00:17:56.417 INFO:tasks.workunit.client.0.smithi078.stdout:1/440: creat d3/d29/d5f/d4e/f89 x:0 0 0 2024-09-11T00:17:56.417 INFO:tasks.workunit.client.0.smithi078.stdout:1/441: dread - d3/d1a/f6b zero size 2024-09-11T00:17:56.418 INFO:tasks.workunit.client.0.smithi078.stdout:8/420: mknod da/d13/d1b/d4e/d66/d79/c7f 0 2024-09-11T00:17:56.420 INFO:tasks.workunit.client.0.smithi078.stdout:0/299: dwrite d2/d2a/d2c/d35/d59/d7/f40 [4194304,4194304] 0 2024-09-11T00:17:56.424 INFO:tasks.workunit.client.0.smithi078.stdout:1/442: dread d3/d1a/f2d [0,4194304] 0 2024-09-11T00:17:56.426 INFO:tasks.workunit.client.0.smithi078.stdout:0/300: creat d2/d2a/d2c/d35/d59/f64 x:0 0 0 2024-09-11T00:17:56.427 INFO:tasks.workunit.client.0.smithi078.stdout:1/443: dread d3/d29/d5f/f18 [0,4194304] 0 2024-09-11T00:17:56.427 INFO:tasks.workunit.client.0.smithi078.stdout:1/444: write d3/d29/f50 [1547847,114901] 0 2024-09-11T00:17:56.429 INFO:tasks.workunit.client.0.smithi078.stdout:9/316: dwrite dc/f65 [0,4194304] 0 2024-09-11T00:17:56.430 INFO:tasks.workunit.client.0.smithi078.stdout:7/371: dwrite d0/d34/db/f47 [0,4194304] 0 2024-09-11T00:17:56.430 INFO:tasks.workunit.client.0.smithi078.stdout:7/372: rename d0/d34 to d0/d34/db/d30/d1d/d14/d6f 22 2024-09-11T00:17:56.430 INFO:tasks.workunit.client.0.smithi078.stdout:4/401: dwrite dc/d10/d3c/f67 [0,4194304] 0 2024-09-11T00:17:56.431 INFO:tasks.workunit.client.0.smithi078.stdout:7/373: dread d0/f36 [0,4194304] 0 2024-09-11T00:17:56.433 INFO:tasks.workunit.client.0.smithi078.stdout:4/402: dread dc/d10/d40/d3a/d3b/f3e [0,4194304] 0 2024-09-11T00:17:56.434 INFO:tasks.workunit.client.0.smithi078.stdout:1/445: unlink d3/d29/d5f/l62 0 2024-09-11T00:17:56.435 INFO:tasks.workunit.client.0.smithi078.stdout:1/446: dread d3/d29/d5f/f18 [0,4194304] 0 2024-09-11T00:17:56.435 INFO:tasks.workunit.client.0.smithi078.stdout:7/374: dread d0/d34/db/f51 [0,4194304] 0 2024-09-11T00:17:56.436 INFO:tasks.workunit.client.0.smithi078.stdout:9/317: symlink dc/d12/d20/d58/d5a/l6a 0 2024-09-11T00:17:56.437 INFO:tasks.workunit.client.0.smithi078.stdout:2/362: dwrite d0/d1/d3b/f4e [0,4194304] 0 2024-09-11T00:17:56.437 INFO:tasks.workunit.client.0.smithi078.stdout:6/392: dwrite d0/d1/f32 [4194304,4194304] 0 2024-09-11T00:17:56.437 INFO:tasks.workunit.client.0.smithi078.stdout:6/393: chown d0/d1/d9/d54/d83 25061 1 2024-09-11T00:17:56.437 INFO:tasks.workunit.client.0.smithi078.stdout:7/375: dread d0/f36 [0,4194304] 0 2024-09-11T00:17:56.437 INFO:tasks.workunit.client.0.smithi078.stdout:7/376: write d0/d34/db/d32/f3a [959153,77988] 0 2024-09-11T00:17:56.437 INFO:tasks.workunit.client.0.smithi078.stdout:0/301: dread d2/d2a/d2c/d42/f1a [0,4194304] 0 2024-09-11T00:17:56.437 INFO:tasks.workunit.client.0.smithi078.stdout:8/421: dwrite da/d13/d19/f35 [0,4194304] 0 2024-09-11T00:17:56.438 INFO:tasks.workunit.client.0.smithi078.stdout:8/422: fsync da/d13/d1b/d24/f27 0 2024-09-11T00:17:56.441 INFO:tasks.workunit.client.0.smithi078.stdout:4/403: link fa dc/d10/d40/d3a/d46/f89 0 2024-09-11T00:17:56.441 INFO:tasks.workunit.client.0.smithi078.stdout:4/404: dread - dc/d10/f3d zero size 2024-09-11T00:17:56.441 INFO:tasks.workunit.client.0.smithi078.stdout:4/405: write dc/ff [3531127,13696] 0 2024-09-11T00:17:56.442 INFO:tasks.workunit.client.0.smithi078.stdout:1/447: stat d3/l55 0 2024-09-11T00:17:56.442 INFO:tasks.workunit.client.0.smithi078.stdout:2/363: symlink d0/d19/d3d/l79 0 2024-09-11T00:17:56.444 INFO:tasks.workunit.client.0.smithi078.stdout:6/394: mkdir d0/d1/d9/d8d 0 2024-09-11T00:17:56.444 INFO:tasks.workunit.client.0.smithi078.stdout:6/395: readlink d0/l26 0 2024-09-11T00:17:56.444 INFO:tasks.workunit.client.0.smithi078.stdout:6/396: truncate d0/d33/f37 4634478 0 2024-09-11T00:17:56.444 INFO:tasks.workunit.client.0.smithi078.stdout:6/397: read d0/d33/f37 [74275,86168] 0 2024-09-11T00:17:56.446 INFO:tasks.workunit.client.0.smithi078.stdout:0/302: dread d2/d2a/d2c/d35/d59/d7/f40 [0,4194304] 0 2024-09-11T00:17:56.446 INFO:tasks.workunit.client.0.smithi078.stdout:8/423: rename da/d13/d28/d5f/c64 to da/d13/d28/d3a/d4b/c80 0 2024-09-11T00:17:56.449 INFO:tasks.workunit.client.0.smithi078.stdout:5/280: truncate d7/d8/d33/d22/d25/d28/d24/fb 3383671 0 2024-09-11T00:17:56.449 INFO:tasks.workunit.client.0.smithi078.stdout:7/377: write d0/d34/db/f47 [3868494,49422] 0 2024-09-11T00:17:56.449 INFO:tasks.workunit.client.0.smithi078.stdout:7/378: read - d0/d34/db/d30/d1d/d14/f5d zero size 2024-09-11T00:17:56.449 INFO:tasks.workunit.client.0.smithi078.stdout:7/379: truncate d0/d34/db/d30/d28/f6a 735551 0 2024-09-11T00:17:56.450 INFO:tasks.workunit.client.0.smithi078.stdout:0/303: link d2/d2a/d2c/d35/d59/c12 d2/d2a/d2c/d5e/c65 0 2024-09-11T00:17:56.450 INFO:tasks.workunit.client.0.smithi078.stdout:0/304: fsync d2/d2a/d2c/d42/d23/d56/f60 0 2024-09-11T00:17:56.451 INFO:tasks.workunit.client.0.smithi078.stdout:4/406: dread dc/d10/d40/f28 [0,4194304] 0 2024-09-11T00:17:56.451 INFO:tasks.workunit.client.0.smithi078.stdout:4/407: chown dc/d10/d40/d3a/d65/c38 4584246 1 2024-09-11T00:17:56.451 INFO:tasks.workunit.client.0.smithi078.stdout:1/448: dread d3/d29/d5f/f25 [0,4194304] 0 2024-09-11T00:17:56.451 INFO:tasks.workunit.client.0.smithi078.stdout:1/449: write d3/d29/d5f/f8 [3945650,1112] 0 2024-09-11T00:17:56.452 INFO:tasks.workunit.client.0.smithi078.stdout:7/380: dread d0/d34/db/f51 [0,4194304] 0 2024-09-11T00:17:56.452 INFO:tasks.workunit.client.0.smithi078.stdout:7/381: stat d0/d34/db/cc 0 2024-09-11T00:17:56.455 INFO:tasks.workunit.client.0.smithi078.stdout:5/281: creat d7/d8/de/d2c/f6c x:0 0 0 2024-09-11T00:17:56.458 INFO:tasks.workunit.client.0.smithi078.stdout:9/318: dwrite f7 [0,4194304] 0 2024-09-11T00:17:56.458 INFO:tasks.workunit.client.0.smithi078.stdout:0/305: mknod d2/d2a/d2c/c66 0 2024-09-11T00:17:56.460 INFO:tasks.workunit.client.0.smithi078.stdout:4/408: creat dc/d10/d40/d3a/d4c/f8a x:0 0 0 2024-09-11T00:17:56.462 INFO:tasks.workunit.client.0.smithi078.stdout:5/282: symlink d7/d8/de/d2c/d62/l6d 0 2024-09-11T00:17:56.462 INFO:tasks.workunit.client.0.smithi078.stdout:8/424: dread f2 [0,4194304] 0 2024-09-11T00:17:56.463 INFO:tasks.workunit.client.0.smithi078.stdout:9/319: symlink dc/d12/d20/d50/l6b 0 2024-09-11T00:17:56.466 INFO:tasks.workunit.client.0.smithi078.stdout:6/398: dwrite d0/f7a [0,4194304] 0 2024-09-11T00:17:56.466 INFO:tasks.workunit.client.0.smithi078.stdout:0/306: rename d2/d2a/d2c/d42/d23/f48 to d2/d2a/d2c/d42/f67 0 2024-09-11T00:17:56.469 INFO:tasks.workunit.client.0.smithi078.stdout:4/409: mkdir dc/d10/d40/d3a/d65/d7b/d8b 0 2024-09-11T00:17:56.470 INFO:tasks.workunit.client.0.smithi078.stdout:8/425: creat da/d13/d28/d3a/f81 x:0 0 0 2024-09-11T00:17:56.472 INFO:tasks.workunit.client.0.smithi078.stdout:9/320: mknod dc/d12/d20/d58/d5b/d68/c6c 0 2024-09-11T00:17:56.472 INFO:tasks.workunit.client.0.smithi078.stdout:9/321: dread - dc/d12/d24/f47 zero size 2024-09-11T00:17:56.472 INFO:tasks.workunit.client.0.smithi078.stdout:6/399: getdents d0/d1/d9/d59 0 2024-09-11T00:17:56.474 INFO:tasks.workunit.client.0.smithi078.stdout:0/307: creat d2/d2a/d2c/d5e/f68 x:0 0 0 2024-09-11T00:17:56.474 INFO:tasks.workunit.client.0.smithi078.stdout:0/308: write d2/d2a/d2c/d42/f24 [5629852,123889] 0 2024-09-11T00:17:56.475 INFO:tasks.workunit.client.0.smithi078.stdout:4/410: symlink dc/d10/d3c/d6e/l8c 0 2024-09-11T00:17:56.475 INFO:tasks.workunit.client.0.smithi078.stdout:4/411: write dc/d10/d40/d3a/d65/f3f [912023,123360] 0 2024-09-11T00:17:56.475 INFO:tasks.workunit.client.0.smithi078.stdout:4/412: write dc/d10/d1f/f5b [269446,39816] 0 2024-09-11T00:17:56.475 INFO:tasks.workunit.client.0.smithi078.stdout:4/413: fdatasync dc/d10/d69/d72/f79 0 2024-09-11T00:17:56.475 INFO:tasks.workunit.client.0.smithi078.stdout:4/414: write f6 [1951910,129554] 0 2024-09-11T00:17:56.476 INFO:tasks.workunit.client.0.smithi078.stdout:5/283: read d7/d8/d33/d22/d25/d28/d24/d1c/f2e [1130025,32219] 0 2024-09-11T00:17:56.476 INFO:tasks.workunit.client.0.smithi078.stdout:9/322: rename dc/d12/d24/d3e/f45 to dc/d12/d24/d3e/f6d 0 2024-09-11T00:17:56.478 INFO:tasks.workunit.client.0.smithi078.stdout:6/400: getdents d0/d1/d1b 0 2024-09-11T00:17:56.478 INFO:tasks.workunit.client.0.smithi078.stdout:1/450: dwrite d3/d1a/ff [4194304,4194304] 0 2024-09-11T00:17:56.478 INFO:tasks.workunit.client.0.smithi078.stdout:8/426: dread da/d13/d1b/f23 [0,4194304] 0 2024-09-11T00:17:56.478 INFO:tasks.workunit.client.0.smithi078.stdout:8/427: chown da/d1c/d1e/c5d 726987 1 2024-09-11T00:17:56.481 INFO:tasks.workunit.client.0.smithi078.stdout:4/415: link dc/d10/d40/d33/l48 dc/d10/d1f/d68/l8d 0 2024-09-11T00:17:56.482 INFO:tasks.workunit.client.0.smithi078.stdout:5/284: link d7/d8/d33/d22/d25/d28/f31 d7/d8/d33/d22/d25/d6a/f6e 0 2024-09-11T00:17:56.482 INFO:tasks.workunit.client.0.smithi078.stdout:5/285: write d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f59 [4396250,100218] 0 2024-09-11T00:17:56.484 INFO:tasks.workunit.client.0.smithi078.stdout:1/451: symlink d3/d29/d5f/d39/d61/l8a 0 2024-09-11T00:17:56.489 INFO:tasks.workunit.client.0.smithi078.stdout:5/286: dread d7/d8/d33/d22/d25/f45 [0,4194304] 0 2024-09-11T00:17:56.492 INFO:tasks.workunit.client.0.smithi078.stdout:0/309: getdents d2/d2a/d2c/d5e 0 2024-09-11T00:17:56.492 INFO:tasks.workunit.client.0.smithi078.stdout:0/310: chown d2/d2a/d2c/c66 22280599 1 2024-09-11T00:17:56.495 INFO:tasks.workunit.client.0.smithi078.stdout:8/428: dwrite da/d13/d1b/d59/f3d [0,4194304] 0 2024-09-11T00:17:56.495 INFO:tasks.workunit.client.0.smithi078.stdout:8/429: stat da/d1c/f38 0 2024-09-11T00:17:56.500 INFO:tasks.workunit.client.0.smithi078.stdout:4/416: mkdir dc/d8e 0 2024-09-11T00:17:56.500 INFO:tasks.workunit.client.0.smithi078.stdout:4/417: write dc/d10/f3d [385268,29921] 0 2024-09-11T00:17:56.501 INFO:tasks.workunit.client.0.smithi078.stdout:9/323: mknod dc/d12/c6e 0 2024-09-11T00:17:56.501 INFO:tasks.workunit.client.0.smithi078.stdout:9/324: write dc/d12/d35/f67 [521209,24442] 0 2024-09-11T00:17:56.501 INFO:tasks.workunit.client.0.smithi078.stdout:9/325: fdatasync fa 0 2024-09-11T00:17:56.502 INFO:tasks.workunit.client.0.smithi078.stdout:5/287: creat d7/d8/d56/f6f x:0 0 0 2024-09-11T00:17:56.506 INFO:tasks.workunit.client.0.smithi078.stdout:0/311: rename d2/d2a/d2c/d42 to d2/d2a/d2c/d35/d59/d4f/d61/d69 0 2024-09-11T00:17:56.506 INFO:tasks.workunit.client.0.smithi078.stdout:0/312: read d2/f1d [1905085,68897] 0 2024-09-11T00:17:56.506 INFO:tasks.workunit.client.0.smithi078.stdout:0/313: getdents d2/d2a/d2c/d5e 0 2024-09-11T00:17:56.507 INFO:tasks.workunit.client.0.smithi078.stdout:4/418: link dc/d10/d40/d3a/d65/f51 dc/d10/d40/f8f 0 2024-09-11T00:17:56.510 INFO:tasks.workunit.client.0.smithi078.stdout:8/430: rename da/d13/d1b/d53 to da/d13/d1b/d59/d68/d82 0 2024-09-11T00:17:56.510 INFO:tasks.workunit.client.0.smithi078.stdout:8/431: chown da/d13/d28/d3a/c54 1906074 1 2024-09-11T00:17:56.511 INFO:tasks.workunit.client.0.smithi078.stdout:4/419: creat dc/d10/d40/d3a/f90 x:0 0 0 2024-09-11T00:17:56.512 INFO:tasks.workunit.client.0.smithi078.stdout:4/420: write dc/d10/d40/d3a/d46/f6f [182329,81020] 0 2024-09-11T00:17:56.513 INFO:tasks.workunit.client.0.smithi078.stdout:9/326: dread dc/d12/d20/f32 [0,4194304] 0 2024-09-11T00:17:56.513 INFO:tasks.workunit.client.0.smithi078.stdout:8/432: creat da/d13/d1b/d4e/d66/d79/f83 x:0 0 0 2024-09-11T00:17:56.513 INFO:tasks.workunit.client.0.smithi078.stdout:5/288: dread d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f20 [0,4194304] 0 2024-09-11T00:17:56.514 INFO:tasks.workunit.client.0.smithi078.stdout:4/421: mknod dc/d10/d40/d3a/c91 0 2024-09-11T00:17:56.514 INFO:tasks.workunit.client.0.smithi078.stdout:9/327: rename dc/d12/c1f to dc/d12/d46/d51/c6f 0 2024-09-11T00:17:56.516 INFO:tasks.workunit.client.0.smithi078.stdout:5/289: link d7/d8/l42 d7/l70 0 2024-09-11T00:17:56.516 INFO:tasks.workunit.client.0.smithi078.stdout:5/290: write d7/d8/de/d2c/f6c [536688,57807] 0 2024-09-11T00:17:56.517 INFO:tasks.workunit.client.0.smithi078.stdout:5/291: unlink d7/d8/d33/d22/d25/c67 0 2024-09-11T00:17:56.518 INFO:tasks.workunit.client.0.smithi078.stdout:4/422: dread dc/d10/d40/d3a/d46/d59/f5f [0,4194304] 0 2024-09-11T00:17:56.519 INFO:tasks.workunit.client.0.smithi078.stdout:1/452: dwrite d3/d1a/f6b [0,4194304] 0 2024-09-11T00:17:56.519 INFO:tasks.workunit.client.0.smithi078.stdout:4/423: fdatasync dc/d10/d1f/f35 0 2024-09-11T00:17:56.519 INFO:tasks.workunit.client.0.smithi078.stdout:4/424: readlink dc/d10/d3c/l4f 0 2024-09-11T00:17:56.519 INFO:tasks.workunit.client.0.smithi078.stdout:5/292: mknod d7/d8/d33/c71 0 2024-09-11T00:17:56.521 INFO:tasks.workunit.client.0.smithi078.stdout:0/314: dwrite d2/d2a/d2c/d35/d59/d7/f3b [0,4194304] 0 2024-09-11T00:17:56.521 INFO:tasks.workunit.client.0.smithi078.stdout:0/315: readlink d2/l1e 0 2024-09-11T00:17:56.521 INFO:tasks.workunit.client.0.smithi078.stdout:0/316: chown d2/d2a/d2c/d35 291492 1 2024-09-11T00:17:56.522 INFO:tasks.workunit.client.0.smithi078.stdout:1/453: fdatasync d3/d1a/d21/f4b 0 2024-09-11T00:17:56.523 INFO:tasks.workunit.client.0.smithi078.stdout:4/425: rename fa to dc/d10/d40/d3a/d65/f92 0 2024-09-11T00:17:56.523 INFO:tasks.workunit.client.0.smithi078.stdout:4/426: write dc/ff [4866366,82036] 0 2024-09-11T00:17:56.526 INFO:tasks.workunit.client.0.smithi078.stdout:4/427: dread dc/d10/d40/d3a/d65/f3f [0,4194304] 0 2024-09-11T00:17:56.526 INFO:tasks.workunit.client.0.smithi078.stdout:4/428: fdatasync dc/d10/d69/d72/f79 0 2024-09-11T00:17:56.528 INFO:tasks.workunit.client.0.smithi078.stdout:8/433: dwrite da/d13/d19/f35 [0,4194304] 0 2024-09-11T00:17:56.530 INFO:tasks.workunit.client.0.smithi078.stdout:9/328: dwrite f4 [0,4194304] 0 2024-09-11T00:17:56.531 INFO:tasks.workunit.client.0.smithi078.stdout:9/329: chown dc/f65 0 1 2024-09-11T00:17:56.531 INFO:tasks.workunit.client.0.smithi078.stdout:0/317: creat d2/d2a/d2c/d5e/f6a x:0 0 0 2024-09-11T00:17:56.531 INFO:tasks.workunit.client.0.smithi078.stdout:1/454: rmdir d3/d1a/d21/d4a 39 2024-09-11T00:17:56.531 INFO:tasks.workunit.client.0.smithi078.stdout:5/293: link d7/d8/de/d2c/d62/l6d d7/d8/l72 0 2024-09-11T00:17:56.534 INFO:tasks.workunit.client.0.smithi078.stdout:9/330: mknod dc/d12/d20/d58/d5b/d68/c70 0 2024-09-11T00:17:56.538 INFO:tasks.workunit.client.0.smithi078.stdout:5/294: mknod d7/d8/d33/d22/d25/d6a/c73 0 2024-09-11T00:17:56.539 INFO:tasks.workunit.client.0.smithi078.stdout:4/429: dwrite dc/d10/d40/d3a/d4c/f2e [0,4194304] 0 2024-09-11T00:17:56.540 INFO:tasks.workunit.client.0.smithi078.stdout:9/331: creat dc/d12/d20/d58/f71 x:0 0 0 2024-09-11T00:17:56.541 INFO:tasks.workunit.client.0.smithi078.stdout:5/295: mknod d7/d8/d56/d2a/c74 0 2024-09-11T00:17:56.541 INFO:tasks.workunit.client.0.smithi078.stdout:5/296: chown d7/d8/de/f69 677059 1 2024-09-11T00:17:56.541 INFO:tasks.workunit.client.0.smithi078.stdout:4/430: truncate dc/f39 1393490 0 2024-09-11T00:17:56.542 INFO:tasks.workunit.client.0.smithi078.stdout:4/431: rmdir dc/d10/d40 39 2024-09-11T00:17:56.547 INFO:tasks.workunit.client.0.smithi078.stdout:9/332: dread dc/d12/f17 [4194304,4194304] 0 2024-09-11T00:17:56.548 INFO:tasks.workunit.client.0.smithi078.stdout:9/333: rename dc/d12/d20/f4f to dc/d12/d20/d58/f72 0 2024-09-11T00:17:56.549 INFO:tasks.workunit.client.0.smithi078.stdout:5/297: dread d7/d8/d33/d22/d25/d28/d24/f4d [0,4194304] 0 2024-09-11T00:17:56.549 INFO:tasks.workunit.client.0.smithi078.stdout:5/298: truncate d7/d8/de/d2c/f6c 1029687 0 2024-09-11T00:17:56.549 INFO:tasks.workunit.client.0.smithi078.stdout:1/455: dwrite d3/d1a/f33 [0,4194304] 0 2024-09-11T00:17:56.550 INFO:tasks.workunit.client.0.smithi078.stdout:9/334: creat dc/d12/d20/d58/f73 x:0 0 0 2024-09-11T00:17:56.550 INFO:tasks.workunit.client.0.smithi078.stdout:9/335: dread - dc/d12/d20/d58/f72 zero size 2024-09-11T00:17:56.551 INFO:tasks.workunit.client.0.smithi078.stdout:5/299: creat d7/d8/d56/f75 x:0 0 0 2024-09-11T00:17:56.551 INFO:tasks.workunit.client.0.smithi078.stdout:5/300: write d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f5f [18706,117725] 0 2024-09-11T00:17:56.553 INFO:tasks.workunit.client.0.smithi078.stdout:1/456: unlink d3/f1c 0 2024-09-11T00:17:56.554 INFO:tasks.workunit.client.0.smithi078.stdout:9/336: mknod dc/d12/d24/c74 0 2024-09-11T00:17:56.555 INFO:tasks.workunit.client.0.smithi078.stdout:1/457: rename d3/d29/d45/f52 to d3/d29/d5f/d39/d61/f8b 0 2024-09-11T00:17:56.556 INFO:tasks.workunit.client.0.smithi078.stdout:9/337: symlink dc/d12/d35/l75 0 2024-09-11T00:17:56.564 INFO:tasks.workunit.client.0.smithi078.stdout:1/458: fsync d3/d29/d5f/d39/d61/f8b 0 2024-09-11T00:17:56.567 INFO:tasks.workunit.client.0.smithi078.stdout:9/338: rename dc/d12/d35 to dc/d12/d20/d58/d5a/d76 0 2024-09-11T00:17:56.567 INFO:tasks.workunit.client.0.smithi078.stdout:5/301: dread d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f5f [0,4194304] 0 2024-09-11T00:17:56.567 INFO:tasks.workunit.client.0.smithi078.stdout:5/302: truncate d7/d8/de/ff 7438107 0 2024-09-11T00:17:56.568 INFO:tasks.workunit.client.0.smithi078.stdout:5/303: read d7/d8/d33/d22/d25/f5e [73388,91745] 0 2024-09-11T00:17:56.569 INFO:tasks.workunit.client.0.smithi078.stdout:4/432: dwrite dc/d10/d3c/f67 [0,4194304] 0 2024-09-11T00:17:56.570 INFO:tasks.workunit.client.0.smithi078.stdout:4/433: fsync dc/f25 0 2024-09-11T00:17:56.572 INFO:tasks.workunit.client.0.smithi078.stdout:5/304: write d7/d8/f3d [339034,93428] 0 2024-09-11T00:17:56.573 INFO:tasks.workunit.client.0.smithi078.stdout:4/434: mkdir dc/d10/d40/d33/d93 0 2024-09-11T00:17:56.573 INFO:tasks.workunit.client.0.smithi078.stdout:5/305: getdents d7/d8/d33 0 2024-09-11T00:17:56.575 INFO:tasks.workunit.client.0.smithi078.stdout:4/435: mkdir dc/d10/d40/d3a/d65/d94 0 2024-09-11T00:17:56.575 INFO:tasks.workunit.client.0.smithi078.stdout:4/436: write dc/d10/d3c/f80 [746771,130591] 0 2024-09-11T00:17:56.575 INFO:tasks.workunit.client.0.smithi078.stdout:4/437: stat dc/d10/d40/d3a/d65/d94 0 2024-09-11T00:17:56.575 INFO:tasks.workunit.client.0.smithi078.stdout:4/438: chown dc 4173 1 2024-09-11T00:17:56.575 INFO:tasks.workunit.client.0.smithi078.stdout:4/439: chown dc/d10/d1f/f2f 27 1 2024-09-11T00:17:56.576 INFO:tasks.workunit.client.0.smithi078.stdout:4/440: creat dc/d10/d69/d72/f95 x:0 0 0 2024-09-11T00:17:56.577 INFO:tasks.workunit.client.0.smithi078.stdout:4/441: creat dc/d10/d40/d3a/d65/d7b/f96 x:0 0 0 2024-09-11T00:17:56.577 INFO:tasks.workunit.client.0.smithi078.stdout:4/442: chown dc/d10/d3c/f80 7519 1 2024-09-11T00:17:56.578 INFO:tasks.workunit.client.0.smithi078.stdout:4/443: creat dc/d10/d1f/f97 x:0 0 0 2024-09-11T00:17:56.580 INFO:tasks.workunit.client.0.smithi078.stdout:1/459: dread d3/d29/d5f/f1f [0,4194304] 0 2024-09-11T00:17:56.582 INFO:tasks.workunit.client.0.smithi078.stdout:1/460: mkdir d3/d29/d5f/d4e/d8c 0 2024-09-11T00:17:56.582 INFO:tasks.workunit.client.0.smithi078.stdout:1/461: chown d3/d29/l37 60 1 2024-09-11T00:17:56.584 INFO:tasks.workunit.client.0.smithi078.stdout:1/462: rmdir d3/d1a/d21/d4a/d85 0 2024-09-11T00:17:56.586 INFO:tasks.workunit.client.0.smithi078.stdout:4/444: dread f6 [0,4194304] 0 2024-09-11T00:17:56.586 INFO:tasks.workunit.client.0.smithi078.stdout:1/463: rename d3/d29/d5f/f25 to d3/d1a/d21/f8d 0 2024-09-11T00:17:56.593 INFO:tasks.workunit.client.0.smithi078.stdout:1/464: dread d3/d1a/d21/f24 [0,4194304] 0 2024-09-11T00:17:56.594 INFO:tasks.workunit.client.0.smithi078.stdout:1/465: symlink d3/l8e 0 2024-09-11T00:17:56.594 INFO:tasks.workunit.client.0.smithi078.stdout:1/466: readlink d3/d1a/d21/l36 0 2024-09-11T00:17:56.595 INFO:tasks.workunit.client.0.smithi078.stdout:1/467: chown d3/d1a/l5b 7475088 1 2024-09-11T00:17:56.668 INFO:tasks.workunit.client.0.smithi078.stdout:9/339: dwrite f4 [0,4194304] 0 2024-09-11T00:17:56.668 INFO:tasks.workunit.client.0.smithi078.stdout:9/340: readlink dc/d12/d20/l2e 0 2024-09-11T00:17:56.669 INFO:tasks.workunit.client.0.smithi078.stdout:9/341: symlink dc/d12/d54/l77 0 2024-09-11T00:17:56.677 INFO:tasks.workunit.client.0.smithi078.stdout:3/328: sync 2024-09-11T00:17:56.678 INFO:tasks.workunit.client.0.smithi078.stdout:3/329: mknod d0/d7/d18/d1b/d34/c6b 0 2024-09-11T00:17:56.679 INFO:tasks.workunit.client.0.smithi078.stdout:3/330: unlink d0/d7/d18/d1b/f50 0 2024-09-11T00:17:56.680 INFO:tasks.workunit.client.0.smithi078.stdout:3/331: mknod d0/d7/d46/c6c 0 2024-09-11T00:17:56.683 INFO:tasks.workunit.client.0.smithi078.stdout:3/332: dread d0/d1a/d1e/f30 [4194304,4194304] 0 2024-09-11T00:17:56.685 INFO:tasks.workunit.client.0.smithi078.stdout:3/333: rename d0/d1a/d1e to d0/d7/d18/d1b/d34/d60/d6d 0 2024-09-11T00:17:56.685 INFO:tasks.workunit.client.0.smithi078.stdout:9/342: dwrite dc/f2c [4194304,4194304] 0 2024-09-11T00:17:56.685 INFO:tasks.workunit.client.0.smithi078.stdout:9/343: write dc/d12/f11 [693997,109561] 0 2024-09-11T00:17:56.686 INFO:tasks.workunit.client.0.smithi078.stdout:3/334: unlink d0/d7/d18/d1b/d27/c12 0 2024-09-11T00:17:56.687 INFO:tasks.workunit.client.0.smithi078.stdout:9/344: mknod dc/d12/d20/d58/c78 0 2024-09-11T00:17:56.687 INFO:tasks.workunit.client.0.smithi078.stdout:9/345: fsync dc/d12/d20/d58/f72 0 2024-09-11T00:17:56.689 INFO:tasks.workunit.client.0.smithi078.stdout:3/335: creat d0/d7/d18/f6e x:0 0 0 2024-09-11T00:17:56.689 INFO:tasks.workunit.client.0.smithi078.stdout:3/336: dread - d0/d7/d46/f5b zero size 2024-09-11T00:17:56.689 INFO:tasks.workunit.client.0.smithi078.stdout:3/337: write d0/d7/d18/d1b/f38 [3891090,90299] 0 2024-09-11T00:17:56.689 INFO:tasks.workunit.client.0.smithi078.stdout:3/338: fsync d0/d7/d46/f5e 0 2024-09-11T00:17:56.689 INFO:tasks.workunit.client.0.smithi078.stdout:3/339: dread - d0/d7/d46/f66 zero size 2024-09-11T00:17:56.691 INFO:tasks.workunit.client.0.smithi078.stdout:9/346: dread dc/d12/d20/d30/f3d [0,4194304] 0 2024-09-11T00:17:56.691 INFO:tasks.workunit.client.0.smithi078.stdout:3/340: unlink d0/d7/d18/d1b/d34/f63 0 2024-09-11T00:17:56.691 INFO:tasks.workunit.client.0.smithi078.stdout:3/341: fsync d0/d7/d18/d1b/d34/d60/d6d/f3a 0 2024-09-11T00:17:56.692 INFO:tasks.workunit.client.0.smithi078.stdout:3/342: mknod d0/d7/d18/d1b/d34/d3e/c6f 0 2024-09-11T00:17:56.707 INFO:tasks.workunit.client.0.smithi078.stdout:9/347: dwrite dc/f14 [0,4194304] 0 2024-09-11T00:17:56.708 INFO:tasks.workunit.client.0.smithi078.stdout:3/343: dwrite d0/f1f [0,4194304] 0 2024-09-11T00:17:56.710 INFO:tasks.workunit.client.0.smithi078.stdout:3/344: mkdir d0/d7/d18/d70 0 2024-09-11T00:17:56.716 INFO:tasks.workunit.client.0.smithi078.stdout:9/348: dread dc/f38 [0,4194304] 0 2024-09-11T00:17:56.717 INFO:tasks.workunit.client.0.smithi078.stdout:9/349: dread dc/d12/d54/f57 [0,4194304] 0 2024-09-11T00:17:56.719 INFO:tasks.workunit.client.0.smithi078.stdout:9/350: rename dc/l2b to dc/d12/d20/d58/d5a/d76/l79 0 2024-09-11T00:17:56.720 INFO:tasks.workunit.client.0.smithi078.stdout:9/351: creat dc/d12/d46/f7a x:0 0 0 2024-09-11T00:17:56.721 INFO:tasks.workunit.client.0.smithi078.stdout:9/352: creat dc/f7b x:0 0 0 2024-09-11T00:17:56.722 INFO:tasks.workunit.client.0.smithi078.stdout:9/353: unlink dc/d12/c33 0 2024-09-11T00:17:56.722 INFO:tasks.workunit.client.0.smithi078.stdout:9/354: symlink dc/d12/d20/d58/d5b/l7c 0 2024-09-11T00:17:56.723 INFO:tasks.workunit.client.0.smithi078.stdout:3/345: dwrite d0/d7/d18/d1b/f56 [0,4194304] 0 2024-09-11T00:17:56.724 INFO:tasks.workunit.client.0.smithi078.stdout:9/355: rename dc/d12/d20/c40 to dc/d12/d20/d58/d5b/d68/c7d 0 2024-09-11T00:17:56.725 INFO:tasks.workunit.client.0.smithi078.stdout:9/356: link dc/f14 dc/d12/d24/f7e 0 2024-09-11T00:17:56.729 INFO:tasks.workunit.client.0.smithi078.stdout:3/346: dread d0/d7/d18/d1b/d34/d60/d6d/f30 [0,4194304] 0 2024-09-11T00:17:56.731 INFO:tasks.workunit.client.0.smithi078.stdout:3/347: creat d0/d39/f71 x:0 0 0 2024-09-11T00:17:56.731 INFO:tasks.workunit.client.0.smithi078.stdout:3/348: chown d0/d7/d18/d70 1009756 1 2024-09-11T00:17:56.731 INFO:tasks.workunit.client.0.smithi078.stdout:3/349: chown d0/d7/d18/f4c 0 1 2024-09-11T00:17:56.731 INFO:tasks.workunit.client.0.smithi078.stdout:3/350: write d0/d7/d18/d1b/d27/f28 [2419354,127479] 0 2024-09-11T00:17:56.739 INFO:tasks.workunit.client.0.smithi078.stdout:3/351: dread d0/d7/d18/d1b/d34/f49 [0,4194304] 0 2024-09-11T00:17:56.739 INFO:tasks.workunit.client.0.smithi078.stdout:3/352: rmdir d0/d39 39 2024-09-11T00:17:56.741 INFO:tasks.workunit.client.0.smithi078.stdout:9/357: dwrite f4 [0,4194304] 0 2024-09-11T00:17:56.742 INFO:tasks.workunit.client.0.smithi078.stdout:9/358: mknod dc/d12/d20/d58/d5a/c7f 0 2024-09-11T00:17:56.742 INFO:tasks.workunit.client.0.smithi078.stdout:9/359: fdatasync dc/d12/d20/d58/f73 0 2024-09-11T00:17:56.743 INFO:tasks.workunit.client.0.smithi078.stdout:9/360: mknod dc/d12/c80 0 2024-09-11T00:17:56.743 INFO:tasks.workunit.client.0.smithi078.stdout:9/361: dread - dc/d12/f64 zero size 2024-09-11T00:17:56.755 INFO:tasks.workunit.client.0.smithi078.stdout:9/362: write fa [1880435,68808] 0 2024-09-11T00:17:56.755 INFO:tasks.workunit.client.0.smithi078.stdout:9/363: chown dc/d12/d46/d51/f53 4999 1 2024-09-11T00:17:56.756 INFO:tasks.workunit.client.0.smithi078.stdout:3/353: dwrite d0/f65 [0,4194304] 0 2024-09-11T00:17:56.756 INFO:tasks.workunit.client.0.smithi078.stdout:9/364: creat dc/d12/d20/d58/d5a/f81 x:0 0 0 2024-09-11T00:17:56.760 INFO:tasks.workunit.client.0.smithi078.stdout:3/354: creat d0/f72 x:0 0 0 2024-09-11T00:17:56.760 INFO:tasks.workunit.client.0.smithi078.stdout:3/355: creat d0/d7/d18/d1b/d34/f73 x:0 0 0 2024-09-11T00:17:56.772 INFO:tasks.workunit.client.0.smithi078.stdout:9/365: dwrite dc/d12/d20/d58/f72 [0,4194304] 0 2024-09-11T00:17:56.773 INFO:tasks.workunit.client.0.smithi078.stdout:7/382: sync 2024-09-11T00:17:56.773 INFO:tasks.workunit.client.0.smithi078.stdout:7/383: stat d0/d34/db/d30/d1d/d14/f4f 0 2024-09-11T00:17:56.773 INFO:tasks.workunit.client.0.smithi078.stdout:2/364: sync 2024-09-11T00:17:56.773 INFO:tasks.workunit.client.0.smithi078.stdout:8/434: sync 2024-09-11T00:17:56.773 INFO:tasks.workunit.client.0.smithi078.stdout:6/401: sync 2024-09-11T00:17:56.774 INFO:tasks.workunit.client.0.smithi078.stdout:7/384: write d0/f29 [1425919,20637] 0 2024-09-11T00:17:56.774 INFO:tasks.workunit.client.0.smithi078.stdout:9/366: symlink dc/d12/d20/d58/d5a/d76/l82 0 2024-09-11T00:17:56.774 INFO:tasks.workunit.client.0.smithi078.stdout:8/435: link da/d1c/c26 da/c84 0 2024-09-11T00:17:56.776 INFO:tasks.workunit.client.0.smithi078.stdout:2/365: creat d0/d67/f7a x:0 0 0 2024-09-11T00:17:56.777 INFO:tasks.workunit.client.0.smithi078.stdout:2/366: write d0/d31/d3a/f3e [298133,104279] 0 2024-09-11T00:17:56.777 INFO:tasks.workunit.client.0.smithi078.stdout:2/367: fdatasync d0/d1/d11/f2d 0 2024-09-11T00:17:56.778 INFO:tasks.workunit.client.0.smithi078.stdout:6/402: mknod d0/d1/d9/d8d/c8e 0 2024-09-11T00:17:56.778 INFO:tasks.workunit.client.0.smithi078.stdout:6/403: readlink d0/d1/d9/l3a 0 2024-09-11T00:17:56.779 INFO:tasks.workunit.client.0.smithi078.stdout:7/385: dread d0/d34/db/d30/d1d/f17 [0,4194304] 0 2024-09-11T00:17:56.779 INFO:tasks.workunit.client.0.smithi078.stdout:7/386: fsync d0/d34/db/d30/d1d/fe 0 2024-09-11T00:17:56.779 INFO:tasks.workunit.client.0.smithi078.stdout:7/387: fdatasync d0/d34/db/d30/d1d/f17 0 2024-09-11T00:17:56.779 INFO:tasks.workunit.client.0.smithi078.stdout:7/388: chown d0/d34/d57 508 1 2024-09-11T00:17:56.779 INFO:tasks.workunit.client.0.smithi078.stdout:7/389: readlink d0/d34/db/d30/d1d/d14/l42 0 2024-09-11T00:17:56.779 INFO:tasks.workunit.client.0.smithi078.stdout:9/367: mkdir dc/d12/d54/d83 0 2024-09-11T00:17:56.781 INFO:tasks.workunit.client.0.smithi078.stdout:8/436: rename da/d13/d1b/d4e/d66 to da/d1c/d60/d85 0 2024-09-11T00:17:56.782 INFO:tasks.workunit.client.0.smithi078.stdout:2/368: symlink d0/d67/l7b 0 2024-09-11T00:17:56.784 INFO:tasks.workunit.client.0.smithi078.stdout:7/390: creat d0/d34/db/d32/f70 x:0 0 0 2024-09-11T00:17:56.785 INFO:tasks.workunit.client.0.smithi078.stdout:9/368: creat dc/d12/d20/d58/d5b/f84 x:0 0 0 2024-09-11T00:17:56.785 INFO:tasks.workunit.client.0.smithi078.stdout:2/369: mknod d0/d1/d33/c7c 0 2024-09-11T00:17:56.786 INFO:tasks.workunit.client.0.smithi078.stdout:9/369: getdents dc/d12/d20/d58/d5a/d76 0 2024-09-11T00:17:56.787 INFO:tasks.workunit.client.0.smithi078.stdout:9/370: fsync dc/f1e 0 2024-09-11T00:17:56.789 INFO:tasks.workunit.client.0.smithi078.stdout:6/404: dwrite d0/f31 [0,4194304] 0 2024-09-11T00:17:56.789 INFO:tasks.workunit.client.0.smithi078.stdout:9/371: rename dc/d12/d24 to dc/d12/d20/d85 0 2024-09-11T00:17:56.791 INFO:tasks.workunit.client.0.smithi078.stdout:7/391: write d0/d34/db/d30/f3e [2711384,120428] 0 2024-09-11T00:17:56.792 INFO:tasks.workunit.client.0.smithi078.stdout:2/370: dread d0/d1/d6/f48 [0,4194304] 0 2024-09-11T00:17:56.798 INFO:tasks.workunit.client.0.smithi078.stdout:9/372: symlink dc/d12/d20/d85/l86 0 2024-09-11T00:17:56.798 INFO:tasks.workunit.client.0.smithi078.stdout:2/371: symlink d0/d1/d3b/l7d 0 2024-09-11T00:17:56.799 INFO:tasks.workunit.client.0.smithi078.stdout:9/373: stat dc/ld 0 2024-09-11T00:17:56.799 INFO:tasks.workunit.client.0.smithi078.stdout:2/372: creat d0/d1/d53/f7e x:0 0 0 2024-09-11T00:17:56.801 INFO:tasks.workunit.client.0.smithi078.stdout:9/374: rename dc/d12/d20/d30/f3d to dc/d12/d20/d58/d5b/f87 0 2024-09-11T00:17:56.802 INFO:tasks.workunit.client.0.smithi078.stdout:2/373: mknod d0/d67/c7f 0 2024-09-11T00:17:56.802 INFO:tasks.workunit.client.0.smithi078.stdout:2/374: write d0/d1/d8/f47 [106004,69403] 0 2024-09-11T00:17:56.802 INFO:tasks.workunit.client.0.smithi078.stdout:9/375: dread dc/d12/d46/d51/f53 [0,4194304] 0 2024-09-11T00:17:56.811 INFO:tasks.workunit.client.0.smithi078.stdout:7/392: dwrite d0/d34/db/f2e [0,4194304] 0 2024-09-11T00:17:56.812 INFO:tasks.workunit.client.0.smithi078.stdout:6/405: dwrite d0/f31 [8388608,4194304] 0 2024-09-11T00:17:56.813 INFO:tasks.workunit.client.0.smithi078.stdout:7/393: creat d0/d34/d65/f71 x:0 0 0 2024-09-11T00:17:56.814 INFO:tasks.workunit.client.0.smithi078.stdout:6/406: symlink d0/d1/l8f 0 2024-09-11T00:17:56.815 INFO:tasks.workunit.client.0.smithi078.stdout:6/407: creat d0/d1/d53/f90 x:0 0 0 2024-09-11T00:17:56.816 INFO:tasks.workunit.client.0.smithi078.stdout:6/408: symlink d0/d1/d9/d17/d5e/l91 0 2024-09-11T00:17:56.816 INFO:tasks.workunit.client.0.smithi078.stdout:6/409: readlink d0/d1/d9/l4 0 2024-09-11T00:17:56.818 INFO:tasks.workunit.client.0.smithi078.stdout:6/410: dread d0/d1/d9/d17/d5e/f77 [0,4194304] 0 2024-09-11T00:17:56.819 INFO:tasks.workunit.client.0.smithi078.stdout:2/375: dwrite d0/d1/f4 [4194304,4194304] 0 2024-09-11T00:17:56.833 INFO:tasks.workunit.client.0.smithi078.stdout:2/376: dwrite d0/d1/d33/d5f/f73 [0,4194304] 0 2024-09-11T00:17:56.833 INFO:tasks.workunit.client.0.smithi078.stdout:6/411: dwrite d0/d1/d53/f90 [0,4194304] 0 2024-09-11T00:17:56.834 INFO:tasks.workunit.client.0.smithi078.stdout:7/394: dwrite d0/d34/db/f51 [0,4194304] 0 2024-09-11T00:17:56.835 INFO:tasks.workunit.client.0.smithi078.stdout:2/377: creat d0/d31/d38/f80 x:0 0 0 2024-09-11T00:17:56.836 INFO:tasks.workunit.client.0.smithi078.stdout:6/412: getdents d0/d33 0 2024-09-11T00:17:56.838 INFO:tasks.workunit.client.0.smithi078.stdout:2/378: creat d0/d31/d38/f81 x:0 0 0 2024-09-11T00:17:56.838 INFO:tasks.workunit.client.0.smithi078.stdout:2/379: fsync d0/d19/d3d/f62 0 2024-09-11T00:17:56.839 INFO:tasks.workunit.client.0.smithi078.stdout:2/380: creat d0/d67/f82 x:0 0 0 2024-09-11T00:17:56.841 INFO:tasks.workunit.client.0.smithi078.stdout:2/381: rename d0/d1/d53 to d0/d1/d8/d83 0 2024-09-11T00:17:56.843 INFO:tasks.workunit.client.0.smithi078.stdout:2/382: creat d0/d1/d3b/f84 x:0 0 0 2024-09-11T00:17:56.845 INFO:tasks.workunit.client.0.smithi078.stdout:0/318: sync 2024-09-11T00:17:56.845 INFO:tasks.workunit.client.0.smithi078.stdout:0/319: fdatasync d2/f4 0 2024-09-11T00:17:56.845 INFO:tasks.workunit.client.0.smithi078.stdout:6/413: dread d0/d1/d9/f24 [0,4194304] 0 2024-09-11T00:17:56.846 INFO:tasks.workunit.client.0.smithi078.stdout:0/320: creat d2/d2a/f6b x:0 0 0 2024-09-11T00:17:56.850 INFO:tasks.workunit.client.0.smithi078.stdout:0/321: rename d2/d2a/d2c/d35/c4a to d2/d2a/d2c/d35/d59/d4f/d61/c6c 0 2024-09-11T00:17:56.850 INFO:tasks.workunit.client.0.smithi078.stdout:0/322: dread - d2/d2a/d2c/d35/d59/d4f/d61/d69/f5c zero size 2024-09-11T00:17:56.850 INFO:tasks.workunit.client.0.smithi078.stdout:0/323: truncate d2/d2a/d2c/d35/d59/d4f/d61/d69/f5c 213568 0 2024-09-11T00:17:56.851 INFO:tasks.workunit.client.0.smithi078.stdout:0/324: mknod d2/d2a/d2c/c6d 0 2024-09-11T00:17:56.852 INFO:tasks.workunit.client.0.smithi078.stdout:0/325: symlink d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/l6e 0 2024-09-11T00:17:56.852 INFO:tasks.workunit.client.0.smithi078.stdout:0/326: chown d2/l1e 157986958 1 2024-09-11T00:17:56.854 INFO:tasks.workunit.client.0.smithi078.stdout:0/327: dread d2/d2a/d2c/d35/d59/f54 [0,4194304] 0 2024-09-11T00:17:56.855 INFO:tasks.workunit.client.0.smithi078.stdout:0/328: mknod d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/c6f 0 2024-09-11T00:17:56.855 INFO:tasks.workunit.client.0.smithi078.stdout:0/329: dread - d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/f5f zero size 2024-09-11T00:17:56.856 INFO:tasks.workunit.client.0.smithi078.stdout:0/330: mknod d2/c70 0 2024-09-11T00:17:56.858 INFO:tasks.workunit.client.0.smithi078.stdout:0/331: mkdir d2/d2a/d2c/d35/d71 0 2024-09-11T00:17:56.858 INFO:tasks.workunit.client.0.smithi078.stdout:6/414: dwrite d0/d66/f7f [4194304,4194304] 0 2024-09-11T00:17:56.858 INFO:tasks.workunit.client.0.smithi078.stdout:6/415: fsync d0/d66/f7f 0 2024-09-11T00:17:56.860 INFO:tasks.workunit.client.0.smithi078.stdout:6/416: dread d0/f5a [0,4194304] 0 2024-09-11T00:17:56.865 INFO:tasks.workunit.client.0.smithi078.stdout:6/417: rename d0/d33/c5d to d0/d33/c92 0 2024-09-11T00:17:56.866 INFO:tasks.workunit.client.0.smithi078.stdout:6/418: symlink d0/d1/d9/d59/d74/l93 0 2024-09-11T00:17:56.872 INFO:tasks.workunit.client.0.smithi078.stdout:6/419: write d0/d1/f52 [3751059,72636] 0 2024-09-11T00:17:56.872 INFO:tasks.workunit.client.0.smithi078.stdout:0/332: dwrite d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/f5f [0,4194304] 0 2024-09-11T00:17:56.873 INFO:tasks.workunit.client.0.smithi078.stdout:6/420: mkdir d0/d1/d9/d54/d94 0 2024-09-11T00:17:56.876 INFO:tasks.workunit.client.0.smithi078.stdout:0/333: link d2/d2a/d2c/d35/d59/d4f/d61/d69/l17 d2/d2a/d2c/d35/d59/l72 0 2024-09-11T00:17:56.878 INFO:tasks.workunit.client.0.smithi078.stdout:6/421: rmdir d0/d1/d9/d54/d94 0 2024-09-11T00:17:56.879 INFO:tasks.workunit.client.0.smithi078.stdout:0/334: readlink d2/d2a/d2c/d35/l36 0 2024-09-11T00:17:56.881 INFO:tasks.workunit.client.0.smithi078.stdout:6/422: creat d0/d1/d9/d54/f95 x:0 0 0 2024-09-11T00:17:56.881 INFO:tasks.workunit.client.0.smithi078.stdout:6/423: write d0/f76 [2709,47619] 0 2024-09-11T00:17:56.882 INFO:tasks.workunit.client.0.smithi078.stdout:0/335: mkdir d2/d2a/d2c/d35/d59/d4f/d61/d69/d73 0 2024-09-11T00:17:56.883 INFO:tasks.workunit.client.0.smithi078.stdout:6/424: creat d0/d1/f96 x:0 0 0 2024-09-11T00:17:56.883 INFO:tasks.workunit.client.0.smithi078.stdout:0/336: read d2/d2a/d2c/d35/d59/d4f/d61/d69/f67 [242717,90801] 0 2024-09-11T00:17:56.885 INFO:tasks.workunit.client.0.smithi078.stdout:0/337: link d2/d2a/d2c/d35/d59/d4f/d61/d69/c34 d2/c74 0 2024-09-11T00:17:56.886 INFO:tasks.workunit.client.0.smithi078.stdout:6/425: mknod d0/c97 0 2024-09-11T00:17:56.889 INFO:tasks.workunit.client.0.smithi078.stdout:0/338: dread d2/d2a/d2c/d35/d59/f22 [0,4194304] 0 2024-09-11T00:17:56.900 INFO:tasks.workunit.client.0.smithi078.stdout:0/339: dwrite d2/d2a/d2c/d35/d59/f1b [4194304,4194304] 0 2024-09-11T00:17:56.902 INFO:tasks.workunit.client.0.smithi078.stdout:0/340: truncate d2/d2a/d2c/d35/d59/d7/f3b 206689 0 2024-09-11T00:17:56.903 INFO:tasks.workunit.client.0.smithi078.stdout:6/426: dwrite d0/d33/f3d [0,4194304] 0 2024-09-11T00:17:56.908 INFO:tasks.workunit.client.0.smithi078.stdout:6/427: creat d0/d1/f98 x:0 0 0 2024-09-11T00:17:56.909 INFO:tasks.workunit.client.0.smithi078.stdout:6/428: symlink d0/d66/l99 0 2024-09-11T00:17:56.910 INFO:tasks.workunit.client.0.smithi078.stdout:6/429: write d0/d33/f48 [1983363,97821] 0 2024-09-11T00:17:56.912 INFO:tasks.workunit.client.0.smithi078.stdout:6/430: dread d0/d1/f71 [0,4194304] 0 2024-09-11T00:17:56.913 INFO:tasks.workunit.client.0.smithi078.stdout:0/341: dwrite d2/d2a/d2c/f55 [0,4194304] 0 2024-09-11T00:17:56.917 INFO:tasks.workunit.client.0.smithi078.stdout:6/431: dread d0/d33/f4f [0,4194304] 0 2024-09-11T00:17:56.918 INFO:tasks.workunit.client.0.smithi078.stdout:6/432: readlink d0/l5 0 2024-09-11T00:17:56.918 INFO:tasks.workunit.client.0.smithi078.stdout:6/433: symlink d0/d1/d9/l9a 0 2024-09-11T00:17:56.925 INFO:tasks.workunit.client.0.smithi078.stdout:0/342: dwrite d2/d2a/d2c/d5e/f6a [0,4194304] 0 2024-09-11T00:17:56.927 INFO:tasks.workunit.client.0.smithi078.stdout:0/343: rename d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/f49 to d2/d2a/d2c/d35/d59/d4f/d61/f75 0 2024-09-11T00:17:56.937 INFO:tasks.workunit.client.0.smithi078.stdout:6/434: dread d0/d1/d9/d59/d74/f67 [0,4194304] 0 2024-09-11T00:17:56.940 INFO:tasks.workunit.client.0.smithi078.stdout:0/344: dwrite d2/d2a/d2c/d35/d59/d4f/d61/f75 [0,4194304] 0 2024-09-11T00:17:56.941 INFO:tasks.workunit.client.0.smithi078.stdout:0/345: creat d2/d2a/d2c/d35/d59/d4f/d61/f76 x:0 0 0 2024-09-11T00:17:56.942 INFO:tasks.workunit.client.0.smithi078.stdout:0/346: mkdir d2/d2a/d2c/d77 0 2024-09-11T00:17:56.943 INFO:tasks.workunit.client.0.smithi078.stdout:0/347: chown d2/d2a/d2c/d35/d59/d4f/d61/d69/f38 0 1 2024-09-11T00:17:56.943 INFO:tasks.workunit.client.0.smithi078.stdout:0/348: creat d2/d2a/d2c/d35/f78 x:0 0 0 2024-09-11T00:17:56.945 INFO:tasks.workunit.client.0.smithi078.stdout:0/349: creat d2/d2a/d2c/d35/f79 x:0 0 0 2024-09-11T00:17:56.945 INFO:tasks.workunit.client.0.smithi078.stdout:0/350: creat d2/d57/f7a x:0 0 0 2024-09-11T00:17:56.946 INFO:tasks.workunit.client.0.smithi078.stdout:0/351: mkdir d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b 0 2024-09-11T00:17:56.947 INFO:tasks.workunit.client.0.smithi078.stdout:0/352: write d2/d2a/d2c/d35/d59/d4f/d61/d69/f31 [1117099,25185] 0 2024-09-11T00:17:56.952 INFO:tasks.workunit.client.0.smithi078.stdout:0/353: dread d2/d2a/d2c/d5e/f6a [0,4194304] 0 2024-09-11T00:17:56.952 INFO:tasks.workunit.client.0.smithi078.stdout:0/354: dread - d2/d2a/d2c/d35/f78 zero size 2024-09-11T00:17:56.953 INFO:tasks.workunit.client.0.smithi078.stdout:0/355: truncate d2/d2a/d2c/d35/d59/d7/fa 6393819 0 2024-09-11T00:17:56.969 INFO:tasks.workunit.client.0.smithi078.stdout:0/356: dwrite d2/d2a/d2c/d35/d59/f54 [0,4194304] 0 2024-09-11T00:17:56.971 INFO:tasks.workunit.client.0.smithi078.stdout:0/357: creat d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/f7c x:0 0 0 2024-09-11T00:17:56.972 INFO:tasks.workunit.client.0.smithi078.stdout:0/358: rename d2/d2a/d2c/d35/d59/f1b to d2/d2a/d2c/d35/d59/d7/f7d 0 2024-09-11T00:17:56.973 INFO:tasks.workunit.client.0.smithi078.stdout:0/359: rename d2/d2a/d2c/d35/d59/d4f/d61/d69/c21 to d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/c7e 0 2024-09-11T00:17:56.980 INFO:tasks.workunit.client.0.smithi078.stdout:0/360: dread d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/f5f [0,4194304] 0 2024-09-11T00:17:56.982 INFO:tasks.workunit.client.0.smithi078.stdout:0/361: creat d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/f7f x:0 0 0 2024-09-11T00:17:56.983 INFO:tasks.workunit.client.0.smithi078.stdout:0/362: creat d2/d2a/d2c/d35/d59/d4f/f80 x:0 0 0 2024-09-11T00:17:56.984 INFO:tasks.workunit.client.0.smithi078.stdout:0/363: fsync d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/f5f 0 2024-09-11T00:17:56.984 INFO:tasks.workunit.client.0.smithi078.stdout:0/364: chown d2/d2a/d2c/d35/d59/c3c 7343 1 2024-09-11T00:17:56.995 INFO:tasks.workunit.client.0.smithi078.stdout:0/365: dwrite d2/d2a/d2c/d35/d59/d7/f50 [0,4194304] 0 2024-09-11T00:17:56.996 INFO:tasks.workunit.client.0.smithi078.stdout:0/366: read d2/d2a/d2c/d35/d59/d7/f3b [191407,82881] 0 2024-09-11T00:17:56.996 INFO:tasks.workunit.client.0.smithi078.stdout:0/367: dread - d2/d2a/d2c/d35/f79 zero size 2024-09-11T00:17:57.018 INFO:tasks.workunit.client.0.smithi078.stdout:5/306: sync 2024-09-11T00:17:57.018 INFO:tasks.workunit.client.0.smithi078.stdout:3/356: sync 2024-09-11T00:17:57.018 INFO:tasks.workunit.client.0.smithi078.stdout:4/445: sync 2024-09-11T00:17:57.018 INFO:tasks.workunit.client.0.smithi078.stdout:5/307: chown d7/d8/d33/d22/d25/d28/d24/c1b 9 1 2024-09-11T00:17:57.018 INFO:tasks.workunit.client.0.smithi078.stdout:1/468: sync 2024-09-11T00:17:57.019 INFO:tasks.workunit.client.0.smithi078.stdout:3/357: truncate d0/f1f 4830912 0 2024-09-11T00:17:57.019 INFO:tasks.workunit.client.0.smithi078.stdout:4/446: mknod dc/d10/d40/d3a/d3b/c98 0 2024-09-11T00:17:57.021 INFO:tasks.workunit.client.0.smithi078.stdout:5/308: creat d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d5b/f76 x:0 0 0 2024-09-11T00:17:57.021 INFO:tasks.workunit.client.0.smithi078.stdout:5/309: write d7/d8/de/f10 [304291,66105] 0 2024-09-11T00:17:57.022 INFO:tasks.workunit.client.0.smithi078.stdout:1/469: creat d3/d29/d5f/d4e/f8f x:0 0 0 2024-09-11T00:17:57.022 INFO:tasks.workunit.client.0.smithi078.stdout:1/470: getdents d3/d29/d5f/d4e/d8c 0 2024-09-11T00:17:57.022 INFO:tasks.workunit.client.0.smithi078.stdout:1/471: fdatasync d3/d29/d5f/d4e/f89 0 2024-09-11T00:17:57.025 INFO:tasks.workunit.client.0.smithi078.stdout:1/472: mkdir d3/d1a/d21/d4a/d90 0 2024-09-11T00:17:57.031 INFO:tasks.workunit.client.0.smithi078.stdout:5/310: write d7/d8/d33/d22/d25/d28/d24/f4d [2789893,54457] 0 2024-09-11T00:17:57.033 INFO:tasks.workunit.client.0.smithi078.stdout:5/311: creat d7/d8/f77 x:0 0 0 2024-09-11T00:17:57.035 INFO:tasks.workunit.client.0.smithi078.stdout:3/358: dwrite d0/d7/d18/f40 [4194304,4194304] 0 2024-09-11T00:17:57.039 INFO:tasks.workunit.client.0.smithi078.stdout:4/447: dwrite dc/d10/d1f/f53 [0,4194304] 0 2024-09-11T00:17:57.039 INFO:tasks.workunit.client.0.smithi078.stdout:4/448: chown dc/d10/d40/d3a/d46/d59/f77 74113869 1 2024-09-11T00:17:57.039 INFO:tasks.workunit.client.0.smithi078.stdout:4/449: truncate dc/d10/d40/d33/f84 1797596 0 2024-09-11T00:17:57.041 INFO:tasks.workunit.client.0.smithi078.stdout:1/473: dwrite d3/d29/d5f/f27 [0,4194304] 0 2024-09-11T00:17:57.042 INFO:tasks.workunit.client.0.smithi078.stdout:1/474: creat d3/d1a/d21/d88/f91 x:0 0 0 2024-09-11T00:17:57.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:56 smithi138 ceph-mon[35019]: pgmap v367: 97 pgs: 97 active+clean; 461 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 28 MiB/s rd, 45 MiB/s wr, 428 op/s 2024-09-11T00:17:57.044 INFO:tasks.workunit.client.0.smithi078.stdout:1/475: unlink d3/l7c 0 2024-09-11T00:17:57.044 INFO:tasks.workunit.client.0.smithi078.stdout:1/476: chown d3/d1a/d21/l26 800429 1 2024-09-11T00:17:57.045 INFO:tasks.workunit.client.0.smithi078.stdout:1/477: creat d3/d1a/d21/d4a/d90/f92 x:0 0 0 2024-09-11T00:17:57.046 INFO:tasks.workunit.client.0.smithi078.stdout:1/478: creat d3/d29/f93 x:0 0 0 2024-09-11T00:17:57.047 INFO:tasks.workunit.client.0.smithi078.stdout:1/479: chown d3/d29/d5f/c32 177 1 2024-09-11T00:17:57.051 INFO:tasks.workunit.client.0.smithi078.stdout:5/312: dwrite d7/d8/de/ff [0,4194304] 0 2024-09-11T00:17:57.051 INFO:tasks.workunit.client.0.smithi078.stdout:5/313: chown d7/d8/d56/d2a 1301 1 2024-09-11T00:17:57.052 INFO:tasks.workunit.client.0.smithi078.stdout:5/314: symlink d7/d8/de/d2c/d62/l78 0 2024-09-11T00:17:57.052 INFO:tasks.workunit.client.0.smithi078.stdout:5/315: readlink d7/d8/d33/d22/d25/l54 0 2024-09-11T00:17:57.053 INFO:tasks.workunit.client.0.smithi078.stdout:5/316: mknod d7/d8/de/d2c/d62/c79 0 2024-09-11T00:17:57.055 INFO:tasks.workunit.client.0.smithi078.stdout:1/480: read d3/d29/d5f/d39/d61/f8b [907099,65146] 0 2024-09-11T00:17:57.057 INFO:tasks.workunit.client.0.smithi078.stdout:1/481: mkdir d3/d1a/d21/d4a/d94 0 2024-09-11T00:17:57.057 INFO:tasks.workunit.client.0.smithi078.stdout:1/482: fsync d3/d29/d45/f60 0 2024-09-11T00:17:57.057 INFO:tasks.workunit.client.0.smithi078.stdout:1/483: write d3/fc [13268403,101027] 0 2024-09-11T00:17:57.058 INFO:tasks.workunit.client.0.smithi078.stdout:5/317: dread d7/d8/d33/d22/d25/d28/d24/d1c/f2e [0,4194304] 0 2024-09-11T00:17:57.063 INFO:tasks.workunit.client.0.smithi078.stdout:1/484: dread d3/d29/f34 [0,4194304] 0 2024-09-11T00:17:57.064 INFO:tasks.workunit.client.0.smithi078.stdout:1/485: rmdir d3/d29/d45 39 2024-09-11T00:17:57.065 INFO:tasks.workunit.client.0.smithi078.stdout:1/486: link d3/d1a/d21/d4a/l74 d3/d1a/d21/d88/l95 0 2024-09-11T00:17:57.065 INFO:tasks.workunit.client.0.smithi078.stdout:5/318: write d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f59 [3545045,95793] 0 2024-09-11T00:17:57.067 INFO:tasks.workunit.client.0.smithi078.stdout:5/319: creat d7/d8/d33/d22/f7a x:0 0 0 2024-09-11T00:17:57.067 INFO:tasks.workunit.client.0.smithi078.stdout:5/320: truncate d7/d8/d56/f5d 536893 0 2024-09-11T00:17:57.070 INFO:tasks.workunit.client.0.smithi078.stdout:1/487: getdents d3/d1a/d21/d4a 0 2024-09-11T00:17:57.073 INFO:tasks.workunit.client.0.smithi078.stdout:5/321: getdents d7/d8/d33/d22 0 2024-09-11T00:17:57.073 INFO:tasks.workunit.client.0.smithi078.stdout:5/322: read d7/d8/d33/d22/d25/f3a [419144,52202] 0 2024-09-11T00:17:57.073 INFO:tasks.workunit.client.0.smithi078.stdout:5/323: write d7/d8/d33/d22/d25/d28/f31 [670614,99997] 0 2024-09-11T00:17:57.074 INFO:tasks.workunit.client.0.smithi078.stdout:5/324: stat d7/d8/d33/d22/d25/d28/d24/d1c/l3f 0 2024-09-11T00:17:57.074 INFO:tasks.workunit.client.0.smithi078.stdout:5/325: fdatasync d7/d8/d56/d2a/f35 0 2024-09-11T00:17:57.075 INFO:tasks.workunit.client.0.smithi078.stdout:5/326: mknod d7/d8/de/c7b 0 2024-09-11T00:17:57.079 INFO:tasks.workunit.client.0.smithi078.stdout:5/327: write d7/d8/d33/d22/d25/f45 [3654779,24925] 0 2024-09-11T00:17:57.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:56 smithi078 ceph-mon[30865]: pgmap v367: 97 pgs: 97 active+clean; 461 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 28 MiB/s rd, 45 MiB/s wr, 428 op/s 2024-09-11T00:17:57.086 INFO:tasks.workunit.client.0.smithi078.stdout:1/488: dwrite d3/d1a/d21/f4b [0,4194304] 0 2024-09-11T00:17:57.101 INFO:tasks.workunit.client.0.smithi078.stdout:1/489: dwrite d3/d1a/d21/f8d [0,4194304] 0 2024-09-11T00:17:57.101 INFO:tasks.workunit.client.0.smithi078.stdout:1/490: chown d3/d29/d5f/d39/l59 134558439 1 2024-09-11T00:17:57.102 INFO:tasks.workunit.client.0.smithi078.stdout:1/491: chown d3/d29/d45/c6a 13 1 2024-09-11T00:17:57.102 INFO:tasks.workunit.client.0.smithi078.stdout:1/492: mkdir d3/d29/d5f/d39/d61/d96 0 2024-09-11T00:17:57.104 INFO:tasks.workunit.client.0.smithi078.stdout:1/493: mknod d3/d1a/d21/d88/c97 0 2024-09-11T00:17:57.105 INFO:tasks.workunit.client.0.smithi078.stdout:1/494: getdents d3/d29/d5f/d4e 0 2024-09-11T00:17:57.105 INFO:tasks.workunit.client.0.smithi078.stdout:1/495: write d3/d1a/d21/d4a/f66 [153733,85299] 0 2024-09-11T00:17:57.105 INFO:tasks.workunit.client.0.smithi078.stdout:1/496: fdatasync d3/d1a/d21/d4a/d90/f92 0 2024-09-11T00:17:57.105 INFO:tasks.workunit.client.0.smithi078.stdout:1/497: write d3/d1a/d21/d4a/d90/f92 [544176,53187] 0 2024-09-11T00:17:57.105 INFO:tasks.workunit.client.0.smithi078.stdout:7/395: sync 2024-09-11T00:17:57.105 INFO:tasks.workunit.client.0.smithi078.stdout:9/376: sync 2024-09-11T00:17:57.105 INFO:tasks.workunit.client.0.smithi078.stdout:8/437: sync 2024-09-11T00:17:57.105 INFO:tasks.workunit.client.0.smithi078.stdout:2/383: sync 2024-09-11T00:17:57.106 INFO:tasks.workunit.client.0.smithi078.stdout:8/438: chown da/d13/d1b/d4e/c5e 85121531 1 2024-09-11T00:17:57.106 INFO:tasks.workunit.client.0.smithi078.stdout:2/384: chown d0/d1/d11/d1b/c49 546857 1 2024-09-11T00:17:57.106 INFO:tasks.workunit.client.0.smithi078.stdout:1/498: creat d3/d29/d5f/d4e/f98 x:0 0 0 2024-09-11T00:17:57.107 INFO:tasks.workunit.client.0.smithi078.stdout:7/396: creat d0/d34/db/d32/f72 x:0 0 0 2024-09-11T00:17:57.107 INFO:tasks.workunit.client.0.smithi078.stdout:7/397: truncate d0/d34/db/f5c 581246 0 2024-09-11T00:17:57.107 INFO:tasks.workunit.client.0.smithi078.stdout:7/398: write d0/d34/db/d30/d1d/d14/f41 [1761612,101832] 0 2024-09-11T00:17:57.107 INFO:tasks.workunit.client.0.smithi078.stdout:7/399: dread - d0/d34/d65/f71 zero size 2024-09-11T00:17:57.107 INFO:tasks.workunit.client.0.smithi078.stdout:7/400: fdatasync d0/f63 0 2024-09-11T00:17:57.107 INFO:tasks.workunit.client.0.smithi078.stdout:7/401: getdents d0/d34/d57 0 2024-09-11T00:17:57.107 INFO:tasks.workunit.client.0.smithi078.stdout:9/377: symlink dc/l88 0 2024-09-11T00:17:57.108 INFO:tasks.workunit.client.0.smithi078.stdout:8/439: mkdir da/d13/d1b/d24/d86 0 2024-09-11T00:17:57.108 INFO:tasks.workunit.client.0.smithi078.stdout:8/440: fsync da/f10 0 2024-09-11T00:17:57.108 INFO:tasks.workunit.client.0.smithi078.stdout:8/441: chown da/d1c/d4c 106995285 1 2024-09-11T00:17:57.109 INFO:tasks.workunit.client.0.smithi078.stdout:7/402: unlink d0/d34/db/f2e 0 2024-09-11T00:17:57.111 INFO:tasks.workunit.client.0.smithi078.stdout:9/378: creat dc/d12/d20/d58/d5a/d76/f89 x:0 0 0 2024-09-11T00:17:57.112 INFO:tasks.workunit.client.0.smithi078.stdout:8/442: unlink da/d13/l3e 0 2024-09-11T00:17:57.113 INFO:tasks.workunit.client.0.smithi078.stdout:9/379: getdents dc/d12/d20/d85 0 2024-09-11T00:17:57.113 INFO:tasks.workunit.client.0.smithi078.stdout:9/380: fsync dc/d12/d20/d30/f4b 0 2024-09-11T00:17:57.117 INFO:tasks.workunit.client.0.smithi078.stdout:9/381: dread dc/d12/f17 [4194304,4194304] 0 2024-09-11T00:17:57.119 INFO:tasks.workunit.client.0.smithi078.stdout:2/385: dread d0/d1/d6/f37 [4194304,4194304] 0 2024-09-11T00:17:57.120 INFO:tasks.workunit.client.0.smithi078.stdout:1/499: dwrite d3/f71 [0,4194304] 0 2024-09-11T00:17:57.121 INFO:tasks.workunit.client.0.smithi078.stdout:2/386: creat d0/d1/d8/d83/f85 x:0 0 0 2024-09-11T00:17:57.124 INFO:tasks.workunit.client.0.smithi078.stdout:2/387: truncate d0/d1/d8/f21 430167 0 2024-09-11T00:17:57.125 INFO:tasks.workunit.client.0.smithi078.stdout:1/500: rename d3/d1a/l13 to d3/d29/d5f/d39/d61/d96/l99 0 2024-09-11T00:17:57.126 INFO:tasks.workunit.client.0.smithi078.stdout:2/388: mkdir d0/d1/d33/d86 0 2024-09-11T00:17:57.129 INFO:tasks.workunit.client.0.smithi078.stdout:1/501: unlink d3/c14 0 2024-09-11T00:17:57.131 INFO:tasks.workunit.client.0.smithi078.stdout:7/403: dwrite d0/d34/db/d30/f3e [4194304,4194304] 0 2024-09-11T00:17:57.131 INFO:tasks.workunit.client.0.smithi078.stdout:1/502: rmdir d3/d29/d45 39 2024-09-11T00:17:57.133 INFO:tasks.workunit.client.0.smithi078.stdout:2/389: rename d0/d1/d8/f30 to d0/d1/d6/f87 0 2024-09-11T00:17:57.134 INFO:tasks.workunit.client.0.smithi078.stdout:7/404: link d0/d3f/c4e d0/d3f/c73 0 2024-09-11T00:17:57.135 INFO:tasks.workunit.client.0.smithi078.stdout:1/503: dread - d3/d1a/f82 zero size 2024-09-11T00:17:57.135 INFO:tasks.workunit.client.0.smithi078.stdout:7/405: dread d0/d34/db/d30/d28/f6a [0,4194304] 0 2024-09-11T00:17:57.136 INFO:tasks.workunit.client.0.smithi078.stdout:2/390: symlink d0/d1/d8/d83/l88 0 2024-09-11T00:17:57.139 INFO:tasks.workunit.client.0.smithi078.stdout:2/391: creat d0/d1/d3c/d40/d50/f89 x:0 0 0 2024-09-11T00:17:57.141 INFO:tasks.workunit.client.0.smithi078.stdout:2/392: mkdir d0/d1/d11/d1b/d1e/d8a 0 2024-09-11T00:17:57.141 INFO:tasks.workunit.client.0.smithi078.stdout:9/382: dwrite dc/d12/d20/d85/d3e/f6d [0,4194304] 0 2024-09-11T00:17:57.143 INFO:tasks.workunit.client.0.smithi078.stdout:2/393: link d0/d1/d11/d1b/c2e d0/d1/d11/d1b/d1e/d8a/c8b 0 2024-09-11T00:17:57.143 INFO:tasks.workunit.client.0.smithi078.stdout:2/394: truncate d0/d1/d3c/f45 3079279 0 2024-09-11T00:17:57.146 INFO:tasks.workunit.client.0.smithi078.stdout:7/406: dread d0/d34/db/d30/f52 [0,4194304] 0 2024-09-11T00:17:57.146 INFO:tasks.workunit.client.0.smithi078.stdout:7/407: chown d0/f63 1964415 1 2024-09-11T00:17:57.148 INFO:tasks.workunit.client.0.smithi078.stdout:8/443: dwrite da/d13/d19/f35 [4194304,4194304] 0 2024-09-11T00:17:57.149 INFO:tasks.workunit.client.0.smithi078.stdout:9/383: symlink dc/d12/d20/d58/d5b/l8a 0 2024-09-11T00:17:57.149 INFO:tasks.workunit.client.0.smithi078.stdout:9/384: dread - dc/d12/d20/d58/f73 zero size 2024-09-11T00:17:57.149 INFO:tasks.workunit.client.0.smithi078.stdout:9/385: chown dc/d12/f17 1 1 2024-09-11T00:17:57.150 INFO:tasks.workunit.client.0.smithi078.stdout:2/395: dread d0/d1/d11/f24 [0,4194304] 0 2024-09-11T00:17:57.150 INFO:tasks.workunit.client.0.smithi078.stdout:1/504: dwrite d3/d1a/d21/f24 [4194304,4194304] 0 2024-09-11T00:17:57.150 INFO:tasks.workunit.client.0.smithi078.stdout:1/505: fdatasync d3/d29/d45/f56 0 2024-09-11T00:17:57.153 INFO:tasks.workunit.client.0.smithi078.stdout:9/386: creat dc/d12/d20/d58/f8b x:0 0 0 2024-09-11T00:17:57.155 INFO:tasks.workunit.client.0.smithi078.stdout:1/506: write d3/d29/d5f/d4e/f86 [780286,115299] 0 2024-09-11T00:17:57.155 INFO:tasks.workunit.client.0.smithi078.stdout:1/507: chown d3/d29/d5f/d39/f6f 0 1 2024-09-11T00:17:57.156 INFO:tasks.workunit.client.0.smithi078.stdout:7/408: rename d0/d34/d6d to d0/d34/db/d30/d1d/d74 0 2024-09-11T00:17:57.160 INFO:tasks.workunit.client.0.smithi078.stdout:9/387: mkdir dc/d12/d20/d58/d5a/d76/d8c 0 2024-09-11T00:17:57.161 INFO:tasks.workunit.client.0.smithi078.stdout:1/508: creat d3/d1a/d21/f9a x:0 0 0 2024-09-11T00:17:57.163 INFO:tasks.workunit.client.0.smithi078.stdout:8/444: rename da/d13/d28 to da/d87 0 2024-09-11T00:17:57.165 INFO:tasks.workunit.client.0.smithi078.stdout:9/388: unlink dc/l1a 0 2024-09-11T00:17:57.165 INFO:tasks.workunit.client.0.smithi078.stdout:9/389: write dc/f1c [5522868,105523] 0 2024-09-11T00:17:57.167 INFO:tasks.workunit.client.0.smithi078.stdout:2/396: rename d0/d1/d8/l14 to d0/d1/d6/d52/l8c 0 2024-09-11T00:17:57.174 INFO:tasks.workunit.client.0.smithi078.stdout:9/390: truncate dc/d12/d20/d85/d3e/f6d 4097397 0 2024-09-11T00:17:57.174 INFO:tasks.workunit.client.0.smithi078.stdout:1/509: creat d3/d29/d5f/d4e/d8c/f9b x:0 0 0 2024-09-11T00:17:57.174 INFO:tasks.workunit.client.0.smithi078.stdout:0/368: sync 2024-09-11T00:17:57.174 INFO:tasks.workunit.client.0.smithi078.stdout:6/435: sync 2024-09-11T00:17:57.174 INFO:tasks.workunit.client.0.smithi078.stdout:0/369: fdatasync d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/f7c 0 2024-09-11T00:17:57.174 INFO:tasks.workunit.client.0.smithi078.stdout:2/397: mkdir d0/d19/d3d/d8d 0 2024-09-11T00:17:57.174 INFO:tasks.workunit.client.0.smithi078.stdout:9/391: symlink dc/d12/d20/d85/d3e/l8d 0 2024-09-11T00:17:57.177 INFO:tasks.workunit.client.0.smithi078.stdout:6/436: rmdir d0/d1/d9/d54/d83 0 2024-09-11T00:17:57.177 INFO:tasks.workunit.client.0.smithi078.stdout:9/392: dread dc/d12/d20/d58/d5b/f87 [0,4194304] 0 2024-09-11T00:17:57.177 INFO:tasks.workunit.client.0.smithi078.stdout:9/393: truncate dc/d12/d20/d58/d5b/f84 483810 0 2024-09-11T00:17:57.178 INFO:tasks.workunit.client.0.smithi078.stdout:0/370: symlink d2/d2a/d2c/d35/d59/d4f/d61/d69/l81 0 2024-09-11T00:17:57.178 INFO:tasks.workunit.client.0.smithi078.stdout:0/371: read - d2/d2a/d2c/d35/d59/d4f/f80 zero size 2024-09-11T00:17:57.179 INFO:tasks.workunit.client.0.smithi078.stdout:9/394: getdents dc/d12/d20/d58 0 2024-09-11T00:17:57.179 INFO:tasks.workunit.client.0.smithi078.stdout:9/395: dread - dc/d12/f64 zero size 2024-09-11T00:17:57.182 INFO:tasks.workunit.client.0.smithi078.stdout:0/372: creat d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/f82 x:0 0 0 2024-09-11T00:17:57.182 INFO:tasks.workunit.client.0.smithi078.stdout:0/373: write d2/d2a/d2c/d35/f46 [1341939,32062] 0 2024-09-11T00:17:57.182 INFO:tasks.workunit.client.0.smithi078.stdout:6/437: dread d0/d1/d9/f15 [0,4194304] 0 2024-09-11T00:17:57.183 INFO:tasks.workunit.client.0.smithi078.stdout:6/438: chown d0/d1/d53/f88 68 1 2024-09-11T00:17:57.183 INFO:tasks.workunit.client.0.smithi078.stdout:6/439: chown d0/d1/d9/d17/d5e/f85 704162221 1 2024-09-11T00:17:57.184 INFO:tasks.workunit.client.0.smithi078.stdout:8/445: dwrite da/d13/d19/f52 [4194304,4194304] 0 2024-09-11T00:17:57.184 INFO:tasks.workunit.client.0.smithi078.stdout:0/374: unlink d2/d2a/d2c/d35/d59/d7/f2b 0 2024-09-11T00:17:57.184 INFO:tasks.workunit.client.0.smithi078.stdout:0/375: dread - d2/d2a/d2c/d35/d59/f64 zero size 2024-09-11T00:17:57.184 INFO:tasks.workunit.client.0.smithi078.stdout:0/376: stat d2/d2a/d2c/d35/d59/d7/f13 0 2024-09-11T00:17:57.184 INFO:tasks.workunit.client.0.smithi078.stdout:0/377: dread - d2/d2a/d2c/d35/d59/d4f/f80 zero size 2024-09-11T00:17:57.185 INFO:tasks.workunit.client.0.smithi078.stdout:1/510: read d3/d1a/d21/d4a/f7f [1843135,104970] 0 2024-09-11T00:17:57.186 INFO:tasks.workunit.client.0.smithi078.stdout:8/446: creat da/d13/d1b/f88 x:0 0 0 2024-09-11T00:17:57.186 INFO:tasks.workunit.client.0.smithi078.stdout:8/447: dread - da/d13/d1b/d24/d62/f69 zero size 2024-09-11T00:17:57.186 INFO:tasks.workunit.client.0.smithi078.stdout:8/448: truncate da/f14 4598712 0 2024-09-11T00:17:57.187 INFO:tasks.workunit.client.0.smithi078.stdout:0/378: creat d2/d2a/d2c/d35/d71/f83 x:0 0 0 2024-09-11T00:17:57.191 INFO:tasks.workunit.client.0.smithi078.stdout:1/511: creat d3/d1a/f9c x:0 0 0 2024-09-11T00:17:57.192 INFO:tasks.workunit.client.0.smithi078.stdout:8/449: unlink da/d1c/c44 0 2024-09-11T00:17:57.193 INFO:tasks.workunit.client.0.smithi078.stdout:0/379: rename d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/c2e to d2/d2a/d2c/d35/d59/d4f/d61/d69/c84 0 2024-09-11T00:17:57.193 INFO:tasks.workunit.client.0.smithi078.stdout:9/396: dwrite dc/d12/d20/f32 [0,4194304] 0 2024-09-11T00:17:57.194 INFO:tasks.workunit.client.0.smithi078.stdout:1/512: rename d3/d1a/l5b to d3/d29/d5f/d4e/d8c/l9d 0 2024-09-11T00:17:57.194 INFO:tasks.workunit.client.0.smithi078.stdout:0/380: truncate d2/f16 3462608 0 2024-09-11T00:17:57.196 INFO:tasks.workunit.client.0.smithi078.stdout:9/397: dread dc/d12/d20/d85/f3b [0,4194304] 0 2024-09-11T00:17:57.196 INFO:tasks.workunit.client.0.smithi078.stdout:1/513: rename d3/f1e to d3/d29/d5f/d4e/d8c/f9e 0 2024-09-11T00:17:57.197 INFO:tasks.workunit.client.0.smithi078.stdout:0/381: creat d2/d2a/d2c/d35/d59/d4f/f85 x:0 0 0 2024-09-11T00:17:57.198 INFO:tasks.workunit.client.0.smithi078.stdout:0/382: dread d2/d2a/d2c/d35/d59/d7/f3b [0,4194304] 0 2024-09-11T00:17:57.198 INFO:tasks.workunit.client.0.smithi078.stdout:1/514: creat d3/d29/d5f/d39/d61/d96/f9f x:0 0 0 2024-09-11T00:17:57.209 INFO:tasks.workunit.client.0.smithi078.stdout:8/450: read da/d13/d19/f52 [6690349,47969] 0 2024-09-11T00:17:57.209 INFO:tasks.workunit.client.0.smithi078.stdout:8/451: rmdir da 39 2024-09-11T00:17:57.210 INFO:tasks.workunit.client.0.smithi078.stdout:8/452: link da/d1c/d60/d85/c73 da/d87/d7b/c89 0 2024-09-11T00:17:57.212 INFO:tasks.workunit.client.0.smithi078.stdout:8/453: creat da/d13/d1b/d24/d62/f8a x:0 0 0 2024-09-11T00:17:57.214 INFO:tasks.workunit.client.0.smithi078.stdout:8/454: creat da/d13/d1b/d59/d68/d82/f8b x:0 0 0 2024-09-11T00:17:57.216 INFO:tasks.workunit.client.0.smithi078.stdout:0/383: write d2/d2a/d2c/d35/d59/d7/f14 [68813,47236] 0 2024-09-11T00:17:57.218 INFO:tasks.workunit.client.0.smithi078.stdout:1/515: dwrite d3/d1a/f2d [0,4194304] 0 2024-09-11T00:17:57.218 INFO:tasks.workunit.client.0.smithi078.stdout:1/516: stat d3/d29/d5f/d39/c41 0 2024-09-11T00:17:57.219 INFO:tasks.workunit.client.0.smithi078.stdout:1/517: truncate d3/d29/d5f/d39/f63 1120134 0 2024-09-11T00:17:57.219 INFO:tasks.workunit.client.0.smithi078.stdout:1/518: dread - d3/d29/d5f/d39/d61/f79 zero size 2024-09-11T00:17:57.219 INFO:tasks.workunit.client.0.smithi078.stdout:0/384: truncate d2/d2a/d2c/d35/d59/d7/f50 1938570 0 2024-09-11T00:17:57.219 INFO:tasks.workunit.client.0.smithi078.stdout:0/385: chown d2/d2a/d2c/d35/d59/d4f/d61/c6c 2846 1 2024-09-11T00:17:57.220 INFO:tasks.workunit.client.0.smithi078.stdout:0/386: creat d2/d2a/d2c/d35/d59/d7/f86 x:0 0 0 2024-09-11T00:17:57.220 INFO:tasks.workunit.client.0.smithi078.stdout:0/387: write d2/d2a/d2c/d35/d59/d7/f86 [539296,42425] 0 2024-09-11T00:17:57.220 INFO:tasks.workunit.client.0.smithi078.stdout:0/388: truncate d2/d2a/d2c/d5e/f68 820436 0 2024-09-11T00:17:57.222 INFO:tasks.workunit.client.0.smithi078.stdout:0/389: link d2/c74 d2/d2a/d2c/d5e/c87 0 2024-09-11T00:17:57.222 INFO:tasks.workunit.client.0.smithi078.stdout:0/390: fsync d2/d2a/d2c/f55 0 2024-09-11T00:17:57.223 INFO:tasks.workunit.client.0.smithi078.stdout:9/398: dwrite dc/d12/d20/d58/d5a/d76/f89 [0,4194304] 0 2024-09-11T00:17:57.223 INFO:tasks.workunit.client.0.smithi078.stdout:9/399: fdatasync dc/d12/d20/d58/d5a/f81 0 2024-09-11T00:17:57.231 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:56 smithi112 ceph-mon[35627]: pgmap v367: 97 pgs: 97 active+clean; 461 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 28 MiB/s rd, 45 MiB/s wr, 428 op/s 2024-09-11T00:17:57.234 INFO:tasks.workunit.client.0.smithi078.stdout:1/519: write d3/d1a/d21/f4b [698207,66408] 0 2024-09-11T00:17:57.234 INFO:tasks.workunit.client.0.smithi078.stdout:8/455: dwrite da/d87/d3a/f81 [0,4194304] 0 2024-09-11T00:17:57.244 INFO:tasks.workunit.client.0.smithi078.stdout:9/400: dwrite dc/d12/d20/d30/f4b [0,4194304] 0 2024-09-11T00:17:57.246 INFO:tasks.workunit.client.0.smithi078.stdout:9/401: getdents dc/d12/d20/d58/d5a 0 2024-09-11T00:17:57.247 INFO:tasks.workunit.client.0.smithi078.stdout:9/402: getdents dc/d12/d20/d58/d5b/d68 0 2024-09-11T00:17:57.247 INFO:tasks.workunit.client.0.smithi078.stdout:9/403: chown dc/d12/d20/d58/d5b/l7c 20 1 2024-09-11T00:17:57.252 INFO:tasks.workunit.client.0.smithi078.stdout:1/520: dwrite d3/d1a/d21/d4a/f65 [4194304,4194304] 0 2024-09-11T00:17:57.254 INFO:tasks.workunit.client.0.smithi078.stdout:8/456: dread da/d13/d19/f35 [0,4194304] 0 2024-09-11T00:17:57.255 INFO:tasks.workunit.client.0.smithi078.stdout:8/457: read da/d13/f2c [205982,124334] 0 2024-09-11T00:17:57.256 INFO:tasks.workunit.client.0.smithi078.stdout:0/391: dwrite d2/d2a/f2f [0,4194304] 0 2024-09-11T00:17:57.256 INFO:tasks.workunit.client.0.smithi078.stdout:0/392: chown d2/d2a/d2c/d35/d59/d4f/d61/d69/d73 2110 1 2024-09-11T00:17:57.258 INFO:tasks.workunit.client.0.smithi078.stdout:8/458: dread da/d1c/f78 [0,4194304] 0 2024-09-11T00:17:57.258 INFO:tasks.workunit.client.0.smithi078.stdout:8/459: fdatasync da/d13/d1b/d59/f57 0 2024-09-11T00:17:57.259 INFO:tasks.workunit.client.0.smithi078.stdout:8/460: write da/d13/d1b/f4a [1698026,130042] 0 2024-09-11T00:17:57.259 INFO:tasks.workunit.client.0.smithi078.stdout:8/461: read da/f2a [148581,102266] 0 2024-09-11T00:17:57.262 INFO:tasks.workunit.client.0.smithi078.stdout:0/393: creat d2/d57/f88 x:0 0 0 2024-09-11T00:17:57.262 INFO:tasks.workunit.client.0.smithi078.stdout:0/394: readlink d2/d2a/d2c/d35/d59/d4f/d61/d69/l58 0 2024-09-11T00:17:57.262 INFO:tasks.workunit.client.0.smithi078.stdout:0/395: write d2/d2a/d2c/d35/d59/d7/f15 [5158729,14888] 0 2024-09-11T00:17:57.263 INFO:tasks.workunit.client.0.smithi078.stdout:8/462: creat da/d13/f8c x:0 0 0 2024-09-11T00:17:57.263 INFO:tasks.workunit.client.0.smithi078.stdout:9/404: dwrite f7 [8388608,4194304] 0 2024-09-11T00:17:57.263 INFO:tasks.workunit.client.0.smithi078.stdout:1/521: dread d3/d1a/ff [4194304,4194304] 0 2024-09-11T00:17:57.264 INFO:tasks.workunit.client.0.smithi078.stdout:0/396: symlink d2/d2a/d2c/d35/d71/l89 0 2024-09-11T00:17:57.264 INFO:tasks.workunit.client.0.smithi078.stdout:8/463: mknod da/d13/c8d 0 2024-09-11T00:17:57.265 INFO:tasks.workunit.client.0.smithi078.stdout:9/405: getdents dc/d12/d20/d30 0 2024-09-11T00:17:57.266 INFO:tasks.workunit.client.0.smithi078.stdout:9/406: chown dc/d12/d20/d50 10 1 2024-09-11T00:17:57.266 INFO:tasks.workunit.client.0.smithi078.stdout:9/407: truncate dc/d12/d54/f57 782207 0 2024-09-11T00:17:57.267 INFO:tasks.workunit.client.0.smithi078.stdout:0/397: rmdir d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56 39 2024-09-11T00:17:57.267 INFO:tasks.workunit.client.0.smithi078.stdout:0/398: chown d2/d2a/d2c/d35/d59/d4f/d61/d69/c34 89153586 1 2024-09-11T00:17:57.267 INFO:tasks.workunit.client.0.smithi078.stdout:0/399: dread - d2/d2a/d2c/d35/d59/d4f/d61/d69/f63 zero size 2024-09-11T00:17:57.268 INFO:tasks.workunit.client.0.smithi078.stdout:8/464: unlink da/d13/d1b/c5b 0 2024-09-11T00:17:57.269 INFO:tasks.workunit.client.0.smithi078.stdout:1/522: creat d3/d1a/d21/d88/fa0 x:0 0 0 2024-09-11T00:17:57.271 INFO:tasks.workunit.client.0.smithi078.stdout:0/400: rename d2/d2a/d2c/d35/d59/l72 to d2/d2a/d2c/d77/l8a 0 2024-09-11T00:17:57.272 INFO:tasks.workunit.client.0.smithi078.stdout:8/465: getdents da/d1c/d60/d85/d79 0 2024-09-11T00:17:57.274 INFO:tasks.workunit.client.0.smithi078.stdout:0/401: mkdir d2/d57/d8b 0 2024-09-11T00:17:57.274 INFO:tasks.workunit.client.0.smithi078.stdout:0/402: write d2/f4 [1760046,43957] 0 2024-09-11T00:17:57.275 INFO:tasks.workunit.client.0.smithi078.stdout:0/403: mknod d2/d57/d8b/c8c 0 2024-09-11T00:17:57.277 INFO:tasks.workunit.client.0.smithi078.stdout:8/466: dread da/d13/d1b/f36 [0,4194304] 0 2024-09-11T00:17:57.277 INFO:tasks.workunit.client.0.smithi078.stdout:8/467: chown da/d13/d1b/d24/d62/f8a 494784 1 2024-09-11T00:17:57.277 INFO:tasks.workunit.client.0.smithi078.stdout:9/408: dread dc/f1c [0,4194304] 0 2024-09-11T00:17:57.277 INFO:tasks.workunit.client.0.smithi078.stdout:9/409: readlink dc/d12/d20/d30/l37 0 2024-09-11T00:17:57.277 INFO:tasks.workunit.client.0.smithi078.stdout:9/410: chown dc/d12/d54/d83 589334112 1 2024-09-11T00:17:57.278 INFO:tasks.workunit.client.0.smithi078.stdout:8/468: truncate f7 3838582 0 2024-09-11T00:17:57.278 INFO:tasks.workunit.client.0.smithi078.stdout:8/469: write da/d13/d1b/d59/d68/d82/f8b [421265,8582] 0 2024-09-11T00:17:57.281 INFO:tasks.workunit.client.0.smithi078.stdout:9/411: creat dc/d12/f8e x:0 0 0 2024-09-11T00:17:57.283 INFO:tasks.workunit.client.0.smithi078.stdout:9/412: symlink dc/d12/d20/d58/d5b/l8f 0 2024-09-11T00:17:57.284 INFO:tasks.workunit.client.0.smithi078.stdout:1/523: dwrite d3/d29/d5f/f8 [4194304,4194304] 0 2024-09-11T00:17:57.284 INFO:tasks.workunit.client.0.smithi078.stdout:9/413: truncate dc/f65 1112959 0 2024-09-11T00:17:57.284 INFO:tasks.workunit.client.0.smithi078.stdout:9/414: chown dc/d12/d46/d51/l62 190334681 1 2024-09-11T00:17:57.284 INFO:tasks.workunit.client.0.smithi078.stdout:8/470: dread da/f10 [0,4194304] 0 2024-09-11T00:17:57.286 INFO:tasks.workunit.client.0.smithi078.stdout:1/524: stat d3/d1a/d21/f57 0 2024-09-11T00:17:57.288 INFO:tasks.workunit.client.0.smithi078.stdout:9/415: creat dc/d12/d20/d58/d5b/f90 x:0 0 0 2024-09-11T00:17:57.289 INFO:tasks.workunit.client.0.smithi078.stdout:3/359: sync 2024-09-11T00:17:57.289 INFO:tasks.workunit.client.0.smithi078.stdout:4/450: sync 2024-09-11T00:17:57.289 INFO:tasks.workunit.client.0.smithi078.stdout:3/360: fdatasync d0/d7/d18/d1b/d34/d3e/f5f 0 2024-09-11T00:17:57.290 INFO:tasks.workunit.client.0.smithi078.stdout:9/416: symlink dc/d12/d54/d83/l91 0 2024-09-11T00:17:57.291 INFO:tasks.workunit.client.0.smithi078.stdout:9/417: fsync dc/d12/d20/d58/f71 0 2024-09-11T00:17:57.297 INFO:tasks.workunit.client.0.smithi078.stdout:0/404: dwrite d2/d2a/d2c/d35/d59/d4f/f80 [0,4194304] 0 2024-09-11T00:17:57.297 INFO:tasks.workunit.client.0.smithi078.stdout:0/405: chown d2/d2a/d2c/d35/d59/f47 162126062 1 2024-09-11T00:17:57.297 INFO:tasks.workunit.client.0.smithi078.stdout:0/406: stat d2/d2a/d2c/d35/d59/d4f/d61/d69/f31 0 2024-09-11T00:17:57.309 INFO:tasks.workunit.client.0.smithi078.stdout:9/418: dwrite dc/d12/d20/d85/f47 [0,4194304] 0 2024-09-11T00:17:57.309 INFO:tasks.workunit.client.0.smithi078.stdout:0/407: dread d2/f4 [0,4194304] 0 2024-09-11T00:17:57.311 INFO:tasks.workunit.client.0.smithi078.stdout:9/419: mknod dc/d12/d20/d58/d5a/c92 0 2024-09-11T00:17:57.312 INFO:tasks.workunit.client.0.smithi078.stdout:0/408: creat d2/f8d x:0 0 0 2024-09-11T00:17:57.316 INFO:tasks.workunit.client.0.smithi078.stdout:8/471: dwrite da/d87/d3a/f40 [0,4194304] 0 2024-09-11T00:17:57.317 INFO:tasks.workunit.client.0.smithi078.stdout:9/420: rename dc/d12/d20/d58/f73 to dc/d12/d20/d58/d5a/d76/d8c/f93 0 2024-09-11T00:17:57.317 INFO:tasks.workunit.client.0.smithi078.stdout:9/421: truncate dc/d12/d20/d85/d3e/f6d 4308601 0 2024-09-11T00:17:57.317 INFO:tasks.workunit.client.0.smithi078.stdout:0/409: getdents d2/d2a/d2c/d35 0 2024-09-11T00:17:57.317 INFO:tasks.workunit.client.0.smithi078.stdout:0/410: write d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/f60 [616751,55361] 0 2024-09-11T00:17:57.317 INFO:tasks.workunit.client.0.smithi078.stdout:0/411: read - d2/d2a/d2c/d35/d59/f64 zero size 2024-09-11T00:17:57.317 INFO:tasks.workunit.client.0.smithi078.stdout:3/361: write d0/d7/d18/d1b/d27/f28 [470606,9877] 0 2024-09-11T00:17:57.317 INFO:tasks.workunit.client.0.smithi078.stdout:3/362: chown d0/d7/d18/d1b/d34/d60/c69 20284 1 2024-09-11T00:17:57.317 INFO:tasks.workunit.client.0.smithi078.stdout:9/422: truncate dc/f29 80091 0 2024-09-11T00:17:57.318 INFO:tasks.workunit.client.0.smithi078.stdout:9/423: write dc/d12/f8e [986343,16300] 0 2024-09-11T00:17:57.318 INFO:tasks.workunit.client.0.smithi078.stdout:0/412: creat d2/d2a/d2c/d35/d71/f8e x:0 0 0 2024-09-11T00:17:57.319 INFO:tasks.workunit.client.0.smithi078.stdout:3/363: creat d0/d39/f74 x:0 0 0 2024-09-11T00:17:57.320 INFO:tasks.workunit.client.0.smithi078.stdout:3/364: dread - d0/d7/d46/f5b zero size 2024-09-11T00:17:57.320 INFO:tasks.workunit.client.0.smithi078.stdout:8/472: dread da/d13/d19/f35 [4194304,4194304] 0 2024-09-11T00:17:57.321 INFO:tasks.workunit.client.0.smithi078.stdout:8/473: write da/d13/f2c [756057,130074] 0 2024-09-11T00:17:57.321 INFO:tasks.workunit.client.0.smithi078.stdout:9/424: creat dc/d12/d20/f94 x:0 0 0 2024-09-11T00:17:57.321 INFO:tasks.workunit.client.0.smithi078.stdout:0/413: rmdir d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b 39 2024-09-11T00:17:57.322 INFO:tasks.workunit.client.0.smithi078.stdout:4/451: dwrite dc/d10/d1f/f35 [0,4194304] 0 2024-09-11T00:17:57.323 INFO:tasks.workunit.client.0.smithi078.stdout:3/365: unlink d0/d7/fd 0 2024-09-11T00:17:57.323 INFO:tasks.workunit.client.0.smithi078.stdout:1/525: dwrite d3/d29/d5f/d39/f6f [4194304,4194304] 0 2024-09-11T00:17:57.324 INFO:tasks.workunit.client.0.smithi078.stdout:8/474: rmdir da/d1c/d60/d85 39 2024-09-11T00:17:57.325 INFO:tasks.workunit.client.0.smithi078.stdout:8/475: dread da/d1c/f38 [0,4194304] 0 2024-09-11T00:17:57.325 INFO:tasks.workunit.client.0.smithi078.stdout:8/476: write da/d13/d1b/f88 [411323,113680] 0 2024-09-11T00:17:57.325 INFO:tasks.workunit.client.0.smithi078.stdout:9/425: truncate dc/d12/d46/d51/f53 80039 0 2024-09-11T00:17:57.326 INFO:tasks.workunit.client.0.smithi078.stdout:0/414: mkdir d2/d2a/d2c/d35/d59/d4f/d61/d8f 0 2024-09-11T00:17:57.328 INFO:tasks.workunit.client.0.smithi078.stdout:4/452: unlink f6 0 2024-09-11T00:17:57.331 INFO:tasks.workunit.client.0.smithi078.stdout:3/366: symlink d0/d7/d18/l75 0 2024-09-11T00:17:57.338 INFO:tasks.workunit.client.0.smithi078.stdout:1/526: creat d3/d29/d5f/d39/d61/fa1 x:0 0 0 2024-09-11T00:17:57.338 INFO:tasks.workunit.client.0.smithi078.stdout:1/527: write d3/d1a/d21/f9a [710544,103211] 0 2024-09-11T00:17:57.339 INFO:tasks.workunit.client.0.smithi078.stdout:1/528: chown d3/d29/f93 155 1 2024-09-11T00:17:57.339 INFO:tasks.workunit.client.0.smithi078.stdout:8/477: mknod da/d13/d1b/d24/c8e 0 2024-09-11T00:17:57.339 INFO:tasks.workunit.client.0.smithi078.stdout:8/478: write da/f2f [2775707,88568] 0 2024-09-11T00:17:57.340 INFO:tasks.workunit.client.0.smithi078.stdout:8/479: dread da/d1c/f38 [0,4194304] 0 2024-09-11T00:17:57.340 INFO:tasks.workunit.client.0.smithi078.stdout:9/426: symlink dc/d12/d20/d58/l95 0 2024-09-11T00:17:57.340 INFO:tasks.workunit.client.0.smithi078.stdout:9/427: write dc/d12/d46/f7a [508428,95369] 0 2024-09-11T00:17:57.341 INFO:tasks.workunit.client.0.smithi078.stdout:0/415: symlink d2/d2a/d2c/d35/l90 0 2024-09-11T00:17:57.342 INFO:tasks.workunit.client.0.smithi078.stdout:9/428: dread dc/d12/d20/d58/d5a/d76/f67 [0,4194304] 0 2024-09-11T00:17:57.342 INFO:tasks.workunit.client.0.smithi078.stdout:9/429: chown dc/d12/c23 45 1 2024-09-11T00:17:57.342 INFO:tasks.workunit.client.0.smithi078.stdout:9/430: dread - dc/d12/d20/f94 zero size 2024-09-11T00:17:57.342 INFO:tasks.workunit.client.0.smithi078.stdout:9/431: chown dc/d12/d20/d58/d5a/d76/f89 6290 1 2024-09-11T00:17:57.343 INFO:tasks.workunit.client.0.smithi078.stdout:4/453: symlink dc/d54/l99 0 2024-09-11T00:17:57.343 INFO:tasks.workunit.client.0.smithi078.stdout:4/454: write dc/f11 [769928,94316] 0 2024-09-11T00:17:57.343 INFO:tasks.workunit.client.0.smithi078.stdout:1/529: rmdir d3/d1a 39 2024-09-11T00:17:57.344 INFO:tasks.workunit.client.0.smithi078.stdout:3/367: read d0/d7/d18/d1b/d34/d60/d6d/f54 [1949043,30866] 0 2024-09-11T00:17:57.345 INFO:tasks.workunit.client.0.smithi078.stdout:8/480: creat da/d87/d7b/f8f x:0 0 0 2024-09-11T00:17:57.346 INFO:tasks.workunit.client.0.smithi078.stdout:0/416: symlink d2/d2a/d2c/d35/d59/d7/l91 0 2024-09-11T00:17:57.347 INFO:tasks.workunit.client.0.smithi078.stdout:4/455: dread dc/f11 [0,4194304] 0 2024-09-11T00:17:57.347 INFO:tasks.workunit.client.0.smithi078.stdout:9/432: creat dc/d12/d20/d58/d5a/f96 x:0 0 0 2024-09-11T00:17:57.348 INFO:tasks.workunit.client.0.smithi078.stdout:4/456: chown dc/d10 189841635 1 2024-09-11T00:17:57.348 INFO:tasks.workunit.client.0.smithi078.stdout:4/457: fdatasync dc/d10/d40/d3a/d46/f89 0 2024-09-11T00:17:57.348 INFO:tasks.workunit.client.0.smithi078.stdout:4/458: truncate dc/d10/d1f/f53 4919000 0 2024-09-11T00:17:57.348 INFO:tasks.workunit.client.0.smithi078.stdout:1/530: creat d3/d1a/d21/d4a/d94/fa2 x:0 0 0 2024-09-11T00:17:57.350 INFO:tasks.workunit.client.0.smithi078.stdout:3/368: creat d0/d7/d18/d70/f76 x:0 0 0 2024-09-11T00:17:57.350 INFO:tasks.workunit.client.0.smithi078.stdout:3/369: truncate d0/d7/d18/d1b/d34/d60/d6d/f54 4565086 0 2024-09-11T00:17:57.351 INFO:tasks.workunit.client.0.smithi078.stdout:8/481: getdents da/d13/d1b/d59/d68 0 2024-09-11T00:17:57.351 INFO:tasks.workunit.client.0.smithi078.stdout:7/409: sync 2024-09-11T00:17:57.351 INFO:tasks.workunit.client.0.smithi078.stdout:6/440: sync 2024-09-11T00:17:57.351 INFO:tasks.workunit.client.0.smithi078.stdout:5/328: sync 2024-09-11T00:17:57.351 INFO:tasks.workunit.client.0.smithi078.stdout:6/441: fdatasync d0/f7a 0 2024-09-11T00:17:57.352 INFO:tasks.workunit.client.0.smithi078.stdout:4/459: dread dc/d10/d1f/f5b [0,4194304] 0 2024-09-11T00:17:57.352 INFO:tasks.workunit.client.0.smithi078.stdout:2/398: sync 2024-09-11T00:17:57.352 INFO:tasks.workunit.client.0.smithi078.stdout:3/370: getdents d0/d7/d18/d1b/d34/d60/d6d 0 2024-09-11T00:17:57.352 INFO:tasks.workunit.client.0.smithi078.stdout:1/531: write d3/d29/d5f/d4e/f8f [307162,72784] 0 2024-09-11T00:17:57.353 INFO:tasks.workunit.client.0.smithi078.stdout:0/417: dread d2/d2a/d2c/d35/d59/d4f/d61/d69/f24 [0,4194304] 0 2024-09-11T00:17:57.353 INFO:tasks.workunit.client.0.smithi078.stdout:5/329: truncate d7/d8/de/f4a 1295529 0 2024-09-11T00:17:57.353 INFO:tasks.workunit.client.0.smithi078.stdout:5/330: fdatasync d7/d8/de/f69 0 2024-09-11T00:17:57.353 INFO:tasks.workunit.client.0.smithi078.stdout:5/331: write d7/d8/de/d2c/f63 [383381,123918] 0 2024-09-11T00:17:57.354 INFO:tasks.workunit.client.0.smithi078.stdout:6/442: mknod d0/d33/c9b 0 2024-09-11T00:17:57.354 INFO:tasks.workunit.client.0.smithi078.stdout:4/460: getdents dc/d10/d40/d3a/d46 0 2024-09-11T00:17:57.354 INFO:tasks.workunit.client.0.smithi078.stdout:6/443: write d0/f5a [798382,63471] 0 2024-09-11T00:17:57.356 INFO:tasks.workunit.client.0.smithi078.stdout:3/371: mkdir d0/d1a/d77 0 2024-09-11T00:17:57.358 INFO:tasks.workunit.client.0.smithi078.stdout:0/418: creat d2/d2a/f92 x:0 0 0 2024-09-11T00:17:57.358 INFO:tasks.workunit.client.0.smithi078.stdout:5/332: getdents d7/d8/d33/d22/d25/d28/d24/d1c/d1e 0 2024-09-11T00:17:57.360 INFO:tasks.workunit.client.0.smithi078.stdout:4/461: rename dc/d10/d1f/c75 to dc/d8e/c9a 0 2024-09-11T00:17:57.361 INFO:tasks.workunit.client.0.smithi078.stdout:6/444: mkdir d0/d1/d53/d9c 0 2024-09-11T00:17:57.361 INFO:tasks.workunit.client.0.smithi078.stdout:5/333: read d7/d8/d33/d22/d25/d6a/f6e [189476,67059] 0 2024-09-11T00:17:57.362 INFO:tasks.workunit.client.0.smithi078.stdout:8/482: dread da/fc [0,4194304] 0 2024-09-11T00:17:57.362 INFO:tasks.workunit.client.0.smithi078.stdout:1/532: link d3/d29/f7e d3/d1a/d21/d4a/fa3 0 2024-09-11T00:17:57.363 INFO:tasks.workunit.client.0.smithi078.stdout:8/483: dread da/d1c/f38 [0,4194304] 0 2024-09-11T00:17:57.363 INFO:tasks.workunit.client.0.smithi078.stdout:3/372: creat d0/f78 x:0 0 0 2024-09-11T00:17:57.365 INFO:tasks.workunit.client.0.smithi078.stdout:0/419: rmdir d2/d2a/d2c/d35/d59/d4f/d61 39 2024-09-11T00:17:57.367 INFO:tasks.workunit.client.0.smithi078.stdout:4/462: link dc/d83/c87 dc/d83/c9b 0 2024-09-11T00:17:57.369 INFO:tasks.workunit.client.0.smithi078.stdout:6/445: mknod d0/d1/d9/d54/c9d 0 2024-09-11T00:17:57.370 INFO:tasks.workunit.client.0.smithi078.stdout:9/433: dwrite dc/d12/d20/d85/d3e/f60 [0,4194304] 0 2024-09-11T00:17:57.371 INFO:tasks.workunit.client.0.smithi078.stdout:8/484: creat da/d13/d1b/d37/f90 x:0 0 0 2024-09-11T00:17:57.371 INFO:tasks.workunit.client.0.smithi078.stdout:8/485: read da/f14 [1338066,8313] 0 2024-09-11T00:17:57.372 INFO:tasks.workunit.client.0.smithi078.stdout:3/373: rmdir d0/d7/d18/d1b/d27 39 2024-09-11T00:17:57.374 INFO:tasks.workunit.client.0.smithi078.stdout:4/463: symlink dc/d10/d40/d3a/d46/d59/l9c 0 2024-09-11T00:17:57.374 INFO:tasks.workunit.client.0.smithi078.stdout:4/464: write dc/d10/d1f/f5b [1984147,47135] 0 2024-09-11T00:17:57.374 INFO:tasks.workunit.client.0.smithi078.stdout:6/446: symlink d0/d1/d1b/l9e 0 2024-09-11T00:17:57.376 INFO:tasks.workunit.client.0.smithi078.stdout:5/334: truncate d7/d8/de/f4a 2223078 0 2024-09-11T00:17:57.376 INFO:tasks.workunit.client.0.smithi078.stdout:5/335: readlink d7/l68 0 2024-09-11T00:17:57.376 INFO:tasks.workunit.client.0.smithi078.stdout:2/399: dwrite d0/d31/d38/f6a [0,4194304] 0 2024-09-11T00:17:57.376 INFO:tasks.workunit.client.0.smithi078.stdout:7/410: dwrite d0/f29 [0,4194304] 0 2024-09-11T00:17:57.376 INFO:tasks.workunit.client.0.smithi078.stdout:9/434: rmdir dc/d12/d46/d51 39 2024-09-11T00:17:57.377 INFO:tasks.workunit.client.0.smithi078.stdout:0/420: dread d2/d2a/d2c/d35/d59/d4f/d61/f75 [0,4194304] 0 2024-09-11T00:17:57.378 INFO:tasks.workunit.client.0.smithi078.stdout:1/533: dread d3/d29/f7e [4194304,4194304] 0 2024-09-11T00:17:57.378 INFO:tasks.workunit.client.0.smithi078.stdout:1/534: chown d3/l5 1902190 1 2024-09-11T00:17:57.378 INFO:tasks.workunit.client.0.smithi078.stdout:1/535: write d3/d29/d45/f77 [1003262,3633] 0 2024-09-11T00:17:57.380 INFO:tasks.workunit.client.0.smithi078.stdout:8/486: rename da/d87/d5f to da/d13/d1b/d24/d86/d91 0 2024-09-11T00:17:57.381 INFO:tasks.workunit.client.0.smithi078.stdout:3/374: symlink d0/d7/d18/d70/l79 0 2024-09-11T00:17:57.381 INFO:tasks.workunit.client.0.smithi078.stdout:1/536: write d3/d29/d5f/d4e/f8f [33963,10622] 0 2024-09-11T00:17:57.383 INFO:tasks.workunit.client.0.smithi078.stdout:4/465: mknod dc/d10/d1f/c9d 0 2024-09-11T00:17:57.384 INFO:tasks.workunit.client.0.smithi078.stdout:6/447: rmdir d0/d66 39 2024-09-11T00:17:57.385 INFO:tasks.workunit.client.0.smithi078.stdout:5/336: mkdir d7/d8/de/d2c/d7c 0 2024-09-11T00:17:57.388 INFO:tasks.workunit.client.0.smithi078.stdout:7/411: creat d0/d34/db/d30/f75 x:0 0 0 2024-09-11T00:17:57.389 INFO:tasks.workunit.client.0.smithi078.stdout:7/412: fsync d0/d34/db/d30/d28/f67 0 2024-09-11T00:17:57.390 INFO:tasks.workunit.client.0.smithi078.stdout:9/435: symlink dc/d12/d54/l97 0 2024-09-11T00:17:57.393 INFO:tasks.workunit.client.0.smithi078.stdout:8/487: symlink da/d13/d1b/d4e/l92 0 2024-09-11T00:17:57.393 INFO:tasks.workunit.client.0.smithi078.stdout:8/488: dread - da/d13/d1b/d24/d62/f8a zero size 2024-09-11T00:17:57.393 INFO:tasks.workunit.client.0.smithi078.stdout:8/489: stat da/d13/d1b/d59/d68 0 2024-09-11T00:17:57.399 INFO:tasks.workunit.client.0.smithi078.stdout:0/421: dwrite d2/d2a/d2c/d35/d59/f22 [0,4194304] 0 2024-09-11T00:17:57.399 INFO:tasks.workunit.client.0.smithi078.stdout:3/375: mknod d0/d7/d18/d1b/d34/c7a 0 2024-09-11T00:17:57.399 INFO:tasks.workunit.client.0.smithi078.stdout:3/376: write d0/d39/f4d [372917,32107] 0 2024-09-11T00:17:57.403 INFO:tasks.workunit.client.0.smithi078.stdout:8/490: write da/d13/f50 [682561,35993] 0 2024-09-11T00:17:57.404 INFO:tasks.workunit.client.0.smithi078.stdout:8/491: chown da/d13/d1b/d59/d68/d82/d63/c6c 81 1 2024-09-11T00:17:57.404 INFO:tasks.workunit.client.0.smithi078.stdout:8/492: chown da/d87/d7b/f8f 65377 1 2024-09-11T00:17:57.404 INFO:tasks.workunit.client.0.smithi078.stdout:8/493: fdatasync da/d1c/f38 0 2024-09-11T00:17:57.404 INFO:tasks.workunit.client.0.smithi078.stdout:4/466: rename dc/d10/d40/d3a/d3b to dc/d10/d40/d3a/d65/d7b/d9e 0 2024-09-11T00:17:57.404 INFO:tasks.workunit.client.0.smithi078.stdout:4/467: truncate dc/d10/d69/f7d 868095 0 2024-09-11T00:17:57.404 INFO:tasks.workunit.client.0.smithi078.stdout:4/468: read - dc/d10/d40/d3a/d65/d7b/d9e/d5d/f78 zero size 2024-09-11T00:17:57.404 INFO:tasks.workunit.client.0.smithi078.stdout:6/448: dwrite d0/d1/d9/d54/f6e [0,4194304] 0 2024-09-11T00:17:57.405 INFO:tasks.workunit.client.0.smithi078.stdout:9/436: symlink dc/d12/d20/d50/l98 0 2024-09-11T00:17:57.405 INFO:tasks.workunit.client.0.smithi078.stdout:9/437: chown dc/d12/d54/f57 467 1 2024-09-11T00:17:57.409 INFO:tasks.workunit.client.0.smithi078.stdout:6/449: write d0/d1/d9/f15 [3410745,66437] 0 2024-09-11T00:17:57.409 INFO:tasks.workunit.client.0.smithi078.stdout:0/422: mkdir d2/d2a/d2c/d35/d93 0 2024-09-11T00:17:57.409 INFO:tasks.workunit.client.0.smithi078.stdout:0/423: readlink d2/l33 0 2024-09-11T00:17:57.410 INFO:tasks.workunit.client.0.smithi078.stdout:1/537: dwrite d3/d29/d45/f60 [0,4194304] 0 2024-09-11T00:17:57.410 INFO:tasks.workunit.client.0.smithi078.stdout:1/538: chown d3/d29/d5f/d39/f63 13 1 2024-09-11T00:17:57.418 INFO:tasks.workunit.client.0.smithi078.stdout:6/450: dread d0/f3b [0,4194304] 0 2024-09-11T00:17:57.420 INFO:tasks.workunit.client.0.smithi078.stdout:6/451: rmdir d0/d1/d9/d17/d5e 39 2024-09-11T00:17:57.422 INFO:tasks.workunit.client.0.smithi078.stdout:6/452: rename d0/d1/d9/d59/d74/l70 to d0/d1/d53/d72/l9f 0 2024-09-11T00:17:57.424 INFO:tasks.workunit.client.0.smithi078.stdout:6/453: dread d0/d1/d1b/f6d [0,4194304] 0 2024-09-11T00:17:57.425 INFO:tasks.workunit.client.0.smithi078.stdout:6/454: truncate d0/d1/f39 268863 0 2024-09-11T00:17:57.427 INFO:tasks.workunit.client.0.smithi078.stdout:4/469: write dc/d10/d40/d3a/d65/f92 [3470923,12131] 0 2024-09-11T00:17:57.427 INFO:tasks.workunit.client.0.smithi078.stdout:3/377: dwrite d0/d7/d18/d1b/d34/d60/d6d/f3a [0,4194304] 0 2024-09-11T00:17:57.427 INFO:tasks.workunit.client.0.smithi078.stdout:4/470: dread - dc/d10/d40/d3a/d46/f6b zero size 2024-09-11T00:17:57.427 INFO:tasks.workunit.client.0.smithi078.stdout:3/378: truncate d0/d7/d18/f4c 1307079 0 2024-09-11T00:17:57.429 INFO:tasks.workunit.client.0.smithi078.stdout:3/379: symlink d0/d7/l7b 0 2024-09-11T00:17:57.436 INFO:tasks.workunit.client.0.smithi078.stdout:9/438: dwrite dc/d12/d20/d58/d5a/f81 [0,4194304] 0 2024-09-11T00:17:57.436 INFO:tasks.workunit.client.0.smithi078.stdout:9/439: chown dc/d12/c1d 186714 1 2024-09-11T00:17:57.437 INFO:tasks.workunit.client.0.smithi078.stdout:9/440: chown dc/d12/d20/d58/d5b/l7c 14793632 1 2024-09-11T00:17:57.439 INFO:tasks.workunit.client.0.smithi078.stdout:8/494: dwrite da/d13/d1b/d59/f3d [0,4194304] 0 2024-09-11T00:17:57.440 INFO:tasks.workunit.client.0.smithi078.stdout:8/495: write da/fe [8815437,83430] 0 2024-09-11T00:17:57.440 INFO:tasks.workunit.client.0.smithi078.stdout:8/496: stat da/d13/d1b/d24/f27 0 2024-09-11T00:17:57.440 INFO:tasks.workunit.client.0.smithi078.stdout:9/441: dread dc/d12/d20/d58/d5b/f87 [0,4194304] 0 2024-09-11T00:17:57.441 INFO:tasks.workunit.client.0.smithi078.stdout:8/497: mkdir da/d13/d1b/d59/d68/d82/d93 0 2024-09-11T00:17:57.441 INFO:tasks.workunit.client.0.smithi078.stdout:8/498: fsync da/d13/d1b/d24/d62/f8a 0 2024-09-11T00:17:57.443 INFO:tasks.workunit.client.0.smithi078.stdout:9/442: rename fb to dc/d12/d54/d83/f99 0 2024-09-11T00:17:57.443 INFO:tasks.workunit.client.0.smithi078.stdout:9/443: fsync f2 0 2024-09-11T00:17:57.443 INFO:tasks.workunit.client.0.smithi078.stdout:8/499: mkdir da/d1c/d60/d85/d94 0 2024-09-11T00:17:57.444 INFO:tasks.workunit.client.0.smithi078.stdout:9/444: creat dc/d12/d20/d85/f9a x:0 0 0 2024-09-11T00:17:57.445 INFO:tasks.workunit.client.0.smithi078.stdout:8/500: mknod da/d1c/d60/d85/d94/c95 0 2024-09-11T00:17:57.445 INFO:tasks.workunit.client.0.smithi078.stdout:8/501: fdatasync da/d13/d1b/f88 0 2024-09-11T00:17:57.445 INFO:tasks.workunit.client.0.smithi078.stdout:8/502: truncate da/d13/d1b/d24/d62/f69 217675 0 2024-09-11T00:17:57.446 INFO:tasks.workunit.client.0.smithi078.stdout:1/539: dwrite d3/d29/d5f/d39/f63 [0,4194304] 0 2024-09-11T00:17:57.446 INFO:tasks.workunit.client.0.smithi078.stdout:8/503: rename l8 to da/d1c/d60/d85/l96 0 2024-09-11T00:17:57.448 INFO:tasks.workunit.client.0.smithi078.stdout:1/540: symlink d3/d29/d5f/d39/d61/la4 0 2024-09-11T00:17:57.449 INFO:tasks.workunit.client.0.smithi078.stdout:3/380: dwrite d0/d7/d46/f5b [0,4194304] 0 2024-09-11T00:17:57.450 INFO:tasks.workunit.client.0.smithi078.stdout:8/504: creat da/d13/d1b/d59/f97 x:0 0 0 2024-09-11T00:17:57.450 INFO:tasks.workunit.client.0.smithi078.stdout:9/445: dread dc/d12/d20/d30/f4b [0,4194304] 0 2024-09-11T00:17:57.451 INFO:tasks.workunit.client.0.smithi078.stdout:1/541: symlink d3/d1a/d21/d4a/la5 0 2024-09-11T00:17:57.451 INFO:tasks.workunit.client.0.smithi078.stdout:9/446: dread dc/d12/d20/d85/d3e/f42 [0,4194304] 0 2024-09-11T00:17:57.451 INFO:tasks.workunit.client.0.smithi078.stdout:9/447: chown dc/f1c 6 1 2024-09-11T00:17:57.453 INFO:tasks.workunit.client.0.smithi078.stdout:6/455: dwrite d0/d1/d9/d54/f6e [4194304,4194304] 0 2024-09-11T00:17:57.454 INFO:tasks.workunit.client.0.smithi078.stdout:3/381: mkdir d0/d7/d23/d7c 0 2024-09-11T00:17:57.454 INFO:tasks.workunit.client.0.smithi078.stdout:3/382: fsync d0/d1a/f4f 0 2024-09-11T00:17:57.455 INFO:tasks.workunit.client.0.smithi078.stdout:8/505: creat da/d13/d1b/d59/d68/f98 x:0 0 0 2024-09-11T00:17:57.455 INFO:tasks.workunit.client.0.smithi078.stdout:8/506: dread - da/d1c/d1e/f55 zero size 2024-09-11T00:17:57.456 INFO:tasks.workunit.client.0.smithi078.stdout:1/542: rename d3/d1a/d21/d4a/f7f to d3/d1a/d21/d88/fa6 0 2024-09-11T00:17:57.457 INFO:tasks.workunit.client.0.smithi078.stdout:9/448: getdents dc/d12/d54 0 2024-09-11T00:17:57.459 INFO:tasks.workunit.client.0.smithi078.stdout:3/383: symlink d0/d39/l7d 0 2024-09-11T00:17:57.460 INFO:tasks.workunit.client.0.smithi078.stdout:1/543: symlink d3/d1a/d21/d88/la7 0 2024-09-11T00:17:57.461 INFO:tasks.workunit.client.0.smithi078.stdout:9/449: creat dc/d12/d20/d50/f9b x:0 0 0 2024-09-11T00:17:57.461 INFO:tasks.workunit.client.0.smithi078.stdout:9/450: readlink dc/d12/d20/d58/d5b/l7c 0 2024-09-11T00:17:57.461 INFO:tasks.workunit.client.0.smithi078.stdout:9/451: write dc/d12/d20/f61 [129048,75721] 0 2024-09-11T00:17:57.462 INFO:tasks.workunit.client.0.smithi078.stdout:9/452: creat dc/d12/d20/d30/f9c x:0 0 0 2024-09-11T00:17:57.463 INFO:tasks.workunit.client.0.smithi078.stdout:1/544: link d3/d1a/d21/d88/l95 d3/d29/la8 0 2024-09-11T00:17:57.468 INFO:tasks.workunit.client.0.smithi078.stdout:6/456: dread d0/d1/d9/f16 [4194304,4194304] 0 2024-09-11T00:17:57.469 INFO:tasks.workunit.client.0.smithi078.stdout:9/453: creat dc/d12/d20/d85/d3e/f9d x:0 0 0 2024-09-11T00:17:57.469 INFO:tasks.workunit.client.0.smithi078.stdout:8/507: rename da/d13/d1b/d59/d68 to da/d1c/d60/d85/d79/d99 0 2024-09-11T00:17:57.469 INFO:tasks.workunit.client.0.smithi078.stdout:8/508: chown da/d13/d1b/d24/d86/d91/l61 109146 1 2024-09-11T00:17:57.469 INFO:tasks.workunit.client.0.smithi078.stdout:8/509: fdatasync da/d13/d1b/f4a 0 2024-09-11T00:17:57.470 INFO:tasks.workunit.client.0.smithi078.stdout:6/457: mknod d0/d1/d9/d59/d74/ca0 0 2024-09-11T00:17:57.470 INFO:tasks.workunit.client.0.smithi078.stdout:6/458: write d0/d1/d9/d17/f58 [1389213,61668] 0 2024-09-11T00:17:57.471 INFO:tasks.workunit.client.0.smithi078.stdout:6/459: unlink d0/d1/d9/d59/d74/l6a 0 2024-09-11T00:17:57.473 INFO:tasks.workunit.client.0.smithi078.stdout:6/460: rename d0/d1/d9/l7d to d0/d1/d53/la1 0 2024-09-11T00:17:57.484 INFO:tasks.workunit.client.0.smithi078.stdout:3/384: dwrite d0/d7/d18/d1b/d34/d3e/f5d [0,4194304] 0 2024-09-11T00:17:57.487 INFO:tasks.workunit.client.0.smithi078.stdout:1/545: dwrite d3/d29/d45/f3a [0,4194304] 0 2024-09-11T00:17:57.487 INFO:tasks.workunit.client.0.smithi078.stdout:3/385: creat d0/d7/d46/f7e x:0 0 0 2024-09-11T00:17:57.487 INFO:tasks.workunit.client.0.smithi078.stdout:3/386: readlink d0/d7/d18/d1b/d34/d60/d6d/l2c 0 2024-09-11T00:17:57.487 INFO:tasks.workunit.client.0.smithi078.stdout:9/454: dread dc/d12/d20/f32 [0,4194304] 0 2024-09-11T00:17:57.488 INFO:tasks.workunit.client.0.smithi078.stdout:6/461: read d0/d1/f2f [7872097,62834] 0 2024-09-11T00:17:57.488 INFO:tasks.workunit.client.0.smithi078.stdout:1/546: symlink d3/la9 0 2024-09-11T00:17:57.489 INFO:tasks.workunit.client.0.smithi078.stdout:6/462: read d0/d1/d1b/f73 [779080,113279] 0 2024-09-11T00:17:57.489 INFO:tasks.workunit.client.0.smithi078.stdout:3/387: creat d0/d7/f7f x:0 0 0 2024-09-11T00:17:57.489 INFO:tasks.workunit.client.0.smithi078.stdout:3/388: dread - d0/d7/d46/f7e zero size 2024-09-11T00:17:57.490 INFO:tasks.workunit.client.0.smithi078.stdout:9/455: unlink dc/d12/d20/d58/f8b 0 2024-09-11T00:17:57.491 INFO:tasks.workunit.client.0.smithi078.stdout:1/547: rename d3/f81 to d3/d1a/d21/d4a/d94/faa 0 2024-09-11T00:17:57.491 INFO:tasks.workunit.client.0.smithi078.stdout:6/463: truncate d0/d1/d9/d17/f1c 1300056 0 2024-09-11T00:17:57.492 INFO:tasks.workunit.client.0.smithi078.stdout:1/548: chown d3/d29/l4f 1702984 1 2024-09-11T00:17:57.492 INFO:tasks.workunit.client.0.smithi078.stdout:6/464: mknod d0/d1/ca2 0 2024-09-11T00:17:57.493 INFO:tasks.workunit.client.0.smithi078.stdout:1/549: truncate d3/d29/d5f/d39/f63 3890341 0 2024-09-11T00:17:57.494 INFO:tasks.workunit.client.0.smithi078.stdout:6/465: truncate d0/d1/d9/d17/d5e/f77 230110 0 2024-09-11T00:17:57.495 INFO:tasks.workunit.client.0.smithi078.stdout:1/550: mknod d3/d29/cab 0 2024-09-11T00:17:57.497 INFO:tasks.workunit.client.0.smithi078.stdout:8/510: dwrite da/d13/f50 [0,4194304] 0 2024-09-11T00:17:57.527 INFO:tasks.workunit.client.0.smithi078.stdout:9/456: dwrite dc/d12/d46/f7a [0,4194304] 0 2024-09-11T00:17:57.528 INFO:tasks.workunit.client.0.smithi078.stdout:6/466: dread d0/d1/d9/f15 [4194304,4194304] 0 2024-09-11T00:17:57.528 INFO:tasks.workunit.client.0.smithi078.stdout:6/467: read d0/d33/f48 [1948854,57495] 0 2024-09-11T00:17:57.528 INFO:tasks.workunit.client.0.smithi078.stdout:1/551: dwrite d3/d1a/d21/d4a/d94/fa2 [0,4194304] 0 2024-09-11T00:17:57.528 INFO:tasks.workunit.client.0.smithi078.stdout:1/552: chown d3/d1a/d21/d4a/f65 135 1 2024-09-11T00:17:57.529 INFO:tasks.workunit.client.0.smithi078.stdout:6/468: getdents d0/d1/d53/d72 0 2024-09-11T00:17:57.531 INFO:tasks.workunit.client.0.smithi078.stdout:8/511: dwrite da/fe [4194304,4194304] 0 2024-09-11T00:17:57.531 INFO:tasks.workunit.client.0.smithi078.stdout:8/512: chown da/d13/d1b/d4e 70206926 1 2024-09-11T00:17:57.531 INFO:tasks.workunit.client.0.smithi078.stdout:8/513: dread - da/d13/d1b/d59/f97 zero size 2024-09-11T00:17:57.532 INFO:tasks.workunit.client.0.smithi078.stdout:8/514: symlink da/d1c/d60/d85/d94/l9a 0 2024-09-11T00:17:57.533 INFO:tasks.workunit.client.0.smithi078.stdout:8/515: mknod da/d13/d1b/d37/c9b 0 2024-09-11T00:17:57.533 INFO:tasks.workunit.client.0.smithi078.stdout:8/516: readlink da/d1c/d1e/l58 0 2024-09-11T00:17:57.533 INFO:tasks.workunit.client.0.smithi078.stdout:3/389: dwrite d0/d7/d18/d1b/d34/f73 [0,4194304] 0 2024-09-11T00:17:57.534 INFO:tasks.workunit.client.0.smithi078.stdout:3/390: fsync d0/d7/d46/f66 0 2024-09-11T00:17:57.535 INFO:tasks.workunit.client.0.smithi078.stdout:3/391: dread d0/d7/d18/f4c [0,4194304] 0 2024-09-11T00:17:57.535 INFO:tasks.workunit.client.0.smithi078.stdout:3/392: chown d0/d39 209862205 1 2024-09-11T00:17:57.535 INFO:tasks.workunit.client.0.smithi078.stdout:3/393: write d0/f78 [1015809,12641] 0 2024-09-11T00:17:57.535 INFO:tasks.workunit.client.0.smithi078.stdout:3/394: fdatasync d0/d7/d23/f6a 0 2024-09-11T00:17:57.535 INFO:tasks.workunit.client.0.smithi078.stdout:3/395: read - d0/d7/d23/f6a zero size 2024-09-11T00:17:57.537 INFO:tasks.workunit.client.0.smithi078.stdout:3/396: unlink d0/f72 0 2024-09-11T00:17:57.537 INFO:tasks.workunit.client.0.smithi078.stdout:3/397: chown d0/f3c 1042081698 1 2024-09-11T00:17:57.540 INFO:tasks.workunit.client.0.smithi078.stdout:6/469: dread d0/d33/f37 [0,4194304] 0 2024-09-11T00:17:57.540 INFO:tasks.workunit.client.0.smithi078.stdout:6/470: fsync d0/d1/d9/f15 0 2024-09-11T00:17:57.541 INFO:tasks.workunit.client.0.smithi078.stdout:6/471: dread - d0/d1/d9/d17/d5e/f85 zero size 2024-09-11T00:17:57.541 INFO:tasks.workunit.client.0.smithi078.stdout:6/472: truncate d0/d33/f4f 4804993 0 2024-09-11T00:17:57.542 INFO:tasks.workunit.client.0.smithi078.stdout:6/473: unlink d0/d1/d9/d54/f95 0 2024-09-11T00:17:57.543 INFO:tasks.workunit.client.0.smithi078.stdout:6/474: chown d0/d1/d9/ld 177 1 2024-09-11T00:17:57.555 INFO:tasks.workunit.client.0.smithi078.stdout:9/457: dwrite dc/f2c [4194304,4194304] 0 2024-09-11T00:17:57.555 INFO:tasks.workunit.client.0.smithi078.stdout:9/458: fsync dc/f38 0 2024-09-11T00:17:57.555 INFO:tasks.workunit.client.0.smithi078.stdout:9/459: write dc/f65 [1632184,81176] 0 2024-09-11T00:17:57.556 INFO:tasks.workunit.client.0.smithi078.stdout:9/460: fsync dc/d12/d20/d85/f3b 0 2024-09-11T00:17:57.557 INFO:tasks.workunit.client.0.smithi078.stdout:9/461: truncate dc/d12/d54/d83/f99 3826921 0 2024-09-11T00:17:57.561 INFO:tasks.workunit.client.0.smithi078.stdout:3/398: dwrite d0/d7/d18/d1b/d34/d60/d6d/f54 [0,4194304] 0 2024-09-11T00:17:57.561 INFO:tasks.workunit.client.0.smithi078.stdout:3/399: chown d0/d7/d18/l58 3369485 1 2024-09-11T00:17:57.561 INFO:tasks.workunit.client.0.smithi078.stdout:3/400: chown d0/f3c 370 1 2024-09-11T00:17:57.571 INFO:tasks.workunit.client.0.smithi078.stdout:8/517: dwrite f2 [4194304,4194304] 0 2024-09-11T00:17:57.571 INFO:tasks.workunit.client.0.smithi078.stdout:9/462: write dc/d12/d20/d58/d5a/d76/f89 [3282480,57667] 0 2024-09-11T00:17:57.571 INFO:tasks.workunit.client.0.smithi078.stdout:8/518: dread - da/d13/d1b/d37/f5a zero size 2024-09-11T00:17:57.572 INFO:tasks.workunit.client.0.smithi078.stdout:8/519: creat da/d1c/d60/d85/d79/d99/d82/d63/f9c x:0 0 0 2024-09-11T00:17:57.572 INFO:tasks.workunit.client.0.smithi078.stdout:8/520: fsync da/d87/d7b/f8f 0 2024-09-11T00:17:57.574 INFO:tasks.workunit.client.0.smithi078.stdout:3/401: dwrite d0/d7/d18/d1b/d34/d3e/f5f [0,4194304] 0 2024-09-11T00:17:57.576 INFO:tasks.workunit.client.0.smithi078.stdout:3/402: creat d0/d7/d23/d7c/f80 x:0 0 0 2024-09-11T00:17:57.576 INFO:tasks.workunit.client.0.smithi078.stdout:3/403: chown d0/d7/d23/c2b 15 1 2024-09-11T00:17:57.576 INFO:tasks.workunit.client.0.smithi078.stdout:3/404: fdatasync d0/d7/d18/d1b/d27/f3d 0 2024-09-11T00:17:57.577 INFO:tasks.workunit.client.0.smithi078.stdout:3/405: rename d0/d7/d23/l5a to d0/d1a/d77/l81 0 2024-09-11T00:17:57.577 INFO:tasks.workunit.client.0.smithi078.stdout:3/406: write d0/f8 [635948,87935] 0 2024-09-11T00:17:57.578 INFO:tasks.workunit.client.0.smithi078.stdout:3/407: rmdir d0/d7/d23/d7c 39 2024-09-11T00:17:57.582 INFO:tasks.workunit.client.0.smithi078.stdout:9/463: read dc/d12/d20/d85/f7e [933997,123306] 0 2024-09-11T00:17:57.583 INFO:tasks.workunit.client.0.smithi078.stdout:9/464: creat dc/d12/d54/d83/f9e x:0 0 0 2024-09-11T00:17:57.584 INFO:tasks.workunit.client.0.smithi078.stdout:9/465: dread - dc/d12/d20/d58/d5a/d76/f39 zero size 2024-09-11T00:17:57.585 INFO:tasks.workunit.client.0.smithi078.stdout:9/466: mknod dc/d12/d20/d58/d5a/d76/c9f 0 2024-09-11T00:17:57.586 INFO:tasks.workunit.client.0.smithi078.stdout:3/408: dread d0/d7/d18/d1b/f56 [0,4194304] 0 2024-09-11T00:17:57.587 INFO:tasks.workunit.client.0.smithi078.stdout:9/467: dread dc/d12/d20/d58/d5a/d76/f67 [0,4194304] 0 2024-09-11T00:17:57.587 INFO:tasks.workunit.client.0.smithi078.stdout:9/468: stat dc/d12/d20/d58/d5b/l8f 0 2024-09-11T00:17:57.587 INFO:tasks.workunit.client.0.smithi078.stdout:3/409: mknod d0/d7/d23/d7c/c82 0 2024-09-11T00:17:57.588 INFO:tasks.workunit.client.0.smithi078.stdout:9/469: rename dc/d12/d20/c4d to dc/d12/d20/d58/ca0 0 2024-09-11T00:17:57.590 INFO:tasks.workunit.client.0.smithi078.stdout:3/410: mknod d0/d7/d18/d1b/d27/c83 0 2024-09-11T00:17:57.590 INFO:tasks.workunit.client.0.smithi078.stdout:3/411: truncate d0/d7/d23/f6a 18298 0 2024-09-11T00:17:57.590 INFO:tasks.workunit.client.0.smithi078.stdout:3/412: write d0/d7/d23/f6a [122462,15748] 0 2024-09-11T00:17:57.590 INFO:tasks.workunit.client.0.smithi078.stdout:3/413: truncate d0/f78 1711121 0 2024-09-11T00:17:57.591 INFO:tasks.workunit.client.0.smithi078.stdout:9/470: dread dc/d12/d54/f57 [0,4194304] 0 2024-09-11T00:17:57.591 INFO:tasks.workunit.client.0.smithi078.stdout:3/414: creat d0/d7/d18/d1b/d34/f84 x:0 0 0 2024-09-11T00:17:57.592 INFO:tasks.workunit.client.0.smithi078.stdout:9/471: creat dc/d12/d20/d58/d5a/d76/d8c/fa1 x:0 0 0 2024-09-11T00:17:57.592 INFO:tasks.workunit.client.0.smithi078.stdout:9/472: readlink dc/d12/d20/d58/d5a/d76/l75 0 2024-09-11T00:17:57.594 INFO:tasks.workunit.client.0.smithi078.stdout:9/473: mknod dc/d12/d54/ca2 0 2024-09-11T00:17:57.594 INFO:tasks.workunit.client.0.smithi078.stdout:9/474: write dc/d12/d20/d85/f7e [4833949,58301] 0 2024-09-11T00:17:57.594 INFO:tasks.workunit.client.0.smithi078.stdout:9/475: chown dc/d12/d20/d85/d3e/f9d 1384204 1 2024-09-11T00:17:57.594 INFO:tasks.workunit.client.0.smithi078.stdout:9/476: write dc/d12/d20/d58/d5b/f84 [947695,69315] 0 2024-09-11T00:17:57.596 INFO:tasks.workunit.client.0.smithi078.stdout:9/477: rename dc/d12/d20/d58/d5a/d76/f39 to dc/d12/d54/fa3 0 2024-09-11T00:17:57.598 INFO:tasks.workunit.client.0.smithi078.stdout:3/415: getdents d0/d7/d23/d7c 0 2024-09-11T00:17:57.616 INFO:tasks.workunit.client.0.smithi078.stdout:9/478: dwrite dc/d12/d20/d58/d5a/f96 [0,4194304] 0 2024-09-11T00:17:57.617 INFO:tasks.workunit.client.0.smithi078.stdout:9/479: creat dc/d12/d20/fa4 x:0 0 0 2024-09-11T00:17:57.618 INFO:tasks.workunit.client.0.smithi078.stdout:3/416: dwrite d0/d7/d18/d1b/d27/f32 [0,4194304] 0 2024-09-11T00:17:57.619 INFO:tasks.workunit.client.0.smithi078.stdout:3/417: link d0/d7/d18/d1b/d34/d60/d6d/f30 d0/d7/d18/d1b/d27/f85 0 2024-09-11T00:17:57.623 INFO:tasks.workunit.client.0.smithi078.stdout:9/480: dread dc/d12/d20/d85/f47 [0,4194304] 0 2024-09-11T00:17:57.627 INFO:tasks.workunit.client.0.smithi078.stdout:3/418: write d0/f3c [3618925,116015] 0 2024-09-11T00:17:57.628 INFO:tasks.workunit.client.0.smithi078.stdout:3/419: mkdir d0/d7/d46/d86 0 2024-09-11T00:17:57.649 INFO:tasks.workunit.client.0.smithi078.stdout:3/420: dwrite d0/d1a/f3b [0,4194304] 0 2024-09-11T00:17:57.649 INFO:tasks.workunit.client.0.smithi078.stdout:3/421: stat d0/d7/d23/d7c 0 2024-09-11T00:17:57.649 INFO:tasks.workunit.client.0.smithi078.stdout:3/422: dread - d0/d7/d46/f66 zero size 2024-09-11T00:17:57.660 INFO:tasks.workunit.client.0.smithi078.stdout:3/423: dwrite d0/d7/d18/d1b/d27/f59 [0,4194304] 0 2024-09-11T00:17:57.660 INFO:tasks.workunit.client.0.smithi078.stdout:3/424: chown d0/d7/d46 58985345 1 2024-09-11T00:17:57.678 INFO:tasks.workunit.client.0.smithi078.stdout:3/425: dwrite d0/d7/d18/d1b/d34/d3e/f5d [0,4194304] 0 2024-09-11T00:17:57.680 INFO:tasks.workunit.client.0.smithi078.stdout:3/426: creat d0/d7/f87 x:0 0 0 2024-09-11T00:17:57.687 INFO:tasks.workunit.client.0.smithi078.stdout:1/553: sync 2024-09-11T00:17:57.687 INFO:tasks.workunit.client.0.smithi078.stdout:2/400: sync 2024-09-11T00:17:57.687 INFO:tasks.workunit.client.0.smithi078.stdout:5/337: sync 2024-09-11T00:17:57.687 INFO:tasks.workunit.client.0.smithi078.stdout:5/338: truncate d7/d8/d33/d22/f7a 415456 0 2024-09-11T00:17:57.688 INFO:tasks.workunit.client.0.smithi078.stdout:5/339: symlink d7/d8/d56/d2a/l7d 0 2024-09-11T00:17:57.689 INFO:tasks.workunit.client.0.smithi078.stdout:7/413: sync 2024-09-11T00:17:57.689 INFO:tasks.workunit.client.0.smithi078.stdout:4/471: sync 2024-09-11T00:17:57.689 INFO:tasks.workunit.client.0.smithi078.stdout:0/424: sync 2024-09-11T00:17:57.689 INFO:tasks.workunit.client.0.smithi078.stdout:4/472: chown dc/d10/d3c/d6e 3876426 1 2024-09-11T00:17:57.689 INFO:tasks.workunit.client.0.smithi078.stdout:3/427: dread d0/d7/d18/d1b/d34/d60/d6d/f54 [0,4194304] 0 2024-09-11T00:17:57.690 INFO:tasks.workunit.client.0.smithi078.stdout:5/340: creat d7/d8/d33/f7e x:0 0 0 2024-09-11T00:17:57.690 INFO:tasks.workunit.client.0.smithi078.stdout:8/521: sync 2024-09-11T00:17:57.690 INFO:tasks.workunit.client.0.smithi078.stdout:6/475: sync 2024-09-11T00:17:57.690 INFO:tasks.workunit.client.0.smithi078.stdout:9/481: sync 2024-09-11T00:17:57.691 INFO:tasks.workunit.client.0.smithi078.stdout:3/428: creat d0/d39/f88 x:0 0 0 2024-09-11T00:17:57.691 INFO:tasks.workunit.client.0.smithi078.stdout:3/429: chown d0/f8 3159 1 2024-09-11T00:17:57.691 INFO:tasks.workunit.client.0.smithi078.stdout:6/476: mkdir d0/d1/d9/d59/da3 0 2024-09-11T00:17:57.692 INFO:tasks.workunit.client.0.smithi078.stdout:8/522: symlink da/d13/d1b/d7d/l9d 0 2024-09-11T00:17:57.692 INFO:tasks.workunit.client.0.smithi078.stdout:8/523: chown da/d1c/c26 39 1 2024-09-11T00:17:57.692 INFO:tasks.workunit.client.0.smithi078.stdout:8/524: readlink da/d13/d1b/d24/d86/d91/l61 0 2024-09-11T00:17:57.693 INFO:tasks.workunit.client.0.smithi078.stdout:3/430: link d0/d39/c5c d0/d7/d46/c89 0 2024-09-11T00:17:57.693 INFO:tasks.workunit.client.0.smithi078.stdout:8/525: getdents da/d13/d1b/d4e 0 2024-09-11T00:17:57.694 INFO:tasks.workunit.client.0.smithi078.stdout:3/431: symlink d0/d7/d18/l8a 0 2024-09-11T00:17:57.695 INFO:tasks.workunit.client.0.smithi078.stdout:7/414: write d0/d34/f33 [228912,44464] 0 2024-09-11T00:17:57.696 INFO:tasks.workunit.client.0.smithi078.stdout:8/526: mkdir da/d1c/d60/d85/d79/d9e 0 2024-09-11T00:17:57.696 INFO:tasks.workunit.client.0.smithi078.stdout:7/415: truncate d0/f1e 2288678 0 2024-09-11T00:17:57.700 INFO:tasks.workunit.client.0.smithi078.stdout:7/416: rename d0/d34/db/d32/f70 to d0/d34/db/d30/f76 0 2024-09-11T00:17:57.702 INFO:tasks.workunit.client.0.smithi078.stdout:7/417: chown d0/d34/db/d30/d1d/d14/d62/l64 335046506 1 2024-09-11T00:17:57.702 INFO:tasks.workunit.client.0.smithi078.stdout:7/418: getdents d0/d34/db/d30/d1d/d74 0 2024-09-11T00:17:57.702 INFO:tasks.workunit.client.0.smithi078.stdout:6/477: dread d0/d1/d9/f16 [0,4194304] 0 2024-09-11T00:17:57.703 INFO:tasks.workunit.client.0.smithi078.stdout:7/419: dread d0/d34/db/f5a [0,4194304] 0 2024-09-11T00:17:57.704 INFO:tasks.workunit.client.0.smithi078.stdout:6/478: symlink d0/d1/d53/d9c/la4 0 2024-09-11T00:17:57.705 INFO:tasks.workunit.client.0.smithi078.stdout:2/401: dread d0/d1/f1f [0,4194304] 0 2024-09-11T00:17:57.705 INFO:tasks.workunit.client.0.smithi078.stdout:7/420: rmdir d0/d34/db/d30/d28 39 2024-09-11T00:17:57.706 INFO:tasks.workunit.client.0.smithi078.stdout:2/402: getdents d0/d31/d3a 0 2024-09-11T00:17:57.706 INFO:tasks.workunit.client.0.smithi078.stdout:5/341: write d7/d8/d33/d22/d25/d28/d24/f44 [3401696,119303] 0 2024-09-11T00:17:57.707 INFO:tasks.workunit.client.0.smithi078.stdout:7/421: write d0/d34/db/d30/d1d/f59 [1703970,96399] 0 2024-09-11T00:17:57.708 INFO:tasks.workunit.client.0.smithi078.stdout:7/422: write d0/d34/db/d30/d1d/f59 [1010213,37947] 0 2024-09-11T00:17:57.709 INFO:tasks.workunit.client.0.smithi078.stdout:2/403: truncate d0/d1/f1f 978370 0 2024-09-11T00:17:57.710 INFO:tasks.workunit.client.0.smithi078.stdout:4/473: dwrite dc/d10/d40/d3a/d46/d59/f66 [0,4194304] 0 2024-09-11T00:17:57.710 INFO:tasks.workunit.client.0.smithi078.stdout:5/342: creat d7/d8/d33/d22/d51/f7f x:0 0 0 2024-09-11T00:17:57.711 INFO:tasks.workunit.client.0.smithi078.stdout:0/425: dwrite d2/d2a/d2c/d35/d59/d7/fa [4194304,4194304] 0 2024-09-11T00:17:57.712 INFO:tasks.workunit.client.0.smithi078.stdout:7/423: creat d0/d34/db/d30/d1d/d14/d45/f77 x:0 0 0 2024-09-11T00:17:57.712 INFO:tasks.workunit.client.0.smithi078.stdout:7/424: chown d0/l23 928330583 1 2024-09-11T00:17:57.713 INFO:tasks.workunit.client.0.smithi078.stdout:2/404: mkdir d0/d19/d3d/d8d/d8e 0 2024-09-11T00:17:57.713 INFO:tasks.workunit.client.0.smithi078.stdout:4/474: write dc/d10/d40/d3a/d46/d59/f5f [1643569,23471] 0 2024-09-11T00:17:57.716 INFO:tasks.workunit.client.0.smithi078.stdout:5/343: chown d7/d8/c39 74985277 1 2024-09-11T00:17:57.717 INFO:tasks.workunit.client.0.smithi078.stdout:0/426: getdents d2/d57 0 2024-09-11T00:17:57.718 INFO:tasks.workunit.client.0.smithi078.stdout:0/427: read d2/d2a/d2c/d35/d59/d7/f3b [197795,67176] 0 2024-09-11T00:17:57.719 INFO:tasks.workunit.client.0.smithi078.stdout:7/425: rename d0/d34/db/d30/d1d/d14/d45/f77 to d0/f78 0 2024-09-11T00:17:57.720 INFO:tasks.workunit.client.0.smithi078.stdout:6/479: write d0/d1/d9/d54/f6e [5919151,112313] 0 2024-09-11T00:17:57.720 INFO:tasks.workunit.client.0.smithi078.stdout:9/482: dwrite dc/d12/d20/d85/d3e/f42 [0,4194304] 0 2024-09-11T00:17:57.721 INFO:tasks.workunit.client.0.smithi078.stdout:2/405: symlink d0/d1/d6f/l8f 0 2024-09-11T00:17:57.723 INFO:tasks.workunit.client.0.smithi078.stdout:3/432: dwrite d0/f65 [0,4194304] 0 2024-09-11T00:17:57.725 INFO:tasks.workunit.client.0.smithi078.stdout:0/428: symlink d2/d2a/d2c/d77/l94 0 2024-09-11T00:17:57.726 INFO:tasks.workunit.client.0.smithi078.stdout:7/426: creat d0/d34/db/d30/d1d/d14/f79 x:0 0 0 2024-09-11T00:17:57.727 INFO:tasks.workunit.client.0.smithi078.stdout:6/480: mkdir d0/d66/da5 0 2024-09-11T00:17:57.730 INFO:tasks.workunit.client.0.smithi078.stdout:9/483: rename dc/f65 to dc/d12/d46/d51/fa5 0 2024-09-11T00:17:57.730 INFO:tasks.workunit.client.0.smithi078.stdout:9/484: write dc/f14 [4866690,26127] 0 2024-09-11T00:17:57.731 INFO:tasks.workunit.client.0.smithi078.stdout:9/485: readlink dc/d12/d20/d85/d3e/l4a 0 2024-09-11T00:17:57.731 INFO:tasks.workunit.client.0.smithi078.stdout:9/486: dread dc/d12/d46/d51/f53 [0,4194304] 0 2024-09-11T00:17:57.732 INFO:tasks.workunit.client.0.smithi078.stdout:2/406: link d0/d1/d11/d1b/c34 d0/d19/d3d/d8d/d8e/c90 0 2024-09-11T00:17:57.732 INFO:tasks.workunit.client.0.smithi078.stdout:2/407: write d0/d31/d38/f80 [990671,47381] 0 2024-09-11T00:17:57.734 INFO:tasks.workunit.client.0.smithi078.stdout:5/344: dwrite d7/d8/d33/d22/d25/d28/d24/fb [4194304,4194304] 0 2024-09-11T00:17:57.734 INFO:tasks.workunit.client.0.smithi078.stdout:3/433: creat d0/d7/f8b x:0 0 0 2024-09-11T00:17:57.735 INFO:tasks.workunit.client.0.smithi078.stdout:0/429: symlink d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/l95 0 2024-09-11T00:17:57.737 INFO:tasks.workunit.client.0.smithi078.stdout:7/427: truncate d0/d34/db/f51 3182691 0 2024-09-11T00:17:57.737 INFO:tasks.workunit.client.0.smithi078.stdout:7/428: dread - d0/d34/db/d32/f72 zero size 2024-09-11T00:17:57.738 INFO:tasks.workunit.client.0.smithi078.stdout:6/481: mknod d0/d1/d53/d72/ca6 0 2024-09-11T00:17:57.740 INFO:tasks.workunit.client.0.smithi078.stdout:9/487: rmdir dc/d12/d20/d58/d5b/d68 39 2024-09-11T00:17:57.741 INFO:tasks.workunit.client.0.smithi078.stdout:2/408: creat d0/d1/d33/f91 x:0 0 0 2024-09-11T00:17:57.743 INFO:tasks.workunit.client.0.smithi078.stdout:3/434: dread d0/f1f [0,4194304] 0 2024-09-11T00:17:57.745 INFO:tasks.workunit.client.0.smithi078.stdout:6/482: truncate d0/d1/d53/f90 3771551 0 2024-09-11T00:17:57.745 INFO:tasks.workunit.client.0.smithi078.stdout:6/483: chown d0/d1/f41 3131991 1 2024-09-11T00:17:57.745 INFO:tasks.workunit.client.0.smithi078.stdout:6/484: truncate d0/d1/f79 627474 0 2024-09-11T00:17:57.745 INFO:tasks.workunit.client.0.smithi078.stdout:6/485: chown d0/d1/d9/f5c 1557 1 2024-09-11T00:17:57.746 INFO:tasks.workunit.client.0.smithi078.stdout:6/486: dread d0/d1/f79 [0,4194304] 0 2024-09-11T00:17:57.746 INFO:tasks.workunit.client.0.smithi078.stdout:6/487: fsync d0/d1/d1b/f21 0 2024-09-11T00:17:57.746 INFO:tasks.workunit.client.0.smithi078.stdout:6/488: fdatasync d0/f31 0 2024-09-11T00:17:57.748 INFO:tasks.workunit.client.0.smithi078.stdout:3/435: mkdir d0/d7/d18/d8c 0 2024-09-11T00:17:57.748 INFO:tasks.workunit.client.0.smithi078.stdout:3/436: truncate d0/d39/f74 481473 0 2024-09-11T00:17:57.752 INFO:tasks.workunit.client.0.smithi078.stdout:6/489: mknod d0/d33/ca7 0 2024-09-11T00:17:57.754 INFO:tasks.workunit.client.0.smithi078.stdout:3/437: rename d0/d7/d46/c6c to d0/d7/d18/d1b/d34/d3e/c8d 0 2024-09-11T00:17:57.755 INFO:tasks.workunit.client.0.smithi078.stdout:6/490: rmdir d0/d1/d1b 39 2024-09-11T00:17:57.756 INFO:tasks.workunit.client.0.smithi078.stdout:0/430: dwrite d2/d57/f7a [0,4194304] 0 2024-09-11T00:17:57.756 INFO:tasks.workunit.client.0.smithi078.stdout:0/431: fsync d2/d2a/d2c/d35/d71/f83 0 2024-09-11T00:17:57.756 INFO:tasks.workunit.client.0.smithi078.stdout:3/438: rmdir d0/d7/d18/d1b/d34 39 2024-09-11T00:17:57.756 INFO:tasks.workunit.client.0.smithi078.stdout:5/345: dwrite d7/d8/d33/d22/d25/d28/f31 [0,4194304] 0 2024-09-11T00:17:57.757 INFO:tasks.workunit.client.0.smithi078.stdout:3/439: dread d0/d7/d23/f6a [0,4194304] 0 2024-09-11T00:17:57.757 INFO:tasks.workunit.client.0.smithi078.stdout:6/491: mkdir d0/d1/da8 0 2024-09-11T00:17:57.760 INFO:tasks.workunit.client.0.smithi078.stdout:0/432: unlink d2/d2a/d2c/d35/d59/f5b 0 2024-09-11T00:17:57.760 INFO:tasks.workunit.client.0.smithi078.stdout:2/409: write d0/d31/d38/f6a [3087135,53888] 0 2024-09-11T00:17:57.762 INFO:tasks.workunit.client.0.smithi078.stdout:5/346: getdents d7/d8/d33/d22/d51 0 2024-09-11T00:17:57.762 INFO:tasks.workunit.client.0.smithi078.stdout:5/347: dread - d7/d8/d33/d22/d51/f7f zero size 2024-09-11T00:17:57.763 INFO:tasks.workunit.client.0.smithi078.stdout:3/440: mkdir d0/d7/d18/d1b/d8e 0 2024-09-11T00:17:57.764 INFO:tasks.workunit.client.0.smithi078.stdout:6/492: creat d0/d1/d9/d59/d74/d6b/fa9 x:0 0 0 2024-09-11T00:17:57.765 INFO:tasks.workunit.client.0.smithi078.stdout:0/433: rmdir d2/d2a/d2c 39 2024-09-11T00:17:57.766 INFO:tasks.workunit.client.0.smithi078.stdout:2/410: symlink d0/d31/l92 0 2024-09-11T00:17:57.767 INFO:tasks.workunit.client.0.smithi078.stdout:3/441: creat d0/d7/d18/d1b/d34/f8f x:0 0 0 2024-09-11T00:17:57.769 INFO:tasks.workunit.client.0.smithi078.stdout:0/434: mkdir d2/d2a/d2c/d35/d59/d7/d96 0 2024-09-11T00:17:57.770 INFO:tasks.workunit.client.0.smithi078.stdout:2/411: mkdir d0/d1/d6f/d93 0 2024-09-11T00:17:57.771 INFO:tasks.workunit.client.0.smithi078.stdout:7/429: dread d0/d34/db/d30/d1d/f13 [0,4194304] 0 2024-09-11T00:17:57.771 INFO:tasks.workunit.client.0.smithi078.stdout:3/442: symlink d0/d1a/d77/l90 0 2024-09-11T00:17:57.772 INFO:tasks.workunit.client.0.smithi078.stdout:2/412: mknod d0/d1/d8/d83/c94 0 2024-09-11T00:17:57.772 INFO:tasks.workunit.client.0.smithi078.stdout:7/430: symlink d0/d34/db/l7a 0 2024-09-11T00:17:57.774 INFO:tasks.workunit.client.0.smithi078.stdout:0/435: dread d2/d2a/d2c/d35/d59/d4f/d61/d69/f24 [0,4194304] 0 2024-09-11T00:17:57.774 INFO:tasks.workunit.client.0.smithi078.stdout:3/443: rename d0/d7/d18/d1b/d27 to d0/d7/d23/d91 0 2024-09-11T00:17:57.774 INFO:tasks.workunit.client.0.smithi078.stdout:3/444: write d0/d7/f7f [630698,54283] 0 2024-09-11T00:17:57.774 INFO:tasks.workunit.client.0.smithi078.stdout:3/445: chown d0/d7/d18/d1b/d34/l51 6677825 1 2024-09-11T00:17:57.775 INFO:tasks.workunit.client.0.smithi078.stdout:5/348: dwrite d7/d8/d33/f7e [0,4194304] 0 2024-09-11T00:17:57.775 INFO:tasks.workunit.client.0.smithi078.stdout:5/349: dread - d7/d8/d33/d22/d51/f7f zero size 2024-09-11T00:17:57.775 INFO:tasks.workunit.client.0.smithi078.stdout:2/413: symlink d0/d1/d6f/l95 0 2024-09-11T00:17:57.775 INFO:tasks.workunit.client.0.smithi078.stdout:7/431: mknod d0/d3f/c7b 0 2024-09-11T00:17:57.776 INFO:tasks.workunit.client.0.smithi078.stdout:0/436: mkdir d2/d97 0 2024-09-11T00:17:57.778 INFO:tasks.workunit.client.0.smithi078.stdout:5/350: mknod d7/c80 0 2024-09-11T00:17:57.778 INFO:tasks.workunit.client.0.smithi078.stdout:0/437: dread d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/f60 [0,4194304] 0 2024-09-11T00:17:57.778 INFO:tasks.workunit.client.0.smithi078.stdout:0/438: getdents d2/d97 0 2024-09-11T00:17:57.778 INFO:tasks.workunit.client.0.smithi078.stdout:2/414: symlink d0/d31/l96 0 2024-09-11T00:17:57.779 INFO:tasks.workunit.client.0.smithi078.stdout:7/432: creat d0/d34/db/f7c x:0 0 0 2024-09-11T00:17:57.785 INFO:tasks.workunit.client.0.smithi078.stdout:6/493: dwrite d0/d1/d9/d59/d74/f86 [0,4194304] 0 2024-09-11T00:17:57.785 INFO:tasks.workunit.client.0.smithi078.stdout:6/494: fsync d0/f8 0 2024-09-11T00:17:57.785 INFO:tasks.workunit.client.0.smithi078.stdout:6/495: dread - d0/d1/d9/d59/f81 zero size 2024-09-11T00:17:57.786 INFO:tasks.workunit.client.0.smithi078.stdout:0/439: mknod d2/d2a/d2c/d35/d59/c98 0 2024-09-11T00:17:57.788 INFO:tasks.workunit.client.0.smithi078.stdout:2/415: mkdir d0/d31/d3a/d51/d97 0 2024-09-11T00:17:57.789 INFO:tasks.workunit.client.0.smithi078.stdout:7/433: truncate d0/d34/db/d30/d28/f44 1131756 0 2024-09-11T00:17:57.792 INFO:tasks.workunit.client.0.smithi078.stdout:0/440: mknod d2/d2a/d2c/d35/d93/c99 0 2024-09-11T00:17:57.793 INFO:tasks.workunit.client.0.smithi078.stdout:7/434: rmdir d0/d34 39 2024-09-11T00:17:57.795 INFO:tasks.workunit.client.0.smithi078.stdout:3/446: dwrite d0/d39/f57 [0,4194304] 0 2024-09-11T00:17:57.795 INFO:tasks.workunit.client.0.smithi078.stdout:3/447: write d0/f8 [1755112,88392] 0 2024-09-11T00:17:57.795 INFO:tasks.workunit.client.0.smithi078.stdout:3/448: chown d0/d7/l41 468114 1 2024-09-11T00:17:57.795 INFO:tasks.workunit.client.0.smithi078.stdout:7/435: creat d0/d34/db/d30/d1d/d14/f7d x:0 0 0 2024-09-11T00:17:57.796 INFO:tasks.workunit.client.0.smithi078.stdout:5/351: truncate d7/d8/d33/f7e 1386934 0 2024-09-11T00:17:57.798 INFO:tasks.workunit.client.0.smithi078.stdout:5/352: dread d7/d8/de/f10 [0,4194304] 0 2024-09-11T00:17:57.798 INFO:tasks.workunit.client.0.smithi078.stdout:5/353: fdatasync d7/d8/f3d 0 2024-09-11T00:17:57.799 INFO:tasks.workunit.client.0.smithi078.stdout:3/449: mknod d0/d7/d18/d1b/d34/d60/c92 0 2024-09-11T00:17:57.799 INFO:tasks.workunit.client.0.smithi078.stdout:3/450: chown d0/d7/d23/d91/f32 2028974 1 2024-09-11T00:17:57.800 INFO:tasks.workunit.client.0.smithi078.stdout:6/496: dwrite d0/d1/d9/d17/f58 [0,4194304] 0 2024-09-11T00:17:57.800 INFO:tasks.workunit.client.0.smithi078.stdout:7/436: creat d0/f7e x:0 0 0 2024-09-11T00:17:57.800 INFO:tasks.workunit.client.0.smithi078.stdout:6/497: readlink d0/l5 0 2024-09-11T00:17:57.802 INFO:tasks.workunit.client.0.smithi078.stdout:3/451: rename d0/d1a/c31 to d0/d7/d46/d86/c93 0 2024-09-11T00:17:57.802 INFO:tasks.workunit.client.0.smithi078.stdout:3/452: fsync d0/d7/d23/d91/f28 0 2024-09-11T00:17:57.804 INFO:tasks.workunit.client.0.smithi078.stdout:3/453: fsync d0/f8 0 2024-09-11T00:17:57.804 INFO:tasks.workunit.client.0.smithi078.stdout:3/454: fdatasync d0/f3c 0 2024-09-11T00:17:57.805 INFO:tasks.workunit.client.0.smithi078.stdout:3/455: dread d0/d7/d23/f6a [0,4194304] 0 2024-09-11T00:17:57.805 INFO:tasks.workunit.client.0.smithi078.stdout:3/456: stat d0/d7/d18/d70 0 2024-09-11T00:17:57.808 INFO:tasks.workunit.client.0.smithi078.stdout:3/457: mknod d0/d7/d23/d91/c94 0 2024-09-11T00:17:57.808 INFO:tasks.workunit.client.0.smithi078.stdout:3/458: fdatasync d0/d7/d23/d91/f28 0 2024-09-11T00:17:57.808 INFO:tasks.workunit.client.0.smithi078.stdout:3/459: chown d0/d7/d23/d91/c21 5 1 2024-09-11T00:17:57.808 INFO:tasks.workunit.client.0.smithi078.stdout:6/498: dread d0/d1/d53/f90 [0,4194304] 0 2024-09-11T00:17:57.812 INFO:tasks.workunit.client.0.smithi078.stdout:3/460: getdents d0/d7/d46/d86 0 2024-09-11T00:17:57.819 INFO:tasks.workunit.client.0.smithi078.stdout:5/354: dwrite d7/d8/d33/d22/d25/d28/d24/fb [0,4194304] 0 2024-09-11T00:17:57.819 INFO:tasks.workunit.client.0.smithi078.stdout:5/355: chown d7/d8/d33/d22/d25/d28/d24/f44 58095 1 2024-09-11T00:17:57.819 INFO:tasks.workunit.client.0.smithi078.stdout:5/356: chown d7/d8/de/d2c/f63 62262 1 2024-09-11T00:17:57.820 INFO:tasks.workunit.client.0.smithi078.stdout:5/357: symlink d7/d8/d33/d22/l81 0 2024-09-11T00:17:57.822 INFO:tasks.workunit.client.0.smithi078.stdout:5/358: rename d7/d8/d33/d22/d25/d28/d24/fb to d7/d8/d33/d22/d25/d28/d24/d1c/f82 0 2024-09-11T00:17:57.823 INFO:tasks.workunit.client.0.smithi078.stdout:5/359: dread d7/d8/d56/d2a/f35 [0,4194304] 0 2024-09-11T00:17:57.824 INFO:tasks.workunit.client.0.smithi078.stdout:5/360: creat d7/d8/d56/f83 x:0 0 0 2024-09-11T00:17:57.825 INFO:tasks.workunit.client.0.smithi078.stdout:5/361: creat d7/d8/d33/d22/d25/f84 x:0 0 0 2024-09-11T00:17:57.825 INFO:tasks.workunit.client.0.smithi078.stdout:5/362: chown d7/d8 132454 1 2024-09-11T00:17:57.826 INFO:tasks.workunit.client.0.smithi078.stdout:3/461: dread d0/d7/d18/d1b/d34/d3e/f5f [0,4194304] 0 2024-09-11T00:17:57.827 INFO:tasks.workunit.client.0.smithi078.stdout:5/363: symlink d7/d8/de/d2c/d7c/l85 0 2024-09-11T00:17:57.827 INFO:tasks.workunit.client.0.smithi078.stdout:5/364: write d7/d8/f77 [233649,6944] 0 2024-09-11T00:17:57.830 INFO:tasks.workunit.client.0.smithi078.stdout:5/365: symlink d7/d8/d47/l86 0 2024-09-11T00:17:57.841 INFO:tasks.workunit.client.0.smithi078.stdout:5/366: dread d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f20 [0,4194304] 0 2024-09-11T00:17:57.842 INFO:tasks.workunit.client.0.smithi078.stdout:5/367: creat d7/d8/f87 x:0 0 0 2024-09-11T00:17:57.843 INFO:tasks.workunit.client.0.smithi078.stdout:5/368: mknod d7/d8/de/d2c/d7c/c88 0 2024-09-11T00:17:57.844 INFO:tasks.workunit.client.0.smithi078.stdout:5/369: symlink d7/d8/l89 0 2024-09-11T00:17:57.854 INFO:tasks.workunit.client.0.smithi078.stdout:5/370: write d7/d8/d33/d22/d25/d28/f31 [1309953,73692] 0 2024-09-11T00:17:57.855 INFO:tasks.workunit.client.0.smithi078.stdout:5/371: rmdir d7/d8/de/d2c/d7c 39 2024-09-11T00:17:57.855 INFO:tasks.workunit.client.0.smithi078.stdout:5/372: chown d7/d8/d33/d22/d51 687439910 1 2024-09-11T00:17:57.856 INFO:tasks.workunit.client.0.smithi078.stdout:5/373: creat d7/d8/d33/d22/d25/d28/d24/d1c/f8a x:0 0 0 2024-09-11T00:17:57.857 INFO:tasks.workunit.client.0.smithi078.stdout:5/374: rmdir d7/d8/d47 39 2024-09-11T00:17:57.857 INFO:tasks.workunit.client.0.smithi078.stdout:5/375: fdatasync d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f20 0 2024-09-11T00:17:57.857 INFO:tasks.workunit.client.0.smithi078.stdout:5/376: fdatasync d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d5b/f76 0 2024-09-11T00:17:57.857 INFO:tasks.workunit.client.0.smithi078.stdout:5/377: fsync d7/d8/d33/d22/d25/d28/f41 0 2024-09-11T00:17:57.857 INFO:tasks.workunit.client.0.smithi078.stdout:5/378: write d7/d8/d33/d22/d25/d6a/f6e [3275124,58142] 0 2024-09-11T00:17:57.859 INFO:tasks.workunit.client.0.smithi078.stdout:5/379: dread d7/d8/de/f4a [0,4194304] 0 2024-09-11T00:17:57.860 INFO:tasks.workunit.client.0.smithi078.stdout:5/380: write d7/d8/d33/d22/d25/d28/d24/d1c/f82 [9139702,22054] 0 2024-09-11T00:17:57.861 INFO:tasks.workunit.client.0.smithi078.stdout:5/381: creat d7/d8/f8b x:0 0 0 2024-09-11T00:17:57.861 INFO:tasks.workunit.client.0.smithi078.stdout:5/382: write d7/d8/d33/d22/f7a [698481,87263] 0 2024-09-11T00:17:57.861 INFO:tasks.workunit.client.0.smithi078.stdout:5/383: truncate d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f5f 362537 0 2024-09-11T00:17:57.861 INFO:tasks.workunit.client.0.smithi078.stdout:5/384: mkdir d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d8c 0 2024-09-11T00:17:57.862 INFO:tasks.workunit.client.0.smithi078.stdout:5/385: symlink d7/d8/d33/d22/d51/l8d 0 2024-09-11T00:17:57.864 INFO:tasks.workunit.client.0.smithi078.stdout:5/386: rename d7/d8/de/d2c/f6c to d7/d8/d33/d22/d25/d28/d24/d1c/f8e 0 2024-09-11T00:17:57.864 INFO:tasks.workunit.client.0.smithi078.stdout:5/387: getdents d7/d8/d47/d66 0 2024-09-11T00:17:57.865 INFO:tasks.workunit.client.0.smithi078.stdout:5/388: rmdir d7/d8 39 2024-09-11T00:17:57.865 INFO:tasks.workunit.client.0.smithi078.stdout:5/389: symlink d7/d8/l8f 0 2024-09-11T00:17:57.866 INFO:tasks.workunit.client.0.smithi078.stdout:5/390: mkdir d7/d8/de/d90 0 2024-09-11T00:17:57.867 INFO:tasks.workunit.client.0.smithi078.stdout:5/391: mknod d7/d8/d33/d22/c91 0 2024-09-11T00:17:57.868 INFO:tasks.workunit.client.0.smithi078.stdout:5/392: symlink d7/d8/l92 0 2024-09-11T00:17:57.868 INFO:tasks.workunit.client.0.smithi078.stdout:5/393: stat d7/d8/d33/d22/l81 0 2024-09-11T00:17:57.870 INFO:tasks.workunit.client.0.smithi078.stdout:5/394: fsync d7/d8/d33/d22/d25/d28/f31 0 2024-09-11T00:17:57.886 INFO:tasks.workunit.client.0.smithi078.stdout:0/441: dwrite d2/d2a/d2c/d5e/f68 [0,4194304] 0 2024-09-11T00:17:57.886 INFO:tasks.workunit.client.0.smithi078.stdout:0/442: chown d2/d2a/d2c/d35/d59/d7/l91 1272846 1 2024-09-11T00:17:57.886 INFO:tasks.workunit.client.0.smithi078.stdout:7/437: dwrite d0/d34/db/d30/d1d/f17 [0,4194304] 0 2024-09-11T00:17:57.888 INFO:tasks.workunit.client.0.smithi078.stdout:5/395: dwrite d7/d8/de/f10 [0,4194304] 0 2024-09-11T00:17:57.889 INFO:tasks.workunit.client.0.smithi078.stdout:7/438: creat d0/d34/db/d30/d1d/d14/d45/f7f x:0 0 0 2024-09-11T00:17:57.891 INFO:tasks.workunit.client.0.smithi078.stdout:5/396: mknod d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d5b/c93 0 2024-09-11T00:17:57.892 INFO:tasks.workunit.client.0.smithi078.stdout:7/439: symlink d0/d34/d65/l80 0 2024-09-11T00:17:57.892 INFO:tasks.workunit.client.0.smithi078.stdout:0/443: dread d2/d2a/d2c/d35/d59/d4f/d61/f75 [0,4194304] 0 2024-09-11T00:17:57.893 INFO:tasks.workunit.client.0.smithi078.stdout:5/397: rmdir d7/d8/d33/d22/d25/d28/d24 39 2024-09-11T00:17:57.894 INFO:tasks.workunit.client.0.smithi078.stdout:0/444: symlink d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/l9a 0 2024-09-11T00:17:57.894 INFO:tasks.workunit.client.0.smithi078.stdout:0/445: fsync d2/f4 0 2024-09-11T00:17:57.894 INFO:tasks.workunit.client.0.smithi078.stdout:1/554: sync 2024-09-11T00:17:57.895 INFO:tasks.workunit.client.0.smithi078.stdout:5/398: unlink d7/d8/d56/c61 0 2024-09-11T00:17:57.895 INFO:tasks.workunit.client.0.smithi078.stdout:7/440: mkdir d0/d34/db/d30/d1d/d81 0 2024-09-11T00:17:57.896 INFO:tasks.workunit.client.0.smithi078.stdout:7/441: fdatasync d0/d34/db/d30/f27 0 2024-09-11T00:17:57.896 INFO:tasks.workunit.client.0.smithi078.stdout:3/462: dwrite d0/d7/d18/d70/f76 [0,4194304] 0 2024-09-11T00:17:57.896 INFO:tasks.workunit.client.0.smithi078.stdout:0/446: mknod d2/d57/d8b/c9b 0 2024-09-11T00:17:57.897 INFO:tasks.workunit.client.0.smithi078.stdout:1/555: fsync d3/d29/f50 0 2024-09-11T00:17:57.897 INFO:tasks.workunit.client.0.smithi078.stdout:1/556: write d3/d29/d45/f60 [4762041,17430] 0 2024-09-11T00:17:57.897 INFO:tasks.workunit.client.0.smithi078.stdout:1/557: chown d3/d29/d45 86523441 1 2024-09-11T00:17:57.898 INFO:tasks.workunit.client.0.smithi078.stdout:7/442: mknod d0/c82 0 2024-09-11T00:17:57.898 INFO:tasks.workunit.client.0.smithi078.stdout:7/443: write d0/d34/db/d30/d1d/d14/f5d [111597,103243] 0 2024-09-11T00:17:57.898 INFO:tasks.workunit.client.0.smithi078.stdout:7/444: chown d0/d34/db/d30/d1d/d14/f2a 19880607 1 2024-09-11T00:17:57.898 INFO:tasks.workunit.client.0.smithi078.stdout:7/445: truncate d0/d34/db/f5c 861398 0 2024-09-11T00:17:57.899 INFO:tasks.workunit.client.0.smithi078.stdout:3/463: getdents d0/d7/d18 0 2024-09-11T00:17:57.900 INFO:tasks.workunit.client.0.smithi078.stdout:0/447: creat d2/d2a/d2c/d35/d59/d4f/d61/d8f/f9c x:0 0 0 2024-09-11T00:17:57.901 INFO:tasks.workunit.client.0.smithi078.stdout:1/558: getdents d3/d29/d5f/d39/d61 0 2024-09-11T00:17:57.901 INFO:tasks.workunit.client.0.smithi078.stdout:1/559: readlink d3/d1a/d21/d4a/l53 0 2024-09-11T00:17:57.903 INFO:tasks.workunit.client.0.smithi078.stdout:0/448: getdents d2/d2a/d2c/d35/d59/d4f/d61/d69 0 2024-09-11T00:17:57.907 INFO:tasks.workunit.client.0.smithi078.stdout:0/449: rename d2/d2a/d2c/d5e/c65 to d2/d2a/d2c/d35/d59/c9d 0 2024-09-11T00:17:57.908 INFO:tasks.workunit.client.0.smithi078.stdout:1/560: truncate d3/d29/f5d 6773390 0 2024-09-11T00:17:57.910 INFO:tasks.workunit.client.0.smithi078.stdout:0/450: mknod d2/d2a/d2c/d35/d59/d4f/d61/c9e 0 2024-09-11T00:17:57.910 INFO:tasks.workunit.client.0.smithi078.stdout:0/451: write d2/d2a/d2c/d35/d59/d7/f40 [8455645,3880] 0 2024-09-11T00:17:57.910 INFO:tasks.workunit.client.0.smithi078.stdout:0/452: chown d2/d2a/d2c/d35/d71/f83 1 1 2024-09-11T00:17:57.910 INFO:tasks.workunit.client.0.smithi078.stdout:0/453: getdents d2/d2a/d2c/d35/d59/d4f/d61/d69 0 2024-09-11T00:17:57.911 INFO:tasks.workunit.client.0.smithi078.stdout:5/399: dwrite d7/d8/d33/d22/d25/d28/d24/d1c/f82 [8388608,4194304] 0 2024-09-11T00:17:57.911 INFO:tasks.workunit.client.0.smithi078.stdout:5/400: truncate d7/d8/d56/f5d 814773 0 2024-09-11T00:17:57.911 INFO:tasks.workunit.client.0.smithi078.stdout:1/561: unlink d3/d1a/d21/f4b 0 2024-09-11T00:17:57.912 INFO:tasks.workunit.client.0.smithi078.stdout:5/401: rmdir d7/d8/d56 39 2024-09-11T00:17:57.916 INFO:tasks.workunit.client.0.smithi078.stdout:3/464: dread d0/d1a/f4f [0,4194304] 0 2024-09-11T00:17:57.916 INFO:tasks.workunit.client.0.smithi078.stdout:3/465: truncate d0/d7/d46/f7e 886143 0 2024-09-11T00:17:57.917 INFO:tasks.workunit.client.0.smithi078.stdout:7/446: dwrite d0/d34/f24 [4194304,4194304] 0 2024-09-11T00:17:57.917 INFO:tasks.workunit.client.0.smithi078.stdout:7/447: rmdir d0/d34/db/d30/d1d/d14/d45 39 2024-09-11T00:17:57.933 INFO:tasks.workunit.client.0.smithi078.stdout:1/562: dwrite d3/f71 [4194304,4194304] 0 2024-09-11T00:17:57.936 INFO:tasks.workunit.client.0.smithi078.stdout:0/454: dwrite d2/d2a/d2c/d35/d71/f8e [0,4194304] 0 2024-09-11T00:17:57.936 INFO:tasks.workunit.client.0.smithi078.stdout:0/455: getdents d2/d97 0 2024-09-11T00:17:57.936 INFO:tasks.workunit.client.0.smithi078.stdout:0/456: read - d2/d2a/d2c/d35/d59/d4f/d61/d8f/f9c zero size 2024-09-11T00:17:57.937 INFO:tasks.workunit.client.0.smithi078.stdout:5/402: dwrite d7/d8/d56/f75 [0,4194304] 0 2024-09-11T00:17:57.941 INFO:tasks.workunit.client.0.smithi078.stdout:7/448: dwrite d0/d3f/f60 [0,4194304] 0 2024-09-11T00:17:57.941 INFO:tasks.workunit.client.0.smithi078.stdout:7/449: chown d0/d34/db 131869375 1 2024-09-11T00:17:57.941 INFO:tasks.workunit.client.0.smithi078.stdout:7/450: truncate d0/d34/db/d30/d28/f67 208694 0 2024-09-11T00:17:57.941 INFO:tasks.workunit.client.0.smithi078.stdout:0/457: truncate d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/f5f 563332 0 2024-09-11T00:17:57.944 INFO:tasks.workunit.client.0.smithi078.stdout:7/451: creat d0/d34/d65/f83 x:0 0 0 2024-09-11T00:17:57.945 INFO:tasks.workunit.client.0.smithi078.stdout:0/458: getdents d2/d2a/d2c/d5e 0 2024-09-11T00:17:57.946 INFO:tasks.workunit.client.0.smithi078.stdout:7/452: link d0/d34/db/f5c d0/d34/db/d30/d1d/d14/d62/f84 0 2024-09-11T00:17:57.946 INFO:tasks.workunit.client.0.smithi078.stdout:1/563: write d3/d29/d5f/d39/f6f [5837310,66132] 0 2024-09-11T00:17:57.946 INFO:tasks.workunit.client.0.smithi078.stdout:1/564: chown f2 9519842 1 2024-09-11T00:17:57.947 INFO:tasks.workunit.client.0.smithi078.stdout:1/565: chown d3/d29/d5f/d39/d61/l8a 10957 1 2024-09-11T00:17:57.947 INFO:tasks.workunit.client.0.smithi078.stdout:1/566: write d3/d29/d5f/d39/f6f [686892,22183] 0 2024-09-11T00:17:57.947 INFO:tasks.workunit.client.0.smithi078.stdout:1/567: write d3/d29/d45/f6d [746095,67272] 0 2024-09-11T00:17:57.947 INFO:tasks.workunit.client.0.smithi078.stdout:0/459: rmdir d2/d2a/d2c/d35/d59/d4f/d61/d69/d73 0 2024-09-11T00:17:57.948 INFO:tasks.workunit.client.0.smithi078.stdout:1/568: link d3/d29/d45/f60 d3/d29/d5f/d39/d61/fac 0 2024-09-11T00:17:57.949 INFO:tasks.workunit.client.0.smithi078.stdout:1/569: mknod d3/d1a/d21/cad 0 2024-09-11T00:17:57.949 INFO:tasks.workunit.client.0.smithi078.stdout:1/570: chown d3/d29/d45 543501 1 2024-09-11T00:17:57.953 INFO:tasks.workunit.client.0.smithi078.stdout:1/571: dread d3/d29/d5f/f1f [4194304,4194304] 0 2024-09-11T00:17:57.954 INFO:tasks.workunit.client.0.smithi078.stdout:1/572: readlink d3/d1a/d21/d88/l95 0 2024-09-11T00:17:57.954 INFO:tasks.workunit.client.0.smithi078.stdout:1/573: write d3/d29/d45/f56 [145470,43330] 0 2024-09-11T00:17:57.954 INFO:tasks.workunit.client.0.smithi078.stdout:3/466: dwrite d0/d7/d18/d1b/f38 [0,4194304] 0 2024-09-11T00:17:57.967 INFO:tasks.workunit.client.0.smithi078.stdout:7/453: dwrite d0/d34/db/d32/f3a [0,4194304] 0 2024-09-11T00:17:57.969 INFO:tasks.workunit.client.0.smithi078.stdout:7/454: symlink d0/d34/db/l85 0 2024-09-11T00:17:57.971 INFO:tasks.workunit.client.0.smithi078.stdout:7/455: mkdir d0/d34/d86 0 2024-09-11T00:17:57.972 INFO:tasks.workunit.client.0.smithi078.stdout:0/460: dwrite d2/d2a/d2c/d35/d59/d4f/d61/f76 [0,4194304] 0 2024-09-11T00:17:57.972 INFO:tasks.workunit.client.0.smithi078.stdout:3/467: dwrite d0/d7/d18/f40 [0,4194304] 0 2024-09-11T00:17:57.973 INFO:tasks.workunit.client.0.smithi078.stdout:7/456: mkdir d0/d34/db/d30/d1d/d14/d87 0 2024-09-11T00:17:57.973 INFO:tasks.workunit.client.0.smithi078.stdout:7/457: stat d0/d34/db/d30/f27 0 2024-09-11T00:17:57.976 INFO:tasks.workunit.client.0.smithi078.stdout:1/574: dwrite d3/d1a/d21/d4a/f65 [4194304,4194304] 0 2024-09-11T00:17:57.976 INFO:tasks.workunit.client.0.smithi078.stdout:1/575: truncate d3/d29/f93 454540 0 2024-09-11T00:17:57.977 INFO:tasks.workunit.client.0.smithi078.stdout:0/461: mkdir d2/d2a/d2c/d5e/d9f 0 2024-09-11T00:17:57.980 INFO:tasks.workunit.client.0.smithi078.stdout:0/462: mknod d2/d2a/d2c/d35/d59/d7/ca0 0 2024-09-11T00:17:57.982 INFO:tasks.workunit.client.0.smithi078.stdout:0/463: mknod d2/d2a/d2c/d35/d59/d4f/d61/d8f/ca1 0 2024-09-11T00:17:57.982 INFO:tasks.workunit.client.0.smithi078.stdout:0/464: write d2/d2a/d2c/d35/d59/d4f/f85 [341781,89882] 0 2024-09-11T00:17:57.982 INFO:tasks.workunit.client.0.smithi078.stdout:1/576: write d3/d29/d5f/f27 [2362793,124133] 0 2024-09-11T00:17:57.982 INFO:tasks.workunit.client.0.smithi078.stdout:1/577: chown d3/d1a/d21/d88/la7 2 1 2024-09-11T00:17:57.983 INFO:tasks.workunit.client.0.smithi078.stdout:0/465: link d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/f7f d2/d2a/d2c/d35/d59/d4f/d61/d69/fa2 0 2024-09-11T00:17:57.984 INFO:tasks.workunit.client.0.smithi078.stdout:0/466: readlink d2/d2a/d2c/d77/l8a 0 2024-09-11T00:17:57.984 INFO:tasks.workunit.client.0.smithi078.stdout:0/467: readlink d2/d2a/d2c/d35/d59/d4f/d61/d69/l81 0 2024-09-11T00:17:57.984 INFO:tasks.workunit.client.0.smithi078.stdout:1/578: read d3/d1a/d21/f2f [7056,94505] 0 2024-09-11T00:17:57.984 INFO:tasks.workunit.client.0.smithi078.stdout:1/579: rename d3/d29/d45 to d3/d29/d45/dae 22 2024-09-11T00:17:57.984 INFO:tasks.workunit.client.0.smithi078.stdout:1/580: read - d3/d1a/d21/d88/f91 zero size 2024-09-11T00:17:57.985 INFO:tasks.workunit.client.0.smithi078.stdout:0/468: rmdir d2/d2a/d2c/d5e/d9f 0 2024-09-11T00:17:57.986 INFO:tasks.workunit.client.0.smithi078.stdout:0/469: chown d2/d2a/d2c/d35/d59 16572141 1 2024-09-11T00:17:57.986 INFO:tasks.workunit.client.0.smithi078.stdout:0/470: fsync d2/d2a/d2c/d35/d59/d7/f15 0 2024-09-11T00:17:57.988 INFO:tasks.workunit.client.0.smithi078.stdout:1/581: mkdir d3/d29/d5f/d39/d61/d96/daf 0 2024-09-11T00:17:57.988 INFO:tasks.workunit.client.0.smithi078.stdout:1/582: chown d3/d29/f7e 10 1 2024-09-11T00:17:57.988 INFO:tasks.workunit.client.0.smithi078.stdout:0/471: symlink d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/la3 0 2024-09-11T00:17:57.989 INFO:tasks.workunit.client.0.smithi078.stdout:1/583: creat d3/d1a/d21/d4a/d94/fb0 x:0 0 0 2024-09-11T00:17:57.990 INFO:tasks.workunit.client.0.smithi078.stdout:3/468: dwrite d0/d7/f8b [0,4194304] 0 2024-09-11T00:17:57.990 INFO:tasks.workunit.client.0.smithi078.stdout:0/472: symlink d2/la4 0 2024-09-11T00:17:57.991 INFO:tasks.workunit.client.0.smithi078.stdout:1/584: creat d3/d29/d45/fb1 x:0 0 0 2024-09-11T00:17:57.993 INFO:tasks.workunit.client.0.smithi078.stdout:7/458: dwrite d0/d34/db/d30/d28/f67 [0,4194304] 0 2024-09-11T00:17:57.993 INFO:tasks.workunit.client.0.smithi078.stdout:0/473: rmdir d2/d57 39 2024-09-11T00:17:57.998 INFO:tasks.workunit.client.0.smithi078.stdout:0/474: symlink d2/d2a/d2c/d35/d59/d7/d96/la5 0 2024-09-11T00:17:57.998 INFO:tasks.workunit.client.0.smithi078.stdout:0/475: fdatasync d2/d57/f7a 0 2024-09-11T00:17:57.999 INFO:tasks.workunit.client.0.smithi078.stdout:1/585: truncate d3/d1a/d21/f24 4944713 0 2024-09-11T00:17:58.001 INFO:tasks.workunit.client.0.smithi078.stdout:0/476: unlink d2/d2a/d2c/d35/d59/d7/f50 0 2024-09-11T00:17:58.002 INFO:tasks.workunit.client.0.smithi078.stdout:1/586: mknod d3/d29/d5f/d39/d61/cb2 0 2024-09-11T00:17:58.004 INFO:tasks.workunit.client.0.smithi078.stdout:0/477: unlink d2/d2a/d2c/d35/d59/d4f/d61/d69/c39 0 2024-09-11T00:17:58.004 INFO:tasks.workunit.client.0.smithi078.stdout:0/478: dread - d2/d2a/d2c/d35/d59/d4f/d61/d69/fa2 zero size 2024-09-11T00:17:58.004 INFO:tasks.workunit.client.0.smithi078.stdout:8/527: sync 2024-09-11T00:17:58.004 INFO:tasks.workunit.client.0.smithi078.stdout:1/587: mkdir d3/db3 0 2024-09-11T00:17:58.006 INFO:tasks.workunit.client.0.smithi078.stdout:0/479: rename d2/d2a/c30 to d2/ca6 0 2024-09-11T00:17:58.006 INFO:tasks.workunit.client.0.smithi078.stdout:8/528: mknod da/d13/c9f 0 2024-09-11T00:17:58.007 INFO:tasks.workunit.client.0.smithi078.stdout:1/588: link d3/d1a/f33 d3/d29/d5f/d39/d61/d96/fb4 0 2024-09-11T00:17:58.008 INFO:tasks.workunit.client.0.smithi078.stdout:7/459: dwrite d0/d34/db/d30/d1d/d14/f79 [0,4194304] 0 2024-09-11T00:17:58.009 INFO:tasks.workunit.client.0.smithi078.stdout:8/529: symlink da/d1c/d60/d85/d79/d99/d82/la0 0 2024-09-11T00:17:58.009 INFO:tasks.workunit.client.0.smithi078.stdout:8/530: dread - da/d1c/d60/d85/d79/f83 zero size 2024-09-11T00:17:58.009 INFO:tasks.workunit.client.0.smithi078.stdout:1/589: symlink d3/d29/d5f/d39/d61/d96/daf/lb5 0 2024-09-11T00:17:58.012 INFO:tasks.workunit.client.0.smithi078.stdout:7/460: mknod d0/d34/db/d30/c88 0 2024-09-11T00:17:58.013 INFO:tasks.workunit.client.0.smithi078.stdout:7/461: truncate d0/d34/db/d30/d1d/d14/f5d 1245683 0 2024-09-11T00:17:58.013 INFO:tasks.workunit.client.0.smithi078.stdout:7/462: fdatasync d0/d34/db/d30/f27 0 2024-09-11T00:17:58.013 INFO:tasks.workunit.client.0.smithi078.stdout:7/463: write d0/d34/db/d30/d28/f6a [1007862,32439] 0 2024-09-11T00:17:58.013 INFO:tasks.workunit.client.0.smithi078.stdout:8/531: link da/d13/d1b/d59/f57 da/d1c/fa1 0 2024-09-11T00:17:58.014 INFO:tasks.workunit.client.0.smithi078.stdout:0/480: read d2/d2a/d2c/d35/d59/f47 [2040680,100630] 0 2024-09-11T00:17:58.014 INFO:tasks.workunit.client.0.smithi078.stdout:0/481: fdatasync d2/d2a/d2c/d35/d59/f64 0 2024-09-11T00:17:58.014 INFO:tasks.workunit.client.0.smithi078.stdout:1/590: mknod d3/d29/d45/cb6 0 2024-09-11T00:17:58.015 INFO:tasks.workunit.client.0.smithi078.stdout:7/464: creat d0/d34/d86/f89 x:0 0 0 2024-09-11T00:17:58.016 INFO:tasks.workunit.client.0.smithi078.stdout:0/482: rmdir d2/d2a/d2c/d5e 39 2024-09-11T00:17:58.018 INFO:tasks.workunit.client.0.smithi078.stdout:0/483: mkdir d2/d2a/d2c/d35/d71/da7 0 2024-09-11T00:17:58.018 INFO:tasks.workunit.client.0.smithi078.stdout:0/484: fdatasync d2/d2a/d2c/d35/d59/d4f/d61/f75 0 2024-09-11T00:17:58.021 INFO:tasks.workunit.client.0.smithi078.stdout:7/465: rename d0/f7e to d0/d34/db/d30/d1d/f8a 0 2024-09-11T00:17:58.021 INFO:tasks.workunit.client.0.smithi078.stdout:7/466: readlink d0/l23 0 2024-09-11T00:17:58.021 INFO:tasks.workunit.client.0.smithi078.stdout:0/485: symlink d2/d2a/d2c/d5e/la8 0 2024-09-11T00:17:58.023 INFO:tasks.workunit.client.0.smithi078.stdout:0/486: rename d2/d2a/d2c/c66 to d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/ca9 0 2024-09-11T00:17:58.029 INFO:tasks.workunit.client.0.smithi078.stdout:8/532: dwrite f7 [0,4194304] 0 2024-09-11T00:17:58.029 INFO:tasks.workunit.client.0.smithi078.stdout:8/533: write da/f2f [4510357,113170] 0 2024-09-11T00:17:58.030 INFO:tasks.workunit.client.0.smithi078.stdout:8/534: getdents da/d13/d1b/d37 0 2024-09-11T00:17:58.031 INFO:tasks.workunit.client.0.smithi078.stdout:8/535: symlink da/d13/d1b/la2 0 2024-09-11T00:17:58.031 INFO:tasks.workunit.client.0.smithi078.stdout:8/536: write da/d1c/d60/d85/d79/d99/f98 [288102,46399] 0 2024-09-11T00:17:58.032 INFO:tasks.workunit.client.0.smithi078.stdout:8/537: write da/d13/d1b/d24/f27 [4526684,6405] 0 2024-09-11T00:17:58.035 INFO:tasks.workunit.client.0.smithi078.stdout:0/487: dwrite d2/d2a/d2c/f55 [0,4194304] 0 2024-09-11T00:17:58.036 INFO:tasks.workunit.client.0.smithi078.stdout:0/488: mknod d2/d2a/d2c/d35/d59/d7/caa 0 2024-09-11T00:17:58.048 INFO:tasks.workunit.client.0.smithi078.stdout:0/489: dwrite d2/d57/f7a [0,4194304] 0 2024-09-11T00:17:58.049 INFO:tasks.workunit.client.0.smithi078.stdout:0/490: rmdir d2/d2a/d2c/d35 39 2024-09-11T00:17:58.053 INFO:tasks.workunit.client.0.smithi078.stdout:0/491: write d2/d2a/d2c/d35/d59/d4f/d61/f75 [2633908,66278] 0 2024-09-11T00:17:58.064 INFO:tasks.workunit.client.0.smithi078.stdout:4/475: sync 2024-09-11T00:17:58.064 INFO:tasks.workunit.client.0.smithi078.stdout:9/488: sync 2024-09-11T00:17:58.065 INFO:tasks.workunit.client.0.smithi078.stdout:9/489: mkdir dc/d12/d20/d85/da6 0 2024-09-11T00:17:58.066 INFO:tasks.workunit.client.0.smithi078.stdout:9/490: chown dc/d12/d20/d58/f72 57776489 1 2024-09-11T00:17:58.066 INFO:tasks.workunit.client.0.smithi078.stdout:0/492: dwrite d2/f4 [0,4194304] 0 2024-09-11T00:17:58.066 INFO:tasks.workunit.client.0.smithi078.stdout:9/491: creat dc/d12/d20/d30/fa7 x:0 0 0 2024-09-11T00:17:58.070 INFO:tasks.workunit.client.0.smithi078.stdout:0/493: rename d2/d2a/d2c/d35/d59/d4f/d61/d69/f24 to d2/d2a/fab 0 2024-09-11T00:17:58.070 INFO:tasks.workunit.client.0.smithi078.stdout:0/494: fdatasync d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/f5f 0 2024-09-11T00:17:58.072 INFO:tasks.workunit.client.0.smithi078.stdout:9/492: rmdir dc/d12/d20/d85/da6 0 2024-09-11T00:17:58.072 INFO:tasks.workunit.client.0.smithi078.stdout:0/495: symlink d2/d2a/d2c/d35/d71/lac 0 2024-09-11T00:17:58.074 INFO:tasks.workunit.client.0.smithi078.stdout:9/493: creat dc/d12/d54/fa8 x:0 0 0 2024-09-11T00:17:58.081 INFO:tasks.workunit.client.0.smithi078.stdout:0/496: dread d2/d2a/d2c/d35/d59/f54 [0,4194304] 0 2024-09-11T00:17:58.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:57 smithi078 ceph-mon[30865]: scrub summary: idle 2024-09-11T00:17:58.096 INFO:tasks.workunit.client.0.smithi078.stdout:0/497: dwrite d2/f16 [0,4194304] 0 2024-09-11T00:17:58.096 INFO:tasks.workunit.client.0.smithi078.stdout:0/498: chown d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/f7c 434432577 1 2024-09-11T00:17:58.103 INFO:tasks.workunit.client.0.smithi078.stdout:0/499: dread d2/d2a/d2c/d35/d71/f8e [0,4194304] 0 2024-09-11T00:17:58.104 INFO:tasks.workunit.client.0.smithi078.stdout:0/500: rename d2/d2a/d2c/d35/d59/d4f/d61/d69/le to d2/d2a/d2c/d35/lad 0 2024-09-11T00:17:58.106 INFO:tasks.workunit.client.0.smithi078.stdout:0/501: link d2/d2a/d2c/d35/f46 d2/d2a/d2c/d35/d59/d4f/d61/fae 0 2024-09-11T00:17:58.106 INFO:tasks.workunit.client.0.smithi078.stdout:0/502: truncate d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/f7c 710972 0 2024-09-11T00:17:58.108 INFO:tasks.workunit.client.0.smithi078.stdout:4/476: dwrite dc/d10/d40/d3a/d65/d7b/d9e/f45 [0,4194304] 0 2024-09-11T00:17:58.110 INFO:tasks.workunit.client.0.smithi078.stdout:4/477: mkdir dc/d10/d40/d3a/d46/d59/d9f 0 2024-09-11T00:17:58.110 INFO:tasks.workunit.client.0.smithi078.stdout:4/478: truncate dc/f1e 2882528 0 2024-09-11T00:17:58.116 INFO:tasks.workunit.client.0.smithi078.stdout:5/403: sync 2024-09-11T00:17:58.116 INFO:tasks.workunit.client.0.smithi078.stdout:6/499: sync 2024-09-11T00:17:58.116 INFO:tasks.workunit.client.0.smithi078.stdout:2/416: sync 2024-09-11T00:17:58.117 INFO:tasks.workunit.client.0.smithi078.stdout:2/417: truncate d0/d1/d11/d1b/d1e/f2f 8063472 0 2024-09-11T00:17:58.117 INFO:tasks.workunit.client.0.smithi078.stdout:2/418: stat d0/d1/d6f/l8f 0 2024-09-11T00:17:58.117 INFO:tasks.workunit.client.0.smithi078.stdout:2/419: write d0/d31/d38/f81 [639631,31458] 0 2024-09-11T00:17:58.117 INFO:tasks.workunit.client.0.smithi078.stdout:2/420: stat d0/d31/d3a/d51/d97 0 2024-09-11T00:17:58.118 INFO:tasks.workunit.client.0.smithi078.stdout:5/404: getdents d7/d8/d33/d22/d25/d28/d24/d1c/d1e 0 2024-09-11T00:17:58.119 INFO:tasks.workunit.client.0.smithi078.stdout:2/421: mkdir d0/d1/d3c/d40/d98 0 2024-09-11T00:17:58.120 INFO:tasks.workunit.client.0.smithi078.stdout:2/422: creat d0/d1/d6/f99 x:0 0 0 2024-09-11T00:17:58.120 INFO:tasks.workunit.client.0.smithi078.stdout:2/423: write d0/d1/d6/f39 [501747,30499] 0 2024-09-11T00:17:58.121 INFO:tasks.workunit.client.0.smithi078.stdout:2/424: mknod d0/d19/d3d/d8d/d8e/c9a 0 2024-09-11T00:17:58.121 INFO:tasks.workunit.client.0.smithi078.stdout:2/425: chown d0/d1/d11/d1b/c2e 3 1 2024-09-11T00:17:58.122 INFO:tasks.workunit.client.0.smithi078.stdout:6/500: dread d0/f31 [8388608,4194304] 0 2024-09-11T00:17:58.122 INFO:tasks.workunit.client.0.smithi078.stdout:2/426: read d0/d1/f46 [467616,56142] 0 2024-09-11T00:17:58.123 INFO:tasks.workunit.client.0.smithi078.stdout:4/479: dwrite dc/f2d [0,4194304] 0 2024-09-11T00:17:58.124 INFO:tasks.workunit.client.0.smithi078.stdout:2/427: unlink d0/d31/d38/c61 0 2024-09-11T00:17:58.124 INFO:tasks.workunit.client.0.smithi078.stdout:5/405: write d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f59 [4856516,30043] 0 2024-09-11T00:17:58.125 INFO:tasks.workunit.client.0.smithi078.stdout:4/480: rename dc/d10/d40/d3a/d46/d59/f77 to dc/d10/d40/d3a/d46/d47/fa0 0 2024-09-11T00:17:58.126 INFO:tasks.workunit.client.0.smithi078.stdout:5/406: link d7/d8/d33/d22/d51/f58 d7/d8/de/d2c/f94 0 2024-09-11T00:17:58.126 INFO:tasks.workunit.client.0.smithi078.stdout:5/407: fdatasync d7/d8/d33/d22/d51/f58 0 2024-09-11T00:17:58.127 INFO:tasks.workunit.client.0.smithi078.stdout:4/481: symlink dc/d10/d40/d3a/la1 0 2024-09-11T00:17:58.128 INFO:tasks.workunit.client.0.smithi078.stdout:5/408: dread d7/d8/d33/d22/d25/f5e [0,4194304] 0 2024-09-11T00:17:58.128 INFO:tasks.workunit.client.0.smithi078.stdout:5/409: write d7/d8/d33/f7e [2245575,58799] 0 2024-09-11T00:17:58.130 INFO:tasks.workunit.client.0.smithi078.stdout:2/428: read d0/d1/d11/f69 [200457,37486] 0 2024-09-11T00:17:58.131 INFO:tasks.workunit.client.0.smithi078.stdout:2/429: truncate d0/d1/fe 62485 0 2024-09-11T00:17:58.131 INFO:tasks.workunit.client.0.smithi078.stdout:2/430: symlink d0/d1/d3c/d40/l9b 0 2024-09-11T00:17:58.132 INFO:tasks.workunit.client.0.smithi078.stdout:4/482: write dc/f39 [217618,80780] 0 2024-09-11T00:17:58.132 INFO:tasks.workunit.client.0.smithi078.stdout:2/431: creat d0/d1/d6/f9c x:0 0 0 2024-09-11T00:17:58.135 INFO:tasks.workunit.client.0.smithi078.stdout:4/483: write dc/d10/d3c/f80 [447757,79408] 0 2024-09-11T00:17:58.135 INFO:tasks.workunit.client.0.smithi078.stdout:4/484: stat dc/f2d 0 2024-09-11T00:17:58.135 INFO:tasks.workunit.client.0.smithi078.stdout:4/485: write dc/d10/d69/d72/f79 [1033889,4475] 0 2024-09-11T00:17:58.139 INFO:tasks.workunit.client.0.smithi078.stdout:6/501: dwrite d0/d1/d1b/f21 [0,4194304] 0 2024-09-11T00:17:58.140 INFO:tasks.workunit.client.0.smithi078.stdout:6/502: creat d0/d33/d8c/faa x:0 0 0 2024-09-11T00:17:58.143 INFO:tasks.workunit.client.0.smithi078.stdout:6/503: symlink d0/d1/d9/d17/lab 0 2024-09-11T00:17:58.143 INFO:tasks.workunit.client.0.smithi078.stdout:6/504: chown d0/c6f 104 1 2024-09-11T00:17:58.147 INFO:tasks.workunit.client.0.smithi078.stdout:6/505: rename d0/d33/d8c to d0/d1/d53/d9c/dac 0 2024-09-11T00:17:58.148 INFO:tasks.workunit.client.0.smithi078.stdout:6/506: chown d0/d1/d9/d59/d74/f56 7167 1 2024-09-11T00:17:58.148 INFO:tasks.workunit.client.0.smithi078.stdout:5/410: dwrite d7/d8/f3d [0,4194304] 0 2024-09-11T00:17:58.150 INFO:tasks.workunit.client.0.smithi078.stdout:6/507: rename d0/d1/d9/d17/f1c to d0/d1/da8/fad 0 2024-09-11T00:17:58.151 INFO:tasks.workunit.client.0.smithi078.stdout:2/432: dwrite d0/d1/d3b/f5c [0,4194304] 0 2024-09-11T00:17:58.152 INFO:tasks.workunit.client.0.smithi078.stdout:6/508: creat d0/d1/d1b/fae x:0 0 0 2024-09-11T00:17:58.152 INFO:tasks.workunit.client.0.smithi078.stdout:6/509: getdents d0/d1/d9/d59/da3 0 2024-09-11T00:17:58.156 INFO:tasks.workunit.client.0.smithi078.stdout:2/433: symlink d0/d31/d3a/d51/l9d 0 2024-09-11T00:17:58.161 INFO:tasks.workunit.client.0.smithi078.stdout:6/510: dread d0/f7a [0,4194304] 0 2024-09-11T00:17:58.165 INFO:tasks.workunit.client.0.smithi078.stdout:2/434: write d0/d1/d11/f24 [972286,39162] 0 2024-09-11T00:17:58.165 INFO:tasks.workunit.client.0.smithi078.stdout:2/435: dread - d0/d19/d3d/f62 zero size 2024-09-11T00:17:58.165 INFO:tasks.workunit.client.0.smithi078.stdout:4/486: dwrite dc/d10/d1f/f35 [0,4194304] 0 2024-09-11T00:17:58.165 INFO:tasks.workunit.client.0.smithi078.stdout:2/436: truncate d0/d1/d11/d1b/f6d 373278 0 2024-09-11T00:17:58.166 INFO:tasks.workunit.client.0.smithi078.stdout:4/487: creat dc/d10/d40/d3a/d65/d7b/d9e/d50/fa2 x:0 0 0 2024-09-11T00:17:58.166 INFO:tasks.workunit.client.0.smithi078.stdout:4/488: readlink dc/d10/d40/d3a/d4c/l37 0 2024-09-11T00:17:58.167 INFO:tasks.workunit.client.0.smithi078.stdout:4/489: chown dc/l64 0 1 2024-09-11T00:17:58.167 INFO:tasks.workunit.client.0.smithi078.stdout:4/490: creat dc/d10/d40/d3a/d46/d47/fa3 x:0 0 0 2024-09-11T00:17:58.168 INFO:tasks.workunit.client.0.smithi078.stdout:4/491: creat dc/d10/d40/d3a/d65/d7b/d9e/d5d/fa4 x:0 0 0 2024-09-11T00:17:58.168 INFO:tasks.workunit.client.0.smithi078.stdout:4/492: fsync dc/f39 0 2024-09-11T00:17:58.170 INFO:tasks.workunit.client.0.smithi078.stdout:6/511: dread d0/d1/d9/f16 [4194304,4194304] 0 2024-09-11T00:17:58.170 INFO:tasks.workunit.client.0.smithi078.stdout:6/512: chown d0/d1/d9/l4 29 1 2024-09-11T00:17:58.175 INFO:tasks.workunit.client.0.smithi078.stdout:4/493: write dc/d10/d40/d3a/d46/d59/f66 [4045509,126326] 0 2024-09-11T00:17:58.175 INFO:tasks.workunit.client.0.smithi078.stdout:4/494: write dc/d10/d1f/f97 [533571,112031] 0 2024-09-11T00:17:58.177 INFO:tasks.workunit.client.0.smithi078.stdout:2/437: dwrite d0/d1/d8/d83/f85 [0,4194304] 0 2024-09-11T00:17:58.177 INFO:tasks.workunit.client.0.smithi078.stdout:2/438: chown d0/d1/d6/f9c 38776660 1 2024-09-11T00:17:58.180 INFO:tasks.workunit.client.0.smithi078.stdout:2/439: dread d0/d1/f1f [0,4194304] 0 2024-09-11T00:17:58.181 INFO:tasks.workunit.client.0.smithi078.stdout:2/440: creat d0/d1/d8/f9e x:0 0 0 2024-09-11T00:17:58.191 INFO:tasks.workunit.client.0.smithi078.stdout:6/513: dwrite d0/d1/d9/d54/f6e [0,4194304] 0 2024-09-11T00:17:58.191 INFO:tasks.workunit.client.0.smithi078.stdout:6/514: stat d0/d1/f52 0 2024-09-11T00:17:58.193 INFO:tasks.workunit.client.0.smithi078.stdout:6/515: getdents d0/d1/d1b 0 2024-09-11T00:17:58.196 INFO:tasks.workunit.client.0.smithi078.stdout:6/516: chown d0/d1/d9 285640 1 2024-09-11T00:17:58.196 INFO:tasks.workunit.client.0.smithi078.stdout:6/517: write d0/d1/d53/d9c/dac/faa [3673,113079] 0 2024-09-11T00:17:58.196 INFO:tasks.workunit.client.0.smithi078.stdout:4/495: dwrite dc/d10/d3c/f67 [0,4194304] 0 2024-09-11T00:17:58.196 INFO:tasks.workunit.client.0.smithi078.stdout:4/496: chown dc/d10/d40/d3a/d65/d7b/d9e/d5d/l60 764992 1 2024-09-11T00:17:58.197 INFO:tasks.workunit.client.0.smithi078.stdout:4/497: chown dc/d10/d40/d3a/d65/f92 19 1 2024-09-11T00:17:58.198 INFO:tasks.workunit.client.0.smithi078.stdout:2/441: dwrite d0/d1/d3c/f45 [0,4194304] 0 2024-09-11T00:17:58.198 INFO:tasks.workunit.client.0.smithi078.stdout:2/442: dread - d0/d1/d6/f9c zero size 2024-09-11T00:17:58.200 INFO:tasks.workunit.client.0.smithi078.stdout:4/498: dread dc/f25 [0,4194304] 0 2024-09-11T00:17:58.200 INFO:tasks.workunit.client.0.smithi078.stdout:2/443: mkdir d0/d1/d3c/d9f 0 2024-09-11T00:17:58.200 INFO:tasks.workunit.client.0.smithi078.stdout:2/444: stat d0/d1/d8/f29 0 2024-09-11T00:17:58.200 INFO:tasks.workunit.client.0.smithi078.stdout:2/445: stat d0/d67/l7b 0 2024-09-11T00:17:58.200 INFO:tasks.workunit.client.0.smithi078.stdout:2/446: dread - d0/d1/d8/d83/f7e zero size 2024-09-11T00:17:58.201 INFO:tasks.workunit.client.0.smithi078.stdout:4/499: link dc/d10/c27 dc/d10/d1f/d68/ca5 0 2024-09-11T00:17:58.201 INFO:tasks.workunit.client.0.smithi078.stdout:4/500: fdatasync dc/d10/d3c/f67 0 2024-09-11T00:17:58.201 INFO:tasks.workunit.client.0.smithi078.stdout:4/501: chown dc/d10/d40/d33/c5a 4765 1 2024-09-11T00:17:58.201 INFO:tasks.workunit.client.0.smithi078.stdout:2/447: dread d0/d1/f1f [0,4194304] 0 2024-09-11T00:17:58.202 INFO:tasks.workunit.client.0.smithi078.stdout:4/502: truncate dc/d10/d40/d3a/d46/f89 362520 0 2024-09-11T00:17:58.203 INFO:tasks.workunit.client.0.smithi078.stdout:2/448: symlink d0/d1/d6/d52/la0 0 2024-09-11T00:17:58.203 INFO:tasks.workunit.client.0.smithi078.stdout:4/503: mknod dc/d10/d40/d3a/d65/d7b/d9e/ca6 0 2024-09-11T00:17:58.208 INFO:tasks.workunit.client.0.smithi078.stdout:2/449: dread d0/d1/d8/f47 [0,4194304] 0 2024-09-11T00:17:58.209 INFO:tasks.workunit.client.0.smithi078.stdout:2/450: mknod d0/d1/d6/d52/ca1 0 2024-09-11T00:17:58.209 INFO:tasks.workunit.client.0.smithi078.stdout:2/451: write d0/d1/d11/f71 [29204,25095] 0 2024-09-11T00:17:58.211 INFO:tasks.workunit.client.0.smithi078.stdout:2/452: read d0/d31/d38/f80 [448677,65825] 0 2024-09-11T00:17:58.211 INFO:tasks.workunit.client.0.smithi078.stdout:2/453: fdatasync d0/d1/d3c/d40/d50/f89 0 2024-09-11T00:17:58.216 INFO:tasks.workunit.client.0.smithi078.stdout:3/469: sync 2024-09-11T00:17:58.216 INFO:tasks.workunit.client.0.smithi078.stdout:1/591: sync 2024-09-11T00:17:58.216 INFO:tasks.workunit.client.0.smithi078.stdout:1/592: chown d3/d29/d5f/d39/c5e 748 1 2024-09-11T00:17:58.216 INFO:tasks.workunit.client.0.smithi078.stdout:1/593: dread - d3/d1a/f82 zero size 2024-09-11T00:17:58.216 INFO:tasks.workunit.client.0.smithi078.stdout:3/470: write d0/d7/d23/d7c/f80 [11762,89278] 0 2024-09-11T00:17:58.217 INFO:tasks.workunit.client.0.smithi078.stdout:2/454: write d0/d31/d38/f4b [1810588,106417] 0 2024-09-11T00:17:58.217 INFO:tasks.workunit.client.0.smithi078.stdout:1/594: chown d3/d1a/l78 28852873 1 2024-09-11T00:17:58.217 INFO:tasks.workunit.client.0.smithi078.stdout:3/471: creat d0/d7/d18/d8c/f95 x:0 0 0 2024-09-11T00:17:58.219 INFO:tasks.workunit.client.0.smithi078.stdout:2/455: rename d0/d31 to d0/d1/d11/d60/da2 0 2024-09-11T00:17:58.220 INFO:tasks.workunit.client.0.smithi078.stdout:3/472: unlink d0/d7/d23/d91/f3d 0 2024-09-11T00:17:58.220 INFO:tasks.workunit.client.0.smithi078.stdout:2/456: mknod d0/d1/d3c/d40/ca3 0 2024-09-11T00:17:58.221 INFO:tasks.workunit.client.0.smithi078.stdout:3/473: mknod d0/d7/d18/d70/c96 0 2024-09-11T00:17:58.221 INFO:tasks.workunit.client.0.smithi078.stdout:2/457: getdents d0/d1/d33/d5f 0 2024-09-11T00:17:58.222 INFO:tasks.workunit.client.0.smithi078.stdout:2/458: chown d0/d1/c18 1 1 2024-09-11T00:17:58.222 INFO:tasks.workunit.client.0.smithi078.stdout:3/474: creat d0/d39/f97 x:0 0 0 2024-09-11T00:17:58.223 INFO:tasks.workunit.client.0.smithi078.stdout:2/459: rename d0/d1/d6/f39 to d0/d1/d11/d60/fa4 0 2024-09-11T00:17:58.225 INFO:tasks.workunit.client.0.smithi078.stdout:3/475: read d0/d7/f7f [222119,72459] 0 2024-09-11T00:17:58.225 INFO:tasks.workunit.client.0.smithi078.stdout:3/476: write d0/d7/d18/f6e [937109,26206] 0 2024-09-11T00:17:58.225 INFO:tasks.workunit.client.0.smithi078.stdout:3/477: chown d0/d7/d18/d1b/d34/l51 6839784 1 2024-09-11T00:17:58.225 INFO:tasks.workunit.client.0.smithi078.stdout:3/478: getdents d0/d7/d18 0 2024-09-11T00:17:58.231 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:57 smithi112 ceph-mon[35627]: scrub summary: idle 2024-09-11T00:17:58.235 INFO:tasks.workunit.client.0.smithi078.stdout:1/595: dwrite d3/d29/d5f/d4e/f8f [0,4194304] 0 2024-09-11T00:17:58.238 INFO:tasks.workunit.client.0.smithi078.stdout:1/596: symlink d3/d29/d5f/d4e/lb7 0 2024-09-11T00:17:58.240 INFO:tasks.workunit.client.0.smithi078.stdout:2/460: dwrite d0/d1/d6/f48 [0,4194304] 0 2024-09-11T00:17:58.242 INFO:tasks.workunit.client.0.smithi078.stdout:3/479: dwrite d0/d1a/f4f [0,4194304] 0 2024-09-11T00:17:58.242 INFO:tasks.workunit.client.0.smithi078.stdout:2/461: creat d0/d19/fa5 x:0 0 0 2024-09-11T00:17:58.244 INFO:tasks.workunit.client.0.smithi078.stdout:3/480: mkdir d0/d7/d18/d1b/d98 0 2024-09-11T00:17:58.245 INFO:tasks.workunit.client.0.smithi078.stdout:2/462: getdents d0/d19/d3d 0 2024-09-11T00:17:58.246 INFO:tasks.workunit.client.0.smithi078.stdout:3/481: mknod d0/d7/c99 0 2024-09-11T00:17:58.246 INFO:tasks.workunit.client.0.smithi078.stdout:2/463: mknod d0/d1/d11/ca6 0 2024-09-11T00:17:58.247 INFO:tasks.workunit.client.0.smithi078.stdout:3/482: unlink d0/d7/d18/d1b/f38 0 2024-09-11T00:17:58.248 INFO:tasks.workunit.client.0.smithi078.stdout:2/464: creat d0/d1/d11/d60/fa7 x:0 0 0 2024-09-11T00:17:58.248 INFO:tasks.workunit.client.0.smithi078.stdout:3/483: truncate d0/d7/d18/d1b/d34/d60/d6d/f30 4927260 0 2024-09-11T00:17:58.248 INFO:tasks.workunit.client.0.smithi078.stdout:3/484: write d0/f3c [3831980,36016] 0 2024-09-11T00:17:58.249 INFO:tasks.workunit.client.0.smithi078.stdout:2/465: mkdir d0/d1/d6/d52/da8 0 2024-09-11T00:17:58.260 INFO:tasks.workunit.client.0.smithi078.stdout:2/466: dread d0/d1/d11/d1b/d1e/f2f [4194304,4194304] 0 2024-09-11T00:17:58.260 INFO:tasks.workunit.client.0.smithi078.stdout:2/467: write d0/d1/d33/f4d [4285927,118398] 0 2024-09-11T00:17:58.262 INFO:tasks.workunit.client.0.smithi078.stdout:2/468: rename d0/d1/d6/f99 to d0/d1/d3c/d9f/fa9 0 2024-09-11T00:17:58.262 INFO:tasks.workunit.client.0.smithi078.stdout:2/469: chown d0/d1/d11/d1b/d1e 11984372 1 2024-09-11T00:17:58.263 INFO:tasks.workunit.client.0.smithi078.stdout:2/470: link d0/d1/d11/d1b/l76 d0/d1/d3c/laa 0 2024-09-11T00:17:58.263 INFO:tasks.workunit.client.0.smithi078.stdout:2/471: write d0/d19/d3d/f62 [984541,65417] 0 2024-09-11T00:17:58.263 INFO:tasks.workunit.client.0.smithi078.stdout:2/472: truncate d0/d1/d8/d83/f7e 576225 0 2024-09-11T00:17:58.265 INFO:tasks.workunit.client.0.smithi078.stdout:2/473: creat d0/d1/d11/d60/fab x:0 0 0 2024-09-11T00:17:58.265 INFO:tasks.workunit.client.0.smithi078.stdout:2/474: chown d0/d1/d3c/d40/ca3 26755500 1 2024-09-11T00:17:58.265 INFO:tasks.workunit.client.0.smithi078.stdout:2/475: truncate d0/d1/d8/f47 5219814 0 2024-09-11T00:17:58.266 INFO:tasks.workunit.client.0.smithi078.stdout:2/476: mkdir d0/d1/d11/d60/da2/d3a/d51/d97/dac 0 2024-09-11T00:17:58.267 INFO:tasks.workunit.client.0.smithi078.stdout:1/597: dwrite d3/d1a/ff [4194304,4194304] 0 2024-09-11T00:17:58.269 INFO:tasks.workunit.client.0.smithi078.stdout:3/485: dwrite d0/d1a/f3b [0,4194304] 0 2024-09-11T00:17:58.270 INFO:tasks.workunit.client.0.smithi078.stdout:1/598: rename d3/d29/d5f/d4e/l73 to d3/d29/d5f/d39/d61/d96/lb8 0 2024-09-11T00:17:58.272 INFO:tasks.workunit.client.0.smithi078.stdout:3/486: rmdir d0/d7/d18/d1b/d98 0 2024-09-11T00:17:58.273 INFO:tasks.workunit.client.0.smithi078.stdout:2/477: write d0/d1/d3c/f45 [2272125,76874] 0 2024-09-11T00:17:58.273 INFO:tasks.workunit.client.0.smithi078.stdout:1/599: symlink d3/d1a/d21/d4a/d94/lb9 0 2024-09-11T00:17:58.274 INFO:tasks.workunit.client.0.smithi078.stdout:3/487: getdents d0 0 2024-09-11T00:17:58.274 INFO:tasks.workunit.client.0.smithi078.stdout:3/488: fdatasync d0/f10 0 2024-09-11T00:17:58.276 INFO:tasks.workunit.client.0.smithi078.stdout:2/478: creat d0/d1/d11/d60/da2/d38/fad x:0 0 0 2024-09-11T00:17:58.276 INFO:tasks.workunit.client.0.smithi078.stdout:2/479: fsync d0/d1/f54 0 2024-09-11T00:17:58.277 INFO:tasks.workunit.client.0.smithi078.stdout:2/480: write d0/d19/f5d [322947,75855] 0 2024-09-11T00:17:58.277 INFO:tasks.workunit.client.0.smithi078.stdout:2/481: chown d0/d1/d8/f47 1 1 2024-09-11T00:17:58.277 INFO:tasks.workunit.client.0.smithi078.stdout:1/600: mknod d3/d1a/cba 0 2024-09-11T00:17:58.277 INFO:tasks.workunit.client.0.smithi078.stdout:1/601: chown d3/d29/d45/fb1 4 1 2024-09-11T00:17:58.278 INFO:tasks.workunit.client.0.smithi078.stdout:2/482: dread d0/d1/d11/d60/da2/d3a/f3e [0,4194304] 0 2024-09-11T00:17:58.278 INFO:tasks.workunit.client.0.smithi078.stdout:2/483: getdents d0/d1/d6 0 2024-09-11T00:17:58.279 INFO:tasks.workunit.client.0.smithi078.stdout:2/484: creat d0/d1/d3c/d9f/fae x:0 0 0 2024-09-11T00:17:58.289 INFO:tasks.workunit.client.0.smithi078.stdout:2/485: write d0/d1/d33/f4d [414256,6474] 0 2024-09-11T00:17:58.290 INFO:tasks.workunit.client.0.smithi078.stdout:3/489: dwrite d0/d7/d23/d91/f22 [4194304,4194304] 0 2024-09-11T00:17:58.291 INFO:tasks.workunit.client.0.smithi078.stdout:1/602: write d3/f71 [2989191,104755] 0 2024-09-11T00:17:58.292 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:57 smithi138 ceph-mon[35019]: scrub summary: idle 2024-09-11T00:17:58.293 INFO:tasks.workunit.client.0.smithi078.stdout:3/490: rmdir d0/d7/d18/d1b/d34 39 2024-09-11T00:17:58.296 INFO:tasks.workunit.client.0.smithi078.stdout:3/491: write d0/d7/d18/d1b/d34/d60/d6d/f30 [3108529,30318] 0 2024-09-11T00:17:58.296 INFO:tasks.workunit.client.0.smithi078.stdout:1/603: symlink d3/d1a/d21/lbb 0 2024-09-11T00:17:58.297 INFO:tasks.workunit.client.0.smithi078.stdout:3/492: truncate d0/d39/f74 541119 0 2024-09-11T00:17:58.298 INFO:tasks.workunit.client.0.smithi078.stdout:1/604: link d3/la9 d3/d29/d5f/d39/d61/d96/lbc 0 2024-09-11T00:17:58.299 INFO:tasks.workunit.client.0.smithi078.stdout:3/493: mkdir d0/d7/d46/d86/d9a 0 2024-09-11T00:17:58.300 INFO:tasks.workunit.client.0.smithi078.stdout:3/494: mknod d0/d1a/c9b 0 2024-09-11T00:17:58.300 INFO:tasks.workunit.client.0.smithi078.stdout:3/495: dread - d0/f62 zero size 2024-09-11T00:17:58.304 INFO:tasks.workunit.client.0.smithi078.stdout:1/605: dread d3/d1a/d21/d88/fa6 [0,4194304] 0 2024-09-11T00:17:58.304 INFO:tasks.workunit.client.0.smithi078.stdout:1/606: stat d3/d29/d5f/d4e/f8f 0 2024-09-11T00:17:58.305 INFO:tasks.workunit.client.0.smithi078.stdout:1/607: rmdir d3 39 2024-09-11T00:17:58.305 INFO:tasks.workunit.client.0.smithi078.stdout:1/608: fdatasync d3/d1a/d21/d4a/f66 0 2024-09-11T00:17:58.306 INFO:tasks.workunit.client.0.smithi078.stdout:1/609: truncate d3/d29/d5f/d39/d61/fac 32857 0 2024-09-11T00:17:58.306 INFO:tasks.workunit.client.0.smithi078.stdout:1/610: dread - d3/d1a/f9c zero size 2024-09-11T00:17:58.308 INFO:tasks.workunit.client.0.smithi078.stdout:1/611: creat d3/d1a/d21/d4a/d90/fbd x:0 0 0 2024-09-11T00:17:58.310 INFO:tasks.workunit.client.0.smithi078.stdout:1/612: rename d3/d29/d5f/d39/d61/d96/f9f to d3/d1a/d21/d88/fbe 0 2024-09-11T00:17:58.312 INFO:tasks.workunit.client.0.smithi078.stdout:1/613: link d3/d1a/f9c d3/d1a/d21/d4a/d90/fbf 0 2024-09-11T00:17:58.312 INFO:tasks.workunit.client.0.smithi078.stdout:7/467: sync 2024-09-11T00:17:58.313 INFO:tasks.workunit.client.0.smithi078.stdout:7/468: symlink d0/d34/l8b 0 2024-09-11T00:17:58.315 INFO:tasks.workunit.client.0.smithi078.stdout:7/469: rename d0/d3f/l37 to d0/d34/db/d30/d1d/d14/d87/l8c 0 2024-09-11T00:17:58.317 INFO:tasks.workunit.client.0.smithi078.stdout:7/470: creat d0/d34/d65/f8d x:0 0 0 2024-09-11T00:17:58.318 INFO:tasks.workunit.client.0.smithi078.stdout:7/471: rename d0/d34/db/d30/f52 to d0/d34/db/f8e 0 2024-09-11T00:17:58.318 INFO:tasks.workunit.client.0.smithi078.stdout:7/472: dread - d0/d34/d65/f83 zero size 2024-09-11T00:17:58.319 INFO:tasks.workunit.client.0.smithi078.stdout:7/473: creat d0/d34/db/d30/d1d/d81/f8f x:0 0 0 2024-09-11T00:17:58.320 INFO:tasks.workunit.client.0.smithi078.stdout:7/474: fdatasync d0/d34/db/d30/d1d/d14/f41 0 2024-09-11T00:17:58.320 INFO:tasks.workunit.client.0.smithi078.stdout:1/614: write d3/d29/d5f/d39/d61/fac [899174,14712] 0 2024-09-11T00:17:58.321 INFO:tasks.workunit.client.0.smithi078.stdout:3/496: dwrite d0/d39/f57 [0,4194304] 0 2024-09-11T00:17:58.321 INFO:tasks.workunit.client.0.smithi078.stdout:3/497: chown d0/d7/d18/d1b/d34/d60/d6d/c47 238 1 2024-09-11T00:17:58.322 INFO:tasks.workunit.client.0.smithi078.stdout:3/498: chown d0/d7/d18/l75 15398707 1 2024-09-11T00:17:58.322 INFO:tasks.workunit.client.0.smithi078.stdout:7/475: link d0/d34/f33 d0/d34/db/d30/d1d/d14/d62/f90 0 2024-09-11T00:17:58.322 INFO:tasks.workunit.client.0.smithi078.stdout:3/499: write d0/f78 [606699,96258] 0 2024-09-11T00:17:58.325 INFO:tasks.workunit.client.0.smithi078.stdout:3/500: creat d0/d7/d18/d8c/f9c x:0 0 0 2024-09-11T00:17:58.325 INFO:tasks.workunit.client.0.smithi078.stdout:3/501: stat d0/d7/d18/d1b/d34/d3e/c67 0 2024-09-11T00:17:58.325 INFO:tasks.workunit.client.0.smithi078.stdout:3/502: write d0/f8 [3006183,4037] 0 2024-09-11T00:17:58.325 INFO:tasks.workunit.client.0.smithi078.stdout:3/503: chown d0/d7/d18/d1b/d34/l45 514725508 1 2024-09-11T00:17:58.327 INFO:tasks.workunit.client.0.smithi078.stdout:7/476: dread d0/f36 [0,4194304] 0 2024-09-11T00:17:58.327 INFO:tasks.workunit.client.0.smithi078.stdout:3/504: creat d0/d7/d23/d7c/f9d x:0 0 0 2024-09-11T00:17:58.327 INFO:tasks.workunit.client.0.smithi078.stdout:3/505: readlink d0/d7/d18/d1b/l20 0 2024-09-11T00:17:58.332 INFO:tasks.workunit.client.0.smithi078.stdout:1/615: getdents d3/d1a/d21 0 2024-09-11T00:17:58.332 INFO:tasks.workunit.client.0.smithi078.stdout:7/477: creat d0/d34/db/d32/f91 x:0 0 0 2024-09-11T00:17:58.332 INFO:tasks.workunit.client.0.smithi078.stdout:7/478: write d0/d34/db/f5c [1162718,13657] 0 2024-09-11T00:17:58.332 INFO:tasks.workunit.client.0.smithi078.stdout:7/479: chown d0/d34/d65 20862 1 2024-09-11T00:17:58.333 INFO:tasks.workunit.client.0.smithi078.stdout:1/616: creat d3/d29/d5f/d39/d61/d96/daf/fc0 x:0 0 0 2024-09-11T00:17:58.336 INFO:tasks.workunit.client.0.smithi078.stdout:7/480: rename d0/d34/db/d30/d1d/d14/f41 to d0/d34/db/d30/d28/f92 0 2024-09-11T00:17:58.336 INFO:tasks.workunit.client.0.smithi078.stdout:7/481: chown d0/d34/db/d30/d1d/d14/d62 559165 1 2024-09-11T00:17:58.338 INFO:tasks.workunit.client.0.smithi078.stdout:7/482: dread d0/d34/db/d30/d28/f44 [0,4194304] 0 2024-09-11T00:17:58.340 INFO:tasks.workunit.client.0.smithi078.stdout:7/483: dread d0/d34/db/d30/d1d/d14/f5d [0,4194304] 0 2024-09-11T00:17:58.340 INFO:tasks.workunit.client.0.smithi078.stdout:1/617: write d3/d1a/f2d [1659065,55539] 0 2024-09-11T00:17:58.340 INFO:tasks.workunit.client.0.smithi078.stdout:3/506: dwrite d0/d7/d18/f40 [0,4194304] 0 2024-09-11T00:17:58.341 INFO:tasks.workunit.client.0.smithi078.stdout:7/484: mkdir d0/d34/db/d30/d1d/d14/d62/d93 0 2024-09-11T00:17:58.341 INFO:tasks.workunit.client.0.smithi078.stdout:7/485: fdatasync d0/d34/d65/f71 0 2024-09-11T00:17:58.345 INFO:tasks.workunit.client.0.smithi078.stdout:3/507: rename d0/d7/l41 to d0/d7/d18/d1b/d8e/l9e 0 2024-09-11T00:17:58.349 INFO:tasks.workunit.client.0.smithi078.stdout:1/618: write d3/d29/f5d [5014033,22829] 0 2024-09-11T00:17:58.352 INFO:tasks.workunit.client.0.smithi078.stdout:1/619: mknod d3/d1a/d21/d4a/d90/cc1 0 2024-09-11T00:17:58.352 INFO:tasks.workunit.client.0.smithi078.stdout:1/620: mknod d3/d29/d5f/d39/d61/d96/cc2 0 2024-09-11T00:17:58.354 INFO:tasks.workunit.client.0.smithi078.stdout:1/621: symlink d3/d29/d5f/d4e/d8c/lc3 0 2024-09-11T00:17:58.356 INFO:tasks.workunit.client.0.smithi078.stdout:1/622: mkdir d3/d29/dc4 0 2024-09-11T00:17:58.356 INFO:tasks.workunit.client.0.smithi078.stdout:1/623: chown d3/d1a/d21/f22 34815823 1 2024-09-11T00:17:58.357 INFO:tasks.workunit.client.0.smithi078.stdout:1/624: rename d3/f9 to d3/d29/d5f/d39/d61/d96/daf/fc5 0 2024-09-11T00:17:58.361 INFO:tasks.workunit.client.0.smithi078.stdout:7/486: dwrite d0/d34/d65/f83 [0,4194304] 0 2024-09-11T00:17:58.365 INFO:tasks.workunit.client.0.smithi078.stdout:3/508: dwrite d0/f2 [0,4194304] 0 2024-09-11T00:17:58.371 INFO:tasks.workunit.client.0.smithi078.stdout:7/487: write d0/d34/db/d30/d1d/f39 [3226953,107156] 0 2024-09-11T00:17:58.372 INFO:tasks.workunit.client.0.smithi078.stdout:1/625: rename d3/d29/d5f/d4e/d8c to d3/dc6 0 2024-09-11T00:17:58.374 INFO:tasks.workunit.client.0.smithi078.stdout:3/509: rename d0/f36 to d0/d7/d18/f9f 0 2024-09-11T00:17:58.374 INFO:tasks.workunit.client.0.smithi078.stdout:3/510: fdatasync d0/d1a/f52 0 2024-09-11T00:17:58.376 INFO:tasks.workunit.client.0.smithi078.stdout:1/626: mkdir d3/d1a/d21/d4a/d90/dc7 0 2024-09-11T00:17:58.377 INFO:tasks.workunit.client.0.smithi078.stdout:7/488: write d0/d34/d65/f83 [4049385,46555] 0 2024-09-11T00:17:58.378 INFO:tasks.workunit.client.0.smithi078.stdout:3/511: dread d0/d7/d23/d91/f28 [0,4194304] 0 2024-09-11T00:17:58.380 INFO:tasks.workunit.client.0.smithi078.stdout:8/538: sync 2024-09-11T00:17:58.380 INFO:tasks.workunit.client.0.smithi078.stdout:0/503: sync 2024-09-11T00:17:58.381 INFO:tasks.workunit.client.0.smithi078.stdout:5/411: sync 2024-09-11T00:17:58.381 INFO:tasks.workunit.client.0.smithi078.stdout:9/494: sync 2024-09-11T00:17:58.382 INFO:tasks.workunit.client.0.smithi078.stdout:0/504: mkdir d2/d2a/d2c/d35/daf 0 2024-09-11T00:17:58.383 INFO:tasks.workunit.client.0.smithi078.stdout:3/512: getdents d0 0 2024-09-11T00:17:58.383 INFO:tasks.workunit.client.0.smithi078.stdout:3/513: truncate d0/d7/d18/d1b/d34/d60/d6d/f3a 5012556 0 2024-09-11T00:17:58.385 INFO:tasks.workunit.client.0.smithi078.stdout:5/412: link d7/d8/de/l18 d7/d8/d33/d22/d25/d28/d24/l95 0 2024-09-11T00:17:58.386 INFO:tasks.workunit.client.0.smithi078.stdout:9/495: symlink dc/d12/la9 0 2024-09-11T00:17:58.388 INFO:tasks.workunit.client.0.smithi078.stdout:0/505: creat d2/d2a/d2c/d35/d71/da7/fb0 x:0 0 0 2024-09-11T00:17:58.388 INFO:tasks.workunit.client.0.smithi078.stdout:3/514: symlink d0/d7/d18/d1b/d8e/la0 0 2024-09-11T00:17:58.390 INFO:tasks.workunit.client.0.smithi078.stdout:9/496: truncate dc/f1c 2378282 0 2024-09-11T00:17:58.390 INFO:tasks.workunit.client.0.smithi078.stdout:9/497: fdatasync dc/d12/d20/d30/f9c 0 2024-09-11T00:17:58.390 INFO:tasks.workunit.client.0.smithi078.stdout:7/489: dwrite d0/d34/db/d30/d28/f92 [0,4194304] 0 2024-09-11T00:17:58.390 INFO:tasks.workunit.client.0.smithi078.stdout:0/506: creat d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/fb1 x:0 0 0 2024-09-11T00:17:58.390 INFO:tasks.workunit.client.0.smithi078.stdout:0/507: stat d2/d2a/d2c/d35/d59/d4f/d61/d69/c84 0 2024-09-11T00:17:58.391 INFO:tasks.workunit.client.0.smithi078.stdout:3/515: unlink d0/d7/f7f 0 2024-09-11T00:17:58.391 INFO:tasks.workunit.client.0.smithi078.stdout:3/516: write d0/d7/d18/d1b/d34/f49 [758560,287] 0 2024-09-11T00:17:58.392 INFO:tasks.workunit.client.0.smithi078.stdout:5/413: rename d7/d8/d33/d22/d51/l8d to d7/d8/l96 0 2024-09-11T00:17:58.393 INFO:tasks.workunit.client.0.smithi078.stdout:5/414: truncate d7/d8/d56/f6f 348454 0 2024-09-11T00:17:58.394 INFO:tasks.workunit.client.0.smithi078.stdout:8/539: dread da/d13/d1b/f3c [0,4194304] 0 2024-09-11T00:17:58.394 INFO:tasks.workunit.client.0.smithi078.stdout:9/498: creat dc/d12/d54/faa x:0 0 0 2024-09-11T00:17:58.394 INFO:tasks.workunit.client.0.smithi078.stdout:9/499: chown f2 5 1 2024-09-11T00:17:58.394 INFO:tasks.workunit.client.0.smithi078.stdout:9/500: chown dc/d12 10 1 2024-09-11T00:17:58.395 INFO:tasks.workunit.client.0.smithi078.stdout:0/508: dread d2/d2a/d2c/d35/d59/d7/f14 [4194304,4194304] 0 2024-09-11T00:17:58.396 INFO:tasks.workunit.client.0.smithi078.stdout:7/490: rmdir d0/d34/d65 39 2024-09-11T00:17:58.398 INFO:tasks.workunit.client.0.smithi078.stdout:3/517: mkdir d0/d7/d23/d7c/da1 0 2024-09-11T00:17:58.398 INFO:tasks.workunit.client.0.smithi078.stdout:1/627: dwrite d3/d29/d45/f70 [0,4194304] 0 2024-09-11T00:17:58.399 INFO:tasks.workunit.client.0.smithi078.stdout:1/628: stat d3/d1a/d21/d4a/d94/fb0 0 2024-09-11T00:17:58.399 INFO:tasks.workunit.client.0.smithi078.stdout:0/509: write d2/d2a/d2c/d35/d59/f54 [625963,130032] 0 2024-09-11T00:17:58.399 INFO:tasks.workunit.client.0.smithi078.stdout:0/510: chown d2/d2a/d2c/d35/d71 373260 1 2024-09-11T00:17:58.400 INFO:tasks.workunit.client.0.smithi078.stdout:5/415: getdents d7/d8/de/d2c/d7c 0 2024-09-11T00:17:58.400 INFO:tasks.workunit.client.0.smithi078.stdout:5/416: fsync d7/d8/d33/d22/d25/d28/d24/d1c/f82 0 2024-09-11T00:17:58.400 INFO:tasks.workunit.client.0.smithi078.stdout:5/417: dread d7/d8/d56/d2a/f35 [0,4194304] 0 2024-09-11T00:17:58.402 INFO:tasks.workunit.client.0.smithi078.stdout:8/540: rename da/d13/d19/f52 to da/d87/d3a/fa3 0 2024-09-11T00:17:58.404 INFO:tasks.workunit.client.0.smithi078.stdout:9/501: creat dc/d12/d20/d85/d3e/fab x:0 0 0 2024-09-11T00:17:58.404 INFO:tasks.workunit.client.0.smithi078.stdout:9/502: write dc/d12/d54/faa [894585,104602] 0 2024-09-11T00:17:58.405 INFO:tasks.workunit.client.0.smithi078.stdout:7/491: rmdir d0/d34/db/d30/d1d/d14/d87 39 2024-09-11T00:17:58.405 INFO:tasks.workunit.client.0.smithi078.stdout:7/492: dread - d0/f55 zero size 2024-09-11T00:17:58.405 INFO:tasks.workunit.client.0.smithi078.stdout:7/493: truncate d0/d34/d65/f71 509552 0 2024-09-11T00:17:58.412 INFO:tasks.workunit.client.0.smithi078.stdout:3/518: link d0/d7/d23/d7c/f9d d0/d7/d46/d86/d9a/fa2 0 2024-09-11T00:17:58.412 INFO:tasks.workunit.client.0.smithi078.stdout:3/519: truncate d0/d7/d18/d1b/d34/f84 1042758 0 2024-09-11T00:17:58.412 INFO:tasks.workunit.client.0.smithi078.stdout:3/520: write d0/d39/f88 [220202,48940] 0 2024-09-11T00:17:58.412 INFO:tasks.workunit.client.0.smithi078.stdout:1/629: symlink d3/d29/d5f/d39/d61/d96/lc8 0 2024-09-11T00:17:58.419 INFO:tasks.workunit.client.0.smithi078.stdout:0/511: getdents d2/d2a/d2c/d35/d59/d4f/d61/d69/d23 0 2024-09-11T00:17:58.419 INFO:tasks.workunit.client.0.smithi078.stdout:9/503: creat dc/d12/d20/d58/d5b/d68/fac x:0 0 0 2024-09-11T00:17:58.419 INFO:tasks.workunit.client.0.smithi078.stdout:0/512: stat d2/d2a/d2c/f55 0 2024-09-11T00:17:58.419 INFO:tasks.workunit.client.0.smithi078.stdout:8/541: creat da/d1c/d4c/fa4 x:0 0 0 2024-09-11T00:17:58.419 INFO:tasks.workunit.client.0.smithi078.stdout:5/418: truncate d7/d8/d56/f75 3958081 0 2024-09-11T00:17:58.420 INFO:tasks.workunit.client.0.smithi078.stdout:9/504: creat dc/d12/d20/d50/fad x:0 0 0 2024-09-11T00:17:58.421 INFO:tasks.workunit.client.0.smithi078.stdout:8/542: mknod da/d1c/d60/ca5 0 2024-09-11T00:17:58.421 INFO:tasks.workunit.client.0.smithi078.stdout:8/543: write f6 [4514092,73842] 0 2024-09-11T00:17:58.422 INFO:tasks.workunit.client.0.smithi078.stdout:9/505: symlink dc/d12/d20/d30/lae 0 2024-09-11T00:17:58.422 INFO:tasks.workunit.client.0.smithi078.stdout:6/518: sync 2024-09-11T00:17:58.423 INFO:tasks.workunit.client.0.smithi078.stdout:4/504: sync 2024-09-11T00:17:58.425 INFO:tasks.workunit.client.0.smithi078.stdout:4/505: creat dc/d10/fa7 x:0 0 0 2024-09-11T00:17:58.430 INFO:tasks.workunit.client.0.smithi078.stdout:7/494: dwrite d0/f63 [0,4194304] 0 2024-09-11T00:17:58.430 INFO:tasks.workunit.client.0.smithi078.stdout:7/495: truncate d0/d3f/f60 4345934 0 2024-09-11T00:17:58.432 INFO:tasks.workunit.client.0.smithi078.stdout:7/496: read d0/f50 [119965,37627] 0 2024-09-11T00:17:58.433 INFO:tasks.workunit.client.0.smithi078.stdout:4/506: dread dc/f1e [0,4194304] 0 2024-09-11T00:17:58.434 INFO:tasks.workunit.client.0.smithi078.stdout:7/497: creat d0/d34/db/d32/f94 x:0 0 0 2024-09-11T00:17:58.434 INFO:tasks.workunit.client.0.smithi078.stdout:7/498: fdatasync d0/d34/db/f5c 0 2024-09-11T00:17:58.436 INFO:tasks.workunit.client.0.smithi078.stdout:4/507: unlink dc/d10/d40/d3a/d65/d7b/d9e/d50/fa2 0 2024-09-11T00:17:58.437 INFO:tasks.workunit.client.0.smithi078.stdout:4/508: write dc/d10/d40/d3a/d46/f6b [288349,60064] 0 2024-09-11T00:17:58.437 INFO:tasks.workunit.client.0.smithi078.stdout:7/499: link d0/c82 d0/d34/d86/c95 0 2024-09-11T00:17:58.438 INFO:tasks.workunit.client.0.smithi078.stdout:6/519: write d0/fc [81507,117967] 0 2024-09-11T00:17:58.438 INFO:tasks.workunit.client.0.smithi078.stdout:8/544: write da/d87/d3a/fa3 [4017189,130999] 0 2024-09-11T00:17:58.439 INFO:tasks.workunit.client.0.smithi078.stdout:7/500: creat d0/d34/db/f96 x:0 0 0 2024-09-11T00:17:58.441 INFO:tasks.workunit.client.0.smithi078.stdout:3/521: dwrite d0/d7/f4e [0,4194304] 0 2024-09-11T00:17:58.442 INFO:tasks.workunit.client.0.smithi078.stdout:1/630: dwrite d3/d1a/d21/d4a/f65 [0,4194304] 0 2024-09-11T00:17:58.445 INFO:tasks.workunit.client.0.smithi078.stdout:6/520: link d0/c97 d0/d66/caf 0 2024-09-11T00:17:58.446 INFO:tasks.workunit.client.0.smithi078.stdout:7/501: mknod d0/d34/db/d30/d1d/d81/c97 0 2024-09-11T00:17:58.446 INFO:tasks.workunit.client.0.smithi078.stdout:7/502: dread - d0/d34/db/d30/d1d/f8a zero size 2024-09-11T00:17:58.446 INFO:tasks.workunit.client.0.smithi078.stdout:7/503: truncate d0/d34/db/f7c 401281 0 2024-09-11T00:17:58.447 INFO:tasks.workunit.client.0.smithi078.stdout:0/513: dwrite d2/d2a/d2c/d5e/f68 [4194304,4194304] 0 2024-09-11T00:17:58.448 INFO:tasks.workunit.client.0.smithi078.stdout:8/545: dread da/fc [0,4194304] 0 2024-09-11T00:17:58.448 INFO:tasks.workunit.client.0.smithi078.stdout:8/546: dread - da/d1c/f7c zero size 2024-09-11T00:17:58.449 INFO:tasks.workunit.client.0.smithi078.stdout:9/506: dwrite dc/d12/d20/d58/d5a/d76/f67 [0,4194304] 0 2024-09-11T00:17:58.450 INFO:tasks.workunit.client.0.smithi078.stdout:4/509: dwrite dc/d10/d40/d3a/d46/d59/f66 [0,4194304] 0 2024-09-11T00:17:58.450 INFO:tasks.workunit.client.0.smithi078.stdout:4/510: fdatasync dc/f25 0 2024-09-11T00:17:58.450 INFO:tasks.workunit.client.0.smithi078.stdout:3/522: creat d0/d7/d18/d1b/d8e/fa3 x:0 0 0 2024-09-11T00:17:58.450 INFO:tasks.workunit.client.0.smithi078.stdout:3/523: write d0/d7/d18/d8c/f9c [90894,18058] 0 2024-09-11T00:17:58.457 INFO:tasks.workunit.client.0.smithi078.stdout:4/511: write dc/d10/d40/d3a/d65/f34 [1200703,131002] 0 2024-09-11T00:17:58.457 INFO:tasks.workunit.client.0.smithi078.stdout:1/631: rmdir d3/d29/d5f/d39/d61/d96 39 2024-09-11T00:17:58.459 INFO:tasks.workunit.client.0.smithi078.stdout:6/521: mknod d0/d1/d9/d59/cb0 0 2024-09-11T00:17:58.459 INFO:tasks.workunit.client.0.smithi078.stdout:6/522: readlink d0/l12 0 2024-09-11T00:17:58.459 INFO:tasks.workunit.client.0.smithi078.stdout:6/523: write d0/d33/f8b [352710,96677] 0 2024-09-11T00:17:58.459 INFO:tasks.workunit.client.0.smithi078.stdout:8/547: dread da/f2f [0,4194304] 0 2024-09-11T00:17:58.459 INFO:tasks.workunit.client.0.smithi078.stdout:8/548: write da/d13/d1b/d37/f5a [432245,54597] 0 2024-09-11T00:17:58.459 INFO:tasks.workunit.client.0.smithi078.stdout:6/524: dread d0/d1/f79 [0,4194304] 0 2024-09-11T00:17:58.460 INFO:tasks.workunit.client.0.smithi078.stdout:7/504: rename d0/f36 to d0/d34/db/d30/d1d/d74/f98 0 2024-09-11T00:17:58.461 INFO:tasks.workunit.client.0.smithi078.stdout:1/632: dread f2 [0,4194304] 0 2024-09-11T00:17:58.462 INFO:tasks.workunit.client.0.smithi078.stdout:0/514: creat d2/d2a/d2c/d35/d93/fb2 x:0 0 0 2024-09-11T00:17:58.466 INFO:tasks.workunit.client.0.smithi078.stdout:4/512: mknod dc/d10/d40/d33/ca8 0 2024-09-11T00:17:58.468 INFO:tasks.workunit.client.0.smithi078.stdout:8/549: symlink da/d1c/d60/d85/d79/d9e/la6 0 2024-09-11T00:17:58.469 INFO:tasks.workunit.client.0.smithi078.stdout:7/505: unlink d0/d34/db/d30/d1d/d14/d62/l64 0 2024-09-11T00:17:58.469 INFO:tasks.workunit.client.0.smithi078.stdout:7/506: fsync d0/d34/db/d30/d1d/d14/f5d 0 2024-09-11T00:17:58.469 INFO:tasks.workunit.client.0.smithi078.stdout:2/486: sync 2024-09-11T00:17:58.472 INFO:tasks.workunit.client.0.smithi078.stdout:1/633: dread d3/d29/f5d [0,4194304] 0 2024-09-11T00:17:58.472 INFO:tasks.workunit.client.0.smithi078.stdout:1/634: chown d3/d29/d5f/d4e/lb7 6978537 1 2024-09-11T00:17:58.473 INFO:tasks.workunit.client.0.smithi078.stdout:9/507: link dc/d12/d20/d85/d3e/f60 dc/d12/faf 0 2024-09-11T00:17:58.474 INFO:tasks.workunit.client.0.smithi078.stdout:0/515: write d2/d2a/d2c/d35/d59/d7/fa [4265103,118133] 0 2024-09-11T00:17:58.474 INFO:tasks.workunit.client.0.smithi078.stdout:0/516: write d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/f5f [977669,15529] 0 2024-09-11T00:17:58.474 INFO:tasks.workunit.client.0.smithi078.stdout:0/517: fdatasync d2/f2d 0 2024-09-11T00:17:58.474 INFO:tasks.workunit.client.0.smithi078.stdout:0/518: write d2/d2a/d2c/d35/d59/f64 [891502,75484] 0 2024-09-11T00:17:58.475 INFO:tasks.workunit.client.0.smithi078.stdout:2/487: creat d0/d1/d6/d52/faf x:0 0 0 2024-09-11T00:17:58.475 INFO:tasks.workunit.client.0.smithi078.stdout:2/488: write d0/d67/f7a [1026603,42579] 0 2024-09-11T00:17:58.475 INFO:tasks.workunit.client.0.smithi078.stdout:2/489: write d0/d1/d8/f4f [5035460,101188] 0 2024-09-11T00:17:58.475 INFO:tasks.workunit.client.0.smithi078.stdout:2/490: dread - d0/d19/fa5 zero size 2024-09-11T00:17:58.475 INFO:tasks.workunit.client.0.smithi078.stdout:2/491: mkdir d0/d1/d11/d60/da2/db0 0 2024-09-11T00:17:58.476 INFO:tasks.workunit.client.0.smithi078.stdout:8/550: dread da/d1c/d60/f67 [0,4194304] 0 2024-09-11T00:17:58.476 INFO:tasks.workunit.client.0.smithi078.stdout:2/492: rename d0/d1/c17 to d0/d19/d3d/d8d/d8e/cb1 0 2024-09-11T00:17:58.478 INFO:tasks.workunit.client.0.smithi078.stdout:7/507: write d0/d34/db/f51 [2052587,83430] 0 2024-09-11T00:17:58.478 INFO:tasks.workunit.client.0.smithi078.stdout:2/493: rename d0/d1/f1f to d0/d67/fb2 0 2024-09-11T00:17:58.479 INFO:tasks.workunit.client.0.smithi078.stdout:2/494: stat d0/d19 0 2024-09-11T00:17:58.479 INFO:tasks.workunit.client.0.smithi078.stdout:2/495: write d0/d1/f46 [180239,98510] 0 2024-09-11T00:17:58.479 INFO:tasks.workunit.client.0.smithi078.stdout:2/496: stat d0/d1/d3b/f5c 0 2024-09-11T00:17:58.480 INFO:tasks.workunit.client.0.smithi078.stdout:2/497: unlink d0/l5b 0 2024-09-11T00:17:58.481 INFO:tasks.workunit.client.0.smithi078.stdout:2/498: getdents d0/d19 0 2024-09-11T00:17:58.481 INFO:tasks.workunit.client.0.smithi078.stdout:2/499: chown d0/d1/d6/f16 39506818 1 2024-09-11T00:17:58.486 INFO:tasks.workunit.client.0.smithi078.stdout:7/508: dread d0/d34/db/d30/d1d/d14/f79 [0,4194304] 0 2024-09-11T00:17:58.488 INFO:tasks.workunit.client.0.smithi078.stdout:1/635: write d3/f17 [5571600,15565] 0 2024-09-11T00:17:58.489 INFO:tasks.workunit.client.0.smithi078.stdout:1/636: rmdir d3/d1a/d21/d4a/d94 39 2024-09-11T00:17:58.491 INFO:tasks.workunit.client.0.smithi078.stdout:1/637: mkdir d3/d1a/d21/d4a/d90/dc7/dc9 0 2024-09-11T00:17:58.491 INFO:tasks.workunit.client.0.smithi078.stdout:1/638: write d3/d1a/d21/f2f [2872379,15448] 0 2024-09-11T00:17:58.492 INFO:tasks.workunit.client.0.smithi078.stdout:1/639: read d3/dc6/f9e [3852256,117489] 0 2024-09-11T00:17:58.492 INFO:tasks.workunit.client.0.smithi078.stdout:0/519: read d2/d2a/d2c/d35/d59/d4f/d61/f76 [157093,40891] 0 2024-09-11T00:17:58.492 INFO:tasks.workunit.client.0.smithi078.stdout:0/520: fdatasync d2/d2a/d2c/d35/d59/d7/fa 0 2024-09-11T00:17:58.492 INFO:tasks.workunit.client.0.smithi078.stdout:0/521: read - d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/f7f zero size 2024-09-11T00:17:58.492 INFO:tasks.workunit.client.0.smithi078.stdout:4/513: dwrite dc/d10/d3c/f80 [0,4194304] 0 2024-09-11T00:17:58.493 INFO:tasks.workunit.client.0.smithi078.stdout:1/640: dread d3/d29/d45/f60 [0,4194304] 0 2024-09-11T00:17:58.494 INFO:tasks.workunit.client.0.smithi078.stdout:4/514: rename dc/d10/d40/d3a/d65/f51 to dc/d10/d40/d33/fa9 0 2024-09-11T00:17:58.494 INFO:tasks.workunit.client.0.smithi078.stdout:1/641: mknod d3/d1a/d21/d4a/d90/dc7/dc9/cca 0 2024-09-11T00:17:58.495 INFO:tasks.workunit.client.0.smithi078.stdout:4/515: rename dc/d10/d1f/d68/l8d to dc/d10/d40/d3a/d65/d7b/laa 0 2024-09-11T00:17:58.496 INFO:tasks.workunit.client.0.smithi078.stdout:8/551: dwrite da/d13/d1b/f88 [0,4194304] 0 2024-09-11T00:17:58.497 INFO:tasks.workunit.client.0.smithi078.stdout:0/522: write d2/f16 [442197,43986] 0 2024-09-11T00:17:58.498 INFO:tasks.workunit.client.0.smithi078.stdout:0/523: fsync d2/d2a/d2c/d35/d59/d4f/d61/d69/f67 0 2024-09-11T00:17:58.498 INFO:tasks.workunit.client.0.smithi078.stdout:1/642: dread d3/d29/f64 [0,4194304] 0 2024-09-11T00:17:58.498 INFO:tasks.workunit.client.0.smithi078.stdout:4/516: rename dc/d10/d40/d3a/d46/d59/f66 to dc/d54/fab 0 2024-09-11T00:17:58.499 INFO:tasks.workunit.client.0.smithi078.stdout:9/508: dwrite dc/d12/d20/d58/d5a/f96 [0,4194304] 0 2024-09-11T00:17:58.500 INFO:tasks.workunit.client.0.smithi078.stdout:8/552: mkdir da/d87/d7b/da7 0 2024-09-11T00:17:58.501 INFO:tasks.workunit.client.0.smithi078.stdout:0/524: creat d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/fb3 x:0 0 0 2024-09-11T00:17:58.502 INFO:tasks.workunit.client.0.smithi078.stdout:1/643: symlink d3/d29/d45/lcb 0 2024-09-11T00:17:58.502 INFO:tasks.workunit.client.0.smithi078.stdout:1/644: dread - d3/d29/d45/fb1 zero size 2024-09-11T00:17:58.502 INFO:tasks.workunit.client.0.smithi078.stdout:1/645: write d3/d1a/d21/d4a/f69 [369068,59819] 0 2024-09-11T00:17:58.503 INFO:tasks.workunit.client.0.smithi078.stdout:4/517: mknod dc/d10/cac 0 2024-09-11T00:17:58.504 INFO:tasks.workunit.client.0.smithi078.stdout:8/553: creat da/d1c/d60/d85/d79/d99/d82/fa8 x:0 0 0 2024-09-11T00:17:58.505 INFO:tasks.workunit.client.0.smithi078.stdout:1/646: symlink d3/dc6/lcc 0 2024-09-11T00:17:58.507 INFO:tasks.workunit.client.0.smithi078.stdout:4/518: unlink dc/d10/d1f/f76 0 2024-09-11T00:17:58.509 INFO:tasks.workunit.client.0.smithi078.stdout:8/554: rmdir da/d1c/d60/d85/d79/d99/d82/d93 0 2024-09-11T00:17:58.510 INFO:tasks.workunit.client.0.smithi078.stdout:4/519: mkdir dc/d10/d40/d3a/d46/dad 0 2024-09-11T00:17:58.512 INFO:tasks.workunit.client.0.smithi078.stdout:4/520: symlink dc/d10/d69/lae 0 2024-09-11T00:17:58.516 INFO:tasks.workunit.client.0.smithi078.stdout:9/509: dwrite dc/d12/d20/d58/d5a/f96 [0,4194304] 0 2024-09-11T00:17:58.517 INFO:tasks.workunit.client.0.smithi078.stdout:9/510: truncate dc/d12/f11 548054 0 2024-09-11T00:17:58.517 INFO:tasks.workunit.client.0.smithi078.stdout:9/511: fdatasync fa 0 2024-09-11T00:17:58.517 INFO:tasks.workunit.client.0.smithi078.stdout:9/512: fdatasync dc/d12/d20/d58/d5a/f96 0 2024-09-11T00:17:58.517 INFO:tasks.workunit.client.0.smithi078.stdout:9/513: write dc/d12/d46/d51/f53 [472349,89319] 0 2024-09-11T00:17:58.519 INFO:tasks.workunit.client.0.smithi078.stdout:9/514: creat dc/d12/d20/d58/d5a/fb0 x:0 0 0 2024-09-11T00:17:58.519 INFO:tasks.workunit.client.0.smithi078.stdout:9/515: chown dc/d12/d20/d58/d5a/d76/l79 401 1 2024-09-11T00:17:58.519 INFO:tasks.workunit.client.0.smithi078.stdout:9/516: fdatasync dc/f1c 0 2024-09-11T00:17:58.520 INFO:tasks.workunit.client.0.smithi078.stdout:9/517: mkdir dc/d12/d20/d50/db1 0 2024-09-11T00:17:58.520 INFO:tasks.workunit.client.0.smithi078.stdout:9/518: fdatasync dc/d12/d20/d58/d5a/d76/d8c/f93 0 2024-09-11T00:17:58.521 INFO:tasks.workunit.client.0.smithi078.stdout:9/519: creat dc/d12/d20/d58/d5b/d68/fb2 x:0 0 0 2024-09-11T00:17:58.523 INFO:tasks.workunit.client.0.smithi078.stdout:9/520: link dc/d12/d20/d50/l6b dc/d12/d20/d50/db1/lb3 0 2024-09-11T00:17:58.524 INFO:tasks.workunit.client.0.smithi078.stdout:4/521: dwrite dc/d10/d40/d3a/d4c/f2e [4194304,4194304] 0 2024-09-11T00:17:58.524 INFO:tasks.workunit.client.0.smithi078.stdout:1/647: dwrite d3/d1a/d21/d4a/d90/f92 [0,4194304] 0 2024-09-11T00:17:58.526 INFO:tasks.workunit.client.0.smithi078.stdout:4/522: dread dc/d10/d40/d3a/d46/f6f [0,4194304] 0 2024-09-11T00:17:58.526 INFO:tasks.workunit.client.0.smithi078.stdout:8/555: read da/d13/d1b/d59/f3d [820263,107591] 0 2024-09-11T00:17:58.526 INFO:tasks.workunit.client.0.smithi078.stdout:9/521: rename dc/d12/d20/d58/d5a/d76/d8c to dc/d12/d54/db4 0 2024-09-11T00:17:58.527 INFO:tasks.workunit.client.0.smithi078.stdout:0/525: dwrite d2/d2a/d2c/d35/d59/d7/fa [0,4194304] 0 2024-09-11T00:17:58.529 INFO:tasks.workunit.client.0.smithi078.stdout:4/523: link dc/d10/fa7 dc/d10/d40/d3a/d65/d7b/d8b/faf 0 2024-09-11T00:17:58.531 INFO:tasks.workunit.client.0.smithi078.stdout:9/522: link dc/d12/d20/d50/fad dc/d12/d20/fb5 0 2024-09-11T00:17:58.532 INFO:tasks.workunit.client.0.smithi078.stdout:8/556: mkdir da/d1c/d60/d85/d79/d99/d82/d63/da9 0 2024-09-11T00:17:58.536 INFO:tasks.workunit.client.0.smithi078.stdout:1/648: read d3/d1a/d21/d4a/d90/f92 [3628550,1017] 0 2024-09-11T00:17:58.536 INFO:tasks.workunit.client.0.smithi078.stdout:1/649: write d3/dc6/f9e [3595640,62723] 0 2024-09-11T00:17:58.536 INFO:tasks.workunit.client.0.smithi078.stdout:1/650: write d3/d1a/d21/f22 [2532526,109892] 0 2024-09-11T00:17:58.536 INFO:tasks.workunit.client.0.smithi078.stdout:4/524: creat dc/d10/d3c/fb0 x:0 0 0 2024-09-11T00:17:58.537 INFO:tasks.workunit.client.0.smithi078.stdout:4/525: chown dc/d10/d40/d3a/d46/dad 27590114 1 2024-09-11T00:17:58.540 INFO:tasks.workunit.client.0.smithi078.stdout:8/557: rename da/d87/d3a/l46 to da/d1c/d60/laa 0 2024-09-11T00:17:58.540 INFO:tasks.workunit.client.0.smithi078.stdout:8/558: chown da/d1c/d60/d85/d79/d99/d82/d63 6922 1 2024-09-11T00:17:58.540 INFO:tasks.workunit.client.0.smithi078.stdout:8/559: chown da/d1c/d1e/c5c 3339 1 2024-09-11T00:17:58.542 INFO:tasks.workunit.client.0.smithi078.stdout:1/651: chown d3/d1a/l49 2 1 2024-09-11T00:17:58.544 INFO:tasks.workunit.client.0.smithi078.stdout:4/526: creat dc/d10/d40/d3a/fb1 x:0 0 0 2024-09-11T00:17:58.544 INFO:tasks.workunit.client.0.smithi078.stdout:8/560: dread da/d13/d1b/f4a [0,4194304] 0 2024-09-11T00:17:58.544 INFO:tasks.workunit.client.0.smithi078.stdout:8/561: dread - da/d1c/d1e/f55 zero size 2024-09-11T00:17:58.544 INFO:tasks.workunit.client.0.smithi078.stdout:1/652: getdents d3/d1a/d21/d4a/d94 0 2024-09-11T00:17:58.544 INFO:tasks.workunit.client.0.smithi078.stdout:1/653: fsync d3/d29/d5f/d39/d61/d96/daf/fc0 0 2024-09-11T00:17:58.545 INFO:tasks.workunit.client.0.smithi078.stdout:8/562: mkdir da/d7a/dab 0 2024-09-11T00:17:58.546 INFO:tasks.workunit.client.0.smithi078.stdout:1/654: creat d3/d1a/d21/d4a/d94/fcd x:0 0 0 2024-09-11T00:17:58.546 INFO:tasks.workunit.client.0.smithi078.stdout:8/563: link da/d13/d1b/d24/c8e da/d1c/d60/cac 0 2024-09-11T00:17:58.547 INFO:tasks.workunit.client.0.smithi078.stdout:8/564: chown da/d1c/d60/d85/d79/d99 238227596 1 2024-09-11T00:17:58.551 INFO:tasks.workunit.client.0.smithi078.stdout:1/655: read d3/d29/d45/f6d [721754,104912] 0 2024-09-11T00:17:58.553 INFO:tasks.workunit.client.0.smithi078.stdout:1/656: creat d3/d1a/d21/d4a/d90/dc7/dc9/fce x:0 0 0 2024-09-11T00:17:58.554 INFO:tasks.workunit.client.0.smithi078.stdout:1/657: mkdir d3/d1a/d21/dcf 0 2024-09-11T00:17:58.554 INFO:tasks.workunit.client.0.smithi078.stdout:1/658: chown d3/d1a/d21/cad 119338 1 2024-09-11T00:17:58.555 INFO:tasks.workunit.client.0.smithi078.stdout:1/659: creat d3/dc6/fd0 x:0 0 0 2024-09-11T00:17:58.556 INFO:tasks.workunit.client.0.smithi078.stdout:1/660: readlink d3/d1a/d21/d4a/d94/lb9 0 2024-09-11T00:17:58.556 INFO:tasks.workunit.client.0.smithi078.stdout:1/661: truncate d3/d29/d5f/d39/d61/d96/daf/fc5 2074491 0 2024-09-11T00:17:58.558 INFO:tasks.workunit.client.0.smithi078.stdout:1/662: creat d3/d1a/d21/d4a/d90/dc7/fd1 x:0 0 0 2024-09-11T00:17:58.560 INFO:tasks.workunit.client.0.smithi078.stdout:4/527: dwrite dc/d10/d40/f28 [0,4194304] 0 2024-09-11T00:17:58.561 INFO:tasks.workunit.client.0.smithi078.stdout:4/528: symlink dc/d10/d40/d33/lb2 0 2024-09-11T00:17:58.561 INFO:tasks.workunit.client.0.smithi078.stdout:4/529: read dc/d10/d40/d3a/d46/f89 [253417,6201] 0 2024-09-11T00:17:58.562 INFO:tasks.workunit.client.0.smithi078.stdout:9/523: dwrite dc/d12/d20/d58/d5b/f90 [0,4194304] 0 2024-09-11T00:17:58.562 INFO:tasks.workunit.client.0.smithi078.stdout:9/524: chown dc/d12/d20/d58/d5a/d76/f67 11728 1 2024-09-11T00:17:58.562 INFO:tasks.workunit.client.0.smithi078.stdout:9/525: chown dc/d12/d54/l59 12 1 2024-09-11T00:17:58.562 INFO:tasks.workunit.client.0.smithi078.stdout:4/530: mknod dc/d54/cb3 0 2024-09-11T00:17:58.564 INFO:tasks.workunit.client.0.smithi078.stdout:9/526: truncate dc/d12/d20/d58/d5a/d76/f66 3919000 0 2024-09-11T00:17:58.564 INFO:tasks.workunit.client.0.smithi078.stdout:9/527: read - dc/d12/d20/d50/f9b zero size 2024-09-11T00:17:58.564 INFO:tasks.workunit.client.0.smithi078.stdout:9/528: dread - dc/d12/d54/db4/fa1 zero size 2024-09-11T00:17:58.564 INFO:tasks.workunit.client.0.smithi078.stdout:9/529: chown dc/d12/d54 6553 1 2024-09-11T00:17:58.564 INFO:tasks.workunit.client.0.smithi078.stdout:8/565: dwrite da/d13/f2c [0,4194304] 0 2024-09-11T00:17:58.588 INFO:tasks.workunit.client.0.smithi078.stdout:1/663: dwrite d3/d29/f5d [4194304,4194304] 0 2024-09-11T00:17:58.588 INFO:tasks.workunit.client.0.smithi078.stdout:1/664: chown d3/d29/d5f/d39/d61/d96/cc2 2565990 1 2024-09-11T00:17:58.588 INFO:tasks.workunit.client.0.smithi078.stdout:8/566: dwrite f6 [0,4194304] 0 2024-09-11T00:17:58.588 INFO:tasks.workunit.client.0.smithi078.stdout:4/531: dwrite dc/d10/d40/f8f [0,4194304] 0 2024-09-11T00:17:58.590 INFO:tasks.workunit.client.0.smithi078.stdout:1/665: rename d3/d29/l37 to d3/d29/d5f/d39/d61/ld2 0 2024-09-11T00:17:58.590 INFO:tasks.workunit.client.0.smithi078.stdout:9/530: dwrite dc/d12/d54/f57 [0,4194304] 0 2024-09-11T00:17:58.591 INFO:tasks.workunit.client.0.smithi078.stdout:8/567: symlink da/d13/d1b/d24/d86/d91/lad 0 2024-09-11T00:17:58.592 INFO:tasks.workunit.client.0.smithi078.stdout:1/666: dread d3/d1a/d21/d4a/f69 [0,4194304] 0 2024-09-11T00:17:58.592 INFO:tasks.workunit.client.0.smithi078.stdout:1/667: chown d3/d1a/d21/f57 12449099 1 2024-09-11T00:17:58.593 INFO:tasks.workunit.client.0.smithi078.stdout:4/532: rename dc/d10/d69 to dc/d10/d40/d3a/d4c/db4 0 2024-09-11T00:17:58.596 INFO:tasks.workunit.client.0.smithi078.stdout:9/531: creat dc/d12/fb6 x:0 0 0 2024-09-11T00:17:58.606 INFO:tasks.workunit.client.0.smithi078.stdout:8/568: dwrite da/d87/d3a/fa3 [0,4194304] 0 2024-09-11T00:17:58.608 INFO:tasks.workunit.client.0.smithi078.stdout:8/569: unlink da/d87/c47 0 2024-09-11T00:17:58.609 INFO:tasks.workunit.client.0.smithi078.stdout:8/570: link da/d13/d1b/d37/f7e da/d1c/fae 0 2024-09-11T00:17:58.610 INFO:tasks.workunit.client.0.smithi078.stdout:8/571: unlink da/d13/d1b/d24/c8e 0 2024-09-11T00:17:58.616 INFO:tasks.workunit.client.0.smithi078.stdout:9/532: dwrite dc/d12/d20/d58/d5b/d68/fac [0,4194304] 0 2024-09-11T00:17:58.619 INFO:tasks.workunit.client.0.smithi078.stdout:9/533: mknod dc/d12/d20/d85/cb7 0 2024-09-11T00:17:58.619 INFO:tasks.workunit.client.0.smithi078.stdout:9/534: chown dc/d12/d20/d85 296 1 2024-09-11T00:17:58.619 INFO:tasks.workunit.client.0.smithi078.stdout:9/535: write dc/d12/d20/d85/f9a [899415,10165] 0 2024-09-11T00:17:58.620 INFO:tasks.workunit.client.0.smithi078.stdout:9/536: write dc/d12/d20/d50/f9b [663960,75871] 0 2024-09-11T00:17:58.620 INFO:tasks.workunit.client.0.smithi078.stdout:9/537: dread - dc/d12/d20/d58/d5a/fb0 zero size 2024-09-11T00:17:58.620 INFO:tasks.workunit.client.0.smithi078.stdout:9/538: stat dc/d12/d20/d58/d5a/d76/c5d 0 2024-09-11T00:17:58.621 INFO:tasks.workunit.client.0.smithi078.stdout:9/539: fsync dc/d12/fb6 0 2024-09-11T00:17:58.623 INFO:tasks.workunit.client.0.smithi078.stdout:8/572: dwrite f2 [0,4194304] 0 2024-09-11T00:17:58.626 INFO:tasks.workunit.client.0.smithi078.stdout:8/573: link da/d1c/f78 da/d87/d7b/faf 0 2024-09-11T00:17:58.629 INFO:tasks.workunit.client.0.smithi078.stdout:5/419: sync 2024-09-11T00:17:58.630 INFO:tasks.workunit.client.0.smithi078.stdout:5/420: creat d7/d8/d33/d22/f97 x:0 0 0 2024-09-11T00:17:58.640 INFO:tasks.workunit.client.0.smithi078.stdout:8/574: dwrite da/d13/d1b/d37/f90 [0,4194304] 0 2024-09-11T00:17:58.644 INFO:tasks.workunit.client.0.smithi078.stdout:8/575: dread da/d1c/fa1 [0,4194304] 0 2024-09-11T00:17:58.644 INFO:tasks.workunit.client.0.smithi078.stdout:8/576: chown da/d13/d1b/d37/l72 471970 1 2024-09-11T00:17:58.652 INFO:tasks.workunit.client.0.smithi078.stdout:5/421: dwrite d7/d8/de/f4a [0,4194304] 0 2024-09-11T00:17:58.653 INFO:tasks.workunit.client.0.smithi078.stdout:5/422: mknod d7/d8/d33/d22/d25/d28/d24/c98 0 2024-09-11T00:17:58.654 INFO:tasks.workunit.client.0.smithi078.stdout:5/423: unlink d7/d8/de/l18 0 2024-09-11T00:17:58.659 INFO:tasks.workunit.client.0.smithi078.stdout:8/577: dwrite da/d1c/f38 [0,4194304] 0 2024-09-11T00:17:58.661 INFO:tasks.workunit.client.0.smithi078.stdout:8/578: link da/c84 da/d13/cb0 0 2024-09-11T00:17:58.662 INFO:tasks.workunit.client.0.smithi078.stdout:8/579: truncate da/d87/d3a/f40 2194974 0 2024-09-11T00:17:58.662 INFO:tasks.workunit.client.0.smithi078.stdout:8/580: fsync da/d13/f31 0 2024-09-11T00:17:58.669 INFO:tasks.workunit.client.0.smithi078.stdout:8/581: dread da/d1c/fa1 [0,4194304] 0 2024-09-11T00:17:58.670 INFO:tasks.workunit.client.0.smithi078.stdout:8/582: symlink da/d13/d1b/d59/lb1 0 2024-09-11T00:17:58.670 INFO:tasks.workunit.client.0.smithi078.stdout:8/583: stat da/d13/d1b/d24/f27 0 2024-09-11T00:17:58.671 INFO:tasks.workunit.client.0.smithi078.stdout:8/584: creat da/d1c/d60/d85/d79/d99/d82/d63/da9/fb2 x:0 0 0 2024-09-11T00:17:58.671 INFO:tasks.workunit.client.0.smithi078.stdout:8/585: write da/d1c/fae [95672,89558] 0 2024-09-11T00:17:58.672 INFO:tasks.workunit.client.0.smithi078.stdout:8/586: link da/d1c/d60/d85/d79/d99/d82/d63/f9c da/d1c/d60/fb3 0 2024-09-11T00:17:58.673 INFO:tasks.workunit.client.0.smithi078.stdout:8/587: creat da/d1c/d60/fb4 x:0 0 0 2024-09-11T00:17:58.678 INFO:tasks.workunit.client.0.smithi078.stdout:5/424: dwrite d7/d8/d56/f83 [0,4194304] 0 2024-09-11T00:17:58.680 INFO:tasks.workunit.client.0.smithi078.stdout:5/425: creat d7/d8/de/d2c/f99 x:0 0 0 2024-09-11T00:17:58.680 INFO:tasks.workunit.client.0.smithi078.stdout:5/426: readlink d7/d8/d33/d22/d25/d28/d24/l95 0 2024-09-11T00:17:58.681 INFO:tasks.workunit.client.0.smithi078.stdout:5/427: mknod d7/d8/d33/d22/d25/c9a 0 2024-09-11T00:17:58.683 INFO:tasks.workunit.client.0.smithi078.stdout:5/428: truncate d7/d8/d33/d22/d25/d28/d24/d1c/f82 3068334 0 2024-09-11T00:17:58.685 INFO:tasks.workunit.client.0.smithi078.stdout:5/429: rename d7/d8/d33/d22/d25/f45 to d7/d8/d33/d22/d51/f9b 0 2024-09-11T00:17:58.686 INFO:tasks.workunit.client.0.smithi078.stdout:5/430: getdents d7/d8/d47 0 2024-09-11T00:17:58.694 INFO:tasks.workunit.client.0.smithi078.stdout:8/588: dwrite da/d1c/d60/d85/d79/f83 [0,4194304] 0 2024-09-11T00:17:58.696 INFO:tasks.workunit.client.0.smithi078.stdout:8/589: symlink da/d1c/d60/d85/d79/d9e/lb5 0 2024-09-11T00:17:58.708 INFO:tasks.workunit.client.0.smithi078.stdout:5/431: dwrite d7/d8/f87 [0,4194304] 0 2024-09-11T00:17:58.710 INFO:tasks.workunit.client.0.smithi078.stdout:5/432: mknod d7/d8/de/d2c/d62/c9c 0 2024-09-11T00:17:58.710 INFO:tasks.workunit.client.0.smithi078.stdout:5/433: write d7/d8/d33/d22/d25/d6a/f6e [4517789,54264] 0 2024-09-11T00:17:58.711 INFO:tasks.workunit.client.0.smithi078.stdout:5/434: symlink d7/l9d 0 2024-09-11T00:17:58.711 INFO:tasks.workunit.client.0.smithi078.stdout:5/435: write d7/d8/d56/f6f [1063610,128495] 0 2024-09-11T00:17:58.712 INFO:tasks.workunit.client.0.smithi078.stdout:8/590: dwrite da/d13/d1b/f88 [0,4194304] 0 2024-09-11T00:17:58.718 INFO:tasks.workunit.client.0.smithi078.stdout:3/524: sync 2024-09-11T00:17:58.718 INFO:tasks.workunit.client.0.smithi078.stdout:3/525: getdents d0/d7/d18/d1b/d34/d60/d6d 0 2024-09-11T00:17:58.726 INFO:tasks.workunit.client.0.smithi078.stdout:8/591: dwrite da/d1c/d4c/fa4 [0,4194304] 0 2024-09-11T00:17:58.729 INFO:tasks.workunit.client.0.smithi078.stdout:8/592: mknod da/d87/d7b/cb6 0 2024-09-11T00:17:58.729 INFO:tasks.workunit.client.0.smithi078.stdout:8/593: dread - da/d13/d1b/d59/f97 zero size 2024-09-11T00:17:58.730 INFO:tasks.workunit.client.0.smithi078.stdout:8/594: truncate da/d1c/d1e/f55 456452 0 2024-09-11T00:17:58.730 INFO:tasks.workunit.client.0.smithi078.stdout:8/595: truncate da/d87/d7b/faf 1538395 0 2024-09-11T00:17:58.730 INFO:tasks.workunit.client.0.smithi078.stdout:8/596: link da/d87/d3a/f40 da/d13/d1b/d37/fb7 0 2024-09-11T00:17:58.732 INFO:tasks.workunit.client.0.smithi078.stdout:3/526: dwrite d0/d7/d23/d91/f22 [0,4194304] 0 2024-09-11T00:17:58.732 INFO:tasks.workunit.client.0.smithi078.stdout:3/527: rmdir d0/d7/d18/d1b/d34 39 2024-09-11T00:17:58.732 INFO:tasks.workunit.client.0.smithi078.stdout:3/528: chown d0/d7/d18/d70/f76 176783 1 2024-09-11T00:17:58.733 INFO:tasks.workunit.client.0.smithi078.stdout:3/529: getdents d0/d7 0 2024-09-11T00:17:58.733 INFO:tasks.workunit.client.0.smithi078.stdout:3/530: truncate d0/d7/f8b 2883298 0 2024-09-11T00:17:58.733 INFO:tasks.workunit.client.0.smithi078.stdout:3/531: chown d0/d7/d23/d7c 4886980 1 2024-09-11T00:17:58.745 INFO:tasks.workunit.client.0.smithi078.stdout:8/597: dwrite da/d13/d1b/d37/fb7 [0,4194304] 0 2024-09-11T00:17:58.745 INFO:tasks.workunit.client.0.smithi078.stdout:8/598: dread - da/d1c/d60/d85/d79/d99/d82/d63/f9c zero size 2024-09-11T00:17:58.745 INFO:tasks.workunit.client.0.smithi078.stdout:8/599: symlink da/d13/d1b/d4e/lb8 0 2024-09-11T00:17:58.747 INFO:tasks.workunit.client.0.smithi078.stdout:8/600: creat da/d87/d3a/fb9 x:0 0 0 2024-09-11T00:17:58.747 INFO:tasks.workunit.client.0.smithi078.stdout:3/532: dwrite d0/d7/d18/d1b/d8e/fa3 [0,4194304] 0 2024-09-11T00:17:58.749 INFO:tasks.workunit.client.0.smithi078.stdout:3/533: symlink d0/d1a/d77/la4 0 2024-09-11T00:17:58.749 INFO:tasks.workunit.client.0.smithi078.stdout:3/534: dread - d0/d7/f87 zero size 2024-09-11T00:17:58.749 INFO:tasks.workunit.client.0.smithi078.stdout:3/535: write d0/d7/f8b [3681891,69379] 0 2024-09-11T00:17:58.750 INFO:tasks.workunit.client.0.smithi078.stdout:3/536: chown d0/d7/d18/d1b/d34/d60/d6d/f3a 1 1 2024-09-11T00:17:58.750 INFO:tasks.workunit.client.0.smithi078.stdout:3/537: dread - d0/d7/d46/d86/d9a/fa2 zero size 2024-09-11T00:17:58.750 INFO:tasks.workunit.client.0.smithi078.stdout:3/538: getdents d0/d7/d18 0 2024-09-11T00:17:58.750 INFO:tasks.workunit.client.0.smithi078.stdout:3/539: readlink d0/d7/d18/l75 0 2024-09-11T00:17:58.764 INFO:tasks.workunit.client.0.smithi078.stdout:3/540: write d0/d7/d18/d70/f76 [765377,81304] 0 2024-09-11T00:17:58.765 INFO:tasks.workunit.client.0.smithi078.stdout:3/541: creat d0/d7/d46/d86/fa5 x:0 0 0 2024-09-11T00:17:58.765 INFO:tasks.workunit.client.0.smithi078.stdout:8/601: dwrite da/d1c/fa1 [0,4194304] 0 2024-09-11T00:17:58.779 INFO:tasks.workunit.client.0.smithi078.stdout:3/542: dwrite d0/d7/d18/d1b/d34/f84 [0,4194304] 0 2024-09-11T00:17:58.791 INFO:tasks.workunit.client.0.smithi078.stdout:8/602: dwrite da/d1c/f7c [0,4194304] 0 2024-09-11T00:17:58.791 INFO:tasks.workunit.client.0.smithi078.stdout:8/603: chown da/d13/d1b/d4e 4 1 2024-09-11T00:17:58.794 INFO:tasks.workunit.client.0.smithi078.stdout:8/604: creat da/fba x:0 0 0 2024-09-11T00:17:58.796 INFO:tasks.workunit.client.0.smithi078.stdout:8/605: rename da/l20 to da/d13/d1b/d37/lbb 0 2024-09-11T00:17:58.798 INFO:tasks.workunit.client.0.smithi078.stdout:8/606: rename da/d1c/d1e to da/d1c/d4c/dbc 0 2024-09-11T00:17:58.798 INFO:tasks.workunit.client.0.smithi078.stdout:8/607: symlink da/d13/d19/lbd 0 2024-09-11T00:17:58.801 INFO:tasks.workunit.client.0.smithi078.stdout:8/608: unlink da/d13/d1b/d24/c2d 0 2024-09-11T00:17:58.801 INFO:tasks.workunit.client.0.smithi078.stdout:8/609: fsync da/d1c/fa1 0 2024-09-11T00:17:58.801 INFO:tasks.workunit.client.0.smithi078.stdout:2/500: sync 2024-09-11T00:17:58.801 INFO:tasks.workunit.client.0.smithi078.stdout:4/533: sync 2024-09-11T00:17:58.801 INFO:tasks.workunit.client.0.smithi078.stdout:6/525: sync 2024-09-11T00:17:58.801 INFO:tasks.workunit.client.0.smithi078.stdout:1/668: sync 2024-09-11T00:17:58.801 INFO:tasks.workunit.client.0.smithi078.stdout:0/526: sync 2024-09-11T00:17:58.801 INFO:tasks.workunit.client.0.smithi078.stdout:7/509: sync 2024-09-11T00:17:58.801 INFO:tasks.workunit.client.0.smithi078.stdout:7/510: chown d0/d34/db/d30/d1d/d81/c97 77891503 1 2024-09-11T00:17:58.801 INFO:tasks.workunit.client.0.smithi078.stdout:0/527: write d2/d2a/d2c/d35/d59/d4f/d61/d69/f67 [136460,123930] 0 2024-09-11T00:17:58.802 INFO:tasks.workunit.client.0.smithi078.stdout:7/511: write d0/d34/db/d32/f72 [611569,114113] 0 2024-09-11T00:17:58.802 INFO:tasks.workunit.client.0.smithi078.stdout:8/610: mkdir da/d13/d19/dbe 0 2024-09-11T00:17:58.802 INFO:tasks.workunit.client.0.smithi078.stdout:1/669: mkdir d3/db3/dd3 0 2024-09-11T00:17:58.802 INFO:tasks.workunit.client.0.smithi078.stdout:6/526: mknod d0/d66/da5/cb1 0 2024-09-11T00:17:58.803 INFO:tasks.workunit.client.0.smithi078.stdout:2/501: creat d0/d1/d11/d60/da2/fb3 x:0 0 0 2024-09-11T00:17:58.803 INFO:tasks.workunit.client.0.smithi078.stdout:2/502: readlink d0/d1/d6/l66 0 2024-09-11T00:17:58.803 INFO:tasks.workunit.client.0.smithi078.stdout:2/503: chown d0/d1/c2 225 1 2024-09-11T00:17:58.804 INFO:tasks.workunit.client.0.smithi078.stdout:0/528: symlink d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/lb4 0 2024-09-11T00:17:58.804 INFO:tasks.workunit.client.0.smithi078.stdout:0/529: getdents d2/d97 0 2024-09-11T00:17:58.805 INFO:tasks.workunit.client.0.smithi078.stdout:8/611: rename da/d1c/d60/d85/d79/c7f to da/d13/d1b/d24/cbf 0 2024-09-11T00:17:58.806 INFO:tasks.workunit.client.0.smithi078.stdout:4/534: dread dc/d10/d40/d3a/d65/f3f [0,4194304] 0 2024-09-11T00:17:58.806 INFO:tasks.workunit.client.0.smithi078.stdout:4/535: write dc/d10/f3d [699047,127330] 0 2024-09-11T00:17:58.806 INFO:tasks.workunit.client.0.smithi078.stdout:0/530: creat d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/fb5 x:0 0 0 2024-09-11T00:17:58.808 INFO:tasks.workunit.client.0.smithi078.stdout:8/612: unlink da/fe 0 2024-09-11T00:17:58.808 INFO:tasks.workunit.client.0.smithi078.stdout:8/613: truncate da/d13/f50 4761431 0 2024-09-11T00:17:58.810 INFO:tasks.workunit.client.0.smithi078.stdout:1/670: dread d3/d29/d5f/d39/f6f [0,4194304] 0 2024-09-11T00:17:58.810 INFO:tasks.workunit.client.0.smithi078.stdout:2/504: rename d0/d1/d8/d83 to d0/d1/d33/d86/db4 0 2024-09-11T00:17:58.813 INFO:tasks.workunit.client.0.smithi078.stdout:4/536: rename dc/d8e to dc/d10/d1f/d68/db5 0 2024-09-11T00:17:58.814 INFO:tasks.workunit.client.0.smithi078.stdout:2/505: symlink d0/d1/d11/d60/da2/lb5 0 2024-09-11T00:17:58.815 INFO:tasks.workunit.client.0.smithi078.stdout:1/671: link d3/d1a/d21/d4a/d94/faa d3/d29/d45/fd4 0 2024-09-11T00:17:58.817 INFO:tasks.workunit.client.0.smithi078.stdout:0/531: rename d2/d2a/d2c/d5e/c87 to d2/d2a/d2c/d35/d71/cb6 0 2024-09-11T00:17:58.818 INFO:tasks.workunit.client.0.smithi078.stdout:0/532: read d2/d2a/d2c/d35/d59/d7/f86 [112142,118167] 0 2024-09-11T00:17:58.818 INFO:tasks.workunit.client.0.smithi078.stdout:4/537: creat dc/d10/d40/d3a/d65/d94/fb6 x:0 0 0 2024-09-11T00:17:58.818 INFO:tasks.workunit.client.0.smithi078.stdout:4/538: stat dc/d54/fab 0 2024-09-11T00:17:58.819 INFO:tasks.workunit.client.0.smithi078.stdout:7/512: dwrite d0/d34/db/d30/d28/f6a [0,4194304] 0 2024-09-11T00:17:58.820 INFO:tasks.workunit.client.0.smithi078.stdout:2/506: symlink d0/d1/d6/d52/da8/lb6 0 2024-09-11T00:17:58.820 INFO:tasks.workunit.client.0.smithi078.stdout:2/507: write d0/d1/d33/f91 [641974,53409] 0 2024-09-11T00:17:58.820 INFO:tasks.workunit.client.0.smithi078.stdout:2/508: write d0/d1/d11/f69 [812537,18327] 0 2024-09-11T00:17:58.820 INFO:tasks.workunit.client.0.smithi078.stdout:2/509: dread - d0/d1/d6/f9c zero size 2024-09-11T00:17:58.821 INFO:tasks.workunit.client.0.smithi078.stdout:2/510: write d0/d1/d11/d60/da2/d38/f80 [833426,56458] 0 2024-09-11T00:17:58.821 INFO:tasks.workunit.client.0.smithi078.stdout:0/533: truncate d2/d2a/d2c/d35/d59/d4f/f80 3464294 0 2024-09-11T00:17:58.822 INFO:tasks.workunit.client.0.smithi078.stdout:4/539: creat dc/d10/d1f/d68/db5/fb7 x:0 0 0 2024-09-11T00:17:58.827 INFO:tasks.workunit.client.0.smithi078.stdout:2/511: mkdir d0/d1/d33/d86/db4/db7 0 2024-09-11T00:17:58.829 INFO:tasks.workunit.client.0.smithi078.stdout:0/534: mkdir d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/db7 0 2024-09-11T00:17:58.829 INFO:tasks.workunit.client.0.smithi078.stdout:0/535: fdatasync d2/d2a/f2f 0 2024-09-11T00:17:58.829 INFO:tasks.workunit.client.0.smithi078.stdout:0/536: chown d2/d2a/d2c/d35/d71/cb6 0 1 2024-09-11T00:17:58.831 INFO:tasks.workunit.client.0.smithi078.stdout:2/512: link d0/d1/d6/d52/ca1 d0/d1/d11/d60/da2/d3a/d51/d97/cb8 0 2024-09-11T00:17:58.831 INFO:tasks.workunit.client.0.smithi078.stdout:8/614: dwrite da/d1c/d60/d85/d79/d99/d82/d63/f9c [0,4194304] 0 2024-09-11T00:17:58.836 INFO:tasks.workunit.client.0.smithi078.stdout:2/513: unlink d0/d1/d3c/d40/d50/f89 0 2024-09-11T00:17:58.836 INFO:tasks.workunit.client.0.smithi078.stdout:2/514: chown d0/d1/d6 41059567 1 2024-09-11T00:17:58.838 INFO:tasks.workunit.client.0.smithi078.stdout:1/672: dwrite d3/d1a/d21/d4a/d94/faa [0,4194304] 0 2024-09-11T00:17:58.841 INFO:tasks.workunit.client.0.smithi078.stdout:2/515: truncate d0/d1/d6/f37 2862797 0 2024-09-11T00:17:58.841 INFO:tasks.workunit.client.0.smithi078.stdout:2/516: write d0/d1/d3c/d9f/fa9 [715484,33329] 0 2024-09-11T00:17:58.843 INFO:tasks.workunit.client.0.smithi078.stdout:4/540: read dc/d10/d1f/f35 [4033108,89062] 0 2024-09-11T00:17:58.843 INFO:tasks.workunit.client.0.smithi078.stdout:7/513: dwrite d0/d34/db/d30/f76 [0,4194304] 0 2024-09-11T00:17:58.845 INFO:tasks.workunit.client.0.smithi078.stdout:1/673: symlink d3/d29/d5f/d39/ld5 0 2024-09-11T00:17:58.845 INFO:tasks.workunit.client.0.smithi078.stdout:1/674: write d3/d29/d5f/d39/d61/fa1 [649773,116218] 0 2024-09-11T00:17:58.846 INFO:tasks.workunit.client.0.smithi078.stdout:2/517: creat d0/d1/d33/fb9 x:0 0 0 2024-09-11T00:17:58.847 INFO:tasks.workunit.client.0.smithi078.stdout:8/615: dread da/f2a [0,4194304] 0 2024-09-11T00:17:58.847 INFO:tasks.workunit.client.0.smithi078.stdout:4/541: link dc/d10/d40/d3a/d46/l88 dc/d10/d40/d3a/d4c/lb8 0 2024-09-11T00:17:58.848 INFO:tasks.workunit.client.0.smithi078.stdout:4/542: stat dc/d10/d1f/f97 0 2024-09-11T00:17:58.848 INFO:tasks.workunit.client.0.smithi078.stdout:4/543: read dc/f39 [447640,33525] 0 2024-09-11T00:17:58.848 INFO:tasks.workunit.client.0.smithi078.stdout:8/616: write f6 [4495676,91396] 0 2024-09-11T00:17:58.850 INFO:tasks.workunit.client.0.smithi078.stdout:0/537: dwrite d2/d57/f88 [0,4194304] 0 2024-09-11T00:17:58.850 INFO:tasks.workunit.client.0.smithi078.stdout:7/514: mknod d0/d34/db/d30/d1d/d14/d45/c99 0 2024-09-11T00:17:58.850 INFO:tasks.workunit.client.0.smithi078.stdout:7/515: fsync d0/f1e 0 2024-09-11T00:17:58.851 INFO:tasks.workunit.client.0.smithi078.stdout:1/675: getdents d3/d1a/d21/d4a/d90/dc7 0 2024-09-11T00:17:58.851 INFO:tasks.workunit.client.0.smithi078.stdout:1/676: chown d3/d29/d45/c54 1 1 2024-09-11T00:17:58.851 INFO:tasks.workunit.client.0.smithi078.stdout:2/518: mknod d0/d1/cba 0 2024-09-11T00:17:58.853 INFO:tasks.workunit.client.0.smithi078.stdout:8/617: creat da/d13/d1b/d37/fc0 x:0 0 0 2024-09-11T00:17:58.857 INFO:tasks.workunit.client.0.smithi078.stdout:0/538: truncate d2/d2a/d2c/d35/d59/d4f/d61/fae 430180 0 2024-09-11T00:17:58.858 INFO:tasks.workunit.client.0.smithi078.stdout:1/677: rename d3/d29/d45/f70 to d3/d1a/d21/dcf/fd6 0 2024-09-11T00:17:58.858 INFO:tasks.workunit.client.0.smithi078.stdout:0/539: dread d2/d2a/d2c/d35/d59/d7/f86 [0,4194304] 0 2024-09-11T00:17:58.860 INFO:tasks.workunit.client.0.smithi078.stdout:2/519: getdents d0/d1/d11/d1b 0 2024-09-11T00:17:58.860 INFO:tasks.workunit.client.0.smithi078.stdout:2/520: write d0/d1/d8/f6e [3437170,118253] 0 2024-09-11T00:17:58.862 INFO:tasks.workunit.client.0.smithi078.stdout:1/678: rmdir d3/d1a/d21/d4a/d90 39 2024-09-11T00:17:58.863 INFO:tasks.workunit.client.0.smithi078.stdout:0/540: symlink d2/d2a/d2c/d35/daf/lb8 0 2024-09-11T00:17:58.864 INFO:tasks.workunit.client.0.smithi078.stdout:8/618: dread da/d1c/d60/f67 [0,4194304] 0 2024-09-11T00:17:58.864 INFO:tasks.workunit.client.0.smithi078.stdout:1/679: mkdir d3/d1a/d21/d4a/d90/dd7 0 2024-09-11T00:17:58.864 INFO:tasks.workunit.client.0.smithi078.stdout:1/680: stat d3 0 2024-09-11T00:17:58.865 INFO:tasks.workunit.client.0.smithi078.stdout:0/541: mkdir d2/d2a/d2c/d35/d59/d7/d96/db9 0 2024-09-11T00:17:58.866 INFO:tasks.workunit.client.0.smithi078.stdout:8/619: mknod da/d1c/d60/d85/d94/cc1 0 2024-09-11T00:17:58.866 INFO:tasks.workunit.client.0.smithi078.stdout:8/620: write da/d13/d1b/f2e [1126334,97227] 0 2024-09-11T00:17:58.867 INFO:tasks.workunit.client.0.smithi078.stdout:1/681: mkdir d3/d29/dc4/dd8 0 2024-09-11T00:17:58.868 INFO:tasks.workunit.client.0.smithi078.stdout:2/521: dread d0/d1/d33/d86/db4/f65 [0,4194304] 0 2024-09-11T00:17:58.869 INFO:tasks.workunit.client.0.smithi078.stdout:0/542: unlink d2/d2a/d2c/d35/d59/d4f/d61/d69/f38 0 2024-09-11T00:17:58.871 INFO:tasks.workunit.client.0.smithi078.stdout:4/544: dwrite dc/d10/f3d [0,4194304] 0 2024-09-11T00:17:58.871 INFO:tasks.workunit.client.0.smithi078.stdout:4/545: fdatasync dc/d10/d40/d3a/d46/f89 0 2024-09-11T00:17:58.871 INFO:tasks.workunit.client.0.smithi078.stdout:1/682: rmdir d3/d29/d5f/d39 39 2024-09-11T00:17:58.871 INFO:tasks.workunit.client.0.smithi078.stdout:1/683: chown d3/d1a/d21/d88/fa6 9691 1 2024-09-11T00:17:58.872 INFO:tasks.workunit.client.0.smithi078.stdout:2/522: rmdir d0/d1/d11/d60 39 2024-09-11T00:17:58.872 INFO:tasks.workunit.client.0.smithi078.stdout:2/523: stat d0/d19/l72 0 2024-09-11T00:17:58.872 INFO:tasks.workunit.client.0.smithi078.stdout:2/524: chown d0/d1/d6/f37 4410799 1 2024-09-11T00:17:58.877 INFO:tasks.workunit.client.0.smithi078.stdout:4/546: creat dc/d10/d40/d3a/d46/dad/fb9 x:0 0 0 2024-09-11T00:17:58.877 INFO:tasks.workunit.client.0.smithi078.stdout:7/516: dwrite d0/d34/f33 [0,4194304] 0 2024-09-11T00:17:58.877 INFO:tasks.workunit.client.0.smithi078.stdout:7/517: dread - d0/d34/d65/f8d zero size 2024-09-11T00:17:58.878 INFO:tasks.workunit.client.0.smithi078.stdout:4/547: getdents dc/d10 0 2024-09-11T00:17:58.880 INFO:tasks.workunit.client.0.smithi078.stdout:2/525: write d0/d1/d6/f48 [1290558,9696] 0 2024-09-11T00:17:58.880 INFO:tasks.workunit.client.0.smithi078.stdout:2/526: chown d0/d1/d11/d60/da2/d3a/d51/l9d 108637283 1 2024-09-11T00:17:58.880 INFO:tasks.workunit.client.0.smithi078.stdout:2/527: truncate d0/d1/d3c/f45 5042454 0 2024-09-11T00:17:58.880 INFO:tasks.workunit.client.0.smithi078.stdout:1/684: write d3/d29/d45/f3a [936076,20346] 0 2024-09-11T00:17:58.881 INFO:tasks.workunit.client.0.smithi078.stdout:7/518: creat d0/d34/db/d30/d1d/d14/f9a x:0 0 0 2024-09-11T00:17:58.882 INFO:tasks.workunit.client.0.smithi078.stdout:2/528: rmdir d0/d1/d6/d52/da8 39 2024-09-11T00:17:58.883 INFO:tasks.workunit.client.0.smithi078.stdout:1/685: mknod d3/dc6/cd9 0 2024-09-11T00:17:58.884 INFO:tasks.workunit.client.0.smithi078.stdout:1/686: creat d3/d29/d5f/d39/d61/d96/fda x:0 0 0 2024-09-11T00:17:58.886 INFO:tasks.workunit.client.0.smithi078.stdout:1/687: symlink d3/d29/d5f/d39/d61/d96/daf/ldb 0 2024-09-11T00:17:58.893 INFO:tasks.workunit.client.0.smithi078.stdout:0/543: dwrite d2/d2a/d2c/d35/d59/d7/f40 [0,4194304] 0 2024-09-11T00:17:58.893 INFO:tasks.workunit.client.0.smithi078.stdout:0/544: write d2/f8d [169397,81455] 0 2024-09-11T00:17:58.896 INFO:tasks.workunit.client.0.smithi078.stdout:2/529: dread d0/d1/d8/f1d [0,4194304] 0 2024-09-11T00:17:58.900 INFO:tasks.workunit.client.0.smithi078.stdout:2/530: dread d0/d1/f4 [0,4194304] 0 2024-09-11T00:17:58.901 INFO:tasks.workunit.client.0.smithi078.stdout:2/531: creat d0/d1/d6/d52/fbb x:0 0 0 2024-09-11T00:17:58.901 INFO:tasks.workunit.client.0.smithi078.stdout:2/532: chown d0/d19/d3d/f62 29 1 2024-09-11T00:17:58.902 INFO:tasks.workunit.client.0.smithi078.stdout:2/533: symlink d0/d67/lbc 0 2024-09-11T00:17:58.903 INFO:tasks.workunit.client.0.smithi078.stdout:2/534: mkdir d0/d1/d11/d60/da2/d3a/d51/d97/dbd 0 2024-09-11T00:17:58.905 INFO:tasks.workunit.client.0.smithi078.stdout:2/535: rename d0/d1/c18 to d0/d1/d11/d60/da2/d3a/cbe 0 2024-09-11T00:17:58.906 INFO:tasks.workunit.client.0.smithi078.stdout:2/536: creat d0/d1/d11/d1b/d1e/fbf x:0 0 0 2024-09-11T00:17:58.909 INFO:tasks.workunit.client.0.smithi078.stdout:2/537: mkdir d0/d1/d3c/d40/d50/dc0 0 2024-09-11T00:17:58.909 INFO:tasks.workunit.client.0.smithi078.stdout:2/538: write d0/d1/f46 [201102,96005] 0 2024-09-11T00:17:58.912 INFO:tasks.workunit.client.0.smithi078.stdout:2/539: unlink d0/d67/f82 0 2024-09-11T00:17:58.912 INFO:tasks.workunit.client.0.smithi078.stdout:4/548: dwrite dc/d10/d1f/d68/db5/fb7 [0,4194304] 0 2024-09-11T00:17:58.913 INFO:tasks.workunit.client.0.smithi078.stdout:2/540: creat d0/d1/d33/d86/fc1 x:0 0 0 2024-09-11T00:17:58.914 INFO:tasks.workunit.client.0.smithi078.stdout:2/541: truncate d0/d19/d3d/f62 668584 0 2024-09-11T00:17:58.915 INFO:tasks.workunit.client.0.smithi078.stdout:2/542: rmdir d0/d1/d3c 39 2024-09-11T00:17:58.917 INFO:tasks.workunit.client.0.smithi078.stdout:2/543: mknod d0/d1/d6f/d93/cc2 0 2024-09-11T00:17:58.917 INFO:tasks.workunit.client.0.smithi078.stdout:2/544: write d0/d1/d8/f9e [490446,12135] 0 2024-09-11T00:17:58.917 INFO:tasks.workunit.client.0.smithi078.stdout:2/545: mkdir d0/d1/d6f/d93/dc3 0 2024-09-11T00:17:58.918 INFO:tasks.workunit.client.0.smithi078.stdout:2/546: chown d0/d1/d6f 4057860 1 2024-09-11T00:17:58.918 INFO:tasks.workunit.client.0.smithi078.stdout:2/547: fsync d0/d1/d3b/f5c 0 2024-09-11T00:17:58.918 INFO:tasks.workunit.client.0.smithi078.stdout:2/548: write d0/d19/f2c [1139614,53575] 0 2024-09-11T00:17:58.918 INFO:tasks.workunit.client.0.smithi078.stdout:2/549: dread - d0/d1/d33/d86/fc1 zero size 2024-09-11T00:17:58.918 INFO:tasks.workunit.client.0.smithi078.stdout:0/545: dwrite d2/d2a/d2c/d35/d59/d4f/d61/f75 [0,4194304] 0 2024-09-11T00:17:58.919 INFO:tasks.workunit.client.0.smithi078.stdout:2/550: getdents d0/d1/d11/d60/da2/d3a 0 2024-09-11T00:17:58.920 INFO:tasks.workunit.client.0.smithi078.stdout:1/688: dwrite d3/d29/f34 [0,4194304] 0 2024-09-11T00:17:58.921 INFO:tasks.workunit.client.0.smithi078.stdout:2/551: mkdir d0/d1/d6f/d93/dc3/dc4 0 2024-09-11T00:17:58.922 INFO:tasks.workunit.client.0.smithi078.stdout:0/546: write d2/d2a/d2c/d35/d71/f8e [3136663,63740] 0 2024-09-11T00:17:58.922 INFO:tasks.workunit.client.0.smithi078.stdout:0/547: readlink d2/d2a/d2c/d35/d59/d7/d96/la5 0 2024-09-11T00:17:58.923 INFO:tasks.workunit.client.0.smithi078.stdout:7/519: dwrite d0/d34/db/d30/d1d/d14/d62/f84 [0,4194304] 0 2024-09-11T00:17:58.923 INFO:tasks.workunit.client.0.smithi078.stdout:1/689: unlink d3/d29/d5f/d39/d61/d96/fb4 0 2024-09-11T00:17:58.924 INFO:tasks.workunit.client.0.smithi078.stdout:2/552: mknod d0/d1/d6f/d93/dc3/cc5 0 2024-09-11T00:17:58.927 INFO:tasks.workunit.client.0.smithi078.stdout:0/548: symlink d2/d57/lba 0 2024-09-11T00:17:58.927 INFO:tasks.workunit.client.0.smithi078.stdout:0/549: chown d2/d2a/d2c/d35/d59/d4f/d61/d69/l17 924956637 1 2024-09-11T00:17:58.935 INFO:tasks.workunit.client.0.smithi078.stdout:1/690: creat d3/d1a/d21/d4a/d90/fdc x:0 0 0 2024-09-11T00:17:58.936 INFO:tasks.workunit.client.0.smithi078.stdout:4/549: dwrite dc/d10/d1f/d68/db5/fb7 [0,4194304] 0 2024-09-11T00:17:58.936 INFO:tasks.workunit.client.0.smithi078.stdout:2/553: mkdir d0/d1/d3c/dc6 0 2024-09-11T00:17:58.937 INFO:tasks.workunit.client.0.smithi078.stdout:1/691: creat d3/d1a/d21/d4a/d90/dc7/fdd x:0 0 0 2024-09-11T00:17:58.938 INFO:tasks.workunit.client.0.smithi078.stdout:7/520: dwrite d0/d34/db/d30/d1d/f59 [0,4194304] 0 2024-09-11T00:17:58.939 INFO:tasks.workunit.client.0.smithi078.stdout:4/550: symlink dc/d10/d40/d3a/d46/lba 0 2024-09-11T00:17:58.940 INFO:tasks.workunit.client.0.smithi078.stdout:2/554: creat d0/d1/d11/d60/da2/d3a/fc7 x:0 0 0 2024-09-11T00:17:58.941 INFO:tasks.workunit.client.0.smithi078.stdout:1/692: creat d3/d1a/d21/d4a/d90/fde x:0 0 0 2024-09-11T00:17:58.944 INFO:tasks.workunit.client.0.smithi078.stdout:7/521: rmdir d0/d34/db 39 2024-09-11T00:17:58.944 INFO:tasks.workunit.client.0.smithi078.stdout:0/550: dwrite d2/d2a/d2c/d35/d59/d4f/d61/d69/f63 [0,4194304] 0 2024-09-11T00:17:58.944 INFO:tasks.workunit.client.0.smithi078.stdout:0/551: chown d2/d2a/d2c/d35/d59/l62 7263 1 2024-09-11T00:17:58.945 INFO:tasks.workunit.client.0.smithi078.stdout:4/551: mkdir dc/d10/d40/d3a/d4c/db4/d72/dbb 0 2024-09-11T00:17:58.945 INFO:tasks.workunit.client.0.smithi078.stdout:4/552: stat dc/d54/fab 0 2024-09-11T00:17:58.945 INFO:tasks.workunit.client.0.smithi078.stdout:4/553: stat dc/d10/d40/d3a/d65/d7b/d9e/d5d 0 2024-09-11T00:17:58.945 INFO:tasks.workunit.client.0.smithi078.stdout:4/554: readlink dc/d10/d40/d3a/d46/d59/l9c 0 2024-09-11T00:17:58.945 INFO:tasks.workunit.client.0.smithi078.stdout:2/555: symlink d0/d1/d11/d60/da2/d3a/lc8 0 2024-09-11T00:17:58.946 INFO:tasks.workunit.client.0.smithi078.stdout:2/556: stat d0/d1/d11/d1b/f6d 0 2024-09-11T00:17:58.946 INFO:tasks.workunit.client.0.smithi078.stdout:2/557: dread - d0/d1/d6/f9c zero size 2024-09-11T00:17:58.947 INFO:tasks.workunit.client.0.smithi078.stdout:7/522: symlink d0/d34/d86/l9b 0 2024-09-11T00:17:58.947 INFO:tasks.workunit.client.0.smithi078.stdout:7/523: fdatasync d0/d34/db/d30/d1d/f39 0 2024-09-11T00:17:58.948 INFO:tasks.workunit.client.0.smithi078.stdout:7/524: chown d0/d34/db/d32/f72 154591 1 2024-09-11T00:17:58.948 INFO:tasks.workunit.client.0.smithi078.stdout:2/558: dread d0/d1/d11/d60/da2/d38/f4b [0,4194304] 0 2024-09-11T00:17:58.949 INFO:tasks.workunit.client.0.smithi078.stdout:0/552: rmdir d2/d2a/d2c/d35/d59/d4f/d61/d69 39 2024-09-11T00:17:58.951 INFO:tasks.workunit.client.0.smithi078.stdout:1/693: mknod d3/d1a/d21/d4a/d94/cdf 0 2024-09-11T00:17:58.951 INFO:tasks.workunit.client.0.smithi078.stdout:1/694: dread - d3/d29/d5f/d39/d61/f79 zero size 2024-09-11T00:17:58.951 INFO:tasks.workunit.client.0.smithi078.stdout:1/695: fdatasync d3/d1a/d21/d4a/f69 0 2024-09-11T00:17:58.951 INFO:tasks.workunit.client.0.smithi078.stdout:7/525: truncate d0/f50 571686 0 2024-09-11T00:17:58.951 INFO:tasks.workunit.client.0.smithi078.stdout:7/526: truncate d0/d34/db/d32/f3a 4936086 0 2024-09-11T00:17:58.952 INFO:tasks.workunit.client.0.smithi078.stdout:2/559: creat d0/d19/d3d/d8d/fc9 x:0 0 0 2024-09-11T00:17:58.952 INFO:tasks.workunit.client.0.smithi078.stdout:2/560: chown d0/d19/d3d/d8d/d8e/c9a 31453 1 2024-09-11T00:17:58.952 INFO:tasks.workunit.client.0.smithi078.stdout:2/561: dread - d0/d1/d11/d60/fa7 zero size 2024-09-11T00:17:58.952 INFO:tasks.workunit.client.0.smithi078.stdout:2/562: truncate d0/d1/d33/d5f/f6c 1124150 0 2024-09-11T00:17:58.952 INFO:tasks.workunit.client.0.smithi078.stdout:0/553: symlink d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/lbb 0 2024-09-11T00:17:58.953 INFO:tasks.workunit.client.0.smithi078.stdout:0/554: mkdir d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/dbc 0 2024-09-11T00:17:58.954 INFO:tasks.workunit.client.0.smithi078.stdout:4/555: write dc/d10/d40/f8f [2397076,6278] 0 2024-09-11T00:17:58.955 INFO:tasks.workunit.client.0.smithi078.stdout:0/555: truncate d2/d57/f88 3664143 0 2024-09-11T00:17:58.957 INFO:tasks.workunit.client.0.smithi078.stdout:4/556: mknod dc/d54/cbc 0 2024-09-11T00:17:58.957 INFO:tasks.workunit.client.0.smithi078.stdout:4/557: stat dc/d10/d40/d3a/d4c/f2e 0 2024-09-11T00:17:58.958 INFO:tasks.workunit.client.0.smithi078.stdout:0/556: mkdir d2/dbd 0 2024-09-11T00:17:58.958 INFO:tasks.workunit.client.0.smithi078.stdout:0/557: fsync d2/d2a/d2c/d35/d59/d7/fa 0 2024-09-11T00:17:58.959 INFO:tasks.workunit.client.0.smithi078.stdout:2/563: read d0/d1/f4 [8295368,65593] 0 2024-09-11T00:17:58.959 INFO:tasks.workunit.client.0.smithi078.stdout:0/558: symlink d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/db7/lbe 0 2024-09-11T00:17:58.960 INFO:tasks.workunit.client.0.smithi078.stdout:9/540: sync 2024-09-11T00:17:58.961 INFO:tasks.workunit.client.0.smithi078.stdout:2/564: symlink d0/d1/d11/d60/da2/d3a/lca 0 2024-09-11T00:17:58.963 INFO:tasks.workunit.client.0.smithi078.stdout:0/559: symlink d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/lbf 0 2024-09-11T00:17:58.963 INFO:tasks.workunit.client.0.smithi078.stdout:0/560: chown d2/d2a/d2c/d35/d59/d4f/f85 1 1 2024-09-11T00:17:58.965 INFO:tasks.workunit.client.0.smithi078.stdout:9/541: creat dc/d12/d54/fb8 x:0 0 0 2024-09-11T00:17:58.966 INFO:tasks.workunit.client.0.smithi078.stdout:2/565: mknod d0/d1/d6f/d93/dc3/ccb 0 2024-09-11T00:17:58.966 INFO:tasks.workunit.client.0.smithi078.stdout:7/527: dwrite d0/d34/db/d30/d28/f44 [0,4194304] 0 2024-09-11T00:17:58.968 INFO:tasks.workunit.client.0.smithi078.stdout:0/561: mknod d2/d57/cc0 0 2024-09-11T00:17:58.968 INFO:tasks.workunit.client.0.smithi078.stdout:0/562: fdatasync d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/f7f 0 2024-09-11T00:17:58.970 INFO:tasks.workunit.client.0.smithi078.stdout:1/696: dwrite d3/d1a/d21/d88/f91 [0,4194304] 0 2024-09-11T00:17:58.970 INFO:tasks.workunit.client.0.smithi078.stdout:9/542: unlink dc/d12/d20/d58/d5b/f87 0 2024-09-11T00:17:58.970 INFO:tasks.workunit.client.0.smithi078.stdout:9/543: readlink dc/l88 0 2024-09-11T00:17:58.970 INFO:tasks.workunit.client.0.smithi078.stdout:9/544: chown dc/d12 54 1 2024-09-11T00:17:58.970 INFO:tasks.workunit.client.0.smithi078.stdout:9/545: dread - dc/d12/d20/d30/fa7 zero size 2024-09-11T00:17:58.970 INFO:tasks.workunit.client.0.smithi078.stdout:9/546: readlink dc/d12/d46/d51/l62 0 2024-09-11T00:17:58.970 INFO:tasks.workunit.client.0.smithi078.stdout:9/547: write dc/d12/d54/f57 [4380015,96700] 0 2024-09-11T00:17:58.970 INFO:tasks.workunit.client.0.smithi078.stdout:9/548: truncate dc/d12/d54/fa8 648092 0 2024-09-11T00:17:58.971 INFO:tasks.workunit.client.0.smithi078.stdout:2/566: getdents d0/d1/d11/d60/da2/d38 0 2024-09-11T00:17:58.972 INFO:tasks.workunit.client.0.smithi078.stdout:2/567: read d0/d67/f7a [133766,57539] 0 2024-09-11T00:17:58.972 INFO:tasks.workunit.client.0.smithi078.stdout:2/568: chown d0/d1/d8/f6e 25949 1 2024-09-11T00:17:58.972 INFO:tasks.workunit.client.0.smithi078.stdout:7/528: creat d0/d34/db/d30/d1d/d14/d87/f9c x:0 0 0 2024-09-11T00:17:58.973 INFO:tasks.workunit.client.0.smithi078.stdout:9/549: write dc/d12/d20/d30/f4b [560698,121437] 0 2024-09-11T00:17:58.973 INFO:tasks.workunit.client.0.smithi078.stdout:9/550: write dc/d12/d54/faa [904195,111685] 0 2024-09-11T00:17:58.974 INFO:tasks.workunit.client.0.smithi078.stdout:0/563: creat d2/d57/d8b/fc1 x:0 0 0 2024-09-11T00:17:58.974 INFO:tasks.workunit.client.0.smithi078.stdout:0/564: fsync d2/d2a/d2c/d35/f78 0 2024-09-11T00:17:58.974 INFO:tasks.workunit.client.0.smithi078.stdout:0/565: chown d2/d2a/d2c/d35/d71/l89 248 1 2024-09-11T00:17:58.978 INFO:tasks.workunit.client.0.smithi078.stdout:1/697: link d3/d1a/d21/dcf/fd6 d3/d1a/d21/fe0 0 2024-09-11T00:17:58.980 INFO:tasks.workunit.client.0.smithi078.stdout:2/569: rmdir d0/d1/d33/d86/db4/db7 0 2024-09-11T00:17:58.982 INFO:tasks.workunit.client.0.smithi078.stdout:9/551: link dc/d12/d46/d51/f53 dc/d12/d54/db4/fb9 0 2024-09-11T00:17:58.983 INFO:tasks.workunit.client.0.smithi078.stdout:0/566: read d2/d2a/d2c/d35/d59/d4f/d61/f75 [3802690,58275] 0 2024-09-11T00:17:58.984 INFO:tasks.workunit.client.0.smithi078.stdout:1/698: link d3/d29/d45/f77 d3/d29/d5f/fe1 0 2024-09-11T00:17:58.984 INFO:tasks.workunit.client.0.smithi078.stdout:1/699: chown d3/d29/d5f/d4e/f8f 194 1 2024-09-11T00:17:58.984 INFO:tasks.workunit.client.0.smithi078.stdout:1/700: chown d3/dc6/f9b 26957262 1 2024-09-11T00:17:58.984 INFO:tasks.workunit.client.0.smithi078.stdout:1/701: write d3/d29/d5f/d39/d61/d96/daf/fc5 [999105,106147] 0 2024-09-11T00:17:58.985 INFO:tasks.workunit.client.0.smithi078.stdout:9/552: creat dc/fba x:0 0 0 2024-09-11T00:17:58.986 INFO:tasks.workunit.client.0.smithi078.stdout:1/702: rename d3/d29/d5f/c43 to d3/d1a/d21/d4a/ce2 0 2024-09-11T00:17:58.988 INFO:tasks.workunit.client.0.smithi078.stdout:9/553: rename dc/d12/d20/d58/d5a/d76 to dc/d12/d20/d58/d5b/dbb 0 2024-09-11T00:17:58.990 INFO:tasks.workunit.client.0.smithi078.stdout:1/703: mknod d3/d1a/d21/d4a/d90/dc7/ce3 0 2024-09-11T00:17:58.992 INFO:tasks.workunit.client.0.smithi078.stdout:9/554: unlink dc/d12/d46/d51/c6f 0 2024-09-11T00:17:58.993 INFO:tasks.workunit.client.0.smithi078.stdout:1/704: creat d3/d1a/d21/d4a/d90/dd7/fe4 x:0 0 0 2024-09-11T00:17:58.993 INFO:tasks.workunit.client.0.smithi078.stdout:1/705: dread - d3/d1a/d21/d88/fa0 zero size 2024-09-11T00:17:58.994 INFO:tasks.workunit.client.0.smithi078.stdout:0/567: write d2/d2a/f2f [3050505,16908] 0 2024-09-11T00:17:58.995 INFO:tasks.workunit.client.0.smithi078.stdout:9/555: mkdir dc/d12/d20/d50/dbc 0 2024-09-11T00:17:58.995 INFO:tasks.workunit.client.0.smithi078.stdout:9/556: dread - dc/d12/d20/d58/d5a/fb0 zero size 2024-09-11T00:17:58.997 INFO:tasks.workunit.client.0.smithi078.stdout:7/529: dwrite d0/d34/db/d30/d1d/f2c [0,4194304] 0 2024-09-11T00:17:58.998 INFO:tasks.workunit.client.0.smithi078.stdout:1/706: rename d3/d29/d5f/d39/c41 to d3/d1a/d21/d4a/d94/ce5 0 2024-09-11T00:17:58.998 INFO:tasks.workunit.client.0.smithi078.stdout:2/570: dwrite d0/d1/d11/d60/da2/d3a/d51/f58 [0,4194304] 0 2024-09-11T00:17:59.000 INFO:tasks.workunit.client.0.smithi078.stdout:9/557: rename dc/d12/d20/d58/ca0 to dc/d12/d20/d58/d5b/d68/cbd 0 2024-09-11T00:17:59.002 INFO:tasks.workunit.client.0.smithi078.stdout:1/707: truncate d3/d1a/d21/d88/fa6 3351987 0 2024-09-11T00:17:59.005 INFO:tasks.workunit.client.0.smithi078.stdout:2/571: truncate d0/d1/d11/d1b/f6d 277274 0 2024-09-11T00:17:59.005 INFO:tasks.workunit.client.0.smithi078.stdout:2/572: truncate d0/d1/d8/f9e 531288 0 2024-09-11T00:17:59.007 INFO:tasks.workunit.client.0.smithi078.stdout:9/558: link dc/d12/d20/d58/d5b/dbb/l52 dc/d12/d54/db4/lbe 0 2024-09-11T00:17:59.008 INFO:tasks.workunit.client.0.smithi078.stdout:1/708: mkdir d3/d29/d5f/d39/d61/d96/daf/de6 0 2024-09-11T00:17:59.008 INFO:tasks.workunit.client.0.smithi078.stdout:1/709: chown d3/d29/d45 8443929 1 2024-09-11T00:17:59.008 INFO:tasks.workunit.client.0.smithi078.stdout:9/559: symlink dc/d12/d20/d50/lbf 0 2024-09-11T00:17:59.009 INFO:tasks.workunit.client.0.smithi078.stdout:9/560: symlink dc/d12/d54/d83/lc0 0 2024-09-11T00:17:59.011 INFO:tasks.workunit.client.0.smithi078.stdout:9/561: link dc/d12/d20/d58/f72 dc/d12/d46/d51/fc1 0 2024-09-11T00:17:59.016 INFO:tasks.workunit.client.0.smithi078.stdout:1/710: write d3/d1a/d21/d4a/fa3 [1438929,124378] 0 2024-09-11T00:17:59.016 INFO:tasks.workunit.client.0.smithi078.stdout:1/711: fsync d3/d1a/d21/d4a/d90/f92 0 2024-09-11T00:17:59.018 INFO:tasks.workunit.client.0.smithi078.stdout:0/568: dwrite d2/d2a/d2c/d35/d59/d7/f13 [0,4194304] 0 2024-09-11T00:17:59.018 INFO:tasks.workunit.client.0.smithi078.stdout:1/712: getdents d3 0 2024-09-11T00:17:59.018 INFO:tasks.workunit.client.0.smithi078.stdout:7/530: dwrite d0/d34/db/d32/f72 [0,4194304] 0 2024-09-11T00:17:59.019 INFO:tasks.workunit.client.0.smithi078.stdout:0/569: unlink d2/d2a/f92 0 2024-09-11T00:17:59.021 INFO:tasks.workunit.client.0.smithi078.stdout:1/713: creat d3/d29/d5f/d39/d61/d96/fe7 x:0 0 0 2024-09-11T00:17:59.023 INFO:tasks.workunit.client.0.smithi078.stdout:9/562: write dc/d12/d20/d85/d3e/f42 [3192756,8240] 0 2024-09-11T00:17:59.026 INFO:tasks.workunit.client.0.smithi078.stdout:1/714: link d3/d1a/d21/d4a/c87 d3/d1a/d21/d4a/d90/dc7/ce8 0 2024-09-11T00:17:59.028 INFO:tasks.workunit.client.0.smithi078.stdout:0/570: read d2/d2a/d2c/d35/d59/d7/fa [1017230,63413] 0 2024-09-11T00:17:59.028 INFO:tasks.workunit.client.0.smithi078.stdout:0/571: fsync d2/d2a/d2c/d35/d59/d7/f40 0 2024-09-11T00:17:59.028 INFO:tasks.workunit.client.0.smithi078.stdout:0/572: readlink d2/d2a/d2c/d35/d59/d4f/d61/d69/l58 0 2024-09-11T00:17:59.028 INFO:tasks.workunit.client.0.smithi078.stdout:0/573: write d2/d57/d8b/fc1 [199275,65140] 0 2024-09-11T00:17:59.028 INFO:tasks.workunit.client.0.smithi078.stdout:0/574: read d2/d2a/fab [3951009,59554] 0 2024-09-11T00:17:59.028 INFO:tasks.workunit.client.0.smithi078.stdout:0/575: chown d2/d2a/d2c/d35/d59/d7/f14 259 1 2024-09-11T00:17:59.028 INFO:tasks.workunit.client.0.smithi078.stdout:0/576: chown d2/d2a/d2c/d35/d59/d4f/d61/f76 26355828 1 2024-09-11T00:17:59.029 INFO:tasks.workunit.client.0.smithi078.stdout:9/563: getdents dc/d12/d20/d50/db1 0 2024-09-11T00:17:59.031 INFO:tasks.workunit.client.0.smithi078.stdout:7/531: dwrite d0/d34/db/f47 [0,4194304] 0 2024-09-11T00:17:59.031 INFO:tasks.workunit.client.0.smithi078.stdout:7/532: dread - d0/d34/d65/f8d zero size 2024-09-11T00:17:59.033 INFO:tasks.workunit.client.0.smithi078.stdout:0/577: rename d2/d2a/d2c/d35/d59/f54 to d2/d2a/d2c/d35/d59/d7/fc2 0 2024-09-11T00:17:59.033 INFO:tasks.workunit.client.0.smithi078.stdout:0/578: truncate d2/d2a/d2c/d35/d71/f83 926385 0 2024-09-11T00:17:59.033 INFO:tasks.workunit.client.0.smithi078.stdout:0/579: write d2/f1d [1139750,86679] 0 2024-09-11T00:17:59.033 INFO:tasks.workunit.client.0.smithi078.stdout:0/580: write d2/d2a/d2c/d35/d59/d4f/d61/d69/fa2 [37816,34053] 0 2024-09-11T00:17:59.036 INFO:tasks.workunit.client.0.smithi078.stdout:9/564: getdents dc 0 2024-09-11T00:17:59.036 INFO:tasks.workunit.client.0.smithi078.stdout:9/565: chown dc/d12/d20/d30 106034 1 2024-09-11T00:17:59.041 INFO:tasks.workunit.client.0.smithi078.stdout:7/533: dread d0/d34/db/d32/f72 [0,4194304] 0 2024-09-11T00:17:59.041 INFO:tasks.workunit.client.0.smithi078.stdout:9/566: read dc/d12/d20/f61 [117772,94069] 0 2024-09-11T00:17:59.045 INFO:tasks.workunit.client.0.smithi078.stdout:1/715: dwrite d3/d29/f93 [0,4194304] 0 2024-09-11T00:17:59.046 INFO:tasks.workunit.client.0.smithi078.stdout:0/581: creat d2/d2a/d2c/d77/fc3 x:0 0 0 2024-09-11T00:17:59.048 INFO:tasks.workunit.client.0.smithi078.stdout:7/534: mknod d0/d34/db/d30/d1d/d14/c9d 0 2024-09-11T00:17:59.049 INFO:tasks.workunit.client.0.smithi078.stdout:9/567: unlink dc/d12/d20/d85/f7e 0 2024-09-11T00:17:59.051 INFO:tasks.workunit.client.0.smithi078.stdout:1/716: write d3/d1a/d21/d4a/d94/fb0 [903511,122718] 0 2024-09-11T00:17:59.052 INFO:tasks.workunit.client.0.smithi078.stdout:1/717: fsync d3/d1a/d21/d4a/d94/fcd 0 2024-09-11T00:17:59.053 INFO:tasks.workunit.client.0.smithi078.stdout:0/582: truncate d2/d2a/d2c/d35/d59/d7/f7d 2978467 0 2024-09-11T00:17:59.058 INFO:tasks.workunit.client.0.smithi078.stdout:5/436: sync 2024-09-11T00:17:59.058 INFO:tasks.workunit.client.0.smithi078.stdout:8/621: sync 2024-09-11T00:17:59.058 INFO:tasks.workunit.client.0.smithi078.stdout:3/543: sync 2024-09-11T00:17:59.058 INFO:tasks.workunit.client.0.smithi078.stdout:6/527: sync 2024-09-11T00:17:59.061 INFO:tasks.workunit.client.0.smithi078.stdout:0/583: dread d2/d2a/d2c/d35/d59/d4f/d61/f76 [0,4194304] 0 2024-09-11T00:17:59.061 INFO:tasks.workunit.client.0.smithi078.stdout:0/584: chown d2/d2a/d2c/d35/d59/d4f/d61/d69/l58 170770913 1 2024-09-11T00:17:59.061 INFO:tasks.workunit.client.0.smithi078.stdout:5/437: mkdir d7/d8/d56/d9e 0 2024-09-11T00:17:59.061 INFO:tasks.workunit.client.0.smithi078.stdout:6/528: creat d0/d1/d9/d17/d5e/fb2 x:0 0 0 2024-09-11T00:17:59.062 INFO:tasks.workunit.client.0.smithi078.stdout:8/622: dread da/d13/d1b/f4a [0,4194304] 0 2024-09-11T00:17:59.063 INFO:tasks.workunit.client.0.smithi078.stdout:0/585: creat d2/d2a/d2c/d5e/fc4 x:0 0 0 2024-09-11T00:17:59.063 INFO:tasks.workunit.client.0.smithi078.stdout:5/438: truncate d7/d8/d33/d22/f7a 55731 0 2024-09-11T00:17:59.064 INFO:tasks.workunit.client.0.smithi078.stdout:5/439: creat d7/d8/de/d2c/d7c/f9f x:0 0 0 2024-09-11T00:17:59.064 INFO:tasks.workunit.client.0.smithi078.stdout:5/440: fdatasync d7/d8/d56/f75 0 2024-09-11T00:17:59.071 INFO:tasks.workunit.client.0.smithi078.stdout:9/568: dwrite f2 [0,4194304] 0 2024-09-11T00:17:59.071 INFO:tasks.workunit.client.0.smithi078.stdout:7/535: dwrite d0/d34/db/d30/d1d/f8a [0,4194304] 0 2024-09-11T00:17:59.072 INFO:tasks.workunit.client.0.smithi078.stdout:3/544: dread d0/d7/d23/d91/f22 [4194304,4194304] 0 2024-09-11T00:17:59.074 INFO:tasks.workunit.client.0.smithi078.stdout:7/536: rmdir d0 39 2024-09-11T00:17:59.075 INFO:tasks.workunit.client.0.smithi078.stdout:5/441: dread f6 [0,4194304] 0 2024-09-11T00:17:59.075 INFO:tasks.workunit.client.0.smithi078.stdout:3/545: creat d0/d7/d46/d86/fa6 x:0 0 0 2024-09-11T00:17:59.077 INFO:tasks.workunit.client.0.smithi078.stdout:9/569: rename dc/f7b to dc/d12/d20/d30/fc2 0 2024-09-11T00:17:59.078 INFO:tasks.workunit.client.0.smithi078.stdout:7/537: dread d0/d34/db/d30/d1d/d14/f79 [0,4194304] 0 2024-09-11T00:17:59.078 INFO:tasks.workunit.client.0.smithi078.stdout:5/442: creat d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d8c/fa0 x:0 0 0 2024-09-11T00:17:59.080 INFO:tasks.workunit.client.0.smithi078.stdout:9/570: creat dc/d12/d20/d50/db1/fc3 x:0 0 0 2024-09-11T00:17:59.080 INFO:tasks.workunit.client.0.smithi078.stdout:9/571: truncate dc/f38 4524335 0 2024-09-11T00:17:59.081 INFO:tasks.workunit.client.0.smithi078.stdout:5/443: dread d7/d8/d56/f6f [0,4194304] 0 2024-09-11T00:17:59.081 INFO:tasks.workunit.client.0.smithi078.stdout:9/572: creat dc/fc4 x:0 0 0 2024-09-11T00:17:59.083 INFO:tasks.workunit.client.0.smithi078.stdout:5/444: creat d7/d8/de/fa1 x:0 0 0 2024-09-11T00:17:59.083 INFO:tasks.workunit.client.0.smithi078.stdout:7/538: read d0/d34/db/d30/d1d/f59 [3698835,115409] 0 2024-09-11T00:17:59.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:17:58 smithi078 ceph-mon[30865]: pgmap v368: 97 pgs: 97 active+clean; 593 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 36 MiB/s rd, 56 MiB/s wr, 351 op/s 2024-09-11T00:17:59.085 INFO:tasks.workunit.client.0.smithi078.stdout:5/445: creat d7/d8/d33/d22/d25/d28/d24/d1c/d1e/fa2 x:0 0 0 2024-09-11T00:17:59.086 INFO:tasks.workunit.client.0.smithi078.stdout:7/539: creat d0/d3f/f9e x:0 0 0 2024-09-11T00:17:59.086 INFO:tasks.workunit.client.0.smithi078.stdout:7/540: read d0/d34/db/d30/f27 [663079,113436] 0 2024-09-11T00:17:59.086 INFO:tasks.workunit.client.0.smithi078.stdout:7/541: readlink d0/d34/l1f 0 2024-09-11T00:17:59.086 INFO:tasks.workunit.client.0.smithi078.stdout:7/542: chown d0/d34/l8b 459605859 1 2024-09-11T00:17:59.086 INFO:tasks.workunit.client.0.smithi078.stdout:5/446: dread d7/d8/f77 [0,4194304] 0 2024-09-11T00:17:59.086 INFO:tasks.workunit.client.0.smithi078.stdout:1/718: dwrite d3/d29/d5f/d39/d61/f79 [0,4194304] 0 2024-09-11T00:17:59.089 INFO:tasks.workunit.client.0.smithi078.stdout:5/447: rename d7/d8/de/d2c/d7c to d7/d8/d33/d22/da3 0 2024-09-11T00:17:59.090 INFO:tasks.workunit.client.0.smithi078.stdout:6/529: dwrite d0/d1/d9/d17/f58 [4194304,4194304] 0 2024-09-11T00:17:59.092 INFO:tasks.workunit.client.0.smithi078.stdout:8/623: dwrite da/d13/d1b/f23 [0,4194304] 0 2024-09-11T00:17:59.092 INFO:tasks.workunit.client.0.smithi078.stdout:8/624: fsync da/d13/d1b/d59/f97 0 2024-09-11T00:17:59.092 INFO:tasks.workunit.client.0.smithi078.stdout:1/719: rename d3/d1a/l78 to d3/d1a/d21/d4a/le9 0 2024-09-11T00:17:59.092 INFO:tasks.workunit.client.0.smithi078.stdout:5/448: mknod d7/d8/d33/d22/da3/ca4 0 2024-09-11T00:17:59.093 INFO:tasks.workunit.client.0.smithi078.stdout:5/449: fsync d7/d8/de/f11 0 2024-09-11T00:17:59.093 INFO:tasks.workunit.client.0.smithi078.stdout:5/450: getdents d7/d8/d47/d66 0 2024-09-11T00:17:59.094 INFO:tasks.workunit.client.0.smithi078.stdout:0/586: dwrite d2/d2a/d2c/d35/d59/d4f/d61/d8f/f9c [0,4194304] 0 2024-09-11T00:17:59.096 INFO:tasks.workunit.client.0.smithi078.stdout:6/530: unlink d0/d1/d9/d59/d74/l35 0 2024-09-11T00:17:59.098 INFO:tasks.workunit.client.0.smithi078.stdout:1/720: rmdir d3/db3/dd3 0 2024-09-11T00:17:59.099 INFO:tasks.workunit.client.0.smithi078.stdout:9/573: dwrite f2 [0,4194304] 0 2024-09-11T00:17:59.099 INFO:tasks.workunit.client.0.smithi078.stdout:9/574: write dc/d12/d20/d50/db1/fc3 [949776,57843] 0 2024-09-11T00:17:59.099 INFO:tasks.workunit.client.0.smithi078.stdout:5/451: stat d7/l68 0 2024-09-11T00:17:59.101 INFO:tasks.workunit.client.0.smithi078.stdout:0/587: mknod d2/d2a/d2c/d35/d59/d4f/d61/cc5 0 2024-09-11T00:17:59.102 INFO:tasks.workunit.client.0.smithi078.stdout:0/588: read - d2/d2a/f6b zero size 2024-09-11T00:17:59.102 INFO:tasks.workunit.client.0.smithi078.stdout:1/721: dread d3/d29/f7e [0,4194304] 0 2024-09-11T00:17:59.103 INFO:tasks.workunit.client.0.smithi078.stdout:6/531: mkdir d0/d1/d9/d59/d74/db3 0 2024-09-11T00:17:59.103 INFO:tasks.workunit.client.0.smithi078.stdout:0/589: dread d2/d2a/d2c/d35/f46 [0,4194304] 0 2024-09-11T00:17:59.105 INFO:tasks.workunit.client.0.smithi078.stdout:9/575: creat dc/d12/d46/fc5 x:0 0 0 2024-09-11T00:17:59.106 INFO:tasks.workunit.client.0.smithi078.stdout:5/452: rename d7/d8/d56/d2a/c38 to d7/d8/d33/d22/d25/d28/d24/d1c/d1e/ca5 0 2024-09-11T00:17:59.106 INFO:tasks.workunit.client.0.smithi078.stdout:5/453: stat d7/d8/l92 0 2024-09-11T00:17:59.107 INFO:tasks.workunit.client.0.smithi078.stdout:7/543: dwrite d0/f1e [0,4194304] 0 2024-09-11T00:17:59.107 INFO:tasks.workunit.client.0.smithi078.stdout:1/722: symlink d3/d29/d5f/d39/d61/d96/lea 0 2024-09-11T00:17:59.108 INFO:tasks.workunit.client.0.smithi078.stdout:6/532: symlink d0/d1/d9/d17/lb4 0 2024-09-11T00:17:59.108 INFO:tasks.workunit.client.0.smithi078.stdout:6/533: getdents d0/d1/d1b 0 2024-09-11T00:17:59.109 INFO:tasks.workunit.client.0.smithi078.stdout:9/576: creat dc/d12/d20/d30/fc6 x:0 0 0 2024-09-11T00:17:59.109 INFO:tasks.workunit.client.0.smithi078.stdout:9/577: read dc/d12/d20/d85/d3e/f42 [2729692,86962] 0 2024-09-11T00:17:59.110 INFO:tasks.workunit.client.0.smithi078.stdout:9/578: dread - dc/d12/d20/fa4 zero size 2024-09-11T00:17:59.110 INFO:tasks.workunit.client.0.smithi078.stdout:0/590: write d2/d2a/d2c/d5e/f68 [7558420,93330] 0 2024-09-11T00:17:59.111 INFO:tasks.workunit.client.0.smithi078.stdout:5/454: unlink d7/l70 0 2024-09-11T00:17:59.111 INFO:tasks.workunit.client.0.smithi078.stdout:5/455: truncate f6 4265865 0 2024-09-11T00:17:59.111 INFO:tasks.workunit.client.0.smithi078.stdout:0/591: read d2/d2a/d2c/d35/d59/d4f/d61/d69/f5c [180131,61166] 0 2024-09-11T00:17:59.111 INFO:tasks.workunit.client.0.smithi078.stdout:6/534: dread d0/d1/d9/f4a [0,4194304] 0 2024-09-11T00:17:59.111 INFO:tasks.workunit.client.0.smithi078.stdout:1/723: creat d3/d29/d5f/d39/d61/feb x:0 0 0 2024-09-11T00:17:59.113 INFO:tasks.workunit.client.0.smithi078.stdout:5/456: unlink d7/l68 0 2024-09-11T00:17:59.113 INFO:tasks.workunit.client.0.smithi078.stdout:5/457: truncate d7/d8/de/d2c/f94 1620527 0 2024-09-11T00:17:59.115 INFO:tasks.workunit.client.0.smithi078.stdout:0/592: creat d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/fc6 x:0 0 0 2024-09-11T00:17:59.116 INFO:tasks.workunit.client.0.smithi078.stdout:6/535: rmdir d0/d1/d9/d59/d74/d6b 39 2024-09-11T00:17:59.116 INFO:tasks.workunit.client.0.smithi078.stdout:6/536: stat d0/l89 0 2024-09-11T00:17:59.116 INFO:tasks.workunit.client.0.smithi078.stdout:1/724: getdents d3/d29/d5f/d39 0 2024-09-11T00:17:59.117 INFO:tasks.workunit.client.0.smithi078.stdout:5/458: truncate d7/d8/de/f4a 1375021 0 2024-09-11T00:17:59.119 INFO:tasks.workunit.client.0.smithi078.stdout:0/593: rename d2/d2a/d2c/d77 to d2/d2a/d2c/d35/d59/dc7 0 2024-09-11T00:17:59.120 INFO:tasks.workunit.client.0.smithi078.stdout:6/537: symlink d0/d66/lb5 0 2024-09-11T00:17:59.120 INFO:tasks.workunit.client.0.smithi078.stdout:6/538: write d0/d1/f41 [47209,93799] 0 2024-09-11T00:17:59.120 INFO:tasks.workunit.client.0.smithi078.stdout:6/539: chown d0/f76 3974 1 2024-09-11T00:17:59.120 INFO:tasks.workunit.client.0.smithi078.stdout:1/725: rmdir d3 39 2024-09-11T00:17:59.122 INFO:tasks.workunit.client.0.smithi078.stdout:0/594: mknod d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/cc8 0 2024-09-11T00:17:59.123 INFO:tasks.workunit.client.0.smithi078.stdout:0/595: fsync d2/d2a/d2c/d35/d59/d4f/d61/d69/f31 0 2024-09-11T00:17:59.123 INFO:tasks.workunit.client.0.smithi078.stdout:0/596: write d2/d2a/d2c/d35/d59/d4f/f85 [426789,102915] 0 2024-09-11T00:17:59.124 INFO:tasks.workunit.client.0.smithi078.stdout:6/540: mkdir d0/d1/d53/d9c/db6 0 2024-09-11T00:17:59.126 INFO:tasks.workunit.client.0.smithi078.stdout:6/541: rmdir d0/d1/d53 39 2024-09-11T00:17:59.126 INFO:tasks.workunit.client.0.smithi078.stdout:6/542: read d0/d1/d9/d54/f6e [8352363,8844] 0 2024-09-11T00:17:59.127 INFO:tasks.workunit.client.0.smithi078.stdout:6/543: dread d0/d1/d9/f4a [0,4194304] 0 2024-09-11T00:17:59.128 INFO:tasks.workunit.client.0.smithi078.stdout:6/544: stat d0/d1/d9/d59/d74/db3 0 2024-09-11T00:17:59.128 INFO:tasks.workunit.client.0.smithi078.stdout:6/545: chown d0/d1/f96 0 1 2024-09-11T00:17:59.129 INFO:tasks.workunit.client.0.smithi078.stdout:1/726: read d3/d29/d5f/f1f [4694424,43127] 0 2024-09-11T00:17:59.129 INFO:tasks.workunit.client.0.smithi078.stdout:7/544: dwrite d0/d34/db/d30/d1d/d14/f4f [0,4194304] 0 2024-09-11T00:17:59.131 INFO:tasks.workunit.client.0.smithi078.stdout:7/545: rename d0/c6 to d0/d34/c9f 0 2024-09-11T00:17:59.132 INFO:tasks.workunit.client.0.smithi078.stdout:9/579: dwrite dc/d12/d46/fc5 [0,4194304] 0 2024-09-11T00:17:59.136 INFO:tasks.workunit.client.0.smithi078.stdout:9/580: truncate dc/f43 1075834 0 2024-09-11T00:17:59.137 INFO:tasks.workunit.client.0.smithi078.stdout:9/581: chown dc/d12/d20/d30/l31 61 1 2024-09-11T00:17:59.138 INFO:tasks.workunit.client.0.smithi078.stdout:1/727: write d3/d1a/f6b [3330738,99246] 0 2024-09-11T00:17:59.140 INFO:tasks.workunit.client.0.smithi078.stdout:9/582: mknod dc/d12/cc7 0 2024-09-11T00:17:59.141 INFO:tasks.workunit.client.0.smithi078.stdout:1/728: rmdir d3/d1a/d21 39 2024-09-11T00:17:59.142 INFO:tasks.workunit.client.0.smithi078.stdout:1/729: fsync d3/f71 0 2024-09-11T00:17:59.142 INFO:tasks.workunit.client.0.smithi078.stdout:5/459: dwrite d7/d8/d33/d22/d25/d28/d24/f44 [0,4194304] 0 2024-09-11T00:17:59.142 INFO:tasks.workunit.client.0.smithi078.stdout:5/460: truncate d7/d8/d33/d22/f97 468552 0 2024-09-11T00:17:59.142 INFO:tasks.workunit.client.0.smithi078.stdout:7/546: write d0/f1e [1018500,99764] 0 2024-09-11T00:17:59.142 INFO:tasks.workunit.client.0.smithi078.stdout:9/583: mkdir dc/d12/d54/d83/dc8 0 2024-09-11T00:17:59.143 INFO:tasks.workunit.client.0.smithi078.stdout:1/730: rename d3/d29/f5d to d3/d29/dc4/fec 0 2024-09-11T00:17:59.146 INFO:tasks.workunit.client.0.smithi078.stdout:7/547: mkdir d0/d34/db/da0 0 2024-09-11T00:17:59.146 INFO:tasks.workunit.client.0.smithi078.stdout:9/584: mkdir dc/d12/d20/d58/d5a/dc9 0 2024-09-11T00:17:59.148 INFO:tasks.workunit.client.0.smithi078.stdout:1/731: mknod d3/d29/d5f/d39/ced 0 2024-09-11T00:17:59.148 INFO:tasks.workunit.client.0.smithi078.stdout:1/732: fdatasync f2 0 2024-09-11T00:17:59.151 INFO:tasks.workunit.client.0.smithi078.stdout:1/733: unlink d3/d1a/d21/d4a/d90/dc7/fd1 0 2024-09-11T00:17:59.154 INFO:tasks.workunit.client.0.smithi078.stdout:1/734: creat d3/d29/d5f/d39/fee x:0 0 0 2024-09-11T00:17:59.155 INFO:tasks.workunit.client.0.smithi078.stdout:1/735: chown d3/d29/l80 19317 1 2024-09-11T00:17:59.156 INFO:tasks.workunit.client.0.smithi078.stdout:1/736: rmdir d3/d29/d5f/d39 39 2024-09-11T00:17:59.159 INFO:tasks.workunit.client.0.smithi078.stdout:9/585: dwrite dc/d12/d54/db4/fa1 [0,4194304] 0 2024-09-11T00:17:59.162 INFO:tasks.workunit.client.0.smithi078.stdout:7/548: dwrite d0/d34/db/d30/d1d/d14/d62/f90 [0,4194304] 0 2024-09-11T00:17:59.164 INFO:tasks.workunit.client.0.smithi078.stdout:1/737: dread d3/f71 [4194304,4194304] 0 2024-09-11T00:17:59.165 INFO:tasks.workunit.client.0.smithi078.stdout:7/549: creat d0/d34/db/d30/d1d/d14/d62/fa1 x:0 0 0 2024-09-11T00:17:59.166 INFO:tasks.workunit.client.0.smithi078.stdout:1/738: rmdir d3/d1a/d21/dcf 39 2024-09-11T00:17:59.167 INFO:tasks.workunit.client.0.smithi078.stdout:5/461: truncate d7/d8/d33/d22/d51/f58 1505925 0 2024-09-11T00:17:59.167 INFO:tasks.workunit.client.0.smithi078.stdout:5/462: read d7/d8/d33/d22/d25/f5e [95308,55613] 0 2024-09-11T00:17:59.167 INFO:tasks.workunit.client.0.smithi078.stdout:5/463: dread - d7/d8/d33/d22/d25/d28/d24/d1c/f8a zero size 2024-09-11T00:17:59.168 INFO:tasks.workunit.client.0.smithi078.stdout:1/739: creat d3/d1a/d21/d4a/d90/dd7/fef x:0 0 0 2024-09-11T00:17:59.169 INFO:tasks.workunit.client.0.smithi078.stdout:9/586: dread dc/d12/d20/d58/d5b/dbb/f66 [0,4194304] 0 2024-09-11T00:17:59.169 INFO:tasks.workunit.client.0.smithi078.stdout:9/587: chown dc/d12/d54/d83 69682001 1 2024-09-11T00:17:59.169 INFO:tasks.workunit.client.0.smithi078.stdout:9/588: write dc/d12/d20/d30/fc2 [109815,40659] 0 2024-09-11T00:17:59.169 INFO:tasks.workunit.client.0.smithi078.stdout:9/589: stat dc/d12/d54/d83/l91 0 2024-09-11T00:17:59.169 INFO:tasks.workunit.client.0.smithi078.stdout:9/590: chown dc/d12/d20/d85 117230 1 2024-09-11T00:17:59.169 INFO:tasks.workunit.client.0.smithi078.stdout:9/591: getdents dc/d12/d20/d50/dbc 0 2024-09-11T00:17:59.170 INFO:tasks.workunit.client.0.smithi078.stdout:5/464: creat d7/d8/de/d2c/fa6 x:0 0 0 2024-09-11T00:17:59.170 INFO:tasks.workunit.client.0.smithi078.stdout:1/740: dread d3/d29/d45/f6d [0,4194304] 0 2024-09-11T00:17:59.171 INFO:tasks.workunit.client.0.smithi078.stdout:9/592: creat dc/d12/d20/d58/d5a/dc9/fca x:0 0 0 2024-09-11T00:17:59.171 INFO:tasks.workunit.client.0.smithi078.stdout:9/593: write dc/fba [705027,12072] 0 2024-09-11T00:17:59.172 INFO:tasks.workunit.client.0.smithi078.stdout:5/465: mkdir d7/d8/d33/da7 0 2024-09-11T00:17:59.173 INFO:tasks.workunit.client.0.smithi078.stdout:1/741: symlink d3/d1a/d21/lf0 0 2024-09-11T00:17:59.174 INFO:tasks.workunit.client.0.smithi078.stdout:9/594: creat dc/d12/d20/d58/d5a/dc9/fcb x:0 0 0 2024-09-11T00:17:59.174 INFO:tasks.workunit.client.0.smithi078.stdout:9/595: truncate dc/d12/d20/d58/d5a/dc9/fcb 4140 0 2024-09-11T00:17:59.174 INFO:tasks.workunit.client.0.smithi078.stdout:9/596: chown dc/d12/d54/db4/lbe 8519 1 2024-09-11T00:17:59.174 INFO:tasks.workunit.client.0.smithi078.stdout:9/597: write dc/d12/d20/d58/d5b/d68/fb2 [546824,24833] 0 2024-09-11T00:17:59.174 INFO:tasks.workunit.client.0.smithi078.stdout:5/466: mkdir d7/d8/d33/d22/d25/d28/da8 0 2024-09-11T00:17:59.181 INFO:tasks.workunit.client.0.smithi078.stdout:5/467: write d7/d8/d33/d22/d25/d28/d24/d1c/f82 [1233547,27888] 0 2024-09-11T00:17:59.181 INFO:tasks.workunit.client.0.smithi078.stdout:9/598: dread dc/f1e [0,4194304] 0 2024-09-11T00:17:59.185 INFO:tasks.workunit.client.0.smithi078.stdout:5/468: mknod d7/d8/d56/d2a/ca9 0 2024-09-11T00:17:59.186 INFO:tasks.workunit.client.0.smithi078.stdout:5/469: symlink d7/d8/d47/d52/laa 0 2024-09-11T00:17:59.188 INFO:tasks.workunit.client.0.smithi078.stdout:5/470: read d7/d8/f77 [12579,92964] 0 2024-09-11T00:17:59.190 INFO:tasks.workunit.client.0.smithi078.stdout:5/471: write d7/d8/d33/d22/d25/d28/d24/d1c/f8e [90789,108186] 0 2024-09-11T00:17:59.190 INFO:tasks.workunit.client.0.smithi078.stdout:5/472: write d7/d8/f8b [90063,71714] 0 2024-09-11T00:17:59.190 INFO:tasks.workunit.client.0.smithi078.stdout:5/473: write d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d8c/fa0 [462839,75477] 0 2024-09-11T00:17:59.190 INFO:tasks.workunit.client.0.smithi078.stdout:5/474: chown d7/d8/d33/d22/d25/d28/d24/d1c/d1e 6294 1 2024-09-11T00:17:59.198 INFO:tasks.workunit.client.0.smithi078.stdout:9/599: dwrite dc/d12/d54/f57 [4194304,4194304] 0 2024-09-11T00:17:59.199 INFO:tasks.workunit.client.0.smithi078.stdout:9/600: getdents dc/d12/d54/db4 0 2024-09-11T00:17:59.202 INFO:tasks.workunit.client.0.smithi078.stdout:1/742: dwrite d3/d1a/d21/f24 [0,4194304] 0 2024-09-11T00:17:59.203 INFO:tasks.workunit.client.0.smithi078.stdout:1/743: mknod d3/d1a/d21/d4a/d90/dc7/dc9/cf1 0 2024-09-11T00:17:59.207 INFO:tasks.workunit.client.0.smithi078.stdout:9/601: dread dc/d12/d20/d58/d5b/dbb/f66 [0,4194304] 0 2024-09-11T00:17:59.208 INFO:tasks.workunit.client.0.smithi078.stdout:9/602: mkdir dc/d12/d46/d51/dcc 0 2024-09-11T00:17:59.209 INFO:tasks.workunit.client.0.smithi078.stdout:9/603: chown dc/d12/la9 212697 1 2024-09-11T00:17:59.209 INFO:tasks.workunit.client.0.smithi078.stdout:9/604: chown dc/d12/d54/d83/lc0 11421605 1 2024-09-11T00:17:59.209 INFO:tasks.workunit.client.0.smithi078.stdout:5/475: dwrite d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f59 [0,4194304] 0 2024-09-11T00:17:59.209 INFO:tasks.workunit.client.0.smithi078.stdout:5/476: write d7/d8/de/f11 [1016727,51141] 0 2024-09-11T00:17:59.209 INFO:tasks.workunit.client.0.smithi078.stdout:9/605: creat dc/d12/d20/d30/fcd x:0 0 0 2024-09-11T00:17:59.210 INFO:tasks.workunit.client.0.smithi078.stdout:1/744: dread d3/d29/d5f/f27 [0,4194304] 0 2024-09-11T00:17:59.225 INFO:tasks.workunit.client.0.smithi078.stdout:9/606: rmdir dc/d12/d54/db4 39 2024-09-11T00:17:59.225 INFO:tasks.workunit.client.0.smithi078.stdout:1/745: symlink d3/lf2 0 2024-09-11T00:17:59.225 INFO:tasks.workunit.client.0.smithi078.stdout:1/746: mknod d3/d29/dc4/cf3 0 2024-09-11T00:17:59.228 INFO:tasks.workunit.client.0.smithi078.stdout:4/558: sync 2024-09-11T00:17:59.228 INFO:tasks.workunit.client.0.smithi078.stdout:2/573: sync 2024-09-11T00:17:59.228 INFO:tasks.workunit.client.0.smithi078.stdout:4/559: write dc/d10/d40/d3a/d46/f89 [493298,66979] 0 2024-09-11T00:17:59.228 INFO:tasks.workunit.client.0.smithi078.stdout:4/560: truncate dc/d10/d40/d3a/d65/f22 1460260 0 2024-09-11T00:17:59.228 INFO:tasks.workunit.client.0.smithi078.stdout:4/561: fdatasync dc/d10/d40/d3a/fb1 0 2024-09-11T00:17:59.229 INFO:tasks.workunit.client.0.smithi078.stdout:2/574: symlink d0/d1/d11/d60/da2/d3a/lcc 0 2024-09-11T00:17:59.230 INFO:tasks.workunit.client.0.smithi078.stdout:2/575: write d0/d1/d8/f21 [272335,16253] 0 2024-09-11T00:17:59.230 INFO:tasks.workunit.client.0.smithi078.stdout:2/576: stat d0/d19/d3d/d8d/fc9 0 2024-09-11T00:17:59.230 INFO:tasks.workunit.client.0.smithi078.stdout:2/577: fdatasync d0/d1/d3c/f45 0 2024-09-11T00:17:59.230 INFO:tasks.workunit.client.0.smithi078.stdout:2/578: chown d0/d1/d6f/l8f 0 1 2024-09-11T00:17:59.230 INFO:tasks.workunit.client.0.smithi078.stdout:1/747: dread d3/f71 [4194304,4194304] 0 2024-09-11T00:17:59.230 INFO:tasks.workunit.client.0.smithi078.stdout:1/748: dread - d3/d1a/d21/d4a/d90/fdc zero size 2024-09-11T00:17:59.231 INFO:tasks.workunit.client.0.smithi078.stdout:2/579: mkdir d0/d19/d3d/d8d/d8e/dcd 0 2024-09-11T00:17:59.231 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:17:58 smithi112 ceph-mon[35627]: pgmap v368: 97 pgs: 97 active+clean; 593 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 36 MiB/s rd, 56 MiB/s wr, 351 op/s 2024-09-11T00:17:59.233 INFO:tasks.workunit.client.0.smithi078.stdout:1/749: unlink d3/d29/d5f/d39/d61/d96/lbc 0 2024-09-11T00:17:59.237 INFO:tasks.workunit.client.0.smithi078.stdout:4/562: read dc/d10/d40/d3a/d65/d7b/d9e/f45 [412484,40354] 0 2024-09-11T00:17:59.237 INFO:tasks.workunit.client.0.smithi078.stdout:4/563: read dc/ff [3975436,107121] 0 2024-09-11T00:17:59.238 INFO:tasks.workunit.client.0.smithi078.stdout:4/564: mknod dc/d54/cbd 0 2024-09-11T00:17:59.245 INFO:tasks.workunit.client.0.smithi078.stdout:9/607: dwrite dc/d12/d20/d30/fa7 [0,4194304] 0 2024-09-11T00:17:59.248 INFO:tasks.workunit.client.0.smithi078.stdout:9/608: mkdir dc/d12/d46/d51/dcc/dce 0 2024-09-11T00:17:59.251 INFO:tasks.workunit.client.0.smithi078.stdout:9/609: mkdir dc/d12/d20/d50/dbc/dcf 0 2024-09-11T00:17:59.251 INFO:tasks.workunit.client.0.smithi078.stdout:9/610: chown dc/d12/d54/d83/l91 22761 1 2024-09-11T00:17:59.256 INFO:tasks.workunit.client.0.smithi078.stdout:4/565: dwrite dc/d54/fab [0,4194304] 0 2024-09-11T00:17:59.258 INFO:tasks.workunit.client.0.smithi078.stdout:4/566: symlink dc/d10/d40/d3a/d65/lbe 0 2024-09-11T00:17:59.258 INFO:tasks.workunit.client.0.smithi078.stdout:4/567: fsync dc/d10/d1f/f35 0 2024-09-11T00:17:59.259 INFO:tasks.workunit.client.0.smithi078.stdout:2/580: dwrite d0/d1/f54 [0,4194304] 0 2024-09-11T00:17:59.259 INFO:tasks.workunit.client.0.smithi078.stdout:4/568: unlink dc/d10/d1f/d68/ca5 0 2024-09-11T00:17:59.259 INFO:tasks.workunit.client.0.smithi078.stdout:4/569: chown dc/f1e 854102 1 2024-09-11T00:17:59.260 INFO:tasks.workunit.client.0.smithi078.stdout:2/581: truncate d0/d1/d11/d60/da2/d38/f80 886234 0 2024-09-11T00:17:59.260 INFO:tasks.workunit.client.0.smithi078.stdout:1/750: dwrite d3/d29/d45/f56 [0,4194304] 0 2024-09-11T00:17:59.260 INFO:tasks.workunit.client.0.smithi078.stdout:1/751: fsync d3/d29/d5f/d39/d61/d96/fe7 0 2024-09-11T00:17:59.261 INFO:tasks.workunit.client.0.smithi078.stdout:1/752: rmdir d3/d29/dc4 39 2024-09-11T00:17:59.261 INFO:tasks.workunit.client.0.smithi078.stdout:1/753: write d3/d29/d5f/d39/d61/fa1 [715761,97518] 0 2024-09-11T00:17:59.261 INFO:tasks.workunit.client.0.smithi078.stdout:1/754: read - d3/d1a/d21/d4a/d90/fbd zero size 2024-09-11T00:17:59.262 INFO:tasks.workunit.client.0.smithi078.stdout:1/755: mkdir d3/d1a/d21/d4a/df4 0 2024-09-11T00:17:59.262 INFO:tasks.workunit.client.0.smithi078.stdout:1/756: chown d3/d1a/d21/d4a/ce2 2673 1 2024-09-11T00:17:59.267 INFO:tasks.workunit.client.0.smithi078.stdout:4/570: write dc/d10/d3c/f67 [2006293,89053] 0 2024-09-11T00:17:59.268 INFO:tasks.workunit.client.0.smithi078.stdout:4/571: symlink dc/d10/d40/d3a/lbf 0 2024-09-11T00:17:59.269 INFO:tasks.workunit.client.0.smithi078.stdout:4/572: creat dc/d10/d40/d3a/fc0 x:0 0 0 2024-09-11T00:17:59.269 INFO:tasks.workunit.client.0.smithi078.stdout:4/573: chown dc/d10/d40/d3a/d65/d7b/d9e/d5d/f73 122779 1 2024-09-11T00:17:59.270 INFO:tasks.workunit.client.0.smithi078.stdout:1/757: write d3/d29/d45/f56 [2631356,63458] 0 2024-09-11T00:17:59.270 INFO:tasks.workunit.client.0.smithi078.stdout:4/574: read dc/d10/d40/d33/f84 [761336,109191] 0 2024-09-11T00:17:59.271 INFO:tasks.workunit.client.0.smithi078.stdout:1/758: symlink d3/d1a/d21/d4a/lf5 0 2024-09-11T00:17:59.272 INFO:tasks.workunit.client.0.smithi078.stdout:4/575: rename dc/d10/d40/d3a/d4c/db4/d72/f95 to dc/d10/d40/d3a/d4c/db4/d72/dbb/fc1 0 2024-09-11T00:17:59.273 INFO:tasks.workunit.client.0.smithi078.stdout:1/759: creat d3/d29/d5f/d4e/ff6 x:0 0 0 2024-09-11T00:17:59.273 INFO:tasks.workunit.client.0.smithi078.stdout:4/576: mknod dc/d10/d1f/d68/db5/cc2 0 2024-09-11T00:17:59.275 INFO:tasks.workunit.client.0.smithi078.stdout:4/577: unlink dc/d10/d40/d3a/d65/d7b/d9e/ca6 0 2024-09-11T00:17:59.275 INFO:tasks.workunit.client.0.smithi078.stdout:4/578: stat dc/d10/d40/d3a/d4c/db4/lae 0 2024-09-11T00:17:59.277 INFO:tasks.workunit.client.0.smithi078.stdout:4/579: unlink dc/d10/d40/c58 0 2024-09-11T00:17:59.277 INFO:tasks.workunit.client.0.smithi078.stdout:4/580: fsync dc/d10/d40/d3a/d65/f34 0 2024-09-11T00:17:59.278 INFO:tasks.workunit.client.0.smithi078.stdout:4/581: mknod dc/d10/d40/d3a/cc3 0 2024-09-11T00:17:59.279 INFO:tasks.workunit.client.0.smithi078.stdout:4/582: stat dc/d83/c9b 0 2024-09-11T00:17:59.280 INFO:tasks.workunit.client.0.smithi078.stdout:4/583: creat dc/d10/d40/d3a/d4c/db4/fc4 x:0 0 0 2024-09-11T00:17:59.281 INFO:tasks.workunit.client.0.smithi078.stdout:4/584: rename dc/d83 to dc/d10/d40/d3a/d65/d7b/d8b/dc5 0 2024-09-11T00:17:59.281 INFO:tasks.workunit.client.0.smithi078.stdout:4/585: fdatasync dc/d54/fab 0 2024-09-11T00:17:59.281 INFO:tasks.workunit.client.0.smithi078.stdout:4/586: chown dc/d10/d40/d3a/d4c/db4/c71 40632385 1 2024-09-11T00:17:59.283 INFO:tasks.workunit.client.0.smithi078.stdout:4/587: rename dc/d10/d3c/f80 to dc/d10/d40/d3a/d4c/db4/d72/fc6 0 2024-09-11T00:17:59.283 INFO:tasks.workunit.client.0.smithi078.stdout:4/588: chown dc/d10/d40/d33/fa9 218595 1 2024-09-11T00:17:59.284 INFO:tasks.workunit.client.0.smithi078.stdout:4/589: unlink dc/c16 0 2024-09-11T00:17:59.285 INFO:tasks.workunit.client.0.smithi078.stdout:4/590: symlink dc/d10/d40/lc7 0 2024-09-11T00:17:59.285 INFO:tasks.workunit.client.0.smithi078.stdout:4/591: readlink dc/d10/d40/d3a/lbf 0 2024-09-11T00:17:59.286 INFO:tasks.workunit.client.0.smithi078.stdout:4/592: creat dc/d10/d1f/d68/fc8 x:0 0 0 2024-09-11T00:17:59.286 INFO:tasks.workunit.client.0.smithi078.stdout:4/593: chown dc/d10/d40/d3a/d65/l2a 484322 1 2024-09-11T00:17:59.286 INFO:tasks.workunit.client.0.smithi078.stdout:4/594: chown dc/d10/d40/d3a/d65/l21 8365 1 2024-09-11T00:17:59.287 INFO:tasks.workunit.client.0.smithi078.stdout:4/595: creat dc/d10/d1f/fc9 x:0 0 0 2024-09-11T00:17:59.287 INFO:tasks.workunit.client.0.smithi078.stdout:4/596: chown dc/d54/fab 79 1 2024-09-11T00:17:59.292 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:17:58 smithi138 ceph-mon[35019]: pgmap v368: 97 pgs: 97 active+clean; 593 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 36 MiB/s rd, 56 MiB/s wr, 351 op/s 2024-09-11T00:17:59.301 INFO:tasks.workunit.client.0.smithi078.stdout:4/597: dwrite dc/d10/d1f/d68/db5/fb7 [4194304,4194304] 0 2024-09-11T00:17:59.303 INFO:tasks.workunit.client.0.smithi078.stdout:4/598: creat dc/d10/d1f/fca x:0 0 0 2024-09-11T00:17:59.310 INFO:tasks.workunit.client.0.smithi078.stdout:4/599: write dc/d10/d1f/d68/db5/fb7 [7521214,116861] 0 2024-09-11T00:17:59.312 INFO:tasks.workunit.client.0.smithi078.stdout:4/600: creat dc/d10/d40/d3a/d4c/fcb x:0 0 0 2024-09-11T00:17:59.312 INFO:tasks.workunit.client.0.smithi078.stdout:4/601: chown dc/d10/d40/d3a/d65/f3f 793278 1 2024-09-11T00:17:59.312 INFO:tasks.workunit.client.0.smithi078.stdout:4/602: fdatasync f3 0 2024-09-11T00:17:59.312 INFO:tasks.workunit.client.0.smithi078.stdout:4/603: fsync dc/d10/d40/d3a/d46/d47/fa0 0 2024-09-11T00:17:59.312 INFO:tasks.workunit.client.0.smithi078.stdout:4/604: creat dc/d10/d40/d3a/d65/d94/fcc x:0 0 0 2024-09-11T00:17:59.313 INFO:tasks.workunit.client.0.smithi078.stdout:4/605: creat dc/d10/d40/d3a/d65/d94/fcd x:0 0 0 2024-09-11T00:17:59.314 INFO:tasks.workunit.client.0.smithi078.stdout:4/606: mknod dc/d10/d40/d3a/d4c/cce 0 2024-09-11T00:17:59.314 INFO:tasks.workunit.client.0.smithi078.stdout:4/607: dread - dc/d10/d1f/fca zero size 2024-09-11T00:17:59.315 INFO:tasks.workunit.client.0.smithi078.stdout:4/608: truncate dc/d10/f14 283690 0 2024-09-11T00:17:59.315 INFO:tasks.workunit.client.0.smithi078.stdout:4/609: getdents dc/d10/d40/d3a/d46/dad 0 2024-09-11T00:17:59.316 INFO:tasks.workunit.client.0.smithi078.stdout:4/610: creat dc/d10/d40/d3a/d46/d59/fcf x:0 0 0 2024-09-11T00:17:59.316 INFO:tasks.workunit.client.0.smithi078.stdout:4/611: chown dc/d10/d40/d3a/d46/c4b 3431671 1 2024-09-11T00:17:59.319 INFO:tasks.workunit.client.0.smithi078.stdout:4/612: fsync dc/d10/d40/d3a/d65/d94/fcc 0 2024-09-11T00:17:59.319 INFO:tasks.workunit.client.0.smithi078.stdout:4/613: chown dc/d10/d40/d3a/d4c/db4/d72/fc6 326753 1 2024-09-11T00:17:59.319 INFO:tasks.workunit.client.0.smithi078.stdout:4/614: dread - dc/d10/d40/d3a/d4c/fcb zero size 2024-09-11T00:17:59.322 INFO:tasks.workunit.client.0.smithi078.stdout:4/615: dread dc/d10/f14 [0,4194304] 0 2024-09-11T00:17:59.329 INFO:tasks.workunit.client.0.smithi078.stdout:3/546: sync 2024-09-11T00:17:59.329 INFO:tasks.workunit.client.0.smithi078.stdout:3/547: write d0/d7/d46/f5e [499843,32563] 0 2024-09-11T00:17:59.329 INFO:tasks.workunit.client.0.smithi078.stdout:3/548: chown d0/d7/d18/d1b/d34/d60/c69 1298 1 2024-09-11T00:17:59.329 INFO:tasks.workunit.client.0.smithi078.stdout:3/549: dread d0/d7/d18/d8c/f9c [0,4194304] 0 2024-09-11T00:17:59.329 INFO:tasks.workunit.client.0.smithi078.stdout:3/550: creat d0/d7/d23/d91/fa7 x:0 0 0 2024-09-11T00:17:59.329 INFO:tasks.workunit.client.0.smithi078.stdout:3/551: chown d0/f3c 19048 1 2024-09-11T00:17:59.329 INFO:tasks.workunit.client.0.smithi078.stdout:3/552: creat d0/d7/d18/d8c/fa8 x:0 0 0 2024-09-11T00:17:59.335 INFO:tasks.workunit.client.0.smithi078.stdout:3/553: write d0/f1f [1769061,71279] 0 2024-09-11T00:17:59.347 INFO:tasks.workunit.client.0.smithi078.stdout:3/554: dwrite d0/d7/d23/d91/f22 [0,4194304] 0 2024-09-11T00:17:59.347 INFO:tasks.workunit.client.0.smithi078.stdout:3/555: readlink d0/d7/l15 0 2024-09-11T00:17:59.347 INFO:tasks.workunit.client.0.smithi078.stdout:3/556: truncate d0/d7/d18/d1b/d34/f8f 321623 0 2024-09-11T00:17:59.348 INFO:tasks.workunit.client.0.smithi078.stdout:3/557: creat d0/d7/d23/d91/fa9 x:0 0 0 2024-09-11T00:17:59.350 INFO:tasks.workunit.client.0.smithi078.stdout:3/558: unlink d0/c16 0 2024-09-11T00:17:59.350 INFO:tasks.workunit.client.0.smithi078.stdout:3/559: write d0/d7/d23/d91/f85 [619486,51557] 0 2024-09-11T00:17:59.351 INFO:tasks.workunit.client.0.smithi078.stdout:3/560: unlink d0/d7/d23/f6a 0 2024-09-11T00:17:59.357 INFO:tasks.workunit.client.0.smithi078.stdout:3/561: dread d0/d7/f8b [0,4194304] 0 2024-09-11T00:17:59.357 INFO:tasks.workunit.client.0.smithi078.stdout:3/562: stat d0/d39/l7d 0 2024-09-11T00:17:59.357 INFO:tasks.workunit.client.0.smithi078.stdout:3/563: fsync d0/d7/d18/d8c/f9c 0 2024-09-11T00:17:59.437 INFO:tasks.workunit.client.0.smithi078.stdout:8/625: sync 2024-09-11T00:17:59.450 INFO:tasks.workunit.client.0.smithi078.stdout:8/626: dwrite da/d1c/d60/d85/d79/d99/d82/d63/da9/fb2 [0,4194304] 0 2024-09-11T00:17:59.452 INFO:tasks.workunit.client.0.smithi078.stdout:8/627: rmdir da/d1c 39 2024-09-11T00:17:59.452 INFO:tasks.workunit.client.0.smithi078.stdout:8/628: read - da/fba zero size 2024-09-11T00:17:59.452 INFO:tasks.workunit.client.0.smithi078.stdout:8/629: mknod da/d87/d7b/da7/cc2 0 2024-09-11T00:17:59.452 INFO:tasks.workunit.client.0.smithi078.stdout:8/630: truncate da/d13/d1b/d24/d62/f69 780662 0 2024-09-11T00:17:59.453 INFO:tasks.workunit.client.0.smithi078.stdout:8/631: creat da/d13/d19/fc3 x:0 0 0 2024-09-11T00:17:59.454 INFO:tasks.workunit.client.0.smithi078.stdout:8/632: rename da/d13/d1b/d24/f27 to da/d1c/d60/d85/d79/d99/d82/d63/da9/fc4 0 2024-09-11T00:17:59.467 INFO:tasks.workunit.client.0.smithi078.stdout:8/633: dwrite da/d1c/fae [0,4194304] 0 2024-09-11T00:17:59.475 INFO:tasks.workunit.client.0.smithi078.stdout:8/634: dread da/d1c/d60/fb3 [0,4194304] 0 2024-09-11T00:17:59.475 INFO:tasks.workunit.client.0.smithi078.stdout:8/635: read - da/fba zero size 2024-09-11T00:17:59.476 INFO:tasks.workunit.client.0.smithi078.stdout:8/636: truncate da/d87/d7b/faf 57412 0 2024-09-11T00:17:59.476 INFO:tasks.workunit.client.0.smithi078.stdout:8/637: truncate da/f10 1153473 0 2024-09-11T00:17:59.492 INFO:tasks.workunit.client.0.smithi078.stdout:8/638: dwrite da/f30 [0,4194304] 0 2024-09-11T00:17:59.493 INFO:tasks.workunit.client.0.smithi078.stdout:8/639: truncate da/d87/d3a/f81 3507517 0 2024-09-11T00:17:59.495 INFO:tasks.workunit.client.0.smithi078.stdout:8/640: creat da/d1c/d60/d85/d79/d99/d82/d63/fc5 x:0 0 0 2024-09-11T00:17:59.495 INFO:tasks.workunit.client.0.smithi078.stdout:8/641: mknod da/d1c/d60/d85/d79/d99/cc6 0 2024-09-11T00:17:59.503 INFO:tasks.workunit.client.0.smithi078.stdout:6/546: sync 2024-09-11T00:17:59.503 INFO:tasks.workunit.client.0.smithi078.stdout:0/597: sync 2024-09-11T00:17:59.503 INFO:tasks.workunit.client.0.smithi078.stdout:6/547: stat d0/c42 0 2024-09-11T00:17:59.503 INFO:tasks.workunit.client.0.smithi078.stdout:0/598: fdatasync d2/d2a/d2c/d35/d59/d7/fa 0 2024-09-11T00:17:59.503 INFO:tasks.workunit.client.0.smithi078.stdout:8/642: write da/d13/d1b/f23 [3061566,116008] 0 2024-09-11T00:17:59.503 INFO:tasks.workunit.client.0.smithi078.stdout:6/548: rmdir d0/d66/da5 39 2024-09-11T00:17:59.505 INFO:tasks.workunit.client.0.smithi078.stdout:0/599: rename d2/c9 to d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/cc9 0 2024-09-11T00:17:59.505 INFO:tasks.workunit.client.0.smithi078.stdout:6/549: creat d0/d1/d53/d9c/dac/fb7 x:0 0 0 2024-09-11T00:17:59.507 INFO:tasks.workunit.client.0.smithi078.stdout:0/600: rename d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/f7f to d2/d2a/d2c/d35/d71/fca 0 2024-09-11T00:17:59.507 INFO:tasks.workunit.client.0.smithi078.stdout:0/601: mknod d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/ccb 0 2024-09-11T00:17:59.508 INFO:tasks.workunit.client.0.smithi078.stdout:0/602: mknod d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/db7/ccc 0 2024-09-11T00:17:59.508 INFO:tasks.workunit.client.0.smithi078.stdout:0/603: chown d2/d2a/d2c/d35/f78 113015073 1 2024-09-11T00:17:59.508 INFO:tasks.workunit.client.0.smithi078.stdout:0/604: truncate d2/d57/f88 3714748 0 2024-09-11T00:17:59.509 INFO:tasks.workunit.client.0.smithi078.stdout:0/605: getdents d2/d57/d8b 0 2024-09-11T00:17:59.509 INFO:tasks.workunit.client.0.smithi078.stdout:6/550: dread d0/d1/d53/f90 [0,4194304] 0 2024-09-11T00:17:59.510 INFO:tasks.workunit.client.0.smithi078.stdout:6/551: rename d0/d1/ca2 to d0/d1/d53/d9c/dac/cb8 0 2024-09-11T00:17:59.511 INFO:tasks.workunit.client.0.smithi078.stdout:6/552: truncate d0/d33/f48 3803135 0 2024-09-11T00:17:59.513 INFO:tasks.workunit.client.0.smithi078.stdout:6/553: creat d0/d1/d53/d9c/dac/fb9 x:0 0 0 2024-09-11T00:17:59.515 INFO:tasks.workunit.client.0.smithi078.stdout:6/554: creat d0/d1/d53/d9c/db6/fba x:0 0 0 2024-09-11T00:17:59.518 INFO:tasks.workunit.client.0.smithi078.stdout:6/555: creat d0/d1/d53/fbb x:0 0 0 2024-09-11T00:17:59.520 INFO:tasks.workunit.client.0.smithi078.stdout:6/556: creat d0/d1/d53/d9c/fbc x:0 0 0 2024-09-11T00:17:59.520 INFO:tasks.workunit.client.0.smithi078.stdout:6/557: chown d0/d1/d1b/f6d 1072408790 1 2024-09-11T00:17:59.527 INFO:tasks.workunit.client.0.smithi078.stdout:0/606: dwrite d2/d2a/d2c/d35/d71/f83 [0,4194304] 0 2024-09-11T00:17:59.528 INFO:tasks.workunit.client.0.smithi078.stdout:8/643: dwrite da/d1c/fae [4194304,4194304] 0 2024-09-11T00:17:59.532 INFO:tasks.workunit.client.0.smithi078.stdout:8/644: creat da/d1c/d60/d85/d94/fc7 x:0 0 0 2024-09-11T00:17:59.533 INFO:tasks.workunit.client.0.smithi078.stdout:8/645: link da/d1c/d60/fb3 da/d13/d1b/d24/d86/d91/fc8 0 2024-09-11T00:17:59.533 INFO:tasks.workunit.client.0.smithi078.stdout:8/646: dread - da/d13/d1b/d24/d62/f8a zero size 2024-09-11T00:17:59.534 INFO:tasks.workunit.client.0.smithi078.stdout:0/607: write d2/f2d [2382696,39575] 0 2024-09-11T00:17:59.534 INFO:tasks.workunit.client.0.smithi078.stdout:8/647: link da/d1c/d60/d85/d79/d99/d82/d63/da9/fc4 da/d87/fc9 0 2024-09-11T00:17:59.535 INFO:tasks.workunit.client.0.smithi078.stdout:0/608: creat d2/d2a/d2c/d35/d59/d4f/d61/fcd x:0 0 0 2024-09-11T00:17:59.536 INFO:tasks.workunit.client.0.smithi078.stdout:8/648: truncate da/d13/f2c 1519463 0 2024-09-11T00:17:59.537 INFO:tasks.workunit.client.0.smithi078.stdout:8/649: creat da/d1c/d60/d85/d79/d99/d82/fca x:0 0 0 2024-09-11T00:17:59.537 INFO:tasks.workunit.client.0.smithi078.stdout:6/558: dwrite d0/d1/d1b/f45 [0,4194304] 0 2024-09-11T00:17:59.537 INFO:tasks.workunit.client.0.smithi078.stdout:6/559: fdatasync d0/d1/d9/d17/d5e/fb2 0 2024-09-11T00:17:59.537 INFO:tasks.workunit.client.0.smithi078.stdout:6/560: truncate d0/d1/d53/fbb 696253 0 2024-09-11T00:17:59.539 INFO:tasks.workunit.client.0.smithi078.stdout:6/561: rename d0/d66/l99 to d0/d1/d53/d9c/lbd 0 2024-09-11T00:17:59.539 INFO:tasks.workunit.client.0.smithi078.stdout:0/609: dread d2/d2a/d2c/d5e/f68 [4194304,4194304] 0 2024-09-11T00:17:59.540 INFO:tasks.workunit.client.0.smithi078.stdout:8/650: read da/d1c/d60/d85/d79/d99/f98 [226576,125413] 0 2024-09-11T00:17:59.541 INFO:tasks.workunit.client.0.smithi078.stdout:8/651: dread da/d87/d7b/faf [0,4194304] 0 2024-09-11T00:17:59.548 INFO:tasks.workunit.client.0.smithi078.stdout:8/652: read da/d1c/f38 [2475137,113337] 0 2024-09-11T00:17:59.558 INFO:tasks.workunit.client.0.smithi078.stdout:0/610: dwrite d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/fb3 [0,4194304] 0 2024-09-11T00:17:59.558 INFO:tasks.workunit.client.0.smithi078.stdout:8/653: read da/f14 [2056571,88880] 0 2024-09-11T00:17:59.560 INFO:tasks.workunit.client.0.smithi078.stdout:6/562: dwrite d0/d1/f96 [0,4194304] 0 2024-09-11T00:17:59.560 INFO:tasks.workunit.client.0.smithi078.stdout:0/611: mknod d2/d2a/d2c/d35/d59/d7/d96/cce 0 2024-09-11T00:17:59.560 INFO:tasks.workunit.client.0.smithi078.stdout:0/612: fsync d2/d2a/d2c/d35/d59/d7/f15 0 2024-09-11T00:17:59.564 INFO:tasks.workunit.client.0.smithi078.stdout:6/563: getdents d0/d1/da8 0 2024-09-11T00:17:59.564 INFO:tasks.workunit.client.0.smithi078.stdout:6/564: fsync d0/d1/d1b/f73 0 2024-09-11T00:17:59.564 INFO:tasks.workunit.client.0.smithi078.stdout:6/565: write d0/d1/d9/d59/f81 [953130,95094] 0 2024-09-11T00:17:59.565 INFO:tasks.workunit.client.0.smithi078.stdout:0/613: unlink d2/d2a/d2c/d35/d59/d4f/d61/d8f/ca1 0 2024-09-11T00:17:59.575 INFO:tasks.workunit.client.0.smithi078.stdout:6/566: dread d0/d33/f37 [0,4194304] 0 2024-09-11T00:17:59.577 INFO:tasks.workunit.client.0.smithi078.stdout:6/567: symlink d0/lbe 0 2024-09-11T00:17:59.579 INFO:tasks.workunit.client.0.smithi078.stdout:6/568: creat d0/d1/d9/d17/fbf x:0 0 0 2024-09-11T00:17:59.579 INFO:tasks.workunit.client.0.smithi078.stdout:6/569: chown d0/d66/caf 561618 1 2024-09-11T00:17:59.580 INFO:tasks.workunit.client.0.smithi078.stdout:6/570: creat d0/d1/d9/d17/d5e/fc0 x:0 0 0 2024-09-11T00:17:59.580 INFO:tasks.workunit.client.0.smithi078.stdout:6/571: stat d0/d1/d9/f16 0 2024-09-11T00:17:59.580 INFO:tasks.workunit.client.0.smithi078.stdout:0/614: dwrite d2/d2a/d2c/d35/d71/f8e [0,4194304] 0 2024-09-11T00:17:59.581 INFO:tasks.workunit.client.0.smithi078.stdout:6/572: rmdir d0/d1/d9/d59 39 2024-09-11T00:17:59.581 INFO:tasks.workunit.client.0.smithi078.stdout:6/573: write d0/d1/d9/f4a [1252558,40676] 0 2024-09-11T00:17:59.582 INFO:tasks.workunit.client.0.smithi078.stdout:6/574: mknod d0/d1/d9/d59/d74/d6b/cc1 0 2024-09-11T00:17:59.597 INFO:tasks.workunit.client.0.smithi078.stdout:6/575: dwrite d0/d1/f41 [0,4194304] 0 2024-09-11T00:17:59.599 INFO:tasks.workunit.client.0.smithi078.stdout:6/576: rmdir d0/d1 39 2024-09-11T00:17:59.599 INFO:tasks.workunit.client.0.smithi078.stdout:6/577: dread - d0/d1/d53/d9c/db6/fba zero size 2024-09-11T00:17:59.600 INFO:tasks.workunit.client.0.smithi078.stdout:6/578: rename d0/c4b to d0/d1/d9/d59/d74/cc2 0 2024-09-11T00:17:59.601 INFO:tasks.workunit.client.0.smithi078.stdout:6/579: mknod d0/d1/d9/d59/cc3 0 2024-09-11T00:17:59.601 INFO:tasks.workunit.client.0.smithi078.stdout:6/580: getdents d0/d1/d1b 0 2024-09-11T00:17:59.609 INFO:tasks.workunit.client.0.smithi078.stdout:7/550: sync 2024-09-11T00:17:59.609 INFO:tasks.workunit.client.0.smithi078.stdout:4/616: sync 2024-09-11T00:17:59.609 INFO:tasks.workunit.client.0.smithi078.stdout:4/617: chown dc/d10/d40/d33/l48 330292443 1 2024-09-11T00:17:59.609 INFO:tasks.workunit.client.0.smithi078.stdout:5/477: sync 2024-09-11T00:17:59.609 INFO:tasks.workunit.client.0.smithi078.stdout:3/564: sync 2024-09-11T00:17:59.609 INFO:tasks.workunit.client.0.smithi078.stdout:1/760: sync 2024-09-11T00:17:59.609 INFO:tasks.workunit.client.0.smithi078.stdout:2/582: sync 2024-09-11T00:17:59.609 INFO:tasks.workunit.client.0.smithi078.stdout:9/611: sync 2024-09-11T00:17:59.609 INFO:tasks.workunit.client.0.smithi078.stdout:7/551: creat d0/d34/db/d30/d1d/d74/fa2 x:0 0 0 2024-09-11T00:17:59.614 INFO:tasks.workunit.client.0.smithi078.stdout:3/565: unlink d0/d39/c5c 0 2024-09-11T00:17:59.614 INFO:tasks.workunit.client.0.smithi078.stdout:1/761: unlink d3/d1a/d21/d4a/lf5 0 2024-09-11T00:17:59.614 INFO:tasks.workunit.client.0.smithi078.stdout:2/583: rmdir d0/d1/d8 39 2024-09-11T00:17:59.614 INFO:tasks.workunit.client.0.smithi078.stdout:4/618: mkdir dc/d54/dd0 0 2024-09-11T00:17:59.614 INFO:tasks.workunit.client.0.smithi078.stdout:1/762: readlink d3/d29/d5f/d39/d61/ld2 0 2024-09-11T00:17:59.614 INFO:tasks.workunit.client.0.smithi078.stdout:2/584: write d0/d67/f7a [476585,16456] 0 2024-09-11T00:17:59.614 INFO:tasks.workunit.client.0.smithi078.stdout:4/619: chown dc/d10/d40/d3a/d65/d7b/d9e/d5d/l60 3092842 1 2024-09-11T00:17:59.614 INFO:tasks.workunit.client.0.smithi078.stdout:2/585: read d0/d1/f46 [322381,26632] 0 2024-09-11T00:17:59.614 INFO:tasks.workunit.client.0.smithi078.stdout:5/478: creat d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d8c/fab x:0 0 0 2024-09-11T00:17:59.615 INFO:tasks.workunit.client.0.smithi078.stdout:2/586: dread d0/d1/d33/d86/db4/f7e [0,4194304] 0 2024-09-11T00:17:59.616 INFO:tasks.workunit.client.0.smithi078.stdout:3/566: symlink d0/d7/d46/laa 0 2024-09-11T00:17:59.616 INFO:tasks.workunit.client.0.smithi078.stdout:3/567: readlink d0/d39/l7d 0 2024-09-11T00:17:59.616 INFO:tasks.workunit.client.0.smithi078.stdout:3/568: fsync d0/d7/d18/f6e 0 2024-09-11T00:17:59.616 INFO:tasks.workunit.client.0.smithi078.stdout:3/569: fdatasync d0/d7/d18/f40 0 2024-09-11T00:17:59.616 INFO:tasks.workunit.client.0.smithi078.stdout:1/763: symlink d3/dc6/lf7 0 2024-09-11T00:17:59.617 INFO:tasks.workunit.client.0.smithi078.stdout:2/587: dread d0/d1/d11/d60/da2/d38/f81 [0,4194304] 0 2024-09-11T00:17:59.618 INFO:tasks.workunit.client.0.smithi078.stdout:4/620: rename dc/d10/d40/f28 to dc/d10/d40/d3a/d65/d7b/d9e/d50/fd1 0 2024-09-11T00:17:59.619 INFO:tasks.workunit.client.0.smithi078.stdout:5/479: link d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d5b/f76 d7/d8/d56/d9e/fac 0 2024-09-11T00:17:59.622 INFO:tasks.workunit.client.0.smithi078.stdout:3/570: unlink d0/d7/c99 0 2024-09-11T00:17:59.622 INFO:tasks.workunit.client.0.smithi078.stdout:3/571: dread - d0/d7/d46/f66 zero size 2024-09-11T00:17:59.622 INFO:tasks.workunit.client.0.smithi078.stdout:3/572: stat d0/d7/d23/l2a 0 2024-09-11T00:17:59.623 INFO:tasks.workunit.client.0.smithi078.stdout:3/573: write d0/d7/d23/d7c/f9d [475265,71086] 0 2024-09-11T00:17:59.623 INFO:tasks.workunit.client.0.smithi078.stdout:7/552: dwrite d0/d34/db/f96 [0,4194304] 0 2024-09-11T00:17:59.623 INFO:tasks.workunit.client.0.smithi078.stdout:1/764: symlink d3/d29/d5f/d39/lf8 0 2024-09-11T00:17:59.624 INFO:tasks.workunit.client.0.smithi078.stdout:2/588: dread d0/d1/d3c/f45 [0,4194304] 0 2024-09-11T00:17:59.624 INFO:tasks.workunit.client.0.smithi078.stdout:4/621: link dc/l4e dc/d54/ld2 0 2024-09-11T00:17:59.626 INFO:tasks.workunit.client.0.smithi078.stdout:5/480: creat d7/d8/d33/d22/d25/d28/fad x:0 0 0 2024-09-11T00:17:59.626 INFO:tasks.workunit.client.0.smithi078.stdout:9/612: dwrite dc/f2c [4194304,4194304] 0 2024-09-11T00:17:59.633 INFO:tasks.workunit.client.0.smithi078.stdout:7/553: mknod d0/d34/d65/ca3 0 2024-09-11T00:17:59.633 INFO:tasks.workunit.client.0.smithi078.stdout:7/554: fsync d0/d34/db/d30/d1d/f2c 0 2024-09-11T00:17:59.633 INFO:tasks.workunit.client.0.smithi078.stdout:4/622: unlink dc/d10/d40/d3a/d65/d7b/d8b/faf 0 2024-09-11T00:17:59.633 INFO:tasks.workunit.client.0.smithi078.stdout:4/623: chown dc/d10/d40/d3a/d4c/db4/d72 54652530 1 2024-09-11T00:17:59.633 INFO:tasks.workunit.client.0.smithi078.stdout:4/624: dread - dc/d10/d40/d3a/d46/d59/fcf zero size 2024-09-11T00:17:59.634 INFO:tasks.workunit.client.0.smithi078.stdout:9/613: chown dc/d12/l34 67569 1 2024-09-11T00:17:59.634 INFO:tasks.workunit.client.0.smithi078.stdout:9/614: stat dc/d12/d20/d50/dbc 0 2024-09-11T00:17:59.634 INFO:tasks.workunit.client.0.smithi078.stdout:9/615: getdents dc/d12/d20/d50/dbc/dcf 0 2024-09-11T00:17:59.641 INFO:tasks.workunit.client.0.smithi078.stdout:4/625: truncate dc/d10/d40/d3a/d65/d7b/d9e/f3e 2717534 0 2024-09-11T00:17:59.642 INFO:tasks.workunit.client.0.smithi078.stdout:5/481: dwrite d7/d8/d56/d9e/fac [0,4194304] 0 2024-09-11T00:17:59.642 INFO:tasks.workunit.client.0.smithi078.stdout:5/482: read d7/d8/d33/d22/d25/f3a [366730,41744] 0 2024-09-11T00:17:59.642 INFO:tasks.workunit.client.0.smithi078.stdout:5/483: chown d7/d8/d33/d22/d25/d28/d24/l95 337750883 1 2024-09-11T00:17:59.642 INFO:tasks.workunit.client.0.smithi078.stdout:5/484: chown d7/d8/f8b 120 1 2024-09-11T00:17:59.642 INFO:tasks.workunit.client.0.smithi078.stdout:5/485: write d7/d8/de/d2c/fa6 [784800,99009] 0 2024-09-11T00:17:59.642 INFO:tasks.workunit.client.0.smithi078.stdout:9/616: mknod dc/d12/d20/cd0 0 2024-09-11T00:17:59.645 INFO:tasks.workunit.client.0.smithi078.stdout:3/574: dwrite d0/d7/d18/d1b/d34/f49 [0,4194304] 0 2024-09-11T00:17:59.646 INFO:tasks.workunit.client.0.smithi078.stdout:7/555: unlink d0/d34/db/d30/d1d/fe 0 2024-09-11T00:17:59.646 INFO:tasks.workunit.client.0.smithi078.stdout:7/556: write d0/d34/db/d30/d1d/f59 [5124954,94783] 0 2024-09-11T00:17:59.646 INFO:tasks.workunit.client.0.smithi078.stdout:7/557: truncate d0/d34/db/d30/d1d/d14/d87/f9c 330074 0 2024-09-11T00:17:59.649 INFO:tasks.workunit.client.0.smithi078.stdout:5/486: rmdir d7/d8/d47 39 2024-09-11T00:17:59.649 INFO:tasks.workunit.client.0.smithi078.stdout:5/487: readlink d7/d8/l89 0 2024-09-11T00:17:59.650 INFO:tasks.workunit.client.0.smithi078.stdout:1/765: dwrite d3/d29/f2e [0,4194304] 0 2024-09-11T00:17:59.651 INFO:tasks.workunit.client.0.smithi078.stdout:9/617: creat dc/d12/fd1 x:0 0 0 2024-09-11T00:17:59.651 INFO:tasks.workunit.client.0.smithi078.stdout:9/618: dread - dc/d12/d54/d83/f9e zero size 2024-09-11T00:17:59.652 INFO:tasks.workunit.client.0.smithi078.stdout:9/619: chown dc/d12/d20/d58/d5b/dbb/l52 6988427 1 2024-09-11T00:17:59.655 INFO:tasks.workunit.client.0.smithi078.stdout:3/575: rmdir d0/d7/d18/d1b/d34/d3e 39 2024-09-11T00:17:59.655 INFO:tasks.workunit.client.0.smithi078.stdout:7/558: mknod d0/d34/db/d30/d1d/d14/ca4 0 2024-09-11T00:17:59.655 INFO:tasks.workunit.client.0.smithi078.stdout:5/488: creat d7/d8/d47/d52/fae x:0 0 0 2024-09-11T00:17:59.655 INFO:tasks.workunit.client.0.smithi078.stdout:5/489: chown f6 2650 1 2024-09-11T00:17:59.659 INFO:tasks.workunit.client.0.smithi078.stdout:4/626: dwrite dc/fd [0,4194304] 0 2024-09-11T00:17:59.659 INFO:tasks.workunit.client.0.smithi078.stdout:4/627: chown dc/d10/d40/d3a/d65/d7b/d8b/dc5/c9b 42 1 2024-09-11T00:17:59.659 INFO:tasks.workunit.client.0.smithi078.stdout:9/620: mknod dc/d12/d20/d58/d5a/cd2 0 2024-09-11T00:17:59.665 INFO:tasks.workunit.client.0.smithi078.stdout:7/559: creat d0/d34/db/d30/d1d/fa5 x:0 0 0 2024-09-11T00:17:59.665 INFO:tasks.workunit.client.0.smithi078.stdout:1/766: dwrite d3/d1a/f2d [4194304,4194304] 0 2024-09-11T00:17:59.666 INFO:tasks.workunit.client.0.smithi078.stdout:1/767: write d3/d29/d5f/f18 [1040280,92126] 0 2024-09-11T00:17:59.667 INFO:tasks.workunit.client.0.smithi078.stdout:9/621: link f2 dc/d12/d46/d51/dcc/fd3 0 2024-09-11T00:17:59.669 INFO:tasks.workunit.client.0.smithi078.stdout:7/560: mknod d0/d34/db/d30/d1d/d14/d87/ca6 0 2024-09-11T00:17:59.671 INFO:tasks.workunit.client.0.smithi078.stdout:1/768: creat d3/d1a/d21/dcf/ff9 x:0 0 0 2024-09-11T00:17:59.675 INFO:tasks.workunit.client.0.smithi078.stdout:4/628: dwrite dc/d10/d40/d3a/d4c/f8a [0,4194304] 0 2024-09-11T00:17:59.675 INFO:tasks.workunit.client.0.smithi078.stdout:5/490: dwrite d7/d8/d33/d22/d25/d6a/f6e [0,4194304] 0 2024-09-11T00:17:59.676 INFO:tasks.workunit.client.0.smithi078.stdout:1/769: dread d3/d1a/d21/d4a/d90/f92 [0,4194304] 0 2024-09-11T00:17:59.676 INFO:tasks.workunit.client.0.smithi078.stdout:4/629: mknod dc/d10/d40/d3a/d65/d94/cd3 0 2024-09-11T00:17:59.678 INFO:tasks.workunit.client.0.smithi078.stdout:5/491: link d7/d8/d33/d22/d25/d28/d24/d1c/f2e d7/d8/d33/d22/d51/faf 0 2024-09-11T00:17:59.678 INFO:tasks.workunit.client.0.smithi078.stdout:5/492: dread - d7/d8/d33/d22/d25/d28/fad zero size 2024-09-11T00:17:59.678 INFO:tasks.workunit.client.0.smithi078.stdout:1/770: mkdir d3/d1a/d21/d4a/dfa 0 2024-09-11T00:17:59.681 INFO:tasks.workunit.client.0.smithi078.stdout:4/630: rename dc/d10/d40/d3a/d4c/db4/d72/f79 to dc/d54/fd4 0 2024-09-11T00:17:59.683 INFO:tasks.workunit.client.0.smithi078.stdout:1/771: dread - d3/d29/d5f/d4e/f89 zero size 2024-09-11T00:17:59.684 INFO:tasks.workunit.client.0.smithi078.stdout:4/631: mknod dc/d10/d40/d3a/d65/d94/cd5 0 2024-09-11T00:17:59.684 INFO:tasks.workunit.client.0.smithi078.stdout:8/654: sync 2024-09-11T00:17:59.684 INFO:tasks.workunit.client.0.smithi078.stdout:1/772: creat d3/dc6/ffb x:0 0 0 2024-09-11T00:17:59.685 INFO:tasks.workunit.client.0.smithi078.stdout:3/576: dwrite d0/d7/d46/d86/fa6 [0,4194304] 0 2024-09-11T00:17:59.686 INFO:tasks.workunit.client.0.smithi078.stdout:4/632: rename dc/d10/d40/d3a/d4c/db4/f7d to dc/d10/d40/d3a/d46/fd6 0 2024-09-11T00:17:59.686 INFO:tasks.workunit.client.0.smithi078.stdout:8/655: symlink da/d1c/d60/d85/d79/lcb 0 2024-09-11T00:17:59.687 INFO:tasks.workunit.client.0.smithi078.stdout:1/773: mkdir d3/dfc 0 2024-09-11T00:17:59.692 INFO:tasks.workunit.client.0.smithi078.stdout:5/493: dread d7/d8/d33/d22/d25/d28/d24/d1c/f2e [0,4194304] 0 2024-09-11T00:17:59.692 INFO:tasks.workunit.client.0.smithi078.stdout:4/633: write dc/f25 [961758,48743] 0 2024-09-11T00:17:59.695 INFO:tasks.workunit.client.0.smithi078.stdout:4/634: mkdir dc/d10/d40/d3a/d65/d7b/dd7 0 2024-09-11T00:17:59.695 INFO:tasks.workunit.client.0.smithi078.stdout:4/635: fdatasync dc/d10/d40/d3a/d46/f89 0 2024-09-11T00:17:59.696 INFO:tasks.workunit.client.0.smithi078.stdout:4/636: getdents dc/d10/d40/d3a/d65/d7b/d9e 0 2024-09-11T00:17:59.696 INFO:tasks.workunit.client.0.smithi078.stdout:7/561: write d0/d34/db/f5c [843170,37648] 0 2024-09-11T00:17:59.697 INFO:tasks.workunit.client.0.smithi078.stdout:4/637: read dc/d10/d1f/f97 [127085,114602] 0 2024-09-11T00:17:59.697 INFO:tasks.workunit.client.0.smithi078.stdout:4/638: chown dc/d10/d40/d3a/c91 598970 1 2024-09-11T00:17:59.698 INFO:tasks.workunit.client.0.smithi078.stdout:4/639: fsync dc/d10/d40/d3a/d65/f3f 0 2024-09-11T00:17:59.698 INFO:tasks.workunit.client.0.smithi078.stdout:4/640: truncate dc/f11 908728 0 2024-09-11T00:17:59.700 INFO:tasks.workunit.client.0.smithi078.stdout:7/562: unlink d0/d34/db/d30/d28/f92 0 2024-09-11T00:17:59.701 INFO:tasks.workunit.client.0.smithi078.stdout:9/622: dwrite dc/d12/d20/d58/d5b/dbb/f89 [0,4194304] 0 2024-09-11T00:17:59.701 INFO:tasks.workunit.client.0.smithi078.stdout:7/563: rename d0/d34/db/d30/d1d/d74 to d0/da7 0 2024-09-11T00:17:59.704 INFO:tasks.workunit.client.0.smithi078.stdout:9/623: mkdir dc/d12/d20/d50/dbc/dd4 0 2024-09-11T00:17:59.704 INFO:tasks.workunit.client.0.smithi078.stdout:9/624: chown dc/d12/d20/d85/f9a 1 1 2024-09-11T00:17:59.704 INFO:tasks.workunit.client.0.smithi078.stdout:9/625: chown dc/d12/d54/fa3 36184859 1 2024-09-11T00:17:59.704 INFO:tasks.workunit.client.0.smithi078.stdout:9/626: rename dc/d12/d20/d30/fc2 to dc/d12/d20/d58/d5b/d68/fd5 0 2024-09-11T00:17:59.706 INFO:tasks.workunit.client.0.smithi078.stdout:9/627: mkdir dc/d12/d46/dd6 0 2024-09-11T00:17:59.707 INFO:tasks.workunit.client.0.smithi078.stdout:9/628: mknod dc/d12/d20/d58/cd7 0 2024-09-11T00:17:59.707 INFO:tasks.workunit.client.0.smithi078.stdout:9/629: stat dc/d12/f64 0 2024-09-11T00:17:59.709 INFO:tasks.workunit.client.0.smithi078.stdout:7/564: dread d0/d34/db/d30/d1d/d14/f4f [0,4194304] 0 2024-09-11T00:17:59.715 INFO:tasks.workunit.client.0.smithi078.stdout:7/565: mknod d0/d34/db/d30/d1d/ca8 0 2024-09-11T00:17:59.715 INFO:tasks.workunit.client.0.smithi078.stdout:7/566: readlink d0/d34/db/l7a 0 2024-09-11T00:17:59.716 INFO:tasks.workunit.client.0.smithi078.stdout:7/567: creat d0/d34/db/d30/d1d/d81/fa9 x:0 0 0 2024-09-11T00:17:59.717 INFO:tasks.workunit.client.0.smithi078.stdout:3/577: dwrite d0/d7/d18/d8c/f95 [0,4194304] 0 2024-09-11T00:17:59.718 INFO:tasks.workunit.client.0.smithi078.stdout:7/568: truncate d0/d34/db/d30/f76 1937306 0 2024-09-11T00:17:59.719 INFO:tasks.workunit.client.0.smithi078.stdout:9/630: read dc/d12/d20/d58/d5b/f90 [306319,104374] 0 2024-09-11T00:17:59.721 INFO:tasks.workunit.client.0.smithi078.stdout:1/774: dwrite d3/dc6/f9b [0,4194304] 0 2024-09-11T00:17:59.722 INFO:tasks.workunit.client.0.smithi078.stdout:3/578: dread d0/d7/d18/f6e [0,4194304] 0 2024-09-11T00:17:59.726 INFO:tasks.workunit.client.0.smithi078.stdout:3/579: creat d0/d7/d18/d1b/d34/d60/d6d/fab x:0 0 0 2024-09-11T00:17:59.726 INFO:tasks.workunit.client.0.smithi078.stdout:5/494: dwrite d7/d8/f77 [0,4194304] 0 2024-09-11T00:17:59.728 INFO:tasks.workunit.client.0.smithi078.stdout:3/580: truncate d0/d7/d18/d1b/d34/d60/d6d/f54 3987467 0 2024-09-11T00:17:59.728 INFO:tasks.workunit.client.0.smithi078.stdout:4/641: dwrite dc/d10/d40/d3a/d65/f92 [0,4194304] 0 2024-09-11T00:17:59.731 INFO:tasks.workunit.client.0.smithi078.stdout:1/775: write d3/d29/dc4/fec [2663193,100887] 0 2024-09-11T00:17:59.732 INFO:tasks.workunit.client.0.smithi078.stdout:8/656: dwrite da/d87/d3a/fa3 [4194304,4194304] 0 2024-09-11T00:17:59.732 INFO:tasks.workunit.client.0.smithi078.stdout:8/657: fsync da/d13/d1b/d24/d62/f69 0 2024-09-11T00:17:59.732 INFO:tasks.workunit.client.0.smithi078.stdout:4/642: unlink dc/d54/ld2 0 2024-09-11T00:17:59.738 INFO:tasks.workunit.client.0.smithi078.stdout:7/569: write d0/d34/db/d30/d1d/d14/d62/f90 [2446678,35782] 0 2024-09-11T00:17:59.740 INFO:tasks.workunit.client.0.smithi078.stdout:1/776: unlink d3/d29/d5f/d39/d61/d96/daf/ldb 0 2024-09-11T00:17:59.741 INFO:tasks.workunit.client.0.smithi078.stdout:8/658: creat da/d1c/fcc x:0 0 0 2024-09-11T00:17:59.742 INFO:tasks.workunit.client.0.smithi078.stdout:7/570: write d0/d34/db/d32/f3a [1970561,16106] 0 2024-09-11T00:17:59.742 INFO:tasks.workunit.client.0.smithi078.stdout:7/571: read - d0/f55 zero size 2024-09-11T00:17:59.742 INFO:tasks.workunit.client.0.smithi078.stdout:7/572: write d0/d34/db/d30/d1d/d14/f9a [847449,94966] 0 2024-09-11T00:17:59.742 INFO:tasks.workunit.client.0.smithi078.stdout:4/643: creat dc/d10/d40/d3a/d65/d94/fd8 x:0 0 0 2024-09-11T00:17:59.744 INFO:tasks.workunit.client.0.smithi078.stdout:1/777: symlink d3/d1a/d21/d4a/dfa/lfd 0 2024-09-11T00:17:59.745 INFO:tasks.workunit.client.0.smithi078.stdout:1/778: truncate d3/d1a/d21/d4a/d94/fcd 593345 0 2024-09-11T00:17:59.745 INFO:tasks.workunit.client.0.smithi078.stdout:1/779: truncate d3/d29/d45/fd4 4802766 0 2024-09-11T00:17:59.745 INFO:tasks.workunit.client.0.smithi078.stdout:1/780: chown d3/d29/d45/f77 0 1 2024-09-11T00:17:59.746 INFO:tasks.workunit.client.0.smithi078.stdout:8/659: creat da/d1c/d60/d85/d79/d99/d82/d63/fcd x:0 0 0 2024-09-11T00:17:59.748 INFO:tasks.workunit.client.0.smithi078.stdout:1/781: stat d3/d29/c47 0 2024-09-11T00:17:59.750 INFO:tasks.workunit.client.0.smithi078.stdout:8/660: rename da/d13/c16 to da/d13/d1b/cce 0 2024-09-11T00:17:59.750 INFO:tasks.workunit.client.0.smithi078.stdout:4/644: dread dc/d10/d40/d3a/d65/d7b/d9e/f45 [0,4194304] 0 2024-09-11T00:17:59.750 INFO:tasks.workunit.client.0.smithi078.stdout:4/645: write dc/d10/d40/d3a/d65/f63 [2269728,53365] 0 2024-09-11T00:17:59.750 INFO:tasks.workunit.client.0.smithi078.stdout:1/782: dread d3/d1a/d21/f2c [0,4194304] 0 2024-09-11T00:17:59.750 INFO:tasks.workunit.client.0.smithi078.stdout:1/783: fdatasync d3/d29/d45/f3a 0 2024-09-11T00:17:59.751 INFO:tasks.workunit.client.0.smithi078.stdout:2/589: sync 2024-09-11T00:17:59.751 INFO:tasks.workunit.client.0.smithi078.stdout:0/615: sync 2024-09-11T00:17:59.751 INFO:tasks.workunit.client.0.smithi078.stdout:6/581: sync 2024-09-11T00:17:59.758 INFO:tasks.workunit.client.0.smithi078.stdout:8/661: creat da/d1c/d60/d85/d79/d9e/fcf x:0 0 0 2024-09-11T00:17:59.758 INFO:tasks.workunit.client.0.smithi078.stdout:4/646: symlink dc/d10/d1f/ld9 0 2024-09-11T00:17:59.758 INFO:tasks.workunit.client.0.smithi078.stdout:2/590: link d0/d1/d11/d60/da2/d38/f81 d0/d1/d6f/fce 0 2024-09-11T00:17:59.758 INFO:tasks.workunit.client.0.smithi078.stdout:0/616: rename d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/f82 to d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/fcf 0 2024-09-11T00:17:59.758 INFO:tasks.workunit.client.0.smithi078.stdout:6/582: truncate d0/d1/da8/fad 163640 0 2024-09-11T00:17:59.758 INFO:tasks.workunit.client.0.smithi078.stdout:0/617: write d2/d2a/d2c/d35/d93/fb2 [639544,86168] 0 2024-09-11T00:17:59.759 INFO:tasks.workunit.client.0.smithi078.stdout:8/662: creat da/d1c/d4c/fd0 x:0 0 0 2024-09-11T00:17:59.761 INFO:tasks.workunit.client.0.smithi078.stdout:4/647: symlink dc/d10/d1f/d68/lda 0 2024-09-11T00:17:59.763 INFO:tasks.workunit.client.0.smithi078.stdout:2/591: unlink d0/d1/d3b/l70 0 2024-09-11T00:17:59.764 INFO:tasks.workunit.client.0.smithi078.stdout:6/583: mknod d0/d66/cc4 0 2024-09-11T00:17:59.765 INFO:tasks.workunit.client.0.smithi078.stdout:1/784: dwrite d3/d1a/d21/d4a/d90/dd7/fef [0,4194304] 0 2024-09-11T00:17:59.766 INFO:tasks.workunit.client.0.smithi078.stdout:1/785: fdatasync d3/d29/d5f/d39/f51 0 2024-09-11T00:17:59.766 INFO:tasks.workunit.client.0.smithi078.stdout:1/786: write d3/d29/d5f/d39/d61/d96/fda [401688,51254] 0 2024-09-11T00:17:59.766 INFO:tasks.workunit.client.0.smithi078.stdout:8/663: symlink da/d13/d1b/d4e/ld1 0 2024-09-11T00:17:59.766 INFO:tasks.workunit.client.0.smithi078.stdout:8/664: chown da/d1c/f38 45 1 2024-09-11T00:17:59.766 INFO:tasks.workunit.client.0.smithi078.stdout:8/665: chown da/d13/c49 10538794 1 2024-09-11T00:17:59.769 INFO:tasks.workunit.client.0.smithi078.stdout:0/618: dread d2/d57/f7a [0,4194304] 0 2024-09-11T00:17:59.770 INFO:tasks.workunit.client.0.smithi078.stdout:4/648: unlink dc/d10/d3c/d6e/l8c 0 2024-09-11T00:17:59.770 INFO:tasks.workunit.client.0.smithi078.stdout:6/584: rmdir d0/d1 39 2024-09-11T00:17:59.772 INFO:tasks.workunit.client.0.smithi078.stdout:8/666: unlink da/d13/d1b/d59/f3d 0 2024-09-11T00:17:59.774 INFO:tasks.workunit.client.0.smithi078.stdout:6/585: unlink d0/d1/d9/l3a 0 2024-09-11T00:17:59.776 INFO:tasks.workunit.client.0.smithi078.stdout:4/649: mkdir dc/d10/ddb 0 2024-09-11T00:17:59.777 INFO:tasks.workunit.client.0.smithi078.stdout:6/586: read d0/d33/f4f [4412395,30473] 0 2024-09-11T00:17:59.777 INFO:tasks.workunit.client.0.smithi078.stdout:6/587: write d0/d1/da8/fad [106865,54458] 0 2024-09-11T00:17:59.777 INFO:tasks.workunit.client.0.smithi078.stdout:2/592: dwrite d0/d1/d8/f47 [0,4194304] 0 2024-09-11T00:17:59.778 INFO:tasks.workunit.client.0.smithi078.stdout:8/667: creat da/d87/d7b/fd2 x:0 0 0 2024-09-11T00:17:59.780 INFO:tasks.workunit.client.0.smithi078.stdout:4/650: mknod dc/d10/d40/d3a/cdc 0 2024-09-11T00:17:59.780 INFO:tasks.workunit.client.0.smithi078.stdout:1/787: dwrite d3/d1a/d21/d88/fa0 [0,4194304] 0 2024-09-11T00:17:59.781 INFO:tasks.workunit.client.0.smithi078.stdout:6/588: creat d0/fc5 x:0 0 0 2024-09-11T00:17:59.781 INFO:tasks.workunit.client.0.smithi078.stdout:6/589: chown d0/d1/d53/d72/l9f 35 1 2024-09-11T00:17:59.785 INFO:tasks.workunit.client.0.smithi078.stdout:1/788: rename d3/d1a/d21/c84 to d3/cfe 0 2024-09-11T00:17:59.787 INFO:tasks.workunit.client.0.smithi078.stdout:6/590: creat d0/d1/d53/d72/fc6 x:0 0 0 2024-09-11T00:17:59.787 INFO:tasks.workunit.client.0.smithi078.stdout:6/591: chown d0/d1/d9/l2a 32106 1 2024-09-11T00:17:59.795 INFO:tasks.workunit.client.0.smithi078.stdout:8/668: write da/d13/d1b/d59/f57 [984290,65573] 0 2024-09-11T00:17:59.795 INFO:tasks.workunit.client.0.smithi078.stdout:8/669: chown da/d87/d3a/d4b/c80 252846050 1 2024-09-11T00:17:59.797 INFO:tasks.workunit.client.0.smithi078.stdout:8/670: mkdir da/d87/d3a/d4b/dd3 0 2024-09-11T00:17:59.798 INFO:tasks.workunit.client.0.smithi078.stdout:8/671: rename da/d87/d7b/cb6 to da/d13/d1b/d4e/cd4 0 2024-09-11T00:17:59.799 INFO:tasks.workunit.client.0.smithi078.stdout:1/789: write d3/d1a/d21/d88/f91 [2905781,122237] 0 2024-09-11T00:17:59.799 INFO:tasks.workunit.client.0.smithi078.stdout:1/790: readlink d3/d29/d5f/d39/d61/ld2 0 2024-09-11T00:17:59.799 INFO:tasks.workunit.client.0.smithi078.stdout:8/672: mkdir da/d13/d1b/d37/dd5 0 2024-09-11T00:17:59.799 INFO:tasks.workunit.client.0.smithi078.stdout:8/673: fsync da/d87/fc9 0 2024-09-11T00:17:59.800 INFO:tasks.workunit.client.0.smithi078.stdout:1/791: rmdir d3/d1a/d21/d4a/df4 0 2024-09-11T00:17:59.801 INFO:tasks.workunit.client.0.smithi078.stdout:8/674: rmdir da/d13/d1b 39 2024-09-11T00:17:59.802 INFO:tasks.workunit.client.0.smithi078.stdout:1/792: rename d3/d1a/d21/d88/fa0 to d3/d1a/d21/fff 0 2024-09-11T00:17:59.802 INFO:tasks.workunit.client.0.smithi078.stdout:1/793: fdatasync d3/d29/d45/fb1 0 2024-09-11T00:17:59.804 INFO:tasks.workunit.client.0.smithi078.stdout:4/651: dwrite dc/d10/d40/d3a/d4c/db4/fc4 [0,4194304] 0 2024-09-11T00:17:59.806 INFO:tasks.workunit.client.0.smithi078.stdout:4/652: mkdir dc/d10/ddd 0 2024-09-11T00:17:59.806 INFO:tasks.workunit.client.0.smithi078.stdout:4/653: chown dc/d10/d1f/c82 7 1 2024-09-11T00:17:59.817 INFO:tasks.workunit.client.0.smithi078.stdout:8/675: dwrite da/f14 [0,4194304] 0 2024-09-11T00:17:59.818 INFO:tasks.workunit.client.0.smithi078.stdout:8/676: rmdir da/d1c/d60/d85/d79/d9e 39 2024-09-11T00:17:59.818 INFO:tasks.workunit.client.0.smithi078.stdout:8/677: dread - da/d1c/d60/d85/d79/d99/d82/fa8 zero size 2024-09-11T00:17:59.818 INFO:tasks.workunit.client.0.smithi078.stdout:8/678: stat da/d87/d7b/f8f 0 2024-09-11T00:17:59.819 INFO:tasks.workunit.client.0.smithi078.stdout:8/679: symlink da/d87/d3a/ld6 0 2024-09-11T00:17:59.819 INFO:tasks.workunit.client.0.smithi078.stdout:8/680: unlink da/f14 0 2024-09-11T00:17:59.830 INFO:tasks.workunit.client.0.smithi078.stdout:8/681: write da/d1c/d60/d85/d79/f83 [1035664,129315] 0 2024-09-11T00:17:59.830 INFO:tasks.workunit.client.0.smithi078.stdout:8/682: write da/d1c/f38 [3253467,123391] 0 2024-09-11T00:17:59.832 INFO:tasks.workunit.client.0.smithi078.stdout:8/683: rename da/d13/d19/c77 to da/d1c/cd7 0 2024-09-11T00:17:59.838 INFO:tasks.workunit.client.0.smithi078.stdout:3/581: dwrite d0/f65 [0,4194304] 0 2024-09-11T00:17:59.850 INFO:tasks.workunit.client.0.smithi078.stdout:8/684: dwrite da/d1c/d60/d85/d79/d99/d82/f8b [0,4194304] 0 2024-09-11T00:17:59.859 INFO:tasks.workunit.client.0.smithi078.stdout:3/582: dwrite d0/d7/d23/d91/f22 [0,4194304] 0 2024-09-11T00:17:59.864 INFO:tasks.workunit.client.0.smithi078.stdout:8/685: dwrite da/d1c/d60/d85/d79/d9e/fcf [0,4194304] 0 2024-09-11T00:17:59.869 INFO:tasks.workunit.client.0.smithi078.stdout:3/583: dread d0/d7/d18/d1b/d34/d3e/f5d [0,4194304] 0 2024-09-11T00:17:59.884 INFO:tasks.workunit.client.0.smithi078.stdout:3/584: dwrite d0/d7/d18/d1b/f56 [0,4194304] 0 2024-09-11T00:17:59.885 INFO:tasks.workunit.client.0.smithi078.stdout:3/585: dread - d0/d39/f97 zero size 2024-09-11T00:17:59.889 INFO:tasks.workunit.client.0.smithi078.stdout:4/654: dwrite dc/d10/d40/d3a/d65/d7b/d9e/f45 [0,4194304] 0 2024-09-11T00:17:59.889 INFO:tasks.workunit.client.0.smithi078.stdout:4/655: chown dc/d10/d40/l30 795 1 2024-09-11T00:17:59.889 INFO:tasks.workunit.client.0.smithi078.stdout:4/656: write dc/d10/d1f/f2f [1987612,108639] 0 2024-09-11T00:17:59.889 INFO:tasks.workunit.client.0.smithi078.stdout:0/619: dwrite d2/d2a/d2c/d35/d59/d4f/f80 [0,4194304] 0 2024-09-11T00:17:59.889 INFO:tasks.workunit.client.0.smithi078.stdout:8/686: dwrite da/d87/d7b/f8f [0,4194304] 0 2024-09-11T00:17:59.890 INFO:tasks.workunit.client.0.smithi078.stdout:4/657: unlink dc/d10/d40/d3a/d65/d7b/d9e/d5d/l60 0 2024-09-11T00:17:59.890 INFO:tasks.workunit.client.0.smithi078.stdout:3/586: truncate d0/d7/d18/d1b/f56 2553106 0 2024-09-11T00:17:59.890 INFO:tasks.workunit.client.0.smithi078.stdout:0/620: truncate d2/d2a/d2c/d35/d59/d7/f40 4920798 0 2024-09-11T00:17:59.891 INFO:tasks.workunit.client.0.smithi078.stdout:0/621: readlink d2/d2a/d2c/d35/d59/d7/l91 0 2024-09-11T00:17:59.891 INFO:tasks.workunit.client.0.smithi078.stdout:0/622: chown d2/d2a/d2c/d5e 772990 1 2024-09-11T00:17:59.891 INFO:tasks.workunit.client.0.smithi078.stdout:0/623: readlink d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/l43 0 2024-09-11T00:17:59.892 INFO:tasks.workunit.client.0.smithi078.stdout:8/687: mkdir da/d1c/d60/d85/d79/d9e/dd8 0 2024-09-11T00:17:59.892 INFO:tasks.workunit.client.0.smithi078.stdout:8/688: fsync da/f30 0 2024-09-11T00:17:59.898 INFO:tasks.workunit.client.0.smithi078.stdout:4/658: creat dc/d10/d40/d3a/d65/fde x:0 0 0 2024-09-11T00:17:59.900 INFO:tasks.workunit.client.0.smithi078.stdout:3/587: rmdir d0/d7/d18/d70 39 2024-09-11T00:17:59.900 INFO:tasks.workunit.client.0.smithi078.stdout:3/588: write d0/d7/d18/d1b/d34/d60/d6d/fab [45170,121101] 0 2024-09-11T00:17:59.901 INFO:tasks.workunit.client.0.smithi078.stdout:0/624: unlink d2/d2a/d2c/d35/d59/d7/l91 0 2024-09-11T00:17:59.901 INFO:tasks.workunit.client.0.smithi078.stdout:0/625: truncate d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/fcf 796119 0 2024-09-11T00:17:59.902 INFO:tasks.workunit.client.0.smithi078.stdout:8/689: creat da/d1c/d60/d85/d79/d99/d82/d63/fd9 x:0 0 0 2024-09-11T00:17:59.903 INFO:tasks.workunit.client.0.smithi078.stdout:4/659: truncate f3 2818583 0 2024-09-11T00:17:59.903 INFO:tasks.workunit.client.0.smithi078.stdout:3/589: mknod d0/d7/d46/d86/cac 0 2024-09-11T00:17:59.904 INFO:tasks.workunit.client.0.smithi078.stdout:3/590: fsync d0/d7/d23/d7c/f80 0 2024-09-11T00:17:59.905 INFO:tasks.workunit.client.0.smithi078.stdout:8/690: mkdir da/d87/d3a/dda 0 2024-09-11T00:17:59.905 INFO:tasks.workunit.client.0.smithi078.stdout:8/691: dread - da/d1c/fcc zero size 2024-09-11T00:17:59.905 INFO:tasks.workunit.client.0.smithi078.stdout:8/692: stat da/d1c/fcc 0 2024-09-11T00:17:59.905 INFO:tasks.workunit.client.0.smithi078.stdout:8/693: readlink da/d87/d3a/d4b/l6b 0 2024-09-11T00:17:59.905 INFO:tasks.workunit.client.0.smithi078.stdout:3/591: creat d0/d39/fad x:0 0 0 2024-09-11T00:17:59.906 INFO:tasks.workunit.client.0.smithi078.stdout:8/694: mkdir da/d87/d3a/d4b/ddb 0 2024-09-11T00:17:59.906 INFO:tasks.workunit.client.0.smithi078.stdout:3/592: rmdir d0/d39 39 2024-09-11T00:17:59.908 INFO:tasks.workunit.client.0.smithi078.stdout:8/695: symlink da/d13/d1b/d37/dd5/ldc 0 2024-09-11T00:17:59.908 INFO:tasks.workunit.client.0.smithi078.stdout:8/696: fdatasync da/d13/d1b/d37/f90 0 2024-09-11T00:17:59.909 INFO:tasks.workunit.client.0.smithi078.stdout:3/593: mknod d0/d7/d18/d1b/d34/d3e/cae 0 2024-09-11T00:17:59.911 INFO:tasks.workunit.client.0.smithi078.stdout:4/660: dread dc/d10/d40/d3a/d65/f92 [0,4194304] 0 2024-09-11T00:17:59.912 INFO:tasks.workunit.client.0.smithi078.stdout:4/661: symlink dc/d10/d40/d3a/d65/d7b/ldf 0 2024-09-11T00:17:59.914 INFO:tasks.workunit.client.0.smithi078.stdout:4/662: mknod dc/d10/d40/d3a/d65/d7b/d9e/d5d/ce0 0 2024-09-11T00:17:59.914 INFO:tasks.workunit.client.0.smithi078.stdout:4/663: fdatasync dc/d10/d40/d3a/d65/d7b/f96 0 2024-09-11T00:17:59.915 INFO:tasks.workunit.client.0.smithi078.stdout:4/664: creat dc/d10/d40/d33/fe1 x:0 0 0 2024-09-11T00:17:59.915 INFO:tasks.workunit.client.0.smithi078.stdout:4/665: stat dc/d10/d40/d3a/d4c/cce 0 2024-09-11T00:17:59.916 INFO:tasks.workunit.client.0.smithi078.stdout:8/697: dread da/d87/d3a/f40 [0,4194304] 0 2024-09-11T00:17:59.918 INFO:tasks.workunit.client.0.smithi078.stdout:3/594: read d0/d7/f4e [1063584,13130] 0 2024-09-11T00:17:59.919 INFO:tasks.workunit.client.0.smithi078.stdout:3/595: mkdir d0/d7/d18/d1b/d8e/daf 0 2024-09-11T00:17:59.919 INFO:tasks.workunit.client.0.smithi078.stdout:3/596: write d0/d7/d18/d1b/d34/f8f [806438,78581] 0 2024-09-11T00:17:59.919 INFO:tasks.workunit.client.0.smithi078.stdout:0/626: dwrite d2/d2a/d2c/d35/d93/fb2 [0,4194304] 0 2024-09-11T00:17:59.919 INFO:tasks.workunit.client.0.smithi078.stdout:0/627: fsync d2/d2a/fab 0 2024-09-11T00:17:59.919 INFO:tasks.workunit.client.0.smithi078.stdout:0/628: chown d2/d2a/d2c/d35/d59/d7/d96/db9 20225 1 2024-09-11T00:17:59.919 INFO:tasks.workunit.client.0.smithi078.stdout:3/597: symlink d0/d7/d23/d7c/da1/lb0 0 2024-09-11T00:17:59.932 INFO:tasks.workunit.client.0.smithi078.stdout:0/629: dread d2/d2a/d2c/d35/d59/d7/f13 [0,4194304] 0 2024-09-11T00:17:59.933 INFO:tasks.workunit.client.0.smithi078.stdout:0/630: creat d2/d2a/d2c/d35/d59/d4f/d61/d8f/fd0 x:0 0 0 2024-09-11T00:17:59.934 INFO:tasks.workunit.client.0.smithi078.stdout:0/631: read - d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/fb1 zero size 2024-09-11T00:17:59.934 INFO:tasks.workunit.client.0.smithi078.stdout:0/632: chown d2/d2a/d2c/d35/d59/f22 334550292 1 2024-09-11T00:17:59.934 INFO:tasks.workunit.client.0.smithi078.stdout:0/633: stat d2/d2a/d2c/d35/d59/d4f/d61/fcd 0 2024-09-11T00:17:59.934 INFO:tasks.workunit.client.0.smithi078.stdout:0/634: write d2/d2a/d2c/d35/d59/d4f/d61/d69/f67 [1352379,69149] 0 2024-09-11T00:17:59.934 INFO:tasks.workunit.client.0.smithi078.stdout:0/635: mknod d2/d2a/d2c/d35/daf/cd1 0 2024-09-11T00:17:59.935 INFO:tasks.workunit.client.0.smithi078.stdout:0/636: mkdir d2/d2a/d2c/d35/d59/d7/dd2 0 2024-09-11T00:17:59.936 INFO:tasks.workunit.client.0.smithi078.stdout:4/666: write dc/d10/d40/d3a/d4c/db4/fc4 [2282781,91390] 0 2024-09-11T00:17:59.937 INFO:tasks.workunit.client.0.smithi078.stdout:8/698: dwrite da/d13/d1b/f36 [0,4194304] 0 2024-09-11T00:17:59.937 INFO:tasks.workunit.client.0.smithi078.stdout:8/699: truncate da/d1c/d60/d85/d79/d99/f98 400294 0 2024-09-11T00:17:59.938 INFO:tasks.workunit.client.0.smithi078.stdout:5/495: sync 2024-09-11T00:17:59.938 INFO:tasks.workunit.client.0.smithi078.stdout:9/631: sync 2024-09-11T00:17:59.940 INFO:tasks.workunit.client.0.smithi078.stdout:8/700: mknod da/d87/d7b/da7/cdd 0 2024-09-11T00:17:59.941 INFO:tasks.workunit.client.0.smithi078.stdout:5/496: mkdir d7/d8/d33/d22/d25/d6a/db0 0 2024-09-11T00:17:59.941 INFO:tasks.workunit.client.0.smithi078.stdout:5/497: chown d7/d8/f77 198163677 1 2024-09-11T00:17:59.942 INFO:tasks.workunit.client.0.smithi078.stdout:9/632: symlink dc/d12/d46/ld8 0 2024-09-11T00:17:59.942 INFO:tasks.workunit.client.0.smithi078.stdout:9/633: dread - dc/fc4 zero size 2024-09-11T00:17:59.942 INFO:tasks.workunit.client.0.smithi078.stdout:9/634: write dc/f1c [574929,92491] 0 2024-09-11T00:17:59.942 INFO:tasks.workunit.client.0.smithi078.stdout:8/701: mknod da/d1c/d4c/dbc/cde 0 2024-09-11T00:17:59.944 INFO:tasks.workunit.client.0.smithi078.stdout:9/635: creat dc/d12/d46/d51/dcc/dce/fd9 x:0 0 0 2024-09-11T00:17:59.945 INFO:tasks.workunit.client.0.smithi078.stdout:8/702: mkdir da/d1c/d60/d85/d94/ddf 0 2024-09-11T00:17:59.945 INFO:tasks.workunit.client.0.smithi078.stdout:8/703: chown da/d87/fc9 1903119 1 2024-09-11T00:17:59.946 INFO:tasks.workunit.client.0.smithi078.stdout:9/636: unlink f4 0 2024-09-11T00:17:59.946 INFO:tasks.workunit.client.0.smithi078.stdout:9/637: chown dc/d12/d20/d30/l31 119956247 1 2024-09-11T00:17:59.947 INFO:tasks.workunit.client.0.smithi078.stdout:8/704: dread da/d13/d1b/d37/f5a [0,4194304] 0 2024-09-11T00:17:59.947 INFO:tasks.workunit.client.0.smithi078.stdout:8/705: chown da/d1c/d60/laa 0 1 2024-09-11T00:17:59.947 INFO:tasks.workunit.client.0.smithi078.stdout:8/706: stat da/d7a/dab 0 2024-09-11T00:17:59.948 INFO:tasks.workunit.client.0.smithi078.stdout:3/598: dwrite d0/d39/f4d [0,4194304] 0 2024-09-11T00:17:59.948 INFO:tasks.workunit.client.0.smithi078.stdout:3/599: dread - d0/d7/d18/f61 zero size 2024-09-11T00:17:59.948 INFO:tasks.workunit.client.0.smithi078.stdout:3/600: chown d0/d7/d18/d1b/d34/d60 12060 1 2024-09-11T00:17:59.948 INFO:tasks.workunit.client.0.smithi078.stdout:9/638: symlink dc/d12/lda 0 2024-09-11T00:17:59.949 INFO:tasks.workunit.client.0.smithi078.stdout:8/707: truncate da/d1c/d60/d85/d79/d99/d82/d63/da9/fc4 87892 0 2024-09-11T00:17:59.951 INFO:tasks.workunit.client.0.smithi078.stdout:3/601: rmdir d0/d39 39 2024-09-11T00:17:59.951 INFO:tasks.workunit.client.0.smithi078.stdout:3/602: truncate d0/d1a/f4f 4700684 0 2024-09-11T00:17:59.951 INFO:tasks.workunit.client.0.smithi078.stdout:4/667: dwrite dc/d10/d1f/d68/fc8 [0,4194304] 0 2024-09-11T00:17:59.951 INFO:tasks.workunit.client.0.smithi078.stdout:9/639: symlink dc/d12/d20/d50/dbc/ldb 0 2024-09-11T00:17:59.952 INFO:tasks.workunit.client.0.smithi078.stdout:8/708: truncate da/d1c/d60/d85/d79/d9e/fcf 3936639 0 2024-09-11T00:17:59.955 INFO:tasks.workunit.client.0.smithi078.stdout:4/668: rmdir dc/d10/d1f 39 2024-09-11T00:17:59.958 INFO:tasks.workunit.client.0.smithi078.stdout:8/709: link da/d13/d1b/d4e/cd4 da/d1c/d60/d85/d94/ddf/ce0 0 2024-09-11T00:17:59.960 INFO:tasks.workunit.client.0.smithi078.stdout:8/710: getdents da/d13/d1b/d24/d86/d91 0 2024-09-11T00:17:59.963 INFO:tasks.workunit.client.0.smithi078.stdout:3/603: dread d0/d7/d23/d91/f22 [0,4194304] 0 2024-09-11T00:17:59.963 INFO:tasks.workunit.client.0.smithi078.stdout:8/711: unlink da/d1c/d60/d85/d94/l9a 0 2024-09-11T00:17:59.964 INFO:tasks.workunit.client.0.smithi078.stdout:3/604: mknod d0/cb1 0 2024-09-11T00:17:59.965 INFO:tasks.workunit.client.0.smithi078.stdout:4/669: dread dc/f2d [0,4194304] 0 2024-09-11T00:17:59.966 INFO:tasks.workunit.client.0.smithi078.stdout:8/712: mkdir da/d87/d7b/de1 0 2024-09-11T00:17:59.967 INFO:tasks.workunit.client.0.smithi078.stdout:4/670: truncate dc/d10/d40/d3a/d46/d59/f5f 1772247 0 2024-09-11T00:17:59.967 INFO:tasks.workunit.client.0.smithi078.stdout:4/671: chown dc/d10/d40/d3a/cdc 3 1 2024-09-11T00:17:59.969 INFO:tasks.workunit.client.0.smithi078.stdout:9/640: dwrite dc/d12/d20/d30/f4b [0,4194304] 0 2024-09-11T00:17:59.969 INFO:tasks.workunit.client.0.smithi078.stdout:8/713: rename da/d13/d1b/f88 to da/d13/fe2 0 2024-09-11T00:17:59.970 INFO:tasks.workunit.client.0.smithi078.stdout:8/714: truncate da/d13/d1b/f2e 330068 0 2024-09-11T00:17:59.971 INFO:tasks.workunit.client.0.smithi078.stdout:8/715: symlink da/d13/d1b/d24/d86/d91/le3 0 2024-09-11T00:17:59.988 INFO:tasks.workunit.client.0.smithi078.stdout:9/641: dwrite dc/d12/d20/d58/d5a/f81 [0,4194304] 0 2024-09-11T00:17:59.991 INFO:tasks.workunit.client.0.smithi078.stdout:4/672: dwrite dc/d10/d40/d3a/fb1 [0,4194304] 0 2024-09-11T00:17:59.993 INFO:tasks.workunit.client.0.smithi078.stdout:4/673: mknod dc/d10/d40/d3a/d65/d7b/d9e/ce2 0 2024-09-11T00:17:59.993 INFO:tasks.workunit.client.0.smithi078.stdout:8/716: dwrite f6 [0,4194304] 0 2024-09-11T00:17:59.997 INFO:tasks.workunit.client.0.smithi078.stdout:8/717: mknod da/d1c/d60/ce4 0 2024-09-11T00:17:59.997 INFO:tasks.workunit.client.0.smithi078.stdout:8/718: write da/d13/d1b/f2e [1194139,104145] 0 2024-09-11T00:17:59.997 INFO:tasks.workunit.client.0.smithi078.stdout:4/674: dread dc/d10/d40/d3a/d65/f92 [0,4194304] 0 2024-09-11T00:17:59.998 INFO:tasks.workunit.client.0.smithi078.stdout:8/719: creat da/d13/d1b/d24/d86/d91/fe5 x:0 0 0 2024-09-11T00:17:59.998 INFO:tasks.workunit.client.0.smithi078.stdout:8/720: chown da/d87/d3a 3891274 1 2024-09-11T00:17:59.999 INFO:tasks.workunit.client.0.smithi078.stdout:4/675: dread dc/d10/d40/d3a/d65/f22 [0,4194304] 0 2024-09-11T00:17:59.999 INFO:tasks.workunit.client.0.smithi078.stdout:8/721: dread da/d1c/f78 [0,4194304] 0 2024-09-11T00:18:00.000 INFO:tasks.workunit.client.0.smithi078.stdout:4/676: creat dc/d10/d40/d3a/d46/d59/fe3 x:0 0 0 2024-09-11T00:18:00.010 INFO:tasks.workunit.client.0.smithi078.stdout:8/722: dread da/d1c/fa1 [0,4194304] 0 2024-09-11T00:18:00.011 INFO:tasks.workunit.client.0.smithi078.stdout:8/723: getdents da/d87/d3a/d4b 0 2024-09-11T00:18:00.012 INFO:tasks.workunit.client.0.smithi078.stdout:8/724: link da/l51 da/d1c/d60/d85/d79/d99/d82/d63/le6 0 2024-09-11T00:18:00.012 INFO:tasks.workunit.client.0.smithi078.stdout:8/725: chown da/d1c/d60/d85/c6a 48345 1 2024-09-11T00:18:00.017 INFO:tasks.workunit.client.0.smithi078.stdout:8/726: write da/d1c/d60/d85/d79/d99/d82/d63/f9c [116007,102890] 0 2024-09-11T00:18:00.017 INFO:tasks.workunit.client.0.smithi078.stdout:4/677: dwrite dc/d10/d3c/fb0 [0,4194304] 0 2024-09-11T00:18:00.017 INFO:tasks.workunit.client.0.smithi078.stdout:4/678: write dc/d10/d40/d33/fe1 [359166,17379] 0 2024-09-11T00:18:00.019 INFO:tasks.workunit.client.0.smithi078.stdout:4/679: rename dc/d10/d40/d3a/d65/d94/fcc to dc/d10/d40/d3a/d4c/db4/fe4 0 2024-09-11T00:18:00.023 INFO:tasks.workunit.client.0.smithi078.stdout:7/573: sync 2024-09-11T00:18:00.023 INFO:tasks.workunit.client.0.smithi078.stdout:2/593: sync 2024-09-11T00:18:00.025 INFO:tasks.workunit.client.0.smithi078.stdout:7/574: unlink d0/d34/db/d30/d1d/c6b 0 2024-09-11T00:18:00.025 INFO:tasks.workunit.client.0.smithi078.stdout:7/575: truncate d0/d34/db/d30/f75 72865 0 2024-09-11T00:18:00.028 INFO:tasks.workunit.client.0.smithi078.stdout:7/576: rename d0/d34/db/d30/d1d/d14/f9a to d0/d34/db/d30/d1d/d14/d62/faa 0 2024-09-11T00:18:00.029 INFO:tasks.workunit.client.0.smithi078.stdout:7/577: symlink d0/d34/db/d32/lab 0 2024-09-11T00:18:00.030 INFO:tasks.workunit.client.0.smithi078.stdout:7/578: rmdir d0/d34/db/d30/d1d/d14/d62 39 2024-09-11T00:18:00.030 INFO:tasks.workunit.client.0.smithi078.stdout:7/579: dread - d0/d34/db/d30/d1d/d81/f8f zero size 2024-09-11T00:18:00.034 INFO:tasks.workunit.client.0.smithi078.stdout:8/727: dwrite da/f30 [4194304,4194304] 0 2024-09-11T00:18:00.034 INFO:tasks.workunit.client.0.smithi078.stdout:8/728: chown da/d1c/d60/d85/d94/cc1 441370779 1 2024-09-11T00:18:00.034 INFO:tasks.workunit.client.0.smithi078.stdout:8/729: dread - da/d1c/d60/d85/d94/fc7 zero size 2024-09-11T00:18:00.035 INFO:tasks.workunit.client.0.smithi078.stdout:8/730: chown da/d1c/d60/fb4 0 1 2024-09-11T00:18:00.037 INFO:tasks.workunit.client.0.smithi078.stdout:8/731: creat da/fe7 x:0 0 0 2024-09-11T00:18:00.044 INFO:tasks.workunit.client.0.smithi078.stdout:2/594: dwrite d0/d1/d11/f69 [0,4194304] 0 2024-09-11T00:18:00.051 INFO:tasks.workunit.client.0.smithi078.stdout:8/732: link da/d13/f8c da/d1c/d60/d85/d79/d99/d82/d63/fe8 0 2024-09-11T00:18:00.051 INFO:tasks.workunit.client.0.smithi078.stdout:8/733: write da/d87/d7b/faf [470475,49612] 0 2024-09-11T00:18:00.051 INFO:tasks.workunit.client.0.smithi078.stdout:8/734: dread - da/d87/d3a/fb9 zero size 2024-09-11T00:18:00.052 INFO:tasks.workunit.client.0.smithi078.stdout:8/735: dread - da/d13/d1b/d24/d86/d91/fe5 zero size 2024-09-11T00:18:00.052 INFO:tasks.workunit.client.0.smithi078.stdout:4/680: dread dc/d10/d40/d3a/d4c/db4/d72/fc6 [0,4194304] 0 2024-09-11T00:18:00.052 INFO:tasks.workunit.client.0.smithi078.stdout:7/580: dwrite d0/d34/db/d30/d1d/f17 [0,4194304] 0 2024-09-11T00:18:00.052 INFO:tasks.workunit.client.0.smithi078.stdout:7/581: write d0/d34/db/d30/f3e [752177,34910] 0 2024-09-11T00:18:00.053 INFO:tasks.workunit.client.0.smithi078.stdout:8/736: mknod da/d1c/d60/d85/d94/ddf/ce9 0 2024-09-11T00:18:00.053 INFO:tasks.workunit.client.0.smithi078.stdout:4/681: mknod dc/d10/d1f/d68/db5/ce5 0 2024-09-11T00:18:00.055 INFO:tasks.workunit.client.0.smithi078.stdout:8/737: rename da/d87/d3a/fa3 to da/d13/d1b/fea 0 2024-09-11T00:18:00.055 INFO:tasks.workunit.client.0.smithi078.stdout:8/738: stat da/d87/d3a/d4b 0 2024-09-11T00:18:00.056 INFO:tasks.workunit.client.0.smithi078.stdout:4/682: creat dc/d10/d40/d3a/d65/d7b/d8b/dc5/fe6 x:0 0 0 2024-09-11T00:18:00.057 INFO:tasks.workunit.client.0.smithi078.stdout:4/683: read - dc/d10/d40/d3a/d65/d7b/d9e/d5d/f73 zero size 2024-09-11T00:18:00.057 INFO:tasks.workunit.client.0.smithi078.stdout:4/684: write dc/d10/d40/d3a/d65/d7b/f96 [457303,106580] 0 2024-09-11T00:18:00.057 INFO:tasks.workunit.client.0.smithi078.stdout:4/685: chown dc/d10/d40/d3a/d65/d7b/d9e/d5d 0 1 2024-09-11T00:18:00.057 INFO:tasks.workunit.client.0.smithi078.stdout:4/686: chown dc/d10/d40/d3a/d65/c36 842126 1 2024-09-11T00:18:00.057 INFO:tasks.workunit.client.0.smithi078.stdout:4/687: readlink dc/d10/l1c 0 2024-09-11T00:18:00.057 INFO:tasks.workunit.client.0.smithi078.stdout:8/739: creat da/d1c/d60/feb x:0 0 0 2024-09-11T00:18:00.057 INFO:tasks.workunit.client.0.smithi078.stdout:8/740: chown da/d1c/d60/d85/d79/d99/d82/d63/fc5 0 1 2024-09-11T00:18:00.057 INFO:tasks.workunit.client.0.smithi078.stdout:4/688: rename dc/d10/d1f/c85 to dc/d10/d40/d3a/ce7 0 2024-09-11T00:18:00.065 INFO:tasks.workunit.client.0.smithi078.stdout:2/595: dwrite d0/d1/d8/f47 [4194304,4194304] 0 2024-09-11T00:18:00.066 INFO:tasks.workunit.client.0.smithi078.stdout:2/596: getdents d0/d1/d3c 0 2024-09-11T00:18:00.068 INFO:tasks.workunit.client.0.smithi078.stdout:2/597: unlink d0/d1/d33/d5f/f6c 0 2024-09-11T00:18:00.068 INFO:tasks.workunit.client.0.smithi078.stdout:2/598: chown d0/d1/d11/d60/da2/l92 2 1 2024-09-11T00:18:00.068 INFO:tasks.workunit.client.0.smithi078.stdout:2/599: truncate d0/d1/d11/d60/da2/fb3 578133 0 2024-09-11T00:18:00.069 INFO:tasks.workunit.client.0.smithi078.stdout:2/600: symlink d0/d19/d3d/d8d/lcf 0 2024-09-11T00:18:00.069 INFO:tasks.workunit.client.0.smithi078.stdout:2/601: chown d0/d67/f7a 9825 1 2024-09-11T00:18:00.075 INFO:tasks.workunit.client.0.smithi078.stdout:8/741: write da/d13/d1b/fea [4035236,48111] 0 2024-09-11T00:18:00.077 INFO:tasks.workunit.client.0.smithi078.stdout:8/742: unlink da/d1c/d60/d85/d79/d9e/lb5 0 2024-09-11T00:18:00.077 INFO:tasks.workunit.client.0.smithi078.stdout:8/743: chown da/d13/d1b/d59/f57 80 1 2024-09-11T00:18:00.083 INFO:tasks.workunit.client.0.smithi078.stdout:7/582: dwrite d0/d34/db/d30/f3e [4194304,4194304] 0 2024-09-11T00:18:00.085 INFO:tasks.workunit.client.0.smithi078.stdout:8/744: dread da/d13/d1b/d37/f7e [0,4194304] 0 2024-09-11T00:18:00.085 INFO:tasks.workunit.client.0.smithi078.stdout:8/745: read da/d1c/fa1 [2417037,68995] 0 2024-09-11T00:18:00.085 INFO:tasks.workunit.client.0.smithi078.stdout:8/746: fdatasync da/fc 0 2024-09-11T00:18:00.085 INFO:tasks.workunit.client.0.smithi078.stdout:7/583: creat d0/d34/db/d30/d28/fac x:0 0 0 2024-09-11T00:18:00.085 INFO:tasks.workunit.client.0.smithi078.stdout:7/584: chown d0/d34/db/d30/d1d/d81/c97 24172028 1 2024-09-11T00:18:00.086 INFO:tasks.workunit.client.0.smithi078.stdout:8/747: rename da/c15 to da/d13/d1b/d24/d62/cec 0 2024-09-11T00:18:00.088 INFO:tasks.workunit.client.0.smithi078.stdout:8/748: creat da/d1c/fed x:0 0 0 2024-09-11T00:18:00.089 INFO:tasks.workunit.client.0.smithi078.stdout:8/749: creat da/d1c/d60/d85/d79/d99/fee x:0 0 0 2024-09-11T00:18:00.090 INFO:tasks.workunit.client.0.smithi078.stdout:7/585: write d0/d34/db/d32/f72 [561876,94742] 0 2024-09-11T00:18:00.097 INFO:tasks.workunit.client.0.smithi078.stdout:7/586: dread d0/d34/db/d30/f3e [4194304,4194304] 0 2024-09-11T00:18:00.097 INFO:tasks.workunit.client.0.smithi078.stdout:7/587: truncate d0/d34/db/f8e 4880677 0 2024-09-11T00:18:00.097 INFO:tasks.workunit.client.0.smithi078.stdout:7/588: write d0/d34/db/d30/d1d/f39 [2821543,96006] 0 2024-09-11T00:18:00.098 INFO:tasks.workunit.client.0.smithi078.stdout:2/602: dwrite d0/d1/d11/f44 [0,4194304] 0 2024-09-11T00:18:00.099 INFO:tasks.workunit.client.0.smithi078.stdout:2/603: write d0/d1/d11/d60/da2/d3a/fc7 [540669,101681] 0 2024-09-11T00:18:00.103 INFO:tasks.workunit.client.0.smithi078.stdout:2/604: getdents d0/d1/d11/d60/da2/d3a/d51 0 2024-09-11T00:18:00.106 INFO:tasks.workunit.client.0.smithi078.stdout:7/589: dread d0/d34/db/d30/d1d/d14/f4f [0,4194304] 0 2024-09-11T00:18:00.107 INFO:tasks.workunit.client.0.smithi078.stdout:7/590: dread d0/d34/db/d30/f75 [0,4194304] 0 2024-09-11T00:18:00.108 INFO:tasks.workunit.client.0.smithi078.stdout:8/750: dwrite da/d13/d1b/f4a [0,4194304] 0 2024-09-11T00:18:00.109 INFO:tasks.workunit.client.0.smithi078.stdout:7/591: link d0/d34/db/d30/d28/f67 d0/d34/db/da0/fad 0 2024-09-11T00:18:00.112 INFO:tasks.workunit.client.0.smithi078.stdout:8/751: creat da/d13/d19/dbe/fef x:0 0 0 2024-09-11T00:18:00.112 INFO:tasks.workunit.client.0.smithi078.stdout:8/752: getdents da/d1c/d60/d85/d79/d9e/dd8 0 2024-09-11T00:18:00.112 INFO:tasks.workunit.client.0.smithi078.stdout:8/753: truncate da/d1c/d60/d85/d79/d99/d82/d63/da9/fb2 4713700 0 2024-09-11T00:18:00.113 INFO:tasks.workunit.client.0.smithi078.stdout:7/592: link d0/d34/db/f5c d0/d34/db/d30/d1d/d14/d62/d93/fae 0 2024-09-11T00:18:00.113 INFO:tasks.workunit.client.0.smithi078.stdout:7/593: dread - d0/d3f/f9e zero size 2024-09-11T00:18:00.114 INFO:tasks.workunit.client.0.smithi078.stdout:8/754: creat da/d7a/ff0 x:0 0 0 2024-09-11T00:18:00.114 INFO:tasks.workunit.client.0.smithi078.stdout:8/755: write da/d1c/d60/d85/d79/d99/d82/d63/fe8 [616465,38645] 0 2024-09-11T00:18:00.115 INFO:tasks.workunit.client.0.smithi078.stdout:8/756: fsync da/d1c/d60/d85/d79/d99/d82/d63/fe8 0 2024-09-11T00:18:00.115 INFO:tasks.workunit.client.0.smithi078.stdout:7/594: mknod d0/d34/db/d30/d28/caf 0 2024-09-11T00:18:00.117 INFO:tasks.workunit.client.0.smithi078.stdout:8/757: mkdir da/d1c/d4c/dbc/df1 0 2024-09-11T00:18:00.119 INFO:tasks.workunit.client.0.smithi078.stdout:7/595: getdents d0/d34/db/d30/d1d/d14/d87 0 2024-09-11T00:18:00.119 INFO:tasks.workunit.client.0.smithi078.stdout:7/596: write d0/f50 [841479,95852] 0 2024-09-11T00:18:00.119 INFO:tasks.workunit.client.0.smithi078.stdout:7/597: stat d0/d34/db/d30/d1d/d14/d87/l8c 0 2024-09-11T00:18:00.122 INFO:tasks.workunit.client.0.smithi078.stdout:8/758: unlink da/d1c/cd7 0 2024-09-11T00:18:00.122 INFO:tasks.workunit.client.0.smithi078.stdout:2/605: truncate d0/d1/d8/f47 5346392 0 2024-09-11T00:18:00.124 INFO:tasks.workunit.client.0.smithi078.stdout:2/606: mkdir d0/d19/dd0 0 2024-09-11T00:18:00.126 INFO:tasks.workunit.client.0.smithi078.stdout:6/592: sync 2024-09-11T00:18:00.126 INFO:tasks.workunit.client.0.smithi078.stdout:1/794: sync 2024-09-11T00:18:00.126 INFO:tasks.workunit.client.0.smithi078.stdout:0/637: sync 2024-09-11T00:18:00.128 INFO:tasks.workunit.client.0.smithi078.stdout:0/638: symlink d2/d2a/d2c/d35/d59/dc7/ld3 0 2024-09-11T00:18:00.129 INFO:tasks.workunit.client.0.smithi078.stdout:0/639: creat d2/d57/fd4 x:0 0 0 2024-09-11T00:18:00.129 INFO:tasks.workunit.client.0.smithi078.stdout:0/640: chown d2/d2a/d2c/d35/d59/d4f/d61/d8f/fd0 154131668 1 2024-09-11T00:18:00.129 INFO:tasks.workunit.client.0.smithi078.stdout:0/641: stat d2/d2a/d2c/d35/d59/d4f/d61/d69/f31 0 2024-09-11T00:18:00.130 INFO:tasks.workunit.client.0.smithi078.stdout:8/759: write da/d87/d7b/f8f [622334,29712] 0 2024-09-11T00:18:00.131 INFO:tasks.workunit.client.0.smithi078.stdout:1/795: dread f2 [0,4194304] 0 2024-09-11T00:18:00.131 INFO:tasks.workunit.client.0.smithi078.stdout:2/607: write d0/d1/d8/f1d [4081358,42001] 0 2024-09-11T00:18:00.132 INFO:tasks.workunit.client.0.smithi078.stdout:2/608: chown d0/d1/d6/d52/da8 95832 1 2024-09-11T00:18:00.135 INFO:tasks.workunit.client.0.smithi078.stdout:0/642: rename d2/d2a/d2c/d35/d59/d7/f13 to d2/d2a/d2c/d35/d59/d7/fd5 0 2024-09-11T00:18:00.136 INFO:tasks.workunit.client.0.smithi078.stdout:1/796: symlink d3/d29/d5f/d39/d61/d96/daf/l100 0 2024-09-11T00:18:00.137 INFO:tasks.workunit.client.0.smithi078.stdout:0/643: rename d2/d2a/d2c/d35/d59/d4f/d61/d69/l28 to d2/d2a/d2c/d35/d59/d7/dd2/ld6 0 2024-09-11T00:18:00.140 INFO:tasks.workunit.client.0.smithi078.stdout:1/797: creat d3/f101 x:0 0 0 2024-09-11T00:18:00.140 INFO:tasks.workunit.client.0.smithi078.stdout:1/798: dread - d3/d1a/d21/d4a/d90/fbf zero size 2024-09-11T00:18:00.141 INFO:tasks.workunit.client.0.smithi078.stdout:1/799: symlink d3/d1a/d21/d4a/d90/dc7/dc9/l102 0 2024-09-11T00:18:00.142 INFO:tasks.workunit.client.0.smithi078.stdout:1/800: stat d3/d1a/d21/d88/la7 0 2024-09-11T00:18:00.142 INFO:tasks.workunit.client.0.smithi078.stdout:1/801: write d3/d29/d5f/d39/d61/f8b [4127133,5241] 0 2024-09-11T00:18:00.144 INFO:tasks.workunit.client.0.smithi078.stdout:6/593: dwrite d0/d1/d9/f4a [0,4194304] 0 2024-09-11T00:18:00.146 INFO:tasks.workunit.client.0.smithi078.stdout:6/594: mknod d0/d1/d9/d17/d5e/cc7 0 2024-09-11T00:18:00.148 INFO:tasks.workunit.client.0.smithi078.stdout:6/595: mknod d0/d1/d9/d17/d5e/cc8 0 2024-09-11T00:18:00.154 INFO:tasks.workunit.client.0.smithi078.stdout:2/609: dwrite d0/d1/d11/d60/da2/d38/f4b [0,4194304] 0 2024-09-11T00:18:00.154 INFO:tasks.workunit.client.0.smithi078.stdout:2/610: stat d0/d1/d11/d1b/d1e/l4c 0 2024-09-11T00:18:00.155 INFO:tasks.workunit.client.0.smithi078.stdout:2/611: chown d0/d1/d11/d60/fab 311130123 1 2024-09-11T00:18:00.155 INFO:tasks.workunit.client.0.smithi078.stdout:2/612: chown d0/d1/d11/d1b/c49 234094 1 2024-09-11T00:18:00.155 INFO:tasks.workunit.client.0.smithi078.stdout:2/613: truncate d0/d1/d33/d86/fc1 613469 0 2024-09-11T00:18:00.155 INFO:tasks.workunit.client.0.smithi078.stdout:8/760: dwrite da/d1c/d4c/dbc/f55 [0,4194304] 0 2024-09-11T00:18:00.156 INFO:tasks.workunit.client.0.smithi078.stdout:2/614: creat d0/d1/d11/fd1 x:0 0 0 2024-09-11T00:18:00.156 INFO:tasks.workunit.client.0.smithi078.stdout:2/615: fsync d0/d1/d8/f4f 0 2024-09-11T00:18:00.156 INFO:tasks.workunit.client.0.smithi078.stdout:2/616: dread - d0/d1/d11/d60/da2/d38/f64 zero size 2024-09-11T00:18:00.159 INFO:tasks.workunit.client.0.smithi078.stdout:2/617: mknod d0/d19/dd0/cd2 0 2024-09-11T00:18:00.159 INFO:tasks.workunit.client.0.smithi078.stdout:8/761: symlink da/d13/d1b/d37/lf2 0 2024-09-11T00:18:00.161 INFO:tasks.workunit.client.0.smithi078.stdout:2/618: creat d0/d1/d11/d60/da2/d3a/fd3 x:0 0 0 2024-09-11T00:18:00.161 INFO:tasks.workunit.client.0.smithi078.stdout:2/619: chown d0/l78 9513 1 2024-09-11T00:18:00.162 INFO:tasks.workunit.client.0.smithi078.stdout:8/762: rename da/d87/d3a/d4b/l6b to da/d1c/d4c/lf3 0 2024-09-11T00:18:00.163 INFO:tasks.workunit.client.0.smithi078.stdout:2/620: mkdir d0/d1/d6f/d93/dc3/dc4/dd4 0 2024-09-11T00:18:00.165 INFO:tasks.workunit.client.0.smithi078.stdout:8/763: truncate da/d1c/d60/f67 2625474 0 2024-09-11T00:18:00.165 INFO:tasks.workunit.client.0.smithi078.stdout:0/644: dwrite d2/d2a/d2c/d35/d59/d4f/d61/d69/f31 [0,4194304] 0 2024-09-11T00:18:00.165 INFO:tasks.workunit.client.0.smithi078.stdout:1/802: dwrite d3/d1a/d21/d4a/d90/fbd [0,4194304] 0 2024-09-11T00:18:00.167 INFO:tasks.workunit.client.0.smithi078.stdout:2/621: link d0/c25 d0/d1/d11/d60/da2/d3a/d51/d97/dac/cd5 0 2024-09-11T00:18:00.172 INFO:tasks.workunit.client.0.smithi078.stdout:2/622: mkdir d0/d1/d6f/dd6 0 2024-09-11T00:18:00.172 INFO:tasks.workunit.client.0.smithi078.stdout:6/596: dwrite d0/d1/d53/f88 [0,4194304] 0 2024-09-11T00:18:00.173 INFO:tasks.workunit.client.0.smithi078.stdout:2/623: dread d0/d1/d11/d60/da2/d38/f81 [0,4194304] 0 2024-09-11T00:18:00.173 INFO:tasks.workunit.client.0.smithi078.stdout:2/624: fdatasync d0/d1/d3b/f5c 0 2024-09-11T00:18:00.174 INFO:tasks.workunit.client.0.smithi078.stdout:1/803: dread d3/d1a/d21/fe0 [0,4194304] 0 2024-09-11T00:18:00.176 INFO:tasks.workunit.client.0.smithi078.stdout:2/625: mkdir d0/dd7 0 2024-09-11T00:18:00.177 INFO:tasks.workunit.client.0.smithi078.stdout:1/804: symlink d3/d1a/d21/dcf/l103 0 2024-09-11T00:18:00.178 INFO:tasks.workunit.client.0.smithi078.stdout:6/597: write d0/d1/d9/f4a [1313648,2628] 0 2024-09-11T00:18:00.184 INFO:tasks.workunit.client.0.smithi078.stdout:6/598: creat d0/d1/d9/fc9 x:0 0 0 2024-09-11T00:18:00.186 INFO:tasks.workunit.client.0.smithi078.stdout:6/599: symlink d0/d1/d9/d54/lca 0 2024-09-11T00:18:00.186 INFO:tasks.workunit.client.0.smithi078.stdout:6/600: chown d0/d1/d53/l7e 11383092 1 2024-09-11T00:18:00.188 INFO:tasks.workunit.client.0.smithi078.stdout:6/601: getdents d0/d1 0 2024-09-11T00:18:00.188 INFO:tasks.workunit.client.0.smithi078.stdout:6/602: fdatasync d0/d1/d9/d17/d5e/fb2 0 2024-09-11T00:18:00.190 INFO:tasks.workunit.client.0.smithi078.stdout:6/603: rename d0/f7a to d0/d1/d9/d59/d74/fcb 0 2024-09-11T00:18:00.195 INFO:tasks.workunit.client.0.smithi078.stdout:1/805: write d3/d29/d5f/f8 [5222930,8662] 0 2024-09-11T00:18:00.195 INFO:tasks.workunit.client.0.smithi078.stdout:2/626: dwrite d0/d1/d11/f71 [0,4194304] 0 2024-09-11T00:18:00.199 INFO:tasks.workunit.client.0.smithi078.stdout:1/806: rename d3/d1a/d21/d88/fa6 to d3/d1a/d21/d4a/d90/dc7/f104 0 2024-09-11T00:18:00.199 INFO:tasks.workunit.client.0.smithi078.stdout:1/807: fsync d3/d1a/d21/d4a/d90/dd7/fef 0 2024-09-11T00:18:00.200 INFO:tasks.workunit.client.0.smithi078.stdout:2/627: link d0/d1/d11/d60/da2/d3a/lc8 d0/d1/d11/d60/ld8 0 2024-09-11T00:18:00.200 INFO:tasks.workunit.client.0.smithi078.stdout:6/604: write d0/d1/f2f [186134,89561] 0 2024-09-11T00:18:00.201 INFO:tasks.workunit.client.0.smithi078.stdout:8/764: dwrite da/d1c/d4c/dbc/f55 [4194304,4194304] 0 2024-09-11T00:18:00.201 INFO:tasks.workunit.client.0.smithi078.stdout:8/765: fdatasync da/d1c/d60/d85/d79/d99/d82/d63/fcd 0 2024-09-11T00:18:00.201 INFO:tasks.workunit.client.0.smithi078.stdout:8/766: truncate da/d13/f8c 927100 0 2024-09-11T00:18:00.203 INFO:tasks.workunit.client.0.smithi078.stdout:1/808: mknod d3/d1a/d21/d4a/c105 0 2024-09-11T00:18:00.204 INFO:tasks.workunit.client.0.smithi078.stdout:8/767: mknod da/d1c/d60/d85/d79/d99/d82/d63/cf4 0 2024-09-11T00:18:00.214 INFO:tasks.workunit.client.0.smithi078.stdout:1/809: dread d3/d1a/d21/f8d [0,4194304] 0 2024-09-11T00:18:00.215 INFO:tasks.workunit.client.0.smithi078.stdout:1/810: mkdir d3/d106 0 2024-09-11T00:18:00.216 INFO:tasks.workunit.client.0.smithi078.stdout:2/628: dwrite d0/d1/d6/f48 [0,4194304] 0 2024-09-11T00:18:00.217 INFO:tasks.workunit.client.0.smithi078.stdout:2/629: chown d0/d1/d11/d1b/c34 30816 1 2024-09-11T00:18:00.217 INFO:tasks.workunit.client.0.smithi078.stdout:1/811: mknod d3/d29/d5f/c107 0 2024-09-11T00:18:00.219 INFO:tasks.workunit.client.0.smithi078.stdout:1/812: rmdir d3/d1a/d21/d4a/d90/dc7 39 2024-09-11T00:18:00.220 INFO:tasks.workunit.client.0.smithi078.stdout:1/813: dread d3/d1a/d21/d4a/f69 [0,4194304] 0 2024-09-11T00:18:00.223 INFO:tasks.workunit.client.0.smithi078.stdout:2/630: write d0/d1/d11/d1b/d1e/f2f [1587797,74730] 0 2024-09-11T00:18:00.224 INFO:tasks.workunit.client.0.smithi078.stdout:2/631: rmdir d0/d1/d3c/d40 39 2024-09-11T00:18:00.225 INFO:tasks.workunit.client.0.smithi078.stdout:2/632: rename d0/d1/d3b/f5c to d0/fd9 0 2024-09-11T00:18:00.226 INFO:tasks.workunit.client.0.smithi078.stdout:2/633: chown d0/d1/d3c/f45 227 1 2024-09-11T00:18:00.227 INFO:tasks.workunit.client.0.smithi078.stdout:8/768: dwrite f7 [4194304,4194304] 0 2024-09-11T00:18:00.230 INFO:tasks.workunit.client.0.smithi078.stdout:8/769: stat da/d1c/d4c/lf3 0 2024-09-11T00:18:00.231 INFO:tasks.workunit.client.0.smithi078.stdout:8/770: creat da/d1c/d4c/dbc/df1/ff5 x:0 0 0 2024-09-11T00:18:00.235 INFO:tasks.workunit.client.0.smithi078.stdout:1/814: dwrite d3/f71 [4194304,4194304] 0 2024-09-11T00:18:00.236 INFO:tasks.workunit.client.0.smithi078.stdout:1/815: mknod d3/d29/d5f/c108 0 2024-09-11T00:18:00.237 INFO:tasks.workunit.client.0.smithi078.stdout:1/816: mknod d3/d29/dc4/dd8/c109 0 2024-09-11T00:18:00.237 INFO:tasks.workunit.client.0.smithi078.stdout:5/498: sync 2024-09-11T00:18:00.237 INFO:tasks.workunit.client.0.smithi078.stdout:5/499: chown d7/d8/d56/f5d 0 1 2024-09-11T00:18:00.237 INFO:tasks.workunit.client.0.smithi078.stdout:1/817: mknod d3/d29/dc4/c10a 0 2024-09-11T00:18:00.250 INFO:tasks.workunit.client.0.smithi078.stdout:8/771: dwrite da/d13/d1b/d59/f57 [0,4194304] 0 2024-09-11T00:18:00.252 INFO:tasks.workunit.client.0.smithi078.stdout:8/772: creat da/d13/d1b/d37/dd5/ff6 x:0 0 0 2024-09-11T00:18:00.253 INFO:tasks.workunit.client.0.smithi078.stdout:1/818: dwrite d3/d1a/d21/d4a/d90/fbf [0,4194304] 0 2024-09-11T00:18:00.256 INFO:tasks.workunit.client.0.smithi078.stdout:1/819: creat d3/d1a/d21/d4a/d94/f10b x:0 0 0 2024-09-11T00:18:00.256 INFO:tasks.workunit.client.0.smithi078.stdout:1/820: write d3/d1a/d21/d88/fbe [766157,37665] 0 2024-09-11T00:18:00.259 INFO:tasks.workunit.client.0.smithi078.stdout:1/821: link d3/d1a/d21/d4a/d90/fbd d3/d29/f10c 0 2024-09-11T00:18:00.259 INFO:tasks.workunit.client.0.smithi078.stdout:8/773: dread da/d1c/fae [4194304,4194304] 0 2024-09-11T00:18:00.261 INFO:tasks.workunit.client.0.smithi078.stdout:1/822: rename d3/d1a/d21/d4a/la5 to d3/d1a/d21/d4a/dfa/l10d 0 2024-09-11T00:18:00.263 INFO:tasks.workunit.client.0.smithi078.stdout:1/823: symlink d3/d1a/d21/d4a/d90/l10e 0 2024-09-11T00:18:00.264 INFO:tasks.workunit.client.0.smithi078.stdout:1/824: creat d3/d1a/d21/d4a/d90/dc7/dc9/f10f x:0 0 0 2024-09-11T00:18:00.275 INFO:tasks.workunit.client.0.smithi078.stdout:1/825: dread d3/d1a/ff [4194304,4194304] 0 2024-09-11T00:18:00.277 INFO:tasks.workunit.client.0.smithi078.stdout:1/826: mkdir d3/d1a/d21/d4a/d90/d110 0 2024-09-11T00:18:00.277 INFO:tasks.workunit.client.0.smithi078.stdout:1/827: rmdir d3/d1a/d21 39 2024-09-11T00:18:00.277 INFO:tasks.workunit.client.0.smithi078.stdout:1/828: truncate d3/d29/d5f/f1f 8615639 0 2024-09-11T00:18:00.278 INFO:tasks.workunit.client.0.smithi078.stdout:1/829: getdents d3/d29/d5f 0 2024-09-11T00:18:00.278 INFO:tasks.workunit.client.0.smithi078.stdout:1/830: rmdir d3/d29/d5f/d39 39 2024-09-11T00:18:00.279 INFO:tasks.workunit.client.0.smithi078.stdout:8/774: dwrite da/d13/d1b/f36 [0,4194304] 0 2024-09-11T00:18:00.293 INFO:tasks.workunit.client.0.smithi078.stdout:1/831: dread d3/d29/d5f/d39/f63 [0,4194304] 0 2024-09-11T00:18:00.297 INFO:tasks.workunit.client.0.smithi078.stdout:8/775: dread da/d13/f31 [0,4194304] 0 2024-09-11T00:18:00.298 INFO:tasks.workunit.client.0.smithi078.stdout:8/776: creat da/d13/ff7 x:0 0 0 2024-09-11T00:18:00.313 INFO:tasks.workunit.client.0.smithi078.stdout:1/832: dwrite d3/d1a/d21/d4a/d94/f10b [0,4194304] 0 2024-09-11T00:18:00.313 INFO:tasks.workunit.client.0.smithi078.stdout:1/833: fdatasync d3/d29/d5f/d39/f51 0 2024-09-11T00:18:00.314 INFO:tasks.workunit.client.0.smithi078.stdout:1/834: write d3/d1a/d21/d4a/d90/fdc [476760,83315] 0 2024-09-11T00:18:00.316 INFO:tasks.workunit.client.0.smithi078.stdout:1/835: read d3/d29/d45/f60 [662463,38303] 0 2024-09-11T00:18:00.317 INFO:tasks.workunit.client.0.smithi078.stdout:1/836: mknod d3/d106/c111 0 2024-09-11T00:18:00.318 INFO:tasks.workunit.client.0.smithi078.stdout:1/837: unlink d3/d29/d5f/c6e 0 2024-09-11T00:18:00.319 INFO:tasks.workunit.client.0.smithi078.stdout:1/838: stat d3/d29/d5f/d39/d61/f8b 0 2024-09-11T00:18:00.319 INFO:tasks.workunit.client.0.smithi078.stdout:1/839: creat d3/d29/f112 x:0 0 0 2024-09-11T00:18:00.319 INFO:tasks.workunit.client.0.smithi078.stdout:8/777: dwrite da/d1c/d60/d85/d79/d99/d82/d63/da9/fb2 [0,4194304] 0 2024-09-11T00:18:00.320 INFO:tasks.workunit.client.0.smithi078.stdout:1/840: unlink d3/d29/f7e 0 2024-09-11T00:18:00.321 INFO:tasks.workunit.client.0.smithi078.stdout:8/778: dread da/d1c/d60/d85/d79/d99/d82/d63/da9/fc4 [0,4194304] 0 2024-09-11T00:18:00.321 INFO:tasks.workunit.client.0.smithi078.stdout:1/841: link d3/d1a/d21/d88/f91 d3/d29/d5f/d39/d61/f113 0 2024-09-11T00:18:00.322 INFO:tasks.workunit.client.0.smithi078.stdout:8/779: creat da/d13/d1b/d24/ff8 x:0 0 0 2024-09-11T00:18:00.323 INFO:tasks.workunit.client.0.smithi078.stdout:1/842: mknod d3/d1a/d21/dcf/c114 0 2024-09-11T00:18:00.324 INFO:tasks.workunit.client.0.smithi078.stdout:1/843: creat d3/f115 x:0 0 0 2024-09-11T00:18:00.324 INFO:tasks.workunit.client.0.smithi078.stdout:1/844: write d3/d29/f50 [2369071,40147] 0 2024-09-11T00:18:00.324 INFO:tasks.workunit.client.0.smithi078.stdout:1/845: creat d3/f116 x:0 0 0 2024-09-11T00:18:00.324 INFO:tasks.workunit.client.0.smithi078.stdout:1/846: fsync d3/d29/d5f/d39/d61/d96/fe7 0 2024-09-11T00:18:00.325 INFO:tasks.workunit.client.0.smithi078.stdout:1/847: truncate d3/d1a/d21/dcf/fd6 5078321 0 2024-09-11T00:18:00.327 INFO:tasks.workunit.client.0.smithi078.stdout:1/848: unlink d3/d29/d5f/d39/d61/d96/daf/fc5 0 2024-09-11T00:18:00.328 INFO:tasks.workunit.client.0.smithi078.stdout:1/849: creat d3/d29/d5f/d4e/f117 x:0 0 0 2024-09-11T00:18:00.332 INFO:tasks.workunit.client.0.smithi078.stdout:1/850: dread d3/d1a/f2d [0,4194304] 0 2024-09-11T00:18:00.332 INFO:tasks.workunit.client.0.smithi078.stdout:1/851: fdatasync d3/f71 0 2024-09-11T00:18:00.338 INFO:tasks.workunit.client.0.smithi078.stdout:8/780: dwrite da/d13/d1b/d24/d62/f69 [0,4194304] 0 2024-09-11T00:18:00.338 INFO:tasks.workunit.client.0.smithi078.stdout:8/781: truncate da/d87/d7b/faf 1493053 0 2024-09-11T00:18:00.340 INFO:tasks.workunit.client.0.smithi078.stdout:8/782: symlink da/d13/d1b/d24/d86/lf9 0 2024-09-11T00:18:00.341 INFO:tasks.workunit.client.0.smithi078.stdout:1/852: write d3/d1a/d21/d4a/d94/fa2 [2433468,123581] 0 2024-09-11T00:18:00.341 INFO:tasks.workunit.client.0.smithi078.stdout:8/783: rename da/d7a/dab to da/d1c/d60/dfa 0 2024-09-11T00:18:00.344 INFO:tasks.workunit.client.0.smithi078.stdout:8/784: creat da/d13/d1b/d59/ffb x:0 0 0 2024-09-11T00:18:00.347 INFO:tasks.workunit.client.0.smithi078.stdout:8/785: rename da/f2f to da/d13/d1b/d24/d62/ffc 0 2024-09-11T00:18:00.352 INFO:tasks.workunit.client.0.smithi078.stdout:1/853: dwrite d3/d1a/d21/d4a/d90/dc7/dc9/f10f [0,4194304] 0 2024-09-11T00:18:00.354 INFO:tasks.workunit.client.0.smithi078.stdout:1/854: creat d3/d1a/d21/d4a/d94/f118 x:0 0 0 2024-09-11T00:18:00.354 INFO:tasks.workunit.client.0.smithi078.stdout:1/855: truncate d3/d1a/d21/d4a/d90/dc7/fdd 515786 0 2024-09-11T00:18:00.354 INFO:tasks.workunit.client.0.smithi078.stdout:1/856: write d3/d29/f2e [5093404,80436] 0 2024-09-11T00:18:00.354 INFO:tasks.workunit.client.0.smithi078.stdout:1/857: chown d3/d29/d45/f77 4490419 1 2024-09-11T00:18:00.365 INFO:tasks.workunit.client.0.smithi078.stdout:8/786: dread da/d13/f2c [0,4194304] 0 2024-09-11T00:18:00.366 INFO:tasks.workunit.client.0.smithi078.stdout:8/787: creat da/d13/d1b/d24/d86/d91/ffd x:0 0 0 2024-09-11T00:18:00.367 INFO:tasks.workunit.client.0.smithi078.stdout:8/788: unlink da/d87/d7b/faf 0 2024-09-11T00:18:00.368 INFO:tasks.workunit.client.0.smithi078.stdout:8/789: creat da/d13/d1b/d37/dd5/ffe x:0 0 0 2024-09-11T00:18:00.369 INFO:tasks.workunit.client.0.smithi078.stdout:8/790: mkdir da/d13/d1b/d24/d86/dff 0 2024-09-11T00:18:00.369 INFO:tasks.workunit.client.0.smithi078.stdout:8/791: stat da/d13/d1b/d59/lb1 0 2024-09-11T00:18:00.369 INFO:tasks.workunit.client.0.smithi078.stdout:8/792: truncate da/d1c/d60/fb4 1019505 0 2024-09-11T00:18:00.369 INFO:tasks.workunit.client.0.smithi078.stdout:8/793: write da/d13/d1b/d59/f97 [488565,62363] 0 2024-09-11T00:18:00.369 INFO:tasks.workunit.client.0.smithi078.stdout:8/794: chown da/d13/d1b/d59/lb1 759 1 2024-09-11T00:18:00.372 INFO:tasks.workunit.client.0.smithi078.stdout:1/858: dwrite d3/d1a/d21/d4a/d90/dc7/f104 [0,4194304] 0 2024-09-11T00:18:00.374 INFO:tasks.workunit.client.0.smithi078.stdout:8/795: read da/fc [187365,115938] 0 2024-09-11T00:18:00.376 INFO:tasks.workunit.client.0.smithi078.stdout:1/859: mkdir d3/d29/dc4/d119 0 2024-09-11T00:18:00.377 INFO:tasks.workunit.client.0.smithi078.stdout:8/796: rmdir da/d87/d3a/d4b/ddb 0 2024-09-11T00:18:00.377 INFO:tasks.workunit.client.0.smithi078.stdout:8/797: chown da/d87/d7b/da7/cc2 32690730 1 2024-09-11T00:18:00.378 INFO:tasks.workunit.client.0.smithi078.stdout:1/860: creat d3/d29/d5f/d39/d61/f11a x:0 0 0 2024-09-11T00:18:00.378 INFO:tasks.workunit.client.0.smithi078.stdout:1/861: chown d3/d1a/d21/d4a/d90/dc7/dc9 661108583 1 2024-09-11T00:18:00.378 INFO:tasks.workunit.client.0.smithi078.stdout:1/862: read d3/d29/d5f/d39/d61/d96/fda [226394,111577] 0 2024-09-11T00:18:00.379 INFO:tasks.workunit.client.0.smithi078.stdout:1/863: creat d3/d1a/d21/d4a/d90/d110/f11b x:0 0 0 2024-09-11T00:18:00.383 INFO:tasks.workunit.client.0.smithi078.stdout:9/642: sync 2024-09-11T00:18:00.383 INFO:tasks.workunit.client.0.smithi078.stdout:3/605: sync 2024-09-11T00:18:00.383 INFO:tasks.workunit.client.0.smithi078.stdout:3/606: fdatasync d0/d1a/f4f 0 2024-09-11T00:18:00.384 INFO:tasks.workunit.client.0.smithi078.stdout:9/643: creat dc/d12/d46/d51/fdc x:0 0 0 2024-09-11T00:18:00.384 INFO:tasks.workunit.client.0.smithi078.stdout:8/798: write da/d1c/d4c/fa4 [3843251,95294] 0 2024-09-11T00:18:00.384 INFO:tasks.workunit.client.0.smithi078.stdout:3/607: symlink d0/d7/d18/d1b/d34/lb2 0 2024-09-11T00:18:00.385 INFO:tasks.workunit.client.0.smithi078.stdout:9/644: rename dc/d12/d20/d58/d5b/l8a to dc/d12/d20/d58/d5b/dbb/ldd 0 2024-09-11T00:18:00.386 INFO:tasks.workunit.client.0.smithi078.stdout:8/799: creat da/d13/f100 x:0 0 0 2024-09-11T00:18:00.386 INFO:tasks.workunit.client.0.smithi078.stdout:8/800: getdents da/d87/d3a/dda 0 2024-09-11T00:18:00.387 INFO:tasks.workunit.client.0.smithi078.stdout:3/608: truncate d0/d7/d18/d1b/d34/d60/d6d/f30 1029756 0 2024-09-11T00:18:00.387 INFO:tasks.workunit.client.0.smithi078.stdout:3/609: fsync d0/f1f 0 2024-09-11T00:18:00.387 INFO:tasks.workunit.client.0.smithi078.stdout:9/645: mknod dc/d12/d20/d58/d5a/dc9/cde 0 2024-09-11T00:18:00.388 INFO:tasks.workunit.client.0.smithi078.stdout:3/610: creat d0/d7/d18/d70/fb3 x:0 0 0 2024-09-11T00:18:00.388 INFO:tasks.workunit.client.0.smithi078.stdout:3/611: stat d0/d7/d18/d1b/d34/f8f 0 2024-09-11T00:18:00.389 INFO:tasks.workunit.client.0.smithi078.stdout:9/646: chown dc/d12/d20/d30/lae 1598026791 1 2024-09-11T00:18:00.389 INFO:tasks.workunit.client.0.smithi078.stdout:9/647: dread - dc/d12/d20/d58/f71 zero size 2024-09-11T00:18:00.390 INFO:tasks.workunit.client.0.smithi078.stdout:9/648: link dc/c55 dc/d12/d46/d51/cdf 0 2024-09-11T00:18:00.390 INFO:tasks.workunit.client.0.smithi078.stdout:9/649: dread - dc/d12/d54/db4/f93 zero size 2024-09-11T00:18:00.394 INFO:tasks.workunit.client.0.smithi078.stdout:9/650: unlink f7 0 2024-09-11T00:18:00.396 INFO:tasks.workunit.client.0.smithi078.stdout:8/801: dread f2 [0,4194304] 0 2024-09-11T00:18:00.396 INFO:tasks.workunit.client.0.smithi078.stdout:9/651: mknod dc/d12/d20/ce0 0 2024-09-11T00:18:00.397 INFO:tasks.workunit.client.0.smithi078.stdout:9/652: chown dc/d12/d54/l77 173 1 2024-09-11T00:18:00.398 INFO:tasks.workunit.client.0.smithi078.stdout:8/802: getdents da/d87/d3a/d4b 0 2024-09-11T00:18:00.402 INFO:tasks.workunit.client.0.smithi078.stdout:9/653: rename dc/d12/d20/d85 to dc/d12/d20/d50/dbc/dcf/de1 0 2024-09-11T00:18:00.403 INFO:tasks.workunit.client.0.smithi078.stdout:1/864: dwrite d3/d29/d5f/f1f [0,4194304] 0 2024-09-11T00:18:00.404 INFO:tasks.workunit.client.0.smithi078.stdout:8/803: symlink da/d87/l101 0 2024-09-11T00:18:00.404 INFO:tasks.workunit.client.0.smithi078.stdout:3/612: dwrite d0/d7/f8b [0,4194304] 0 2024-09-11T00:18:00.406 INFO:tasks.workunit.client.0.smithi078.stdout:9/654: creat dc/d12/d46/fe2 x:0 0 0 2024-09-11T00:18:00.406 INFO:tasks.workunit.client.0.smithi078.stdout:8/804: creat da/d1c/d60/d85/d79/d99/d82/d63/da9/f102 x:0 0 0 2024-09-11T00:18:00.407 INFO:tasks.workunit.client.0.smithi078.stdout:3/613: chown d0/d7/d46/f5b 11619333 1 2024-09-11T00:18:00.411 INFO:tasks.workunit.client.0.smithi078.stdout:3/614: truncate d0/f65 3306880 0 2024-09-11T00:18:00.412 INFO:tasks.workunit.client.0.smithi078.stdout:3/615: link d0/d7/d23/d91/c21 d0/d7/d18/d1b/d8e/daf/cb4 0 2024-09-11T00:18:00.413 INFO:tasks.workunit.client.0.smithi078.stdout:1/865: write d3/d1a/d21/f24 [702405,3260] 0 2024-09-11T00:18:00.413 INFO:tasks.workunit.client.0.smithi078.stdout:1/866: truncate d3/d29/d5f/d4e/ff6 1001559 0 2024-09-11T00:18:00.414 INFO:tasks.workunit.client.0.smithi078.stdout:3/616: mknod d0/d7/d23/d7c/cb5 0 2024-09-11T00:18:00.419 INFO:tasks.workunit.client.0.smithi078.stdout:3/617: rename d0/d7/d18/d1b/d34/d3e/c67 to d0/d7/d18/cb6 0 2024-09-11T00:18:00.420 INFO:tasks.workunit.client.0.smithi078.stdout:3/618: mkdir d0/d7/d23/d7c/db7 0 2024-09-11T00:18:00.421 INFO:tasks.workunit.client.0.smithi078.stdout:3/619: readlink d0/d7/d18/d1b/d8e/l9e 0 2024-09-11T00:18:00.432 INFO:tasks.workunit.client.0.smithi078.stdout:9/655: dwrite dc/d12/d20/d50/dbc/dcf/de1/d3e/fab [0,4194304] 0 2024-09-11T00:18:00.433 INFO:tasks.workunit.client.0.smithi078.stdout:8/805: dwrite da/d1c/d60/d85/d79/d99/d82/d63/da9/f102 [0,4194304] 0 2024-09-11T00:18:00.435 INFO:tasks.workunit.client.0.smithi078.stdout:9/656: mknod dc/d12/d46/d51/dcc/ce3 0 2024-09-11T00:18:00.437 INFO:tasks.workunit.client.0.smithi078.stdout:8/806: mknod da/d87/d3a/d4b/c103 0 2024-09-11T00:18:00.439 INFO:tasks.workunit.client.0.smithi078.stdout:9/657: rename dc/d12/d20/d58/d5b/d68/c7d to dc/d12/d20/d58/d5a/dc9/ce4 0 2024-09-11T00:18:00.440 INFO:tasks.workunit.client.0.smithi078.stdout:1/867: dwrite d3/d29/d5f/d39/d61/f79 [4194304,4194304] 0 2024-09-11T00:18:00.440 INFO:tasks.workunit.client.0.smithi078.stdout:1/868: write d3/d1a/d21/d4a/d90/dc7/dc9/fce [751231,119006] 0 2024-09-11T00:18:00.440 INFO:tasks.workunit.client.0.smithi078.stdout:9/658: rename dc/d12/d20/d50/lbf to dc/d12/d20/d58/d5a/dc9/le5 0 2024-09-11T00:18:00.440 INFO:tasks.workunit.client.0.smithi078.stdout:3/620: dwrite d0/d7/d18/d1b/d34/f84 [0,4194304] 0 2024-09-11T00:18:00.443 INFO:tasks.workunit.client.0.smithi078.stdout:1/869: unlink d3/d29/d5f/d39/d61/f11a 0 2024-09-11T00:18:00.444 INFO:tasks.workunit.client.0.smithi078.stdout:9/659: creat dc/fe6 x:0 0 0 2024-09-11T00:18:00.444 INFO:tasks.workunit.client.0.smithi078.stdout:9/660: getdents dc/d12/d46/dd6 0 2024-09-11T00:18:00.453 INFO:tasks.workunit.client.0.smithi078.stdout:1/870: symlink d3/d1a/d21/d4a/d90/dc7/dc9/l11c 0 2024-09-11T00:18:00.453 INFO:tasks.workunit.client.0.smithi078.stdout:1/871: write d3/d29/d5f/d39/d61/f8b [1545968,129210] 0 2024-09-11T00:18:00.453 INFO:tasks.workunit.client.0.smithi078.stdout:9/661: truncate dc/d12/d54/faa 684978 0 2024-09-11T00:18:00.453 INFO:tasks.workunit.client.0.smithi078.stdout:1/872: creat d3/d29/f11d x:0 0 0 2024-09-11T00:18:00.454 INFO:tasks.workunit.client.0.smithi078.stdout:9/662: getdents dc/d12 0 2024-09-11T00:18:00.455 INFO:tasks.workunit.client.0.smithi078.stdout:4/689: sync 2024-09-11T00:18:00.455 INFO:tasks.workunit.client.0.smithi078.stdout:0/645: sync 2024-09-11T00:18:00.455 INFO:tasks.workunit.client.0.smithi078.stdout:7/598: sync 2024-09-11T00:18:00.455 INFO:tasks.workunit.client.0.smithi078.stdout:4/690: chown dc/d10/d40/d3a/d46/d47/fa0 5842517 1 2024-09-11T00:18:00.455 INFO:tasks.workunit.client.0.smithi078.stdout:0/646: write d2/d2a/d2c/d35/d59/d4f/d61/d69/f1a [4483595,96562] 0 2024-09-11T00:18:00.455 INFO:tasks.workunit.client.0.smithi078.stdout:0/647: read - d2/d2a/d2c/d35/f79 zero size 2024-09-11T00:18:00.456 INFO:tasks.workunit.client.0.smithi078.stdout:1/873: rmdir d3/d1a/d21/d4a 39 2024-09-11T00:18:00.456 INFO:tasks.workunit.client.0.smithi078.stdout:8/807: dwrite da/d13/d1b/d37/dd5/ffe [0,4194304] 0 2024-09-11T00:18:00.456 INFO:tasks.workunit.client.0.smithi078.stdout:9/663: mkdir dc/d12/d54/de7 0 2024-09-11T00:18:00.457 INFO:tasks.workunit.client.0.smithi078.stdout:1/874: rmdir d3/d1a/d21/d88 39 2024-09-11T00:18:00.460 INFO:tasks.workunit.client.0.smithi078.stdout:8/808: link da/d13/d1b/f3c da/d13/d1b/d37/f104 0 2024-09-11T00:18:00.461 INFO:tasks.workunit.client.0.smithi078.stdout:1/875: dread d3/d29/f50 [0,4194304] 0 2024-09-11T00:18:00.461 INFO:tasks.workunit.client.0.smithi078.stdout:1/876: rename d3/d29 to d3/d29/d5f/d39/d61/d11e 22 2024-09-11T00:18:00.461 INFO:tasks.workunit.client.0.smithi078.stdout:9/664: creat dc/d12/d20/d58/d5b/d68/fe8 x:0 0 0 2024-09-11T00:18:00.464 INFO:tasks.workunit.client.0.smithi078.stdout:9/665: rename dc/d12/d20/fb5 to dc/d12/d20/d58/fe9 0 2024-09-11T00:18:00.465 INFO:tasks.workunit.client.0.smithi078.stdout:1/877: mknod d3/d1a/c11f 0 2024-09-11T00:18:00.467 INFO:tasks.workunit.client.0.smithi078.stdout:1/878: rename d3/f115 to d3/d1a/d21/d4a/d90/f120 0 2024-09-11T00:18:00.467 INFO:tasks.workunit.client.0.smithi078.stdout:6/605: sync 2024-09-11T00:18:00.467 INFO:tasks.workunit.client.0.smithi078.stdout:5/500: sync 2024-09-11T00:18:00.468 INFO:tasks.workunit.client.0.smithi078.stdout:2/634: sync 2024-09-11T00:18:00.469 INFO:tasks.workunit.client.0.smithi078.stdout:6/606: mkdir d0/d1/d53/d72/dcc 0 2024-09-11T00:18:00.471 INFO:tasks.workunit.client.0.smithi078.stdout:6/607: getdents d0/d1/d9/d17 0 2024-09-11T00:18:00.473 INFO:tasks.workunit.client.0.smithi078.stdout:4/691: dread dc/d10/d1f/d68/db5/fb7 [0,4194304] 0 2024-09-11T00:18:00.473 INFO:tasks.workunit.client.0.smithi078.stdout:4/692: write dc/d10/d1f/fc9 [668989,27463] 0 2024-09-11T00:18:00.474 INFO:tasks.workunit.client.0.smithi078.stdout:6/608: creat d0/d1/d9/d17/fcd x:0 0 0 2024-09-11T00:18:00.474 INFO:tasks.workunit.client.0.smithi078.stdout:6/609: dread - d0/fc5 zero size 2024-09-11T00:18:00.474 INFO:tasks.workunit.client.0.smithi078.stdout:6/610: read - d0/d1/f98 zero size 2024-09-11T00:18:00.483 INFO:tasks.workunit.client.0.smithi078.stdout:1/879: fdatasync d3/d29/d5f/d39/d61/f8b 0 2024-09-11T00:18:00.483 INFO:tasks.workunit.client.0.smithi078.stdout:1/880: fsync d3/d1a/d21/d4a/d94/faa 0 2024-09-11T00:18:00.484 INFO:tasks.workunit.client.0.smithi078.stdout:1/881: readlink d3/dc6/lc3 0 2024-09-11T00:18:00.485 INFO:tasks.workunit.client.0.smithi078.stdout:7/599: dwrite d0/d34/db/d30/d1d/f8a [4194304,4194304] 0 2024-09-11T00:18:00.485 INFO:tasks.workunit.client.0.smithi078.stdout:7/600: chown d0/d34/db/d30/d1d/d14/d62/l6e 43470 1 2024-09-11T00:18:00.487 INFO:tasks.workunit.client.0.smithi078.stdout:1/882: getdents d3/d1a/d21/d4a/d90/dc7 0 2024-09-11T00:18:00.487 INFO:tasks.workunit.client.0.smithi078.stdout:5/501: dread d7/d8/d33/d22/d25/d28/d24/d1c/f2e [0,4194304] 0 2024-09-11T00:18:00.488 INFO:tasks.workunit.client.0.smithi078.stdout:5/502: stat d7/d8/d33/d22/d25/d28/d24/c98 0 2024-09-11T00:18:00.489 INFO:tasks.workunit.client.0.smithi078.stdout:0/648: dwrite d2/f8d [0,4194304] 0 2024-09-11T00:18:00.490 INFO:tasks.workunit.client.0.smithi078.stdout:8/809: dwrite f2 [0,4194304] 0 2024-09-11T00:18:00.491 INFO:tasks.workunit.client.0.smithi078.stdout:8/810: read - da/d1c/d60/d85/d94/fc7 zero size 2024-09-11T00:18:00.491 INFO:tasks.workunit.client.0.smithi078.stdout:8/811: fdatasync da/d1c/d60/feb 0 2024-09-11T00:18:00.492 INFO:tasks.workunit.client.0.smithi078.stdout:0/649: symlink d2/d2a/d2c/d35/d71/ld7 0 2024-09-11T00:18:00.493 INFO:tasks.workunit.client.0.smithi078.stdout:0/650: mknod d2/d2a/d2c/d5e/cd8 0 2024-09-11T00:18:00.496 INFO:tasks.workunit.client.0.smithi078.stdout:9/666: dwrite dc/fba [0,4194304] 0 2024-09-11T00:18:00.499 INFO:tasks.workunit.client.0.smithi078.stdout:4/693: dwrite dc/d10/d40/d3a/d4c/fcb [0,4194304] 0 2024-09-11T00:18:00.501 INFO:tasks.workunit.client.0.smithi078.stdout:9/667: rename dc/d12/d54/l97 to dc/d12/d20/d58/lea 0 2024-09-11T00:18:00.501 INFO:tasks.workunit.client.0.smithi078.stdout:6/611: write d0/d1/f96 [4049519,67123] 0 2024-09-11T00:18:00.504 INFO:tasks.workunit.client.0.smithi078.stdout:2/635: dwrite d0/d1/d11/d1b/d1e/f2f [0,4194304] 0 2024-09-11T00:18:00.504 INFO:tasks.workunit.client.0.smithi078.stdout:2/636: chown d0/d1/d33/d86 423339 1 2024-09-11T00:18:00.507 INFO:tasks.workunit.client.0.smithi078.stdout:4/694: rename dc/d10/d40/d3a/d46/c4b to dc/d10/d1f/ce8 0 2024-09-11T00:18:00.508 INFO:tasks.workunit.client.0.smithi078.stdout:4/695: truncate dc/d10/d40/d3a/d65/f63 2045135 0 2024-09-11T00:18:00.510 INFO:tasks.workunit.client.0.smithi078.stdout:4/696: unlink dc/d10/d40/d3a/d46/d59/fcf 0 2024-09-11T00:18:00.510 INFO:tasks.workunit.client.0.smithi078.stdout:4/697: write dc/d10/d40/d3a/fc0 [727458,75218] 0 2024-09-11T00:18:00.510 INFO:tasks.workunit.client.0.smithi078.stdout:4/698: chown dc/d10/d40/d3a/ce7 1510 1 2024-09-11T00:18:00.512 INFO:tasks.workunit.client.0.smithi078.stdout:4/699: mkdir dc/d10/d40/d3a/d65/d94/de9 0 2024-09-11T00:18:00.513 INFO:tasks.workunit.client.0.smithi078.stdout:4/700: creat dc/d54/dd0/fea x:0 0 0 2024-09-11T00:18:00.515 INFO:tasks.workunit.client.0.smithi078.stdout:4/701: rename dc/d10/d40/d3a/cc3 to dc/d10/ddb/ceb 0 2024-09-11T00:18:00.523 INFO:tasks.workunit.client.0.smithi078.stdout:0/651: dwrite d2/d57/f88 [0,4194304] 0 2024-09-11T00:18:00.526 INFO:tasks.workunit.client.0.smithi078.stdout:6/612: dwrite d0/d1/d9/d59/f64 [0,4194304] 0 2024-09-11T00:18:00.527 INFO:tasks.workunit.client.0.smithi078.stdout:6/613: creat d0/d1/d9/d59/d74/db3/fce x:0 0 0 2024-09-11T00:18:00.527 INFO:tasks.workunit.client.0.smithi078.stdout:6/614: write d0/d1/d9/d59/d74/fcb [4851251,5002] 0 2024-09-11T00:18:00.530 INFO:tasks.workunit.client.0.smithi078.stdout:6/615: creat d0/d1/d9/d59/d74/db3/fcf x:0 0 0 2024-09-11T00:18:00.530 INFO:tasks.workunit.client.0.smithi078.stdout:6/616: fdatasync d0/d1/f39 0 2024-09-11T00:18:00.530 INFO:tasks.workunit.client.0.smithi078.stdout:6/617: write d0/d1/da8/fad [253697,98180] 0 2024-09-11T00:18:00.530 INFO:tasks.workunit.client.0.smithi078.stdout:1/883: dwrite d3/d1a/d21/d4a/d90/dc7/fdd [0,4194304] 0 2024-09-11T00:18:00.530 INFO:tasks.workunit.client.0.smithi078.stdout:8/812: dread da/d13/d19/f35 [4194304,4194304] 0 2024-09-11T00:18:00.530 INFO:tasks.workunit.client.0.smithi078.stdout:8/813: write da/fe7 [459526,1604] 0 2024-09-11T00:18:00.531 INFO:tasks.workunit.client.0.smithi078.stdout:8/814: dread da/d1c/d60/fb4 [0,4194304] 0 2024-09-11T00:18:00.532 INFO:tasks.workunit.client.0.smithi078.stdout:8/815: fdatasync da/d13/d1b/f3c 0 2024-09-11T00:18:00.532 INFO:tasks.workunit.client.0.smithi078.stdout:8/816: chown da/c11 31949 1 2024-09-11T00:18:00.532 INFO:tasks.workunit.client.0.smithi078.stdout:8/817: dread - da/d87/d3a/fb9 zero size 2024-09-11T00:18:00.538 INFO:tasks.workunit.client.0.smithi078.stdout:4/702: read dc/d10/d40/d3a/d4c/f8a [2997971,114392] 0 2024-09-11T00:18:00.538 INFO:tasks.workunit.client.0.smithi078.stdout:4/703: truncate dc/f11 1202576 0 2024-09-11T00:18:00.539 INFO:tasks.workunit.client.0.smithi078.stdout:9/668: dwrite dc/d12/d54/fb8 [0,4194304] 0 2024-09-11T00:18:00.539 INFO:tasks.workunit.client.0.smithi078.stdout:9/669: dread - dc/d12/fd1 zero size 2024-09-11T00:18:00.539 INFO:tasks.workunit.client.0.smithi078.stdout:9/670: getdents dc/d12 0 2024-09-11T00:18:00.539 INFO:tasks.workunit.client.0.smithi078.stdout:7/601: dwrite d0/d34/db/d30/d1d/f13 [0,4194304] 0 2024-09-11T00:18:00.540 INFO:tasks.workunit.client.0.smithi078.stdout:4/704: symlink dc/d10/d40/d3a/lec 0 2024-09-11T00:18:00.540 INFO:tasks.workunit.client.0.smithi078.stdout:5/503: dwrite d7/d8/d33/d22/d25/d6a/f6e [0,4194304] 0 2024-09-11T00:18:00.540 INFO:tasks.workunit.client.0.smithi078.stdout:5/504: truncate d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d8c/fab 1041728 0 2024-09-11T00:18:00.542 INFO:tasks.workunit.client.0.smithi078.stdout:9/671: mknod dc/d12/d54/de7/ceb 0 2024-09-11T00:18:00.542 INFO:tasks.workunit.client.0.smithi078.stdout:9/672: fdatasync dc/d12/d46/d51/dcc/fd3 0 2024-09-11T00:18:00.542 INFO:tasks.workunit.client.0.smithi078.stdout:9/673: fsync dc/d12/d20/d58/d5b/dbb/f67 0 2024-09-11T00:18:00.543 INFO:tasks.workunit.client.0.smithi078.stdout:4/705: truncate dc/d10/d1f/f53 4713431 0 2024-09-11T00:18:00.543 INFO:tasks.workunit.client.0.smithi078.stdout:4/706: chown dc/d10/d40/d3a/d65/d94/cd3 1534342426 1 2024-09-11T00:18:00.543 INFO:tasks.workunit.client.0.smithi078.stdout:4/707: write dc/d10/d1f/f97 [1083023,102846] 0 2024-09-11T00:18:00.544 INFO:tasks.workunit.client.0.smithi078.stdout:7/602: mkdir d0/d34/db/d30/d1d/db0 0 2024-09-11T00:18:00.544 INFO:tasks.workunit.client.0.smithi078.stdout:4/708: symlink dc/d10/d40/d3a/d65/d94/de9/led 0 2024-09-11T00:18:00.548 INFO:tasks.workunit.client.0.smithi078.stdout:4/709: getdents dc/d10/d40/d3a/d65/d7b/d8b/dc5 0 2024-09-11T00:18:00.550 INFO:tasks.workunit.client.0.smithi078.stdout:4/710: mknod dc/d10/d40/d3a/d46/dad/cee 0 2024-09-11T00:18:00.550 INFO:tasks.workunit.client.0.smithi078.stdout:4/711: chown dc/d10/d40/d3a/d4c/db4/d72/dbb/fc1 78 1 2024-09-11T00:18:00.550 INFO:tasks.workunit.client.0.smithi078.stdout:4/712: readlink dc/d10/d40/lc7 0 2024-09-11T00:18:00.551 INFO:tasks.workunit.client.0.smithi078.stdout:4/713: mkdir dc/d10/d1f/def 0 2024-09-11T00:18:00.553 INFO:tasks.workunit.client.0.smithi078.stdout:4/714: symlink dc/d10/d40/d33/lf0 0 2024-09-11T00:18:00.553 INFO:tasks.workunit.client.0.smithi078.stdout:4/715: read dc/f11 [73314,103511] 0 2024-09-11T00:18:00.553 INFO:tasks.workunit.client.0.smithi078.stdout:9/674: dread dc/d12/d20/d50/dbc/dcf/de1/d3e/fab [0,4194304] 0 2024-09-11T00:18:00.558 INFO:tasks.workunit.client.0.smithi078.stdout:1/884: dwrite d3/d1a/d21/d4a/d90/dc7/dc9/fce [0,4194304] 0 2024-09-11T00:18:00.561 INFO:tasks.workunit.client.0.smithi078.stdout:1/885: link d3/d29/d5f/c32 d3/d1a/c121 0 2024-09-11T00:18:00.563 INFO:tasks.workunit.client.0.smithi078.stdout:1/886: creat d3/d106/f122 x:0 0 0 2024-09-11T00:18:00.565 INFO:tasks.workunit.client.0.smithi078.stdout:5/505: dwrite d7/d8/d33/f7e [0,4194304] 0 2024-09-11T00:18:00.568 INFO:tasks.workunit.client.0.smithi078.stdout:5/506: mkdir d7/d8/d33/d22/d25/db1 0 2024-09-11T00:18:00.568 INFO:tasks.workunit.client.0.smithi078.stdout:5/507: write d7/d8/d33/d22/d25/d28/d24/d1c/d1e/fa2 [107957,130200] 0 2024-09-11T00:18:00.568 INFO:tasks.workunit.client.0.smithi078.stdout:5/508: write d7/d8/d56/f5d [1397197,2526] 0 2024-09-11T00:18:00.570 INFO:tasks.workunit.client.0.smithi078.stdout:5/509: symlink d7/lb2 0 2024-09-11T00:18:00.570 INFO:tasks.workunit.client.0.smithi078.stdout:0/652: dwrite d2/d2a/d2c/d35/d59/d7/f14 [0,4194304] 0 2024-09-11T00:18:00.570 INFO:tasks.workunit.client.0.smithi078.stdout:6/618: dread d0/d1/f96 [0,4194304] 0 2024-09-11T00:18:00.572 INFO:tasks.workunit.client.0.smithi078.stdout:0/653: mknod d2/d97/cd9 0 2024-09-11T00:18:00.573 INFO:tasks.workunit.client.0.smithi078.stdout:1/887: dread d3/d1a/d21/fff [0,4194304] 0 2024-09-11T00:18:00.574 INFO:tasks.workunit.client.0.smithi078.stdout:6/619: symlink d0/d33/ld0 0 2024-09-11T00:18:00.574 INFO:tasks.workunit.client.0.smithi078.stdout:6/620: fdatasync d0/d1/d53/d9c/fbc 0 2024-09-11T00:18:00.574 INFO:tasks.workunit.client.0.smithi078.stdout:4/716: dwrite dc/d10/d1f/d68/db5/fb7 [4194304,4194304] 0 2024-09-11T00:18:00.574 INFO:tasks.workunit.client.0.smithi078.stdout:8/818: dwrite da/d13/d1b/d59/f57 [0,4194304] 0 2024-09-11T00:18:00.574 INFO:tasks.workunit.client.0.smithi078.stdout:8/819: read da/d87/fc9 [74494,86067] 0 2024-09-11T00:18:00.574 INFO:tasks.workunit.client.0.smithi078.stdout:8/820: dread - da/d13/d1b/d37/dd5/ff6 zero size 2024-09-11T00:18:00.574 INFO:tasks.workunit.client.0.smithi078.stdout:8/821: write da/d13/d1b/d24/d86/d91/ffd [639162,74666] 0 2024-09-11T00:18:00.574 INFO:tasks.workunit.client.0.smithi078.stdout:8/822: chown da/d87/d3a/f40 16163 1 2024-09-11T00:18:00.574 INFO:tasks.workunit.client.0.smithi078.stdout:8/823: fdatasync da/d13/d1b/d24/ff8 0 2024-09-11T00:18:00.574 INFO:tasks.workunit.client.0.smithi078.stdout:8/824: readlink da/d1c/d60/laa 0 2024-09-11T00:18:00.574 INFO:tasks.workunit.client.0.smithi078.stdout:0/654: creat d2/fda x:0 0 0 2024-09-11T00:18:00.575 INFO:tasks.workunit.client.0.smithi078.stdout:1/888: creat d3/d1a/d21/d4a/d90/dd7/f123 x:0 0 0 2024-09-11T00:18:00.575 INFO:tasks.workunit.client.0.smithi078.stdout:6/621: creat d0/d1/d9/d17/fd1 x:0 0 0 2024-09-11T00:18:00.575 INFO:tasks.workunit.client.0.smithi078.stdout:6/622: truncate d0/d1/d53/d9c/dac/fb9 794280 0 2024-09-11T00:18:00.575 INFO:tasks.workunit.client.0.smithi078.stdout:6/623: write d0/d1/d9/d59/d74/fcb [4875417,45794] 0 2024-09-11T00:18:00.576 INFO:tasks.workunit.client.0.smithi078.stdout:6/624: stat d0/d1/d9/d59/d74/d6b 0 2024-09-11T00:18:00.576 INFO:tasks.workunit.client.0.smithi078.stdout:4/717: symlink dc/lf1 0 2024-09-11T00:18:00.576 INFO:tasks.workunit.client.0.smithi078.stdout:0/655: mknod d2/d2a/d2c/d35/d59/d4f/d61/d8f/cdb 0 2024-09-11T00:18:00.577 INFO:tasks.workunit.client.0.smithi078.stdout:1/889: rename d3/d1a/d21/l26 to d3/d1a/d21/d4a/d90/dc7/l124 0 2024-09-11T00:18:00.578 INFO:tasks.workunit.client.0.smithi078.stdout:0/656: mknod d2/d2a/cdc 0 2024-09-11T00:18:00.578 INFO:tasks.workunit.client.0.smithi078.stdout:0/657: stat d2/d2a/d2c/d35/d59/d4f/d61 0 2024-09-11T00:18:00.579 INFO:tasks.workunit.client.0.smithi078.stdout:1/890: creat d3/d1a/d21/d4a/f125 x:0 0 0 2024-09-11T00:18:00.579 INFO:tasks.workunit.client.0.smithi078.stdout:1/891: readlink d3/d1a/d21/d4a/le9 0 2024-09-11T00:18:00.580 INFO:tasks.workunit.client.0.smithi078.stdout:0/658: rename d2/d2a/d2c/c6d to d2/d2a/d2c/d35/d59/d7/cdd 0 2024-09-11T00:18:00.581 INFO:tasks.workunit.client.0.smithi078.stdout:0/659: creat d2/d2a/d2c/d35/d59/d4f/d61/d8f/fde x:0 0 0 2024-09-11T00:18:00.584 INFO:tasks.workunit.client.0.smithi078.stdout:5/510: dread d7/d8/d33/d22/d25/d28/d24/f44 [0,4194304] 0 2024-09-11T00:18:00.585 INFO:tasks.workunit.client.0.smithi078.stdout:5/511: symlink d7/d8/d33/d22/d25/d28/d24/d1c/lb3 0 2024-09-11T00:18:00.585 INFO:tasks.workunit.client.0.smithi078.stdout:5/512: write d7/d8/de/d2c/fa6 [1770201,37758] 0 2024-09-11T00:18:00.586 INFO:tasks.workunit.client.0.smithi078.stdout:1/892: dread d3/d1a/d21/d4a/d94/faa [0,4194304] 0 2024-09-11T00:18:00.586 INFO:tasks.workunit.client.0.smithi078.stdout:1/893: write d3/d29/d5f/f1f [7243496,33554] 0 2024-09-11T00:18:00.586 INFO:tasks.workunit.client.0.smithi078.stdout:1/894: read - d3/d1a/d21/d4a/d90/dd7/fe4 zero size 2024-09-11T00:18:00.587 INFO:tasks.workunit.client.0.smithi078.stdout:5/513: dread d7/d8/d56/d2a/f35 [0,4194304] 0 2024-09-11T00:18:00.588 INFO:tasks.workunit.client.0.smithi078.stdout:5/514: mknod d7/d8/d33/d22/da3/cb4 0 2024-09-11T00:18:00.591 INFO:tasks.workunit.client.0.smithi078.stdout:4/718: dread dc/d10/d40/d3a/d46/d47/fa0 [0,4194304] 0 2024-09-11T00:18:00.592 INFO:tasks.workunit.client.0.smithi078.stdout:4/719: symlink dc/d10/d3c/lf2 0 2024-09-11T00:18:00.592 INFO:tasks.workunit.client.0.smithi078.stdout:6/625: dread d0/d1/d9/d59/d74/f67 [0,4194304] 0 2024-09-11T00:18:00.593 INFO:tasks.workunit.client.0.smithi078.stdout:6/626: write d0/d1/d9/d17/fcd [939411,55867] 0 2024-09-11T00:18:00.593 INFO:tasks.workunit.client.0.smithi078.stdout:1/895: dread d3/d29/d5f/d4e/ff6 [0,4194304] 0 2024-09-11T00:18:00.593 INFO:tasks.workunit.client.0.smithi078.stdout:6/627: read - d0/d1/d53/d9c/db6/fba zero size 2024-09-11T00:18:00.593 INFO:tasks.workunit.client.0.smithi078.stdout:4/720: mknod dc/d10/d40/d3a/d46/d59/cf3 0 2024-09-11T00:18:00.593 INFO:tasks.workunit.client.0.smithi078.stdout:4/721: chown dc/d10/d40/d3a/d65/d94 28788 1 2024-09-11T00:18:00.595 INFO:tasks.workunit.client.0.smithi078.stdout:4/722: rename dc/d10/d3c/d6e to dc/d10/ddd/df4 0 2024-09-11T00:18:00.595 INFO:tasks.workunit.client.0.smithi078.stdout:4/723: dread - dc/d10/d40/d3a/d65/d7b/d9e/d5d/f73 zero size 2024-09-11T00:18:00.596 INFO:tasks.workunit.client.0.smithi078.stdout:4/724: mknod dc/d54/dd0/cf5 0 2024-09-11T00:18:00.597 INFO:tasks.workunit.client.0.smithi078.stdout:5/515: write d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d8c/fa0 [206419,66220] 0 2024-09-11T00:18:00.603 INFO:tasks.workunit.client.0.smithi078.stdout:4/725: read dc/d10/d40/d3a/d65/d7b/d9e/d50/fd1 [22752,2385] 0 2024-09-11T00:18:00.605 INFO:tasks.workunit.client.0.smithi078.stdout:4/726: mknod dc/d10/d40/d3a/d4c/cf6 0 2024-09-11T00:18:00.605 INFO:tasks.workunit.client.0.smithi078.stdout:4/727: chown dc/d10/l1c 881918 1 2024-09-11T00:18:00.605 INFO:tasks.workunit.client.0.smithi078.stdout:6/628: dread d0/d1/d9/d17/f58 [0,4194304] 0 2024-09-11T00:18:00.608 INFO:tasks.workunit.client.0.smithi078.stdout:4/728: rename dc/d54/cbc to dc/d10/d40/d3a/d46/dad/cf7 0 2024-09-11T00:18:00.608 INFO:tasks.workunit.client.0.smithi078.stdout:4/729: write dc/d10/f14 [1060689,125756] 0 2024-09-11T00:18:00.608 INFO:tasks.workunit.client.0.smithi078.stdout:6/629: creat d0/d1/d9/d59/da3/fd2 x:0 0 0 2024-09-11T00:18:00.609 INFO:tasks.workunit.client.0.smithi078.stdout:4/730: mknod dc/d10/ddb/cf8 0 2024-09-11T00:18:00.609 INFO:tasks.workunit.client.0.smithi078.stdout:4/731: readlink dc/d10/d40/l32 0 2024-09-11T00:18:00.610 INFO:tasks.workunit.client.0.smithi078.stdout:4/732: mkdir dc/d10/d40/d3a/d4c/db4/df9 0 2024-09-11T00:18:00.611 INFO:tasks.workunit.client.0.smithi078.stdout:4/733: getdents dc/d10/d40/d33 0 2024-09-11T00:18:00.611 INFO:tasks.workunit.client.0.smithi078.stdout:5/516: dwrite d7/d8/d56/f75 [0,4194304] 0 2024-09-11T00:18:00.613 INFO:tasks.workunit.client.0.smithi078.stdout:8/825: dwrite da/d13/d1b/d24/d86/d91/ffd [0,4194304] 0 2024-09-11T00:18:00.613 INFO:tasks.workunit.client.0.smithi078.stdout:8/826: dread - da/d1c/d60/d85/d79/d99/fee zero size 2024-09-11T00:18:00.614 INFO:tasks.workunit.client.0.smithi078.stdout:8/827: link da/d13/d1b/d24/d86/d91/fe5 da/d87/d7b/f105 0 2024-09-11T00:18:00.615 INFO:tasks.workunit.client.0.smithi078.stdout:0/660: dwrite d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/fb1 [0,4194304] 0 2024-09-11T00:18:00.615 INFO:tasks.workunit.client.0.smithi078.stdout:1/896: dwrite d3/d29/d5f/f8 [4194304,4194304] 0 2024-09-11T00:18:00.616 INFO:tasks.workunit.client.0.smithi078.stdout:8/828: dread da/d1c/d60/fb4 [0,4194304] 0 2024-09-11T00:18:00.618 INFO:tasks.workunit.client.0.smithi078.stdout:0/661: mknod d2/d2a/d2c/d35/d59/d7/d96/cdf 0 2024-09-11T00:18:00.618 INFO:tasks.workunit.client.0.smithi078.stdout:1/897: mkdir d3/d29/d5f/d39/d61/d96/daf/d126 0 2024-09-11T00:18:00.618 INFO:tasks.workunit.client.0.smithi078.stdout:1/898: chown d3/d29/d5f/d39/f51 538 1 2024-09-11T00:18:00.619 INFO:tasks.workunit.client.0.smithi078.stdout:8/829: creat da/d1c/d60/f106 x:0 0 0 2024-09-11T00:18:00.619 INFO:tasks.workunit.client.0.smithi078.stdout:1/899: mkdir d3/d1a/d21/d88/d127 0 2024-09-11T00:18:00.620 INFO:tasks.workunit.client.0.smithi078.stdout:8/830: getdents da/d13/d1b/d37 0 2024-09-11T00:18:00.620 INFO:tasks.workunit.client.0.smithi078.stdout:8/831: write da/d13/d1b/d24/d62/ffc [1472918,129241] 0 2024-09-11T00:18:00.622 INFO:tasks.workunit.client.0.smithi078.stdout:8/832: creat da/d87/d3a/d4b/dd3/f107 x:0 0 0 2024-09-11T00:18:00.623 INFO:tasks.workunit.client.0.smithi078.stdout:4/734: dread dc/d10/d40/d3a/d4c/f8a [0,4194304] 0 2024-09-11T00:18:00.625 INFO:tasks.workunit.client.0.smithi078.stdout:8/833: dread da/d13/d1b/d37/f5a [0,4194304] 0 2024-09-11T00:18:00.625 INFO:tasks.workunit.client.0.smithi078.stdout:4/735: rename dc/d10/d1f/def to dc/d10/d40/d3a/d65/d7b/d8b/dfa 0 2024-09-11T00:18:00.626 INFO:tasks.workunit.client.0.smithi078.stdout:8/834: creat da/d1c/d60/d85/d79/d9e/dd8/f108 x:0 0 0 2024-09-11T00:18:00.627 INFO:tasks.workunit.client.0.smithi078.stdout:4/736: dread dc/d10/d40/d33/f84 [0,4194304] 0 2024-09-11T00:18:00.628 INFO:tasks.workunit.client.0.smithi078.stdout:4/737: chown dc/d10/d40/d3a/d4c/f41 0 1 2024-09-11T00:18:00.628 INFO:tasks.workunit.client.0.smithi078.stdout:4/738: write dc/d10/d1f/f97 [2112915,98417] 0 2024-09-11T00:18:00.631 INFO:tasks.workunit.client.0.smithi078.stdout:1/900: dread d3/d1a/d21/f2f [0,4194304] 0 2024-09-11T00:18:00.631 INFO:tasks.workunit.client.0.smithi078.stdout:6/630: dwrite d0/d1/d1b/f73 [0,4194304] 0 2024-09-11T00:18:00.631 INFO:tasks.workunit.client.0.smithi078.stdout:6/631: truncate d0/d1/d9/d59/da3/fd2 792716 0 2024-09-11T00:18:00.631 INFO:tasks.workunit.client.0.smithi078.stdout:6/632: write d0/d1/f98 [494338,44671] 0 2024-09-11T00:18:00.634 INFO:tasks.workunit.client.0.smithi078.stdout:8/835: creat da/d13/d1b/d24/d86/d91/f109 x:0 0 0 2024-09-11T00:18:00.637 INFO:tasks.workunit.client.0.smithi078.stdout:5/517: dwrite d7/d8/d56/d9e/fac [0,4194304] 0 2024-09-11T00:18:00.639 INFO:tasks.workunit.client.0.smithi078.stdout:0/662: dwrite d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/f5f [0,4194304] 0 2024-09-11T00:18:00.640 INFO:tasks.workunit.client.0.smithi078.stdout:0/663: read d2/d2a/d2c/d35/d59/f47 [2790431,91429] 0 2024-09-11T00:18:00.643 INFO:tasks.workunit.client.0.smithi078.stdout:8/836: symlink da/d13/d1b/d59/l10a 0 2024-09-11T00:18:00.643 INFO:tasks.workunit.client.0.smithi078.stdout:8/837: dread - da/d1c/d60/d85/d94/fc7 zero size 2024-09-11T00:18:00.651 INFO:tasks.workunit.client.0.smithi078.stdout:5/518: write d7/d8/de/ff [3916868,78947] 0 2024-09-11T00:18:00.656 INFO:tasks.workunit.client.0.smithi078.stdout:6/633: dwrite d0/f76 [0,4194304] 0 2024-09-11T00:18:00.656 INFO:tasks.workunit.client.0.smithi078.stdout:4/739: dwrite dc/d10/d40/d3a/d65/d7b/d9e/d5d/f78 [0,4194304] 0 2024-09-11T00:18:00.657 INFO:tasks.workunit.client.0.smithi078.stdout:5/519: dread d7/d8/d33/d22/d51/f9b [0,4194304] 0 2024-09-11T00:18:00.657 INFO:tasks.workunit.client.0.smithi078.stdout:1/901: dwrite d3/d1a/f82 [0,4194304] 0 2024-09-11T00:18:00.657 INFO:tasks.workunit.client.0.smithi078.stdout:1/902: getdents d3/dfc 0 2024-09-11T00:18:00.657 INFO:tasks.workunit.client.0.smithi078.stdout:1/903: fsync d3/d1a/d21/d4a/d94/fcd 0 2024-09-11T00:18:00.662 INFO:tasks.workunit.client.0.smithi078.stdout:0/664: dwrite d2/d2a/f6b [0,4194304] 0 2024-09-11T00:18:00.666 INFO:tasks.workunit.client.0.smithi078.stdout:8/838: creat da/d7a/f10b x:0 0 0 2024-09-11T00:18:00.668 INFO:tasks.workunit.client.0.smithi078.stdout:6/634: creat d0/d1/d1b/fd3 x:0 0 0 2024-09-11T00:18:00.668 INFO:tasks.workunit.client.0.smithi078.stdout:6/635: readlink d0/d33/ld0 0 2024-09-11T00:18:00.670 INFO:tasks.workunit.client.0.smithi078.stdout:4/740: rename dc/d10/d40/d3a/d65/d7b/d9e/c98 to dc/d10/d40/d3a/d46/d59/cfb 0 2024-09-11T00:18:00.672 INFO:tasks.workunit.client.0.smithi078.stdout:5/520: dwrite d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d5b/f76 [4194304,4194304] 0 2024-09-11T00:18:00.672 INFO:tasks.workunit.client.0.smithi078.stdout:5/521: read f6 [1082706,57991] 0 2024-09-11T00:18:00.672 INFO:tasks.workunit.client.0.smithi078.stdout:1/904: creat d3/d1a/d21/d4a/d90/f128 x:0 0 0 2024-09-11T00:18:00.674 INFO:tasks.workunit.client.0.smithi078.stdout:0/665: mkdir d2/d2a/d2c/d35/d59/de0 0 2024-09-11T00:18:00.675 INFO:tasks.workunit.client.0.smithi078.stdout:0/666: chown d2/d2a/d2c/d35/d59/d4f/d61/d8f 803 1 2024-09-11T00:18:00.675 INFO:tasks.workunit.client.0.smithi078.stdout:0/667: fdatasync d2/d2a/d2c/d35/f78 0 2024-09-11T00:18:00.675 INFO:tasks.workunit.client.0.smithi078.stdout:8/839: mknod da/d87/d3a/dda/c10c 0 2024-09-11T00:18:00.676 INFO:tasks.workunit.client.0.smithi078.stdout:6/636: truncate d0/d1/d53/f88 3850933 0 2024-09-11T00:18:00.677 INFO:tasks.workunit.client.0.smithi078.stdout:4/741: rename dc/d10/d40/d3a/d46/d59/c5c to dc/d10/d40/d3a/d65/cfc 0 2024-09-11T00:18:00.678 INFO:tasks.workunit.client.0.smithi078.stdout:4/742: write dc/d10/d1f/fc9 [1659138,112187] 0 2024-09-11T00:18:00.678 INFO:tasks.workunit.client.0.smithi078.stdout:4/743: write dc/d10/d1f/f20 [248381,113675] 0 2024-09-11T00:18:00.678 INFO:tasks.workunit.client.0.smithi078.stdout:4/744: write dc/f25 [3320180,115620] 0 2024-09-11T00:18:00.678 INFO:tasks.workunit.client.0.smithi078.stdout:5/522: symlink d7/d8/d56/lb5 0 2024-09-11T00:18:00.679 INFO:tasks.workunit.client.0.smithi078.stdout:0/668: getdents d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56 0 2024-09-11T00:18:00.680 INFO:tasks.workunit.client.0.smithi078.stdout:6/637: mknod d0/d1/d9/d59/d74/db3/cd4 0 2024-09-11T00:18:00.681 INFO:tasks.workunit.client.0.smithi078.stdout:6/638: read - d0/d1/d9/d59/d74/db3/fce zero size 2024-09-11T00:18:00.681 INFO:tasks.workunit.client.0.smithi078.stdout:6/639: chown d0/d1/c38 247 1 2024-09-11T00:18:00.683 INFO:tasks.workunit.client.0.smithi078.stdout:8/840: rename da/f10 to da/d1c/d4c/dbc/f10d 0 2024-09-11T00:18:00.683 INFO:tasks.workunit.client.0.smithi078.stdout:8/841: truncate da/d1c/d60/feb 104085 0 2024-09-11T00:18:00.683 INFO:tasks.workunit.client.0.smithi078.stdout:8/842: read da/d13/d1b/d37/f5a [53719,78316] 0 2024-09-11T00:18:00.686 INFO:tasks.workunit.client.0.smithi078.stdout:4/745: symlink dc/d10/d40/d3a/d46/d59/d9f/lfd 0 2024-09-11T00:18:00.686 INFO:tasks.workunit.client.0.smithi078.stdout:4/746: truncate dc/d10/d1f/f5b 2986980 0 2024-09-11T00:18:00.687 INFO:tasks.workunit.client.0.smithi078.stdout:5/523: creat d7/d8/d33/d22/d25/d28/fb6 x:0 0 0 2024-09-11T00:18:00.687 INFO:tasks.workunit.client.0.smithi078.stdout:5/524: write d7/d8/d33/d22/f97 [1166336,85339] 0 2024-09-11T00:18:00.688 INFO:tasks.workunit.client.0.smithi078.stdout:1/905: link d3/d29/d45/c54 d3/d1a/c129 0 2024-09-11T00:18:00.688 INFO:tasks.workunit.client.0.smithi078.stdout:1/906: fdatasync d3/f116 0 2024-09-11T00:18:00.688 INFO:tasks.workunit.client.0.smithi078.stdout:1/907: dread - d3/d29/d5f/d4e/f117 zero size 2024-09-11T00:18:00.688 INFO:tasks.workunit.client.0.smithi078.stdout:1/908: fsync d3/d29/f2e 0 2024-09-11T00:18:00.689 INFO:tasks.workunit.client.0.smithi078.stdout:0/669: creat d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/fe1 x:0 0 0 2024-09-11T00:18:00.689 INFO:tasks.workunit.client.0.smithi078.stdout:6/640: getdents d0/d1/d53/d9c/dac 0 2024-09-11T00:18:00.691 INFO:tasks.workunit.client.0.smithi078.stdout:8/843: creat da/d1c/d4c/f10e x:0 0 0 2024-09-11T00:18:00.695 INFO:tasks.workunit.client.0.smithi078.stdout:0/670: write d2/d2a/d2c/d35/d59/d7/f7d [465930,91018] 0 2024-09-11T00:18:00.695 INFO:tasks.workunit.client.0.smithi078.stdout:8/844: dread da/d87/d7b/f8f [0,4194304] 0 2024-09-11T00:18:00.696 INFO:tasks.workunit.client.0.smithi078.stdout:1/909: getdents d3/db3 0 2024-09-11T00:18:00.696 INFO:tasks.workunit.client.0.smithi078.stdout:1/910: fdatasync d3/d29/f10c 0 2024-09-11T00:18:00.696 INFO:tasks.workunit.client.0.smithi078.stdout:6/641: getdents d0/d1/d53 0 2024-09-11T00:18:00.699 INFO:tasks.workunit.client.0.smithi078.stdout:0/671: mknod d2/d2a/d2c/ce2 0 2024-09-11T00:18:00.699 INFO:tasks.workunit.client.0.smithi078.stdout:0/672: write d2/d2a/d2c/d35/d59/d4f/d61/d69/fa2 [1038138,86737] 0 2024-09-11T00:18:00.699 INFO:tasks.workunit.client.0.smithi078.stdout:8/845: creat da/d1c/d60/d85/d79/d99/d82/d63/f10f x:0 0 0 2024-09-11T00:18:00.702 INFO:tasks.workunit.client.0.smithi078.stdout:6/642: truncate d0/d1/f2f 914063 0 2024-09-11T00:18:00.702 INFO:tasks.workunit.client.0.smithi078.stdout:0/673: dread d2/d2a/d2c/d5e/f68 [4194304,4194304] 0 2024-09-11T00:18:00.703 INFO:tasks.workunit.client.0.smithi078.stdout:8/846: mkdir da/d87/d7b/da7/d110 0 2024-09-11T00:18:00.704 INFO:tasks.workunit.client.0.smithi078.stdout:4/747: dwrite dc/d10/d40/d3a/d46/fd6 [0,4194304] 0 2024-09-11T00:18:00.707 INFO:tasks.workunit.client.0.smithi078.stdout:6/643: rename d0/d33 to d0/d1/d9/d59/d74/db3/dd5 0 2024-09-11T00:18:00.709 INFO:tasks.workunit.client.0.smithi078.stdout:5/525: dwrite d7/d8/d33/d22/d25/d6a/f6e [0,4194304] 0 2024-09-11T00:18:00.711 INFO:tasks.workunit.client.0.smithi078.stdout:4/748: truncate f3 1987587 0 2024-09-11T00:18:00.711 INFO:tasks.workunit.client.0.smithi078.stdout:4/749: write dc/d10/d40/d3a/d46/f6b [1032545,62224] 0 2024-09-11T00:18:00.711 INFO:tasks.workunit.client.0.smithi078.stdout:4/750: fdatasync dc/d10/d1f/f97 0 2024-09-11T00:18:00.711 INFO:tasks.workunit.client.0.smithi078.stdout:4/751: stat dc/d10/d1f/d68/db5/ce5 0 2024-09-11T00:18:00.711 INFO:tasks.workunit.client.0.smithi078.stdout:4/752: write dc/d10/d1f/f20 [5362076,52822] 0 2024-09-11T00:18:00.713 INFO:tasks.workunit.client.0.smithi078.stdout:6/644: truncate d0/d1/f32 9766697 0 2024-09-11T00:18:00.719 INFO:tasks.workunit.client.0.smithi078.stdout:5/526: mkdir d7/d8/d33/d22/d25/d6a/db7 0 2024-09-11T00:18:00.720 INFO:tasks.workunit.client.0.smithi078.stdout:0/674: dwrite d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/fe1 [0,4194304] 0 2024-09-11T00:18:00.721 INFO:tasks.workunit.client.0.smithi078.stdout:4/753: mknod dc/d10/d40/d3a/d65/d7b/d8b/dfa/cfe 0 2024-09-11T00:18:00.723 INFO:tasks.workunit.client.0.smithi078.stdout:5/527: unlink d7/d8/d33/d22/d25/d28/d24/d1c/d1e/ca5 0 2024-09-11T00:18:00.723 INFO:tasks.workunit.client.0.smithi078.stdout:5/528: readlink d7/d8/l72 0 2024-09-11T00:18:00.724 INFO:tasks.workunit.client.0.smithi078.stdout:1/911: dwrite d3/d29/d5f/fe1 [0,4194304] 0 2024-09-11T00:18:00.728 INFO:tasks.workunit.client.0.smithi078.stdout:5/529: symlink d7/d8/d56/d2a/lb8 0 2024-09-11T00:18:00.728 INFO:tasks.workunit.client.0.smithi078.stdout:0/675: creat d2/d57/d8b/fe3 x:0 0 0 2024-09-11T00:18:00.729 INFO:tasks.workunit.client.0.smithi078.stdout:8/847: rename da/d1c/d60/d85/d79 to da/d13/d1b/d24/d62/d111 0 2024-09-11T00:18:00.729 INFO:tasks.workunit.client.0.smithi078.stdout:0/676: truncate d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/f7c 989739 0 2024-09-11T00:18:00.734 INFO:tasks.workunit.client.0.smithi078.stdout:5/530: mknod d7/d8/d33/d22/d25/d6a/db0/cb9 0 2024-09-11T00:18:00.734 INFO:tasks.workunit.client.0.smithi078.stdout:0/677: write d2/d2a/d2c/d5e/f68 [3097181,117425] 0 2024-09-11T00:18:00.734 INFO:tasks.workunit.client.0.smithi078.stdout:0/678: readlink d2/l5a 0 2024-09-11T00:18:00.735 INFO:tasks.workunit.client.0.smithi078.stdout:4/754: rename dc/d10/d40/d3a/d46/dad/fb9 to dc/d10/d40/d3a/d4c/db4/df9/fff 0 2024-09-11T00:18:00.736 INFO:tasks.workunit.client.0.smithi078.stdout:8/848: mknod da/d1c/d60/d85/d94/c112 0 2024-09-11T00:18:00.737 INFO:tasks.workunit.client.0.smithi078.stdout:1/912: dwrite d3/d29/f11d [0,4194304] 0 2024-09-11T00:18:00.737 INFO:tasks.workunit.client.0.smithi078.stdout:8/849: dread da/d1c/d60/fb4 [0,4194304] 0 2024-09-11T00:18:00.739 INFO:tasks.workunit.client.0.smithi078.stdout:0/679: creat d2/fe4 x:0 0 0 2024-09-11T00:18:00.740 INFO:tasks.workunit.client.0.smithi078.stdout:4/755: mknod dc/d10/d1f/c100 0 2024-09-11T00:18:00.740 INFO:tasks.workunit.client.0.smithi078.stdout:4/756: chown dc/d10/d40/d3a/d65/d7b/d8b/dc5/fe6 956 1 2024-09-11T00:18:00.743 INFO:tasks.workunit.client.0.smithi078.stdout:1/913: rename d3/f101 to d3/d29/d5f/d39/f12a 0 2024-09-11T00:18:00.744 INFO:tasks.workunit.client.0.smithi078.stdout:8/850: rmdir da/d13/d1b/d4e 39 2024-09-11T00:18:00.744 INFO:tasks.workunit.client.0.smithi078.stdout:5/531: dread d7/d8/f77 [0,4194304] 0 2024-09-11T00:18:00.745 INFO:tasks.workunit.client.0.smithi078.stdout:0/680: link d2/d57/d8b/c8c d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/ce5 0 2024-09-11T00:18:00.746 INFO:tasks.workunit.client.0.smithi078.stdout:4/757: dread dc/d10/d40/d3a/fb1 [0,4194304] 0 2024-09-11T00:18:00.746 INFO:tasks.workunit.client.0.smithi078.stdout:1/914: creat d3/d1a/d21/d88/d127/f12b x:0 0 0 2024-09-11T00:18:00.747 INFO:tasks.workunit.client.0.smithi078.stdout:8/851: rmdir da/d87/d3a 39 2024-09-11T00:18:00.747 INFO:tasks.workunit.client.0.smithi078.stdout:8/852: chown da/d1c/d60/d85/d94/ddf/ce0 14 1 2024-09-11T00:18:00.747 INFO:tasks.workunit.client.0.smithi078.stdout:8/853: chown da/d13/d1b/d4e/c5e 0 1 2024-09-11T00:18:00.747 INFO:tasks.workunit.client.0.smithi078.stdout:8/854: chown da/d13 1871752100 1 2024-09-11T00:18:00.749 INFO:tasks.workunit.client.0.smithi078.stdout:5/532: rename d7/d8/d33/d22/d25/d6a/db0/cb9 to d7/d8/d56/d2a/cba 0 2024-09-11T00:18:00.750 INFO:tasks.workunit.client.0.smithi078.stdout:3/621: sync 2024-09-11T00:18:00.751 INFO:tasks.workunit.client.0.smithi078.stdout:0/681: creat d2/d2a/d2c/d35/d59/dc7/fe6 x:0 0 0 2024-09-11T00:18:00.751 INFO:tasks.workunit.client.0.smithi078.stdout:1/915: dread d3/d29/dc4/fec [4194304,4194304] 0 2024-09-11T00:18:00.751 INFO:tasks.workunit.client.0.smithi078.stdout:2/637: sync 2024-09-11T00:18:00.751 INFO:tasks.workunit.client.0.smithi078.stdout:7/603: sync 2024-09-11T00:18:00.751 INFO:tasks.workunit.client.0.smithi078.stdout:9/675: sync 2024-09-11T00:18:00.751 INFO:tasks.workunit.client.0.smithi078.stdout:2/638: chown d0/d1 377597 1 2024-09-11T00:18:00.751 INFO:tasks.workunit.client.0.smithi078.stdout:2/639: write d0/d1/d6/d52/faf [828211,37113] 0 2024-09-11T00:18:00.752 INFO:tasks.workunit.client.0.smithi078.stdout:4/758: truncate dc/d10/d40/d33/fa9 883712 0 2024-09-11T00:18:00.753 INFO:tasks.workunit.client.0.smithi078.stdout:8/855: symlink da/d13/d1b/l113 0 2024-09-11T00:18:00.754 INFO:tasks.workunit.client.0.smithi078.stdout:7/604: dread d0/d34/db/d30/d1d/d14/d62/faa [0,4194304] 0 2024-09-11T00:18:00.754 INFO:tasks.workunit.client.0.smithi078.stdout:5/533: mknod d7/d8/d33/d22/d25/d28/da8/cbb 0 2024-09-11T00:18:00.754 INFO:tasks.workunit.client.0.smithi078.stdout:7/605: truncate d0/da7/fa2 1027546 0 2024-09-11T00:18:00.754 INFO:tasks.workunit.client.0.smithi078.stdout:7/606: chown d0/d34/db/d30/d28 5255661 1 2024-09-11T00:18:00.755 INFO:tasks.workunit.client.0.smithi078.stdout:3/622: mknod d0/d7/d18/d8c/cb8 0 2024-09-11T00:18:00.756 INFO:tasks.workunit.client.0.smithi078.stdout:1/916: creat d3/d29/d45/f12c x:0 0 0 2024-09-11T00:18:00.759 INFO:tasks.workunit.client.0.smithi078.stdout:2/640: creat d0/d1/d3c/d40/d50/fda x:0 0 0 2024-09-11T00:18:00.759 INFO:tasks.workunit.client.0.smithi078.stdout:2/641: chown d0/d1/d11/d60/da2/d38 250 1 2024-09-11T00:18:00.759 INFO:tasks.workunit.client.0.smithi078.stdout:2/642: truncate d0/d67/f7a 1161131 0 2024-09-11T00:18:00.760 INFO:tasks.workunit.client.0.smithi078.stdout:5/534: link d7/d8/d56/c3b d7/d8/d33/d22/d51/cbc 0 2024-09-11T00:18:00.762 INFO:tasks.workunit.client.0.smithi078.stdout:7/607: getdents d0/d34/db 0 2024-09-11T00:18:00.762 INFO:tasks.workunit.client.0.smithi078.stdout:7/608: write d0/f50 [1067062,121852] 0 2024-09-11T00:18:00.763 INFO:tasks.workunit.client.0.smithi078.stdout:4/759: write dc/d10/d3c/fb0 [2402114,3365] 0 2024-09-11T00:18:00.763 INFO:tasks.workunit.client.0.smithi078.stdout:4/760: stat dc/d10/d40/d33/f84 0 2024-09-11T00:18:00.765 INFO:tasks.workunit.client.0.smithi078.stdout:8/856: dread da/d13/d1b/d24/d62/d111/d99/d82/d63/da9/fb2 [0,4194304] 0 2024-09-11T00:18:00.766 INFO:tasks.workunit.client.0.smithi078.stdout:1/917: symlink d3/d29/d5f/d39/l12d 0 2024-09-11T00:18:00.768 INFO:tasks.workunit.client.0.smithi078.stdout:5/535: write d7/d8/d33/d22/d25/d28/f41 [3291718,20712] 0 2024-09-11T00:18:00.768 INFO:tasks.workunit.client.0.smithi078.stdout:5/536: fdatasync d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d8c/fa0 0 2024-09-11T00:18:00.768 INFO:tasks.workunit.client.0.smithi078.stdout:2/643: dread d0/d1/d33/d86/db4/f85 [0,4194304] 0 2024-09-11T00:18:00.768 INFO:tasks.workunit.client.0.smithi078.stdout:2/644: chown d0/d1/d33/d86/db4/f7e 341 1 2024-09-11T00:18:00.768 INFO:tasks.workunit.client.0.smithi078.stdout:2/645: readlink d0/d19/d3d/d8d/lcf 0 2024-09-11T00:18:00.768 INFO:tasks.workunit.client.0.smithi078.stdout:2/646: truncate d0/fc 1630927 0 2024-09-11T00:18:00.769 INFO:tasks.workunit.client.0.smithi078.stdout:2/647: chown d0/d19/d3d/d8d/lcf 254514 1 2024-09-11T00:18:00.770 INFO:tasks.workunit.client.0.smithi078.stdout:3/623: mknod d0/d7/d46/cb9 0 2024-09-11T00:18:00.770 INFO:tasks.workunit.client.0.smithi078.stdout:9/676: dwrite dc/d12/d20/d58/fe9 [0,4194304] 0 2024-09-11T00:18:00.772 INFO:tasks.workunit.client.0.smithi078.stdout:4/761: truncate dc/d10/d40/d3a/d46/fd6 852059 0 2024-09-11T00:18:00.774 INFO:tasks.workunit.client.0.smithi078.stdout:8/857: mkdir da/d13/d1b/d24/d62/d111/d9e/d114 0 2024-09-11T00:18:00.777 INFO:tasks.workunit.client.0.smithi078.stdout:1/918: creat d3/d29/d5f/d39/d61/d96/daf/de6/f12e x:0 0 0 2024-09-11T00:18:00.777 INFO:tasks.workunit.client.0.smithi078.stdout:7/609: dwrite d0/d34/db/d30/d28/f44 [4194304,4194304] 0 2024-09-11T00:18:00.778 INFO:tasks.workunit.client.0.smithi078.stdout:4/762: dread dc/d10/f86 [0,4194304] 0 2024-09-11T00:18:00.778 INFO:tasks.workunit.client.0.smithi078.stdout:2/648: rename d0/d1/d11/fd1 to d0/d1/d11/d60/da2/d3a/d51/d97/dbd/fdb 0 2024-09-11T00:18:00.780 INFO:tasks.workunit.client.0.smithi078.stdout:3/624: creat d0/d7/d18/d1b/d34/d60/fba x:0 0 0 2024-09-11T00:18:00.781 INFO:tasks.workunit.client.0.smithi078.stdout:3/625: chown d0/d7/d18/d1b/d8e/la0 31568846 1 2024-09-11T00:18:00.781 INFO:tasks.workunit.client.0.smithi078.stdout:3/626: read d0/d7/d23/f2d [4188628,11973] 0 2024-09-11T00:18:00.783 INFO:tasks.workunit.client.0.smithi078.stdout:9/677: symlink dc/d12/d20/d58/d5b/dbb/lec 0 2024-09-11T00:18:00.784 INFO:tasks.workunit.client.0.smithi078.stdout:9/678: write dc/d12/d46/d51/fa5 [2487447,63740] 0 2024-09-11T00:18:00.785 INFO:tasks.workunit.client.0.smithi078.stdout:8/858: creat da/d13/d1b/d24/d62/d111/d9e/f115 x:0 0 0 2024-09-11T00:18:00.786 INFO:tasks.workunit.client.0.smithi078.stdout:5/537: dwrite d7/d8/d33/d22/d25/f84 [0,4194304] 0 2024-09-11T00:18:00.787 INFO:tasks.workunit.client.0.smithi078.stdout:7/610: symlink d0/lb1 0 2024-09-11T00:18:00.789 INFO:tasks.workunit.client.0.smithi078.stdout:1/919: rename d3/d1a/d21/d4a/d94 to d3/d1a/d21/d4a/d90/d12f 0 2024-09-11T00:18:00.791 INFO:tasks.workunit.client.0.smithi078.stdout:2/649: unlink d0/d1/d3c/d40/ca3 0 2024-09-11T00:18:00.793 INFO:tasks.workunit.client.0.smithi078.stdout:3/627: creat d0/d7/d18/fbb x:0 0 0 2024-09-11T00:18:00.793 INFO:tasks.workunit.client.0.smithi078.stdout:3/628: write d0/d39/f74 [697425,45860] 0 2024-09-11T00:18:00.795 INFO:tasks.workunit.client.0.smithi078.stdout:4/763: dwrite dc/d10/d40/d3a/d46/f89 [4194304,4194304] 0 2024-09-11T00:18:00.795 INFO:tasks.workunit.client.0.smithi078.stdout:5/538: symlink d7/d8/d33/d22/d25/d28/lbd 0 2024-09-11T00:18:00.798 INFO:tasks.workunit.client.0.smithi078.stdout:7/611: getdents d0/d34/db/d30/d1d/d14/d62 0 2024-09-11T00:18:00.798 INFO:tasks.workunit.client.0.smithi078.stdout:1/920: write d3/d29/f11d [542423,77767] 0 2024-09-11T00:18:00.799 INFO:tasks.workunit.client.0.smithi078.stdout:2/650: getdents d0/d1/d3c/d9f 0 2024-09-11T00:18:00.800 INFO:tasks.workunit.client.0.smithi078.stdout:1/921: dread d3/d1a/d21/f2c [0,4194304] 0 2024-09-11T00:18:00.801 INFO:tasks.workunit.client.0.smithi078.stdout:4/764: unlink dc/d10/d40/d3a/d65/lbe 0 2024-09-11T00:18:00.802 INFO:tasks.workunit.client.0.smithi078.stdout:5/539: creat d7/d8/de/d90/fbe x:0 0 0 2024-09-11T00:18:00.803 INFO:tasks.workunit.client.0.smithi078.stdout:1/922: dread d3/d1a/d21/d4a/f66 [0,4194304] 0 2024-09-11T00:18:00.803 INFO:tasks.workunit.client.0.smithi078.stdout:7/612: creat d0/d34/db/d30/d1d/d14/d87/fb2 x:0 0 0 2024-09-11T00:18:00.806 INFO:tasks.workunit.client.0.smithi078.stdout:4/765: link dc/d10/d1f/f5b dc/d10/d40/d3a/d65/f101 0 2024-09-11T00:18:00.807 INFO:tasks.workunit.client.0.smithi078.stdout:5/540: mkdir d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf 0 2024-09-11T00:18:00.808 INFO:tasks.workunit.client.0.smithi078.stdout:5/541: dread - d7/d8/d33/d22/d25/d28/d24/d1c/f8a zero size 2024-09-11T00:18:00.809 INFO:tasks.workunit.client.0.smithi078.stdout:1/923: creat d3/d1a/d21/d4a/d90/dc7/dc9/f130 x:0 0 0 2024-09-11T00:18:00.809 INFO:tasks.workunit.client.0.smithi078.stdout:1/924: chown d3/d1a/d21/d4a/d90/d12f/fcd 1 1 2024-09-11T00:18:00.810 INFO:tasks.workunit.client.0.smithi078.stdout:7/613: creat d0/d34/db/fb3 x:0 0 0 2024-09-11T00:18:00.810 INFO:tasks.workunit.client.0.smithi078.stdout:7/614: chown d0/d34/db/d30/d1d/d14/d87/fb2 45266653 1 2024-09-11T00:18:00.810 INFO:tasks.workunit.client.0.smithi078.stdout:7/615: write d0/d34/d65/f8d [133063,38566] 0 2024-09-11T00:18:00.811 INFO:tasks.workunit.client.0.smithi078.stdout:3/629: dwrite d0/d7/d18/d8c/f95 [0,4194304] 0 2024-09-11T00:18:00.811 INFO:tasks.workunit.client.0.smithi078.stdout:4/766: link dc/f1e dc/d10/d40/d3a/d46/d59/f102 0 2024-09-11T00:18:00.813 INFO:tasks.workunit.client.0.smithi078.stdout:5/542: rename d7/d8/d33/d22/d25/d6a/db7 to d7/d8/d33/d22/d25/d6a/dc0 0 2024-09-11T00:18:00.813 INFO:tasks.workunit.client.0.smithi078.stdout:7/616: dread d0/d34/db/d30/d1d/d14/f2a [0,4194304] 0 2024-09-11T00:18:00.814 INFO:tasks.workunit.client.0.smithi078.stdout:1/925: symlink d3/db3/l131 0 2024-09-11T00:18:00.817 INFO:tasks.workunit.client.0.smithi078.stdout:3/630: creat d0/d7/d18/fbc x:0 0 0 2024-09-11T00:18:00.817 INFO:tasks.workunit.client.0.smithi078.stdout:3/631: dread - d0/d7/d46/d86/fa5 zero size 2024-09-11T00:18:00.818 INFO:tasks.workunit.client.0.smithi078.stdout:2/651: dwrite d0/d1/d6/f87 [0,4194304] 0 2024-09-11T00:18:00.818 INFO:tasks.workunit.client.0.smithi078.stdout:2/652: write d0/d1/d11/d1b/f6d [574566,45312] 0 2024-09-11T00:18:00.820 INFO:tasks.workunit.client.0.smithi078.stdout:5/543: rename d7/d8/d47/l86 to d7/d8/d56/d9e/lc1 0 2024-09-11T00:18:00.822 INFO:tasks.workunit.client.0.smithi078.stdout:7/617: creat d0/d34/db/d32/fb4 x:0 0 0 2024-09-11T00:18:00.823 INFO:tasks.workunit.client.0.smithi078.stdout:1/926: truncate d3/d29/d5f/d39/d61/f113 4096210 0 2024-09-11T00:18:00.823 INFO:tasks.workunit.client.0.smithi078.stdout:1/927: readlink d3/d29/d5f/d39/d61/d96/lb8 0 2024-09-11T00:18:00.824 INFO:tasks.workunit.client.0.smithi078.stdout:2/653: symlink d0/d1/d6f/ldc 0 2024-09-11T00:18:00.824 INFO:tasks.workunit.client.0.smithi078.stdout:2/654: write d0/d1/d11/d60/da2/d38/f81 [1642762,89384] 0 2024-09-11T00:18:00.824 INFO:tasks.workunit.client.0.smithi078.stdout:2/655: fsync d0/d1/d11/d60/da2/d3a/fc7 0 2024-09-11T00:18:00.826 INFO:tasks.workunit.client.0.smithi078.stdout:3/632: rename d0/d7/d46/d86/fa6 to d0/d7/d18/d1b/fbd 0 2024-09-11T00:18:00.827 INFO:tasks.workunit.client.0.smithi078.stdout:7/618: mknod d0/d34/db/d30/d1d/d14/d62/cb5 0 2024-09-11T00:18:00.827 INFO:tasks.workunit.client.0.smithi078.stdout:7/619: truncate d0/d34/db/d30/d1d/d14/d62/f84 5145262 0 2024-09-11T00:18:00.828 INFO:tasks.workunit.client.0.smithi078.stdout:7/620: chown d0/d3f/c73 0 1 2024-09-11T00:18:00.828 INFO:tasks.workunit.client.0.smithi078.stdout:7/621: chown d0/d34/d86/c95 45154486 1 2024-09-11T00:18:00.828 INFO:tasks.workunit.client.0.smithi078.stdout:3/633: chown d0/d7/d46/f7e 0 1 2024-09-11T00:18:00.828 INFO:tasks.workunit.client.0.smithi078.stdout:3/634: truncate d0/d39/f71 380953 0 2024-09-11T00:18:00.832 INFO:tasks.workunit.client.0.smithi078.stdout:3/635: creat d0/d7/d18/d1b/d34/d60/d6d/fbe x:0 0 0 2024-09-11T00:18:00.832 INFO:tasks.workunit.client.0.smithi078.stdout:3/636: read d0/d7/d18/d1b/d34/d60/d6d/f30 [81996,30550] 0 2024-09-11T00:18:00.833 INFO:tasks.workunit.client.0.smithi078.stdout:4/767: dwrite dc/d10/d3c/fb0 [4194304,4194304] 0 2024-09-11T00:18:00.833 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:00 smithi078 ceph-mon[30865]: pgmap v369: 97 pgs: 97 active+clean; 1.1 GiB data, 984 MiB used, 1.0 TiB / 1.0 TiB avail; 101 MiB/s rd, 136 MiB/s wr, 473 op/s 2024-09-11T00:18:00.834 INFO:tasks.workunit.client.0.smithi078.stdout:7/622: symlink d0/d34/db/d30/d1d/lb6 0 2024-09-11T00:18:00.835 INFO:tasks.workunit.client.0.smithi078.stdout:1/928: dread d3/d1a/d21/f22 [0,4194304] 0 2024-09-11T00:18:00.838 INFO:tasks.workunit.client.0.smithi078.stdout:7/623: unlink d0/d34/db/d32/lab 0 2024-09-11T00:18:00.838 INFO:tasks.workunit.client.0.smithi078.stdout:7/624: write d0/d34/db/d30/f3e [8948608,21773] 0 2024-09-11T00:18:00.838 INFO:tasks.workunit.client.0.smithi078.stdout:7/625: fdatasync d0/d34/db/d30/d1d/d81/fa9 0 2024-09-11T00:18:00.838 INFO:tasks.workunit.client.0.smithi078.stdout:7/626: chown d0/d34/db/d30/d1d/fa5 115 1 2024-09-11T00:18:00.839 INFO:tasks.workunit.client.0.smithi078.stdout:3/637: symlink d0/d7/d46/lbf 0 2024-09-11T00:18:00.839 INFO:tasks.workunit.client.0.smithi078.stdout:3/638: chown d0/d7/d18/d1b 14454743 1 2024-09-11T00:18:00.839 INFO:tasks.workunit.client.0.smithi078.stdout:1/929: creat d3/d1a/d21/d88/d127/f132 x:0 0 0 2024-09-11T00:18:00.841 INFO:tasks.workunit.client.0.smithi078.stdout:7/627: creat d0/d34/db/da0/fb7 x:0 0 0 2024-09-11T00:18:00.842 INFO:tasks.workunit.client.0.smithi078.stdout:1/930: mkdir d3/d133 0 2024-09-11T00:18:00.842 INFO:tasks.workunit.client.0.smithi078.stdout:1/931: truncate d3/d1a/d21/d4a/d90/dc7/dc9/f130 584668 0 2024-09-11T00:18:00.842 INFO:tasks.workunit.client.0.smithi078.stdout:1/932: write d3/d1a/d21/d88/d127/f132 [793479,77288] 0 2024-09-11T00:18:00.842 INFO:tasks.workunit.client.0.smithi078.stdout:1/933: write d3/d29/d5f/f8 [9221018,120463] 0 2024-09-11T00:18:00.842 INFO:tasks.workunit.client.0.smithi078.stdout:1/934: fdatasync d3/d1a/d21/d4a/d90/dd7/fef 0 2024-09-11T00:18:00.842 INFO:tasks.workunit.client.0.smithi078.stdout:1/935: chown d3/d133 1 1 2024-09-11T00:18:00.844 INFO:tasks.workunit.client.0.smithi078.stdout:7/628: creat d0/d34/db/d30/d28/fb8 x:0 0 0 2024-09-11T00:18:00.844 INFO:tasks.workunit.client.0.smithi078.stdout:7/629: chown d0/d34/db/f5c 245472 1 2024-09-11T00:18:00.844 INFO:tasks.workunit.client.0.smithi078.stdout:7/630: write d0/d34/db/d30/d28/fb8 [500725,19258] 0 2024-09-11T00:18:00.845 INFO:tasks.workunit.client.0.smithi078.stdout:5/544: dwrite d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f20 [4194304,4194304] 0 2024-09-11T00:18:00.845 INFO:tasks.workunit.client.0.smithi078.stdout:3/639: dread d0/d7/d46/d86/d9a/fa2 [0,4194304] 0 2024-09-11T00:18:00.846 INFO:tasks.workunit.client.0.smithi078.stdout:1/936: rename d3/d29/d5f/d39/d61/l8a to d3/d29/d5f/d39/d61/d96/daf/d126/l134 0 2024-09-11T00:18:00.846 INFO:tasks.workunit.client.0.smithi078.stdout:1/937: write d3/d29/f11d [4865204,9758] 0 2024-09-11T00:18:00.847 INFO:tasks.workunit.client.0.smithi078.stdout:2/656: dwrite d0/d1/d8/f12 [0,4194304] 0 2024-09-11T00:18:00.848 INFO:tasks.workunit.client.0.smithi078.stdout:1/938: symlink d3/d1a/d21/d4a/d90/dc7/dc9/l135 0 2024-09-11T00:18:00.849 INFO:tasks.workunit.client.0.smithi078.stdout:2/657: creat d0/d1/d11/d1b/d1e/fdd x:0 0 0 2024-09-11T00:18:00.849 INFO:tasks.workunit.client.0.smithi078.stdout:2/658: read - d0/d1/d11/d60/fab zero size 2024-09-11T00:18:00.852 INFO:tasks.workunit.client.0.smithi078.stdout:7/631: dread d0/d34/db/d30/d1d/f8a [0,4194304] 0 2024-09-11T00:18:00.856 INFO:tasks.workunit.client.0.smithi078.stdout:2/659: dread d0/d1/d3b/f4e [0,4194304] 0 2024-09-11T00:18:00.856 INFO:tasks.workunit.client.0.smithi078.stdout:2/660: chown d0/d1/d11/d60/da2/d3a/fd3 891 1 2024-09-11T00:18:00.857 INFO:tasks.workunit.client.0.smithi078.stdout:2/661: rename d0/d1/d6/d52/fbb to d0/d1/d3b/fde 0 2024-09-11T00:18:00.857 INFO:tasks.workunit.client.0.smithi078.stdout:4/768: dwrite dc/d10/d1f/f53 [0,4194304] 0 2024-09-11T00:18:00.858 INFO:tasks.workunit.client.0.smithi078.stdout:2/662: creat d0/d1/d11/d1b/fdf x:0 0 0 2024-09-11T00:18:00.861 INFO:tasks.workunit.client.0.smithi078.stdout:5/545: dwrite d7/d8/de/d90/fbe [0,4194304] 0 2024-09-11T00:18:00.862 INFO:tasks.workunit.client.0.smithi078.stdout:1/939: read d3/d29/d5f/d39/f63 [3326670,97952] 0 2024-09-11T00:18:00.865 INFO:tasks.workunit.client.0.smithi078.stdout:5/546: link d7/d8/d33/d22/l81 d7/d8/d33/d22/d25/d28/da8/lc2 0 2024-09-11T00:18:00.865 INFO:tasks.workunit.client.0.smithi078.stdout:5/547: stat d7/d8/de/fa1 0 2024-09-11T00:18:00.866 INFO:tasks.workunit.client.0.smithi078.stdout:1/940: rename d3/dc6/fd0 to d3/d29/d45/f136 0 2024-09-11T00:18:00.866 INFO:tasks.workunit.client.0.smithi078.stdout:4/769: write dc/f2d [4084584,91092] 0 2024-09-11T00:18:00.866 INFO:tasks.workunit.client.0.smithi078.stdout:5/548: getdents d7/d8/de/d2c/d62 0 2024-09-11T00:18:00.868 INFO:tasks.workunit.client.0.smithi078.stdout:1/941: mkdir d3/d29/d45/d137 0 2024-09-11T00:18:00.868 INFO:tasks.workunit.client.0.smithi078.stdout:5/549: dread d7/d8/d33/d22/d25/d28/d24/d1c/d1e/fa2 [0,4194304] 0 2024-09-11T00:18:00.869 INFO:tasks.workunit.client.0.smithi078.stdout:4/770: truncate dc/d10/d40/d3a/d65/d7b/d9e/f45 2776021 0 2024-09-11T00:18:00.869 INFO:tasks.workunit.client.0.smithi078.stdout:7/632: dread d0/d34/f24 [0,4194304] 0 2024-09-11T00:18:00.870 INFO:tasks.workunit.client.0.smithi078.stdout:5/550: creat d7/d8/d33/d22/d25/db1/fc3 x:0 0 0 2024-09-11T00:18:00.871 INFO:tasks.workunit.client.0.smithi078.stdout:4/771: link dc/d10/l1c dc/d10/d1f/d68/l103 0 2024-09-11T00:18:00.871 INFO:tasks.workunit.client.0.smithi078.stdout:4/772: chown dc/d54/fd4 119 1 2024-09-11T00:18:00.871 INFO:tasks.workunit.client.0.smithi078.stdout:4/773: chown dc/d10/d40/d3a/d65/c36 1622389821 1 2024-09-11T00:18:00.872 INFO:tasks.workunit.client.0.smithi078.stdout:4/774: chown dc/d10/d40/d3a/d46/d59/f5f 6972 1 2024-09-11T00:18:00.872 INFO:tasks.workunit.client.0.smithi078.stdout:4/775: chown dc/f1e 0 1 2024-09-11T00:18:00.872 INFO:tasks.workunit.client.0.smithi078.stdout:3/640: dwrite d0/d39/f97 [0,4194304] 0 2024-09-11T00:18:00.872 INFO:tasks.workunit.client.0.smithi078.stdout:7/633: getdents d0/d34/d65 0 2024-09-11T00:18:00.872 INFO:tasks.workunit.client.0.smithi078.stdout:7/634: readlink d0/d34/l1f 0 2024-09-11T00:18:00.872 INFO:tasks.workunit.client.0.smithi078.stdout:5/551: symlink d7/d8/de/d2c/lc4 0 2024-09-11T00:18:00.874 INFO:tasks.workunit.client.0.smithi078.stdout:3/641: rename d0/d7/d23/d7c/cb5 to d0/d7/d18/d1b/d34/d60/d6d/cc0 0 2024-09-11T00:18:00.874 INFO:tasks.workunit.client.0.smithi078.stdout:7/635: symlink d0/d34/db/d32/lb9 0 2024-09-11T00:18:00.874 INFO:tasks.workunit.client.0.smithi078.stdout:7/636: stat d0/d34/db/d30/d28/f67 0 2024-09-11T00:18:00.876 INFO:tasks.workunit.client.0.smithi078.stdout:4/776: dread dc/ff [4194304,4194304] 0 2024-09-11T00:18:00.882 INFO:tasks.workunit.client.0.smithi078.stdout:4/777: dread dc/d10/d40/d3a/d65/d7b/f96 [0,4194304] 0 2024-09-11T00:18:00.884 INFO:tasks.workunit.client.0.smithi078.stdout:4/778: mknod dc/d10/d40/d3a/d46/d59/c104 0 2024-09-11T00:18:00.884 INFO:tasks.workunit.client.0.smithi078.stdout:4/779: fdatasync dc/d10/d40/d3a/d65/d7b/d9e/f3e 0 2024-09-11T00:18:00.886 INFO:tasks.workunit.client.0.smithi078.stdout:4/780: rename dc/l7f to dc/d10/d40/l105 0 2024-09-11T00:18:00.886 INFO:tasks.workunit.client.0.smithi078.stdout:3/642: dread d0/d7/d18/d1b/d34/d3e/f5f [0,4194304] 0 2024-09-11T00:18:00.887 INFO:tasks.workunit.client.0.smithi078.stdout:4/781: mkdir dc/d10/d40/d3a/d65/d7b/d9e/d50/d106 0 2024-09-11T00:18:00.887 INFO:tasks.workunit.client.0.smithi078.stdout:3/643: creat d0/d39/fc1 x:0 0 0 2024-09-11T00:18:00.889 INFO:tasks.workunit.client.0.smithi078.stdout:3/644: link d0/d7/d18/d8c/cb8 d0/d1a/cc2 0 2024-09-11T00:18:00.891 INFO:tasks.workunit.client.0.smithi078.stdout:2/663: dwrite d0/d1/d11/d60/da2/d3a/fc7 [0,4194304] 0 2024-09-11T00:18:00.892 INFO:tasks.workunit.client.0.smithi078.stdout:5/552: dwrite d7/d8/d56/f75 [0,4194304] 0 2024-09-11T00:18:00.894 INFO:tasks.workunit.client.0.smithi078.stdout:4/782: write dc/d10/d40/d3a/d46/f89 [2913419,124197] 0 2024-09-11T00:18:00.894 INFO:tasks.workunit.client.0.smithi078.stdout:2/664: unlink d0/d1/d11/d60/da2/d38/f4b 0 2024-09-11T00:18:00.895 INFO:tasks.workunit.client.0.smithi078.stdout:5/553: truncate d7/d8/d33/d22/d25/f5e 27062 0 2024-09-11T00:18:00.896 INFO:tasks.workunit.client.0.smithi078.stdout:3/645: dread d0/f65 [0,4194304] 0 2024-09-11T00:18:00.896 INFO:tasks.workunit.client.0.smithi078.stdout:4/783: symlink dc/d10/d40/d3a/d46/dad/l107 0 2024-09-11T00:18:00.897 INFO:tasks.workunit.client.0.smithi078.stdout:5/554: truncate d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d5b/f76 8350146 0 2024-09-11T00:18:00.897 INFO:tasks.workunit.client.0.smithi078.stdout:3/646: truncate d0/d7/d18/d1b/d34/d3e/f5d 1708830 0 2024-09-11T00:18:00.898 INFO:tasks.workunit.client.0.smithi078.stdout:3/647: readlink d0/d7/d23/l2a 0 2024-09-11T00:18:00.898 INFO:tasks.workunit.client.0.smithi078.stdout:7/637: dread d0/d34/db/d30/d1d/f2c [0,4194304] 0 2024-09-11T00:18:00.898 INFO:tasks.workunit.client.0.smithi078.stdout:4/784: mkdir dc/d10/d40/d3a/d65/d7b/d108 0 2024-09-11T00:18:00.898 INFO:tasks.workunit.client.0.smithi078.stdout:4/785: dread - dc/d10/d40/d3a/d65/d7b/d8b/dc5/fe6 zero size 2024-09-11T00:18:00.899 INFO:tasks.workunit.client.0.smithi078.stdout:4/786: fsync dc/d10/d3c/f67 0 2024-09-11T00:18:00.900 INFO:tasks.workunit.client.0.smithi078.stdout:7/638: truncate d0/d34/d65/f83 3047322 0 2024-09-11T00:18:00.901 INFO:tasks.workunit.client.0.smithi078.stdout:4/787: mkdir dc/d10/ddd/d109 0 2024-09-11T00:18:00.901 INFO:tasks.workunit.client.0.smithi078.stdout:7/639: creat d0/fba x:0 0 0 2024-09-11T00:18:00.902 INFO:tasks.workunit.client.0.smithi078.stdout:7/640: fsync d0/d34/db/d30/d1d/d14/d62/d93/fae 0 2024-09-11T00:18:00.902 INFO:tasks.workunit.client.0.smithi078.stdout:4/788: getdents dc/d10/d1f/d68 0 2024-09-11T00:18:00.903 INFO:tasks.workunit.client.0.smithi078.stdout:2/665: dread d0/d19/f2c [0,4194304] 0 2024-09-11T00:18:00.904 INFO:tasks.workunit.client.0.smithi078.stdout:3/648: dread d0/f10 [0,4194304] 0 2024-09-11T00:18:00.904 INFO:tasks.workunit.client.0.smithi078.stdout:3/649: truncate d0/f10 1637092 0 2024-09-11T00:18:00.904 INFO:tasks.workunit.client.0.smithi078.stdout:4/789: write dc/d10/fa7 [657736,71973] 0 2024-09-11T00:18:00.905 INFO:tasks.workunit.client.0.smithi078.stdout:1/942: dwrite d3/d29/d45/f12c [0,4194304] 0 2024-09-11T00:18:00.905 INFO:tasks.workunit.client.0.smithi078.stdout:2/666: write d0/d19/f5d [791041,61943] 0 2024-09-11T00:18:00.908 INFO:tasks.workunit.client.0.smithi078.stdout:7/641: dread d0/d34/db/f8e [0,4194304] 0 2024-09-11T00:18:00.908 INFO:tasks.workunit.client.0.smithi078.stdout:3/650: creat d0/d7/d23/d7c/fc3 x:0 0 0 2024-09-11T00:18:00.908 INFO:tasks.workunit.client.0.smithi078.stdout:3/651: dread - d0/d7/d46/d86/fa5 zero size 2024-09-11T00:18:00.909 INFO:tasks.workunit.client.0.smithi078.stdout:4/790: creat dc/f10a x:0 0 0 2024-09-11T00:18:00.909 INFO:tasks.workunit.client.0.smithi078.stdout:4/791: stat dc/d10/cac 0 2024-09-11T00:18:00.911 INFO:tasks.workunit.client.0.smithi078.stdout:2/667: creat d0/d1/d6f/d93/dc3/dc4/dd4/fe0 x:0 0 0 2024-09-11T00:18:00.911 INFO:tasks.workunit.client.0.smithi078.stdout:2/668: fdatasync d0/d19/fa5 0 2024-09-11T00:18:00.913 INFO:tasks.workunit.client.0.smithi078.stdout:7/642: creat d0/d34/d86/fbb x:0 0 0 2024-09-11T00:18:00.913 INFO:tasks.workunit.client.0.smithi078.stdout:7/643: fsync d0/d34/db/f51 0 2024-09-11T00:18:00.914 INFO:tasks.workunit.client.0.smithi078.stdout:4/792: creat dc/d10/d40/d3a/d46/d59/d9f/f10b x:0 0 0 2024-09-11T00:18:00.914 INFO:tasks.workunit.client.0.smithi078.stdout:4/793: write dc/d10/d40/d3a/f90 [1018531,115843] 0 2024-09-11T00:18:00.914 INFO:tasks.workunit.client.0.smithi078.stdout:1/943: mkdir d3/d29/d5f/d138 0 2024-09-11T00:18:00.915 INFO:tasks.workunit.client.0.smithi078.stdout:7/644: write d0/f50 [707617,121855] 0 2024-09-11T00:18:00.915 INFO:tasks.workunit.client.0.smithi078.stdout:2/669: creat d0/d19/d3d/d8d/d8e/dcd/fe1 x:0 0 0 2024-09-11T00:18:00.916 INFO:tasks.workunit.client.0.smithi078.stdout:5/555: dwrite d7/d8/de/d2c/fa6 [0,4194304] 0 2024-09-11T00:18:00.917 INFO:tasks.workunit.client.0.smithi078.stdout:1/944: creat d3/d1a/d21/d4a/d90/d12f/f139 x:0 0 0 2024-09-11T00:18:00.917 INFO:tasks.workunit.client.0.smithi078.stdout:2/670: symlink d0/d1/d33/d86/db4/le2 0 2024-09-11T00:18:00.921 INFO:tasks.workunit.client.0.smithi078.stdout:5/556: rename d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d5b to d7/d8/d33/d22/da3/dc5 0 2024-09-11T00:18:00.921 INFO:tasks.workunit.client.0.smithi078.stdout:5/557: write d7/d8/f77 [4423396,61449] 0 2024-09-11T00:18:00.921 INFO:tasks.workunit.client.0.smithi078.stdout:1/945: mkdir d3/d133/d13a 0 2024-09-11T00:18:00.923 INFO:tasks.workunit.client.0.smithi078.stdout:2/671: creat d0/d1/d11/d60/fe3 x:0 0 0 2024-09-11T00:18:00.925 INFO:tasks.workunit.client.0.smithi078.stdout:5/558: unlink d7/d8/d56/d2a/c74 0 2024-09-11T00:18:00.925 INFO:tasks.workunit.client.0.smithi078.stdout:4/794: write dc/d10/f3d [2093645,31738] 0 2024-09-11T00:18:00.925 INFO:tasks.workunit.client.0.smithi078.stdout:3/652: dwrite d0/d7/d18/d70/f76 [4194304,4194304] 0 2024-09-11T00:18:00.926 INFO:tasks.workunit.client.0.smithi078.stdout:1/946: mknod d3/d1a/d21/d88/c13b 0 2024-09-11T00:18:00.926 INFO:tasks.workunit.client.0.smithi078.stdout:1/947: fdatasync d3/d1a/d21/dcf/fd6 0 2024-09-11T00:18:00.926 INFO:tasks.workunit.client.0.smithi078.stdout:1/948: stat d3/l20 0 2024-09-11T00:18:00.926 INFO:tasks.workunit.client.0.smithi078.stdout:4/795: write dc/d10/d40/d3a/d46/f6b [525161,33916] 0 2024-09-11T00:18:00.926 INFO:tasks.workunit.client.0.smithi078.stdout:4/796: readlink dc/d54/l99 0 2024-09-11T00:18:00.927 INFO:tasks.workunit.client.0.smithi078.stdout:2/672: link d0/d1/d6f/ldc d0/d1/d33/d86/db4/le4 0 2024-09-11T00:18:00.927 INFO:tasks.workunit.client.0.smithi078.stdout:5/559: symlink d7/d8/d33/d22/d25/d6a/dc0/lc6 0 2024-09-11T00:18:00.928 INFO:tasks.workunit.client.0.smithi078.stdout:5/560: chown d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f5f 18722 1 2024-09-11T00:18:00.928 INFO:tasks.workunit.client.0.smithi078.stdout:5/561: read d7/d8/d33/d22/d25/d28/f31 [4232890,47790] 0 2024-09-11T00:18:00.928 INFO:tasks.workunit.client.0.smithi078.stdout:5/562: write d7/d8/de/f69 [1276833,5393] 0 2024-09-11T00:18:00.929 INFO:tasks.workunit.client.0.smithi078.stdout:3/653: truncate d0/d7/d23/d7c/f9d 18112 0 2024-09-11T00:18:00.930 INFO:tasks.workunit.client.0.smithi078.stdout:1/949: creat d3/d1a/d21/d4a/dfa/f13c x:0 0 0 2024-09-11T00:18:00.936 INFO:tasks.workunit.client.0.smithi078.stdout:3/654: dread d0/d7/d18/d1b/fbd [0,4194304] 0 2024-09-11T00:18:00.937 INFO:tasks.workunit.client.0.smithi078.stdout:7/645: dwrite d0/d34/d86/fbb [0,4194304] 0 2024-09-11T00:18:00.937 INFO:tasks.workunit.client.0.smithi078.stdout:4/797: symlink dc/d10/d40/d3a/d65/d7b/d9e/d5d/l10c 0 2024-09-11T00:18:00.937 INFO:tasks.workunit.client.0.smithi078.stdout:2/673: link d0/d1/d11/d60/da2/fb3 d0/d1/d33/d86/db4/fe5 0 2024-09-11T00:18:00.937 INFO:tasks.workunit.client.0.smithi078.stdout:5/563: mkdir d7/d8/d56/d2a/dc7 0 2024-09-11T00:18:00.937 INFO:tasks.workunit.client.0.smithi078.stdout:2/674: read - d0/d1/d3c/d40/d50/fda zero size 2024-09-11T00:18:00.937 INFO:tasks.workunit.client.0.smithi078.stdout:7/646: write d0/d34/db/d30/d28/fb8 [717357,91704] 0 2024-09-11T00:18:00.937 INFO:tasks.workunit.client.0.smithi078.stdout:7/647: write d0/d34/db/da0/fb7 [842014,121682] 0 2024-09-11T00:18:00.937 INFO:tasks.workunit.client.0.smithi078.stdout:7/648: chown d0/d34/f24 34 1 2024-09-11T00:18:00.937 INFO:tasks.workunit.client.0.smithi078.stdout:7/649: readlink d0/l19 0 2024-09-11T00:18:00.947 INFO:tasks.workunit.client.0.smithi078.stdout:4/798: getdents dc/d10/d40/d3a/d4c/db4/d72/dbb 0 2024-09-11T00:18:00.948 INFO:tasks.workunit.client.0.smithi078.stdout:1/950: dwrite d3/d1a/d21/d4a/d90/d12f/f118 [0,4194304] 0 2024-09-11T00:18:00.949 INFO:tasks.workunit.client.0.smithi078.stdout:2/675: rmdir d0/d19 39 2024-09-11T00:18:00.949 INFO:tasks.workunit.client.0.smithi078.stdout:2/676: read d0/d67/fb2 [959516,34938] 0 2024-09-11T00:18:00.949 INFO:tasks.workunit.client.0.smithi078.stdout:2/677: fdatasync d0/fd9 0 2024-09-11T00:18:00.950 INFO:tasks.workunit.client.0.smithi078.stdout:7/650: unlink d0/d34/db/d30/d1d/d14/d87/l8c 0 2024-09-11T00:18:00.954 INFO:tasks.workunit.client.0.smithi078.stdout:5/564: dwrite d7/d8/de/d2c/f94 [0,4194304] 0 2024-09-11T00:18:00.954 INFO:tasks.workunit.client.0.smithi078.stdout:5/565: chown d7/d8/d33/d22/d25/c48 181754652 1 2024-09-11T00:18:00.954 INFO:tasks.workunit.client.0.smithi078.stdout:5/566: fdatasync d7/d8/d33/d22/d25/d28/d24/d1c/f82 0 2024-09-11T00:18:00.954 INFO:tasks.workunit.client.0.smithi078.stdout:3/655: mknod d0/d7/d46/cc4 0 2024-09-11T00:18:00.958 INFO:tasks.workunit.client.0.smithi078.stdout:4/799: creat dc/d10/d40/d3a/d65/d7b/d9e/d5d/f10d x:0 0 0 2024-09-11T00:18:00.958 INFO:tasks.workunit.client.0.smithi078.stdout:4/800: chown dc/d10/d40/d3a/d65/f63 0 1 2024-09-11T00:18:00.971 INFO:tasks.workunit.client.0.smithi078.stdout:1/951: creat d3/d1a/d21/d4a/d90/dc7/f13d x:0 0 0 2024-09-11T00:18:00.972 INFO:tasks.workunit.client.0.smithi078.stdout:2/678: truncate d0/d1/d33/d86/db4/f65 506558 0 2024-09-11T00:18:00.972 INFO:tasks.workunit.client.0.smithi078.stdout:2/679: chown d0/d19/d3d/d8d 62 1 2024-09-11T00:18:00.974 INFO:tasks.workunit.client.0.smithi078.stdout:5/567: rename d7/d8/d56 to d7/d8/d33/d22/da3/dc5/dc8 0 2024-09-11T00:18:00.974 INFO:tasks.workunit.client.0.smithi078.stdout:5/568: fsync d7/d8/d33/d22/f2d 0 2024-09-11T00:18:00.975 INFO:tasks.workunit.client.0.smithi078.stdout:3/656: link d0/f1f d0/d7/d46/d86/d9a/fc5 0 2024-09-11T00:18:00.981 INFO:tasks.workunit.client.0.smithi078.stdout:1/952: mkdir d3/d1a/d21/d4a/d13e 0 2024-09-11T00:18:00.981 INFO:tasks.workunit.client.0.smithi078.stdout:1/953: chown d3/d1a/d21/d4a/d90/dc7/dc9/cf1 110 1 2024-09-11T00:18:00.981 INFO:tasks.workunit.client.0.smithi078.stdout:1/954: readlink d3/d29/d5f/d39/d61/ld2 0 2024-09-11T00:18:00.981 INFO:tasks.workunit.client.0.smithi078.stdout:1/955: write d3/d1a/d21/d4a/f125 [352681,9331] 0 2024-09-11T00:18:00.981 INFO:tasks.workunit.client.0.smithi078.stdout:4/801: rename dc/d10/d40/d3a/ce7 to dc/d10/d1f/d68/c10e 0 2024-09-11T00:18:00.983 INFO:tasks.workunit.client.0.smithi078.stdout:5/569: link d7/d8/d33/d22/da3/dc5/dc8/f83 d7/d8/d33/d22/d25/d6a/db0/fc9 0 2024-09-11T00:18:00.983 INFO:tasks.workunit.client.0.smithi078.stdout:5/570: chown d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f20 191 1 2024-09-11T00:18:00.983 INFO:tasks.workunit.client.0.smithi078.stdout:3/657: mknod d0/d7/d18/d1b/d8e/daf/cc6 0 2024-09-11T00:18:00.984 INFO:tasks.workunit.client.0.smithi078.stdout:5/571: rmdir d7/d8/d33/d22/d25 39 2024-09-11T00:18:00.985 INFO:tasks.workunit.client.0.smithi078.stdout:3/658: link d0/d7/d18/d1b/d34/d3e/cae d0/d7/d18/cc7 0 2024-09-11T00:18:00.985 INFO:tasks.workunit.client.0.smithi078.stdout:3/659: write d0/d7/d23/d91/f28 [3135297,129467] 0 2024-09-11T00:18:00.986 INFO:tasks.workunit.client.0.smithi078.stdout:2/680: dwrite d0/d1/d11/f69 [0,4194304] 0 2024-09-11T00:18:00.986 INFO:tasks.workunit.client.0.smithi078.stdout:2/681: chown d0/d1/d11/d60/da2/d38/l5e 943497 1 2024-09-11T00:18:00.987 INFO:tasks.workunit.client.0.smithi078.stdout:3/660: rename d0/d7/d18/l58 to d0/d39/lc8 0 2024-09-11T00:18:00.987 INFO:tasks.workunit.client.0.smithi078.stdout:2/682: rmdir d0/d19/d3d 39 2024-09-11T00:18:00.989 INFO:tasks.workunit.client.0.smithi078.stdout:3/661: rename d0/d7/d18/f40 to d0/d7/d46/d86/fc9 0 2024-09-11T00:18:00.989 INFO:tasks.workunit.client.0.smithi078.stdout:3/662: dread - d0/d7/d23/d91/fa7 zero size 2024-09-11T00:18:00.993 INFO:tasks.workunit.client.0.smithi078.stdout:3/663: unlink d0/d7/d46/f5e 0 2024-09-11T00:18:00.993 INFO:tasks.workunit.client.0.smithi078.stdout:3/664: fdatasync d0/d7/d46/f7e 0 2024-09-11T00:18:00.997 INFO:tasks.workunit.client.0.smithi078.stdout:6/645: sync 2024-09-11T00:18:00.999 INFO:tasks.workunit.client.0.smithi078.stdout:6/646: unlink d0/d1/d9/fc9 0 2024-09-11T00:18:01.001 INFO:tasks.workunit.client.0.smithi078.stdout:6/647: mknod d0/d1/d1b/cd6 0 2024-09-11T00:18:01.002 INFO:tasks.workunit.client.0.smithi078.stdout:6/648: mkdir d0/d1/d53/d9c/dac/dd7 0 2024-09-11T00:18:01.002 INFO:tasks.workunit.client.0.smithi078.stdout:6/649: chown d0/d1/d53/fbb 1321199 1 2024-09-11T00:18:01.002 INFO:tasks.workunit.client.0.smithi078.stdout:6/650: dread - d0/d1/d1b/f50 zero size 2024-09-11T00:18:01.002 INFO:tasks.workunit.client.0.smithi078.stdout:1/956: dwrite d3/d29/d45/f136 [0,4194304] 0 2024-09-11T00:18:01.003 INFO:tasks.workunit.client.0.smithi078.stdout:1/957: chown d3/d1a/d21/dcf/ff9 0 1 2024-09-11T00:18:01.005 INFO:tasks.workunit.client.0.smithi078.stdout:1/958: truncate d3/d1a/d21/d4a/d90/dc7/f104 3362963 0 2024-09-11T00:18:01.005 INFO:tasks.workunit.client.0.smithi078.stdout:1/959: truncate d3/d1a/d21/d4a/d90/dd7/fef 4477089 0 2024-09-11T00:18:01.005 INFO:tasks.workunit.client.0.smithi078.stdout:4/802: dwrite dc/d10/d40/d3a/d65/f22 [0,4194304] 0 2024-09-11T00:18:01.005 INFO:tasks.workunit.client.0.smithi078.stdout:4/803: stat dc/d10/d1f/d68/db5/ce5 0 2024-09-11T00:18:01.005 INFO:tasks.workunit.client.0.smithi078.stdout:4/804: chown dc/d10/d40 121790071 1 2024-09-11T00:18:01.006 INFO:tasks.workunit.client.0.smithi078.stdout:1/960: rename d3/d1a/d21/c42 to d3/dc6/c13f 0 2024-09-11T00:18:01.006 INFO:tasks.workunit.client.0.smithi078.stdout:1/961: fdatasync d3/d1a/d21/d4a/d90/d12f/fb0 0 2024-09-11T00:18:01.010 INFO:tasks.workunit.client.0.smithi078.stdout:1/962: dread d3/d29/d45/f60 [0,4194304] 0 2024-09-11T00:18:01.010 INFO:tasks.workunit.client.0.smithi078.stdout:1/963: fdatasync d3/f71 0 2024-09-11T00:18:01.010 INFO:tasks.workunit.client.0.smithi078.stdout:3/665: dwrite d0/d7/d18/f4c [0,4194304] 0 2024-09-11T00:18:01.010 INFO:tasks.workunit.client.0.smithi078.stdout:4/805: creat dc/d10/d40/d3a/d65/f10f x:0 0 0 2024-09-11T00:18:01.013 INFO:tasks.workunit.client.0.smithi078.stdout:3/666: dread d0/f10 [0,4194304] 0 2024-09-11T00:18:01.013 INFO:tasks.workunit.client.0.smithi078.stdout:3/667: fdatasync d0/d7/d18/f61 0 2024-09-11T00:18:01.013 INFO:tasks.workunit.client.0.smithi078.stdout:3/668: chown d0/d7 0 1 2024-09-11T00:18:01.013 INFO:tasks.workunit.client.0.smithi078.stdout:3/669: chown d0/d7/d18/d70/c96 379 1 2024-09-11T00:18:01.014 INFO:tasks.workunit.client.0.smithi078.stdout:4/806: creat dc/d10/d40/d3a/d4c/db4/d72/f110 x:0 0 0 2024-09-11T00:18:01.014 INFO:tasks.workunit.client.0.smithi078.stdout:4/807: chown dc/d10/d3c/fb0 116 1 2024-09-11T00:18:01.015 INFO:tasks.workunit.client.0.smithi078.stdout:3/670: rename d0/d7/d18/d1b/d34/d3e/c6f to d0/d7/cca 0 2024-09-11T00:18:01.016 INFO:tasks.workunit.client.0.smithi078.stdout:1/964: mknod d3/d29/d5f/d4e/c140 0 2024-09-11T00:18:01.016 INFO:tasks.workunit.client.0.smithi078.stdout:2/683: dwrite d0/d1/d6f/d93/dc3/dc4/dd4/fe0 [0,4194304] 0 2024-09-11T00:18:01.017 INFO:tasks.workunit.client.0.smithi078.stdout:3/671: mknod d0/d7/d46/d86/ccb 0 2024-09-11T00:18:01.020 INFO:tasks.workunit.client.0.smithi078.stdout:2/684: mkdir d0/d1/d11/d60/da2/d3a/d51/de6 0 2024-09-11T00:18:01.023 INFO:tasks.workunit.client.0.smithi078.stdout:2/685: mknod d0/d1/d33/d5f/ce7 0 2024-09-11T00:18:01.023 INFO:tasks.workunit.client.0.smithi078.stdout:2/686: write d0/d1/d11/d60/da2/d38/f64 [1032103,47235] 0 2024-09-11T00:18:01.023 INFO:tasks.workunit.client.0.smithi078.stdout:2/687: chown d0/d1/d3c/d9f/fa9 73256326 1 2024-09-11T00:18:01.025 INFO:tasks.workunit.client.0.smithi078.stdout:3/672: dread d0/d7/d46/f5b [0,4194304] 0 2024-09-11T00:18:01.025 INFO:tasks.workunit.client.0.smithi078.stdout:3/673: fsync d0/d7/d18/d1b/d34/d60/fba 0 2024-09-11T00:18:01.025 INFO:tasks.workunit.client.0.smithi078.stdout:3/674: chown d0/d7/d46/d86/ccb 355 1 2024-09-11T00:18:01.025 INFO:tasks.workunit.client.0.smithi078.stdout:2/688: creat d0/d1/d6/d52/da8/fe8 x:0 0 0 2024-09-11T00:18:01.025 INFO:tasks.workunit.client.0.smithi078.stdout:2/689: chown d0/d1/d11/d60/da2/d3a/d51/d97/dac 623 1 2024-09-11T00:18:01.026 INFO:tasks.workunit.client.0.smithi078.stdout:6/651: write d0/d66/f7f [7849015,4473] 0 2024-09-11T00:18:01.026 INFO:tasks.workunit.client.0.smithi078.stdout:5/572: dwrite d7/d8/d33/d22/f7a [0,4194304] 0 2024-09-11T00:18:01.026 INFO:tasks.workunit.client.0.smithi078.stdout:2/690: write d0/d1/d11/d60/fa4 [473855,14372] 0 2024-09-11T00:18:01.026 INFO:tasks.workunit.client.0.smithi078.stdout:2/691: chown d0/d1/d11 127 1 2024-09-11T00:18:01.026 INFO:tasks.workunit.client.0.smithi078.stdout:2/692: dread - d0/d19/d3d/d8d/fc9 zero size 2024-09-11T00:18:01.026 INFO:tasks.workunit.client.0.smithi078.stdout:2/693: dread - d0/d1/d11/d1b/fdf zero size 2024-09-11T00:18:01.026 INFO:tasks.workunit.client.0.smithi078.stdout:2/694: chown d0/d19/d3d 51891826 1 2024-09-11T00:18:01.031 INFO:tasks.workunit.client.0.smithi078.stdout:6/652: mknod d0/d1/d53/d72/cd8 0 2024-09-11T00:18:01.032 INFO:tasks.workunit.client.0.smithi078.stdout:2/695: getdents d0/d1/d3c/d40/d50 0 2024-09-11T00:18:01.034 INFO:tasks.workunit.client.0.smithi078.stdout:6/653: getdents d0/d1/d9/d8d 0 2024-09-11T00:18:01.035 INFO:tasks.workunit.client.0.smithi078.stdout:3/675: write d0/d7/d23/d91/f59 [2311858,120828] 0 2024-09-11T00:18:01.036 INFO:tasks.workunit.client.0.smithi078.stdout:1/965: dwrite d3/d1a/d21/d4a/d90/fbf [0,4194304] 0 2024-09-11T00:18:01.036 INFO:tasks.workunit.client.0.smithi078.stdout:1/966: write d3/d29/d5f/d39/fee [787656,13170] 0 2024-09-11T00:18:01.037 INFO:tasks.workunit.client.0.smithi078.stdout:1/967: dread - d3/d29/d5f/d39/d61/d96/daf/fc0 zero size 2024-09-11T00:18:01.037 INFO:tasks.workunit.client.0.smithi078.stdout:2/696: mknod d0/d1/d11/ce9 0 2024-09-11T00:18:01.038 INFO:tasks.workunit.client.0.smithi078.stdout:4/808: dwrite dc/d10/d1f/f35 [0,4194304] 0 2024-09-11T00:18:01.041 INFO:tasks.workunit.client.0.smithi078.stdout:6/654: mknod d0/d66/cd9 0 2024-09-11T00:18:01.041 INFO:tasks.workunit.client.0.smithi078.stdout:6/655: chown d0/d1/d1b/fae 243 1 2024-09-11T00:18:01.044 INFO:tasks.workunit.client.0.smithi078.stdout:5/573: dwrite d7/d8/de/f69 [0,4194304] 0 2024-09-11T00:18:01.044 INFO:tasks.workunit.client.0.smithi078.stdout:3/676: rename d0/d7/d18/d1b/d34/d3e/cae to d0/ccc 0 2024-09-11T00:18:01.046 INFO:tasks.workunit.client.0.smithi078.stdout:1/968: mknod d3/d29/dc4/d119/c141 0 2024-09-11T00:18:01.050 INFO:tasks.workunit.client.0.smithi078.stdout:2/697: mknod d0/d1/d6f/dd6/cea 0 2024-09-11T00:18:01.050 INFO:tasks.workunit.client.0.smithi078.stdout:2/698: write d0/d1/d6/d52/da8/fe8 [463307,79838] 0 2024-09-11T00:18:01.051 INFO:tasks.workunit.client.0.smithi078.stdout:6/656: mknod d0/d1/d9/d59/d74/d6b/cda 0 2024-09-11T00:18:01.053 INFO:tasks.workunit.client.0.smithi078.stdout:4/809: dwrite dc/d10/d40/d3a/d65/d7b/d9e/f3e [0,4194304] 0 2024-09-11T00:18:01.053 INFO:tasks.workunit.client.0.smithi078.stdout:4/810: readlink dc/d10/d40/d33/l48 0 2024-09-11T00:18:01.053 INFO:tasks.workunit.client.0.smithi078.stdout:4/811: write dc/f10a [256773,103852] 0 2024-09-11T00:18:01.053 INFO:tasks.workunit.client.0.smithi078.stdout:5/574: rmdir d7/d8/d33/d22/d25/d28/d24 39 2024-09-11T00:18:01.053 INFO:tasks.workunit.client.0.smithi078.stdout:5/575: read - d7/d8/de/d2c/f99 zero size 2024-09-11T00:18:01.053 INFO:tasks.workunit.client.0.smithi078.stdout:3/677: rmdir d0/d7/d46 39 2024-09-11T00:18:01.054 INFO:tasks.workunit.client.0.smithi078.stdout:2/699: symlink d0/d19/d3d/d8d/leb 0 2024-09-11T00:18:01.055 INFO:tasks.workunit.client.0.smithi078.stdout:4/812: creat dc/d10/d40/d3a/d65/f111 x:0 0 0 2024-09-11T00:18:01.056 INFO:tasks.workunit.client.0.smithi078.stdout:4/813: write dc/d10/d1f/f20 [758343,29253] 0 2024-09-11T00:18:01.056 INFO:tasks.workunit.client.0.smithi078.stdout:5/576: mknod d7/d8/d33/da7/cca 0 2024-09-11T00:18:01.057 INFO:tasks.workunit.client.0.smithi078.stdout:4/814: write dc/d10/d1f/f2f [1635632,63695] 0 2024-09-11T00:18:01.057 INFO:tasks.workunit.client.0.smithi078.stdout:4/815: write dc/d10/d40/d33/fe1 [1213896,106384] 0 2024-09-11T00:18:01.057 INFO:tasks.workunit.client.0.smithi078.stdout:4/816: write dc/d10/d40/d33/f81 [62899,121332] 0 2024-09-11T00:18:01.057 INFO:tasks.workunit.client.0.smithi078.stdout:4/817: read dc/d10/d40/d3a/d4c/f41 [2220888,65084] 0 2024-09-11T00:18:01.057 INFO:tasks.workunit.client.0.smithi078.stdout:3/678: mkdir d0/d7/d23/dcd 0 2024-09-11T00:18:01.057 INFO:tasks.workunit.client.0.smithi078.stdout:3/679: chown d0/d39/fad 22 1 2024-09-11T00:18:01.058 INFO:tasks.workunit.client.0.smithi078.stdout:2/700: symlink d0/d1/d3c/d40/d98/lec 0 2024-09-11T00:18:01.060 INFO:tasks.workunit.client.0.smithi078.stdout:2/701: dread d0/d1/d33/d86/db4/f7e [0,4194304] 0 2024-09-11T00:18:01.060 INFO:tasks.workunit.client.0.smithi078.stdout:5/577: rmdir d7/d8/d33/d22/d25/db1 39 2024-09-11T00:18:01.064 INFO:tasks.workunit.client.0.smithi078.stdout:4/818: rmdir dc/d10/d40/d3a/d65/d7b/d9e/d50/d106 0 2024-09-11T00:18:01.065 INFO:tasks.workunit.client.0.smithi078.stdout:2/702: creat d0/d1/d3c/d40/d50/fed x:0 0 0 2024-09-11T00:18:01.065 INFO:tasks.workunit.client.0.smithi078.stdout:6/657: write d0/d1/d53/f88 [2565586,128990] 0 2024-09-11T00:18:01.065 INFO:tasks.workunit.client.0.smithi078.stdout:6/658: fdatasync d0/d1/d9/f24 0 2024-09-11T00:18:01.065 INFO:tasks.workunit.client.0.smithi078.stdout:1/969: dwrite d3/d1a/d21/d4a/d90/dc7/fdd [0,4194304] 0 2024-09-11T00:18:01.066 INFO:tasks.workunit.client.0.smithi078.stdout:5/578: mknod d7/d8/d33/d22/da3/dc5/dc8/d9e/ccb 0 2024-09-11T00:18:01.066 INFO:tasks.workunit.client.0.smithi078.stdout:5/579: read - d7/d8/de/fa1 zero size 2024-09-11T00:18:01.071 INFO:tasks.workunit.client.0.smithi078.stdout:1/970: rename d3/dc6/f9e to d3/d1a/d21/dcf/f142 0 2024-09-11T00:18:01.071 INFO:tasks.workunit.client.0.smithi078.stdout:2/703: dread d0/d1/d11/f24 [0,4194304] 0 2024-09-11T00:18:01.071 INFO:tasks.workunit.client.0.smithi078.stdout:2/704: readlink d0/d1/d6/d52/l8c 0 2024-09-11T00:18:01.071 INFO:tasks.workunit.client.0.smithi078.stdout:5/580: creat d7/d8/d33/d22/fcc x:0 0 0 2024-09-11T00:18:01.073 INFO:tasks.workunit.client.0.smithi078.stdout:1/971: rename d3/d1a/d21/d4a/d90/d12f/lb9 to d3/l143 0 2024-09-11T00:18:01.073 INFO:tasks.workunit.client.0.smithi078.stdout:1/972: write d3/d29/d5f/d39/d61/d96/daf/fc0 [313965,104825] 0 2024-09-11T00:18:01.073 INFO:tasks.workunit.client.0.smithi078.stdout:3/680: dwrite d0/d1a/f52 [0,4194304] 0 2024-09-11T00:18:01.073 INFO:tasks.workunit.client.0.smithi078.stdout:3/681: write d0/f1f [1419032,25001] 0 2024-09-11T00:18:01.074 INFO:tasks.workunit.client.0.smithi078.stdout:5/581: mknod d7/d8/d33/d22/d51/ccd 0 2024-09-11T00:18:01.074 INFO:tasks.workunit.client.0.smithi078.stdout:5/582: chown d7/d8/d33/d22/d25/d28/d24/d1c/l3f 141 1 2024-09-11T00:18:01.076 INFO:tasks.workunit.client.0.smithi078.stdout:4/819: dread dc/d54/fab [0,4194304] 0 2024-09-11T00:18:01.076 INFO:tasks.workunit.client.0.smithi078.stdout:4/820: fsync dc/fd 0 2024-09-11T00:18:01.076 INFO:tasks.workunit.client.0.smithi078.stdout:4/821: write dc/f10a [1301513,108950] 0 2024-09-11T00:18:01.079 INFO:tasks.workunit.client.0.smithi078.stdout:5/583: getdents d7/d8/d33/d22/d25/db1 0 2024-09-11T00:18:01.081 INFO:tasks.workunit.client.0.smithi078.stdout:5/584: mknod d7/d8/d33/d22/d25/d28/da8/cce 0 2024-09-11T00:18:01.081 INFO:tasks.workunit.client.0.smithi078.stdout:5/585: chown d7/d8/d33/d22/d25/f3a 96567330 1 2024-09-11T00:18:01.081 INFO:tasks.workunit.client.0.smithi078.stdout:2/705: dread d0/d1/d8/f12 [0,4194304] 0 2024-09-11T00:18:01.081 INFO:tasks.workunit.client.0.smithi078.stdout:2/706: chown d0/d1/d33/d86/fc1 33874914 1 2024-09-11T00:18:01.082 INFO:tasks.workunit.client.0.smithi078.stdout:1/973: dread d3/d1a/d21/d4a/f125 [0,4194304] 0 2024-09-11T00:18:01.083 INFO:tasks.workunit.client.0.smithi078.stdout:5/586: symlink d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d8c/lcf 0 2024-09-11T00:18:01.085 INFO:tasks.workunit.client.0.smithi078.stdout:1/974: creat d3/d29/d5f/f144 x:0 0 0 2024-09-11T00:18:01.085 INFO:tasks.workunit.client.0.smithi078.stdout:1/975: write d3/f116 [860309,30737] 0 2024-09-11T00:18:01.085 INFO:tasks.workunit.client.0.smithi078.stdout:6/659: dwrite d0/d1/d9/d17/fd1 [0,4194304] 0 2024-09-11T00:18:01.087 INFO:tasks.workunit.client.0.smithi078.stdout:1/976: mkdir d3/d29/d5f/d39/d61/d96/daf/de6/d145 0 2024-09-11T00:18:01.088 INFO:tasks.workunit.client.0.smithi078.stdout:3/682: write d0/d39/f57 [1142287,126953] 0 2024-09-11T00:18:01.090 INFO:tasks.workunit.client.0.smithi078.stdout:6/660: mknod d0/d1/da8/cdb 0 2024-09-11T00:18:01.091 INFO:tasks.workunit.client.0.smithi078.stdout:1/977: creat d3/d29/d5f/d39/f146 x:0 0 0 2024-09-11T00:18:01.093 INFO:tasks.workunit.client.0.smithi078.stdout:3/683: mkdir d0/d7/d23/d7c/da1/dce 0 2024-09-11T00:18:01.093 INFO:tasks.workunit.client.0.smithi078.stdout:3/684: chown d0/d7/d18/d8c/f9c 6143503 1 2024-09-11T00:18:01.095 INFO:tasks.workunit.client.0.smithi078.stdout:5/587: dread d7/d8/d33/f7e [0,4194304] 0 2024-09-11T00:18:01.096 INFO:tasks.workunit.client.0.smithi078.stdout:4/822: dwrite dc/d10/d40/d3a/d65/f3f [0,4194304] 0 2024-09-11T00:18:01.096 INFO:tasks.workunit.client.0.smithi078.stdout:4/823: readlink dc/d10/l49 0 2024-09-11T00:18:01.096 INFO:tasks.workunit.client.0.smithi078.stdout:4/824: write dc/d10/d40/d33/fe1 [2049134,11595] 0 2024-09-11T00:18:01.097 INFO:tasks.workunit.client.0.smithi078.stdout:1/978: mknod d3/d29/d5f/d39/d61/d96/daf/d126/c147 0 2024-09-11T00:18:01.098 INFO:tasks.workunit.client.0.smithi078.stdout:3/685: creat d0/d7/fcf x:0 0 0 2024-09-11T00:18:01.102 INFO:tasks.workunit.client.0.smithi078.stdout:5/588: truncate d7/d8/d33/d22/d25/d28/d24/d1c/f2e 1889448 0 2024-09-11T00:18:01.102 INFO:tasks.workunit.client.0.smithi078.stdout:5/589: readlink d7/d8/de/d2c/lc4 0 2024-09-11T00:18:01.104 INFO:tasks.workunit.client.0.smithi078.stdout:2/707: dwrite d0/d1/d11/d1b/f6d [0,4194304] 0 2024-09-11T00:18:01.104 INFO:tasks.workunit.client.0.smithi078.stdout:2/708: readlink d0/d1/d11/d60/da2/d38/l5e 0 2024-09-11T00:18:01.104 INFO:tasks.workunit.client.0.smithi078.stdout:2/709: readlink d0/d1/d3c/d40/l9b 0 2024-09-11T00:18:01.105 INFO:tasks.workunit.client.0.smithi078.stdout:4/825: creat dc/d10/d40/d3a/d65/f112 x:0 0 0 2024-09-11T00:18:01.108 INFO:tasks.workunit.client.0.smithi078.stdout:6/661: link d0/d1/d9/d17/d5e/f85 d0/d1/d1b/fdc 0 2024-09-11T00:18:01.110 INFO:tasks.workunit.client.0.smithi078.stdout:1/979: link d3/d106/f122 d3/d1a/d21/d4a/f148 0 2024-09-11T00:18:01.111 INFO:tasks.workunit.client.0.smithi078.stdout:3/686: symlink d0/d7/d18/d1b/d34/d60/ld0 0 2024-09-11T00:18:01.114 INFO:tasks.workunit.client.0.smithi078.stdout:4/826: truncate dc/d10/d40/d3a/d65/f22 710356 0 2024-09-11T00:18:01.115 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:00 smithi112 ceph-mon[35627]: pgmap v369: 97 pgs: 97 active+clean; 1.1 GiB data, 984 MiB used, 1.0 TiB / 1.0 TiB avail; 101 MiB/s rd, 136 MiB/s wr, 473 op/s 2024-09-11T00:18:01.116 INFO:tasks.workunit.client.0.smithi078.stdout:6/662: mknod d0/d1/d9/cdd 0 2024-09-11T00:18:01.118 INFO:tasks.workunit.client.0.smithi078.stdout:4/827: dread dc/d10/d40/d33/f81 [0,4194304] 0 2024-09-11T00:18:01.118 INFO:tasks.workunit.client.0.smithi078.stdout:4/828: fdatasync dc/d10/d40/d3a/d65/f92 0 2024-09-11T00:18:01.119 INFO:tasks.workunit.client.0.smithi078.stdout:1/980: mkdir d3/d29/d5f/d4e/d149 0 2024-09-11T00:18:01.121 INFO:tasks.workunit.client.0.smithi078.stdout:5/590: dwrite d7/d8/d33/d22/da3/f9f [0,4194304] 0 2024-09-11T00:18:01.121 INFO:tasks.workunit.client.0.smithi078.stdout:1/981: mkdir d3/d29/d5f/d39/d14a 0 2024-09-11T00:18:01.123 INFO:tasks.workunit.client.0.smithi078.stdout:5/591: rename d7/d8/d33/d22/da3/dc5/dc8/f83 to d7/d8/d33/d22/da3/dc5/dc8/d2a/dc7/fd0 0 2024-09-11T00:18:01.125 INFO:tasks.workunit.client.0.smithi078.stdout:3/687: dread d0/d39/f57 [0,4194304] 0 2024-09-11T00:18:01.125 INFO:tasks.workunit.client.0.smithi078.stdout:2/710: dwrite d0/d67/f7a [0,4194304] 0 2024-09-11T00:18:01.125 INFO:tasks.workunit.client.0.smithi078.stdout:2/711: chown d0/d1/d3b/f84 338512199 1 2024-09-11T00:18:01.126 INFO:tasks.workunit.client.0.smithi078.stdout:5/592: creat d7/d8/d33/da7/fd1 x:0 0 0 2024-09-11T00:18:01.126 INFO:tasks.workunit.client.0.smithi078.stdout:5/593: write d7/d8/de/ff [1799525,56827] 0 2024-09-11T00:18:01.126 INFO:tasks.workunit.client.0.smithi078.stdout:6/663: dread d0/d1/d9/d59/d74/fcb [0,4194304] 0 2024-09-11T00:18:01.126 INFO:tasks.workunit.client.0.smithi078.stdout:6/664: write d0/f3b [4791977,104951] 0 2024-09-11T00:18:01.129 INFO:tasks.workunit.client.0.smithi078.stdout:1/982: link d3/f40 d3/d29/d5f/d4e/f14b 0 2024-09-11T00:18:01.133 INFO:tasks.workunit.client.0.smithi078.stdout:2/712: rmdir d0/d1/d11 39 2024-09-11T00:18:01.134 INFO:tasks.workunit.client.0.smithi078.stdout:2/713: write d0/d1/d11/d1b/d1e/fbf [176027,129982] 0 2024-09-11T00:18:01.134 INFO:tasks.workunit.client.0.smithi078.stdout:2/714: chown d0/d1/d33/f4d 500337164 1 2024-09-11T00:18:01.136 INFO:tasks.workunit.client.0.smithi078.stdout:1/983: creat d3/dc6/f14c x:0 0 0 2024-09-11T00:18:01.137 INFO:tasks.workunit.client.0.smithi078.stdout:2/715: mknod d0/d1/d11/d60/da2/d3a/cee 0 2024-09-11T00:18:01.138 INFO:tasks.workunit.client.0.smithi078.stdout:2/716: getdents d0/d1/d3c/d40/d98 0 2024-09-11T00:18:01.145 INFO:tasks.workunit.client.0.smithi078.stdout:5/594: dwrite d7/d8/d33/d22/d51/f9b [4194304,4194304] 0 2024-09-11T00:18:01.146 INFO:tasks.workunit.client.0.smithi078.stdout:2/717: write d0/d1/d11/d1b/f6d [4044,41896] 0 2024-09-11T00:18:01.147 INFO:tasks.workunit.client.0.smithi078.stdout:5/595: fsync d7/d8/d33/d22/d25/d28/d24/d1c/f2e 0 2024-09-11T00:18:01.148 INFO:tasks.workunit.client.0.smithi078.stdout:3/688: dwrite d0/d7/d23/d7c/fc3 [0,4194304] 0 2024-09-11T00:18:01.149 INFO:tasks.workunit.client.0.smithi078.stdout:5/596: mknod d7/d8/d33/d22/da3/dc5/dc8/cd2 0 2024-09-11T00:18:01.150 INFO:tasks.workunit.client.0.smithi078.stdout:6/665: dwrite d0/d1/d9/d59/d74/fcb [4194304,4194304] 0 2024-09-11T00:18:01.151 INFO:tasks.workunit.client.0.smithi078.stdout:1/984: dwrite d3/d29/d45/f136 [0,4194304] 0 2024-09-11T00:18:01.152 INFO:tasks.workunit.client.0.smithi078.stdout:3/689: unlink d0/d7/d18/d1b/d8e/l9e 0 2024-09-11T00:18:01.152 INFO:tasks.workunit.client.0.smithi078.stdout:5/597: dread d7/d8/d33/d22/d51/faf [0,4194304] 0 2024-09-11T00:18:01.154 INFO:tasks.workunit.client.0.smithi078.stdout:6/666: creat d0/d1/d9/d8d/fde x:0 0 0 2024-09-11T00:18:01.154 INFO:tasks.workunit.client.0.smithi078.stdout:6/667: dread - d0/d1/d9/d17/d5e/fc0 zero size 2024-09-11T00:18:01.155 INFO:tasks.workunit.client.0.smithi078.stdout:1/985: mknod d3/d1a/d21/d4a/d90/dc7/c14d 0 2024-09-11T00:18:01.155 INFO:tasks.workunit.client.0.smithi078.stdout:3/690: creat d0/d7/d18/d1b/d34/fd1 x:0 0 0 2024-09-11T00:18:01.156 INFO:tasks.workunit.client.0.smithi078.stdout:5/598: readlink d7/d8/d33/d22/d25/d28/d24/l57 0 2024-09-11T00:18:01.159 INFO:tasks.workunit.client.0.smithi078.stdout:3/691: dread d0/d7/d23/d91/f85 [0,4194304] 0 2024-09-11T00:18:01.159 INFO:tasks.workunit.client.0.smithi078.stdout:6/668: rename d0/d1/f96 to d0/d66/da5/fdf 0 2024-09-11T00:18:01.159 INFO:tasks.workunit.client.0.smithi078.stdout:6/669: chown d0/d1/d9/d17/fcd 31 1 2024-09-11T00:18:01.159 INFO:tasks.workunit.client.0.smithi078.stdout:6/670: chown d0/d1/d9/l4 863100089 1 2024-09-11T00:18:01.163 INFO:tasks.workunit.client.0.smithi078.stdout:1/986: creat d3/d1a/d21/dcf/f14e x:0 0 0 2024-09-11T00:18:01.166 INFO:tasks.workunit.client.0.smithi078.stdout:2/718: dwrite d0/d1/d11/d60/da2/d38/f81 [0,4194304] 0 2024-09-11T00:18:01.166 INFO:tasks.workunit.client.0.smithi078.stdout:9/679: sync 2024-09-11T00:18:01.167 INFO:tasks.workunit.client.0.smithi078.stdout:8/859: sync 2024-09-11T00:18:01.167 INFO:tasks.workunit.client.0.smithi078.stdout:0/682: sync 2024-09-11T00:18:01.167 INFO:tasks.workunit.client.0.smithi078.stdout:8/860: fsync da/d13/d1b/d24/d62/f69 0 2024-09-11T00:18:01.167 INFO:tasks.workunit.client.0.smithi078.stdout:0/683: stat d2/d2a/d2c/d35/d71/f83 0 2024-09-11T00:18:01.167 INFO:tasks.workunit.client.0.smithi078.stdout:7/651: sync 2024-09-11T00:18:01.167 INFO:tasks.workunit.client.0.smithi078.stdout:7/652: stat d0/f78 0 2024-09-11T00:18:01.167 INFO:tasks.workunit.client.0.smithi078.stdout:8/861: write da/d7a/f10b [991203,111875] 0 2024-09-11T00:18:01.172 INFO:tasks.workunit.client.0.smithi078.stdout:9/680: rename dc/d12/d20/d58/d5b/dbb/f89 to dc/d12/d20/d58/fed 0 2024-09-11T00:18:01.173 INFO:tasks.workunit.client.0.smithi078.stdout:7/653: creat d0/d34/db/fbc x:0 0 0 2024-09-11T00:18:01.174 INFO:tasks.workunit.client.0.smithi078.stdout:7/654: truncate d0/d34/db/d30/d28/f61 866734 0 2024-09-11T00:18:01.177 INFO:tasks.workunit.client.0.smithi078.stdout:7/655: creat d0/d34/db/d30/d1d/d14/d87/fbd x:0 0 0 2024-09-11T00:18:01.177 INFO:tasks.workunit.client.0.smithi078.stdout:5/599: dwrite d7/d8/f3d [0,4194304] 0 2024-09-11T00:18:01.180 INFO:tasks.workunit.client.0.smithi078.stdout:3/692: dwrite d0/f78 [0,4194304] 0 2024-09-11T00:18:01.181 INFO:tasks.workunit.client.0.smithi078.stdout:3/693: write d0/d7/d18/d1b/d34/d3e/f5f [4971091,25175] 0 2024-09-11T00:18:01.182 INFO:tasks.workunit.client.0.smithi078.stdout:5/600: creat d7/d8/d33/d22/d25/d28/d24/d1c/fd3 x:0 0 0 2024-09-11T00:18:01.183 INFO:tasks.workunit.client.0.smithi078.stdout:9/681: dread dc/f1c [0,4194304] 0 2024-09-11T00:18:01.186 INFO:tasks.workunit.client.0.smithi078.stdout:5/601: dread d7/d8/de/f4a [0,4194304] 0 2024-09-11T00:18:01.186 INFO:tasks.workunit.client.0.smithi078.stdout:9/682: creat dc/d12/fee x:0 0 0 2024-09-11T00:18:01.187 INFO:tasks.workunit.client.0.smithi078.stdout:9/683: dread dc/d12/d46/d51/f53 [0,4194304] 0 2024-09-11T00:18:01.188 INFO:tasks.workunit.client.0.smithi078.stdout:5/602: mknod d7/d8/d33/da7/cd4 0 2024-09-11T00:18:01.190 INFO:tasks.workunit.client.0.smithi078.stdout:9/684: mknod dc/d12/cef 0 2024-09-11T00:18:01.191 INFO:tasks.workunit.client.0.smithi078.stdout:5/603: truncate d7/d8/d33/d22/d25/f5e 605756 0 2024-09-11T00:18:01.192 INFO:tasks.workunit.client.0.smithi078.stdout:5/604: mkdir d7/d8/de/dd5 0 2024-09-11T00:18:01.193 INFO:tasks.workunit.client.0.smithi078.stdout:1/987: dwrite d3/d29/d5f/d4e/f98 [0,4194304] 0 2024-09-11T00:18:01.193 INFO:tasks.workunit.client.0.smithi078.stdout:1/988: truncate d3/d29/d45/f3a 5124222 0 2024-09-11T00:18:01.194 INFO:tasks.workunit.client.0.smithi078.stdout:1/989: unlink d3/d1a/d21/d4a/ce2 0 2024-09-11T00:18:01.196 INFO:tasks.workunit.client.0.smithi078.stdout:1/990: creat d3/d29/dc4/d119/f14f x:0 0 0 2024-09-11T00:18:01.196 INFO:tasks.workunit.client.0.smithi078.stdout:1/991: read d3/d1a/d21/d4a/d90/d12f/fa2 [2076994,9346] 0 2024-09-11T00:18:01.197 INFO:tasks.workunit.client.0.smithi078.stdout:3/694: dread d0/d7/d18/d1b/f56 [0,4194304] 0 2024-09-11T00:18:01.197 INFO:tasks.workunit.client.0.smithi078.stdout:2/719: dwrite d0/d1/d33/d86/fc1 [0,4194304] 0 2024-09-11T00:18:01.197 INFO:tasks.workunit.client.0.smithi078.stdout:4/829: dwrite dc/d10/d40/d3a/d65/f22 [0,4194304] 0 2024-09-11T00:18:01.197 INFO:tasks.workunit.client.0.smithi078.stdout:4/830: truncate dc/d10/d40/d3a/d65/f111 549341 0 2024-09-11T00:18:01.197 INFO:tasks.workunit.client.0.smithi078.stdout:3/695: write d0/d39/f57 [822786,51742] 0 2024-09-11T00:18:01.197 INFO:tasks.workunit.client.0.smithi078.stdout:4/831: fsync dc/d10/d40/d3a/d65/f111 0 2024-09-11T00:18:01.200 INFO:tasks.workunit.client.0.smithi078.stdout:2/720: rename d0/d67/l7b to d0/d1/d6/d52/da8/lef 0 2024-09-11T00:18:01.200 INFO:tasks.workunit.client.0.smithi078.stdout:2/721: readlink d0/d1/d11/d60/da2/d3a/lca 0 2024-09-11T00:18:01.202 INFO:tasks.workunit.client.0.smithi078.stdout:4/832: link dc/d10/d1f/c9d dc/d54/c113 0 2024-09-11T00:18:01.204 INFO:tasks.workunit.client.0.smithi078.stdout:2/722: creat d0/d1/d6f/d93/dc3/dc4/dd4/ff0 x:0 0 0 2024-09-11T00:18:01.206 INFO:tasks.workunit.client.0.smithi078.stdout:2/723: dread d0/d1/d33/d86/db4/f65 [0,4194304] 0 2024-09-11T00:18:01.207 INFO:tasks.workunit.client.0.smithi078.stdout:5/605: dread d7/d8/de/d2c/fa6 [0,4194304] 0 2024-09-11T00:18:01.210 INFO:tasks.workunit.client.0.smithi078.stdout:9/685: dwrite dc/d12/d20/d50/fad [4194304,4194304] 0 2024-09-11T00:18:01.212 INFO:tasks.workunit.client.0.smithi078.stdout:5/606: creat d7/d8/d33/d22/da3/dc5/dc8/fd6 x:0 0 0 2024-09-11T00:18:01.222 INFO:tasks.workunit.client.0.smithi078.stdout:9/686: dread dc/f38 [0,4194304] 0 2024-09-11T00:18:01.223 INFO:tasks.workunit.client.0.smithi078.stdout:3/696: dwrite d0/f3c [4194304,4194304] 0 2024-09-11T00:18:01.223 INFO:tasks.workunit.client.0.smithi078.stdout:3/697: readlink d0/d7/d18/d1b/d34/l51 0 2024-09-11T00:18:01.228 INFO:tasks.workunit.client.0.smithi078.stdout:4/833: dwrite dc/d10/d40/d3a/d65/d7b/d8b/dc5/fe6 [0,4194304] 0 2024-09-11T00:18:01.229 INFO:tasks.workunit.client.0.smithi078.stdout:1/992: dwrite d3/d1a/d21/dcf/f142 [0,4194304] 0 2024-09-11T00:18:01.230 INFO:tasks.workunit.client.0.smithi078.stdout:3/698: dread d0/d7/d23/d91/f22 [4194304,4194304] 0 2024-09-11T00:18:01.231 INFO:tasks.workunit.client.0.smithi078.stdout:2/724: dwrite d0/d1/d8/f29 [0,4194304] 0 2024-09-11T00:18:01.248 INFO:tasks.workunit.client.0.smithi078.stdout:4/834: dwrite dc/d10/d40/d3a/d46/d47/fa0 [0,4194304] 0 2024-09-11T00:18:01.248 INFO:tasks.workunit.client.0.smithi078.stdout:4/835: stat dc/d10/d40/d3a/d65/f34 0 2024-09-11T00:18:01.251 INFO:tasks.workunit.client.0.smithi078.stdout:9/687: symlink dc/d12/d54/de7/lf0 0 2024-09-11T00:18:01.251 INFO:tasks.workunit.client.0.smithi078.stdout:9/688: write dc/d12/d20/d58/fed [5167701,121645] 0 2024-09-11T00:18:01.256 INFO:tasks.workunit.client.0.smithi078.stdout:3/699: truncate d0/d7/d46/f66 488988 0 2024-09-11T00:18:01.261 INFO:tasks.workunit.client.0.smithi078.stdout:9/689: write dc/d12/d20/d58/d5b/d68/fac [1645663,17856] 0 2024-09-11T00:18:01.261 INFO:tasks.workunit.client.0.smithi078.stdout:9/690: write dc/d12/d20/d50/dbc/dcf/de1/d3e/fab [4821875,56769] 0 2024-09-11T00:18:01.261 INFO:tasks.workunit.client.0.smithi078.stdout:9/691: write dc/f1e [1396550,64662] 0 2024-09-11T00:18:01.269 INFO:tasks.workunit.client.0.smithi078.stdout:4/836: dwrite dc/d10/d40/d3a/d65/d7b/d9e/d5d/fa4 [0,4194304] 0 2024-09-11T00:18:01.269 INFO:tasks.workunit.client.0.smithi078.stdout:3/700: write d0/d7/d18/f4c [3431711,64797] 0 2024-09-11T00:18:01.270 INFO:tasks.workunit.client.0.smithi078.stdout:3/701: creat d0/d1a/d77/fd2 x:0 0 0 2024-09-11T00:18:01.271 INFO:tasks.workunit.client.0.smithi078.stdout:3/702: dread - d0/d39/fad zero size 2024-09-11T00:18:01.271 INFO:tasks.workunit.client.0.smithi078.stdout:3/703: fsync d0/d7/d18/d1b/d34/f84 0 2024-09-11T00:18:01.271 INFO:tasks.workunit.client.0.smithi078.stdout:3/704: write d0/d7/d23/f2d [1380978,111016] 0 2024-09-11T00:18:01.271 INFO:tasks.workunit.client.0.smithi078.stdout:3/705: chown d0/d7/d23/dcd 24010 1 2024-09-11T00:18:01.271 INFO:tasks.workunit.client.0.smithi078.stdout:3/706: readlink d0/d1a/d77/la4 0 2024-09-11T00:18:01.275 INFO:tasks.workunit.client.0.smithi078.stdout:9/692: dwrite dc/d12/d54/fb8 [0,4194304] 0 2024-09-11T00:18:01.279 INFO:tasks.workunit.client.0.smithi078.stdout:9/693: creat dc/d12/d20/d58/d5a/ff1 x:0 0 0 2024-09-11T00:18:01.288 INFO:tasks.workunit.client.0.smithi078.stdout:4/837: dwrite dc/d10/d40/d3a/d46/f6b [0,4194304] 0 2024-09-11T00:18:01.288 INFO:tasks.workunit.client.0.smithi078.stdout:4/838: write dc/d54/fd4 [1725667,117715] 0 2024-09-11T00:18:01.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:00 smithi138 ceph-mon[35019]: pgmap v369: 97 pgs: 97 active+clean; 1.1 GiB data, 984 MiB used, 1.0 TiB / 1.0 TiB avail; 101 MiB/s rd, 136 MiB/s wr, 473 op/s 2024-09-11T00:18:01.293 INFO:tasks.workunit.client.0.smithi078.stdout:3/707: dwrite d0/d39/f74 [0,4194304] 0 2024-09-11T00:18:01.295 INFO:tasks.workunit.client.0.smithi078.stdout:4/839: dread dc/d10/d40/d3a/d65/f22 [0,4194304] 0 2024-09-11T00:18:01.299 INFO:tasks.workunit.client.0.smithi078.stdout:3/708: dread d0/d7/d23/d91/f22 [0,4194304] 0 2024-09-11T00:18:01.299 INFO:tasks.workunit.client.0.smithi078.stdout:3/709: truncate d0/d1a/d77/fd2 531661 0 2024-09-11T00:18:01.302 INFO:tasks.workunit.client.0.smithi078.stdout:3/710: unlink d0/d7/d23/d7c/f80 0 2024-09-11T00:18:01.302 INFO:tasks.workunit.client.0.smithi078.stdout:3/711: truncate d0/d7/d18/fbb 782096 0 2024-09-11T00:18:01.303 INFO:tasks.workunit.client.0.smithi078.stdout:9/694: dwrite dc/fe6 [0,4194304] 0 2024-09-11T00:18:01.303 INFO:tasks.workunit.client.0.smithi078.stdout:9/695: chown dc/d12/fd1 47 1 2024-09-11T00:18:01.303 INFO:tasks.workunit.client.0.smithi078.stdout:9/696: fsync dc/d12/f11 0 2024-09-11T00:18:01.303 INFO:tasks.workunit.client.0.smithi078.stdout:9/697: chown dc/d12/c19 101024 1 2024-09-11T00:18:01.303 INFO:tasks.workunit.client.0.smithi078.stdout:9/698: write dc/d12/d20/f94 [190069,63394] 0 2024-09-11T00:18:01.303 INFO:tasks.workunit.client.0.smithi078.stdout:9/699: chown dc/d12/d54/db4/lbe 18151 1 2024-09-11T00:18:01.303 INFO:tasks.workunit.client.0.smithi078.stdout:2/725: unlink d0/d1/d33/f4d 0 2024-09-11T00:18:01.309 INFO:tasks.workunit.client.0.smithi078.stdout:9/700: mknod dc/d12/d54/cf2 0 2024-09-11T00:18:01.310 INFO:tasks.workunit.client.0.smithi078.stdout:3/712: symlink d0/d7/d46/ld3 0 2024-09-11T00:18:01.311 INFO:tasks.workunit.client.0.smithi078.stdout:3/713: mknod d0/d7/d46/cd4 0 2024-09-11T00:18:01.313 INFO:tasks.workunit.client.0.smithi078.stdout:3/714: symlink d0/d7/d46/ld5 0 2024-09-11T00:18:01.313 INFO:tasks.workunit.client.0.smithi078.stdout:3/715: truncate d0/d7/d18/d1b/d34/f8f 1637843 0 2024-09-11T00:18:01.314 INFO:tasks.workunit.client.0.smithi078.stdout:3/716: symlink d0/d7/d46/d86/ld6 0 2024-09-11T00:18:01.315 INFO:tasks.workunit.client.0.smithi078.stdout:3/717: creat d0/d7/d18/d1b/d34/fd7 x:0 0 0 2024-09-11T00:18:01.320 INFO:tasks.workunit.client.0.smithi078.stdout:2/726: dwrite d0/d1/d11/d60/da2/fb3 [0,4194304] 0 2024-09-11T00:18:01.322 INFO:tasks.workunit.client.0.smithi078.stdout:5/607: rmdir d7/d8/d33 39 2024-09-11T00:18:01.334 INFO:tasks.workunit.client.0.smithi078.stdout:5/608: write d7/d8/d33/d22/da3/dc5/dc8/d2a/dc7/fd0 [4026248,67954] 0 2024-09-11T00:18:01.334 INFO:tasks.workunit.client.0.smithi078.stdout:5/609: chown d7/d8/f87 63 1 2024-09-11T00:18:01.339 INFO:tasks.workunit.client.0.smithi078.stdout:2/727: creat d0/d1/d11/d60/da2/ff1 x:0 0 0 2024-09-11T00:18:01.339 INFO:tasks.workunit.client.0.smithi078.stdout:2/728: write d0/d1/d8/f9e [779164,45583] 0 2024-09-11T00:18:01.347 INFO:tasks.workunit.client.0.smithi078.stdout:2/729: dread d0/d1/d6/f37 [0,4194304] 0 2024-09-11T00:18:01.347 INFO:tasks.workunit.client.0.smithi078.stdout:2/730: mknod d0/d1/d3b/cf2 0 2024-09-11T00:18:01.348 INFO:tasks.workunit.client.0.smithi078.stdout:2/731: creat d0/d1/d11/d60/da2/db0/ff3 x:0 0 0 2024-09-11T00:18:01.349 INFO:tasks.workunit.client.0.smithi078.stdout:2/732: symlink d0/d1/d11/d60/da2/d3a/d51/d97/dbd/lf4 0 2024-09-11T00:18:01.350 INFO:tasks.workunit.client.0.smithi078.stdout:2/733: symlink d0/d1/d11/d60/da2/db0/lf5 0 2024-09-11T00:18:01.351 INFO:tasks.workunit.client.0.smithi078.stdout:2/734: truncate d0/d19/d3d/f62 1100764 0 2024-09-11T00:18:01.351 INFO:tasks.workunit.client.0.smithi078.stdout:2/735: chown d0/d1/d6/f48 6356718 1 2024-09-11T00:18:01.351 INFO:tasks.workunit.client.0.smithi078.stdout:2/736: chown d0/d1/d11/d60/da2/d3a/d51/f58 520212 1 2024-09-11T00:18:01.351 INFO:tasks.workunit.client.0.smithi078.stdout:2/737: chown d0/d1/d6f/l8f 1399 1 2024-09-11T00:18:01.351 INFO:tasks.workunit.client.0.smithi078.stdout:2/738: chown d0/d1/d11/d60/da2/d3a/d51/l9d 0 1 2024-09-11T00:18:01.366 INFO:tasks.workunit.client.0.smithi078.stdout:1/993: rename d3/d29/f11d to d3/d29/d5f/d39/f150 0 2024-09-11T00:18:01.369 INFO:tasks.workunit.client.0.smithi078.stdout:9/701: rename dc/d12/d46/dd6 to dc/d12/d54/de7/df3 0 2024-09-11T00:18:01.371 INFO:tasks.workunit.client.0.smithi078.stdout:3/718: rename d0/d7/d18/d1b/d34 to d0/d7/d18/dd8 0 2024-09-11T00:18:01.373 INFO:tasks.workunit.client.0.smithi078.stdout:9/702: symlink dc/lf4 0 2024-09-11T00:18:01.373 INFO:tasks.workunit.client.0.smithi078.stdout:9/703: read dc/d12/d20/d50/db1/fc3 [315747,92998] 0 2024-09-11T00:18:01.374 INFO:tasks.workunit.client.0.smithi078.stdout:1/994: link d3/d29/d5f/d39/f150 d3/d1a/d21/d4a/d90/f151 0 2024-09-11T00:18:01.375 INFO:tasks.workunit.client.0.smithi078.stdout:2/739: rename d0/d1/d6f/d93/cc2 to d0/d19/d3d/d8d/d8e/cf6 0 2024-09-11T00:18:01.378 INFO:tasks.workunit.client.0.smithi078.stdout:9/704: creat dc/d12/ff5 x:0 0 0 2024-09-11T00:18:01.378 INFO:tasks.workunit.client.0.smithi078.stdout:3/719: symlink d0/d7/d18/d1b/ld9 0 2024-09-11T00:18:01.380 INFO:tasks.workunit.client.0.smithi078.stdout:2/740: mkdir d0/d19/d3d/d8d/df7 0 2024-09-11T00:18:01.380 INFO:tasks.workunit.client.0.smithi078.stdout:2/741: readlink d0/d1/d6/d52/da8/lef 0 2024-09-11T00:18:01.380 INFO:tasks.workunit.client.0.smithi078.stdout:9/705: rmdir dc/d12/d20/d58/d5a 39 2024-09-11T00:18:01.381 INFO:tasks.workunit.client.0.smithi078.stdout:9/706: getdents dc/d12/d54/de7/df3 0 2024-09-11T00:18:01.381 INFO:tasks.workunit.client.0.smithi078.stdout:3/720: getdents d0/d7/d18/d1b/d8e/daf 0 2024-09-11T00:18:01.382 INFO:tasks.workunit.client.0.smithi078.stdout:9/707: rename dc/d12/d20 to dc/d12/d20/d30/df6 22 2024-09-11T00:18:01.386 INFO:tasks.workunit.client.0.smithi078.stdout:2/742: dread d0/d1/d6/f48 [0,4194304] 0 2024-09-11T00:18:01.386 INFO:tasks.workunit.client.0.smithi078.stdout:2/743: chown d0/d1/d11/d60/da2/d3a/cee 101111080 1 2024-09-11T00:18:01.386 INFO:tasks.workunit.client.0.smithi078.stdout:2/744: getdents d0/d1/d11/d60/da2/d3a/d51/de6 0 2024-09-11T00:18:01.387 INFO:tasks.workunit.client.0.smithi078.stdout:2/745: link d0/d1/d11/d60/da2/d38/l5e d0/lf8 0 2024-09-11T00:18:01.387 INFO:tasks.workunit.client.0.smithi078.stdout:2/746: readlink d0/d1/d6f/ldc 0 2024-09-11T00:18:01.388 INFO:tasks.workunit.client.0.smithi078.stdout:2/747: truncate d0/d1/d6/f9c 456492 0 2024-09-11T00:18:01.388 INFO:tasks.workunit.client.0.smithi078.stdout:2/748: creat d0/d1/d3c/d40/d98/ff9 x:0 0 0 2024-09-11T00:18:01.388 INFO:tasks.workunit.client.0.smithi078.stdout:1/995: dwrite d3/d29/f10c [4194304,4194304] 0 2024-09-11T00:18:01.389 INFO:tasks.workunit.client.0.smithi078.stdout:2/749: mknod d0/d1/d3c/dc6/cfa 0 2024-09-11T00:18:01.392 INFO:tasks.workunit.client.0.smithi078.stdout:1/996: rename d3/dc6/lf7 to d3/d1a/d21/d4a/d90/dc7/l152 0 2024-09-11T00:18:01.394 INFO:tasks.workunit.client.0.smithi078.stdout:1/997: symlink d3/d29/dc4/dd8/l153 0 2024-09-11T00:18:01.394 INFO:tasks.workunit.client.0.smithi078.stdout:1/998: readlink d3/d29/d5f/d39/l12d 0 2024-09-11T00:18:01.409 INFO:tasks.workunit.client.0.smithi078.stdout:3/721: dwrite d0/f62 [0,4194304] 0 2024-09-11T00:18:01.409 INFO:tasks.workunit.client.0.smithi078.stdout:2/750: dread d0/d1/d11/d1b/d1e/f2f [0,4194304] 0 2024-09-11T00:18:01.410 INFO:tasks.workunit.client.0.smithi078.stdout:2/751: dread d0/fc [0,4194304] 0 2024-09-11T00:18:01.412 INFO:tasks.workunit.client.0.smithi078.stdout:9/708: dwrite dc/d12/d20/f94 [0,4194304] 0 2024-09-11T00:18:01.412 INFO:tasks.workunit.client.0.smithi078.stdout:9/709: chown dc/d12/d46/d51/l62 2250611 1 2024-09-11T00:18:01.412 INFO:tasks.workunit.client.0.smithi078.stdout:9/710: chown dc/d12/d20/d58/d5b/dbb/f66 872226320 1 2024-09-11T00:18:01.412 INFO:tasks.workunit.client.0.smithi078.stdout:3/722: creat d0/d7/d18/d70/fda x:0 0 0 2024-09-11T00:18:01.412 INFO:tasks.workunit.client.0.smithi078.stdout:1/999: dwrite d3/d1a/d21/d4a/d90/fde [0,4194304] 0 2024-09-11T00:18:01.412 INFO:tasks.workunit.client.0.smithi078.stdout:2/752: mkdir d0/d1/d11/d1b/d1e/dfb 0 2024-09-11T00:18:01.419 INFO:tasks.workunit.client.0.smithi078.stdout:2/753: dread d0/fd9 [0,4194304] 0 2024-09-11T00:18:01.419 INFO:tasks.workunit.client.0.smithi078.stdout:2/754: chown d0/d1/d6f/fce 9 1 2024-09-11T00:18:01.421 INFO:tasks.workunit.client.0.smithi078.stdout:3/723: creat d0/d1a/d77/fdb x:0 0 0 2024-09-11T00:18:01.421 INFO:tasks.workunit.client.0.smithi078.stdout:3/724: getdents d0/d7/d23/d7c/da1/dce 0 2024-09-11T00:18:01.421 INFO:tasks.workunit.client.0.smithi078.stdout:3/725: write d0/d7/f87 [1047227,48416] 0 2024-09-11T00:18:01.422 INFO:tasks.workunit.client.0.smithi078.stdout:3/726: rename d0/d39/lc8 to d0/d7/d18/dd8/d60/d6d/ldc 0 2024-09-11T00:18:01.422 INFO:tasks.workunit.client.0.smithi078.stdout:3/727: write d0/d7/fcf [540115,97021] 0 2024-09-11T00:18:01.429 INFO:tasks.workunit.client.0.smithi078.stdout:9/711: dwrite dc/f14 [4194304,4194304] 0 2024-09-11T00:18:01.430 INFO:tasks.workunit.client.0.smithi078.stdout:9/712: creat dc/d12/d20/d58/d5b/d68/ff7 x:0 0 0 2024-09-11T00:18:01.430 INFO:tasks.workunit.client.0.smithi078.stdout:9/713: chown dc/d12/d46/d51/fa5 781481 1 2024-09-11T00:18:01.441 INFO:tasks.workunit.client.0.smithi078.stdout:9/714: dwrite dc/d12/d46/d51/f53 [0,4194304] 0 2024-09-11T00:18:01.441 INFO:tasks.workunit.client.0.smithi078.stdout:9/715: fdatasync dc/d12/d20/d50/dbc/dcf/de1/d3e/f6d 0 2024-09-11T00:18:01.458 INFO:tasks.workunit.client.0.smithi078.stdout:9/716: dwrite dc/d12/d54/fb8 [0,4194304] 0 2024-09-11T00:18:01.458 INFO:tasks.workunit.client.0.smithi078.stdout:9/717: truncate dc/d12/d54/faa 1639561 0 2024-09-11T00:18:01.460 INFO:tasks.workunit.client.0.smithi078.stdout:9/718: symlink dc/d12/d20/d30/lf8 0 2024-09-11T00:18:01.460 INFO:tasks.workunit.client.0.smithi078.stdout:9/719: fsync dc/d12/d20/d30/fa7 0 2024-09-11T00:18:01.460 INFO:tasks.workunit.client.0.smithi078.stdout:9/720: rmdir dc/d12/d20/d58/d5b 39 2024-09-11T00:18:01.461 INFO:tasks.workunit.client.0.smithi078.stdout:9/721: rmdir dc/d12/d20/d30 39 2024-09-11T00:18:01.461 INFO:tasks.workunit.client.0.smithi078.stdout:9/722: write dc/d12/d20/d58/d5a/dc9/fcb [458828,78492] 0 2024-09-11T00:18:01.461 INFO:tasks.workunit.client.0.smithi078.stdout:9/723: chown dc/d12/d20/f61 53191675 1 2024-09-11T00:18:01.461 INFO:tasks.workunit.client.0.smithi078.stdout:9/724: write dc/d12/d46/d51/fdc [186857,117642] 0 2024-09-11T00:18:01.462 INFO:tasks.workunit.client.0.smithi078.stdout:9/725: creat dc/d12/d54/ff9 x:0 0 0 2024-09-11T00:18:01.561 INFO:tasks.workunit.client.0.smithi078.stdout:6/671: sync 2024-09-11T00:18:01.562 INFO:tasks.workunit.client.0.smithi078.stdout:6/672: symlink d0/d1/d9/d59/d74/db3/dd5/le0 0 2024-09-11T00:18:01.571 INFO:tasks.workunit.client.0.smithi078.stdout:6/673: dread d0/d66/f7f [4194304,4194304] 0 2024-09-11T00:18:01.571 INFO:tasks.workunit.client.0.smithi078.stdout:6/674: write d0/d1/d9/d17/fcd [1330787,28959] 0 2024-09-11T00:18:01.572 INFO:tasks.workunit.client.0.smithi078.stdout:6/675: rename d0/d1/d9/d59/c87 to d0/d1/d9/d59/d74/d6b/ce1 0 2024-09-11T00:18:01.577 INFO:tasks.workunit.client.0.smithi078.stdout:6/676: read d0/d1/d53/f90 [2762959,72951] 0 2024-09-11T00:18:01.579 INFO:tasks.workunit.client.0.smithi078.stdout:6/677: rename d0/d1/d9/d59/da3/fd2 to d0/d1/d53/d9c/db6/fe2 0 2024-09-11T00:18:01.579 INFO:tasks.workunit.client.0.smithi078.stdout:6/678: dread - d0/d1/d9/d8d/fde zero size 2024-09-11T00:18:01.585 INFO:tasks.workunit.client.0.smithi078.stdout:6/679: write d0/d1/d9/f15 [3662874,76624] 0 2024-09-11T00:18:01.585 INFO:tasks.workunit.client.0.smithi078.stdout:6/680: chown d0/d1/d9/d54/l78 643198094 1 2024-09-11T00:18:01.586 INFO:tasks.workunit.client.0.smithi078.stdout:6/681: mkdir d0/d1/d53/d9c/dac/de3 0 2024-09-11T00:18:01.591 INFO:tasks.workunit.client.0.smithi078.stdout:6/682: read d0/d1/d9/d59/d74/db3/dd5/f3d [3455972,30958] 0 2024-09-11T00:18:01.599 INFO:tasks.workunit.client.0.smithi078.stdout:6/683: dread d0/d1/d9/f5c [0,4194304] 0 2024-09-11T00:18:01.600 INFO:tasks.workunit.client.0.smithi078.stdout:6/684: mkdir d0/d1/d53/d72/de4 0 2024-09-11T00:18:01.601 INFO:tasks.workunit.client.0.smithi078.stdout:6/685: mkdir d0/d1/d53/d9c/db6/de5 0 2024-09-11T00:18:01.602 INFO:tasks.workunit.client.0.smithi078.stdout:6/686: creat d0/d1/d9/d59/fe6 x:0 0 0 2024-09-11T00:18:01.699 INFO:tasks.workunit.client.0.smithi078.stdout:0/684: sync 2024-09-11T00:18:01.699 INFO:tasks.workunit.client.0.smithi078.stdout:0/685: truncate d2/d2a/d2c/d35/d59/d4f/d61/d69/f1a 1378739 0 2024-09-11T00:18:01.701 INFO:tasks.workunit.client.0.smithi078.stdout:0/686: unlink d2/d2a/d2c/d35/d59/d4f/d61/d8f/cdb 0 2024-09-11T00:18:01.717 INFO:tasks.workunit.client.0.smithi078.stdout:0/687: dwrite d2/d2a/d2c/d35/d59/d7/f86 [0,4194304] 0 2024-09-11T00:18:01.717 INFO:tasks.workunit.client.0.smithi078.stdout:0/688: read - d2/fda zero size 2024-09-11T00:18:01.718 INFO:tasks.workunit.client.0.smithi078.stdout:0/689: mkdir d2/d2a/d2c/d35/d59/de7 0 2024-09-11T00:18:01.718 INFO:tasks.workunit.client.0.smithi078.stdout:0/690: chown d2/d2a/d2c/d35/f46 72 1 2024-09-11T00:18:01.719 INFO:tasks.workunit.client.0.smithi078.stdout:0/691: stat d2/l33 0 2024-09-11T00:18:01.811 INFO:tasks.workunit.client.0.smithi078.stdout:7/656: sync 2024-09-11T00:18:01.812 INFO:tasks.workunit.client.0.smithi078.stdout:5/610: sync 2024-09-11T00:18:01.812 INFO:tasks.workunit.client.0.smithi078.stdout:9/726: sync 2024-09-11T00:18:01.812 INFO:tasks.workunit.client.0.smithi078.stdout:5/611: read - d7/d8/de/fa1 zero size 2024-09-11T00:18:01.812 INFO:tasks.workunit.client.0.smithi078.stdout:3/728: sync 2024-09-11T00:18:01.812 INFO:tasks.workunit.client.0.smithi078.stdout:4/840: sync 2024-09-11T00:18:01.812 INFO:tasks.workunit.client.0.smithi078.stdout:9/727: dread - dc/d12/d20/d58/d5a/ff1 zero size 2024-09-11T00:18:01.812 INFO:tasks.workunit.client.0.smithi078.stdout:6/687: sync 2024-09-11T00:18:01.812 INFO:tasks.workunit.client.0.smithi078.stdout:3/729: chown d0/d1a/c37 118226 1 2024-09-11T00:18:01.812 INFO:tasks.workunit.client.0.smithi078.stdout:8/862: sync 2024-09-11T00:18:01.812 INFO:tasks.workunit.client.0.smithi078.stdout:2/755: sync 2024-09-11T00:18:01.813 INFO:tasks.workunit.client.0.smithi078.stdout:7/657: creat d0/da7/fbe x:0 0 0 2024-09-11T00:18:01.813 INFO:tasks.workunit.client.0.smithi078.stdout:7/658: dread - d0/d34/db/d30/f53 zero size 2024-09-11T00:18:01.813 INFO:tasks.workunit.client.0.smithi078.stdout:4/841: rmdir dc/d10/d40/d3a/d46/d59 39 2024-09-11T00:18:01.813 INFO:tasks.workunit.client.0.smithi078.stdout:4/842: write dc/d10/d40/d3a/d4c/f41 [5031130,8785] 0 2024-09-11T00:18:01.813 INFO:tasks.workunit.client.0.smithi078.stdout:4/843: write dc/d10/d40/d3a/d4c/db4/d72/f110 [268866,31056] 0 2024-09-11T00:18:01.814 INFO:tasks.workunit.client.0.smithi078.stdout:4/844: stat dc/d10/d40/d3a/d46/d59/d9f 0 2024-09-11T00:18:01.814 INFO:tasks.workunit.client.0.smithi078.stdout:8/863: truncate da/d1c/d60/fb4 78884 0 2024-09-11T00:18:01.814 INFO:tasks.workunit.client.0.smithi078.stdout:8/864: stat da/d1c/d4c/dbc/c5c 0 2024-09-11T00:18:01.815 INFO:tasks.workunit.client.0.smithi078.stdout:8/865: chown da/d1c/d4c/fa4 0 1 2024-09-11T00:18:01.815 INFO:tasks.workunit.client.0.smithi078.stdout:8/866: dread - da/d13/d1b/d24/d62/f8a zero size 2024-09-11T00:18:01.815 INFO:tasks.workunit.client.0.smithi078.stdout:3/730: creat d0/d7/d46/d86/d9a/fdd x:0 0 0 2024-09-11T00:18:01.816 INFO:tasks.workunit.client.0.smithi078.stdout:6/688: creat d0/d1/d53/d72/dcc/fe7 x:0 0 0 2024-09-11T00:18:01.817 INFO:tasks.workunit.client.0.smithi078.stdout:2/756: rmdir d0/d1/d6f/d93/dc3/dc4 39 2024-09-11T00:18:01.817 INFO:tasks.workunit.client.0.smithi078.stdout:2/757: fdatasync d0/d1/d11/d60/da2/d38/f81 0 2024-09-11T00:18:01.819 INFO:tasks.workunit.client.0.smithi078.stdout:7/659: symlink d0/d34/db/d30/d1d/d14/lbf 0 2024-09-11T00:18:01.819 INFO:tasks.workunit.client.0.smithi078.stdout:5/612: write d7/d8/d33/d22/da3/dc5/dc8/f75 [2942054,45386] 0 2024-09-11T00:18:01.821 INFO:tasks.workunit.client.0.smithi078.stdout:2/758: dread d0/d1/d11/d60/da2/d38/f64 [0,4194304] 0 2024-09-11T00:18:01.821 INFO:tasks.workunit.client.0.smithi078.stdout:7/660: mknod d0/d34/db/da0/cc0 0 2024-09-11T00:18:01.821 INFO:tasks.workunit.client.0.smithi078.stdout:7/661: chown d0/da7 2936 1 2024-09-11T00:18:01.821 INFO:tasks.workunit.client.0.smithi078.stdout:5/613: symlink d7/d8/d33/d22/d25/d28/ld7 0 2024-09-11T00:18:01.822 INFO:tasks.workunit.client.0.smithi078.stdout:7/662: creat d0/d34/db/d30/d1d/d14/d87/fc1 x:0 0 0 2024-09-11T00:18:01.823 INFO:tasks.workunit.client.0.smithi078.stdout:5/614: link d7/d8/d47/c4c d7/d8/d47/cd8 0 2024-09-11T00:18:01.823 INFO:tasks.workunit.client.0.smithi078.stdout:7/663: creat d0/d34/db/d30/fc2 x:0 0 0 2024-09-11T00:18:01.823 INFO:tasks.workunit.client.0.smithi078.stdout:4/845: write dc/d10/d1f/f35 [3115529,46624] 0 2024-09-11T00:18:01.824 INFO:tasks.workunit.client.0.smithi078.stdout:5/615: mkdir d7/d8/d33/d22/dd9 0 2024-09-11T00:18:01.824 INFO:tasks.workunit.client.0.smithi078.stdout:5/616: fsync d7/d8/d33/d22/d25/f84 0 2024-09-11T00:18:01.827 INFO:tasks.workunit.client.0.smithi078.stdout:5/617: symlink d7/d8/d33/d22/dd9/lda 0 2024-09-11T00:18:01.828 INFO:tasks.workunit.client.0.smithi078.stdout:5/618: stat d7/d8/d47/cd8 0 2024-09-11T00:18:01.831 INFO:tasks.workunit.client.0.smithi078.stdout:4/846: dread dc/d10/f3d [0,4194304] 0 2024-09-11T00:18:01.831 INFO:tasks.workunit.client.0.smithi078.stdout:5/619: write d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f5f [233186,71937] 0 2024-09-11T00:18:01.832 INFO:tasks.workunit.client.0.smithi078.stdout:4/847: stat dc/d10/d40/d3a/d46/d59/fe3 0 2024-09-11T00:18:01.832 INFO:tasks.workunit.client.0.smithi078.stdout:4/848: chown dc/d10/d40/d3a/d65/d94 31971596 1 2024-09-11T00:18:01.834 INFO:tasks.workunit.client.0.smithi078.stdout:5/620: symlink d7/d8/ldb 0 2024-09-11T00:18:01.834 INFO:tasks.workunit.client.0.smithi078.stdout:5/621: read f6 [2146928,109370] 0 2024-09-11T00:18:01.843 INFO:tasks.workunit.client.0.smithi078.stdout:4/849: dread dc/d10/d40/d3a/d4c/f8a [0,4194304] 0 2024-09-11T00:18:01.844 INFO:tasks.workunit.client.0.smithi078.stdout:2/759: dwrite d0/d1/d11/d60/fa4 [0,4194304] 0 2024-09-11T00:18:01.845 INFO:tasks.workunit.client.0.smithi078.stdout:4/850: symlink dc/d10/d40/d3a/d65/d7b/d8b/dfa/l114 0 2024-09-11T00:18:01.845 INFO:tasks.workunit.client.0.smithi078.stdout:4/851: fdatasync dc/d10/d40/d3a/d46/d59/fe3 0 2024-09-11T00:18:01.846 INFO:tasks.workunit.client.0.smithi078.stdout:4/852: mknod dc/d10/d40/d3a/d65/d7b/d9e/d5d/c115 0 2024-09-11T00:18:01.848 INFO:tasks.workunit.client.0.smithi078.stdout:3/731: dwrite d0/d7/d18/d8c/fa8 [0,4194304] 0 2024-09-11T00:18:01.852 INFO:tasks.workunit.client.0.smithi078.stdout:4/853: dread dc/d10/d40/d3a/d65/d7b/d9e/d50/fd1 [0,4194304] 0 2024-09-11T00:18:01.853 INFO:tasks.workunit.client.0.smithi078.stdout:4/854: fdatasync dc/d10/d40/d3a/d4c/db4/fe4 0 2024-09-11T00:18:01.854 INFO:tasks.workunit.client.0.smithi078.stdout:4/855: link dc/d10/d40/d33/lf0 dc/d10/d40/d3a/l116 0 2024-09-11T00:18:01.856 INFO:tasks.workunit.client.0.smithi078.stdout:4/856: rename dc/d10/d40/d3a/d4c/db4/df9/fff to dc/d10/d40/d3a/d46/dad/f117 0 2024-09-11T00:18:01.856 INFO:tasks.workunit.client.0.smithi078.stdout:4/857: fsync dc/d10/d1f/f5b 0 2024-09-11T00:18:01.856 INFO:tasks.workunit.client.0.smithi078.stdout:3/732: dread d0/d7/d46/d86/d9a/fc5 [0,4194304] 0 2024-09-11T00:18:01.857 INFO:tasks.workunit.client.0.smithi078.stdout:4/858: rmdir dc/d10/d40/d3a/d4c/db4/d72 39 2024-09-11T00:18:01.857 INFO:tasks.workunit.client.0.smithi078.stdout:4/859: truncate dc/d10/d40/d33/f81 1175431 0 2024-09-11T00:18:01.858 INFO:tasks.workunit.client.0.smithi078.stdout:5/622: dwrite d7/d8/d33/d22/d25/d28/d24/f44 [0,4194304] 0 2024-09-11T00:18:01.859 INFO:tasks.workunit.client.0.smithi078.stdout:5/623: truncate d7/d8/d33/d22/d25/f3a 364058 0 2024-09-11T00:18:01.860 INFO:tasks.workunit.client.0.smithi078.stdout:5/624: link d7/d8/d33/d22/da3/dc5/dc8/f75 d7/d8/d33/d22/da3/dc5/fdc 0 2024-09-11T00:18:01.861 INFO:tasks.workunit.client.0.smithi078.stdout:5/625: truncate d7/d8/d33/d22/f7a 1016838 0 2024-09-11T00:18:01.861 INFO:tasks.workunit.client.0.smithi078.stdout:5/626: stat d7/d8/d33/d22/da3/f9f 0 2024-09-11T00:18:01.865 INFO:tasks.workunit.client.0.smithi078.stdout:3/733: dread d0/d1a/f52 [0,4194304] 0 2024-09-11T00:18:01.865 INFO:tasks.workunit.client.0.smithi078.stdout:2/760: dwrite d0/d1/d6/f15 [4194304,4194304] 0 2024-09-11T00:18:01.866 INFO:tasks.workunit.client.0.smithi078.stdout:2/761: mkdir d0/d1/d11/d60/da2/d3a/d51/d97/dac/dfc 0 2024-09-11T00:18:01.870 INFO:tasks.workunit.client.0.smithi078.stdout:5/627: dread d7/d8/d33/d22/d51/f9b [4194304,4194304] 0 2024-09-11T00:18:01.871 INFO:tasks.workunit.client.0.smithi078.stdout:5/628: fsync d7/d8/d33/d22/da3/f9f 0 2024-09-11T00:18:01.871 INFO:tasks.workunit.client.0.smithi078.stdout:4/860: dwrite dc/d10/d40/d3a/d46/f6b [0,4194304] 0 2024-09-11T00:18:01.872 INFO:tasks.workunit.client.0.smithi078.stdout:5/629: mkdir d7/d8/d47/ddd 0 2024-09-11T00:18:01.872 INFO:tasks.workunit.client.0.smithi078.stdout:2/762: dread d0/d1/d3b/f4e [0,4194304] 0 2024-09-11T00:18:01.873 INFO:tasks.workunit.client.0.smithi078.stdout:4/861: link dc/d10/d40/d3a/d65/cfc dc/d10/d40/d3a/d65/d7b/c118 0 2024-09-11T00:18:01.873 INFO:tasks.workunit.client.0.smithi078.stdout:3/734: write d0/d7/d46/d86/fc9 [4361136,73578] 0 2024-09-11T00:18:01.874 INFO:tasks.workunit.client.0.smithi078.stdout:5/630: symlink d7/d8/d33/d22/d25/d28/d24/d1c/lde 0 2024-09-11T00:18:01.875 INFO:tasks.workunit.client.0.smithi078.stdout:4/862: symlink dc/d10/d40/d3a/d4c/db4/l119 0 2024-09-11T00:18:01.876 INFO:tasks.workunit.client.0.smithi078.stdout:3/735: getdents d0 0 2024-09-11T00:18:01.877 INFO:tasks.workunit.client.0.smithi078.stdout:4/863: symlink dc/d10/ddd/df4/l11a 0 2024-09-11T00:18:01.877 INFO:tasks.workunit.client.0.smithi078.stdout:4/864: write dc/d10/d40/d3a/d65/d94/fd8 [967622,61132] 0 2024-09-11T00:18:01.880 INFO:tasks.workunit.client.0.smithi078.stdout:3/736: creat d0/d7/d23/d7c/fde x:0 0 0 2024-09-11T00:18:01.881 INFO:tasks.workunit.client.0.smithi078.stdout:4/865: symlink dc/d10/ddd/d109/l11b 0 2024-09-11T00:18:01.881 INFO:tasks.workunit.client.0.smithi078.stdout:4/866: fsync dc/d10/d40/d3a/d46/d47/fa3 0 2024-09-11T00:18:01.881 INFO:tasks.workunit.client.0.smithi078.stdout:4/867: rmdir dc/d10/d40/d3a/d65/d94 39 2024-09-11T00:18:01.881 INFO:tasks.workunit.client.0.smithi078.stdout:2/763: read d0/d1/f54 [4079679,5939] 0 2024-09-11T00:18:01.881 INFO:tasks.workunit.client.0.smithi078.stdout:4/868: rmdir dc/d10/ddd/df4 39 2024-09-11T00:18:01.881 INFO:tasks.workunit.client.0.smithi078.stdout:2/764: getdents d0/d1/d11/d1b/d1e 0 2024-09-11T00:18:01.882 INFO:tasks.workunit.client.0.smithi078.stdout:4/869: truncate dc/d10/d40/d3a/d65/f3f 2552581 0 2024-09-11T00:18:01.883 INFO:tasks.workunit.client.0.smithi078.stdout:2/765: link d0/d1/d11/d60/da2/lb5 d0/d1/d6/d52/da8/lfd 0 2024-09-11T00:18:01.884 INFO:tasks.workunit.client.0.smithi078.stdout:4/870: creat dc/d10/d40/d3a/d46/d59/d9f/f11c x:0 0 0 2024-09-11T00:18:01.884 INFO:tasks.workunit.client.0.smithi078.stdout:2/766: creat d0/d67/ffe x:0 0 0 2024-09-11T00:18:01.885 INFO:tasks.workunit.client.0.smithi078.stdout:2/767: write d0/d1/d6/d52/faf [1345405,126830] 0 2024-09-11T00:18:01.887 INFO:tasks.workunit.client.0.smithi078.stdout:3/737: dread d0/d7/d23/d91/f59 [0,4194304] 0 2024-09-11T00:18:01.887 INFO:tasks.workunit.client.0.smithi078.stdout:3/738: chown d0/d1a/d77 507656 1 2024-09-11T00:18:01.888 INFO:tasks.workunit.client.0.smithi078.stdout:3/739: mknod d0/d7/d18/dd8/d3e/cdf 0 2024-09-11T00:18:01.888 INFO:tasks.workunit.client.0.smithi078.stdout:4/871: write dc/d10/d40/d3a/f90 [452032,125408] 0 2024-09-11T00:18:01.888 INFO:tasks.workunit.client.0.smithi078.stdout:4/872: write dc/d10/d40/d3a/d4c/f8a [5185747,10082] 0 2024-09-11T00:18:01.889 INFO:tasks.workunit.client.0.smithi078.stdout:4/873: truncate dc/d10/d40/d3a/d4c/db4/d72/dbb/fc1 484105 0 2024-09-11T00:18:01.889 INFO:tasks.workunit.client.0.smithi078.stdout:4/874: truncate dc/d10/d40/d3a/d65/f22 3338474 0 2024-09-11T00:18:01.889 INFO:tasks.workunit.client.0.smithi078.stdout:4/875: write dc/f39 [927863,116316] 0 2024-09-11T00:18:01.895 INFO:tasks.workunit.client.0.smithi078.stdout:3/740: read d0/d7/d23/d7c/fc3 [3084890,81438] 0 2024-09-11T00:18:01.896 INFO:tasks.workunit.client.0.smithi078.stdout:3/741: creat d0/d7/d18/d70/fe0 x:0 0 0 2024-09-11T00:18:01.896 INFO:tasks.workunit.client.0.smithi078.stdout:3/742: dread - d0/d7/d18/d70/fe0 zero size 2024-09-11T00:18:01.898 INFO:tasks.workunit.client.0.smithi078.stdout:3/743: rename d0/d7/d46/f66 to d0/d7/d23/d7c/db7/fe1 0 2024-09-11T00:18:01.900 INFO:tasks.workunit.client.0.smithi078.stdout:5/631: dread d7/d8/d33/d22/d25/d6a/db0/fc9 [0,4194304] 0 2024-09-11T00:18:01.900 INFO:tasks.workunit.client.0.smithi078.stdout:9/728: dwrite dc/d12/d46/d51/dcc/fd3 [4194304,4194304] 0 2024-09-11T00:18:01.901 INFO:tasks.workunit.client.0.smithi078.stdout:3/744: rename d0/d7/d18/dd8/d60/d6d/ldc to d0/d39/le2 0 2024-09-11T00:18:01.901 INFO:tasks.workunit.client.0.smithi078.stdout:3/745: dread - d0/d7/d18/d70/fe0 zero size 2024-09-11T00:18:01.903 INFO:tasks.workunit.client.0.smithi078.stdout:9/729: rmdir dc/d12 39 2024-09-11T00:18:01.906 INFO:tasks.workunit.client.0.smithi078.stdout:5/632: rename d7/d8/d33/d22/da3 to d7/d8/d33/d22/dd9/ddf 0 2024-09-11T00:18:01.906 INFO:tasks.workunit.client.0.smithi078.stdout:7/664: dwrite d0/d34/db/d30/d1d/d14/d62/f84 [0,4194304] 0 2024-09-11T00:18:01.908 INFO:tasks.workunit.client.0.smithi078.stdout:3/746: dread d0/d7/d18/dd8/d3e/f5f [0,4194304] 0 2024-09-11T00:18:01.910 INFO:tasks.workunit.client.0.smithi078.stdout:3/747: dread d0/d7/d18/dd8/f8f [0,4194304] 0 2024-09-11T00:18:01.910 INFO:tasks.workunit.client.0.smithi078.stdout:3/748: fsync d0/d39/fc1 0 2024-09-11T00:18:01.910 INFO:tasks.workunit.client.0.smithi078.stdout:4/876: dwrite dc/d10/d40/d3a/d65/f92 [4194304,4194304] 0 2024-09-11T00:18:01.913 INFO:tasks.workunit.client.0.smithi078.stdout:2/768: dwrite d0/d1/d33/f91 [0,4194304] 0 2024-09-11T00:18:01.913 INFO:tasks.workunit.client.0.smithi078.stdout:2/769: stat d0/d1/d6/d52/da8 0 2024-09-11T00:18:01.917 INFO:tasks.workunit.client.0.smithi078.stdout:7/665: read d0/d34/db/d30/d28/f44 [1235888,63345] 0 2024-09-11T00:18:01.920 INFO:tasks.workunit.client.0.smithi078.stdout:4/877: mknod dc/d10/d40/d3a/d65/d7b/d8b/dfa/c11d 0 2024-09-11T00:18:01.921 INFO:tasks.workunit.client.0.smithi078.stdout:4/878: truncate dc/d10/d40/d3a/d65/f10f 815714 0 2024-09-11T00:18:01.921 INFO:tasks.workunit.client.0.smithi078.stdout:4/879: fdatasync dc/f10a 0 2024-09-11T00:18:01.924 INFO:tasks.workunit.client.0.smithi078.stdout:2/770: mkdir d0/d1/d6/d52/da8/dff 0 2024-09-11T00:18:01.925 INFO:tasks.workunit.client.0.smithi078.stdout:5/633: dread d7/d8/de/d2c/f94 [0,4194304] 0 2024-09-11T00:18:01.926 INFO:tasks.workunit.client.0.smithi078.stdout:4/880: rmdir dc/d10/d40/d3a/d65/d7b 39 2024-09-11T00:18:01.926 INFO:tasks.workunit.client.0.smithi078.stdout:4/881: chown dc/d10/d40/d3a/d65/fde 91335 1 2024-09-11T00:18:01.927 INFO:tasks.workunit.client.0.smithi078.stdout:7/666: dread d0/f43 [0,4194304] 0 2024-09-11T00:18:01.927 INFO:tasks.workunit.client.0.smithi078.stdout:2/771: mknod d0/d1/d6/c100 0 2024-09-11T00:18:01.929 INFO:tasks.workunit.client.0.smithi078.stdout:5/634: symlink d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d8c/le0 0 2024-09-11T00:18:01.930 INFO:tasks.workunit.client.0.smithi078.stdout:3/749: dwrite d0/d7/d23/d91/f22 [0,4194304] 0 2024-09-11T00:18:01.930 INFO:tasks.workunit.client.0.smithi078.stdout:3/750: fsync d0/d1a/f4f 0 2024-09-11T00:18:01.930 INFO:tasks.workunit.client.0.smithi078.stdout:3/751: write d0/f65 [3562794,114533] 0 2024-09-11T00:18:01.930 INFO:tasks.workunit.client.0.smithi078.stdout:4/882: mkdir dc/d10/d40/d3a/d46/d47/d11e 0 2024-09-11T00:18:01.930 INFO:tasks.workunit.client.0.smithi078.stdout:4/883: write dc/d10/d40/d3a/d65/d94/fcd [87281,47111] 0 2024-09-11T00:18:01.930 INFO:tasks.workunit.client.0.smithi078.stdout:5/635: creat d7/d8/fe1 x:0 0 0 2024-09-11T00:18:01.932 INFO:tasks.workunit.client.0.smithi078.stdout:4/884: creat dc/f11f x:0 0 0 2024-09-11T00:18:01.934 INFO:tasks.workunit.client.0.smithi078.stdout:4/885: creat dc/d10/d40/d3a/d4c/db4/df9/f120 x:0 0 0 2024-09-11T00:18:01.935 INFO:tasks.workunit.client.0.smithi078.stdout:4/886: truncate dc/d10/d40/d3a/d4c/db4/d72/dbb/fc1 1511995 0 2024-09-11T00:18:01.935 INFO:tasks.workunit.client.0.smithi078.stdout:4/887: write dc/d10/d40/d3a/d65/d94/fb6 [833724,59793] 0 2024-09-11T00:18:01.936 INFO:tasks.workunit.client.0.smithi078.stdout:4/888: chown dc/d10/d40/d3a/d65/c38 19 1 2024-09-11T00:18:01.936 INFO:tasks.workunit.client.0.smithi078.stdout:4/889: fsync dc/d10/d40/d3a/d4c/fcb 0 2024-09-11T00:18:01.936 INFO:tasks.workunit.client.0.smithi078.stdout:3/752: dread d0/f1f [0,4194304] 0 2024-09-11T00:18:01.936 INFO:tasks.workunit.client.0.smithi078.stdout:3/753: chown d0/d7/d46/f5b 2199 1 2024-09-11T00:18:01.936 INFO:tasks.workunit.client.0.smithi078.stdout:2/772: dread d0/d1/d11/f69 [0,4194304] 0 2024-09-11T00:18:01.937 INFO:tasks.workunit.client.0.smithi078.stdout:7/667: dread d0/d34/db/f51 [0,4194304] 0 2024-09-11T00:18:01.938 INFO:tasks.workunit.client.0.smithi078.stdout:5/636: dread d7/d8/d33/d22/d25/d28/d24/d1c/d1e/fa2 [0,4194304] 0 2024-09-11T00:18:01.938 INFO:tasks.workunit.client.0.smithi078.stdout:2/773: dread d0/d1/d11/d60/da2/d3a/f4a [0,4194304] 0 2024-09-11T00:18:01.944 INFO:tasks.workunit.client.0.smithi078.stdout:6/689: sync 2024-09-11T00:18:01.944 INFO:tasks.workunit.client.0.smithi078.stdout:8/867: sync 2024-09-11T00:18:01.944 INFO:tasks.workunit.client.0.smithi078.stdout:6/690: chown d0/d1/d9/d59/d74/db3/dd5/f3d 4 1 2024-09-11T00:18:01.944 INFO:tasks.workunit.client.0.smithi078.stdout:8/868: write da/d13/d1b/d24/d62/d111/d99/d82/d63/fcd [11878,29394] 0 2024-09-11T00:18:01.944 INFO:tasks.workunit.client.0.smithi078.stdout:8/869: fsync da/d13/d1b/d37/fb7 0 2024-09-11T00:18:01.944 INFO:tasks.workunit.client.0.smithi078.stdout:0/692: sync 2024-09-11T00:18:01.944 INFO:tasks.workunit.client.0.smithi078.stdout:0/693: write d2/d57/f7a [4216387,89125] 0 2024-09-11T00:18:01.946 INFO:tasks.workunit.client.0.smithi078.stdout:2/774: symlink d0/d1/d11/d60/da2/d3a/d51/d97/dbd/l101 0 2024-09-11T00:18:01.946 INFO:tasks.workunit.client.0.smithi078.stdout:3/754: dread d0/d7/d18/dd8/d60/d6d/f3a [0,4194304] 0 2024-09-11T00:18:01.947 INFO:tasks.workunit.client.0.smithi078.stdout:0/694: dread d2/d2a/d2c/d35/d59/d4f/d61/fae [0,4194304] 0 2024-09-11T00:18:01.950 INFO:tasks.workunit.client.0.smithi078.stdout:8/870: dread da/d87/d7b/f8f [0,4194304] 0 2024-09-11T00:18:01.950 INFO:tasks.workunit.client.0.smithi078.stdout:5/637: dread d7/d8/de/f11 [0,4194304] 0 2024-09-11T00:18:01.952 INFO:tasks.workunit.client.0.smithi078.stdout:8/871: mkdir da/d87/d3a/d4b/dd3/d116 0 2024-09-11T00:18:01.954 INFO:tasks.workunit.client.0.smithi078.stdout:8/872: mkdir da/d13/d1b/d24/d86/d117 0 2024-09-11T00:18:01.954 INFO:tasks.workunit.client.0.smithi078.stdout:8/873: truncate da/d13/d1b/d37/f5a 603097 0 2024-09-11T00:18:01.955 INFO:tasks.workunit.client.0.smithi078.stdout:8/874: creat da/d1c/d60/dfa/f118 x:0 0 0 2024-09-11T00:18:01.956 INFO:tasks.workunit.client.0.smithi078.stdout:8/875: fsync da/d87/d3a/f81 0 2024-09-11T00:18:01.956 INFO:tasks.workunit.client.0.smithi078.stdout:8/876: truncate da/d13/d1b/d24/d62/d111/f83 4229317 0 2024-09-11T00:18:01.956 INFO:tasks.workunit.client.0.smithi078.stdout:3/755: dread d0/d7/d18/dd8/d3e/f5d [0,4194304] 0 2024-09-11T00:18:01.957 INFO:tasks.workunit.client.0.smithi078.stdout:4/890: dwrite dc/d10/d40/d3a/d46/f6b [0,4194304] 0 2024-09-11T00:18:01.958 INFO:tasks.workunit.client.0.smithi078.stdout:8/877: unlink da/cd 0 2024-09-11T00:18:01.958 INFO:tasks.workunit.client.0.smithi078.stdout:3/756: rmdir d0/d7/d23/d7c/db7 39 2024-09-11T00:18:01.960 INFO:tasks.workunit.client.0.smithi078.stdout:4/891: mknod dc/d10/ddd/c121 0 2024-09-11T00:18:01.960 INFO:tasks.workunit.client.0.smithi078.stdout:4/892: fsync dc/d10/d1f/f97 0 2024-09-11T00:18:01.961 INFO:tasks.workunit.client.0.smithi078.stdout:4/893: write dc/d10/d1f/f97 [862289,86699] 0 2024-09-11T00:18:01.962 INFO:tasks.workunit.client.0.smithi078.stdout:8/878: rename da/d13/d1b/d24/d62/d111/d9e/dd8/f108 to da/d7a/f119 0 2024-09-11T00:18:01.962 INFO:tasks.workunit.client.0.smithi078.stdout:8/879: stat da/d13/d1b/d24/d62/f69 0 2024-09-11T00:18:01.962 INFO:tasks.workunit.client.0.smithi078.stdout:3/757: mkdir d0/d7/d18/d8c/de3 0 2024-09-11T00:18:01.962 INFO:tasks.workunit.client.0.smithi078.stdout:3/758: write d0/d7/d18/f61 [621836,36119] 0 2024-09-11T00:18:01.963 INFO:tasks.workunit.client.0.smithi078.stdout:3/759: rmdir d0/d7/d18/dd8/d60 39 2024-09-11T00:18:01.964 INFO:tasks.workunit.client.0.smithi078.stdout:6/691: dwrite d0/d1/d1b/f50 [0,4194304] 0 2024-09-11T00:18:01.967 INFO:tasks.workunit.client.0.smithi078.stdout:6/692: getdents d0/d1/d53/d9c/dac 0 2024-09-11T00:18:01.967 INFO:tasks.workunit.client.0.smithi078.stdout:6/693: chown d0/d66/f7f 245893640 1 2024-09-11T00:18:01.969 INFO:tasks.workunit.client.0.smithi078.stdout:4/894: dread dc/d10/d40/d3a/d4c/fcb [0,4194304] 0 2024-09-11T00:18:01.969 INFO:tasks.workunit.client.0.smithi078.stdout:4/895: write dc/d10/d1f/f97 [294573,51550] 0 2024-09-11T00:18:01.969 INFO:tasks.workunit.client.0.smithi078.stdout:4/896: write dc/d10/d40/d3a/d4c/db4/fc4 [3837873,60997] 0 2024-09-11T00:18:01.970 INFO:tasks.workunit.client.0.smithi078.stdout:0/695: dwrite d2/f16 [0,4194304] 0 2024-09-11T00:18:01.971 INFO:tasks.workunit.client.0.smithi078.stdout:3/760: dread d0/d7/d18/dd8/d60/d6d/f3a [0,4194304] 0 2024-09-11T00:18:01.971 INFO:tasks.workunit.client.0.smithi078.stdout:2/775: write d0/d1/d11/d60/da2/fb3 [2033219,38984] 0 2024-09-11T00:18:01.971 INFO:tasks.workunit.client.0.smithi078.stdout:3/761: write d0/d39/fad [463964,109546] 0 2024-09-11T00:18:01.971 INFO:tasks.workunit.client.0.smithi078.stdout:4/897: mknod dc/d10/d40/d3a/d65/d7b/d9e/d50/c122 0 2024-09-11T00:18:01.971 INFO:tasks.workunit.client.0.smithi078.stdout:7/668: dwrite d0/d34/db/d30/d1d/f2c [4194304,4194304] 0 2024-09-11T00:18:01.975 INFO:tasks.workunit.client.0.smithi078.stdout:0/696: creat d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/dbc/fe8 x:0 0 0 2024-09-11T00:18:01.977 INFO:tasks.workunit.client.0.smithi078.stdout:2/776: mkdir d0/d1/d6/d52/d102 0 2024-09-11T00:18:01.977 INFO:tasks.workunit.client.0.smithi078.stdout:2/777: dread - d0/d1/d11/d60/fab zero size 2024-09-11T00:18:01.979 INFO:tasks.workunit.client.0.smithi078.stdout:3/762: symlink d0/d1a/d77/le4 0 2024-09-11T00:18:01.979 INFO:tasks.workunit.client.0.smithi078.stdout:3/763: write d0/d7/d23/d7c/fc3 [3532318,98877] 0 2024-09-11T00:18:01.979 INFO:tasks.workunit.client.0.smithi078.stdout:3/764: readlink d0/d7/d46/lbf 0 2024-09-11T00:18:01.979 INFO:tasks.workunit.client.0.smithi078.stdout:3/765: dread - d0/d7/d18/fbc zero size 2024-09-11T00:18:01.980 INFO:tasks.workunit.client.0.smithi078.stdout:4/898: symlink dc/d54/dd0/l123 0 2024-09-11T00:18:01.985 INFO:tasks.workunit.client.0.smithi078.stdout:0/697: dread d2/d2a/d2c/d35/d59/d4f/d61/d69/f67 [0,4194304] 0 2024-09-11T00:18:01.986 INFO:tasks.workunit.client.0.smithi078.stdout:4/899: truncate dc/d10/d40/d3a/d65/f101 315324 0 2024-09-11T00:18:01.992 INFO:tasks.workunit.client.0.smithi078.stdout:7/669: dwrite d0/d34/db/d30/d1d/f59 [0,4194304] 0 2024-09-11T00:18:01.992 INFO:tasks.workunit.client.0.smithi078.stdout:7/670: chown d0/d34/c9f 693486015 1 2024-09-11T00:18:01.997 INFO:tasks.workunit.client.0.smithi078.stdout:6/694: dwrite d0/d1/f2f [0,4194304] 0 2024-09-11T00:18:01.997 INFO:tasks.workunit.client.0.smithi078.stdout:6/695: write d0/d1/d1b/fae [565716,30274] 0 2024-09-11T00:18:01.997 INFO:tasks.workunit.client.0.smithi078.stdout:6/696: chown d0/d1/d9/d8d/fde 972 1 2024-09-11T00:18:02.000 INFO:tasks.workunit.client.0.smithi078.stdout:6/697: symlink d0/d1/d53/d72/le8 0 2024-09-11T00:18:02.000 INFO:tasks.workunit.client.0.smithi078.stdout:6/698: chown d0/d1/d1b/f73 0 1 2024-09-11T00:18:02.002 INFO:tasks.workunit.client.0.smithi078.stdout:6/699: unlink d0/d1/d53/d72/ca6 0 2024-09-11T00:18:02.004 INFO:tasks.workunit.client.0.smithi078.stdout:6/700: mknod d0/d1/d9/d59/d74/ce9 0 2024-09-11T00:18:02.005 INFO:tasks.workunit.client.0.smithi078.stdout:6/701: rmdir d0/d1/d53/d72/dcc 39 2024-09-11T00:18:02.011 INFO:tasks.workunit.client.0.smithi078.stdout:4/900: dwrite dc/d10/d40/d3a/d4c/db4/fe4 [0,4194304] 0 2024-09-11T00:18:02.011 INFO:tasks.workunit.client.0.smithi078.stdout:0/698: dwrite d2/d2a/d2c/d5e/fc4 [0,4194304] 0 2024-09-11T00:18:02.011 INFO:tasks.workunit.client.0.smithi078.stdout:4/901: fdatasync dc/d10/f86 0 2024-09-11T00:18:02.011 INFO:tasks.workunit.client.0.smithi078.stdout:8/880: dwrite da/d87/d3a/d4b/dd3/f107 [0,4194304] 0 2024-09-11T00:18:02.015 INFO:tasks.workunit.client.0.smithi078.stdout:7/671: dwrite d0/d34/db/d30/d28/f6a [0,4194304] 0 2024-09-11T00:18:02.015 INFO:tasks.workunit.client.0.smithi078.stdout:0/699: creat d2/dbd/fe9 x:0 0 0 2024-09-11T00:18:02.015 INFO:tasks.workunit.client.0.smithi078.stdout:7/672: write d0/da7/fbe [459675,107345] 0 2024-09-11T00:18:02.017 INFO:tasks.workunit.client.0.smithi078.stdout:4/902: mknod dc/d10/d40/d3a/d4c/db4/c124 0 2024-09-11T00:18:02.020 INFO:tasks.workunit.client.0.smithi078.stdout:5/638: read d7/d8/d33/d22/d25/d28/f31 [1603163,18998] 0 2024-09-11T00:18:02.020 INFO:tasks.workunit.client.0.smithi078.stdout:2/778: dwrite d0/d1/d11/d60/da2/d3a/fc7 [0,4194304] 0 2024-09-11T00:18:02.020 INFO:tasks.workunit.client.0.smithi078.stdout:2/779: dread - d0/d1/d3c/d40/d50/fda zero size 2024-09-11T00:18:02.021 INFO:tasks.workunit.client.0.smithi078.stdout:6/702: dwrite d0/d1/f52 [0,4194304] 0 2024-09-11T00:18:02.021 INFO:tasks.workunit.client.0.smithi078.stdout:6/703: stat d0/d1/d9/l4 0 2024-09-11T00:18:02.023 INFO:tasks.workunit.client.0.smithi078.stdout:0/700: symlink d2/lea 0 2024-09-11T00:18:02.023 INFO:tasks.workunit.client.0.smithi078.stdout:4/903: creat dc/d10/ddb/f125 x:0 0 0 2024-09-11T00:18:02.023 INFO:tasks.workunit.client.0.smithi078.stdout:0/701: fsync d2/d2a/d2c/d35/d59/d7/f86 0 2024-09-11T00:18:02.025 INFO:tasks.workunit.client.0.smithi078.stdout:3/766: dwrite d0/d1a/f3b [0,4194304] 0 2024-09-11T00:18:02.039 INFO:tasks.workunit.client.0.smithi078.stdout:2/780: dwrite d0/d1/d3c/d9f/fa9 [0,4194304] 0 2024-09-11T00:18:02.040 INFO:tasks.workunit.client.0.smithi078.stdout:6/704: dwrite d0/d66/f7f [4194304,4194304] 0 2024-09-11T00:18:02.040 INFO:tasks.workunit.client.0.smithi078.stdout:6/705: dread - d0/fc5 zero size 2024-09-11T00:18:02.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:01 smithi078 ceph-mon[30865]: pgmap v370: 97 pgs: 97 active+clean; 1.4 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 130 MiB/s rd, 170 MiB/s wr, 422 op/s 2024-09-11T00:18:02.111 INFO:tasks.workunit.client.0.smithi078.stdout:7/673: dwrite d0/d34/db/d30/d1d/d14/f79 [4194304,4194304] 0 2024-09-11T00:18:02.112 INFO:tasks.workunit.client.0.smithi078.stdout:5/639: mknod d7/d8/d33/d22/d25/d6a/dc0/ce2 0 2024-09-11T00:18:02.112 INFO:tasks.workunit.client.0.smithi078.stdout:5/640: chown d7/d8/d33/d22/dd9/ddf/f9f 16 1 2024-09-11T00:18:02.112 INFO:tasks.workunit.client.0.smithi078.stdout:5/641: write d7/d8/de/f11 [1794599,101017] 0 2024-09-11T00:18:02.113 INFO:tasks.workunit.client.0.smithi078.stdout:2/781: dwrite d0/d1/d11/d60/da2/d3a/d51/f58 [0,4194304] 0 2024-09-11T00:18:02.113 INFO:tasks.workunit.client.0.smithi078.stdout:2/782: truncate d0/d1/d11/d60/da2/d3a/f3e 1073296 0 2024-09-11T00:18:02.113 INFO:tasks.workunit.client.0.smithi078.stdout:2/783: chown d0/d1/d11/d60/da2/d3a/d51/d97/dac/cd5 8 1 2024-09-11T00:18:02.113 INFO:tasks.workunit.client.0.smithi078.stdout:8/881: link da/d87/d3a/d4b/c103 da/d13/d1b/d24/d62/d111/d99/d82/d63/c11a 0 2024-09-11T00:18:02.114 INFO:tasks.workunit.client.0.smithi078.stdout:4/904: unlink dc/d10/d40/d3a/d65/d7b/d9e/d5d/c115 0 2024-09-11T00:18:02.115 INFO:tasks.workunit.client.0.smithi078.stdout:4/905: write dc/d10/d1f/f20 [4494566,130863] 0 2024-09-11T00:18:02.116 INFO:tasks.workunit.client.0.smithi078.stdout:0/702: rename d2/d2a/d2c/ce2 to d2/d2a/d2c/d35/d59/de7/ceb 0 2024-09-11T00:18:02.120 INFO:tasks.workunit.client.0.smithi078.stdout:0/703: dread d2/d2a/d2c/d35/d59/d7/fd5 [0,4194304] 0 2024-09-11T00:18:02.126 INFO:tasks.workunit.client.0.smithi078.stdout:6/706: mknod d0/d66/da5/cea 0 2024-09-11T00:18:02.127 INFO:tasks.workunit.client.0.smithi078.stdout:7/674: creat d0/d34/db/d30/d28/fc3 x:0 0 0 2024-09-11T00:18:02.127 INFO:tasks.workunit.client.0.smithi078.stdout:7/675: stat d0/d34/db/d30/d1d/d14/l42 0 2024-09-11T00:18:02.128 INFO:tasks.workunit.client.0.smithi078.stdout:5/642: getdents d7/d8/d33/d22/d25/d6a 0 2024-09-11T00:18:02.130 INFO:tasks.workunit.client.0.smithi078.stdout:2/784: mknod d0/d1/d11/d60/da2/d3a/d51/de6/c103 0 2024-09-11T00:18:02.130 INFO:tasks.workunit.client.0.smithi078.stdout:2/785: truncate d0/d1/d11/d60/da2/d38/fad 337904 0 2024-09-11T00:18:02.130 INFO:tasks.workunit.client.0.smithi078.stdout:8/882: write da/fba [733157,91684] 0 2024-09-11T00:18:02.132 INFO:tasks.workunit.client.0.smithi078.stdout:4/906: truncate dc/d10/d40/d33/fe1 432496 0 2024-09-11T00:18:02.132 INFO:tasks.workunit.client.0.smithi078.stdout:4/907: fsync dc/f11 0 2024-09-11T00:18:02.133 INFO:tasks.workunit.client.0.smithi078.stdout:4/908: write dc/d10/f14 [750939,25548] 0 2024-09-11T00:18:02.133 INFO:tasks.workunit.client.0.smithi078.stdout:3/767: rename d0/d7/d18/dd8/d60/c92 to d0/d7/d18/d1b/d8e/daf/ce5 0 2024-09-11T00:18:02.135 INFO:tasks.workunit.client.0.smithi078.stdout:0/704: mknod d2/d2a/d2c/d35/d59/de7/cec 0 2024-09-11T00:18:02.136 INFO:tasks.workunit.client.0.smithi078.stdout:7/676: mkdir d0/d34/db/d30/d28/dc4 0 2024-09-11T00:18:02.137 INFO:tasks.workunit.client.0.smithi078.stdout:5/643: mkdir d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/de3 0 2024-09-11T00:18:02.138 INFO:tasks.workunit.client.0.smithi078.stdout:4/909: creat dc/d10/d40/d3a/d65/d7b/d108/f126 x:0 0 0 2024-09-11T00:18:02.139 INFO:tasks.workunit.client.0.smithi078.stdout:6/707: rename d0/d1/d53/d72/fc6 to d0/d1/d53/d9c/dac/feb 0 2024-09-11T00:18:02.140 INFO:tasks.workunit.client.0.smithi078.stdout:0/705: rmdir d2/d57 39 2024-09-11T00:18:02.142 INFO:tasks.workunit.client.0.smithi078.stdout:7/677: mkdir d0/d34/db/d30/d1d/d14/d87/dc5 0 2024-09-11T00:18:02.143 INFO:tasks.workunit.client.0.smithi078.stdout:5/644: truncate d7/d8/de/d2c/fa6 839744 0 2024-09-11T00:18:02.144 INFO:tasks.workunit.client.0.smithi078.stdout:2/786: rename d0/d1/d6/f37 to d0/d1/d6/d52/d102/f104 0 2024-09-11T00:18:02.146 INFO:tasks.workunit.client.0.smithi078.stdout:4/910: dread dc/d10/d40/d3a/d65/d7b/d9e/f45 [0,4194304] 0 2024-09-11T00:18:02.146 INFO:tasks.workunit.client.0.smithi078.stdout:3/768: dread d0/f8 [0,4194304] 0 2024-09-11T00:18:02.146 INFO:tasks.workunit.client.0.smithi078.stdout:0/706: dread d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/f60 [0,4194304] 0 2024-09-11T00:18:02.147 INFO:tasks.workunit.client.0.smithi078.stdout:7/678: creat d0/d34/d65/fc6 x:0 0 0 2024-09-11T00:18:02.148 INFO:tasks.workunit.client.0.smithi078.stdout:0/707: dread d2/d57/d8b/fc1 [0,4194304] 0 2024-09-11T00:18:02.149 INFO:tasks.workunit.client.0.smithi078.stdout:8/883: rename da/d87/d7b/da7/d110 to da/d87/d3a/d4b/dd3/d11b 0 2024-09-11T00:18:02.151 INFO:tasks.workunit.client.0.smithi078.stdout:2/787: rmdir d0 39 2024-09-11T00:18:02.152 INFO:tasks.workunit.client.0.smithi078.stdout:4/911: creat dc/d10/ddd/d109/f127 x:0 0 0 2024-09-11T00:18:02.153 INFO:tasks.workunit.client.0.smithi078.stdout:6/708: dwrite d0/d1/d53/fbb [0,4194304] 0 2024-09-11T00:18:02.153 INFO:tasks.workunit.client.0.smithi078.stdout:0/708: dread d2/d2a/d2c/d35/d59/d4f/d61/d69/f67 [0,4194304] 0 2024-09-11T00:18:02.153 INFO:tasks.workunit.client.0.smithi078.stdout:0/709: read d2/f1d [2846774,2764] 0 2024-09-11T00:18:02.154 INFO:tasks.workunit.client.0.smithi078.stdout:2/788: read d0/fd9 [1793765,119599] 0 2024-09-11T00:18:02.154 INFO:tasks.workunit.client.0.smithi078.stdout:3/769: creat d0/fe6 x:0 0 0 2024-09-11T00:18:02.154 INFO:tasks.workunit.client.0.smithi078.stdout:3/770: write d0/f78 [4281786,91617] 0 2024-09-11T00:18:02.156 INFO:tasks.workunit.client.0.smithi078.stdout:7/679: link d0/d34/db/d30/d1d/d14/d62/f84 d0/d34/d86/fc7 0 2024-09-11T00:18:02.156 INFO:tasks.workunit.client.0.smithi078.stdout:7/680: stat d0/d34/db/d32/lb9 0 2024-09-11T00:18:02.161 INFO:tasks.workunit.client.0.smithi078.stdout:6/709: mkdir d0/d1/d53/d9c/db6/de5/dec 0 2024-09-11T00:18:02.162 INFO:tasks.workunit.client.0.smithi078.stdout:0/710: getdents d2/d2a/d2c/d5e 0 2024-09-11T00:18:02.162 INFO:tasks.workunit.client.0.smithi078.stdout:0/711: write d2/d2a/d2c/d35/d59/d7/f3b [423958,105453] 0 2024-09-11T00:18:02.163 INFO:tasks.workunit.client.0.smithi078.stdout:9/730: sync 2024-09-11T00:18:02.163 INFO:tasks.workunit.client.0.smithi078.stdout:2/789: mknod d0/d1/d8/c105 0 2024-09-11T00:18:02.163 INFO:tasks.workunit.client.0.smithi078.stdout:8/884: mkdir da/d1c/d60/d85/d94/d11c 0 2024-09-11T00:18:02.163 INFO:tasks.workunit.client.0.smithi078.stdout:8/885: truncate da/d13/d1b/d37/fc0 474788 0 2024-09-11T00:18:02.164 INFO:tasks.workunit.client.0.smithi078.stdout:2/790: dread d0/d1/d11/d1b/d1e/fbf [0,4194304] 0 2024-09-11T00:18:02.165 INFO:tasks.workunit.client.0.smithi078.stdout:4/912: write dc/d54/fab [2909726,40709] 0 2024-09-11T00:18:02.165 INFO:tasks.workunit.client.0.smithi078.stdout:5/645: dwrite d7/d8/d33/d22/d51/faf [0,4194304] 0 2024-09-11T00:18:02.165 INFO:tasks.workunit.client.0.smithi078.stdout:5/646: write d7/d8/f8b [421745,48863] 0 2024-09-11T00:18:02.166 INFO:tasks.workunit.client.0.smithi078.stdout:6/710: link d0/d1/d53/d9c/fbc d0/d1/d9/d59/d74/fed 0 2024-09-11T00:18:02.167 INFO:tasks.workunit.client.0.smithi078.stdout:9/731: mkdir dc/d12/d46/dfa 0 2024-09-11T00:18:02.168 INFO:tasks.workunit.client.0.smithi078.stdout:0/712: dread d2/d2a/fab [0,4194304] 0 2024-09-11T00:18:02.169 INFO:tasks.workunit.client.0.smithi078.stdout:8/886: symlink da/d13/d1b/d24/d62/d111/d99/d82/d63/da9/l11d 0 2024-09-11T00:18:02.170 INFO:tasks.workunit.client.0.smithi078.stdout:2/791: link d0/d1/d11/d60/da2/d3a/d51/f58 d0/d19/d3d/f106 0 2024-09-11T00:18:02.174 INFO:tasks.workunit.client.0.smithi078.stdout:5/647: symlink d7/d8/de/d90/le4 0 2024-09-11T00:18:02.174 INFO:tasks.workunit.client.0.smithi078.stdout:5/648: read d7/d8/d33/d22/f2d [973243,77440] 0 2024-09-11T00:18:02.174 INFO:tasks.workunit.client.0.smithi078.stdout:5/649: getdents d7/d8/d33/d22/d25/db1 0 2024-09-11T00:18:02.176 INFO:tasks.workunit.client.0.smithi078.stdout:6/711: creat d0/d1/d53/fee x:0 0 0 2024-09-11T00:18:02.177 INFO:tasks.workunit.client.0.smithi078.stdout:9/732: creat dc/d12/d20/d50/dbc/dd4/ffb x:0 0 0 2024-09-11T00:18:02.179 INFO:tasks.workunit.client.0.smithi078.stdout:8/887: rename da/d13/d1b/d59/lb1 to da/d1c/d4c/dbc/l11e 0 2024-09-11T00:18:02.181 INFO:tasks.workunit.client.0.smithi078.stdout:4/913: write dc/d10/d40/d3a/d65/f63 [3233637,6586] 0 2024-09-11T00:18:02.181 INFO:tasks.workunit.client.0.smithi078.stdout:4/914: fsync dc/d10/d1f/fc9 0 2024-09-11T00:18:02.181 INFO:tasks.workunit.client.0.smithi078.stdout:4/915: write dc/d10/d40/d3a/d65/d7b/d9e/d5d/f10d [597332,101924] 0 2024-09-11T00:18:02.181 INFO:tasks.workunit.client.0.smithi078.stdout:6/712: truncate d0/d1/d9/d59/d74/db3/dd5/f3d 2342467 0 2024-09-11T00:18:02.183 INFO:tasks.workunit.client.0.smithi078.stdout:5/650: dread d7/d8/d33/d22/d25/d28/d24/d1c/f2e [0,4194304] 0 2024-09-11T00:18:02.184 INFO:tasks.workunit.client.0.smithi078.stdout:4/916: getdents dc 0 2024-09-11T00:18:02.187 INFO:tasks.workunit.client.0.smithi078.stdout:5/651: unlink d7/d8/d33/d22/d51/f7f 0 2024-09-11T00:18:02.188 INFO:tasks.workunit.client.0.smithi078.stdout:5/652: symlink d7/d8/d47/d52/le5 0 2024-09-11T00:18:02.193 INFO:tasks.workunit.client.0.smithi078.stdout:8/888: dread da/fc [0,4194304] 0 2024-09-11T00:18:02.194 INFO:tasks.workunit.client.0.smithi078.stdout:8/889: rmdir da/d13/d1b/d7d 39 2024-09-11T00:18:02.194 INFO:tasks.workunit.client.0.smithi078.stdout:8/890: chown da/d13/d1b/d24 1978 1 2024-09-11T00:18:02.194 INFO:tasks.workunit.client.0.smithi078.stdout:8/891: truncate da/d1c/d4c/f10e 704396 0 2024-09-11T00:18:02.198 INFO:tasks.workunit.client.0.smithi078.stdout:2/792: dwrite d0/d1/d11/d60/da2/ff1 [0,4194304] 0 2024-09-11T00:18:02.198 INFO:tasks.workunit.client.0.smithi078.stdout:2/793: dread - d0/d67/ffe zero size 2024-09-11T00:18:02.199 INFO:tasks.workunit.client.0.smithi078.stdout:9/733: read dc/fe6 [1297152,53962] 0 2024-09-11T00:18:02.200 INFO:tasks.workunit.client.0.smithi078.stdout:2/794: rename d0/d19/d3d/d8d/d8e to d0/d1/d11/d60/da2/d3a/d107 0 2024-09-11T00:18:02.202 INFO:tasks.workunit.client.0.smithi078.stdout:2/795: dread d0/d1/d8/f21 [0,4194304] 0 2024-09-11T00:18:02.202 INFO:tasks.workunit.client.0.smithi078.stdout:2/796: readlink d0/d1/d6/l66 0 2024-09-11T00:18:02.214 INFO:tasks.workunit.client.0.smithi078.stdout:9/734: dwrite dc/d12/d46/d51/f53 [0,4194304] 0 2024-09-11T00:18:02.214 INFO:tasks.workunit.client.0.smithi078.stdout:9/735: chown dc/d12/f11 206493 1 2024-09-11T00:18:02.216 INFO:tasks.workunit.client.0.smithi078.stdout:6/713: getdents d0/d1/d53/d9c/db6/de5 0 2024-09-11T00:18:02.217 INFO:tasks.workunit.client.0.smithi078.stdout:2/797: write d0/d1/d6f/d93/dc3/dc4/dd4/fe0 [3591783,75754] 0 2024-09-11T00:18:02.218 INFO:tasks.workunit.client.0.smithi078.stdout:8/892: dwrite da/d13/d19/fc3 [0,4194304] 0 2024-09-11T00:18:02.218 INFO:tasks.workunit.client.0.smithi078.stdout:8/893: fsync da/d13/d1b/d24/d62/d111/d9e/fcf 0 2024-09-11T00:18:02.218 INFO:tasks.workunit.client.0.smithi078.stdout:2/798: write d0/d1/d6/d52/faf [2193290,35313] 0 2024-09-11T00:18:02.218 INFO:tasks.workunit.client.0.smithi078.stdout:2/799: chown d0/d1/d6/d52/da8/lb6 3 1 2024-09-11T00:18:02.218 INFO:tasks.workunit.client.0.smithi078.stdout:8/894: write da/d13/d1b/d24/d62/d111/d99/d82/d63/da9/fc4 [1070789,125495] 0 2024-09-11T00:18:02.218 INFO:tasks.workunit.client.0.smithi078.stdout:9/736: creat dc/d12/d20/d50/dbc/dcf/de1/d3e/ffc x:0 0 0 2024-09-11T00:18:02.218 INFO:tasks.workunit.client.0.smithi078.stdout:5/653: dwrite d7/d8/d47/d52/fae [0,4194304] 0 2024-09-11T00:18:02.223 INFO:tasks.workunit.client.0.smithi078.stdout:8/895: rename da/d87/d3a/f40 to da/d13/d1b/d7d/f11f 0 2024-09-11T00:18:02.224 INFO:tasks.workunit.client.0.smithi078.stdout:4/917: dwrite dc/d10/d40/d3a/d65/d94/fcd [0,4194304] 0 2024-09-11T00:18:02.224 INFO:tasks.workunit.client.0.smithi078.stdout:4/918: truncate dc/f2d 4449191 0 2024-09-11T00:18:02.224 INFO:tasks.workunit.client.0.smithi078.stdout:4/919: write dc/d10/d40/d3a/d65/d7b/d9e/d5d/f10d [852906,13851] 0 2024-09-11T00:18:02.224 INFO:tasks.workunit.client.0.smithi078.stdout:4/920: chown dc/d10/d40/d3a/d46/d59/d9f/lfd 6477086 1 2024-09-11T00:18:02.225 INFO:tasks.workunit.client.0.smithi078.stdout:8/896: truncate da/d13/d1b/d24/d62/ffc 4600119 0 2024-09-11T00:18:02.227 INFO:tasks.workunit.client.0.smithi078.stdout:8/897: mknod da/d13/d1b/d37/dd5/c120 0 2024-09-11T00:18:02.228 INFO:tasks.workunit.client.0.smithi078.stdout:8/898: creat da/d1c/d60/d85/d94/f121 x:0 0 0 2024-09-11T00:18:02.229 INFO:tasks.workunit.client.0.smithi078.stdout:4/921: dread dc/d10/d40/d3a/d65/d7b/d9e/d50/fd1 [0,4194304] 0 2024-09-11T00:18:02.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:01 smithi112 ceph-mon[35627]: pgmap v370: 97 pgs: 97 active+clean; 1.4 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 130 MiB/s rd, 170 MiB/s wr, 422 op/s 2024-09-11T00:18:02.236 INFO:tasks.workunit.client.0.smithi078.stdout:4/922: dread dc/d10/d40/d3a/d65/f92 [0,4194304] 0 2024-09-11T00:18:02.244 INFO:tasks.workunit.client.0.smithi078.stdout:9/737: dwrite dc/f1e [0,4194304] 0 2024-09-11T00:18:02.244 INFO:tasks.workunit.client.0.smithi078.stdout:9/738: chown dc/d12/cc7 420591 1 2024-09-11T00:18:02.248 INFO:tasks.workunit.client.0.smithi078.stdout:2/800: dwrite d0/d1/d11/d60/da2/d3a/fd3 [0,4194304] 0 2024-09-11T00:18:02.248 INFO:tasks.workunit.client.0.smithi078.stdout:2/801: write d0/fd9 [340894,41356] 0 2024-09-11T00:18:02.248 INFO:tasks.workunit.client.0.smithi078.stdout:2/802: chown d0/d19 228119 1 2024-09-11T00:18:02.248 INFO:tasks.workunit.client.0.smithi078.stdout:2/803: chown d0/d1/d11/f69 7562 1 2024-09-11T00:18:02.250 INFO:tasks.workunit.client.0.smithi078.stdout:2/804: mkdir d0/d1/d33/d86/d108 0 2024-09-11T00:18:02.250 INFO:tasks.workunit.client.0.smithi078.stdout:2/805: write d0/d1/d11/d1b/d1e/fbf [1290224,15162] 0 2024-09-11T00:18:02.269 INFO:tasks.workunit.client.0.smithi078.stdout:9/739: dwrite dc/d12/d20/d30/fa7 [0,4194304] 0 2024-09-11T00:18:02.269 INFO:tasks.workunit.client.0.smithi078.stdout:9/740: stat dc/d12/d20/d30/fc6 0 2024-09-11T00:18:02.269 INFO:tasks.workunit.client.0.smithi078.stdout:9/741: fdatasync dc/f29 0 2024-09-11T00:18:02.269 INFO:tasks.workunit.client.0.smithi078.stdout:9/742: stat dc/d12/f64 0 2024-09-11T00:18:02.269 INFO:tasks.workunit.client.0.smithi078.stdout:9/743: chown dc/d12/d20/d58/d5b/dbb/l82 9195733 1 2024-09-11T00:18:02.270 INFO:tasks.workunit.client.0.smithi078.stdout:9/744: mkdir dc/d12/d46/d51/dcc/dce/dfd 0 2024-09-11T00:18:02.271 INFO:tasks.workunit.client.0.smithi078.stdout:6/714: dwrite d0/d66/da5/fdf [0,4194304] 0 2024-09-11T00:18:02.271 INFO:tasks.workunit.client.0.smithi078.stdout:9/745: mknod dc/d12/d54/de7/cfe 0 2024-09-11T00:18:02.271 INFO:tasks.workunit.client.0.smithi078.stdout:6/715: chown d0/d1/d53/d72/le8 952556 1 2024-09-11T00:18:02.271 INFO:tasks.workunit.client.0.smithi078.stdout:9/746: stat dc/d12/d20/d58/d5b/f84 0 2024-09-11T00:18:02.271 INFO:tasks.workunit.client.0.smithi078.stdout:8/899: dwrite da/d13/d1b/d24/d62/d111/d99/d82/d63/fd9 [0,4194304] 0 2024-09-11T00:18:02.271 INFO:tasks.workunit.client.0.smithi078.stdout:5/654: dread d7/d8/d33/d22/d25/d6a/f6e [0,4194304] 0 2024-09-11T00:18:02.272 INFO:tasks.workunit.client.0.smithi078.stdout:8/900: stat da/d13/d1b/d37/f7e 0 2024-09-11T00:18:02.272 INFO:tasks.workunit.client.0.smithi078.stdout:9/747: truncate dc/d12/d54/d83/f9e 378107 0 2024-09-11T00:18:02.272 INFO:tasks.workunit.client.0.smithi078.stdout:8/901: fdatasync da/d87/d3a/d4b/dd3/f107 0 2024-09-11T00:18:02.272 INFO:tasks.workunit.client.0.smithi078.stdout:4/923: dwrite dc/d10/d40/d3a/d4c/db4/d72/fc6 [0,4194304] 0 2024-09-11T00:18:02.273 INFO:tasks.workunit.client.0.smithi078.stdout:2/806: dwrite d0/d1/d11/f69 [4194304,4194304] 0 2024-09-11T00:18:02.275 INFO:tasks.workunit.client.0.smithi078.stdout:5/655: dread d7/d8/d33/d22/d25/d28/f41 [0,4194304] 0 2024-09-11T00:18:02.277 INFO:tasks.workunit.client.0.smithi078.stdout:2/807: dread d0/d1/d11/f2d [0,4194304] 0 2024-09-11T00:18:02.282 INFO:tasks.workunit.client.0.smithi078.stdout:6/716: link d0/d1/da8/fad d0/d1/d53/d9c/dac/de3/fef 0 2024-09-11T00:18:02.284 INFO:tasks.workunit.client.0.smithi078.stdout:9/748: symlink dc/d12/d54/d83/dc8/lff 0 2024-09-11T00:18:02.284 INFO:tasks.workunit.client.0.smithi078.stdout:9/749: read - dc/d12/d20/d30/fcd zero size 2024-09-11T00:18:02.284 INFO:tasks.workunit.client.0.smithi078.stdout:8/902: mknod da/d87/d3a/d4b/dd3/d116/c122 0 2024-09-11T00:18:02.285 INFO:tasks.workunit.client.0.smithi078.stdout:9/750: write dc/d12/d20/d58/d5b/d68/fb2 [6035,113906] 0 2024-09-11T00:18:02.285 INFO:tasks.workunit.client.0.smithi078.stdout:4/924: getdents dc/d10/d40/d3a/d65/d7b/d8b 0 2024-09-11T00:18:02.288 INFO:tasks.workunit.client.0.smithi078.stdout:2/808: rename d0/d1/d11/d1b/d1e/f2f to d0/d1/d3c/d40/f109 0 2024-09-11T00:18:02.289 INFO:tasks.workunit.client.0.smithi078.stdout:8/903: stat da/d87/d7b/c89 0 2024-09-11T00:18:02.289 INFO:tasks.workunit.client.0.smithi078.stdout:8/904: fsync da/d13/f50 0 2024-09-11T00:18:02.289 INFO:tasks.workunit.client.0.smithi078.stdout:8/905: fsync da/d13/d1b/d24/d62/d111/d99/d82/d63/da9/fb2 0 2024-09-11T00:18:02.292 INFO:tasks.workunit.client.0.smithi078.stdout:2/809: link d0/d1/d11/d60/da2/d3a/d107/c90 d0/d1/d6f/d93/dc3/dc4/c10a 0 2024-09-11T00:18:02.292 INFO:tasks.workunit.client.0.smithi078.stdout:2/810: mkdir d0/d1/d10b 0 2024-09-11T00:18:02.293 INFO:tasks.workunit.client.0.smithi078.stdout:8/906: getdents da/d7a 0 2024-09-11T00:18:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:01 smithi138 ceph-mon[35019]: pgmap v370: 97 pgs: 97 active+clean; 1.4 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 130 MiB/s rd, 170 MiB/s wr, 422 op/s 2024-09-11T00:18:02.294 INFO:tasks.workunit.client.0.smithi078.stdout:6/717: dread d0/d1/d9/d59/d74/db3/dd5/f37 [0,4194304] 0 2024-09-11T00:18:02.294 INFO:tasks.workunit.client.0.smithi078.stdout:2/811: truncate d0/d1/d6/d52/d102/f104 2017456 0 2024-09-11T00:18:02.295 INFO:tasks.workunit.client.0.smithi078.stdout:2/812: mknod d0/d1/d11/d60/da2/d3a/d51/d97/dbd/c10c 0 2024-09-11T00:18:02.296 INFO:tasks.workunit.client.0.smithi078.stdout:2/813: unlink d0/d1/d11/d60/da2/lb5 0 2024-09-11T00:18:02.297 INFO:tasks.workunit.client.0.smithi078.stdout:2/814: symlink d0/d1/d11/l10d 0 2024-09-11T00:18:02.297 INFO:tasks.workunit.client.0.smithi078.stdout:2/815: getdents d0/d1/d11/d60/da2/d3a/d51/d97/dac/dfc 0 2024-09-11T00:18:02.297 INFO:tasks.workunit.client.0.smithi078.stdout:2/816: write d0/d1/d11/d60/da2/d38/f6a [3334084,47340] 0 2024-09-11T00:18:02.298 INFO:tasks.workunit.client.0.smithi078.stdout:4/925: dread dc/d10/d40/d3a/d4c/f8a [0,4194304] 0 2024-09-11T00:18:02.299 INFO:tasks.workunit.client.0.smithi078.stdout:2/817: creat d0/d1/d3c/d40/d98/f10e x:0 0 0 2024-09-11T00:18:02.299 INFO:tasks.workunit.client.0.smithi078.stdout:6/718: dread d0/d1/d9/d59/d74/db3/dd5/f4f [0,4194304] 0 2024-09-11T00:18:02.300 INFO:tasks.workunit.client.0.smithi078.stdout:4/926: link dc/d10/d40/l30 dc/d10/d40/d3a/d65/d7b/l128 0 2024-09-11T00:18:02.300 INFO:tasks.workunit.client.0.smithi078.stdout:4/927: chown dc/d10/d40/d3a/d65/d7b/d9e/l42 50 1 2024-09-11T00:18:02.301 INFO:tasks.workunit.client.0.smithi078.stdout:4/928: write dc/d10/d40/d3a/d65/d94/fb6 [557439,120390] 0 2024-09-11T00:18:02.301 INFO:tasks.workunit.client.0.smithi078.stdout:2/818: mknod d0/d19/d3d/c10f 0 2024-09-11T00:18:02.302 INFO:tasks.workunit.client.0.smithi078.stdout:6/719: mkdir d0/d1/d9/d59/d74/df0 0 2024-09-11T00:18:02.304 INFO:tasks.workunit.client.0.smithi078.stdout:4/929: symlink dc/d10/d40/d3a/d4c/db4/l129 0 2024-09-11T00:18:02.304 INFO:tasks.workunit.client.0.smithi078.stdout:2/819: truncate d0/d1/d11/f2d 247942 0 2024-09-11T00:18:02.306 INFO:tasks.workunit.client.0.smithi078.stdout:4/930: link dc/d10/d40/d3a/d46/dad/f117 dc/d10/d40/d3a/d65/d94/f12a 0 2024-09-11T00:18:02.306 INFO:tasks.workunit.client.0.smithi078.stdout:2/820: rmdir d0/d1/d11/d60/da2/d3a/d107/dcd 39 2024-09-11T00:18:02.307 INFO:tasks.workunit.client.0.smithi078.stdout:2/821: write d0/d1/d11/d1b/f6d [4294074,121019] 0 2024-09-11T00:18:02.307 INFO:tasks.workunit.client.0.smithi078.stdout:2/822: write d0/d1/d3c/d40/d50/fda [578760,84201] 0 2024-09-11T00:18:02.308 INFO:tasks.workunit.client.0.smithi078.stdout:2/823: link d0/d1/d3c/d9f/fae d0/d1/d11/d60/da2/d3a/d107/dcd/f110 0 2024-09-11T00:18:02.309 INFO:tasks.workunit.client.0.smithi078.stdout:8/907: write da/d13/f31 [1115806,44635] 0 2024-09-11T00:18:02.309 INFO:tasks.workunit.client.0.smithi078.stdout:2/824: symlink d0/d1/d3c/l111 0 2024-09-11T00:18:02.311 INFO:tasks.workunit.client.0.smithi078.stdout:8/908: creat da/d1c/d60/d85/d94/d11c/f123 x:0 0 0 2024-09-11T00:18:02.313 INFO:tasks.workunit.client.0.smithi078.stdout:2/825: rename d0/d1/d8/f4f to d0/d1/d3c/d40/d50/dc0/f112 0 2024-09-11T00:18:02.313 INFO:tasks.workunit.client.0.smithi078.stdout:2/826: write d0/d1/f54 [3954703,9773] 0 2024-09-11T00:18:02.316 INFO:tasks.workunit.client.0.smithi078.stdout:2/827: unlink d0/d1/d33/d86/db4/l88 0 2024-09-11T00:18:02.318 INFO:tasks.workunit.client.0.smithi078.stdout:5/656: dwrite d7/d8/d33/d22/d25/f5e [0,4194304] 0 2024-09-11T00:18:02.318 INFO:tasks.workunit.client.0.smithi078.stdout:5/657: fsync d7/d8/de/d2c/f63 0 2024-09-11T00:18:02.321 INFO:tasks.workunit.client.0.smithi078.stdout:5/658: write d7/d8/d33/d22/d25/d28/d24/f4d [4157936,60568] 0 2024-09-11T00:18:02.324 INFO:tasks.workunit.client.0.smithi078.stdout:5/659: rename d7/d8/d33/d22/d25/d28/d24/f44 to d7/d8/d33/d22/dd9/fe6 0 2024-09-11T00:18:02.326 INFO:tasks.workunit.client.0.smithi078.stdout:6/720: dwrite d0/d1/da8/fad [4194304,4194304] 0 2024-09-11T00:18:02.326 INFO:tasks.workunit.client.0.smithi078.stdout:6/721: fsync d0/d1/d9/f5c 0 2024-09-11T00:18:02.326 INFO:tasks.workunit.client.0.smithi078.stdout:6/722: dread - d0/d1/d9/d59/d74/fed zero size 2024-09-11T00:18:02.326 INFO:tasks.workunit.client.0.smithi078.stdout:6/723: chown d0/d1/d9/d17 13 1 2024-09-11T00:18:02.326 INFO:tasks.workunit.client.0.smithi078.stdout:6/724: chown d0/d1/d9/d17/d5e/l91 1114 1 2024-09-11T00:18:02.326 INFO:tasks.workunit.client.0.smithi078.stdout:6/725: symlink d0/d66/lf1 0 2024-09-11T00:18:02.329 INFO:tasks.workunit.client.0.smithi078.stdout:4/931: dwrite dc/d10/d40/d3a/d4c/fcb [4194304,4194304] 0 2024-09-11T00:18:02.331 INFO:tasks.workunit.client.0.smithi078.stdout:5/660: write d7/d8/f87 [49366,7094] 0 2024-09-11T00:18:02.331 INFO:tasks.workunit.client.0.smithi078.stdout:5/661: chown d7/d8/l8f 13102 1 2024-09-11T00:18:02.331 INFO:tasks.workunit.client.0.smithi078.stdout:5/662: write d7/d8/d33/d22/d25/d6a/db0/fc9 [1347488,80712] 0 2024-09-11T00:18:02.333 INFO:tasks.workunit.client.0.smithi078.stdout:8/909: dwrite da/d87/d7b/f105 [0,4194304] 0 2024-09-11T00:18:02.345 INFO:tasks.workunit.client.0.smithi078.stdout:2/828: dread d0/d1/d11/d60/da2/d38/f6a [0,4194304] 0 2024-09-11T00:18:02.346 INFO:tasks.workunit.client.0.smithi078.stdout:2/829: mkdir d0/d1/d3c/d40/d50/dc0/d113 0 2024-09-11T00:18:02.347 INFO:tasks.workunit.client.0.smithi078.stdout:2/830: mknod d0/dd7/c114 0 2024-09-11T00:18:02.349 INFO:tasks.workunit.client.0.smithi078.stdout:5/663: write d7/d8/d47/d52/fae [3325193,45898] 0 2024-09-11T00:18:02.350 INFO:tasks.workunit.client.0.smithi078.stdout:8/910: truncate da/d13/f31 366214 0 2024-09-11T00:18:02.350 INFO:tasks.workunit.client.0.smithi078.stdout:6/726: write d0/d1/d9/d59/f64 [7601041,33823] 0 2024-09-11T00:18:02.350 INFO:tasks.workunit.client.0.smithi078.stdout:6/727: readlink d0/d66/lb5 0 2024-09-11T00:18:02.350 INFO:tasks.workunit.client.0.smithi078.stdout:6/728: write d0/f3b [3510953,17054] 0 2024-09-11T00:18:02.351 INFO:tasks.workunit.client.0.smithi078.stdout:8/911: write da/d13/d1b/d24/d62/d111/d99/d82/d63/fe8 [559389,60314] 0 2024-09-11T00:18:02.356 INFO:tasks.workunit.client.0.smithi078.stdout:6/729: creat d0/d1/d53/d9c/dac/ff2 x:0 0 0 2024-09-11T00:18:02.356 INFO:tasks.workunit.client.0.smithi078.stdout:6/730: chown d0/d1/d53/d9c/fbc 27083462 1 2024-09-11T00:18:02.356 INFO:tasks.workunit.client.0.smithi078.stdout:5/664: write d7/d8/d33/d22/d25/f3a [841733,119413] 0 2024-09-11T00:18:02.357 INFO:tasks.workunit.client.0.smithi078.stdout:8/912: rmdir da/d13/d1b/d24/d62/d111 39 2024-09-11T00:18:02.357 INFO:tasks.workunit.client.0.smithi078.stdout:8/913: fdatasync da/d1c/d60/d85/d94/f121 0 2024-09-11T00:18:02.359 INFO:tasks.workunit.client.0.smithi078.stdout:5/665: unlink d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/ccb 0 2024-09-11T00:18:02.359 INFO:tasks.workunit.client.0.smithi078.stdout:8/914: mkdir da/d1c/d60/d85/d94/d124 0 2024-09-11T00:18:02.359 INFO:tasks.workunit.client.0.smithi078.stdout:8/915: write da/d13/d1b/d24/d62/d111/f83 [3893838,102143] 0 2024-09-11T00:18:02.360 INFO:tasks.workunit.client.0.smithi078.stdout:8/916: rename da/fba to da/d87/d3a/d4b/dd3/f125 0 2024-09-11T00:18:02.363 INFO:tasks.workunit.client.0.smithi078.stdout:2/831: dwrite d0/d67/f75 [0,4194304] 0 2024-09-11T00:18:02.363 INFO:tasks.workunit.client.0.smithi078.stdout:5/666: dread d7/d8/d33/d22/d51/f58 [0,4194304] 0 2024-09-11T00:18:02.363 INFO:tasks.workunit.client.0.smithi078.stdout:2/832: fsync d0/d1/d3c/d40/f109 0 2024-09-11T00:18:02.366 INFO:tasks.workunit.client.0.smithi078.stdout:6/731: getdents d0/d1/d53/d9c/dac 0 2024-09-11T00:18:02.368 INFO:tasks.workunit.client.0.smithi078.stdout:2/833: creat d0/dd7/f115 x:0 0 0 2024-09-11T00:18:02.369 INFO:tasks.workunit.client.0.smithi078.stdout:5/667: creat d7/d8/d33/d22/d25/d28/d24/d1c/fe7 x:0 0 0 2024-09-11T00:18:02.369 INFO:tasks.workunit.client.0.smithi078.stdout:6/732: dread d0/f5a [0,4194304] 0 2024-09-11T00:18:02.377 INFO:tasks.workunit.client.0.smithi078.stdout:6/733: read d0/d1/d9/f4a [1243010,78107] 0 2024-09-11T00:18:02.377 INFO:tasks.workunit.client.0.smithi078.stdout:6/734: write d0/d1/d9/d59/d74/db3/dd5/f37 [3301217,26776] 0 2024-09-11T00:18:02.379 INFO:tasks.workunit.client.0.smithi078.stdout:6/735: mkdir d0/d1/d53/d9c/dac/de3/df3 0 2024-09-11T00:18:02.379 INFO:tasks.workunit.client.0.smithi078.stdout:6/736: write d0/d1/d53/d9c/dac/fb7 [785140,29164] 0 2024-09-11T00:18:02.380 INFO:tasks.workunit.client.0.smithi078.stdout:6/737: rename d0/d1/d53/f90 to d0/d1/d53/ff4 0 2024-09-11T00:18:02.381 INFO:tasks.workunit.client.0.smithi078.stdout:6/738: rename d0/d1/f39 to d0/d1/d9/d59/d74/db3/dd5/ff5 0 2024-09-11T00:18:02.386 INFO:tasks.workunit.client.0.smithi078.stdout:2/834: dwrite d0/d1/d11/d60/da2/d3a/d51/d97/dbd/fdb [0,4194304] 0 2024-09-11T00:18:02.388 INFO:tasks.workunit.client.0.smithi078.stdout:6/739: write d0/d1/d9/d17/fd1 [1896697,62333] 0 2024-09-11T00:18:02.388 INFO:tasks.workunit.client.0.smithi078.stdout:8/917: dwrite da/d13/d1b/d24/d62/d111/d99/fee [0,4194304] 0 2024-09-11T00:18:02.388 INFO:tasks.workunit.client.0.smithi078.stdout:8/918: write da/d13/d1b/d37/f5a [497453,89898] 0 2024-09-11T00:18:02.389 INFO:tasks.workunit.client.0.smithi078.stdout:2/835: link d0/d1/c2 d0/d1/d3c/c116 0 2024-09-11T00:18:02.391 INFO:tasks.workunit.client.0.smithi078.stdout:6/740: link d0/d1/d9/ld d0/d1/lf6 0 2024-09-11T00:18:02.391 INFO:tasks.workunit.client.0.smithi078.stdout:6/741: chown d0/d1/d9/d59/d74/fcb 17682 1 2024-09-11T00:18:02.391 INFO:tasks.workunit.client.0.smithi078.stdout:5/668: dwrite d7/d8/d33/d22/d25/d28/d24/d1c/fd3 [0,4194304] 0 2024-09-11T00:18:02.392 INFO:tasks.workunit.client.0.smithi078.stdout:2/836: dread d0/d1/d3c/f45 [0,4194304] 0 2024-09-11T00:18:02.394 INFO:tasks.workunit.client.0.smithi078.stdout:8/919: mkdir da/d1c/d126 0 2024-09-11T00:18:02.395 INFO:tasks.workunit.client.0.smithi078.stdout:6/742: truncate d0/d1/d9/d59/d74/db3/dd5/f48 3630713 0 2024-09-11T00:18:02.395 INFO:tasks.workunit.client.0.smithi078.stdout:6/743: readlink d0/d1/d53/la1 0 2024-09-11T00:18:02.396 INFO:tasks.workunit.client.0.smithi078.stdout:6/744: chown d0/l89 15 1 2024-09-11T00:18:02.396 INFO:tasks.workunit.client.0.smithi078.stdout:6/745: chown d0/d1/d1b/fd3 1232 1 2024-09-11T00:18:02.397 INFO:tasks.workunit.client.0.smithi078.stdout:5/669: dread d7/d8/f87 [0,4194304] 0 2024-09-11T00:18:02.398 INFO:tasks.workunit.client.0.smithi078.stdout:2/837: unlink d0/d1/d3c/d40/f109 0 2024-09-11T00:18:02.399 INFO:tasks.workunit.client.0.smithi078.stdout:2/838: dread d0/d1/d6/f9c [0,4194304] 0 2024-09-11T00:18:02.399 INFO:tasks.workunit.client.0.smithi078.stdout:8/920: mknod da/d1c/d60/dfa/c127 0 2024-09-11T00:18:02.401 INFO:tasks.workunit.client.0.smithi078.stdout:6/746: mknod d0/d1/d9/d59/d74/db3/dd5/cf7 0 2024-09-11T00:18:02.401 INFO:tasks.workunit.client.0.smithi078.stdout:6/747: chown d0/d1/d9/d59/fe6 6 1 2024-09-11T00:18:02.401 INFO:tasks.workunit.client.0.smithi078.stdout:6/748: getdents d0/d1/d53/d9c/dac 0 2024-09-11T00:18:02.401 INFO:tasks.workunit.client.0.smithi078.stdout:6/749: chown d0/d1/f2f 351472347 1 2024-09-11T00:18:02.403 INFO:tasks.workunit.client.0.smithi078.stdout:5/670: rename d7/d8/d33/d22/dd9/ddf/dc5/dc8/d2a/l7d to d7/d8/de/d90/le8 0 2024-09-11T00:18:02.405 INFO:tasks.workunit.client.0.smithi078.stdout:6/750: rmdir d0/d1/d53/d9c/dac/dd7 0 2024-09-11T00:18:02.407 INFO:tasks.workunit.client.0.smithi078.stdout:8/921: rename da/d87/d3a/d4b/dd3/f107 to da/d13/d19/f128 0 2024-09-11T00:18:02.412 INFO:tasks.workunit.client.0.smithi078.stdout:5/671: rename d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f59 to d7/d8/d33/d22/d25/d28/da8/fe9 0 2024-09-11T00:18:02.414 INFO:tasks.workunit.client.0.smithi078.stdout:8/922: creat da/d13/d1b/d24/d62/d111/d9e/d114/f129 x:0 0 0 2024-09-11T00:18:02.414 INFO:tasks.workunit.client.0.smithi078.stdout:8/923: dread - da/d1c/fcc zero size 2024-09-11T00:18:02.414 INFO:tasks.workunit.client.0.smithi078.stdout:8/924: chown da/d13/d19/lbd 91838 1 2024-09-11T00:18:02.415 INFO:tasks.workunit.client.0.smithi078.stdout:6/751: write d0/d1/d1b/f45 [2612019,129102] 0 2024-09-11T00:18:02.415 INFO:tasks.workunit.client.0.smithi078.stdout:6/752: fdatasync d0/d1/d9/d59/fe6 0 2024-09-11T00:18:02.415 INFO:tasks.workunit.client.0.smithi078.stdout:8/925: write da/d13/d1b/d24/d62/d111/d99/d82/d63/da9/fc4 [363044,89890] 0 2024-09-11T00:18:02.415 INFO:tasks.workunit.client.0.smithi078.stdout:8/926: fdatasync da/d13/d19/f128 0 2024-09-11T00:18:02.417 INFO:tasks.workunit.client.0.smithi078.stdout:6/753: mknod d0/d1/d9/d17/d5e/cf8 0 2024-09-11T00:18:02.420 INFO:tasks.workunit.client.0.smithi078.stdout:8/927: unlink da/d1c/d60/f106 0 2024-09-11T00:18:02.422 INFO:tasks.workunit.client.0.smithi078.stdout:6/754: creat d0/d1/d53/d9c/dac/ff9 x:0 0 0 2024-09-11T00:18:02.423 INFO:tasks.workunit.client.0.smithi078.stdout:6/755: chown d0/d1/d9/d59/d74/db3/dd5/f37 27586 1 2024-09-11T00:18:02.424 INFO:tasks.workunit.client.0.smithi078.stdout:5/672: dwrite d7/d8/d33/d22/d25/d28/d24/d1c/f8a [0,4194304] 0 2024-09-11T00:18:02.426 INFO:tasks.workunit.client.0.smithi078.stdout:8/928: rename da/d1c/d60/d85/c6a to da/d87/d7b/c12a 0 2024-09-11T00:18:02.426 INFO:tasks.workunit.client.0.smithi078.stdout:6/756: rmdir d0/d1/d9 39 2024-09-11T00:18:02.429 INFO:tasks.workunit.client.0.smithi078.stdout:5/673: mkdir d7/d8/de/d2c/d62/dea 0 2024-09-11T00:18:02.430 INFO:tasks.workunit.client.0.smithi078.stdout:8/929: creat da/d1c/d60/d85/d94/d11c/f12b x:0 0 0 2024-09-11T00:18:02.430 INFO:tasks.workunit.client.0.smithi078.stdout:8/930: chown da/d13/d1b/d37/f5a 1588 1 2024-09-11T00:18:02.430 INFO:tasks.workunit.client.0.smithi078.stdout:8/931: write da/d13/d1b/d24/d62/d111/d99/d82/fca [775481,55980] 0 2024-09-11T00:18:02.431 INFO:tasks.workunit.client.0.smithi078.stdout:6/757: truncate d0/d1/d53/ff4 1706856 0 2024-09-11T00:18:02.431 INFO:tasks.workunit.client.0.smithi078.stdout:6/758: chown d0/d1/lf6 4800899 1 2024-09-11T00:18:02.432 INFO:tasks.workunit.client.0.smithi078.stdout:6/759: dread d0/d1/d9/d17/d5e/f77 [0,4194304] 0 2024-09-11T00:18:02.432 INFO:tasks.workunit.client.0.smithi078.stdout:6/760: fsync d0/d1/d9/d59/f64 0 2024-09-11T00:18:02.433 INFO:tasks.workunit.client.0.smithi078.stdout:8/932: creat da/d13/d1b/d24/d62/d111/d9e/d114/f12c x:0 0 0 2024-09-11T00:18:02.433 INFO:tasks.workunit.client.0.smithi078.stdout:8/933: truncate da/d13/d1b/d24/d62/d111/d9e/f115 945161 0 2024-09-11T00:18:02.434 INFO:tasks.workunit.client.0.smithi078.stdout:6/761: rmdir d0/d1/d9 39 2024-09-11T00:18:02.434 INFO:tasks.workunit.client.0.smithi078.stdout:6/762: getdents d0/d1/d53/d9c/dac/de3/df3 0 2024-09-11T00:18:02.434 INFO:tasks.workunit.client.0.smithi078.stdout:6/763: chown d0/d66/cc4 0 1 2024-09-11T00:18:02.435 INFO:tasks.workunit.client.0.smithi078.stdout:6/764: rename d0/d1/d1b/f50 to d0/d1/d53/d9c/db6/ffa 0 2024-09-11T00:18:02.450 INFO:tasks.workunit.client.0.smithi078.stdout:8/934: dwrite da/d1c/d60/fb4 [0,4194304] 0 2024-09-11T00:18:02.454 INFO:tasks.workunit.client.0.smithi078.stdout:8/935: mkdir da/d13/d1b/d24/d62/d111/d9e/d12d 0 2024-09-11T00:18:02.454 INFO:tasks.workunit.client.0.smithi078.stdout:8/936: write da/d13/d1b/d24/d62/d111/d99/d82/d63/f10f [464181,11332] 0 2024-09-11T00:18:02.454 INFO:tasks.workunit.client.0.smithi078.stdout:8/937: truncate da/d13/d19/f128 4707829 0 2024-09-11T00:18:02.454 INFO:tasks.workunit.client.0.smithi078.stdout:8/938: stat da/d87/d3a/f81 0 2024-09-11T00:18:02.454 INFO:tasks.workunit.client.0.smithi078.stdout:6/765: dwrite d0/d1/d9/d17/fcd [0,4194304] 0 2024-09-11T00:18:02.461 INFO:tasks.workunit.client.0.smithi078.stdout:6/766: symlink d0/d66/lfb 0 2024-09-11T00:18:02.462 INFO:tasks.workunit.client.0.smithi078.stdout:6/767: readlink d0/d1/d53/d72/le8 0 2024-09-11T00:18:02.462 INFO:tasks.workunit.client.0.smithi078.stdout:6/768: fdatasync d0/d1/d53/fbb 0 2024-09-11T00:18:02.468 INFO:tasks.workunit.client.0.smithi078.stdout:8/939: dwrite da/d1c/d60/feb [0,4194304] 0 2024-09-11T00:18:02.470 INFO:tasks.workunit.client.0.smithi078.stdout:8/940: mkdir da/d13/d1b/d24/d86/d91/d12e 0 2024-09-11T00:18:02.471 INFO:tasks.workunit.client.0.smithi078.stdout:8/941: creat da/d87/d7b/da7/f12f x:0 0 0 2024-09-11T00:18:02.472 INFO:tasks.workunit.client.0.smithi078.stdout:8/942: write da/f30 [9229924,90626] 0 2024-09-11T00:18:02.472 INFO:tasks.workunit.client.0.smithi078.stdout:8/943: rmdir da/d13 39 2024-09-11T00:18:02.473 INFO:tasks.workunit.client.0.smithi078.stdout:8/944: read da/d13/f31 [310706,36919] 0 2024-09-11T00:18:02.473 INFO:tasks.workunit.client.0.smithi078.stdout:8/945: creat da/d13/f130 x:0 0 0 2024-09-11T00:18:02.475 INFO:tasks.workunit.client.0.smithi078.stdout:8/946: dread da/d13/d1b/d59/f97 [0,4194304] 0 2024-09-11T00:18:02.475 INFO:tasks.workunit.client.0.smithi078.stdout:6/769: dwrite d0/d1/d9/d59/d74/db3/dd5/f4f [0,4194304] 0 2024-09-11T00:18:02.476 INFO:tasks.workunit.client.0.smithi078.stdout:6/770: write d0/d1/d9/f16 [8887132,5123] 0 2024-09-11T00:18:02.477 INFO:tasks.workunit.client.0.smithi078.stdout:8/947: rename da/d13/d1b/d37/fc0 to da/d13/d1b/f131 0 2024-09-11T00:18:02.478 INFO:tasks.workunit.client.0.smithi078.stdout:6/771: creat d0/ffc x:0 0 0 2024-09-11T00:18:02.479 INFO:tasks.workunit.client.0.smithi078.stdout:8/948: rmdir da/d1c/d4c 39 2024-09-11T00:18:02.480 INFO:tasks.workunit.client.0.smithi078.stdout:6/772: mknod d0/d1/d53/d9c/db6/cfd 0 2024-09-11T00:18:02.481 INFO:tasks.workunit.client.0.smithi078.stdout:6/773: creat d0/ffe x:0 0 0 2024-09-11T00:18:02.487 INFO:tasks.workunit.client.0.smithi078.stdout:8/949: dread da/d13/fe2 [0,4194304] 0 2024-09-11T00:18:02.487 INFO:tasks.workunit.client.0.smithi078.stdout:6/774: write d0/d1/d9/d59/d74/f86 [3513590,46097] 0 2024-09-11T00:18:02.488 INFO:tasks.workunit.client.0.smithi078.stdout:8/950: link da/d1c/d60/d85/d94/cc1 da/d1c/d60/d85/d94/ddf/c132 0 2024-09-11T00:18:02.490 INFO:tasks.workunit.client.0.smithi078.stdout:6/775: mkdir d0/d1/d53/d9c/dac/de3/df3/dff 0 2024-09-11T00:18:02.492 INFO:tasks.workunit.client.0.smithi078.stdout:8/951: rename da/d13/d1b/d24/d86/d91/c65 to da/d13/d1b/d24/d62/d111/d99/d82/d63/da9/c133 0 2024-09-11T00:18:02.497 INFO:tasks.workunit.client.0.smithi078.stdout:6/776: mknod d0/d1/d9/d17/c100 0 2024-09-11T00:18:02.498 INFO:tasks.workunit.client.0.smithi078.stdout:6/777: chown d0/d1/d9/d54/c9d 116359 1 2024-09-11T00:18:02.498 INFO:tasks.workunit.client.0.smithi078.stdout:6/778: read - d0/f61 zero size 2024-09-11T00:18:02.498 INFO:tasks.workunit.client.0.smithi078.stdout:6/779: write d0/d1/d9/d17/d5e/f85 [32737,101165] 0 2024-09-11T00:18:02.498 INFO:tasks.workunit.client.0.smithi078.stdout:6/780: symlink d0/d1/d53/d9c/dac/de3/l101 0 2024-09-11T00:18:02.498 INFO:tasks.workunit.client.0.smithi078.stdout:8/952: dread da/d1c/d60/f67 [0,4194304] 0 2024-09-11T00:18:02.498 INFO:tasks.workunit.client.0.smithi078.stdout:6/781: creat d0/d1/d9/f102 x:0 0 0 2024-09-11T00:18:02.498 INFO:tasks.workunit.client.0.smithi078.stdout:6/782: chown d0/d1/d9/d59/d74 5018038 1 2024-09-11T00:18:02.498 INFO:tasks.workunit.client.0.smithi078.stdout:8/953: rmdir da/d13/d1b/d24/d62/d111/d99/d82/d63 39 2024-09-11T00:18:02.499 INFO:tasks.workunit.client.0.smithi078.stdout:6/783: truncate d0/d1/d9/d17/fcd 1426608 0 2024-09-11T00:18:02.499 INFO:tasks.workunit.client.0.smithi078.stdout:6/784: creat d0/d1/d9/d59/d74/d6b/f103 x:0 0 0 2024-09-11T00:18:02.499 INFO:tasks.workunit.client.0.smithi078.stdout:6/785: chown d0/d1/d9/d54 248958119 1 2024-09-11T00:18:02.500 INFO:tasks.workunit.client.0.smithi078.stdout:6/786: read - d0/ffe zero size 2024-09-11T00:18:02.500 INFO:tasks.workunit.client.0.smithi078.stdout:8/954: write da/d13/d1b/f2e [34893,91934] 0 2024-09-11T00:18:02.506 INFO:tasks.workunit.client.0.smithi078.stdout:8/955: dread da/d87/d7b/f8f [0,4194304] 0 2024-09-11T00:18:02.513 INFO:tasks.workunit.client.0.smithi078.stdout:8/956: dread da/d13/d1b/d24/d62/d111/f83 [0,4194304] 0 2024-09-11T00:18:02.513 INFO:tasks.workunit.client.0.smithi078.stdout:8/957: write da/d13/f31 [615724,81492] 0 2024-09-11T00:18:02.514 INFO:tasks.workunit.client.0.smithi078.stdout:8/958: creat da/d13/d1b/d24/d62/d111/d9e/f134 x:0 0 0 2024-09-11T00:18:02.515 INFO:tasks.workunit.client.0.smithi078.stdout:8/959: creat da/d1c/d60/dfa/f135 x:0 0 0 2024-09-11T00:18:02.522 INFO:tasks.workunit.client.0.smithi078.stdout:8/960: dread da/d13/d1b/d24/d62/d111/d9e/fcf [0,4194304] 0 2024-09-11T00:18:02.522 INFO:tasks.workunit.client.0.smithi078.stdout:8/961: fdatasync da/d13/d1b/d24/d62/d111/d9e/fcf 0 2024-09-11T00:18:02.523 INFO:tasks.workunit.client.0.smithi078.stdout:8/962: read - da/d13/d19/dbe/fef zero size 2024-09-11T00:18:02.523 INFO:tasks.workunit.client.0.smithi078.stdout:8/963: rename da/d87/d3a/d4b/dd3/d116/c122 to da/d1c/d60/d85/d94/ddf/c136 0 2024-09-11T00:18:02.525 INFO:tasks.workunit.client.0.smithi078.stdout:8/964: read da/d1c/f78 [943062,120077] 0 2024-09-11T00:18:02.525 INFO:tasks.workunit.client.0.smithi078.stdout:8/965: dread - da/d13/d1b/d24/d62/d111/d9e/f134 zero size 2024-09-11T00:18:02.526 INFO:tasks.workunit.client.0.smithi078.stdout:8/966: symlink da/d87/d3a/d4b/dd3/l137 0 2024-09-11T00:18:02.526 INFO:tasks.workunit.client.0.smithi078.stdout:8/967: stat da/d87/d3a/d4b/dd3/d11b 0 2024-09-11T00:18:02.541 INFO:tasks.workunit.client.0.smithi078.stdout:3/771: sync 2024-09-11T00:18:02.541 INFO:tasks.workunit.client.0.smithi078.stdout:7/681: sync 2024-09-11T00:18:02.541 INFO:tasks.workunit.client.0.smithi078.stdout:0/713: sync 2024-09-11T00:18:02.541 INFO:tasks.workunit.client.0.smithi078.stdout:8/968: dwrite da/d87/d7b/fd2 [0,4194304] 0 2024-09-11T00:18:02.541 INFO:tasks.workunit.client.0.smithi078.stdout:8/969: readlink da/d1c/d60/d85/l96 0 2024-09-11T00:18:02.541 INFO:tasks.workunit.client.0.smithi078.stdout:7/682: creat d0/d34/d65/fc8 x:0 0 0 2024-09-11T00:18:02.542 INFO:tasks.workunit.client.0.smithi078.stdout:0/714: truncate d2/d2a/d2c/d35/d59/d7/fc2 2622402 0 2024-09-11T00:18:02.544 INFO:tasks.workunit.client.0.smithi078.stdout:7/683: mknod d0/d34/db/d32/cc9 0 2024-09-11T00:18:02.545 INFO:tasks.workunit.client.0.smithi078.stdout:7/684: symlink d0/d34/db/d30/lca 0 2024-09-11T00:18:02.548 INFO:tasks.workunit.client.0.smithi078.stdout:7/685: mknod d0/d34/db/da0/ccb 0 2024-09-11T00:18:02.549 INFO:tasks.workunit.client.0.smithi078.stdout:8/970: dread da/d13/d1b/d24/d62/ffc [0,4194304] 0 2024-09-11T00:18:02.550 INFO:tasks.workunit.client.0.smithi078.stdout:7/686: mknod d0/d34/db/d30/d28/ccc 0 2024-09-11T00:18:02.550 INFO:tasks.workunit.client.0.smithi078.stdout:7/687: read - d0/d34/db/d30/d1d/d14/d87/fbd zero size 2024-09-11T00:18:02.551 INFO:tasks.workunit.client.0.smithi078.stdout:8/971: dread da/d13/d1b/d24/d62/d111/d99/f98 [0,4194304] 0 2024-09-11T00:18:02.551 INFO:tasks.workunit.client.0.smithi078.stdout:8/972: fsync da/d13/d1b/f36 0 2024-09-11T00:18:02.551 INFO:tasks.workunit.client.0.smithi078.stdout:7/688: creat d0/d34/db/d30/d1d/d14/fcd x:0 0 0 2024-09-11T00:18:02.556 INFO:tasks.workunit.client.0.smithi078.stdout:8/973: symlink da/d87/d7b/de1/l138 0 2024-09-11T00:18:02.556 INFO:tasks.workunit.client.0.smithi078.stdout:8/974: stat da/d13/f2c 0 2024-09-11T00:18:02.557 INFO:tasks.workunit.client.0.smithi078.stdout:8/975: symlink da/l139 0 2024-09-11T00:18:02.558 INFO:tasks.workunit.client.0.smithi078.stdout:8/976: creat da/d13/d1b/d24/d62/d111/d9e/f13a x:0 0 0 2024-09-11T00:18:02.564 INFO:tasks.workunit.client.0.smithi078.stdout:3/772: dwrite d0/d7/d18/d70/f76 [0,4194304] 0 2024-09-11T00:18:02.571 INFO:tasks.workunit.client.0.smithi078.stdout:3/773: dread d0/f78 [0,4194304] 0 2024-09-11T00:18:02.571 INFO:tasks.workunit.client.0.smithi078.stdout:7/689: dwrite d0/da7/f98 [0,4194304] 0 2024-09-11T00:18:02.571 INFO:tasks.workunit.client.0.smithi078.stdout:7/690: chown d0/d34/db/d30/d1d 53152 1 2024-09-11T00:18:02.571 INFO:tasks.workunit.client.0.smithi078.stdout:7/691: readlink d0/d34/db/d30/d1d/d14/l42 0 2024-09-11T00:18:02.571 INFO:tasks.workunit.client.0.smithi078.stdout:8/977: dwrite da/d1c/fed [0,4194304] 0 2024-09-11T00:18:02.571 INFO:tasks.workunit.client.0.smithi078.stdout:8/978: write da/d1c/f78 [745382,22012] 0 2024-09-11T00:18:02.571 INFO:tasks.workunit.client.0.smithi078.stdout:8/979: chown da/d1c/f78 34 1 2024-09-11T00:18:02.571 INFO:tasks.workunit.client.0.smithi078.stdout:8/980: chown f2 37860939 1 2024-09-11T00:18:02.573 INFO:tasks.workunit.client.0.smithi078.stdout:3/774: link d0/d7/d18/l8a d0/d7/d23/d7c/da1/dce/le7 0 2024-09-11T00:18:02.574 INFO:tasks.workunit.client.0.smithi078.stdout:3/775: rename d0/d7/d18/dd8/d60/d6d to d0/d7/d23/d7c/db7/de8 0 2024-09-11T00:18:02.576 INFO:tasks.workunit.client.0.smithi078.stdout:3/776: mkdir d0/d7/d46/d86/d9a/de9 0 2024-09-11T00:18:02.576 INFO:tasks.workunit.client.0.smithi078.stdout:3/777: getdents d0/d7/d18/d8c/de3 0 2024-09-11T00:18:02.577 INFO:tasks.workunit.client.0.smithi078.stdout:3/778: unlink d0/d7/d18/l8a 0 2024-09-11T00:18:02.577 INFO:tasks.workunit.client.0.smithi078.stdout:3/779: truncate d0/d7/d18/dd8/f84 5122992 0 2024-09-11T00:18:02.577 INFO:tasks.workunit.client.0.smithi078.stdout:3/780: chown d0/d7/d18/dd8/fd7 0 1 2024-09-11T00:18:02.577 INFO:tasks.workunit.client.0.smithi078.stdout:3/781: write d0/d1a/d77/fd2 [1135788,49080] 0 2024-09-11T00:18:02.582 INFO:tasks.workunit.client.0.smithi078.stdout:8/981: dread da/d1c/f7c [0,4194304] 0 2024-09-11T00:18:02.583 INFO:tasks.workunit.client.0.smithi078.stdout:3/782: dread d0/d7/f4e [0,4194304] 0 2024-09-11T00:18:02.588 INFO:tasks.workunit.client.0.smithi078.stdout:7/692: dwrite d0/d34/db/d30/d1d/d14/f79 [0,4194304] 0 2024-09-11T00:18:02.589 INFO:tasks.workunit.client.0.smithi078.stdout:3/783: dread d0/d7/d23/d91/f28 [0,4194304] 0 2024-09-11T00:18:02.589 INFO:tasks.workunit.client.0.smithi078.stdout:7/693: link d0/d34/d86/c95 d0/d34/db/d30/d1d/d14/d45/cce 0 2024-09-11T00:18:02.591 INFO:tasks.workunit.client.0.smithi078.stdout:3/784: unlink d0/d7/d18/f61 0 2024-09-11T00:18:02.593 INFO:tasks.workunit.client.0.smithi078.stdout:3/785: mkdir d0/d7/d46/d86/dea 0 2024-09-11T00:18:02.594 INFO:tasks.workunit.client.0.smithi078.stdout:3/786: mknod d0/d1a/ceb 0 2024-09-11T00:18:02.595 INFO:tasks.workunit.client.0.smithi078.stdout:8/982: dwrite da/d13/d1b/d24/d62/d111/d9e/d114/f129 [0,4194304] 0 2024-09-11T00:18:02.595 INFO:tasks.workunit.client.0.smithi078.stdout:3/787: rename d0/d7/d23/dcd to d0/d7/d18/d70/dec 0 2024-09-11T00:18:02.596 INFO:tasks.workunit.client.0.smithi078.stdout:3/788: write d0/d7/d46/f7e [198029,98534] 0 2024-09-11T00:18:02.612 INFO:tasks.workunit.client.0.smithi078.stdout:7/694: dwrite d0/d34/d86/fc7 [4194304,4194304] 0 2024-09-11T00:18:02.616 INFO:tasks.workunit.client.0.smithi078.stdout:8/983: dwrite da/d1c/d4c/dbc/f55 [8388608,4194304] 0 2024-09-11T00:18:02.616 INFO:tasks.workunit.client.0.smithi078.stdout:3/789: dwrite d0/d1a/d77/fdb [0,4194304] 0 2024-09-11T00:18:02.616 INFO:tasks.workunit.client.0.smithi078.stdout:3/790: chown d0/d7/d23/d7c/db7/de8/c47 489507 1 2024-09-11T00:18:02.616 INFO:tasks.workunit.client.0.smithi078.stdout:3/791: truncate d0/d7/d18/d8c/f95 4266003 0 2024-09-11T00:18:02.616 INFO:tasks.workunit.client.0.smithi078.stdout:3/792: truncate d0/d7/d46/d86/fa5 816549 0 2024-09-11T00:18:02.617 INFO:tasks.workunit.client.0.smithi078.stdout:8/984: creat da/d13/d1b/d24/d62/d111/d99/d82/d63/da9/f13b x:0 0 0 2024-09-11T00:18:02.617 INFO:tasks.workunit.client.0.smithi078.stdout:8/985: fdatasync da/d13/d1b/d24/d62/d111/d9e/f134 0 2024-09-11T00:18:02.618 INFO:tasks.workunit.client.0.smithi078.stdout:7/695: dread d0/d34/d86/fbb [0,4194304] 0 2024-09-11T00:18:02.618 INFO:tasks.workunit.client.0.smithi078.stdout:3/793: link d0/d7/d18/d8c/f95 d0/d39/fed 0 2024-09-11T00:18:02.619 INFO:tasks.workunit.client.0.smithi078.stdout:7/696: dread d0/da7/fbe [0,4194304] 0 2024-09-11T00:18:02.620 INFO:tasks.workunit.client.0.smithi078.stdout:7/697: chown d0/d34/d65/f8d 0 1 2024-09-11T00:18:02.620 INFO:tasks.workunit.client.0.smithi078.stdout:8/986: symlink da/d1c/d126/l13c 0 2024-09-11T00:18:02.620 INFO:tasks.workunit.client.0.smithi078.stdout:7/698: symlink d0/d34/db/d30/d1d/d14/d87/dc5/lcf 0 2024-09-11T00:18:02.621 INFO:tasks.workunit.client.0.smithi078.stdout:8/987: mkdir da/d87/d7b/da7/d13d 0 2024-09-11T00:18:02.621 INFO:tasks.workunit.client.0.smithi078.stdout:8/988: write da/d13/d1b/d24/d62/d111/d99/d82/d63/da9/fb2 [4298824,124127] 0 2024-09-11T00:18:02.622 INFO:tasks.workunit.client.0.smithi078.stdout:3/794: dread d0/d7/d46/d86/fc9 [4194304,4194304] 0 2024-09-11T00:18:02.623 INFO:tasks.workunit.client.0.smithi078.stdout:3/795: link d0/d1a/f52 d0/d7/d18/d8c/fee 0 2024-09-11T00:18:02.623 INFO:tasks.workunit.client.0.smithi078.stdout:3/796: chown d0/d7/d18/d8c/de3 62215 1 2024-09-11T00:18:02.623 INFO:tasks.workunit.client.0.smithi078.stdout:3/797: fsync d0/d1a/d77/fd2 0 2024-09-11T00:18:02.624 INFO:tasks.workunit.client.0.smithi078.stdout:3/798: truncate d0/d7/f87 973525 0 2024-09-11T00:18:02.624 INFO:tasks.workunit.client.0.smithi078.stdout:9/751: sync 2024-09-11T00:18:02.626 INFO:tasks.workunit.client.0.smithi078.stdout:9/752: symlink dc/d12/d20/d50/db1/l100 0 2024-09-11T00:18:02.628 INFO:tasks.workunit.client.0.smithi078.stdout:9/753: mkdir dc/d12/d20/d58/d5a/d101 0 2024-09-11T00:18:02.641 INFO:tasks.workunit.client.0.smithi078.stdout:3/799: dwrite d0/d1a/d77/fd2 [0,4194304] 0 2024-09-11T00:18:02.641 INFO:tasks.workunit.client.0.smithi078.stdout:3/800: truncate d0/f78 5357130 0 2024-09-11T00:18:02.641 INFO:tasks.workunit.client.0.smithi078.stdout:8/989: dwrite da/d13/d1b/d24/d62/d111/d99/d82/d63/fcd [0,4194304] 0 2024-09-11T00:18:02.641 INFO:tasks.workunit.client.0.smithi078.stdout:7/699: dwrite d0/d34/d65/f8d [0,4194304] 0 2024-09-11T00:18:02.641 INFO:tasks.workunit.client.0.smithi078.stdout:7/700: fsync d0/d34/f33 0 2024-09-11T00:18:02.641 INFO:tasks.workunit.client.0.smithi078.stdout:7/701: readlink d0/d34/db/d32/lb9 0 2024-09-11T00:18:02.641 INFO:tasks.workunit.client.0.smithi078.stdout:7/702: write d0/d34/db/d30/d1d/d14/d62/fa1 [219472,46424] 0 2024-09-11T00:18:02.646 INFO:tasks.workunit.client.0.smithi078.stdout:8/990: unlink da/d13/d1b/d24/d62/d111/f83 0 2024-09-11T00:18:02.646 INFO:tasks.workunit.client.0.smithi078.stdout:8/991: chown da/d1c/d4c/fd0 1 1 2024-09-11T00:18:02.646 INFO:tasks.workunit.client.0.smithi078.stdout:8/992: stat da/d13/d1b/d24/d62/d111/d9e/f115 0 2024-09-11T00:18:02.647 INFO:tasks.workunit.client.0.smithi078.stdout:7/703: creat d0/d34/db/d32/fd0 x:0 0 0 2024-09-11T00:18:02.650 INFO:tasks.workunit.client.0.smithi078.stdout:3/801: dread d0/d1a/d77/fdb [0,4194304] 0 2024-09-11T00:18:02.652 INFO:tasks.workunit.client.0.smithi078.stdout:8/993: symlink da/d87/d3a/d4b/dd3/d11b/l13e 0 2024-09-11T00:18:02.652 INFO:tasks.workunit.client.0.smithi078.stdout:8/994: truncate da/d13/f130 30384 0 2024-09-11T00:18:02.652 INFO:tasks.workunit.client.0.smithi078.stdout:7/704: symlink d0/d34/db/ld1 0 2024-09-11T00:18:02.653 INFO:tasks.workunit.client.0.smithi078.stdout:3/802: getdents d0/d7/d18/d70 0 2024-09-11T00:18:02.657 INFO:tasks.workunit.client.0.smithi078.stdout:7/705: rmdir d0/d34/db/d30/d1d/d14/d87 39 2024-09-11T00:18:02.657 INFO:tasks.workunit.client.0.smithi078.stdout:8/995: truncate da/d13/d1b/f3c 1899527 0 2024-09-11T00:18:02.657 INFO:tasks.workunit.client.0.smithi078.stdout:8/996: chown da/d13/c8d 269121019 1 2024-09-11T00:18:02.672 INFO:tasks.workunit.client.0.smithi078.stdout:3/803: dwrite d0/d7/d23/d91/f32 [0,4194304] 0 2024-09-11T00:18:02.673 INFO:tasks.workunit.client.0.smithi078.stdout:3/804: creat d0/d7/d18/d1b/d8e/fef x:0 0 0 2024-09-11T00:18:02.673 INFO:tasks.workunit.client.0.smithi078.stdout:7/706: dwrite d0/d34/db/d30/d28/f44 [0,4194304] 0 2024-09-11T00:18:02.677 INFO:tasks.workunit.client.0.smithi078.stdout:7/707: mkdir d0/d34/db/d30/d1d/db0/dd2 0 2024-09-11T00:18:02.678 INFO:tasks.workunit.client.0.smithi078.stdout:7/708: symlink d0/d34/db/d30/d1d/db0/dd2/ld3 0 2024-09-11T00:18:02.678 INFO:tasks.workunit.client.0.smithi078.stdout:7/709: truncate d0/d34/db/d32/f3a 2744521 0 2024-09-11T00:18:02.689 INFO:tasks.workunit.client.0.smithi078.stdout:3/805: dwrite d0/f65 [0,4194304] 0 2024-09-11T00:18:02.690 INFO:tasks.workunit.client.0.smithi078.stdout:3/806: creat d0/d7/d18/d1b/d8e/ff0 x:0 0 0 2024-09-11T00:18:02.695 INFO:tasks.workunit.client.0.smithi078.stdout:7/710: dwrite d0/f55 [0,4194304] 0 2024-09-11T00:18:02.696 INFO:tasks.workunit.client.0.smithi078.stdout:7/711: dread - d0/d34/db/fbc zero size 2024-09-11T00:18:02.700 INFO:tasks.workunit.client.0.smithi078.stdout:4/932: sync 2024-09-11T00:18:02.701 INFO:tasks.workunit.client.0.smithi078.stdout:5/674: sync 2024-09-11T00:18:02.701 INFO:tasks.workunit.client.0.smithi078.stdout:4/933: fsync dc/d10/d1f/f5b 0 2024-09-11T00:18:02.701 INFO:tasks.workunit.client.0.smithi078.stdout:2/839: sync 2024-09-11T00:18:02.701 INFO:tasks.workunit.client.0.smithi078.stdout:4/934: chown dc/ff 3782291 1 2024-09-11T00:18:02.701 INFO:tasks.workunit.client.0.smithi078.stdout:4/935: fsync dc/f1e 0 2024-09-11T00:18:02.701 INFO:tasks.workunit.client.0.smithi078.stdout:4/936: read dc/d10/f3d [1694805,84900] 0 2024-09-11T00:18:02.701 INFO:tasks.workunit.client.0.smithi078.stdout:7/712: creat d0/d34/db/fd4 x:0 0 0 2024-09-11T00:18:02.701 INFO:tasks.workunit.client.0.smithi078.stdout:7/713: creat d0/d34/db/d30/d1d/d14/d87/dc5/fd5 x:0 0 0 2024-09-11T00:18:02.701 INFO:tasks.workunit.client.0.smithi078.stdout:7/714: symlink d0/d34/db/d30/d1d/d14/d45/ld6 0 2024-09-11T00:18:02.701 INFO:tasks.workunit.client.0.smithi078.stdout:3/807: dread d0/d1a/f3b [0,4194304] 0 2024-09-11T00:18:02.701 INFO:tasks.workunit.client.0.smithi078.stdout:3/808: chown d0/d1a/d77/la4 224982 1 2024-09-11T00:18:02.701 INFO:tasks.workunit.client.0.smithi078.stdout:3/809: stat d0/d7/d18/dd8/fd1 0 2024-09-11T00:18:02.702 INFO:tasks.workunit.client.0.smithi078.stdout:7/715: mknod d0/cd7 0 2024-09-11T00:18:02.702 INFO:tasks.workunit.client.0.smithi078.stdout:4/937: dread dc/d10/d40/d3a/f90 [0,4194304] 0 2024-09-11T00:18:02.702 INFO:tasks.workunit.client.0.smithi078.stdout:3/810: symlink d0/d7/d18/d1b/d8e/lf1 0 2024-09-11T00:18:02.703 INFO:tasks.workunit.client.0.smithi078.stdout:5/675: dread d7/d8/d33/d22/d25/f84 [0,4194304] 0 2024-09-11T00:18:02.703 INFO:tasks.workunit.client.0.smithi078.stdout:5/676: read d7/d8/d33/d22/f97 [1177290,72753] 0 2024-09-11T00:18:02.703 INFO:tasks.workunit.client.0.smithi078.stdout:7/716: link d0/d34/db/f51 d0/d3f/fd8 0 2024-09-11T00:18:02.703 INFO:tasks.workunit.client.0.smithi078.stdout:7/717: stat d0/d3f/c7b 0 2024-09-11T00:18:02.704 INFO:tasks.workunit.client.0.smithi078.stdout:4/938: truncate dc/d54/fd4 359604 0 2024-09-11T00:18:02.704 INFO:tasks.workunit.client.0.smithi078.stdout:2/840: dread d0/d1/d6/d52/faf [0,4194304] 0 2024-09-11T00:18:02.705 INFO:tasks.workunit.client.0.smithi078.stdout:3/811: mknod d0/d7/d18/dd8/d60/cf2 0 2024-09-11T00:18:02.705 INFO:tasks.workunit.client.0.smithi078.stdout:3/812: stat d0/d7/d23/d7c/db7/de8/f54 0 2024-09-11T00:18:02.706 INFO:tasks.workunit.client.0.smithi078.stdout:5/677: mkdir d7/d8/d33/d22/d25/d28/deb 0 2024-09-11T00:18:02.708 INFO:tasks.workunit.client.0.smithi078.stdout:7/718: mknod d0/d34/db/d30/d28/cd9 0 2024-09-11T00:18:02.708 INFO:tasks.workunit.client.0.smithi078.stdout:7/719: read d0/f50 [804508,17092] 0 2024-09-11T00:18:02.708 INFO:tasks.workunit.client.0.smithi078.stdout:2/841: truncate d0/d1/d11/d1b/d1e/fbf 211815 0 2024-09-11T00:18:02.709 INFO:tasks.workunit.client.0.smithi078.stdout:2/842: read d0/d1/d11/d60/da2/d38/fad [173835,4261] 0 2024-09-11T00:18:02.709 INFO:tasks.workunit.client.0.smithi078.stdout:3/813: mkdir d0/d7/d23/d7c/db7/de8/df3 0 2024-09-11T00:18:02.710 INFO:tasks.workunit.client.0.smithi078.stdout:7/720: dread d0/d34/db/da0/fb7 [0,4194304] 0 2024-09-11T00:18:02.710 INFO:tasks.workunit.client.0.smithi078.stdout:4/939: write dc/d10/d40/d3a/d46/d59/f102 [1177382,1766] 0 2024-09-11T00:18:02.710 INFO:tasks.workunit.client.0.smithi078.stdout:3/814: mkdir d0/d7/d18/d8c/de3/df4 0 2024-09-11T00:18:02.712 INFO:tasks.workunit.client.0.smithi078.stdout:7/721: creat d0/d34/db/d30/fda x:0 0 0 2024-09-11T00:18:02.712 INFO:tasks.workunit.client.0.smithi078.stdout:7/722: truncate d0/d34/db/fbc 552194 0 2024-09-11T00:18:02.713 INFO:tasks.workunit.client.0.smithi078.stdout:2/843: write d0/d1/d3c/f45 [418557,81624] 0 2024-09-11T00:18:02.714 INFO:tasks.workunit.client.0.smithi078.stdout:5/678: dread d7/d8/d33/d22/d25/d28/f41 [4194304,4194304] 0 2024-09-11T00:18:02.715 INFO:tasks.workunit.client.0.smithi078.stdout:5/679: fsync d7/d8/d33/d22/dd9/fe6 0 2024-09-11T00:18:02.716 INFO:tasks.workunit.client.0.smithi078.stdout:5/680: dread d7/d8/d33/d22/d25/f3a [0,4194304] 0 2024-09-11T00:18:02.717 INFO:tasks.workunit.client.0.smithi078.stdout:7/723: link d0/d34/db/d30/d1d/f17 d0/d34/db/d30/fdb 0 2024-09-11T00:18:02.717 INFO:tasks.workunit.client.0.smithi078.stdout:7/724: dread - d0/d3f/f9e zero size 2024-09-11T00:18:02.717 INFO:tasks.workunit.client.0.smithi078.stdout:7/725: write d0/fba [584579,28793] 0 2024-09-11T00:18:02.718 INFO:tasks.workunit.client.0.smithi078.stdout:2/844: rmdir d0/d1/d6f/d93/dc3/dc4 39 2024-09-11T00:18:02.718 INFO:tasks.workunit.client.0.smithi078.stdout:2/845: stat d0/d1/d8/l13 0 2024-09-11T00:18:02.718 INFO:tasks.workunit.client.0.smithi078.stdout:3/815: dread d0/f62 [0,4194304] 0 2024-09-11T00:18:02.719 INFO:tasks.workunit.client.0.smithi078.stdout:5/681: getdents d7/d8/d47 0 2024-09-11T00:18:02.720 INFO:tasks.workunit.client.0.smithi078.stdout:5/682: write d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f5f [451476,13863] 0 2024-09-11T00:18:02.722 INFO:tasks.workunit.client.0.smithi078.stdout:2/846: link d0/d1/d3c/d9f/fae d0/d1/d11/d60/f117 0 2024-09-11T00:18:02.724 INFO:tasks.workunit.client.0.smithi078.stdout:7/726: dread d0/d34/db/f96 [0,4194304] 0 2024-09-11T00:18:02.724 INFO:tasks.workunit.client.0.smithi078.stdout:7/727: chown d0/d34/db/fd4 86 1 2024-09-11T00:18:02.725 INFO:tasks.workunit.client.0.smithi078.stdout:2/847: stat d0/d1/d3b/fde 0 2024-09-11T00:18:02.726 INFO:tasks.workunit.client.0.smithi078.stdout:2/848: rmdir d0/d1/d11/d60/da2/d3a/d51/de6 39 2024-09-11T00:18:02.727 INFO:tasks.workunit.client.0.smithi078.stdout:2/849: write d0/d1/d33/d86/db4/f65 [565987,5286] 0 2024-09-11T00:18:02.728 INFO:tasks.workunit.client.0.smithi078.stdout:4/940: write dc/d10/d40/d3a/d4c/db4/d72/dbb/fc1 [316952,56381] 0 2024-09-11T00:18:02.729 INFO:tasks.workunit.client.0.smithi078.stdout:4/941: dread - dc/d10/d40/d3a/d65/d94/f12a zero size 2024-09-11T00:18:02.731 INFO:tasks.workunit.client.0.smithi078.stdout:4/942: rename dc/d10/f3d to dc/d10/d40/d33/f12b 0 2024-09-11T00:18:02.732 INFO:tasks.workunit.client.0.smithi078.stdout:5/683: dread d7/d8/d33/d22/d25/d28/f31 [0,4194304] 0 2024-09-11T00:18:02.733 INFO:tasks.workunit.client.0.smithi078.stdout:4/943: creat dc/d10/d40/d3a/d4c/f12c x:0 0 0 2024-09-11T00:18:02.734 INFO:tasks.workunit.client.0.smithi078.stdout:4/944: symlink dc/d10/d40/d3a/d46/l12d 0 2024-09-11T00:18:02.734 INFO:tasks.workunit.client.0.smithi078.stdout:4/945: readlink dc/d10/d40/d3a/d65/d7b/laa 0 2024-09-11T00:18:02.735 INFO:tasks.workunit.client.0.smithi078.stdout:4/946: symlink dc/d10/d40/d3a/d4c/db4/df9/l12e 0 2024-09-11T00:18:02.735 INFO:tasks.workunit.client.0.smithi078.stdout:4/947: fdatasync dc/d10/d40/d3a/d46/d47/fa0 0 2024-09-11T00:18:02.736 INFO:tasks.workunit.client.0.smithi078.stdout:7/728: dread d0/f63 [0,4194304] 0 2024-09-11T00:18:02.737 INFO:tasks.workunit.client.0.smithi078.stdout:7/729: dread d0/d34/db/d30/d1d/f13 [4194304,4194304] 0 2024-09-11T00:18:02.739 INFO:tasks.workunit.client.0.smithi078.stdout:7/730: mkdir d0/d34/db/d32/ddc 0 2024-09-11T00:18:02.740 INFO:tasks.workunit.client.0.smithi078.stdout:7/731: symlink d0/d34/db/da0/ldd 0 2024-09-11T00:18:02.740 INFO:tasks.workunit.client.0.smithi078.stdout:3/816: dwrite d0/d7/d23/d7c/db7/de8/f3a [0,4194304] 0 2024-09-11T00:18:02.741 INFO:tasks.workunit.client.0.smithi078.stdout:7/732: symlink d0/d34/d86/lde 0 2024-09-11T00:18:02.741 INFO:tasks.workunit.client.0.smithi078.stdout:7/733: chown d0/d34 0 1 2024-09-11T00:18:02.742 INFO:tasks.workunit.client.0.smithi078.stdout:3/817: truncate d0/d7/d46/f5b 2316126 0 2024-09-11T00:18:02.743 INFO:tasks.workunit.client.0.smithi078.stdout:4/948: write dc/d10/d40/d3a/d46/f6b [2400231,50335] 0 2024-09-11T00:18:02.744 INFO:tasks.workunit.client.0.smithi078.stdout:7/734: mkdir d0/da7/ddf 0 2024-09-11T00:18:02.744 INFO:tasks.workunit.client.0.smithi078.stdout:2/850: dwrite d0/d19/f2c [0,4194304] 0 2024-09-11T00:18:02.744 INFO:tasks.workunit.client.0.smithi078.stdout:4/949: write dc/d10/d40/d33/f84 [1080953,2161] 0 2024-09-11T00:18:02.745 INFO:tasks.workunit.client.0.smithi078.stdout:3/818: mkdir d0/d7/d18/d70/df5 0 2024-09-11T00:18:02.745 INFO:tasks.workunit.client.0.smithi078.stdout:3/819: chown d0/d7/d23/d7c/db7/de8/df3 12 1 2024-09-11T00:18:02.746 INFO:tasks.workunit.client.0.smithi078.stdout:2/851: symlink d0/d1/d11/d60/da2/d3a/d107/dcd/l118 0 2024-09-11T00:18:02.748 INFO:tasks.workunit.client.0.smithi078.stdout:3/820: creat d0/d7/d18/d1b/d8e/daf/ff6 x:0 0 0 2024-09-11T00:18:02.748 INFO:tasks.workunit.client.0.smithi078.stdout:3/821: readlink d0/d1a/d77/l90 0 2024-09-11T00:18:02.748 INFO:tasks.workunit.client.0.smithi078.stdout:5/684: dwrite d7/d8/d33/d22/d25/d28/fb6 [0,4194304] 0 2024-09-11T00:18:02.748 INFO:tasks.workunit.client.0.smithi078.stdout:5/685: stat d7/d8/d33/da7/cd4 0 2024-09-11T00:18:02.749 INFO:tasks.workunit.client.0.smithi078.stdout:2/852: creat d0/d19/d3d/d8d/f119 x:0 0 0 2024-09-11T00:18:02.751 INFO:tasks.workunit.client.0.smithi078.stdout:3/822: link d0/d7/d23/d91/c83 d0/d7/d23/cf7 0 2024-09-11T00:18:02.751 INFO:tasks.workunit.client.0.smithi078.stdout:3/823: write d0/d7/f87 [1466925,29234] 0 2024-09-11T00:18:02.754 INFO:tasks.workunit.client.0.smithi078.stdout:3/824: dread d0/d7/d18/f6e [0,4194304] 0 2024-09-11T00:18:02.760 INFO:tasks.workunit.client.0.smithi078.stdout:7/735: dwrite d0/d34/db/d30/fc2 [0,4194304] 0 2024-09-11T00:18:02.761 INFO:tasks.workunit.client.0.smithi078.stdout:7/736: write d0/d34/db/d32/fb4 [290408,25025] 0 2024-09-11T00:18:02.761 INFO:tasks.workunit.client.0.smithi078.stdout:7/737: write d0/d34/db/d30/d1d/f39 [3621244,14650] 0 2024-09-11T00:18:02.761 INFO:tasks.workunit.client.0.smithi078.stdout:5/686: creat d7/d8/d33/d22/d25/d28/deb/fec x:0 0 0 2024-09-11T00:18:02.762 INFO:tasks.workunit.client.0.smithi078.stdout:4/950: dwrite dc/f25 [0,4194304] 0 2024-09-11T00:18:02.763 INFO:tasks.workunit.client.0.smithi078.stdout:4/951: write dc/d10/d40/d3a/d46/f6b [459982,104306] 0 2024-09-11T00:18:02.763 INFO:tasks.workunit.client.0.smithi078.stdout:2/853: mkdir d0/d1/d11/d60/da2/d3a/d51/d97/dac/d11a 0 2024-09-11T00:18:02.773 INFO:tasks.workunit.client.0.smithi078.stdout:4/952: unlink dc/d10/d40/d33/fa9 0 2024-09-11T00:18:02.773 INFO:tasks.workunit.client.0.smithi078.stdout:4/953: chown dc/d10/d40/d3a/d65 125280590 1 2024-09-11T00:18:02.773 INFO:tasks.workunit.client.0.smithi078.stdout:4/954: read dc/d10/d1f/f5b [107970,10051] 0 2024-09-11T00:18:02.774 INFO:tasks.workunit.client.0.smithi078.stdout:4/955: write dc/d10/d40/d3a/d4c/db4/d72/f110 [1094120,67675] 0 2024-09-11T00:18:02.774 INFO:tasks.workunit.client.0.smithi078.stdout:4/956: chown dc/d10/d40/d3a/d65/d7b/laa 30 1 2024-09-11T00:18:02.774 INFO:tasks.workunit.client.0.smithi078.stdout:4/957: chown dc/d10/d40/d3a/d46/d59/cfb 495 1 2024-09-11T00:18:02.774 INFO:tasks.workunit.client.0.smithi078.stdout:3/825: dwrite d0/f78 [4194304,4194304] 0 2024-09-11T00:18:02.774 INFO:tasks.workunit.client.0.smithi078.stdout:2/854: stat d0/d1/d6f/ldc 0 2024-09-11T00:18:02.774 INFO:tasks.workunit.client.0.smithi078.stdout:4/958: creat dc/d54/dd0/f12f x:0 0 0 2024-09-11T00:18:02.777 INFO:tasks.workunit.client.0.smithi078.stdout:3/826: link d0/d7/d23/d7c/da1/lb0 d0/d7/d23/d7c/da1/lf8 0 2024-09-11T00:18:02.777 INFO:tasks.workunit.client.0.smithi078.stdout:3/827: write d0/d7/d23/d91/f28 [3491762,97448] 0 2024-09-11T00:18:02.777 INFO:tasks.workunit.client.0.smithi078.stdout:3/828: write d0/d7/d18/dd8/d3e/f5f [5565065,60755] 0 2024-09-11T00:18:02.777 INFO:tasks.workunit.client.0.smithi078.stdout:6/787: sync 2024-09-11T00:18:02.777 INFO:tasks.workunit.client.0.smithi078.stdout:0/715: sync 2024-09-11T00:18:02.777 INFO:tasks.workunit.client.0.smithi078.stdout:0/716: stat d2/d2a/d2c/d35/d59/d7/f3b 0 2024-09-11T00:18:02.778 INFO:tasks.workunit.client.0.smithi078.stdout:2/855: mknod d0/d1/d11/d60/da2/d38/c11b 0 2024-09-11T00:18:02.778 INFO:tasks.workunit.client.0.smithi078.stdout:6/788: dread d0/d1/d53/d9c/db6/fe2 [0,4194304] 0 2024-09-11T00:18:02.780 INFO:tasks.workunit.client.0.smithi078.stdout:5/687: dwrite d7/d8/de/d90/fbe [4194304,4194304] 0 2024-09-11T00:18:02.783 INFO:tasks.workunit.client.0.smithi078.stdout:2/856: rename d0/d1/d6/d52/faf to d0/d1/d3b/f11c 0 2024-09-11T00:18:02.787 INFO:tasks.workunit.client.0.smithi078.stdout:2/857: truncate d0/d1/d3b/f84 404621 0 2024-09-11T00:18:02.787 INFO:tasks.workunit.client.0.smithi078.stdout:6/789: dread d0/f3b [0,4194304] 0 2024-09-11T00:18:02.787 INFO:tasks.workunit.client.0.smithi078.stdout:6/790: write d0/f68 [64610,18867] 0 2024-09-11T00:18:02.787 INFO:tasks.workunit.client.0.smithi078.stdout:9/754: sync 2024-09-11T00:18:02.787 INFO:tasks.workunit.client.0.smithi078.stdout:8/997: sync 2024-09-11T00:18:02.787 INFO:tasks.workunit.client.0.smithi078.stdout:8/998: fdatasync da/d13/d19/f35 0 2024-09-11T00:18:02.788 INFO:tasks.workunit.client.0.smithi078.stdout:5/688: dread d7/d8/d33/d22/dd9/ddf/dc5/dc8/f6f [0,4194304] 0 2024-09-11T00:18:02.788 INFO:tasks.workunit.client.0.smithi078.stdout:5/689: write d7/d8/d33/da7/fd1 [366962,76700] 0 2024-09-11T00:18:02.788 INFO:tasks.workunit.client.0.smithi078.stdout:2/858: truncate d0/d1/d6/f16 799119 0 2024-09-11T00:18:02.789 INFO:tasks.workunit.client.0.smithi078.stdout:9/755: creat dc/d12/d20/d58/d5b/dbb/f102 x:0 0 0 2024-09-11T00:18:02.789 INFO:tasks.workunit.client.0.smithi078.stdout:9/756: readlink dc/d12/d54/de7/lf0 0 2024-09-11T00:18:02.791 INFO:tasks.workunit.client.0.smithi078.stdout:8/999: symlink da/d13/d1b/d24/d62/d111/d9e/l13f 0 2024-09-11T00:18:02.794 INFO:tasks.workunit.client.0.smithi078.stdout:5/690: dread d7/d8/d33/d22/d25/d28/d24/d1c/d1e/f5f [0,4194304] 0 2024-09-11T00:18:02.794 INFO:tasks.workunit.client.0.smithi078.stdout:9/757: mkdir dc/d12/d54/de7/d103 0 2024-09-11T00:18:02.796 INFO:tasks.workunit.client.0.smithi078.stdout:0/717: dwrite d2/d2a/d2c/d35/d59/f22 [0,4194304] 0 2024-09-11T00:18:02.798 INFO:tasks.workunit.client.0.smithi078.stdout:5/691: creat d7/d8/d33/d22/d25/db1/fed x:0 0 0 2024-09-11T00:18:02.800 INFO:tasks.workunit.client.0.smithi078.stdout:9/758: creat dc/d12/f104 x:0 0 0 2024-09-11T00:18:02.802 INFO:tasks.workunit.client.0.smithi078.stdout:6/791: dwrite d0/d1/f52 [0,4194304] 0 2024-09-11T00:18:02.803 INFO:tasks.workunit.client.0.smithi078.stdout:0/718: creat d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/db7/fed x:0 0 0 2024-09-11T00:18:02.803 INFO:tasks.workunit.client.0.smithi078.stdout:2/859: dwrite d0/d19/d3d/f106 [4194304,4194304] 0 2024-09-11T00:18:02.803 INFO:tasks.workunit.client.0.smithi078.stdout:2/860: dread - d0/d19/d3d/d8d/f119 zero size 2024-09-11T00:18:02.805 INFO:tasks.workunit.client.0.smithi078.stdout:9/759: unlink dc/d12/d54/de7/lf0 0 2024-09-11T00:18:02.806 INFO:tasks.workunit.client.0.smithi078.stdout:6/792: link d0/d1/d53/d9c/dac/ff2 d0/d1/d9/d8d/f104 0 2024-09-11T00:18:02.808 INFO:tasks.workunit.client.0.smithi078.stdout:0/719: creat d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/fee x:0 0 0 2024-09-11T00:18:02.808 INFO:tasks.workunit.client.0.smithi078.stdout:0/720: fsync d2/d2a/d2c/d35/d71/da7/fb0 0 2024-09-11T00:18:02.811 INFO:tasks.workunit.client.0.smithi078.stdout:2/861: rename d0/d1/d11/d60/da2/d3a/fc7 to d0/d1/d6f/d93/dc3/dc4/f11d 0 2024-09-11T00:18:02.812 INFO:tasks.workunit.client.0.smithi078.stdout:6/793: dread d0/d1/d9/d59/d74/db3/dd5/f4f [0,4194304] 0 2024-09-11T00:18:02.814 INFO:tasks.workunit.client.0.smithi078.stdout:0/721: creat d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/fef x:0 0 0 2024-09-11T00:18:02.816 INFO:tasks.workunit.client.0.smithi078.stdout:2/862: rename d0/d1/d33/d86/db4/f85 to d0/d1/f11e 0 2024-09-11T00:18:02.819 INFO:tasks.workunit.client.0.smithi078.stdout:9/760: dwrite dc/d12/f17 [0,4194304] 0 2024-09-11T00:18:02.819 INFO:tasks.workunit.client.0.smithi078.stdout:0/722: getdents d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/db7 0 2024-09-11T00:18:02.822 INFO:tasks.workunit.client.0.smithi078.stdout:0/723: symlink d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/lf0 0 2024-09-11T00:18:02.823 INFO:tasks.workunit.client.0.smithi078.stdout:0/724: creat d2/d2a/d2c/d35/ff1 x:0 0 0 2024-09-11T00:18:02.824 INFO:tasks.workunit.client.0.smithi078.stdout:0/725: mkdir d2/d2a/d2c/d35/d59/d4f/d61/df2 0 2024-09-11T00:18:02.825 INFO:tasks.workunit.client.0.smithi078.stdout:0/726: symlink d2/dbd/lf3 0 2024-09-11T00:18:02.825 INFO:tasks.workunit.client.0.smithi078.stdout:0/727: chown d2/la4 0 1 2024-09-11T00:18:02.829 INFO:tasks.workunit.client.0.smithi078.stdout:6/794: dwrite d0/d1/f98 [0,4194304] 0 2024-09-11T00:18:02.829 INFO:tasks.workunit.client.0.smithi078.stdout:6/795: chown d0/d1/d1b/f6d 713820 1 2024-09-11T00:18:02.834 INFO:tasks.workunit.client.0.smithi078.stdout:2/863: dwrite d0/d1/d11/d60/da2/d3a/d51/f58 [4194304,4194304] 0 2024-09-11T00:18:02.835 INFO:tasks.workunit.client.0.smithi078.stdout:9/761: dwrite dc/d12/d46/fe2 [0,4194304] 0 2024-09-11T00:18:02.835 INFO:tasks.workunit.client.0.smithi078.stdout:9/762: truncate dc/d12/d20/d50/dbc/dcf/de1/d3e/ffc 375816 0 2024-09-11T00:18:02.836 INFO:tasks.workunit.client.0.smithi078.stdout:2/864: creat d0/d1/d3c/d40/d98/f11f x:0 0 0 2024-09-11T00:18:02.837 INFO:tasks.workunit.client.0.smithi078.stdout:9/763: truncate dc/d12/d20/d58/d5a/f96 3713616 0 2024-09-11T00:18:02.838 INFO:tasks.workunit.client.0.smithi078.stdout:9/764: symlink dc/d12/d20/d30/l105 0 2024-09-11T00:18:02.841 INFO:tasks.workunit.client.0.smithi078.stdout:9/765: read dc/d12/f8e [390758,75638] 0 2024-09-11T00:18:02.842 INFO:tasks.workunit.client.0.smithi078.stdout:9/766: creat dc/d12/d46/d51/dcc/dce/f106 x:0 0 0 2024-09-11T00:18:02.843 INFO:tasks.workunit.client.0.smithi078.stdout:9/767: creat dc/d12/d54/d83/f107 x:0 0 0 2024-09-11T00:18:02.843 INFO:tasks.workunit.client.0.smithi078.stdout:9/768: truncate dc/f29 959738 0 2024-09-11T00:18:02.844 INFO:tasks.workunit.client.0.smithi078.stdout:2/865: dread d0/d19/d3d/f106 [0,4194304] 0 2024-09-11T00:18:02.844 INFO:tasks.workunit.client.0.smithi078.stdout:2/866: stat d0/d1/d11/f71 0 2024-09-11T00:18:02.844 INFO:tasks.workunit.client.0.smithi078.stdout:2/867: fdatasync d0/d1/d3c/d40/d50/fda 0 2024-09-11T00:18:02.844 INFO:tasks.workunit.client.0.smithi078.stdout:2/868: readlink d0/d19/l72 0 2024-09-11T00:18:02.845 INFO:tasks.workunit.client.0.smithi078.stdout:9/769: rename dc/d12/d20/d30/f4b to dc/d12/d20/d50/db1/f108 0 2024-09-11T00:18:02.845 INFO:tasks.workunit.client.0.smithi078.stdout:2/869: getdents d0/d19/d3d 0 2024-09-11T00:18:02.846 INFO:tasks.workunit.client.0.smithi078.stdout:9/770: rmdir dc/d12/d20/d30 39 2024-09-11T00:18:02.851 INFO:tasks.workunit.client.0.smithi078.stdout:2/870: creat d0/d19/d3d/d8d/df7/f120 x:0 0 0 2024-09-11T00:18:02.851 INFO:tasks.workunit.client.0.smithi078.stdout:2/871: rmdir d0/d1/d6 39 2024-09-11T00:18:02.851 INFO:tasks.workunit.client.0.smithi078.stdout:2/872: write d0/d1/d3c/d40/d98/f11f [748991,128879] 0 2024-09-11T00:18:02.855 INFO:tasks.workunit.client.0.smithi078.stdout:2/873: dread d0/d1/d8/f6e [0,4194304] 0 2024-09-11T00:18:02.855 INFO:tasks.workunit.client.0.smithi078.stdout:2/874: dread - d0/d19/d3d/d8d/f119 zero size 2024-09-11T00:18:02.856 INFO:tasks.workunit.client.0.smithi078.stdout:2/875: creat d0/d1/d3c/dc6/f121 x:0 0 0 2024-09-11T00:18:02.860 INFO:tasks.workunit.client.0.smithi078.stdout:2/876: getdents d0/d1/d3c/dc6 0 2024-09-11T00:18:02.862 INFO:tasks.workunit.client.0.smithi078.stdout:9/771: dwrite dc/d12/d20/d50/dbc/dcf/de1/d3e/ffc [0,4194304] 0 2024-09-11T00:18:02.865 INFO:tasks.workunit.client.0.smithi078.stdout:9/772: creat dc/d12/d20/d50/db1/f109 x:0 0 0 2024-09-11T00:18:02.882 INFO:tasks.workunit.client.0.smithi078.stdout:2/877: dwrite d0/d1/d11/f2d [0,4194304] 0 2024-09-11T00:18:02.882 INFO:tasks.workunit.client.0.smithi078.stdout:2/878: write d0/d1/d11/d60/da2/d3a/f3e [1569410,101053] 0 2024-09-11T00:18:02.882 INFO:tasks.workunit.client.0.smithi078.stdout:9/773: dwrite dc/d12/d20/d58/d5b/f84 [0,4194304] 0 2024-09-11T00:18:02.885 INFO:tasks.workunit.client.0.smithi078.stdout:9/774: creat dc/d12/d20/d58/d5b/d68/f10a x:0 0 0 2024-09-11T00:18:02.885 INFO:tasks.workunit.client.0.smithi078.stdout:9/775: dread - dc/d12/d20/d58/d5b/d68/f10a zero size 2024-09-11T00:18:02.887 INFO:tasks.workunit.client.0.smithi078.stdout:9/776: fsync dc/d12/d20/d30/f9c 0 2024-09-11T00:18:02.887 INFO:tasks.workunit.client.0.smithi078.stdout:9/777: write dc/d12/d20/d50/dbc/dcf/de1/d3e/f9d [238562,108981] 0 2024-09-11T00:18:02.888 INFO:tasks.workunit.client.0.smithi078.stdout:9/778: stat dc/d12/d20/d30/lf8 0 2024-09-11T00:18:02.888 INFO:tasks.workunit.client.0.smithi078.stdout:9/779: fsync dc/d12/ff5 0 2024-09-11T00:18:02.888 INFO:tasks.workunit.client.0.smithi078.stdout:9/780: stat dc/d12/c15 0 2024-09-11T00:18:02.888 INFO:tasks.workunit.client.0.smithi078.stdout:9/781: truncate fa 3173595 0 2024-09-11T00:18:02.902 INFO:tasks.workunit.client.0.smithi078.stdout:9/782: dwrite dc/d12/d20/d58/d5b/d68/fac [0,4194304] 0 2024-09-11T00:18:02.902 INFO:tasks.workunit.client.0.smithi078.stdout:9/783: fsync dc/d12/d20/d58/fed 0 2024-09-11T00:18:02.904 INFO:tasks.workunit.client.0.smithi078.stdout:9/784: rename dc/d12/d54/de7/cfe to dc/d12/d20/d50/dbc/dcf/de1/c10b 0 2024-09-11T00:18:02.905 INFO:tasks.workunit.client.0.smithi078.stdout:9/785: link dc/d12/d20/d50/dbc/ldb dc/d12/d20/d58/d5a/dc9/l10c 0 2024-09-11T00:18:02.921 INFO:tasks.workunit.client.0.smithi078.stdout:9/786: dwrite dc/d12/d54/db4/f93 [0,4194304] 0 2024-09-11T00:18:02.923 INFO:tasks.workunit.client.0.smithi078.stdout:9/787: creat dc/d12/d46/d51/dcc/dce/f10d x:0 0 0 2024-09-11T00:18:02.924 INFO:tasks.workunit.client.0.smithi078.stdout:9/788: mknod dc/d12/d46/d51/dcc/dce/c10e 0 2024-09-11T00:18:02.925 INFO:tasks.workunit.client.0.smithi078.stdout:9/789: read dc/d12/d54/faa [970009,36116] 0 2024-09-11T00:18:02.925 INFO:tasks.workunit.client.0.smithi078.stdout:9/790: mknod dc/d12/d46/d51/c10f 0 2024-09-11T00:18:02.926 INFO:tasks.workunit.client.0.smithi078.stdout:9/791: getdents dc/d12/d20/d58/d5a/dc9 0 2024-09-11T00:18:02.931 INFO:tasks.workunit.client.0.smithi078.stdout:9/792: dread dc/d12/d54/db4/fa1 [0,4194304] 0 2024-09-11T00:18:02.932 INFO:tasks.workunit.client.0.smithi078.stdout:9/793: creat dc/d12/d20/d58/d5b/f110 x:0 0 0 2024-09-11T00:18:02.933 INFO:tasks.workunit.client.0.smithi078.stdout:9/794: readlink dc/d12/d20/d30/l37 0 2024-09-11T00:18:02.945 INFO:tasks.workunit.client.0.smithi078.stdout:9/795: dwrite dc/d12/d54/f57 [0,4194304] 0 2024-09-11T00:18:02.947 INFO:tasks.workunit.client.0.smithi078.stdout:9/796: unlink dc/d12/d20/d50/f9b 0 2024-09-11T00:18:02.948 INFO:tasks.workunit.client.0.smithi078.stdout:9/797: fsync dc/d12/d20/d50/dbc/dcf/de1/d3e/f60 0 2024-09-11T00:18:02.987 INFO:tasks.workunit.client.0.smithi078.stdout:7/738: sync 2024-09-11T00:18:02.989 INFO:tasks.workunit.client.0.smithi078.stdout:7/739: link d0/d34/db/d30/d1d/d14/d62/fa1 d0/d34/db/d30/d1d/d14/d45/fe0 0 2024-09-11T00:18:02.997 INFO:tasks.workunit.client.0.smithi078.stdout:7/740: read d0/d34/db/d30/fdb [1478139,73068] 0 2024-09-11T00:18:02.997 INFO:tasks.workunit.client.0.smithi078.stdout:7/741: chown d0/d34/d65 60707 1 2024-09-11T00:18:02.997 INFO:tasks.workunit.client.0.smithi078.stdout:7/742: truncate d0/d34/d86/f89 167750 0 2024-09-11T00:18:03.011 INFO:tasks.workunit.client.0.smithi078.stdout:7/743: dwrite d0/d3f/f9e [0,4194304] 0 2024-09-11T00:18:03.012 INFO:tasks.workunit.client.0.smithi078.stdout:7/744: fdatasync d0/d3f/f60 0 2024-09-11T00:18:03.012 INFO:tasks.workunit.client.0.smithi078.stdout:7/745: write d0/d34/d65/fc6 [317378,93410] 0 2024-09-11T00:18:03.013 INFO:tasks.workunit.client.0.smithi078.stdout:7/746: mknod d0/d34/db/d30/d1d/d14/d45/ce1 0 2024-09-11T00:18:03.014 INFO:tasks.workunit.client.0.smithi078.stdout:7/747: link d0/d34/db/da0/cc0 d0/da7/ce2 0 2024-09-11T00:18:03.015 INFO:tasks.workunit.client.0.smithi078.stdout:7/748: symlink d0/d34/db/d30/d28/dc4/le3 0 2024-09-11T00:18:03.016 INFO:tasks.workunit.client.0.smithi078.stdout:7/749: mknod d0/d34/d86/ce4 0 2024-09-11T00:18:03.017 INFO:tasks.workunit.client.0.smithi078.stdout:7/750: chown d0/d3f/c4e 15138869 1 2024-09-11T00:18:03.017 INFO:tasks.workunit.client.0.smithi078.stdout:7/751: write d0/d34/d65/fc6 [252481,42472] 0 2024-09-11T00:18:03.018 INFO:tasks.workunit.client.0.smithi078.stdout:7/752: mknod d0/d34/db/d30/d1d/d81/ce5 0 2024-09-11T00:18:03.019 INFO:tasks.workunit.client.0.smithi078.stdout:7/753: getdents d0/d3f 0 2024-09-11T00:18:03.019 INFO:tasks.workunit.client.0.smithi078.stdout:7/754: write d0/d34/db/d30/d1d/f17 [2059769,11943] 0 2024-09-11T00:18:03.019 INFO:tasks.workunit.client.0.smithi078.stdout:7/755: readlink d0/d34/db/l69 0 2024-09-11T00:18:03.097 INFO:tasks.workunit.client.0.smithi078.stdout:4/959: sync 2024-09-11T00:18:03.098 INFO:tasks.workunit.client.0.smithi078.stdout:3/829: sync 2024-09-11T00:18:03.098 INFO:tasks.workunit.client.0.smithi078.stdout:3/830: chown d0/f3c 8697 1 2024-09-11T00:18:03.098 INFO:tasks.workunit.client.0.smithi078.stdout:3/831: mkdir d0/d7/d46/d86/d9a/de9/df9 0 2024-09-11T00:18:03.099 INFO:tasks.workunit.client.0.smithi078.stdout:3/832: mknod d0/d7/d18/cfa 0 2024-09-11T00:18:03.099 INFO:tasks.workunit.client.0.smithi078.stdout:3/833: write d0/d7/d18/d70/fb3 [7118,128041] 0 2024-09-11T00:18:03.112 INFO:tasks.workunit.client.0.smithi078.stdout:4/960: dwrite dc/d10/d40/d3a/d65/d7b/d9e/f3e [0,4194304] 0 2024-09-11T00:18:03.123 INFO:tasks.workunit.client.0.smithi078.stdout:4/961: dwrite dc/d10/ddb/f125 [0,4194304] 0 2024-09-11T00:18:03.128 INFO:tasks.workunit.client.0.smithi078.stdout:4/962: read dc/d10/d40/d3a/d46/d59/f102 [2150689,13002] 0 2024-09-11T00:18:03.129 INFO:tasks.workunit.client.0.smithi078.stdout:4/963: stat dc/d10/d40/d3a/d65/d94/de9/led 0 2024-09-11T00:18:03.129 INFO:tasks.workunit.client.0.smithi078.stdout:4/964: fdatasync dc/f25 0 2024-09-11T00:18:03.129 INFO:tasks.workunit.client.0.smithi078.stdout:4/965: chown dc/d10/d40/d33/lb2 15365291 1 2024-09-11T00:18:03.130 INFO:tasks.workunit.client.0.smithi078.stdout:4/966: creat dc/d10/d40/d3a/d4c/db4/d72/f130 x:0 0 0 2024-09-11T00:18:03.131 INFO:tasks.workunit.client.0.smithi078.stdout:4/967: truncate dc/d10/d1f/f2f 1096884 0 2024-09-11T00:18:03.132 INFO:tasks.workunit.client.0.smithi078.stdout:4/968: mknod dc/d10/d40/d3a/d65/d94/de9/c131 0 2024-09-11T00:18:03.133 INFO:tasks.workunit.client.0.smithi078.stdout:4/969: rename dc/d10/d3c/lf2 to dc/d10/d1f/l132 0 2024-09-11T00:18:03.145 INFO:tasks.workunit.client.0.smithi078.stdout:4/970: dwrite dc/d10/d1f/f20 [4194304,4194304] 0 2024-09-11T00:18:03.145 INFO:tasks.workunit.client.0.smithi078.stdout:4/971: write dc/d10/d40/d3a/d65/d94/f12a [181238,3490] 0 2024-09-11T00:18:03.147 INFO:tasks.workunit.client.0.smithi078.stdout:4/972: link dc/d10/d40/d3a/d65/d7b/d9e/d50/c122 dc/d10/ddd/d109/c133 0 2024-09-11T00:18:03.147 INFO:tasks.workunit.client.0.smithi078.stdout:4/973: link dc/d10/d40/d3a/c74 dc/d54/c134 0 2024-09-11T00:18:03.150 INFO:tasks.workunit.client.0.smithi078.stdout:4/974: dread dc/d10/d40/d3a/d46/d59/f5f [0,4194304] 0 2024-09-11T00:18:03.152 INFO:tasks.workunit.client.0.smithi078.stdout:4/975: rename f3 to dc/d10/d40/d3a/d65/d7b/d108/f135 0 2024-09-11T00:18:03.152 INFO:tasks.workunit.client.0.smithi078.stdout:4/976: write dc/d10/f86 [3197872,25949] 0 2024-09-11T00:18:03.155 INFO:tasks.workunit.client.0.smithi078.stdout:0/728: sync 2024-09-11T00:18:03.155 INFO:tasks.workunit.client.0.smithi078.stdout:6/796: sync 2024-09-11T00:18:03.156 INFO:tasks.workunit.client.0.smithi078.stdout:0/729: chown d2/f2d 1721762979 1 2024-09-11T00:18:03.156 INFO:tasks.workunit.client.0.smithi078.stdout:6/797: chown d0/d1/d9/d17 0 1 2024-09-11T00:18:03.156 INFO:tasks.workunit.client.0.smithi078.stdout:5/692: sync 2024-09-11T00:18:03.156 INFO:tasks.workunit.client.0.smithi078.stdout:9/798: sync 2024-09-11T00:18:03.156 INFO:tasks.workunit.client.0.smithi078.stdout:2/879: sync 2024-09-11T00:18:03.156 INFO:tasks.workunit.client.0.smithi078.stdout:6/798: creat d0/d66/f105 x:0 0 0 2024-09-11T00:18:03.158 INFO:tasks.workunit.client.0.smithi078.stdout:5/693: rename d7/d8/d33/d22/dd9/ddf/dc5/dc8/d2a/f35 to d7/d8/d33/d22/d25/d28/da8/fee 0 2024-09-11T00:18:03.158 INFO:tasks.workunit.client.0.smithi078.stdout:9/799: creat dc/d12/d46/d51/dcc/dce/dfd/f111 x:0 0 0 2024-09-11T00:18:03.159 INFO:tasks.workunit.client.0.smithi078.stdout:9/800: write dc/d12/d20/d58/d5b/d68/f10a [429337,10736] 0 2024-09-11T00:18:03.159 INFO:tasks.workunit.client.0.smithi078.stdout:2/880: link d0/d1/d3c/l111 d0/d1/d33/d86/d108/l122 0 2024-09-11T00:18:03.160 INFO:tasks.workunit.client.0.smithi078.stdout:6/799: symlink d0/d1/da8/l106 0 2024-09-11T00:18:03.161 INFO:tasks.workunit.client.0.smithi078.stdout:0/730: write d2/d2a/d2c/d35/d59/d4f/f80 [1626365,92091] 0 2024-09-11T00:18:03.161 INFO:tasks.workunit.client.0.smithi078.stdout:0/731: read d2/d2a/fab [3967292,106577] 0 2024-09-11T00:18:03.161 INFO:tasks.workunit.client.0.smithi078.stdout:5/694: creat d7/d8/d33/d22/d25/fef x:0 0 0 2024-09-11T00:18:03.162 INFO:tasks.workunit.client.0.smithi078.stdout:9/801: rmdir dc/d12/d20/d30 39 2024-09-11T00:18:03.162 INFO:tasks.workunit.client.0.smithi078.stdout:9/802: stat dc/d12/d20/d58/f72 0 2024-09-11T00:18:03.162 INFO:tasks.workunit.client.0.smithi078.stdout:9/803: stat dc/d12/c15 0 2024-09-11T00:18:03.162 INFO:tasks.workunit.client.0.smithi078.stdout:0/732: rmdir d2/d2a/d2c/d35/d59/d7 39 2024-09-11T00:18:03.163 INFO:tasks.workunit.client.0.smithi078.stdout:5/695: getdents d7/d8/d33/d22/d25/d6a/dc0 0 2024-09-11T00:18:03.164 INFO:tasks.workunit.client.0.smithi078.stdout:0/733: creat d2/d2a/d2c/d35/d59/d4f/ff4 x:0 0 0 2024-09-11T00:18:03.164 INFO:tasks.workunit.client.0.smithi078.stdout:0/734: chown d2/d97/cd9 67689342 1 2024-09-11T00:18:03.164 INFO:tasks.workunit.client.0.smithi078.stdout:0/735: readlink d2/d2a/d2c/l4b 0 2024-09-11T00:18:03.164 INFO:tasks.workunit.client.0.smithi078.stdout:4/977: dwrite dc/f39 [0,4194304] 0 2024-09-11T00:18:03.165 INFO:tasks.workunit.client.0.smithi078.stdout:5/696: mkdir d7/d8/d47/d52/df0 0 2024-09-11T00:18:03.165 INFO:tasks.workunit.client.0.smithi078.stdout:0/736: symlink d2/d2a/d2c/d35/d93/lf5 0 2024-09-11T00:18:03.165 INFO:tasks.workunit.client.0.smithi078.stdout:0/737: readlink d2/d2a/d2c/d35/d59/d7/dd2/ld6 0 2024-09-11T00:18:03.166 INFO:tasks.workunit.client.0.smithi078.stdout:4/978: mknod dc/d10/ddd/df4/c136 0 2024-09-11T00:18:03.166 INFO:tasks.workunit.client.0.smithi078.stdout:5/697: symlink d7/d8/d33/d22/dd9/ddf/dc5/dc8/d2a/lf1 0 2024-09-11T00:18:03.167 INFO:tasks.workunit.client.0.smithi078.stdout:0/738: creat d2/d2a/d2c/d35/d71/da7/ff6 x:0 0 0 2024-09-11T00:18:03.167 INFO:tasks.workunit.client.0.smithi078.stdout:0/739: write d2/d2a/d2c/d35/d59/d4f/d61/d69/fa2 [1724091,66904] 0 2024-09-11T00:18:03.168 INFO:tasks.workunit.client.0.smithi078.stdout:4/979: mkdir dc/d54/d137 0 2024-09-11T00:18:03.168 INFO:tasks.workunit.client.0.smithi078.stdout:4/980: fsync dc/f25 0 2024-09-11T00:18:03.170 INFO:tasks.workunit.client.0.smithi078.stdout:4/981: mknod dc/d10/d40/d3a/d65/d7b/d8b/dfa/c138 0 2024-09-11T00:18:03.170 INFO:tasks.workunit.client.0.smithi078.stdout:6/800: dread d0/d1/da8/fad [4194304,4194304] 0 2024-09-11T00:18:03.170 INFO:tasks.workunit.client.0.smithi078.stdout:4/982: chown dc/d10/d40/d3a/d46/d59/d9f/f11c 57 1 2024-09-11T00:18:03.172 INFO:tasks.workunit.client.0.smithi078.stdout:6/801: rename d0/d1/d53/d9c/dac/de3/df3 to d0/d1/d9/d59/da3/d107 0 2024-09-11T00:18:03.172 INFO:tasks.workunit.client.0.smithi078.stdout:6/802: fdatasync d0/d1/d9/d59/d74/db3/dd5/ff5 0 2024-09-11T00:18:03.172 INFO:tasks.workunit.client.0.smithi078.stdout:6/803: chown d0/ffe 59 1 2024-09-11T00:18:03.177 INFO:tasks.workunit.client.0.smithi078.stdout:0/740: dread d2/d2a/d2c/d35/d71/f8e [0,4194304] 0 2024-09-11T00:18:03.177 INFO:tasks.workunit.client.0.smithi078.stdout:0/741: write d2/d2a/d2c/d35/d59/d7/f3b [145753,52165] 0 2024-09-11T00:18:03.177 INFO:tasks.workunit.client.0.smithi078.stdout:0/742: dread - d2/d2a/d2c/d35/ff1 zero size 2024-09-11T00:18:03.178 INFO:tasks.workunit.client.0.smithi078.stdout:4/983: dread dc/d10/d3c/f67 [0,4194304] 0 2024-09-11T00:18:03.180 INFO:tasks.workunit.client.0.smithi078.stdout:4/984: mkdir dc/d54/dd0/d139 0 2024-09-11T00:18:03.181 INFO:tasks.workunit.client.0.smithi078.stdout:2/881: dwrite d0/d1/d11/f69 [0,4194304] 0 2024-09-11T00:18:03.182 INFO:tasks.workunit.client.0.smithi078.stdout:4/985: creat dc/d10/d40/d3a/d46/f13a x:0 0 0 2024-09-11T00:18:03.183 INFO:tasks.workunit.client.0.smithi078.stdout:9/804: dwrite dc/d12/d20/d58/d5a/fb0 [0,4194304] 0 2024-09-11T00:18:03.183 INFO:tasks.workunit.client.0.smithi078.stdout:2/882: rename d0/d1/d3c/d9f to d0/d1/d11/d60/da2/d3a/d123 0 2024-09-11T00:18:03.183 INFO:tasks.workunit.client.0.smithi078.stdout:2/883: chown d0/d1/d11/d60/da2/d3a/d107/cb1 39 1 2024-09-11T00:18:03.184 INFO:tasks.workunit.client.0.smithi078.stdout:4/986: creat dc/d10/ddb/f13b x:0 0 0 2024-09-11T00:18:03.184 INFO:tasks.workunit.client.0.smithi078.stdout:5/698: write d7/d8/de/ff [5187857,77148] 0 2024-09-11T00:18:03.185 INFO:tasks.workunit.client.0.smithi078.stdout:2/884: read d0/d1/d3c/d40/d50/dc0/f112 [4503468,23266] 0 2024-09-11T00:18:03.186 INFO:tasks.workunit.client.0.smithi078.stdout:9/805: mknod dc/c112 0 2024-09-11T00:18:03.187 INFO:tasks.workunit.client.0.smithi078.stdout:4/987: rename dc/d10/d40/d3a/d65/d7b/d8b/dfa/cfe to dc/d10/d40/d3a/d65/d7b/c13c 0 2024-09-11T00:18:03.188 INFO:tasks.workunit.client.0.smithi078.stdout:4/988: stat dc/d10/d40/d3a/d4c/cce 0 2024-09-11T00:18:03.188 INFO:tasks.workunit.client.0.smithi078.stdout:4/989: truncate dc/d10/d40/d3a/d46/dad/f117 686657 0 2024-09-11T00:18:03.188 INFO:tasks.workunit.client.0.smithi078.stdout:4/990: dread - dc/d10/d40/d3a/d65/f112 zero size 2024-09-11T00:18:03.189 INFO:tasks.workunit.client.0.smithi078.stdout:5/699: creat d7/d8/d33/d22/d25/db1/ff2 x:0 0 0 2024-09-11T00:18:03.189 INFO:tasks.workunit.client.0.smithi078.stdout:5/700: dread - d7/d8/d33/d22/d25/d28/fad zero size 2024-09-11T00:18:03.189 INFO:tasks.workunit.client.0.smithi078.stdout:5/701: chown d7/d8/de/fa1 0 1 2024-09-11T00:18:03.190 INFO:tasks.workunit.client.0.smithi078.stdout:9/806: symlink dc/d12/d46/d51/l113 0 2024-09-11T00:18:03.192 INFO:tasks.workunit.client.0.smithi078.stdout:6/804: dwrite d0/d1/d9/d59/d74/f86 [0,4194304] 0 2024-09-11T00:18:03.192 INFO:tasks.workunit.client.0.smithi078.stdout:2/885: write d0/d1/d3c/d40/d50/dc0/f112 [3147754,115203] 0 2024-09-11T00:18:03.192 INFO:tasks.workunit.client.0.smithi078.stdout:4/991: link dc/f11 dc/d10/d40/d3a/d65/d7b/dd7/f13d 0 2024-09-11T00:18:03.193 INFO:tasks.workunit.client.0.smithi078.stdout:4/992: stat dc/d10/d40/d3a/d65/d7b 0 2024-09-11T00:18:03.198 INFO:tasks.workunit.client.0.smithi078.stdout:0/743: dwrite d2/d2a/fab [0,4194304] 0 2024-09-11T00:18:03.199 INFO:tasks.workunit.client.0.smithi078.stdout:0/744: chown d2/d2a/d2c/d35/f78 76424 1 2024-09-11T00:18:03.203 INFO:tasks.workunit.client.0.smithi078.stdout:6/805: symlink d0/d1/d9/l108 0 2024-09-11T00:18:03.203 INFO:tasks.workunit.client.0.smithi078.stdout:6/806: truncate d0/d1/d53/d9c/dac/fb9 865263 0 2024-09-11T00:18:03.203 INFO:tasks.workunit.client.0.smithi078.stdout:6/807: chown d0/d1/d53/d72/c8a 44018 1 2024-09-11T00:18:03.205 INFO:tasks.workunit.client.0.smithi078.stdout:5/702: write d7/d8/d33/d22/d25/d28/d24/f50 [521511,122612] 0 2024-09-11T00:18:03.205 INFO:tasks.workunit.client.0.smithi078.stdout:4/993: symlink dc/d10/ddb/l13e 0 2024-09-11T00:18:03.206 INFO:tasks.workunit.client.0.smithi078.stdout:6/808: creat d0/d1/d53/d9c/dac/de3/f109 x:0 0 0 2024-09-11T00:18:03.207 INFO:tasks.workunit.client.0.smithi078.stdout:2/886: rename d0/d1/d3b/cf2 to d0/d1/d11/d60/da2/d3a/d107/dcd/c124 0 2024-09-11T00:18:03.207 INFO:tasks.workunit.client.0.smithi078.stdout:2/887: chown d0/d1/d11/f44 129082891 1 2024-09-11T00:18:03.209 INFO:tasks.workunit.client.0.smithi078.stdout:9/807: dwrite dc/d12/d20/d50/dbc/dcf/de1/f3b [0,4194304] 0 2024-09-11T00:18:03.209 INFO:tasks.workunit.client.0.smithi078.stdout:4/994: symlink dc/d10/d1f/d68/db5/l13f 0 2024-09-11T00:18:03.210 INFO:tasks.workunit.client.0.smithi078.stdout:4/995: chown dc/d10/d40/d3a/d65/d94/fd8 1259 1 2024-09-11T00:18:03.210 INFO:tasks.workunit.client.0.smithi078.stdout:4/996: chown dc/d10/d40/d3a/d4c/c5e 3941019 1 2024-09-11T00:18:03.210 INFO:tasks.workunit.client.0.smithi078.stdout:4/997: fdatasync dc/f39 0 2024-09-11T00:18:03.211 INFO:tasks.workunit.client.0.smithi078.stdout:6/809: symlink d0/d1/d9/d59/da3/d107/dff/l10a 0 2024-09-11T00:18:03.211 INFO:tasks.workunit.client.0.smithi078.stdout:6/810: truncate d0/d1/d9/d59/d74/d6b/fa9 432442 0 2024-09-11T00:18:03.213 INFO:tasks.workunit.client.0.smithi078.stdout:2/888: mknod d0/d1/d11/d60/da2/c125 0 2024-09-11T00:18:03.222 INFO:tasks.workunit.client.0.smithi078.stdout:4/998: link dc/d10/d40/d3a/d65/d94/cd5 dc/d10/d3c/c140 0 2024-09-11T00:18:03.223 INFO:tasks.workunit.client.0.smithi078.stdout:0/745: dwrite d2/d2a/d2c/d35/d59/d4f/d61/d69/f31 [0,4194304] 0 2024-09-11T00:18:03.223 INFO:tasks.workunit.client.0.smithi078.stdout:0/746: readlink d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/l43 0 2024-09-11T00:18:03.224 INFO:tasks.workunit.client.0.smithi078.stdout:2/889: truncate d0/d1/d6f/d93/dc3/dc4/dd4/fe0 2701931 0 2024-09-11T00:18:03.226 INFO:tasks.workunit.client.0.smithi078.stdout:4/999: mkdir dc/d10/d40/d3a/d46/d47/d11e/d141 0 2024-09-11T00:18:03.231 INFO:tasks.workunit.client.0.smithi078.stdout:5/703: dwrite d7/d8/d33/d22/d25/d28/d24/f4d [0,4194304] 0 2024-09-11T00:18:03.231 INFO:tasks.workunit.client.0.smithi078.stdout:5/704: stat d7/d8/d33/d22/d25/d28/d24/d1c/f82 0 2024-09-11T00:18:03.231 INFO:tasks.workunit.client.0.smithi078.stdout:0/747: link d2/d2a/d2c/d35/f78 d2/d2a/d2c/d35/d59/d4f/d61/df2/ff7 0 2024-09-11T00:18:03.233 INFO:tasks.workunit.client.0.smithi078.stdout:2/890: creat d0/d1/d6f/d93/dc3/f126 x:0 0 0 2024-09-11T00:18:03.233 INFO:tasks.workunit.client.0.smithi078.stdout:2/891: fdatasync d0/dd7/f115 0 2024-09-11T00:18:03.234 INFO:tasks.workunit.client.0.smithi078.stdout:9/808: dwrite dc/d12/d46/d51/fc1 [0,4194304] 0 2024-09-11T00:18:03.236 INFO:tasks.workunit.client.0.smithi078.stdout:5/705: unlink d7/d8/d47/c4c 0 2024-09-11T00:18:03.237 INFO:tasks.workunit.client.0.smithi078.stdout:6/811: dwrite d0/d1/d53/f88 [0,4194304] 0 2024-09-11T00:18:03.237 INFO:tasks.workunit.client.0.smithi078.stdout:6/812: stat d0/d1/d9/f15 0 2024-09-11T00:18:03.237 INFO:tasks.workunit.client.0.smithi078.stdout:0/748: rmdir d2/d2a/d2c/d35/d71/da7 39 2024-09-11T00:18:03.239 INFO:tasks.workunit.client.0.smithi078.stdout:7/756: sync 2024-09-11T00:18:03.239 INFO:tasks.workunit.client.0.smithi078.stdout:2/892: rename d0/d1/d11/d1b/fdf to d0/d19/dd0/f127 0 2024-09-11T00:18:03.242 INFO:tasks.workunit.client.0.smithi078.stdout:9/809: truncate dc/d12/d20/d58/d5b/dbb/f66 3483972 0 2024-09-11T00:18:03.242 INFO:tasks.workunit.client.0.smithi078.stdout:9/810: chown dc/d12/d54/d83/dc8/lff 19694596 1 2024-09-11T00:18:03.242 INFO:tasks.workunit.client.0.smithi078.stdout:2/893: read d0/d19/d3d/f62 [452370,64795] 0 2024-09-11T00:18:03.243 INFO:tasks.workunit.client.0.smithi078.stdout:2/894: fsync d0/d19/f5d 0 2024-09-11T00:18:03.245 INFO:tasks.workunit.client.0.smithi078.stdout:0/749: rmdir d2/d2a/d2c/d35/d59/d4f 39 2024-09-11T00:18:03.246 INFO:tasks.workunit.client.0.smithi078.stdout:7/757: creat d0/d34/db/d30/d1d/d14/d87/fe6 x:0 0 0 2024-09-11T00:18:03.246 INFO:tasks.workunit.client.0.smithi078.stdout:7/758: write d0/d34/db/d30/d1d/d81/f8f [794490,64485] 0 2024-09-11T00:18:03.248 INFO:tasks.workunit.client.0.smithi078.stdout:9/811: creat dc/d12/d20/d50/dbc/dcf/f114 x:0 0 0 2024-09-11T00:18:03.252 INFO:tasks.workunit.client.0.smithi078.stdout:2/895: unlink d0/d1/d11/d1b/l76 0 2024-09-11T00:18:03.252 INFO:tasks.workunit.client.0.smithi078.stdout:7/759: symlink d0/d34/db/d30/d1d/d14/d87/le7 0 2024-09-11T00:18:03.253 INFO:tasks.workunit.client.0.smithi078.stdout:9/812: getdents dc/d12/d54/d83/dc8 0 2024-09-11T00:18:03.253 INFO:tasks.workunit.client.0.smithi078.stdout:9/813: write dc/d12/d20/f61 [84630,106048] 0 2024-09-11T00:18:03.255 INFO:tasks.workunit.client.0.smithi078.stdout:2/896: mkdir d0/d19/d128 0 2024-09-11T00:18:03.255 INFO:tasks.workunit.client.0.smithi078.stdout:3/834: sync 2024-09-11T00:18:03.255 INFO:tasks.workunit.client.0.smithi078.stdout:3/835: readlink d0/d7/d46/d86/ld6 0 2024-09-11T00:18:03.255 INFO:tasks.workunit.client.0.smithi078.stdout:7/760: creat d0/d34/db/d30/d28/dc4/fe8 x:0 0 0 2024-09-11T00:18:03.257 INFO:tasks.workunit.client.0.smithi078.stdout:9/814: mkdir dc/d12/d54/de7/d115 0 2024-09-11T00:18:03.257 INFO:tasks.workunit.client.0.smithi078.stdout:9/815: chown dc/d12/d20/d50/dbc/dcf/de1/d3e/l4a 198 1 2024-09-11T00:18:03.257 INFO:tasks.workunit.client.0.smithi078.stdout:3/836: dread d0/d7/d18/d8c/f9c [0,4194304] 0 2024-09-11T00:18:03.257 INFO:tasks.workunit.client.0.smithi078.stdout:3/837: chown d0/d7/d23/d91/fa7 10203538 1 2024-09-11T00:18:03.257 INFO:tasks.workunit.client.0.smithi078.stdout:3/838: write d0/d1a/d77/fd2 [4574600,112262] 0 2024-09-11T00:18:03.258 INFO:tasks.workunit.client.0.smithi078.stdout:7/761: creat d0/da7/fe9 x:0 0 0 2024-09-11T00:18:03.258 INFO:tasks.workunit.client.0.smithi078.stdout:9/816: mknod dc/d12/d54/de7/c116 0 2024-09-11T00:18:03.259 INFO:tasks.workunit.client.0.smithi078.stdout:7/762: getdents d0/d34/d86 0 2024-09-11T00:18:03.259 INFO:tasks.workunit.client.0.smithi078.stdout:7/763: dread - d0/d34/db/d30/d1d/d14/d45/f7f zero size 2024-09-11T00:18:03.259 INFO:tasks.workunit.client.0.smithi078.stdout:2/897: dread d0/d1/d3b/f11c [0,4194304] 0 2024-09-11T00:18:03.262 INFO:tasks.workunit.client.0.smithi078.stdout:9/817: dread dc/d12/d20/d58/d5b/d68/f10a [0,4194304] 0 2024-09-11T00:18:03.263 INFO:tasks.workunit.client.0.smithi078.stdout:3/839: dread d0/f2 [0,4194304] 0 2024-09-11T00:18:03.263 INFO:tasks.workunit.client.0.smithi078.stdout:3/840: chown d0/d1a/d77/le4 2 1 2024-09-11T00:18:03.264 INFO:tasks.workunit.client.0.smithi078.stdout:6/813: dwrite d0/f61 [0,4194304] 0 2024-09-11T00:18:03.264 INFO:tasks.workunit.client.0.smithi078.stdout:9/818: mkdir dc/d12/d20/d30/d117 0 2024-09-11T00:18:03.264 INFO:tasks.workunit.client.0.smithi078.stdout:5/706: dwrite d7/d8/fe1 [0,4194304] 0 2024-09-11T00:18:03.264 INFO:tasks.workunit.client.0.smithi078.stdout:0/750: dwrite d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/fe1 [0,4194304] 0 2024-09-11T00:18:03.264 INFO:tasks.workunit.client.0.smithi078.stdout:9/819: dread - dc/d12/d20/d58/f71 zero size 2024-09-11T00:18:03.264 INFO:tasks.workunit.client.0.smithi078.stdout:2/898: dread d0/d1/d6/d52/da8/fe8 [0,4194304] 0 2024-09-11T00:18:03.264 INFO:tasks.workunit.client.0.smithi078.stdout:5/707: write d7/d8/d33/d22/dd9/ddf/dc5/dc8/f75 [1808676,80956] 0 2024-09-11T00:18:03.264 INFO:tasks.workunit.client.0.smithi078.stdout:2/899: readlink d0/d1/d6/d52/la0 0 2024-09-11T00:18:03.265 INFO:tasks.workunit.client.0.smithi078.stdout:7/764: dread d0/d3f/fd8 [0,4194304] 0 2024-09-11T00:18:03.265 INFO:tasks.workunit.client.0.smithi078.stdout:7/765: chown d0/d34/d65/f83 4321969 1 2024-09-11T00:18:03.265 INFO:tasks.workunit.client.0.smithi078.stdout:7/766: write d0/d34/d65/f83 [3589154,80689] 0 2024-09-11T00:18:03.265 INFO:tasks.workunit.client.0.smithi078.stdout:3/841: creat d0/d7/d23/d7c/ffb x:0 0 0 2024-09-11T00:18:03.272 INFO:tasks.workunit.client.0.smithi078.stdout:6/814: mknod d0/d1/d53/d72/c10b 0 2024-09-11T00:18:03.273 INFO:tasks.workunit.client.0.smithi078.stdout:0/751: rmdir d2/d97 39 2024-09-11T00:18:03.274 INFO:tasks.workunit.client.0.smithi078.stdout:7/767: creat d0/da7/fea x:0 0 0 2024-09-11T00:18:03.276 INFO:tasks.workunit.client.0.smithi078.stdout:3/842: truncate d0/f8 926096 0 2024-09-11T00:18:03.283 INFO:tasks.workunit.client.0.smithi078.stdout:6/815: mkdir d0/d1/d9/d59/d74/d10c 0 2024-09-11T00:18:03.285 INFO:tasks.workunit.client.0.smithi078.stdout:7/768: creat d0/d34/db/d32/ddc/feb x:0 0 0 2024-09-11T00:18:03.290 INFO:tasks.workunit.client.0.smithi078.stdout:7/769: mkdir d0/dec 0 2024-09-11T00:18:03.290 INFO:tasks.workunit.client.0.smithi078.stdout:7/770: fdatasync d0/d34/db/f5c 0 2024-09-11T00:18:03.290 INFO:tasks.workunit.client.0.smithi078.stdout:5/708: dwrite d7/d8/de/d2c/fa6 [0,4194304] 0 2024-09-11T00:18:03.293 INFO:tasks.workunit.client.0.smithi078.stdout:5/709: unlink d7/d8/d33/d22/d25/db1/ff2 0 2024-09-11T00:18:03.294 INFO:tasks.workunit.client.0.smithi078.stdout:5/710: creat d7/d8/d33/d22/d25/d28/deb/ff3 x:0 0 0 2024-09-11T00:18:03.297 INFO:tasks.workunit.client.0.smithi078.stdout:5/711: symlink d7/d8/d33/d22/d25/d28/da8/lf4 0 2024-09-11T00:18:03.297 INFO:tasks.workunit.client.0.smithi078.stdout:2/900: dwrite d0/d67/f7a [0,4194304] 0 2024-09-11T00:18:03.298 INFO:tasks.workunit.client.0.smithi078.stdout:0/752: dwrite d2/d2a/d2c/d35/d59/d4f/d61/fcd [0,4194304] 0 2024-09-11T00:18:03.298 INFO:tasks.workunit.client.0.smithi078.stdout:5/712: truncate d7/d8/d33/d22/dd9/ddf/dc5/dc8/f5d 848113 0 2024-09-11T00:18:03.298 INFO:tasks.workunit.client.0.smithi078.stdout:7/771: write d0/f55 [762491,53077] 0 2024-09-11T00:18:03.298 INFO:tasks.workunit.client.0.smithi078.stdout:7/772: write d0/d34/db/d30/d1d/d14/d45/fe0 [591725,17861] 0 2024-09-11T00:18:03.301 INFO:tasks.workunit.client.0.smithi078.stdout:2/901: link d0/d1/d6/d52/ca1 d0/dd7/c129 0 2024-09-11T00:18:03.301 INFO:tasks.workunit.client.0.smithi078.stdout:3/843: dwrite d0/d7/d18/d8c/fee [0,4194304] 0 2024-09-11T00:18:03.302 INFO:tasks.workunit.client.0.smithi078.stdout:6/816: dwrite d0/fc5 [0,4194304] 0 2024-09-11T00:18:03.304 INFO:tasks.workunit.client.0.smithi078.stdout:0/753: getdents d2/d57 0 2024-09-11T00:18:03.304 INFO:tasks.workunit.client.0.smithi078.stdout:0/754: truncate d2/d2a/d2c/d35/d71/da7/fb0 774109 0 2024-09-11T00:18:03.305 INFO:tasks.workunit.client.0.smithi078.stdout:0/755: dread d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/f60 [0,4194304] 0 2024-09-11T00:18:03.305 INFO:tasks.workunit.client.0.smithi078.stdout:0/756: chown d2/lea 1983 1 2024-09-11T00:18:03.307 INFO:tasks.workunit.client.0.smithi078.stdout:5/713: unlink d7/d8/de/d2c/d62/l6d 0 2024-09-11T00:18:03.310 INFO:tasks.workunit.client.0.smithi078.stdout:3/844: write d0/f3c [2023669,82813] 0 2024-09-11T00:18:03.310 INFO:tasks.workunit.client.0.smithi078.stdout:3/845: stat d0/d39/f88 0 2024-09-11T00:18:03.310 INFO:tasks.workunit.client.0.smithi078.stdout:7/773: rename d0/d34/d86/c95 to d0/d34/db/d30/d1d/db0/dd2/ced 0 2024-09-11T00:18:03.311 INFO:tasks.workunit.client.0.smithi078.stdout:0/757: dread d2/d2a/d2c/d5e/f68 [0,4194304] 0 2024-09-11T00:18:03.311 INFO:tasks.workunit.client.0.smithi078.stdout:2/902: creat d0/d1/d6f/f12a x:0 0 0 2024-09-11T00:18:03.316 INFO:tasks.workunit.client.0.smithi078.stdout:6/817: mknod d0/d66/c10d 0 2024-09-11T00:18:03.319 INFO:tasks.workunit.client.0.smithi078.stdout:5/714: mknod d7/d8/d33/d22/d25/d28/d24/d1c/d1e/cf5 0 2024-09-11T00:18:03.320 INFO:tasks.workunit.client.0.smithi078.stdout:6/818: dread d0/f61 [0,4194304] 0 2024-09-11T00:18:03.320 INFO:tasks.workunit.client.0.smithi078.stdout:6/819: chown d0/c42 396 1 2024-09-11T00:18:03.321 INFO:tasks.workunit.client.0.smithi078.stdout:3/846: unlink d0/d7/d23/l2a 0 2024-09-11T00:18:03.323 INFO:tasks.workunit.client.0.smithi078.stdout:7/774: rename d0/lb1 to d0/d3f/lee 0 2024-09-11T00:18:03.323 INFO:tasks.workunit.client.0.smithi078.stdout:7/775: write d0/da7/fe9 [321903,73739] 0 2024-09-11T00:18:03.323 INFO:tasks.workunit.client.0.smithi078.stdout:7/776: write d0/d34/f33 [63447,49801] 0 2024-09-11T00:18:03.323 INFO:tasks.workunit.client.0.smithi078.stdout:7/777: chown d0/d34/db/d30/d1d/d14/lbf 14572628 1 2024-09-11T00:18:03.323 INFO:tasks.workunit.client.0.smithi078.stdout:7/778: chown d0/d34/db/d30/d1d/d81/ce5 1685 1 2024-09-11T00:18:03.323 INFO:tasks.workunit.client.0.smithi078.stdout:7/779: chown d0/d34/db/l38 129964635 1 2024-09-11T00:18:03.324 INFO:tasks.workunit.client.0.smithi078.stdout:0/758: mkdir d2/d2a/d2c/d35/d59/dc7/df8 0 2024-09-11T00:18:03.328 INFO:tasks.workunit.client.0.smithi078.stdout:5/715: rename d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d8c/le0 to d7/d8/de/d2c/lf6 0 2024-09-11T00:18:03.330 INFO:tasks.workunit.client.0.smithi078.stdout:7/780: unlink d0/da7/fea 0 2024-09-11T00:18:03.330 INFO:tasks.workunit.client.0.smithi078.stdout:7/781: read - d0/d34/db/d32/ddc/feb zero size 2024-09-11T00:18:03.330 INFO:tasks.workunit.client.0.smithi078.stdout:7/782: chown d0/d34/db/d30 401 1 2024-09-11T00:18:03.330 INFO:tasks.workunit.client.0.smithi078.stdout:2/903: mknod d0/d1/d3b/c12b 0 2024-09-11T00:18:03.332 INFO:tasks.workunit.client.0.smithi078.stdout:0/759: rename d2/d2a/d2c/d35/d59/c3c to d2/d97/cf9 0 2024-09-11T00:18:03.332 INFO:tasks.workunit.client.0.smithi078.stdout:0/760: chown d2/d2a/d2c/d35/d59/de0 6 1 2024-09-11T00:18:03.332 INFO:tasks.workunit.client.0.smithi078.stdout:0/761: chown d2/c26 2 1 2024-09-11T00:18:03.335 INFO:tasks.workunit.client.0.smithi078.stdout:5/716: truncate d7/d8/f77 3668224 0 2024-09-11T00:18:03.336 INFO:tasks.workunit.client.0.smithi078.stdout:7/783: getdents d0/d3f 0 2024-09-11T00:18:03.338 INFO:tasks.workunit.client.0.smithi078.stdout:3/847: dwrite d0/d7/d18/d1b/d8e/fef [0,4194304] 0 2024-09-11T00:18:03.338 INFO:tasks.workunit.client.0.smithi078.stdout:0/762: dread d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/fe1 [0,4194304] 0 2024-09-11T00:18:03.344 INFO:tasks.workunit.client.0.smithi078.stdout:3/848: dread d0/d7/d23/d7c/fc3 [0,4194304] 0 2024-09-11T00:18:03.345 INFO:tasks.workunit.client.0.smithi078.stdout:3/849: getdents d0/d7/d18/d1b/d8e 0 2024-09-11T00:18:03.348 INFO:tasks.workunit.client.0.smithi078.stdout:3/850: creat d0/d7/d18/ffc x:0 0 0 2024-09-11T00:18:03.350 INFO:tasks.workunit.client.0.smithi078.stdout:0/763: dread d2/d2a/d2c/d35/d59/d4f/d61/fcd [0,4194304] 0 2024-09-11T00:18:03.350 INFO:tasks.workunit.client.0.smithi078.stdout:2/904: dwrite d0/d19/d3d/d8d/fc9 [0,4194304] 0 2024-09-11T00:18:03.350 INFO:tasks.workunit.client.0.smithi078.stdout:3/851: unlink d0/d7/d18/fbc 0 2024-09-11T00:18:03.350 INFO:tasks.workunit.client.0.smithi078.stdout:5/717: write d7/d8/d33/d22/d25/d28/d24/d1c/f2e [2189420,112492] 0 2024-09-11T00:18:03.352 INFO:tasks.workunit.client.0.smithi078.stdout:0/764: creat d2/d2a/d2c/d35/d59/d7/dd2/ffa x:0 0 0 2024-09-11T00:18:03.353 INFO:tasks.workunit.client.0.smithi078.stdout:3/852: write d0/d7/d18/d1b/f56 [1818728,77264] 0 2024-09-11T00:18:03.354 INFO:tasks.workunit.client.0.smithi078.stdout:7/784: dwrite d0/d34/db/d30/f3e [8388608,4194304] 0 2024-09-11T00:18:03.354 INFO:tasks.workunit.client.0.smithi078.stdout:2/905: mkdir d0/d1/d11/d60/da2/d3a/d12c 0 2024-09-11T00:18:03.357 INFO:tasks.workunit.client.0.smithi078.stdout:2/906: mkdir d0/dd7/d12d 0 2024-09-11T00:18:03.360 INFO:tasks.workunit.client.0.smithi078.stdout:2/907: rmdir d0/d1/d8 39 2024-09-11T00:18:03.360 INFO:tasks.workunit.client.0.smithi078.stdout:2/908: chown d0/d19/d3d/f106 119574397 1 2024-09-11T00:18:03.360 INFO:tasks.workunit.client.0.smithi078.stdout:0/765: dread d2/d2a/d2c/d35/d59/d4f/d61/d8f/f9c [0,4194304] 0 2024-09-11T00:18:03.360 INFO:tasks.workunit.client.0.smithi078.stdout:0/766: chown d2/d2a/d2c/d35/d59/f47 6538 1 2024-09-11T00:18:03.360 INFO:tasks.workunit.client.0.smithi078.stdout:0/767: truncate d2/d2a/d2c/d35/d59/dc7/fc3 480397 0 2024-09-11T00:18:03.364 INFO:tasks.workunit.client.0.smithi078.stdout:5/718: write d7/d8/de/d2c/fa6 [3008314,109513] 0 2024-09-11T00:18:03.364 INFO:tasks.workunit.client.0.smithi078.stdout:5/719: fsync d7/d8/d33/d22/d25/db1/fed 0 2024-09-11T00:18:03.365 INFO:tasks.workunit.client.0.smithi078.stdout:0/768: unlink d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/la3 0 2024-09-11T00:18:03.366 INFO:tasks.workunit.client.0.smithi078.stdout:0/769: creat d2/d2a/d2c/d35/d59/dc7/df8/ffb x:0 0 0 2024-09-11T00:18:03.367 INFO:tasks.workunit.client.0.smithi078.stdout:5/720: chown d7/d8/d47/ddd 1454 1 2024-09-11T00:18:03.368 INFO:tasks.workunit.client.0.smithi078.stdout:0/770: creat d2/d57/ffc x:0 0 0 2024-09-11T00:18:03.368 INFO:tasks.workunit.client.0.smithi078.stdout:5/721: symlink d7/d8/de/d90/lf7 0 2024-09-11T00:18:03.370 INFO:tasks.workunit.client.0.smithi078.stdout:0/771: getdents d2/d2a/d2c/d35/d59/d7 0 2024-09-11T00:18:03.370 INFO:tasks.workunit.client.0.smithi078.stdout:0/772: write d2/d2a/d2c/d35/d59/d4f/d61/d69/f1a [2180892,96012] 0 2024-09-11T00:18:03.371 INFO:tasks.workunit.client.0.smithi078.stdout:5/722: dread d7/d8/d33/d22/dd9/ddf/dc5/dc8/f6f [0,4194304] 0 2024-09-11T00:18:03.372 INFO:tasks.workunit.client.0.smithi078.stdout:0/773: mkdir d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/dfd 0 2024-09-11T00:18:03.372 INFO:tasks.workunit.client.0.smithi078.stdout:0/774: read - d2/fe4 zero size 2024-09-11T00:18:03.373 INFO:tasks.workunit.client.0.smithi078.stdout:5/723: mknod d7/d8/d33/d22/d25/d28/da8/cf8 0 2024-09-11T00:18:03.374 INFO:tasks.workunit.client.0.smithi078.stdout:5/724: mknod d7/d8/d33/da7/cf9 0 2024-09-11T00:18:03.374 INFO:tasks.workunit.client.0.smithi078.stdout:3/853: dwrite d0/d7/d46/d86/d9a/fdd [0,4194304] 0 2024-09-11T00:18:03.374 INFO:tasks.workunit.client.0.smithi078.stdout:3/854: write d0/d39/fad [694224,66572] 0 2024-09-11T00:18:03.377 INFO:tasks.workunit.client.0.smithi078.stdout:5/725: link d7/d8/de/d2c/fa6 d7/d8/d47/d52/df0/ffa 0 2024-09-11T00:18:03.378 INFO:tasks.workunit.client.0.smithi078.stdout:5/726: creat d7/d8/d33/d22/dd9/ddf/dc5/dc8/d2a/dc7/ffb x:0 0 0 2024-09-11T00:18:03.380 INFO:tasks.workunit.client.0.smithi078.stdout:5/727: truncate d7/d8/d33/d22/d25/d28/da8/fe9 1426699 0 2024-09-11T00:18:03.381 INFO:tasks.workunit.client.0.smithi078.stdout:2/909: dwrite d0/d1/d6f/d93/dc3/f126 [0,4194304] 0 2024-09-11T00:18:03.383 INFO:tasks.workunit.client.0.smithi078.stdout:3/855: dread d0/d7/d46/d86/d9a/fdd [0,4194304] 0 2024-09-11T00:18:03.383 INFO:tasks.workunit.client.0.smithi078.stdout:2/910: unlink d0/d1/d3b/f84 0 2024-09-11T00:18:03.383 INFO:tasks.workunit.client.0.smithi078.stdout:3/856: write d0/d7/d23/d91/fa7 [687834,26493] 0 2024-09-11T00:18:03.383 INFO:tasks.workunit.client.0.smithi078.stdout:3/857: dread - d0/d39/fc1 zero size 2024-09-11T00:18:03.384 INFO:tasks.workunit.client.0.smithi078.stdout:0/775: dwrite d2/fda [0,4194304] 0 2024-09-11T00:18:03.384 INFO:tasks.workunit.client.0.smithi078.stdout:0/776: write d2/d2a/d2c/d35/d93/fb2 [4488239,100701] 0 2024-09-11T00:18:03.384 INFO:tasks.workunit.client.0.smithi078.stdout:3/858: mknod d0/d7/d18/d1b/d8e/daf/cfd 0 2024-09-11T00:18:03.385 INFO:tasks.workunit.client.0.smithi078.stdout:3/859: chown d0/d7/d18/dd8 1 1 2024-09-11T00:18:03.387 INFO:tasks.workunit.client.0.smithi078.stdout:5/728: dread d7/d8/d47/d52/fae [0,4194304] 0 2024-09-11T00:18:03.387 INFO:tasks.workunit.client.0.smithi078.stdout:5/729: write d7/d8/d47/d52/fae [1398229,21496] 0 2024-09-11T00:18:03.388 INFO:tasks.workunit.client.0.smithi078.stdout:0/777: rmdir d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/dbc 39 2024-09-11T00:18:03.389 INFO:tasks.workunit.client.0.smithi078.stdout:3/860: rmdir d0/d7/d18/d8c 39 2024-09-11T00:18:03.391 INFO:tasks.workunit.client.0.smithi078.stdout:2/911: dread d0/d19/f2c [0,4194304] 0 2024-09-11T00:18:03.391 INFO:tasks.workunit.client.0.smithi078.stdout:2/912: dread - d0/d1/d11/d60/da2/db0/ff3 zero size 2024-09-11T00:18:03.393 INFO:tasks.workunit.client.0.smithi078.stdout:2/913: truncate d0/d1/d11/d60/fa4 2456280 0 2024-09-11T00:18:03.398 INFO:tasks.workunit.client.0.smithi078.stdout:3/861: dread d0/d7/d18/d8c/fee [0,4194304] 0 2024-09-11T00:18:03.398 INFO:tasks.workunit.client.0.smithi078.stdout:5/730: dread d7/d8/d33/d22/d25/d28/d24/f4d [0,4194304] 0 2024-09-11T00:18:03.398 INFO:tasks.workunit.client.0.smithi078.stdout:3/862: getdents d0/d7/d46/d86/d9a/de9/df9 0 2024-09-11T00:18:03.400 INFO:tasks.workunit.client.0.smithi078.stdout:5/731: truncate d7/d8/de/d90/fbe 7515762 0 2024-09-11T00:18:03.400 INFO:tasks.workunit.client.0.smithi078.stdout:5/732: fdatasync d7/d8/d33/da7/fd1 0 2024-09-11T00:18:03.402 INFO:tasks.workunit.client.0.smithi078.stdout:2/914: dread d0/d1/d6f/fce [0,4194304] 0 2024-09-11T00:18:03.402 INFO:tasks.workunit.client.0.smithi078.stdout:0/778: write d2/fda [4046885,14022] 0 2024-09-11T00:18:03.402 INFO:tasks.workunit.client.0.smithi078.stdout:0/779: fsync d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/fef 0 2024-09-11T00:18:03.403 INFO:tasks.workunit.client.0.smithi078.stdout:2/915: symlink d0/d1/d11/d60/da2/d3a/d51/d97/dac/dfc/l12e 0 2024-09-11T00:18:03.404 INFO:tasks.workunit.client.0.smithi078.stdout:2/916: mkdir d0/d19/d128/d12f 0 2024-09-11T00:18:03.406 INFO:tasks.workunit.client.0.smithi078.stdout:2/917: link d0/d19/d3d/c10f d0/d19/d128/c130 0 2024-09-11T00:18:03.406 INFO:tasks.workunit.client.0.smithi078.stdout:2/918: truncate d0/d1/d11/d60/da2/fb3 4282660 0 2024-09-11T00:18:03.407 INFO:tasks.workunit.client.0.smithi078.stdout:2/919: truncate d0/d1/d8/f21 653488 0 2024-09-11T00:18:03.407 INFO:tasks.workunit.client.0.smithi078.stdout:0/780: truncate d2/d2a/d2c/d35/d59/dc7/fc3 425767 0 2024-09-11T00:18:03.409 INFO:tasks.workunit.client.0.smithi078.stdout:2/920: creat d0/d1/d11/d60/da2/d3a/d107/dcd/f131 x:0 0 0 2024-09-11T00:18:03.409 INFO:tasks.workunit.client.0.smithi078.stdout:5/733: dread d7/d8/de/d2c/f94 [0,4194304] 0 2024-09-11T00:18:03.411 INFO:tasks.workunit.client.0.smithi078.stdout:2/921: truncate d0/d1/d33/d5f/f73 1697364 0 2024-09-11T00:18:03.411 INFO:tasks.workunit.client.0.smithi078.stdout:2/922: chown d0/d1/d6/f87 22920 1 2024-09-11T00:18:03.412 INFO:tasks.workunit.client.0.smithi078.stdout:2/923: symlink d0/dd7/d12d/l132 0 2024-09-11T00:18:03.413 INFO:tasks.workunit.client.0.smithi078.stdout:2/924: chown d0/d1/d11/c22 114 1 2024-09-11T00:18:03.414 INFO:tasks.workunit.client.0.smithi078.stdout:2/925: mknod d0/d1/d11/d60/da2/d3a/d51/d97/dac/c133 0 2024-09-11T00:18:03.414 INFO:tasks.workunit.client.0.smithi078.stdout:3/863: dwrite d0/d7/fcf [0,4194304] 0 2024-09-11T00:18:03.414 INFO:tasks.workunit.client.0.smithi078.stdout:3/864: chown d0/d7/d46 45 1 2024-09-11T00:18:03.417 INFO:tasks.workunit.client.0.smithi078.stdout:2/926: creat d0/d67/f134 x:0 0 0 2024-09-11T00:18:03.417 INFO:tasks.workunit.client.0.smithi078.stdout:2/927: dread - d0/d1/d11/d60/da2/d3a/d107/dcd/f110 zero size 2024-09-11T00:18:03.418 INFO:tasks.workunit.client.0.smithi078.stdout:2/928: read - d0/d1/d3c/d40/d98/f10e zero size 2024-09-11T00:18:03.420 INFO:tasks.workunit.client.0.smithi078.stdout:2/929: rmdir d0/d1/d11/d60/da2/d38 39 2024-09-11T00:18:03.422 INFO:tasks.workunit.client.0.smithi078.stdout:2/930: unlink d0/d1/d11/d60/da2/d3a/d107/cf6 0 2024-09-11T00:18:03.422 INFO:tasks.workunit.client.0.smithi078.stdout:2/931: write d0/d1/d11/d60/da2/d3a/f4a [1732732,19256] 0 2024-09-11T00:18:03.422 INFO:tasks.workunit.client.0.smithi078.stdout:2/932: chown d0/d1/d11/c2a 16265611 1 2024-09-11T00:18:03.422 INFO:tasks.workunit.client.0.smithi078.stdout:2/933: chown d0/lf8 88589607 1 2024-09-11T00:18:03.429 INFO:tasks.workunit.client.0.smithi078.stdout:5/734: dwrite d7/d8/d33/d22/dd9/fe6 [0,4194304] 0 2024-09-11T00:18:03.429 INFO:tasks.workunit.client.0.smithi078.stdout:5/735: fdatasync d7/d8/d33/d22/d25/d28/fad 0 2024-09-11T00:18:03.432 INFO:tasks.workunit.client.0.smithi078.stdout:3/865: dwrite d0/d7/d18/d1b/d8e/fef [0,4194304] 0 2024-09-11T00:18:03.433 INFO:tasks.workunit.client.0.smithi078.stdout:5/736: mkdir d7/d8/de/dfc 0 2024-09-11T00:18:03.443 INFO:tasks.workunit.client.0.smithi078.stdout:2/934: dwrite d0/d1/d11/f2d [0,4194304] 0 2024-09-11T00:18:03.443 INFO:tasks.workunit.client.0.smithi078.stdout:2/935: truncate d0/d1/d11/d60/fa4 3502737 0 2024-09-11T00:18:03.445 INFO:tasks.workunit.client.0.smithi078.stdout:2/936: truncate d0/d1/f54 249284 0 2024-09-11T00:18:03.445 INFO:tasks.workunit.client.0.smithi078.stdout:2/937: dread - d0/d19/dd0/f127 zero size 2024-09-11T00:18:03.445 INFO:tasks.workunit.client.0.smithi078.stdout:2/938: chown d0/d1/d11/d60/da2/d3a/lc8 1669531 1 2024-09-11T00:18:03.445 INFO:tasks.workunit.client.0.smithi078.stdout:2/939: write d0/d1/d33/fb9 [563585,78612] 0 2024-09-11T00:18:03.447 INFO:tasks.workunit.client.0.smithi078.stdout:2/940: write d0/d1/d3b/f11c [682635,120353] 0 2024-09-11T00:18:03.448 INFO:tasks.workunit.client.0.smithi078.stdout:2/941: mknod d0/d1/d33/d86/db4/c135 0 2024-09-11T00:18:03.448 INFO:tasks.workunit.client.0.smithi078.stdout:2/942: stat d0/d1/d11/d60/da2/l92 0 2024-09-11T00:18:03.449 INFO:tasks.workunit.client.0.smithi078.stdout:5/737: dwrite d7/d8/d33/d22/d25/db1/fed [0,4194304] 0 2024-09-11T00:18:03.449 INFO:tasks.workunit.client.0.smithi078.stdout:5/738: truncate d7/d8/d33/d22/d25/d28/d24/d1c/f8a 4672874 0 2024-09-11T00:18:03.450 INFO:tasks.workunit.client.0.smithi078.stdout:2/943: symlink d0/d1/l136 0 2024-09-11T00:18:03.450 INFO:tasks.workunit.client.0.smithi078.stdout:2/944: read - d0/d1/d6f/d93/dc3/dc4/dd4/ff0 zero size 2024-09-11T00:18:03.450 INFO:tasks.workunit.client.0.smithi078.stdout:3/866: dwrite d0/d7/d18/fbb [0,4194304] 0 2024-09-11T00:18:03.452 INFO:tasks.workunit.client.0.smithi078.stdout:5/739: mknod d7/d8/d33/d22/d25/d28/cfd 0 2024-09-11T00:18:03.452 INFO:tasks.workunit.client.0.smithi078.stdout:5/740: readlink d7/d8/d33/d22/d25/d6a/dc0/lc6 0 2024-09-11T00:18:03.452 INFO:tasks.workunit.client.0.smithi078.stdout:2/945: mkdir d0/d1/d11/d60/da2/d3a/d51/d97/dbd/d137 0 2024-09-11T00:18:03.455 INFO:tasks.workunit.client.0.smithi078.stdout:3/867: mkdir d0/d7/d23/d7c/db7/de8/dfe 0 2024-09-11T00:18:03.456 INFO:tasks.workunit.client.0.smithi078.stdout:5/741: creat d7/d8/de/d2c/d62/ffe x:0 0 0 2024-09-11T00:18:03.457 INFO:tasks.workunit.client.0.smithi078.stdout:2/946: creat d0/d19/f138 x:0 0 0 2024-09-11T00:18:03.458 INFO:tasks.workunit.client.0.smithi078.stdout:3/868: rename d0/d7/d18/dd8/c7a to d0/d7/d46/d86/dea/cff 0 2024-09-11T00:18:03.459 INFO:tasks.workunit.client.0.smithi078.stdout:5/742: creat d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/fff x:0 0 0 2024-09-11T00:18:03.459 INFO:tasks.workunit.client.0.smithi078.stdout:5/743: fsync d7/d8/d33/f7e 0 2024-09-11T00:18:03.461 INFO:tasks.workunit.client.0.smithi078.stdout:3/869: unlink d0/d1a/cc2 0 2024-09-11T00:18:03.462 INFO:tasks.workunit.client.0.smithi078.stdout:5/744: creat d7/d8/d33/d22/dd9/ddf/dc5/dc8/f100 x:0 0 0 2024-09-11T00:18:03.462 INFO:tasks.workunit.client.0.smithi078.stdout:3/870: getdents d0/d7/d23/d7c/db7/de8 0 2024-09-11T00:18:03.464 INFO:tasks.workunit.client.0.smithi078.stdout:5/745: creat d7/d8/d47/d52/f101 x:0 0 0 2024-09-11T00:18:03.464 INFO:tasks.workunit.client.0.smithi078.stdout:2/947: dread d0/d1/d33/d86/db4/fe5 [0,4194304] 0 2024-09-11T00:18:03.464 INFO:tasks.workunit.client.0.smithi078.stdout:2/948: dread - d0/d1/d3c/d40/d98/f10e zero size 2024-09-11T00:18:03.464 INFO:tasks.workunit.client.0.smithi078.stdout:2/949: fdatasync d0/fc 0 2024-09-11T00:18:03.465 INFO:tasks.workunit.client.0.smithi078.stdout:3/871: truncate d0/d7/f8b 22094 0 2024-09-11T00:18:03.466 INFO:tasks.workunit.client.0.smithi078.stdout:2/950: link d0/d1/d3b/c12b d0/d1/d11/d60/c139 0 2024-09-11T00:18:03.466 INFO:tasks.workunit.client.0.smithi078.stdout:2/951: dread - d0/d1/d3b/fde zero size 2024-09-11T00:18:03.466 INFO:tasks.workunit.client.0.smithi078.stdout:3/872: rmdir d0/d7/d46/d86 39 2024-09-11T00:18:03.466 INFO:tasks.workunit.client.0.smithi078.stdout:3/873: write d0/d39/fc1 [935714,77495] 0 2024-09-11T00:18:03.468 INFO:tasks.workunit.client.0.smithi078.stdout:5/746: rename d7/d8/d47/d66 to d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/de3/d102 0 2024-09-11T00:18:03.468 INFO:tasks.workunit.client.0.smithi078.stdout:5/747: stat d7/d8/d33/d22/d25/d28/d24 0 2024-09-11T00:18:03.470 INFO:tasks.workunit.client.0.smithi078.stdout:3/874: rmdir d0/d7/d46/d86 39 2024-09-11T00:18:03.472 INFO:tasks.workunit.client.0.smithi078.stdout:5/748: rmdir d7/d8/d33/d22/d25 39 2024-09-11T00:18:03.472 INFO:tasks.workunit.client.0.smithi078.stdout:2/952: dread d0/d1/d3c/f45 [0,4194304] 0 2024-09-11T00:18:03.472 INFO:tasks.workunit.client.0.smithi078.stdout:2/953: write d0/d1/d11/d60/da2/d38/f80 [82332,129560] 0 2024-09-11T00:18:03.473 INFO:tasks.workunit.client.0.smithi078.stdout:3/875: symlink d0/d7/d18/d8c/de3/l100 0 2024-09-11T00:18:03.473 INFO:tasks.workunit.client.0.smithi078.stdout:3/876: write d0/d7/d23/d7c/db7/fe1 [316556,37964] 0 2024-09-11T00:18:03.474 INFO:tasks.workunit.client.0.smithi078.stdout:3/877: dread - d0/d7/d23/d7c/ffb zero size 2024-09-11T00:18:03.474 INFO:tasks.workunit.client.0.smithi078.stdout:2/954: mknod d0/d1/d11/d60/da2/d3a/d51/d97/dbd/d137/c13a 0 2024-09-11T00:18:03.475 INFO:tasks.workunit.client.0.smithi078.stdout:5/749: mknod d7/d8/c103 0 2024-09-11T00:18:03.475 INFO:tasks.workunit.client.0.smithi078.stdout:5/750: getdents d7/d8/d33/d22/d25/d6a/dc0 0 2024-09-11T00:18:03.476 INFO:tasks.workunit.client.0.smithi078.stdout:3/878: mknod d0/d7/d23/d7c/db7/c101 0 2024-09-11T00:18:03.476 INFO:tasks.workunit.client.0.smithi078.stdout:2/955: mkdir d0/d1/d6f/d93/d13b 0 2024-09-11T00:18:03.484 INFO:tasks.workunit.client.0.smithi078.stdout:5/751: mkdir d7/d8/d33/d22/d25/d28/d24/d1c/d104 0 2024-09-11T00:18:03.485 INFO:tasks.workunit.client.0.smithi078.stdout:5/752: chown d7/d8/d33/d22/d25/d6a/dc0/lc6 2054945 1 2024-09-11T00:18:03.486 INFO:tasks.workunit.client.0.smithi078.stdout:3/879: read d0/d7/d46/f48 [146686,90150] 0 2024-09-11T00:18:03.486 INFO:tasks.workunit.client.0.smithi078.stdout:5/753: link d7/d8/d33/d22/dd9/ddf/dc5/dc8/d2a/dc7/ffb d7/d8/de/d90/f105 0 2024-09-11T00:18:03.487 INFO:tasks.workunit.client.0.smithi078.stdout:2/956: dwrite d0/d1/d11/d60/da2/d3a/d123/fa9 [0,4194304] 0 2024-09-11T00:18:03.488 INFO:tasks.workunit.client.0.smithi078.stdout:3/880: unlink d0/d7/d18/d1b/l68 0 2024-09-11T00:18:03.489 INFO:tasks.workunit.client.0.smithi078.stdout:5/754: mkdir d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d106 0 2024-09-11T00:18:03.492 INFO:tasks.workunit.client.0.smithi078.stdout:3/881: rename d0/d7/d18/dd8/fd1 to d0/d7/d18/dd8/d60/f102 0 2024-09-11T00:18:03.493 INFO:tasks.workunit.client.0.smithi078.stdout:5/755: mknod d7/d8/de/d90/c107 0 2024-09-11T00:18:03.500 INFO:tasks.workunit.client.0.smithi078.stdout:2/957: dwrite d0/d1/d11/f69 [4194304,4194304] 0 2024-09-11T00:18:03.500 INFO:tasks.workunit.client.0.smithi078.stdout:2/958: readlink d0/d1/d11/d60/da2/d3a/lca 0 2024-09-11T00:18:03.503 INFO:tasks.workunit.client.0.smithi078.stdout:2/959: dread d0/d1/d3c/f45 [0,4194304] 0 2024-09-11T00:18:03.503 INFO:tasks.workunit.client.0.smithi078.stdout:2/960: truncate d0/d1/d33/d86/fc1 2756600 0 2024-09-11T00:18:03.504 INFO:tasks.workunit.client.0.smithi078.stdout:5/756: write d7/d8/d33/d22/f7a [507046,16317] 0 2024-09-11T00:18:03.511 INFO:tasks.workunit.client.0.smithi078.stdout:5/757: dread d7/d8/de/d2c/f94 [0,4194304] 0 2024-09-11T00:18:03.512 INFO:tasks.workunit.client.0.smithi078.stdout:5/758: write d7/d8/d33/d22/d25/d28/deb/fec [438631,115187] 0 2024-09-11T00:18:03.512 INFO:tasks.workunit.client.0.smithi078.stdout:3/882: dwrite d0/d39/fc1 [0,4194304] 0 2024-09-11T00:18:03.513 INFO:tasks.workunit.client.0.smithi078.stdout:5/759: dread d7/d8/d33/d22/dd9/ddf/dc5/dc8/f5d [0,4194304] 0 2024-09-11T00:18:03.515 INFO:tasks.workunit.client.0.smithi078.stdout:5/760: rename d7/d8/de to d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108 0 2024-09-11T00:18:03.516 INFO:tasks.workunit.client.0.smithi078.stdout:2/961: dwrite d0/d1/d8/f47 [0,4194304] 0 2024-09-11T00:18:03.517 INFO:tasks.workunit.client.0.smithi078.stdout:5/761: creat d7/d8/d33/d22/d25/d28/da8/f109 x:0 0 0 2024-09-11T00:18:03.519 INFO:tasks.workunit.client.0.smithi078.stdout:5/762: creat d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/f10a x:0 0 0 2024-09-11T00:18:03.519 INFO:tasks.workunit.client.0.smithi078.stdout:6/820: sync 2024-09-11T00:18:03.519 INFO:tasks.workunit.client.0.smithi078.stdout:9/820: sync 2024-09-11T00:18:03.519 INFO:tasks.workunit.client.0.smithi078.stdout:5/763: chown d7/d8/d33/d22/d25/d28/d24/d1c/d1e/fa2 46770 1 2024-09-11T00:18:03.520 INFO:tasks.workunit.client.0.smithi078.stdout:9/821: creat dc/d12/d20/d50/dbc/dd4/f118 x:0 0 0 2024-09-11T00:18:03.521 INFO:tasks.workunit.client.0.smithi078.stdout:6/821: symlink d0/d1/d9/d59/l10e 0 2024-09-11T00:18:03.521 INFO:tasks.workunit.client.0.smithi078.stdout:3/883: write d0/d7/d23/d7c/db7/de8/f3a [445672,29710] 0 2024-09-11T00:18:03.522 INFO:tasks.workunit.client.0.smithi078.stdout:5/764: creat d7/f10b x:0 0 0 2024-09-11T00:18:03.522 INFO:tasks.workunit.client.0.smithi078.stdout:0/781: sync 2024-09-11T00:18:03.522 INFO:tasks.workunit.client.0.smithi078.stdout:7/785: sync 2024-09-11T00:18:03.523 INFO:tasks.workunit.client.0.smithi078.stdout:9/822: getdents dc/d12/d20/d50/dbc 0 2024-09-11T00:18:03.523 INFO:tasks.workunit.client.0.smithi078.stdout:9/823: readlink dc/d12/d54/l77 0 2024-09-11T00:18:03.527 INFO:tasks.workunit.client.0.smithi078.stdout:6/822: getdents d0/d1/d9/d54 0 2024-09-11T00:18:03.528 INFO:tasks.workunit.client.0.smithi078.stdout:5/765: creat d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/f10c x:0 0 0 2024-09-11T00:18:03.528 INFO:tasks.workunit.client.0.smithi078.stdout:7/786: symlink d0/d34/db/d32/lef 0 2024-09-11T00:18:03.529 INFO:tasks.workunit.client.0.smithi078.stdout:5/766: link d7/d8/d33/d22/dd9/ddf/dc5/dc8/f100 d7/d8/d33/d22/d25/d28/f10d 0 2024-09-11T00:18:03.529 INFO:tasks.workunit.client.0.smithi078.stdout:7/787: creat d0/d34/db/ff0 x:0 0 0 2024-09-11T00:18:03.531 INFO:tasks.workunit.client.0.smithi078.stdout:7/788: symlink d0/d34/db/d30/d1d/d14/d45/lf1 0 2024-09-11T00:18:03.549 INFO:tasks.workunit.client.0.smithi078.stdout:3/884: dwrite d0/d7/d18/d1b/d8e/fa3 [0,4194304] 0 2024-09-11T00:18:03.549 INFO:tasks.workunit.client.0.smithi078.stdout:3/885: write d0/d7/d23/d91/f59 [3451934,9230] 0 2024-09-11T00:18:03.549 INFO:tasks.workunit.client.0.smithi078.stdout:3/886: fsync d0/d7/d18/d1b/d8e/daf/ff6 0 2024-09-11T00:18:03.549 INFO:tasks.workunit.client.0.smithi078.stdout:6/823: dwrite d0/d1/f41 [0,4194304] 0 2024-09-11T00:18:03.552 INFO:tasks.workunit.client.0.smithi078.stdout:0/782: dwrite d2/d2a/d2c/d35/d59/d4f/f85 [0,4194304] 0 2024-09-11T00:18:03.552 INFO:tasks.workunit.client.0.smithi078.stdout:0/783: dread - d2/d2a/d2c/d35/d59/d4f/d61/d8f/fde zero size 2024-09-11T00:18:03.552 INFO:tasks.workunit.client.0.smithi078.stdout:0/784: write d2/d2a/d2c/d35/d59/d7/fd5 [4438103,7733] 0 2024-09-11T00:18:03.552 INFO:tasks.workunit.client.0.smithi078.stdout:5/767: dwrite d7/d8/d33/d22/dd9/ddf/dc5/dc8/fd6 [0,4194304] 0 2024-09-11T00:18:03.552 INFO:tasks.workunit.client.0.smithi078.stdout:5/768: dread - d7/d8/d33/d22/d25/d28/deb/ff3 zero size 2024-09-11T00:18:03.555 INFO:tasks.workunit.client.0.smithi078.stdout:9/824: dwrite dc/d12/d20/d58/d5b/d68/fb2 [0,4194304] 0 2024-09-11T00:18:03.555 INFO:tasks.workunit.client.0.smithi078.stdout:3/887: read d0/d7/d18/d1b/fbd [721633,53974] 0 2024-09-11T00:18:03.557 INFO:tasks.workunit.client.0.smithi078.stdout:0/785: truncate d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/fb3 3225316 0 2024-09-11T00:18:03.559 INFO:tasks.workunit.client.0.smithi078.stdout:0/786: creat d2/ffe x:0 0 0 2024-09-11T00:18:03.559 INFO:tasks.workunit.client.0.smithi078.stdout:0/787: write d2/fe4 [886904,38041] 0 2024-09-11T00:18:03.559 INFO:tasks.workunit.client.0.smithi078.stdout:0/788: fsync d2/d57/d8b/fc1 0 2024-09-11T00:18:03.560 INFO:tasks.workunit.client.0.smithi078.stdout:0/789: mknod d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/cff 0 2024-09-11T00:18:03.567 INFO:tasks.workunit.client.0.smithi078.stdout:5/769: dread d7/d8/d33/d22/d25/d6a/db0/fc9 [0,4194304] 0 2024-09-11T00:18:03.568 INFO:tasks.workunit.client.0.smithi078.stdout:6/824: dwrite d0/d1/d1b/f21 [0,4194304] 0 2024-09-11T00:18:03.569 INFO:tasks.workunit.client.0.smithi078.stdout:5/770: rename d7/d8/d33/d22/d25/d6a/db0 to d7/d8/d33/d22/d25/d28/d24/d1c/d10e 0 2024-09-11T00:18:03.571 INFO:tasks.workunit.client.0.smithi078.stdout:6/825: rename d0/d1/d53/d9c/db6/cfd to d0/d1/d9/d59/d74/db3/dd5/c10f 0 2024-09-11T00:18:03.573 INFO:tasks.workunit.client.0.smithi078.stdout:5/771: mkdir d7/d8/d33/d22/d10f 0 2024-09-11T00:18:03.574 INFO:tasks.workunit.client.0.smithi078.stdout:5/772: dread d7/d8/d33/d22/d25/d28/da8/fee [0,4194304] 0 2024-09-11T00:18:03.578 INFO:tasks.workunit.client.0.smithi078.stdout:9/825: dwrite dc/d12/fee [0,4194304] 0 2024-09-11T00:18:03.580 INFO:tasks.workunit.client.0.smithi078.stdout:9/826: rmdir dc/d12/d20/d50/dbc/dd4 39 2024-09-11T00:18:03.580 INFO:tasks.workunit.client.0.smithi078.stdout:9/827: chown dc/d12/d20/d58/d5b/dbb/f66 39100 1 2024-09-11T00:18:03.580 INFO:tasks.workunit.client.0.smithi078.stdout:9/828: dread - dc/d12/d20/d30/f9c zero size 2024-09-11T00:18:03.581 INFO:tasks.workunit.client.0.smithi078.stdout:9/829: symlink dc/d12/d54/de7/d103/l119 0 2024-09-11T00:18:03.581 INFO:tasks.workunit.client.0.smithi078.stdout:9/830: rename dc/d12/d46/d51/dcc to dc/d12/d46/d51/dcc/dce/d11a 22 2024-09-11T00:18:03.583 INFO:tasks.workunit.client.0.smithi078.stdout:9/831: rename dc/d12/d54/ff9 to dc/d12/d20/d58/f11b 0 2024-09-11T00:18:03.586 INFO:tasks.workunit.client.0.smithi078.stdout:9/832: creat dc/d12/d54/db4/f11c x:0 0 0 2024-09-11T00:18:03.586 INFO:tasks.workunit.client.0.smithi078.stdout:9/833: write dc/d12/d54/faa [790322,9817] 0 2024-09-11T00:18:03.587 INFO:tasks.workunit.client.0.smithi078.stdout:9/834: truncate dc/d12/d20/d58/d5b/f84 291630 0 2024-09-11T00:18:03.587 INFO:tasks.workunit.client.0.smithi078.stdout:0/790: dwrite d2/d2a/d2c/d35/d59/d7/f14 [0,4194304] 0 2024-09-11T00:18:03.588 INFO:tasks.workunit.client.0.smithi078.stdout:6/826: dread d0/d1/d9/d59/d74/f67 [0,4194304] 0 2024-09-11T00:18:03.588 INFO:tasks.workunit.client.0.smithi078.stdout:3/888: dwrite d0/d7/d18/dd8/f73 [0,4194304] 0 2024-09-11T00:18:03.588 INFO:tasks.workunit.client.0.smithi078.stdout:0/791: mknod d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/dfd/c100 0 2024-09-11T00:18:03.589 INFO:tasks.workunit.client.0.smithi078.stdout:0/792: dread - d2/d57/ffc zero size 2024-09-11T00:18:03.589 INFO:tasks.workunit.client.0.smithi078.stdout:6/827: mkdir d0/d1/d53/d9c/db6/de5/dec/d110 0 2024-09-11T00:18:03.589 INFO:tasks.workunit.client.0.smithi078.stdout:6/828: getdents d0/d1/d9/d59/d74/df0 0 2024-09-11T00:18:03.589 INFO:tasks.workunit.client.0.smithi078.stdout:6/829: readlink d0/d1/d53/d9c/la4 0 2024-09-11T00:18:03.590 INFO:tasks.workunit.client.0.smithi078.stdout:3/889: rmdir d0/d7/d18/d1b 39 2024-09-11T00:18:03.590 INFO:tasks.workunit.client.0.smithi078.stdout:3/890: truncate d0/d7/d23/d7c/f9d 301167 0 2024-09-11T00:18:03.592 INFO:tasks.workunit.client.0.smithi078.stdout:0/793: rename d2/d2a/d2c/d35/d59/d4f/d61/d69/c20 to d2/d2a/d2c/d35/c101 0 2024-09-11T00:18:03.592 INFO:tasks.workunit.client.0.smithi078.stdout:0/794: fsync d2/d2a/d2c/d35/d59/d4f/d61/d69/f31 0 2024-09-11T00:18:03.593 INFO:tasks.workunit.client.0.smithi078.stdout:6/830: mkdir d0/d1/d9/d59/d74/db3/dd5/d111 0 2024-09-11T00:18:03.594 INFO:tasks.workunit.client.0.smithi078.stdout:9/835: dread dc/d12/d20/d30/fa7 [0,4194304] 0 2024-09-11T00:18:03.594 INFO:tasks.workunit.client.0.smithi078.stdout:5/773: dwrite d7/d8/d33/d22/d25/d28/d24/f50 [0,4194304] 0 2024-09-11T00:18:03.598 INFO:tasks.workunit.client.0.smithi078.stdout:3/891: mkdir d0/d7/d18/d70/df5/d103 0 2024-09-11T00:18:03.598 INFO:tasks.workunit.client.0.smithi078.stdout:9/836: truncate dc/d12/d20/d50/db1/f108 3219228 0 2024-09-11T00:18:03.599 INFO:tasks.workunit.client.0.smithi078.stdout:5/774: getdents d7/d8/d47 0 2024-09-11T00:18:03.601 INFO:tasks.workunit.client.0.smithi078.stdout:6/831: dread d0/d1/d1b/f45 [0,4194304] 0 2024-09-11T00:18:03.601 INFO:tasks.workunit.client.0.smithi078.stdout:3/892: mknod d0/d7/d23/d7c/db7/de8/dfe/c104 0 2024-09-11T00:18:03.607 INFO:tasks.workunit.client.0.smithi078.stdout:0/795: dwrite d2/d57/f88 [0,4194304] 0 2024-09-11T00:18:03.607 INFO:tasks.workunit.client.0.smithi078.stdout:0/796: chown d2/d2a/d2c/d35/d59/d7/ca0 25010585 1 2024-09-11T00:18:03.607 INFO:tasks.workunit.client.0.smithi078.stdout:5/775: dread d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/f4a [0,4194304] 0 2024-09-11T00:18:03.608 INFO:tasks.workunit.client.0.smithi078.stdout:0/797: creat d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/f102 x:0 0 0 2024-09-11T00:18:03.609 INFO:tasks.workunit.client.0.smithi078.stdout:9/837: dread dc/d12/d20/d58/d5a/fb0 [0,4194304] 0 2024-09-11T00:18:03.609 INFO:tasks.workunit.client.0.smithi078.stdout:9/838: chown dc/d12/d20/d58/d5a/ff1 703 1 2024-09-11T00:18:03.609 INFO:tasks.workunit.client.0.smithi078.stdout:0/798: symlink d2/d2a/d2c/d35/d59/d4f/d61/d8f/l103 0 2024-09-11T00:18:03.612 INFO:tasks.workunit.client.0.smithi078.stdout:0/799: creat d2/d2a/d2c/d35/d59/dc7/f104 x:0 0 0 2024-09-11T00:18:03.612 INFO:tasks.workunit.client.0.smithi078.stdout:0/800: dread - d2/d57/fd4 zero size 2024-09-11T00:18:03.612 INFO:tasks.workunit.client.0.smithi078.stdout:0/801: chown d2/d57/ffc 9 1 2024-09-11T00:18:03.625 INFO:tasks.workunit.client.0.smithi078.stdout:3/893: dwrite d0/d7/d46/d86/fc9 [4194304,4194304] 0 2024-09-11T00:18:03.628 INFO:tasks.workunit.client.0.smithi078.stdout:3/894: dread d0/d7/f8b [0,4194304] 0 2024-09-11T00:18:03.631 INFO:tasks.workunit.client.0.smithi078.stdout:6/832: dwrite d0/d1/d1b/fae [0,4194304] 0 2024-09-11T00:18:03.633 INFO:tasks.workunit.client.0.smithi078.stdout:6/833: symlink d0/d1/d9/d59/da3/d107/dff/l112 0 2024-09-11T00:18:03.634 INFO:tasks.workunit.client.0.smithi078.stdout:6/834: creat d0/d1/d9/d59/d74/db3/dd5/d111/f113 x:0 0 0 2024-09-11T00:18:03.635 INFO:tasks.workunit.client.0.smithi078.stdout:6/835: mknod d0/d1/d9/c114 0 2024-09-11T00:18:03.636 INFO:tasks.workunit.client.0.smithi078.stdout:3/895: write d0/d7/d23/d91/f22 [7371195,130066] 0 2024-09-11T00:18:03.636 INFO:tasks.workunit.client.0.smithi078.stdout:3/896: dread - d0/d7/d18/ffc zero size 2024-09-11T00:18:03.636 INFO:tasks.workunit.client.0.smithi078.stdout:6/836: creat d0/d1/d9/d59/d74/f115 x:0 0 0 2024-09-11T00:18:03.636 INFO:tasks.workunit.client.0.smithi078.stdout:3/897: dread d0/d7/d23/d7c/f9d [0,4194304] 0 2024-09-11T00:18:03.638 INFO:tasks.workunit.client.0.smithi078.stdout:3/898: rename d0/d7/d23/d7c/db7/de8/c43 to d0/d7/d18/dd8/d60/c105 0 2024-09-11T00:18:03.638 INFO:tasks.workunit.client.0.smithi078.stdout:6/837: dread d0/f5a [0,4194304] 0 2024-09-11T00:18:03.639 INFO:tasks.workunit.client.0.smithi078.stdout:6/838: symlink d0/d1/d9/d59/d74/l116 0 2024-09-11T00:18:03.639 INFO:tasks.workunit.client.0.smithi078.stdout:6/839: fdatasync d0/d1/d53/d9c/dac/de3/f109 0 2024-09-11T00:18:03.639 INFO:tasks.workunit.client.0.smithi078.stdout:6/840: chown d0/d1/d9/d59/d74/fed 464 1 2024-09-11T00:18:03.640 INFO:tasks.workunit.client.0.smithi078.stdout:6/841: getdents d0/d66 0 2024-09-11T00:18:03.643 INFO:tasks.workunit.client.0.smithi078.stdout:0/802: dwrite d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/fee [0,4194304] 0 2024-09-11T00:18:03.643 INFO:tasks.workunit.client.0.smithi078.stdout:0/803: fsync d2/d2a/d2c/d35/d59/dc7/fe6 0 2024-09-11T00:18:03.643 INFO:tasks.workunit.client.0.smithi078.stdout:0/804: stat d2/d2a/d2c/d35/d59/d7/f3b 0 2024-09-11T00:18:03.643 INFO:tasks.workunit.client.0.smithi078.stdout:0/805: write d2/d2a/d2c/d35/d59/d4f/d61/d8f/fd0 [386205,93832] 0 2024-09-11T00:18:03.643 INFO:tasks.workunit.client.0.smithi078.stdout:3/899: write d0/d7/d18/dd8/d3e/f5d [130864,106010] 0 2024-09-11T00:18:03.647 INFO:tasks.workunit.client.0.smithi078.stdout:0/806: mknod d2/c105 0 2024-09-11T00:18:03.649 INFO:tasks.workunit.client.0.smithi078.stdout:6/842: dread d0/d1/d9/d59/d74/db3/dd5/f37 [0,4194304] 0 2024-09-11T00:18:03.649 INFO:tasks.workunit.client.0.smithi078.stdout:6/843: readlink d0/d1/d9/d17/d5e/l69 0 2024-09-11T00:18:03.649 INFO:tasks.workunit.client.0.smithi078.stdout:6/844: chown d0/d1/da8/fad 58 1 2024-09-11T00:18:03.670 INFO:tasks.workunit.client.0.smithi078.stdout:3/900: dwrite d0/d1a/d77/fd2 [4194304,4194304] 0 2024-09-11T00:18:03.670 INFO:tasks.workunit.client.0.smithi078.stdout:6/845: dwrite d0/d1/d9/d59/d74/f115 [0,4194304] 0 2024-09-11T00:18:03.672 INFO:tasks.workunit.client.0.smithi078.stdout:0/807: dwrite d2/d2a/d2c/d35/d93/fb2 [0,4194304] 0 2024-09-11T00:18:03.672 INFO:tasks.workunit.client.0.smithi078.stdout:3/901: creat d0/d1a/f106 x:0 0 0 2024-09-11T00:18:03.674 INFO:tasks.workunit.client.0.smithi078.stdout:0/808: mknod d2/d2a/d2c/d35/d59/dc7/c106 0 2024-09-11T00:18:03.676 INFO:tasks.workunit.client.0.smithi078.stdout:3/902: symlink d0/d7/d18/dd8/d3e/l107 0 2024-09-11T00:18:03.676 INFO:tasks.workunit.client.0.smithi078.stdout:3/903: truncate d0/d7/d23/d7c/fde 593463 0 2024-09-11T00:18:03.676 INFO:tasks.workunit.client.0.smithi078.stdout:6/846: write d0/d1/d9/d54/f6e [246892,122061] 0 2024-09-11T00:18:03.677 INFO:tasks.workunit.client.0.smithi078.stdout:0/809: mkdir d2/d57/d8b/d107 0 2024-09-11T00:18:03.679 INFO:tasks.workunit.client.0.smithi078.stdout:6/847: creat d0/d1/d53/d9c/db6/de5/dec/f117 x:0 0 0 2024-09-11T00:18:03.683 INFO:tasks.workunit.client.0.smithi078.stdout:6/848: dread d0/d1/f52 [0,4194304] 0 2024-09-11T00:18:03.683 INFO:tasks.workunit.client.0.smithi078.stdout:6/849: chown d0/l27 324351701 1 2024-09-11T00:18:03.684 INFO:tasks.workunit.client.0.smithi078.stdout:6/850: creat d0/d66/f118 x:0 0 0 2024-09-11T00:18:03.686 INFO:tasks.workunit.client.0.smithi078.stdout:6/851: mknod d0/d1/d9/d59/d74/d6b/c119 0 2024-09-11T00:18:03.686 INFO:tasks.workunit.client.0.smithi078.stdout:6/852: write d0/d66/f118 [989032,58639] 0 2024-09-11T00:18:03.691 INFO:tasks.workunit.client.0.smithi078.stdout:6/853: dread d0/d1/d9/d59/d74/f86 [0,4194304] 0 2024-09-11T00:18:03.692 INFO:tasks.workunit.client.0.smithi078.stdout:6/854: rmdir d0/d66/da5 39 2024-09-11T00:18:03.692 INFO:tasks.workunit.client.0.smithi078.stdout:6/855: readlink d0/l12 0 2024-09-11T00:18:03.693 INFO:tasks.workunit.client.0.smithi078.stdout:6/856: creat d0/d1/d53/d9c/dac/f11a x:0 0 0 2024-09-11T00:18:03.694 INFO:tasks.workunit.client.0.smithi078.stdout:6/857: rename d0/c6f to d0/d1/d1b/c11b 0 2024-09-11T00:18:03.694 INFO:tasks.workunit.client.0.smithi078.stdout:6/858: fsync d0/d1/d53/d9c/dac/de3/fef 0 2024-09-11T00:18:03.696 INFO:tasks.workunit.client.0.smithi078.stdout:6/859: unlink d0/d1/d53/d9c/lbd 0 2024-09-11T00:18:03.696 INFO:tasks.workunit.client.0.smithi078.stdout:6/860: chown d0/d66/caf 1465129 1 2024-09-11T00:18:03.696 INFO:tasks.workunit.client.0.smithi078.stdout:3/904: dwrite d0/d7/d23/d91/fa9 [0,4194304] 0 2024-09-11T00:18:03.696 INFO:tasks.workunit.client.0.smithi078.stdout:0/810: dwrite d2/d57/fd4 [0,4194304] 0 2024-09-11T00:18:03.697 INFO:tasks.workunit.client.0.smithi078.stdout:6/861: mknod d0/d1/d9/d59/da3/c11c 0 2024-09-11T00:18:03.698 INFO:tasks.workunit.client.0.smithi078.stdout:3/905: mknod d0/d7/d23/d7c/db7/c108 0 2024-09-11T00:18:03.698 INFO:tasks.workunit.client.0.smithi078.stdout:3/906: fdatasync d0/d7/d18/dd8/f49 0 2024-09-11T00:18:03.709 INFO:tasks.workunit.client.0.smithi078.stdout:0/811: rename d2/d2a/d2c/c41 to d2/d2a/d2c/d35/d93/c108 0 2024-09-11T00:18:03.711 INFO:tasks.workunit.client.0.smithi078.stdout:6/862: mkdir d0/d1/d9/d59/da3/d107/dff/d11d 0 2024-09-11T00:18:03.711 INFO:tasks.workunit.client.0.smithi078.stdout:3/907: getdents d0/d7/d23/d7c/db7/de8 0 2024-09-11T00:18:03.712 INFO:tasks.workunit.client.0.smithi078.stdout:0/812: symlink d2/d2a/l109 0 2024-09-11T00:18:03.713 INFO:tasks.workunit.client.0.smithi078.stdout:6/863: creat d0/d1/d9/d17/f11e x:0 0 0 2024-09-11T00:18:03.714 INFO:tasks.workunit.client.0.smithi078.stdout:3/908: creat d0/d1a/d77/f109 x:0 0 0 2024-09-11T00:18:03.715 INFO:tasks.workunit.client.0.smithi078.stdout:6/864: dread d0/d1/f71 [0,4194304] 0 2024-09-11T00:18:03.715 INFO:tasks.workunit.client.0.smithi078.stdout:2/962: sync 2024-09-11T00:18:03.716 INFO:tasks.workunit.client.0.smithi078.stdout:7/789: sync 2024-09-11T00:18:03.716 INFO:tasks.workunit.client.0.smithi078.stdout:7/790: mkdir d0/d34/df2 0 2024-09-11T00:18:03.716 INFO:tasks.workunit.client.0.smithi078.stdout:7/791: chown d0/d34/db/d30/d1d/lb6 8 1 2024-09-11T00:18:03.717 INFO:tasks.workunit.client.0.smithi078.stdout:7/792: rename d0/d34/d86/ce4 to d0/d34/db/d30/d28/dc4/cf3 0 2024-09-11T00:18:03.719 INFO:tasks.workunit.client.0.smithi078.stdout:7/793: unlink d0/l4a 0 2024-09-11T00:18:03.719 INFO:tasks.workunit.client.0.smithi078.stdout:0/813: dread d2/f8d [0,4194304] 0 2024-09-11T00:18:03.720 INFO:tasks.workunit.client.0.smithi078.stdout:7/794: link d0/da7/fbe d0/d34/db/d32/ff4 0 2024-09-11T00:18:03.721 INFO:tasks.workunit.client.0.smithi078.stdout:0/814: unlink d2/d2a/f6b 0 2024-09-11T00:18:03.723 INFO:tasks.workunit.client.0.smithi078.stdout:0/815: symlink d2/d2a/d2c/d5e/l10a 0 2024-09-11T00:18:03.725 INFO:tasks.workunit.client.0.smithi078.stdout:0/816: link d2/d2a/d2c/d35/d71/f83 d2/d2a/d2c/d35/d59/d4f/d61/d8f/f10b 0 2024-09-11T00:18:03.726 INFO:tasks.workunit.client.0.smithi078.stdout:6/865: write d0/d1/d1b/fae [1615921,64293] 0 2024-09-11T00:18:03.726 INFO:tasks.workunit.client.0.smithi078.stdout:6/866: dread - d0/d1/f75 zero size 2024-09-11T00:18:03.727 INFO:tasks.workunit.client.0.smithi078.stdout:0/817: creat d2/d2a/d2c/d35/d71/da7/f10c x:0 0 0 2024-09-11T00:18:03.728 INFO:tasks.workunit.client.0.smithi078.stdout:6/867: rename d0/f31 to d0/d1/d53/d9c/dac/de3/f11f 0 2024-09-11T00:18:03.728 INFO:tasks.workunit.client.0.smithi078.stdout:6/868: chown d0/d1/f52 148 1 2024-09-11T00:18:03.728 INFO:tasks.workunit.client.0.smithi078.stdout:0/818: mknod d2/d2a/d2c/c10d 0 2024-09-11T00:18:03.728 INFO:tasks.workunit.client.0.smithi078.stdout:0/819: stat d2/d2a/d2c/d35/d59/d4f/d61/d69 0 2024-09-11T00:18:03.729 INFO:tasks.workunit.client.0.smithi078.stdout:6/869: symlink d0/d1/d9/d59/d74/d6b/l120 0 2024-09-11T00:18:03.729 INFO:tasks.workunit.client.0.smithi078.stdout:0/820: creat d2/d2a/d2c/d35/d59/f10e x:0 0 0 2024-09-11T00:18:03.730 INFO:tasks.workunit.client.0.smithi078.stdout:6/870: dread d0/f68 [0,4194304] 0 2024-09-11T00:18:03.730 INFO:tasks.workunit.client.0.smithi078.stdout:0/821: creat d2/d2a/d2c/d5e/f10f x:0 0 0 2024-09-11T00:18:03.731 INFO:tasks.workunit.client.0.smithi078.stdout:0/822: read - d2/d2a/d2c/d35/f79 zero size 2024-09-11T00:18:03.731 INFO:tasks.workunit.client.0.smithi078.stdout:6/871: mkdir d0/d1/da8/d121 0 2024-09-11T00:18:03.732 INFO:tasks.workunit.client.0.smithi078.stdout:6/872: mknod d0/d1/d9/d59/d74/db3/dd5/c122 0 2024-09-11T00:18:03.732 INFO:tasks.workunit.client.0.smithi078.stdout:6/873: dread - d0/d1/d53/d72/dcc/fe7 zero size 2024-09-11T00:18:03.732 INFO:tasks.workunit.client.0.smithi078.stdout:6/874: symlink d0/d1/d9/d59/d74/l123 0 2024-09-11T00:18:03.733 INFO:tasks.workunit.client.0.smithi078.stdout:6/875: fsync d0/d1/d53/d9c/db6/ffa 0 2024-09-11T00:18:03.733 INFO:tasks.workunit.client.0.smithi078.stdout:6/876: chown d0/d1/d9/d59/d74/l93 34846 1 2024-09-11T00:18:03.736 INFO:tasks.workunit.client.0.smithi078.stdout:3/909: dwrite d0/f2 [0,4194304] 0 2024-09-11T00:18:03.738 INFO:tasks.workunit.client.0.smithi078.stdout:3/910: creat d0/d7/d18/d70/df5/f10a x:0 0 0 2024-09-11T00:18:03.738 INFO:tasks.workunit.client.0.smithi078.stdout:0/823: dread d2/d2a/d2c/d35/d59/d7/fa [4194304,4194304] 0 2024-09-11T00:18:03.739 INFO:tasks.workunit.client.0.smithi078.stdout:0/824: write d2/d2a/d2c/d35/d59/d7/f14 [5547998,105025] 0 2024-09-11T00:18:03.739 INFO:tasks.workunit.client.0.smithi078.stdout:3/911: truncate d0/d1a/f52 2190582 0 2024-09-11T00:18:03.739 INFO:tasks.workunit.client.0.smithi078.stdout:3/912: readlink d0/d7/d18/d1b/l20 0 2024-09-11T00:18:03.740 INFO:tasks.workunit.client.0.smithi078.stdout:3/913: creat d0/d7/d18/dd8/f10b x:0 0 0 2024-09-11T00:18:03.743 INFO:tasks.workunit.client.0.smithi078.stdout:3/914: dread d0/d7/d23/d91/f85 [0,4194304] 0 2024-09-11T00:18:03.743 INFO:tasks.workunit.client.0.smithi078.stdout:3/915: dread - d0/d7/d18/d70/fda zero size 2024-09-11T00:18:03.748 INFO:tasks.workunit.client.0.smithi078.stdout:6/877: dwrite d0/d1/d53/d9c/dac/fb7 [0,4194304] 0 2024-09-11T00:18:03.754 INFO:tasks.workunit.client.0.smithi078.stdout:0/825: dwrite d2/d57/fd4 [4194304,4194304] 0 2024-09-11T00:18:03.761 INFO:tasks.workunit.client.0.smithi078.stdout:0/826: dread d2/d2a/d2c/d35/d93/fb2 [0,4194304] 0 2024-09-11T00:18:03.761 INFO:tasks.workunit.client.0.smithi078.stdout:0/827: dread - d2/d2a/d2c/d35/d59/f10e zero size 2024-09-11T00:18:03.761 INFO:tasks.workunit.client.0.smithi078.stdout:0/828: fsync d2/d2a/d2c/d35/d59/d7/fa 0 2024-09-11T00:18:03.762 INFO:tasks.workunit.client.0.smithi078.stdout:0/829: symlink d2/dbd/l110 0 2024-09-11T00:18:03.763 INFO:tasks.workunit.client.0.smithi078.stdout:0/830: unlink d2/d2a/d2c/d35/d59/d7/f15 0 2024-09-11T00:18:03.763 INFO:tasks.workunit.client.0.smithi078.stdout:6/878: dwrite d0/d1/d9/d8d/fde [0,4194304] 0 2024-09-11T00:18:03.763 INFO:tasks.workunit.client.0.smithi078.stdout:3/916: dwrite d0/d7/d23/d91/f28 [0,4194304] 0 2024-09-11T00:18:03.764 INFO:tasks.workunit.client.0.smithi078.stdout:0/831: rename d2/d2a/d2c/d35/d59/l62 to d2/d2a/d2c/d35/d59/dc7/df8/l111 0 2024-09-11T00:18:03.766 INFO:tasks.workunit.client.0.smithi078.stdout:6/879: creat d0/d1/d9/d17/d5e/f124 x:0 0 0 2024-09-11T00:18:03.766 INFO:tasks.workunit.client.0.smithi078.stdout:6/880: dread - d0/d1/d53/d9c/dac/ff2 zero size 2024-09-11T00:18:03.767 INFO:tasks.workunit.client.0.smithi078.stdout:3/917: creat d0/d1a/f10c x:0 0 0 2024-09-11T00:18:03.768 INFO:tasks.workunit.client.0.smithi078.stdout:6/881: mknod d0/d1/d53/d9c/db6/de5/c125 0 2024-09-11T00:18:03.768 INFO:tasks.workunit.client.0.smithi078.stdout:6/882: readlink d0/d1/d53/d9c/la4 0 2024-09-11T00:18:03.769 INFO:tasks.workunit.client.0.smithi078.stdout:3/918: getdents d0/d7/d18/d1b/d8e/daf 0 2024-09-11T00:18:03.771 INFO:tasks.workunit.client.0.smithi078.stdout:0/832: write d2/d57/f7a [647176,108044] 0 2024-09-11T00:18:03.771 INFO:tasks.workunit.client.0.smithi078.stdout:0/833: stat d2/d2a/d2c/d35/d71 0 2024-09-11T00:18:03.772 INFO:tasks.workunit.client.0.smithi078.stdout:6/883: rename d0/d1/d9/d59/l10e to d0/d1/d53/d72/de4/l126 0 2024-09-11T00:18:03.772 INFO:tasks.workunit.client.0.smithi078.stdout:6/884: fsync d0/d1/d9/d54/f6e 0 2024-09-11T00:18:03.772 INFO:tasks.workunit.client.0.smithi078.stdout:6/885: chown d0/d1/d9/d59/da3/d107/dff/l10a 402 1 2024-09-11T00:18:03.773 INFO:tasks.workunit.client.0.smithi078.stdout:3/919: unlink d0/d1a/f10c 0 2024-09-11T00:18:03.774 INFO:tasks.workunit.client.0.smithi078.stdout:6/886: mknod d0/d1/d53/c127 0 2024-09-11T00:18:03.775 INFO:tasks.workunit.client.0.smithi078.stdout:6/887: creat d0/d1/da8/f128 x:0 0 0 2024-09-11T00:18:03.776 INFO:tasks.workunit.client.0.smithi078.stdout:6/888: creat d0/d1/d53/d9c/db6/de5/f129 x:0 0 0 2024-09-11T00:18:03.777 INFO:tasks.workunit.client.0.smithi078.stdout:0/834: write d2/d2a/d2c/d35/d59/d7/fd5 [4004865,35246] 0 2024-09-11T00:18:03.777 INFO:tasks.workunit.client.0.smithi078.stdout:0/835: chown d2/d2a/f2f 448 1 2024-09-11T00:18:03.777 INFO:tasks.workunit.client.0.smithi078.stdout:6/889: rename d0/d1/d53/d72/cd8 to d0/d1/d9/d8d/c12a 0 2024-09-11T00:18:03.778 INFO:tasks.workunit.client.0.smithi078.stdout:0/836: creat d2/d2a/d2c/d35/d59/d7/dd2/f112 x:0 0 0 2024-09-11T00:18:03.778 INFO:tasks.workunit.client.0.smithi078.stdout:0/837: chown d2/d2a/d2c/d35/d59/d7/f14 63214444 1 2024-09-11T00:18:03.778 INFO:tasks.workunit.client.0.smithi078.stdout:6/890: rmdir d0/d1/d53/d9c/dac 39 2024-09-11T00:18:03.779 INFO:tasks.workunit.client.0.smithi078.stdout:6/891: truncate d0/d1/d9/f24 3794916 0 2024-09-11T00:18:03.780 INFO:tasks.workunit.client.0.smithi078.stdout:6/892: mknod d0/d1/d53/d9c/db6/de5/c12b 0 2024-09-11T00:18:03.781 INFO:tasks.workunit.client.0.smithi078.stdout:6/893: symlink d0/d1/d9/d17/d5e/l12c 0 2024-09-11T00:18:03.781 INFO:tasks.workunit.client.0.smithi078.stdout:6/894: fdatasync d0/d1/d9/d59/fe6 0 2024-09-11T00:18:03.781 INFO:tasks.workunit.client.0.smithi078.stdout:6/895: fsync d0/d1/d9/d59/d74/db3/dd5/f8b 0 2024-09-11T00:18:03.782 INFO:tasks.workunit.client.0.smithi078.stdout:3/920: dread d0/d7/d18/d70/f76 [0,4194304] 0 2024-09-11T00:18:03.783 INFO:tasks.workunit.client.0.smithi078.stdout:3/921: chown d0/d7/d46/c89 0 1 2024-09-11T00:18:03.784 INFO:tasks.workunit.client.0.smithi078.stdout:3/922: mknod d0/d7/d18/d70/c10d 0 2024-09-11T00:18:03.785 INFO:tasks.workunit.client.0.smithi078.stdout:3/923: symlink d0/d7/d23/l10e 0 2024-09-11T00:18:03.785 INFO:tasks.workunit.client.0.smithi078.stdout:0/838: read d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/fee [136932,37654] 0 2024-09-11T00:18:03.786 INFO:tasks.workunit.client.0.smithi078.stdout:6/896: dread d0/d1/d9/d59/d74/db3/dd5/f3d [0,4194304] 0 2024-09-11T00:18:03.786 INFO:tasks.workunit.client.0.smithi078.stdout:6/897: write d0/d1/d9/d17/d5e/fc0 [373911,26842] 0 2024-09-11T00:18:03.786 INFO:tasks.workunit.client.0.smithi078.stdout:3/924: creat d0/d7/d46/d86/d9a/de9/df9/f10f x:0 0 0 2024-09-11T00:18:03.788 INFO:tasks.workunit.client.0.smithi078.stdout:3/925: dread d0/d7/d46/d86/d9a/fa2 [0,4194304] 0 2024-09-11T00:18:03.788 INFO:tasks.workunit.client.0.smithi078.stdout:3/926: chown d0/d7/d46/cc4 70 1 2024-09-11T00:18:03.788 INFO:tasks.workunit.client.0.smithi078.stdout:3/927: chown d0/d7/d46/d86/ccb 1288228 1 2024-09-11T00:18:03.788 INFO:tasks.workunit.client.0.smithi078.stdout:0/839: mknod d2/d2a/d2c/d35/daf/c113 0 2024-09-11T00:18:03.788 INFO:tasks.workunit.client.0.smithi078.stdout:6/898: readlink d0/d1/d9/d17/l25 0 2024-09-11T00:18:03.789 INFO:tasks.workunit.client.0.smithi078.stdout:0/840: getdents d2/dbd 0 2024-09-11T00:18:03.789 INFO:tasks.workunit.client.0.smithi078.stdout:0/841: chown d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/dbc/fe8 122094083 1 2024-09-11T00:18:03.791 INFO:tasks.workunit.client.0.smithi078.stdout:0/842: unlink d2/c26 0 2024-09-11T00:18:03.791 INFO:tasks.workunit.client.0.smithi078.stdout:0/843: dread - d2/d2a/d2c/d35/ff1 zero size 2024-09-11T00:18:03.791 INFO:tasks.workunit.client.0.smithi078.stdout:0/844: stat d2/d2a/d2c/d35/d59/d4f/d61/df2 0 2024-09-11T00:18:03.792 INFO:tasks.workunit.client.0.smithi078.stdout:6/899: dread d0/d1/d9/d59/d74/db3/dd5/f4f [0,4194304] 0 2024-09-11T00:18:03.792 INFO:tasks.workunit.client.0.smithi078.stdout:6/900: chown d0/d1/d9/d59/d74/db3/dd5/c122 53445 1 2024-09-11T00:18:03.792 INFO:tasks.workunit.client.0.smithi078.stdout:0/845: creat d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/dfd/f114 x:0 0 0 2024-09-11T00:18:03.794 INFO:tasks.workunit.client.0.smithi078.stdout:6/901: creat d0/d1/d53/d9c/db6/de5/f12d x:0 0 0 2024-09-11T00:18:03.794 INFO:tasks.workunit.client.0.smithi078.stdout:6/902: truncate d0/d1/d9/d17/d5e/f85 560196 0 2024-09-11T00:18:03.795 INFO:tasks.workunit.client.0.smithi078.stdout:0/846: link d2/d2a/d2c/d35/d59/f22 d2/d2a/d2c/d35/d59/d4f/d61/d8f/f115 0 2024-09-11T00:18:03.796 INFO:tasks.workunit.client.0.smithi078.stdout:0/847: getdents d2/d57 0 2024-09-11T00:18:03.797 INFO:tasks.workunit.client.0.smithi078.stdout:0/848: mkdir d2/d57/d8b/d107/d116 0 2024-09-11T00:18:03.798 INFO:tasks.workunit.client.0.smithi078.stdout:0/849: symlink d2/d2a/d2c/d35/l117 0 2024-09-11T00:18:03.798 INFO:tasks.workunit.client.0.smithi078.stdout:3/928: fsync d0/d7/d46/d86/d9a/de9/df9/f10f 0 2024-09-11T00:18:03.802 INFO:tasks.workunit.client.0.smithi078.stdout:6/903: write d0/d1/d53/fbb [1026589,28389] 0 2024-09-11T00:18:03.805 INFO:tasks.workunit.client.0.smithi078.stdout:3/929: dread d0/d7/d23/d7c/fc3 [0,4194304] 0 2024-09-11T00:18:03.808 INFO:tasks.workunit.client.0.smithi078.stdout:3/930: link d0/d7/d46/ld3 d0/d7/d46/d86/d9a/de9/df9/l110 0 2024-09-11T00:18:03.810 INFO:tasks.workunit.client.0.smithi078.stdout:3/931: creat d0/d7/d18/d70/df5/f111 x:0 0 0 2024-09-11T00:18:03.818 INFO:tasks.workunit.client.0.smithi078.stdout:3/932: dread d0/d39/f74 [0,4194304] 0 2024-09-11T00:18:03.818 INFO:tasks.workunit.client.0.smithi078.stdout:0/850: dwrite d2/d2a/d2c/d35/d59/d7/fa [4194304,4194304] 0 2024-09-11T00:18:03.819 INFO:tasks.workunit.client.0.smithi078.stdout:0/851: creat d2/d2a/d2c/d35/d59/d4f/d61/df2/f118 x:0 0 0 2024-09-11T00:18:03.820 INFO:tasks.workunit.client.0.smithi078.stdout:6/904: dwrite d0/d1/d53/d9c/dac/feb [0,4194304] 0 2024-09-11T00:18:03.820 INFO:tasks.workunit.client.0.smithi078.stdout:0/852: symlink d2/d2a/d2c/d35/d59/d4f/l119 0 2024-09-11T00:18:03.825 INFO:tasks.workunit.client.0.smithi078.stdout:9/839: sync 2024-09-11T00:18:03.825 INFO:tasks.workunit.client.0.smithi078.stdout:5/776: sync 2024-09-11T00:18:03.827 INFO:tasks.workunit.client.0.smithi078.stdout:9/840: link dc/d12/d54/d83/f107 dc/d12/d46/f11d 0 2024-09-11T00:18:03.827 INFO:tasks.workunit.client.0.smithi078.stdout:9/841: write fa [2060493,90521] 0 2024-09-11T00:18:03.828 INFO:tasks.workunit.client.0.smithi078.stdout:5/777: mknod d7/d8/d33/d22/d25/db1/c110 0 2024-09-11T00:18:03.828 INFO:tasks.workunit.client.0.smithi078.stdout:5/778: fdatasync d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/f10a 0 2024-09-11T00:18:03.829 INFO:tasks.workunit.client.0.smithi078.stdout:9/842: mkdir dc/d12/d20/d58/d5a/dc9/d11e 0 2024-09-11T00:18:03.829 INFO:tasks.workunit.client.0.smithi078.stdout:9/843: write dc/d12/d46/d51/dcc/dce/dfd/f111 [351285,109297] 0 2024-09-11T00:18:03.830 INFO:tasks.workunit.client.0.smithi078.stdout:5/779: truncate d7/d8/d33/d22/d25/d28/d24/f4d 2915985 0 2024-09-11T00:18:03.830 INFO:tasks.workunit.client.0.smithi078.stdout:9/844: mknod dc/d12/d20/d58/c11f 0 2024-09-11T00:18:03.831 INFO:tasks.workunit.client.0.smithi078.stdout:5/780: unlink d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d2c/fa6 0 2024-09-11T00:18:03.832 INFO:tasks.workunit.client.0.smithi078.stdout:0/853: dwrite d2/d2a/d2c/d35/d71/da7/fb0 [0,4194304] 0 2024-09-11T00:18:03.832 INFO:tasks.workunit.client.0.smithi078.stdout:9/845: mkdir dc/d12/d46/dfa/d120 0 2024-09-11T00:18:03.834 INFO:tasks.workunit.client.0.smithi078.stdout:5/781: link d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d2c/d62/ffe d7/d8/d33/d22/dd9/ddf/dc5/dc8/f111 0 2024-09-11T00:18:03.837 INFO:tasks.workunit.client.0.smithi078.stdout:0/854: rename d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/db7/fed to d2/d57/d8b/d107/d116/f11a 0 2024-09-11T00:18:03.838 INFO:tasks.workunit.client.0.smithi078.stdout:5/782: creat d7/d8/d33/d22/d25/d28/d24/d1c/f112 x:0 0 0 2024-09-11T00:18:03.842 INFO:tasks.workunit.client.0.smithi078.stdout:0/855: creat d2/d2a/d2c/d35/d59/f11b x:0 0 0 2024-09-11T00:18:03.842 INFO:tasks.workunit.client.0.smithi078.stdout:0/856: fsync d2/d2a/d2c/d35/ff1 0 2024-09-11T00:18:03.842 INFO:tasks.workunit.client.0.smithi078.stdout:9/846: dread dc/d12/d20/d50/dbc/dcf/de1/f3b [0,4194304] 0 2024-09-11T00:18:03.842 INFO:tasks.workunit.client.0.smithi078.stdout:5/783: creat d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/dd5/f113 x:0 0 0 2024-09-11T00:18:03.845 INFO:tasks.workunit.client.0.smithi078.stdout:9/847: creat dc/d12/d20/d58/f121 x:0 0 0 2024-09-11T00:18:03.847 INFO:tasks.workunit.client.0.smithi078.stdout:5/784: symlink d7/d8/d33/d22/d25/d28/da8/l114 0 2024-09-11T00:18:03.847 INFO:tasks.workunit.client.0.smithi078.stdout:9/848: creat dc/d12/d54/de7/df3/f122 x:0 0 0 2024-09-11T00:18:03.847 INFO:tasks.workunit.client.0.smithi078.stdout:9/849: dread - dc/d12/d46/d51/dcc/dce/f106 zero size 2024-09-11T00:18:03.847 INFO:tasks.workunit.client.0.smithi078.stdout:9/850: fdatasync dc/fe6 0 2024-09-11T00:18:03.847 INFO:tasks.workunit.client.0.smithi078.stdout:9/851: dread - dc/d12/d20/d58/f11b zero size 2024-09-11T00:18:03.849 INFO:tasks.workunit.client.0.smithi078.stdout:0/857: dread d2/d2a/d2c/d35/d59/f47 [0,4194304] 0 2024-09-11T00:18:03.859 INFO:tasks.workunit.client.0.smithi078.stdout:9/852: dwrite dc/d12/d20/d58/d5b/f84 [0,4194304] 0 2024-09-11T00:18:03.860 INFO:tasks.workunit.client.0.smithi078.stdout:9/853: mkdir dc/d12/d20/d50/dbc/dcf/de1/d123 0 2024-09-11T00:18:03.860 INFO:tasks.workunit.client.0.smithi078.stdout:9/854: getdents dc/d12/d54/de7 0 2024-09-11T00:18:03.860 INFO:tasks.workunit.client.0.smithi078.stdout:9/855: getdents dc/d12/d20/d30/d117 0 2024-09-11T00:18:03.861 INFO:tasks.workunit.client.0.smithi078.stdout:9/856: creat dc/d12/d46/d51/dcc/dce/dfd/f124 x:0 0 0 2024-09-11T00:18:03.861 INFO:tasks.workunit.client.0.smithi078.stdout:9/857: fdatasync dc/f38 0 2024-09-11T00:18:03.861 INFO:tasks.workunit.client.0.smithi078.stdout:9/858: stat dc/d12/d20/d30/d117 0 2024-09-11T00:18:03.862 INFO:tasks.workunit.client.0.smithi078.stdout:9/859: truncate dc/d12/d20/d58/f11b 771963 0 2024-09-11T00:18:03.862 INFO:tasks.workunit.client.0.smithi078.stdout:9/860: write dc/d12/d20/d58/f71 [557891,66922] 0 2024-09-11T00:18:03.862 INFO:tasks.workunit.client.0.smithi078.stdout:9/861: stat dc/d12/d20/d30/l105 0 2024-09-11T00:18:03.862 INFO:tasks.workunit.client.0.smithi078.stdout:0/858: write d2/d2a/d2c/d35/d59/d7/f14 [1168722,101880] 0 2024-09-11T00:18:03.862 INFO:tasks.workunit.client.0.smithi078.stdout:9/862: unlink dc/f29 0 2024-09-11T00:18:03.863 INFO:tasks.workunit.client.0.smithi078.stdout:0/859: mkdir d2/d2a/d2c/d35/d59/d7/d96/d11c 0 2024-09-11T00:18:03.863 INFO:tasks.workunit.client.0.smithi078.stdout:0/860: chown d2/f8d 390012312 1 2024-09-11T00:18:03.864 INFO:tasks.workunit.client.0.smithi078.stdout:9/863: link dc/d12/l34 dc/d12/d46/d51/dcc/dce/l125 0 2024-09-11T00:18:03.864 INFO:tasks.workunit.client.0.smithi078.stdout:9/864: mkdir dc/d12/d20/d58/d5b/dbb/d126 0 2024-09-11T00:18:03.865 INFO:tasks.workunit.client.0.smithi078.stdout:9/865: symlink dc/d12/d54/l127 0 2024-09-11T00:18:03.866 INFO:tasks.workunit.client.0.smithi078.stdout:0/861: dread d2/d2a/d2c/d35/d71/f8e [0,4194304] 0 2024-09-11T00:18:03.866 INFO:tasks.workunit.client.0.smithi078.stdout:0/862: mkdir d2/d11d 0 2024-09-11T00:18:03.867 INFO:tasks.workunit.client.0.smithi078.stdout:0/863: mknod d2/d2a/d2c/d5e/c11e 0 2024-09-11T00:18:03.867 INFO:tasks.workunit.client.0.smithi078.stdout:0/864: write d2/d2a/d2c/d35/f78 [442502,69022] 0 2024-09-11T00:18:03.869 INFO:tasks.workunit.client.0.smithi078.stdout:0/865: mknod d2/d2a/d2c/d35/d59/d7/d96/c11f 0 2024-09-11T00:18:03.869 INFO:tasks.workunit.client.0.smithi078.stdout:0/866: write d2/d2a/d2c/d35/d59/d7/f40 [3554839,57327] 0 2024-09-11T00:18:03.869 INFO:tasks.workunit.client.0.smithi078.stdout:0/867: fdatasync d2/d2a/d2c/d35/d59/d4f/d61/d69/f5c 0 2024-09-11T00:18:03.869 INFO:tasks.workunit.client.0.smithi078.stdout:0/868: chown d2/d2a/d2c/d5e/la8 1266527715 1 2024-09-11T00:18:03.869 INFO:tasks.workunit.client.0.smithi078.stdout:9/866: write dc/d12/d54/db4/fa1 [2303451,71037] 0 2024-09-11T00:18:03.870 INFO:tasks.workunit.client.0.smithi078.stdout:0/869: rename d2/d57/ffc to d2/dbd/f120 0 2024-09-11T00:18:03.870 INFO:tasks.workunit.client.0.smithi078.stdout:0/870: write d2/d2a/d2c/d35/d59/d4f/f85 [4225050,122499] 0 2024-09-11T00:18:03.870 INFO:tasks.workunit.client.0.smithi078.stdout:0/871: readlink d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/lb4 0 2024-09-11T00:18:03.870 INFO:tasks.workunit.client.0.smithi078.stdout:9/867: creat dc/d12/d20/d58/d5b/dbb/f128 x:0 0 0 2024-09-11T00:18:03.871 INFO:tasks.workunit.client.0.smithi078.stdout:0/872: creat d2/d2a/d2c/d5e/f121 x:0 0 0 2024-09-11T00:18:03.871 INFO:tasks.workunit.client.0.smithi078.stdout:0/873: getdents d2/d2a/d2c/d35/d59/de0 0 2024-09-11T00:18:03.879 INFO:tasks.workunit.client.0.smithi078.stdout:9/868: rename dc/d12/d20/d58/d5b to dc/d12/d20/d58/d5a/d101/d129 0 2024-09-11T00:18:03.880 INFO:tasks.workunit.client.0.smithi078.stdout:9/869: link dc/c112 dc/d12/d20/c12a 0 2024-09-11T00:18:03.881 INFO:tasks.workunit.client.0.smithi078.stdout:9/870: stat dc 0 2024-09-11T00:18:03.881 INFO:tasks.workunit.client.0.smithi078.stdout:0/874: rename d2/d2a/d2c/d35/d59/dc7/df8/ffb to d2/d2a/d2c/d35/daf/f122 0 2024-09-11T00:18:03.882 INFO:tasks.workunit.client.0.smithi078.stdout:9/871: mknod dc/d12/d54/c12b 0 2024-09-11T00:18:03.882 INFO:tasks.workunit.client.0.smithi078.stdout:0/875: mknod d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/c123 0 2024-09-11T00:18:03.883 INFO:tasks.workunit.client.0.smithi078.stdout:9/872: rmdir dc/d12/d54/d83/dc8 39 2024-09-11T00:18:03.883 INFO:tasks.workunit.client.0.smithi078.stdout:9/873: write dc/d12/d54/de7/df3/f122 [21419,31961] 0 2024-09-11T00:18:03.883 INFO:tasks.workunit.client.0.smithi078.stdout:9/874: dread - dc/d12/ff5 zero size 2024-09-11T00:18:03.883 INFO:tasks.workunit.client.0.smithi078.stdout:9/875: chown dc/d12/d20/c12a 5 1 2024-09-11T00:18:03.883 INFO:tasks.workunit.client.0.smithi078.stdout:9/876: dread - dc/d12/fb6 zero size 2024-09-11T00:18:03.891 INFO:tasks.workunit.client.0.smithi078.stdout:9/877: dread dc/d12/d46/d51/fc1 [0,4194304] 0 2024-09-11T00:18:03.891 INFO:tasks.workunit.client.0.smithi078.stdout:9/878: readlink dc/d12/d20/d50/dbc/dcf/de1/d3e/l4a 0 2024-09-11T00:18:03.892 INFO:tasks.workunit.client.0.smithi078.stdout:9/879: getdents dc/d12/d20/d58/d5a/dc9 0 2024-09-11T00:18:03.894 INFO:tasks.workunit.client.0.smithi078.stdout:9/880: rename dc/d12/d20/d58/d5a/d101/d129/d68 to dc/d12/d46/d51/dcc/dce/d12c 0 2024-09-11T00:18:03.895 INFO:tasks.workunit.client.0.smithi078.stdout:9/881: creat dc/d12/d54/d83/dc8/f12d x:0 0 0 2024-09-11T00:18:03.895 INFO:tasks.workunit.client.0.smithi078.stdout:9/882: write dc/d12/d20/d58/f121 [787037,79816] 0 2024-09-11T00:18:03.897 INFO:tasks.workunit.client.0.smithi078.stdout:9/883: symlink dc/d12/l12e 0 2024-09-11T00:18:03.899 INFO:tasks.workunit.client.0.smithi078.stdout:0/876: dwrite d2/d2a/d2c/d35/d59/d7/dd2/ffa [0,4194304] 0 2024-09-11T00:18:03.904 INFO:tasks.workunit.client.0.smithi078.stdout:9/884: read dc/d12/d20/d50/dbc/dcf/de1/f47 [1776779,46071] 0 2024-09-11T00:18:03.904 INFO:tasks.workunit.client.0.smithi078.stdout:0/877: read d2/d2a/d2c/d35/d59/d7/f86 [796177,6308] 0 2024-09-11T00:18:03.906 INFO:tasks.workunit.client.0.smithi078.stdout:0/878: link d2/d2a/d2c/d35/daf/cd1 d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/c124 0 2024-09-11T00:18:03.906 INFO:tasks.workunit.client.0.smithi078.stdout:0/879: read - d2/d2a/d2c/d35/d59/dc7/fe6 zero size 2024-09-11T00:18:03.910 INFO:tasks.workunit.client.0.smithi078.stdout:9/885: dread dc/d12/d20/d50/dbc/dcf/de1/d3e/fab [0,4194304] 0 2024-09-11T00:18:03.912 INFO:tasks.workunit.client.0.smithi078.stdout:0/880: write d2/d2a/d2c/d35/d59/d4f/d61/d8f/f115 [10092,115687] 0 2024-09-11T00:18:03.919 INFO:tasks.workunit.client.0.smithi078.stdout:0/881: dread d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/fee [0,4194304] 0 2024-09-11T00:18:03.919 INFO:tasks.workunit.client.0.smithi078.stdout:0/882: chown d2/f2d 723180 1 2024-09-11T00:18:03.920 INFO:tasks.workunit.client.0.smithi078.stdout:0/883: symlink d2/d2a/d2c/d35/d71/da7/l125 0 2024-09-11T00:18:03.920 INFO:tasks.workunit.client.0.smithi078.stdout:0/884: chown d2/f2d 615035708 1 2024-09-11T00:18:03.921 INFO:tasks.workunit.client.0.smithi078.stdout:0/885: mkdir d2/dbd/d126 0 2024-09-11T00:18:03.922 INFO:tasks.workunit.client.0.smithi078.stdout:0/886: unlink d2/d2a/d2c/d35/d59/d4f/d61/d8f/f115 0 2024-09-11T00:18:03.923 INFO:tasks.workunit.client.0.smithi078.stdout:0/887: fsync d2/d2a/d2c/d35/d59/d7/f40 0 2024-09-11T00:18:03.923 INFO:tasks.workunit.client.0.smithi078.stdout:0/888: creat d2/d2a/d2c/d35/d71/f127 x:0 0 0 2024-09-11T00:18:03.928 INFO:tasks.workunit.client.0.smithi078.stdout:9/886: dwrite dc/d12/d20/d58/d5a/d101/d129/f84 [0,4194304] 0 2024-09-11T00:18:03.928 INFO:tasks.workunit.client.0.smithi078.stdout:0/889: write d2/d2a/d2c/d35/d59/d4f/d61/fcd [1357353,108537] 0 2024-09-11T00:18:03.929 INFO:tasks.workunit.client.0.smithi078.stdout:9/887: rmdir dc/d12/d20/d58/d5a/dc9 39 2024-09-11T00:18:03.930 INFO:tasks.workunit.client.0.smithi078.stdout:9/888: mknod dc/d12/d46/c12f 0 2024-09-11T00:18:03.930 INFO:tasks.workunit.client.0.smithi078.stdout:9/889: fsync dc/d12/d20/d58/d5a/d101/d129/dbb/f102 0 2024-09-11T00:18:03.931 INFO:tasks.workunit.client.0.smithi078.stdout:9/890: unlink dc/d12/d54/db4/fa1 0 2024-09-11T00:18:03.932 INFO:tasks.workunit.client.0.smithi078.stdout:9/891: mkdir dc/d12/d46/d51/d130 0 2024-09-11T00:18:03.932 INFO:tasks.workunit.client.0.smithi078.stdout:9/892: chown dc/d12/d20/d58/d5a/d101/d129/dbb/c5d 23438491 1 2024-09-11T00:18:03.933 INFO:tasks.workunit.client.0.smithi078.stdout:9/893: read dc/d12/d46/d51/dcc/dce/d12c/f10a [120246,29462] 0 2024-09-11T00:18:03.936 INFO:tasks.workunit.client.0.smithi078.stdout:9/894: link dc/d12/d54/fb8 dc/d12/d54/de7/d103/f131 0 2024-09-11T00:18:03.936 INFO:tasks.workunit.client.0.smithi078.stdout:2/963: sync 2024-09-11T00:18:03.937 INFO:tasks.workunit.client.0.smithi078.stdout:2/964: fsync d0/d1/d11/d60/da2/d3a/fd3 0 2024-09-11T00:18:03.939 INFO:tasks.workunit.client.0.smithi078.stdout:2/965: rename d0/d19/d3d/d8d to d0/d1/d11/d60/da2/d38/d13c 0 2024-09-11T00:18:03.939 INFO:tasks.workunit.client.0.smithi078.stdout:2/966: write d0/d1/fe [506783,96579] 0 2024-09-11T00:18:03.940 INFO:tasks.workunit.client.0.smithi078.stdout:2/967: creat d0/d1/d11/d60/da2/d3a/d51/f13d x:0 0 0 2024-09-11T00:18:03.940 INFO:tasks.workunit.client.0.smithi078.stdout:2/968: truncate d0/d1/d6f/f12a 43111 0 2024-09-11T00:18:03.940 INFO:tasks.workunit.client.0.smithi078.stdout:0/890: dread d2/d2a/f2f [0,4194304] 0 2024-09-11T00:18:03.946 INFO:tasks.workunit.client.0.smithi078.stdout:0/891: write d2/d2a/fab [2181021,124581] 0 2024-09-11T00:18:03.947 INFO:tasks.workunit.client.0.smithi078.stdout:9/895: dwrite dc/d12/d20/d58/d5a/d101/d129/f110 [0,4194304] 0 2024-09-11T00:18:03.947 INFO:tasks.workunit.client.0.smithi078.stdout:9/896: write dc/d12/d46/d51/fc1 [4630263,87659] 0 2024-09-11T00:18:03.947 INFO:tasks.workunit.client.0.smithi078.stdout:9/897: fsync dc/d12/d20/d50/dbc/dcf/de1/f3b 0 2024-09-11T00:18:03.948 INFO:tasks.workunit.client.0.smithi078.stdout:9/898: chown dc/d12/c19 0 1 2024-09-11T00:18:03.948 INFO:tasks.workunit.client.0.smithi078.stdout:0/892: creat d2/dbd/f128 x:0 0 0 2024-09-11T00:18:03.948 INFO:tasks.workunit.client.0.smithi078.stdout:0/893: chown d2/d57/fd4 13840730 1 2024-09-11T00:18:03.949 INFO:tasks.workunit.client.0.smithi078.stdout:9/899: rmdir dc/d12/d20/d50 39 2024-09-11T00:18:03.949 INFO:tasks.workunit.client.0.smithi078.stdout:9/900: truncate dc/d12/d20/d50/dbc/dcf/de1/f9a 1669870 0 2024-09-11T00:18:03.949 INFO:tasks.workunit.client.0.smithi078.stdout:9/901: write dc/d12/d20/d30/fcd [91644,111082] 0 2024-09-11T00:18:03.949 INFO:tasks.workunit.client.0.smithi078.stdout:9/902: dread - dc/d12/d20/d50/dbc/dd4/ffb zero size 2024-09-11T00:18:03.950 INFO:tasks.workunit.client.0.smithi078.stdout:0/894: mknod d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/dbc/c129 0 2024-09-11T00:18:03.953 INFO:tasks.workunit.client.0.smithi078.stdout:0/895: dread d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/fe1 [0,4194304] 0 2024-09-11T00:18:03.956 INFO:tasks.workunit.client.0.smithi078.stdout:0/896: rename d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/ce5 to d2/d2a/d2c/d35/d59/de7/c12a 0 2024-09-11T00:18:03.956 INFO:tasks.workunit.client.0.smithi078.stdout:0/897: readlink d2/d2a/d2c/d35/d59/dc7/df8/l111 0 2024-09-11T00:18:03.956 INFO:tasks.workunit.client.0.smithi078.stdout:0/898: chown d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/c124 1117 1 2024-09-11T00:18:03.957 INFO:tasks.workunit.client.0.smithi078.stdout:0/899: rename d2/d2a/d2c/d35/d59/d4f/d61/f76 to d2/d2a/d2c/d35/d59/d4f/f12b 0 2024-09-11T00:18:03.959 INFO:tasks.workunit.client.0.smithi078.stdout:0/900: unlink d2/d2a/d2c/d35/d59/f64 0 2024-09-11T00:18:03.960 INFO:tasks.workunit.client.0.smithi078.stdout:0/901: fsync d2/f16 0 2024-09-11T00:18:03.960 INFO:tasks.workunit.client.0.smithi078.stdout:9/903: dwrite dc/d12/d54/d83/dc8/f12d [0,4194304] 0 2024-09-11T00:18:03.961 INFO:tasks.workunit.client.0.smithi078.stdout:0/902: rename d2/d2a/d2c/f55 to d2/d2a/d2c/d35/d59/dc7/df8/f12c 0 2024-09-11T00:18:03.961 INFO:tasks.workunit.client.0.smithi078.stdout:0/903: read d2/d2a/d2c/d35/d59/d4f/d61/fae [307467,6188] 0 2024-09-11T00:18:03.964 INFO:tasks.workunit.client.0.smithi078.stdout:9/904: mknod dc/d12/d20/d50/db1/c132 0 2024-09-11T00:18:03.965 INFO:tasks.workunit.client.0.smithi078.stdout:0/904: rename d2/fe4 to d2/d2a/d2c/d35/d71/da7/f12d 0 2024-09-11T00:18:03.966 INFO:tasks.workunit.client.0.smithi078.stdout:9/905: creat dc/d12/d20/d30/d117/f133 x:0 0 0 2024-09-11T00:18:03.967 INFO:tasks.workunit.client.0.smithi078.stdout:0/905: rename d2/d2a/d2c/d35/d59/d4f/d61/d69/f63 to d2/d2a/d2c/d35/d59/d7/d96/d11c/f12e 0 2024-09-11T00:18:03.967 INFO:tasks.workunit.client.0.smithi078.stdout:0/906: chown d2/d2a/d2c/d35/d59/d7/d96/cce 2510035 1 2024-09-11T00:18:03.982 INFO:tasks.workunit.client.0.smithi078.stdout:9/906: dwrite dc/d12/d20/d58/d5a/dc9/fcb [0,4194304] 0 2024-09-11T00:18:03.983 INFO:tasks.workunit.client.0.smithi078.stdout:0/907: dwrite d2/d2a/d2c/d35/d71/da7/f10c [0,4194304] 0 2024-09-11T00:18:03.984 INFO:tasks.workunit.client.0.smithi078.stdout:9/907: creat dc/d12/d20/d50/dbc/dcf/de1/f134 x:0 0 0 2024-09-11T00:18:03.986 INFO:tasks.workunit.client.0.smithi078.stdout:9/908: link dc/d12/d20/d58/d5a/d101/d129/dbb/f128 dc/f135 0 2024-09-11T00:18:03.986 INFO:tasks.workunit.client.0.smithi078.stdout:9/909: chown dc/d12/d20/d58/d5a/d101/d129/dbb/lec 39 1 2024-09-11T00:18:03.987 INFO:tasks.workunit.client.0.smithi078.stdout:0/908: rmdir d2/d2a/d2c/d35/d59/de0 0 2024-09-11T00:18:03.994 INFO:tasks.workunit.client.0.smithi078.stdout:0/909: dread d2/d2a/d2c/d35/d59/d4f/d61/fcd [0,4194304] 0 2024-09-11T00:18:03.995 INFO:tasks.workunit.client.0.smithi078.stdout:0/910: creat d2/dbd/d126/f12f x:0 0 0 2024-09-11T00:18:03.997 INFO:tasks.workunit.client.0.smithi078.stdout:9/910: dread dc/d12/d46/fc5 [0,4194304] 0 2024-09-11T00:18:03.997 INFO:tasks.workunit.client.0.smithi078.stdout:0/911: dread d2/d2a/d2c/d35/d59/d4f/d61/df2/ff7 [0,4194304] 0 2024-09-11T00:18:03.997 INFO:tasks.workunit.client.0.smithi078.stdout:7/795: sync 2024-09-11T00:18:03.997 INFO:tasks.workunit.client.0.smithi078.stdout:9/911: getdents dc/d12/d20/d58 0 2024-09-11T00:18:03.998 INFO:tasks.workunit.client.0.smithi078.stdout:9/912: chown dc/d12/d54/f57 279487 1 2024-09-11T00:18:03.998 INFO:tasks.workunit.client.0.smithi078.stdout:0/912: rename d2/d2a/d2c/d35/d59/d4f/d61/c9e to d2/dbd/c130 0 2024-09-11T00:18:03.999 INFO:tasks.workunit.client.0.smithi078.stdout:9/913: creat dc/d12/d20/d50/f136 x:0 0 0 2024-09-11T00:18:04.000 INFO:tasks.workunit.client.0.smithi078.stdout:0/913: rename d2/d2a/d2c/d5e/la8 to d2/d57/l131 0 2024-09-11T00:18:04.000 INFO:tasks.workunit.client.0.smithi078.stdout:0/914: stat d2/d2a/d2c/d35/d59/de7 0 2024-09-11T00:18:04.001 INFO:tasks.workunit.client.0.smithi078.stdout:9/914: mknod dc/c137 0 2024-09-11T00:18:04.005 INFO:tasks.workunit.client.0.smithi078.stdout:7/796: write d0/d34/db/da0/fad [1877109,121876] 0 2024-09-11T00:18:04.015 INFO:tasks.workunit.client.0.smithi078.stdout:0/915: dwrite d2/d2a/d2c/d35/d59/d4f/d61/d69/f1a [0,4194304] 0 2024-09-11T00:18:04.016 INFO:tasks.workunit.client.0.smithi078.stdout:9/915: dwrite dc/d12/d20/d58/d5a/d101/d129/dbb/f102 [0,4194304] 0 2024-09-11T00:18:04.018 INFO:tasks.workunit.client.0.smithi078.stdout:9/916: mknod dc/d12/d46/c138 0 2024-09-11T00:18:04.018 INFO:tasks.workunit.client.0.smithi078.stdout:7/797: dwrite d0/d34/db/d30/d1d/d14/d45/fe0 [0,4194304] 0 2024-09-11T00:18:04.021 INFO:tasks.workunit.client.0.smithi078.stdout:7/798: creat d0/d34/db/da0/ff5 x:0 0 0 2024-09-11T00:18:04.021 INFO:tasks.workunit.client.0.smithi078.stdout:7/799: write d0/d34/db/d30/d1d/fa5 [332398,68771] 0 2024-09-11T00:18:04.021 INFO:tasks.workunit.client.0.smithi078.stdout:7/800: write d0/d34/db/d30/d1d/d14/d62/f90 [3397926,59501] 0 2024-09-11T00:18:04.021 INFO:tasks.workunit.client.0.smithi078.stdout:0/916: dread d2/f2d [0,4194304] 0 2024-09-11T00:18:04.021 INFO:tasks.workunit.client.0.smithi078.stdout:7/801: creat d0/d34/ff6 x:0 0 0 2024-09-11T00:18:04.026 INFO:tasks.workunit.client.0.smithi078.stdout:9/917: read dc/d12/d20/d50/dbc/dcf/de1/d3e/ffc [3257774,129543] 0 2024-09-11T00:18:04.026 INFO:tasks.workunit.client.0.smithi078.stdout:9/918: stat dc/lf4 0 2024-09-11T00:18:04.026 INFO:tasks.workunit.client.0.smithi078.stdout:9/919: fdatasync dc/d12/f17 0 2024-09-11T00:18:04.028 INFO:tasks.workunit.client.0.smithi078.stdout:9/920: creat dc/d12/d20/d58/d5a/dc9/d11e/f139 x:0 0 0 2024-09-11T00:18:04.028 INFO:tasks.workunit.client.0.smithi078.stdout:9/921: chown dc/d12/d46/d51/l113 9666 1 2024-09-11T00:18:04.033 INFO:tasks.workunit.client.0.smithi078.stdout:0/917: dwrite d2/f8d [4194304,4194304] 0 2024-09-11T00:18:04.040 INFO:tasks.workunit.client.0.smithi078.stdout:0/918: dread d2/d2a/d2c/d5e/f6a [0,4194304] 0 2024-09-11T00:18:04.040 INFO:tasks.workunit.client.0.smithi078.stdout:0/919: readlink d2/d2a/d2c/d35/l117 0 2024-09-11T00:18:04.040 INFO:tasks.workunit.client.0.smithi078.stdout:0/920: write d2/d2a/d2c/d35/d71/da7/f12d [1821196,110445] 0 2024-09-11T00:18:04.040 INFO:tasks.workunit.client.0.smithi078.stdout:0/921: chown d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/fee 136 1 2024-09-11T00:18:04.040 INFO:tasks.workunit.client.0.smithi078.stdout:0/922: dread - d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/dbc/fe8 zero size 2024-09-11T00:18:04.040 INFO:tasks.workunit.client.0.smithi078.stdout:0/923: stat d2/d2a/d2c/d35/d59/d4f/d61/d69 0 2024-09-11T00:18:04.040 INFO:tasks.workunit.client.0.smithi078.stdout:0/924: fsync d2/d2a/d2c/d35/d59/d7/dd2/f112 0 2024-09-11T00:18:04.044 INFO:tasks.workunit.client.0.smithi078.stdout:9/922: dwrite dc/d12/d20/d58/d5a/f96 [0,4194304] 0 2024-09-11T00:18:04.045 INFO:tasks.workunit.client.0.smithi078.stdout:9/923: mknod dc/d12/d54/de7/d103/c13a 0 2024-09-11T00:18:04.045 INFO:tasks.workunit.client.0.smithi078.stdout:9/924: readlink dc/d12/d46/d51/dcc/dce/l125 0 2024-09-11T00:18:04.045 INFO:tasks.workunit.client.0.smithi078.stdout:9/925: stat dc/d12/d46/d51/dcc/dce/d12c/c6c 0 2024-09-11T00:18:04.046 INFO:tasks.workunit.client.0.smithi078.stdout:9/926: creat dc/d12/d20/d58/f13b x:0 0 0 2024-09-11T00:18:04.047 INFO:tasks.workunit.client.0.smithi078.stdout:9/927: symlink dc/d12/d54/l13c 0 2024-09-11T00:18:04.047 INFO:tasks.workunit.client.0.smithi078.stdout:9/928: chown dc/d12/d46/d51/dcc/dce/fd9 58173 1 2024-09-11T00:18:04.047 INFO:tasks.workunit.client.0.smithi078.stdout:3/933: sync 2024-09-11T00:18:04.047 INFO:tasks.workunit.client.0.smithi078.stdout:6/905: sync 2024-09-11T00:18:04.047 INFO:tasks.workunit.client.0.smithi078.stdout:5/785: sync 2024-09-11T00:18:04.047 INFO:tasks.workunit.client.0.smithi078.stdout:5/786: chown d7/d8/d33/d22/d25/d28/da8/lf4 10568 1 2024-09-11T00:18:04.048 INFO:tasks.workunit.client.0.smithi078.stdout:9/929: creat dc/d12/d20/d58/f13d x:0 0 0 2024-09-11T00:18:04.048 INFO:tasks.workunit.client.0.smithi078.stdout:9/930: chown dc/d12 32 1 2024-09-11T00:18:04.048 INFO:tasks.workunit.client.0.smithi078.stdout:9/931: fsync dc/d12/d20/d50/dbc/dcf/de1/d3e/f42 0 2024-09-11T00:18:04.048 INFO:tasks.workunit.client.0.smithi078.stdout:9/932: write dc/d12/d20/d58/d5a/ff1 [123227,107370] 0 2024-09-11T00:18:04.049 INFO:tasks.workunit.client.0.smithi078.stdout:5/787: truncate d7/d8/d33/d22/d25/d28/d24/f4d 351404 0 2024-09-11T00:18:04.049 INFO:tasks.workunit.client.0.smithi078.stdout:9/933: creat dc/d12/d54/de7/f13e x:0 0 0 2024-09-11T00:18:04.049 INFO:tasks.workunit.client.0.smithi078.stdout:9/934: chown dc/d12/d46/dfa 378013721 1 2024-09-11T00:18:04.050 INFO:tasks.workunit.client.0.smithi078.stdout:0/925: write d2/d2a/d2c/d35/d59/dc7/df8/f12c [253182,48160] 0 2024-09-11T00:18:04.050 INFO:tasks.workunit.client.0.smithi078.stdout:0/926: chown d2/d11d 29 1 2024-09-11T00:18:04.050 INFO:tasks.workunit.client.0.smithi078.stdout:6/906: rename d0/d1/d9/d17/d5e/cc7 to d0/c12e 0 2024-09-11T00:18:04.051 INFO:tasks.workunit.client.0.smithi078.stdout:9/935: rmdir dc/d12/d54 39 2024-09-11T00:18:04.052 INFO:tasks.workunit.client.0.smithi078.stdout:5/788: dread d7/d8/d33/d22/d25/d28/da8/fe9 [0,4194304] 0 2024-09-11T00:18:04.052 INFO:tasks.workunit.client.0.smithi078.stdout:5/789: dread - d7/d8/d33/d22/dd9/ddf/dc5/dc8/d2a/dc7/ffb zero size 2024-09-11T00:18:04.053 INFO:tasks.workunit.client.0.smithi078.stdout:6/907: link d0/d1/d9/d54/c82 d0/d1/d9/d59/da3/d107/dff/d11d/c12f 0 2024-09-11T00:18:04.053 INFO:tasks.workunit.client.0.smithi078.stdout:6/908: write d0/d1/d9/d59/d74/d6b/f103 [924165,95770] 0 2024-09-11T00:18:04.055 INFO:tasks.workunit.client.0.smithi078.stdout:6/909: mkdir d0/d1/d9/d59/da3/d107/dff/d11d/d130 0 2024-09-11T00:18:04.056 INFO:tasks.workunit.client.0.smithi078.stdout:6/910: symlink d0/d1/d9/l131 0 2024-09-11T00:18:04.063 INFO:tasks.workunit.client.0.smithi078.stdout:5/790: dread d7/d8/d33/d22/d25/d6a/f6e [0,4194304] 0 2024-09-11T00:18:04.065 INFO:tasks.workunit.client.0.smithi078.stdout:5/791: mkdir d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/de3/d115 0 2024-09-11T00:18:04.066 INFO:tasks.workunit.client.0.smithi078.stdout:5/792: symlink d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/l116 0 2024-09-11T00:18:04.078 INFO:tasks.workunit.client.0.smithi078.stdout:3/934: dwrite d0/d7/d18/dd8/d3e/f5d [0,4194304] 0 2024-09-11T00:18:04.078 INFO:tasks.workunit.client.0.smithi078.stdout:3/935: dread - d0/d7/d18/dd8/d60/fba zero size 2024-09-11T00:18:04.079 INFO:tasks.workunit.client.0.smithi078.stdout:9/936: dwrite fa [0,4194304] 0 2024-09-11T00:18:04.080 INFO:tasks.workunit.client.0.smithi078.stdout:3/936: symlink d0/d7/d23/d7c/db7/de8/dfe/l112 0 2024-09-11T00:18:04.082 INFO:tasks.workunit.client.0.smithi078.stdout:6/911: dwrite d0/fc [0,4194304] 0 2024-09-11T00:18:04.082 INFO:tasks.workunit.client.0.smithi078.stdout:9/937: rename dc/d12/d54 to dc/d12/d20/d58/d5a/d101/d129/dbb/d13f 0 2024-09-11T00:18:04.085 INFO:tasks.workunit.client.0.smithi078.stdout:5/793: dwrite d7/d8/d33/d22/d25/f84 [4194304,4194304] 0 2024-09-11T00:18:04.085 INFO:tasks.workunit.client.0.smithi078.stdout:5/794: fdatasync d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d8c/fa0 0 2024-09-11T00:18:04.085 INFO:tasks.workunit.client.0.smithi078.stdout:5/795: chown d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d90/lf7 2 1 2024-09-11T00:18:04.086 INFO:tasks.workunit.client.0.smithi078.stdout:9/938: creat dc/d12/d20/d58/f140 x:0 0 0 2024-09-11T00:18:04.086 INFO:tasks.workunit.client.0.smithi078.stdout:9/939: readlink dc/d12/d20/d30/lae 0 2024-09-11T00:18:04.090 INFO:tasks.workunit.client.0.smithi078.stdout:6/912: dread d0/fc [0,4194304] 0 2024-09-11T00:18:04.091 INFO:tasks.workunit.client.0.smithi078.stdout:6/913: stat d0/d1/d9/d59/d74/db3/dd5/f37 0 2024-09-11T00:18:04.092 INFO:tasks.workunit.client.0.smithi078.stdout:9/940: truncate dc/d12/d20/d50/dbc/dcf/de1/d3e/f60 1533807 0 2024-09-11T00:18:04.092 INFO:tasks.workunit.client.0.smithi078.stdout:9/941: chown dc/d12/la9 11 1 2024-09-11T00:18:04.094 INFO:tasks.workunit.client.0.smithi078.stdout:9/942: rename dc/d12/d20/d58/d5a/d101/d129/dbb/f128 to dc/d12/d46/dfa/d120/f141 0 2024-09-11T00:18:04.095 INFO:tasks.workunit.client.0.smithi078.stdout:9/943: mkdir dc/d12/d20/d58/d5a/d101/d129/dbb/d13f/de7/d142 0 2024-09-11T00:18:04.100 INFO:tasks.workunit.client.0.smithi078.stdout:3/937: dwrite d0/d7/d18/d8c/f95 [0,4194304] 0 2024-09-11T00:18:04.110 INFO:tasks.workunit.client.0.smithi078.stdout:6/914: dwrite d0/d1/d9/d59/d74/f67 [0,4194304] 0 2024-09-11T00:18:04.112 INFO:tasks.workunit.client.0.smithi078.stdout:5/796: dwrite d7/d8/d33/d22/d25/f3a [0,4194304] 0 2024-09-11T00:18:04.112 INFO:tasks.workunit.client.0.smithi078.stdout:6/915: symlink d0/d66/l132 0 2024-09-11T00:18:04.117 INFO:tasks.workunit.client.0.smithi078.stdout:9/944: dwrite dc/d12/d20/d58/d5a/d101/d129/dbb/f67 [0,4194304] 0 2024-09-11T00:18:04.119 INFO:tasks.workunit.client.0.smithi078.stdout:9/945: dread dc/d12/f8e [0,4194304] 0 2024-09-11T00:18:04.131 INFO:tasks.workunit.client.0.smithi078.stdout:5/797: dwrite d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d90/fbe [0,4194304] 0 2024-09-11T00:18:04.132 INFO:tasks.workunit.client.0.smithi078.stdout:6/916: dwrite d0/d1/d9/f24 [0,4194304] 0 2024-09-11T00:18:04.132 INFO:tasks.workunit.client.0.smithi078.stdout:6/917: truncate d0/d1/d9/f102 793198 0 2024-09-11T00:18:04.132 INFO:tasks.workunit.client.0.smithi078.stdout:5/798: chown d7/d8/l72 353 1 2024-09-11T00:18:04.132 INFO:tasks.workunit.client.0.smithi078.stdout:5/799: fdatasync d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d2c/d62/ffe 0 2024-09-11T00:18:04.136 INFO:tasks.workunit.client.0.smithi078.stdout:6/918: mkdir d0/d1/d9/d133 0 2024-09-11T00:18:04.136 INFO:tasks.workunit.client.0.smithi078.stdout:6/919: stat d0/d1/d9/c114 0 2024-09-11T00:18:04.136 INFO:tasks.workunit.client.0.smithi078.stdout:6/920: fdatasync d0/d1/d53/d9c/dac/de3/f11f 0 2024-09-11T00:18:04.136 INFO:tasks.workunit.client.0.smithi078.stdout:9/946: dwrite dc/d12/fee [0,4194304] 0 2024-09-11T00:18:04.140 INFO:tasks.workunit.client.0.smithi078.stdout:9/947: write dc/d12/d20/d30/fa7 [3491993,9964] 0 2024-09-11T00:18:04.140 INFO:tasks.workunit.client.0.smithi078.stdout:9/948: readlink dc/d12/d20/d30/l31 0 2024-09-11T00:18:04.140 INFO:tasks.workunit.client.0.smithi078.stdout:9/949: chown dc/d12/d20/d50/dbc/ldb 352979 1 2024-09-11T00:18:04.140 INFO:tasks.workunit.client.0.smithi078.stdout:9/950: write dc/f1e [4256937,83513] 0 2024-09-11T00:18:04.146 INFO:tasks.workunit.client.0.smithi078.stdout:5/800: dwrite d7/d8/d33/d22/dd9/ddf/dc5/dc8/f5d [0,4194304] 0 2024-09-11T00:18:04.147 INFO:tasks.workunit.client.0.smithi078.stdout:5/801: read d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d8c/fab [467693,84509] 0 2024-09-11T00:18:04.147 INFO:tasks.workunit.client.0.smithi078.stdout:5/802: dread - d7/d8/d33/d22/d25/d28/d24/d1c/fe7 zero size 2024-09-11T00:18:04.148 INFO:tasks.workunit.client.0.smithi078.stdout:5/803: creat d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/de3/d115/f117 x:0 0 0 2024-09-11T00:18:04.148 INFO:tasks.workunit.client.0.smithi078.stdout:5/804: readlink d7/d8/d33/d22/dd9/ddf/dc5/dc8/d2a/lf1 0 2024-09-11T00:18:04.150 INFO:tasks.workunit.client.0.smithi078.stdout:5/805: dread d7/d8/d33/d22/dd9/ddf/dc5/dc8/f6f [0,4194304] 0 2024-09-11T00:18:04.152 INFO:tasks.workunit.client.0.smithi078.stdout:5/806: creat d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d90/f118 x:0 0 0 2024-09-11T00:18:04.152 INFO:tasks.workunit.client.0.smithi078.stdout:5/807: readlink d7/d8/d33/d22/d25/l54 0 2024-09-11T00:18:04.152 INFO:tasks.workunit.client.0.smithi078.stdout:5/808: stat d7/c15 0 2024-09-11T00:18:04.155 INFO:tasks.workunit.client.0.smithi078.stdout:9/951: dwrite dc/fc4 [0,4194304] 0 2024-09-11T00:18:04.157 INFO:tasks.workunit.client.0.smithi078.stdout:9/952: mkdir dc/d12/d20/d50/dbc/dcf/d143 0 2024-09-11T00:18:04.158 INFO:tasks.workunit.client.0.smithi078.stdout:9/953: creat dc/d12/f144 x:0 0 0 2024-09-11T00:18:04.159 INFO:tasks.workunit.client.0.smithi078.stdout:5/809: write d7/d8/d33/d22/d25/d6a/f6b [2709596,52943] 0 2024-09-11T00:18:04.159 INFO:tasks.workunit.client.0.smithi078.stdout:5/810: truncate d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/f10a 813223 0 2024-09-11T00:18:04.160 INFO:tasks.workunit.client.0.smithi078.stdout:5/811: symlink d7/d8/d33/d22/d25/l119 0 2024-09-11T00:18:04.161 INFO:tasks.workunit.client.0.smithi078.stdout:5/812: creat d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d2c/f11a x:0 0 0 2024-09-11T00:18:04.162 INFO:tasks.workunit.client.0.smithi078.stdout:5/813: mkdir d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/de3/d102/d11b 0 2024-09-11T00:18:04.167 INFO:tasks.workunit.client.0.smithi078.stdout:9/954: dread dc/d12/d20/d50/dbc/dcf/de1/d3e/f6d [0,4194304] 0 2024-09-11T00:18:04.168 INFO:tasks.workunit.client.0.smithi078.stdout:9/955: fdatasync dc/d12/d20/d58/d5a/fb0 0 2024-09-11T00:18:04.168 INFO:tasks.workunit.client.0.smithi078.stdout:9/956: readlink dc/d12/d20/l5e 0 2024-09-11T00:18:04.168 INFO:tasks.workunit.client.0.smithi078.stdout:9/957: mkdir dc/d12/d46/d51/dcc/d145 0 2024-09-11T00:18:04.168 INFO:tasks.workunit.client.0.smithi078.stdout:9/958: fsync dc/d12/d20/d50/dbc/dd4/f118 0 2024-09-11T00:18:04.170 INFO:tasks.workunit.client.0.smithi078.stdout:9/959: rename dc/d12/d20/d58/d5a/dc9/d11e to dc/d12/d20/d58/d5a/d101/d146 0 2024-09-11T00:18:04.171 INFO:tasks.workunit.client.0.smithi078.stdout:9/960: mknod dc/d12/d20/d50/dbc/c147 0 2024-09-11T00:18:04.171 INFO:tasks.workunit.client.0.smithi078.stdout:9/961: fsync dc/d12/d20/d58/fe9 0 2024-09-11T00:18:04.171 INFO:tasks.workunit.client.0.smithi078.stdout:9/962: write dc/d12/d20/d30/fcd [225609,86315] 0 2024-09-11T00:18:04.171 INFO:tasks.workunit.client.0.smithi078.stdout:9/963: stat dc/d12/faf 0 2024-09-11T00:18:04.181 INFO:tasks.workunit.client.0.smithi078.stdout:2/969: sync 2024-09-11T00:18:04.181 INFO:tasks.workunit.client.0.smithi078.stdout:9/964: dwrite dc/d12/d20/d50/dbc/dcf/f114 [0,4194304] 0 2024-09-11T00:18:04.183 INFO:tasks.workunit.client.0.smithi078.stdout:9/965: creat dc/d12/d20/d58/d5a/d101/d129/dbb/d13f/f148 x:0 0 0 2024-09-11T00:18:04.184 INFO:tasks.workunit.client.0.smithi078.stdout:9/966: mknod dc/d12/d20/d58/d5a/d101/d129/dbb/d13f/de7/d103/c149 0 2024-09-11T00:18:04.185 INFO:tasks.workunit.client.0.smithi078.stdout:9/967: mknod dc/d12/d46/d51/dcc/dce/d12c/c14a 0 2024-09-11T00:18:04.194 INFO:tasks.workunit.client.0.smithi078.stdout:2/970: dwrite d0/d1/d3c/f45 [4194304,4194304] 0 2024-09-11T00:18:04.194 INFO:tasks.workunit.client.0.smithi078.stdout:2/971: stat d0 0 2024-09-11T00:18:04.194 INFO:tasks.workunit.client.0.smithi078.stdout:2/972: dread - d0/d1/d11/d60/fe3 zero size 2024-09-11T00:18:04.195 INFO:tasks.workunit.client.0.smithi078.stdout:2/973: creat d0/d1/d11/d60/da2/d3a/d51/d97/dac/dfc/f13e x:0 0 0 2024-09-11T00:18:04.196 INFO:tasks.workunit.client.0.smithi078.stdout:2/974: creat d0/d1/d11/d60/da2/d38/f13f x:0 0 0 2024-09-11T00:18:04.196 INFO:tasks.workunit.client.0.smithi078.stdout:2/975: write d0/d19/dd0/f127 [787214,120097] 0 2024-09-11T00:18:04.198 INFO:tasks.workunit.client.0.smithi078.stdout:2/976: symlink d0/d1/d6/d52/d102/l140 0 2024-09-11T00:18:04.198 INFO:tasks.workunit.client.0.smithi078.stdout:2/977: read d0/d1/d3c/f45 [1207694,68966] 0 2024-09-11T00:18:04.199 INFO:tasks.workunit.client.0.smithi078.stdout:9/968: dwrite dc/d12/d20/d58/d5a/f96 [0,4194304] 0 2024-09-11T00:18:04.199 INFO:tasks.workunit.client.0.smithi078.stdout:2/978: dread d0/d19/d3d/f62 [0,4194304] 0 2024-09-11T00:18:04.199 INFO:tasks.workunit.client.0.smithi078.stdout:9/969: getdents dc/d12/d20/d50 0 2024-09-11T00:18:04.199 INFO:tasks.workunit.client.0.smithi078.stdout:9/970: fdatasync dc/d12/d46/d51/dcc/dce/d12c/fd5 0 2024-09-11T00:18:04.203 INFO:tasks.workunit.client.0.smithi078.stdout:9/971: read dc/d12/d46/d51/fa5 [716229,5788] 0 2024-09-11T00:18:04.203 INFO:tasks.workunit.client.0.smithi078.stdout:9/972: write dc/fe6 [903594,7505] 0 2024-09-11T00:18:04.204 INFO:tasks.workunit.client.0.smithi078.stdout:9/973: symlink dc/d12/d20/l14b 0 2024-09-11T00:18:04.204 INFO:tasks.workunit.client.0.smithi078.stdout:9/974: fdatasync dc/d12/d20/d50/db1/f108 0 2024-09-11T00:18:04.215 INFO:tasks.workunit.client.0.smithi078.stdout:2/979: dwrite d0/d1/f27 [0,4194304] 0 2024-09-11T00:18:04.215 INFO:tasks.workunit.client.0.smithi078.stdout:2/980: chown d0/d1/d11/d60/da2/d3a/d51/d97/dac 6135954 1 2024-09-11T00:18:04.215 INFO:tasks.workunit.client.0.smithi078.stdout:2/981: chown d0/d1/d6f/l8f 1 1 2024-09-11T00:18:04.216 INFO:tasks.workunit.client.0.smithi078.stdout:2/982: creat d0/d1/d3b/f141 x:0 0 0 2024-09-11T00:18:04.217 INFO:tasks.workunit.client.0.smithi078.stdout:2/983: creat d0/d1/d11/d60/f142 x:0 0 0 2024-09-11T00:18:04.219 INFO:tasks.workunit.client.0.smithi078.stdout:9/975: dwrite dc/d12/d46/d51/dcc/dce/d12c/fac [0,4194304] 0 2024-09-11T00:18:04.220 INFO:tasks.workunit.client.0.smithi078.stdout:9/976: truncate dc/d12/f64 949974 0 2024-09-11T00:18:04.220 INFO:tasks.workunit.client.0.smithi078.stdout:9/977: chown dc/d12/d20/d30/l105 43 1 2024-09-11T00:18:04.220 INFO:tasks.workunit.client.0.smithi078.stdout:2/984: rename d0/dd7/f115 to d0/d1/d11/d60/da2/d3a/d107/f143 0 2024-09-11T00:18:04.220 INFO:tasks.workunit.client.0.smithi078.stdout:9/978: symlink dc/d12/d20/d58/d5a/dc9/l14c 0 2024-09-11T00:18:04.221 INFO:tasks.workunit.client.0.smithi078.stdout:2/985: link d0/d1/d11/d1b/f6d d0/d1/d11/d60/da2/d3a/d51/f144 0 2024-09-11T00:18:04.222 INFO:tasks.workunit.client.0.smithi078.stdout:9/979: creat dc/d12/d20/d58/d5a/f14d x:0 0 0 2024-09-11T00:18:04.223 INFO:tasks.workunit.client.0.smithi078.stdout:9/980: mkdir dc/d12/d20/d30/d14e 0 2024-09-11T00:18:04.239 INFO:tasks.workunit.client.0.smithi078.stdout:2/986: dwrite d0/d1/d8/f12 [8388608,4194304] 0 2024-09-11T00:18:04.242 INFO:tasks.workunit.client.0.smithi078.stdout:9/981: dwrite dc/d12/d20/d50/dbc/dcf/de1/f3b [0,4194304] 0 2024-09-11T00:18:04.242 INFO:tasks.workunit.client.0.smithi078.stdout:9/982: truncate dc/d12/d20/d58/f71 1262530 0 2024-09-11T00:18:04.247 INFO:tasks.workunit.client.0.smithi078.stdout:7/802: sync 2024-09-11T00:18:04.247 INFO:tasks.workunit.client.0.smithi078.stdout:0/927: sync 2024-09-11T00:18:04.247 INFO:tasks.workunit.client.0.smithi078.stdout:0/928: dread - d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/dbc/fe8 zero size 2024-09-11T00:18:04.248 INFO:tasks.workunit.client.0.smithi078.stdout:7/803: rename d0/d34/db/d32/ff4 to d0/d34/d86/ff7 0 2024-09-11T00:18:04.249 INFO:tasks.workunit.client.0.smithi078.stdout:0/929: creat d2/d57/d8b/d107/f132 x:0 0 0 2024-09-11T00:18:04.251 INFO:tasks.workunit.client.0.smithi078.stdout:7/804: link d0/d34/db/d30/d1d/lb6 d0/d34/db/d30/lf8 0 2024-09-11T00:18:04.262 INFO:tasks.workunit.client.0.smithi078.stdout:7/805: write d0/d34/db/d30/d1d/d14/d62/d93/fae [716074,17437] 0 2024-09-11T00:18:04.262 INFO:tasks.workunit.client.0.smithi078.stdout:7/806: truncate d0/d34/db/d32/f94 357571 0 2024-09-11T00:18:04.262 INFO:tasks.workunit.client.0.smithi078.stdout:7/807: dread - d0/d34/db/fd4 zero size 2024-09-11T00:18:04.263 INFO:tasks.workunit.client.0.smithi078.stdout:7/808: creat d0/d34/db/d30/d1d/d14/d87/dc5/ff9 x:0 0 0 2024-09-11T00:18:04.266 INFO:tasks.workunit.client.0.smithi078.stdout:0/930: dwrite d2/d2a/d2c/d35/d71/da7/f10c [0,4194304] 0 2024-09-11T00:18:04.266 INFO:tasks.workunit.client.0.smithi078.stdout:0/931: getdents d2/d2a/d2c/d35/d93 0 2024-09-11T00:18:04.267 INFO:tasks.workunit.client.0.smithi078.stdout:2/987: dwrite d0/d1/d11/d60/da2/d38/f6a [0,4194304] 0 2024-09-11T00:18:04.267 INFO:tasks.workunit.client.0.smithi078.stdout:9/983: write dc/f1c [1676468,127329] 0 2024-09-11T00:18:04.267 INFO:tasks.workunit.client.0.smithi078.stdout:0/932: creat d2/d2a/d2c/d35/d59/dc7/df8/f133 x:0 0 0 2024-09-11T00:18:04.267 INFO:tasks.workunit.client.0.smithi078.stdout:0/933: write d2/d2a/d2c/d35/d59/f10e [734367,103437] 0 2024-09-11T00:18:04.271 INFO:tasks.workunit.client.0.smithi078.stdout:9/984: rename dc/d12/d46/d51/dcc/dce/d12c/ff7 to dc/d12/d20/d58/d5a/d101/d129/f14f 0 2024-09-11T00:18:04.271 INFO:tasks.workunit.client.0.smithi078.stdout:9/985: readlink dc/d12/d20/d58/d5a/d101/d129/dbb/d13f/d83/dc8/lff 0 2024-09-11T00:18:04.272 INFO:tasks.workunit.client.0.smithi078.stdout:0/934: mkdir d2/d2a/d2c/d35/d59/dc7/d134 0 2024-09-11T00:18:04.272 INFO:tasks.workunit.client.0.smithi078.stdout:0/935: write d2/d2a/d2c/d35/d59/d4f/f12b [942938,48046] 0 2024-09-11T00:18:04.272 INFO:tasks.workunit.client.0.smithi078.stdout:0/936: write d2/d2a/d2c/d35/d59/d4f/f80 [2421302,11869] 0 2024-09-11T00:18:04.272 INFO:tasks.workunit.client.0.smithi078.stdout:9/986: stat dc/d12/d20/d30/l41 0 2024-09-11T00:18:04.272 INFO:tasks.workunit.client.0.smithi078.stdout:7/809: write d0/f63 [3888489,122028] 0 2024-09-11T00:18:04.273 INFO:tasks.workunit.client.0.smithi078.stdout:2/988: dread d0/d1/d3b/f11c [0,4194304] 0 2024-09-11T00:18:04.273 INFO:tasks.workunit.client.0.smithi078.stdout:0/937: symlink d2/d2a/d2c/d35/daf/l135 0 2024-09-11T00:18:04.275 INFO:tasks.workunit.client.0.smithi078.stdout:9/987: link dc/d12/d46/d51/l113 dc/d12/d20/d50/dbc/l150 0 2024-09-11T00:18:04.275 INFO:tasks.workunit.client.0.smithi078.stdout:9/988: write dc/d12/d46/d51/dcc/dce/d12c/f10a [1161934,89122] 0 2024-09-11T00:18:04.277 INFO:tasks.workunit.client.0.smithi078.stdout:7/810: getdents d0/d34/db/d32/ddc 0 2024-09-11T00:18:04.278 INFO:tasks.workunit.client.0.smithi078.stdout:2/989: mknod d0/d19/c145 0 2024-09-11T00:18:04.278 INFO:tasks.workunit.client.0.smithi078.stdout:0/938: mknod d2/d2a/d2c/d35/d71/da7/c136 0 2024-09-11T00:18:04.279 INFO:tasks.workunit.client.0.smithi078.stdout:7/811: mknod d0/d34/db/d30/d1d/d14/d87/dc5/cfa 0 2024-09-11T00:18:04.280 INFO:tasks.workunit.client.0.smithi078.stdout:2/990: unlink d0/d1/d11/d1b/d1e/fdd 0 2024-09-11T00:18:04.282 INFO:tasks.workunit.client.0.smithi078.stdout:3/938: sync 2024-09-11T00:18:04.283 INFO:tasks.workunit.client.0.smithi078.stdout:0/939: mknod d2/d2a/d2c/d35/c137 0 2024-09-11T00:18:04.283 INFO:tasks.workunit.client.0.smithi078.stdout:0/940: fdatasync d2/d2a/d2c/d35/d59/dc7/fc3 0 2024-09-11T00:18:04.284 INFO:tasks.workunit.client.0.smithi078.stdout:0/941: fsync d2/dbd/f128 0 2024-09-11T00:18:04.284 INFO:tasks.workunit.client.0.smithi078.stdout:0/942: write d2/dbd/f120 [368824,96999] 0 2024-09-11T00:18:04.284 INFO:tasks.workunit.client.0.smithi078.stdout:0/943: write d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/f102 [226683,92299] 0 2024-09-11T00:18:04.284 INFO:tasks.workunit.client.0.smithi078.stdout:7/812: rmdir d0/d34/db/da0 39 2024-09-11T00:18:04.284 INFO:tasks.workunit.client.0.smithi078.stdout:7/813: readlink d0/l23 0 2024-09-11T00:18:04.284 INFO:tasks.workunit.client.0.smithi078.stdout:7/814: write d0/d34/db/d30/d1d/d14/d87/fc1 [615485,69215] 0 2024-09-11T00:18:04.284 INFO:tasks.workunit.client.0.smithi078.stdout:9/989: dread dc/f2c [4194304,4194304] 0 2024-09-11T00:18:04.284 INFO:tasks.workunit.client.0.smithi078.stdout:3/939: mknod d0/d7/d23/d91/c113 0 2024-09-11T00:18:04.286 INFO:tasks.workunit.client.0.smithi078.stdout:7/815: link d0/d3f/lee d0/d34/db/d30/d1d/db0/lfb 0 2024-09-11T00:18:04.287 INFO:tasks.workunit.client.0.smithi078.stdout:9/990: creat dc/d12/d46/f151 x:0 0 0 2024-09-11T00:18:04.288 INFO:tasks.workunit.client.0.smithi078.stdout:7/816: creat d0/d34/ffc x:0 0 0 2024-09-11T00:18:04.288 INFO:tasks.workunit.client.0.smithi078.stdout:7/817: chown d0/d3f/f60 25 1 2024-09-11T00:18:04.289 INFO:tasks.workunit.client.0.smithi078.stdout:9/991: truncate dc/d12/d20/d58/d5a/d101/d129/dbb/f67 1081575 0 2024-09-11T00:18:04.291 INFO:tasks.workunit.client.0.smithi078.stdout:7/818: creat d0/d34/db/d30/d1d/d14/ffd x:0 0 0 2024-09-11T00:18:04.291 INFO:tasks.workunit.client.0.smithi078.stdout:7/819: write d0/d34/db/d30/fda [949556,46788] 0 2024-09-11T00:18:04.292 INFO:tasks.workunit.client.0.smithi078.stdout:7/820: truncate d0/d34/db/d30/d1d/f2c 3705651 0 2024-09-11T00:18:04.293 INFO:tasks.workunit.client.0.smithi078.stdout:7/821: getdents d0/d34/db/d30/d1d/d14/d87 0 2024-09-11T00:18:04.295 INFO:tasks.workunit.client.0.smithi078.stdout:7/822: symlink d0/d34/db/lfe 0 2024-09-11T00:18:04.296 INFO:tasks.workunit.client.0.smithi078.stdout:3/940: write d0/d7/d18/d8c/f95 [3064729,6035] 0 2024-09-11T00:18:04.296 INFO:tasks.workunit.client.0.smithi078.stdout:3/941: chown d0/d7/d23/d7c/db7/de8/dfe 1250853575 1 2024-09-11T00:18:04.296 INFO:tasks.workunit.client.0.smithi078.stdout:3/942: truncate d0/d7/d46/d86/d9a/fa2 1264291 0 2024-09-11T00:18:04.296 INFO:tasks.workunit.client.0.smithi078.stdout:2/991: dwrite d0/d1/d33/d86/db4/fe5 [4194304,4194304] 0 2024-09-11T00:18:04.296 INFO:tasks.workunit.client.0.smithi078.stdout:2/992: dread - d0/d1/d3b/fde zero size 2024-09-11T00:18:04.298 INFO:tasks.workunit.client.0.smithi078.stdout:7/823: creat d0/d34/d57/fff x:0 0 0 2024-09-11T00:18:04.299 INFO:tasks.workunit.client.0.smithi078.stdout:2/993: mkdir d0/d1/d8/d146 0 2024-09-11T00:18:04.301 INFO:tasks.workunit.client.0.smithi078.stdout:0/944: dwrite d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/fc6 [0,4194304] 0 2024-09-11T00:18:04.301 INFO:tasks.workunit.client.0.smithi078.stdout:0/945: readlink d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d7b/db7/lbe 0 2024-09-11T00:18:04.303 INFO:tasks.workunit.client.0.smithi078.stdout:2/994: unlink d0/d19/d3d/f106 0 2024-09-11T00:18:04.304 INFO:tasks.workunit.client.0.smithi078.stdout:6/921: sync 2024-09-11T00:18:04.304 INFO:tasks.workunit.client.0.smithi078.stdout:5/814: sync 2024-09-11T00:18:04.304 INFO:tasks.workunit.client.0.smithi078.stdout:6/922: chown d0/d1/d53/la1 147 1 2024-09-11T00:18:04.305 INFO:tasks.workunit.client.0.smithi078.stdout:6/923: dread - d0/d1/f75 zero size 2024-09-11T00:18:04.308 INFO:tasks.workunit.client.0.smithi078.stdout:7/824: write d0/d34/f24 [6620848,13030] 0 2024-09-11T00:18:04.312 INFO:tasks.workunit.client.0.smithi078.stdout:2/995: creat d0/d1/d33/f147 x:0 0 0 2024-09-11T00:18:04.312 INFO:tasks.workunit.client.0.smithi078.stdout:2/996: read d0/d1/d8/f6e [2397004,106038] 0 2024-09-11T00:18:04.312 INFO:tasks.workunit.client.0.smithi078.stdout:2/997: chown d0/d1/d11/d60/da2/d3a 155621 1 2024-09-11T00:18:04.312 INFO:tasks.workunit.client.0.smithi078.stdout:9/992: dwrite dc/d12/d20/d58/d5a/d101/d129/dbb/d13f/d83/f99 [0,4194304] 0 2024-09-11T00:18:04.314 INFO:tasks.workunit.client.0.smithi078.stdout:5/815: getdents d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d90 0 2024-09-11T00:18:04.314 INFO:tasks.workunit.client.0.smithi078.stdout:5/816: stat d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108 0 2024-09-11T00:18:04.320 INFO:tasks.workunit.client.0.smithi078.stdout:7/825: truncate d0/d34/db/d30/d1d/d14/d62/f90 2025776 0 2024-09-11T00:18:04.320 INFO:tasks.workunit.client.0.smithi078.stdout:9/993: dread dc/d12/d46/d51/dcc/dce/d12c/fd5 [0,4194304] 0 2024-09-11T00:18:04.320 INFO:tasks.workunit.client.0.smithi078.stdout:9/994: write dc/d12/d20/d50/dbc/dcf/de1/f47 [900899,119342] 0 2024-09-11T00:18:04.324 INFO:tasks.workunit.client.0.smithi078.stdout:5/817: mknod d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/dd5/c11c 0 2024-09-11T00:18:04.324 INFO:tasks.workunit.client.0.smithi078.stdout:2/998: read d0/d1/d6/d52/d102/f104 [1175916,15449] 0 2024-09-11T00:18:04.325 INFO:tasks.workunit.client.0.smithi078.stdout:0/946: dwrite d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/fb3 [0,4194304] 0 2024-09-11T00:18:04.325 INFO:tasks.workunit.client.0.smithi078.stdout:7/826: creat d0/d34/f100 x:0 0 0 2024-09-11T00:18:04.327 INFO:tasks.workunit.client.0.smithi078.stdout:9/995: rmdir dc/d12/d46/d51/d130 0 2024-09-11T00:18:04.327 INFO:tasks.workunit.client.0.smithi078.stdout:9/996: dread - dc/f135 zero size 2024-09-11T00:18:04.327 INFO:tasks.workunit.client.0.smithi078.stdout:6/924: dwrite d0/d1/d53/d9c/dac/feb [0,4194304] 0 2024-09-11T00:18:04.328 INFO:tasks.workunit.client.0.smithi078.stdout:5/818: symlink d7/d8/d33/d22/d25/d28/d24/d1c/l11d 0 2024-09-11T00:18:04.329 INFO:tasks.workunit.client.0.smithi078.stdout:0/947: mknod d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/dbc/c138 0 2024-09-11T00:18:04.330 INFO:tasks.workunit.client.0.smithi078.stdout:7/827: creat d0/d34/db/da0/f101 x:0 0 0 2024-09-11T00:18:04.331 INFO:tasks.workunit.client.0.smithi078.stdout:9/997: creat dc/d12/d46/f152 x:0 0 0 2024-09-11T00:18:04.333 INFO:tasks.workunit.client.0.smithi078.stdout:5/819: creat d7/d8/d33/d22/dd9/f11e x:0 0 0 2024-09-11T00:18:04.335 INFO:tasks.workunit.client.0.smithi078.stdout:0/948: rename d2/d2a/d2c/d35/d59/dc7/d134 to d2/dbd/d126/d139 0 2024-09-11T00:18:04.338 INFO:tasks.workunit.client.0.smithi078.stdout:9/998: rename dc/d12/d46/d51/dcc/dce/c10e to dc/d12/d20/d30/d14e/c153 0 2024-09-11T00:18:04.339 INFO:tasks.workunit.client.0.smithi078.stdout:9/999: fdatasync dc/d12/d46/d51/fdc 0 2024-09-11T00:18:04.339 INFO:tasks.workunit.client.0.smithi078.stdout:0/949: symlink d2/d2a/l13a 0 2024-09-11T00:18:04.340 INFO:tasks.workunit.client.0.smithi078.stdout:5/820: read d7/d8/d33/d22/dd9/ddf/f9f [3901733,43585] 0 2024-09-11T00:18:04.342 INFO:tasks.workunit.client.0.smithi078.stdout:5/821: creat d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/de3/d102/d11b/f11f x:0 0 0 2024-09-11T00:18:04.342 INFO:tasks.workunit.client.0.smithi078.stdout:5/822: write d7/d8/d33/d22/dd9/f11e [587255,9734] 0 2024-09-11T00:18:04.343 INFO:tasks.workunit.client.0.smithi078.stdout:2/999: dwrite d0/d1/d33/f91 [0,4194304] 0 2024-09-11T00:18:04.351 INFO:tasks.workunit.client.0.smithi078.stdout:6/925: dwrite d0/d1/d1b/fdc [0,4194304] 0 2024-09-11T00:18:04.359 INFO:tasks.workunit.client.0.smithi078.stdout:7/828: dwrite d0/d34/ffc [0,4194304] 0 2024-09-11T00:18:04.362 INFO:tasks.workunit.client.0.smithi078.stdout:7/829: rmdir d0/d34/db/d30/d1d/d14/d62/d93 39 2024-09-11T00:18:04.364 INFO:tasks.workunit.client.0.smithi078.stdout:7/830: unlink d0/d34/db/f51 0 2024-09-11T00:18:04.367 INFO:tasks.workunit.client.0.smithi078.stdout:7/831: link d0/d34/db/d30/d1d/l10 d0/d34/db/d30/d28/l102 0 2024-09-11T00:18:04.368 INFO:tasks.workunit.client.0.smithi078.stdout:7/832: mkdir d0/d34/db/d103 0 2024-09-11T00:18:04.368 INFO:tasks.workunit.client.0.smithi078.stdout:7/833: chown d0/d34/db/l38 3 1 2024-09-11T00:18:04.370 INFO:tasks.workunit.client.0.smithi078.stdout:7/834: unlink d0/d34/db/d30/d28/fc3 0 2024-09-11T00:18:04.371 INFO:tasks.workunit.client.0.smithi078.stdout:0/950: dwrite d2/d2a/d2c/d5e/f68 [4194304,4194304] 0 2024-09-11T00:18:04.371 INFO:tasks.workunit.client.0.smithi078.stdout:0/951: write d2/d2a/d2c/d35/d59/d7/fc2 [3256260,110284] 0 2024-09-11T00:18:04.372 INFO:tasks.workunit.client.0.smithi078.stdout:0/952: mkdir d2/d2a/d2c/d35/d59/d4f/d61/d13b 0 2024-09-11T00:18:04.373 INFO:tasks.workunit.client.0.smithi078.stdout:0/953: mknod d2/d2a/d2c/c13c 0 2024-09-11T00:18:04.374 INFO:tasks.workunit.client.0.smithi078.stdout:0/954: write d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/fcf [1804792,103402] 0 2024-09-11T00:18:04.375 INFO:tasks.workunit.client.0.smithi078.stdout:0/955: symlink d2/d57/d8b/l13d 0 2024-09-11T00:18:04.375 INFO:tasks.workunit.client.0.smithi078.stdout:0/956: truncate d2/d2a/d2c/d35/d59/dc7/fe6 711043 0 2024-09-11T00:18:04.375 INFO:tasks.workunit.client.0.smithi078.stdout:5/823: dwrite d7/f10b [0,4194304] 0 2024-09-11T00:18:04.375 INFO:tasks.workunit.client.0.smithi078.stdout:6/926: dwrite d0/d1/d9/d59/d74/f56 [4194304,4194304] 0 2024-09-11T00:18:04.378 INFO:tasks.workunit.client.0.smithi078.stdout:0/957: creat d2/d2a/d2c/d35/f13e x:0 0 0 2024-09-11T00:18:04.378 INFO:tasks.workunit.client.0.smithi078.stdout:5/824: stat d7/d8/d47/cd8 0 2024-09-11T00:18:04.379 INFO:tasks.workunit.client.0.smithi078.stdout:7/835: read d0/d34/db/f47 [1191236,17924] 0 2024-09-11T00:18:04.381 INFO:tasks.workunit.client.0.smithi078.stdout:5/825: rename d7/d8/d33/d22/d25/d28/da8 to d7/d8/d33/d22/d25/d28/d24/d120 0 2024-09-11T00:18:04.382 INFO:tasks.workunit.client.0.smithi078.stdout:7/836: stat d0/d34/db/d30/d28/dc4/cf3 0 2024-09-11T00:18:04.385 INFO:tasks.workunit.client.0.smithi078.stdout:0/958: dread d2/d2a/d2c/d35/d59/d4f/d61/d69/f1a [0,4194304] 0 2024-09-11T00:18:04.389 INFO:tasks.workunit.client.0.smithi078.stdout:5/826: creat d7/d8/f121 x:0 0 0 2024-09-11T00:18:04.390 INFO:tasks.workunit.client.0.smithi078.stdout:7/837: truncate d0/d34/db/d30/d1d/f2c 3587773 0 2024-09-11T00:18:04.391 INFO:tasks.workunit.client.0.smithi078.stdout:7/838: chown d0/d34/db/d30/d1d/d14/d87/fbd 9 1 2024-09-11T00:18:04.391 INFO:tasks.workunit.client.0.smithi078.stdout:7/839: write d0/d34/db/da0/ff5 [964110,89868] 0 2024-09-11T00:18:04.394 INFO:tasks.workunit.client.0.smithi078.stdout:0/959: creat d2/dbd/f13f x:0 0 0 2024-09-11T00:18:04.398 INFO:tasks.workunit.client.0.smithi078.stdout:7/840: read d0/d34/ffc [3106534,54927] 0 2024-09-11T00:18:04.399 INFO:tasks.workunit.client.0.smithi078.stdout:5/827: mkdir d7/d8/d33/d22/d25/d122 0 2024-09-11T00:18:04.401 INFO:tasks.workunit.client.0.smithi078.stdout:7/841: rename d0/d34/db/d30/d1d/d14/d45/cce to d0/d34/db/d30/d1d/c104 0 2024-09-11T00:18:04.402 INFO:tasks.workunit.client.0.smithi078.stdout:0/960: write d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/f5f [307829,48667] 0 2024-09-11T00:18:04.402 INFO:tasks.workunit.client.0.smithi078.stdout:0/961: chown d2/d2a/d2c/d35/d71/da7/c136 4247427 1 2024-09-11T00:18:04.403 INFO:tasks.workunit.client.0.smithi078.stdout:0/962: chown d2/d2a/d2c/d5e/fc4 4898 1 2024-09-11T00:18:04.408 INFO:tasks.workunit.client.0.smithi078.stdout:0/963: dread d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/fc6 [0,4194304] 0 2024-09-11T00:18:04.408 INFO:tasks.workunit.client.0.smithi078.stdout:0/964: mknod d2/dbd/c140 0 2024-09-11T00:18:04.409 INFO:tasks.workunit.client.0.smithi078.stdout:0/965: creat d2/d2a/d2c/d35/d59/d4f/d61/df2/f141 x:0 0 0 2024-09-11T00:18:04.410 INFO:tasks.workunit.client.0.smithi078.stdout:0/966: link d2/d2a/d2c/d35/d59/d4f/d61/d69/f67 d2/d2a/d2c/d35/d59/de7/f142 0 2024-09-11T00:18:04.412 INFO:tasks.workunit.client.0.smithi078.stdout:0/967: creat d2/d2a/d2c/d35/d59/dc7/f143 x:0 0 0 2024-09-11T00:18:04.412 INFO:tasks.workunit.client.0.smithi078.stdout:0/968: chown d2/d2a/d2c/d35/d59/d7/fd5 1235548 1 2024-09-11T00:18:04.412 INFO:tasks.workunit.client.0.smithi078.stdout:0/969: write d2/d2a/d2c/d35/d59/d4f/d61/d8f/fde [842841,121463] 0 2024-09-11T00:18:04.413 INFO:tasks.workunit.client.0.smithi078.stdout:0/970: write d2/d57/d8b/d107/d116/f11a [122412,72543] 0 2024-09-11T00:18:04.414 INFO:tasks.workunit.client.0.smithi078.stdout:0/971: dread d2/d2a/fab [4194304,4194304] 0 2024-09-11T00:18:04.415 INFO:tasks.workunit.client.0.smithi078.stdout:0/972: rmdir d2/dbd/d126/d139 0 2024-09-11T00:18:04.416 INFO:tasks.workunit.client.0.smithi078.stdout:0/973: truncate d2/d2a/d2c/d35/f78 1136552 0 2024-09-11T00:18:04.416 INFO:tasks.workunit.client.0.smithi078.stdout:0/974: symlink d2/d2a/d2c/l144 0 2024-09-11T00:18:04.417 INFO:tasks.workunit.client.0.smithi078.stdout:0/975: mkdir d2/d57/d145 0 2024-09-11T00:18:04.417 INFO:tasks.workunit.client.0.smithi078.stdout:0/976: write d2/d2a/d2c/d35/d59/d4f/d61/d8f/fd0 [571188,40751] 0 2024-09-11T00:18:04.420 INFO:tasks.workunit.client.0.smithi078.stdout:0/977: dread d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/d56/fcf [0,4194304] 0 2024-09-11T00:18:04.420 INFO:tasks.workunit.client.0.smithi078.stdout:0/978: stat d2/d2a/d2c/l4b 0 2024-09-11T00:18:04.425 INFO:tasks.workunit.client.0.smithi078.stdout:0/979: dread d2/d2a/d2c/d35/d59/d4f/d61/d8f/fde [0,4194304] 0 2024-09-11T00:18:04.426 INFO:tasks.workunit.client.0.smithi078.stdout:0/980: creat d2/d2a/d2c/d35/d59/d7/dd2/f146 x:0 0 0 2024-09-11T00:18:04.426 INFO:tasks.workunit.client.0.smithi078.stdout:0/981: chown d2/d2a/d2c/d35/d59/d4f/d61/d69/d23/dbc/c129 6057337 1 2024-09-11T00:18:04.426 INFO:tasks.workunit.client.0.smithi078.stdout:0/982: symlink d2/d2a/d2c/d35/d59/d7/dd2/l147 0 2024-09-11T00:18:04.427 INFO:tasks.workunit.client.0.smithi078.stdout:0/983: dread - d2/d2a/d2c/d35/d59/dc7/df8/f133 zero size 2024-09-11T00:18:04.428 INFO:tasks.workunit.client.0.smithi078.stdout:0/984: link d2/d57/d8b/fc1 d2/d2a/d2c/d35/d59/d7/d96/db9/f148 0 2024-09-11T00:18:04.429 INFO:tasks.workunit.client.0.smithi078.stdout:0/985: creat d2/d2a/d2c/d35/d59/dc7/f149 x:0 0 0 2024-09-11T00:18:04.429 INFO:tasks.workunit.client.0.smithi078.stdout:0/986: write d2/d2a/d2c/d35/d59/dc7/df8/f12c [2728196,20470] 0 2024-09-11T00:18:04.429 INFO:tasks.workunit.client.0.smithi078.stdout:0/987: dread - d2/d2a/d2c/d35/daf/f122 zero size 2024-09-11T00:18:04.430 INFO:tasks.workunit.client.0.smithi078.stdout:0/988: rename d2/d2a/d2c/d35/d59/d4f/d61/f75 to d2/f14a 0 2024-09-11T00:18:04.431 INFO:tasks.workunit.client.0.smithi078.stdout:0/989: mknod d2/d2a/d2c/d35/d59/d4f/d61/c14b 0 2024-09-11T00:18:04.432 INFO:tasks.workunit.client.0.smithi078.stdout:0/990: creat d2/dbd/d126/f14c x:0 0 0 2024-09-11T00:18:04.432 INFO:tasks.workunit.client.0.smithi078.stdout:0/991: stat d2/d2a/d2c/d35/d59 0 2024-09-11T00:18:04.442 INFO:tasks.workunit.client.0.smithi078.stdout:0/992: fsync d2/dbd/d126/f14c 0 2024-09-11T00:18:04.443 INFO:tasks.workunit.client.0.smithi078.stdout:0/993: symlink d2/d2a/d2c/d35/d59/d4f/d61/df2/l14d 0 2024-09-11T00:18:04.443 INFO:tasks.workunit.client.0.smithi078.stdout:0/994: dread - d2/d2a/d2c/d35/d59/dc7/f149 zero size 2024-09-11T00:18:04.454 INFO:tasks.workunit.client.0.smithi078.stdout:0/995: dwrite d2/dbd/d126/f12f [0,4194304] 0 2024-09-11T00:18:04.456 INFO:tasks.workunit.client.0.smithi078.stdout:0/996: mkdir d2/d2a/d2c/d35/d59/d7/d96/db9/d14e 0 2024-09-11T00:18:04.456 INFO:tasks.workunit.client.0.smithi078.stdout:0/997: chown d2/d2a/d2c/d35/d59/d4f/d61/d69 1448104 1 2024-09-11T00:18:04.456 INFO:tasks.workunit.client.0.smithi078.stdout:0/998: getdents d2/d2a/d2c/d35/d59/de7 0 2024-09-11T00:18:04.456 INFO:tasks.workunit.client.0.smithi078.stdout:0/999: stat d2/la4 0 2024-09-11T00:18:04.472 INFO:tasks.workunit.client.0.smithi078.stdout:3/943: sync 2024-09-11T00:18:04.472 INFO:tasks.workunit.client.0.smithi078.stdout:3/944: fdatasync d0/d7/d18/d70/df5/f111 0 2024-09-11T00:18:04.473 INFO:tasks.workunit.client.0.smithi078.stdout:3/945: mkdir d0/d7/d18/d70/df5/d103/d114 0 2024-09-11T00:18:04.486 INFO:tasks.workunit.client.0.smithi078.stdout:3/946: dwrite d0/f10 [0,4194304] 0 2024-09-11T00:18:04.486 INFO:tasks.workunit.client.0.smithi078.stdout:3/947: getdents d0/d7/d18/d70/dec 0 2024-09-11T00:18:04.486 INFO:tasks.workunit.client.0.smithi078.stdout:3/948: fsync d0/d7/d46/d86/d9a/fa2 0 2024-09-11T00:18:04.486 INFO:tasks.workunit.client.0.smithi078.stdout:3/949: chown d0/d7/d18/dd8/d60 2 1 2024-09-11T00:18:04.491 INFO:tasks.workunit.client.0.smithi078.stdout:7/842: sync 2024-09-11T00:18:04.491 INFO:tasks.workunit.client.0.smithi078.stdout:6/927: sync 2024-09-11T00:18:04.492 INFO:tasks.workunit.client.0.smithi078.stdout:5/828: sync 2024-09-11T00:18:04.492 INFO:tasks.workunit.client.0.smithi078.stdout:6/928: chown d0/d1/d9/cdd 29523 1 2024-09-11T00:18:04.493 INFO:tasks.workunit.client.0.smithi078.stdout:5/829: rename d7/c15 to d7/d8/d33/d22/d25/c123 0 2024-09-11T00:18:04.493 INFO:tasks.workunit.client.0.smithi078.stdout:5/830: chown d7/d8/d33 13744 1 2024-09-11T00:18:04.493 INFO:tasks.workunit.client.0.smithi078.stdout:5/831: read d7/d8/d33/d22/d25/d6a/f6b [1407148,125668] 0 2024-09-11T00:18:04.493 INFO:tasks.workunit.client.0.smithi078.stdout:6/929: truncate d0/fc 1834190 0 2024-09-11T00:18:04.494 INFO:tasks.workunit.client.0.smithi078.stdout:5/832: creat d7/d8/d47/d52/df0/f124 x:0 0 0 2024-09-11T00:18:04.495 INFO:tasks.workunit.client.0.smithi078.stdout:6/930: link d0/d1/d9/d59/cc3 d0/d1/d9/d59/d74/db3/dd5/d111/c134 0 2024-09-11T00:18:04.497 INFO:tasks.workunit.client.0.smithi078.stdout:3/950: write d0/d7/d18/fbb [3917617,97764] 0 2024-09-11T00:18:04.497 INFO:tasks.workunit.client.0.smithi078.stdout:5/833: creat d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d2c/f125 x:0 0 0 2024-09-11T00:18:04.498 INFO:tasks.workunit.client.0.smithi078.stdout:5/834: truncate d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d2c/f94 565480 0 2024-09-11T00:18:04.500 INFO:tasks.workunit.client.0.smithi078.stdout:7/843: write d0/d34/db/f5c [5651680,9601] 0 2024-09-11T00:18:04.500 INFO:tasks.workunit.client.0.smithi078.stdout:7/844: truncate d0/d34/db/d32/fb4 466156 0 2024-09-11T00:18:04.500 INFO:tasks.workunit.client.0.smithi078.stdout:7/845: chown d0/d34/db/d30/fda 16 1 2024-09-11T00:18:04.500 INFO:tasks.workunit.client.0.smithi078.stdout:7/846: stat d0/d34/db/d30/d1d/db0/dd2/ld3 0 2024-09-11T00:18:04.500 INFO:tasks.workunit.client.0.smithi078.stdout:5/835: link d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d90/f118 d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/de3/d102/d11b/f126 0 2024-09-11T00:18:04.502 INFO:tasks.workunit.client.0.smithi078.stdout:7/847: creat d0/d34/db/f105 x:0 0 0 2024-09-11T00:18:04.506 INFO:tasks.workunit.client.0.smithi078.stdout:7/848: creat d0/d3f/f106 x:0 0 0 2024-09-11T00:18:04.507 INFO:tasks.workunit.client.0.smithi078.stdout:3/951: read d0/d7/d23/d91/fa9 [4060563,109422] 0 2024-09-11T00:18:04.507 INFO:tasks.workunit.client.0.smithi078.stdout:7/849: truncate d0/d34/db/f47 2523594 0 2024-09-11T00:18:04.507 INFO:tasks.workunit.client.0.smithi078.stdout:7/850: chown d0/d34/db/d30/d1d/fa5 0 1 2024-09-11T00:18:04.508 INFO:tasks.workunit.client.0.smithi078.stdout:7/851: truncate d0/d34/db/d30/d1d/d14/ffd 599945 0 2024-09-11T00:18:04.508 INFO:tasks.workunit.client.0.smithi078.stdout:3/952: creat d0/d7/d18/d70/f115 x:0 0 0 2024-09-11T00:18:04.510 INFO:tasks.workunit.client.0.smithi078.stdout:3/953: link d0/d7/d23/d7c/db7/de8/c44 d0/d7/d18/c116 0 2024-09-11T00:18:04.510 INFO:tasks.workunit.client.0.smithi078.stdout:3/954: rmdir d0/d7/d23/d7c/db7/de8 39 2024-09-11T00:18:04.511 INFO:tasks.workunit.client.0.smithi078.stdout:3/955: symlink d0/d7/d18/d70/dec/l117 0 2024-09-11T00:18:04.512 INFO:tasks.workunit.client.0.smithi078.stdout:3/956: write d0/d7/d18/f6e [1413163,24288] 0 2024-09-11T00:18:04.512 INFO:tasks.workunit.client.0.smithi078.stdout:3/957: getdents d0/d7/d18/dd8/d3e 0 2024-09-11T00:18:04.512 INFO:tasks.workunit.client.0.smithi078.stdout:3/958: write d0/d7/d23/d7c/fde [1246653,4620] 0 2024-09-11T00:18:04.513 INFO:tasks.workunit.client.0.smithi078.stdout:3/959: mknod d0/d39/c118 0 2024-09-11T00:18:04.513 INFO:tasks.workunit.client.0.smithi078.stdout:3/960: chown d0/d1a 987386 1 2024-09-11T00:18:04.513 INFO:tasks.workunit.client.0.smithi078.stdout:5/836: dwrite d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d8c/fab [0,4194304] 0 2024-09-11T00:18:04.514 INFO:tasks.workunit.client.0.smithi078.stdout:7/852: dread d0/d3f/fd8 [0,4194304] 0 2024-09-11T00:18:04.516 INFO:tasks.workunit.client.0.smithi078.stdout:3/961: truncate d0/f65 1526952 0 2024-09-11T00:18:04.516 INFO:tasks.workunit.client.0.smithi078.stdout:3/962: read d0/d7/d23/f2d [2423333,66722] 0 2024-09-11T00:18:04.516 INFO:tasks.workunit.client.0.smithi078.stdout:3/963: fdatasync d0/d7/d46/d86/fc9 0 2024-09-11T00:18:04.516 INFO:tasks.workunit.client.0.smithi078.stdout:3/964: read - d0/fe6 zero size 2024-09-11T00:18:04.517 INFO:tasks.workunit.client.0.smithi078.stdout:5/837: rename d7/d8/d47/d52/df0 to d7/d8/d33/d22/dd9/ddf/d127 0 2024-09-11T00:18:04.517 INFO:tasks.workunit.client.0.smithi078.stdout:5/838: chown d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/l5c 15 1 2024-09-11T00:18:04.518 INFO:tasks.workunit.client.0.smithi078.stdout:7/853: mknod d0/d34/db/d30/d1d/db0/dd2/c107 0 2024-09-11T00:18:04.518 INFO:tasks.workunit.client.0.smithi078.stdout:7/854: truncate d0/d34/db/d30/f53 453816 0 2024-09-11T00:18:04.519 INFO:tasks.workunit.client.0.smithi078.stdout:3/965: creat d0/d7/d18/d8c/f119 x:0 0 0 2024-09-11T00:18:04.520 INFO:tasks.workunit.client.0.smithi078.stdout:7/855: symlink d0/d34/db/d30/d1d/d14/d45/l108 0 2024-09-11T00:18:04.523 INFO:tasks.workunit.client.0.smithi078.stdout:3/966: truncate d0/d7/d46/f5b 745998 0 2024-09-11T00:18:04.525 INFO:tasks.workunit.client.0.smithi078.stdout:7/856: symlink d0/d34/db/d30/d1d/d14/d45/l109 0 2024-09-11T00:18:04.525 INFO:tasks.workunit.client.0.smithi078.stdout:3/967: rmdir d0/d7/d23 39 2024-09-11T00:18:04.528 INFO:tasks.workunit.client.0.smithi078.stdout:7/857: rename d0/f29 to d0/d34/d86/f10a 0 2024-09-11T00:18:04.528 INFO:tasks.workunit.client.0.smithi078.stdout:7/858: stat d0/d34/db/d32/f94 0 2024-09-11T00:18:04.528 INFO:tasks.workunit.client.0.smithi078.stdout:7/859: readlink d0/d34/db/d30/d28/l3b 0 2024-09-11T00:18:04.529 INFO:tasks.workunit.client.0.smithi078.stdout:3/968: creat d0/d7/d46/d86/f11a x:0 0 0 2024-09-11T00:18:04.529 INFO:tasks.workunit.client.0.smithi078.stdout:3/969: fsync d0/d7/d18/d70/fb3 0 2024-09-11T00:18:04.532 INFO:tasks.workunit.client.0.smithi078.stdout:7/860: link d0/d34/db/d30/d1d/d14/d87/ca6 d0/d34/db/d30/d1d/d14/d62/c10b 0 2024-09-11T00:18:04.533 INFO:tasks.workunit.client.0.smithi078.stdout:5/839: dwrite d7/d8/d33/d22/d25/d28/d24/d1c/fd3 [0,4194304] 0 2024-09-11T00:18:04.534 INFO:tasks.workunit.client.0.smithi078.stdout:5/840: truncate d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/fff 808191 0 2024-09-11T00:18:04.539 INFO:tasks.workunit.client.0.smithi078.stdout:3/970: write d0/d7/d23/d7c/db7/de8/f54 [1798603,5761] 0 2024-09-11T00:18:04.546 INFO:tasks.workunit.client.0.smithi078.stdout:3/971: dread d0/d7/d18/d1b/d8e/fef [0,4194304] 0 2024-09-11T00:18:04.547 INFO:tasks.workunit.client.0.smithi078.stdout:3/972: rmdir d0/d7/d18/d70 39 2024-09-11T00:18:04.547 INFO:tasks.workunit.client.0.smithi078.stdout:3/973: mkdir d0/d7/d18/d70/df5/d103/d114/d11b 0 2024-09-11T00:18:04.548 INFO:tasks.workunit.client.0.smithi078.stdout:7/861: dwrite d0/d34/db/f96 [0,4194304] 0 2024-09-11T00:18:04.552 INFO:tasks.workunit.client.0.smithi078.stdout:5/841: dwrite d7/d8/d33/d22/d25/d6a/f6e [0,4194304] 0 2024-09-11T00:18:04.552 INFO:tasks.workunit.client.0.smithi078.stdout:5/842: chown d7/d8/d33/d22 2509 1 2024-09-11T00:18:04.552 INFO:tasks.workunit.client.0.smithi078.stdout:3/974: link d0/d7/d18/d8c/fee d0/d7/d23/d91/f11c 0 2024-09-11T00:18:04.553 INFO:tasks.workunit.client.0.smithi078.stdout:5/843: mknod d7/d8/d33/d22/d25/d28/c128 0 2024-09-11T00:18:04.554 INFO:tasks.workunit.client.0.smithi078.stdout:3/975: symlink d0/d7/d23/d7c/db7/l11d 0 2024-09-11T00:18:04.569 INFO:tasks.workunit.client.0.smithi078.stdout:7/862: dwrite d0/d34/db/f5a [0,4194304] 0 2024-09-11T00:18:04.572 INFO:tasks.workunit.client.0.smithi078.stdout:7/863: creat d0/d34/db/d30/d1d/d14/d45/f10c x:0 0 0 2024-09-11T00:18:04.572 INFO:tasks.workunit.client.0.smithi078.stdout:7/864: truncate d0/d34/db/d30/d1d/d14/d87/dc5/ff9 1009364 0 2024-09-11T00:18:04.574 INFO:tasks.workunit.client.0.smithi078.stdout:5/844: dwrite d7/d8/d33/d22/d25/d28/d24/f4d [0,4194304] 0 2024-09-11T00:18:04.576 INFO:tasks.workunit.client.0.smithi078.stdout:3/976: dwrite d0/d7/d18/ffc [0,4194304] 0 2024-09-11T00:18:04.576 INFO:tasks.workunit.client.0.smithi078.stdout:5/845: creat d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/de3/d102/f129 x:0 0 0 2024-09-11T00:18:04.576 INFO:tasks.workunit.client.0.smithi078.stdout:5/846: truncate d7/d8/d33/d22/d25/d28/d24/d1c/d1e/fa2 924841 0 2024-09-11T00:18:04.580 INFO:tasks.workunit.client.0.smithi078.stdout:3/977: getdents d0/d7/d46/d86/d9a/de9/df9 0 2024-09-11T00:18:04.582 INFO:tasks.workunit.client.0.smithi078.stdout:5/847: creat d7/d8/d33/d22/d25/d6a/f12a x:0 0 0 2024-09-11T00:18:04.584 INFO:tasks.workunit.client.0.smithi078.stdout:5/848: creat d7/d8/d47/ddd/f12b x:0 0 0 2024-09-11T00:18:04.584 INFO:tasks.workunit.client.0.smithi078.stdout:7/865: write d0/d34/db/d30/f27 [6047975,66301] 0 2024-09-11T00:18:04.587 INFO:tasks.workunit.client.0.smithi078.stdout:7/866: link d0/l23 d0/d34/d86/l10d 0 2024-09-11T00:18:04.588 INFO:tasks.workunit.client.0.smithi078.stdout:7/867: dread d0/d34/db/f7c [0,4194304] 0 2024-09-11T00:18:04.590 INFO:tasks.workunit.client.0.smithi078.stdout:7/868: dread d0/d34/d65/fc6 [0,4194304] 0 2024-09-11T00:18:04.590 INFO:tasks.workunit.client.0.smithi078.stdout:7/869: dread - d0/d34/db/d30/d1d/d14/d45/f7f zero size 2024-09-11T00:18:04.591 INFO:tasks.workunit.client.0.smithi078.stdout:6/931: sync 2024-09-11T00:18:04.592 INFO:tasks.workunit.client.0.smithi078.stdout:6/932: symlink d0/d1/d53/d72/dcc/l135 0 2024-09-11T00:18:04.594 INFO:tasks.workunit.client.0.smithi078.stdout:5/849: write d7/d8/f77 [6214,50142] 0 2024-09-11T00:18:04.594 INFO:tasks.workunit.client.0.smithi078.stdout:5/850: dread - d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d90/f105 zero size 2024-09-11T00:18:04.594 INFO:tasks.workunit.client.0.smithi078.stdout:6/933: rename d0/d1/d9/d17 to d0/d1/d53/d9c/db6/de5/dec/d136 0 2024-09-11T00:18:04.594 INFO:tasks.workunit.client.0.smithi078.stdout:6/934: chown d0/d1/d1b/c36 52604 1 2024-09-11T00:18:04.595 INFO:tasks.workunit.client.0.smithi078.stdout:5/851: symlink d7/d8/d33/d22/d25/d122/l12c 0 2024-09-11T00:18:04.597 INFO:tasks.workunit.client.0.smithi078.stdout:3/978: dwrite d0/d1a/d77/f109 [0,4194304] 0 2024-09-11T00:18:04.597 INFO:tasks.workunit.client.0.smithi078.stdout:5/852: mkdir d7/d8/d33/d22/d25/db1/d12d 0 2024-09-11T00:18:04.597 INFO:tasks.workunit.client.0.smithi078.stdout:5/853: write d7/d8/d33/d22/d25/d28/d24/d1c/d1e/fa2 [1865480,12347] 0 2024-09-11T00:18:04.597 INFO:tasks.workunit.client.0.smithi078.stdout:5/854: dread - d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d2c/f11a zero size 2024-09-11T00:18:04.597 INFO:tasks.workunit.client.0.smithi078.stdout:3/979: rmdir d0/d7/d18 39 2024-09-11T00:18:04.598 INFO:tasks.workunit.client.0.smithi078.stdout:5/855: truncate d7/d8/d33/d22/dd9/ddf/dc5/f76 4006246 0 2024-09-11T00:18:04.598 INFO:tasks.workunit.client.0.smithi078.stdout:5/856: read d7/d8/d33/d22/d51/faf [2932688,49169] 0 2024-09-11T00:18:04.599 INFO:tasks.workunit.client.0.smithi078.stdout:5/857: truncate d7/d8/d33/d22/d25/d28/d24/d120/fee 1200146 0 2024-09-11T00:18:04.599 INFO:tasks.workunit.client.0.smithi078.stdout:7/870: dread d0/d34/d65/f8d [0,4194304] 0 2024-09-11T00:18:04.600 INFO:tasks.workunit.client.0.smithi078.stdout:5/858: rename d7/d8/d33/d22/dd9/ddf/dc5/dc8/fd6 to d7/d8/d33/d22/d25/d28/f12e 0 2024-09-11T00:18:04.600 INFO:tasks.workunit.client.0.smithi078.stdout:5/859: chown d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d90/c107 3 1 2024-09-11T00:18:04.601 INFO:tasks.workunit.client.0.smithi078.stdout:7/871: getdents d0/d34/db/d30/d1d/db0 0 2024-09-11T00:18:04.602 INFO:tasks.workunit.client.0.smithi078.stdout:5/860: rename d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/l5c to d7/d8/d33/l12f 0 2024-09-11T00:18:04.603 INFO:tasks.workunit.client.0.smithi078.stdout:6/935: write d0/d1/d53/d9c/dac/de3/f11f [5074151,33128] 0 2024-09-11T00:18:04.604 INFO:tasks.workunit.client.0.smithi078.stdout:7/872: rename d0/d34/db/d30/d28/fac to d0/d34/db/da0/f10e 0 2024-09-11T00:18:04.604 INFO:tasks.workunit.client.0.smithi078.stdout:7/873: write d0/d34/db/f96 [4284490,84991] 0 2024-09-11T00:18:04.605 INFO:tasks.workunit.client.0.smithi078.stdout:7/874: truncate d0/d34/db/fb3 737514 0 2024-09-11T00:18:04.605 INFO:tasks.workunit.client.0.smithi078.stdout:7/875: link d0/d34/db/d32/lb9 d0/d34/db/d30/l10f 0 2024-09-11T00:18:04.605 INFO:tasks.workunit.client.0.smithi078.stdout:7/876: truncate d0/d34/db/fbc 1178273 0 2024-09-11T00:18:04.606 INFO:tasks.workunit.client.0.smithi078.stdout:7/877: mknod d0/d34/d65/c110 0 2024-09-11T00:18:04.607 INFO:tasks.workunit.client.0.smithi078.stdout:7/878: mkdir d0/d34/db/d30/d1d/d14/d111 0 2024-09-11T00:18:04.607 INFO:tasks.workunit.client.0.smithi078.stdout:7/879: chown d0/d34/d57 19788429 1 2024-09-11T00:18:04.608 INFO:tasks.workunit.client.0.smithi078.stdout:3/980: dread d0/d1a/f3b [0,4194304] 0 2024-09-11T00:18:04.608 INFO:tasks.workunit.client.0.smithi078.stdout:6/936: write d0/d1/f52 [3098630,97788] 0 2024-09-11T00:18:04.609 INFO:tasks.workunit.client.0.smithi078.stdout:3/981: mknod d0/d7/d23/d7c/db7/de8/dfe/c11e 0 2024-09-11T00:18:04.610 INFO:tasks.workunit.client.0.smithi078.stdout:6/937: mkdir d0/d1/d137 0 2024-09-11T00:18:04.611 INFO:tasks.workunit.client.0.smithi078.stdout:5/861: dread d7/d8/d33/d22/d25/d28/d24/d1c/d1e/fa2 [0,4194304] 0 2024-09-11T00:18:04.612 INFO:tasks.workunit.client.0.smithi078.stdout:3/982: link d0/d7/d18/d1b/fbd d0/d7/d18/f11f 0 2024-09-11T00:18:04.613 INFO:tasks.workunit.client.0.smithi078.stdout:3/983: truncate d0/f62 2944204 0 2024-09-11T00:18:04.613 INFO:tasks.workunit.client.0.smithi078.stdout:3/984: chown d0/d7/d18/d1b 936159 1 2024-09-11T00:18:04.615 INFO:tasks.workunit.client.0.smithi078.stdout:3/985: creat d0/d7/d46/d86/f120 x:0 0 0 2024-09-11T00:18:04.615 INFO:tasks.workunit.client.0.smithi078.stdout:3/986: readlink d0/d7/d18/d1b/d8e/la0 0 2024-09-11T00:18:04.615 INFO:tasks.workunit.client.0.smithi078.stdout:7/880: dread d0/d34/db/d30/d1d/f17 [0,4194304] 0 2024-09-11T00:18:04.616 INFO:tasks.workunit.client.0.smithi078.stdout:3/987: rmdir d0/d7/d46/d86/d9a/de9/df9 39 2024-09-11T00:18:04.616 INFO:tasks.workunit.client.0.smithi078.stdout:3/988: fsync d0/d7/d23/d91/f32 0 2024-09-11T00:18:04.616 INFO:tasks.workunit.client.0.smithi078.stdout:3/989: dread - d0/d7/d23/d7c/db7/de8/fbe zero size 2024-09-11T00:18:04.617 INFO:tasks.workunit.client.0.smithi078.stdout:6/938: dread d0/fc5 [0,4194304] 0 2024-09-11T00:18:04.617 INFO:tasks.workunit.client.0.smithi078.stdout:7/881: symlink d0/d34/d65/l112 0 2024-09-11T00:18:04.619 INFO:tasks.workunit.client.0.smithi078.stdout:3/990: link d0/d7/d23/c2b d0/d7/d46/d86/d9a/c121 0 2024-09-11T00:18:04.621 INFO:tasks.workunit.client.0.smithi078.stdout:6/939: unlink d0/d1/d9/d59/d74/ce9 0 2024-09-11T00:18:04.621 INFO:tasks.workunit.client.0.smithi078.stdout:6/940: dread - d0/ffe zero size 2024-09-11T00:18:04.622 INFO:tasks.workunit.client.0.smithi078.stdout:6/941: readlink d0/d1/d53/d72/de4/l126 0 2024-09-11T00:18:04.622 INFO:tasks.workunit.client.0.smithi078.stdout:6/942: write d0/d1/d53/d9c/fbc [846426,7380] 0 2024-09-11T00:18:04.622 INFO:tasks.workunit.client.0.smithi078.stdout:6/943: fsync d0/d1/d9/d54/f6e 0 2024-09-11T00:18:04.623 INFO:tasks.workunit.client.0.smithi078.stdout:3/991: rename d0/d1a/d77/la4 to d0/d7/d23/l122 0 2024-09-11T00:18:04.625 INFO:tasks.workunit.client.0.smithi078.stdout:6/944: link d0/d1/d53/d72/dcc/l135 d0/d1/d1b/l138 0 2024-09-11T00:18:04.625 INFO:tasks.workunit.client.0.smithi078.stdout:6/945: readlink d0/l1e 0 2024-09-11T00:18:04.625 INFO:tasks.workunit.client.0.smithi078.stdout:6/946: write d0/d1/d53/d72/dcc/fe7 [874105,54078] 0 2024-09-11T00:18:04.627 INFO:tasks.workunit.client.0.smithi078.stdout:3/992: unlink d0/d7/d18/dd8/d60/fba 0 2024-09-11T00:18:04.629 INFO:tasks.workunit.client.0.smithi078.stdout:6/947: dread d0/d1/d1b/fae [0,4194304] 0 2024-09-11T00:18:04.629 INFO:tasks.workunit.client.0.smithi078.stdout:5/862: dwrite d7/d8/d33/d22/dd9/ddf/dc5/dc8/f111 [0,4194304] 0 2024-09-11T00:18:04.629 INFO:tasks.workunit.client.0.smithi078.stdout:5/863: truncate d7/d8/d33/d22/dd9/ddf/dc5/dc8/f100 781212 0 2024-09-11T00:18:04.630 INFO:tasks.workunit.client.0.smithi078.stdout:6/948: getdents d0/d1/d53/d9c/dac/de3 0 2024-09-11T00:18:04.632 INFO:tasks.workunit.client.0.smithi078.stdout:5/864: creat d7/d8/d33/d22/d51/f130 x:0 0 0 2024-09-11T00:18:04.632 INFO:tasks.workunit.client.0.smithi078.stdout:5/865: write d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/fac [4666323,131036] 0 2024-09-11T00:18:04.632 INFO:tasks.workunit.client.0.smithi078.stdout:5/866: readlink d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d90/le4 0 2024-09-11T00:18:04.634 INFO:tasks.workunit.client.0.smithi078.stdout:6/949: creat d0/d1/da8/f139 x:0 0 0 2024-09-11T00:18:04.637 INFO:tasks.workunit.client.0.smithi078.stdout:7/882: dwrite d0/d34/db/fb3 [0,4194304] 0 2024-09-11T00:18:04.637 INFO:tasks.workunit.client.0.smithi078.stdout:7/883: readlink d0/d34/db/d30/d28/l3b 0 2024-09-11T00:18:04.643 INFO:tasks.workunit.client.0.smithi078.stdout:3/993: dwrite d0/d1a/f52 [0,4194304] 0 2024-09-11T00:18:04.649 INFO:tasks.workunit.client.0.smithi078.stdout:7/884: dread d0/d3f/f60 [0,4194304] 0 2024-09-11T00:18:04.650 INFO:tasks.workunit.client.0.smithi078.stdout:3/994: rename d0/d7/d23/d7c/db7/fe1 to d0/d7/d46/d86/d9a/de9/f123 0 2024-09-11T00:18:04.653 INFO:tasks.workunit.client.0.smithi078.stdout:6/950: truncate d0/d1/f32 5504431 0 2024-09-11T00:18:04.654 INFO:tasks.workunit.client.0.smithi078.stdout:6/951: creat d0/d66/f13a x:0 0 0 2024-09-11T00:18:04.656 INFO:tasks.workunit.client.0.smithi078.stdout:6/952: link d0/d1/d9/d59/d74/db3/fcf d0/d1/d53/d72/f13b 0 2024-09-11T00:18:04.662 INFO:tasks.workunit.client.0.smithi078.stdout:6/953: dread d0/d1/d53/d9c/dac/fb7 [0,4194304] 0 2024-09-11T00:18:04.663 INFO:tasks.workunit.client.0.smithi078.stdout:6/954: truncate d0/f3b 3711060 0 2024-09-11T00:18:04.669 INFO:tasks.workunit.client.0.smithi078.stdout:7/885: dwrite d0/d34/d86/fc7 [0,4194304] 0 2024-09-11T00:18:04.669 INFO:tasks.workunit.client.0.smithi078.stdout:7/886: mkdir d0/d34/d86/d113 0 2024-09-11T00:18:04.681 INFO:tasks.workunit.client.0.smithi078.stdout:6/955: dwrite d0/d1/d53/d72/f13b [0,4194304] 0 2024-09-11T00:18:04.684 INFO:tasks.workunit.client.0.smithi078.stdout:7/887: dwrite d0/d34/db/f8e [0,4194304] 0 2024-09-11T00:18:04.684 INFO:tasks.workunit.client.0.smithi078.stdout:7/888: fdatasync d0/d34/db/da0/f10e 0 2024-09-11T00:18:04.684 INFO:tasks.workunit.client.0.smithi078.stdout:7/889: truncate d0/d34/db/da0/f10e 711832 0 2024-09-11T00:18:04.685 INFO:tasks.workunit.client.0.smithi078.stdout:6/956: rename d0/d1/d53/d72/le8 to d0/d1/da8/l13c 0 2024-09-11T00:18:04.685 INFO:tasks.workunit.client.0.smithi078.stdout:7/890: mknod d0/d34/db/d30/d1d/d14/d87/dc5/c114 0 2024-09-11T00:18:04.687 INFO:tasks.workunit.client.0.smithi078.stdout:7/891: dread d0/d34/d86/ff7 [0,4194304] 0 2024-09-11T00:18:04.702 INFO:tasks.workunit.client.0.smithi078.stdout:6/957: dwrite d0/d1/d53/d9c/db6/de5/dec/d136/d5e/fb2 [0,4194304] 0 2024-09-11T00:18:04.704 INFO:tasks.workunit.client.0.smithi078.stdout:6/958: mknod d0/d1/d137/c13d 0 2024-09-11T00:18:04.704 INFO:tasks.workunit.client.0.smithi078.stdout:6/959: truncate d0/d66/f13a 952130 0 2024-09-11T00:18:04.704 INFO:tasks.workunit.client.0.smithi078.stdout:6/960: dread - d0/d1/d53/d9c/db6/de5/f129 zero size 2024-09-11T00:18:04.711 INFO:tasks.workunit.client.0.smithi078.stdout:7/892: dwrite d0/d3f/f9e [4194304,4194304] 0 2024-09-11T00:18:04.711 INFO:tasks.workunit.client.0.smithi078.stdout:7/893: write d0/d34/db/d32/f3a [3688503,53898] 0 2024-09-11T00:18:04.714 INFO:tasks.workunit.client.0.smithi078.stdout:7/894: link d0/d3f/c4e d0/da7/ddf/c115 0 2024-09-11T00:18:04.715 INFO:tasks.workunit.client.0.smithi078.stdout:7/895: mkdir d0/d34/db/d30/d1d/d14/d45/d116 0 2024-09-11T00:18:04.717 INFO:tasks.workunit.client.0.smithi078.stdout:7/896: link d0/d34/d65/fc8 d0/d34/d65/f117 0 2024-09-11T00:18:04.718 INFO:tasks.workunit.client.0.smithi078.stdout:7/897: mknod d0/d34/db/d30/d28/dc4/c118 0 2024-09-11T00:18:04.719 INFO:tasks.workunit.client.0.smithi078.stdout:7/898: dread d0/d34/db/fbc [0,4194304] 0 2024-09-11T00:18:04.719 INFO:tasks.workunit.client.0.smithi078.stdout:7/899: fsync d0/d34/db/da0/fad 0 2024-09-11T00:18:04.719 INFO:tasks.workunit.client.0.smithi078.stdout:7/900: dread - d0/d34/db/d30/d1d/d14/d87/fe6 zero size 2024-09-11T00:18:04.721 INFO:tasks.workunit.client.0.smithi078.stdout:7/901: mkdir d0/da7/ddf/d119 0 2024-09-11T00:18:04.721 INFO:tasks.workunit.client.0.smithi078.stdout:6/961: dwrite d0/d1/d9/d54/f6e [4194304,4194304] 0 2024-09-11T00:18:04.722 INFO:tasks.workunit.client.0.smithi078.stdout:6/962: dread d0/d1/d53/d9c/dac/fb9 [0,4194304] 0 2024-09-11T00:18:04.722 INFO:tasks.workunit.client.0.smithi078.stdout:6/963: mkdir d0/d1/d53/d9c/d13e 0 2024-09-11T00:18:04.724 INFO:tasks.workunit.client.0.smithi078.stdout:7/902: getdents d0/da7/ddf 0 2024-09-11T00:18:04.727 INFO:tasks.workunit.client.0.smithi078.stdout:6/964: write d0/d1/d9/d59/d74/fcb [2642304,43593] 0 2024-09-11T00:18:04.728 INFO:tasks.workunit.client.0.smithi078.stdout:6/965: dread d0/d1/d9/d59/d74/d6b/fa9 [0,4194304] 0 2024-09-11T00:18:04.735 INFO:tasks.workunit.client.0.smithi078.stdout:6/966: dread d0/d1/d53/d9c/db6/de5/dec/d136/f58 [4194304,4194304] 0 2024-09-11T00:18:04.735 INFO:tasks.workunit.client.0.smithi078.stdout:6/967: write d0/d1/d9/d8d/f104 [109949,102279] 0 2024-09-11T00:18:04.735 INFO:tasks.workunit.client.0.smithi078.stdout:6/968: stat d0/d1/d9/d54 0 2024-09-11T00:18:04.747 INFO:tasks.workunit.client.0.smithi078.stdout:6/969: dwrite d0/d1/d9/f4a [0,4194304] 0 2024-09-11T00:18:04.747 INFO:tasks.workunit.client.0.smithi078.stdout:6/970: read - d0/d1/da8/f139 zero size 2024-09-11T00:18:04.747 INFO:tasks.workunit.client.0.smithi078.stdout:6/971: write d0/ffc [974183,105021] 0 2024-09-11T00:18:04.747 INFO:tasks.workunit.client.0.smithi078.stdout:6/972: dread - d0/d1/d53/fee zero size 2024-09-11T00:18:04.788 INFO:tasks.workunit.client.0.smithi078.stdout:5/867: sync 2024-09-11T00:18:04.789 INFO:tasks.workunit.client.0.smithi078.stdout:5/868: creat d7/d8/d33/d22/dd9/ddf/dc5/dc8/d2a/f131 x:0 0 0 2024-09-11T00:18:04.790 INFO:tasks.workunit.client.0.smithi078.stdout:5/869: creat d7/d8/d33/d22/d25/d28/d24/d120/f132 x:0 0 0 2024-09-11T00:18:04.792 INFO:tasks.workunit.client.0.smithi078.stdout:5/870: rename d7/d8/d33/d22/dd9/ddf/dc5/f76 to d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/de3/d102/d11b/f133 0 2024-09-11T00:18:04.793 INFO:tasks.workunit.client.0.smithi078.stdout:5/871: creat d7/d8/d33/d22/dd9/ddf/dc5/dc8/f134 x:0 0 0 2024-09-11T00:18:04.795 INFO:tasks.workunit.client.0.smithi078.stdout:5/872: getdents d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/de3/d102/d11b 0 2024-09-11T00:18:04.796 INFO:tasks.workunit.client.0.smithi078.stdout:5/873: write d7/d8/d33/d22/dd9/ddf/dc5/fdc [1056421,120632] 0 2024-09-11T00:18:04.796 INFO:tasks.workunit.client.0.smithi078.stdout:5/874: chown d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/de3/d102 397 1 2024-09-11T00:18:04.796 INFO:tasks.workunit.client.0.smithi078.stdout:5/875: write d7/d8/d33/d22/dd9/ddf/dc5/dc8/d2a/f131 [208840,78255] 0 2024-09-11T00:18:04.801 INFO:tasks.workunit.client.0.smithi078.stdout:5/876: read d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d2c/d62/ffe [2195188,52486] 0 2024-09-11T00:18:04.802 INFO:tasks.workunit.client.0.smithi078.stdout:5/877: fsync d7/d8/d33/d22/fcc 0 2024-09-11T00:18:04.802 INFO:tasks.workunit.client.0.smithi078.stdout:5/878: mknod d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d2c/c135 0 2024-09-11T00:18:04.803 INFO:tasks.workunit.client.0.smithi078.stdout:5/879: truncate d7/d8/f121 113063 0 2024-09-11T00:18:04.803 INFO:tasks.workunit.client.0.smithi078.stdout:5/880: creat d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/dfc/f136 x:0 0 0 2024-09-11T00:18:04.804 INFO:tasks.workunit.client.0.smithi078.stdout:5/881: symlink d7/d8/d33/d22/d25/l137 0 2024-09-11T00:18:04.805 INFO:tasks.workunit.client.0.smithi078.stdout:5/882: truncate d7/d8/d33/d22/d25/d28/f12e 852838 0 2024-09-11T00:18:04.805 INFO:tasks.workunit.client.0.smithi078.stdout:5/883: write d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/f10c [550161,126347] 0 2024-09-11T00:18:04.807 INFO:tasks.workunit.client.0.smithi078.stdout:5/884: unlink d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d2c/lc4 0 2024-09-11T00:18:04.818 INFO:tasks.workunit.client.0.smithi078.stdout:5/885: dwrite d7/d8/d33/d22/d25/d28/deb/ff3 [0,4194304] 0 2024-09-11T00:18:04.821 INFO:tasks.workunit.client.0.smithi078.stdout:5/886: link d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/lc1 d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/dfc/l138 0 2024-09-11T00:18:04.821 INFO:tasks.workunit.client.0.smithi078.stdout:5/887: dread - d7/d8/d33/d22/d25/d28/d24/d120/f109 zero size 2024-09-11T00:18:04.822 INFO:tasks.workunit.client.0.smithi078.stdout:5/888: mkdir d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d139 0 2024-09-11T00:18:04.823 INFO:tasks.workunit.client.0.smithi078.stdout:5/889: link d7/d8/d33/d22/d51/f58 d7/d8/d33/d22/d10f/f13a 0 2024-09-11T00:18:04.823 INFO:tasks.workunit.client.0.smithi078.stdout:5/890: dread - d7/d8/d33/d22/d25/d28/d24/d120/f109 zero size 2024-09-11T00:18:04.823 INFO:tasks.workunit.client.0.smithi078.stdout:5/891: truncate d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d90/f118 772308 0 2024-09-11T00:18:04.824 INFO:tasks.workunit.client.0.smithi078.stdout:5/892: write d7/d8/d33/d22/dd9/ddf/d127/ffa [4146492,89955] 0 2024-09-11T00:18:04.836 INFO:tasks.workunit.client.0.smithi078.stdout:5/893: dwrite d7/d8/d33/d22/d25/db1/fc3 [0,4194304] 0 2024-09-11T00:18:04.836 INFO:tasks.workunit.client.0.smithi078.stdout:5/894: write d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d8c/fa0 [199243,40152] 0 2024-09-11T00:18:04.843 INFO:tasks.workunit.client.0.smithi078.stdout:5/895: dread d7/d8/fe1 [0,4194304] 0 2024-09-11T00:18:04.845 INFO:tasks.workunit.client.0.smithi078.stdout:5/896: read d7/d8/d33/d22/f97 [869725,114129] 0 2024-09-11T00:18:04.849 INFO:tasks.workunit.client.0.smithi078.stdout:3/995: sync 2024-09-11T00:18:04.864 INFO:tasks.workunit.client.0.smithi078.stdout:3/996: dwrite d0/d7/d18/dd8/fd7 [0,4194304] 0 2024-09-11T00:18:04.876 INFO:tasks.workunit.client.0.smithi078.stdout:3/997: dwrite d0/d7/d23/d7c/db7/de8/fbe [0,4194304] 0 2024-09-11T00:18:05.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:04 smithi138 ceph-mon[35019]: pgmap v371: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 167 MiB/s rd, 215 MiB/s wr, 459 op/s 2024-09-11T00:18:05.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:04 smithi078 ceph-mon[30865]: pgmap v371: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 167 MiB/s rd, 215 MiB/s wr, 459 op/s 2024-09-11T00:18:05.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:04 smithi112 ceph-mon[35627]: pgmap v371: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 167 MiB/s rd, 215 MiB/s wr, 459 op/s 2024-09-11T00:18:06.251 INFO:tasks.workunit.client.0.smithi078.stdout:7/903: sync 2024-09-11T00:18:06.251 INFO:tasks.workunit.client.0.smithi078.stdout:6/973: sync 2024-09-11T00:18:06.251 INFO:tasks.workunit.client.0.smithi078.stdout:5/897: sync 2024-09-11T00:18:06.251 INFO:tasks.workunit.client.0.smithi078.stdout:3/998: sync 2024-09-11T00:18:06.251 INFO:tasks.workunit.client.0.smithi078.stdout:7/904: write d0/d34/db/d30/d1d/d81/fa9 [14071,45284] 0 2024-09-11T00:18:06.253 INFO:tasks.workunit.client.0.smithi078.stdout:6/974: unlink d0/d1/d1b/c60 0 2024-09-11T00:18:06.253 INFO:tasks.workunit.client.0.smithi078.stdout:6/975: fdatasync d0/d1/d9/d59/d74/fed 0 2024-09-11T00:18:06.255 INFO:tasks.workunit.client.0.smithi078.stdout:5/898: truncate d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/de3/d102/d11b/f133 1859155 0 2024-09-11T00:18:06.256 INFO:tasks.workunit.client.0.smithi078.stdout:3/999: symlink d0/d39/l124 0 2024-09-11T00:18:06.258 INFO:tasks.workunit.client.0.smithi078.stdout:7/905: creat d0/d34/db/d30/d1d/d14/d45/f11a x:0 0 0 2024-09-11T00:18:06.258 INFO:tasks.workunit.client.0.smithi078.stdout:7/906: write d0/d34/db/d30/d1d/d14/f5d [1376164,75798] 0 2024-09-11T00:18:06.259 INFO:tasks.workunit.client.0.smithi078.stdout:7/907: getdents d0/d34/db/d30/d1d/db0 0 2024-09-11T00:18:06.259 INFO:tasks.workunit.client.0.smithi078.stdout:7/908: write d0/d34/db/d30/d1d/d14/d87/fc1 [205281,21051] 0 2024-09-11T00:18:06.260 INFO:tasks.workunit.client.0.smithi078.stdout:6/976: getdents d0/d1/d9/d59/da3/d107 0 2024-09-11T00:18:06.262 INFO:tasks.workunit.client.0.smithi078.stdout:5/899: mkdir d7/d8/d33/d22/dd9/ddf/dc5/dc8/d2a/dc7/d13b 0 2024-09-11T00:18:06.265 INFO:tasks.workunit.client.0.smithi078.stdout:6/977: rename d0/d1/d9/d59/da3/d107/dff to d0/d1/da8/d13f 0 2024-09-11T00:18:06.265 INFO:tasks.workunit.client.0.smithi078.stdout:6/978: stat d0/d1/d53/d9c/d13e 0 2024-09-11T00:18:06.265 INFO:tasks.workunit.client.0.smithi078.stdout:7/909: dread d0/f1e [0,4194304] 0 2024-09-11T00:18:06.269 INFO:tasks.workunit.client.0.smithi078.stdout:5/900: rename d7/d8/d33/d22/d25/db1/fed to d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/de3/d115/f13c 0 2024-09-11T00:18:06.269 INFO:tasks.workunit.client.0.smithi078.stdout:5/901: chown d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d2c/d62/ffe 6 1 2024-09-11T00:18:06.271 INFO:tasks.workunit.client.0.smithi078.stdout:7/910: creat d0/d3f/f11b x:0 0 0 2024-09-11T00:18:06.278 INFO:tasks.workunit.client.0.smithi078.stdout:7/911: dread d0/d34/db/d30/d28/f6a [0,4194304] 0 2024-09-11T00:18:06.281 INFO:tasks.workunit.client.0.smithi078.stdout:7/912: rename d0/d34/c9f to d0/da7/ddf/d119/c11c 0 2024-09-11T00:18:06.287 INFO:tasks.workunit.client.0.smithi078.stdout:5/902: dwrite d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/ff [0,4194304] 0 2024-09-11T00:18:06.290 INFO:tasks.workunit.client.0.smithi078.stdout:5/903: creat d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/de3/d102/f13d x:0 0 0 2024-09-11T00:18:06.295 INFO:tasks.workunit.client.0.smithi078.stdout:5/904: dread d7/d8/d33/d22/dd9/ddf/dc5/dc8/f111 [0,4194304] 0 2024-09-11T00:18:06.299 INFO:tasks.workunit.client.0.smithi078.stdout:7/913: dwrite d0/d34/db/d30/d1d/d14/f7d [0,4194304] 0 2024-09-11T00:18:06.301 INFO:tasks.workunit.client.0.smithi078.stdout:7/914: symlink d0/d34/db/d30/d28/l11d 0 2024-09-11T00:18:06.302 INFO:tasks.workunit.client.0.smithi078.stdout:7/915: creat d0/da7/ddf/f11e x:0 0 0 2024-09-11T00:18:06.304 INFO:tasks.workunit.client.0.smithi078.stdout:7/916: rename d0/d34/d65/f83 to d0/d34/db/d30/d1d/d14/d45/d116/f11f 0 2024-09-11T00:18:06.305 INFO:tasks.workunit.client.0.smithi078.stdout:7/917: stat d0/d3f/f106 0 2024-09-11T00:18:06.313 INFO:tasks.workunit.client.0.smithi078.stdout:5/905: dwrite d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/f11 [0,4194304] 0 2024-09-11T00:18:06.313 INFO:tasks.workunit.client.0.smithi078.stdout:5/906: chown d7/d8/d33/d22/d25/d6a/f6e 177607656 1 2024-09-11T00:18:06.315 INFO:tasks.workunit.client.0.smithi078.stdout:5/907: symlink d7/d8/d33/d22/dd9/ddf/dc5/dc8/d2a/dc7/d13b/l13e 0 2024-09-11T00:18:06.315 INFO:tasks.workunit.client.0.smithi078.stdout:5/908: fsync d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/ff 0 2024-09-11T00:18:06.316 INFO:tasks.workunit.client.0.smithi078.stdout:5/909: truncate d7/d8/d33/d22/d51/f9b 6552822 0 2024-09-11T00:18:06.318 INFO:tasks.workunit.client.0.smithi078.stdout:5/910: creat d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/de3/d115/f13f x:0 0 0 2024-09-11T00:18:06.318 INFO:tasks.workunit.client.0.smithi078.stdout:5/911: write f6 [4456005,85797] 0 2024-09-11T00:18:06.320 INFO:tasks.workunit.client.0.smithi078.stdout:5/912: mkdir d7/d8/d47/ddd/d140 0 2024-09-11T00:18:06.331 INFO:tasks.workunit.client.0.smithi078.stdout:5/913: dwrite d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d2c/f99 [0,4194304] 0 2024-09-11T00:18:06.340 INFO:tasks.workunit.client.0.smithi078.stdout:6/979: write d0/d1/d9/d59/d74/db3/dd5/f3d [1119530,96844] 0 2024-09-11T00:18:06.341 INFO:tasks.workunit.client.0.smithi078.stdout:6/980: fdatasync d0/d1/d53/d9c/dac/de3/fef 0 2024-09-11T00:18:06.341 INFO:tasks.workunit.client.0.smithi078.stdout:6/981: truncate d0/d1/f2f 4741181 0 2024-09-11T00:18:06.341 INFO:tasks.workunit.client.0.smithi078.stdout:6/982: symlink d0/d1/d53/d72/de4/l140 0 2024-09-11T00:18:06.346 INFO:tasks.workunit.client.0.smithi078.stdout:5/914: dwrite d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/f10a [0,4194304] 0 2024-09-11T00:18:06.346 INFO:tasks.workunit.client.0.smithi078.stdout:6/983: creat d0/d1/d53/f141 x:0 0 0 2024-09-11T00:18:06.346 INFO:tasks.workunit.client.0.smithi078.stdout:6/984: readlink d0/l5 0 2024-09-11T00:18:06.346 INFO:tasks.workunit.client.0.smithi078.stdout:6/985: write d0/d66/f13a [1983558,121511] 0 2024-09-11T00:18:06.346 INFO:tasks.workunit.client.0.smithi078.stdout:6/986: readlink d0/d1/d9/d59/d74/db3/dd5/ld0 0 2024-09-11T00:18:06.348 INFO:tasks.workunit.client.0.smithi078.stdout:5/915: truncate d7/d8/d33/f7e 47780 0 2024-09-11T00:18:06.348 INFO:tasks.workunit.client.0.smithi078.stdout:5/916: fdatasync d7/d8/f121 0 2024-09-11T00:18:06.349 INFO:tasks.workunit.client.0.smithi078.stdout:6/987: creat d0/d66/f142 x:0 0 0 2024-09-11T00:18:06.351 INFO:tasks.workunit.client.0.smithi078.stdout:6/988: symlink d0/d1/d53/d9c/dac/l143 0 2024-09-11T00:18:06.351 INFO:tasks.workunit.client.0.smithi078.stdout:6/989: dread - d0/d66/f105 zero size 2024-09-11T00:18:06.352 INFO:tasks.workunit.client.0.smithi078.stdout:6/990: read d0/d1/f79 [463811,394] 0 2024-09-11T00:18:06.361 INFO:tasks.workunit.client.0.smithi078.stdout:5/917: symlink d7/d8/d33/d22/dd9/ddf/dc5/dc8/d2a/l141 0 2024-09-11T00:18:06.361 INFO:tasks.workunit.client.0.smithi078.stdout:5/918: write d7/d8/d33/d22/dd9/ddf/d127/f124 [563162,48015] 0 2024-09-11T00:18:06.361 INFO:tasks.workunit.client.0.smithi078.stdout:5/919: write d7/d8/d33/d22/dd9/ddf/d127/ffa [391678,675] 0 2024-09-11T00:18:06.370 INFO:tasks.workunit.client.0.smithi078.stdout:6/991: dwrite d0/d1/d9/d8d/fde [4194304,4194304] 0 2024-09-11T00:18:06.373 INFO:tasks.workunit.client.0.smithi078.stdout:6/992: creat d0/d1/d53/d9c/d13e/f144 x:0 0 0 2024-09-11T00:18:06.375 INFO:tasks.workunit.client.0.smithi078.stdout:6/993: link d0/d66/l132 d0/d1/d53/d9c/db6/de5/dec/d110/l145 0 2024-09-11T00:18:06.376 INFO:tasks.workunit.client.0.smithi078.stdout:6/994: creat d0/d1/da8/d13f/d11d/d130/f146 x:0 0 0 2024-09-11T00:18:06.377 INFO:tasks.workunit.client.0.smithi078.stdout:6/995: mkdir d0/d1/d147 0 2024-09-11T00:18:06.378 INFO:tasks.workunit.client.0.smithi078.stdout:6/996: rmdir d0/d1/d53/d9c/db6 39 2024-09-11T00:18:06.380 INFO:tasks.workunit.client.0.smithi078.stdout:5/920: dwrite d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d2c/f11a [0,4194304] 0 2024-09-11T00:18:06.380 INFO:tasks.workunit.client.0.smithi078.stdout:6/997: creat d0/d1/d53/d9c/dac/f148 x:0 0 0 2024-09-11T00:18:06.380 INFO:tasks.workunit.client.0.smithi078.stdout:6/998: readlink d0/d1/d53/la1 0 2024-09-11T00:18:06.380 INFO:tasks.workunit.client.0.smithi078.stdout:6/999: chown d0/d66/f142 0 1 2024-09-11T00:18:06.380 INFO:tasks.workunit.client.0.smithi078.stdout:7/918: dwrite d0/d34/d86/f89 [0,4194304] 0 2024-09-11T00:18:06.381 INFO:tasks.workunit.client.0.smithi078.stdout:7/919: write d0/d34/db/d30/fdb [4772676,69316] 0 2024-09-11T00:18:06.382 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:18:06.383 INFO:tasks.workunit.client.0.smithi078.stdout:5/921: mkdir d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/de3/d102/d142 0 2024-09-11T00:18:06.384 INFO:tasks.workunit.client.0.smithi078.stdout:7/920: dread d0/d34/d65/f8d [0,4194304] 0 2024-09-11T00:18:06.387 INFO:tasks.workunit.client.0.smithi078.stdout:7/921: unlink d0/d3f/fd8 0 2024-09-11T00:18:06.387 INFO:tasks.workunit.client.0.smithi078.stdout:7/922: fdatasync d0/d34/d57/fff 0 2024-09-11T00:18:06.387 INFO:tasks.workunit.client.0.smithi078.stdout:7/923: write d0/d34/db/d30/d1d/f17 [3856521,103381] 0 2024-09-11T00:18:06.387 INFO:tasks.workunit.client.0.smithi078.stdout:7/924: chown d0/f43 1026 1 2024-09-11T00:18:06.388 INFO:tasks.workunit.client.0.smithi078.stdout:5/922: mkdir d7/d8/d33/d22/d25/d28/d24/d143 0 2024-09-11T00:18:06.389 INFO:tasks.workunit.client.0.smithi078.stdout:7/925: rmdir d0/d34/db/d30/d28/dc4 39 2024-09-11T00:18:06.398 INFO:tasks.workunit.client.0.smithi078.stdout:7/926: dread d0/f63 [0,4194304] 0 2024-09-11T00:18:06.399 INFO:tasks.workunit.client.0.smithi078.stdout:7/927: rmdir d0/d34/db/d32 39 2024-09-11T00:18:06.399 INFO:tasks.workunit.client.0.smithi078.stdout:7/928: write d0/da7/fe9 [480755,36227] 0 2024-09-11T00:18:06.399 INFO:tasks.workunit.client.0.smithi078.stdout:5/923: dread d7/d8/d33/d22/d25/d28/d24/d1c/fd3 [0,4194304] 0 2024-09-11T00:18:06.399 INFO:tasks.workunit.client.0.smithi078.stdout:5/924: chown d7/d8/d33/d22/d25/d28/d24/d1c/lde 4967 1 2024-09-11T00:18:06.400 INFO:tasks.workunit.client.0.smithi078.stdout:7/929: creat d0/d34/d86/f120 x:0 0 0 2024-09-11T00:18:06.400 INFO:tasks.workunit.client.0.smithi078.stdout:7/930: chown d0/d34/db/d30/d1d/d14/d111 148766507 1 2024-09-11T00:18:06.402 INFO:tasks.workunit.client.0.smithi078.stdout:5/925: unlink d7/d8/d33/d22/f2d 0 2024-09-11T00:18:06.403 INFO:tasks.workunit.client.0.smithi078.stdout:5/926: mkdir d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d8c/d144 0 2024-09-11T00:18:06.405 INFO:tasks.workunit.client.0.smithi078.stdout:5/927: mkdir d7/d8/d33/d22/dd9/d145 0 2024-09-11T00:18:06.406 INFO:tasks.workunit.client.0.smithi078.stdout:5/928: symlink d7/l146 0 2024-09-11T00:18:06.406 INFO:tasks.workunit.client.0.smithi078.stdout:7/931: write d0/d34/db/d30/f3e [5751361,45190] 0 2024-09-11T00:18:06.407 INFO:tasks.workunit.client.0.smithi078.stdout:5/929: mkdir d7/d8/d33/d22/d25/db1/d12d/d147 0 2024-09-11T00:18:06.408 INFO:tasks.workunit.client.0.smithi078.stdout:7/932: dread d0/d34/db/d32/f94 [0,4194304] 0 2024-09-11T00:18:06.408 INFO:tasks.workunit.client.0.smithi078.stdout:7/933: truncate d0/fba 1287605 0 2024-09-11T00:18:06.408 INFO:tasks.workunit.client.0.smithi078.stdout:5/930: mkdir d7/d8/d33/d22/d25/d122/d148 0 2024-09-11T00:18:06.408 INFO:tasks.workunit.client.0.smithi078.stdout:5/931: fsync d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/dd5/f113 0 2024-09-11T00:18:06.411 INFO:tasks.workunit.client.0.smithi078.stdout:7/934: rename d0/d34/db/d30/fda to d0/d34/db/d103/f121 0 2024-09-11T00:18:06.413 INFO:tasks.workunit.client.0.smithi078.stdout:7/935: link d0/d34/db/l85 d0/d34/db/d30/d1d/d14/d111/l122 0 2024-09-11T00:18:06.415 INFO:tasks.workunit.client.0.smithi078.stdout:7/936: dread d0/d34/db/d30/d1d/d81/f8f [0,4194304] 0 2024-09-11T00:18:06.420 INFO:tasks.workunit.client.0.smithi078.stdout:7/937: dread d0/d34/d86/fc7 [4194304,4194304] 0 2024-09-11T00:18:06.420 INFO:tasks.workunit.client.0.smithi078.stdout:7/938: chown d0/d34/db/d30/d1d/d14/d45/fe0 16083160 1 2024-09-11T00:18:06.421 INFO:tasks.workunit.client.0.smithi078.stdout:7/939: mknod d0/d34/d86/d113/c123 0 2024-09-11T00:18:06.421 INFO:tasks.workunit.client.0.smithi078.stdout:7/940: write d0/d34/db/f105 [586428,79338] 0 2024-09-11T00:18:06.423 INFO:tasks.workunit.client.0.smithi078.stdout:7/941: rename d0/d34/db/ld1 to d0/d34/db/d30/d1d/d14/d87/dc5/l124 0 2024-09-11T00:18:06.426 INFO:tasks.workunit.client.0.smithi078.stdout:7/942: link d0/f55 d0/d34/db/d30/d28/dc4/f125 0 2024-09-11T00:18:06.427 INFO:tasks.workunit.client.0.smithi078.stdout:7/943: symlink d0/d34/db/d30/d1d/d14/l126 0 2024-09-11T00:18:06.433 INFO:tasks.workunit.client.0.smithi078.stdout:7/944: dread d0/f63 [0,4194304] 0 2024-09-11T00:18:06.436 INFO:tasks.workunit.client.0.smithi078.stdout:7/945: rename d0/d34/db/da0/fad to d0/d34/db/d103/f127 0 2024-09-11T00:18:06.533 INFO:tasks.workunit.client.0.smithi078.stdout:5/932: sync 2024-09-11T00:18:06.533 INFO:tasks.workunit.client.0.smithi078.stdout:5/933: stat d7/c80 0 2024-09-11T00:18:06.545 INFO:tasks.workunit.client.0.smithi078.stdout:5/934: dwrite d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/fac [0,4194304] 0 2024-09-11T00:18:06.547 INFO:tasks.workunit.client.0.smithi078.stdout:5/935: read d7/d8/d33/d22/dd9/ddf/dc5/dc8/f6f [905851,41042] 0 2024-09-11T00:18:06.548 INFO:tasks.workunit.client.0.smithi078.stdout:5/936: creat d7/d8/d33/d22/dd9/ddf/d127/f149 x:0 0 0 2024-09-11T00:18:06.548 INFO:tasks.workunit.client.0.smithi078.stdout:5/937: chown d7/d8/d33/d22/dd9/ddf/dc5/dc8/f6f 3622812 1 2024-09-11T00:18:06.549 INFO:tasks.workunit.client.0.smithi078.stdout:5/938: mkdir d7/d8/d33/d22/dd9/ddf/dc5/dc8/d14a 0 2024-09-11T00:18:06.567 INFO:tasks.workunit.client.0.smithi078.stdout:5/939: dwrite d7/d8/d33/d22/dd9/ddf/dc5/dc8/d2a/dc7/fd0 [0,4194304] 0 2024-09-11T00:18:06.567 INFO:tasks.workunit.client.0.smithi078.stdout:5/940: rmdir d7/d8/d33 39 2024-09-11T00:18:06.569 INFO:tasks.workunit.client.0.smithi078.stdout:5/941: creat d7/d8/d33/d22/d25/db1/d12d/f14b x:0 0 0 2024-09-11T00:18:06.569 INFO:tasks.workunit.client.0.smithi078.stdout:5/942: chown d7/d8/d33/d22/d25/d28/deb/fec 1796 1 2024-09-11T00:18:06.569 INFO:tasks.workunit.client.0.smithi078.stdout:5/943: getdents d7/d8/d47 0 2024-09-11T00:18:06.570 INFO:tasks.workunit.client.0.smithi078.stdout:5/944: write d7/d8/d33/d22/d25/d28/d24/d1c/f8e [2016410,125460] 0 2024-09-11T00:18:06.571 INFO:tasks.workunit.client.0.smithi078.stdout:5/945: creat d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d90/f14c x:0 0 0 2024-09-11T00:18:06.574 INFO:tasks.workunit.client.0.smithi078.stdout:5/946: write d7/d8/d33/d22/d25/d28/f12e [38244,77684] 0 2024-09-11T00:18:06.584 INFO:tasks.workunit.client.0.smithi078.stdout:5/947: write d7/d8/d33/d22/d25/d28/f31 [1516860,33290] 0 2024-09-11T00:18:06.586 INFO:tasks.workunit.client.0.smithi078.stdout:5/948: rmdir d7/d8/d33/d22/d25/d28/d24/d143 0 2024-09-11T00:18:06.587 INFO:tasks.workunit.client.0.smithi078.stdout:5/949: creat d7/d8/d33/d22/dd9/ddf/dc5/dc8/f14d x:0 0 0 2024-09-11T00:18:06.587 INFO:tasks.workunit.client.0.smithi078.stdout:5/950: read d7/d8/d33/d22/dd9/ddf/f9f [1005471,62721] 0 2024-09-11T00:18:06.588 INFO:tasks.workunit.client.0.smithi078.stdout:5/951: creat d7/f14e x:0 0 0 2024-09-11T00:18:06.590 INFO:tasks.workunit.client.0.smithi078.stdout:7/946: sync 2024-09-11T00:18:06.590 INFO:tasks.workunit.client.0.smithi078.stdout:7/947: chown d0/d34/db/d30/d1d/d14/lbf 3081731 1 2024-09-11T00:18:06.592 INFO:tasks.workunit.client.0.smithi078.stdout:7/948: dread d0/d34/db/f105 [0,4194304] 0 2024-09-11T00:18:06.593 INFO:tasks.workunit.client.0.smithi078.stdout:7/949: mknod d0/d34/db/d30/d28/c128 0 2024-09-11T00:18:06.594 INFO:tasks.workunit.client.0.smithi078.stdout:7/950: write d0/d34/db/d30/d1d/fa5 [1311528,55161] 0 2024-09-11T00:18:06.594 INFO:tasks.workunit.client.0.smithi078.stdout:7/951: symlink d0/d34/db/d30/d1d/d14/l129 0 2024-09-11T00:18:06.595 INFO:tasks.workunit.client.0.smithi078.stdout:5/952: write d7/d8/d33/d22/d25/f3a [4023789,101961] 0 2024-09-11T00:18:06.610 INFO:tasks.workunit.client.0.smithi078.stdout:5/953: dwrite d7/d8/d33/d22/dd9/ddf/dc5/dc8/d2a/dc7/ffb [0,4194304] 0 2024-09-11T00:18:06.611 INFO:tasks.workunit.client.0.smithi078.stdout:7/952: dwrite d0/d34/db/d30/d28/dc4/f125 [0,4194304] 0 2024-09-11T00:18:06.613 INFO:tasks.workunit.client.0.smithi078.stdout:7/953: creat d0/d34/d65/f12a x:0 0 0 2024-09-11T00:18:06.622 INFO:tasks.workunit.client.0.smithi078.stdout:5/954: dwrite d7/d8/d33/d22/dd9/ddf/dc5/dc8/f14d [0,4194304] 0 2024-09-11T00:18:06.625 INFO:tasks.workunit.client.0.smithi078.stdout:5/955: rename d7/d8/l42 to d7/d8/d33/d22/d25/d122/d148/l14f 0 2024-09-11T00:18:06.636 INFO:tasks.workunit.client.0.smithi078.stdout:5/956: dwrite d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d8c/fa0 [0,4194304] 0 2024-09-11T00:18:06.638 INFO:tasks.workunit.client.0.smithi078.stdout:5/957: read d7/d8/d33/d22/d25/d28/d24/d120/fee [831431,6632] 0 2024-09-11T00:18:06.638 INFO:tasks.workunit.client.0.smithi078.stdout:5/958: chown d7/d8/d33/d22/d25/d28/d24/f50 2 1 2024-09-11T00:18:06.639 INFO:tasks.workunit.client.0.smithi078.stdout:5/959: unlink d7/d8/d33/d22/dd9/ddf/dc5/dc8/f100 0 2024-09-11T00:18:06.639 INFO:tasks.workunit.client.0.smithi078.stdout:5/960: dread - d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/dfc/f136 zero size 2024-09-11T00:18:06.645 INFO:tasks.workunit.client.0.smithi078.stdout:5/961: write d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/de3/d115/f13c [3431307,71907] 0 2024-09-11T00:18:06.645 INFO:tasks.workunit.client.0.smithi078.stdout:5/962: dread - d7/d8/d33/d22/d25/fef zero size 2024-09-11T00:18:06.657 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:18:06.658 INFO:tasks.workunit.client.0.smithi078.stdout:5/963: dwrite d7/f10b [4194304,4194304] 0 2024-09-11T00:18:06.660 INFO:tasks.workunit.client.0.smithi078.stdout:5/964: mknod d7/d8/d33/d22/d25/d28/d24/c150 0 2024-09-11T00:18:06.661 INFO:tasks.workunit.client.0.smithi078.stdout:5/965: link d7/d8/d33/d22/dd9/ddf/l85 d7/d8/d33/d22/d25/d28/d24/d1c/d10e/l151 0 2024-09-11T00:18:06.668 INFO:tasks.workunit.client.0.smithi078.stdout:5/966: dread d7/d8/d33/d22/dd9/ddf/dc5/fdc [0,4194304] 0 2024-09-11T00:18:06.669 INFO:tasks.workunit.client.0.smithi078.stdout:5/967: mknod d7/d8/d33/d22/dd9/ddf/dc5/dc8/d14a/c152 0 2024-09-11T00:18:06.670 INFO:tasks.workunit.client.0.smithi078.stdout:5/968: mknod d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d139/c153 0 2024-09-11T00:18:06.671 INFO:tasks.workunit.client.0.smithi078.stdout:5/969: mkdir d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d2c/d154 0 2024-09-11T00:18:06.671 INFO:tasks.workunit.client.0.smithi078.stdout:5/970: write d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d2c/d62/ffe [293794,118472] 0 2024-09-11T00:18:06.671 INFO:tasks.workunit.client.0.smithi078.stdout:5/971: write d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/de3/d102/d11b/f11f [355089,41335] 0 2024-09-11T00:18:06.673 INFO:tasks.workunit.client.0.smithi078.stdout:5/972: rename d7/d8/f3d to d7/d8/d33/d22/d25/d28/d24/f155 0 2024-09-11T00:18:06.673 INFO:tasks.workunit.client.0.smithi078.stdout:5/973: chown d7/d8/d33/d22/dd9/ddf/dc5/dc8/d2a/cba 15551 1 2024-09-11T00:18:06.677 INFO:tasks.workunit.client.0.smithi078.stdout:5/974: dread d7/d8/d33/d22/d25/d28/f12e [0,4194304] 0 2024-09-11T00:18:06.677 INFO:tasks.workunit.client.0.smithi078.stdout:5/975: write d7/d8/d33/d22/d25/d28/f12e [325366,72136] 0 2024-09-11T00:18:06.679 INFO:tasks.workunit.client.0.smithi078.stdout:5/976: rename d7/d8/d33/d22/d25/d28/f10d to d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/f156 0 2024-09-11T00:18:06.679 INFO:tasks.workunit.client.0.smithi078.stdout:5/977: truncate d7/d8/d33/d22/d25/d28/d24/d1c/d1e/d8c/fa0 4502320 0 2024-09-11T00:18:06.680 INFO:tasks.workunit.client.0.smithi078.stdout:5/978: creat d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d2c/d62/f157 x:0 0 0 2024-09-11T00:18:06.681 INFO:tasks.workunit.client.0.smithi078.stdout:5/979: symlink d7/d8/d33/d22/d25/db1/l158 0 2024-09-11T00:18:06.684 INFO:tasks.workunit.client.0.smithi078.stdout:7/954: sync 2024-09-11T00:18:06.684 INFO:tasks.workunit.client.0.smithi078.stdout:7/955: symlink d0/d34/l12b 0 2024-09-11T00:18:06.686 INFO:tasks.workunit.client.0.smithi078.stdout:7/956: link d0/d34/db/d30/d28/f44 d0/d34/d86/d113/f12c 0 2024-09-11T00:18:06.687 INFO:tasks.workunit.client.0.smithi078.stdout:7/957: write d0/d34/db/d30/fdb [4646982,106695] 0 2024-09-11T00:18:06.688 INFO:tasks.workunit.client.0.smithi078.stdout:7/958: symlink d0/da7/l12d 0 2024-09-11T00:18:06.688 INFO:tasks.workunit.client.0.smithi078.stdout:7/959: stat d0/d34/db/d30/d1d/d14/d62/fa1 0 2024-09-11T00:18:06.688 INFO:tasks.workunit.client.0.smithi078.stdout:5/980: write d7/d8/d33/d22/d25/d28/deb/ff3 [1322381,67339] 0 2024-09-11T00:18:06.689 INFO:tasks.workunit.client.0.smithi078.stdout:7/960: mknod d0/d34/db/d103/c12e 0 2024-09-11T00:18:06.689 INFO:tasks.workunit.client.0.smithi078.stdout:7/961: dread - d0/d34/db/da0/f101 zero size 2024-09-11T00:18:06.689 INFO:tasks.workunit.client.0.smithi078.stdout:7/962: unlink d0/d34/db/fbc 0 2024-09-11T00:18:06.690 INFO:tasks.workunit.client.0.smithi078.stdout:5/981: dread d7/d8/d33/d22/d25/d28/deb/fec [0,4194304] 0 2024-09-11T00:18:06.691 INFO:tasks.workunit.client.0.smithi078.stdout:7/963: rename d0/d34/db/d32/f3a to d0/d34/db/d30/d1d/d14/d62/d93/f12f 0 2024-09-11T00:18:06.692 INFO:tasks.workunit.client.0.smithi078.stdout:7/964: getdents d0/d34/db/d30/d1d/d14 0 2024-09-11T00:18:06.693 INFO:tasks.workunit.client.0.smithi078.stdout:7/965: symlink d0/d34/db/d30/d28/l130 0 2024-09-11T00:18:06.693 INFO:tasks.workunit.client.0.smithi078.stdout:7/966: truncate d0/d34/db/d30/d1d/d14/d62/d93/fae 6773462 0 2024-09-11T00:18:06.694 INFO:tasks.workunit.client.0.smithi078.stdout:7/967: symlink d0/d34/db/d30/d1d/d14/d87/dc5/l131 0 2024-09-11T00:18:06.696 INFO:tasks.workunit.client.0.smithi078.stdout:7/968: rename d0/d34/db/d32/ddc/feb to d0/d34/db/d30/d1d/d14/d87/f132 0 2024-09-11T00:18:06.697 INFO:tasks.workunit.client.0.smithi078.stdout:5/982: dread d7/d8/d33/d22/d25/f5e [0,4194304] 0 2024-09-11T00:18:06.699 INFO:tasks.workunit.client.0.smithi078.stdout:7/969: dread d0/d3f/f60 [0,4194304] 0 2024-09-11T00:18:06.699 INFO:tasks.workunit.client.0.smithi078.stdout:5/983: link d7/d8/d33/d22/dd9/ddf/dc5/dc8/d9e/de3/d102/d11b/f126 d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d2c/d62/dea/f159 0 2024-09-11T00:18:06.699 INFO:tasks.workunit.client.0.smithi078.stdout:5/984: fsync d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d2c/f63 0 2024-09-11T00:18:06.702 INFO:tasks.workunit.client.0.smithi078.stdout:5/985: mkdir d7/d8/d33/d22/d25/d6a/dc0/d15a 0 2024-09-11T00:18:06.704 INFO:tasks.workunit.client.0.smithi078.stdout:5/986: rename d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d2c/d154 to d7/d8/d33/d22/d10f/d15b 0 2024-09-11T00:18:06.706 INFO:tasks.workunit.client.0.smithi078.stdout:5/987: link d7/d8/d33/d22/l46 d7/d8/d33/d22/dd9/ddf/d127/l15c 0 2024-09-11T00:18:06.713 INFO:tasks.workunit.client.0.smithi078.stdout:7/970: dwrite d0/d34/f100 [0,4194304] 0 2024-09-11T00:18:06.715 INFO:tasks.workunit.client.0.smithi078.stdout:5/988: dread d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d90/f105 [0,4194304] 0 2024-09-11T00:18:06.715 INFO:tasks.workunit.client.0.smithi078.stdout:7/971: dread d0/d34/db/d30/d1d/d81/fa9 [0,4194304] 0 2024-09-11T00:18:06.715 INFO:tasks.workunit.client.0.smithi078.stdout:5/989: creat d7/d8/d33/d22/d25/d28/deb/f15d x:0 0 0 2024-09-11T00:18:06.716 INFO:tasks.workunit.client.0.smithi078.stdout:7/972: mknod d0/d34/db/da0/c133 0 2024-09-11T00:18:06.717 INFO:tasks.workunit.client.0.smithi078.stdout:5/990: symlink d7/d8/d33/l15e 0 2024-09-11T00:18:06.718 INFO:tasks.workunit.client.0.smithi078.stdout:7/973: rename d0/d34/d57/fff to d0/d34/db/d30/d1d/db0/f134 0 2024-09-11T00:18:06.718 INFO:tasks.workunit.client.0.smithi078.stdout:7/974: chown d0/d34/db/d30/d1d/db0/dd2 112064 1 2024-09-11T00:18:06.719 INFO:tasks.workunit.client.0.smithi078.stdout:5/991: rename d7/d8/d33/d22/dd9/ddf/dc5/dc8/cd2 to d7/d8/d33/d22/d10f/c15f 0 2024-09-11T00:18:06.720 INFO:tasks.workunit.client.0.smithi078.stdout:5/992: truncate d7/d8/d33/d22/d25/d28/deb/fec 502868 0 2024-09-11T00:18:06.721 INFO:tasks.workunit.client.0.smithi078.stdout:7/975: read d0/f43 [2723338,71360] 0 2024-09-11T00:18:06.722 INFO:tasks.workunit.client.0.smithi078.stdout:7/976: unlink d0/d34/db/c12 0 2024-09-11T00:18:06.736 INFO:tasks.workunit.client.0.smithi078.stdout:7/977: dwrite d0/d34/db/d30/d1d/f59 [0,4194304] 0 2024-09-11T00:18:06.736 INFO:tasks.workunit.client.0.smithi078.stdout:7/978: write d0/d34/db/d30/d1d/d14/d45/f11a [1006983,106471] 0 2024-09-11T00:18:06.736 INFO:tasks.workunit.client.0.smithi078.stdout:7/979: write d0/d34/db/d30/d1d/d14/d62/f84 [6063262,11386] 0 2024-09-11T00:18:06.736 INFO:tasks.workunit.client.0.smithi078.stdout:7/980: creat d0/d34/db/d30/d28/dc4/f135 x:0 0 0 2024-09-11T00:18:06.738 INFO:tasks.workunit.client.0.smithi078.stdout:5/993: dwrite d7/d8/d33/d22/d51/f9b [0,4194304] 0 2024-09-11T00:18:06.743 INFO:tasks.workunit.client.0.smithi078.stdout:7/981: dread d0/d34/d86/fbb [0,4194304] 0 2024-09-11T00:18:06.744 INFO:tasks.workunit.client.0.smithi078.stdout:7/982: stat d0/d34/db/d30/d1d/d81/c97 0 2024-09-11T00:18:06.744 INFO:tasks.workunit.client.0.smithi078.stdout:5/994: write d7/d8/d33/d22/dd9/ddf/dc5/dc8/d2a/dc7/ffb [1298614,59345] 0 2024-09-11T00:18:06.754 INFO:tasks.workunit.client.0.smithi078.stdout:7/983: write d0/d3f/f9e [7661435,119035] 0 2024-09-11T00:18:06.763 INFO:tasks.workunit.client.0.smithi078.stdout:5/995: dwrite d7/d8/d33/d22/d25/d28/deb/f15d [0,4194304] 0 2024-09-11T00:18:06.765 INFO:tasks.workunit.client.0.smithi078.stdout:5/996: mknod d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d2c/c160 0 2024-09-11T00:18:06.765 INFO:tasks.workunit.client.0.smithi078.stdout:5/997: readlink d7/d8/d33/d22/d25/d28/d24/d1c/d1e/dbf/d108/d2c/lf6 0 2024-09-11T00:18:06.969 INFO:tasks.workunit.client.0.smithi078.stdout:5/998: sync 2024-09-11T00:18:06.970 INFO:tasks.workunit.client.0.smithi078.stdout:7/984: sync 2024-09-11T00:18:06.971 INFO:tasks.workunit.client.0.smithi078.stdout:5/999: creat d7/d8/d33/d22/dd9/ddf/f161 x:0 0 0 2024-09-11T00:18:07.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:06 smithi138 ceph-mon[35019]: pgmap v372: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 222 MiB/s rd, 268 MiB/s wr, 563 op/s 2024-09-11T00:18:07.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:06 smithi078 ceph-mon[30865]: pgmap v372: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 222 MiB/s rd, 268 MiB/s wr, 563 op/s 2024-09-11T00:18:07.135 INFO:tasks.workunit.client.0.smithi078.stdout:7/985: sync 2024-09-11T00:18:07.136 INFO:tasks.workunit.client.0.smithi078.stdout:7/986: creat d0/d34/d86/d113/f136 x:0 0 0 2024-09-11T00:18:07.137 INFO:tasks.workunit.client.0.smithi078.stdout:7/987: getdents d0/d34/db/da0 0 2024-09-11T00:18:07.137 INFO:tasks.workunit.client.0.smithi078.stdout:7/988: chown d0/d34/d86/ff7 133670196 1 2024-09-11T00:18:07.143 INFO:tasks.workunit.client.0.smithi078.stdout:7/989: dread d0/d34/db/d30/d1d/f17 [0,4194304] 0 2024-09-11T00:18:07.143 INFO:tasks.workunit.client.0.smithi078.stdout:7/990: truncate d0/d34/db/d30/d28/dc4/f135 611208 0 2024-09-11T00:18:07.144 INFO:tasks.workunit.client.0.smithi078.stdout:7/991: unlink d0/d34/db/d30/d1d/ca8 0 2024-09-11T00:18:07.160 INFO:tasks.workunit.client.0.smithi078.stdout:7/992: dwrite d0/d34/db/d30/d1d/d14/d62/faa [0,4194304] 0 2024-09-11T00:18:07.163 INFO:tasks.workunit.client.0.smithi078.stdout:7/993: rename d0/d34/db/lfe to d0/d34/db/d30/d28/dc4/l137 0 2024-09-11T00:18:07.164 INFO:tasks.workunit.client.0.smithi078.stdout:7/994: getdents d0/d3f 0 2024-09-11T00:18:07.165 INFO:tasks.workunit.client.0.smithi078.stdout:7/995: getdents d0/d34/db/d32/ddc 0 2024-09-11T00:18:07.166 INFO:tasks.workunit.client.0.smithi078.stdout:7/996: getdents d0/d34/db/d30 0 2024-09-11T00:18:07.167 INFO:tasks.workunit.client.0.smithi078.stdout:7/997: creat d0/d34/db/d32/f138 x:0 0 0 2024-09-11T00:18:07.168 INFO:tasks.workunit.client.0.smithi078.stdout:7/998: creat d0/d34/d65/f139 x:0 0 0 2024-09-11T00:18:07.169 INFO:tasks.workunit.client.0.smithi078.stdout:7/999: mknod d0/d34/db/d103/c13a 0 2024-09-11T00:18:07.172 INFO:tasks.workunit.client.0.smithi078.stderr:+ rm -rf -- ./tmp.zqjqjc0zll 2024-09-11T00:18:07.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:06 smithi112 ceph-mon[35627]: pgmap v372: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 222 MiB/s rd, 268 MiB/s wr, 563 op/s 2024-09-11T00:18:07.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.468+0000 7efd14391640 1 -- 172.21.15.78:0/2387096809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd0c101c90 msgr2=0x7efd0c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:07.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.468+0000 7efd14391640 1 --2- 172.21.15.78:0/2387096809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd0c101c90 0x7efd0c102070 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7efd08009ca0 tx=0x7efd0802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.468+0000 7efd14391640 1 -- 172.21.15.78:0/2387096809 shutdown_connections 2024-09-11T00:18:07.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.468+0000 7efd14391640 1 --2- 172.21.15.78:0/2387096809 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd0c108020 0x7efd0c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.468+0000 7efd14391640 1 --2- 172.21.15.78:0/2387096809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd0c1076a0 0x7efd0c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.468+0000 7efd14391640 1 --2- 172.21.15.78:0/2387096809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd0c101c90 0x7efd0c102070 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.468+0000 7efd14391640 1 -- 172.21.15.78:0/2387096809 >> 172.21.15.78:0/2387096809 conn(0x7efd0c0fd700 msgr2=0x7efd0c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:07.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.468+0000 7efd14391640 1 -- 172.21.15.78:0/2387096809 shutdown_connections 2024-09-11T00:18:07.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.468+0000 7efd14391640 1 -- 172.21.15.78:0/2387096809 wait complete. 2024-09-11T00:18:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.468+0000 7efd14391640 1 Processor -- start 2024-09-11T00:18:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.468+0000 7efd14391640 1 -- start start 2024-09-11T00:18:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.469+0000 7efd14391640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd0c101c90 0x7efd0c1a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.469+0000 7efd14391640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd0c1076a0 0x7efd0c1a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.469+0000 7efd14391640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd0c108020 0x7efd0c19f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.469+0000 7efd14391640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efd0c111ce0 con 0x7efd0c108020 2024-09-11T00:18:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.469+0000 7efd14391640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efd0c111b60 con 0x7efd0c1076a0 2024-09-11T00:18:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.469+0000 7efd14391640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7efd0c111e60 con 0x7efd0c101c90 2024-09-11T00:18:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.469+0000 7efd1292e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd0c108020 0x7efd0c19f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.469+0000 7efd1292e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd0c108020 0x7efd0c19f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55528/0 (socket says 172.21.15.78:55528) 2024-09-11T00:18:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.469+0000 7efd1192c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd0c1076a0 0x7efd0c1a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.469+0000 7efd1292e640 1 -- 172.21.15.78:0/4169444214 learned_addr learned my addr 172.21.15.78:0/4169444214 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.469+0000 7efd1212d640 1 --2- 172.21.15.78:0/4169444214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd0c101c90 0x7efd0c1a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.469+0000 7efd1292e640 1 -- 172.21.15.78:0/4169444214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd0c101c90 msgr2=0x7efd0c1a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.469+0000 7efd1292e640 1 --2- 172.21.15.78:0/4169444214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd0c101c90 0x7efd0c1a5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.469+0000 7efd1292e640 1 -- 172.21.15.78:0/4169444214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd0c1076a0 msgr2=0x7efd0c1a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.469+0000 7efd1292e640 1 --2- 172.21.15.78:0/4169444214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd0c1076a0 0x7efd0c1a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.469+0000 7efd1292e640 1 -- 172.21.15.78:0/4169444214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0c1a0220 con 0x7efd0c108020 2024-09-11T00:18:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.469+0000 7efd1292e640 1 --2- 172.21.15.78:0/4169444214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd0c108020 0x7efd0c19f960 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7efd0400d950 tx=0x7efd0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.469+0000 7efd037fe640 1 -- 172.21.15.78:0/4169444214 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd04017030 con 0x7efd0c108020 2024-09-11T00:18:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.469+0000 7efd14391640 1 -- 172.21.15.78:0/4169444214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd0c1a04b0 con 0x7efd0c108020 2024-09-11T00:18:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.469+0000 7efd037fe640 1 -- 172.21.15.78:0/4169444214 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd04004020 con 0x7efd0c108020 2024-09-11T00:18:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.469+0000 7efd037fe640 1 -- 172.21.15.78:0/4169444214 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd04003b50 con 0x7efd0c108020 2024-09-11T00:18:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.470+0000 7efd14391640 1 -- 172.21.15.78:0/4169444214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd0c1ac460 con 0x7efd0c108020 2024-09-11T00:18:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.472+0000 7efd16766740 1 Processor -- start 2024-09-11T00:18:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.472+0000 7efd037fe640 1 -- 172.21.15.78:0/4169444214 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7efd04003cf0 con 0x7efd0c108020 2024-09-11T00:18:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.472+0000 7efd16766740 1 -- start start 2024-09-11T00:18:07.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.473+0000 7efd16766740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85c480 0x55a28d85c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:07.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.473+0000 7efd16766740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a28d85cda0 0x55a28d8687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:07.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.473+0000 7efd16766740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a28d868d30 0x55a28d86b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:07.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.473+0000 7efd16766740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a28d7d2e50 con 0x55a28d85c480 2024-09-11T00:18:07.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.473+0000 7efd16766740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a28d7c2280 con 0x55a28d85cda0 2024-09-11T00:18:07.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.473+0000 7efd16766740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a28d7c6090 con 0x55a28d868d30 2024-09-11T00:18:07.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.473+0000 7efd1192c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85c480 0x55a28d85c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:07.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.473+0000 7efd1192c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85c480 0x55a28d85c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55534/0 (socket says 172.21.15.78:55534) 2024-09-11T00:18:07.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.473+0000 7efd1192c640 1 -- 172.21.15.78:0/1771487621 learned_addr learned my addr 172.21.15.78:0/1771487621 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:07.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.473+0000 7efd1212d640 1 --2- 172.21.15.78:0/1771487621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a28d85cda0 0x55a28d8687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:07.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.473+0000 7efd1192c640 1 --2- 172.21.15.78:0/1771487621 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a28d868d30 0x55a28d86b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:07.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.473+0000 7efd1192c640 1 -- 172.21.15.78:0/1771487621 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a28d868d30 msgr2=0x55a28d86b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:07.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.473+0000 7efd1192c640 1 --2- 172.21.15.78:0/1771487621 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a28d868d30 0x55a28d86b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.473+0000 7efd1192c640 1 -- 172.21.15.78:0/1771487621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a28d85cda0 msgr2=0x55a28d8687f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:07.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.473+0000 7efd1192c640 1 --2- 172.21.15.78:0/1771487621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a28d85cda0 0x55a28d8687f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.473+0000 7efd1192c640 1 -- 172.21.15.78:0/1771487621 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a28d520650 con 0x55a28d85c480 2024-09-11T00:18:07.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.473+0000 7efd037fe640 1 --2- 172.21.15.78:0/4169444214 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efcf80b5450 0x7efcf80b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:07.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.473+0000 7efd1192c640 1 --2- 172.21.15.78:0/1771487621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85c480 0x55a28d85c860 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7efcfc0135a0 tx=0x7efcfc009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3911a33b05a11de4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:07.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.473+0000 7efd1212d640 1 --2- 172.21.15.78:0/4169444214 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efcf80b5450 0x7efcf80b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:07.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.474+0000 7efd037fe640 1 -- 172.21.15.78:0/4169444214 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7efd040e5ae0 con 0x7efd0c108020 2024-09-11T00:18:07.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.474+0000 7efd00de6640 1 -- 172.21.15.78:0/1771487621 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc004050 con 0x55a28d85c480 2024-09-11T00:18:07.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.474+0000 7efd00de6640 1 -- 172.21.15.78:0/1771487621 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcfc0041f0 con 0x55a28d85c480 2024-09-11T00:18:07.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.474+0000 7efd00de6640 1 -- 172.21.15.78:0/1771487621 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc00f7e0 con 0x55a28d85c480 2024-09-11T00:18:07.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.474+0000 7efd16766740 1 -- 172.21.15.78:0/1771487621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85c480 msgr2=0x55a28d85c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:07.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.474+0000 7efd1212d640 1 --2- 172.21.15.78:0/4169444214 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efcf80b5450 0x7efcf80b7910 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55a28d85b190 tx=0x7efd08009980 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:07.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.474+0000 7efd16766740 1 --2- 172.21.15.78:0/1771487621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85c480 0x55a28d85c860 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7efcfc0135a0 tx=0x7efcfc009850 comp rx=0 tx=0).stop 2024-09-11T00:18:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.474+0000 7efd16766740 1 -- 172.21.15.78:0/1771487621 shutdown_connections 2024-09-11T00:18:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.474+0000 7efd16766740 1 --2- 172.21.15.78:0/1771487621 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a28d868d30 0x55a28d86b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.474+0000 7efd16766740 1 --2- 172.21.15.78:0/1771487621 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a28d85cda0 0x55a28d8687f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.474+0000 7efd16766740 1 --2- 172.21.15.78:0/1771487621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85c480 0x55a28d85c860 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.474+0000 7efd16766740 1 -- 172.21.15.78:0/1771487621 >> 172.21.15.78:0/1771487621 conn(0x55a28d85a2b0 msgr2=0x55a28d85b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.475+0000 7efd16766740 1 -- 172.21.15.78:0/1771487621 shutdown_connections 2024-09-11T00:18:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.475+0000 7efd16766740 1 -- 172.21.15.78:0/1771487621 wait complete. 2024-09-11T00:18:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.475+0000 7efd16766740 1 -- start start 2024-09-11T00:18:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.475+0000 7efd16766740 1 Processor -- start 2024-09-11T00:18:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.475+0000 7efd16766740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a28d85c480 0x55a28d868640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.475+0000 7efd16766740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85cda0 0x55a28d865a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.475+0000 7efd16766740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a28d868d30 0x55a28d8660c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.475+0000 7efd16766740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a28d623700 con 0x55a28d85cda0 2024-09-11T00:18:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.475+0000 7efd16766740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a28d75d110 con 0x55a28d85c480 2024-09-11T00:18:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.475+0000 7efd16766740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a28d86b950 con 0x55a28d868d30 2024-09-11T00:18:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.475+0000 7efd16766740 10 client.0 _ll_register_callbacks cb 0x55a28d776990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:18:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.475+0000 7efd1192c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85cda0 0x55a28d865a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.475+0000 7efd1212d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a28d85c480 0x55a28d868640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.475+0000 7efd1192c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85cda0 0x55a28d865a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55536/0 (socket says 172.21.15.78:55536) 2024-09-11T00:18:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.475+0000 7efd1292e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a28d868d30 0x55a28d8660c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.475+0000 7efd1192c640 1 -- 172.21.15.78:0/732250381 learned_addr learned my addr 172.21.15.78:0/732250381 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.476+0000 7efd1192c640 1 -- 172.21.15.78:0/732250381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a28d868d30 msgr2=0x55a28d8660c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.476+0000 7efd1192c640 1 --2- 172.21.15.78:0/732250381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a28d868d30 0x55a28d8660c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.476+0000 7efd1192c640 1 -- 172.21.15.78:0/732250381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a28d85c480 msgr2=0x55a28d868640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.476+0000 7efd1192c640 1 --2- 172.21.15.78:0/732250381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a28d85c480 0x55a28d868640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.476+0000 7efd1192c640 1 -- 172.21.15.78:0/732250381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a28d78ac40 con 0x55a28d85cda0 2024-09-11T00:18:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.476+0000 7efd1192c640 1 --2- 172.21.15.78:0/732250381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85cda0 0x55a28d865a90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7efcfc005bc0 tx=0x7efcfc0099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a7093693ffe103 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.476+0000 7efcf5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:18:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.476+0000 7efcf5ffb640 1 -- 172.21.15.78:0/732250381 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0037f0 con 0x55a28d85cda0 2024-09-11T00:18:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.476+0000 7efcf5ffb640 1 -- 172.21.15.78:0/732250381 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7efcfc003990 con 0x55a28d85cda0 2024-09-11T00:18:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.476+0000 7efd16766740 1 -- 172.21.15.78:0/732250381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcfc0041f0 con 0x55a28d85cda0 2024-09-11T00:18:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.476+0000 7efcf5ffb640 1 -- 172.21.15.78:0/732250381 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7efcfc005050 con 0x55a28d85cda0 2024-09-11T00:18:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.476+0000 7efd16766740 10 client.15522 fetch_fsmap learned FSMap version 20 2024-09-11T00:18:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.476+0000 7efd16766740 1 -- 172.21.15.78:0/732250381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a28d8772e0 con 0x55a28d85cda0 2024-09-11T00:18:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.476+0000 7efcf5ffb640 1 -- 172.21.15.78:0/732250381 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcfc0041f0 con 0x55a28d85cda0 2024-09-11T00:18:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.477+0000 7efcf5ffb640 1 -- 172.21.15.78:0/732250381 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7efcfc031020 con 0x55a28d85cda0 2024-09-11T00:18:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.477+0000 7efd16766740 10 client.15522 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:18:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.477+0000 7efd16766740 10 client.15522 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:18:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.477+0000 7efd16766740 20 client.15522 populate_metadata read hostname 'smithi078' 2024-09-11T00:18:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.477+0000 7efd16766740 1 --2- 172.21.15.78:0/732250381 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a28d878630 0x55a28d87aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.477+0000 7efd16766740 4 client.15522 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:18:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.477+0000 7efd16766740 1 -- 172.21.15.78:0/732250381 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a28d7d4da0 con 0x55a28d878630 2024-09-11T00:18:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.477+0000 7efd1212d640 1 --2- 172.21.15.78:0/732250381 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a28d878630 0x55a28d87aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.477+0000 7efcf5ffb640 10 client.15522 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.477+0000 7efd1212d640 1 --2- 172.21.15.78:0/732250381 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a28d878630 0x55a28d87aa20 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d169529b6dd64b2 server_cookie=90693ca598769803 in_seq=0 out_seq=0 2024-09-11T00:18:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.478+0000 7efcf5ffb640 1 -- 172.21.15.78:0/732250381 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a28d7d4da0 con 0x55a28d878630 2024-09-11T00:18:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.478+0000 7efcf5ffb640 10 client.15522 handle_command_reply: tid=0 2024-09-11T00:18:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.478+0000 7efd16766740 1 client.15522 shutdown 2024-09-11T00:18:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.478+0000 7efd16766740 1 -- 172.21.15.78:0/732250381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85cda0 msgr2=0x55a28d865a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.478+0000 7efd16766740 1 --2- 172.21.15.78:0/732250381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85cda0 0x55a28d865a90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7efcfc005bc0 tx=0x7efcfc0099b0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.478+0000 7efd16766740 1 -- 172.21.15.78:0/732250381 shutdown_connections 2024-09-11T00:18:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.478+0000 7efd16766740 1 --2- 172.21.15.78:0/732250381 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a28d878630 0x55a28d87aa20 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.478+0000 7efd16766740 1 --2- 172.21.15.78:0/732250381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a28d868d30 0x55a28d8660c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.478+0000 7efd16766740 1 --2- 172.21.15.78:0/732250381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85cda0 0x55a28d865a90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.478+0000 7efd16766740 1 --2- 172.21.15.78:0/732250381 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a28d85c480 0x55a28d868640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.478+0000 7efcf5ffb640 0 client.15522 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:07.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.478+0000 7efd16766740 1 -- 172.21.15.78:0/732250381 >> 172.21.15.78:0/732250381 conn(0x55a28d85a2b0 msgr2=0x55a28d85fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:07.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.478+0000 7efd16766740 1 -- 172.21.15.78:0/732250381 shutdown_connections 2024-09-11T00:18:07.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.478+0000 7efd16766740 1 -- 172.21.15.78:0/732250381 wait complete. 2024-09-11T00:18:07.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.478+0000 7efd16766740 20 client.15522 trim_cache size 0 max 16384 2024-09-11T00:18:07.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.496+0000 7efd16766740 1 Processor -- start 2024-09-11T00:18:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.496+0000 7efd16766740 1 -- start start 2024-09-11T00:18:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.497+0000 7efd16766740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a28d85c480 0x55a28d85ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.497+0000 7efd16766740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85cda0 0x55a28d8552d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.497+0000 7efd16766740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a28d868d30 0x55a28d86a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.497+0000 7efd16766740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efd0c1b2d10 con 0x55a28d85cda0 2024-09-11T00:18:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.497+0000 7efd16766740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efd0c1b5590 con 0x55a28d868d30 2024-09-11T00:18:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.497+0000 7efd16766740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7efd0c1b3380 con 0x55a28d85c480 2024-09-11T00:18:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.497+0000 7efd1192c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85cda0 0x55a28d8552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.497+0000 7efd1212d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a28d85c480 0x55a28d85ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.497+0000 7efd1192c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85cda0 0x55a28d8552d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55538/0 (socket says 172.21.15.78:55538) 2024-09-11T00:18:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.497+0000 7efd1212d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a28d85c480 0x55a28d85ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.78:53946/0 (socket says 172.21.15.78:53946) 2024-09-11T00:18:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.497+0000 7efd1192c640 1 -- 172.21.15.78:0/1184831575 learned_addr learned my addr 172.21.15.78:0/1184831575 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.497+0000 7efd1292e640 1 --2- 172.21.15.78:0/1184831575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a28d868d30 0x55a28d86a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.497+0000 7efd1192c640 1 -- 172.21.15.78:0/1184831575 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a28d85c480 msgr2=0x55a28d85ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.497+0000 7efd1192c640 1 --2- 172.21.15.78:0/1184831575 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a28d85c480 0x55a28d85ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.497+0000 7efd1192c640 1 -- 172.21.15.78:0/1184831575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a28d868d30 msgr2=0x55a28d86a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.497+0000 7efd1192c640 1 --2- 172.21.15.78:0/1184831575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a28d868d30 0x55a28d86a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.497+0000 7efd1192c640 1 -- 172.21.15.78:0/1184831575 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a28d8649f0 con 0x55a28d85cda0 2024-09-11T00:18:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.497+0000 7efd1192c640 1 --2- 172.21.15.78:0/1184831575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85cda0 0x55a28d8552d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7efcfc014fd0 tx=0x7efcfc00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f84fbebe9ae30 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.497+0000 7efcf7fff640 1 -- 172.21.15.78:0/1184831575 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0133c0 con 0x55a28d85cda0 2024-09-11T00:18:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.497+0000 7efcf7fff640 1 -- 172.21.15.78:0/1184831575 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcfc0097a0 con 0x55a28d85cda0 2024-09-11T00:18:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.497+0000 7efcf7fff640 1 -- 172.21.15.78:0/1184831575 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc003a10 con 0x55a28d85cda0 2024-09-11T00:18:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.498+0000 7efd16766740 1 -- 172.21.15.78:0/1184831575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85cda0 msgr2=0x55a28d8552d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.498+0000 7efd16766740 1 --2- 172.21.15.78:0/1184831575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85cda0 0x55a28d8552d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7efcfc014fd0 tx=0x7efcfc00f3c0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.498+0000 7efd16766740 1 -- 172.21.15.78:0/1184831575 shutdown_connections 2024-09-11T00:18:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.498+0000 7efd16766740 1 --2- 172.21.15.78:0/1184831575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a28d868d30 0x55a28d86a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.498+0000 7efd16766740 1 --2- 172.21.15.78:0/1184831575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85cda0 0x55a28d8552d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.498+0000 7efd16766740 1 --2- 172.21.15.78:0/1184831575 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a28d85c480 0x55a28d85ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.498+0000 7efd16766740 1 -- 172.21.15.78:0/1184831575 >> 172.21.15.78:0/1184831575 conn(0x55a28d85a2b0 msgr2=0x55a28d85b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.498+0000 7efd16766740 1 -- 172.21.15.78:0/1184831575 shutdown_connections 2024-09-11T00:18:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.498+0000 7efd16766740 1 -- 172.21.15.78:0/1184831575 wait complete. 2024-09-11T00:18:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.498+0000 7efd16766740 1 -- start start 2024-09-11T00:18:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.498+0000 7efd16766740 1 Processor -- start 2024-09-11T00:18:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.499+0000 7efd16766740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a28d85c480 0x55a28d871420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.499+0000 7efd16766740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85cda0 0x55a28d86bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.499+0000 7efd16766740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a28d868d30 0x55a28d86c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.499+0000 7efd16766740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efd0c1b3a50 con 0x55a28d85cda0 2024-09-11T00:18:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.499+0000 7efd16766740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efd0c1b4ec0 con 0x55a28d85c480 2024-09-11T00:18:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.499+0000 7efd16766740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7efd0c1b4120 con 0x55a28d868d30 2024-09-11T00:18:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.499+0000 7efd16766740 10 client.0 _ll_register_callbacks cb 0x7efcfc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:18:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.499+0000 7efd1192c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85cda0 0x55a28d86bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.499+0000 7efd1212d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a28d85c480 0x55a28d871420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.499+0000 7efd1212d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a28d85c480 0x55a28d871420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.78:40144/0 (socket says 172.21.15.78:40144) 2024-09-11T00:18:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.499+0000 7efd1192c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85cda0 0x55a28d86bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55544/0 (socket says 172.21.15.78:55544) 2024-09-11T00:18:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.499+0000 7efd1212d640 1 -- 172.21.15.78:0/374254392 learned_addr learned my addr 172.21.15.78:0/374254392 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.499+0000 7efd1292e640 1 --2- 172.21.15.78:0/374254392 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a28d868d30 0x55a28d86c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.499+0000 7efd1212d640 1 -- 172.21.15.78:0/374254392 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a28d868d30 msgr2=0x55a28d86c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.499+0000 7efd1212d640 1 --2- 172.21.15.78:0/374254392 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a28d868d30 0x55a28d86c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.499+0000 7efd1212d640 1 -- 172.21.15.78:0/374254392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85cda0 msgr2=0x55a28d86bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.499+0000 7efd1212d640 1 --2- 172.21.15.78:0/374254392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85cda0 0x55a28d86bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.499+0000 7efd1212d640 1 -- 172.21.15.78:0/374254392 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a28d85cbd0 con 0x55a28d85c480 2024-09-11T00:18:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.499+0000 7efd1192c640 1 --2- 172.21.15.78:0/374254392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85cda0 0x55a28d86bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:18:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.499+0000 7efd1212d640 1 --2- 172.21.15.78:0/374254392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a28d85c480 0x55a28d871420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efd08009ca0 tx=0x7efd080095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8382896ad00f8ab9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.499+0000 7efcf5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-11T00:18:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.500+0000 7efcf5ffb640 1 -- 172.21.15.78:0/374254392 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd08031740 con 0x55a28d85c480 2024-09-11T00:18:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.500+0000 7efcf5ffb640 1 -- 172.21.15.78:0/374254392 <== mon.2 v2:172.21.15.112:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7efd08003970 con 0x55a28d85c480 2024-09-11T00:18:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.500+0000 7efd16766740 1 -- 172.21.15.78:0/374254392 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcfc0097a0 con 0x55a28d85c480 2024-09-11T00:18:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.500+0000 7efcf5ffb640 1 -- 172.21.15.78:0/374254392 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7efd080318e0 con 0x55a28d85c480 2024-09-11T00:18:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.500+0000 7efd16766740 10 client.25061 fetch_fsmap learned FSMap version 20 2024-09-11T00:18:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.500+0000 7efd16766740 1 -- 172.21.15.78:0/374254392 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a28d866430 con 0x55a28d85c480 2024-09-11T00:18:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.500+0000 7efcf5ffb640 1 -- 172.21.15.78:0/374254392 <== mon.2 v2:172.21.15.112:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcfc0097a0 con 0x55a28d85c480 2024-09-11T00:18:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.500+0000 7efcf5ffb640 1 -- 172.21.15.78:0/374254392 <== mon.2 v2:172.21.15.112:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7efd08062030 con 0x55a28d85c480 2024-09-11T00:18:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.500+0000 7efd16766740 10 client.25061 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:18:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.500+0000 7efd16766740 10 client.25061 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:18:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.500+0000 7efd16766740 20 client.25061 populate_metadata read hostname 'smithi078' 2024-09-11T00:18:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.500+0000 7efd16766740 1 --2- 172.21.15.78:0/374254392 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a28d8e67d0 0x55a28d8e8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.500+0000 7efd16766740 4 client.25061 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:18:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.500+0000 7efd16766740 1 -- 172.21.15.78:0/374254392 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a28d7d0850 con 0x55a28d8e67d0 2024-09-11T00:18:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.500+0000 7efd1192c640 1 --2- 172.21.15.78:0/374254392 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a28d8e67d0 0x55a28d8e8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.501+0000 7efcf5ffb640 10 client.25061 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.501+0000 7efd1192c640 1 --2- 172.21.15.78:0/374254392 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a28d8e67d0 0x55a28d8e8bf0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=306e3624e5914aac server_cookie=87e31e33001d2aac in_seq=0 out_seq=0 2024-09-11T00:18:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.502+0000 7efcf5ffb640 1 -- 172.21.15.78:0/374254392 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x55a28d7d0850 con 0x55a28d8e67d0 2024-09-11T00:18:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.502+0000 7efcf5ffb640 10 client.25061 handle_command_reply: tid=0 2024-09-11T00:18:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.502+0000 7efd16766740 1 client.25061 shutdown 2024-09-11T00:18:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.502+0000 7efd16766740 1 -- 172.21.15.78:0/374254392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a28d85c480 msgr2=0x55a28d871420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.502+0000 7efd16766740 1 --2- 172.21.15.78:0/374254392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a28d85c480 0x55a28d871420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efd08009ca0 tx=0x7efd080095c0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.502+0000 7efd16766740 1 -- 172.21.15.78:0/374254392 shutdown_connections 2024-09-11T00:18:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.502+0000 7efd16766740 1 --2- 172.21.15.78:0/374254392 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a28d8e67d0 0x55a28d8e8bf0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.502+0000 7efd16766740 1 --2- 172.21.15.78:0/374254392 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a28d868d30 0x55a28d86c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.502+0000 7efd16766740 1 --2- 172.21.15.78:0/374254392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a28d85cda0 0x55a28d86bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.502+0000 7efcf5ffb640 0 client.25061 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:07.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.502+0000 7efd16766740 1 --2- 172.21.15.78:0/374254392 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a28d85c480 0x55a28d871420 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.502+0000 7efd16766740 1 -- 172.21.15.78:0/374254392 >> 172.21.15.78:0/374254392 conn(0x55a28d85a2b0 msgr2=0x55a28d858bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:07.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.502+0000 7efd16766740 1 -- 172.21.15.78:0/374254392 shutdown_connections 2024-09-11T00:18:07.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.503+0000 7efd16766740 1 -- 172.21.15.78:0/374254392 wait complete. 2024-09-11T00:18:07.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.503+0000 7efd16766740 20 client.25061 trim_cache size 0 max 16384 2024-09-11T00:18:07.517 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:18:07.517 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-11T00:18:07.517 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {}, 2024-09-11T00:18:07.517 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:18:07.518 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:18:07.518 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:18:07.518 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:18:07.518 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:18:07.518 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:18:07.518 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:18:07.518 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:18:07.518 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:18:07.518 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:18:07.518 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:18:07.518 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:18:07.518 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:18:07.518 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:18:07.518 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:18:07.519 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:18:07.519 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:18:07.519 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:18:07.519 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:18:07.519 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:18:07.519 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:18:07.519 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:18:07.519 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:18:07.519 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:18:07.519 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:18:07.519 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:18:07.519 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:18:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.503+0000 7efd14391640 1 -- 172.21.15.78:0/4169444214 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efcf80b5450 msgr2=0x7efcf80b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.503+0000 7efd14391640 1 --2- 172.21.15.78:0/4169444214 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efcf80b5450 0x7efcf80b7910 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55a28d85b190 tx=0x7efd08009980 comp rx=0 tx=0).stop 2024-09-11T00:18:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.503+0000 7efd14391640 1 -- 172.21.15.78:0/4169444214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd0c108020 msgr2=0x7efd0c19f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.503+0000 7efd14391640 1 --2- 172.21.15.78:0/4169444214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd0c108020 0x7efd0c19f960 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7efd0400d950 tx=0x7efd0400de10 comp rx=0 tx=0).stop 2024-09-11T00:18:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.503+0000 7efd14391640 1 -- 172.21.15.78:0/4169444214 shutdown_connections 2024-09-11T00:18:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.503+0000 7efd14391640 1 --2- 172.21.15.78:0/4169444214 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efcf80b5450 0x7efcf80b7910 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.503+0000 7efd14391640 1 --2- 172.21.15.78:0/4169444214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd0c108020 0x7efd0c19f960 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.503+0000 7efd14391640 1 --2- 172.21.15.78:0/4169444214 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efd0c1076a0 0x7efd0c1a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.503+0000 7efd14391640 1 --2- 172.21.15.78:0/4169444214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd0c101c90 0x7efd0c1a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.503+0000 7efd14391640 1 -- 172.21.15.78:0/4169444214 >> 172.21.15.78:0/4169444214 conn(0x7efd0c0fd700 msgr2=0x7efd0c06abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.503+0000 7efd14391640 1 -- 172.21.15.78:0/4169444214 shutdown_connections 2024-09-11T00:18:07.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:07.503+0000 7efd14391640 1 -- 172.21.15.78:0/4169444214 wait complete. 2024-09-11T00:18:08.402 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:18:08.403 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:18:08.698 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:18:09.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:08 smithi138 ceph-mon[35019]: pgmap v373: 97 pgs: 97 active+clean; 2.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 225 MiB/s rd, 274 MiB/s wr, 382 op/s 2024-09-11T00:18:09.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:08 smithi078 ceph-mon[30865]: pgmap v373: 97 pgs: 97 active+clean; 2.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 225 MiB/s rd, 274 MiB/s wr, 382 op/s 2024-09-11T00:18:09.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.192+0000 7f4ed8ed1640 1 -- 172.21.15.78:0/997004003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ed410d100 msgr2=0x7f4ed410f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:09.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.192+0000 7f4ed8ed1640 1 --2- 172.21.15.78:0/997004003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ed410d100 0x7f4ed410f560 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009ca0 tx=0x7f4ecc02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:18:09.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.192+0000 7f4ed8ed1640 1 -- 172.21.15.78:0/997004003 shutdown_connections 2024-09-11T00:18:09.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.192+0000 7f4ed8ed1640 1 --2- 172.21.15.78:0/997004003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ed410d100 0x7f4ed410f560 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:09.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.192+0000 7f4ed8ed1640 1 --2- 172.21.15.78:0/997004003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ed41045c0 0x7f4ed410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:09.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.192+0000 7f4ed8ed1640 1 --2- 172.21.15.78:0/997004003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ed4103ca0 0x7f4ed4104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:09.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.192+0000 7f4ed8ed1640 1 -- 172.21.15.78:0/997004003 >> 172.21.15.78:0/997004003 conn(0x7f4ed40fd700 msgr2=0x7f4ed40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:09.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.192+0000 7f4ed8ed1640 1 -- 172.21.15.78:0/997004003 shutdown_connections 2024-09-11T00:18:09.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.192+0000 7f4ed8ed1640 1 -- 172.21.15.78:0/997004003 wait complete. 2024-09-11T00:18:09.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.193+0000 7f4ed8ed1640 1 Processor -- start 2024-09-11T00:18:09.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.193+0000 7f4ed8ed1640 1 -- start start 2024-09-11T00:18:09.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.193+0000 7f4ed8ed1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ed4103ca0 0x7f4ed41992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:09.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.193+0000 7f4ed8ed1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ed41045c0 0x7f4ed41997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:09.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.193+0000 7f4ed8ed1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ed410d100 0x7f4ed419eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:09.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.193+0000 7f4ed8ed1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed4112dd0 con 0x7f4ed41045c0 2024-09-11T00:18:09.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.193+0000 7f4ed8ed1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed4112c50 con 0x7f4ed410d100 2024-09-11T00:18:09.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.193+0000 7f4ed8ed1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed4112f50 con 0x7f4ed4103ca0 2024-09-11T00:18:09.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.193+0000 7f4ed2d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ed410d100 0x7f4ed419eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:09.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.193+0000 7f4ed259c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ed4103ca0 0x7f4ed41992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:09.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.193+0000 7f4ed2d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ed410d100 0x7f4ed419eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.78:40150/0 (socket says 172.21.15.78:40150) 2024-09-11T00:18:09.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.193+0000 7f4ed2d9d640 1 -- 172.21.15.78:0/1950865964 learned_addr learned my addr 172.21.15.78:0/1950865964 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:09.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.194+0000 7f4ecbfff640 1 --2- 172.21.15.78:0/1950865964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ed41045c0 0x7f4ed41997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:09.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.194+0000 7f4ed259c640 1 -- 172.21.15.78:0/1950865964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ed410d100 msgr2=0x7f4ed419eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:09.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.194+0000 7f4ed259c640 1 --2- 172.21.15.78:0/1950865964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ed410d100 0x7f4ed419eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:09.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.194+0000 7f4ed259c640 1 -- 172.21.15.78:0/1950865964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ed41045c0 msgr2=0x7f4ed41997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:09.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.194+0000 7f4ed259c640 1 --2- 172.21.15.78:0/1950865964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ed41045c0 0x7f4ed41997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:09.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.194+0000 7f4ed259c640 1 -- 172.21.15.78:0/1950865964 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ed419f350 con 0x7f4ed4103ca0 2024-09-11T00:18:09.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.194+0000 7f4ecbfff640 1 --2- 172.21.15.78:0/1950865964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ed41045c0 0x7f4ed41997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:18:09.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.194+0000 7f4ed259c640 1 --2- 172.21.15.78:0/1950865964 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ed4103ca0 0x7f4ed41992a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400d6d0 tx=0x7f4ec400db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:09.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.194+0000 7f4ecb7fe640 1 -- 172.21.15.78:0/1950865964 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4017070 con 0x7f4ed4103ca0 2024-09-11T00:18:09.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.195+0000 7f4ed8ed1640 1 -- 172.21.15.78:0/1950865964 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ed419f640 con 0x7f4ed4103ca0 2024-09-11T00:18:09.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.195+0000 7f4ecb7fe640 1 -- 172.21.15.78:0/1950865964 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ec4009820 con 0x7f4ed4103ca0 2024-09-11T00:18:09.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.195+0000 7f4ecb7fe640 1 -- 172.21.15.78:0/1950865964 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4004c40 con 0x7f4ed4103ca0 2024-09-11T00:18:09.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.195+0000 7f4ed8ed1640 1 -- 172.21.15.78:0/1950865964 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ed4101a80 con 0x7f4ed4103ca0 2024-09-11T00:18:09.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.195+0000 7f4ed8ed1640 1 -- 172.21.15.78:0/1950865964 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ed406b1b0 con 0x7f4ed4103ca0 2024-09-11T00:18:09.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.197+0000 7f4ecb7fe640 1 -- 172.21.15.78:0/1950865964 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f4ec4005220 con 0x7f4ed4103ca0 2024-09-11T00:18:09.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.198+0000 7f4ecb7fe640 1 --2- 172.21.15.78:0/1950865964 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4ec00b5450 0x7f4ec00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:09.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.198+0000 7f4ecbfff640 1 --2- 172.21.15.78:0/1950865964 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4ec00b5450 0x7f4ec00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:09.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.198+0000 7f4ecb7fe640 1 -- 172.21.15.78:0/1950865964 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f4ec40e5e10 con 0x7f4ed4103ca0 2024-09-11T00:18:09.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.198+0000 7f4ecbfff640 1 --2- 172.21.15.78:0/1950865964 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4ec00b5450 0x7f4ec00b7910 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4ed41012c0 tx=0x7f4ebc009060 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:09.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.203+0000 7f4ecb7fe640 1 -- 172.21.15.78:0/1950865964 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4ec40ac360 con 0x7f4ed4103ca0 2024-09-11T00:18:09.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:08 smithi112 ceph-mon[35627]: pgmap v373: 97 pgs: 97 active+clean; 2.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 225 MiB/s rd, 274 MiB/s wr, 382 op/s 2024-09-11T00:18:09.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.469+0000 7f4ed8ed1640 1 -- 172.21.15.78:0/1950865964 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ed4101ce0 con 0x7f4ed4103ca0 2024-09-11T00:18:09.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.470+0000 7f4ecb7fe640 1 -- 172.21.15.78:0/1950865964 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f4ec40b0d90 con 0x7f4ed4103ca0 2024-09-11T00:18:09.472 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:18:09.472 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:18:09.472 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:18:09.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.473+0000 7f4ed8ed1640 1 -- 172.21.15.78:0/1950865964 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4ec00b5450 msgr2=0x7f4ec00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:09.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.473+0000 7f4ed8ed1640 1 --2- 172.21.15.78:0/1950865964 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4ec00b5450 0x7f4ec00b7910 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4ed41012c0 tx=0x7f4ebc009060 comp rx=0 tx=0).stop 2024-09-11T00:18:09.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.473+0000 7f4ed8ed1640 1 -- 172.21.15.78:0/1950865964 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ed4103ca0 msgr2=0x7f4ed41992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:09.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.473+0000 7f4ed8ed1640 1 --2- 172.21.15.78:0/1950865964 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ed4103ca0 0x7f4ed41992a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400d6d0 tx=0x7f4ec400db90 comp rx=0 tx=0).stop 2024-09-11T00:18:09.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.473+0000 7f4ed8ed1640 1 -- 172.21.15.78:0/1950865964 shutdown_connections 2024-09-11T00:18:09.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.473+0000 7f4ed8ed1640 1 --2- 172.21.15.78:0/1950865964 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4ec00b5450 0x7f4ec00b7910 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:09.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.473+0000 7f4ed8ed1640 1 --2- 172.21.15.78:0/1950865964 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4ed410d100 0x7f4ed419eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:09.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.473+0000 7f4ed8ed1640 1 --2- 172.21.15.78:0/1950865964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ed41045c0 0x7f4ed41997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:09.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.473+0000 7f4ed8ed1640 1 --2- 172.21.15.78:0/1950865964 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ed4103ca0 0x7f4ed41992a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:09.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.473+0000 7f4ed8ed1640 1 -- 172.21.15.78:0/1950865964 >> 172.21.15.78:0/1950865964 conn(0x7f4ed40fd700 msgr2=0x7f4ed410f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:09.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.473+0000 7f4ed8ed1640 1 -- 172.21.15.78:0/1950865964 shutdown_connections 2024-09-11T00:18:09.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:09.473+0000 7f4ed8ed1640 1 -- 172.21.15.78:0/1950865964 wait complete. 2024-09-11T00:18:10.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:09 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1950865964' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:18:10.082 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:09 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1950865964' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:18:10.110 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:18:10.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:09 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1950865964' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:18:10.388 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:18:10.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.878+0000 7f9498b61640 1 -- 172.21.15.78:0/180364923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94941087a0 msgr2=0x7f9494108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:10.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.878+0000 7f9498b61640 1 --2- 172.21.15.78:0/180364923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94941087a0 0x7f9494108be0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f947c009900 tx=0x7f947c02a410 comp rx=0 tx=0).stop 2024-09-11T00:18:10.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.878+0000 7f9498b61640 1 -- 172.21.15.78:0/180364923 shutdown_connections 2024-09-11T00:18:10.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.878+0000 7f9498b61640 1 --2- 172.21.15.78:0/180364923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9494109120 0x7f949410f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.878+0000 7f9498b61640 1 --2- 172.21.15.78:0/180364923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94941087a0 0x7f9494108be0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.878+0000 7f9498b61640 1 --2- 172.21.15.78:0/180364923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9494102d90 0x7f9494103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.878+0000 7f9498b61640 1 -- 172.21.15.78:0/180364923 >> 172.21.15.78:0/180364923 conn(0x7f94940fe820 msgr2=0x7f9494100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:10.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.878+0000 7f9498b61640 1 -- 172.21.15.78:0/180364923 shutdown_connections 2024-09-11T00:18:10.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.878+0000 7f9498b61640 1 -- 172.21.15.78:0/180364923 wait complete. 2024-09-11T00:18:10.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.879+0000 7f9498b61640 1 Processor -- start 2024-09-11T00:18:10.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.879+0000 7f9498b61640 1 -- start start 2024-09-11T00:18:10.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.879+0000 7f9498b61640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9494102d90 0x7f9494199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:10.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.879+0000 7f9498b61640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94941087a0 0x7f94941997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:10.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.880+0000 7f9498b61640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9494109120 0x7f949419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:10.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.880+0000 7f9498b61640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9494112d70 con 0x7f94941087a0 2024-09-11T00:18:10.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.880+0000 7f9498b61640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9494112bf0 con 0x7f9494109120 2024-09-11T00:18:10.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.880+0000 7f9498b61640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9494112ef0 con 0x7f9494102d90 2024-09-11T00:18:10.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.880+0000 7f9489d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94941087a0 0x7f94941997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:10.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.880+0000 7f9489d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94941087a0 0x7f94941997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55594/0 (socket says 172.21.15.78:55594) 2024-09-11T00:18:10.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.880+0000 7f9489d9b640 1 -- 172.21.15.78:0/381442164 learned_addr learned my addr 172.21.15.78:0/381442164 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:10.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.880+0000 7f949259c640 1 --2- 172.21.15.78:0/381442164 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9494102d90 0x7f9494199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:10.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.880+0000 7f9492d9d640 1 --2- 172.21.15.78:0/381442164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9494109120 0x7f949419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:10.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.880+0000 7f9489d9b640 1 -- 172.21.15.78:0/381442164 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9494102d90 msgr2=0x7f9494199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:10.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.880+0000 7f9489d9b640 1 --2- 172.21.15.78:0/381442164 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9494102d90 0x7f9494199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.880+0000 7f9489d9b640 1 -- 172.21.15.78:0/381442164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9494109120 msgr2=0x7f949419eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:10.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.880+0000 7f9489d9b640 1 --2- 172.21.15.78:0/381442164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9494109120 0x7f949419eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.880+0000 7f9489d9b640 1 -- 172.21.15.78:0/381442164 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f949419f330 con 0x7f94941087a0 2024-09-11T00:18:10.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.880+0000 7f9489d9b640 1 --2- 172.21.15.78:0/381442164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94941087a0 0x7f94941997c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f947c005940 tx=0x7f947c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:10.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.880+0000 7f948bfff640 1 -- 172.21.15.78:0/381442164 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c03f030 con 0x7f94941087a0 2024-09-11T00:18:10.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.880+0000 7f9498b61640 1 -- 172.21.15.78:0/381442164 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f949419f5c0 con 0x7f94941087a0 2024-09-11T00:18:10.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.880+0000 7f948bfff640 1 -- 172.21.15.78:0/381442164 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f947c003aa0 con 0x7f94941087a0 2024-09-11T00:18:10.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.880+0000 7f948bfff640 1 -- 172.21.15.78:0/381442164 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c035070 con 0x7f94941087a0 2024-09-11T00:18:10.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.880+0000 7f9498b61640 1 -- 172.21.15.78:0/381442164 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94941a5ce0 con 0x7f94941087a0 2024-09-11T00:18:10.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.883+0000 7f949af36740 1 Processor -- start 2024-09-11T00:18:10.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.883+0000 7f948bfff640 1 -- 172.21.15.78:0/381442164 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f947c03bce0 con 0x7f94941087a0 2024-09-11T00:18:10.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.883+0000 7f949af36740 1 -- start start 2024-09-11T00:18:10.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.883+0000 7f949af36740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c01104d0 0x5557c01108b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:10.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.883+0000 7f949af36740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c0110df0 0x5557c011c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:10.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.883+0000 7f949af36740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5557c011cd80 0x5557c011f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:10.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.883+0000 7f949af36740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5557c0086ea0 con 0x5557c0110df0 2024-09-11T00:18:10.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.883+0000 7f949af36740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5557c00762d0 con 0x5557c01104d0 2024-09-11T00:18:10.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.883+0000 7f949af36740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5557c007a0e0 con 0x5557c011cd80 2024-09-11T00:18:10.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.883+0000 7f949259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c0110df0 0x5557c011c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:10.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.883+0000 7f9492d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c01104d0 0x5557c01108b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:10.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.883+0000 7f949259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c0110df0 0x5557c011c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55600/0 (socket says 172.21.15.78:55600) 2024-09-11T00:18:10.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.883+0000 7f9489d9b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5557c011cd80 0x5557c011f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:10.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.884+0000 7f949259c640 1 -- 172.21.15.78:0/2530035287 learned_addr learned my addr 172.21.15.78:0/2530035287 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:10.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.884+0000 7f949259c640 1 -- 172.21.15.78:0/2530035287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5557c011cd80 msgr2=0x5557c011f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:10.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.884+0000 7f949259c640 1 --2- 172.21.15.78:0/2530035287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5557c011cd80 0x5557c011f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.884+0000 7f949259c640 1 -- 172.21.15.78:0/2530035287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c01104d0 msgr2=0x5557c01108b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:10.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.884+0000 7f949259c640 1 --2- 172.21.15.78:0/2530035287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c01104d0 0x5557c01108b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.884+0000 7f949259c640 1 -- 172.21.15.78:0/2530035287 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557bfdd4650 con 0x5557c0110df0 2024-09-11T00:18:10.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.884+0000 7f9492d9d640 1 --2- 172.21.15.78:0/2530035287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c01104d0 0x5557c01108b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:18:10.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.884+0000 7f948bfff640 1 --2- 172.21.15.78:0/381442164 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f94800b5450 0x7f94800b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:10.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.884+0000 7f949259c640 1 --2- 172.21.15.78:0/2530035287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c0110df0 0x5557c011c840 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9484003b20 tx=0x7f9484009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead587f0a64d2009 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:10.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.884+0000 7f9492d9d640 1 --2- 172.21.15.78:0/381442164 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f94800b5450 0x7f94800b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:10.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.884+0000 7f9488d99640 1 -- 172.21.15.78:0/2530035287 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9484011440 con 0x5557c0110df0 2024-09-11T00:18:10.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.884+0000 7f948bfff640 1 -- 172.21.15.78:0/381442164 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f947c106930 con 0x7f94941087a0 2024-09-11T00:18:10.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.884+0000 7f9488d99640 1 -- 172.21.15.78:0/2530035287 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9484015030 con 0x5557c0110df0 2024-09-11T00:18:10.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.884+0000 7f9488d99640 1 -- 172.21.15.78:0/2530035287 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94840109e0 con 0x5557c0110df0 2024-09-11T00:18:10.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.885+0000 7f949af36740 1 -- 172.21.15.78:0/2530035287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c0110df0 msgr2=0x5557c011c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:10.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.885+0000 7f9492d9d640 1 --2- 172.21.15.78:0/381442164 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f94800b5450 0x7f94800b7910 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f948c009ef0 tx=0x7f948c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:10.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.885+0000 7f949af36740 1 --2- 172.21.15.78:0/2530035287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c0110df0 0x5557c011c840 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9484003b20 tx=0x7f9484009f70 comp rx=0 tx=0).stop 2024-09-11T00:18:10.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.885+0000 7f949af36740 1 -- 172.21.15.78:0/2530035287 shutdown_connections 2024-09-11T00:18:10.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.885+0000 7f949af36740 1 --2- 172.21.15.78:0/2530035287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5557c011cd80 0x5557c011f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.885+0000 7f949af36740 1 --2- 172.21.15.78:0/2530035287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c0110df0 0x5557c011c840 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.885+0000 7f949af36740 1 --2- 172.21.15.78:0/2530035287 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c01104d0 0x5557c01108b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.885+0000 7f949af36740 1 -- 172.21.15.78:0/2530035287 >> 172.21.15.78:0/2530035287 conn(0x5557c010e300 msgr2=0x5557c010f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:10.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.885+0000 7f949af36740 1 -- 172.21.15.78:0/2530035287 shutdown_connections 2024-09-11T00:18:10.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.885+0000 7f949af36740 1 -- 172.21.15.78:0/2530035287 wait complete. 2024-09-11T00:18:10.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.885+0000 7f949af36740 1 -- start start 2024-09-11T00:18:10.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.886+0000 7f949af36740 1 Processor -- start 2024-09-11T00:18:10.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.886+0000 7f949af36740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5557c01104d0 0x5557c011c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:10.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.886+0000 7f949af36740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c0110df0 0x5557c0119aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:10.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.886+0000 7f949af36740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c011cd80 0x5557c011a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:10.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.886+0000 7f949af36740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5557bfed7700 con 0x5557c0110df0 2024-09-11T00:18:10.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.886+0000 7f949af36740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5557c0011160 con 0x5557c011cd80 2024-09-11T00:18:10.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.886+0000 7f949af36740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5557c011fa00 con 0x5557c01104d0 2024-09-11T00:18:10.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.886+0000 7f949af36740 10 client.0 _ll_register_callbacks cb 0x5557c002a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:18:10.919 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-11T00:18:10.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.886+0000 7f9489d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c0110df0 0x5557c0119aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:10.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.886+0000 7f9489d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c0110df0 0x5557c0119aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55602/0 (socket says 172.21.15.78:55602) 2024-09-11T00:18:10.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.886+0000 7f9489d9b640 1 -- 172.21.15.78:0/4051828813 learned_addr learned my addr 172.21.15.78:0/4051828813 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:10.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.886+0000 7f9492d9d640 1 --2- 172.21.15.78:0/4051828813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c011cd80 0x5557c011a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:10.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.886+0000 7f949259c640 1 --2- 172.21.15.78:0/4051828813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5557c01104d0 0x5557c011c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:10.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.886+0000 7f9489d9b640 1 -- 172.21.15.78:0/4051828813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5557c01104d0 msgr2=0x5557c011c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:10.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.886+0000 7f9489d9b640 1 --2- 172.21.15.78:0/4051828813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5557c01104d0 0x5557c011c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.886+0000 7f9489d9b640 1 -- 172.21.15.78:0/4051828813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c011cd80 msgr2=0x5557c011a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:10.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.886+0000 7f9489d9b640 1 --2- 172.21.15.78:0/4051828813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c011cd80 0x5557c011a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.886+0000 7f9489d9b640 1 -- 172.21.15.78:0/4051828813 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557c003ec90 con 0x5557c0110df0 2024-09-11T00:18:10.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.887+0000 7f9489d9b640 1 --2- 172.21.15.78:0/4051828813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c0110df0 0x5557c0119aa0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f947c006010 tx=0x7f947c003e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594c0187b4c26b82 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:10.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.887+0000 7f9479ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:18:10.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.887+0000 7f9479ffb640 1 -- 172.21.15.78:0/4051828813 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c049030 con 0x5557c0110df0 2024-09-11T00:18:10.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.887+0000 7f9479ffb640 1 -- 172.21.15.78:0/4051828813 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f947c0b40e0 con 0x5557c0110df0 2024-09-11T00:18:10.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.887+0000 7f949af36740 1 -- 172.21.15.78:0/4051828813 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9484015030 con 0x5557c0110df0 2024-09-11T00:18:10.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.887+0000 7f9479ffb640 1 -- 172.21.15.78:0/4051828813 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f947c0c8d20 con 0x5557c0110df0 2024-09-11T00:18:10.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.887+0000 7f949af36740 10 client.15546 fetch_fsmap learned FSMap version 20 2024-09-11T00:18:10.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.887+0000 7f949af36740 1 -- 172.21.15.78:0/4051828813 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5557c012b310 con 0x5557c0110df0 2024-09-11T00:18:10.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.887+0000 7f9479ffb640 1 -- 172.21.15.78:0/4051828813 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9484015030 con 0x5557c0110df0 2024-09-11T00:18:10.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.887+0000 7f9479ffb640 1 -- 172.21.15.78:0/4051828813 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f947c0cd0e0 con 0x5557c0110df0 2024-09-11T00:18:10.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.887+0000 7f949af36740 10 client.15546 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:18:10.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.887+0000 7f949af36740 10 client.15546 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:18:10.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.887+0000 7f949af36740 20 client.15546 populate_metadata read hostname 'smithi078' 2024-09-11T00:18:10.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.887+0000 7f949af36740 1 --2- 172.21.15.78:0/4051828813 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5557c012c810 0x5557c012ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:10.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.887+0000 7f949af36740 4 client.15546 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:18:10.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.887+0000 7f949af36740 1 -- 172.21.15.78:0/4051828813 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557c0088df0 con 0x5557c012c810 2024-09-11T00:18:10.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.887+0000 7f949259c640 1 --2- 172.21.15.78:0/4051828813 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5557c012c810 0x5557c012ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:10.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.888+0000 7f9479ffb640 10 client.15546 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:10.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.888+0000 7f949259c640 1 --2- 172.21.15.78:0/4051828813 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5557c012c810 0x5557c012ec40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=241e37c7e747de83 server_cookie=b7740f0b6b420531 in_seq=0 out_seq=0 2024-09-11T00:18:10.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.889+0000 7f9479ffb640 1 -- 172.21.15.78:0/4051828813 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5557c0088df0 con 0x5557c012c810 2024-09-11T00:18:10.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.889+0000 7f9479ffb640 10 client.15546 handle_command_reply: tid=0 2024-09-11T00:18:10.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.889+0000 7f949af36740 1 client.15546 shutdown 2024-09-11T00:18:10.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.889+0000 7f949af36740 1 -- 172.21.15.78:0/4051828813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c0110df0 msgr2=0x5557c0119aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:10.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.889+0000 7f949af36740 1 --2- 172.21.15.78:0/4051828813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c0110df0 0x5557c0119aa0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f947c006010 tx=0x7f947c003e80 comp rx=0 tx=0).stop 2024-09-11T00:18:10.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.889+0000 7f949af36740 1 -- 172.21.15.78:0/4051828813 shutdown_connections 2024-09-11T00:18:10.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.889+0000 7f949af36740 1 --2- 172.21.15.78:0/4051828813 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5557c012c810 0x5557c012ec40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.889+0000 7f949af36740 1 --2- 172.21.15.78:0/4051828813 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c011cd80 0x5557c011a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.889+0000 7f949af36740 1 --2- 172.21.15.78:0/4051828813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c0110df0 0x5557c0119aa0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.889+0000 7f9479ffb640 0 client.15546 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:10.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.889+0000 7f949af36740 1 --2- 172.21.15.78:0/4051828813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5557c01104d0 0x5557c011c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.889+0000 7f949af36740 1 -- 172.21.15.78:0/4051828813 >> 172.21.15.78:0/4051828813 conn(0x5557c010e300 msgr2=0x5557c0113ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:10.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.889+0000 7f949af36740 1 -- 172.21.15.78:0/4051828813 shutdown_connections 2024-09-11T00:18:10.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.889+0000 7f949af36740 1 -- 172.21.15.78:0/4051828813 wait complete. 2024-09-11T00:18:10.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.889+0000 7f949af36740 20 client.15546 trim_cache size 0 max 16384 2024-09-11T00:18:10.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.903+0000 7f949af36740 1 Processor -- start 2024-09-11T00:18:10.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.903+0000 7f949af36740 1 -- start start 2024-09-11T00:18:10.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.903+0000 7f949af36740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c01104d0 0x5557c0128c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:10.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.903+0000 7f949af36740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5557c0110df0 0x5557c011b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:10.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.903+0000 7f949af36740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c011cd80 0x5557c011e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:10.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.903+0000 7f949af36740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f94941ac6b0 con 0x5557c011cd80 2024-09-11T00:18:10.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.903+0000 7f949af36740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f94941aef30 con 0x5557c01104d0 2024-09-11T00:18:10.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.903+0000 7f949af36740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f94941acd20 con 0x5557c0110df0 2024-09-11T00:18:10.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.903+0000 7f9492d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c011cd80 0x5557c011e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:10.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.903+0000 7f9492d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c011cd80 0x5557c011e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55612/0 (socket says 172.21.15.78:55612) 2024-09-11T00:18:10.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.903+0000 7f9492d9d640 1 -- 172.21.15.78:0/662711726 learned_addr learned my addr 172.21.15.78:0/662711726 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:10.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.903+0000 7f949259c640 1 --2- 172.21.15.78:0/662711726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c01104d0 0x5557c0128c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:10.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.903+0000 7f9489d9b640 1 --2- 172.21.15.78:0/662711726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5557c0110df0 0x5557c011b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:10.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.903+0000 7f9492d9d640 1 -- 172.21.15.78:0/662711726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5557c0110df0 msgr2=0x5557c011b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:10.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.903+0000 7f9492d9d640 1 --2- 172.21.15.78:0/662711726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5557c0110df0 0x5557c011b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.903+0000 7f9492d9d640 1 -- 172.21.15.78:0/662711726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c01104d0 msgr2=0x5557c0128c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:10.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.903+0000 7f9492d9d640 1 --2- 172.21.15.78:0/662711726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c01104d0 0x5557c0128c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.903+0000 7f9492d9d640 1 -- 172.21.15.78:0/662711726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557c0110c20 con 0x5557c011cd80 2024-09-11T00:18:10.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.903+0000 7f949259c640 1 --2- 172.21.15.78:0/662711726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c01104d0 0x5557c0128c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:18:10.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.903+0000 7f9489d9b640 1 --2- 172.21.15.78:0/662711726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5557c0110df0 0x5557c011b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:18:10.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.904+0000 7f9492d9d640 1 --2- 172.21.15.78:0/662711726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c011cd80 0x5557c011e170 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f948c004390 tx=0x7f948c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a8b8ec65699167 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:10.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.904+0000 7f947bfff640 1 -- 172.21.15.78:0/662711726 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c02a480 con 0x5557c011cd80 2024-09-11T00:18:10.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.904+0000 7f947bfff640 1 -- 172.21.15.78:0/662711726 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f948c02aad0 con 0x5557c011cd80 2024-09-11T00:18:10.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.904+0000 7f947bfff640 1 -- 172.21.15.78:0/662711726 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c01fae0 con 0x5557c011cd80 2024-09-11T00:18:10.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.904+0000 7f949af36740 1 -- 172.21.15.78:0/662711726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c011cd80 msgr2=0x5557c011e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:10.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.904+0000 7f949af36740 1 --2- 172.21.15.78:0/662711726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c011cd80 0x5557c011e170 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f948c004390 tx=0x7f948c01b000 comp rx=0 tx=0).stop 2024-09-11T00:18:10.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.904+0000 7f949af36740 1 -- 172.21.15.78:0/662711726 shutdown_connections 2024-09-11T00:18:10.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.904+0000 7f949af36740 1 --2- 172.21.15.78:0/662711726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c011cd80 0x5557c011e170 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.904+0000 7f949af36740 1 --2- 172.21.15.78:0/662711726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5557c0110df0 0x5557c011b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.904+0000 7f949af36740 1 --2- 172.21.15.78:0/662711726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c01104d0 0x5557c0128c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.904+0000 7f949af36740 1 -- 172.21.15.78:0/662711726 >> 172.21.15.78:0/662711726 conn(0x5557c010e300 msgr2=0x5557c011b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:10.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.904+0000 7f949af36740 1 -- 172.21.15.78:0/662711726 shutdown_connections 2024-09-11T00:18:10.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.905+0000 7f949af36740 1 -- 172.21.15.78:0/662711726 wait complete. 2024-09-11T00:18:10.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.905+0000 7f949af36740 1 -- start start 2024-09-11T00:18:10.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.905+0000 7f949af36740 1 Processor -- start 2024-09-11T00:18:10.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.905+0000 7f949af36740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c01104d0 0x5557c0124f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:10.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.905+0000 7f949af36740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5557c0110df0 0x5557c0125500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:10.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.905+0000 7f949af36740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c011cd80 0x5557c011fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:10.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.905+0000 7f949af36740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f94941ad3f0 con 0x5557c011cd80 2024-09-11T00:18:10.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.905+0000 7f949af36740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f94941ae860 con 0x5557c01104d0 2024-09-11T00:18:10.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.905+0000 7f949af36740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f94941adac0 con 0x5557c0110df0 2024-09-11T00:18:10.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.905+0000 7f949af36740 10 client.0 _ll_register_callbacks cb 0x7f947c10c240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:18:10.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.905+0000 7f9492d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c011cd80 0x5557c011fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:10.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.905+0000 7f9492d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c011cd80 0x5557c011fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55624/0 (socket says 172.21.15.78:55624) 2024-09-11T00:18:10.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.905+0000 7f9492d9d640 1 -- 172.21.15.78:0/3153858849 learned_addr learned my addr 172.21.15.78:0/3153858849 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:10.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.905+0000 7f9489d9b640 1 --2- 172.21.15.78:0/3153858849 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5557c0110df0 0x5557c0125500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:10.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.905+0000 7f949259c640 1 --2- 172.21.15.78:0/3153858849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c01104d0 0x5557c0124f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:10.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.906+0000 7f9492d9d640 1 -- 172.21.15.78:0/3153858849 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5557c0110df0 msgr2=0x5557c0125500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:10.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.906+0000 7f9492d9d640 1 --2- 172.21.15.78:0/3153858849 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5557c0110df0 0x5557c0125500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.906+0000 7f9492d9d640 1 -- 172.21.15.78:0/3153858849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c01104d0 msgr2=0x5557c0124f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:10.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.906+0000 7f9492d9d640 1 --2- 172.21.15.78:0/3153858849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c01104d0 0x5557c0124f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.906+0000 7f9492d9d640 1 -- 172.21.15.78:0/3153858849 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557c0120500 con 0x5557c011cd80 2024-09-11T00:18:10.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.906+0000 7f9492d9d640 1 --2- 172.21.15.78:0/3153858849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c011cd80 0x5557c011fcd0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f948c0096f0 tx=0x7f948c004090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25cb1911da89dd9f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:10.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.906+0000 7f9479ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:18:10.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.906+0000 7f9479ffb640 1 -- 172.21.15.78:0/3153858849 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c02a890 con 0x5557c011cd80 2024-09-11T00:18:10.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.906+0000 7f9479ffb640 1 -- 172.21.15.78:0/3153858849 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f948c005040 con 0x5557c011cd80 2024-09-11T00:18:10.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.906+0000 7f949af36740 1 -- 172.21.15.78:0/3153858849 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f948c02aad0 con 0x5557c011cd80 2024-09-11T00:18:10.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.906+0000 7f9479ffb640 1 -- 172.21.15.78:0/3153858849 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f948c005240 con 0x5557c011cd80 2024-09-11T00:18:10.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.906+0000 7f949af36740 10 client.15552 fetch_fsmap learned FSMap version 20 2024-09-11T00:18:10.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.906+0000 7f949af36740 1 -- 172.21.15.78:0/3153858849 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5557c019a2b0 con 0x5557c011cd80 2024-09-11T00:18:10.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.906+0000 7f9479ffb640 1 -- 172.21.15.78:0/3153858849 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f948c02aad0 con 0x5557c011cd80 2024-09-11T00:18:10.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.906+0000 7f9479ffb640 1 -- 172.21.15.78:0/3153858849 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f948c03a070 con 0x5557c011cd80 2024-09-11T00:18:10.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.907+0000 7f949af36740 10 client.15552 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:18:10.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.907+0000 7f949af36740 10 client.15552 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:18:10.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.907+0000 7f949af36740 20 client.15552 populate_metadata read hostname 'smithi078' 2024-09-11T00:18:10.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.907+0000 7f949af36740 1 --2- 172.21.15.78:0/3153858849 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5557c019a920 0x5557c019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:10.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.907+0000 7f949af36740 4 client.15552 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:18:10.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.907+0000 7f949af36740 1 -- 172.21.15.78:0/3153858849 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5557c00848a0 con 0x5557c019a920 2024-09-11T00:18:10.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.907+0000 7f949259c640 1 --2- 172.21.15.78:0/3153858849 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5557c019a920 0x5557c019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:10.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.907+0000 7f9479ffb640 10 client.15552 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:10.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.907+0000 7f949259c640 1 --2- 172.21.15.78:0/3153858849 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5557c019a920 0x5557c019cd40 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dca51ca04563dab6 server_cookie=da31f911a4e9a582 in_seq=0 out_seq=0 2024-09-11T00:18:10.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.909+0000 7f9479ffb640 1 -- 172.21.15.78:0/3153858849 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5557c00848a0 con 0x5557c019a920 2024-09-11T00:18:10.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.909+0000 7f9479ffb640 10 client.15552 handle_command_reply: tid=0 2024-09-11T00:18:10.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.909+0000 7f949af36740 1 client.15552 shutdown 2024-09-11T00:18:10.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.909+0000 7f949af36740 1 -- 172.21.15.78:0/3153858849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c011cd80 msgr2=0x5557c011fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:10.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.909+0000 7f949af36740 1 --2- 172.21.15.78:0/3153858849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c011cd80 0x5557c011fcd0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f948c0096f0 tx=0x7f948c004090 comp rx=0 tx=0).stop 2024-09-11T00:18:10.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.909+0000 7f949af36740 1 -- 172.21.15.78:0/3153858849 shutdown_connections 2024-09-11T00:18:10.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.909+0000 7f949af36740 1 --2- 172.21.15.78:0/3153858849 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5557c019a920 0x5557c019cd40 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.909+0000 7f949af36740 1 --2- 172.21.15.78:0/3153858849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5557c011cd80 0x5557c011fcd0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.909+0000 7f949af36740 1 --2- 172.21.15.78:0/3153858849 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5557c0110df0 0x5557c0125500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.909+0000 7f949af36740 1 --2- 172.21.15.78:0/3153858849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5557c01104d0 0x5557c0124f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.909+0000 7f949af36740 1 -- 172.21.15.78:0/3153858849 >> 172.21.15.78:0/3153858849 conn(0x5557c010e300 msgr2=0x5557c011b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:10.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.909+0000 7f9479ffb640 0 client.15552 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:10.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.909+0000 7f949af36740 1 -- 172.21.15.78:0/3153858849 shutdown_connections 2024-09-11T00:18:10.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.909+0000 7f949af36740 1 -- 172.21.15.78:0/3153858849 wait complete. 2024-09-11T00:18:10.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.909+0000 7f949af36740 20 client.15552 trim_cache size 0 max 16384 2024-09-11T00:18:10.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.910+0000 7f9498b61640 1 -- 172.21.15.78:0/381442164 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f94800b5450 msgr2=0x7f94800b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:10.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.910+0000 7f9498b61640 1 --2- 172.21.15.78:0/381442164 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f94800b5450 0x7f94800b7910 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f948c009ef0 tx=0x7f948c005f90 comp rx=0 tx=0).stop 2024-09-11T00:18:10.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.910+0000 7f9498b61640 1 -- 172.21.15.78:0/381442164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94941087a0 msgr2=0x7f94941997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:10.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.910+0000 7f9498b61640 1 --2- 172.21.15.78:0/381442164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94941087a0 0x7f94941997c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f947c005940 tx=0x7f947c004270 comp rx=0 tx=0).stop 2024-09-11T00:18:10.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.910+0000 7f9498b61640 1 -- 172.21.15.78:0/381442164 shutdown_connections 2024-09-11T00:18:10.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.910+0000 7f9498b61640 1 --2- 172.21.15.78:0/381442164 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f94800b5450 0x7f94800b7910 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.910+0000 7f9498b61640 1 --2- 172.21.15.78:0/381442164 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9494109120 0x7f949419eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.910+0000 7f9498b61640 1 --2- 172.21.15.78:0/381442164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94941087a0 0x7f94941997c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.910+0000 7f9498b61640 1 --2- 172.21.15.78:0/381442164 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9494102d90 0x7f9494199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:10.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.910+0000 7f9498b61640 1 -- 172.21.15.78:0/381442164 >> 172.21.15.78:0/381442164 conn(0x7f94940fe820 msgr2=0x7f9494100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:10.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.910+0000 7f9498b61640 1 -- 172.21.15.78:0/381442164 shutdown_connections 2024-09-11T00:18:10.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:10.910+0000 7f9498b61640 1 -- 172.21.15.78:0/381442164 wait complete. 2024-09-11T00:18:11.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:10 smithi138 ceph-mon[35019]: pgmap v374: 97 pgs: 97 active+clean; 2.6 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 232 MiB/s rd, 277 MiB/s wr, 389 op/s 2024-09-11T00:18:11.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:10 smithi078 ceph-mon[30865]: pgmap v374: 97 pgs: 97 active+clean; 2.6 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 232 MiB/s rd, 277 MiB/s wr, 389 op/s 2024-09-11T00:18:11.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:10 smithi112 ceph-mon[35627]: pgmap v374: 97 pgs: 97 active+clean; 2.6 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 232 MiB/s rd, 277 MiB/s wr, 389 op/s 2024-09-11T00:18:12.577 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:18:12.578 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:18:12.833 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:18:12.953 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:12 smithi078 ceph-mon[30865]: pgmap v375: 97 pgs: 97 active+clean; 2.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 167 MiB/s rd, 195 MiB/s wr, 323 op/s 2024-09-11T00:18:13.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:12 smithi138 ceph-mon[35019]: pgmap v375: 97 pgs: 97 active+clean; 2.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 167 MiB/s rd, 195 MiB/s wr, 323 op/s 2024-09-11T00:18:13.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:12 smithi112 ceph-mon[35627]: pgmap v375: 97 pgs: 97 active+clean; 2.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 167 MiB/s rd, 195 MiB/s wr, 323 op/s 2024-09-11T00:18:13.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.348+0000 7f7ca0042640 1 -- 172.21.15.78:0/3782243819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c98103ca0 msgr2=0x7f7c98104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:13.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.348+0000 7f7ca0042640 1 --2- 172.21.15.78:0/3782243819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c98103ca0 0x7f7c98104080 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7c94009900 tx=0x7f7c9402a410 comp rx=0 tx=0).stop 2024-09-11T00:18:13.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.348+0000 7f7ca0042640 1 -- 172.21.15.78:0/3782243819 shutdown_connections 2024-09-11T00:18:13.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.348+0000 7f7ca0042640 1 --2- 172.21.15.78:0/3782243819 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c9810d100 0x7f7c9810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.348+0000 7f7ca0042640 1 --2- 172.21.15.78:0/3782243819 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c981045c0 0x7f7c9810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.348+0000 7f7ca0042640 1 --2- 172.21.15.78:0/3782243819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c98103ca0 0x7f7c98104080 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.348+0000 7f7ca0042640 1 -- 172.21.15.78:0/3782243819 >> 172.21.15.78:0/3782243819 conn(0x7f7c980fd700 msgr2=0x7f7c980ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:13.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.348+0000 7f7ca0042640 1 -- 172.21.15.78:0/3782243819 shutdown_connections 2024-09-11T00:18:13.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.348+0000 7f7ca0042640 1 -- 172.21.15.78:0/3782243819 wait complete. 2024-09-11T00:18:13.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.349+0000 7f7ca0042640 1 Processor -- start 2024-09-11T00:18:13.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.349+0000 7f7ca0042640 1 -- start start 2024-09-11T00:18:13.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.349+0000 7f7ca0042640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c98103ca0 0x7f7c98199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:13.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.349+0000 7f7ca0042640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c981045c0 0x7f7c981997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:13.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.349+0000 7f7ca0042640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c9810d100 0x7f7c9819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:13.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.349+0000 7f7ca0042640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7c98112d70 con 0x7f7c98103ca0 2024-09-11T00:18:13.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.349+0000 7f7ca0042640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7c98112bf0 con 0x7f7c981045c0 2024-09-11T00:18:13.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.349+0000 7f7ca0042640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7c98112ef0 con 0x7f7c9810d100 2024-09-11T00:18:13.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.349+0000 7f7c9ddde640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c98103ca0 0x7f7c98199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:13.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.349+0000 7f7c9ddde640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c98103ca0 0x7f7c98199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55650/0 (socket says 172.21.15.78:55650) 2024-09-11T00:18:13.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.349+0000 7f7c9ddde640 1 -- 172.21.15.78:0/925190421 learned_addr learned my addr 172.21.15.78:0/925190421 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:13.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.349+0000 7f7c9e5df640 1 --2- 172.21.15.78:0/925190421 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c9810d100 0x7f7c9819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:13.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.349+0000 7f7c9d5dd640 1 --2- 172.21.15.78:0/925190421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c981045c0 0x7f7c981997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:13.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.349+0000 7f7c9ddde640 1 -- 172.21.15.78:0/925190421 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c9810d100 msgr2=0x7f7c9819eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:13.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.349+0000 7f7c9ddde640 1 --2- 172.21.15.78:0/925190421 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c9810d100 0x7f7c9819eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.349+0000 7f7c9ddde640 1 -- 172.21.15.78:0/925190421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c981045c0 msgr2=0x7f7c981997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:13.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.349+0000 7f7c9ddde640 1 --2- 172.21.15.78:0/925190421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c981045c0 0x7f7c981997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.349+0000 7f7c9ddde640 1 -- 172.21.15.78:0/925190421 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9819f330 con 0x7f7c98103ca0 2024-09-11T00:18:13.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.349+0000 7f7c9d5dd640 1 --2- 172.21.15.78:0/925190421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c981045c0 0x7f7c981997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:18:13.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.350+0000 7f7c9ddde640 1 --2- 172.21.15.78:0/925190421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c98103ca0 0x7f7c98199280 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7c94005940 tx=0x7f7c94004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:13.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.350+0000 7f7c8effd640 1 -- 172.21.15.78:0/925190421 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9403f030 con 0x7f7c98103ca0 2024-09-11T00:18:13.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.350+0000 7f7ca0042640 1 -- 172.21.15.78:0/925190421 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c9819f5c0 con 0x7f7c98103ca0 2024-09-11T00:18:13.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.350+0000 7f7c8effd640 1 -- 172.21.15.78:0/925190421 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c94003aa0 con 0x7f7c98103ca0 2024-09-11T00:18:13.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.350+0000 7f7ca0042640 1 -- 172.21.15.78:0/925190421 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c981a5ce0 con 0x7f7c98103ca0 2024-09-11T00:18:13.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.350+0000 7f7c8effd640 1 -- 172.21.15.78:0/925190421 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c94049060 con 0x7f7c98103ca0 2024-09-11T00:18:13.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.352+0000 7f7c8effd640 1 -- 172.21.15.78:0/925190421 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f7c940035f0 con 0x7f7c98103ca0 2024-09-11T00:18:13.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.352+0000 7f7ca2417740 1 Processor -- start 2024-09-11T00:18:13.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.353+0000 7f7ca2417740 1 -- start start 2024-09-11T00:18:13.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.353+0000 7f7ca2417740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faa2f0 0x55a619faa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:13.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.353+0000 7f7ca2417740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a619faac10 0x55a619fb6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:13.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.353+0000 7f7ca2417740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a619fb6ba0 0x55a619fb8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:13.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.353+0000 7f7ca2417740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a619f1ce60 con 0x55a619faa2f0 2024-09-11T00:18:13.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.353+0000 7f7ca2417740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a619f0c290 con 0x55a619faac10 2024-09-11T00:18:13.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.353+0000 7f7ca2417740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a619f100a0 con 0x55a619fb6ba0 2024-09-11T00:18:13.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.353+0000 7f7c9e5df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faa2f0 0x55a619faa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:13.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.353+0000 7f7c9e5df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faa2f0 0x55a619faa6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55652/0 (socket says 172.21.15.78:55652) 2024-09-11T00:18:13.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.353+0000 7f7c9e5df640 1 -- 172.21.15.78:0/3591571784 learned_addr learned my addr 172.21.15.78:0/3591571784 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:13.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.353+0000 7f7c9ddde640 1 --2- 172.21.15.78:0/3591571784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a619faac10 0x55a619fb6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:13.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.353+0000 7f7c9d5dd640 1 --2- 172.21.15.78:0/3591571784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a619fb6ba0 0x55a619fb8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:13.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.353+0000 7f7c9e5df640 1 -- 172.21.15.78:0/3591571784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a619fb6ba0 msgr2=0x55a619fb8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.353+0000 7f7c9e5df640 1 --2- 172.21.15.78:0/3591571784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a619fb6ba0 0x55a619fb8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.353+0000 7f7c9e5df640 1 -- 172.21.15.78:0/3591571784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a619faac10 msgr2=0x55a619fb6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.353+0000 7f7c9e5df640 1 --2- 172.21.15.78:0/3591571784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a619faac10 0x55a619fb6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.353+0000 7f7c8effd640 1 --2- 172.21.15.78:0/925190421 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7c840b5450 0x7f7c840b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.353+0000 7f7c9e5df640 1 -- 172.21.15.78:0/3591571784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a619c6a930 con 0x55a619faa2f0 2024-09-11T00:18:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.353+0000 7f7c9d5dd640 1 --2- 172.21.15.78:0/3591571784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a619fb6ba0 0x55a619fb8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:18:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.353+0000 7f7c9e5df640 1 --2- 172.21.15.78:0/925190421 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7c840b5450 0x7f7c840b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.354+0000 7f7c8effd640 1 -- 172.21.15.78:0/925190421 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f7c94106d50 con 0x7f7c98103ca0 2024-09-11T00:18:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.354+0000 7f7c9e5df640 1 --2- 172.21.15.78:0/3591571784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faa2f0 0x55a619faa6d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7c90010370 tx=0x7f7c90010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dfc8bd3068f1d0e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.354+0000 7f7c83fff640 1 -- 172.21.15.78:0/3591571784 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c90022070 con 0x55a619faa2f0 2024-09-11T00:18:13.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.354+0000 7f7c83fff640 1 -- 172.21.15.78:0/3591571784 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c900113e0 con 0x55a619faa2f0 2024-09-11T00:18:13.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.354+0000 7f7c83fff640 1 -- 172.21.15.78:0/3591571784 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9001b5d0 con 0x55a619faa2f0 2024-09-11T00:18:13.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.355+0000 7f7ca2417740 1 -- 172.21.15.78:0/3591571784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faa2f0 msgr2=0x55a619faa6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:13.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.355+0000 7f7c9e5df640 1 --2- 172.21.15.78:0/925190421 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7c840b5450 0x7f7c840b7910 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7c9001f000 tx=0x7f7c90022000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:13.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.355+0000 7f7ca2417740 1 --2- 172.21.15.78:0/3591571784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faa2f0 0x55a619faa6d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7c90010370 tx=0x7f7c90010830 comp rx=0 tx=0).stop 2024-09-11T00:18:13.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.355+0000 7f7ca2417740 1 -- 172.21.15.78:0/3591571784 shutdown_connections 2024-09-11T00:18:13.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.355+0000 7f7ca2417740 1 --2- 172.21.15.78:0/3591571784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a619fb6ba0 0x55a619fb8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.355+0000 7f7ca2417740 1 --2- 172.21.15.78:0/3591571784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a619faac10 0x55a619fb6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.355+0000 7f7ca2417740 1 --2- 172.21.15.78:0/3591571784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faa2f0 0x55a619faa6d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.355+0000 7f7ca2417740 1 -- 172.21.15.78:0/3591571784 >> 172.21.15.78:0/3591571784 conn(0x55a619fa8120 msgr2=0x55a619fa92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:13.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.355+0000 7f7ca2417740 1 -- 172.21.15.78:0/3591571784 shutdown_connections 2024-09-11T00:18:13.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.355+0000 7f7ca2417740 1 -- 172.21.15.78:0/3591571784 wait complete. 2024-09-11T00:18:13.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.355+0000 7f7ca2417740 1 -- start start 2024-09-11T00:18:13.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.355+0000 7f7ca2417740 1 Processor -- start 2024-09-11T00:18:13.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.356+0000 7f7ca2417740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a619faa2f0 0x55a619fb3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:13.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.356+0000 7f7ca2417740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faac10 0x55a619fb4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:13.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.356+0000 7f7ca2417740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a619fb6ba0 0x55a619fb4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:13.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.356+0000 7f7ca2417740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a619d6d890 con 0x55a619faac10 2024-09-11T00:18:13.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.356+0000 7f7ca2417740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a619ea6d40 con 0x55a619fb6ba0 2024-09-11T00:18:13.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.356+0000 7f7ca2417740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a619fb98c0 con 0x55a619faa2f0 2024-09-11T00:18:13.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.356+0000 7f7ca2417740 10 client.0 _ll_register_callbacks cb 0x55a619f0ac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:18:13.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.356+0000 7f7c9d5dd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faac10 0x55a619fb4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:13.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.356+0000 7f7c9d5dd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faac10 0x55a619fb4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55662/0 (socket says 172.21.15.78:55662) 2024-09-11T00:18:13.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.356+0000 7f7c9d5dd640 1 -- 172.21.15.78:0/3129819503 learned_addr learned my addr 172.21.15.78:0/3129819503 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:13.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.356+0000 7f7c9e5df640 1 --2- 172.21.15.78:0/3129819503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a619fb6ba0 0x55a619fb4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:13.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.356+0000 7f7c9ddde640 1 --2- 172.21.15.78:0/3129819503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a619faa2f0 0x55a619fb3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:13.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.356+0000 7f7c9d5dd640 1 -- 172.21.15.78:0/3129819503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a619faa2f0 msgr2=0x55a619fb3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:13.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.356+0000 7f7c9d5dd640 1 --2- 172.21.15.78:0/3129819503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a619faa2f0 0x55a619fb3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.356+0000 7f7c9d5dd640 1 -- 172.21.15.78:0/3129819503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a619fb6ba0 msgr2=0x55a619fb4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:13.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.356+0000 7f7c9d5dd640 1 --2- 172.21.15.78:0/3129819503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a619fb6ba0 0x55a619fb4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.356+0000 7f7c9d5dd640 1 -- 172.21.15.78:0/3129819503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a619fc2c50 con 0x55a619faac10 2024-09-11T00:18:13.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.356+0000 7f7c9ddde640 1 --2- 172.21.15.78:0/3129819503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a619faa2f0 0x55a619fb3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:18:13.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.356+0000 7f7c9d5dd640 1 --2- 172.21.15.78:0/3129819503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faac10 0x55a619fb4010 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7c88012780 tx=0x7f7c88012c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a45d84d55f8233 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:13.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.356+0000 7f7c817fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:18:13.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.356+0000 7f7c817fa640 1 -- 172.21.15.78:0/3129819503 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c88004460 con 0x55a619faac10 2024-09-11T00:18:13.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.357+0000 7f7c817fa640 1 -- 172.21.15.78:0/3129819503 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f7c880109b0 con 0x55a619faac10 2024-09-11T00:18:13.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.357+0000 7f7ca2417740 1 -- 172.21.15.78:0/3129819503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c900113e0 con 0x55a619faac10 2024-09-11T00:18:13.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.357+0000 7f7c817fa640 1 -- 172.21.15.78:0/3129819503 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7c88010bf0 con 0x55a619faac10 2024-09-11T00:18:13.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.357+0000 7f7ca2417740 10 client.15564 fetch_fsmap learned FSMap version 20 2024-09-11T00:18:13.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.357+0000 7f7ca2417740 1 -- 172.21.15.78:0/3129819503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a619fc55b0 con 0x55a619faac10 2024-09-11T00:18:13.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.357+0000 7f7c817fa640 1 -- 172.21.15.78:0/3129819503 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c900113e0 con 0x55a619faac10 2024-09-11T00:18:13.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.357+0000 7f7c817fa640 1 -- 172.21.15.78:0/3129819503 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7c88022070 con 0x55a619faac10 2024-09-11T00:18:13.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.357+0000 7f7ca2417740 10 client.15564 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:18:13.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.357+0000 7f7ca2417740 10 client.15564 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:18:13.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.357+0000 7f7ca2417740 20 client.15564 populate_metadata read hostname 'smithi078' 2024-09-11T00:18:13.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.357+0000 7f7ca2417740 1 --2- 172.21.15.78:0/3129819503 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a619fc6ac0 0x55a619fc8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:13.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.357+0000 7f7ca2417740 4 client.15564 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:18:13.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.357+0000 7f7ca2417740 1 -- 172.21.15.78:0/3129819503 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a619f1edb0 con 0x55a619fc6ac0 2024-09-11T00:18:13.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.357+0000 7f7c9ddde640 1 --2- 172.21.15.78:0/3129819503 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a619fc6ac0 0x55a619fc8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:13.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.358+0000 7f7c817fa640 10 client.15564 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:13.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.358+0000 7f7c9ddde640 1 --2- 172.21.15.78:0/3129819503 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a619fc6ac0 0x55a619fc8f40 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f68ae6285802806 server_cookie=1c072d67c64fb677 in_seq=0 out_seq=0 2024-09-11T00:18:13.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.360+0000 7f7c817fa640 1 -- 172.21.15.78:0/3129819503 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a619f1edb0 con 0x55a619fc6ac0 2024-09-11T00:18:13.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.360+0000 7f7c817fa640 10 client.15564 handle_command_reply: tid=0 2024-09-11T00:18:13.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.360+0000 7f7ca2417740 1 client.15564 shutdown 2024-09-11T00:18:13.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.360+0000 7f7ca2417740 1 -- 172.21.15.78:0/3129819503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faac10 msgr2=0x55a619fb4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:13.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.360+0000 7f7ca2417740 1 --2- 172.21.15.78:0/3129819503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faac10 0x55a619fb4010 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7c88012780 tx=0x7f7c88012c40 comp rx=0 tx=0).stop 2024-09-11T00:18:13.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.360+0000 7f7ca2417740 1 -- 172.21.15.78:0/3129819503 shutdown_connections 2024-09-11T00:18:13.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.360+0000 7f7ca2417740 1 --2- 172.21.15.78:0/3129819503 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a619fc6ac0 0x55a619fc8f40 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.360+0000 7f7ca2417740 1 --2- 172.21.15.78:0/3129819503 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a619fb6ba0 0x55a619fb4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.360+0000 7f7ca2417740 1 --2- 172.21.15.78:0/3129819503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faac10 0x55a619fb4010 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.360+0000 7f7ca2417740 1 --2- 172.21.15.78:0/3129819503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a619faa2f0 0x55a619fb3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.360+0000 7f7c817fa640 0 client.15564 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:13.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.360+0000 7f7ca2417740 1 -- 172.21.15.78:0/3129819503 >> 172.21.15.78:0/3129819503 conn(0x55a619fa8120 msgr2=0x55a619fad470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:13.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.360+0000 7f7ca2417740 1 -- 172.21.15.78:0/3129819503 shutdown_connections 2024-09-11T00:18:13.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.360+0000 7f7ca2417740 1 -- 172.21.15.78:0/3129819503 wait complete. 2024-09-11T00:18:13.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.360+0000 7f7ca2417740 20 client.15564 trim_cache size 0 max 16384 2024-09-11T00:18:13.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.378+0000 7f7ca2417740 1 Processor -- start 2024-09-11T00:18:13.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.378+0000 7f7ca2417740 1 -- start start 2024-09-11T00:18:13.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.378+0000 7f7ca2417740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a619faa2f0 0x55a619fb0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:13.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.378+0000 7f7ca2417740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faac10 0x55a619fb1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:13.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.378+0000 7f7ca2417740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a619fb6ba0 0x55a619fa2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:13.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.378+0000 7f7ca2417740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7c981aa4e0 con 0x55a619faac10 2024-09-11T00:18:13.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.378+0000 7f7ca2417740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7c981acd60 con 0x55a619faa2f0 2024-09-11T00:18:13.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.378+0000 7f7ca2417740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7c981aab50 con 0x55a619fb6ba0 2024-09-11T00:18:13.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.378+0000 7f7c9d5dd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faac10 0x55a619fb1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:13.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.378+0000 7f7c9d5dd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faac10 0x55a619fb1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55672/0 (socket says 172.21.15.78:55672) 2024-09-11T00:18:13.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.378+0000 7f7c9d5dd640 1 -- 172.21.15.78:0/854997546 learned_addr learned my addr 172.21.15.78:0/854997546 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:13.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.378+0000 7f7c9ddde640 1 --2- 172.21.15.78:0/854997546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a619faa2f0 0x55a619fb0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:13.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.378+0000 7f7c9e5df640 1 --2- 172.21.15.78:0/854997546 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a619fb6ba0 0x55a619fa2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:13.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.379+0000 7f7c9d5dd640 1 -- 172.21.15.78:0/854997546 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a619fb6ba0 msgr2=0x55a619fa2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:13.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.379+0000 7f7c9d5dd640 1 --2- 172.21.15.78:0/854997546 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a619fb6ba0 0x55a619fa2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.379+0000 7f7c9d5dd640 1 -- 172.21.15.78:0/854997546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a619faa2f0 msgr2=0x55a619fb0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:13.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.379+0000 7f7c9d5dd640 1 --2- 172.21.15.78:0/854997546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a619faa2f0 0x55a619fb0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.379+0000 7f7c9d5dd640 1 -- 172.21.15.78:0/854997546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a619faaa40 con 0x55a619faac10 2024-09-11T00:18:13.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.379+0000 7f7c9d5dd640 1 --2- 172.21.15.78:0/854997546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faac10 0x55a619fb1450 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7c8801b5b0 tx=0x7f7c8801b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a993685f730a142 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:13.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.379+0000 7f7c837fe640 1 -- 172.21.15.78:0/854997546 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c88028070 con 0x55a619faac10 2024-09-11T00:18:13.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.379+0000 7f7c837fe640 1 -- 172.21.15.78:0/854997546 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c88010a30 con 0x55a619faac10 2024-09-11T00:18:13.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.379+0000 7f7c837fe640 1 -- 172.21.15.78:0/854997546 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c88003c20 con 0x55a619faac10 2024-09-11T00:18:13.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.380+0000 7f7ca2417740 1 -- 172.21.15.78:0/854997546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faac10 msgr2=0x55a619fb1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:13.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.380+0000 7f7ca2417740 1 --2- 172.21.15.78:0/854997546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faac10 0x55a619fb1450 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7c8801b5b0 tx=0x7f7c8801b4c0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.380+0000 7f7ca2417740 1 -- 172.21.15.78:0/854997546 shutdown_connections 2024-09-11T00:18:13.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.380+0000 7f7ca2417740 1 --2- 172.21.15.78:0/854997546 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a619fb6ba0 0x55a619fa2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.380+0000 7f7ca2417740 1 --2- 172.21.15.78:0/854997546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faac10 0x55a619fb1450 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.380+0000 7f7ca2417740 1 --2- 172.21.15.78:0/854997546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a619faa2f0 0x55a619fb0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.380+0000 7f7ca2417740 1 -- 172.21.15.78:0/854997546 >> 172.21.15.78:0/854997546 conn(0x55a619fa8120 msgr2=0x55a619fb2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:13.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.380+0000 7f7ca2417740 1 -- 172.21.15.78:0/854997546 shutdown_connections 2024-09-11T00:18:13.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.380+0000 7f7ca2417740 1 -- 172.21.15.78:0/854997546 wait complete. 2024-09-11T00:18:13.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.380+0000 7f7ca2417740 1 -- start start 2024-09-11T00:18:13.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.380+0000 7f7ca2417740 1 Processor -- start 2024-09-11T00:18:13.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.381+0000 7f7ca2417740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faa2f0 0x55a619fbf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:13.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.381+0000 7f7ca2417740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a619faac10 0x55a619fb9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:13.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.381+0000 7f7ca2417740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a619fb6ba0 0x55a619fba0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:13.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.381+0000 7f7ca2417740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7c981ab220 con 0x55a619faa2f0 2024-09-11T00:18:13.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.381+0000 7f7ca2417740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7c981ac690 con 0x55a619faac10 2024-09-11T00:18:13.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.381+0000 7f7ca2417740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7c981ab8f0 con 0x55a619fb6ba0 2024-09-11T00:18:13.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.381+0000 7f7ca2417740 10 client.0 _ll_register_callbacks cb 0x7f7c9806bb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:18:13.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.381+0000 7f7c9ddde640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faa2f0 0x55a619fbf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:13.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.381+0000 7f7c9ddde640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faa2f0 0x55a619fbf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55686/0 (socket says 172.21.15.78:55686) 2024-09-11T00:18:13.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.381+0000 7f7c9ddde640 1 -- 172.21.15.78:0/3576074646 learned_addr learned my addr 172.21.15.78:0/3576074646 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:13.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.381+0000 7f7c9d5dd640 1 --2- 172.21.15.78:0/3576074646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a619faac10 0x55a619fb9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:13.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.381+0000 7f7c9e5df640 1 --2- 172.21.15.78:0/3576074646 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a619fb6ba0 0x55a619fba0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:13.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.381+0000 7f7c9ddde640 1 -- 172.21.15.78:0/3576074646 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a619fb6ba0 msgr2=0x55a619fba0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:13.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.381+0000 7f7c9ddde640 1 --2- 172.21.15.78:0/3576074646 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a619fb6ba0 0x55a619fba0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.381+0000 7f7c9ddde640 1 -- 172.21.15.78:0/3576074646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a619faac10 msgr2=0x55a619fb9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:13.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.381+0000 7f7c9ddde640 1 --2- 172.21.15.78:0/3576074646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a619faac10 0x55a619fb9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.381+0000 7f7c9ddde640 1 -- 172.21.15.78:0/3576074646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a619fba8f0 con 0x55a619faa2f0 2024-09-11T00:18:13.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.381+0000 7f7c9ddde640 1 --2- 172.21.15.78:0/3576074646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faa2f0 0x55a619fbf390 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7c94104ac0 tx=0x7f7c94106f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c0cb00739f0641 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:13.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.381+0000 7f7c817fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:18:13.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.382+0000 7f7c817fa640 1 -- 172.21.15.78:0/3576074646 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c94035040 con 0x55a619faa2f0 2024-09-11T00:18:13.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.382+0000 7f7c817fa640 1 -- 172.21.15.78:0/3576074646 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f7c94104740 con 0x55a619faa2f0 2024-09-11T00:18:13.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.382+0000 7f7ca2417740 1 -- 172.21.15.78:0/3576074646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a619f1a860 con 0x55a619faa2f0 2024-09-11T00:18:13.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.382+0000 7f7c817fa640 1 -- 172.21.15.78:0/3576074646 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7c940c9090 con 0x55a619faa2f0 2024-09-11T00:18:13.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.382+0000 7f7ca2417740 10 client.15570 fetch_fsmap learned FSMap version 20 2024-09-11T00:18:13.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.382+0000 7f7ca2417740 1 -- 172.21.15.78:0/3576074646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a61a034b90 con 0x55a619faa2f0 2024-09-11T00:18:13.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.382+0000 7f7c817fa640 1 -- 172.21.15.78:0/3576074646 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a619f1a860 con 0x55a619faa2f0 2024-09-11T00:18:13.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.382+0000 7f7c817fa640 1 -- 172.21.15.78:0/3576074646 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7c940c9460 con 0x55a619faa2f0 2024-09-11T00:18:13.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.382+0000 7f7ca2417740 10 client.15570 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:18:13.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.382+0000 7f7ca2417740 10 client.15570 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:18:13.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.382+0000 7f7ca2417740 20 client.15570 populate_metadata read hostname 'smithi078' 2024-09-11T00:18:13.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.382+0000 7f7ca2417740 1 --2- 172.21.15.78:0/3576074646 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a61a0352b0 0x55a61a0376d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:13.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.382+0000 7f7ca2417740 4 client.15570 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:18:13.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.382+0000 7f7ca2417740 1 -- 172.21.15.78:0/3576074646 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a619f17c90 con 0x55a61a0352b0 2024-09-11T00:18:13.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.382+0000 7f7c9d5dd640 1 --2- 172.21.15.78:0/3576074646 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a61a0352b0 0x55a61a0376d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:13.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.383+0000 7f7c9d5dd640 1 --2- 172.21.15.78:0/3576074646 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a61a0352b0 0x55a61a0376d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f9a3749cce0a486 server_cookie=f78cdbe4a344617 in_seq=0 out_seq=0 2024-09-11T00:18:13.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.383+0000 7f7c817fa640 10 client.15570 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:13.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.385+0000 7f7c817fa640 1 -- 172.21.15.78:0/3576074646 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a619f17c90 con 0x55a61a0352b0 2024-09-11T00:18:13.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.385+0000 7f7c817fa640 10 client.15570 handle_command_reply: tid=0 2024-09-11T00:18:13.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.385+0000 7f7ca2417740 1 client.15570 shutdown 2024-09-11T00:18:13.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.385+0000 7f7ca2417740 1 -- 172.21.15.78:0/3576074646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faa2f0 msgr2=0x55a619fbf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:13.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.386+0000 7f7ca2417740 1 --2- 172.21.15.78:0/3576074646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faa2f0 0x55a619fbf390 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7c94104ac0 tx=0x7f7c94106f50 comp rx=0 tx=0).stop 2024-09-11T00:18:13.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.386+0000 7f7ca2417740 1 -- 172.21.15.78:0/3576074646 shutdown_connections 2024-09-11T00:18:13.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.386+0000 7f7ca2417740 1 --2- 172.21.15.78:0/3576074646 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a61a0352b0 0x55a61a0376d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.386+0000 7f7ca2417740 1 --2- 172.21.15.78:0/3576074646 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a619fb6ba0 0x55a619fba0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.386+0000 7f7ca2417740 1 --2- 172.21.15.78:0/3576074646 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a619faac10 0x55a619fb9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.386+0000 7f7c817fa640 0 client.15570 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:13.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.386+0000 7f7ca2417740 1 --2- 172.21.15.78:0/3576074646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a619faa2f0 0x55a619fbf390 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.386+0000 7f7ca2417740 1 -- 172.21.15.78:0/3576074646 >> 172.21.15.78:0/3576074646 conn(0x55a619fa8120 msgr2=0x55a619fb0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:13.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.386+0000 7f7ca2417740 1 -- 172.21.15.78:0/3576074646 shutdown_connections 2024-09-11T00:18:13.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.386+0000 7f7ca2417740 1 -- 172.21.15.78:0/3576074646 wait complete. 2024-09-11T00:18:13.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.386+0000 7f7ca2417740 20 client.15570 trim_cache size 0 max 16384 2024-09-11T00:18:13.392 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:18:13.392 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-11T00:18:13.392 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "a682c96e-1acb-43c1-884d-6ae3d81cba47", 2024-09-11T00:18:13.392 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-11T00:18:13.392 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:18:13.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.386+0000 7f7ca0042640 1 -- 172.21.15.78:0/925190421 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7c840b5450 msgr2=0x7f7c840b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:13.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.386+0000 7f7ca0042640 1 --2- 172.21.15.78:0/925190421 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7c840b5450 0x7f7c840b7910 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7c9001f000 tx=0x7f7c90022000 comp rx=0 tx=0).stop 2024-09-11T00:18:13.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.386+0000 7f7ca0042640 1 -- 172.21.15.78:0/925190421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c98103ca0 msgr2=0x7f7c98199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:13.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.386+0000 7f7ca0042640 1 --2- 172.21.15.78:0/925190421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c98103ca0 0x7f7c98199280 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7c94005940 tx=0x7f7c94004270 comp rx=0 tx=0).stop 2024-09-11T00:18:13.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.387+0000 7f7ca0042640 1 -- 172.21.15.78:0/925190421 shutdown_connections 2024-09-11T00:18:13.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.387+0000 7f7ca0042640 1 --2- 172.21.15.78:0/925190421 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f7c840b5450 0x7f7c840b7910 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.387+0000 7f7ca0042640 1 --2- 172.21.15.78:0/925190421 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c9810d100 0x7f7c9819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.387+0000 7f7ca0042640 1 --2- 172.21.15.78:0/925190421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7c981045c0 0x7f7c981997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.387+0000 7f7ca0042640 1 --2- 172.21.15.78:0/925190421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c98103ca0 0x7f7c98199280 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:13.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.387+0000 7f7ca0042640 1 -- 172.21.15.78:0/925190421 >> 172.21.15.78:0/925190421 conn(0x7f7c980fd700 msgr2=0x7f7c980fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:13.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.387+0000 7f7ca0042640 1 -- 172.21.15.78:0/925190421 shutdown_connections 2024-09-11T00:18:13.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:13.387+0000 7f7ca0042640 1 -- 172.21.15.78:0/925190421 wait complete. 2024-09-11T00:18:14.069 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:18:14.341 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:18:14.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.845+0000 7ff74359e640 1 -- 172.21.15.78:0/2393049840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff744107e90 msgr2=0x7ff74410e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:14.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.845+0000 7ff74359e640 1 --2- 172.21.15.78:0/2393049840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff744107e90 0x7ff74410e690 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff73c009ca0 tx=0x7ff73c02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.845+0000 7ff74359e640 1 -- 172.21.15.78:0/2393049840 shutdown_connections 2024-09-11T00:18:14.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.845+0000 7ff74359e640 1 --2- 172.21.15.78:0/2393049840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff744107e90 0x7ff74410e690 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.845+0000 7ff74359e640 1 --2- 172.21.15.78:0/2393049840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff744107510 0x7ff744107950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.845+0000 7ff74359e640 1 --2- 172.21.15.78:0/2393049840 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff744101b00 0x7ff744101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.845+0000 7ff74359e640 1 -- 172.21.15.78:0/2393049840 >> 172.21.15.78:0/2393049840 conn(0x7ff7440fd5b0 msgr2=0x7ff7440ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:14.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.845+0000 7ff74359e640 1 -- 172.21.15.78:0/2393049840 shutdown_connections 2024-09-11T00:18:14.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.845+0000 7ff74359e640 1 -- 172.21.15.78:0/2393049840 wait complete. 2024-09-11T00:18:14.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.846+0000 7ff74359e640 1 Processor -- start 2024-09-11T00:18:14.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.846+0000 7ff74359e640 1 -- start start 2024-09-11T00:18:14.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.846+0000 7ff74359e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff744101b00 0x7ff744199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:14.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.846+0000 7ff74359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff744107510 0x7ff7441995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:14.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.846+0000 7ff74359e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff744107e90 0x7ff74419e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:14.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.846+0000 7ff74359e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff744111b10 con 0x7ff744107510 2024-09-11T00:18:14.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.846+0000 7ff74359e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff744111990 con 0x7ff744101b00 2024-09-11T00:18:14.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.846+0000 7ff74359e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff744111c90 con 0x7ff744107e90 2024-09-11T00:18:14.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.846+0000 7ff741d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff744107510 0x7ff7441995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:14.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.846+0000 7ff741d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff744107510 0x7ff7441995a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49174/0 (socket says 172.21.15.78:49174) 2024-09-11T00:18:14.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.846+0000 7ff741d9b640 1 -- 172.21.15.78:0/3257867787 learned_addr learned my addr 172.21.15.78:0/3257867787 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:14.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.846+0000 7ff74259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff744101b00 0x7ff744199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:14.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.846+0000 7ff742d9d640 1 --2- 172.21.15.78:0/3257867787 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff744107e90 0x7ff74419e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:14.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.847+0000 7ff741d9b640 1 -- 172.21.15.78:0/3257867787 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff744107e90 msgr2=0x7ff74419e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:14.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.847+0000 7ff741d9b640 1 --2- 172.21.15.78:0/3257867787 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff744107e90 0x7ff74419e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.847+0000 7ff741d9b640 1 -- 172.21.15.78:0/3257867787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff744101b00 msgr2=0x7ff744199060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:14.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.847+0000 7ff741d9b640 1 --2- 172.21.15.78:0/3257867787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff744101b00 0x7ff744199060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.847+0000 7ff741d9b640 1 -- 172.21.15.78:0/3257867787 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74419f110 con 0x7ff744107510 2024-09-11T00:18:14.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.847+0000 7ff742d9d640 1 --2- 172.21.15.78:0/3257867787 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff744107e90 0x7ff74419e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:18:14.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.847+0000 7ff74259c640 1 --2- 172.21.15.78:0/3257867787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff744101b00 0x7ff744199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:18:14.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.847+0000 7ff741d9b640 1 --2- 172.21.15.78:0/3257867787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff744107510 0x7ff7441995a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff73800e9f0 tx=0x7ff73800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:14.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.847+0000 7ff7337fe640 1 -- 172.21.15.78:0/3257867787 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73800cd80 con 0x7ff744107510 2024-09-11T00:18:14.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.847+0000 7ff74359e640 1 -- 172.21.15.78:0/3257867787 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff74419f400 con 0x7ff744107510 2024-09-11T00:18:14.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.847+0000 7ff7337fe640 1 -- 172.21.15.78:0/3257867787 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7380108e0 con 0x7ff744107510 2024-09-11T00:18:14.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.847+0000 7ff7337fe640 1 -- 172.21.15.78:0/3257867787 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738018980 con 0x7ff744107510 2024-09-11T00:18:14.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.847+0000 7ff74359e640 1 -- 172.21.15.78:0/3257867787 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7441a5c90 con 0x7ff744107510 2024-09-11T00:18:14.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.849+0000 7ff7337fe640 1 -- 172.21.15.78:0/3257867787 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7ff738010430 con 0x7ff744107510 2024-09-11T00:18:14.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.850+0000 7ff74add6740 1 Processor -- start 2024-09-11T00:18:14.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.850+0000 7ff74add6740 1 -- start start 2024-09-11T00:18:14.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.850+0000 7ff74add6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbce280 0x56086cbce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:14.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.850+0000 7ff74add6740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbceba0 0x56086cbda5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:14.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.850+0000 7ff74add6740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbdab30 0x56086cbdcf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:14.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.850+0000 7ff74add6740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56086cb44e50 con 0x56086cbdab30 2024-09-11T00:18:14.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.850+0000 7ff74add6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56086cb34280 con 0x56086cbce280 2024-09-11T00:18:14.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.850+0000 7ff74add6740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56086cb38090 con 0x56086cbceba0 2024-09-11T00:18:14.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.850+0000 7ff741d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbdab30 0x56086cbdcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:14.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.850+0000 7ff742d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbce280 0x56086cbce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:14.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.850+0000 7ff74259c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbceba0 0x56086cbda5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:14.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.850+0000 7ff741d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbdab30 0x56086cbdcf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49178/0 (socket says 172.21.15.78:49178) 2024-09-11T00:18:14.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.850+0000 7ff742d9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbce280 0x56086cbce660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.78:52450/0 (socket says 172.21.15.78:52450) 2024-09-11T00:18:14.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.850+0000 7ff741d9b640 1 -- 172.21.15.78:0/956828658 learned_addr learned my addr 172.21.15.78:0/956828658 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:14.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.851+0000 7ff7337fe640 1 --2- 172.21.15.78:0/3257867787 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff72c0b5500 0x7ff72c0b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:14.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.851+0000 7ff741d9b640 1 -- 172.21.15.78:0/956828658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbceba0 msgr2=0x56086cbda5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:14.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.851+0000 7ff741d9b640 1 --2- 172.21.15.78:0/956828658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbceba0 0x56086cbda5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.851+0000 7ff741d9b640 1 -- 172.21.15.78:0/956828658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbce280 msgr2=0x56086cbce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:14.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.851+0000 7ff741d9b640 1 --2- 172.21.15.78:0/956828658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbce280 0x56086cbce660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.851+0000 7ff741d9b640 1 -- 172.21.15.78:0/956828658 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56086c892650 con 0x56086cbdab30 2024-09-11T00:18:14.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.851+0000 7ff742d9d640 1 --2- 172.21.15.78:0/956828658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbce280 0x56086cbce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:18:14.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.851+0000 7ff74259c640 1 --2- 172.21.15.78:0/956828658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbceba0 0x56086cbda5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:18:14.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.851+0000 7ff742d9d640 1 --2- 172.21.15.78:0/3257867787 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff72c0b5500 0x7ff72c0b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:14.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.851+0000 7ff7337fe640 1 -- 172.21.15.78:0/3257867787 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7ff7380e6370 con 0x7ff744107510 2024-09-11T00:18:14.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.851+0000 7ff741d9b640 1 --2- 172.21.15.78:0/956828658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbdab30 0x56086cbdcf20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff7380e39c0 tx=0x7ff738070f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb679c4cb0f162ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:14.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.851+0000 7ff730ff9640 1 -- 172.21.15.78:0/956828658 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738026030 con 0x56086cbdab30 2024-09-11T00:18:14.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.851+0000 7ff730ff9640 1 -- 172.21.15.78:0/956828658 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff738096990 con 0x56086cbdab30 2024-09-11T00:18:14.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.851+0000 7ff742d9d640 1 --2- 172.21.15.78:0/3257867787 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff72c0b5500 0x7ff72c0b79c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff73c02f500 tx=0x7ff73c0095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:14.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.851+0000 7ff730ff9640 1 -- 172.21.15.78:0/956828658 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73806f360 con 0x56086cbdab30 2024-09-11T00:18:14.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.852+0000 7ff74add6740 1 -- 172.21.15.78:0/956828658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbdab30 msgr2=0x56086cbdcf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:14.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.852+0000 7ff74add6740 1 --2- 172.21.15.78:0/956828658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbdab30 0x56086cbdcf20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff7380e39c0 tx=0x7ff738070f90 comp rx=0 tx=0).stop 2024-09-11T00:18:14.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.852+0000 7ff74add6740 1 -- 172.21.15.78:0/956828658 shutdown_connections 2024-09-11T00:18:14.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.852+0000 7ff74add6740 1 --2- 172.21.15.78:0/956828658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbdab30 0x56086cbdcf20 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.852+0000 7ff74add6740 1 --2- 172.21.15.78:0/956828658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbceba0 0x56086cbda5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.852+0000 7ff74add6740 1 --2- 172.21.15.78:0/956828658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbce280 0x56086cbce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.852+0000 7ff74add6740 1 -- 172.21.15.78:0/956828658 >> 172.21.15.78:0/956828658 conn(0x56086cbcc0b0 msgr2=0x56086cbcd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:14.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.852+0000 7ff74add6740 1 -- 172.21.15.78:0/956828658 shutdown_connections 2024-09-11T00:18:14.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.852+0000 7ff74add6740 1 -- 172.21.15.78:0/956828658 wait complete. 2024-09-11T00:18:14.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.852+0000 7ff74add6740 1 -- start start 2024-09-11T00:18:14.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.852+0000 7ff74add6740 1 Processor -- start 2024-09-11T00:18:14.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.853+0000 7ff74add6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbce280 0x56086cbda460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:14.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.853+0000 7ff74add6740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbceba0 0x56086cbd78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:14.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.853+0000 7ff74add6740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbdab30 0x56086cbd7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:14.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.853+0000 7ff74add6740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56086c995700 con 0x56086cbceba0 2024-09-11T00:18:14.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.853+0000 7ff74add6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56086cacf110 con 0x56086cbce280 2024-09-11T00:18:14.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.853+0000 7ff74add6740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56086cbdd750 con 0x56086cbdab30 2024-09-11T00:18:14.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.853+0000 7ff74add6740 10 client.0 _ll_register_callbacks cb 0x56086cae8990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:18:14.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.853+0000 7ff741d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbceba0 0x56086cbd78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:14.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.853+0000 7ff74259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbce280 0x56086cbda460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:14.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.853+0000 7ff741d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbceba0 0x56086cbd78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49180/0 (socket says 172.21.15.78:49180) 2024-09-11T00:18:14.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.853+0000 7ff741d9b640 1 -- 172.21.15.78:0/9767044 learned_addr learned my addr 172.21.15.78:0/9767044 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:14.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.853+0000 7ff742d9d640 1 --2- 172.21.15.78:0/9767044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbdab30 0x56086cbd7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:14.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.853+0000 7ff741d9b640 1 -- 172.21.15.78:0/9767044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbdab30 msgr2=0x56086cbd7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:14.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.853+0000 7ff741d9b640 1 --2- 172.21.15.78:0/9767044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbdab30 0x56086cbd7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.853+0000 7ff741d9b640 1 -- 172.21.15.78:0/9767044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbce280 msgr2=0x56086cbda460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:14.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.853+0000 7ff741d9b640 1 --2- 172.21.15.78:0/9767044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbce280 0x56086cbda460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.853+0000 7ff741d9b640 1 -- 172.21.15.78:0/9767044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56086cafcc40 con 0x56086cbceba0 2024-09-11T00:18:14.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.853+0000 7ff742d9d640 1 --2- 172.21.15.78:0/9767044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbdab30 0x56086cbd7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:18:14.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.853+0000 7ff741d9b640 1 --2- 172.21.15.78:0/9767044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbceba0 0x56086cbd78b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff73806e1b0 tx=0x7ff738018420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef9e461541b50b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:14.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.853+0000 7ff729ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:18:14.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.853+0000 7ff729ffb640 1 -- 172.21.15.78:0/9767044 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738096790 con 0x56086cbceba0 2024-09-11T00:18:14.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.853+0000 7ff729ffb640 1 -- 172.21.15.78:0/9767044 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7ff7380a8180 con 0x56086cbceba0 2024-09-11T00:18:14.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.854+0000 7ff74add6740 1 -- 172.21.15.78:0/9767044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56086cb46da0 con 0x56086cbceba0 2024-09-11T00:18:14.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.854+0000 7ff729ffb640 1 -- 172.21.15.78:0/9767044 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff738079b50 con 0x56086cbceba0 2024-09-11T00:18:14.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.854+0000 7ff74add6740 10 client.15582 fetch_fsmap learned FSMap version 20 2024-09-11T00:18:14.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.854+0000 7ff74add6740 1 -- 172.21.15.78:0/9767044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56086cbe90c0 con 0x56086cbceba0 2024-09-11T00:18:14.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.854+0000 7ff729ffb640 1 -- 172.21.15.78:0/9767044 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56086cb46da0 con 0x56086cbceba0 2024-09-11T00:18:14.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.854+0000 7ff729ffb640 1 -- 172.21.15.78:0/9767044 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff7380e3d00 con 0x56086cbceba0 2024-09-11T00:18:14.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.854+0000 7ff74add6740 10 client.15582 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:18:14.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.854+0000 7ff74add6740 10 client.15582 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:18:14.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.854+0000 7ff74add6740 20 client.15582 populate_metadata read hostname 'smithi078' 2024-09-11T00:18:14.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.854+0000 7ff74add6740 1 --2- 172.21.15.78:0/9767044 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56086cbea410 0x56086cbec800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:14.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.854+0000 7ff74add6740 4 client.15582 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:18:14.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.854+0000 7ff74add6740 1 -- 172.21.15.78:0/9767044 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56086cb42850 con 0x56086cbea410 2024-09-11T00:18:14.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.854+0000 7ff74259c640 1 --2- 172.21.15.78:0/9767044 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56086cbea410 0x56086cbec800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:14.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.855+0000 7ff74259c640 1 --2- 172.21.15.78:0/9767044 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56086cbea410 0x56086cbec800 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92073c01e9cebfe9 server_cookie=86dc88ccd5c2867d in_seq=0 out_seq=0 2024-09-11T00:18:14.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.855+0000 7ff729ffb640 10 client.15582 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:14.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.857+0000 7ff729ffb640 1 -- 172.21.15.78:0/9767044 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56086cb42850 con 0x56086cbea410 2024-09-11T00:18:14.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.857+0000 7ff729ffb640 10 client.15582 handle_command_reply: tid=0 2024-09-11T00:18:14.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.857+0000 7ff74add6740 1 client.15582 shutdown 2024-09-11T00:18:14.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.857+0000 7ff74add6740 1 -- 172.21.15.78:0/9767044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbceba0 msgr2=0x56086cbd78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:14.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.857+0000 7ff74add6740 1 --2- 172.21.15.78:0/9767044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbceba0 0x56086cbd78b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff73806e1b0 tx=0x7ff738018420 comp rx=0 tx=0).stop 2024-09-11T00:18:14.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.857+0000 7ff74add6740 1 -- 172.21.15.78:0/9767044 shutdown_connections 2024-09-11T00:18:14.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.857+0000 7ff74add6740 1 --2- 172.21.15.78:0/9767044 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56086cbea410 0x56086cbec800 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.857+0000 7ff74add6740 1 --2- 172.21.15.78:0/9767044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbdab30 0x56086cbd7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.857+0000 7ff74add6740 1 --2- 172.21.15.78:0/9767044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbceba0 0x56086cbd78b0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.857+0000 7ff74add6740 1 --2- 172.21.15.78:0/9767044 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbce280 0x56086cbda460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.857+0000 7ff729ffb640 0 client.15582 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:14.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.857+0000 7ff74add6740 1 -- 172.21.15.78:0/9767044 >> 172.21.15.78:0/9767044 conn(0x56086cbcc0b0 msgr2=0x56086cbd1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:14.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.857+0000 7ff74add6740 1 -- 172.21.15.78:0/9767044 shutdown_connections 2024-09-11T00:18:14.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.857+0000 7ff74add6740 1 -- 172.21.15.78:0/9767044 wait complete. 2024-09-11T00:18:14.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.857+0000 7ff74add6740 20 client.15582 trim_cache size 0 max 16384 2024-09-11T00:18:14.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.875+0000 7ff74add6740 1 Processor -- start 2024-09-11T00:18:14.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.875+0000 7ff74add6740 1 -- start start 2024-09-11T00:18:14.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.875+0000 7ff74add6740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbce280 0x56086cbe6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:14.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.875+0000 7ff74add6740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbceba0 0x56086cbd7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:14.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.875+0000 7ff74add6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbdab30 0x56086cbcb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:14.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.875+0000 7ff74add6740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff7441ac580 con 0x56086cbceba0 2024-09-11T00:18:14.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.875+0000 7ff74add6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff7441aee00 con 0x56086cbdab30 2024-09-11T00:18:14.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.875+0000 7ff74add6740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff7441acbf0 con 0x56086cbce280 2024-09-11T00:18:14.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.875+0000 7ff741d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbceba0 0x56086cbd7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:14.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.875+0000 7ff74259c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbce280 0x56086cbe6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:14.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.875+0000 7ff741d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbceba0 0x56086cbd7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49196/0 (socket says 172.21.15.78:49196) 2024-09-11T00:18:14.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.875+0000 7ff741d9b640 1 -- 172.21.15.78:0/1921742604 learned_addr learned my addr 172.21.15.78:0/1921742604 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:14.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.876+0000 7ff742d9d640 1 --2- 172.21.15.78:0/1921742604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbdab30 0x56086cbcb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:14.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.876+0000 7ff741d9b640 1 -- 172.21.15.78:0/1921742604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbce280 msgr2=0x56086cbe6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:14.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.876+0000 7ff741d9b640 1 --2- 172.21.15.78:0/1921742604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbce280 0x56086cbe6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.876+0000 7ff741d9b640 1 -- 172.21.15.78:0/1921742604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbdab30 msgr2=0x56086cbcb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:14.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.876+0000 7ff741d9b640 1 --2- 172.21.15.78:0/1921742604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbdab30 0x56086cbcb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.876+0000 7ff741d9b640 1 -- 172.21.15.78:0/1921742604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56086cbccb30 con 0x56086cbceba0 2024-09-11T00:18:14.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.876+0000 7ff74259c640 1 --2- 172.21.15.78:0/1921742604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbce280 0x56086cbe6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:18:14.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.876+0000 7ff741d9b640 1 --2- 172.21.15.78:0/1921742604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbceba0 0x56086cbd7660 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff7380a8d80 tx=0x7ff73800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53072fa42d760d2b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:14.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.876+0000 7ff72bfff640 1 -- 172.21.15.78:0/1921742604 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7380ac800 con 0x56086cbceba0 2024-09-11T00:18:14.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.876+0000 7ff72bfff640 1 -- 172.21.15.78:0/1921742604 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7380e9bc0 con 0x56086cbceba0 2024-09-11T00:18:14.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.876+0000 7ff72bfff640 1 -- 172.21.15.78:0/1921742604 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7380ac580 con 0x56086cbceba0 2024-09-11T00:18:14.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.877+0000 7ff74add6740 1 -- 172.21.15.78:0/1921742604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbceba0 msgr2=0x56086cbd7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:14.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.877+0000 7ff74add6740 1 --2- 172.21.15.78:0/1921742604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbceba0 0x56086cbd7660 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff7380a8d80 tx=0x7ff73800cf20 comp rx=0 tx=0).stop 2024-09-11T00:18:14.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.877+0000 7ff74add6740 1 -- 172.21.15.78:0/1921742604 shutdown_connections 2024-09-11T00:18:14.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.877+0000 7ff74add6740 1 --2- 172.21.15.78:0/1921742604 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbdab30 0x56086cbcb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.877+0000 7ff74add6740 1 --2- 172.21.15.78:0/1921742604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbceba0 0x56086cbd7660 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.877+0000 7ff74add6740 1 --2- 172.21.15.78:0/1921742604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbce280 0x56086cbe6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.877+0000 7ff74add6740 1 -- 172.21.15.78:0/1921742604 >> 172.21.15.78:0/1921742604 conn(0x56086cbcc0b0 msgr2=0x56086cbca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:14.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.877+0000 7ff74add6740 1 -- 172.21.15.78:0/1921742604 shutdown_connections 2024-09-11T00:18:14.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.877+0000 7ff74add6740 1 -- 172.21.15.78:0/1921742604 wait complete. 2024-09-11T00:18:14.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.877+0000 7ff74add6740 1 -- start start 2024-09-11T00:18:14.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.877+0000 7ff74add6740 1 Processor -- start 2024-09-11T00:18:14.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.877+0000 7ff74add6740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbce280 0x56086cbe29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:14.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.877+0000 7ff74add6740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbceba0 0x56086cbe2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:14.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.877+0000 7ff74add6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbdab30 0x56086cbdd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:14.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.877+0000 7ff74add6740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff7441ad2c0 con 0x56086cbceba0 2024-09-11T00:18:14.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.877+0000 7ff74add6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff7441ae730 con 0x56086cbdab30 2024-09-11T00:18:14.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.877+0000 7ff74add6740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff7441ad990 con 0x56086cbce280 2024-09-11T00:18:14.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.878+0000 7ff74add6740 10 client.0 _ll_register_callbacks cb 0x7ff738005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:18:14.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.878+0000 7ff741d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbceba0 0x56086cbe2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:14.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.878+0000 7ff741d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbceba0 0x56086cbe2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49210/0 (socket says 172.21.15.78:49210) 2024-09-11T00:18:14.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.878+0000 7ff741d9b640 1 -- 172.21.15.78:0/3636367431 learned_addr learned my addr 172.21.15.78:0/3636367431 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:14.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.878+0000 7ff74259c640 1 --2- 172.21.15.78:0/3636367431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbce280 0x56086cbe29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:14.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.878+0000 7ff742d9d640 1 --2- 172.21.15.78:0/3636367431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbdab30 0x56086cbdd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:14.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.878+0000 7ff741d9b640 1 -- 172.21.15.78:0/3636367431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbce280 msgr2=0x56086cbe29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:14.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.878+0000 7ff741d9b640 1 --2- 172.21.15.78:0/3636367431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbce280 0x56086cbe29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.878+0000 7ff741d9b640 1 -- 172.21.15.78:0/3636367431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbdab30 msgr2=0x56086cbdd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:14.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.878+0000 7ff741d9b640 1 --2- 172.21.15.78:0/3636367431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbdab30 0x56086cbdd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.878+0000 7ff741d9b640 1 -- 172.21.15.78:0/3636367431 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56086cbddee0 con 0x56086cbceba0 2024-09-11T00:18:14.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.878+0000 7ff74259c640 1 --2- 172.21.15.78:0/3636367431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbce280 0x56086cbe29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:18:14.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.878+0000 7ff742d9d640 1 --2- 172.21.15.78:0/3636367431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbdab30 0x56086cbdd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:18:14.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.878+0000 7ff741d9b640 1 --2- 172.21.15.78:0/3636367431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbceba0 0x56086cbe2f30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff7380ad060 tx=0x7ff7380a8330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4429a55f03e0913 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:14.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.878+0000 7ff729ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:18:14.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.878+0000 7ff729ffb640 1 -- 172.21.15.78:0/3636367431 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7380ac100 con 0x56086cbceba0 2024-09-11T00:18:14.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.878+0000 7ff729ffb640 1 -- 172.21.15.78:0/3636367431 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7ff7380b5ac0 con 0x56086cbceba0 2024-09-11T00:18:14.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.878+0000 7ff74add6740 1 -- 172.21.15.78:0/3636367431 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7380e9bc0 con 0x56086cbceba0 2024-09-11T00:18:14.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.878+0000 7ff729ffb640 1 -- 172.21.15.78:0/3636367431 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff7380ac580 con 0x56086cbceba0 2024-09-11T00:18:14.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.878+0000 7ff74add6740 10 client.15588 fetch_fsmap learned FSMap version 20 2024-09-11T00:18:14.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.878+0000 7ff74add6740 1 -- 172.21.15.78:0/3636367431 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56086cbddee0 con 0x56086cbceba0 2024-09-11T00:18:14.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.879+0000 7ff729ffb640 1 -- 172.21.15.78:0/3636367431 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7380e9bc0 con 0x56086cbceba0 2024-09-11T00:18:14.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.879+0000 7ff729ffb640 1 -- 172.21.15.78:0/3636367431 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff7380aba10 con 0x56086cbceba0 2024-09-11T00:18:14.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.879+0000 7ff74add6740 10 client.15588 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:18:14.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.879+0000 7ff74add6740 10 client.15588 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:18:14.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.879+0000 7ff74add6740 20 client.15588 populate_metadata read hostname 'smithi078' 2024-09-11T00:18:14.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.879+0000 7ff74add6740 1 --2- 172.21.15.78:0/3636367431 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56086cc57960 0x56086cc59d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:14.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.879+0000 7ff74add6740 4 client.15588 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:18:14.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.879+0000 7ff74add6740 1 -- 172.21.15.78:0/3636367431 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56086cb3fc80 con 0x56086cc57960 2024-09-11T00:18:14.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.879+0000 7ff74259c640 1 --2- 172.21.15.78:0/3636367431 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56086cc57960 0x56086cc59d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:14.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.879+0000 7ff74259c640 1 --2- 172.21.15.78:0/3636367431 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56086cc57960 0x56086cc59d80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a3097768f8e1a54 server_cookie=af72a44fe13b3048 in_seq=0 out_seq=0 2024-09-11T00:18:14.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.879+0000 7ff729ffb640 10 client.15588 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:14.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.881+0000 7ff729ffb640 1 -- 172.21.15.78:0/3636367431 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1431 (crc 0 0 0) 0x56086cb3fc80 con 0x56086cc57960 2024-09-11T00:18:14.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.881+0000 7ff729ffb640 10 client.15588 handle_command_reply: tid=0 2024-09-11T00:18:14.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.881+0000 7ff74add6740 1 client.15588 shutdown 2024-09-11T00:18:14.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.881+0000 7ff74add6740 1 -- 172.21.15.78:0/3636367431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbceba0 msgr2=0x56086cbe2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:14.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.881+0000 7ff74add6740 1 --2- 172.21.15.78:0/3636367431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbceba0 0x56086cbe2f30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff7380ad060 tx=0x7ff7380a8330 comp rx=0 tx=0).stop 2024-09-11T00:18:14.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.881+0000 7ff74add6740 1 -- 172.21.15.78:0/3636367431 shutdown_connections 2024-09-11T00:18:14.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.881+0000 7ff74add6740 1 --2- 172.21.15.78:0/3636367431 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56086cc57960 0x56086cc59d80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.882+0000 7ff74add6740 1 --2- 172.21.15.78:0/3636367431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56086cbdab30 0x56086cbdd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.882+0000 7ff74add6740 1 --2- 172.21.15.78:0/3636367431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56086cbceba0 0x56086cbe2f30 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.882+0000 7ff74add6740 1 --2- 172.21.15.78:0/3636367431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56086cbce280 0x56086cbe29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.882+0000 7ff729ffb640 0 client.15588 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:14.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.882+0000 7ff74add6740 1 -- 172.21.15.78:0/3636367431 >> 172.21.15.78:0/3636367431 conn(0x56086cbcc0b0 msgr2=0x56086cbcb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:14.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.882+0000 7ff74add6740 1 -- 172.21.15.78:0/3636367431 shutdown_connections 2024-09-11T00:18:14.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.882+0000 7ff74add6740 1 -- 172.21.15.78:0/3636367431 wait complete. 2024-09-11T00:18:14.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.882+0000 7ff74add6740 20 client.15588 trim_cache size 0 max 16384 2024-09-11T00:18:14.893 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:18:14.894 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "scrub active (1599 inodes in the stack)", 2024-09-11T00:18:14.894 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-11T00:18:14.894 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:18:14.894 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:18:14.894 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "a682c96e-1acb-43c1-884d-6ae3d81cba47", 2024-09-11T00:18:14.894 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-11T00:18:14.894 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:18:14.894 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:18:14.894 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:18:14.894 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:18:14.894 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:18:14.895 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:18:14.895 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:18:14.895 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:18:14.895 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:18:14.895 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:18:14.895 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:18:14.895 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:18:14.895 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:18:14.895 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:18:14.895 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:18:14.895 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:18:14.895 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:18:14.896 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:18:14.896 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:18:14.896 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:18:14.896 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:18:14.896 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:18:14.896 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:18:14.896 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:18:14.896 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:18:14.896 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:18:14.896 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:18:14.896 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:18:14.897 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:18:14.897 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:18:14.897 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:18:14.897 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:18:14.897 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:18:14.897 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:18:14.897 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:18:14.897 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:18:14.897 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:18:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.882+0000 7ff74359e640 1 -- 172.21.15.78:0/3257867787 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff72c0b5500 msgr2=0x7ff72c0b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.882+0000 7ff74359e640 1 --2- 172.21.15.78:0/3257867787 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff72c0b5500 0x7ff72c0b79c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff73c02f500 tx=0x7ff73c0095c0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.882+0000 7ff74359e640 1 -- 172.21.15.78:0/3257867787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff744107510 msgr2=0x7ff7441995a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.882+0000 7ff74359e640 1 --2- 172.21.15.78:0/3257867787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff744107510 0x7ff7441995a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff73800e9f0 tx=0x7ff73800eeb0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.882+0000 7ff74359e640 1 -- 172.21.15.78:0/3257867787 shutdown_connections 2024-09-11T00:18:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.882+0000 7ff74359e640 1 --2- 172.21.15.78:0/3257867787 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff72c0b5500 0x7ff72c0b79c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.882+0000 7ff74359e640 1 --2- 172.21.15.78:0/3257867787 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff744107e90 0x7ff74419e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.882+0000 7ff74359e640 1 --2- 172.21.15.78:0/3257867787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff744107510 0x7ff7441995a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.882+0000 7ff74359e640 1 --2- 172.21.15.78:0/3257867787 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff744101b00 0x7ff744199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:14.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.882+0000 7ff74359e640 1 -- 172.21.15.78:0/3257867787 >> 172.21.15.78:0/3257867787 conn(0x7ff7440fd5b0 msgr2=0x7ff7441047a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:14.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.883+0000 7ff74359e640 1 -- 172.21.15.78:0/3257867787 shutdown_connections 2024-09-11T00:18:14.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:14.883+0000 7ff74359e640 1 -- 172.21.15.78:0/3257867787 wait complete. 2024-09-11T00:18:15.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:14 smithi138 ceph-mon[35019]: scrub queued for path: / 2024-09-11T00:18:15.046 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:14 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:18:15.046 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:14 smithi138 ceph-mon[35019]: scrub summary: active paths [/] 2024-09-11T00:18:15.046 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:14 smithi138 ceph-mon[35019]: pgmap v376: 97 pgs: 97 active+clean; 2.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 134 MiB/s rd, 151 MiB/s wr, 283 op/s 2024-09-11T00:18:15.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:14 smithi078 ceph-mon[30865]: scrub queued for path: / 2024-09-11T00:18:15.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:14 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:18:15.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:14 smithi078 ceph-mon[30865]: scrub summary: active paths [/] 2024-09-11T00:18:15.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:14 smithi078 ceph-mon[30865]: pgmap v376: 97 pgs: 97 active+clean; 2.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 134 MiB/s rd, 151 MiB/s wr, 283 op/s 2024-09-11T00:18:15.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:14 smithi112 ceph-mon[35627]: scrub queued for path: / 2024-09-11T00:18:15.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:14 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:18:15.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:14 smithi112 ceph-mon[35627]: scrub summary: active paths [/] 2024-09-11T00:18:15.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:14 smithi112 ceph-mon[35627]: pgmap v376: 97 pgs: 97 active+clean; 2.2 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 134 MiB/s rd, 151 MiB/s wr, 283 op/s 2024-09-11T00:18:15.584 INFO:tasks.cephfs.filesystem:scrub status for tag:a682c96e-1acb-43c1-884d-6ae3d81cba47 - {'path': '/', 'tag': 'a682c96e-1acb-43c1-884d-6ae3d81cba47', 'options': 'recursive,force'} 2024-09-11T00:18:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:16 smithi138 ceph-mon[35019]: pgmap v377: 97 pgs: 97 active+clean; 2.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 95 MiB/s rd, 106 MiB/s wr, 292 op/s 2024-09-11T00:18:17.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:16 smithi078 ceph-mon[30865]: pgmap v377: 97 pgs: 97 active+clean; 2.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 95 MiB/s rd, 106 MiB/s wr, 292 op/s 2024-09-11T00:18:17.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:16 smithi112 ceph-mon[35627]: pgmap v377: 97 pgs: 97 active+clean; 2.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 95 MiB/s rd, 106 MiB/s wr, 292 op/s 2024-09-11T00:18:17.986 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-11T00:18:17.986 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-11T00:18:19.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:18 smithi078 ceph-mon[30865]: pgmap v378: 97 pgs: 97 active+clean; 1.9 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 MiB/s rd, 52 MiB/s wr, 235 op/s 2024-09-11T00:18:19.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:18 smithi112 ceph-mon[35627]: pgmap v378: 97 pgs: 97 active+clean; 1.9 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 MiB/s rd, 52 MiB/s wr, 235 op/s 2024-09-11T00:18:19.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:18 smithi138 ceph-mon[35019]: pgmap v378: 97 pgs: 97 active+clean; 1.9 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 MiB/s rd, 52 MiB/s wr, 235 op/s 2024-09-11T00:18:21.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:20 smithi078 ceph-mon[30865]: pgmap v379: 97 pgs: 97 active+clean; 1.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 29 MiB/s wr, 207 op/s 2024-09-11T00:18:21.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:20 smithi112 ceph-mon[35627]: pgmap v379: 97 pgs: 97 active+clean; 1.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 29 MiB/s wr, 207 op/s 2024-09-11T00:18:21.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:20 smithi138 ceph-mon[35019]: pgmap v379: 97 pgs: 97 active+clean; 1.6 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 29 MiB/s wr, 207 op/s 2024-09-11T00:18:23.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:22 smithi078 ceph-mon[30865]: pgmap v380: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 5.2 MiB/s wr, 258 op/s 2024-09-11T00:18:23.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:22 smithi112 ceph-mon[35627]: pgmap v380: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 5.2 MiB/s wr, 258 op/s 2024-09-11T00:18:23.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:22 smithi138 ceph-mon[35019]: pgmap v380: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 5.2 MiB/s wr, 258 op/s 2024-09-11T00:18:24.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:23 smithi112 ceph-mon[35627]: pgmap v381: 97 pgs: 97 active+clean; 1.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 208 op/s 2024-09-11T00:18:24.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:23 smithi138 ceph-mon[35019]: pgmap v381: 97 pgs: 97 active+clean; 1.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 208 op/s 2024-09-11T00:18:24.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:23 smithi078 ceph-mon[30865]: pgmap v381: 97 pgs: 97 active+clean; 1.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 208 op/s 2024-09-11T00:18:27.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:26 smithi138 ceph-mon[35019]: pgmap v382: 97 pgs: 97 active+clean; 1.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 272 op/s 2024-09-11T00:18:27.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:26 smithi078 ceph-mon[30865]: pgmap v382: 97 pgs: 97 active+clean; 1.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 272 op/s 2024-09-11T00:18:27.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:26 smithi112 ceph-mon[35627]: pgmap v382: 97 pgs: 97 active+clean; 1.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 272 op/s 2024-09-11T00:18:29.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:28 smithi138 ceph-mon[35019]: pgmap v383: 97 pgs: 97 active+clean; 1.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 248 op/s 2024-09-11T00:18:29.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:28 smithi078 ceph-mon[30865]: pgmap v383: 97 pgs: 97 active+clean; 1.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 248 op/s 2024-09-11T00:18:29.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:28 smithi112 ceph-mon[35627]: pgmap v383: 97 pgs: 97 active+clean; 1.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 248 op/s 2024-09-11T00:18:31.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:30 smithi138 ceph-mon[35019]: pgmap v384: 97 pgs: 97 active+clean; 1.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 263 op/s 2024-09-11T00:18:31.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:30 smithi078 ceph-mon[30865]: pgmap v384: 97 pgs: 97 active+clean; 1.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 263 op/s 2024-09-11T00:18:31.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:30 smithi112 ceph-mon[35627]: pgmap v384: 97 pgs: 97 active+clean; 1.4 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 263 op/s 2024-09-11T00:18:33.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:32 smithi138 ceph-mon[35019]: pgmap v385: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 306 op/s 2024-09-11T00:18:33.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:32 smithi078 ceph-mon[30865]: pgmap v385: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 306 op/s 2024-09-11T00:18:33.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:32 smithi112 ceph-mon[35627]: pgmap v385: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 306 op/s 2024-09-11T00:18:34.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:33 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:18:34.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:33 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:18:34.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:33 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:18:35.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:34 smithi138 ceph-mon[35019]: pgmap v386: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 263 op/s 2024-09-11T00:18:35.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:34 smithi078 ceph-mon[30865]: pgmap v386: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 263 op/s 2024-09-11T00:18:35.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:34 smithi112 ceph-mon[35627]: pgmap v386: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 263 op/s 2024-09-11T00:18:37.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:36 smithi138 ceph-mon[35019]: pgmap v387: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 322 op/s 2024-09-11T00:18:37.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:36 smithi138 ceph-mon[35019]: scrub summary: idle 2024-09-11T00:18:37.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:36 smithi078 ceph-mon[30865]: pgmap v387: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 322 op/s 2024-09-11T00:18:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:36 smithi078 ceph-mon[30865]: scrub summary: idle 2024-09-11T00:18:37.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:36 smithi112 ceph-mon[35627]: pgmap v387: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 322 op/s 2024-09-11T00:18:37.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:36 smithi112 ceph-mon[35627]: scrub summary: idle 2024-09-11T00:18:38.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:37 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:18:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:37 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:18:38.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:37 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:18:39.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:38 smithi078 ceph-mon[30865]: pgmap v388: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 294 op/s 2024-09-11T00:18:39.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:38 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:18:39.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:38 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:18:39.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:38 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:18:39.194 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:38 smithi138 ceph-mon[35019]: pgmap v388: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 294 op/s 2024-09-11T00:18:39.194 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:38 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:18:39.194 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:38 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:18:39.194 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:38 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:18:39.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:38 smithi112 ceph-mon[35627]: pgmap v388: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 294 op/s 2024-09-11T00:18:39.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:38 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:18:39.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:38 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:18:39.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:38 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:18:41.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:40 smithi078 ceph-mon[30865]: pgmap v389: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 376 op/s 2024-09-11T00:18:41.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:40 smithi112 ceph-mon[35627]: pgmap v389: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 376 op/s 2024-09-11T00:18:41.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:40 smithi138 ceph-mon[35019]: pgmap v389: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 376 op/s 2024-09-11T00:18:42.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:41 smithi112 ceph-mon[35627]: pgmap v390: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 381 op/s 2024-09-11T00:18:42.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:41 smithi138 ceph-mon[35019]: pgmap v390: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 381 op/s 2024-09-11T00:18:42.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:41 smithi078 ceph-mon[30865]: pgmap v390: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 381 op/s 2024-09-11T00:18:45.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:44 smithi138 ceph-mon[35019]: pgmap v391: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 371 op/s 2024-09-11T00:18:45.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:44 smithi078 ceph-mon[30865]: pgmap v391: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 371 op/s 2024-09-11T00:18:45.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:44 smithi112 ceph-mon[35627]: pgmap v391: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 371 op/s 2024-09-11T00:18:45.585 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:18:45.841 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:18:46.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.517+0000 7f426a229640 1 -- 172.21.15.78:0/69411717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42641076a0 msgr2=0x7f4264107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:46.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.517+0000 7f426a229640 1 --2- 172.21.15.78:0/69411717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42641076a0 0x7f4264107ae0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f425800dc90 tx=0x7f425802e370 comp rx=0 tx=0).stop 2024-09-11T00:18:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.517+0000 7f426a229640 1 -- 172.21.15.78:0/69411717 shutdown_connections 2024-09-11T00:18:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.517+0000 7f426a229640 1 --2- 172.21.15.78:0/69411717 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4264108020 0x7f426410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.517+0000 7f426a229640 1 --2- 172.21.15.78:0/69411717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42641076a0 0x7f4264107ae0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.517+0000 7f426a229640 1 --2- 172.21.15.78:0/69411717 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4264101c90 0x7f4264102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.517+0000 7f426a229640 1 -- 172.21.15.78:0/69411717 >> 172.21.15.78:0/69411717 conn(0x7f42640fd700 msgr2=0x7f42640ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.518+0000 7f426a229640 1 -- 172.21.15.78:0/69411717 shutdown_connections 2024-09-11T00:18:46.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.518+0000 7f426a229640 1 -- 172.21.15.78:0/69411717 wait complete. 2024-09-11T00:18:46.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.519+0000 7f426a229640 1 Processor -- start 2024-09-11T00:18:46.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.519+0000 7f426a229640 1 -- start start 2024-09-11T00:18:46.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.520+0000 7f426a229640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4264101c90 0x7f426406ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:46.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.520+0000 7f426a229640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42641076a0 0x7f426406ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:46.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.520+0000 7f426a229640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4264108020 0x7f42640742d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:46.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.520+0000 7f426a229640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f426406d290 con 0x7f42641076a0 2024-09-11T00:18:46.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.520+0000 7f426a229640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f426406d110 con 0x7f4264108020 2024-09-11T00:18:46.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.520+0000 7f426a229640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f426406d410 con 0x7f4264101c90 2024-09-11T00:18:46.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.520+0000 7f42637fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4264101c90 0x7f426406ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:46.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.520+0000 7f42637fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4264101c90 0x7f426406ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.78:52156/0 (socket says 172.21.15.78:52156) 2024-09-11T00:18:46.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.520+0000 7f42637fe640 1 -- 172.21.15.78:0/4219861807 learned_addr learned my addr 172.21.15.78:0/4219861807 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:46.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.520+0000 7f4262ffd640 1 --2- 172.21.15.78:0/4219861807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42641076a0 0x7f426406ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:46.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.520+0000 7f4263fff640 1 --2- 172.21.15.78:0/4219861807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4264108020 0x7f42640742d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:46.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.520+0000 7f42637fe640 1 -- 172.21.15.78:0/4219861807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4264108020 msgr2=0x7f42640742d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:46.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.520+0000 7f42637fe640 1 --2- 172.21.15.78:0/4219861807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4264108020 0x7f42640742d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.520+0000 7f42637fe640 1 -- 172.21.15.78:0/4219861807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42641076a0 msgr2=0x7f426406ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:46.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.520+0000 7f42637fe640 1 --2- 172.21.15.78:0/4219861807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42641076a0 0x7f426406ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.521+0000 7f42637fe640 1 -- 172.21.15.78:0/4219861807 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4264074aa0 con 0x7f4264101c90 2024-09-11T00:18:46.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.521+0000 7f42637fe640 1 --2- 172.21.15.78:0/4219861807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4264101c90 0x7f426406ea40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f425400c890 tx=0x7f425400cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:46.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.521+0000 7f4260ff9640 1 -- 172.21.15.78:0/4219861807 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4254004220 con 0x7f4264101c90 2024-09-11T00:18:46.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.521+0000 7f4260ff9640 1 -- 172.21.15.78:0/4219861807 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42540043c0 con 0x7f4264101c90 2024-09-11T00:18:46.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.521+0000 7f426a229640 1 -- 172.21.15.78:0/4219861807 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4264074d90 con 0x7f4264101c90 2024-09-11T00:18:46.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.521+0000 7f426a229640 1 -- 172.21.15.78:0/4219861807 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42641b4af0 con 0x7f4264101c90 2024-09-11T00:18:46.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.522+0000 7f4260ff9640 1 -- 172.21.15.78:0/4219861807 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4254004a00 con 0x7f4264101c90 2024-09-11T00:18:46.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.524+0000 7f4260ff9640 1 -- 172.21.15.78:0/4219861807 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f4254004ba0 con 0x7f4264101c90 2024-09-11T00:18:46.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.525+0000 7f426c5fe740 1 Processor -- start 2024-09-11T00:18:46.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.525+0000 7f4260ff9640 1 --2- 172.21.15.78:0/4219861807 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f424c0b5500 0x7f424c0b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:46.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.525+0000 7f426c5fe740 1 -- start start 2024-09-11T00:18:46.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.525+0000 7f4260ff9640 1 -- 172.21.15.78:0/4219861807 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f42540e5b20 con 0x7f4264101c90 2024-09-11T00:18:46.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f426c5fe740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b38db5a480 0x55b38db5a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:46.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f426c5fe740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5ada0 0x55b38db667f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:46.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f426c5fe740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b38db66d30 0x55b38db69120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:46.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f426c5fe740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55b38dad0e50 con 0x55b38db5ada0 2024-09-11T00:18:46.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f426c5fe740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b38dac0280 con 0x55b38db66d30 2024-09-11T00:18:46.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f426c5fe740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55b38dac4090 con 0x55b38db5a480 2024-09-11T00:18:46.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f4263fff640 1 --2- 172.21.15.78:0/4219861807 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f424c0b5500 0x7f424c0b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:46.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f4262ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5ada0 0x55b38db667f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:46.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f4262ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5ada0 0x55b38db667f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48828/0 (socket says 172.21.15.78:48828) 2024-09-11T00:18:46.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f4262ffd640 1 -- 172.21.15.78:0/2264393100 learned_addr learned my addr 172.21.15.78:0/2264393100 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:46.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f4263fff640 1 --2- 172.21.15.78:0/2264393100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b38db66d30 0x55b38db69120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:46.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f42637fe640 1 --2- 172.21.15.78:0/2264393100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b38db5a480 0x55b38db5a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:46.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f4262ffd640 1 -- 172.21.15.78:0/2264393100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b38db5a480 msgr2=0x55b38db5a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:46.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f4262ffd640 1 --2- 172.21.15.78:0/2264393100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b38db5a480 0x55b38db5a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f4262ffd640 1 -- 172.21.15.78:0/2264393100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b38db66d30 msgr2=0x55b38db69120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:46.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f4262ffd640 1 --2- 172.21.15.78:0/2264393100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b38db66d30 0x55b38db69120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f4262ffd640 1 -- 172.21.15.78:0/2264393100 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b38d81e650 con 0x55b38db5ada0 2024-09-11T00:18:46.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f42637fe640 1 --2- 172.21.15.78:0/2264393100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b38db5a480 0x55b38db5a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:18:46.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f4263fff640 1 --2- 172.21.15.78:0/4219861807 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f424c0b5500 0x7f424c0b79c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f425c009fd0 tx=0x7f425c0099f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:46.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f4262ffd640 1 --2- 172.21.15.78:0/2264393100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5ada0 0x55b38db667f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4258004770 tx=0x7f42580047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ed8c15875ce790 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:46.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f4249ffb640 1 -- 172.21.15.78:0/2264393100 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4258043070 con 0x55b38db5ada0 2024-09-11T00:18:46.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f4249ffb640 1 -- 172.21.15.78:0/2264393100 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42580048c0 con 0x55b38db5ada0 2024-09-11T00:18:46.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.526+0000 7f4249ffb640 1 -- 172.21.15.78:0/2264393100 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4258003970 con 0x55b38db5ada0 2024-09-11T00:18:46.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.527+0000 7f426c5fe740 1 -- 172.21.15.78:0/2264393100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5ada0 msgr2=0x55b38db667f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:46.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.527+0000 7f426c5fe740 1 --2- 172.21.15.78:0/2264393100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5ada0 0x55b38db667f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4258004770 tx=0x7f42580047a0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.527+0000 7f426c5fe740 1 -- 172.21.15.78:0/2264393100 shutdown_connections 2024-09-11T00:18:46.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.527+0000 7f426c5fe740 1 --2- 172.21.15.78:0/2264393100 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b38db66d30 0x55b38db69120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.527+0000 7f426c5fe740 1 --2- 172.21.15.78:0/2264393100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5ada0 0x55b38db667f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.527+0000 7f426c5fe740 1 --2- 172.21.15.78:0/2264393100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b38db5a480 0x55b38db5a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.527+0000 7f426c5fe740 1 -- 172.21.15.78:0/2264393100 >> 172.21.15.78:0/2264393100 conn(0x55b38db582b0 msgr2=0x55b38db59450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:46.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.527+0000 7f426c5fe740 1 -- 172.21.15.78:0/2264393100 shutdown_connections 2024-09-11T00:18:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.527+0000 7f426c5fe740 1 -- 172.21.15.78:0/2264393100 wait complete. 2024-09-11T00:18:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.528+0000 7f426c5fe740 1 -- start start 2024-09-11T00:18:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.528+0000 7f426c5fe740 1 Processor -- start 2024-09-11T00:18:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.528+0000 7f426c5fe740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b38db5a480 0x55b38db66530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.528+0000 7f426c5fe740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5ada0 0x55b38db63980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.528+0000 7f426c5fe740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b38db66d30 0x55b38db63ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.528+0000 7f4262ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5ada0 0x55b38db63980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.528+0000 7f426c5fe740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55b38d921700 con 0x55b38db5ada0 2024-09-11T00:18:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.528+0000 7f426c5fe740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b38da5b110 con 0x55b38db66d30 2024-09-11T00:18:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.528+0000 7f4262ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5ada0 0x55b38db63980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48838/0 (socket says 172.21.15.78:48838) 2024-09-11T00:18:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.528+0000 7f426c5fe740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55b38db699a0 con 0x55b38db5a480 2024-09-11T00:18:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.528+0000 7f4262ffd640 1 -- 172.21.15.78:0/1218976714 learned_addr learned my addr 172.21.15.78:0/1218976714 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.528+0000 7f426c5fe740 10 client.0 _ll_register_callbacks cb 0x55b38da74990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:18:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.528+0000 7f42637fe640 1 --2- 172.21.15.78:0/1218976714 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b38db5a480 0x55b38db66530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.528+0000 7f4263fff640 1 --2- 172.21.15.78:0/1218976714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b38db66d30 0x55b38db63ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:46.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.529+0000 7f4262ffd640 1 -- 172.21.15.78:0/1218976714 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b38db5a480 msgr2=0x55b38db66530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:46.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.529+0000 7f4262ffd640 1 --2- 172.21.15.78:0/1218976714 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b38db5a480 0x55b38db66530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.529+0000 7f4262ffd640 1 -- 172.21.15.78:0/1218976714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b38db66d30 msgr2=0x55b38db63ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:46.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.529+0000 7f4262ffd640 1 --2- 172.21.15.78:0/1218976714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b38db66d30 0x55b38db63ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.529+0000 7f4262ffd640 1 -- 172.21.15.78:0/1218976714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b38da88c40 con 0x55b38db5ada0 2024-09-11T00:18:46.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.529+0000 7f4262ffd640 1 --2- 172.21.15.78:0/1218976714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5ada0 0x55b38db63980 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f425800d300 tx=0x7f425800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab83785c5a9add5c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:46.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.529+0000 7f4242ffd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:18:46.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.529+0000 7f4242ffd640 1 -- 172.21.15.78:0/1218976714 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4258043070 con 0x55b38db5ada0 2024-09-11T00:18:46.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.529+0000 7f4242ffd640 1 -- 172.21.15.78:0/1218976714 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f4258003900 con 0x55b38db5ada0 2024-09-11T00:18:46.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.529+0000 7f426c5fe740 1 -- 172.21.15.78:0/1218976714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42580048c0 con 0x55b38db5ada0 2024-09-11T00:18:46.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.529+0000 7f4242ffd640 1 -- 172.21.15.78:0/1218976714 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4258056050 con 0x55b38db5ada0 2024-09-11T00:18:46.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.529+0000 7f426c5fe740 10 client.15600 fetch_fsmap learned FSMap version 20 2024-09-11T00:18:46.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.529+0000 7f426c5fe740 1 -- 172.21.15.78:0/1218976714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b38db75250 con 0x55b38db5ada0 2024-09-11T00:18:46.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.529+0000 7f4242ffd640 1 -- 172.21.15.78:0/1218976714 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42580048c0 con 0x55b38db5ada0 2024-09-11T00:18:46.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.529+0000 7f4242ffd640 1 -- 172.21.15.78:0/1218976714 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f42580488c0 con 0x55b38db5ada0 2024-09-11T00:18:46.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.530+0000 7f426c5fe740 10 client.15600 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:18:46.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.530+0000 7f426c5fe740 10 client.15600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:18:46.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.530+0000 7f426c5fe740 20 client.15600 populate_metadata read hostname 'smithi078' 2024-09-11T00:18:46.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.530+0000 7f426c5fe740 1 --2- 172.21.15.78:0/1218976714 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b38db768d0 0x55b38db78d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:46.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.530+0000 7f426c5fe740 4 client.15600 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:18:46.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.530+0000 7f426c5fe740 1 -- 172.21.15.78:0/1218976714 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b38dad2da0 con 0x55b38db768d0 2024-09-11T00:18:46.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.530+0000 7f42637fe640 1 --2- 172.21.15.78:0/1218976714 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b38db768d0 0x55b38db78d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:46.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.530+0000 7f4242ffd640 10 client.15600 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:46.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.530+0000 7f42637fe640 1 --2- 172.21.15.78:0/1218976714 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b38db768d0 0x55b38db78d30 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2f3987e2175f74b server_cookie=7b337942f3f01cfc in_seq=0 out_seq=0 2024-09-11T00:18:46.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.531+0000 7f4242ffd640 1 -- 172.21.15.78:0/1218976714 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b38dad2da0 con 0x55b38db768d0 2024-09-11T00:18:46.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.531+0000 7f4242ffd640 10 client.15600 handle_command_reply: tid=0 2024-09-11T00:18:46.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.531+0000 7f426c5fe740 1 client.15600 shutdown 2024-09-11T00:18:46.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.532+0000 7f426c5fe740 1 -- 172.21.15.78:0/1218976714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5ada0 msgr2=0x55b38db63980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:46.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.532+0000 7f426c5fe740 1 --2- 172.21.15.78:0/1218976714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5ada0 0x55b38db63980 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f425800d300 tx=0x7f425800d330 comp rx=0 tx=0).stop 2024-09-11T00:18:46.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.532+0000 7f426c5fe740 1 -- 172.21.15.78:0/1218976714 shutdown_connections 2024-09-11T00:18:46.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.532+0000 7f426c5fe740 1 --2- 172.21.15.78:0/1218976714 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b38db768d0 0x55b38db78d30 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.532+0000 7f426c5fe740 1 --2- 172.21.15.78:0/1218976714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b38db66d30 0x55b38db63ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.532+0000 7f426c5fe740 1 --2- 172.21.15.78:0/1218976714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5ada0 0x55b38db63980 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.532+0000 7f4242ffd640 0 client.15600 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:46.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.532+0000 7f426c5fe740 1 --2- 172.21.15.78:0/1218976714 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b38db5a480 0x55b38db66530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.532+0000 7f426c5fe740 1 -- 172.21.15.78:0/1218976714 >> 172.21.15.78:0/1218976714 conn(0x55b38db582b0 msgr2=0x55b38db5de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:46.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.532+0000 7f426c5fe740 1 -- 172.21.15.78:0/1218976714 shutdown_connections 2024-09-11T00:18:46.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.532+0000 7f426c5fe740 1 -- 172.21.15.78:0/1218976714 wait complete. 2024-09-11T00:18:46.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.532+0000 7f426c5fe740 20 client.15600 trim_cache size 0 max 16384 2024-09-11T00:18:46.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.549+0000 7f426c5fe740 1 Processor -- start 2024-09-11T00:18:46.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.549+0000 7f426c5fe740 1 -- start start 2024-09-11T00:18:46.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.549+0000 7f426c5fe740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5a480 0x55b38db60b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:46.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.549+0000 7f426c5fe740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b38db5ada0 0x55b38db610d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:46.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.549+0000 7f426c5fe740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b38db66d30 0x55b38db7e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:46.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.549+0000 7f426c5fe740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f425000c780 con 0x55b38db5a480 2024-09-11T00:18:46.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.549+0000 7f426c5fe740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f425000f000 con 0x55b38db66d30 2024-09-11T00:18:46.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.549+0000 7f426c5fe740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f425000cdf0 con 0x55b38db5ada0 2024-09-11T00:18:46.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.550+0000 7f42637fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5a480 0x55b38db60b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:46.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.550+0000 7f42637fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5a480 0x55b38db60b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48842/0 (socket says 172.21.15.78:48842) 2024-09-11T00:18:46.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.550+0000 7f42637fe640 1 -- 172.21.15.78:0/898838576 learned_addr learned my addr 172.21.15.78:0/898838576 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:46.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.550+0000 7f4263fff640 1 --2- 172.21.15.78:0/898838576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b38db66d30 0x55b38db7e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:46.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.550+0000 7f4262ffd640 1 --2- 172.21.15.78:0/898838576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b38db5ada0 0x55b38db610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:46.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.550+0000 7f42637fe640 1 -- 172.21.15.78:0/898838576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b38db5ada0 msgr2=0x55b38db610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:46.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.550+0000 7f42637fe640 1 --2- 172.21.15.78:0/898838576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b38db5ada0 0x55b38db610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.550+0000 7f42637fe640 1 -- 172.21.15.78:0/898838576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b38db66d30 msgr2=0x55b38db7e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:46.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.550+0000 7f42637fe640 1 --2- 172.21.15.78:0/898838576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b38db66d30 0x55b38db7e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.550+0000 7f42637fe640 1 -- 172.21.15.78:0/898838576 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b38db5abd0 con 0x55b38db5a480 2024-09-11T00:18:46.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.550+0000 7f42637fe640 1 --2- 172.21.15.78:0/898838576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5a480 0x55b38db60b90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f42540a96e0 tx=0x7f4254000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37149aa1774b284 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:46.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.550+0000 7f42497fa640 1 -- 172.21.15.78:0/898838576 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425401d040 con 0x55b38db5a480 2024-09-11T00:18:46.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.550+0000 7f42497fa640 1 -- 172.21.15.78:0/898838576 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42540a9380 con 0x55b38db5a480 2024-09-11T00:18:46.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.550+0000 7f42497fa640 1 -- 172.21.15.78:0/898838576 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42540b1bd0 con 0x55b38db5a480 2024-09-11T00:18:46.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.551+0000 7f426c5fe740 1 -- 172.21.15.78:0/898838576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5a480 msgr2=0x55b38db60b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:46.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.551+0000 7f426c5fe740 1 --2- 172.21.15.78:0/898838576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5a480 0x55b38db60b90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f42540a96e0 tx=0x7f4254000bc0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.551+0000 7f426c5fe740 1 -- 172.21.15.78:0/898838576 shutdown_connections 2024-09-11T00:18:46.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.551+0000 7f426c5fe740 1 --2- 172.21.15.78:0/898838576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b38db66d30 0x55b38db7e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.551+0000 7f426c5fe740 1 --2- 172.21.15.78:0/898838576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b38db5ada0 0x55b38db610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.551+0000 7f426c5fe740 1 --2- 172.21.15.78:0/898838576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5a480 0x55b38db60b90 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.551+0000 7f426c5fe740 1 -- 172.21.15.78:0/898838576 >> 172.21.15.78:0/898838576 conn(0x55b38db582b0 msgr2=0x55b38db5ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:46.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.551+0000 7f426c5fe740 1 -- 172.21.15.78:0/898838576 shutdown_connections 2024-09-11T00:18:46.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.551+0000 7f426c5fe740 1 -- 172.21.15.78:0/898838576 wait complete. 2024-09-11T00:18:46.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.551+0000 7f426c5fe740 1 -- start start 2024-09-11T00:18:46.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.551+0000 7f426c5fe740 1 Processor -- start 2024-09-11T00:18:46.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.552+0000 7f426c5fe740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b38db5a480 0x55b38db6f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:46.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.552+0000 7f426c5fe740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5ada0 0x55b38db6a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:46.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.552+0000 7f426c5fe740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b38db66d30 0x55b38db6aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:46.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.552+0000 7f4262ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5ada0 0x55b38db6a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:46.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.552+0000 7f4262ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5ada0 0x55b38db6a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48858/0 (socket says 172.21.15.78:48858) 2024-09-11T00:18:46.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.552+0000 7f4262ffd640 1 -- 172.21.15.78:0/2237201768 learned_addr learned my addr 172.21.15.78:0/2237201768 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:46.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.552+0000 7f42637fe640 1 --2- 172.21.15.78:0/2237201768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b38db5a480 0x55b38db6f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:46.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.552+0000 7f426c5fe740 1 -- 172.21.15.78:0/2237201768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f425000d4c0 con 0x55b38db5ada0 2024-09-11T00:18:46.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.552+0000 7f426c5fe740 1 -- 172.21.15.78:0/2237201768 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f425000e930 con 0x55b38db5a480 2024-09-11T00:18:46.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.552+0000 7f426c5fe740 1 -- 172.21.15.78:0/2237201768 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f425000db90 con 0x55b38db66d30 2024-09-11T00:18:46.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.552+0000 7f426c5fe740 10 client.0 _ll_register_callbacks cb 0x7f4258041070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:18:46.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.552+0000 7f4263fff640 1 --2- 172.21.15.78:0/2237201768 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b38db66d30 0x55b38db6aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:46.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.552+0000 7f4262ffd640 1 -- 172.21.15.78:0/2237201768 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b38db66d30 msgr2=0x55b38db6aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:46.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.552+0000 7f4262ffd640 1 --2- 172.21.15.78:0/2237201768 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b38db66d30 0x55b38db6aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.552+0000 7f4262ffd640 1 -- 172.21.15.78:0/2237201768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b38db5a480 msgr2=0x55b38db6f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:46.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.552+0000 7f4262ffd640 1 --2- 172.21.15.78:0/2237201768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b38db5a480 0x55b38db6f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.552+0000 7f4262ffd640 1 -- 172.21.15.78:0/2237201768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b38db6b6f0 con 0x55b38db5ada0 2024-09-11T00:18:46.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.552+0000 7f4263fff640 1 --2- 172.21.15.78:0/2237201768 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b38db66d30 0x55b38db6aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:18:46.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.552+0000 7f4262ffd640 1 --2- 172.21.15.78:0/2237201768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5ada0 0x55b38db6a980 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4258030010 tx=0x7f425800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196e8fb8ed819237 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:46.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.552+0000 7f4242ffd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:18:46.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.552+0000 7f4242ffd640 1 -- 172.21.15.78:0/2237201768 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425805e070 con 0x55b38db5ada0 2024-09-11T00:18:46.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.553+0000 7f4242ffd640 1 -- 172.21.15.78:0/2237201768 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f4258004360 con 0x55b38db5ada0 2024-09-11T00:18:46.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.553+0000 7f426c5fe740 1 -- 172.21.15.78:0/2237201768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42540a9380 con 0x55b38db5ada0 2024-09-11T00:18:46.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.553+0000 7f4242ffd640 1 -- 172.21.15.78:0/2237201768 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4258043040 con 0x55b38db5ada0 2024-09-11T00:18:46.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.553+0000 7f426c5fe740 10 client.15606 fetch_fsmap learned FSMap version 20 2024-09-11T00:18:46.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.553+0000 7f426c5fe740 1 -- 172.21.15.78:0/2237201768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b38dbe37f0 con 0x55b38db5ada0 2024-09-11T00:18:46.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.553+0000 7f4242ffd640 1 -- 172.21.15.78:0/2237201768 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42540a9380 con 0x55b38db5ada0 2024-09-11T00:18:46.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.553+0000 7f4242ffd640 1 -- 172.21.15.78:0/2237201768 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f42580486e0 con 0x55b38db5ada0 2024-09-11T00:18:46.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.553+0000 7f426c5fe740 10 client.15606 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:18:46.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.553+0000 7f426c5fe740 10 client.15606 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:18:46.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.553+0000 7f426c5fe740 20 client.15606 populate_metadata read hostname 'smithi078' 2024-09-11T00:18:46.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.553+0000 7f426c5fe740 1 --2- 172.21.15.78:0/2237201768 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b38dbe3ee0 0x55b38dbe6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:46.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.553+0000 7f426c5fe740 4 client.15606 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:18:46.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.553+0000 7f426c5fe740 1 -- 172.21.15.78:0/2237201768 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b38dace850 con 0x55b38dbe3ee0 2024-09-11T00:18:46.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.553+0000 7f42637fe640 1 --2- 172.21.15.78:0/2237201768 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b38dbe3ee0 0x55b38dbe6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:46.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.554+0000 7f4242ffd640 10 client.15606 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:46.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.554+0000 7f42637fe640 1 --2- 172.21.15.78:0/2237201768 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b38dbe3ee0 0x55b38dbe6300 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5a6b187cf0ab0d5 server_cookie=e1e262cca402ee73 in_seq=0 out_seq=0 2024-09-11T00:18:46.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.555+0000 7f4242ffd640 1 -- 172.21.15.78:0/2237201768 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x55b38dace850 con 0x55b38dbe3ee0 2024-09-11T00:18:46.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.555+0000 7f4242ffd640 10 client.15606 handle_command_reply: tid=0 2024-09-11T00:18:46.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.555+0000 7f426c5fe740 1 client.15606 shutdown 2024-09-11T00:18:46.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.555+0000 7f426c5fe740 1 -- 172.21.15.78:0/2237201768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5ada0 msgr2=0x55b38db6a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:46.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.555+0000 7f426c5fe740 1 --2- 172.21.15.78:0/2237201768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5ada0 0x55b38db6a980 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4258030010 tx=0x7f425800db90 comp rx=0 tx=0).stop 2024-09-11T00:18:46.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.555+0000 7f426c5fe740 1 -- 172.21.15.78:0/2237201768 shutdown_connections 2024-09-11T00:18:46.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.555+0000 7f426c5fe740 1 --2- 172.21.15.78:0/2237201768 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b38dbe3ee0 0x55b38dbe6300 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.555+0000 7f426c5fe740 1 --2- 172.21.15.78:0/2237201768 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b38db66d30 0x55b38db6aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.555+0000 7f4242ffd640 0 client.15606 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:46.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.555+0000 7f426c5fe740 1 --2- 172.21.15.78:0/2237201768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b38db5ada0 0x55b38db6a980 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.555+0000 7f426c5fe740 1 --2- 172.21.15.78:0/2237201768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b38db5a480 0x55b38db6f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.555+0000 7f426c5fe740 1 -- 172.21.15.78:0/2237201768 >> 172.21.15.78:0/2237201768 conn(0x55b38db582b0 msgr2=0x55b38db56bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:46.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.556+0000 7f426c5fe740 1 -- 172.21.15.78:0/2237201768 shutdown_connections 2024-09-11T00:18:46.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.556+0000 7f426c5fe740 1 -- 172.21.15.78:0/2237201768 wait complete. 2024-09-11T00:18:46.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.556+0000 7f426c5fe740 20 client.15606 trim_cache size 0 max 16384 2024-09-11T00:18:46.562 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:18:46.562 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-11T00:18:46.562 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {}, 2024-09-11T00:18:46.562 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:18:46.562 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:18:46.562 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:18:46.562 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:18:46.562 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:18:46.562 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:18:46.562 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:18:46.563 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:18:46.563 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:18:46.563 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:18:46.563 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:18:46.563 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:18:46.563 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:18:46.563 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:18:46.563 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:18:46.563 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:18:46.563 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:18:46.563 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:18:46.563 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:18:46.563 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:18:46.563 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:18:46.563 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:18:46.564 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:18:46.564 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:18:46.564 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:18:46.564 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:18:46.564 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:18:46.564 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:18:46.564 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:18:46.564 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:18:46.564 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:18:46.564 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:18:46.564 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:18:46.564 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:18:46.564 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:18:46.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.556+0000 7f426a229640 1 -- 172.21.15.78:0/4219861807 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f424c0b5500 msgr2=0x7f424c0b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:46.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.556+0000 7f426a229640 1 --2- 172.21.15.78:0/4219861807 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f424c0b5500 0x7f424c0b79c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f425c009fd0 tx=0x7f425c0099f0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.556+0000 7f426a229640 1 -- 172.21.15.78:0/4219861807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4264101c90 msgr2=0x7f426406ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:46.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.556+0000 7f426a229640 1 --2- 172.21.15.78:0/4219861807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4264101c90 0x7f426406ea40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f425400c890 tx=0x7f425400cd50 comp rx=0 tx=0).stop 2024-09-11T00:18:46.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.556+0000 7f426a229640 1 -- 172.21.15.78:0/4219861807 shutdown_connections 2024-09-11T00:18:46.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.556+0000 7f426a229640 1 --2- 172.21.15.78:0/4219861807 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f424c0b5500 0x7f424c0b79c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.556+0000 7f426a229640 1 --2- 172.21.15.78:0/4219861807 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4264108020 0x7f42640742d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.556+0000 7f426a229640 1 --2- 172.21.15.78:0/4219861807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42641076a0 0x7f426406ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.556+0000 7f426a229640 1 --2- 172.21.15.78:0/4219861807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4264101c90 0x7f426406ea40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:46.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.556+0000 7f426a229640 1 -- 172.21.15.78:0/4219861807 >> 172.21.15.78:0/4219861807 conn(0x7f42640fd700 msgr2=0x7f42640ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:46.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.556+0000 7f426a229640 1 -- 172.21.15.78:0/4219861807 shutdown_connections 2024-09-11T00:18:46.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:46.556+0000 7f426a229640 1 -- 172.21.15.78:0/4219861807 wait complete. 2024-09-11T00:18:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:46 smithi138 ceph-mon[35019]: pgmap v392: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 410 op/s 2024-09-11T00:18:47.078 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:46 smithi078 ceph-mon[30865]: pgmap v392: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 410 op/s 2024-09-11T00:18:47.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:46 smithi112 ceph-mon[35627]: pgmap v392: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 410 op/s 2024-09-11T00:18:47.384 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:18:47.385 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:18:47.679 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:18:48.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.187+0000 7f61af53f640 1 -- 172.21.15.78:0/78340339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61a810d120 msgr2=0x7f61a810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:48.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.187+0000 7f61af53f640 1 --2- 172.21.15.78:0/78340339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61a810d120 0x7f61a810f550 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f61a0009ca0 tx=0x7f61a002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:18:48.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.187+0000 7f61af53f640 1 -- 172.21.15.78:0/78340339 shutdown_connections 2024-09-11T00:18:48.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.187+0000 7f61af53f640 1 --2- 172.21.15.78:0/78340339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61a810d120 0x7f61a810f550 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:48.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.187+0000 7f61af53f640 1 --2- 172.21.15.78:0/78340339 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61a8104570 0x7f61a810cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:48.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.187+0000 7f61af53f640 1 --2- 172.21.15.78:0/78340339 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61a8103b70 0x7f61a8103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:48.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.187+0000 7f61af53f640 1 -- 172.21.15.78:0/78340339 >> 172.21.15.78:0/78340339 conn(0x7f61a80fd700 msgr2=0x7f61a80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:48.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.187+0000 7f61af53f640 1 -- 172.21.15.78:0/78340339 shutdown_connections 2024-09-11T00:18:48.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.187+0000 7f61af53f640 1 -- 172.21.15.78:0/78340339 wait complete. 2024-09-11T00:18:48.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.187+0000 7f61af53f640 1 Processor -- start 2024-09-11T00:18:48.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.187+0000 7f61af53f640 1 -- start start 2024-09-11T00:18:48.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.188+0000 7f61af53f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61a8103b70 0x7f61a8199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:48.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.188+0000 7f61af53f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61a8104570 0x7f61a81996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:48.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.188+0000 7f61af53f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61a810d120 0x7f61a819ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:48.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.188+0000 7f61af53f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f61a8112d60 con 0x7f61a8104570 2024-09-11T00:18:48.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.188+0000 7f61af53f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f61a8112be0 con 0x7f61a810d120 2024-09-11T00:18:48.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.188+0000 7f61af53f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f61a8112ee0 con 0x7f61a8103b70 2024-09-11T00:18:48.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.188+0000 7f61acada640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61a8104570 0x7f61a81996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:48.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.188+0000 7f61acada640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61a8104570 0x7f61a81996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48870/0 (socket says 172.21.15.78:48870) 2024-09-11T00:18:48.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.188+0000 7f61acada640 1 -- 172.21.15.78:0/1245008979 learned_addr learned my addr 172.21.15.78:0/1245008979 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:48.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.188+0000 7f61adadc640 1 --2- 172.21.15.78:0/1245008979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61a810d120 0x7f61a819ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:48.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.188+0000 7f61ad2db640 1 --2- 172.21.15.78:0/1245008979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61a8103b70 0x7f61a8199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:48.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.188+0000 7f61acada640 1 -- 172.21.15.78:0/1245008979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61a8103b70 msgr2=0x7f61a8199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:48.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.188+0000 7f61acada640 1 --2- 172.21.15.78:0/1245008979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61a8103b70 0x7f61a8199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:48.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.188+0000 7f61acada640 1 -- 172.21.15.78:0/1245008979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61a810d120 msgr2=0x7f61a819ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:48.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.188+0000 7f61acada640 1 --2- 172.21.15.78:0/1245008979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61a810d120 0x7f61a819ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:48.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.188+0000 7f61acada640 1 -- 172.21.15.78:0/1245008979 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a819f220 con 0x7f61a8104570 2024-09-11T00:18:48.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.188+0000 7f61acada640 1 --2- 172.21.15.78:0/1245008979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61a8104570 0x7f61a81996b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f619800c920 tx=0x7f619800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:48.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.188+0000 7f619e7fc640 1 -- 172.21.15.78:0/1245008979 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6198007c70 con 0x7f61a8104570 2024-09-11T00:18:48.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.188+0000 7f619e7fc640 1 -- 172.21.15.78:0/1245008979 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6198007e10 con 0x7f61a8104570 2024-09-11T00:18:48.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.188+0000 7f61af53f640 1 -- 172.21.15.78:0/1245008979 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61a819f510 con 0x7f61a8104570 2024-09-11T00:18:48.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.188+0000 7f619e7fc640 1 -- 172.21.15.78:0/1245008979 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6198018820 con 0x7f61a8104570 2024-09-11T00:18:48.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.188+0000 7f61af53f640 1 -- 172.21.15.78:0/1245008979 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61a81a5da0 con 0x7f61a8104570 2024-09-11T00:18:48.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.189+0000 7f61af53f640 1 -- 172.21.15.78:0/1245008979 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61a8103f50 con 0x7f61a8104570 2024-09-11T00:18:48.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.191+0000 7f619e7fc640 1 -- 172.21.15.78:0/1245008979 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f619800f450 con 0x7f61a8104570 2024-09-11T00:18:48.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.192+0000 7f619e7fc640 1 --2- 172.21.15.78:0/1245008979 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f61940b54d0 0x7f61940b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:48.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.192+0000 7f61ad2db640 1 --2- 172.21.15.78:0/1245008979 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f61940b54d0 0x7f61940b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:48.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.192+0000 7f619e7fc640 1 -- 172.21.15.78:0/1245008979 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f61980e5fe0 con 0x7f61a8104570 2024-09-11T00:18:48.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.192+0000 7f61ad2db640 1 --2- 172.21.15.78:0/1245008979 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f61940b54d0 0x7f61940b7990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f61a4005fd0 tx=0x7f61a4005c70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:48.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.196+0000 7f619e7fc640 1 -- 172.21.15.78:0/1245008979 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6198014030 con 0x7f61a8104570 2024-09-11T00:18:48.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.416+0000 7f61af53f640 1 -- 172.21.15.78:0/1245008979 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61a81a6020 con 0x7f61a8104570 2024-09-11T00:18:48.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.416+0000 7f619e7fc640 1 -- 172.21.15.78:0/1245008979 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f61980acb80 con 0x7f61a8104570 2024-09-11T00:18:48.419 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:18:48.419 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:18:48.419 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:18:48.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.419+0000 7f61af53f640 1 -- 172.21.15.78:0/1245008979 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f61940b54d0 msgr2=0x7f61940b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:48.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.419+0000 7f61af53f640 1 --2- 172.21.15.78:0/1245008979 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f61940b54d0 0x7f61940b7990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f61a4005fd0 tx=0x7f61a4005c70 comp rx=0 tx=0).stop 2024-09-11T00:18:48.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.419+0000 7f61af53f640 1 -- 172.21.15.78:0/1245008979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61a8104570 msgr2=0x7f61a81996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:48.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.419+0000 7f61af53f640 1 --2- 172.21.15.78:0/1245008979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61a8104570 0x7f61a81996b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f619800c920 tx=0x7f619800cde0 comp rx=0 tx=0).stop 2024-09-11T00:18:48.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.419+0000 7f61af53f640 1 -- 172.21.15.78:0/1245008979 shutdown_connections 2024-09-11T00:18:48.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.419+0000 7f61af53f640 1 --2- 172.21.15.78:0/1245008979 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f61940b54d0 0x7f61940b7990 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:48.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.419+0000 7f61af53f640 1 --2- 172.21.15.78:0/1245008979 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f61a810d120 0x7f61a819ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:48.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.419+0000 7f61af53f640 1 --2- 172.21.15.78:0/1245008979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61a8104570 0x7f61a81996b0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:48.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.419+0000 7f61af53f640 1 --2- 172.21.15.78:0/1245008979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61a8103b70 0x7f61a8199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:48.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.419+0000 7f61af53f640 1 -- 172.21.15.78:0/1245008979 >> 172.21.15.78:0/1245008979 conn(0x7f61a80fd700 msgr2=0x7f61a810f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:48.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.419+0000 7f61af53f640 1 -- 172.21.15.78:0/1245008979 shutdown_connections 2024-09-11T00:18:48.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:48.419+0000 7f61af53f640 1 -- 172.21.15.78:0/1245008979 wait complete. 2024-09-11T00:18:49.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:48 smithi138 ceph-mon[35019]: pgmap v393: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 379 op/s 2024-09-11T00:18:49.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:48 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1245008979' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:18:49.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:48 smithi078 ceph-mon[30865]: pgmap v393: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 379 op/s 2024-09-11T00:18:49.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:48 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1245008979' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:18:49.226 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:18:49.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:48 smithi112 ceph-mon[35627]: pgmap v393: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 379 op/s 2024-09-11T00:18:49.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:48 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1245008979' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:18:49.482 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:18:50.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.996+0000 7fbea55c3640 1 -- 172.21.15.78:0/3208121893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbea0108020 msgr2=0x7fbea010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:50.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.996+0000 7fbea55c3640 1 --2- 172.21.15.78:0/3208121893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbea0108020 0x7fbea010e820 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009ca0 tx=0x7fbe9802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.996+0000 7fbea55c3640 1 -- 172.21.15.78:0/3208121893 shutdown_connections 2024-09-11T00:18:50.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.996+0000 7fbea55c3640 1 --2- 172.21.15.78:0/3208121893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbea0108020 0x7fbea010e820 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.996+0000 7fbea55c3640 1 --2- 172.21.15.78:0/3208121893 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbea01076a0 0x7fbea0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.996+0000 7fbea55c3640 1 --2- 172.21.15.78:0/3208121893 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbea0101c90 0x7fbea0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.996+0000 7fbea55c3640 1 -- 172.21.15.78:0/3208121893 >> 172.21.15.78:0/3208121893 conn(0x7fbea00fd700 msgr2=0x7fbea00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:50.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.996+0000 7fbea55c3640 1 -- 172.21.15.78:0/3208121893 shutdown_connections 2024-09-11T00:18:50.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.996+0000 7fbea55c3640 1 -- 172.21.15.78:0/3208121893 wait complete. 2024-09-11T00:18:50.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.996+0000 7fbea55c3640 1 Processor -- start 2024-09-11T00:18:50.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.997+0000 7fbea55c3640 1 -- start start 2024-09-11T00:18:50.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.997+0000 7fbea55c3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbea0101c90 0x7fbea01992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:50.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.997+0000 7fbea55c3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbea01076a0 0x7fbea0199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:50.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.997+0000 7fbea55c3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbea0108020 0x7fbea019eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:50.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.997+0000 7fbea55c3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbea0111ce0 con 0x7fbea01076a0 2024-09-11T00:18:50.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.997+0000 7fbea55c3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbea0111b60 con 0x7fbea0101c90 2024-09-11T00:18:50.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.997+0000 7fbea55c3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbea0111e60 con 0x7fbea0108020 2024-09-11T00:18:50.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.997+0000 7fbe967fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbea01076a0 0x7fbea0199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:50.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.997+0000 7fbe9effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbea0101c90 0x7fbea01992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:50.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.997+0000 7fbe967fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbea01076a0 0x7fbea0199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48888/0 (socket says 172.21.15.78:48888) 2024-09-11T00:18:50.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.997+0000 7fbe967fc640 1 -- 172.21.15.78:0/621796095 learned_addr learned my addr 172.21.15.78:0/621796095 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:50.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.997+0000 7fbe9f7fe640 1 --2- 172.21.15.78:0/621796095 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbea0108020 0x7fbea019eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:50.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.997+0000 7fbe967fc640 1 -- 172.21.15.78:0/621796095 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbea0108020 msgr2=0x7fbea019eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:50.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.997+0000 7fbe967fc640 1 --2- 172.21.15.78:0/621796095 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbea0108020 0x7fbea019eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.997+0000 7fbe967fc640 1 -- 172.21.15.78:0/621796095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbea0101c90 msgr2=0x7fbea01992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:50.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.997+0000 7fbe967fc640 1 --2- 172.21.15.78:0/621796095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbea0101c90 0x7fbea01992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.997+0000 7fbe967fc640 1 -- 172.21.15.78:0/621796095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea019f370 con 0x7fbea01076a0 2024-09-11T00:18:50.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.997+0000 7fbe9f7fe640 1 --2- 172.21.15.78:0/621796095 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbea0108020 0x7fbea019eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:18:50.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.997+0000 7fbe967fc640 1 --2- 172.21.15.78:0/621796095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbea01076a0 0x7fbea0199800 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800e9f0 tx=0x7fbe8800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:50.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.997+0000 7fbe9cff9640 1 -- 172.21.15.78:0/621796095 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8800cd80 con 0x7fbea01076a0 2024-09-11T00:18:50.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.997+0000 7fbe9cff9640 1 -- 172.21.15.78:0/621796095 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe880108e0 con 0x7fbea01076a0 2024-09-11T00:18:50.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.997+0000 7fbea55c3640 1 -- 172.21.15.78:0/621796095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea019f660 con 0x7fbea01076a0 2024-09-11T00:18:50.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.998+0000 7fbe9cff9640 1 -- 172.21.15.78:0/621796095 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88018980 con 0x7fbea01076a0 2024-09-11T00:18:50.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:49.998+0000 7fbea55c3640 1 -- 172.21.15.78:0/621796095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea01a5d20 con 0x7fbea01076a0 2024-09-11T00:18:50.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.000+0000 7fbea7998740 1 Processor -- start 2024-09-11T00:18:50.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.000+0000 7fbea7998740 1 -- start start 2024-09-11T00:18:50.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.001+0000 7fbe9cff9640 1 -- 172.21.15.78:0/621796095 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fbe88010430 con 0x7fbea01076a0 2024-09-11T00:18:50.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.001+0000 7fbea7998740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138b14d0 0x5618138b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:50.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.001+0000 7fbea7998740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138b1df0 0x5618138bd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:50.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.001+0000 7fbea7998740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138bdd80 0x5618138c0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:50.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.001+0000 7fbea7998740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x561813827ea0 con 0x5618138b14d0 2024-09-11T00:18:50.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.001+0000 7fbea7998740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5618138172d0 con 0x5618138b1df0 2024-09-11T00:18:50.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.001+0000 7fbea7998740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56181381b0e0 con 0x5618138bdd80 2024-09-11T00:18:50.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.001+0000 7fbe9f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138b14d0 0x5618138b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:50.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.001+0000 7fbe9f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138b14d0 0x5618138b18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48902/0 (socket says 172.21.15.78:48902) 2024-09-11T00:18:50.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.001+0000 7fbe9f7fe640 1 -- 172.21.15.78:0/4100046923 learned_addr learned my addr 172.21.15.78:0/4100046923 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:50.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.001+0000 7fbe9effd640 1 --2- 172.21.15.78:0/4100046923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138b1df0 0x5618138bd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:50.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.001+0000 7fbe967fc640 1 --2- 172.21.15.78:0/4100046923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138bdd80 0x5618138c0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:50.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.001+0000 7fbe9effd640 1 -- 172.21.15.78:0/4100046923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138bdd80 msgr2=0x5618138c0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:50.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.001+0000 7fbe9effd640 1 --2- 172.21.15.78:0/4100046923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138bdd80 0x5618138c0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.001+0000 7fbe9effd640 1 -- 172.21.15.78:0/4100046923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138b14d0 msgr2=0x5618138b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:50.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.001+0000 7fbe9effd640 1 --2- 172.21.15.78:0/4100046923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138b14d0 0x5618138b18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.001+0000 7fbe9effd640 1 -- 172.21.15.78:0/4100046923 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561813575650 con 0x5618138b1df0 2024-09-11T00:18:50.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.001+0000 7fbe9f7fe640 1 --2- 172.21.15.78:0/4100046923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138b14d0 0x5618138b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:18:50.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.001+0000 7fbe967fc640 1 --2- 172.21.15.78:0/4100046923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138bdd80 0x5618138c0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:18:50.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.002+0000 7fbe9effd640 1 --2- 172.21.15.78:0/4100046923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138b1df0 0x5618138bd840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009c00 tx=0x7fbe90011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbf15dadf6b87ffb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:50.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.002+0000 7fbe957fa640 1 -- 172.21.15.78:0/4100046923 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe90004230 con 0x5618138b1df0 2024-09-11T00:18:50.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.002+0000 7fbe957fa640 1 -- 172.21.15.78:0/4100046923 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe900043d0 con 0x5618138b1df0 2024-09-11T00:18:50.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.002+0000 7fbe957fa640 1 -- 172.21.15.78:0/4100046923 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe90004c30 con 0x5618138b1df0 2024-09-11T00:18:50.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.002+0000 7fbe9cff9640 1 --2- 172.21.15.78:0/621796095 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbe8c0b5450 0x7fbe8c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:50.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.002+0000 7fbe9f7fe640 1 --2- 172.21.15.78:0/621796095 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbe8c0b5450 0x7fbe8c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:50.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.002+0000 7fbe9cff9640 1 -- 172.21.15.78:0/621796095 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fbe880e62f0 con 0x7fbea01076a0 2024-09-11T00:18:50.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.003+0000 7fbea7998740 1 -- 172.21.15.78:0/4100046923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138b1df0 msgr2=0x5618138bd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:50.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.003+0000 7fbea7998740 1 --2- 172.21.15.78:0/4100046923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138b1df0 0x5618138bd840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009c00 tx=0x7fbe90011810 comp rx=0 tx=0).stop 2024-09-11T00:18:50.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.003+0000 7fbe9f7fe640 1 --2- 172.21.15.78:0/621796095 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbe8c0b5450 0x7fbe8c0b7910 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009a60 tx=0x7fbe980098b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:50.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.003+0000 7fbea7998740 1 -- 172.21.15.78:0/4100046923 shutdown_connections 2024-09-11T00:18:50.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.003+0000 7fbea7998740 1 --2- 172.21.15.78:0/4100046923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138bdd80 0x5618138c0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.003+0000 7fbea7998740 1 --2- 172.21.15.78:0/4100046923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138b1df0 0x5618138bd840 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.003+0000 7fbea7998740 1 --2- 172.21.15.78:0/4100046923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138b14d0 0x5618138b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.003+0000 7fbea7998740 1 -- 172.21.15.78:0/4100046923 >> 172.21.15.78:0/4100046923 conn(0x5618138af300 msgr2=0x5618138b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:50.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.003+0000 7fbea7998740 1 -- 172.21.15.78:0/4100046923 shutdown_connections 2024-09-11T00:18:50.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.003+0000 7fbea7998740 1 -- 172.21.15.78:0/4100046923 wait complete. 2024-09-11T00:18:50.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.003+0000 7fbea7998740 1 -- start start 2024-09-11T00:18:50.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.003+0000 7fbea7998740 1 Processor -- start 2024-09-11T00:18:50.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.004+0000 7fbea7998740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138b14d0 0x5618138c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:50.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.004+0000 7fbea7998740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138b1df0 0x5618138c2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:50.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.004+0000 7fbea7998740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138bdd80 0x5618138c7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:50.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.004+0000 7fbea7998740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x561813678700 con 0x5618138bdd80 2024-09-11T00:18:50.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.004+0000 7fbea7998740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5618137b2160 con 0x5618138b14d0 2024-09-11T00:18:50.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.004+0000 7fbea7998740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5618138c0a00 con 0x5618138b1df0 2024-09-11T00:18:50.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.004+0000 7fbea7998740 10 client.0 _ll_register_callbacks cb 0x5618137cb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:18:50.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.004+0000 7fbe967fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138b1df0 0x5618138c2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:50.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.004+0000 7fbe9effd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138b14d0 0x5618138c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:50.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.004+0000 7fbe967fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138b1df0 0x5618138c2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.78:52234/0 (socket says 172.21.15.78:52234) 2024-09-11T00:18:50.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.004+0000 7fbe967fc640 1 -- 172.21.15.78:0/2627074758 learned_addr learned my addr 172.21.15.78:0/2627074758 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:50.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.004+0000 7fbe9f7fe640 1 --2- 172.21.15.78:0/2627074758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138bdd80 0x5618138c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:50.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.004+0000 7fbe967fc640 1 -- 172.21.15.78:0/2627074758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138b14d0 msgr2=0x5618138c1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:50.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.004+0000 7fbe967fc640 1 --2- 172.21.15.78:0/2627074758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138b14d0 0x5618138c1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.004+0000 7fbe967fc640 1 -- 172.21.15.78:0/2627074758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138bdd80 msgr2=0x5618138c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:50.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.004+0000 7fbe967fc640 1 --2- 172.21.15.78:0/2627074758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138bdd80 0x5618138c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.004+0000 7fbe967fc640 1 -- 172.21.15.78:0/2627074758 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618137dfc90 con 0x5618138b1df0 2024-09-11T00:18:50.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.004+0000 7fbe967fc640 1 --2- 172.21.15.78:0/2627074758 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138b1df0 0x5618138c2520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe880a9a00 tx=0x7fbe88010cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f491c6854ae0e3a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:50.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.004+0000 7fbe867fc640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-11T00:18:50.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.005+0000 7fbe867fc640 1 -- 172.21.15.78:0/2627074758 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe880cf070 con 0x5618138b1df0 2024-09-11T00:18:50.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.005+0000 7fbe867fc640 1 -- 172.21.15.78:0/2627074758 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fbe880ab9f0 con 0x5618138b1df0 2024-09-11T00:18:50.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.005+0000 7fbea7998740 1 -- 172.21.15.78:0/2627074758 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe900043d0 con 0x5618138b1df0 2024-09-11T00:18:50.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.005+0000 7fbe867fc640 1 -- 172.21.15.78:0/2627074758 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbe880ac0e0 con 0x5618138b1df0 2024-09-11T00:18:50.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.005+0000 7fbea7998740 10 client.25153 fetch_fsmap learned FSMap version 20 2024-09-11T00:18:50.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.005+0000 7fbea7998740 1 -- 172.21.15.78:0/2627074758 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5618138b7060 con 0x5618138b1df0 2024-09-11T00:18:50.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.005+0000 7fbe867fc640 1 -- 172.21.15.78:0/2627074758 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe900043d0 con 0x5618138b1df0 2024-09-11T00:18:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.005+0000 7fbe867fc640 1 -- 172.21.15.78:0/2627074758 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fbe880cfae0 con 0x5618138b1df0 2024-09-11T00:18:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.005+0000 7fbea7998740 10 client.25153 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:18:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.005+0000 7fbea7998740 10 client.25153 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:18:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.005+0000 7fbea7998740 20 client.25153 populate_metadata read hostname 'smithi078' 2024-09-11T00:18:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.005+0000 7fbea7998740 1 --2- 172.21.15.78:0/2627074758 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5618138b8400 0x5618138b8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.005+0000 7fbea7998740 4 client.25153 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:18:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.005+0000 7fbea7998740 1 -- 172.21.15.78:0/2627074758 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561813829df0 con 0x5618138b8400 2024-09-11T00:18:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.005+0000 7fbe9effd640 1 --2- 172.21.15.78:0/2627074758 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5618138b8400 0x5618138b8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.006+0000 7fbe867fc640 10 client.25153 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.006+0000 7fbe9effd640 1 --2- 172.21.15.78:0/2627074758 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5618138b8400 0x5618138b8810 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11355a3cc6999ff0 server_cookie=2216c8d003592264 in_seq=0 out_seq=0 2024-09-11T00:18:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.008+0000 7fbe867fc640 1 -- 172.21.15.78:0/2627074758 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561813829df0 con 0x5618138b8400 2024-09-11T00:18:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.008+0000 7fbe867fc640 10 client.25153 handle_command_reply: tid=0 2024-09-11T00:18:50.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.008+0000 7fbea7998740 1 client.25153 shutdown 2024-09-11T00:18:50.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.008+0000 7fbea7998740 1 -- 172.21.15.78:0/2627074758 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138b1df0 msgr2=0x5618138c2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:50.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.008+0000 7fbea7998740 1 --2- 172.21.15.78:0/2627074758 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138b1df0 0x5618138c2520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe880a9a00 tx=0x7fbe88010cc0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.008+0000 7fbea7998740 1 -- 172.21.15.78:0/2627074758 shutdown_connections 2024-09-11T00:18:50.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.008+0000 7fbea7998740 1 --2- 172.21.15.78:0/2627074758 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5618138b8400 0x5618138b8810 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.008+0000 7fbea7998740 1 --2- 172.21.15.78:0/2627074758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138bdd80 0x5618138c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.008+0000 7fbea7998740 1 --2- 172.21.15.78:0/2627074758 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138b1df0 0x5618138c2520 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.008+0000 7fbea7998740 1 --2- 172.21.15.78:0/2627074758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138b14d0 0x5618138c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.008+0000 7fbe867fc640 0 client.25153 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:50.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.008+0000 7fbea7998740 1 -- 172.21.15.78:0/2627074758 >> 172.21.15.78:0/2627074758 conn(0x5618138af300 msgr2=0x5618138b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:50.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.008+0000 7fbea7998740 1 -- 172.21.15.78:0/2627074758 shutdown_connections 2024-09-11T00:18:50.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.008+0000 7fbea7998740 1 -- 172.21.15.78:0/2627074758 wait complete. 2024-09-11T00:18:50.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.008+0000 7fbea7998740 20 client.25153 trim_cache size 0 max 16384 2024-09-11T00:18:50.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.021+0000 7fbea7998740 1 Processor -- start 2024-09-11T00:18:50.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.021+0000 7fbea7998740 1 -- start start 2024-09-11T00:18:50.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.022+0000 7fbea7998740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138b14d0 0x5618138b97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:50.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.022+0000 7fbea7998740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138b1df0 0x5618138b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:50.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.022+0000 7fbea7998740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138bdd80 0x5618138c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:50.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.022+0000 7fbea7998740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbea01aa5b0 con 0x5618138b1df0 2024-09-11T00:18:50.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.022+0000 7fbea7998740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbea01ace30 con 0x5618138bdd80 2024-09-11T00:18:50.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.022+0000 7fbea7998740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbea01aac20 con 0x5618138b14d0 2024-09-11T00:18:50.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.022+0000 7fbe967fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138b1df0 0x5618138b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:50.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.022+0000 7fbe9f7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138bdd80 0x5618138c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:50.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.022+0000 7fbe967fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138b1df0 0x5618138b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48924/0 (socket says 172.21.15.78:48924) 2024-09-11T00:18:50.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.022+0000 7fbe967fc640 1 -- 172.21.15.78:0/892058290 learned_addr learned my addr 172.21.15.78:0/892058290 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.022+0000 7fbe9effd640 1 --2- 172.21.15.78:0/892058290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138b14d0 0x5618138b97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.022+0000 7fbe967fc640 1 -- 172.21.15.78:0/892058290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138b14d0 msgr2=0x5618138b97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.022+0000 7fbe967fc640 1 --2- 172.21.15.78:0/892058290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138b14d0 0x5618138b97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.022+0000 7fbe967fc640 1 -- 172.21.15.78:0/892058290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138bdd80 msgr2=0x5618138c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.022+0000 7fbe967fc640 1 --2- 172.21.15.78:0/892058290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138bdd80 0x5618138c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.022+0000 7fbe967fc640 1 -- 172.21.15.78:0/892058290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618138b1c20 con 0x5618138b1df0 2024-09-11T00:18:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.022+0000 7fbe9effd640 1 --2- 172.21.15.78:0/892058290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138b14d0 0x5618138b97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:18:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.022+0000 7fbe9f7fe640 1 --2- 172.21.15.78:0/892058290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138bdd80 0x5618138c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:18:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.022+0000 7fbe967fc640 1 --2- 172.21.15.78:0/892058290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138b1df0 0x5618138b8400 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fbe880e4060 tx=0x7fbe8800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526b823ad6b93132 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.022+0000 7fbe94ff9640 1 -- 172.21.15.78:0/892058290 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe880d3070 con 0x5618138b1df0 2024-09-11T00:18:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.022+0000 7fbe94ff9640 1 -- 172.21.15.78:0/892058290 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe880ac2a0 con 0x5618138b1df0 2024-09-11T00:18:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.022+0000 7fbe94ff9640 1 -- 172.21.15.78:0/892058290 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe880cf040 con 0x5618138b1df0 2024-09-11T00:18:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.023+0000 7fbea7998740 1 -- 172.21.15.78:0/892058290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138b1df0 msgr2=0x5618138b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:50.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.023+0000 7fbea7998740 1 --2- 172.21.15.78:0/892058290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138b1df0 0x5618138b8400 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fbe880e4060 tx=0x7fbe8800c7d0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.023+0000 7fbea7998740 1 -- 172.21.15.78:0/892058290 shutdown_connections 2024-09-11T00:18:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.023+0000 7fbea7998740 1 --2- 172.21.15.78:0/892058290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138bdd80 0x5618138c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.023+0000 7fbea7998740 1 --2- 172.21.15.78:0/892058290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138b1df0 0x5618138b8400 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.023+0000 7fbea7998740 1 --2- 172.21.15.78:0/892058290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138b14d0 0x5618138b97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.023+0000 7fbea7998740 1 -- 172.21.15.78:0/892058290 >> 172.21.15.78:0/892058290 conn(0x5618138af300 msgr2=0x5618138b90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.023+0000 7fbea7998740 1 -- 172.21.15.78:0/892058290 shutdown_connections 2024-09-11T00:18:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.023+0000 7fbea7998740 1 -- 172.21.15.78:0/892058290 wait complete. 2024-09-11T00:18:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.024+0000 7fbea7998740 1 -- start start 2024-09-11T00:18:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.024+0000 7fbea7998740 1 Processor -- start 2024-09-11T00:18:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.024+0000 7fbea7998740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138b14d0 0x5618138c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.024+0000 7fbea7998740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138b1df0 0x5618138c9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.024+0000 7fbea7998740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138bdd80 0x5618138cd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.024+0000 7fbea7998740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbea01ab2f0 con 0x5618138b14d0 2024-09-11T00:18:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.024+0000 7fbea7998740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbea01ac760 con 0x5618138bdd80 2024-09-11T00:18:50.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.024+0000 7fbea7998740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbea01ab9c0 con 0x5618138b1df0 2024-09-11T00:18:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.024+0000 7fbe9effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138b14d0 0x5618138c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.024+0000 7fbea7998740 10 client.0 _ll_register_callbacks cb 0x7fbe8800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:18:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.024+0000 7fbe9effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138b14d0 0x5618138c90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48932/0 (socket says 172.21.15.78:48932) 2024-09-11T00:18:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.024+0000 7fbe9effd640 1 -- 172.21.15.78:0/2407307143 learned_addr learned my addr 172.21.15.78:0/2407307143 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.024+0000 7fbe9f7fe640 1 --2- 172.21.15.78:0/2407307143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138bdd80 0x5618138cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.024+0000 7fbe967fc640 1 --2- 172.21.15.78:0/2407307143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138b1df0 0x5618138c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.024+0000 7fbe9effd640 1 -- 172.21.15.78:0/2407307143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138b1df0 msgr2=0x5618138c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.024+0000 7fbe9effd640 1 --2- 172.21.15.78:0/2407307143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138b1df0 0x5618138c9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.024+0000 7fbe9effd640 1 -- 172.21.15.78:0/2407307143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138bdd80 msgr2=0x5618138cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.024+0000 7fbe9effd640 1 --2- 172.21.15.78:0/2407307143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138bdd80 0x5618138cd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.024+0000 7fbe9effd640 1 -- 172.21.15.78:0/2407307143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618138cdcc0 con 0x5618138b14d0 2024-09-11T00:18:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.024+0000 7fbe9f7fe640 1 --2- 172.21.15.78:0/2407307143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138bdd80 0x5618138cd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:18:50.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.025+0000 7fbe9effd640 1 --2- 172.21.15.78:0/2407307143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138b14d0 0x5618138c90e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbe90005e00 tx=0x7fbe90005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbc76b1b5382607 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.025+0000 7fbe867fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:18:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.025+0000 7fbe867fc640 1 -- 172.21.15.78:0/2407307143 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9001e040 con 0x5618138b14d0 2024-09-11T00:18:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.025+0000 7fbe867fc640 1 -- 172.21.15.78:0/2407307143 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fbe90026440 con 0x5618138b14d0 2024-09-11T00:18:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.025+0000 7fbea7998740 1 -- 172.21.15.78:0/2407307143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe880ac2a0 con 0x5618138b14d0 2024-09-11T00:18:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.025+0000 7fbe867fc640 1 -- 172.21.15.78:0/2407307143 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbe9003c050 con 0x5618138b14d0 2024-09-11T00:18:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.025+0000 7fbea7998740 10 client.15630 fetch_fsmap learned FSMap version 20 2024-09-11T00:18:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.025+0000 7fbea7998740 1 -- 172.21.15.78:0/2407307143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5618139434f0 con 0x5618138b14d0 2024-09-11T00:18:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.025+0000 7fbe867fc640 1 -- 172.21.15.78:0/2407307143 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe880ac2a0 con 0x5618138b14d0 2024-09-11T00:18:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.025+0000 7fbe867fc640 1 -- 172.21.15.78:0/2407307143 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fbe90024040 con 0x5618138b14d0 2024-09-11T00:18:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.025+0000 7fbea7998740 10 client.15630 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:18:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.025+0000 7fbea7998740 10 client.15630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:18:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.025+0000 7fbea7998740 20 client.15630 populate_metadata read hostname 'smithi078' 2024-09-11T00:18:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.025+0000 7fbea7998740 1 --2- 172.21.15.78:0/2407307143 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x561813943b30 0x561813945f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.025+0000 7fbea7998740 4 client.15630 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:18:50.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.025+0000 7fbea7998740 1 -- 172.21.15.78:0/2407307143 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5618138258a0 con 0x561813943b30 2024-09-11T00:18:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.026+0000 7fbe967fc640 1 --2- 172.21.15.78:0/2407307143 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x561813943b30 0x561813945f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.026+0000 7fbe867fc640 10 client.15630 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.026+0000 7fbe967fc640 1 --2- 172.21.15.78:0/2407307143 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x561813943b30 0x561813945f50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c5fa00de28c2f46 server_cookie=5f49b96645307378 in_seq=0 out_seq=0 2024-09-11T00:18:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.026+0000 7fbe867fc640 1 -- 172.21.15.78:0/2407307143 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5618138258a0 con 0x561813943b30 2024-09-11T00:18:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.026+0000 7fbe867fc640 10 client.15630 handle_command_reply: tid=0 2024-09-11T00:18:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.026+0000 7fbea7998740 1 client.15630 shutdown 2024-09-11T00:18:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.026+0000 7fbea7998740 1 -- 172.21.15.78:0/2407307143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138b14d0 msgr2=0x5618138c90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.026+0000 7fbea7998740 1 --2- 172.21.15.78:0/2407307143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138b14d0 0x5618138c90e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbe90005e00 tx=0x7fbe90005870 comp rx=0 tx=0).stop 2024-09-11T00:18:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.026+0000 7fbea7998740 1 -- 172.21.15.78:0/2407307143 shutdown_connections 2024-09-11T00:18:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.026+0000 7fbea7998740 1 --2- 172.21.15.78:0/2407307143 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x561813943b30 0x561813945f50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.026+0000 7fbea7998740 1 --2- 172.21.15.78:0/2407307143 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5618138bdd80 0x5618138cd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.026+0000 7fbea7998740 1 --2- 172.21.15.78:0/2407307143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5618138b1df0 0x5618138c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.026+0000 7fbe867fc640 0 client.15630 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.026+0000 7fbea7998740 1 --2- 172.21.15.78:0/2407307143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5618138b14d0 0x5618138c90e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.026+0000 7fbea7998740 1 -- 172.21.15.78:0/2407307143 >> 172.21.15.78:0/2407307143 conn(0x5618138af300 msgr2=0x5618138c0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:50.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.027+0000 7fbea7998740 1 -- 172.21.15.78:0/2407307143 shutdown_connections 2024-09-11T00:18:50.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.027+0000 7fbea7998740 1 -- 172.21.15.78:0/2407307143 wait complete. 2024-09-11T00:18:50.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.027+0000 7fbea7998740 20 client.15630 trim_cache size 0 max 16384 2024-09-11T00:18:50.040 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-11T00:18:50.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.027+0000 7fbea55c3640 1 -- 172.21.15.78:0/621796095 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbe8c0b5450 msgr2=0x7fbe8c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:50.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.027+0000 7fbea55c3640 1 --2- 172.21.15.78:0/621796095 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbe8c0b5450 0x7fbe8c0b7910 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009a60 tx=0x7fbe980098b0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.027+0000 7fbea55c3640 1 -- 172.21.15.78:0/621796095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbea01076a0 msgr2=0x7fbea0199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:50.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.027+0000 7fbea55c3640 1 --2- 172.21.15.78:0/621796095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbea01076a0 0x7fbea0199800 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800e9f0 tx=0x7fbe8800eeb0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.027+0000 7fbea55c3640 1 -- 172.21.15.78:0/621796095 shutdown_connections 2024-09-11T00:18:50.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.027+0000 7fbea55c3640 1 --2- 172.21.15.78:0/621796095 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbe8c0b5450 0x7fbe8c0b7910 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.027+0000 7fbea55c3640 1 --2- 172.21.15.78:0/621796095 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbea0108020 0x7fbea019eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.027+0000 7fbea55c3640 1 --2- 172.21.15.78:0/621796095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbea01076a0 0x7fbea0199800 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.027+0000 7fbea55c3640 1 --2- 172.21.15.78:0/621796095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbea0101c90 0x7fbea01992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:50.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.027+0000 7fbea55c3640 1 -- 172.21.15.78:0/621796095 >> 172.21.15.78:0/621796095 conn(0x7fbea00fd700 msgr2=0x7fbea006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:50.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.027+0000 7fbea55c3640 1 -- 172.21.15.78:0/621796095 shutdown_connections 2024-09-11T00:18:50.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:50.027+0000 7fbea55c3640 1 -- 172.21.15.78:0/621796095 wait complete. 2024-09-11T00:18:51.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:50 smithi138 ceph-mon[35019]: pgmap v394: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 416 op/s 2024-09-11T00:18:51.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:50 smithi078 ceph-mon[30865]: pgmap v394: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 416 op/s 2024-09-11T00:18:51.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:50 smithi112 ceph-mon[35627]: pgmap v394: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 416 op/s 2024-09-11T00:18:51.819 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:18:51.819 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:18:52.071 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:18:52.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.568+0000 7fa4fa30b640 1 -- 172.21.15.78:0/4150795495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4f41139b0 msgr2=0x7fa4f4115da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:52.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.568+0000 7fa4fa30b640 1 --2- 172.21.15.78:0/4150795495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4f41139b0 0x7fa4f4115da0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4009900 tx=0x7fa4e402a400 comp rx=0 tx=0).stop 2024-09-11T00:18:52.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.568+0000 7fa4fa30b640 1 -- 172.21.15.78:0/4150795495 shutdown_connections 2024-09-11T00:18:52.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.568+0000 7fa4fa30b640 1 --2- 172.21.15.78:0/4150795495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4f41139b0 0x7fa4f4115da0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.568+0000 7fa4fa30b640 1 --2- 172.21.15.78:0/4150795495 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4f4077ff0 0x7fa4f4113470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.568+0000 7fa4fa30b640 1 --2- 172.21.15.78:0/4150795495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4f40776d0 0x7fa4f4077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.568+0000 7fa4fa30b640 1 -- 172.21.15.78:0/4150795495 >> 172.21.15.78:0/4150795495 conn(0x7fa4f41009f0 msgr2=0x7fa4f4102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:52.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.568+0000 7fa4fa30b640 1 -- 172.21.15.78:0/4150795495 shutdown_connections 2024-09-11T00:18:52.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.568+0000 7fa4fa30b640 1 -- 172.21.15.78:0/4150795495 wait complete. 2024-09-11T00:18:52.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.569+0000 7fa4fa30b640 1 Processor -- start 2024-09-11T00:18:52.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.569+0000 7fa4fa30b640 1 -- start start 2024-09-11T00:18:52.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.570+0000 7fa4fa30b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4f40776d0 0x7fa4f419f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.570+0000 7fa4fa30b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4f4077ff0 0x7fa4f419fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.570+0000 7fa4fa30b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4f41139b0 0x7fa4f41a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.570+0000 7fa4fa30b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f4119380 con 0x7fa4f40776d0 2024-09-11T00:18:52.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.570+0000 7fa4fa30b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f4119200 con 0x7fa4f41139b0 2024-09-11T00:18:52.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.570+0000 7fa4fa30b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f4119500 con 0x7fa4f4077ff0 2024-09-11T00:18:52.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.570+0000 7fa4f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4f40776d0 0x7fa4f419f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.570+0000 7fa4f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4f40776d0 0x7fa4f419f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48948/0 (socket says 172.21.15.78:48948) 2024-09-11T00:18:52.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.570+0000 7fa4f3fff640 1 -- 172.21.15.78:0/2310542463 learned_addr learned my addr 172.21.15.78:0/2310542463 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:52.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.570+0000 7fa4f37fe640 1 --2- 172.21.15.78:0/2310542463 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4f4077ff0 0x7fa4f419fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.570+0000 7fa4f88a8640 1 --2- 172.21.15.78:0/2310542463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4f41139b0 0x7fa4f41a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.571+0000 7fa4f88a8640 1 -- 172.21.15.78:0/2310542463 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4f4077ff0 msgr2=0x7fa4f419fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:52.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.571+0000 7fa4f88a8640 1 --2- 172.21.15.78:0/2310542463 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4f4077ff0 0x7fa4f419fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.571+0000 7fa4f88a8640 1 -- 172.21.15.78:0/2310542463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4f40776d0 msgr2=0x7fa4f419f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:52.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.571+0000 7fa4f88a8640 1 --2- 172.21.15.78:0/2310542463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4f40776d0 0x7fa4f419f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.571+0000 7fa4f88a8640 1 -- 172.21.15.78:0/2310542463 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f41a5960 con 0x7fa4f41139b0 2024-09-11T00:18:52.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.572+0000 7fa4f88a8640 1 --2- 172.21.15.78:0/2310542463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4f41139b0 0x7fa4f41a5190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4009230 tx=0x7fa4e4003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:52.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.572+0000 7fa4f17fa640 1 -- 172.21.15.78:0/2310542463 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e403f070 con 0x7fa4f41139b0 2024-09-11T00:18:52.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.573+0000 7fa4f17fa640 1 -- 172.21.15.78:0/2310542463 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4e4031b50 con 0x7fa4f41139b0 2024-09-11T00:18:52.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.573+0000 7fa4f17fa640 1 -- 172.21.15.78:0/2310542463 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4035030 con 0x7fa4f41139b0 2024-09-11T00:18:52.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.573+0000 7fa4fa30b640 1 -- 172.21.15.78:0/2310542463 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f41a5bf0 con 0x7fa4f41139b0 2024-09-11T00:18:52.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.573+0000 7fa4fa30b640 1 -- 172.21.15.78:0/2310542463 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f41ac310 con 0x7fa4f41139b0 2024-09-11T00:18:52.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.576+0000 7fa4fc6e0740 1 Processor -- start 2024-09-11T00:18:52.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.576+0000 7fa4fc6e0740 1 -- start start 2024-09-11T00:18:52.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.576+0000 7fa4fc6e0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752b1ee0 0x561d752b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.576+0000 7fa4fc6e0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b2800 0x561d752be250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.577+0000 7fa4fc6e0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561d752be790 0x561d752c0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.577+0000 7fa4fc6e0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x561d75228e60 con 0x561d752b2800 2024-09-11T00:18:52.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.577+0000 7fa4fc6e0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x561d75218290 con 0x561d752b1ee0 2024-09-11T00:18:52.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.577+0000 7fa4fc6e0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x561d7521c0a0 con 0x561d752be790 2024-09-11T00:18:52.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.578+0000 7fa4f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b2800 0x561d752be250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.578+0000 7fa4f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b2800 0x561d752be250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48960/0 (socket says 172.21.15.78:48960) 2024-09-11T00:18:52.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.578+0000 7fa4f3fff640 1 -- 172.21.15.78:0/783875840 learned_addr learned my addr 172.21.15.78:0/783875840 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:52.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.579+0000 7fa4f37fe640 1 --2- 172.21.15.78:0/783875840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752b1ee0 0x561d752b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.579+0000 7fa4f3fff640 1 -- 172.21.15.78:0/783875840 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561d752be790 msgr2=0x561d752c0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:52.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.580+0000 7fa4f37fe640 1 --2- 172.21.15.78:0/783875840 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561d752be790 0x561d752c0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.580+0000 7fa4f3fff640 1 --2- 172.21.15.78:0/783875840 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561d752be790 0x561d752c0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.580+0000 7fa4f3fff640 1 -- 172.21.15.78:0/783875840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752b1ee0 msgr2=0x561d752b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:52.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.580+0000 7fa4f3fff640 1 --2- 172.21.15.78:0/783875840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752b1ee0 0x561d752b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.580+0000 7fa4f3fff640 1 -- 172.21.15.78:0/783875840 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d74f76930 con 0x561d752b2800 2024-09-11T00:18:52.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.580+0000 7fa4f3fff640 1 --2- 172.21.15.78:0/783875840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b2800 0x561d752be250 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0115f0 tx=0x7fa4ec011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7effa72a0872dc4d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:52.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.581+0000 7fa4f37fe640 1 --2- 172.21.15.78:0/783875840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752b1ee0 0x561d752b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:18:52.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.581+0000 7fa4f17fa640 1 -- 172.21.15.78:0/2310542463 <== mon.2 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fa4e403b460 con 0x7fa4f41139b0 2024-09-11T00:18:52.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.581+0000 7fa4da7fc640 1 -- 172.21.15.78:0/783875840 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec01e070 con 0x561d752b2800 2024-09-11T00:18:52.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.582+0000 7fa4da7fc640 1 -- 172.21.15.78:0/783875840 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4ec00fda0 con 0x561d752b2800 2024-09-11T00:18:52.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.582+0000 7fa4f17fa640 1 --2- 172.21.15.78:0/2310542463 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa4dc0b5500 0x7fa4dc0b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.582+0000 7fa4f17fa640 1 -- 172.21.15.78:0/2310542463 <== mon.2 v2:172.21.15.112:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fa4e41061c0 con 0x7fa4f41139b0 2024-09-11T00:18:52.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.582+0000 7fa4f37fe640 1 --2- 172.21.15.78:0/2310542463 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa4dc0b5500 0x7fa4dc0b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.582+0000 7fa4da7fc640 1 -- 172.21.15.78:0/783875840 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec00e3b0 con 0x561d752b2800 2024-09-11T00:18:52.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.582+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/783875840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b2800 msgr2=0x561d752be250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:52.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.582+0000 7fa4fc6e0740 1 --2- 172.21.15.78:0/783875840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b2800 0x561d752be250 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0115f0 tx=0x7fa4ec011ab0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.583+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/783875840 shutdown_connections 2024-09-11T00:18:52.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.583+0000 7fa4fc6e0740 1 --2- 172.21.15.78:0/783875840 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561d752be790 0x561d752c0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.583+0000 7fa4fc6e0740 1 --2- 172.21.15.78:0/783875840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b2800 0x561d752be250 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.583+0000 7fa4fc6e0740 1 --2- 172.21.15.78:0/783875840 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752b1ee0 0x561d752b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.583+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/783875840 >> 172.21.15.78:0/783875840 conn(0x561d752afd10 msgr2=0x561d752b0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:52.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.583+0000 7fa4f37fe640 1 --2- 172.21.15.78:0/2310542463 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa4dc0b5500 0x7fa4dc0b79c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x561d752b1e90 tx=0x7fa4e8005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:52.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.583+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/783875840 shutdown_connections 2024-09-11T00:18:52.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.583+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/783875840 wait complete. 2024-09-11T00:18:52.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.583+0000 7fa4fc6e0740 1 -- start start 2024-09-11T00:18:52.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.584+0000 7fa4fc6e0740 1 Processor -- start 2024-09-11T00:18:52.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.584+0000 7fa4fc6e0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b1ee0 0x561d752bb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.584+0000 7fa4fc6e0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752b2800 0x561d752bbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.584+0000 7fa4fc6e0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561d752be790 0x561d752bc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.584+0000 7fa4fc6e0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x561d75079890 con 0x561d752b1ee0 2024-09-11T00:18:52.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.584+0000 7fa4fc6e0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x561d751b2d40 con 0x561d752b2800 2024-09-11T00:18:52.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.584+0000 7fa4fc6e0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x561d752d24a0 con 0x561d752be790 2024-09-11T00:18:52.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.584+0000 7fa4fc6e0740 10 client.0 _ll_register_callbacks cb 0x561d75216c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:18:52.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.584+0000 7fa4f37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752b2800 0x561d752bbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.584+0000 7fa4f37fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752b2800 0x561d752bbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.78:58154/0 (socket says 172.21.15.78:58154) 2024-09-11T00:18:52.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.584+0000 7fa4f37fe640 1 -- 172.21.15.78:0/4055516419 learned_addr learned my addr 172.21.15.78:0/4055516419 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:52.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.584+0000 7fa4f3fff640 1 --2- 172.21.15.78:0/4055516419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b1ee0 0x561d752bb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.585+0000 7fa4f88a8640 1 --2- 172.21.15.78:0/4055516419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561d752be790 0x561d752bc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.585+0000 7fa4f37fe640 1 -- 172.21.15.78:0/4055516419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561d752be790 msgr2=0x561d752bc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:52.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.585+0000 7fa4f37fe640 1 --2- 172.21.15.78:0/4055516419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561d752be790 0x561d752bc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.585+0000 7fa4f37fe640 1 -- 172.21.15.78:0/4055516419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b1ee0 msgr2=0x561d752bb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:52.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.585+0000 7fa4f37fe640 1 --2- 172.21.15.78:0/4055516419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b1ee0 0x561d752bb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.585+0000 7fa4f37fe640 1 -- 172.21.15.78:0/4055516419 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d752db8e0 con 0x561d752b2800 2024-09-11T00:18:52.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.585+0000 7fa4f37fe640 1 --2- 172.21.15.78:0/4055516419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752b2800 0x561d752bbc20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8010c60 tx=0x7fa4e80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=536565b6fe5d680a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:52.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.585+0000 7fa4d37fe640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-11T00:18:52.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.585+0000 7fa4d37fe640 1 -- 172.21.15.78:0/4055516419 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8010ea0 con 0x561d752b2800 2024-09-11T00:18:52.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.585+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/4055516419 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4ec00fda0 con 0x561d752b2800 2024-09-11T00:18:52.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.585+0000 7fa4d37fe640 1 -- 172.21.15.78:0/4055516419 <== mon.2 v2:172.21.15.112:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fa4e801c460 con 0x561d752b2800 2024-09-11T00:18:52.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.586+0000 7fa4d37fe640 1 -- 172.21.15.78:0/4055516419 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa4e801c660 con 0x561d752b2800 2024-09-11T00:18:52.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.586+0000 7fa4fc6e0740 10 client.25169 fetch_fsmap learned FSMap version 20 2024-09-11T00:18:52.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.586+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/4055516419 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x561d752de2e0 con 0x561d752b2800 2024-09-11T00:18:52.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.586+0000 7fa4d37fe640 1 -- 172.21.15.78:0/4055516419 <== mon.2 v2:172.21.15.112:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4ec00fda0 con 0x561d752b2800 2024-09-11T00:18:52.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.586+0000 7fa4d37fe640 1 -- 172.21.15.78:0/4055516419 <== mon.2 v2:172.21.15.112:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa4e802d020 con 0x561d752b2800 2024-09-11T00:18:52.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.586+0000 7fa4fc6e0740 10 client.25169 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:18:52.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.586+0000 7fa4fc6e0740 10 client.25169 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:18:52.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.586+0000 7fa4fc6e0740 20 client.25169 populate_metadata read hostname 'smithi078' 2024-09-11T00:18:52.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.586+0000 7fa4fc6e0740 1 --2- 172.21.15.78:0/4055516419 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x561d752dfb70 0x561d752e2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.586+0000 7fa4fc6e0740 4 client.25169 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:18:52.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.586+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/4055516419 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d7522adb0 con 0x561d752dfb70 2024-09-11T00:18:52.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.586+0000 7fa4f3fff640 1 --2- 172.21.15.78:0/4055516419 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x561d752dfb70 0x561d752e2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.587+0000 7fa4f3fff640 1 --2- 172.21.15.78:0/4055516419 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x561d752dfb70 0x561d752e2030 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e007740292a43a3 server_cookie=8be87e5869e0376 in_seq=0 out_seq=0 2024-09-11T00:18:52.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.587+0000 7fa4d37fe640 10 client.25169 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:52.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.589+0000 7fa4d37fe640 1 -- 172.21.15.78:0/4055516419 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561d7522adb0 con 0x561d752dfb70 2024-09-11T00:18:52.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.589+0000 7fa4d37fe640 10 client.25169 handle_command_reply: tid=0 2024-09-11T00:18:52.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.589+0000 7fa4fc6e0740 1 client.25169 shutdown 2024-09-11T00:18:52.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.589+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/4055516419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752b2800 msgr2=0x561d752bbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:52.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.589+0000 7fa4fc6e0740 1 --2- 172.21.15.78:0/4055516419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752b2800 0x561d752bbc20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8010c60 tx=0x7fa4e80046c0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.589+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/4055516419 shutdown_connections 2024-09-11T00:18:52.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.589+0000 7fa4fc6e0740 1 --2- 172.21.15.78:0/4055516419 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x561d752dfb70 0x561d752e2030 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.589+0000 7fa4fc6e0740 1 --2- 172.21.15.78:0/4055516419 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561d752be790 0x561d752bc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.589+0000 7fa4d37fe640 0 client.25169 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:52.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.589+0000 7fa4fc6e0740 1 --2- 172.21.15.78:0/4055516419 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752b2800 0x561d752bbc20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.589+0000 7fa4fc6e0740 1 --2- 172.21.15.78:0/4055516419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b1ee0 0x561d752bb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.589+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/4055516419 >> 172.21.15.78:0/4055516419 conn(0x561d752afd10 msgr2=0x561d752aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:52.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.589+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/4055516419 shutdown_connections 2024-09-11T00:18:52.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.589+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/4055516419 wait complete. 2024-09-11T00:18:52.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.589+0000 7fa4fc6e0740 20 client.25169 trim_cache size 0 max 16384 2024-09-11T00:18:52.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.607+0000 7fa4fc6e0740 1 Processor -- start 2024-09-11T00:18:52.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.607+0000 7fa4fc6e0740 1 -- start start 2024-09-11T00:18:52.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.607+0000 7fa4fc6e0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b1ee0 0x561d752b9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.607+0000 7fa4fc6e0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561d752b2800 0x561d752b1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.607+0000 7fa4fc6e0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752be790 0x561d752e7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.607+0000 7fa4fc6e0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e000c780 con 0x561d752b1ee0 2024-09-11T00:18:52.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.607+0000 7fa4fc6e0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e000f000 con 0x561d752be790 2024-09-11T00:18:52.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.607+0000 7fa4fc6e0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e000cdf0 con 0x561d752b2800 2024-09-11T00:18:52.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.607+0000 7fa4f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b1ee0 0x561d752b9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.607+0000 7fa4f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b1ee0 0x561d752b9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48988/0 (socket says 172.21.15.78:48988) 2024-09-11T00:18:52.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.607+0000 7fa4f3fff640 1 -- 172.21.15.78:0/27822699 learned_addr learned my addr 172.21.15.78:0/27822699 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:52.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.607+0000 7fa4f88a8640 1 --2- 172.21.15.78:0/27822699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752be790 0x561d752e7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.607+0000 7fa4f37fe640 1 --2- 172.21.15.78:0/27822699 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561d752b2800 0x561d752b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.607+0000 7fa4f3fff640 1 -- 172.21.15.78:0/27822699 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561d752b2800 msgr2=0x561d752b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:52.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.607+0000 7fa4f3fff640 1 --2- 172.21.15.78:0/27822699 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561d752b2800 0x561d752b1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.607+0000 7fa4f3fff640 1 -- 172.21.15.78:0/27822699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752be790 msgr2=0x561d752e7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:52.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.607+0000 7fa4f3fff640 1 --2- 172.21.15.78:0/27822699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752be790 0x561d752e7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.607+0000 7fa4f3fff640 1 -- 172.21.15.78:0/27822699 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d752d2560 con 0x561d752b1ee0 2024-09-11T00:18:52.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.607+0000 7fa4f3fff640 1 --2- 172.21.15.78:0/27822699 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b1ee0 0x561d752b9170 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x561d752b5060 tx=0x7fa4ec019a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b2ced78d8acc0d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:52.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.608+0000 7fa4d9ffb640 1 -- 172.21.15.78:0/27822699 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec01e040 con 0x561d752b1ee0 2024-09-11T00:18:52.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.608+0000 7fa4d9ffb640 1 -- 172.21.15.78:0/27822699 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4ec019630 con 0x561d752b1ee0 2024-09-11T00:18:52.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.608+0000 7fa4d9ffb640 1 -- 172.21.15.78:0/27822699 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec00f920 con 0x561d752b1ee0 2024-09-11T00:18:52.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.608+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/27822699 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b1ee0 msgr2=0x561d752b9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:52.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.608+0000 7fa4fc6e0740 1 --2- 172.21.15.78:0/27822699 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b1ee0 0x561d752b9170 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x561d752b5060 tx=0x7fa4ec019a30 comp rx=0 tx=0).stop 2024-09-11T00:18:52.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.608+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/27822699 shutdown_connections 2024-09-11T00:18:52.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.608+0000 7fa4fc6e0740 1 --2- 172.21.15.78:0/27822699 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752be790 0x561d752e7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.608+0000 7fa4fc6e0740 1 --2- 172.21.15.78:0/27822699 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561d752b2800 0x561d752b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.608+0000 7fa4fc6e0740 1 --2- 172.21.15.78:0/27822699 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b1ee0 0x561d752b9170 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.608+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/27822699 >> 172.21.15.78:0/27822699 conn(0x561d752afd10 msgr2=0x561d752b0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:52.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.608+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/27822699 shutdown_connections 2024-09-11T00:18:52.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.608+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/27822699 wait complete. 2024-09-11T00:18:52.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.609+0000 7fa4fc6e0740 1 -- start start 2024-09-11T00:18:52.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.609+0000 7fa4fc6e0740 1 Processor -- start 2024-09-11T00:18:52.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.609+0000 7fa4fc6e0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752b1ee0 0x561d752d7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.609+0000 7fa4fc6e0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b2800 0x561d752d7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.609+0000 7fa4fc6e0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561d752be790 0x561d752d27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.609+0000 7fa4fc6e0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e000d4c0 con 0x561d752b2800 2024-09-11T00:18:52.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.609+0000 7fa4fc6e0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e000e930 con 0x561d752b1ee0 2024-09-11T00:18:52.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.609+0000 7fa4fc6e0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e000db90 con 0x561d752be790 2024-09-11T00:18:52.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.609+0000 7fa4fc6e0740 10 client.0 _ll_register_callbacks cb 0x7fa4e80099b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:18:52.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.609+0000 7fa4f37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b2800 0x561d752d7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.609+0000 7fa4f3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752b1ee0 0x561d752d7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.609+0000 7fa4f3fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752b1ee0 0x561d752d7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.78:58174/0 (socket says 172.21.15.78:58174) 2024-09-11T00:18:52.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.609+0000 7fa4f3fff640 1 -- 172.21.15.78:0/1854901715 learned_addr learned my addr 172.21.15.78:0/1854901715 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:52.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.610+0000 7fa4f88a8640 1 --2- 172.21.15.78:0/1854901715 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561d752be790 0x561d752d27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.610+0000 7fa4f3fff640 1 -- 172.21.15.78:0/1854901715 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561d752be790 msgr2=0x561d752d27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:52.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.610+0000 7fa4f3fff640 1 --2- 172.21.15.78:0/1854901715 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561d752be790 0x561d752d27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.610+0000 7fa4f3fff640 1 -- 172.21.15.78:0/1854901715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b2800 msgr2=0x561d752d7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:52.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.610+0000 7fa4f3fff640 1 --2- 172.21.15.78:0/1854901715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b2800 0x561d752d7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.610+0000 7fa4f3fff640 1 -- 172.21.15.78:0/1854901715 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d752d2dc0 con 0x561d752b1ee0 2024-09-11T00:18:52.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.610+0000 7fa4f3fff640 1 --2- 172.21.15.78:0/1854901715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752b1ee0 0x561d752d7a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec011af0 tx=0x7fa4ec0099b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=633c3f6783ddf874 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:52.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.610+0000 7fa4d37fe640 10 client.0 ms_handle_connect on v2:172.21.15.112:3300/0 2024-09-11T00:18:52.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.610+0000 7fa4d37fe640 1 -- 172.21.15.78:0/1854901715 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec033070 con 0x561d752b1ee0 2024-09-11T00:18:52.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.610+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/1854901715 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4ec019630 con 0x561d752b1ee0 2024-09-11T00:18:52.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.610+0000 7fa4d37fe640 1 -- 172.21.15.78:0/1854901715 <== mon.2 v2:172.21.15.112:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fa4ec003970 con 0x561d752b1ee0 2024-09-11T00:18:52.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.610+0000 7fa4d37fe640 1 -- 172.21.15.78:0/1854901715 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa4ec03f050 con 0x561d752b1ee0 2024-09-11T00:18:52.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.610+0000 7fa4fc6e0740 10 client.25175 fetch_fsmap learned FSMap version 20 2024-09-11T00:18:52.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.610+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/1854901715 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x561d7534d460 con 0x561d752b1ee0 2024-09-11T00:18:52.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.611+0000 7fa4d37fe640 1 -- 172.21.15.78:0/1854901715 <== mon.2 v2:172.21.15.112:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4ec019630 con 0x561d752b1ee0 2024-09-11T00:18:52.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.611+0000 7fa4d37fe640 1 -- 172.21.15.78:0/1854901715 <== mon.2 v2:172.21.15.112:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa4ec02c020 con 0x561d752b1ee0 2024-09-11T00:18:52.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.611+0000 7fa4fc6e0740 10 client.25175 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:18:52.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.611+0000 7fa4fc6e0740 10 client.25175 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:18:52.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.611+0000 7fa4fc6e0740 20 client.25175 populate_metadata read hostname 'smithi078' 2024-09-11T00:18:52.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.611+0000 7fa4fc6e0740 1 --2- 172.21.15.78:0/1854901715 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x561d7534d950 0x561d7534fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:52.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.611+0000 7fa4fc6e0740 4 client.25175 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:18:52.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.611+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/1854901715 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561d75226860 con 0x561d7534d950 2024-09-11T00:18:52.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.611+0000 7fa4f37fe640 1 --2- 172.21.15.78:0/1854901715 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x561d7534d950 0x561d7534fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:52.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.611+0000 7fa4d37fe640 10 client.25175 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:52.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.611+0000 7fa4f37fe640 1 --2- 172.21.15.78:0/1854901715 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x561d7534d950 0x561d7534fd70 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b06fa80f23490381 server_cookie=98d52c12c32edece in_seq=0 out_seq=0 2024-09-11T00:18:52.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.613+0000 7fa4d37fe640 1 -- 172.21.15.78:0/1854901715 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561d75226860 con 0x561d7534d950 2024-09-11T00:18:52.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.613+0000 7fa4d37fe640 10 client.25175 handle_command_reply: tid=0 2024-09-11T00:18:52.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.613+0000 7fa4fc6e0740 1 client.25175 shutdown 2024-09-11T00:18:52.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.613+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/1854901715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752b1ee0 msgr2=0x561d752d7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:52.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.613+0000 7fa4fc6e0740 1 --2- 172.21.15.78:0/1854901715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752b1ee0 0x561d752d7a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec011af0 tx=0x7fa4ec0099b0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.613+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/1854901715 shutdown_connections 2024-09-11T00:18:52.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.613+0000 7fa4fc6e0740 1 --2- 172.21.15.78:0/1854901715 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x561d7534d950 0x561d7534fd70 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.613+0000 7fa4fc6e0740 1 --2- 172.21.15.78:0/1854901715 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561d752be790 0x561d752d27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.613+0000 7fa4fc6e0740 1 --2- 172.21.15.78:0/1854901715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561d752b2800 0x561d752d7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.613+0000 7fa4fc6e0740 1 --2- 172.21.15.78:0/1854901715 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x561d752b1ee0 0x561d752d7a00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.613+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/1854901715 >> 172.21.15.78:0/1854901715 conn(0x561d752afd10 msgr2=0x561d752b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:52.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.613+0000 7fa4d37fe640 0 client.25175 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:52.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.613+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/1854901715 shutdown_connections 2024-09-11T00:18:52.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.613+0000 7fa4fc6e0740 1 -- 172.21.15.78:0/1854901715 wait complete. 2024-09-11T00:18:52.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.613+0000 7fa4fc6e0740 20 client.25175 trim_cache size 0 max 16384 2024-09-11T00:18:52.620 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:18:52.620 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-11T00:18:52.620 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458", 2024-09-11T00:18:52.621 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-11T00:18:52.621 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:18:52.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.614+0000 7fa4fa30b640 1 -- 172.21.15.78:0/2310542463 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa4dc0b5500 msgr2=0x7fa4dc0b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:52.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.614+0000 7fa4fa30b640 1 --2- 172.21.15.78:0/2310542463 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa4dc0b5500 0x7fa4dc0b79c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x561d752b1e90 tx=0x7fa4e8005f90 comp rx=0 tx=0).stop 2024-09-11T00:18:52.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.614+0000 7fa4fa30b640 1 -- 172.21.15.78:0/2310542463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4f41139b0 msgr2=0x7fa4f41a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:52.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.614+0000 7fa4fa30b640 1 --2- 172.21.15.78:0/2310542463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4f41139b0 0x7fa4f41a5190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4009230 tx=0x7fa4e4003b90 comp rx=0 tx=0).stop 2024-09-11T00:18:52.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.614+0000 7fa4fa30b640 1 -- 172.21.15.78:0/2310542463 shutdown_connections 2024-09-11T00:18:52.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.614+0000 7fa4fa30b640 1 --2- 172.21.15.78:0/2310542463 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa4dc0b5500 0x7fa4dc0b79c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.614+0000 7fa4fa30b640 1 --2- 172.21.15.78:0/2310542463 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa4f41139b0 0x7fa4f41a5190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.614+0000 7fa4fa30b640 1 --2- 172.21.15.78:0/2310542463 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4f4077ff0 0x7fa4f419fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.614+0000 7fa4fa30b640 1 --2- 172.21.15.78:0/2310542463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4f40776d0 0x7fa4f419f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:52.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.614+0000 7fa4fa30b640 1 -- 172.21.15.78:0/2310542463 >> 172.21.15.78:0/2310542463 conn(0x7fa4f41009f0 msgr2=0x7fa4f4102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:52.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.614+0000 7fa4fa30b640 1 -- 172.21.15.78:0/2310542463 shutdown_connections 2024-09-11T00:18:52.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:52.614+0000 7fa4fa30b640 1 -- 172.21.15.78:0/2310542463 wait complete. 2024-09-11T00:18:53.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:52 smithi138 ceph-mon[35019]: pgmap v395: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 369 op/s 2024-09-11T00:18:53.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:52 smithi078 ceph-mon[30865]: pgmap v395: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 369 op/s 2024-09-11T00:18:53.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:52 smithi112 ceph-mon[35627]: pgmap v395: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 369 op/s 2024-09-11T00:18:53.384 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:18:53.665 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:18:54.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:53 smithi078 ceph-mon[30865]: scrub queued for path: / 2024-09-11T00:18:54.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:53 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:18:54.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:53 smithi078 ceph-mon[30865]: scrub summary: active paths [/] 2024-09-11T00:18:54.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.187+0000 7f5123449640 1 -- 172.21.15.78:0/3052061774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f511c109150 msgr2=0x7f511c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:54.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.187+0000 7f5123449640 1 --2- 172.21.15.78:0/3052061774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f511c109150 0x7f511c10f950 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5114009ca0 tx=0x7f511402ecd0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.187+0000 7f5123449640 1 -- 172.21.15.78:0/3052061774 shutdown_connections 2024-09-11T00:18:54.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.187+0000 7f5123449640 1 --2- 172.21.15.78:0/3052061774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f511c109150 0x7f511c10f950 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.187+0000 7f5123449640 1 --2- 172.21.15.78:0/3052061774 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f511c1087d0 0x7f511c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.187+0000 7f5123449640 1 --2- 172.21.15.78:0/3052061774 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f511c102dc0 0x7f511c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.187+0000 7f5123449640 1 -- 172.21.15.78:0/3052061774 >> 172.21.15.78:0/3052061774 conn(0x7f511c0fe870 msgr2=0x7f511c100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:54.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.187+0000 7f5123449640 1 -- 172.21.15.78:0/3052061774 shutdown_connections 2024-09-11T00:18:54.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.187+0000 7f5123449640 1 -- 172.21.15.78:0/3052061774 wait complete. 2024-09-11T00:18:54.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.188+0000 7f5123449640 1 Processor -- start 2024-09-11T00:18:54.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.188+0000 7f5123449640 1 -- start start 2024-09-11T00:18:54.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.188+0000 7f5123449640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f511c102dc0 0x7f511c197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:54.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.188+0000 7f5123449640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f511c1087d0 0x7f511c197660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:54.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.188+0000 7f5123449640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f511c109150 0x7f511c19ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:54.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.188+0000 7f5123449640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f511c110bf0 con 0x7f511c1087d0 2024-09-11T00:18:54.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.188+0000 7f5123449640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f511c110a70 con 0x7f511c109150 2024-09-11T00:18:54.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.188+0000 7f5123449640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f511c110d70 con 0x7f511c102dc0 2024-09-11T00:18:54.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.188+0000 7f51209e4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f511c1087d0 0x7f511c197660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:54.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.188+0000 7f51209e4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f511c1087d0 0x7f511c197660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49020/0 (socket says 172.21.15.78:49020) 2024-09-11T00:18:54.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.188+0000 7f51209e4640 1 -- 172.21.15.78:0/3417084664 learned_addr learned my addr 172.21.15.78:0/3417084664 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:54.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.188+0000 7f51211e5640 1 --2- 172.21.15.78:0/3417084664 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f511c102dc0 0x7f511c197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:54.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.188+0000 7f51219e6640 1 --2- 172.21.15.78:0/3417084664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f511c109150 0x7f511c19ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:54.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.188+0000 7f51209e4640 1 -- 172.21.15.78:0/3417084664 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f511c102dc0 msgr2=0x7f511c197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:54.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.188+0000 7f51209e4640 1 --2- 172.21.15.78:0/3417084664 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f511c102dc0 0x7f511c197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.188+0000 7f51209e4640 1 -- 172.21.15.78:0/3417084664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f511c109150 msgr2=0x7f511c19ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:54.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.188+0000 7f51209e4640 1 --2- 172.21.15.78:0/3417084664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f511c109150 0x7f511c19ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.188+0000 7f51209e4640 1 -- 172.21.15.78:0/3417084664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511c19d1d0 con 0x7f511c1087d0 2024-09-11T00:18:54.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.189+0000 7f51209e4640 1 --2- 172.21.15.78:0/3417084664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f511c1087d0 0x7f511c197660 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f510c00e9f0 tx=0x7f510c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:54.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.189+0000 7f51127fc640 1 -- 172.21.15.78:0/3417084664 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510c00cd80 con 0x7f511c1087d0 2024-09-11T00:18:54.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.189+0000 7f51127fc640 1 -- 172.21.15.78:0/3417084664 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f510c0108e0 con 0x7f511c1087d0 2024-09-11T00:18:54.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.189+0000 7f5123449640 1 -- 172.21.15.78:0/3417084664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f511c19d4c0 con 0x7f511c1087d0 2024-09-11T00:18:54.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.189+0000 7f51127fc640 1 -- 172.21.15.78:0/3417084664 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510c018980 con 0x7f511c1087d0 2024-09-11T00:18:54.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.189+0000 7f5123449640 1 -- 172.21.15.78:0/3417084664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f511c1a3b80 con 0x7f511c1087d0 2024-09-11T00:18:54.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.192+0000 7f512581e740 1 Processor -- start 2024-09-11T00:18:54.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.192+0000 7f512581e740 1 -- start start 2024-09-11T00:18:54.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.192+0000 7f51127fc640 1 -- 172.21.15.78:0/3417084664 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f510c010430 con 0x7f511c1087d0 2024-09-11T00:18:54.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.193+0000 7f512581e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1cd480 0x5634bc1cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:54.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.193+0000 7f512581e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1cdda0 0x5634bc1d97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:54.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.193+0000 7f512581e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1d9d30 0x5634bc1dc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:54.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.193+0000 7f512581e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5634bc143e50 con 0x5634bc1cd480 2024-09-11T00:18:54.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.193+0000 7f512581e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5634bc133280 con 0x5634bc1cdda0 2024-09-11T00:18:54.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.193+0000 7f512581e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5634bc137090 con 0x5634bc1d9d30 2024-09-11T00:18:54.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.193+0000 7f51219e6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1cd480 0x5634bc1cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:54.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.193+0000 7f51211e5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1cdda0 0x5634bc1d97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:54.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.193+0000 7f51219e6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1cd480 0x5634bc1cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49036/0 (socket says 172.21.15.78:49036) 2024-09-11T00:18:54.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.193+0000 7f51219e6640 1 -- 172.21.15.78:0/1032861830 learned_addr learned my addr 172.21.15.78:0/1032861830 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:54.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.193+0000 7f51209e4640 1 --2- 172.21.15.78:0/1032861830 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1d9d30 0x5634bc1dc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:54.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.193+0000 7f51211e5640 1 -- 172.21.15.78:0/1032861830 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1d9d30 msgr2=0x5634bc1dc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:54.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.193+0000 7f51211e5640 1 --2- 172.21.15.78:0/1032861830 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1d9d30 0x5634bc1dc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.193+0000 7f51211e5640 1 -- 172.21.15.78:0/1032861830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1cd480 msgr2=0x5634bc1cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:54.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.193+0000 7f51211e5640 1 --2- 172.21.15.78:0/1032861830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1cd480 0x5634bc1cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.193+0000 7f51211e5640 1 -- 172.21.15.78:0/1032861830 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634bbe91650 con 0x5634bc1cdda0 2024-09-11T00:18:54.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.193+0000 7f51127fc640 1 --2- 172.21.15.78:0/3417084664 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f51080b5450 0x7f51080b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:54.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.193+0000 7f51211e5640 1 --2- 172.21.15.78:0/1032861830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1cdda0 0x5634bc1d97f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5118009c20 tx=0x7f5118011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e563d212e35dee47 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:54.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.193+0000 7f51219e6640 1 --2- 172.21.15.78:0/3417084664 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f51080b5450 0x7f51080b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:54.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.193+0000 7f51077fe640 1 -- 172.21.15.78:0/1032861830 <== mon.2 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5118004050 con 0x5634bc1cdda0 2024-09-11T00:18:54.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.193+0000 7f51127fc640 1 -- 172.21.15.78:0/3417084664 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f510c0e6240 con 0x7f511c1087d0 2024-09-11T00:18:54.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.194+0000 7f51077fe640 1 -- 172.21.15.78:0/1032861830 <== mon.2 v2:172.21.15.112:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51180054d0 con 0x5634bc1cdda0 2024-09-11T00:18:54.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.194+0000 7f51077fe640 1 -- 172.21.15.78:0/1032861830 <== mon.2 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5118004ca0 con 0x5634bc1cdda0 2024-09-11T00:18:54.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.194+0000 7f512581e740 1 -- 172.21.15.78:0/1032861830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1cdda0 msgr2=0x5634bc1d97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:54.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.194+0000 7f51219e6640 1 --2- 172.21.15.78:0/3417084664 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f51080b5450 0x7f51080b7910 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f511403a040 tx=0x7f5114031040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:54.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.194+0000 7f512581e740 1 --2- 172.21.15.78:0/1032861830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1cdda0 0x5634bc1d97f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5118009c20 tx=0x7f5118011810 comp rx=0 tx=0).stop 2024-09-11T00:18:54.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.194+0000 7f512581e740 1 -- 172.21.15.78:0/1032861830 shutdown_connections 2024-09-11T00:18:54.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.194+0000 7f512581e740 1 --2- 172.21.15.78:0/1032861830 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1d9d30 0x5634bc1dc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.194+0000 7f512581e740 1 --2- 172.21.15.78:0/1032861830 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1cdda0 0x5634bc1d97f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.194+0000 7f512581e740 1 --2- 172.21.15.78:0/1032861830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1cd480 0x5634bc1cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.194+0000 7f512581e740 1 -- 172.21.15.78:0/1032861830 >> 172.21.15.78:0/1032861830 conn(0x5634bc1cb2b0 msgr2=0x5634bc1cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:54.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.194+0000 7f512581e740 1 -- 172.21.15.78:0/1032861830 shutdown_connections 2024-09-11T00:18:54.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.194+0000 7f512581e740 1 -- 172.21.15.78:0/1032861830 wait complete. 2024-09-11T00:18:54.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.195+0000 7f512581e740 1 -- start start 2024-09-11T00:18:54.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.195+0000 7f512581e740 1 Processor -- start 2024-09-11T00:18:54.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.195+0000 7f512581e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1cd480 0x5634bc1d9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:54.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.195+0000 7f512581e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1cdda0 0x5634bc1d6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:54.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.195+0000 7f512581e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1d9d30 0x5634bc1d7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:54.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.195+0000 7f512581e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5634bbf94700 con 0x5634bc1d9d30 2024-09-11T00:18:54.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.195+0000 7f512581e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5634bc0ce110 con 0x5634bc1cd480 2024-09-11T00:18:54.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.195+0000 7f512581e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5634bc1dc9b0 con 0x5634bc1cdda0 2024-09-11T00:18:54.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.195+0000 7f512581e740 10 client.0 _ll_register_callbacks cb 0x5634bc0e7990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:18:54.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.195+0000 7f51219e6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1d9d30 0x5634bc1d7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:54.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.196+0000 7f51209e4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1cdda0 0x5634bc1d6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:54.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.196+0000 7f51219e6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1d9d30 0x5634bc1d7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49048/0 (socket says 172.21.15.78:49048) 2024-09-11T00:18:54.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.196+0000 7f51219e6640 1 -- 172.21.15.78:0/561839988 learned_addr learned my addr 172.21.15.78:0/561839988 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:54.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.196+0000 7f51211e5640 1 --2- 172.21.15.78:0/561839988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1cd480 0x5634bc1d9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:54.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.196+0000 7f51219e6640 1 -- 172.21.15.78:0/561839988 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1cdda0 msgr2=0x5634bc1d6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:54.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.196+0000 7f51219e6640 1 --2- 172.21.15.78:0/561839988 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1cdda0 0x5634bc1d6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.196+0000 7f51219e6640 1 -- 172.21.15.78:0/561839988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1cd480 msgr2=0x5634bc1d9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:54.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.196+0000 7f51219e6640 1 --2- 172.21.15.78:0/561839988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1cd480 0x5634bc1d9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.196+0000 7f51219e6640 1 -- 172.21.15.78:0/561839988 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634bc0fbc40 con 0x5634bc1d9d30 2024-09-11T00:18:54.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.196+0000 7f51209e4640 1 --2- 172.21.15.78:0/561839988 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1cdda0 0x5634bc1d6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:18:54.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.196+0000 7f51219e6640 1 --2- 172.21.15.78:0/561839988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1d9d30 0x5634bc1d7030 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5114003da0 tx=0x7f511402ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95af676786a03f80 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:54.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.196+0000 7f5104ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:18:54.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.196+0000 7f5104ff9640 1 -- 172.21.15.78:0/561839988 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5114053070 con 0x5634bc1d9d30 2024-09-11T00:18:54.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.196+0000 7f5104ff9640 1 -- 172.21.15.78:0/561839988 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f511402f820 con 0x5634bc1d9d30 2024-09-11T00:18:54.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.196+0000 7f512581e740 1 -- 172.21.15.78:0/561839988 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51180054d0 con 0x5634bc1d9d30 2024-09-11T00:18:54.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.196+0000 7f5104ff9640 1 -- 172.21.15.78:0/561839988 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f511403c040 con 0x5634bc1d9d30 2024-09-11T00:18:54.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.196+0000 7f512581e740 10 client.15660 fetch_fsmap learned FSMap version 20 2024-09-11T00:18:54.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.196+0000 7f512581e740 1 -- 172.21.15.78:0/561839988 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5634bc1e82c0 con 0x5634bc1d9d30 2024-09-11T00:18:54.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.197+0000 7f5104ff9640 1 -- 172.21.15.78:0/561839988 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51180054d0 con 0x5634bc1d9d30 2024-09-11T00:18:54.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.197+0000 7f5104ff9640 1 -- 172.21.15.78:0/561839988 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f511405e020 con 0x5634bc1d9d30 2024-09-11T00:18:54.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.197+0000 7f512581e740 10 client.15660 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:18:54.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.197+0000 7f512581e740 10 client.15660 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:18:54.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.197+0000 7f512581e740 20 client.15660 populate_metadata read hostname 'smithi078' 2024-09-11T00:18:54.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.197+0000 7f512581e740 1 --2- 172.21.15.78:0/561839988 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5634bc1e9720 0x5634bc1ebb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:54.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.197+0000 7f512581e740 4 client.15660 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:18:54.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.197+0000 7f512581e740 1 -- 172.21.15.78:0/561839988 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634bc145da0 con 0x5634bc1e9720 2024-09-11T00:18:54.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.197+0000 7f51211e5640 1 --2- 172.21.15.78:0/561839988 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5634bc1e9720 0x5634bc1ebb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:54.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.197+0000 7f5104ff9640 10 client.15660 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:54.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.197+0000 7f51211e5640 1 --2- 172.21.15.78:0/561839988 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5634bc1e9720 0x5634bc1ebb90 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5aeb170694faa2a server_cookie=2de22d49808e661c in_seq=0 out_seq=0 2024-09-11T00:18:54.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.199+0000 7f5104ff9640 1 -- 172.21.15.78:0/561839988 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5634bc145da0 con 0x5634bc1e9720 2024-09-11T00:18:54.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.199+0000 7f5104ff9640 10 client.15660 handle_command_reply: tid=0 2024-09-11T00:18:54.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.199+0000 7f512581e740 1 client.15660 shutdown 2024-09-11T00:18:54.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.199+0000 7f512581e740 1 -- 172.21.15.78:0/561839988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1d9d30 msgr2=0x5634bc1d7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:54.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.199+0000 7f512581e740 1 --2- 172.21.15.78:0/561839988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1d9d30 0x5634bc1d7030 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5114003da0 tx=0x7f511402ecd0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.199+0000 7f512581e740 1 -- 172.21.15.78:0/561839988 shutdown_connections 2024-09-11T00:18:54.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.199+0000 7f512581e740 1 --2- 172.21.15.78:0/561839988 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5634bc1e9720 0x5634bc1ebb90 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.199+0000 7f512581e740 1 --2- 172.21.15.78:0/561839988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1d9d30 0x5634bc1d7030 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.199+0000 7f512581e740 1 --2- 172.21.15.78:0/561839988 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1cdda0 0x5634bc1d6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.199+0000 7f512581e740 1 --2- 172.21.15.78:0/561839988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1cd480 0x5634bc1d9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.199+0000 7f5104ff9640 0 client.15660 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:54.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.199+0000 7f512581e740 1 -- 172.21.15.78:0/561839988 >> 172.21.15.78:0/561839988 conn(0x5634bc1cb2b0 msgr2=0x5634bc1d0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:54.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.199+0000 7f512581e740 1 -- 172.21.15.78:0/561839988 shutdown_connections 2024-09-11T00:18:54.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.199+0000 7f512581e740 1 -- 172.21.15.78:0/561839988 wait complete. 2024-09-11T00:18:54.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.199+0000 7f512581e740 20 client.15660 trim_cache size 0 max 16384 2024-09-11T00:18:54.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.217+0000 7f512581e740 1 Processor -- start 2024-09-11T00:18:54.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.217+0000 7f512581e740 1 -- start start 2024-09-11T00:18:54.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.217+0000 7f512581e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1cd480 0x5634bc1cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:54.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.217+0000 7f512581e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1cdda0 0x5634bc1db120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:54.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.217+0000 7f512581e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1d9d30 0x5634bc1db660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:54.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.217+0000 7f512581e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f511c1aa580 con 0x5634bc1cdda0 2024-09-11T00:18:54.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.217+0000 7f512581e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f511c1ace00 con 0x5634bc1d9d30 2024-09-11T00:18:54.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.217+0000 7f512581e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f511c1aabf0 con 0x5634bc1cd480 2024-09-11T00:18:54.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.217+0000 7f51209e4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1cdda0 0x5634bc1db120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:54.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.217+0000 7f51209e4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1cdda0 0x5634bc1db120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49060/0 (socket says 172.21.15.78:49060) 2024-09-11T00:18:54.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.217+0000 7f51209e4640 1 -- 172.21.15.78:0/3909953056 learned_addr learned my addr 172.21.15.78:0/3909953056 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:54.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.217+0000 7f51219e6640 1 --2- 172.21.15.78:0/3909953056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1d9d30 0x5634bc1db660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:54.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.217+0000 7f51211e5640 1 --2- 172.21.15.78:0/3909953056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1cd480 0x5634bc1cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:54.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.218+0000 7f51209e4640 1 -- 172.21.15.78:0/3909953056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1cd480 msgr2=0x5634bc1cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:54.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.218+0000 7f51209e4640 1 --2- 172.21.15.78:0/3909953056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1cd480 0x5634bc1cabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.218+0000 7f51209e4640 1 -- 172.21.15.78:0/3909953056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1d9d30 msgr2=0x5634bc1db660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:54.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.218+0000 7f51209e4640 1 --2- 172.21.15.78:0/3909953056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1d9d30 0x5634bc1db660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.218+0000 7f51209e4640 1 -- 172.21.15.78:0/3909953056 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634bc1c6b60 con 0x5634bc1cdda0 2024-09-11T00:18:54.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.218+0000 7f51209e4640 1 --2- 172.21.15.78:0/3909953056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1cdda0 0x5634bc1db120 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f510c00c6a0 tx=0x7f510c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a618fddacd3a3e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:54.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.218+0000 7f5106ffd640 1 -- 172.21.15.78:0/3909953056 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510c0abf00 con 0x5634bc1cdda0 2024-09-11T00:18:54.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.218+0000 7f5106ffd640 1 -- 172.21.15.78:0/3909953056 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f510c0e6070 con 0x5634bc1cdda0 2024-09-11T00:18:54.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.218+0000 7f5106ffd640 1 -- 172.21.15.78:0/3909953056 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510c0b5a40 con 0x5634bc1cdda0 2024-09-11T00:18:54.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.219+0000 7f512581e740 1 -- 172.21.15.78:0/3909953056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1cdda0 msgr2=0x5634bc1db120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:54.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.219+0000 7f512581e740 1 --2- 172.21.15.78:0/3909953056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1cdda0 0x5634bc1db120 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f510c00c6a0 tx=0x7f510c00cf20 comp rx=0 tx=0).stop 2024-09-11T00:18:54.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.219+0000 7f512581e740 1 -- 172.21.15.78:0/3909953056 shutdown_connections 2024-09-11T00:18:54.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.219+0000 7f512581e740 1 --2- 172.21.15.78:0/3909953056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1d9d30 0x5634bc1db660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.219+0000 7f512581e740 1 --2- 172.21.15.78:0/3909953056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1cdda0 0x5634bc1db120 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.219+0000 7f512581e740 1 --2- 172.21.15.78:0/3909953056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1cd480 0x5634bc1cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.219+0000 7f512581e740 1 -- 172.21.15.78:0/3909953056 >> 172.21.15.78:0/3909953056 conn(0x5634bc1cb2b0 msgr2=0x5634bc1d88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:54.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.219+0000 7f512581e740 1 -- 172.21.15.78:0/3909953056 shutdown_connections 2024-09-11T00:18:54.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.219+0000 7f512581e740 1 -- 172.21.15.78:0/3909953056 wait complete. 2024-09-11T00:18:54.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.219+0000 7f512581e740 1 -- start start 2024-09-11T00:18:54.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.219+0000 7f512581e740 1 Processor -- start 2024-09-11T00:18:54.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f512581e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1cd480 0x5634bc1e1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:54.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f512581e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1cdda0 0x5634bc1e2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:54.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f512581e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1d9d30 0x5634bc1dcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:54.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f512581e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f511c1ab2c0 con 0x5634bc1cdda0 2024-09-11T00:18:54.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f512581e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f511c1ac730 con 0x5634bc1d9d30 2024-09-11T00:18:54.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f512581e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f511c1ab990 con 0x5634bc1cd480 2024-09-11T00:18:54.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f512581e740 10 client.0 _ll_register_callbacks cb 0x7f5114047050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:18:54.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f51209e4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1cdda0 0x5634bc1e2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:54.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f51219e6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1d9d30 0x5634bc1dcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:54.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f51211e5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1cd480 0x5634bc1e1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:54.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f51219e6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1d9d30 0x5634bc1dcd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.78:58228/0 (socket says 172.21.15.78:58228) 2024-09-11T00:18:54.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f51209e4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1cdda0 0x5634bc1e2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49064/0 (socket says 172.21.15.78:49064) 2024-09-11T00:18:54.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f51219e6640 1 -- 172.21.15.78:0/718711784 learned_addr learned my addr 172.21.15.78:0/718711784 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:18:54.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f51211e5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1cd480 0x5634bc1e1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.78:52358/0 (socket says 172.21.15.78:52358) 2024-09-11T00:18:54.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f51211e5640 1 -- 172.21.15.78:0/718711784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1d9d30 msgr2=0x5634bc1dcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:54.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f51211e5640 1 --2- 172.21.15.78:0/718711784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1d9d30 0x5634bc1dcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f51211e5640 1 -- 172.21.15.78:0/718711784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1cdda0 msgr2=0x5634bc1e2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:18:54.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f51211e5640 1 --2- 172.21.15.78:0/718711784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1cdda0 0x5634bc1e2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f51211e5640 1 -- 172.21.15.78:0/718711784 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634bc1dd540 con 0x5634bc1cd480 2024-09-11T00:18:54.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f51209e4640 1 --2- 172.21.15.78:0/718711784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1cdda0 0x5634bc1e2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:18:54.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f51219e6640 1 --2- 172.21.15.78:0/718711784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1d9d30 0x5634bc1dcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:18:54.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f51211e5640 1 --2- 172.21.15.78:0/718711784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1cd480 0x5634bc1e1fe0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5118009350 tx=0x7f5118009900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8408a801187b6644 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:18:54.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.220+0000 7f5104ff9640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-11T00:18:54.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.221+0000 7f5104ff9640 1 -- 172.21.15.78:0/718711784 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5118032030 con 0x5634bc1cd480 2024-09-11T00:18:54.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.221+0000 7f512581e740 1 -- 172.21.15.78:0/718711784 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f510c0e6070 con 0x5634bc1cd480 2024-09-11T00:18:54.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.221+0000 7f5104ff9640 1 -- 172.21.15.78:0/718711784 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f5118004310 con 0x5634bc1cd480 2024-09-11T00:18:54.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.221+0000 7f5104ff9640 1 -- 172.21.15.78:0/718711784 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f511803c050 con 0x5634bc1cd480 2024-09-11T00:18:54.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.221+0000 7f512581e740 10 client.25189 fetch_fsmap learned FSMap version 20 2024-09-11T00:18:54.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.221+0000 7f512581e740 1 -- 172.21.15.78:0/718711784 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5634bc2572b0 con 0x5634bc1cd480 2024-09-11T00:18:54.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.221+0000 7f5104ff9640 1 -- 172.21.15.78:0/718711784 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f510c0e6070 con 0x5634bc1cd480 2024-09-11T00:18:54.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.221+0000 7f5104ff9640 1 -- 172.21.15.78:0/718711784 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5118004a40 con 0x5634bc1cd480 2024-09-11T00:18:54.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.221+0000 7f512581e740 10 client.25189 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:18:54.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.221+0000 7f512581e740 10 client.25189 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:18:54.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.221+0000 7f512581e740 20 client.25189 populate_metadata read hostname 'smithi078' 2024-09-11T00:18:54.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.221+0000 7f512581e740 1 --2- 172.21.15.78:0/718711784 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5634bc257890 0x5634bc259c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:18:54.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.221+0000 7f512581e740 4 client.25189 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:18:54.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.221+0000 7f512581e740 1 -- 172.21.15.78:0/718711784 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5634bc141850 con 0x5634bc257890 2024-09-11T00:18:54.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.221+0000 7f51209e4640 1 --2- 172.21.15.78:0/718711784 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5634bc257890 0x5634bc259c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:18:54.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.222+0000 7f51209e4640 1 --2- 172.21.15.78:0/718711784 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5634bc257890 0x5634bc259c80 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=274830df4be0e90d server_cookie=88efbbbdc2609548 in_seq=0 out_seq=0 2024-09-11T00:18:54.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.222+0000 7f5104ff9640 10 client.25189 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:54.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.223+0000 7f5104ff9640 1 -- 172.21.15.78:0/718711784 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x5634bc141850 con 0x5634bc257890 2024-09-11T00:18:54.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.223+0000 7f5104ff9640 10 client.25189 handle_command_reply: tid=0 2024-09-11T00:18:54.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.223+0000 7f512581e740 1 client.25189 shutdown 2024-09-11T00:18:54.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.223+0000 7f512581e740 1 -- 172.21.15.78:0/718711784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1cd480 msgr2=0x5634bc1e1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:54.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.223+0000 7f512581e740 1 --2- 172.21.15.78:0/718711784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1cd480 0x5634bc1e1fe0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5118009350 tx=0x7f5118009900 comp rx=0 tx=0).stop 2024-09-11T00:18:54.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.223+0000 7f512581e740 1 -- 172.21.15.78:0/718711784 shutdown_connections 2024-09-11T00:18:54.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.223+0000 7f512581e740 1 --2- 172.21.15.78:0/718711784 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5634bc257890 0x5634bc259c80 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.223+0000 7f512581e740 1 --2- 172.21.15.78:0/718711784 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5634bc1d9d30 0x5634bc1dcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.223+0000 7f512581e740 1 --2- 172.21.15.78:0/718711784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5634bc1cdda0 0x5634bc1e2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.223+0000 7f5104ff9640 0 client.25189 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:18:54.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.223+0000 7f512581e740 1 --2- 172.21.15.78:0/718711784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5634bc1cd480 0x5634bc1e1fe0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.223+0000 7f512581e740 1 -- 172.21.15.78:0/718711784 >> 172.21.15.78:0/718711784 conn(0x5634bc1cb2b0 msgr2=0x5634bc1d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:54.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.223+0000 7f512581e740 1 -- 172.21.15.78:0/718711784 shutdown_connections 2024-09-11T00:18:54.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.223+0000 7f512581e740 1 -- 172.21.15.78:0/718711784 wait complete. 2024-09-11T00:18:54.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.223+0000 7f512581e740 20 client.25189 trim_cache size 0 max 16384 2024-09-11T00:18:54.230 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:18:54.230 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:18:54.230 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-11T00:18:54.230 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:18:54.230 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:18:54.230 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458", 2024-09-11T00:18:54.230 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-11T00:18:54.231 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:18:54.231 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:18:54.231 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:18:54.231 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:18:54.231 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:18:54.231 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:18:54.231 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:18:54.231 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:18:54.231 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:18:54.231 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:18:54.231 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:18:54.231 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:18:54.231 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:18:54.231 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:18:54.232 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:18:54.232 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:18:54.232 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:18:54.232 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:18:54.232 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:18:54.232 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:18:54.232 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:18:54.232 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:18:54.232 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:18:54.232 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:18:54.232 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:18:54.232 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:18:54.232 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:18:54.233 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:18:54.233 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:18:54.233 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:18:54.233 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:18:54.233 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:18:54.233 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:18:54.233 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:18:54.233 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:18:54.233 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:18:54.233 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:18:54.233 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:18:54.233 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:18:54.233 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:18:54.233 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:18:54.234 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:18:54.234 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:18:54.234 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:18:54.234 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:18:54.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.224+0000 7f5123449640 1 -- 172.21.15.78:0/3417084664 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f51080b5450 msgr2=0x7f51080b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:54.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.224+0000 7f5123449640 1 --2- 172.21.15.78:0/3417084664 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f51080b5450 0x7f51080b7910 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f511403a040 tx=0x7f5114031040 comp rx=0 tx=0).stop 2024-09-11T00:18:54.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.224+0000 7f5123449640 1 -- 172.21.15.78:0/3417084664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f511c1087d0 msgr2=0x7f511c197660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:18:54.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.224+0000 7f5123449640 1 --2- 172.21.15.78:0/3417084664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f511c1087d0 0x7f511c197660 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f510c00e9f0 tx=0x7f510c00eeb0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.224+0000 7f5123449640 1 -- 172.21.15.78:0/3417084664 shutdown_connections 2024-09-11T00:18:54.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.224+0000 7f5123449640 1 --2- 172.21.15.78:0/3417084664 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f51080b5450 0x7f51080b7910 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.224+0000 7f5123449640 1 --2- 172.21.15.78:0/3417084664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f511c109150 0x7f511c19ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.224+0000 7f5123449640 1 --2- 172.21.15.78:0/3417084664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f511c1087d0 0x7f511c197660 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.224+0000 7f5123449640 1 --2- 172.21.15.78:0/3417084664 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f511c102dc0 0x7f511c197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:18:54.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.224+0000 7f5123449640 1 -- 172.21.15.78:0/3417084664 >> 172.21.15.78:0/3417084664 conn(0x7f511c0fe870 msgr2=0x7f511c0ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:18:54.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.224+0000 7f5123449640 1 -- 172.21.15.78:0/3417084664 shutdown_connections 2024-09-11T00:18:54.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:18:54.224+0000 7f5123449640 1 -- 172.21.15.78:0/3417084664 wait complete. 2024-09-11T00:18:54.235 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:53 smithi112 ceph-mon[35627]: scrub queued for path: / 2024-09-11T00:18:54.235 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:53 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:18:54.236 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:53 smithi112 ceph-mon[35627]: scrub summary: active paths [/] 2024-09-11T00:18:54.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:53 smithi138 ceph-mon[35019]: scrub queued for path: / 2024-09-11T00:18:54.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:53 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:18:54.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:53 smithi138 ceph-mon[35019]: scrub summary: active paths [/] 2024-09-11T00:18:54.969 INFO:tasks.cephfs.filesystem:scrub status for tag:f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458 - {'path': '/', 'tag': 'f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458', 'options': 'recursive,force'} 2024-09-11T00:18:55.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:54 smithi078 ceph-mon[30865]: pgmap v396: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 343 op/s 2024-09-11T00:18:55.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:54 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:18:55.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:54 smithi112 ceph-mon[35627]: pgmap v396: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 343 op/s 2024-09-11T00:18:55.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:54 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:18:55.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:54 smithi138 ceph-mon[35019]: pgmap v396: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 343 op/s 2024-09-11T00:18:55.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:54 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:18:57.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:56 smithi078 ceph-mon[30865]: pgmap v397: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 350 op/s 2024-09-11T00:18:57.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:56 smithi078 ceph-mon[30865]: scrub summary: idle 2024-09-11T00:18:57.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:56 smithi112 ceph-mon[35627]: pgmap v397: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 350 op/s 2024-09-11T00:18:57.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:56 smithi112 ceph-mon[35627]: scrub summary: idle 2024-09-11T00:18:57.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:56 smithi138 ceph-mon[35019]: pgmap v397: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.0 MiB/s wr, 350 op/s 2024-09-11T00:18:57.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:56 smithi138 ceph-mon[35019]: scrub summary: idle 2024-09-11T00:18:57.585 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-11T00:18:57.586 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-11T00:18:57.883 DEBUG:teuthology.parallel:result is None 2024-09-11T00:18:57.883 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T00:18:57.914 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T00:18:57.914 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-11T00:18:57.926 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-11T00:18:57.927 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T00:18:57.927 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi078.front.sepia.ceph.com 2024-09-11T00:18:57.927 DEBUG:teuthology.orchestra.run.smithi078:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-11T00:18:57.984 DEBUG:teuthology.orchestra.run.smithi078:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-11T00:18:59.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:58 smithi078 ceph-mon[30865]: pgmap v398: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 351 op/s 2024-09-11T00:18:59.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:58 smithi112 ceph-mon[35627]: pgmap v398: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 351 op/s 2024-09-11T00:18:59.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:58 smithi138 ceph-mon[35019]: pgmap v398: 97 pgs: 97 active+clean; 1.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 351 op/s 2024-09-11T00:19:00.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:18:59 smithi112 ceph-mon[35627]: pgmap v399: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 358 op/s 2024-09-11T00:19:00.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:18:59 smithi138 ceph-mon[35019]: pgmap v399: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 358 op/s 2024-09-11T00:19:00.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:18:59 smithi078 ceph-mon[30865]: pgmap v399: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 358 op/s 2024-09-11T00:19:03.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:02 smithi138 ceph-mon[35019]: pgmap v400: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 316 op/s 2024-09-11T00:19:03.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:02 smithi078 ceph-mon[30865]: pgmap v400: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 316 op/s 2024-09-11T00:19:03.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:02 smithi112 ceph-mon[35627]: pgmap v400: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 316 op/s 2024-09-11T00:19:05.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:04 smithi138 ceph-mon[35019]: pgmap v401: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 260 op/s 2024-09-11T00:19:05.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:04 smithi078 ceph-mon[30865]: pgmap v401: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 260 op/s 2024-09-11T00:19:05.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:04 smithi112 ceph-mon[35627]: pgmap v401: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 260 op/s 2024-09-11T00:19:07.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:06 smithi078 ceph-mon[30865]: pgmap v402: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 228 op/s 2024-09-11T00:19:07.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:06 smithi112 ceph-mon[35627]: pgmap v402: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 228 op/s 2024-09-11T00:19:07.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:06 smithi138 ceph-mon[35019]: pgmap v402: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 228 op/s 2024-09-11T00:19:09.074 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:08 smithi078 ceph-mon[30865]: pgmap v403: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 178 op/s 2024-09-11T00:19:09.095 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:08 smithi138 ceph-mon[35019]: pgmap v403: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 178 op/s 2024-09-11T00:19:09.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:08 smithi112 ceph-mon[35627]: pgmap v403: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 178 op/s 2024-09-11T00:19:11.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:10 smithi078 ceph-mon[30865]: pgmap v404: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 298 KiB/s wr, 106 op/s 2024-09-11T00:19:11.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:10 smithi112 ceph-mon[35627]: pgmap v404: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 298 KiB/s wr, 106 op/s 2024-09-11T00:19:11.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:10 smithi138 ceph-mon[35019]: pgmap v404: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 298 KiB/s wr, 106 op/s 2024-09-11T00:19:13.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:12 smithi078 ceph-mon[30865]: pgmap v405: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 305 KiB/s wr, 61 op/s 2024-09-11T00:19:13.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:12 smithi112 ceph-mon[35627]: pgmap v405: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 305 KiB/s wr, 61 op/s 2024-09-11T00:19:13.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:12 smithi138 ceph-mon[35019]: pgmap v405: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 305 KiB/s wr, 61 op/s 2024-09-11T00:19:14.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:13 smithi078 ceph-mon[30865]: pgmap v406: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 32 KiB/s wr, 19 op/s 2024-09-11T00:19:14.133 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:13 smithi112 ceph-mon[35627]: pgmap v406: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 32 KiB/s wr, 19 op/s 2024-09-11T00:19:14.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:13 smithi138 ceph-mon[35019]: pgmap v406: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 32 KiB/s wr, 19 op/s 2024-09-11T00:19:17.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:16 smithi078 ceph-mon[30865]: pgmap v407: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 32 KiB/s wr, 16 op/s 2024-09-11T00:19:17.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:16 smithi112 ceph-mon[35627]: pgmap v407: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 32 KiB/s wr, 16 op/s 2024-09-11T00:19:17.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:16 smithi138 ceph-mon[35019]: pgmap v407: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 32 KiB/s wr, 16 op/s 2024-09-11T00:19:19.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:18 smithi078 ceph-mon[30865]: pgmap v408: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-11T00:19:19.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:18 smithi112 ceph-mon[35627]: pgmap v408: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-11T00:19:19.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:18 smithi138 ceph-mon[35019]: pgmap v408: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-09-11T00:19:21.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:20 smithi078 ceph-mon[30865]: pgmap v409: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 3 op/s 2024-09-11T00:19:21.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:20 smithi112 ceph-mon[35627]: pgmap v409: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 3 op/s 2024-09-11T00:19:21.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:20 smithi138 ceph-mon[35019]: pgmap v409: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 3 op/s 2024-09-11T00:19:23.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:22 smithi078 ceph-mon[30865]: pgmap v410: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 4 op/s 2024-09-11T00:19:23.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:22 smithi112 ceph-mon[35627]: pgmap v410: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 4 op/s 2024-09-11T00:19:23.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:22 smithi138 ceph-mon[35019]: pgmap v410: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 4 op/s 2024-09-11T00:19:24.971 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:19:25.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:24 smithi078 ceph-mon[30865]: pgmap v411: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-11T00:19:25.231 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:19:25.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:24 smithi112 ceph-mon[35627]: pgmap v411: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-11T00:19:25.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:24 smithi138 ceph-mon[35019]: pgmap v411: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-11T00:19:25.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.722+0000 7f2fdc425640 1 -- 172.21.15.78:0/2404822011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fd4109160 msgr2=0x7f2fd410f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:25.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.722+0000 7f2fdc425640 1 --2- 172.21.15.78:0/2404822011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fd4109160 0x7f2fd410f960 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc009ca0 tx=0x7f2fcc02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.722+0000 7f2fdc425640 1 -- 172.21.15.78:0/2404822011 shutdown_connections 2024-09-11T00:19:25.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.722+0000 7f2fdc425640 1 --2- 172.21.15.78:0/2404822011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fd4109160 0x7f2fd410f960 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.722+0000 7f2fdc425640 1 --2- 172.21.15.78:0/2404822011 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fd41087e0 0x7f2fd4108c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.722+0000 7f2fdc425640 1 --2- 172.21.15.78:0/2404822011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd4102dd0 0x7f2fd41031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.722+0000 7f2fdc425640 1 -- 172.21.15.78:0/2404822011 >> 172.21.15.78:0/2404822011 conn(0x7f2fd40fe860 msgr2=0x7f2fd4100c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:25.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.722+0000 7f2fdc425640 1 -- 172.21.15.78:0/2404822011 shutdown_connections 2024-09-11T00:19:25.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.722+0000 7f2fdc425640 1 -- 172.21.15.78:0/2404822011 wait complete. 2024-09-11T00:19:25.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.723+0000 7f2fdc425640 1 Processor -- start 2024-09-11T00:19:25.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.723+0000 7f2fdc425640 1 -- start start 2024-09-11T00:19:25.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.723+0000 7f2fdc425640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fd4102dd0 0x7f2fd4199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.723+0000 7f2fdc425640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd41087e0 0x7f2fd4199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.723+0000 7f2fdc425640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fd4109160 0x7f2fd419ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.723+0000 7f2fdc425640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd4112e20 con 0x7f2fd4102dd0 2024-09-11T00:19:25.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.723+0000 7f2fdc425640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd4112ca0 con 0x7f2fd41087e0 2024-09-11T00:19:25.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.723+0000 7f2fdc425640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd4112fa0 con 0x7f2fd4109160 2024-09-11T00:19:25.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.723+0000 7f2fda1c1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fd4102dd0 0x7f2fd4199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.723+0000 7f2fda1c1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fd4102dd0 0x7f2fd4199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55540/0 (socket says 172.21.15.78:55540) 2024-09-11T00:19:25.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.723+0000 7f2fda1c1640 1 -- 172.21.15.78:0/2430316264 learned_addr learned my addr 172.21.15.78:0/2430316264 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:19:25.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.723+0000 7f2fda9c2640 1 --2- 172.21.15.78:0/2430316264 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fd4109160 0x7f2fd419ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.723+0000 7f2fd99c0640 1 --2- 172.21.15.78:0/2430316264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd41087e0 0x7f2fd4199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.723+0000 7f2fda1c1640 1 -- 172.21.15.78:0/2430316264 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fd4109160 msgr2=0x7f2fd419ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:25.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.723+0000 7f2fda1c1640 1 --2- 172.21.15.78:0/2430316264 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fd4109160 0x7f2fd419ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.723+0000 7f2fda1c1640 1 -- 172.21.15.78:0/2430316264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd41087e0 msgr2=0x7f2fd4199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:25.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.723+0000 7f2fda1c1640 1 --2- 172.21.15.78:0/2430316264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd41087e0 0x7f2fd4199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.723+0000 7f2fda1c1640 1 -- 172.21.15.78:0/2430316264 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd419f400 con 0x7f2fd4102dd0 2024-09-11T00:19:25.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.723+0000 7f2fda9c2640 1 --2- 172.21.15.78:0/2430316264 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fd4109160 0x7f2fd419ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:19:25.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.723+0000 7f2fd99c0640 1 --2- 172.21.15.78:0/2430316264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd41087e0 0x7f2fd4199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:19:25.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.724+0000 7f2fda1c1640 1 --2- 172.21.15.78:0/2430316264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fd4102dd0 0x7f2fd4199350 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2fc800c890 tx=0x7f2fc800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:25.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.724+0000 7f2fc77fe640 1 -- 172.21.15.78:0/2430316264 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc8004220 con 0x7f2fd4102dd0 2024-09-11T00:19:25.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.724+0000 7f2fdc425640 1 -- 172.21.15.78:0/2430316264 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fd419f6f0 con 0x7f2fd4102dd0 2024-09-11T00:19:25.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.724+0000 7f2fc77fe640 1 -- 172.21.15.78:0/2430316264 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fc80043c0 con 0x7f2fd4102dd0 2024-09-11T00:19:25.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.724+0000 7f2fc77fe640 1 -- 172.21.15.78:0/2430316264 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc8004a00 con 0x7f2fd4102dd0 2024-09-11T00:19:25.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.724+0000 7f2fdc425640 1 -- 172.21.15.78:0/2430316264 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fd41a5f80 con 0x7f2fd4102dd0 2024-09-11T00:19:25.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.726+0000 7f2fde7fa740 1 Processor -- start 2024-09-11T00:19:25.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.727+0000 7f2fde7fa740 1 -- start start 2024-09-11T00:19:25.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.727+0000 7f2fc77fe640 1 -- 172.21.15.78:0/2430316264 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f2fc80079b0 con 0x7f2fd4102dd0 2024-09-11T00:19:25.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.727+0000 7f2fde7fa740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56013e46b480 0x56013e46b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.727+0000 7f2fde7fa740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e46bda0 0x56013e47bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.727+0000 7f2fde7fa740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56013e47c140 0x56013e47e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.727+0000 7f2fde7fa740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56013e3e1e50 con 0x56013e46bda0 2024-09-11T00:19:25.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.727+0000 7f2fde7fa740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56013e3d1280 con 0x56013e47c140 2024-09-11T00:19:25.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.727+0000 7f2fde7fa740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56013e3d5090 con 0x56013e46b480 2024-09-11T00:19:25.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.727+0000 7f2fda1c1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e46bda0 0x56013e47bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.727+0000 7f2fda1c1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e46bda0 0x56013e47bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55548/0 (socket says 172.21.15.78:55548) 2024-09-11T00:19:25.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.727+0000 7f2fda1c1640 1 -- 172.21.15.78:0/2187702235 learned_addr learned my addr 172.21.15.78:0/2187702235 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:19:25.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.727+0000 7f2fda9c2640 1 --2- 172.21.15.78:0/2187702235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56013e46b480 0x56013e46b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.727+0000 7f2fd99c0640 1 --2- 172.21.15.78:0/2187702235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56013e47c140 0x56013e47e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.727+0000 7f2fda1c1640 1 -- 172.21.15.78:0/2187702235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56013e46b480 msgr2=0x56013e46b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:25.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.727+0000 7f2fda1c1640 1 --2- 172.21.15.78:0/2187702235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56013e46b480 0x56013e46b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.727+0000 7f2fda1c1640 1 -- 172.21.15.78:0/2187702235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56013e47c140 msgr2=0x56013e47e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:25.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.727+0000 7f2fda1c1640 1 --2- 172.21.15.78:0/2187702235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56013e47c140 0x56013e47e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.728+0000 7f2fda1c1640 1 -- 172.21.15.78:0/2187702235 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56013e12f650 con 0x56013e46bda0 2024-09-11T00:19:25.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.728+0000 7f2fd99c0640 1 --2- 172.21.15.78:0/2187702235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56013e47c140 0x56013e47e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:19:25.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.728+0000 7f2fda9c2640 1 --2- 172.21.15.78:0/2187702235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56013e46b480 0x56013e46b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:19:25.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.728+0000 7f2fda1c1640 1 --2- 172.21.15.78:0/2187702235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e46bda0 0x56013e47bc00 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80e34f0 tx=0x7f2fc80ee5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c95ee54dc59849 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:25.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.728+0000 7f2fc4de6640 1 -- 172.21.15.78:0/2187702235 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc80f9070 con 0x56013e46bda0 2024-09-11T00:19:25.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.728+0000 7f2fc77fe640 1 --2- 172.21.15.78:0/2430316264 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2fc00b5450 0x7f2fc00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.728+0000 7f2fc4de6640 1 -- 172.21.15.78:0/2187702235 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fc80f4ab0 con 0x56013e46bda0 2024-09-11T00:19:25.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.728+0000 7f2fc4de6640 1 -- 172.21.15.78:0/2187702235 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc80a8900 con 0x56013e46bda0 2024-09-11T00:19:25.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.728+0000 7f2fda9c2640 1 --2- 172.21.15.78:0/2430316264 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2fc00b5450 0x7f2fc00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.728+0000 7f2fc77fe640 1 -- 172.21.15.78:0/2430316264 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f2fc80e5e10 con 0x7f2fd4102dd0 2024-09-11T00:19:25.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.729+0000 7f2fda9c2640 1 --2- 172.21.15.78:0/2430316264 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2fc00b5450 0x7f2fc00b7910 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc009a60 tx=0x7f2fcc0093f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:25.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.729+0000 7f2fde7fa740 1 -- 172.21.15.78:0/2187702235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e46bda0 msgr2=0x56013e47bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:25.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.729+0000 7f2fde7fa740 1 --2- 172.21.15.78:0/2187702235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e46bda0 0x56013e47bc00 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80e34f0 tx=0x7f2fc80ee5f0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.729+0000 7f2fde7fa740 1 -- 172.21.15.78:0/2187702235 shutdown_connections 2024-09-11T00:19:25.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.729+0000 7f2fde7fa740 1 --2- 172.21.15.78:0/2187702235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56013e47c140 0x56013e47e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.729+0000 7f2fde7fa740 1 --2- 172.21.15.78:0/2187702235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e46bda0 0x56013e47bc00 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.729+0000 7f2fde7fa740 1 --2- 172.21.15.78:0/2187702235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56013e46b480 0x56013e46b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.729+0000 7f2fde7fa740 1 -- 172.21.15.78:0/2187702235 >> 172.21.15.78:0/2187702235 conn(0x56013e4692b0 msgr2=0x56013e46a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:25.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.729+0000 7f2fde7fa740 1 -- 172.21.15.78:0/2187702235 shutdown_connections 2024-09-11T00:19:25.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.729+0000 7f2fde7fa740 1 -- 172.21.15.78:0/2187702235 wait complete. 2024-09-11T00:19:25.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.730+0000 7f2fde7fa740 1 -- start start 2024-09-11T00:19:25.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.730+0000 7f2fde7fa740 1 Processor -- start 2024-09-11T00:19:25.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.730+0000 7f2fde7fa740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56013e46b480 0x56013e4790a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.730+0000 7f2fde7fa740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56013e47c140 0x56013e4795e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.730+0000 7f2fde7fa740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e479b20 0x56013e488150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.730+0000 7f2fde7fa740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56013e232700 con 0x56013e479b20 2024-09-11T00:19:25.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.730+0000 7f2fde7fa740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56013e36c110 con 0x56013e46b480 2024-09-11T00:19:25.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.730+0000 7f2fde7fa740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56013e47edf0 con 0x56013e47c140 2024-09-11T00:19:25.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.730+0000 7f2fde7fa740 10 client.0 _ll_register_callbacks cb 0x56013e385990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:19:25.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.730+0000 7f2fda9c2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e479b20 0x56013e488150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.730+0000 7f2fda9c2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e479b20 0x56013e488150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55560/0 (socket says 172.21.15.78:55560) 2024-09-11T00:19:25.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.730+0000 7f2fda9c2640 1 -- 172.21.15.78:0/2859330012 learned_addr learned my addr 172.21.15.78:0/2859330012 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:19:25.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.730+0000 7f2fd99c0640 1 --2- 172.21.15.78:0/2859330012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56013e47c140 0x56013e4795e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.730+0000 7f2fda1c1640 1 --2- 172.21.15.78:0/2859330012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56013e46b480 0x56013e4790a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.731+0000 7f2fda9c2640 1 -- 172.21.15.78:0/2859330012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56013e47c140 msgr2=0x56013e4795e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:25.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.731+0000 7f2fda9c2640 1 --2- 172.21.15.78:0/2859330012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56013e47c140 0x56013e4795e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.731+0000 7f2fda9c2640 1 -- 172.21.15.78:0/2859330012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56013e46b480 msgr2=0x56013e4790a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:25.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.731+0000 7f2fda9c2640 1 --2- 172.21.15.78:0/2859330012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56013e46b480 0x56013e4790a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.731+0000 7f2fda9c2640 1 -- 172.21.15.78:0/2859330012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56013e399c40 con 0x56013e479b20 2024-09-11T00:19:25.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.731+0000 7f2fda9c2640 1 --2- 172.21.15.78:0/2859330012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e479b20 0x56013e488150 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc0317a0 tx=0x7f2fcc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30e945c1825b1a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:25.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.731+0000 7f2fbdffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:19:25.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.731+0000 7f2fbdffb640 1 -- 172.21.15.78:0/2859330012 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc04e070 con 0x56013e479b20 2024-09-11T00:19:25.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.731+0000 7f2fbdffb640 1 -- 172.21.15.78:0/2859330012 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f2fcc0047c0 con 0x56013e479b20 2024-09-11T00:19:25.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.731+0000 7f2fde7fa740 1 -- 172.21.15.78:0/2859330012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fc80f4ab0 con 0x56013e479b20 2024-09-11T00:19:25.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.731+0000 7f2fbdffb640 1 -- 172.21.15.78:0/2859330012 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2fcc02f660 con 0x56013e479b20 2024-09-11T00:19:25.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.731+0000 7f2fde7fa740 10 client.15678 fetch_fsmap learned FSMap version 20 2024-09-11T00:19:25.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.731+0000 7f2fde7fa740 1 -- 172.21.15.78:0/2859330012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56013e48ad50 con 0x56013e479b20 2024-09-11T00:19:25.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.731+0000 7f2fbdffb640 1 -- 172.21.15.78:0/2859330012 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fc80f4ab0 con 0x56013e479b20 2024-09-11T00:19:25.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.732+0000 7f2fbdffb640 1 -- 172.21.15.78:0/2859330012 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2fcc043040 con 0x56013e479b20 2024-09-11T00:19:25.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.732+0000 7f2fde7fa740 10 client.15678 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:19:25.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.732+0000 7f2fde7fa740 10 client.15678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:19:25.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.732+0000 7f2fde7fa740 20 client.15678 populate_metadata read hostname 'smithi078' 2024-09-11T00:19:25.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.732+0000 7f2fde7fa740 1 --2- 172.21.15.78:0/2859330012 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56013e48c200 0x56013e48e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.732+0000 7f2fde7fa740 4 client.15678 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:19:25.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.732+0000 7f2fde7fa740 1 -- 172.21.15.78:0/2859330012 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56013e3e3da0 con 0x56013e48c200 2024-09-11T00:19:25.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.732+0000 7f2fda1c1640 1 --2- 172.21.15.78:0/2859330012 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56013e48c200 0x56013e48e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.732+0000 7f2fda1c1640 1 --2- 172.21.15.78:0/2859330012 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56013e48c200 0x56013e48e640 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=791c95b9a2e33a3e server_cookie=63cb1f10499dd93b in_seq=0 out_seq=0 2024-09-11T00:19:25.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.732+0000 7f2fbdffb640 10 client.15678 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:19:25.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.733+0000 7f2fbdffb640 1 -- 172.21.15.78:0/2859330012 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56013e3e3da0 con 0x56013e48c200 2024-09-11T00:19:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.733+0000 7f2fbdffb640 10 client.15678 handle_command_reply: tid=0 2024-09-11T00:19:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.733+0000 7f2fde7fa740 1 client.15678 shutdown 2024-09-11T00:19:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.733+0000 7f2fde7fa740 1 -- 172.21.15.78:0/2859330012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e479b20 msgr2=0x56013e488150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.733+0000 7f2fde7fa740 1 --2- 172.21.15.78:0/2859330012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e479b20 0x56013e488150 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc0317a0 tx=0x7f2fcc0095c0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.733+0000 7f2fde7fa740 1 -- 172.21.15.78:0/2859330012 shutdown_connections 2024-09-11T00:19:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.733+0000 7f2fde7fa740 1 --2- 172.21.15.78:0/2859330012 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56013e48c200 0x56013e48e640 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.733+0000 7f2fde7fa740 1 --2- 172.21.15.78:0/2859330012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e479b20 0x56013e488150 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.733+0000 7f2fde7fa740 1 --2- 172.21.15.78:0/2859330012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56013e47c140 0x56013e4795e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.733+0000 7f2fbdffb640 0 client.15678 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:19:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.733+0000 7f2fde7fa740 1 --2- 172.21.15.78:0/2859330012 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56013e46b480 0x56013e4790a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.733+0000 7f2fde7fa740 1 -- 172.21.15.78:0/2859330012 >> 172.21.15.78:0/2859330012 conn(0x56013e4692b0 msgr2=0x56013e46ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.733+0000 7f2fde7fa740 1 -- 172.21.15.78:0/2859330012 shutdown_connections 2024-09-11T00:19:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.733+0000 7f2fde7fa740 1 -- 172.21.15.78:0/2859330012 wait complete. 2024-09-11T00:19:25.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.733+0000 7f2fde7fa740 20 client.15678 trim_cache size 0 max 16384 2024-09-11T00:19:25.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.751+0000 7f2fde7fa740 1 Processor -- start 2024-09-11T00:19:25.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.751+0000 7f2fde7fa740 1 -- start start 2024-09-11T00:19:25.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.751+0000 7f2fde7fa740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56013e46b480 0x56013e46aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.751+0000 7f2fde7fa740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56013e479b20 0x56013e476bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.751+0000 7f2fde7fa740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e47c140 0x56013e488050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.751+0000 7f2fde7fa740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd41aa580 con 0x56013e47c140 2024-09-11T00:19:25.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.752+0000 7f2fde7fa740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd41ace00 con 0x56013e479b20 2024-09-11T00:19:25.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.752+0000 7f2fde7fa740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd41aabf0 con 0x56013e46b480 2024-09-11T00:19:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.752+0000 7f2fda9c2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e47c140 0x56013e488050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.752+0000 7f2fda9c2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e47c140 0x56013e488050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55568/0 (socket says 172.21.15.78:55568) 2024-09-11T00:19:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.752+0000 7f2fda9c2640 1 -- 172.21.15.78:0/3152457849 learned_addr learned my addr 172.21.15.78:0/3152457849 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:19:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.752+0000 7f2fd99c0640 1 --2- 172.21.15.78:0/3152457849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56013e479b20 0x56013e476bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.752+0000 7f2fda1c1640 1 --2- 172.21.15.78:0/3152457849 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56013e46b480 0x56013e46aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.752+0000 7f2fda9c2640 1 -- 172.21.15.78:0/3152457849 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56013e46b480 msgr2=0x56013e46aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.752+0000 7f2fda9c2640 1 --2- 172.21.15.78:0/3152457849 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56013e46b480 0x56013e46aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.752+0000 7f2fda9c2640 1 -- 172.21.15.78:0/3152457849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56013e479b20 msgr2=0x56013e476bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.752+0000 7f2fda9c2640 1 --2- 172.21.15.78:0/3152457849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56013e479b20 0x56013e476bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.752+0000 7f2fda9c2640 1 -- 172.21.15.78:0/3152457849 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56013e469a50 con 0x56013e47c140 2024-09-11T00:19:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.752+0000 7f2fda1c1640 1 --2- 172.21.15.78:0/3152457849 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56013e46b480 0x56013e46aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:19:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.752+0000 7f2fd99c0640 1 --2- 172.21.15.78:0/3152457849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56013e479b20 0x56013e476bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:19:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.752+0000 7f2fda9c2640 1 --2- 172.21.15.78:0/3152457849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e47c140 0x56013e488050 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc02f500 tx=0x7f2fcc0314b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20a3bb99387e386 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:25.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.752+0000 7f2fbffff640 1 -- 172.21.15.78:0/3152457849 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc04e070 con 0x56013e47c140 2024-09-11T00:19:25.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.752+0000 7f2fbffff640 1 -- 172.21.15.78:0/3152457849 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fcc036040 con 0x56013e47c140 2024-09-11T00:19:25.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.752+0000 7f2fbffff640 1 -- 172.21.15.78:0/3152457849 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc02fd90 con 0x56013e47c140 2024-09-11T00:19:25.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.753+0000 7f2fde7fa740 1 -- 172.21.15.78:0/3152457849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e47c140 msgr2=0x56013e488050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:25.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.753+0000 7f2fde7fa740 1 --2- 172.21.15.78:0/3152457849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e47c140 0x56013e488050 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc02f500 tx=0x7f2fcc0314b0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.753+0000 7f2fde7fa740 1 -- 172.21.15.78:0/3152457849 shutdown_connections 2024-09-11T00:19:25.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.753+0000 7f2fde7fa740 1 --2- 172.21.15.78:0/3152457849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e47c140 0x56013e488050 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.753+0000 7f2fde7fa740 1 --2- 172.21.15.78:0/3152457849 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56013e479b20 0x56013e476bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.753+0000 7f2fde7fa740 1 --2- 172.21.15.78:0/3152457849 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56013e46b480 0x56013e46aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.754+0000 7f2fde7fa740 1 -- 172.21.15.78:0/3152457849 >> 172.21.15.78:0/3152457849 conn(0x56013e4692b0 msgr2=0x56013e46a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:25.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.754+0000 7f2fde7fa740 1 -- 172.21.15.78:0/3152457849 shutdown_connections 2024-09-11T00:19:25.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.754+0000 7f2fde7fa740 1 -- 172.21.15.78:0/3152457849 wait complete. 2024-09-11T00:19:25.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.754+0000 7f2fde7fa740 1 -- start start 2024-09-11T00:19:25.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.754+0000 7f2fde7fa740 1 Processor -- start 2024-09-11T00:19:25.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.754+0000 7f2fde7fa740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e46b480 0x56013e4840b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.754+0000 7f2fde7fa740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56013e479b20 0x56013e4845f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.754+0000 7f2fde7fa740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56013e47c140 0x56013e481080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.754+0000 7f2fde7fa740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd41ab2c0 con 0x56013e46b480 2024-09-11T00:19:25.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.754+0000 7f2fde7fa740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd41ac730 con 0x56013e47c140 2024-09-11T00:19:25.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.754+0000 7f2fde7fa740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd41ab990 con 0x56013e479b20 2024-09-11T00:19:25.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.754+0000 7f2fde7fa740 10 client.0 _ll_register_callbacks cb 0x7f2fcc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:19:25.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.755+0000 7f2fda1c1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e46b480 0x56013e4840b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.755+0000 7f2fda1c1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e46b480 0x56013e4840b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55570/0 (socket says 172.21.15.78:55570) 2024-09-11T00:19:25.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.755+0000 7f2fda1c1640 1 -- 172.21.15.78:0/3077538298 learned_addr learned my addr 172.21.15.78:0/3077538298 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:19:25.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.755+0000 7f2fd99c0640 1 --2- 172.21.15.78:0/3077538298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56013e479b20 0x56013e4845f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.755+0000 7f2fda9c2640 1 --2- 172.21.15.78:0/3077538298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56013e47c140 0x56013e481080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.755+0000 7f2fda1c1640 1 -- 172.21.15.78:0/3077538298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56013e479b20 msgr2=0x56013e4845f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:25.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.755+0000 7f2fda1c1640 1 --2- 172.21.15.78:0/3077538298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56013e479b20 0x56013e4845f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.755+0000 7f2fda1c1640 1 -- 172.21.15.78:0/3077538298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56013e47c140 msgr2=0x56013e481080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:25.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.755+0000 7f2fda1c1640 1 --2- 172.21.15.78:0/3077538298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56013e47c140 0x56013e481080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.755+0000 7f2fda1c1640 1 -- 172.21.15.78:0/3077538298 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56013e484d30 con 0x56013e46b480 2024-09-11T00:19:25.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.755+0000 7f2fda1c1640 1 --2- 172.21.15.78:0/3077538298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e46b480 0x56013e4840b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80058c0 tx=0x7f2fc80e9470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c73d570dff0943 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:25.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.755+0000 7f2fbdffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:19:25.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.755+0000 7f2fbdffb640 1 -- 172.21.15.78:0/3077538298 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc80abc00 con 0x56013e46b480 2024-09-11T00:19:25.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.755+0000 7f2fbdffb640 1 -- 172.21.15.78:0/3077538298 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f2fc80e3800 con 0x56013e46b480 2024-09-11T00:19:25.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.755+0000 7f2fde7fa740 1 -- 172.21.15.78:0/3077538298 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fcc036040 con 0x56013e46b480 2024-09-11T00:19:25.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.755+0000 7f2fbdffb640 1 -- 172.21.15.78:0/3077538298 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2fc80abdf0 con 0x56013e46b480 2024-09-11T00:19:25.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.755+0000 7f2fde7fa740 10 client.15684 fetch_fsmap learned FSMap version 20 2024-09-11T00:19:25.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.755+0000 7f2fde7fa740 1 -- 172.21.15.78:0/3077538298 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56013e4f9610 con 0x56013e46b480 2024-09-11T00:19:25.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.756+0000 7f2fbdffb640 1 -- 172.21.15.78:0/3077538298 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fcc036040 con 0x56013e46b480 2024-09-11T00:19:25.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.756+0000 7f2fbdffb640 1 -- 172.21.15.78:0/3077538298 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2fc80a8520 con 0x56013e46b480 2024-09-11T00:19:25.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.756+0000 7f2fde7fa740 10 client.15684 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:19:25.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.756+0000 7f2fde7fa740 10 client.15684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:19:25.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.756+0000 7f2fde7fa740 20 client.15684 populate_metadata read hostname 'smithi078' 2024-09-11T00:19:25.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.756+0000 7f2fde7fa740 1 --2- 172.21.15.78:0/3077538298 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56013e4f9950 0x56013e4fbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:25.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.756+0000 7f2fde7fa740 4 client.15684 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:19:25.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.756+0000 7f2fde7fa740 1 -- 172.21.15.78:0/3077538298 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56013e3df850 con 0x56013e4f9950 2024-09-11T00:19:25.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.756+0000 7f2fd99c0640 1 --2- 172.21.15.78:0/3077538298 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56013e4f9950 0x56013e4fbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:25.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.756+0000 7f2fbdffb640 10 client.15684 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:19:25.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.756+0000 7f2fd99c0640 1 --2- 172.21.15.78:0/3077538298 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56013e4f9950 0x56013e4fbd40 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9f94ce2b46adc83 server_cookie=81aecf217088131a in_seq=0 out_seq=0 2024-09-11T00:19:25.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.757+0000 7f2fbdffb640 1 -- 172.21.15.78:0/3077538298 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x56013e3df850 con 0x56013e4f9950 2024-09-11T00:19:25.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.757+0000 7f2fbdffb640 10 client.15684 handle_command_reply: tid=0 2024-09-11T00:19:25.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.757+0000 7f2fde7fa740 1 client.15684 shutdown 2024-09-11T00:19:25.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.757+0000 7f2fde7fa740 1 -- 172.21.15.78:0/3077538298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e46b480 msgr2=0x56013e4840b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:25.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.757+0000 7f2fde7fa740 1 --2- 172.21.15.78:0/3077538298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e46b480 0x56013e4840b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80058c0 tx=0x7f2fc80e9470 comp rx=0 tx=0).stop 2024-09-11T00:19:25.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.757+0000 7f2fde7fa740 1 -- 172.21.15.78:0/3077538298 shutdown_connections 2024-09-11T00:19:25.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.757+0000 7f2fde7fa740 1 --2- 172.21.15.78:0/3077538298 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56013e4f9950 0x56013e4fbd40 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.757+0000 7f2fde7fa740 1 --2- 172.21.15.78:0/3077538298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56013e47c140 0x56013e481080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.757+0000 7f2fde7fa740 1 --2- 172.21.15.78:0/3077538298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56013e479b20 0x56013e4845f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.757+0000 7f2fde7fa740 1 --2- 172.21.15.78:0/3077538298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56013e46b480 0x56013e4840b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.757+0000 7f2fde7fa740 1 -- 172.21.15.78:0/3077538298 >> 172.21.15.78:0/3077538298 conn(0x56013e4692b0 msgr2=0x56013e467bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:25.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.757+0000 7f2fbdffb640 0 client.15684 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:19:25.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.757+0000 7f2fde7fa740 1 -- 172.21.15.78:0/3077538298 shutdown_connections 2024-09-11T00:19:25.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.757+0000 7f2fde7fa740 1 -- 172.21.15.78:0/3077538298 wait complete. 2024-09-11T00:19:25.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.757+0000 7f2fde7fa740 20 client.15684 trim_cache size 0 max 16384 2024-09-11T00:19:25.765 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:19:25.765 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-11T00:19:25.765 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {}, 2024-09-11T00:19:25.765 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:19:25.765 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:19:25.765 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:19:25.765 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:19:25.765 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:19:25.765 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:19:25.765 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:19:25.766 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:19:25.766 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:19:25.766 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:19:25.766 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:19:25.766 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:19:25.766 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:19:25.766 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:19:25.766 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:19:25.766 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:19:25.766 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:19:25.766 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:19:25.766 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:19:25.766 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:19:25.767 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:19:25.767 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:19:25.767 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:19:25.767 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:19:25.767 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:19:25.767 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:19:25.767 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:19:25.767 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:19:25.767 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:19:25.767 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:19:25.767 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:19:25.768 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:19:25.768 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:19:25.768 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:19:25.768 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:19:25.768 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:19:25.768 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:19:25.768 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:19:25.768 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:19:25.769 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:19:25.769 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:19:25.769 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:19:25.769 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:19:25.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.758+0000 7f2fdc425640 1 -- 172.21.15.78:0/2430316264 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2fc00b5450 msgr2=0x7f2fc00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:25.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.758+0000 7f2fdc425640 1 --2- 172.21.15.78:0/2430316264 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2fc00b5450 0x7f2fc00b7910 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc009a60 tx=0x7f2fcc0093f0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.758+0000 7f2fdc425640 1 -- 172.21.15.78:0/2430316264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fd4102dd0 msgr2=0x7f2fd4199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:25.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.758+0000 7f2fdc425640 1 --2- 172.21.15.78:0/2430316264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fd4102dd0 0x7f2fd4199350 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2fc800c890 tx=0x7f2fc800cd50 comp rx=0 tx=0).stop 2024-09-11T00:19:25.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.758+0000 7f2fdc425640 1 -- 172.21.15.78:0/2430316264 shutdown_connections 2024-09-11T00:19:25.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.758+0000 7f2fdc425640 1 --2- 172.21.15.78:0/2430316264 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2fc00b5450 0x7f2fc00b7910 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.758+0000 7f2fdc425640 1 --2- 172.21.15.78:0/2430316264 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fd4109160 0x7f2fd419ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.758+0000 7f2fdc425640 1 --2- 172.21.15.78:0/2430316264 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd41087e0 0x7f2fd4199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.758+0000 7f2fdc425640 1 --2- 172.21.15.78:0/2430316264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fd4102dd0 0x7f2fd4199350 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:25.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.758+0000 7f2fdc425640 1 -- 172.21.15.78:0/2430316264 >> 172.21.15.78:0/2430316264 conn(0x7f2fd40fe860 msgr2=0x7f2fd4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:25.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.758+0000 7f2fdc425640 1 -- 172.21.15.78:0/2430316264 shutdown_connections 2024-09-11T00:19:25.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:25.758+0000 7f2fdc425640 1 -- 172.21.15.78:0/2430316264 wait complete. 2024-09-11T00:19:25.930 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:25 smithi078 ceph-mon[30865]: pgmap v412: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-09-11T00:19:26.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:25 smithi112 ceph-mon[35627]: pgmap v412: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-09-11T00:19:26.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:25 smithi138 ceph-mon[35019]: pgmap v412: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-09-11T00:19:26.579 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:19:26.580 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:19:26.847 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:19:27.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.351+0000 7fdd3c2cf640 1 -- 172.21.15.78:0/1232717261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd34108060 msgr2=0x7fdd3410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:27.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.351+0000 7fdd3c2cf640 1 --2- 172.21.15.78:0/1232717261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd34108060 0x7fdd3410e860 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c009900 tx=0x7fdd2c02a410 comp rx=0 tx=0).stop 2024-09-11T00:19:27.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.352+0000 7fdd3c2cf640 1 -- 172.21.15.78:0/1232717261 shutdown_connections 2024-09-11T00:19:27.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.352+0000 7fdd3c2cf640 1 --2- 172.21.15.78:0/1232717261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd34108060 0x7fdd3410e860 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:27.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.352+0000 7fdd3c2cf640 1 --2- 172.21.15.78:0/1232717261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd341076e0 0x7fdd34107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:27.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.352+0000 7fdd3c2cf640 1 --2- 172.21.15.78:0/1232717261 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd34101cd0 0x7fdd341020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:27.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.352+0000 7fdd3c2cf640 1 -- 172.21.15.78:0/1232717261 >> 172.21.15.78:0/1232717261 conn(0x7fdd340fd700 msgr2=0x7fdd340ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:27.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.352+0000 7fdd3c2cf640 1 -- 172.21.15.78:0/1232717261 shutdown_connections 2024-09-11T00:19:27.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.352+0000 7fdd3c2cf640 1 -- 172.21.15.78:0/1232717261 wait complete. 2024-09-11T00:19:27.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.352+0000 7fdd3c2cf640 1 Processor -- start 2024-09-11T00:19:27.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.352+0000 7fdd3c2cf640 1 -- start start 2024-09-11T00:19:27.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.352+0000 7fdd3c2cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd34101cd0 0x7fdd3419b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:27.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.352+0000 7fdd3c2cf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd341076e0 0x7fdd3419ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:27.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.352+0000 7fdd3c2cf640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd34108060 0x7fdd341a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:27.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.352+0000 7fdd3c2cf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdd34111d20 con 0x7fdd34101cd0 2024-09-11T00:19:27.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.352+0000 7fdd3c2cf640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdd34111ba0 con 0x7fdd341076e0 2024-09-11T00:19:27.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.352+0000 7fdd3c2cf640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdd34111ea0 con 0x7fdd34108060 2024-09-11T00:19:27.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.352+0000 7fdd3a06b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd34101cd0 0x7fdd3419b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:27.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.352+0000 7fdd3a06b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd34101cd0 0x7fdd3419b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55600/0 (socket says 172.21.15.78:55600) 2024-09-11T00:19:27.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.352+0000 7fdd3a06b640 1 -- 172.21.15.78:0/417738509 learned_addr learned my addr 172.21.15.78:0/417738509 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:19:27.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.353+0000 7fdd3a86c640 1 --2- 172.21.15.78:0/417738509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd34108060 0x7fdd341a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:27.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.353+0000 7fdd3986a640 1 --2- 172.21.15.78:0/417738509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd341076e0 0x7fdd3419ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:27.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.353+0000 7fdd3a06b640 1 -- 172.21.15.78:0/417738509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd34108060 msgr2=0x7fdd341a0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:27.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.353+0000 7fdd3a06b640 1 --2- 172.21.15.78:0/417738509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd34108060 0x7fdd341a0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:27.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.353+0000 7fdd3a06b640 1 -- 172.21.15.78:0/417738509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd341076e0 msgr2=0x7fdd3419ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:27.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.353+0000 7fdd3a06b640 1 --2- 172.21.15.78:0/417738509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd341076e0 0x7fdd3419ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:27.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.353+0000 7fdd3a06b640 1 -- 172.21.15.78:0/417738509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd341a1590 con 0x7fdd34101cd0 2024-09-11T00:19:27.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.353+0000 7fdd3a06b640 1 --2- 172.21.15.78:0/417738509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd34101cd0 0x7fdd3419b4e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400eab0 tx=0x7fdd2400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:27.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.353+0000 7fdd337fe640 1 -- 172.21.15.78:0/417738509 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2400ce40 con 0x7fdd34101cd0 2024-09-11T00:19:27.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.353+0000 7fdd3c2cf640 1 -- 172.21.15.78:0/417738509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd341a1880 con 0x7fdd34101cd0 2024-09-11T00:19:27.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.353+0000 7fdd337fe640 1 -- 172.21.15.78:0/417738509 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd24011920 con 0x7fdd34101cd0 2024-09-11T00:19:27.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.353+0000 7fdd337fe640 1 -- 172.21.15.78:0/417738509 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd24010a30 con 0x7fdd34101cd0 2024-09-11T00:19:27.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.353+0000 7fdd3c2cf640 1 -- 172.21.15.78:0/417738509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd341a7fc0 con 0x7fdd34101cd0 2024-09-11T00:19:27.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.354+0000 7fdd3c2cf640 1 -- 172.21.15.78:0/417738509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd341020b0 con 0x7fdd34101cd0 2024-09-11T00:19:27.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.356+0000 7fdd337fe640 1 -- 172.21.15.78:0/417738509 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fdd2400f040 con 0x7fdd34101cd0 2024-09-11T00:19:27.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.356+0000 7fdd337fe640 1 --2- 172.21.15.78:0/417738509 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdd1c0b5450 0x7fdd1c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:27.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.357+0000 7fdd3986a640 1 --2- 172.21.15.78:0/417738509 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdd1c0b5450 0x7fdd1c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:27.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.357+0000 7fdd337fe640 1 -- 172.21.15.78:0/417738509 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fdd240e62e0 con 0x7fdd34101cd0 2024-09-11T00:19:27.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.357+0000 7fdd3986a640 1 --2- 172.21.15.78:0/417738509 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdd1c0b5450 0x7fdd1c0b7910 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdd34103c00 tx=0x7fdd28008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:27.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.359+0000 7fdd337fe640 1 -- 172.21.15.78:0/417738509 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdd24016030 con 0x7fdd34101cd0 2024-09-11T00:19:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.572+0000 7fdd3c2cf640 1 -- 172.21.15.78:0/417738509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd341a83f0 con 0x7fdd34101cd0 2024-09-11T00:19:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.572+0000 7fdd337fe640 1 -- 172.21.15.78:0/417738509 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7fdd240ace80 con 0x7fdd34101cd0 2024-09-11T00:19:27.574 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:19:27.575 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:19:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:19:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.575+0000 7fdd3c2cf640 1 -- 172.21.15.78:0/417738509 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdd1c0b5450 msgr2=0x7fdd1c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.575+0000 7fdd3c2cf640 1 --2- 172.21.15.78:0/417738509 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdd1c0b5450 0x7fdd1c0b7910 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdd34103c00 tx=0x7fdd28008040 comp rx=0 tx=0).stop 2024-09-11T00:19:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.575+0000 7fdd3c2cf640 1 -- 172.21.15.78:0/417738509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd34101cd0 msgr2=0x7fdd3419b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.575+0000 7fdd3c2cf640 1 --2- 172.21.15.78:0/417738509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd34101cd0 0x7fdd3419b4e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400eab0 tx=0x7fdd2400ef70 comp rx=0 tx=0).stop 2024-09-11T00:19:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.575+0000 7fdd3c2cf640 1 -- 172.21.15.78:0/417738509 shutdown_connections 2024-09-11T00:19:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.575+0000 7fdd3c2cf640 1 --2- 172.21.15.78:0/417738509 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdd1c0b5450 0x7fdd1c0b7910 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.575+0000 7fdd3c2cf640 1 --2- 172.21.15.78:0/417738509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdd34108060 0x7fdd341a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.575+0000 7fdd3c2cf640 1 --2- 172.21.15.78:0/417738509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdd341076e0 0x7fdd3419ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.575+0000 7fdd3c2cf640 1 --2- 172.21.15.78:0/417738509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd34101cd0 0x7fdd3419b4e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.575+0000 7fdd3c2cf640 1 -- 172.21.15.78:0/417738509 >> 172.21.15.78:0/417738509 conn(0x7fdd340fd700 msgr2=0x7fdd34104cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.575+0000 7fdd3c2cf640 1 -- 172.21.15.78:0/417738509 shutdown_connections 2024-09-11T00:19:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:27.575+0000 7fdd3c2cf640 1 -- 172.21.15.78:0/417738509 wait complete. 2024-09-11T00:19:27.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:27 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/417738509' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:19:27.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:27 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/417738509' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:19:28.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:27 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/417738509' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:19:28.331 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:19:28.579 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:19:28.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:28 smithi112 ceph-mon[35627]: pgmap v413: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-11T00:19:28.998 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:28 smithi078 ceph-mon[30865]: pgmap v413: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-11T00:19:29.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:28 smithi138 ceph-mon[35019]: pgmap v413: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-11T00:19:29.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.077+0000 7f8210661640 1 -- 172.21.15.78:0/4149832800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8208103ca0 msgr2=0x7f8208104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:29.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.077+0000 7f8210661640 1 --2- 172.21.15.78:0/4149832800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8208103ca0 0x7f8208104080 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8204009900 tx=0x7f820402a410 comp rx=0 tx=0).stop 2024-09-11T00:19:29.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.077+0000 7f8210661640 1 -- 172.21.15.78:0/4149832800 shutdown_connections 2024-09-11T00:19:29.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.077+0000 7f8210661640 1 --2- 172.21.15.78:0/4149832800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f820810d100 0x7f820810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.077+0000 7f8210661640 1 --2- 172.21.15.78:0/4149832800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82081045c0 0x7f820810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.077+0000 7f8210661640 1 --2- 172.21.15.78:0/4149832800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8208103ca0 0x7f8208104080 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.077+0000 7f8210661640 1 -- 172.21.15.78:0/4149832800 >> 172.21.15.78:0/4149832800 conn(0x7f82080fd700 msgr2=0x7f82080ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:29.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.077+0000 7f8210661640 1 -- 172.21.15.78:0/4149832800 shutdown_connections 2024-09-11T00:19:29.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.077+0000 7f8210661640 1 -- 172.21.15.78:0/4149832800 wait complete. 2024-09-11T00:19:29.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.077+0000 7f8210661640 1 Processor -- start 2024-09-11T00:19:29.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.077+0000 7f8210661640 1 -- start start 2024-09-11T00:19:29.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.078+0000 7f8210661640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8208103ca0 0x7f8208199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:29.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.078+0000 7f8210661640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82081045c0 0x7f8208199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:29.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.078+0000 7f8210661640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f820810d100 0x7f820819ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:29.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.078+0000 7f8210661640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8208112d70 con 0x7f8208103ca0 2024-09-11T00:19:29.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.078+0000 7f8210661640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8208112bf0 con 0x7f82081045c0 2024-09-11T00:19:29.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.078+0000 7f8210661640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8208112ef0 con 0x7f820810d100 2024-09-11T00:19:29.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.078+0000 7f820e3fd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8208103ca0 0x7f8208199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:29.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.078+0000 7f820e3fd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8208103ca0 0x7f8208199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55610/0 (socket says 172.21.15.78:55610) 2024-09-11T00:19:29.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.078+0000 7f820e3fd640 1 -- 172.21.15.78:0/3886584056 learned_addr learned my addr 172.21.15.78:0/3886584056 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:19:29.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.078+0000 7f820dbfc640 1 --2- 172.21.15.78:0/3886584056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82081045c0 0x7f8208199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:29.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.078+0000 7f820ebfe640 1 --2- 172.21.15.78:0/3886584056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f820810d100 0x7f820819ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:29.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.078+0000 7f820e3fd640 1 -- 172.21.15.78:0/3886584056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f820810d100 msgr2=0x7f820819ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:29.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.078+0000 7f820e3fd640 1 --2- 172.21.15.78:0/3886584056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f820810d100 0x7f820819ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.078+0000 7f820e3fd640 1 -- 172.21.15.78:0/3886584056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82081045c0 msgr2=0x7f8208199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:29.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.078+0000 7f820e3fd640 1 --2- 172.21.15.78:0/3886584056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82081045c0 0x7f8208199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.078+0000 7f820e3fd640 1 -- 172.21.15.78:0/3886584056 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820819f3f0 con 0x7f8208103ca0 2024-09-11T00:19:29.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.078+0000 7f820e3fd640 1 --2- 172.21.15.78:0/3886584056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8208103ca0 0x7f8208199340 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8204005940 tx=0x7f82040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:29.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.078+0000 7f81ff7fe640 1 -- 172.21.15.78:0/3886584056 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820403f030 con 0x7f8208103ca0 2024-09-11T00:19:29.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.078+0000 7f8210661640 1 -- 172.21.15.78:0/3886584056 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f820819f680 con 0x7f8208103ca0 2024-09-11T00:19:29.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.078+0000 7f81ff7fe640 1 -- 172.21.15.78:0/3886584056 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8204003cb0 con 0x7f8208103ca0 2024-09-11T00:19:29.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.078+0000 7f81ff7fe640 1 -- 172.21.15.78:0/3886584056 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8204035070 con 0x7f8208103ca0 2024-09-11T00:19:29.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.078+0000 7f8210661640 1 -- 172.21.15.78:0/3886584056 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82081a5da0 con 0x7f8208103ca0 2024-09-11T00:19:29.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.081+0000 7f8212a36740 1 Processor -- start 2024-09-11T00:19:29.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.081+0000 7f8212a36740 1 -- start start 2024-09-11T00:19:29.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.081+0000 7f81ff7fe640 1 -- 172.21.15.78:0/3886584056 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f820403bbf0 con 0x7f8208103ca0 2024-09-11T00:19:29.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.081+0000 7f8212a36740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560feb15f0f0 0x560feb15f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:29.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.081+0000 7f8212a36740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560feb15fa10 0x560feb16f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:29.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.081+0000 7f8212a36740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb16fdb0 0x560feb1721a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:29.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.081+0000 7f8212a36740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x560feb0d5ea0 con 0x560feb16fdb0 2024-09-11T00:19:29.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.081+0000 7f8212a36740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560feb0c52d0 con 0x560feb15f0f0 2024-09-11T00:19:29.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.081+0000 7f8212a36740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x560feb0c90e0 con 0x560feb15fa10 2024-09-11T00:19:29.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.081+0000 7f820dbfc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb16fdb0 0x560feb1721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:29.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.081+0000 7f820dbfc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb16fdb0 0x560feb1721a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55618/0 (socket says 172.21.15.78:55618) 2024-09-11T00:19:29.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.081+0000 7f820dbfc640 1 -- 172.21.15.78:0/2010801321 learned_addr learned my addr 172.21.15.78:0/2010801321 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:19:29.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.082+0000 7f820e3fd640 1 --2- 172.21.15.78:0/2010801321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560feb15fa10 0x560feb16f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:29.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.082+0000 7f820ebfe640 1 --2- 172.21.15.78:0/2010801321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560feb15f0f0 0x560feb15f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:29.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.082+0000 7f820dbfc640 1 -- 172.21.15.78:0/2010801321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560feb15fa10 msgr2=0x560feb16f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:29.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.082+0000 7f820dbfc640 1 --2- 172.21.15.78:0/2010801321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560feb15fa10 0x560feb16f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.082+0000 7f820dbfc640 1 -- 172.21.15.78:0/2010801321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560feb15f0f0 msgr2=0x560feb15f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:29.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.082+0000 7f820dbfc640 1 --2- 172.21.15.78:0/2010801321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560feb15f0f0 0x560feb15f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.082+0000 7f820dbfc640 1 -- 172.21.15.78:0/2010801321 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560feae23650 con 0x560feb16fdb0 2024-09-11T00:19:29.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.082+0000 7f81ff7fe640 1 --2- 172.21.15.78:0/3886584056 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f81f40b5450 0x7f81f40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:29.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.082+0000 7f820ebfe640 1 --2- 172.21.15.78:0/3886584056 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f81f40b5450 0x7f81f40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:29.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.082+0000 7f820dbfc640 1 --2- 172.21.15.78:0/2010801321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb16fdb0 0x560feb1721a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f81f800bc90 tx=0x7f81f80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01e70283c344987 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:29.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.082+0000 7f81ff7fe640 1 -- 172.21.15.78:0/3886584056 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f8204106b80 con 0x7f8208103ca0 2024-09-11T00:19:29.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.082+0000 7f81fcff9640 1 -- 172.21.15.78:0/2010801321 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f801c680 con 0x560feb16fdb0 2024-09-11T00:19:29.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.082+0000 7f81fcff9640 1 -- 172.21.15.78:0/2010801321 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81f800be40 con 0x560feb16fdb0 2024-09-11T00:19:29.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.082+0000 7f81fcff9640 1 -- 172.21.15.78:0/2010801321 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f801a6b0 con 0x560feb16fdb0 2024-09-11T00:19:29.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.083+0000 7f8212a36740 1 -- 172.21.15.78:0/2010801321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb16fdb0 msgr2=0x560feb1721a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:29.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.083+0000 7f820ebfe640 1 --2- 172.21.15.78:0/3886584056 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f81f40b5450 0x7f81f40b7910 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8200008dc0 tx=0x7f8200008570 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:29.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.083+0000 7f8212a36740 1 --2- 172.21.15.78:0/2010801321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb16fdb0 0x560feb1721a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f81f800bc90 tx=0x7f81f80107a0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.083+0000 7f8212a36740 1 -- 172.21.15.78:0/2010801321 shutdown_connections 2024-09-11T00:19:29.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.083+0000 7f8212a36740 1 --2- 172.21.15.78:0/2010801321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb16fdb0 0x560feb1721a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.083+0000 7f8212a36740 1 --2- 172.21.15.78:0/2010801321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560feb15fa10 0x560feb16f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.083+0000 7f8212a36740 1 --2- 172.21.15.78:0/2010801321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560feb15f0f0 0x560feb15f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.083+0000 7f8212a36740 1 -- 172.21.15.78:0/2010801321 >> 172.21.15.78:0/2010801321 conn(0x560feb15cf20 msgr2=0x560feb15e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:29.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.083+0000 7f8212a36740 1 -- 172.21.15.78:0/2010801321 shutdown_connections 2024-09-11T00:19:29.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.083+0000 7f8212a36740 1 -- 172.21.15.78:0/2010801321 wait complete. 2024-09-11T00:19:29.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.083+0000 7f8212a36740 1 -- start start 2024-09-11T00:19:29.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.084+0000 7f8212a36740 1 Processor -- start 2024-09-11T00:19:29.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.084+0000 7f8212a36740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560feb15f0f0 0x560feb16f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:29.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.084+0000 7f8212a36740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb15fa10 0x560feb16cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:29.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.084+0000 7f8212a36740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560feb16fdb0 0x560feb16d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:29.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.084+0000 7f8212a36740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x560feaf26700 con 0x560feb15fa10 2024-09-11T00:19:29.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.084+0000 7f8212a36740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560feb060160 con 0x560feb15f0f0 2024-09-11T00:19:29.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.084+0000 7f8212a36740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x560feb172a60 con 0x560feb16fdb0 2024-09-11T00:19:29.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.084+0000 7f8212a36740 10 client.0 _ll_register_callbacks cb 0x560feb0799e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:19:29.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.084+0000 7f820dbfc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb15fa10 0x560feb16cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:29.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.084+0000 7f820dbfc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb15fa10 0x560feb16cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55622/0 (socket says 172.21.15.78:55622) 2024-09-11T00:19:29.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.084+0000 7f820dbfc640 1 -- 172.21.15.78:0/1053923772 learned_addr learned my addr 172.21.15.78:0/1053923772 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:19:29.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.084+0000 7f820e3fd640 1 --2- 172.21.15.78:0/1053923772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560feb15f0f0 0x560feb16f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:29.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.084+0000 7f820dbfc640 1 -- 172.21.15.78:0/1053923772 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560feb16fdb0 msgr2=0x560feb16d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:29.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.084+0000 7f820dbfc640 1 --2- 172.21.15.78:0/1053923772 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560feb16fdb0 0x560feb16d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.084+0000 7f820dbfc640 1 -- 172.21.15.78:0/1053923772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560feb15f0f0 msgr2=0x560feb16f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:29.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.084+0000 7f820dbfc640 1 --2- 172.21.15.78:0/1053923772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560feb15f0f0 0x560feb16f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.084+0000 7f820dbfc640 1 -- 172.21.15.78:0/1053923772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560feb08dc90 con 0x560feb15fa10 2024-09-11T00:19:29.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.084+0000 7f820e3fd640 1 --2- 172.21.15.78:0/1053923772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560feb15f0f0 0x560feb16f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:19:29.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.084+0000 7f820dbfc640 1 --2- 172.21.15.78:0/1053923772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb15fa10 0x560feb16cb30 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f81f8011e30 tx=0x7f81f80052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dedc2d4916f19fd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:29.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.084+0000 7f81f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:19:29.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.085+0000 7f81f1ffb640 1 -- 172.21.15.78:0/1053923772 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f8011640 con 0x560feb15fa10 2024-09-11T00:19:29.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.085+0000 7f81f1ffb640 1 -- 172.21.15.78:0/1053923772 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f81f80117e0 con 0x560feb15fa10 2024-09-11T00:19:29.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.085+0000 7f8212a36740 1 -- 172.21.15.78:0/1053923772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560feb0d7df0 con 0x560feb15fa10 2024-09-11T00:19:29.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.085+0000 7f81f1ffb640 1 -- 172.21.15.78:0/1053923772 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f81f80119e0 con 0x560feb15fa10 2024-09-11T00:19:29.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.085+0000 7f8212a36740 10 client.15702 fetch_fsmap learned FSMap version 20 2024-09-11T00:19:29.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.085+0000 7f8212a36740 1 -- 172.21.15.78:0/1053923772 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560feb17e3d0 con 0x560feb15fa10 2024-09-11T00:19:29.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.085+0000 7f81f1ffb640 1 -- 172.21.15.78:0/1053923772 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560feb0d7df0 con 0x560feb15fa10 2024-09-11T00:19:29.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.085+0000 7f81f1ffb640 1 -- 172.21.15.78:0/1053923772 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f81f802e020 con 0x560feb15fa10 2024-09-11T00:19:29.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.085+0000 7f8212a36740 10 client.15702 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:19:29.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.085+0000 7f8212a36740 10 client.15702 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:19:29.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.085+0000 7f8212a36740 20 client.15702 populate_metadata read hostname 'smithi078' 2024-09-11T00:19:29.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.085+0000 7f8212a36740 1 --2- 172.21.15.78:0/1053923772 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560feb17f7d0 0x560feb181bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:29.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.085+0000 7f8212a36740 4 client.15702 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:19:29.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.085+0000 7f8212a36740 1 -- 172.21.15.78:0/1053923772 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560feb0d38a0 con 0x560feb17f7d0 2024-09-11T00:19:29.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.085+0000 7f820e3fd640 1 --2- 172.21.15.78:0/1053923772 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560feb17f7d0 0x560feb181bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:29.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.086+0000 7f81f1ffb640 10 client.15702 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:19:29.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.086+0000 7f820e3fd640 1 --2- 172.21.15.78:0/1053923772 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560feb17f7d0 0x560feb181bc0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73c43f95e345e25a server_cookie=c56ece51459e716b in_seq=0 out_seq=0 2024-09-11T00:19:29.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.087+0000 7f81f1ffb640 1 -- 172.21.15.78:0/1053923772 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560feb0d38a0 con 0x560feb17f7d0 2024-09-11T00:19:29.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.087+0000 7f81f1ffb640 10 client.15702 handle_command_reply: tid=0 2024-09-11T00:19:29.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.087+0000 7f8212a36740 1 client.15702 shutdown 2024-09-11T00:19:29.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.087+0000 7f8212a36740 1 -- 172.21.15.78:0/1053923772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb15fa10 msgr2=0x560feb16cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:29.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.087+0000 7f8212a36740 1 --2- 172.21.15.78:0/1053923772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb15fa10 0x560feb16cb30 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f81f8011e30 tx=0x7f81f80052f0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.087+0000 7f8212a36740 1 -- 172.21.15.78:0/1053923772 shutdown_connections 2024-09-11T00:19:29.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.087+0000 7f8212a36740 1 --2- 172.21.15.78:0/1053923772 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560feb17f7d0 0x560feb181bc0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.087+0000 7f8212a36740 1 --2- 172.21.15.78:0/1053923772 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560feb16fdb0 0x560feb16d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.087+0000 7f8212a36740 1 --2- 172.21.15.78:0/1053923772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb15fa10 0x560feb16cb30 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.087+0000 7f8212a36740 1 --2- 172.21.15.78:0/1053923772 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560feb15f0f0 0x560feb16f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.087+0000 7f81f1ffb640 0 client.15702 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:19:29.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.087+0000 7f8212a36740 1 -- 172.21.15.78:0/1053923772 >> 172.21.15.78:0/1053923772 conn(0x560feb15cf20 msgr2=0x560feb162a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:29.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.087+0000 7f8212a36740 1 -- 172.21.15.78:0/1053923772 shutdown_connections 2024-09-11T00:19:29.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.087+0000 7f8212a36740 1 -- 172.21.15.78:0/1053923772 wait complete. 2024-09-11T00:19:29.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.087+0000 7f8212a36740 20 client.15702 trim_cache size 0 max 16384 2024-09-11T00:19:29.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.100+0000 7f8212a36740 1 Processor -- start 2024-09-11T00:19:29.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.100+0000 7f8212a36740 1 -- start start 2024-09-11T00:19:29.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.100+0000 7f8212a36740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb15f0f0 0x560feb17bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:29.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.100+0000 7f8212a36740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560feb15fa10 0x560feb1817e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:29.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.100+0000 7f8212a36740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560feb16fdb0 0x560feb181d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:29.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.100+0000 7f8212a36740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f82081aa4e0 con 0x560feb15f0f0 2024-09-11T00:19:29.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.100+0000 7f8212a36740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f82081acd60 con 0x560feb15fa10 2024-09-11T00:19:29.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.100+0000 7f8212a36740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f82081aab50 con 0x560feb16fdb0 2024-09-11T00:19:29.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.100+0000 7f820e3fd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb15f0f0 0x560feb17bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:29.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.100+0000 7f820e3fd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb15f0f0 0x560feb17bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55628/0 (socket says 172.21.15.78:55628) 2024-09-11T00:19:29.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.100+0000 7f820e3fd640 1 -- 172.21.15.78:0/3865157240 learned_addr learned my addr 172.21.15.78:0/3865157240 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:19:29.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.101+0000 7f820e3fd640 1 -- 172.21.15.78:0/3865157240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560feb16fdb0 msgr2=0x560feb181d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:29.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.101+0000 7f820ebfe640 1 --2- 172.21.15.78:0/3865157240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560feb16fdb0 0x560feb181d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:29.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.101+0000 7f820e3fd640 1 --2- 172.21.15.78:0/3865157240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560feb16fdb0 0x560feb181d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.101+0000 7f820dbfc640 1 --2- 172.21.15.78:0/3865157240 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560feb15fa10 0x560feb1817e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:29.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.101+0000 7f820e3fd640 1 -- 172.21.15.78:0/3865157240 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560feb15fa10 msgr2=0x560feb1817e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:29.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.101+0000 7f820e3fd640 1 --2- 172.21.15.78:0/3865157240 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560feb15fa10 0x560feb1817e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.101+0000 7f820e3fd640 1 -- 172.21.15.78:0/3865157240 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560feb15e9e0 con 0x560feb15f0f0 2024-09-11T00:19:29.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.101+0000 7f820ebfe640 1 --2- 172.21.15.78:0/3865157240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560feb16fdb0 0x560feb181d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:19:29.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.101+0000 7f820e3fd640 1 --2- 172.21.15.78:0/3865157240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb15f0f0 0x560feb17bc90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f82040ccfb0 tx=0x7f82040b4040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff4f6a8370a063d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:29.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.101+0000 7f81f3fff640 1 -- 172.21.15.78:0/3865157240 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8204049040 con 0x560feb15f0f0 2024-09-11T00:19:29.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.101+0000 7f81f3fff640 1 -- 172.21.15.78:0/3865157240 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82040ccb30 con 0x560feb15f0f0 2024-09-11T00:19:29.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.101+0000 7f81f3fff640 1 -- 172.21.15.78:0/3865157240 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8204003e60 con 0x560feb15f0f0 2024-09-11T00:19:29.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.101+0000 7f8212a36740 1 -- 172.21.15.78:0/3865157240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb15f0f0 msgr2=0x560feb17bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:29.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.101+0000 7f8212a36740 1 --2- 172.21.15.78:0/3865157240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb15f0f0 0x560feb17bc90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f82040ccfb0 tx=0x7f82040b4040 comp rx=0 tx=0).stop 2024-09-11T00:19:29.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.102+0000 7f8212a36740 1 -- 172.21.15.78:0/3865157240 shutdown_connections 2024-09-11T00:19:29.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.102+0000 7f8212a36740 1 --2- 172.21.15.78:0/3865157240 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560feb16fdb0 0x560feb181d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.102+0000 7f8212a36740 1 --2- 172.21.15.78:0/3865157240 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560feb15fa10 0x560feb1817e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.102+0000 7f8212a36740 1 --2- 172.21.15.78:0/3865157240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb15f0f0 0x560feb17bc90 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.102+0000 7f8212a36740 1 -- 172.21.15.78:0/3865157240 >> 172.21.15.78:0/3865157240 conn(0x560feb15cf20 msgr2=0x560feb170be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:29.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.102+0000 7f8212a36740 1 -- 172.21.15.78:0/3865157240 shutdown_connections 2024-09-11T00:19:29.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.102+0000 7f8212a36740 1 -- 172.21.15.78:0/3865157240 wait complete. 2024-09-11T00:19:29.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.102+0000 7f8212a36740 1 -- start start 2024-09-11T00:19:29.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.102+0000 7f8212a36740 1 Processor -- start 2024-09-11T00:19:29.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.102+0000 7f8212a36740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560feb15f0f0 0x560feb177d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:29.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.102+0000 7f8212a36740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560feb15fa10 0x560feb178240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:29.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.102+0000 7f8212a36740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb16fdb0 0x560feb172cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:29.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.102+0000 7f8212a36740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f82081ab220 con 0x560feb16fdb0 2024-09-11T00:19:29.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.102+0000 7f8212a36740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f82081ac690 con 0x560feb15f0f0 2024-09-11T00:19:29.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.102+0000 7f8212a36740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f82081ab8f0 con 0x560feb15fa10 2024-09-11T00:19:29.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.102+0000 7f8212a36740 10 client.0 _ll_register_callbacks cb 0x7f8200008410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:19:29.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.102+0000 7f820ebfe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb16fdb0 0x560feb172cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:29.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.102+0000 7f820ebfe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb16fdb0 0x560feb172cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55630/0 (socket says 172.21.15.78:55630) 2024-09-11T00:19:29.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.102+0000 7f820ebfe640 1 -- 172.21.15.78:0/3697626043 learned_addr learned my addr 172.21.15.78:0/3697626043 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:19:29.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.102+0000 7f820e3fd640 1 --2- 172.21.15.78:0/3697626043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560feb15f0f0 0x560feb177d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:29.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.103+0000 7f820dbfc640 1 --2- 172.21.15.78:0/3697626043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560feb15fa10 0x560feb178240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:29.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.103+0000 7f820ebfe640 1 -- 172.21.15.78:0/3697626043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560feb15fa10 msgr2=0x560feb178240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:29.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.103+0000 7f820ebfe640 1 --2- 172.21.15.78:0/3697626043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560feb15fa10 0x560feb178240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.103+0000 7f820ebfe640 1 -- 172.21.15.78:0/3697626043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560feb15f0f0 msgr2=0x560feb177d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:29.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.103+0000 7f820ebfe640 1 --2- 172.21.15.78:0/3697626043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560feb15f0f0 0x560feb177d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.103+0000 7f820ebfe640 1 -- 172.21.15.78:0/3697626043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560feb17c1d0 con 0x560feb16fdb0 2024-09-11T00:19:29.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.103+0000 7f820ebfe640 1 --2- 172.21.15.78:0/3697626043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb16fdb0 0x560feb172cb0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f820001dde0 tx=0x7f8200004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb11ff88290cf0f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:29.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.103+0000 7f81f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:19:29.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.103+0000 7f81f1ffb640 1 -- 172.21.15.78:0/3697626043 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820002a060 con 0x560feb16fdb0 2024-09-11T00:19:29.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.103+0000 7f81f1ffb640 1 -- 172.21.15.78:0/3697626043 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f820001b620 con 0x560feb16fdb0 2024-09-11T00:19:29.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.103+0000 7f8212a36740 1 -- 172.21.15.78:0/3697626043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82040ccb30 con 0x560feb16fdb0 2024-09-11T00:19:29.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.103+0000 7f81f1ffb640 1 -- 172.21.15.78:0/3697626043 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f820001b860 con 0x560feb16fdb0 2024-09-11T00:19:29.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.103+0000 7f8212a36740 10 client.15708 fetch_fsmap learned FSMap version 20 2024-09-11T00:19:29.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.103+0000 7f8212a36740 1 -- 172.21.15.78:0/3697626043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560feb15e790 con 0x560feb16fdb0 2024-09-11T00:19:29.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.103+0000 7f81f1ffb640 1 -- 172.21.15.78:0/3697626043 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82040ccb30 con 0x560feb16fdb0 2024-09-11T00:19:29.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.103+0000 7f81f1ffb640 1 -- 172.21.15.78:0/3697626043 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8200024030 con 0x560feb16fdb0 2024-09-11T00:19:29.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.103+0000 7f8212a36740 10 client.15708 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:19:29.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.103+0000 7f8212a36740 10 client.15708 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:19:29.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.103+0000 7f8212a36740 20 client.15708 populate_metadata read hostname 'smithi078' 2024-09-11T00:19:29.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.104+0000 7f8212a36740 1 --2- 172.21.15.78:0/3697626043 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560feb1ed1a0 0x560feb1ef5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:29.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.104+0000 7f8212a36740 4 client.15708 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:19:29.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.104+0000 7f8212a36740 1 -- 172.21.15.78:0/3697626043 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560feb0d0cd0 con 0x560feb1ed1a0 2024-09-11T00:19:29.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.104+0000 7f820e3fd640 1 --2- 172.21.15.78:0/3697626043 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560feb1ed1a0 0x560feb1ef5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:29.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.104+0000 7f820e3fd640 1 --2- 172.21.15.78:0/3697626043 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560feb1ed1a0 0x560feb1ef5c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df3016cf9f967d8d server_cookie=e23718a7158e4f73 in_seq=0 out_seq=0 2024-09-11T00:19:29.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.104+0000 7f81f1ffb640 10 client.15708 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:19:29.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.104+0000 7f81f1ffb640 1 -- 172.21.15.78:0/3697626043 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560feb0d0cd0 con 0x560feb1ed1a0 2024-09-11T00:19:29.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.104+0000 7f81f1ffb640 10 client.15708 handle_command_reply: tid=0 2024-09-11T00:19:29.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.104+0000 7f8212a36740 1 client.15708 shutdown 2024-09-11T00:19:29.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.104+0000 7f8212a36740 1 -- 172.21.15.78:0/3697626043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb16fdb0 msgr2=0x560feb172cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:29.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.104+0000 7f8212a36740 1 --2- 172.21.15.78:0/3697626043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb16fdb0 0x560feb172cb0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f820001dde0 tx=0x7f8200004ab0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.104+0000 7f8212a36740 1 -- 172.21.15.78:0/3697626043 shutdown_connections 2024-09-11T00:19:29.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.104+0000 7f8212a36740 1 --2- 172.21.15.78:0/3697626043 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560feb1ed1a0 0x560feb1ef5c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.104+0000 7f8212a36740 1 --2- 172.21.15.78:0/3697626043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560feb16fdb0 0x560feb172cb0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.104+0000 7f8212a36740 1 --2- 172.21.15.78:0/3697626043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560feb15fa10 0x560feb178240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.104+0000 7f8212a36740 1 --2- 172.21.15.78:0/3697626043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560feb15f0f0 0x560feb177d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.104+0000 7f8212a36740 1 -- 172.21.15.78:0/3697626043 >> 172.21.15.78:0/3697626043 conn(0x560feb15cf20 msgr2=0x560feb1817e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:29.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.104+0000 7f81f1ffb640 0 client.15708 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:19:29.165 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-11T00:19:29.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.105+0000 7f8212a36740 1 -- 172.21.15.78:0/3697626043 shutdown_connections 2024-09-11T00:19:29.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.105+0000 7f8212a36740 1 -- 172.21.15.78:0/3697626043 wait complete. 2024-09-11T00:19:29.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.105+0000 7f8212a36740 20 client.15708 trim_cache size 0 max 16384 2024-09-11T00:19:29.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.105+0000 7f8210661640 1 -- 172.21.15.78:0/3886584056 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f81f40b5450 msgr2=0x7f81f40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:29.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.105+0000 7f8210661640 1 --2- 172.21.15.78:0/3886584056 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f81f40b5450 0x7f81f40b7910 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8200008dc0 tx=0x7f8200008570 comp rx=0 tx=0).stop 2024-09-11T00:19:29.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.105+0000 7f8210661640 1 -- 172.21.15.78:0/3886584056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8208103ca0 msgr2=0x7f8208199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:29.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.105+0000 7f8210661640 1 --2- 172.21.15.78:0/3886584056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8208103ca0 0x7f8208199340 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8204005940 tx=0x7f82040042f0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.105+0000 7f8210661640 1 -- 172.21.15.78:0/3886584056 shutdown_connections 2024-09-11T00:19:29.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.105+0000 7f8210661640 1 --2- 172.21.15.78:0/3886584056 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f81f40b5450 0x7f81f40b7910 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.105+0000 7f8210661640 1 --2- 172.21.15.78:0/3886584056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f820810d100 0x7f820819ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.105+0000 7f8210661640 1 --2- 172.21.15.78:0/3886584056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82081045c0 0x7f8208199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.105+0000 7f8210661640 1 --2- 172.21.15.78:0/3886584056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8208103ca0 0x7f8208199340 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:29.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.105+0000 7f8210661640 1 -- 172.21.15.78:0/3886584056 >> 172.21.15.78:0/3886584056 conn(0x7f82080fd700 msgr2=0x7f82080fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:29.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.105+0000 7f8210661640 1 -- 172.21.15.78:0/3886584056 shutdown_connections 2024-09-11T00:19:29.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:29.105+0000 7f8210661640 1 -- 172.21.15.78:0/3886584056 wait complete. 2024-09-11T00:19:30.893 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:19:30.894 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:19:31.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:30 smithi078 ceph-mon[30865]: pgmap v414: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-11T00:19:31.146 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:19:31.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:30 smithi112 ceph-mon[35627]: pgmap v414: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-11T00:19:31.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:30 smithi138 ceph-mon[35019]: pgmap v414: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.6 KiB/s wr, 1 op/s 2024-09-11T00:19:31.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.620+0000 7f2018728640 1 -- 172.21.15.78:0/192289795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20101087d0 msgr2=0x7f2010108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:31.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.620+0000 7f2018728640 1 --2- 172.21.15.78:0/192289795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20101087d0 0x7f2010108c10 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2000009900 tx=0x7f200002a410 comp rx=0 tx=0).stop 2024-09-11T00:19:31.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.620+0000 7f2018728640 1 -- 172.21.15.78:0/192289795 shutdown_connections 2024-09-11T00:19:31.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.620+0000 7f2018728640 1 --2- 172.21.15.78:0/192289795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2010109150 0x7f201010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.620+0000 7f2018728640 1 --2- 172.21.15.78:0/192289795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20101087d0 0x7f2010108c10 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.620+0000 7f2018728640 1 --2- 172.21.15.78:0/192289795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2010102dc0 0x7f20101031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.620+0000 7f2018728640 1 -- 172.21.15.78:0/192289795 >> 172.21.15.78:0/192289795 conn(0x7f20100fe830 msgr2=0x7f2010100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:31.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.620+0000 7f2018728640 1 -- 172.21.15.78:0/192289795 shutdown_connections 2024-09-11T00:19:31.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.620+0000 7f2018728640 1 -- 172.21.15.78:0/192289795 wait complete. 2024-09-11T00:19:31.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.621+0000 7f2018728640 1 Processor -- start 2024-09-11T00:19:31.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.621+0000 7f2018728640 1 -- start start 2024-09-11T00:19:31.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.621+0000 7f2018728640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2010102dc0 0x7f2010199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:31.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.621+0000 7f2018728640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20101087d0 0x7f2010199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:31.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.621+0000 7f2018728640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2010109150 0x7f201019eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:31.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.621+0000 7f2018728640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2010112dd0 con 0x7f2010109150 2024-09-11T00:19:31.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.621+0000 7f2018728640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2010112c50 con 0x7f2010102dc0 2024-09-11T00:19:31.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.621+0000 7f2018728640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2010112f50 con 0x7f20101087d0 2024-09-11T00:19:31.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.622+0000 7f2016cc5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2010109150 0x7f201019eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:31.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.622+0000 7f2016cc5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2010109150 0x7f201019eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55652/0 (socket says 172.21.15.78:55652) 2024-09-11T00:19:31.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.622+0000 7f2016cc5640 1 -- 172.21.15.78:0/4138882556 learned_addr learned my addr 172.21.15.78:0/4138882556 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:19:31.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.622+0000 7f20164c4640 1 --2- 172.21.15.78:0/4138882556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2010102dc0 0x7f2010199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:31.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.622+0000 7f2015cc3640 1 --2- 172.21.15.78:0/4138882556 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20101087d0 0x7f2010199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:31.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.622+0000 7f2016cc5640 1 -- 172.21.15.78:0/4138882556 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20101087d0 msgr2=0x7f2010199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:31.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.622+0000 7f2016cc5640 1 --2- 172.21.15.78:0/4138882556 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20101087d0 0x7f2010199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.622+0000 7f2016cc5640 1 -- 172.21.15.78:0/4138882556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2010102dc0 msgr2=0x7f2010199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:31.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.622+0000 7f2016cc5640 1 --2- 172.21.15.78:0/4138882556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2010102dc0 0x7f2010199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.622+0000 7f2016cc5640 1 -- 172.21.15.78:0/4138882556 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201019f2f0 con 0x7f2010109150 2024-09-11T00:19:31.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.622+0000 7f2016cc5640 1 --2- 172.21.15.78:0/4138882556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2010109150 0x7f201019eb20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f200800cad0 tx=0x7f200800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:31.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.622+0000 7f20077fe640 1 -- 172.21.15.78:0/4138882556 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200800ad60 con 0x7f2010109150 2024-09-11T00:19:31.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.622+0000 7f2018728640 1 -- 172.21.15.78:0/4138882556 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f201019f5e0 con 0x7f2010109150 2024-09-11T00:19:31.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.622+0000 7f20077fe640 1 -- 172.21.15.78:0/4138882556 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2008005020 con 0x7f2010109150 2024-09-11T00:19:31.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.622+0000 7f2018728640 1 -- 172.21.15.78:0/4138882556 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20101a5e70 con 0x7f2010109150 2024-09-11T00:19:31.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.622+0000 7f20077fe640 1 -- 172.21.15.78:0/4138882556 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200800f6b0 con 0x7f2010109150 2024-09-11T00:19:31.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.625+0000 7f20077fe640 1 -- 172.21.15.78:0/4138882556 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f20080054f0 con 0x7f2010109150 2024-09-11T00:19:31.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.625+0000 7f201aafd740 1 Processor -- start 2024-09-11T00:19:31.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.625+0000 7f201aafd740 1 -- start start 2024-09-11T00:19:31.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.625+0000 7f201aafd740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa51ee0 0x555bdaa522c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:31.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.625+0000 7f201aafd740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555bdaa52800 0x555bdaa62660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:31.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.625+0000 7f201aafd740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555bdaa62ba0 0x555bdaa64f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:31.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.625+0000 7f201aafd740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x555bda9c8e60 con 0x555bdaa51ee0 2024-09-11T00:19:31.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.625+0000 7f201aafd740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555bda9b8290 con 0x555bdaa62ba0 2024-09-11T00:19:31.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.625+0000 7f201aafd740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x555bda9bc0a0 con 0x555bdaa52800 2024-09-11T00:19:31.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.625+0000 7f2015cc3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa51ee0 0x555bdaa522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:31.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.625+0000 7f2015cc3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa51ee0 0x555bdaa522c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55656/0 (socket says 172.21.15.78:55656) 2024-09-11T00:19:31.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.625+0000 7f2015cc3640 1 -- 172.21.15.78:0/276281695 learned_addr learned my addr 172.21.15.78:0/276281695 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:19:31.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.626+0000 7f20164c4640 1 --2- 172.21.15.78:0/276281695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555bdaa52800 0x555bdaa62660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:31.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.626+0000 7f2015cc3640 1 --2- 172.21.15.78:0/276281695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555bdaa62ba0 0x555bdaa64f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:31.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.626+0000 7f20077fe640 1 --2- 172.21.15.78:0/4138882556 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1ffc0b5450 0x7f1ffc0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:31.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.626+0000 7f2015cc3640 1 -- 172.21.15.78:0/276281695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555bdaa52800 msgr2=0x555bdaa62660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:31.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.626+0000 7f2015cc3640 1 --2- 172.21.15.78:0/276281695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555bdaa52800 0x555bdaa62660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.669 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:19:31.669 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-11T00:19:31.670 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "e5be74b1-4915-468d-a739-e995b5d71e26", 2024-09-11T00:19:31.670 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-11T00:19:31.670 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:19:31.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.626+0000 7f2015cc3640 1 -- 172.21.15.78:0/276281695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555bdaa62ba0 msgr2=0x555bdaa64f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:31.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.626+0000 7f2015cc3640 1 --2- 172.21.15.78:0/276281695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555bdaa62ba0 0x555bdaa64f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.626+0000 7f2015cc3640 1 -- 172.21.15.78:0/276281695 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bda716930 con 0x555bdaa51ee0 2024-09-11T00:19:31.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.626+0000 7f2016cc5640 1 --2- 172.21.15.78:0/4138882556 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1ffc0b5450 0x7f1ffc0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:31.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.626+0000 7f2015cc3640 1 --2- 172.21.15.78:0/276281695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa51ee0 0x555bdaa522c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f200002a930 tx=0x7f2000009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac442708abb12b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:31.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.626+0000 7f20077fe640 1 -- 172.21.15.78:0/4138882556 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f20080e5f00 con 0x7f2010109150 2024-09-11T00:19:31.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.626+0000 7f2004ff9640 1 -- 172.21.15.78:0/276281695 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2000035040 con 0x555bdaa51ee0 2024-09-11T00:19:31.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.626+0000 7f2004ff9640 1 -- 172.21.15.78:0/276281695 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20000316d0 con 0x555bdaa51ee0 2024-09-11T00:19:31.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.626+0000 7f2004ff9640 1 -- 172.21.15.78:0/276281695 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2000003d70 con 0x555bdaa51ee0 2024-09-11T00:19:31.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.627+0000 7f201aafd740 1 -- 172.21.15.78:0/276281695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa51ee0 msgr2=0x555bdaa522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:31.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.627+0000 7f2016cc5640 1 --2- 172.21.15.78:0/4138882556 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1ffc0b5450 0x7f1ffc0b7910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f200800caa0 tx=0x7f2008079820 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:31.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.627+0000 7f201aafd740 1 --2- 172.21.15.78:0/276281695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa51ee0 0x555bdaa522c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f200002a930 tx=0x7f2000009610 comp rx=0 tx=0).stop 2024-09-11T00:19:31.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.627+0000 7f201aafd740 1 -- 172.21.15.78:0/276281695 shutdown_connections 2024-09-11T00:19:31.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.627+0000 7f201aafd740 1 --2- 172.21.15.78:0/276281695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555bdaa62ba0 0x555bdaa64f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.627+0000 7f201aafd740 1 --2- 172.21.15.78:0/276281695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555bdaa52800 0x555bdaa62660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.627+0000 7f201aafd740 1 --2- 172.21.15.78:0/276281695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa51ee0 0x555bdaa522c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.627+0000 7f201aafd740 1 -- 172.21.15.78:0/276281695 >> 172.21.15.78:0/276281695 conn(0x555bdaa4fd10 msgr2=0x555bdaa50eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:31.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.627+0000 7f201aafd740 1 -- 172.21.15.78:0/276281695 shutdown_connections 2024-09-11T00:19:31.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.627+0000 7f201aafd740 1 -- 172.21.15.78:0/276281695 wait complete. 2024-09-11T00:19:31.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.627+0000 7f201aafd740 1 -- start start 2024-09-11T00:19:31.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.628+0000 7f201aafd740 1 Processor -- start 2024-09-11T00:19:31.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.628+0000 7f201aafd740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa51ee0 0x555bdaa5fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:31.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.628+0000 7f201aafd740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555bdaa52800 0x555bdaa60070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:31.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.628+0000 7f201aafd740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555bdaa62ba0 0x555bdaa605b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:31.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.628+0000 7f201aafd740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x555bda819890 con 0x555bdaa51ee0 2024-09-11T00:19:31.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.628+0000 7f201aafd740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x555bda952d40 con 0x555bdaa52800 2024-09-11T00:19:31.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.628+0000 7f201aafd740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x555bdaa657f0 con 0x555bdaa62ba0 2024-09-11T00:19:31.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.628+0000 7f201aafd740 10 client.0 _ll_register_callbacks cb 0x555bda9b6c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:19:31.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.628+0000 7f2015cc3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa51ee0 0x555bdaa5fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:31.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.628+0000 7f2015cc3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa51ee0 0x555bdaa5fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55664/0 (socket says 172.21.15.78:55664) 2024-09-11T00:19:31.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.628+0000 7f2015cc3640 1 -- 172.21.15.78:0/787304017 learned_addr learned my addr 172.21.15.78:0/787304017 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:19:31.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.628+0000 7f20164c4640 1 --2- 172.21.15.78:0/787304017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555bdaa52800 0x555bdaa60070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:31.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.628+0000 7f2015cc3640 1 --2- 172.21.15.78:0/787304017 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555bdaa62ba0 0x555bdaa605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:31.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.628+0000 7f2015cc3640 1 -- 172.21.15.78:0/787304017 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555bdaa62ba0 msgr2=0x555bdaa605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:31.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.628+0000 7f2015cc3640 1 --2- 172.21.15.78:0/787304017 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555bdaa62ba0 0x555bdaa605b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.628+0000 7f2015cc3640 1 -- 172.21.15.78:0/787304017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555bdaa52800 msgr2=0x555bdaa60070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:31.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.628+0000 7f2015cc3640 1 --2- 172.21.15.78:0/787304017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555bdaa52800 0x555bdaa60070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.628+0000 7f2015cc3640 1 -- 172.21.15.78:0/787304017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bdaa6ebd0 con 0x555bdaa51ee0 2024-09-11T00:19:31.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.628+0000 7f2015cc3640 1 --2- 172.21.15.78:0/787304017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa51ee0 0x555bdaa5fb30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2000031980 tx=0x7f2000003950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817405b3ca76d0b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:31.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.628+0000 7f1ff9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:19:31.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.629+0000 7f1ff9ffb640 1 -- 172.21.15.78:0/787304017 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2000035070 con 0x555bdaa51ee0 2024-09-11T00:19:31.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.629+0000 7f1ff9ffb640 1 -- 172.21.15.78:0/787304017 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f2000045070 con 0x555bdaa51ee0 2024-09-11T00:19:31.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.629+0000 7f201aafd740 1 -- 172.21.15.78:0/787304017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20000316d0 con 0x555bdaa51ee0 2024-09-11T00:19:31.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.629+0000 7f1ff9ffb640 1 -- 172.21.15.78:0/787304017 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2000005020 con 0x555bdaa51ee0 2024-09-11T00:19:31.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.629+0000 7f201aafd740 10 client.15720 fetch_fsmap learned FSMap version 20 2024-09-11T00:19:31.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.629+0000 7f201aafd740 1 -- 172.21.15.78:0/787304017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555bdaa71580 con 0x555bdaa51ee0 2024-09-11T00:19:31.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.629+0000 7f1ff9ffb640 1 -- 172.21.15.78:0/787304017 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20000316d0 con 0x555bdaa51ee0 2024-09-11T00:19:31.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.629+0000 7f1ff9ffb640 1 -- 172.21.15.78:0/787304017 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2000003d80 con 0x555bdaa51ee0 2024-09-11T00:19:31.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.629+0000 7f201aafd740 10 client.15720 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:19:31.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.629+0000 7f201aafd740 10 client.15720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:19:31.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.629+0000 7f201aafd740 20 client.15720 populate_metadata read hostname 'smithi078' 2024-09-11T00:19:31.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.629+0000 7f201aafd740 1 --2- 172.21.15.78:0/787304017 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x555bdaa728d0 0x555bdaa74cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:31.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.629+0000 7f201aafd740 4 client.15720 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:19:31.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.629+0000 7f201aafd740 1 -- 172.21.15.78:0/787304017 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555bda9cadb0 con 0x555bdaa728d0 2024-09-11T00:19:31.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.630+0000 7f20164c4640 1 --2- 172.21.15.78:0/787304017 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x555bdaa728d0 0x555bdaa74cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:31.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.630+0000 7f1ff9ffb640 10 client.15720 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:19:31.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.630+0000 7f20164c4640 1 --2- 172.21.15.78:0/787304017 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x555bdaa728d0 0x555bdaa74cc0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d54883f942823de3 server_cookie=86277998faa4c661 in_seq=0 out_seq=0 2024-09-11T00:19:31.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.631+0000 7f1ff9ffb640 1 -- 172.21.15.78:0/787304017 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555bda9cadb0 con 0x555bdaa728d0 2024-09-11T00:19:31.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.631+0000 7f1ff9ffb640 10 client.15720 handle_command_reply: tid=0 2024-09-11T00:19:31.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.631+0000 7f201aafd740 1 client.15720 shutdown 2024-09-11T00:19:31.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.631+0000 7f201aafd740 1 -- 172.21.15.78:0/787304017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa51ee0 msgr2=0x555bdaa5fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:31.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.631+0000 7f201aafd740 1 --2- 172.21.15.78:0/787304017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa51ee0 0x555bdaa5fb30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2000031980 tx=0x7f2000003950 comp rx=0 tx=0).stop 2024-09-11T00:19:31.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.631+0000 7f201aafd740 1 -- 172.21.15.78:0/787304017 shutdown_connections 2024-09-11T00:19:31.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.631+0000 7f201aafd740 1 --2- 172.21.15.78:0/787304017 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x555bdaa728d0 0x555bdaa74cc0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.631+0000 7f201aafd740 1 --2- 172.21.15.78:0/787304017 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555bdaa62ba0 0x555bdaa605b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.631+0000 7f201aafd740 1 --2- 172.21.15.78:0/787304017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555bdaa52800 0x555bdaa60070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.631+0000 7f1ff9ffb640 0 client.15720 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:19:31.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.631+0000 7f201aafd740 1 --2- 172.21.15.78:0/787304017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa51ee0 0x555bdaa5fb30 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.631+0000 7f201aafd740 1 -- 172.21.15.78:0/787304017 >> 172.21.15.78:0/787304017 conn(0x555bdaa4fd10 msgr2=0x555bdaa4ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:31.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.631+0000 7f201aafd740 1 -- 172.21.15.78:0/787304017 shutdown_connections 2024-09-11T00:19:31.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.631+0000 7f201aafd740 1 -- 172.21.15.78:0/787304017 wait complete. 2024-09-11T00:19:31.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.631+0000 7f201aafd740 20 client.15720 trim_cache size 0 max 16384 2024-09-11T00:19:31.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.648+0000 7f201aafd740 1 Processor -- start 2024-09-11T00:19:31.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.648+0000 7f201aafd740 1 -- start start 2024-09-11T00:19:31.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.648+0000 7f201aafd740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555bdaa4fd10 0x555bdaa5f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:31.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.648+0000 7f201aafd740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa51ee0 0x555bdaa61980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:31.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.648+0000 7f201aafd740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555bdaa52800 0x555bdaa77ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:31.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.648+0000 7f201aafd740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f20101aa470 con 0x555bdaa51ee0 2024-09-11T00:19:31.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.648+0000 7f201aafd740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f20101accf0 con 0x555bdaa4fd10 2024-09-11T00:19:31.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.648+0000 7f201aafd740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f20101aaae0 con 0x555bdaa52800 2024-09-11T00:19:31.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.649+0000 7f20164c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa51ee0 0x555bdaa61980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:31.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.649+0000 7f20164c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa51ee0 0x555bdaa61980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55672/0 (socket says 172.21.15.78:55672) 2024-09-11T00:19:31.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.649+0000 7f20164c4640 1 -- 172.21.15.78:0/352000386 learned_addr learned my addr 172.21.15.78:0/352000386 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:19:31.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.649+0000 7f2015cc3640 1 --2- 172.21.15.78:0/352000386 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555bdaa4fd10 0x555bdaa5f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:31.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.649+0000 7f20164c4640 1 -- 172.21.15.78:0/352000386 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555bdaa52800 msgr2=0x555bdaa77ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:31.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.649+0000 7f20164c4640 1 --2- 172.21.15.78:0/352000386 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555bdaa52800 0x555bdaa77ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.649+0000 7f20164c4640 1 -- 172.21.15.78:0/352000386 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555bdaa4fd10 msgr2=0x555bdaa5f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:31.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.649+0000 7f20164c4640 1 --2- 172.21.15.78:0/352000386 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555bdaa4fd10 0x555bdaa5f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.649+0000 7f20164c4640 1 -- 172.21.15.78:0/352000386 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bdaa52630 con 0x555bdaa51ee0 2024-09-11T00:19:31.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.649+0000 7f2015cc3640 1 --2- 172.21.15.78:0/352000386 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555bdaa4fd10 0x555bdaa5f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:19:31.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.649+0000 7f20164c4640 1 --2- 172.21.15.78:0/352000386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa51ee0 0x555bdaa61980 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f200c00afd0 tx=0x7f200c00a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09c61545305018 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:31.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.649+0000 7f1ffbfff640 1 -- 172.21.15.78:0/352000386 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c005220 con 0x555bdaa51ee0 2024-09-11T00:19:31.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.649+0000 7f1ffbfff640 1 -- 172.21.15.78:0/352000386 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f200c004c50 con 0x555bdaa51ee0 2024-09-11T00:19:31.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.649+0000 7f1ffbfff640 1 -- 172.21.15.78:0/352000386 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c01d9c0 con 0x555bdaa51ee0 2024-09-11T00:19:31.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.650+0000 7f201aafd740 1 -- 172.21.15.78:0/352000386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa51ee0 msgr2=0x555bdaa61980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:31.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.650+0000 7f201aafd740 1 --2- 172.21.15.78:0/352000386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa51ee0 0x555bdaa61980 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f200c00afd0 tx=0x7f200c00a2d0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.650+0000 7f201aafd740 1 -- 172.21.15.78:0/352000386 shutdown_connections 2024-09-11T00:19:31.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.650+0000 7f201aafd740 1 --2- 172.21.15.78:0/352000386 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555bdaa52800 0x555bdaa77ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.650+0000 7f201aafd740 1 --2- 172.21.15.78:0/352000386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa51ee0 0x555bdaa61980 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.650+0000 7f201aafd740 1 --2- 172.21.15.78:0/352000386 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555bdaa4fd10 0x555bdaa5f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.650+0000 7f201aafd740 1 -- 172.21.15.78:0/352000386 >> 172.21.15.78:0/352000386 conn(0x555bdaa64380 msgr2=0x555bdaa51060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:31.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.650+0000 7f201aafd740 1 -- 172.21.15.78:0/352000386 shutdown_connections 2024-09-11T00:19:31.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.650+0000 7f201aafd740 1 -- 172.21.15.78:0/352000386 wait complete. 2024-09-11T00:19:31.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.650+0000 7f201aafd740 1 -- start start 2024-09-11T00:19:31.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.650+0000 7f201aafd740 1 Processor -- start 2024-09-11T00:19:31.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.650+0000 7f201aafd740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555bdaa4fd10 0x555bdaa783a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:31.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.650+0000 7f201aafd740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555bdaa51ee0 0x555bdaa768a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:31.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.650+0000 7f201aafd740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa52800 0x555bdaa76de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:31.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.650+0000 7f201aafd740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f20101ab1b0 con 0x555bdaa52800 2024-09-11T00:19:31.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.650+0000 7f201aafd740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f20101ac620 con 0x555bdaa4fd10 2024-09-11T00:19:31.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.650+0000 7f201aafd740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f20101ab880 con 0x555bdaa51ee0 2024-09-11T00:19:31.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.650+0000 7f201aafd740 10 client.0 _ll_register_callbacks cb 0x7f200c00a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:19:31.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.651+0000 7f2015cc3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa52800 0x555bdaa76de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:31.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.651+0000 7f2015cc3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa52800 0x555bdaa76de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55678/0 (socket says 172.21.15.78:55678) 2024-09-11T00:19:31.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.651+0000 7f2015cc3640 1 -- 172.21.15.78:0/2788033904 learned_addr learned my addr 172.21.15.78:0/2788033904 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:19:31.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.651+0000 7f20164c4640 1 --2- 172.21.15.78:0/2788033904 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555bdaa51ee0 0x555bdaa768a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:31.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.651+0000 7f2015cc3640 1 -- 172.21.15.78:0/2788033904 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555bdaa51ee0 msgr2=0x555bdaa768a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:31.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.651+0000 7f2015cc3640 1 --2- 172.21.15.78:0/2788033904 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555bdaa51ee0 0x555bdaa768a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.651+0000 7f2015cc3640 1 -- 172.21.15.78:0/2788033904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555bdaa4fd10 msgr2=0x555bdaa783a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:31.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.651+0000 7f2015cc3640 1 --2- 172.21.15.78:0/2788033904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555bdaa4fd10 0x555bdaa783a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.651+0000 7f2015cc3640 1 -- 172.21.15.78:0/2788033904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bdaa77520 con 0x555bdaa52800 2024-09-11T00:19:31.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.651+0000 7f2015cc3640 1 --2- 172.21.15.78:0/2788033904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa52800 0x555bdaa76de0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2000006010 tx=0x7f20000314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2249ce6bae253b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:31.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.651+0000 7f1ff9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:19:31.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.651+0000 7f1ff9ffb640 1 -- 172.21.15.78:0/2788033904 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2000035040 con 0x555bdaa52800 2024-09-11T00:19:31.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.651+0000 7f201aafd740 1 -- 172.21.15.78:0/2788033904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f200c004c50 con 0x555bdaa52800 2024-09-11T00:19:31.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.651+0000 7f1ff9ffb640 1 -- 172.21.15.78:0/2788033904 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f2000051040 con 0x555bdaa52800 2024-09-11T00:19:31.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.651+0000 7f1ff9ffb640 1 -- 172.21.15.78:0/2788033904 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2000005850 con 0x555bdaa52800 2024-09-11T00:19:31.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.651+0000 7f201aafd740 10 client.15726 fetch_fsmap learned FSMap version 20 2024-09-11T00:19:31.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.651+0000 7f201aafd740 1 -- 172.21.15.78:0/2788033904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555bdaae0370 con 0x555bdaa52800 2024-09-11T00:19:31.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.651+0000 7f1ff9ffb640 1 -- 172.21.15.78:0/2788033904 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f200c004c50 con 0x555bdaa52800 2024-09-11T00:19:31.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.652+0000 7f1ff9ffb640 1 -- 172.21.15.78:0/2788033904 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f2000064070 con 0x555bdaa52800 2024-09-11T00:19:31.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.652+0000 7f201aafd740 10 client.15726 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:19:31.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.652+0000 7f201aafd740 10 client.15726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:19:31.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.652+0000 7f201aafd740 20 client.15726 populate_metadata read hostname 'smithi078' 2024-09-11T00:19:31.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.652+0000 7f201aafd740 1 --2- 172.21.15.78:0/2788033904 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x555bdaa62ba0 0x555bdaae2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:31.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.652+0000 7f201aafd740 4 client.15726 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:19:31.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.652+0000 7f201aafd740 1 -- 172.21.15.78:0/2788033904 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555bda9c6860 con 0x555bdaa62ba0 2024-09-11T00:19:31.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.652+0000 7f20164c4640 1 --2- 172.21.15.78:0/2788033904 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x555bdaa62ba0 0x555bdaae2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:31.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.652+0000 7f1ff9ffb640 10 client.15726 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:19:31.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.652+0000 7f20164c4640 1 --2- 172.21.15.78:0/2788033904 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x555bdaa62ba0 0x555bdaae2970 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d197e4574fc42f46 server_cookie=3868350421415df6 in_seq=0 out_seq=0 2024-09-11T00:19:31.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.654+0000 7f1ff9ffb640 1 -- 172.21.15.78:0/2788033904 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555bda9c6860 con 0x555bdaa62ba0 2024-09-11T00:19:31.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.654+0000 7f1ff9ffb640 10 client.15726 handle_command_reply: tid=0 2024-09-11T00:19:31.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.654+0000 7f201aafd740 1 client.15726 shutdown 2024-09-11T00:19:31.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.654+0000 7f201aafd740 1 -- 172.21.15.78:0/2788033904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa52800 msgr2=0x555bdaa76de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:31.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.654+0000 7f201aafd740 1 --2- 172.21.15.78:0/2788033904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa52800 0x555bdaa76de0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2000006010 tx=0x7f20000314a0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.654+0000 7f201aafd740 1 -- 172.21.15.78:0/2788033904 shutdown_connections 2024-09-11T00:19:31.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.654+0000 7f201aafd740 1 --2- 172.21.15.78:0/2788033904 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x555bdaa62ba0 0x555bdaae2970 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.654+0000 7f201aafd740 1 --2- 172.21.15.78:0/2788033904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555bdaa52800 0x555bdaa76de0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.654+0000 7f1ff9ffb640 0 client.15726 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:19:31.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.654+0000 7f201aafd740 1 --2- 172.21.15.78:0/2788033904 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555bdaa51ee0 0x555bdaa768a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.654+0000 7f201aafd740 1 --2- 172.21.15.78:0/2788033904 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x555bdaa4fd10 0x555bdaa783a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.654+0000 7f201aafd740 1 -- 172.21.15.78:0/2788033904 >> 172.21.15.78:0/2788033904 conn(0x555bdaa64380 msgr2=0x555bdaa61980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:31.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.654+0000 7f201aafd740 1 -- 172.21.15.78:0/2788033904 shutdown_connections 2024-09-11T00:19:31.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.654+0000 7f201aafd740 1 -- 172.21.15.78:0/2788033904 wait complete. 2024-09-11T00:19:31.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.654+0000 7f201aafd740 20 client.15726 trim_cache size 0 max 16384 2024-09-11T00:19:31.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.655+0000 7f2018728640 1 -- 172.21.15.78:0/4138882556 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1ffc0b5450 msgr2=0x7f1ffc0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:31.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.655+0000 7f2018728640 1 --2- 172.21.15.78:0/4138882556 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1ffc0b5450 0x7f1ffc0b7910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f200800caa0 tx=0x7f2008079820 comp rx=0 tx=0).stop 2024-09-11T00:19:31.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.655+0000 7f2018728640 1 -- 172.21.15.78:0/4138882556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2010109150 msgr2=0x7f201019eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:31.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.655+0000 7f2018728640 1 --2- 172.21.15.78:0/4138882556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2010109150 0x7f201019eb20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f200800cad0 tx=0x7f200800ced0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.655+0000 7f2018728640 1 -- 172.21.15.78:0/4138882556 shutdown_connections 2024-09-11T00:19:31.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.655+0000 7f2018728640 1 --2- 172.21.15.78:0/4138882556 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1ffc0b5450 0x7f1ffc0b7910 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.655+0000 7f2018728640 1 --2- 172.21.15.78:0/4138882556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2010109150 0x7f201019eb20 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.655+0000 7f2018728640 1 --2- 172.21.15.78:0/4138882556 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20101087d0 0x7f2010199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.655+0000 7f2018728640 1 --2- 172.21.15.78:0/4138882556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2010102dc0 0x7f2010199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:31.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.655+0000 7f2018728640 1 -- 172.21.15.78:0/4138882556 >> 172.21.15.78:0/4138882556 conn(0x7f20100fe830 msgr2=0x7f2010100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:31.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.655+0000 7f2018728640 1 -- 172.21.15.78:0/4138882556 shutdown_connections 2024-09-11T00:19:31.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:31.655+0000 7f2018728640 1 -- 172.21.15.78:0/4138882556 wait complete. 2024-09-11T00:19:32.473 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:19:32.720 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:19:33.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:32 smithi078 ceph-mon[30865]: scrub queued for path: / 2024-09-11T00:19:33.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:32 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:19:33.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:32 smithi078 ceph-mon[30865]: scrub summary: active paths [/] 2024-09-11T00:19:33.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:32 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:19:33.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:32 smithi078 ceph-mon[30865]: pgmap v415: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-09-11T00:19:33.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.193+0000 7f34145bc640 1 -- 172.21.15.78:0/1937476177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f340c1087d0 msgr2=0x7f340c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:33.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.193+0000 7f34145bc640 1 --2- 172.21.15.78:0/1937476177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f340c1087d0 0x7f340c108c10 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f33fc009900 tx=0x7f33fc02a410 comp rx=0 tx=0).stop 2024-09-11T00:19:33.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.193+0000 7f34145bc640 1 -- 172.21.15.78:0/1937476177 shutdown_connections 2024-09-11T00:19:33.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.193+0000 7f34145bc640 1 --2- 172.21.15.78:0/1937476177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f340c109150 0x7f340c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.193+0000 7f34145bc640 1 --2- 172.21.15.78:0/1937476177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f340c1087d0 0x7f340c108c10 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.193+0000 7f34145bc640 1 --2- 172.21.15.78:0/1937476177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f340c102dc0 0x7f340c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.193+0000 7f34145bc640 1 -- 172.21.15.78:0/1937476177 >> 172.21.15.78:0/1937476177 conn(0x7f340c0fe830 msgr2=0x7f340c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:33.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.193+0000 7f34145bc640 1 -- 172.21.15.78:0/1937476177 shutdown_connections 2024-09-11T00:19:33.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.193+0000 7f34145bc640 1 -- 172.21.15.78:0/1937476177 wait complete. 2024-09-11T00:19:33.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.194+0000 7f34145bc640 1 Processor -- start 2024-09-11T00:19:33.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.194+0000 7f34145bc640 1 -- start start 2024-09-11T00:19:33.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.194+0000 7f34145bc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f340c102dc0 0x7f340c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:33.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.194+0000 7f34145bc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f340c1087d0 0x7f340c199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:33.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.194+0000 7f34145bc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f340c109150 0x7f340c19ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:33.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.194+0000 7f34145bc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f340c112e10 con 0x7f340c102dc0 2024-09-11T00:19:33.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.194+0000 7f34145bc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f340c112c90 con 0x7f340c1087d0 2024-09-11T00:19:33.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.194+0000 7f34145bc640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f340c112f90 con 0x7f340c109150 2024-09-11T00:19:33.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.194+0000 7f3412358640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f340c102dc0 0x7f340c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:33.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.194+0000 7f3412358640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f340c102dc0 0x7f340c199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55694/0 (socket says 172.21.15.78:55694) 2024-09-11T00:19:33.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.194+0000 7f3412358640 1 -- 172.21.15.78:0/406431932 learned_addr learned my addr 172.21.15.78:0/406431932 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:19:33.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.194+0000 7f3411b57640 1 --2- 172.21.15.78:0/406431932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f340c1087d0 0x7f340c199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:33.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.194+0000 7f3412358640 1 -- 172.21.15.78:0/406431932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f340c109150 msgr2=0x7f340c19ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:33.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.194+0000 7f3412358640 1 --2- 172.21.15.78:0/406431932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f340c109150 0x7f340c19ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.194+0000 7f3412358640 1 -- 172.21.15.78:0/406431932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f340c1087d0 msgr2=0x7f340c199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:33.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.194+0000 7f3412358640 1 --2- 172.21.15.78:0/406431932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f340c1087d0 0x7f340c199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.194+0000 7f3412358640 1 -- 172.21.15.78:0/406431932 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340c19f3d0 con 0x7f340c102dc0 2024-09-11T00:19:33.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.194+0000 7f3412358640 1 --2- 172.21.15.78:0/406431932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f340c102dc0 0x7f340c199320 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f340800b4a0 tx=0x7f340800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:33.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.195+0000 7f34037fe640 1 -- 172.21.15.78:0/406431932 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3408014070 con 0x7f340c102dc0 2024-09-11T00:19:33.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.195+0000 7f34145bc640 1 -- 172.21.15.78:0/406431932 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f340c19f6c0 con 0x7f340c102dc0 2024-09-11T00:19:33.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.195+0000 7f34037fe640 1 -- 172.21.15.78:0/406431932 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3408010ac0 con 0x7f340c102dc0 2024-09-11T00:19:33.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.195+0000 7f34037fe640 1 -- 172.21.15.78:0/406431932 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3408017c30 con 0x7f340c102dc0 2024-09-11T00:19:33.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.195+0000 7f34145bc640 1 -- 172.21.15.78:0/406431932 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f340c1a5d80 con 0x7f340c102dc0 2024-09-11T00:19:33.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.197+0000 7f34037fe640 1 -- 172.21.15.78:0/406431932 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f3408010610 con 0x7f340c102dc0 2024-09-11T00:19:33.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.197+0000 7f3416991740 1 Processor -- start 2024-09-11T00:19:33.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.197+0000 7f3416991740 1 -- start start 2024-09-11T00:19:33.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.198+0000 7f3416991740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1b480 0x55ff59c1b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:33.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.198+0000 7f3416991740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff59c1bda0 0x55ff59c277f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:33.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.198+0000 7f3416991740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff59c27d30 0x55ff59c2a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:33.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.198+0000 7f3416991740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ff59b91e50 con 0x55ff59c1b480 2024-09-11T00:19:33.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.198+0000 7f3416991740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ff59b81280 con 0x55ff59c27d30 2024-09-11T00:19:33.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.198+0000 7f3416991740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55ff59b85090 con 0x55ff59c1bda0 2024-09-11T00:19:33.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.198+0000 7f3412b59640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1b480 0x55ff59c1b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:33.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.198+0000 7f3412b59640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1b480 0x55ff59c1b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55702/0 (socket says 172.21.15.78:55702) 2024-09-11T00:19:33.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.198+0000 7f3412b59640 1 -- 172.21.15.78:0/2471026448 learned_addr learned my addr 172.21.15.78:0/2471026448 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:19:33.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.198+0000 7f3411b57640 1 --2- 172.21.15.78:0/2471026448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff59c27d30 0x55ff59c2a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:33.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.198+0000 7f3412358640 1 --2- 172.21.15.78:0/2471026448 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff59c1bda0 0x55ff59c277f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:33.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.198+0000 7f34037fe640 1 --2- 172.21.15.78:0/406431932 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f33f80b5450 0x7f33f80b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:33.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.198+0000 7f3412b59640 1 -- 172.21.15.78:0/2471026448 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff59c1bda0 msgr2=0x55ff59c277f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:33.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.198+0000 7f3412b59640 1 --2- 172.21.15.78:0/2471026448 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff59c1bda0 0x55ff59c277f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.198+0000 7f3412b59640 1 -- 172.21.15.78:0/2471026448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff59c27d30 msgr2=0x55ff59c2a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:33.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.198+0000 7f3412b59640 1 --2- 172.21.15.78:0/2471026448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff59c27d30 0x55ff59c2a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.198+0000 7f3412b59640 1 -- 172.21.15.78:0/2471026448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff598df650 con 0x55ff59c1b480 2024-09-11T00:19:33.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.198+0000 7f3411b57640 1 --2- 172.21.15.78:0/2471026448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff59c27d30 0x55ff59c2a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:19:33.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.198+0000 7f3412b59640 1 --2- 172.21.15.78:0/406431932 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f33f80b5450 0x7f33f80b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:33.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.198+0000 7f34037fe640 1 -- 172.21.15.78:0/406431932 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f34080e5690 con 0x7f340c102dc0 2024-09-11T00:19:33.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.198+0000 7f3412b59640 1 --2- 172.21.15.78:0/2471026448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1b480 0x55ff59c1b860 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f3404009d80 tx=0x7f340400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01b3066f1a3c6ab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:33.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.199+0000 7f3400ff9640 1 -- 172.21.15.78:0/2471026448 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340401e950 con 0x55ff59c1b480 2024-09-11T00:19:33.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.199+0000 7f3400ff9640 1 -- 172.21.15.78:0/2471026448 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3404016070 con 0x55ff59c1b480 2024-09-11T00:19:33.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.199+0000 7f3400ff9640 1 -- 172.21.15.78:0/2471026448 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340401dbd0 con 0x55ff59c1b480 2024-09-11T00:19:33.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.199+0000 7f3416991740 1 -- 172.21.15.78:0/2471026448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1b480 msgr2=0x55ff59c1b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:33.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.199+0000 7f3412b59640 1 --2- 172.21.15.78:0/406431932 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f33f80b5450 0x7f33f80b7910 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f340401d000 tx=0x7f340401e000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:33.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.199+0000 7f3416991740 1 --2- 172.21.15.78:0/2471026448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1b480 0x55ff59c1b860 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f3404009d80 tx=0x7f340400e6c0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.200+0000 7f3416991740 1 -- 172.21.15.78:0/2471026448 shutdown_connections 2024-09-11T00:19:33.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.200+0000 7f3416991740 1 --2- 172.21.15.78:0/2471026448 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff59c27d30 0x55ff59c2a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.200+0000 7f3416991740 1 --2- 172.21.15.78:0/2471026448 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff59c1bda0 0x55ff59c277f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.200+0000 7f3416991740 1 --2- 172.21.15.78:0/2471026448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1b480 0x55ff59c1b860 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.200+0000 7f3416991740 1 -- 172.21.15.78:0/2471026448 >> 172.21.15.78:0/2471026448 conn(0x55ff59c192b0 msgr2=0x55ff59c1a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:33.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.200+0000 7f3416991740 1 -- 172.21.15.78:0/2471026448 shutdown_connections 2024-09-11T00:19:33.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.200+0000 7f3416991740 1 -- 172.21.15.78:0/2471026448 wait complete. 2024-09-11T00:19:33.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.200+0000 7f3416991740 1 -- start start 2024-09-11T00:19:33.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.200+0000 7f3416991740 1 Processor -- start 2024-09-11T00:19:33.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.200+0000 7f3416991740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1b480 0x55ff59c27640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:33.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.200+0000 7f3416991740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff59c1bda0 0x55ff59c24a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:33.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.200+0000 7f3416991740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff59c27d30 0x55ff59c250c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:33.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.200+0000 7f3416991740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ff599e2700 con 0x55ff59c1b480 2024-09-11T00:19:33.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.200+0000 7f3416991740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ff59b1c110 con 0x55ff59c27d30 2024-09-11T00:19:33.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.200+0000 7f3416991740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55ff59c2a9b0 con 0x55ff59c1bda0 2024-09-11T00:19:33.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.200+0000 7f3416991740 10 client.0 _ll_register_callbacks cb 0x55ff59b35990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:19:33.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.200+0000 7f3412358640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1b480 0x55ff59c27640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:33.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.200+0000 7f3412358640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1b480 0x55ff59c27640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55706/0 (socket says 172.21.15.78:55706) 2024-09-11T00:19:33.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.200+0000 7f3412358640 1 -- 172.21.15.78:0/1846527970 learned_addr learned my addr 172.21.15.78:0/1846527970 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:19:33.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.201+0000 7f3412b59640 1 --2- 172.21.15.78:0/1846527970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff59c27d30 0x55ff59c250c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:33.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.201+0000 7f3411b57640 1 --2- 172.21.15.78:0/1846527970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff59c1bda0 0x55ff59c24a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:33.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.201+0000 7f3412358640 1 -- 172.21.15.78:0/1846527970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff59c1bda0 msgr2=0x55ff59c24a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:33.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.201+0000 7f3412358640 1 --2- 172.21.15.78:0/1846527970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff59c1bda0 0x55ff59c24a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.201+0000 7f3412358640 1 -- 172.21.15.78:0/1846527970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff59c27d30 msgr2=0x55ff59c250c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:33.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.201+0000 7f3412358640 1 --2- 172.21.15.78:0/1846527970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff59c27d30 0x55ff59c250c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.201+0000 7f3412358640 1 -- 172.21.15.78:0/1846527970 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff59b49c40 con 0x55ff59c1b480 2024-09-11T00:19:33.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.201+0000 7f3412358640 1 --2- 172.21.15.78:0/1846527970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1b480 0x55ff59c27640 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f340800be60 tx=0x7f34080ab960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c94b4e03ba0c1d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:33.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.201+0000 7f33f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:19:33.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.201+0000 7f33f5ffb640 1 -- 172.21.15.78:0/1846527970 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340801e030 con 0x55ff59c1b480 2024-09-11T00:19:33.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.201+0000 7f33f5ffb640 1 -- 172.21.15.78:0/1846527970 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f34080e3020 con 0x55ff59c1b480 2024-09-11T00:19:33.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.201+0000 7f3416991740 1 -- 172.21.15.78:0/1846527970 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3404016070 con 0x55ff59c1b480 2024-09-11T00:19:33.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.201+0000 7f33f5ffb640 1 -- 172.21.15.78:0/1846527970 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f34080a7240 con 0x55ff59c1b480 2024-09-11T00:19:33.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.201+0000 7f3416991740 10 client.15738 fetch_fsmap learned FSMap version 20 2024-09-11T00:19:33.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.201+0000 7f3416991740 1 -- 172.21.15.78:0/1846527970 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ff59c36360 con 0x55ff59c1b480 2024-09-11T00:19:33.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.201+0000 7f33f5ffb640 1 -- 172.21.15.78:0/1846527970 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3404016070 con 0x55ff59c1b480 2024-09-11T00:19:33.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.201+0000 7f33f5ffb640 1 -- 172.21.15.78:0/1846527970 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f34080b00d0 con 0x55ff59c1b480 2024-09-11T00:19:33.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.201+0000 7f3416991740 10 client.15738 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:19:33.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.201+0000 7f3416991740 10 client.15738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:19:33.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.202+0000 7f3416991740 20 client.15738 populate_metadata read hostname 'smithi078' 2024-09-11T00:19:33.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.202+0000 7f3416991740 1 --2- 172.21.15.78:0/1846527970 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ff59c376b0 0x55ff59c39b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:33.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.202+0000 7f3416991740 4 client.15738 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:19:33.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.202+0000 7f3416991740 1 -- 172.21.15.78:0/1846527970 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff59b93da0 con 0x55ff59c376b0 2024-09-11T00:19:33.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.202+0000 7f3411b57640 1 --2- 172.21.15.78:0/1846527970 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ff59c376b0 0x55ff59c39b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:33.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.202+0000 7f3411b57640 1 --2- 172.21.15.78:0/1846527970 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ff59c376b0 0x55ff59c39b00 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=294739fee144ee5a server_cookie=f5823c8e1ca5f903 in_seq=0 out_seq=0 2024-09-11T00:19:33.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.202+0000 7f33f5ffb640 10 client.15738 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:19:33.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.203+0000 7f33f5ffb640 1 -- 172.21.15.78:0/1846527970 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ff59b93da0 con 0x55ff59c376b0 2024-09-11T00:19:33.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.203+0000 7f33f5ffb640 10 client.15738 handle_command_reply: tid=0 2024-09-11T00:19:33.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.203+0000 7f3416991740 1 client.15738 shutdown 2024-09-11T00:19:33.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.203+0000 7f3416991740 1 -- 172.21.15.78:0/1846527970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1b480 msgr2=0x55ff59c27640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:33.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.203+0000 7f3416991740 1 --2- 172.21.15.78:0/1846527970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1b480 0x55ff59c27640 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f340800be60 tx=0x7f34080ab960 comp rx=0 tx=0).stop 2024-09-11T00:19:33.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.203+0000 7f3416991740 1 -- 172.21.15.78:0/1846527970 shutdown_connections 2024-09-11T00:19:33.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.203+0000 7f3416991740 1 --2- 172.21.15.78:0/1846527970 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ff59c376b0 0x55ff59c39b00 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.203+0000 7f3416991740 1 --2- 172.21.15.78:0/1846527970 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff59c27d30 0x55ff59c250c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.203+0000 7f3416991740 1 --2- 172.21.15.78:0/1846527970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff59c1bda0 0x55ff59c24a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.203+0000 7f33f5ffb640 0 client.15738 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:19:33.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.203+0000 7f3416991740 1 --2- 172.21.15.78:0/1846527970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1b480 0x55ff59c27640 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.203+0000 7f3416991740 1 -- 172.21.15.78:0/1846527970 >> 172.21.15.78:0/1846527970 conn(0x55ff59c192b0 msgr2=0x55ff59c1ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:33.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.203+0000 7f3416991740 1 -- 172.21.15.78:0/1846527970 shutdown_connections 2024-09-11T00:19:33.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.203+0000 7f3416991740 1 -- 172.21.15.78:0/1846527970 wait complete. 2024-09-11T00:19:33.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.203+0000 7f3416991740 20 client.15738 trim_cache size 0 max 16384 2024-09-11T00:19:33.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.220+0000 7f3416991740 1 Processor -- start 2024-09-11T00:19:33.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.220+0000 7f3416991740 1 -- start start 2024-09-11T00:19:33.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.220+0000 7f3416991740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1b480 0x55ff59c33c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:33.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.220+0000 7f3416991740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff59c1bda0 0x55ff59c29120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:33.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.220+0000 7f3416991740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff59c27d30 0x55ff59c29660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:33.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.220+0000 7f3416991740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f340c1ac790 con 0x55ff59c1b480 2024-09-11T00:19:33.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.220+0000 7f3416991740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f340c1af010 con 0x55ff59c1bda0 2024-09-11T00:19:33.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.220+0000 7f3416991740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f340c1ace00 con 0x55ff59c27d30 2024-09-11T00:19:33.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.221+0000 7f3412358640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1b480 0x55ff59c33c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:33.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.221+0000 7f3412358640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1b480 0x55ff59c33c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55720/0 (socket says 172.21.15.78:55720) 2024-09-11T00:19:33.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.221+0000 7f3412358640 1 -- 172.21.15.78:0/291018705 learned_addr learned my addr 172.21.15.78:0/291018705 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:19:33.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.221+0000 7f3411b57640 1 --2- 172.21.15.78:0/291018705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff59c1bda0 0x55ff59c29120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:33.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.221+0000 7f3412358640 1 -- 172.21.15.78:0/291018705 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff59c27d30 msgr2=0x55ff59c29660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:33.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.221+0000 7f3412358640 1 --2- 172.21.15.78:0/291018705 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff59c27d30 0x55ff59c29660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.221+0000 7f3412358640 1 -- 172.21.15.78:0/291018705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff59c1bda0 msgr2=0x55ff59c29120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:33.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.221+0000 7f3412358640 1 --2- 172.21.15.78:0/291018705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff59c1bda0 0x55ff59c29120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.221+0000 7f3412358640 1 -- 172.21.15.78:0/291018705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff59c24840 con 0x55ff59c1b480 2024-09-11T00:19:33.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.221+0000 7f3412358640 1 --2- 172.21.15.78:0/291018705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1b480 0x55ff59c33c30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f34080b0040 tx=0x7f340800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd58952a4ffedb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:33.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.221+0000 7f33f7fff640 1 -- 172.21.15.78:0/291018705 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340801e070 con 0x55ff59c1b480 2024-09-11T00:19:33.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.221+0000 7f33f7fff640 1 -- 172.21.15.78:0/291018705 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3408017360 con 0x55ff59c1b480 2024-09-11T00:19:33.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.221+0000 7f33f7fff640 1 -- 172.21.15.78:0/291018705 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34080a7420 con 0x55ff59c1b480 2024-09-11T00:19:33.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.222+0000 7f3416991740 1 -- 172.21.15.78:0/291018705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1b480 msgr2=0x55ff59c33c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:33.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.222+0000 7f3416991740 1 --2- 172.21.15.78:0/291018705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1b480 0x55ff59c33c30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f34080b0040 tx=0x7f340800bf90 comp rx=0 tx=0).stop 2024-09-11T00:19:33.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.222+0000 7f3416991740 1 -- 172.21.15.78:0/291018705 shutdown_connections 2024-09-11T00:19:33.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.222+0000 7f3416991740 1 --2- 172.21.15.78:0/291018705 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff59c27d30 0x55ff59c29660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.222+0000 7f3416991740 1 --2- 172.21.15.78:0/291018705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff59c1bda0 0x55ff59c29120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.222+0000 7f3416991740 1 --2- 172.21.15.78:0/291018705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1b480 0x55ff59c33c30 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.222+0000 7f3416991740 1 -- 172.21.15.78:0/291018705 >> 172.21.15.78:0/291018705 conn(0x55ff59c192b0 msgr2=0x55ff59c1fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:33.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.222+0000 7f3416991740 1 -- 172.21.15.78:0/291018705 shutdown_connections 2024-09-11T00:19:33.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.222+0000 7f3416991740 1 -- 172.21.15.78:0/291018705 wait complete. 2024-09-11T00:19:33.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.222+0000 7f3416991740 1 -- start start 2024-09-11T00:19:33.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.222+0000 7f3416991740 1 Processor -- start 2024-09-11T00:19:33.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.222+0000 7f3416991740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff59c1b480 0x55ff59c2fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:33.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.222+0000 7f3416991740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1bda0 0x55ff59c30440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:33.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.222+0000 7f3416991740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff59c27d30 0x55ff59c2ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:33.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.222+0000 7f3416991740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f340c1ad4d0 con 0x55ff59c1bda0 2024-09-11T00:19:33.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.222+0000 7f3416991740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f340c1ae940 con 0x55ff59c1b480 2024-09-11T00:19:33.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.222+0000 7f3416991740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f340c1adba0 con 0x55ff59c27d30 2024-09-11T00:19:33.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.222+0000 7f3416991740 10 client.0 _ll_register_callbacks cb 0x7f3408010930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:19:33.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.222+0000 7f3411b57640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1bda0 0x55ff59c30440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:33.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.222+0000 7f3411b57640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1bda0 0x55ff59c30440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55726/0 (socket says 172.21.15.78:55726) 2024-09-11T00:19:33.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.223+0000 7f3411b57640 1 -- 172.21.15.78:0/3817864765 learned_addr learned my addr 172.21.15.78:0/3817864765 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:19:33.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.223+0000 7f3412358640 1 --2- 172.21.15.78:0/3817864765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff59c1b480 0x55ff59c2fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:33.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.223+0000 7f3412b59640 1 --2- 172.21.15.78:0/3817864765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff59c27d30 0x55ff59c2ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:33.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.223+0000 7f3411b57640 1 -- 172.21.15.78:0/3817864765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff59c27d30 msgr2=0x55ff59c2ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:33.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.223+0000 7f3411b57640 1 --2- 172.21.15.78:0/3817864765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff59c27d30 0x55ff59c2ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.223+0000 7f3411b57640 1 -- 172.21.15.78:0/3817864765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff59c1b480 msgr2=0x55ff59c2fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:19:33.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.223+0000 7f3411b57640 1 --2- 172.21.15.78:0/3817864765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff59c1b480 0x55ff59c2fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.223+0000 7f3411b57640 1 -- 172.21.15.78:0/3817864765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff59c2b480 con 0x55ff59c1bda0 2024-09-11T00:19:33.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.223+0000 7f3411b57640 1 --2- 172.21.15.78:0/3817864765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1bda0 0x55ff59c30440 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f33fc02a930 tx=0x7f33fc005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c131a92441fb8d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:19:33.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.223+0000 7f33f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:19:33.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.223+0000 7f33f5ffb640 1 -- 172.21.15.78:0/3817864765 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33fc035040 con 0x55ff59c1bda0 2024-09-11T00:19:33.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.223+0000 7f33f5ffb640 1 -- 172.21.15.78:0/3817864765 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f33fc004390 con 0x55ff59c1bda0 2024-09-11T00:19:33.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.223+0000 7f3416991740 1 -- 172.21.15.78:0/3817864765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ff59b8f850 con 0x55ff59c1bda0 2024-09-11T00:19:33.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.223+0000 7f33f5ffb640 1 -- 172.21.15.78:0/3817864765 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f33fc050050 con 0x55ff59c1bda0 2024-09-11T00:19:33.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.223+0000 7f3416991740 10 client.15744 fetch_fsmap learned FSMap version 20 2024-09-11T00:19:33.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.223+0000 7f3416991740 1 -- 172.21.15.78:0/3817864765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ff59ca50f0 con 0x55ff59c1bda0 2024-09-11T00:19:33.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.223+0000 7f33f5ffb640 1 -- 172.21.15.78:0/3817864765 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ff59b8f850 con 0x55ff59c1bda0 2024-09-11T00:19:33.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.224+0000 7f33f5ffb640 1 -- 172.21.15.78:0/3817864765 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f33fc004b20 con 0x55ff59c1bda0 2024-09-11T00:19:33.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.224+0000 7f3416991740 10 client.15744 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:19:33.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.224+0000 7f3416991740 10 client.15744 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:19:33.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.224+0000 7f3416991740 20 client.15744 populate_metadata read hostname 'smithi078' 2024-09-11T00:19:33.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.224+0000 7f3416991740 1 --2- 172.21.15.78:0/3817864765 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ff59ca58a0 0x55ff59ca7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:19:33.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.224+0000 7f3416991740 4 client.15744 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:19:33.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.224+0000 7f3416991740 1 -- 172.21.15.78:0/3817864765 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ff59b8cc80 con 0x55ff59ca58a0 2024-09-11T00:19:33.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.224+0000 7f3412358640 1 --2- 172.21.15.78:0/3817864765 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ff59ca58a0 0x55ff59ca7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:19:33.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.224+0000 7f3412358640 1 --2- 172.21.15.78:0/3817864765 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ff59ca58a0 0x55ff59ca7cc0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b46d75c22aef3df server_cookie=b30aec2bd8058d90 in_seq=0 out_seq=0 2024-09-11T00:19:33.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.224+0000 7f33f5ffb640 10 client.15744 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:19:33.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f33f5ffb640 1 -- 172.21.15.78:0/3817864765 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x55ff59b8cc80 con 0x55ff59ca58a0 2024-09-11T00:19:33.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f33f5ffb640 10 client.15744 handle_command_reply: tid=0 2024-09-11T00:19:33.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f3416991740 1 client.15744 shutdown 2024-09-11T00:19:33.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f3416991740 1 -- 172.21.15.78:0/3817864765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1bda0 msgr2=0x55ff59c30440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:33.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f3416991740 1 --2- 172.21.15.78:0/3817864765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1bda0 0x55ff59c30440 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f33fc02a930 tx=0x7f33fc005c00 comp rx=0 tx=0).stop 2024-09-11T00:19:33.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f3416991740 1 -- 172.21.15.78:0/3817864765 shutdown_connections 2024-09-11T00:19:33.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f3416991740 1 --2- 172.21.15.78:0/3817864765 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ff59ca58a0 0x55ff59ca7cc0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f3416991740 1 --2- 172.21.15.78:0/3817864765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ff59c27d30 0x55ff59c2ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f3416991740 1 --2- 172.21.15.78:0/3817864765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff59c1bda0 0x55ff59c30440 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f33f5ffb640 0 client.15744 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:19:33.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f3416991740 1 --2- 172.21.15.78:0/3817864765 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ff59c1b480 0x55ff59c2fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f3416991740 1 -- 172.21.15.78:0/3817864765 >> 172.21.15.78:0/3817864765 conn(0x55ff59c192b0 msgr2=0x55ff59c260c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:33.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f3416991740 1 -- 172.21.15.78:0/3817864765 shutdown_connections 2024-09-11T00:19:33.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f3416991740 1 -- 172.21.15.78:0/3817864765 wait complete. 2024-09-11T00:19:33.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f3416991740 20 client.15744 trim_cache size 0 max 16384 2024-09-11T00:19:33.245 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:19:33.245 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:19:33.245 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-11T00:19:33.245 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:19:33.245 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:19:33.245 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "e5be74b1-4915-468d-a739-e995b5d71e26", 2024-09-11T00:19:33.245 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-11T00:19:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:19:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:19:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:19:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:19:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:19:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:19:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:19:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:19:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:19:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:19:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:19:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:19:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:19:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:19:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:19:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:19:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:19:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:19:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:19:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:19:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:19:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:19:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:19:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:19:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:19:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:19:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:19:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:19:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:19:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:19:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:19:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:19:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:19:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:19:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:19:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:19:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:19:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:19:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:19:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:19:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:19:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:19:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:19:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:19:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:19:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:19:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:19:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:19:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:19:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:19:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:19:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:19:33.249 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:19:33.250 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:32 smithi112 ceph-mon[35627]: scrub queued for path: / 2024-09-11T00:19:33.250 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:32 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:19:33.250 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:32 smithi112 ceph-mon[35627]: scrub summary: active paths [/] 2024-09-11T00:19:33.250 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:32 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:19:33.250 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:32 smithi112 ceph-mon[35627]: pgmap v415: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-09-11T00:19:33.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f34145bc640 1 -- 172.21.15.78:0/406431932 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f33f80b5450 msgr2=0x7f33f80b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:33.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f34145bc640 1 --2- 172.21.15.78:0/406431932 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f33f80b5450 0x7f33f80b7910 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f340401d000 tx=0x7f340401e000 comp rx=0 tx=0).stop 2024-09-11T00:19:33.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f34145bc640 1 -- 172.21.15.78:0/406431932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f340c102dc0 msgr2=0x7f340c199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:19:33.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f34145bc640 1 --2- 172.21.15.78:0/406431932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f340c102dc0 0x7f340c199320 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f340800b4a0 tx=0x7f340800b960 comp rx=0 tx=0).stop 2024-09-11T00:19:33.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f34145bc640 1 -- 172.21.15.78:0/406431932 shutdown_connections 2024-09-11T00:19:33.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f34145bc640 1 --2- 172.21.15.78:0/406431932 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f33f80b5450 0x7f33f80b7910 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f34145bc640 1 --2- 172.21.15.78:0/406431932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f340c109150 0x7f340c19ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f34145bc640 1 --2- 172.21.15.78:0/406431932 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f340c1087d0 0x7f340c199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f34145bc640 1 --2- 172.21.15.78:0/406431932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f340c102dc0 0x7f340c199320 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:19:33.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.225+0000 7f34145bc640 1 -- 172.21.15.78:0/406431932 >> 172.21.15.78:0/406431932 conn(0x7f340c0fe830 msgr2=0x7f340c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:19:33.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.226+0000 7f34145bc640 1 -- 172.21.15.78:0/406431932 shutdown_connections 2024-09-11T00:19:33.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:19:33.226+0000 7f34145bc640 1 -- 172.21.15.78:0/406431932 wait complete. 2024-09-11T00:19:33.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:32 smithi138 ceph-mon[35019]: scrub queued for path: / 2024-09-11T00:19:33.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:32 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:19:33.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:32 smithi138 ceph-mon[35019]: scrub summary: active paths [/] 2024-09-11T00:19:33.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:32 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:19:33.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:32 smithi138 ceph-mon[35019]: pgmap v415: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-09-11T00:19:34.191 INFO:tasks.cephfs.filesystem:scrub status for tag:e5be74b1-4915-468d-a739-e995b5d71e26 - {'path': '/', 'tag': 'e5be74b1-4915-468d-a739-e995b5d71e26', 'options': 'recursive,force'} 2024-09-11T00:19:35.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:34 smithi078 ceph-mon[30865]: pgmap v416: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:19:35.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:34 smithi112 ceph-mon[35627]: pgmap v416: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:19:35.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:34 smithi138 ceph-mon[35019]: pgmap v416: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:19:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:36 smithi078 ceph-mon[30865]: pgmap v417: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-11T00:19:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:36 smithi078 ceph-mon[30865]: scrub summary: idle 2024-09-11T00:19:37.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:36 smithi112 ceph-mon[35627]: pgmap v417: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-11T00:19:37.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:36 smithi112 ceph-mon[35627]: scrub summary: idle 2024-09-11T00:19:37.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:36 smithi138 ceph-mon[35019]: pgmap v417: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-11T00:19:37.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:36 smithi138 ceph-mon[35019]: scrub summary: idle 2024-09-11T00:19:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:37 smithi112 ceph-mon[35627]: pgmap v418: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:19:38.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:37 smithi138 ceph-mon[35019]: pgmap v418: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:19:38.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:37 smithi078 ceph-mon[30865]: pgmap v418: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:19:39.180 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:38 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:19:39.180 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:38 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:19:39.180 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:38 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:19:39.180 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:38 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:19:39.193 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:38 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:19:39.194 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:38 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:19:39.194 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:38 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:19:39.194 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:38 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:19:39.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:38 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:19:39.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:38 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:19:39.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:38 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:19:39.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:38 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:19:40.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:39 smithi112 ceph-mon[35627]: pgmap v419: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:19:40.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:39 smithi138 ceph-mon[35019]: pgmap v419: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:19:40.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:39 smithi078 ceph-mon[30865]: pgmap v419: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:19:43.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:42 smithi078 ceph-mon[30865]: pgmap v420: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:19:43.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:42 smithi112 ceph-mon[35627]: pgmap v420: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:19:43.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:42 smithi138 ceph-mon[35019]: pgmap v420: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:19:45.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:44 smithi078 ceph-mon[30865]: pgmap v421: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:19:45.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:44 smithi112 ceph-mon[35627]: pgmap v421: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:19:45.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:44 smithi138 ceph-mon[35019]: pgmap v421: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:19:47.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:46 smithi078 ceph-mon[30865]: pgmap v422: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:19:47.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:46 smithi112 ceph-mon[35627]: pgmap v422: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:19:47.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:46 smithi138 ceph-mon[35019]: pgmap v422: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:19:49.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:48 smithi078 ceph-mon[30865]: pgmap v423: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-11T00:19:49.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:48 smithi112 ceph-mon[35627]: pgmap v423: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-11T00:19:49.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:48 smithi138 ceph-mon[35019]: pgmap v423: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-11T00:19:50.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:49 smithi078 ceph-mon[30865]: pgmap v424: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:19:50.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:49 smithi112 ceph-mon[35627]: pgmap v424: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:19:50.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:49 smithi138 ceph-mon[35019]: pgmap v424: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:19:53.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:52 smithi078 ceph-mon[30865]: pgmap v425: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:19:53.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:52 smithi112 ceph-mon[35627]: pgmap v425: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:19:53.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:52 smithi138 ceph-mon[35019]: pgmap v425: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:19:55.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:54 smithi078 ceph-mon[30865]: pgmap v426: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:19:55.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:54 smithi112 ceph-mon[35627]: pgmap v426: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:19:55.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:54 smithi138 ceph-mon[35019]: pgmap v426: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:19:57.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:56 smithi078 ceph-mon[30865]: pgmap v427: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:19:57.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:56 smithi112 ceph-mon[35627]: pgmap v427: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:19:57.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:56 smithi138 ceph-mon[35019]: pgmap v427: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:19:58.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:19:57 smithi112 ceph-mon[35627]: pgmap v428: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:19:58.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:19:57 smithi138 ceph-mon[35019]: pgmap v428: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:19:58.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:19:57 smithi078 ceph-mon[30865]: pgmap v428: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:01.062 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:00 smithi078 ceph-mon[30865]: pgmap v429: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:01.062 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:00 smithi078 ceph-mon[30865]: overall HEALTH_OK 2024-09-11T00:20:01.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:00 smithi112 ceph-mon[35627]: pgmap v429: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:01.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:00 smithi112 ceph-mon[35627]: overall HEALTH_OK 2024-09-11T00:20:01.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:00 smithi138 ceph-mon[35019]: pgmap v429: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:01.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:00 smithi138 ceph-mon[35019]: overall HEALTH_OK 2024-09-11T00:20:03.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:02 smithi078 ceph-mon[30865]: pgmap v430: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-11T00:20:03.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:02 smithi112 ceph-mon[35627]: pgmap v430: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-11T00:20:03.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:02 smithi138 ceph-mon[35019]: pgmap v430: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-11T00:20:04.192 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:20:04.462 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:20:04.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:04 smithi078 ceph-mon[30865]: pgmap v431: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:20:05.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.988+0000 7fc26f227640 1 -- 172.21.15.78:0/1500111490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc268102de0 msgr2=0x7fc2681031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:05.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.988+0000 7fc26f227640 1 --2- 172.21.15.78:0/1500111490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc268102de0 0x7fc2681031c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc258009ca0 tx=0x7fc25802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.988+0000 7fc26f227640 1 -- 172.21.15.78:0/1500111490 shutdown_connections 2024-09-11T00:20:05.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.988+0000 7fc26f227640 1 --2- 172.21.15.78:0/1500111490 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc268109170 0x7fc26810f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.988+0000 7fc26f227640 1 --2- 172.21.15.78:0/1500111490 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2681087f0 0x7fc268108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.988+0000 7fc26f227640 1 --2- 172.21.15.78:0/1500111490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc268102de0 0x7fc2681031c0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.988+0000 7fc26f227640 1 -- 172.21.15.78:0/1500111490 >> 172.21.15.78:0/1500111490 conn(0x7fc2680fe830 msgr2=0x7fc268100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:05.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.988+0000 7fc26f227640 1 -- 172.21.15.78:0/1500111490 shutdown_connections 2024-09-11T00:20:05.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.988+0000 7fc26f227640 1 -- 172.21.15.78:0/1500111490 wait complete. 2024-09-11T00:20:05.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.989+0000 7fc26f227640 1 Processor -- start 2024-09-11T00:20:05.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.989+0000 7fc26f227640 1 -- start start 2024-09-11T00:20:05.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.989+0000 7fc26f227640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc268102de0 0x7fc268199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:05.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.989+0000 7fc26f227640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2681087f0 0x7fc268199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:05.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.989+0000 7fc26f227640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc268109170 0x7fc26819eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:05.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.989+0000 7fc26f227640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc268112e30 con 0x7fc268102de0 2024-09-11T00:20:05.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.989+0000 7fc26f227640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc268112cb0 con 0x7fc2681087f0 2024-09-11T00:20:05.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.989+0000 7fc26f227640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc268112fb0 con 0x7fc268109170 2024-09-11T00:20:05.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.989+0000 7fc26cfc3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc268102de0 0x7fc268199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:05.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.989+0000 7fc26cfc3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc268102de0 0x7fc268199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33090/0 (socket says 172.21.15.78:33090) 2024-09-11T00:20:05.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.989+0000 7fc26cfc3640 1 -- 172.21.15.78:0/1165327232 learned_addr learned my addr 172.21.15.78:0/1165327232 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:05.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.989+0000 7fc267fff640 1 --2- 172.21.15.78:0/1165327232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2681087f0 0x7fc268199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:05.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.989+0000 7fc26d7c4640 1 --2- 172.21.15.78:0/1165327232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc268109170 0x7fc26819eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:05.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.989+0000 7fc26cfc3640 1 -- 172.21.15.78:0/1165327232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc268109170 msgr2=0x7fc26819eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:05.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.989+0000 7fc26cfc3640 1 --2- 172.21.15.78:0/1165327232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc268109170 0x7fc26819eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.989+0000 7fc26cfc3640 1 -- 172.21.15.78:0/1165327232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2681087f0 msgr2=0x7fc268199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:05.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.989+0000 7fc26cfc3640 1 --2- 172.21.15.78:0/1165327232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2681087f0 0x7fc268199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.989+0000 7fc26cfc3640 1 -- 172.21.15.78:0/1165327232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26819f2b0 con 0x7fc268102de0 2024-09-11T00:20:05.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.989+0000 7fc267fff640 1 --2- 172.21.15.78:0/1165327232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2681087f0 0x7fc268199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:20:05.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.989+0000 7fc26d7c4640 1 --2- 172.21.15.78:0/1165327232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc268109170 0x7fc26819eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:05.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.990+0000 7fc26cfc3640 1 --2- 172.21.15.78:0/1165327232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc268102de0 0x7fc268199200 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc25802ade0 tx=0x7fc258003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:05.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.990+0000 7fc265ffb640 1 -- 172.21.15.78:0/1165327232 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc258003d60 con 0x7fc268102de0 2024-09-11T00:20:05.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.990+0000 7fc265ffb640 1 -- 172.21.15.78:0/1165327232 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2580044f0 con 0x7fc268102de0 2024-09-11T00:20:05.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.990+0000 7fc26f227640 1 -- 172.21.15.78:0/1165327232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc26819f540 con 0x7fc268102de0 2024-09-11T00:20:05.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.990+0000 7fc265ffb640 1 -- 172.21.15.78:0/1165327232 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25802fd10 con 0x7fc268102de0 2024-09-11T00:20:05.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.990+0000 7fc26f227640 1 -- 172.21.15.78:0/1165327232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2681a5c60 con 0x7fc268102de0 2024-09-11T00:20:05.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.992+0000 7fc2715fc740 1 Processor -- start 2024-09-11T00:20:05.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.993+0000 7fc2715fc740 1 -- start start 2024-09-11T00:20:05.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.993+0000 7fc2715fc740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5582419dd0a0 0x5582419dd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:05.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.993+0000 7fc265ffb640 1 -- 172.21.15.78:0/1165327232 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fc258004040 con 0x7fc268102de0 2024-09-11T00:20:05.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.993+0000 7fc2715fc740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419dd9c0 0x5582419e9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:05.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.993+0000 7fc2715fc740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419e9950 0x5582419ebd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:05.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.993+0000 7fc2715fc740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x558241953e50 con 0x5582419dd9c0 2024-09-11T00:20:05.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.993+0000 7fc2715fc740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558241943280 con 0x5582419e9950 2024-09-11T00:20:05.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.993+0000 7fc2715fc740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x558241947090 con 0x5582419dd0a0 2024-09-11T00:20:05.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.993+0000 7fc26cfc3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419dd9c0 0x5582419e9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:05.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.993+0000 7fc26cfc3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419dd9c0 0x5582419e9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33104/0 (socket says 172.21.15.78:33104) 2024-09-11T00:20:05.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.993+0000 7fc26cfc3640 1 -- 172.21.15.78:0/1186251003 learned_addr learned my addr 172.21.15.78:0/1186251003 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:05.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.993+0000 7fc267fff640 1 --2- 172.21.15.78:0/1186251003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419e9950 0x5582419ebd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:05.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.993+0000 7fc26d7c4640 1 --2- 172.21.15.78:0/1186251003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5582419dd0a0 0x5582419dd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:05.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.993+0000 7fc26cfc3640 1 -- 172.21.15.78:0/1186251003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5582419dd0a0 msgr2=0x5582419dd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:05.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.993+0000 7fc26cfc3640 1 --2- 172.21.15.78:0/1186251003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5582419dd0a0 0x5582419dd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.993+0000 7fc26cfc3640 1 -- 172.21.15.78:0/1186251003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419e9950 msgr2=0x5582419ebd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:05.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.993+0000 7fc26cfc3640 1 --2- 172.21.15.78:0/1186251003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419e9950 0x5582419ebd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.993+0000 7fc26cfc3640 1 -- 172.21.15.78:0/1186251003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582416a1650 con 0x5582419dd9c0 2024-09-11T00:20:05.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.993+0000 7fc267fff640 1 --2- 172.21.15.78:0/1186251003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419e9950 0x5582419ebd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:20:05.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.993+0000 7fc26cfc3640 1 --2- 172.21.15.78:0/1186251003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419dd9c0 0x5582419e9410 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc258104c90 tx=0x7fc25810db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abbbe7abcbe0776b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:05.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.994+0000 7fc265ffb640 1 --2- 172.21.15.78:0/1165327232 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc2540b5450 0x7fc2540b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:05.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.994+0000 7fc25effd640 1 -- 172.21.15.78:0/1186251003 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2580cd3a0 con 0x5582419dd9c0 2024-09-11T00:20:05.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.994+0000 7fc26d7c4640 1 --2- 172.21.15.78:0/1165327232 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc2540b5450 0x7fc2540b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:05.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.994+0000 7fc25effd640 1 -- 172.21.15.78:0/1186251003 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc258117020 con 0x5582419dd9c0 2024-09-11T00:20:05.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.994+0000 7fc25effd640 1 -- 172.21.15.78:0/1186251003 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2580cd590 con 0x5582419dd9c0 2024-09-11T00:20:05.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.994+0000 7fc265ffb640 1 -- 172.21.15.78:0/1165327232 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fc2581075b0 con 0x7fc268102de0 2024-09-11T00:20:05.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.995+0000 7fc26d7c4640 1 --2- 172.21.15.78:0/1165327232 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc2540b5450 0x7fc2540b7910 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc26000bba0 tx=0x7fc260005e10 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:05.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.995+0000 7fc2715fc740 1 -- 172.21.15.78:0/1186251003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419dd9c0 msgr2=0x5582419e9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:05.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.995+0000 7fc2715fc740 1 --2- 172.21.15.78:0/1186251003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419dd9c0 0x5582419e9410 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc258104c90 tx=0x7fc25810db40 comp rx=0 tx=0).stop 2024-09-11T00:20:05.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.995+0000 7fc2715fc740 1 -- 172.21.15.78:0/1186251003 shutdown_connections 2024-09-11T00:20:05.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.995+0000 7fc2715fc740 1 --2- 172.21.15.78:0/1186251003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419e9950 0x5582419ebd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.995+0000 7fc2715fc740 1 --2- 172.21.15.78:0/1186251003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419dd9c0 0x5582419e9410 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.995+0000 7fc2715fc740 1 --2- 172.21.15.78:0/1186251003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5582419dd0a0 0x5582419dd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.995+0000 7fc2715fc740 1 -- 172.21.15.78:0/1186251003 >> 172.21.15.78:0/1186251003 conn(0x5582419daed0 msgr2=0x5582419dc070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:05.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.995+0000 7fc2715fc740 1 -- 172.21.15.78:0/1186251003 shutdown_connections 2024-09-11T00:20:05.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.995+0000 7fc2715fc740 1 -- 172.21.15.78:0/1186251003 wait complete. 2024-09-11T00:20:05.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.995+0000 7fc2715fc740 1 -- start start 2024-09-11T00:20:05.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.995+0000 7fc2715fc740 1 Processor -- start 2024-09-11T00:20:05.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.996+0000 7fc2715fc740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5582419dd0a0 0x5582419e91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:05.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.996+0000 7fc2715fc740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419dd9c0 0x5582419e6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:05.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.996+0000 7fc2715fc740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419e9950 0x5582419e6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:05.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.996+0000 7fc2715fc740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5582417a4700 con 0x5582419e9950 2024-09-11T00:20:05.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.996+0000 7fc2715fc740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5582418de110 con 0x5582419dd9c0 2024-09-11T00:20:05.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.996+0000 7fc2715fc740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x558241953e50 con 0x5582419dd0a0 2024-09-11T00:20:05.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.996+0000 7fc2715fc740 10 client.0 _ll_register_callbacks cb 0x5582418f7990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:20:05.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.996+0000 7fc26d7c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419e9950 0x5582419e6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:05.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.996+0000 7fc26d7c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419e9950 0x5582419e6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33112/0 (socket says 172.21.15.78:33112) 2024-09-11T00:20:05.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.996+0000 7fc26d7c4640 1 -- 172.21.15.78:0/2130124462 learned_addr learned my addr 172.21.15.78:0/2130124462 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:05.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.996+0000 7fc26cfc3640 1 --2- 172.21.15.78:0/2130124462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5582419dd0a0 0x5582419e91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:05.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.996+0000 7fc267fff640 1 --2- 172.21.15.78:0/2130124462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419dd9c0 0x5582419e6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:05.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.996+0000 7fc26d7c4640 1 -- 172.21.15.78:0/2130124462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5582419dd0a0 msgr2=0x5582419e91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:05.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.996+0000 7fc26d7c4640 1 --2- 172.21.15.78:0/2130124462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5582419dd0a0 0x5582419e91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.996+0000 7fc26d7c4640 1 -- 172.21.15.78:0/2130124462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419dd9c0 msgr2=0x5582419e6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:05.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.996+0000 7fc26d7c4640 1 --2- 172.21.15.78:0/2130124462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419dd9c0 0x5582419e6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.996+0000 7fc26d7c4640 1 -- 172.21.15.78:0/2130124462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55824190bc40 con 0x5582419e9950 2024-09-11T00:20:05.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.996+0000 7fc267fff640 1 --2- 172.21.15.78:0/2130124462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419dd9c0 0x5582419e6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:20:05.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.996+0000 7fc26d7c4640 1 --2- 172.21.15.78:0/2130124462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419e9950 0x5582419e6bc0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc260010a90 tx=0x7fc2600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9d74292df6457b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:05.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.996+0000 7fc247fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:20:05.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.996+0000 7fc247fff640 1 -- 172.21.15.78:0/2130124462 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26000dd80 con 0x5582419e9950 2024-09-11T00:20:05.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.996+0000 7fc247fff640 1 -- 172.21.15.78:0/2130124462 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fc26001d420 con 0x5582419e9950 2024-09-11T00:20:05.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.997+0000 7fc2715fc740 1 -- 172.21.15.78:0/2130124462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc258117020 con 0x5582419e9950 2024-09-11T00:20:05.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.997+0000 7fc247fff640 1 -- 172.21.15.78:0/2130124462 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc26001d620 con 0x5582419e9950 2024-09-11T00:20:05.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.997+0000 7fc2715fc740 10 client.15756 fetch_fsmap learned FSMap version 20 2024-09-11T00:20:05.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.997+0000 7fc2715fc740 1 -- 172.21.15.78:0/2130124462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5582419f7ac0 con 0x5582419e9950 2024-09-11T00:20:05.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.997+0000 7fc247fff640 1 -- 172.21.15.78:0/2130124462 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc258117020 con 0x5582419e9950 2024-09-11T00:20:05.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.997+0000 7fc247fff640 1 -- 172.21.15.78:0/2130124462 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc26002c020 con 0x5582419e9950 2024-09-11T00:20:05.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.997+0000 7fc2715fc740 10 client.15756 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:20:05.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.997+0000 7fc2715fc740 10 client.15756 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:20:05.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.997+0000 7fc2715fc740 20 client.15756 populate_metadata read hostname 'smithi078' 2024-09-11T00:20:05.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.997+0000 7fc2715fc740 1 --2- 172.21.15.78:0/2130124462 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5582419f9340 0x5582419fb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:05.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.997+0000 7fc2715fc740 4 client.15756 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:20:05.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.997+0000 7fc2715fc740 1 -- 172.21.15.78:0/2130124462 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558241955da0 con 0x5582419f9340 2024-09-11T00:20:05.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.998+0000 7fc26cfc3640 1 --2- 172.21.15.78:0/2130124462 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5582419f9340 0x5582419fb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:05.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.998+0000 7fc247fff640 10 client.15756 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:05.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.998+0000 7fc26cfc3640 1 --2- 172.21.15.78:0/2130124462 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5582419f9340 0x5582419fb7a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=292816dee94b66fa server_cookie=788b913543a81ddc in_seq=0 out_seq=0 2024-09-11T00:20:05.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.999+0000 7fc247fff640 1 -- 172.21.15.78:0/2130124462 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558241955da0 con 0x5582419f9340 2024-09-11T00:20:05.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.999+0000 7fc247fff640 10 client.15756 handle_command_reply: tid=0 2024-09-11T00:20:05.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.999+0000 7fc2715fc740 1 client.15756 shutdown 2024-09-11T00:20:05.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.999+0000 7fc2715fc740 1 -- 172.21.15.78:0/2130124462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419e9950 msgr2=0x5582419e6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:05.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.999+0000 7fc2715fc740 1 --2- 172.21.15.78:0/2130124462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419e9950 0x5582419e6bc0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc260010a90 tx=0x7fc2600046c0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.999+0000 7fc2715fc740 1 -- 172.21.15.78:0/2130124462 shutdown_connections 2024-09-11T00:20:05.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.999+0000 7fc2715fc740 1 --2- 172.21.15.78:0/2130124462 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5582419f9340 0x5582419fb7a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.999+0000 7fc2715fc740 1 --2- 172.21.15.78:0/2130124462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419e9950 0x5582419e6bc0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.999+0000 7fc2715fc740 1 --2- 172.21.15.78:0/2130124462 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419dd9c0 0x5582419e6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.999+0000 7fc2715fc740 1 --2- 172.21.15.78:0/2130124462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5582419dd0a0 0x5582419e91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.999+0000 7fc247fff640 0 client.15756 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:05.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.999+0000 7fc2715fc740 1 -- 172.21.15.78:0/2130124462 >> 172.21.15.78:0/2130124462 conn(0x5582419daed0 msgr2=0x5582419e0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:05.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.999+0000 7fc2715fc740 1 -- 172.21.15.78:0/2130124462 shutdown_connections 2024-09-11T00:20:05.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.999+0000 7fc2715fc740 1 -- 172.21.15.78:0/2130124462 wait complete. 2024-09-11T00:20:05.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:04.999+0000 7fc2715fc740 20 client.15756 trim_cache size 0 max 16384 2024-09-11T00:20:05.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.016+0000 7fc2715fc740 1 Processor -- start 2024-09-11T00:20:05.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.016+0000 7fc2715fc740 1 -- start start 2024-09-11T00:20:05.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.017+0000 7fc2715fc740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419dd0a0 0x5582419f1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:05.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.017+0000 7fc2715fc740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419dd9c0 0x5582419f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:05.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.017+0000 7fc2715fc740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5582419e9950 0x5582419e4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.017+0000 7fc2715fc740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc2681ac6a0 con 0x5582419dd0a0 2024-09-11T00:20:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.017+0000 7fc2715fc740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc2681aef20 con 0x5582419dd9c0 2024-09-11T00:20:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.017+0000 7fc2715fc740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc2681acd10 con 0x5582419e9950 2024-09-11T00:20:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.017+0000 7fc26cfc3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419dd0a0 0x5582419f1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.017+0000 7fc26cfc3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419dd0a0 0x5582419f1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33116/0 (socket says 172.21.15.78:33116) 2024-09-11T00:20:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.017+0000 7fc26cfc3640 1 -- 172.21.15.78:0/243467242 learned_addr learned my addr 172.21.15.78:0/243467242 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.017+0000 7fc26d7c4640 1 --2- 172.21.15.78:0/243467242 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5582419e9950 0x5582419e4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.017+0000 7fc267fff640 1 --2- 172.21.15.78:0/243467242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419dd9c0 0x5582419f1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.017+0000 7fc26cfc3640 1 -- 172.21.15.78:0/243467242 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5582419e9950 msgr2=0x5582419e4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.017+0000 7fc26cfc3640 1 --2- 172.21.15.78:0/243467242 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5582419e9950 0x5582419e4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.017+0000 7fc26cfc3640 1 -- 172.21.15.78:0/243467242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419dd9c0 msgr2=0x5582419f1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.017+0000 7fc26cfc3640 1 --2- 172.21.15.78:0/243467242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419dd9c0 0x5582419f1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.017+0000 7fc26cfc3640 1 -- 172.21.15.78:0/243467242 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582419e9540 con 0x5582419dd0a0 2024-09-11T00:20:05.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.017+0000 7fc267fff640 1 --2- 172.21.15.78:0/243467242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419dd9c0 0x5582419f1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:05.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.017+0000 7fc26cfc3640 1 --2- 172.21.15.78:0/243467242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419dd0a0 0x5582419f1840 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc258104dd0 tx=0x7fc25810d550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e52687a4f7e06e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:05.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.017+0000 7fc25e7fc640 1 -- 172.21.15.78:0/243467242 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2580cd820 con 0x5582419dd0a0 2024-09-11T00:20:05.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.017+0000 7fc25e7fc640 1 -- 172.21.15.78:0/243467242 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc258036030 con 0x5582419dd0a0 2024-09-11T00:20:05.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.017+0000 7fc25e7fc640 1 -- 172.21.15.78:0/243467242 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2580c91c0 con 0x5582419dd0a0 2024-09-11T00:20:05.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.018+0000 7fc2715fc740 1 -- 172.21.15.78:0/243467242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419dd0a0 msgr2=0x5582419f1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:05.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.018+0000 7fc2715fc740 1 --2- 172.21.15.78:0/243467242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419dd0a0 0x5582419f1840 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc258104dd0 tx=0x7fc25810d550 comp rx=0 tx=0).stop 2024-09-11T00:20:05.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.018+0000 7fc2715fc740 1 -- 172.21.15.78:0/243467242 shutdown_connections 2024-09-11T00:20:05.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.018+0000 7fc2715fc740 1 --2- 172.21.15.78:0/243467242 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5582419e9950 0x5582419e4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.018+0000 7fc2715fc740 1 --2- 172.21.15.78:0/243467242 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419dd9c0 0x5582419f1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.018+0000 7fc2715fc740 1 --2- 172.21.15.78:0/243467242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419dd0a0 0x5582419f1840 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.018+0000 7fc2715fc740 1 -- 172.21.15.78:0/243467242 >> 172.21.15.78:0/243467242 conn(0x5582419daed0 msgr2=0x5582419dbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:05.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.018+0000 7fc2715fc740 1 -- 172.21.15.78:0/243467242 shutdown_connections 2024-09-11T00:20:05.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.018+0000 7fc2715fc740 1 -- 172.21.15.78:0/243467242 wait complete. 2024-09-11T00:20:05.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.018+0000 7fc2715fc740 1 -- start start 2024-09-11T00:20:05.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.018+0000 7fc2715fc740 1 Processor -- start 2024-09-11T00:20:05.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.019+0000 7fc2715fc740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5582419dd0a0 0x558241a00f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:05.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.019+0000 7fc2715fc740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419dd9c0 0x558241a01510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:05.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.019+0000 7fc2715fc740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419e9950 0x558241a627f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.019+0000 7fc2715fc740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc2681ad3e0 con 0x5582419dd9c0 2024-09-11T00:20:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.019+0000 7fc2715fc740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc2681ae850 con 0x5582419e9950 2024-09-11T00:20:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.019+0000 7fc2715fc740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc2681adab0 con 0x5582419dd0a0 2024-09-11T00:20:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.019+0000 7fc2715fc740 10 client.0 _ll_register_callbacks cb 0x7fc26000b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:20:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.019+0000 7fc267fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419dd9c0 0x558241a01510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.019+0000 7fc267fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419dd9c0 0x558241a01510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33126/0 (socket says 172.21.15.78:33126) 2024-09-11T00:20:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.019+0000 7fc267fff640 1 -- 172.21.15.78:0/1220909230 learned_addr learned my addr 172.21.15.78:0/1220909230 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.019+0000 7fc26d7c4640 1 --2- 172.21.15.78:0/1220909230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419e9950 0x558241a627f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.019+0000 7fc26cfc3640 1 --2- 172.21.15.78:0/1220909230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5582419dd0a0 0x558241a00f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.019+0000 7fc267fff640 1 -- 172.21.15.78:0/1220909230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5582419dd0a0 msgr2=0x558241a00f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.019+0000 7fc267fff640 1 --2- 172.21.15.78:0/1220909230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5582419dd0a0 0x558241a00f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.019+0000 7fc267fff640 1 -- 172.21.15.78:0/1220909230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419e9950 msgr2=0x558241a627f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.019+0000 7fc267fff640 1 --2- 172.21.15.78:0/1220909230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419e9950 0x558241a627f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.019+0000 7fc267fff640 1 -- 172.21.15.78:0/1220909230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558241a62f30 con 0x5582419dd9c0 2024-09-11T00:20:05.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.019+0000 7fc26cfc3640 1 --2- 172.21.15.78:0/1220909230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5582419dd0a0 0x558241a00f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:20:05.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.020+0000 7fc267fff640 1 --2- 172.21.15.78:0/1220909230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419dd9c0 0x558241a01510 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc250013850 tx=0x7fc250013d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2ef0f9c0e3aeee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:05.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.020+0000 7fc247fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:20:05.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.020+0000 7fc247fff640 1 -- 172.21.15.78:0/1220909230 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc250011dd0 con 0x5582419dd9c0 2024-09-11T00:20:05.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.020+0000 7fc247fff640 1 -- 172.21.15.78:0/1220909230 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fc250004020 con 0x5582419dd9c0 2024-09-11T00:20:05.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.020+0000 7fc2715fc740 1 -- 172.21.15.78:0/1220909230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc258036030 con 0x5582419dd9c0 2024-09-11T00:20:05.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.020+0000 7fc247fff640 1 -- 172.21.15.78:0/1220909230 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc250004220 con 0x5582419dd9c0 2024-09-11T00:20:05.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.020+0000 7fc2715fc740 10 client.15762 fetch_fsmap learned FSMap version 20 2024-09-11T00:20:05.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.020+0000 7fc2715fc740 1 -- 172.21.15.78:0/1220909230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558241a6a390 con 0x5582419dd9c0 2024-09-11T00:20:05.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.020+0000 7fc247fff640 1 -- 172.21.15.78:0/1220909230 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc258036030 con 0x5582419dd9c0 2024-09-11T00:20:05.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.020+0000 7fc247fff640 1 -- 172.21.15.78:0/1220909230 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc250022020 con 0x5582419dd9c0 2024-09-11T00:20:05.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.020+0000 7fc2715fc740 10 client.15762 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:20:05.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.020+0000 7fc2715fc740 10 client.15762 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:20:05.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.020+0000 7fc2715fc740 20 client.15762 populate_metadata read hostname 'smithi078' 2024-09-11T00:20:05.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.020+0000 7fc2715fc740 1 --2- 172.21.15.78:0/1220909230 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x558241a6ab60 0x558241a6cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:05.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.020+0000 7fc2715fc740 4 client.15762 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:20:05.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.020+0000 7fc2715fc740 1 -- 172.21.15.78:0/1220909230 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558241951850 con 0x558241a6ab60 2024-09-11T00:20:05.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.021+0000 7fc26cfc3640 1 --2- 172.21.15.78:0/1220909230 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x558241a6ab60 0x558241a6cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:05.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.021+0000 7fc247fff640 10 client.15762 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:05.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.021+0000 7fc26cfc3640 1 --2- 172.21.15.78:0/1220909230 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x558241a6ab60 0x558241a6cf80 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e46b31af616ca605 server_cookie=5dfd5fb15336e4d1 in_seq=0 out_seq=0 2024-09-11T00:20:05.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.021+0000 7fc247fff640 1 -- 172.21.15.78:0/1220909230 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x558241951850 con 0x558241a6ab60 2024-09-11T00:20:05.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.021+0000 7fc247fff640 10 client.15762 handle_command_reply: tid=0 2024-09-11T00:20:05.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.021+0000 7fc2715fc740 1 client.15762 shutdown 2024-09-11T00:20:05.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.021+0000 7fc2715fc740 1 -- 172.21.15.78:0/1220909230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419dd9c0 msgr2=0x558241a01510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:05.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.021+0000 7fc2715fc740 1 --2- 172.21.15.78:0/1220909230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419dd9c0 0x558241a01510 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc250013850 tx=0x7fc250013d10 comp rx=0 tx=0).stop 2024-09-11T00:20:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.021+0000 7fc2715fc740 1 -- 172.21.15.78:0/1220909230 shutdown_connections 2024-09-11T00:20:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.021+0000 7fc2715fc740 1 --2- 172.21.15.78:0/1220909230 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x558241a6ab60 0x558241a6cf80 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.021+0000 7fc2715fc740 1 --2- 172.21.15.78:0/1220909230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5582419e9950 0x558241a627f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.021+0000 7fc2715fc740 1 --2- 172.21.15.78:0/1220909230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5582419dd9c0 0x558241a01510 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.021+0000 7fc247fff640 0 client.15762 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.021+0000 7fc2715fc740 1 --2- 172.21.15.78:0/1220909230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5582419dd0a0 0x558241a00f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.021+0000 7fc2715fc740 1 -- 172.21.15.78:0/1220909230 >> 172.21.15.78:0/1220909230 conn(0x5582419daed0 msgr2=0x5582419e7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.022+0000 7fc2715fc740 1 -- 172.21.15.78:0/1220909230 shutdown_connections 2024-09-11T00:20:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.022+0000 7fc2715fc740 1 -- 172.21.15.78:0/1220909230 wait complete. 2024-09-11T00:20:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.022+0000 7fc2715fc740 20 client.15762 trim_cache size 0 max 16384 2024-09-11T00:20:05.030 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:20:05.030 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-11T00:20:05.030 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {}, 2024-09-11T00:20:05.030 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:20:05.030 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:20:05.030 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:20:05.030 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:05.030 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:05.030 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:05.030 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:05.030 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:05.030 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:05.030 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:20:05.031 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:20:05.031 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:05.031 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:05.031 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:05.031 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:05.031 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:05.031 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:05.031 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:20:05.031 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:20:05.031 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:05.031 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:05.031 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:05.031 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:05.031 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:05.032 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:05.032 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:20:05.032 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:20:05.032 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:05.032 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:05.032 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:05.032 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:05.032 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:05.032 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:05.032 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:20:05.032 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:20:05.032 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:05.032 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:05.032 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:05.033 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:05.033 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:05.033 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:05.033 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:20:05.033 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:20:05.033 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:05.033 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:05.033 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:05.033 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:05.033 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:05.033 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:20:05.033 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:20:05.033 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:20:05.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.022+0000 7fc26f227640 1 -- 172.21.15.78:0/1165327232 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc2540b5450 msgr2=0x7fc2540b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:05.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.022+0000 7fc26f227640 1 --2- 172.21.15.78:0/1165327232 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc2540b5450 0x7fc2540b7910 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc26000bba0 tx=0x7fc260005e10 comp rx=0 tx=0).stop 2024-09-11T00:20:05.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.022+0000 7fc26f227640 1 -- 172.21.15.78:0/1165327232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc268102de0 msgr2=0x7fc268199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:05.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.022+0000 7fc26f227640 1 --2- 172.21.15.78:0/1165327232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc268102de0 0x7fc268199200 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc25802ade0 tx=0x7fc258003970 comp rx=0 tx=0).stop 2024-09-11T00:20:05.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.022+0000 7fc26f227640 1 -- 172.21.15.78:0/1165327232 shutdown_connections 2024-09-11T00:20:05.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.022+0000 7fc26f227640 1 --2- 172.21.15.78:0/1165327232 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc2540b5450 0x7fc2540b7910 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.022+0000 7fc26f227640 1 --2- 172.21.15.78:0/1165327232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc268109170 0x7fc26819eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.022+0000 7fc26f227640 1 --2- 172.21.15.78:0/1165327232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc2681087f0 0x7fc268199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.022+0000 7fc26f227640 1 --2- 172.21.15.78:0/1165327232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc268102de0 0x7fc268199200 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:05.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.022+0000 7fc26f227640 1 -- 172.21.15.78:0/1165327232 >> 172.21.15.78:0/1165327232 conn(0x7fc2680fe830 msgr2=0x7fc268100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:05.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.022+0000 7fc26f227640 1 -- 172.21.15.78:0/1165327232 shutdown_connections 2024-09-11T00:20:05.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:05.022+0000 7fc26f227640 1 -- 172.21.15.78:0/1165327232 wait complete. 2024-09-11T00:20:05.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:04 smithi112 ceph-mon[35627]: pgmap v431: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:20:05.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:04 smithi138 ceph-mon[35019]: pgmap v431: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:20:05.882 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:05 smithi078 ceph-mon[30865]: pgmap v432: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T00:20:05.907 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:20:05.908 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:20:06.152 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:20:06.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:05 smithi112 ceph-mon[35627]: pgmap v432: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T00:20:06.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:05 smithi138 ceph-mon[35019]: pgmap v432: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T00:20:06.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.628+0000 7f48946d5640 1 -- 172.21.15.78:0/580473112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f488c102d90 msgr2=0x7f488c103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:06.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.628+0000 7f48946d5640 1 --2- 172.21.15.78:0/580473112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f488c102d90 0x7f488c103170 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4888009900 tx=0x7f488802a410 comp rx=0 tx=0).stop 2024-09-11T00:20:06.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.628+0000 7f48946d5640 1 -- 172.21.15.78:0/580473112 shutdown_connections 2024-09-11T00:20:06.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.628+0000 7f48946d5640 1 --2- 172.21.15.78:0/580473112 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f488c109120 0x7f488c10f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:06.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.628+0000 7f48946d5640 1 --2- 172.21.15.78:0/580473112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f488c1087a0 0x7f488c108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:06.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.628+0000 7f48946d5640 1 --2- 172.21.15.78:0/580473112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f488c102d90 0x7f488c103170 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:06.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.628+0000 7f48946d5640 1 -- 172.21.15.78:0/580473112 >> 172.21.15.78:0/580473112 conn(0x7f488c0fe820 msgr2=0x7f488c100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:06.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.628+0000 7f48946d5640 1 -- 172.21.15.78:0/580473112 shutdown_connections 2024-09-11T00:20:06.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.628+0000 7f48946d5640 1 -- 172.21.15.78:0/580473112 wait complete. 2024-09-11T00:20:06.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.629+0000 7f48946d5640 1 Processor -- start 2024-09-11T00:20:06.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.629+0000 7f48946d5640 1 -- start start 2024-09-11T00:20:06.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.629+0000 7f48946d5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f488c102d90 0x7f488c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:06.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.629+0000 7f48946d5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f488c1087a0 0x7f488c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:06.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.629+0000 7f48946d5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f488c109120 0x7f488c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:06.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.629+0000 7f48946d5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f488c112de0 con 0x7f488c1087a0 2024-09-11T00:20:06.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.629+0000 7f48946d5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f488c112c60 con 0x7f488c109120 2024-09-11T00:20:06.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.629+0000 7f48946d5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f488c112f60 con 0x7f488c102d90 2024-09-11T00:20:06.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.629+0000 7f4891c70640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f488c1087a0 0x7f488c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:06.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.629+0000 7f4891c70640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f488c1087a0 0x7f488c0759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33148/0 (socket says 172.21.15.78:33148) 2024-09-11T00:20:06.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.629+0000 7f4891c70640 1 -- 172.21.15.78:0/2710683550 learned_addr learned my addr 172.21.15.78:0/2710683550 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:06.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.629+0000 7f4892c72640 1 --2- 172.21.15.78:0/2710683550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f488c109120 0x7f488c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:06.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.630+0000 7f4892471640 1 --2- 172.21.15.78:0/2710683550 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f488c102d90 0x7f488c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:06.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.630+0000 7f4891c70640 1 -- 172.21.15.78:0/2710683550 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f488c102d90 msgr2=0x7f488c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:06.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.630+0000 7f4891c70640 1 --2- 172.21.15.78:0/2710683550 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f488c102d90 0x7f488c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:06.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.630+0000 7f4891c70640 1 -- 172.21.15.78:0/2710683550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f488c109120 msgr2=0x7f488c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:06.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.630+0000 7f4891c70640 1 --2- 172.21.15.78:0/2710683550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f488c109120 0x7f488c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:06.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.630+0000 7f4891c70640 1 -- 172.21.15.78:0/2710683550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488c1a76c0 con 0x7f488c1087a0 2024-09-11T00:20:06.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.630+0000 7f4891c70640 1 --2- 172.21.15.78:0/2710683550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f488c1087a0 0x7f488c0759e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f487c00d770 tx=0x7f487c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:06.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.630+0000 7f48837fe640 1 -- 172.21.15.78:0/2710683550 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c017070 con 0x7f488c1087a0 2024-09-11T00:20:06.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.630+0000 7f48837fe640 1 -- 172.21.15.78:0/2710683550 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f487c0054d0 con 0x7f488c1087a0 2024-09-11T00:20:06.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.630+0000 7f48946d5640 1 -- 172.21.15.78:0/2710683550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f488c1a79b0 con 0x7f488c1087a0 2024-09-11T00:20:06.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.630+0000 7f48837fe640 1 -- 172.21.15.78:0/2710683550 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c004c30 con 0x7f488c1087a0 2024-09-11T00:20:06.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.630+0000 7f48946d5640 1 -- 172.21.15.78:0/2710683550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f488c1a7ea0 con 0x7f488c1087a0 2024-09-11T00:20:06.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.631+0000 7f48946d5640 1 -- 172.21.15.78:0/2710683550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f488c103170 con 0x7f488c1087a0 2024-09-11T00:20:06.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.632+0000 7f48837fe640 1 -- 172.21.15.78:0/2710683550 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f487c004dd0 con 0x7f488c1087a0 2024-09-11T00:20:06.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.633+0000 7f48837fe640 1 --2- 172.21.15.78:0/2710683550 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f48780b5450 0x7f48780b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:06.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.633+0000 7f4892471640 1 --2- 172.21.15.78:0/2710683550 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f48780b5450 0x7f48780b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:06.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.633+0000 7f48837fe640 1 -- 172.21.15.78:0/2710683550 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f487c0e5e50 con 0x7f488c1087a0 2024-09-11T00:20:06.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.634+0000 7f4892471640 1 --2- 172.21.15.78:0/2710683550 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f48780b5450 0x7f48780b7910 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4888031440 tx=0x7f48880095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:06.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.636+0000 7f48837fe640 1 -- 172.21.15.78:0/2710683550 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f487c0ac9f0 con 0x7f488c1087a0 2024-09-11T00:20:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.845+0000 7f48946d5640 1 -- 172.21.15.78:0/2710683550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f488c02e5c0 con 0x7f488c1087a0 2024-09-11T00:20:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.846+0000 7f48837fe640 1 -- 172.21.15.78:0/2710683550 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f487c0ac2f0 con 0x7f488c1087a0 2024-09-11T00:20:06.848 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:20:06.848 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:20:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:20:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.848+0000 7f48946d5640 1 -- 172.21.15.78:0/2710683550 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f48780b5450 msgr2=0x7f48780b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.848+0000 7f48946d5640 1 --2- 172.21.15.78:0/2710683550 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f48780b5450 0x7f48780b7910 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4888031440 tx=0x7f48880095f0 comp rx=0 tx=0).stop 2024-09-11T00:20:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.848+0000 7f48946d5640 1 -- 172.21.15.78:0/2710683550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f488c1087a0 msgr2=0x7f488c0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.848+0000 7f48946d5640 1 --2- 172.21.15.78:0/2710683550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f488c1087a0 0x7f488c0759e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f487c00d770 tx=0x7f487c00dc30 comp rx=0 tx=0).stop 2024-09-11T00:20:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.848+0000 7f48946d5640 1 -- 172.21.15.78:0/2710683550 shutdown_connections 2024-09-11T00:20:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.848+0000 7f48946d5640 1 --2- 172.21.15.78:0/2710683550 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f48780b5450 0x7f48780b7910 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.848+0000 7f48946d5640 1 --2- 172.21.15.78:0/2710683550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f488c109120 0x7f488c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.848+0000 7f48946d5640 1 --2- 172.21.15.78:0/2710683550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f488c1087a0 0x7f488c0759e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.848+0000 7f48946d5640 1 --2- 172.21.15.78:0/2710683550 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f488c102d90 0x7f488c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.848+0000 7f48946d5640 1 -- 172.21.15.78:0/2710683550 >> 172.21.15.78:0/2710683550 conn(0x7f488c0fe820 msgr2=0x7f488c100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.848+0000 7f48946d5640 1 -- 172.21.15.78:0/2710683550 shutdown_connections 2024-09-11T00:20:06.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:06.848+0000 7f48946d5640 1 -- 172.21.15.78:0/2710683550 wait complete. 2024-09-11T00:20:07.229 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:06 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2710683550' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:20:07.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:06 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2710683550' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:20:07.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:06 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2710683550' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:20:07.699 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:20:07.947 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:20:08.067 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:07 smithi078 ceph-mon[30865]: pgmap v433: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:20:08.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:07 smithi112 ceph-mon[35627]: pgmap v433: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:20:08.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:07 smithi138 ceph-mon[35019]: pgmap v433: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:20:08.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.447+0000 7f902a708640 1 -- 172.21.15.78:0/1144023163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9024103ce0 msgr2=0x7f90241040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:08.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.447+0000 7f902a708640 1 --2- 172.21.15.78:0/1144023163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9024103ce0 0x7f90241040c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9014009900 tx=0x7f901402a410 comp rx=0 tx=0).stop 2024-09-11T00:20:08.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.447+0000 7f902a708640 1 -- 172.21.15.78:0/1144023163 shutdown_connections 2024-09-11T00:20:08.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.447+0000 7f902a708640 1 --2- 172.21.15.78:0/1144023163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f902410d140 0x7f902410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.447+0000 7f902a708640 1 --2- 172.21.15.78:0/1144023163 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9024104600 0x7f902410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.447+0000 7f902a708640 1 --2- 172.21.15.78:0/1144023163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9024103ce0 0x7f90241040c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.447+0000 7f902a708640 1 -- 172.21.15.78:0/1144023163 >> 172.21.15.78:0/1144023163 conn(0x7f90240fd700 msgr2=0x7f90240ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:08.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.447+0000 7f902a708640 1 -- 172.21.15.78:0/1144023163 shutdown_connections 2024-09-11T00:20:08.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.447+0000 7f902a708640 1 -- 172.21.15.78:0/1144023163 wait complete. 2024-09-11T00:20:08.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.448+0000 7f902a708640 1 Processor -- start 2024-09-11T00:20:08.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.448+0000 7f902a708640 1 -- start start 2024-09-11T00:20:08.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.448+0000 7f902a708640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9024103ce0 0x7f9024199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:08.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.448+0000 7f902a708640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9024104600 0x7f90241998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:08.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.448+0000 7f902a708640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f902410d140 0x7f902419ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:08.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.448+0000 7f902a708640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9024112e10 con 0x7f902410d140 2024-09-11T00:20:08.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.448+0000 7f902a708640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9024112c90 con 0x7f9024103ce0 2024-09-11T00:20:08.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.448+0000 7f902a708640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9024112f90 con 0x7f9024104600 2024-09-11T00:20:08.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.448+0000 7f9028ca5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f902410d140 0x7f902419ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:08.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.448+0000 7f9028ca5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f902410d140 0x7f902419ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33156/0 (socket says 172.21.15.78:33156) 2024-09-11T00:20:08.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.448+0000 7f9028ca5640 1 -- 172.21.15.78:0/212002820 learned_addr learned my addr 172.21.15.78:0/212002820 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:08.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.448+0000 7f9023fff640 1 --2- 172.21.15.78:0/212002820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9024103ce0 0x7f9024199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:08.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.448+0000 7f9028ca5640 1 -- 172.21.15.78:0/212002820 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9024104600 msgr2=0x7f90241998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:08.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.448+0000 7f90237fe640 1 --2- 172.21.15.78:0/212002820 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9024104600 0x7f90241998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:08.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.448+0000 7f9028ca5640 1 --2- 172.21.15.78:0/212002820 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9024104600 0x7f90241998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.448+0000 7f9028ca5640 1 -- 172.21.15.78:0/212002820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9024103ce0 msgr2=0x7f9024199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:08.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.448+0000 7f9028ca5640 1 --2- 172.21.15.78:0/212002820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9024103ce0 0x7f9024199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.448+0000 7f9028ca5640 1 -- 172.21.15.78:0/212002820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902419f410 con 0x7f902410d140 2024-09-11T00:20:08.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.448+0000 7f9023fff640 1 --2- 172.21.15.78:0/212002820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9024103ce0 0x7f9024199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:08.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.448+0000 7f90237fe640 1 --2- 172.21.15.78:0/212002820 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9024104600 0x7f90241998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:08.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.449+0000 7f9028ca5640 1 --2- 172.21.15.78:0/212002820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f902410d140 0x7f902419ec40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f901c00eaa0 tx=0x7f901c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:08.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.449+0000 7f90217fa640 1 -- 172.21.15.78:0/212002820 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901c00cdb0 con 0x7f902410d140 2024-09-11T00:20:08.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.449+0000 7f90217fa640 1 -- 172.21.15.78:0/212002820 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f901c005020 con 0x7f902410d140 2024-09-11T00:20:08.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.449+0000 7f902a708640 1 -- 172.21.15.78:0/212002820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f902419f700 con 0x7f902410d140 2024-09-11T00:20:08.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.449+0000 7f90217fa640 1 -- 172.21.15.78:0/212002820 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901c0116d0 con 0x7f902410d140 2024-09-11T00:20:08.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.449+0000 7f902a708640 1 -- 172.21.15.78:0/212002820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90241a5e40 con 0x7f902410d140 2024-09-11T00:20:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.451+0000 7f90217fa640 1 -- 172.21.15.78:0/212002820 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f901c00f040 con 0x7f902410d140 2024-09-11T00:20:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.452+0000 7f902cadd740 1 Processor -- start 2024-09-11T00:20:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.452+0000 7f902cadd740 1 -- start start 2024-09-11T00:20:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.452+0000 7f902cadd740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b838484d0 0x564b838488b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.452+0000 7f902cadd740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564b83848df0 0x564b83854840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.452+0000 7f902cadd740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b83854d80 0x564b83857170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.452+0000 7f902cadd740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x564b837beea0 con 0x564b83854d80 2024-09-11T00:20:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.452+0000 7f902cadd740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564b837ae2d0 con 0x564b83848df0 2024-09-11T00:20:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.452+0000 7f902cadd740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564b837b20e0 con 0x564b838484d0 2024-09-11T00:20:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.452+0000 7f90237fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b83854d80 0x564b83857170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.452+0000 7f90237fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b83854d80 0x564b83857170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33168/0 (socket says 172.21.15.78:33168) 2024-09-11T00:20:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.452+0000 7f90237fe640 1 -- 172.21.15.78:0/1212100416 learned_addr learned my addr 172.21.15.78:0/1212100416 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.452+0000 7f9023fff640 1 --2- 172.21.15.78:0/1212100416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564b83848df0 0x564b83854840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.452+0000 7f90237fe640 1 --2- 172.21.15.78:0/1212100416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b838484d0 0x564b838488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.452+0000 7f90237fe640 1 -- 172.21.15.78:0/1212100416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b838484d0 msgr2=0x564b838488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.452+0000 7f90237fe640 1 --2- 172.21.15.78:0/1212100416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b838484d0 0x564b838488b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.452+0000 7f90237fe640 1 -- 172.21.15.78:0/1212100416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564b83848df0 msgr2=0x564b83854840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.452+0000 7f90237fe640 1 --2- 172.21.15.78:0/1212100416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564b83848df0 0x564b83854840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.452+0000 7f90237fe640 1 -- 172.21.15.78:0/1212100416 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8350c650 con 0x564b83854d80 2024-09-11T00:20:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.452+0000 7f90217fa640 1 --2- 172.21.15.78:0/212002820 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f900c0b5450 0x7f900c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.452+0000 7f90237fe640 1 --2- 172.21.15.78:0/1212100416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b83854d80 0x564b83857170 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f901800cc60 tx=0x7f901800c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be38c1f807d0b0d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.453+0000 7f9023fff640 1 --2- 172.21.15.78:0/212002820 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f900c0b5450 0x7f900c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.453+0000 7f90217fa640 1 -- 172.21.15.78:0/212002820 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f901c0e5f20 con 0x7f902410d140 2024-09-11T00:20:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.453+0000 7f900a7fc640 1 -- 172.21.15.78:0/1212100416 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901800f040 con 0x564b83854d80 2024-09-11T00:20:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.453+0000 7f900a7fc640 1 -- 172.21.15.78:0/1212100416 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9018019070 con 0x564b83854d80 2024-09-11T00:20:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.453+0000 7f900a7fc640 1 -- 172.21.15.78:0/1212100416 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9018013380 con 0x564b83854d80 2024-09-11T00:20:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.453+0000 7f902cadd740 1 -- 172.21.15.78:0/1212100416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b83854d80 msgr2=0x564b83857170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:08.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.453+0000 7f9023fff640 1 --2- 172.21.15.78:0/212002820 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f900c0b5450 0x7f900c0b7910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9014031440 tx=0x7f9014005de0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:08.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.453+0000 7f902cadd740 1 --2- 172.21.15.78:0/1212100416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b83854d80 0x564b83857170 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f901800cc60 tx=0x7f901800c380 comp rx=0 tx=0).stop 2024-09-11T00:20:08.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.453+0000 7f902cadd740 1 -- 172.21.15.78:0/1212100416 shutdown_connections 2024-09-11T00:20:08.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.453+0000 7f902cadd740 1 --2- 172.21.15.78:0/1212100416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b83854d80 0x564b83857170 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.453+0000 7f902cadd740 1 --2- 172.21.15.78:0/1212100416 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564b83848df0 0x564b83854840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.453+0000 7f902cadd740 1 --2- 172.21.15.78:0/1212100416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b838484d0 0x564b838488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.453+0000 7f902cadd740 1 -- 172.21.15.78:0/1212100416 >> 172.21.15.78:0/1212100416 conn(0x564b83846300 msgr2=0x564b838474a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:08.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.454+0000 7f902cadd740 1 -- 172.21.15.78:0/1212100416 shutdown_connections 2024-09-11T00:20:08.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.454+0000 7f902cadd740 1 -- 172.21.15.78:0/1212100416 wait complete. 2024-09-11T00:20:08.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.454+0000 7f902cadd740 1 -- start start 2024-09-11T00:20:08.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.454+0000 7f902cadd740 1 Processor -- start 2024-09-11T00:20:08.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.454+0000 7f902cadd740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564b838484d0 0x564b838546f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:08.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.454+0000 7f902cadd740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b83848df0 0x564b83851b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:08.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.454+0000 7f902cadd740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b83854d80 0x564b838521c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:08.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.454+0000 7f902cadd740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x564b8360f700 con 0x564b83854d80 2024-09-11T00:20:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.454+0000 7f902cadd740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564b83749160 con 0x564b838484d0 2024-09-11T00:20:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.454+0000 7f902cadd740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564b838579a0 con 0x564b83848df0 2024-09-11T00:20:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.454+0000 7f902cadd740 10 client.0 _ll_register_callbacks cb 0x564b837629e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:20:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.454+0000 7f9028ca5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b83854d80 0x564b838521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.455+0000 7f9028ca5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b83854d80 0x564b838521c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33174/0 (socket says 172.21.15.78:33174) 2024-09-11T00:20:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.455+0000 7f9028ca5640 1 -- 172.21.15.78:0/1687791794 learned_addr learned my addr 172.21.15.78:0/1687791794 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.455+0000 7f90237fe640 1 --2- 172.21.15.78:0/1687791794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b83848df0 0x564b83851b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.455+0000 7f9023fff640 1 --2- 172.21.15.78:0/1687791794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564b838484d0 0x564b838546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.455+0000 7f9028ca5640 1 -- 172.21.15.78:0/1687791794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b83848df0 msgr2=0x564b83851b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.455+0000 7f9028ca5640 1 --2- 172.21.15.78:0/1687791794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b83848df0 0x564b83851b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.455+0000 7f9028ca5640 1 -- 172.21.15.78:0/1687791794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564b838484d0 msgr2=0x564b838546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.455+0000 7f9028ca5640 1 --2- 172.21.15.78:0/1687791794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564b838484d0 0x564b838546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.455+0000 7f9028ca5640 1 -- 172.21.15.78:0/1687791794 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b83776c90 con 0x564b83854d80 2024-09-11T00:20:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.455+0000 7f9028ca5640 1 --2- 172.21.15.78:0/1687791794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b83854d80 0x564b838521c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f901c0e3c90 tx=0x7f901c005450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a905cb24d2ae278 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:08.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.455+0000 7f90037fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:20:08.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.455+0000 7f90037fe640 1 -- 172.21.15.78:0/1687791794 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901c01f030 con 0x564b83854d80 2024-09-11T00:20:08.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.455+0000 7f90037fe640 1 -- 172.21.15.78:0/1687791794 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f901c0ab620 con 0x564b83854d80 2024-09-11T00:20:08.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.455+0000 7f902cadd740 1 -- 172.21.15.78:0/1687791794 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9018019070 con 0x564b83854d80 2024-09-11T00:20:08.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.455+0000 7f90037fe640 1 -- 172.21.15.78:0/1687791794 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f901c0b0ea0 con 0x564b83854d80 2024-09-11T00:20:08.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.455+0000 7f902cadd740 10 client.15780 fetch_fsmap learned FSMap version 20 2024-09-11T00:20:08.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.455+0000 7f902cadd740 1 -- 172.21.15.78:0/1687791794 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564b83863410 con 0x564b83854d80 2024-09-11T00:20:08.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.455+0000 7f90037fe640 1 -- 172.21.15.78:0/1687791794 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9018019070 con 0x564b83854d80 2024-09-11T00:20:08.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.456+0000 7f90037fe640 1 -- 172.21.15.78:0/1687791794 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f901c0a7d10 con 0x564b83854d80 2024-09-11T00:20:08.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.456+0000 7f902cadd740 10 client.15780 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:20:08.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.456+0000 7f902cadd740 10 client.15780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:20:08.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.456+0000 7f902cadd740 20 client.15780 populate_metadata read hostname 'smithi078' 2024-09-11T00:20:08.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.456+0000 7f902cadd740 1 --2- 172.21.15.78:0/1687791794 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564b83864970 0x564b83866d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:08.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.456+0000 7f902cadd740 4 client.15780 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:20:08.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.456+0000 7f902cadd740 1 -- 172.21.15.78:0/1687791794 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b837c0df0 con 0x564b83864970 2024-09-11T00:20:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.456+0000 7f9023fff640 1 --2- 172.21.15.78:0/1687791794 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564b83864970 0x564b83866d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.456+0000 7f90037fe640 10 client.15780 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.456+0000 7f9023fff640 1 --2- 172.21.15.78:0/1687791794 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564b83864970 0x564b83866d60 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c9f6b3679f398eb server_cookie=e8682011f6863bbb in_seq=0 out_seq=0 2024-09-11T00:20:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.457+0000 7f90037fe640 1 -- 172.21.15.78:0/1687791794 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564b837c0df0 con 0x564b83864970 2024-09-11T00:20:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.457+0000 7f90037fe640 10 client.15780 handle_command_reply: tid=0 2024-09-11T00:20:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.457+0000 7f902cadd740 1 client.15780 shutdown 2024-09-11T00:20:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.457+0000 7f902cadd740 1 -- 172.21.15.78:0/1687791794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b83854d80 msgr2=0x564b838521c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.457+0000 7f902cadd740 1 --2- 172.21.15.78:0/1687791794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b83854d80 0x564b838521c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f901c0e3c90 tx=0x7f901c005450 comp rx=0 tx=0).stop 2024-09-11T00:20:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.457+0000 7f902cadd740 1 -- 172.21.15.78:0/1687791794 shutdown_connections 2024-09-11T00:20:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.457+0000 7f902cadd740 1 --2- 172.21.15.78:0/1687791794 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564b83864970 0x564b83866d60 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.457+0000 7f902cadd740 1 --2- 172.21.15.78:0/1687791794 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b83854d80 0x564b838521c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.457+0000 7f902cadd740 1 --2- 172.21.15.78:0/1687791794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b83848df0 0x564b83851b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.457+0000 7f902cadd740 1 --2- 172.21.15.78:0/1687791794 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564b838484d0 0x564b838546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.457+0000 7f90037fe640 0 client.15780 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.457+0000 7f902cadd740 1 -- 172.21.15.78:0/1687791794 >> 172.21.15.78:0/1687791794 conn(0x564b83846300 msgr2=0x564b8384be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.458+0000 7f902cadd740 1 -- 172.21.15.78:0/1687791794 shutdown_connections 2024-09-11T00:20:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.458+0000 7f902cadd740 1 -- 172.21.15.78:0/1687791794 wait complete. 2024-09-11T00:20:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.458+0000 7f902cadd740 20 client.15780 trim_cache size 0 max 16384 2024-09-11T00:20:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.470+0000 7f902cadd740 1 Processor -- start 2024-09-11T00:20:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.470+0000 7f902cadd740 1 -- start start 2024-09-11T00:20:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.471+0000 7f902cadd740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b838484d0 0x564b83860c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.471+0000 7f902cadd740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564b83848df0 0x564b83856170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.471+0000 7f902cadd740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b83854d80 0x564b838566b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.471+0000 7f902cadd740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f90241ac770 con 0x564b838484d0 2024-09-11T00:20:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.471+0000 7f902cadd740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f90241aeff0 con 0x564b83848df0 2024-09-11T00:20:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.471+0000 7f902cadd740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f90241acde0 con 0x564b83854d80 2024-09-11T00:20:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.471+0000 7f9023fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b838484d0 0x564b83860c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.471+0000 7f9023fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b838484d0 0x564b83860c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33180/0 (socket says 172.21.15.78:33180) 2024-09-11T00:20:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.471+0000 7f9023fff640 1 -- 172.21.15.78:0/3800769496 learned_addr learned my addr 172.21.15.78:0/3800769496 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.471+0000 7f9023fff640 1 -- 172.21.15.78:0/3800769496 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b83854d80 msgr2=0x564b838566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.471+0000 7f9023fff640 1 --2- 172.21.15.78:0/3800769496 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b83854d80 0x564b838566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.471+0000 7f9023fff640 1 -- 172.21.15.78:0/3800769496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564b83848df0 msgr2=0x564b83856170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.471+0000 7f9023fff640 1 --2- 172.21.15.78:0/3800769496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564b83848df0 0x564b83856170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.471+0000 7f9023fff640 1 -- 172.21.15.78:0/3800769496 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b83867390 con 0x564b838484d0 2024-09-11T00:20:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.471+0000 7f9023fff640 1 --2- 172.21.15.78:0/3800769496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b838484d0 0x564b83860c30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9014009230 tx=0x7f901403c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f8ff1d3a8690aa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.471+0000 7f9009ffb640 1 -- 172.21.15.78:0/3800769496 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014035050 con 0x564b838484d0 2024-09-11T00:20:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.471+0000 7f9009ffb640 1 -- 172.21.15.78:0/3800769496 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9014005050 con 0x564b838484d0 2024-09-11T00:20:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.471+0000 7f9009ffb640 1 -- 172.21.15.78:0/3800769496 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014004760 con 0x564b838484d0 2024-09-11T00:20:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.472+0000 7f902cadd740 1 -- 172.21.15.78:0/3800769496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b838484d0 msgr2=0x564b83860c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.472+0000 7f902cadd740 1 --2- 172.21.15.78:0/3800769496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b838484d0 0x564b83860c30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9014009230 tx=0x7f901403c000 comp rx=0 tx=0).stop 2024-09-11T00:20:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.472+0000 7f902cadd740 1 -- 172.21.15.78:0/3800769496 shutdown_connections 2024-09-11T00:20:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.472+0000 7f902cadd740 1 --2- 172.21.15.78:0/3800769496 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b83854d80 0x564b838566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.472+0000 7f902cadd740 1 --2- 172.21.15.78:0/3800769496 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564b83848df0 0x564b83856170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.472+0000 7f902cadd740 1 --2- 172.21.15.78:0/3800769496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b838484d0 0x564b83860c30 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.472+0000 7f902cadd740 1 -- 172.21.15.78:0/3800769496 >> 172.21.15.78:0/3800769496 conn(0x564b83846300 msgr2=0x564b8384cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.472+0000 7f902cadd740 1 -- 172.21.15.78:0/3800769496 shutdown_connections 2024-09-11T00:20:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.472+0000 7f902cadd740 1 -- 172.21.15.78:0/3800769496 wait complete. 2024-09-11T00:20:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.472+0000 7f902cadd740 1 -- start start 2024-09-11T00:20:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.473+0000 7f902cadd740 1 Processor -- start 2024-09-11T00:20:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.473+0000 7f902cadd740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564b838484d0 0x564b8386c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.473+0000 7f902cadd740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b83848df0 0x564b8386ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.473+0000 7f902cadd740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b83854d80 0x564b8386cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.473+0000 7f902cadd740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f90241ad4b0 con 0x564b83848df0 2024-09-11T00:20:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.473+0000 7f902cadd740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f90241ae920 con 0x564b838484d0 2024-09-11T00:20:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.473+0000 7f902cadd740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f90241adb80 con 0x564b83854d80 2024-09-11T00:20:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.473+0000 7f902cadd740 10 client.0 _ll_register_callbacks cb 0x7f901c0a8260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:20:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.473+0000 7f90237fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b83848df0 0x564b8386ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.473+0000 7f90237fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b83848df0 0x564b8386ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33188/0 (socket says 172.21.15.78:33188) 2024-09-11T00:20:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.473+0000 7f90237fe640 1 -- 172.21.15.78:0/2777327307 learned_addr learned my addr 172.21.15.78:0/2777327307 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.473+0000 7f90237fe640 1 -- 172.21.15.78:0/2777327307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b83854d80 msgr2=0x564b8386cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.473+0000 7f90237fe640 1 --2- 172.21.15.78:0/2777327307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b83854d80 0x564b8386cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.473+0000 7f90237fe640 1 -- 172.21.15.78:0/2777327307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564b838484d0 msgr2=0x564b8386c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.473+0000 7f90237fe640 1 --2- 172.21.15.78:0/2777327307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564b838484d0 0x564b8386c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.473+0000 7f90237fe640 1 -- 172.21.15.78:0/2777327307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b83859290 con 0x564b83848df0 2024-09-11T00:20:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.473+0000 7f90237fe640 1 --2- 172.21.15.78:0/2777327307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b83848df0 0x564b8386ca50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f901800cc30 tx=0x7f901800ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641a9d5e0e3a4619 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.473+0000 7f90037fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:20:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.473+0000 7f90037fe640 1 -- 172.21.15.78:0/2777327307 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9018014620 con 0x564b83848df0 2024-09-11T00:20:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.474+0000 7f90037fe640 1 -- 172.21.15.78:0/2777327307 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f90180147c0 con 0x564b83848df0 2024-09-11T00:20:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.474+0000 7f902cadd740 1 -- 172.21.15.78:0/2777327307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9014005050 con 0x564b83848df0 2024-09-11T00:20:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.474+0000 7f90037fe640 1 -- 172.21.15.78:0/2777327307 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f90180149c0 con 0x564b83848df0 2024-09-11T00:20:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.474+0000 7f902cadd740 10 client.15786 fetch_fsmap learned FSMap version 20 2024-09-11T00:20:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.474+0000 7f902cadd740 1 -- 172.21.15.78:0/2777327307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564b838d5fa0 con 0x564b83848df0 2024-09-11T00:20:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.474+0000 7f90037fe640 1 -- 172.21.15.78:0/2777327307 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9014005050 con 0x564b83848df0 2024-09-11T00:20:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.474+0000 7f90037fe640 1 -- 172.21.15.78:0/2777327307 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f901802f020 con 0x564b83848df0 2024-09-11T00:20:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.474+0000 7f902cadd740 10 client.15786 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:20:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.474+0000 7f902cadd740 10 client.15786 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:20:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.474+0000 7f902cadd740 20 client.15786 populate_metadata read hostname 'smithi078' 2024-09-11T00:20:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.474+0000 7f902cadd740 1 --2- 172.21.15.78:0/2777327307 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564b838d6510 0x564b838d8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.474+0000 7f902cadd740 4 client.15786 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:20:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.474+0000 7f902cadd740 1 -- 172.21.15.78:0/2777327307 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564b837bc8a0 con 0x564b838d6510 2024-09-11T00:20:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.474+0000 7f9023fff640 1 --2- 172.21.15.78:0/2777327307 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564b838d6510 0x564b838d8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.475+0000 7f9023fff640 1 --2- 172.21.15.78:0/2777327307 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564b838d6510 0x564b838d8930 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b0a588bfc4f96b server_cookie=263b14b148ab38ad in_seq=0 out_seq=0 2024-09-11T00:20:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.475+0000 7f90037fe640 10 client.15786 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.475+0000 7f90037fe640 1 -- 172.21.15.78:0/2777327307 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564b837bc8a0 con 0x564b838d6510 2024-09-11T00:20:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.475+0000 7f90037fe640 10 client.15786 handle_command_reply: tid=0 2024-09-11T00:20:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.475+0000 7f902cadd740 1 client.15786 shutdown 2024-09-11T00:20:08.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.475+0000 7f902cadd740 1 -- 172.21.15.78:0/2777327307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b83848df0 msgr2=0x564b8386ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:08.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.475+0000 7f902cadd740 1 --2- 172.21.15.78:0/2777327307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b83848df0 0x564b8386ca50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f901800cc30 tx=0x7f901800ce10 comp rx=0 tx=0).stop 2024-09-11T00:20:08.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.475+0000 7f902cadd740 1 -- 172.21.15.78:0/2777327307 shutdown_connections 2024-09-11T00:20:08.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.475+0000 7f902cadd740 1 --2- 172.21.15.78:0/2777327307 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564b838d6510 0x564b838d8930 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.475+0000 7f902cadd740 1 --2- 172.21.15.78:0/2777327307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b83854d80 0x564b8386cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.475+0000 7f90037fe640 0 client.15786 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:08.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.475+0000 7f902cadd740 1 --2- 172.21.15.78:0/2777327307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564b83848df0 0x564b8386ca50 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.475+0000 7f902cadd740 1 --2- 172.21.15.78:0/2777327307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564b838484d0 0x564b8386c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.475+0000 7f902cadd740 1 -- 172.21.15.78:0/2777327307 >> 172.21.15.78:0/2777327307 conn(0x564b83846300 msgr2=0x564b83853170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:08.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.475+0000 7f902cadd740 1 -- 172.21.15.78:0/2777327307 shutdown_connections 2024-09-11T00:20:08.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.475+0000 7f902cadd740 1 -- 172.21.15.78:0/2777327307 wait complete. 2024-09-11T00:20:08.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.475+0000 7f902cadd740 20 client.15786 trim_cache size 0 max 16384 2024-09-11T00:20:08.506 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-11T00:20:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.476+0000 7f902a708640 1 -- 172.21.15.78:0/212002820 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f900c0b5450 msgr2=0x7f900c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.476+0000 7f902a708640 1 --2- 172.21.15.78:0/212002820 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f900c0b5450 0x7f900c0b7910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9014031440 tx=0x7f9014005de0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.476+0000 7f902a708640 1 -- 172.21.15.78:0/212002820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f902410d140 msgr2=0x7f902419ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.476+0000 7f902a708640 1 --2- 172.21.15.78:0/212002820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f902410d140 0x7f902419ec40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f901c00eaa0 tx=0x7f901c00ef60 comp rx=0 tx=0).stop 2024-09-11T00:20:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.476+0000 7f902a708640 1 -- 172.21.15.78:0/212002820 shutdown_connections 2024-09-11T00:20:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.476+0000 7f902a708640 1 --2- 172.21.15.78:0/212002820 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f900c0b5450 0x7f900c0b7910 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.476+0000 7f902a708640 1 --2- 172.21.15.78:0/212002820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f902410d140 0x7f902419ec40 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.476+0000 7f902a708640 1 --2- 172.21.15.78:0/212002820 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9024104600 0x7f90241998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.476+0000 7f902a708640 1 --2- 172.21.15.78:0/212002820 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9024103ce0 0x7f9024199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:08.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.476+0000 7f902a708640 1 -- 172.21.15.78:0/212002820 >> 172.21.15.78:0/212002820 conn(0x7f90240fd700 msgr2=0x7f90240fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:08.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.476+0000 7f902a708640 1 -- 172.21.15.78:0/212002820 shutdown_connections 2024-09-11T00:20:08.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:08.476+0000 7f902a708640 1 -- 172.21.15.78:0/212002820 wait complete. 2024-09-11T00:20:10.368 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:20:10.369 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:20:10.620 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:20:11.068 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:10 smithi078 ceph-mon[30865]: pgmap v434: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:20:11.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.150+0000 7f10fbb45640 1 -- 172.21.15.78:0/212346644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10f41077c0 msgr2=0x7f10f410dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:11.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.150+0000 7f10fbb45640 1 --2- 172.21.15.78:0/212346644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10f41077c0 0x7f10f410dfc0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f10ec009900 tx=0x7f10ec02a410 comp rx=0 tx=0).stop 2024-09-11T00:20:11.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.150+0000 7f10fbb45640 1 -- 172.21.15.78:0/212346644 shutdown_connections 2024-09-11T00:20:11.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.150+0000 7f10fbb45640 1 --2- 172.21.15.78:0/212346644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10f41077c0 0x7f10f410dfc0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.150+0000 7f10fbb45640 1 --2- 172.21.15.78:0/212346644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10f4106e40 0x7f10f4107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.150+0000 7f10fbb45640 1 --2- 172.21.15.78:0/212346644 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10f4101810 0x7f10f4101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.150+0000 7f10fbb45640 1 -- 172.21.15.78:0/212346644 >> 172.21.15.78:0/212346644 conn(0x7f10f4076f50 msgr2=0x7f10f4077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:11.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.150+0000 7f10fbb45640 1 -- 172.21.15.78:0/212346644 shutdown_connections 2024-09-11T00:20:11.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.150+0000 7f10fbb45640 1 -- 172.21.15.78:0/212346644 wait complete. 2024-09-11T00:20:11.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.150+0000 7f10fbb45640 1 Processor -- start 2024-09-11T00:20:11.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.150+0000 7f10fbb45640 1 -- start start 2024-09-11T00:20:11.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.151+0000 7f10fbb45640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10f4101810 0x7f10f4199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:11.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.151+0000 7f10fbb45640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10f4106e40 0x7f10f4199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:11.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.151+0000 7f10fbb45640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10f41077c0 0x7f10f419ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:11.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.151+0000 7f10fbb45640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f10f4110bd0 con 0x7f10f41077c0 2024-09-11T00:20:11.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.151+0000 7f10fbb45640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f10f4110a50 con 0x7f10f4101810 2024-09-11T00:20:11.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.151+0000 7f10fbb45640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f10f4110d50 con 0x7f10f4106e40 2024-09-11T00:20:11.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.151+0000 7f10fa0e2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10f41077c0 0x7f10f419ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:11.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.151+0000 7f10fa0e2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10f41077c0 0x7f10f419ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33200/0 (socket says 172.21.15.78:33200) 2024-09-11T00:20:11.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.151+0000 7f10fa0e2640 1 -- 172.21.15.78:0/1223964763 learned_addr learned my addr 172.21.15.78:0/1223964763 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:11.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.151+0000 7f10f98e1640 1 --2- 172.21.15.78:0/1223964763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10f4101810 0x7f10f4199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:11.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.151+0000 7f10f90e0640 1 --2- 172.21.15.78:0/1223964763 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10f4106e40 0x7f10f4199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:11.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.151+0000 7f10fa0e2640 1 -- 172.21.15.78:0/1223964763 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10f4106e40 msgr2=0x7f10f4199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:11.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.151+0000 7f10fa0e2640 1 --2- 172.21.15.78:0/1223964763 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10f4106e40 0x7f10f4199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.151+0000 7f10fa0e2640 1 -- 172.21.15.78:0/1223964763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10f4101810 msgr2=0x7f10f4199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:11.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.151+0000 7f10fa0e2640 1 --2- 172.21.15.78:0/1223964763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10f4101810 0x7f10f4199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.151+0000 7f10fa0e2640 1 -- 172.21.15.78:0/1223964763 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f419f3c0 con 0x7f10f41077c0 2024-09-11T00:20:11.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.151+0000 7f10fa0e2640 1 --2- 172.21.15.78:0/1223964763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10f41077c0 0x7f10f419ebf0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f10ec004770 tx=0x7f10ec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:11.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.151+0000 7f10f2ffd640 1 -- 172.21.15.78:0/1223964763 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec03f030 con 0x7f10f41077c0 2024-09-11T00:20:11.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.152+0000 7f10f2ffd640 1 -- 172.21.15.78:0/1223964763 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10ec003aa0 con 0x7f10f41077c0 2024-09-11T00:20:11.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.152+0000 7f10fbb45640 1 -- 172.21.15.78:0/1223964763 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f419f650 con 0x7f10f41077c0 2024-09-11T00:20:11.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.152+0000 7f10f2ffd640 1 -- 172.21.15.78:0/1223964763 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec035070 con 0x7f10f41077c0 2024-09-11T00:20:11.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.152+0000 7f10fbb45640 1 -- 172.21.15.78:0/1223964763 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f41a5d70 con 0x7f10f41077c0 2024-09-11T00:20:11.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.154+0000 7f10fdf1a740 1 Processor -- start 2024-09-11T00:20:11.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.154+0000 7f10f2ffd640 1 -- 172.21.15.78:0/1223964763 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f10ec0035f0 con 0x7f10f41077c0 2024-09-11T00:20:11.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.154+0000 7f10fdf1a740 1 -- start start 2024-09-11T00:20:11.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.154+0000 7f10fdf1a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d799aee0 0x55f0d799b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:11.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.154+0000 7f10fdf1a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f0d799b800 0x55f0d79ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:11.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.154+0000 7f10fdf1a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0d79abba0 0x55f0d79adf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:11.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.154+0000 7f10fdf1a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f0d7911e60 con 0x55f0d799aee0 2024-09-11T00:20:11.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.154+0000 7f10fdf1a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f0d7901290 con 0x55f0d799b800 2024-09-11T00:20:11.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.154+0000 7f10fdf1a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55f0d79050a0 con 0x55f0d79abba0 2024-09-11T00:20:11.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.155+0000 7f10f90e0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d799aee0 0x55f0d799b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:11.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.155+0000 7f10f90e0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d799aee0 0x55f0d799b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33202/0 (socket says 172.21.15.78:33202) 2024-09-11T00:20:11.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.155+0000 7f10f90e0640 1 -- 172.21.15.78:0/3075279133 learned_addr learned my addr 172.21.15.78:0/3075279133 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:11.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.155+0000 7f10f98e1640 1 --2- 172.21.15.78:0/3075279133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f0d799b800 0x55f0d79ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:11.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.155+0000 7f10f90e0640 1 --2- 172.21.15.78:0/3075279133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0d79abba0 0x55f0d79adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:11.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.155+0000 7f10f90e0640 1 -- 172.21.15.78:0/3075279133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0d79abba0 msgr2=0x55f0d79adf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:11.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.155+0000 7f10f90e0640 1 --2- 172.21.15.78:0/3075279133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0d79abba0 0x55f0d79adf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.155+0000 7f10f90e0640 1 -- 172.21.15.78:0/3075279133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f0d799b800 msgr2=0x55f0d79ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:11.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.155+0000 7f10f90e0640 1 --2- 172.21.15.78:0/3075279133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f0d799b800 0x55f0d79ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.155+0000 7f10f90e0640 1 -- 172.21.15.78:0/3075279133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0d765f930 con 0x55f0d799aee0 2024-09-11T00:20:11.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.155+0000 7f10f2ffd640 1 --2- 172.21.15.78:0/1223964763 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f10dc0b5450 0x7f10dc0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:11.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.155+0000 7f10f90e0640 1 --2- 172.21.15.78:0/3075279133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d799aee0 0x55f0d799b2c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f10e800bfa0 tx=0x7f10e800b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2dd6ba8e23decb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:11.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.155+0000 7f10f98e1640 1 --2- 172.21.15.78:0/1223964763 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f10dc0b5450 0x7f10dc0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:11.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.155+0000 7f10f2ffd640 1 -- 172.21.15.78:0/1223964763 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f10ec106a10 con 0x7f10f41077c0 2024-09-11T00:20:11.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.155+0000 7f10dbfff640 1 -- 172.21.15.78:0/3075279133 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e8005020 con 0x55f0d799aee0 2024-09-11T00:20:11.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.156+0000 7f10dbfff640 1 -- 172.21.15.78:0/3075279133 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10e8005bf0 con 0x55f0d799aee0 2024-09-11T00:20:11.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.156+0000 7f10dbfff640 1 -- 172.21.15.78:0/3075279133 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e800da10 con 0x55f0d799aee0 2024-09-11T00:20:11.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.156+0000 7f10fdf1a740 1 -- 172.21.15.78:0/3075279133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d799aee0 msgr2=0x55f0d799b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:11.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.156+0000 7f10fdf1a740 1 --2- 172.21.15.78:0/3075279133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d799aee0 0x55f0d799b2c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f10e800bfa0 tx=0x7f10e800b6b0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.156+0000 7f10f98e1640 1 --2- 172.21.15.78:0/1223964763 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f10dc0b5450 0x7f10dc0b7910 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55f0d799f120 tx=0x7f10e400a590 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:11.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.156+0000 7f10fdf1a740 1 -- 172.21.15.78:0/3075279133 shutdown_connections 2024-09-11T00:20:11.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.156+0000 7f10fdf1a740 1 --2- 172.21.15.78:0/3075279133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0d79abba0 0x55f0d79adf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.156+0000 7f10fdf1a740 1 --2- 172.21.15.78:0/3075279133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f0d799b800 0x55f0d79ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.156+0000 7f10fdf1a740 1 --2- 172.21.15.78:0/3075279133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d799aee0 0x55f0d799b2c0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.156+0000 7f10fdf1a740 1 -- 172.21.15.78:0/3075279133 >> 172.21.15.78:0/3075279133 conn(0x55f0d7998d10 msgr2=0x55f0d7999eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:11.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.156+0000 7f10fdf1a740 1 -- 172.21.15.78:0/3075279133 shutdown_connections 2024-09-11T00:20:11.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.156+0000 7f10fdf1a740 1 -- 172.21.15.78:0/3075279133 wait complete. 2024-09-11T00:20:11.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.157+0000 7f10fdf1a740 1 -- start start 2024-09-11T00:20:11.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.157+0000 7f10fdf1a740 1 Processor -- start 2024-09-11T00:20:11.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.157+0000 7f10fdf1a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0d799aee0 0x55f0d79a8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:11.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.157+0000 7f10fdf1a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d799b800 0x55f0d79a9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:11.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.157+0000 7f10fdf1a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f0d79abba0 0x55f0d79a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:11.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.157+0000 7f10fdf1a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f0d7762890 con 0x55f0d799b800 2024-09-11T00:20:11.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.157+0000 7f10fdf1a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f0d789bd40 con 0x55f0d79abba0 2024-09-11T00:20:11.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.157+0000 7f10fdf1a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55f0d79ae850 con 0x55f0d799aee0 2024-09-11T00:20:11.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.157+0000 7f10fdf1a740 10 client.0 _ll_register_callbacks cb 0x55f0d78ffc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:20:11.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.157+0000 7f10f90e0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d799b800 0x55f0d79a9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:11.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.157+0000 7f10f90e0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d799b800 0x55f0d79a9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33218/0 (socket says 172.21.15.78:33218) 2024-09-11T00:20:11.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.157+0000 7f10f90e0640 1 -- 172.21.15.78:0/3082551991 learned_addr learned my addr 172.21.15.78:0/3082551991 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:11.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.158+0000 7f10fa0e2640 1 --2- 172.21.15.78:0/3082551991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f0d79abba0 0x55f0d79a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:11.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.158+0000 7f10f98e1640 1 --2- 172.21.15.78:0/3082551991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0d799aee0 0x55f0d79a8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:11.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.158+0000 7f10f90e0640 1 -- 172.21.15.78:0/3082551991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0d799aee0 msgr2=0x55f0d79a8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:11.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.158+0000 7f10f90e0640 1 --2- 172.21.15.78:0/3082551991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0d799aee0 0x55f0d79a8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.158+0000 7f10f90e0640 1 -- 172.21.15.78:0/3082551991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f0d79abba0 msgr2=0x55f0d79a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:11.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.158+0000 7f10f90e0640 1 --2- 172.21.15.78:0/3082551991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f0d79abba0 0x55f0d79a95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.158+0000 7f10f90e0640 1 -- 172.21.15.78:0/3082551991 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0d79b7c30 con 0x55f0d799b800 2024-09-11T00:20:11.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.158+0000 7f10f90e0640 1 --2- 172.21.15.78:0/3082551991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d799b800 0x55f0d79a9070 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f10e8011410 tx=0x7f10e800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4334916f54fb62 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:11.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.158+0000 7f10d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:20:11.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.158+0000 7f10d97fa640 1 -- 172.21.15.78:0/3082551991 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e8005230 con 0x55f0d799b800 2024-09-11T00:20:11.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.158+0000 7f10d97fa640 1 -- 172.21.15.78:0/3082551991 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f10e80053d0 con 0x55f0d799b800 2024-09-11T00:20:11.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.158+0000 7f10fdf1a740 1 -- 172.21.15.78:0/3082551991 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f0d7913db0 con 0x55f0d799b800 2024-09-11T00:20:11.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.158+0000 7f10d97fa640 1 -- 172.21.15.78:0/3082551991 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f10e80055d0 con 0x55f0d799b800 2024-09-11T00:20:11.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.158+0000 7f10fdf1a740 10 client.15798 fetch_fsmap learned FSMap version 20 2024-09-11T00:20:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.158+0000 7f10fdf1a740 1 -- 172.21.15.78:0/3082551991 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f0d79ba5e0 con 0x55f0d799b800 2024-09-11T00:20:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.158+0000 7f10d97fa640 1 -- 172.21.15.78:0/3082551991 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f0d7913db0 con 0x55f0d799b800 2024-09-11T00:20:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.159+0000 7f10d97fa640 1 -- 172.21.15.78:0/3082551991 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f10e8025070 con 0x55f0d799b800 2024-09-11T00:20:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.159+0000 7f10fdf1a740 10 client.15798 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:20:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.159+0000 7f10fdf1a740 10 client.15798 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:20:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.159+0000 7f10fdf1a740 20 client.15798 populate_metadata read hostname 'smithi078' 2024-09-11T00:20:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.159+0000 7f10fdf1a740 1 --2- 172.21.15.78:0/3082551991 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55f0d79bb930 0x55f0d79bdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.159+0000 7f10fdf1a740 4 client.15798 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:20:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.159+0000 7f10fdf1a740 1 -- 172.21.15.78:0/3082551991 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0d790f860 con 0x55f0d79bb930 2024-09-11T00:20:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.159+0000 7f10f98e1640 1 --2- 172.21.15.78:0/3082551991 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55f0d79bb930 0x55f0d79bdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.159+0000 7f10d97fa640 10 client.15798 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.159+0000 7f10f98e1640 1 --2- 172.21.15.78:0/3082551991 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55f0d79bb930 0x55f0d79bdd20 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f26e61748fcda7d server_cookie=421d4e7d1ba3f18c in_seq=0 out_seq=0 2024-09-11T00:20:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.160+0000 7f10d97fa640 1 -- 172.21.15.78:0/3082551991 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f0d790f860 con 0x55f0d79bb930 2024-09-11T00:20:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.160+0000 7f10d97fa640 10 client.15798 handle_command_reply: tid=0 2024-09-11T00:20:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.160+0000 7f10fdf1a740 1 client.15798 shutdown 2024-09-11T00:20:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.160+0000 7f10fdf1a740 1 -- 172.21.15.78:0/3082551991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d799b800 msgr2=0x55f0d79a9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.160+0000 7f10fdf1a740 1 --2- 172.21.15.78:0/3082551991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d799b800 0x55f0d79a9070 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f10e8011410 tx=0x7f10e800b8f0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.160+0000 7f10fdf1a740 1 -- 172.21.15.78:0/3082551991 shutdown_connections 2024-09-11T00:20:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.160+0000 7f10fdf1a740 1 --2- 172.21.15.78:0/3082551991 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55f0d79bb930 0x55f0d79bdd20 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.160+0000 7f10fdf1a740 1 --2- 172.21.15.78:0/3082551991 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f0d79abba0 0x55f0d79a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.160+0000 7f10fdf1a740 1 --2- 172.21.15.78:0/3082551991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d799b800 0x55f0d79a9070 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.160+0000 7f10d97fa640 0 client.15798 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.160+0000 7f10fdf1a740 1 --2- 172.21.15.78:0/3082551991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0d799aee0 0x55f0d79a8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.160+0000 7f10fdf1a740 1 -- 172.21.15.78:0/3082551991 >> 172.21.15.78:0/3082551991 conn(0x55f0d7998d10 msgr2=0x55f0d7997f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.161+0000 7f10fdf1a740 1 -- 172.21.15.78:0/3082551991 shutdown_connections 2024-09-11T00:20:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.161+0000 7f10fdf1a740 1 -- 172.21.15.78:0/3082551991 wait complete. 2024-09-11T00:20:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.161+0000 7f10fdf1a740 20 client.15798 trim_cache size 0 max 16384 2024-09-11T00:20:11.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.178+0000 7f10fdf1a740 1 Processor -- start 2024-09-11T00:20:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.178+0000 7f10fdf1a740 1 -- start start 2024-09-11T00:20:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.178+0000 7f10fdf1a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0d799aee0 0x55f0d79a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.178+0000 7f10fdf1a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d799b800 0x55f0d799e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.178+0000 7f10fdf1a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f0d79abba0 0x55f0d79c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.178+0000 7f10fdf1a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f10f41aa510 con 0x55f0d799b800 2024-09-11T00:20:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.178+0000 7f10fdf1a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f10f41acd90 con 0x55f0d79abba0 2024-09-11T00:20:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.178+0000 7f10fdf1a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f10f41aab80 con 0x55f0d799aee0 2024-09-11T00:20:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.178+0000 7f10f90e0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d799b800 0x55f0d799e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.178+0000 7f10f90e0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d799b800 0x55f0d799e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33230/0 (socket says 172.21.15.78:33230) 2024-09-11T00:20:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.178+0000 7f10f90e0640 1 -- 172.21.15.78:0/3640159294 learned_addr learned my addr 172.21.15.78:0/3640159294 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.178+0000 7f10f90e0640 1 -- 172.21.15.78:0/3640159294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0d799aee0 msgr2=0x55f0d79a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.178+0000 7f10f90e0640 1 --2- 172.21.15.78:0/3640159294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0d799aee0 0x55f0d79a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.178+0000 7f10f90e0640 1 -- 172.21.15.78:0/3640159294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f0d79abba0 msgr2=0x55f0d79c34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:11.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.178+0000 7f10fa0e2640 1 --2- 172.21.15.78:0/3640159294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f0d79abba0 0x55f0d79c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:11.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.178+0000 7f10f90e0640 1 --2- 172.21.15.78:0/3640159294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f0d79abba0 0x55f0d79c34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.178+0000 7f10f90e0640 1 -- 172.21.15.78:0/3640159294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0d79ae040 con 0x55f0d799b800 2024-09-11T00:20:11.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.178+0000 7f10fa0e2640 1 --2- 172.21.15.78:0/3640159294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f0d79abba0 0x55f0d79c34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:11.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.179+0000 7f10f90e0640 1 --2- 172.21.15.78:0/3640159294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d799b800 0x55f0d799e730 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f10e800e630 tx=0x7f10e8005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903e77582922e6f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:11.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.179+0000 7f10db7fe640 1 -- 172.21.15.78:0/3640159294 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e800b440 con 0x55f0d799b800 2024-09-11T00:20:11.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.179+0000 7f10db7fe640 1 -- 172.21.15.78:0/3640159294 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10e8011440 con 0x55f0d799b800 2024-09-11T00:20:11.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.179+0000 7f10db7fe640 1 -- 172.21.15.78:0/3640159294 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e8005230 con 0x55f0d799b800 2024-09-11T00:20:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.179+0000 7f10fdf1a740 1 -- 172.21.15.78:0/3640159294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d799b800 msgr2=0x55f0d799e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.179+0000 7f10fdf1a740 1 --2- 172.21.15.78:0/3640159294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d799b800 0x55f0d799e730 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f10e800e630 tx=0x7f10e8005f70 comp rx=0 tx=0).stop 2024-09-11T00:20:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.179+0000 7f10fdf1a740 1 -- 172.21.15.78:0/3640159294 shutdown_connections 2024-09-11T00:20:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.179+0000 7f10fdf1a740 1 --2- 172.21.15.78:0/3640159294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f0d79abba0 0x55f0d79c34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.179+0000 7f10fdf1a740 1 --2- 172.21.15.78:0/3640159294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d799b800 0x55f0d799e730 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.179+0000 7f10fdf1a740 1 --2- 172.21.15.78:0/3640159294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0d799aee0 0x55f0d79a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.179+0000 7f10fdf1a740 1 -- 172.21.15.78:0/3640159294 >> 172.21.15.78:0/3640159294 conn(0x55f0d7998d10 msgr2=0x55f0d799e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:11.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.179+0000 7f10fdf1a740 1 -- 172.21.15.78:0/3640159294 shutdown_connections 2024-09-11T00:20:11.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.180+0000 7f10fdf1a740 1 -- 172.21.15.78:0/3640159294 wait complete. 2024-09-11T00:20:11.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.180+0000 7f10fdf1a740 1 -- start start 2024-09-11T00:20:11.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.180+0000 7f10fdf1a740 1 Processor -- start 2024-09-11T00:20:11.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.180+0000 7f10fdf1a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0d799aee0 0x55f0d79b2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:11.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.180+0000 7f10fdf1a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f0d799b800 0x55f0d79b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:11.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.180+0000 7f10fdf1a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d79abba0 0x55f0d7a276f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:11.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.180+0000 7f10fdf1a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f10f41ab250 con 0x55f0d79abba0 2024-09-11T00:20:11.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.180+0000 7f10fdf1a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f10f41ac6c0 con 0x55f0d799b800 2024-09-11T00:20:11.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.180+0000 7f10fdf1a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f10f41ab920 con 0x55f0d799aee0 2024-09-11T00:20:11.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.180+0000 7f10fdf1a740 10 client.0 _ll_register_callbacks cb 0x7f10e400a250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:20:11.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.180+0000 7f10fa0e2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d79abba0 0x55f0d7a276f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:11.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.180+0000 7f10fa0e2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d79abba0 0x55f0d7a276f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33232/0 (socket says 172.21.15.78:33232) 2024-09-11T00:20:11.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.180+0000 7f10fa0e2640 1 -- 172.21.15.78:0/1825435950 learned_addr learned my addr 172.21.15.78:0/1825435950 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:11.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.181+0000 7f10f90e0640 1 --2- 172.21.15.78:0/1825435950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f0d799b800 0x55f0d79b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:11.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.181+0000 7f10f98e1640 1 --2- 172.21.15.78:0/1825435950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0d799aee0 0x55f0d79b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:11.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.181+0000 7f10fa0e2640 1 -- 172.21.15.78:0/1825435950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0d799aee0 msgr2=0x55f0d79b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:11.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.181+0000 7f10fa0e2640 1 --2- 172.21.15.78:0/1825435950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0d799aee0 0x55f0d79b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.181+0000 7f10fa0e2640 1 -- 172.21.15.78:0/1825435950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f0d799b800 msgr2=0x55f0d79b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:11.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.181+0000 7f10fa0e2640 1 --2- 172.21.15.78:0/1825435950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f0d799b800 0x55f0d79b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.181+0000 7f10fa0e2640 1 -- 172.21.15.78:0/1825435950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0d7a27de0 con 0x55f0d79abba0 2024-09-11T00:20:11.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.181+0000 7f10fa0e2640 1 --2- 172.21.15.78:0/1825435950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d79abba0 0x55f0d7a276f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f10ec005c20 tx=0x7f10ec0c8e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3810466088b87633 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:11.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.181+0000 7f10d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:20:11.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.181+0000 7f10d97fa640 1 -- 172.21.15.78:0/1825435950 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec049040 con 0x55f0d79abba0 2024-09-11T00:20:11.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.181+0000 7f10d97fa640 1 -- 172.21.15.78:0/1825435950 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f10ec0c9120 con 0x55f0d79abba0 2024-09-11T00:20:11.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.181+0000 7f10fdf1a740 1 -- 172.21.15.78:0/1825435950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10e8011440 con 0x55f0d79abba0 2024-09-11T00:20:11.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.181+0000 7f10d97fa640 1 -- 172.21.15.78:0/1825435950 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f10ec0cc9c0 con 0x55f0d79abba0 2024-09-11T00:20:11.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.181+0000 7f10fdf1a740 10 client.15804 fetch_fsmap learned FSMap version 20 2024-09-11T00:20:11.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.181+0000 7f10fdf1a740 1 -- 172.21.15.78:0/1825435950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f0d7a29070 con 0x55f0d79abba0 2024-09-11T00:20:11.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.181+0000 7f10d97fa640 1 -- 172.21.15.78:0/1825435950 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10e8011440 con 0x55f0d79abba0 2024-09-11T00:20:11.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.182+0000 7f10d97fa640 1 -- 172.21.15.78:0/1825435950 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f10ec0b40b0 con 0x55f0d79abba0 2024-09-11T00:20:11.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.182+0000 7f10fdf1a740 10 client.15804 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:20:11.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.182+0000 7f10fdf1a740 10 client.15804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:20:11.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.182+0000 7f10fdf1a740 20 client.15804 populate_metadata read hostname 'smithi078' 2024-09-11T00:20:11.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.182+0000 7f10fdf1a740 1 --2- 172.21.15.78:0/1825435950 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55f0d7a297e0 0x55f0d7a2bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:11.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.182+0000 7f10fdf1a740 4 client.15804 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:20:11.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.182+0000 7f10fdf1a740 1 -- 172.21.15.78:0/1825435950 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f0d790cc90 con 0x55f0d7a297e0 2024-09-11T00:20:11.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.182+0000 7f10f98e1640 1 --2- 172.21.15.78:0/1825435950 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55f0d7a297e0 0x55f0d7a2bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:11.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.182+0000 7f10d97fa640 10 client.15804 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:11.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.182+0000 7f10f98e1640 1 --2- 172.21.15.78:0/1825435950 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55f0d7a297e0 0x55f0d7a2bbd0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe3584c65e6dcbc5 server_cookie=ab86e52d9c4744c9 in_seq=0 out_seq=0 2024-09-11T00:20:11.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.184+0000 7f10d97fa640 1 -- 172.21.15.78:0/1825435950 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f0d790cc90 con 0x55f0d7a297e0 2024-09-11T00:20:11.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.184+0000 7f10d97fa640 10 client.15804 handle_command_reply: tid=0 2024-09-11T00:20:11.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.184+0000 7f10fdf1a740 1 client.15804 shutdown 2024-09-11T00:20:11.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.184+0000 7f10fdf1a740 1 -- 172.21.15.78:0/1825435950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d79abba0 msgr2=0x55f0d7a276f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:11.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.184+0000 7f10fdf1a740 1 --2- 172.21.15.78:0/1825435950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d79abba0 0x55f0d7a276f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f10ec005c20 tx=0x7f10ec0c8e10 comp rx=0 tx=0).stop 2024-09-11T00:20:11.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.184+0000 7f10fdf1a740 1 -- 172.21.15.78:0/1825435950 shutdown_connections 2024-09-11T00:20:11.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.184+0000 7f10fdf1a740 1 --2- 172.21.15.78:0/1825435950 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55f0d7a297e0 0x55f0d7a2bbd0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.184+0000 7f10fdf1a740 1 --2- 172.21.15.78:0/1825435950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f0d79abba0 0x55f0d7a276f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.184+0000 7f10fdf1a740 1 --2- 172.21.15.78:0/1825435950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f0d799b800 0x55f0d79b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.184+0000 7f10fdf1a740 1 --2- 172.21.15.78:0/1825435950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0d799aee0 0x55f0d79b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.184+0000 7f10d97fa640 0 client.15804 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:11.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.184+0000 7f10fdf1a740 1 -- 172.21.15.78:0/1825435950 >> 172.21.15.78:0/1825435950 conn(0x55f0d7998d10 msgr2=0x55f0d79b72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:11.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.184+0000 7f10fdf1a740 1 -- 172.21.15.78:0/1825435950 shutdown_connections 2024-09-11T00:20:11.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.184+0000 7f10fdf1a740 1 -- 172.21.15.78:0/1825435950 wait complete. 2024-09-11T00:20:11.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.184+0000 7f10fdf1a740 20 client.15804 trim_cache size 0 max 16384 2024-09-11T00:20:11.191 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:20:11.191 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-11T00:20:11.191 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "b854cbd3-8ca7-4277-a205-8887d2ff5567", 2024-09-11T00:20:11.191 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-11T00:20:11.191 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:20:11.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.185+0000 7f10fbb45640 1 -- 172.21.15.78:0/1223964763 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f10dc0b5450 msgr2=0x7f10dc0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:11.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.185+0000 7f10fbb45640 1 --2- 172.21.15.78:0/1223964763 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f10dc0b5450 0x7f10dc0b7910 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55f0d799f120 tx=0x7f10e400a590 comp rx=0 tx=0).stop 2024-09-11T00:20:11.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.185+0000 7f10fbb45640 1 -- 172.21.15.78:0/1223964763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10f41077c0 msgr2=0x7f10f419ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:11.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.185+0000 7f10fbb45640 1 --2- 172.21.15.78:0/1223964763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10f41077c0 0x7f10f419ebf0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f10ec004770 tx=0x7f10ec004270 comp rx=0 tx=0).stop 2024-09-11T00:20:11.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.185+0000 7f10fbb45640 1 -- 172.21.15.78:0/1223964763 shutdown_connections 2024-09-11T00:20:11.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.185+0000 7f10fbb45640 1 --2- 172.21.15.78:0/1223964763 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f10dc0b5450 0x7f10dc0b7910 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.185+0000 7f10fbb45640 1 --2- 172.21.15.78:0/1223964763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10f41077c0 0x7f10f419ebf0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.185+0000 7f10fbb45640 1 --2- 172.21.15.78:0/1223964763 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10f4106e40 0x7f10f4199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.185+0000 7f10fbb45640 1 --2- 172.21.15.78:0/1223964763 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f10f4101810 0x7f10f4199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:11.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.185+0000 7f10fbb45640 1 -- 172.21.15.78:0/1223964763 >> 172.21.15.78:0/1223964763 conn(0x7f10f4076f50 msgr2=0x7f10f4104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:11.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.185+0000 7f10fbb45640 1 -- 172.21.15.78:0/1223964763 shutdown_connections 2024-09-11T00:20:11.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:11.185+0000 7f10fbb45640 1 -- 172.21.15.78:0/1223964763 wait complete. 2024-09-11T00:20:11.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:10 smithi112 ceph-mon[35627]: pgmap v434: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:20:11.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:10 smithi138 ceph-mon[35019]: pgmap v434: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:20:11.943 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:20:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:11 smithi078 ceph-mon[30865]: scrub queued for path: / 2024-09-11T00:20:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:11 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:20:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:11 smithi078 ceph-mon[30865]: scrub summary: active paths [/] 2024-09-11T00:20:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:11 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:20:12.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:11 smithi078 ceph-mon[30865]: scrub summary: idle 2024-09-11T00:20:12.190 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:20:12.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:11 smithi112 ceph-mon[35627]: scrub queued for path: / 2024-09-11T00:20:12.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:11 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:20:12.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:11 smithi112 ceph-mon[35627]: scrub summary: active paths [/] 2024-09-11T00:20:12.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:11 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:20:12.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:11 smithi112 ceph-mon[35627]: scrub summary: idle 2024-09-11T00:20:12.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:11 smithi138 ceph-mon[35019]: scrub queued for path: / 2024-09-11T00:20:12.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:11 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:20:12.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:11 smithi138 ceph-mon[35019]: scrub summary: active paths [/] 2024-09-11T00:20:12.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:11 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:20:12.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:11 smithi138 ceph-mon[35019]: scrub summary: idle 2024-09-11T00:20:12.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.681+0000 7fd36171d640 1 -- 172.21.15.78:0/905055321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd35c101cb0 msgr2=0x7fd35c102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:12.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.681+0000 7fd36171d640 1 --2- 172.21.15.78:0/905055321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd35c101cb0 0x7fd35c102090 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009900 tx=0x7fd34c02a410 comp rx=0 tx=0).stop 2024-09-11T00:20:12.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.681+0000 7fd36171d640 1 -- 172.21.15.78:0/905055321 shutdown_connections 2024-09-11T00:20:12.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.681+0000 7fd36171d640 1 --2- 172.21.15.78:0/905055321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd35c108040 0x7fd35c10e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.681+0000 7fd36171d640 1 --2- 172.21.15.78:0/905055321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd35c1076c0 0x7fd35c107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.681+0000 7fd36171d640 1 --2- 172.21.15.78:0/905055321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd35c101cb0 0x7fd35c102090 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.681+0000 7fd36171d640 1 -- 172.21.15.78:0/905055321 >> 172.21.15.78:0/905055321 conn(0x7fd35c0fd700 msgr2=0x7fd35c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:12.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.681+0000 7fd36171d640 1 -- 172.21.15.78:0/905055321 shutdown_connections 2024-09-11T00:20:12.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.681+0000 7fd36171d640 1 -- 172.21.15.78:0/905055321 wait complete. 2024-09-11T00:20:12.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.682+0000 7fd36171d640 1 Processor -- start 2024-09-11T00:20:12.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.682+0000 7fd36171d640 1 -- start start 2024-09-11T00:20:12.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.682+0000 7fd36171d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd35c101cb0 0x7fd35c197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:12.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.682+0000 7fd36171d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd35c1076c0 0x7fd35c1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:12.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.682+0000 7fd36171d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd35c108040 0x7fd35c198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:12.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.682+0000 7fd36171d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c111d00 con 0x7fd35c108040 2024-09-11T00:20:12.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.682+0000 7fd36171d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c111b80 con 0x7fd35c1076c0 2024-09-11T00:20:12.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.682+0000 7fd36171d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c111e80 con 0x7fd35c101cb0 2024-09-11T00:20:12.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.682+0000 7fd35b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd35c108040 0x7fd35c198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:12.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.682+0000 7fd35b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd35c108040 0x7fd35c198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33248/0 (socket says 172.21.15.78:33248) 2024-09-11T00:20:12.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.682+0000 7fd35b7fe640 1 -- 172.21.15.78:0/250988617 learned_addr learned my addr 172.21.15.78:0/250988617 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:12.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.683+0000 7fd353fff640 1 --2- 172.21.15.78:0/250988617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd35c1076c0 0x7fd35c1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:12.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.683+0000 7fd35affd640 1 --2- 172.21.15.78:0/250988617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd35c101cb0 0x7fd35c197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:12.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.683+0000 7fd35b7fe640 1 -- 172.21.15.78:0/250988617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd35c101cb0 msgr2=0x7fd35c197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:12.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.683+0000 7fd35b7fe640 1 --2- 172.21.15.78:0/250988617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd35c101cb0 0x7fd35c197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.683+0000 7fd35b7fe640 1 -- 172.21.15.78:0/250988617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd35c1076c0 msgr2=0x7fd35c1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:12.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.683+0000 7fd35b7fe640 1 --2- 172.21.15.78:0/250988617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd35c1076c0 0x7fd35c1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.683+0000 7fd35b7fe640 1 -- 172.21.15.78:0/250988617 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd35c1a7690 con 0x7fd35c108040 2024-09-11T00:20:12.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.683+0000 7fd35b7fe640 1 --2- 172.21.15.78:0/250988617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd35c108040 0x7fd35c198900 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd35400cad0 tx=0x7fd35400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:12.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.683+0000 7fd358ff9640 1 -- 172.21.15.78:0/250988617 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35400ae20 con 0x7fd35c108040 2024-09-11T00:20:12.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.683+0000 7fd36171d640 1 -- 172.21.15.78:0/250988617 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd35c1a7980 con 0x7fd35c108040 2024-09-11T00:20:12.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.683+0000 7fd358ff9640 1 -- 172.21.15.78:0/250988617 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd354005020 con 0x7fd35c108040 2024-09-11T00:20:12.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.683+0000 7fd358ff9640 1 -- 172.21.15.78:0/250988617 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35400f6b0 con 0x7fd35c108040 2024-09-11T00:20:12.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.683+0000 7fd36171d640 1 -- 172.21.15.78:0/250988617 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd35c1a7e70 con 0x7fd35c108040 2024-09-11T00:20:12.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.685+0000 7fd363af2740 1 Processor -- start 2024-09-11T00:20:12.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.686+0000 7fd358ff9640 1 -- 172.21.15.78:0/250988617 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fd354004a40 con 0x7fd35c108040 2024-09-11T00:20:12.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.686+0000 7fd363af2740 1 -- start start 2024-09-11T00:20:12.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.686+0000 7fd363af2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a18e54b480 0x55a18e54b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:12.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.686+0000 7fd363af2740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a18e54bda0 0x55a18e5577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:12.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.686+0000 7fd363af2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e557d30 0x55a18e55a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:12.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.686+0000 7fd363af2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a18e4c1e50 con 0x55a18e557d30 2024-09-11T00:20:12.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.686+0000 7fd363af2740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a18e4b1280 con 0x55a18e54bda0 2024-09-11T00:20:12.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.686+0000 7fd363af2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a18e4b5090 con 0x55a18e54b480 2024-09-11T00:20:12.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.686+0000 7fd353fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e557d30 0x55a18e55a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:12.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.686+0000 7fd353fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e557d30 0x55a18e55a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33260/0 (socket says 172.21.15.78:33260) 2024-09-11T00:20:12.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.686+0000 7fd353fff640 1 -- 172.21.15.78:0/1966564253 learned_addr learned my addr 172.21.15.78:0/1966564253 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:12.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.686+0000 7fd35affd640 1 --2- 172.21.15.78:0/1966564253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a18e54bda0 0x55a18e5577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:12.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.686+0000 7fd353fff640 1 --2- 172.21.15.78:0/1966564253 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a18e54b480 0x55a18e54b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:12.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.687+0000 7fd358ff9640 1 --2- 172.21.15.78:0/250988617 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd3480b5450 0x7fd3480b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:12.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.687+0000 7fd353fff640 1 -- 172.21.15.78:0/1966564253 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a18e54b480 msgr2=0x55a18e54b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:12.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.687+0000 7fd353fff640 1 --2- 172.21.15.78:0/1966564253 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a18e54b480 0x55a18e54b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.687+0000 7fd353fff640 1 -- 172.21.15.78:0/1966564253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a18e54bda0 msgr2=0x55a18e5577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:12.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.687+0000 7fd353fff640 1 --2- 172.21.15.78:0/1966564253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a18e54bda0 0x55a18e5577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.687+0000 7fd353fff640 1 -- 172.21.15.78:0/1966564253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a18e20f650 con 0x55a18e557d30 2024-09-11T00:20:12.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.687+0000 7fd35b7fe640 1 --2- 172.21.15.78:0/250988617 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd3480b5450 0x7fd3480b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:12.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.687+0000 7fd353fff640 1 --2- 172.21.15.78:0/1966564253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e557d30 0x55a18e55a120 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fd3440149c0 tx=0x7fd34400c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b414c982b144652 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:12.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.687+0000 7fd358ff9640 1 -- 172.21.15.78:0/250988617 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fd3540e60b0 con 0x7fd35c108040 2024-09-11T00:20:12.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.687+0000 7fd3517fa640 1 -- 172.21.15.78:0/1966564253 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3440142d0 con 0x55a18e557d30 2024-09-11T00:20:12.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.687+0000 7fd3517fa640 1 -- 172.21.15.78:0/1966564253 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd34400fc10 con 0x55a18e557d30 2024-09-11T00:20:12.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.687+0000 7fd3517fa640 1 -- 172.21.15.78:0/1966564253 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd344012a90 con 0x55a18e557d30 2024-09-11T00:20:12.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.688+0000 7fd363af2740 1 -- 172.21.15.78:0/1966564253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e557d30 msgr2=0x55a18e55a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:12.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.688+0000 7fd363af2740 1 --2- 172.21.15.78:0/1966564253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e557d30 0x55a18e55a120 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fd3440149c0 tx=0x7fd34400c4d0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.688+0000 7fd35b7fe640 1 --2- 172.21.15.78:0/250988617 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd3480b5450 0x7fd3480b7910 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd3540ac250 tx=0x7fd354078730 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:12.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.688+0000 7fd363af2740 1 -- 172.21.15.78:0/1966564253 shutdown_connections 2024-09-11T00:20:12.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.688+0000 7fd363af2740 1 --2- 172.21.15.78:0/1966564253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e557d30 0x55a18e55a120 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.688+0000 7fd363af2740 1 --2- 172.21.15.78:0/1966564253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a18e54bda0 0x55a18e5577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.688+0000 7fd363af2740 1 --2- 172.21.15.78:0/1966564253 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a18e54b480 0x55a18e54b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.688+0000 7fd363af2740 1 -- 172.21.15.78:0/1966564253 >> 172.21.15.78:0/1966564253 conn(0x55a18e5492b0 msgr2=0x55a18e54a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:12.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.688+0000 7fd363af2740 1 -- 172.21.15.78:0/1966564253 shutdown_connections 2024-09-11T00:20:12.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.688+0000 7fd363af2740 1 -- 172.21.15.78:0/1966564253 wait complete. 2024-09-11T00:20:12.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.688+0000 7fd363af2740 1 -- start start 2024-09-11T00:20:12.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.689+0000 7fd363af2740 1 Processor -- start 2024-09-11T00:20:12.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.689+0000 7fd363af2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a18e54b480 0x55a18e5576a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.689+0000 7fd363af2740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a18e54bda0 0x55a18e554af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.689+0000 7fd363af2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e557d30 0x55a18e555170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.689+0000 7fd363af2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a18e312700 con 0x55a18e557d30 2024-09-11T00:20:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.689+0000 7fd363af2740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a18e44c110 con 0x55a18e54bda0 2024-09-11T00:20:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.689+0000 7fd363af2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a18e55a9b0 con 0x55a18e54b480 2024-09-11T00:20:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.689+0000 7fd363af2740 10 client.0 _ll_register_callbacks cb 0x55a18e465990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:20:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.689+0000 7fd353fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e557d30 0x55a18e555170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.689+0000 7fd353fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e557d30 0x55a18e555170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33266/0 (socket says 172.21.15.78:33266) 2024-09-11T00:20:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.689+0000 7fd353fff640 1 -- 172.21.15.78:0/1061048476 learned_addr learned my addr 172.21.15.78:0/1061048476 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.689+0000 7fd35affd640 1 --2- 172.21.15.78:0/1061048476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a18e54bda0 0x55a18e554af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.689+0000 7fd353fff640 1 --2- 172.21.15.78:0/1061048476 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a18e54b480 0x55a18e5576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:12.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.689+0000 7fd353fff640 1 -- 172.21.15.78:0/1061048476 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a18e54b480 msgr2=0x55a18e5576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:12.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.689+0000 7fd353fff640 1 --2- 172.21.15.78:0/1061048476 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a18e54b480 0x55a18e5576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.689+0000 7fd353fff640 1 -- 172.21.15.78:0/1061048476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a18e54bda0 msgr2=0x55a18e554af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:12.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.689+0000 7fd353fff640 1 --2- 172.21.15.78:0/1061048476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a18e54bda0 0x55a18e554af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.689+0000 7fd353fff640 1 -- 172.21.15.78:0/1061048476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a18e479c40 con 0x55a18e557d30 2024-09-11T00:20:12.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.689+0000 7fd353fff640 1 --2- 172.21.15.78:0/1061048476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e557d30 0x55a18e555170 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd3440124e0 tx=0x7fd344012670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991e06ef203cf856 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:12.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.689+0000 7fd3427fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:20:12.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.690+0000 7fd3427fc640 1 -- 172.21.15.78:0/1061048476 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3440140d0 con 0x55a18e557d30 2024-09-11T00:20:12.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.690+0000 7fd3427fc640 1 -- 172.21.15.78:0/1061048476 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fd344014270 con 0x55a18e557d30 2024-09-11T00:20:12.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.690+0000 7fd363af2740 1 -- 172.21.15.78:0/1061048476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd34400fc10 con 0x55a18e557d30 2024-09-11T00:20:12.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.690+0000 7fd3427fc640 1 -- 172.21.15.78:0/1061048476 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd344032050 con 0x55a18e557d30 2024-09-11T00:20:12.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.690+0000 7fd363af2740 10 client.15816 fetch_fsmap learned FSMap version 20 2024-09-11T00:20:12.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.690+0000 7fd363af2740 1 -- 172.21.15.78:0/1061048476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a18e566390 con 0x55a18e557d30 2024-09-11T00:20:12.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.690+0000 7fd3427fc640 1 -- 172.21.15.78:0/1061048476 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd34400fc10 con 0x55a18e557d30 2024-09-11T00:20:12.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.690+0000 7fd3427fc640 1 -- 172.21.15.78:0/1061048476 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd344012a10 con 0x55a18e557d30 2024-09-11T00:20:12.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.690+0000 7fd363af2740 10 client.15816 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:20:12.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.690+0000 7fd363af2740 10 client.15816 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:20:12.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.690+0000 7fd363af2740 20 client.15816 populate_metadata read hostname 'smithi078' 2024-09-11T00:20:12.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.690+0000 7fd363af2740 1 --2- 172.21.15.78:0/1061048476 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a18e5676e0 0x55a18e569ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:12.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.690+0000 7fd363af2740 4 client.15816 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:20:12.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.690+0000 7fd363af2740 1 -- 172.21.15.78:0/1061048476 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a18e4c3da0 con 0x55a18e5676e0 2024-09-11T00:20:12.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.691+0000 7fd35affd640 1 --2- 172.21.15.78:0/1061048476 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a18e5676e0 0x55a18e569ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:12.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.691+0000 7fd35affd640 1 --2- 172.21.15.78:0/1061048476 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a18e5676e0 0x55a18e569ad0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64c4e29e60e20b47 server_cookie=6f535753d3c8f4b8 in_seq=0 out_seq=0 2024-09-11T00:20:12.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.691+0000 7fd3427fc640 10 client.15816 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:12.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.692+0000 7fd3427fc640 1 -- 172.21.15.78:0/1061048476 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a18e4c3da0 con 0x55a18e5676e0 2024-09-11T00:20:12.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.692+0000 7fd3427fc640 10 client.15816 handle_command_reply: tid=0 2024-09-11T00:20:12.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.692+0000 7fd363af2740 1 client.15816 shutdown 2024-09-11T00:20:12.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.692+0000 7fd363af2740 1 -- 172.21.15.78:0/1061048476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e557d30 msgr2=0x55a18e555170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:12.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.692+0000 7fd363af2740 1 --2- 172.21.15.78:0/1061048476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e557d30 0x55a18e555170 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd3440124e0 tx=0x7fd344012670 comp rx=0 tx=0).stop 2024-09-11T00:20:12.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.692+0000 7fd363af2740 1 -- 172.21.15.78:0/1061048476 shutdown_connections 2024-09-11T00:20:12.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.692+0000 7fd363af2740 1 --2- 172.21.15.78:0/1061048476 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a18e5676e0 0x55a18e569ad0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.692+0000 7fd363af2740 1 --2- 172.21.15.78:0/1061048476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e557d30 0x55a18e555170 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.692+0000 7fd3427fc640 0 client.15816 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:12.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.692+0000 7fd363af2740 1 --2- 172.21.15.78:0/1061048476 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a18e54bda0 0x55a18e554af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.692+0000 7fd363af2740 1 --2- 172.21.15.78:0/1061048476 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a18e54b480 0x55a18e5576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.692+0000 7fd363af2740 1 -- 172.21.15.78:0/1061048476 >> 172.21.15.78:0/1061048476 conn(0x55a18e5492b0 msgr2=0x55a18e54ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:12.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.692+0000 7fd363af2740 1 -- 172.21.15.78:0/1061048476 shutdown_connections 2024-09-11T00:20:12.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.692+0000 7fd363af2740 1 -- 172.21.15.78:0/1061048476 wait complete. 2024-09-11T00:20:12.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.692+0000 7fd363af2740 20 client.15816 trim_cache size 0 max 16384 2024-09-11T00:20:12.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.709+0000 7fd363af2740 1 Processor -- start 2024-09-11T00:20:12.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.709+0000 7fd363af2740 1 -- start start 2024-09-11T00:20:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.709+0000 7fd363af2740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a18e54b480 0x55a18e54aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.709+0000 7fd363af2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e54bda0 0x55a18e563c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.709+0000 7fd363af2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a18e557d30 0x55a18e559120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.709+0000 7fd363af2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c1ae8f0 con 0x55a18e54bda0 2024-09-11T00:20:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.709+0000 7fd363af2740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c1b1170 con 0x55a18e54b480 2024-09-11T00:20:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.709+0000 7fd363af2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c1aef60 con 0x55a18e557d30 2024-09-11T00:20:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.709+0000 7fd35affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e54bda0 0x55a18e563c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.709+0000 7fd35affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e54bda0 0x55a18e563c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33278/0 (socket says 172.21.15.78:33278) 2024-09-11T00:20:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.709+0000 7fd35affd640 1 -- 172.21.15.78:0/2707698653 learned_addr learned my addr 172.21.15.78:0/2707698653 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.710+0000 7fd35affd640 1 -- 172.21.15.78:0/2707698653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a18e557d30 msgr2=0x55a18e559120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:12.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.710+0000 7fd353fff640 1 --2- 172.21.15.78:0/2707698653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a18e557d30 0x55a18e559120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:12.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.710+0000 7fd35affd640 1 --2- 172.21.15.78:0/2707698653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a18e557d30 0x55a18e559120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.710+0000 7fd35affd640 1 -- 172.21.15.78:0/2707698653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a18e54b480 msgr2=0x55a18e54aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:12.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.710+0000 7fd35affd640 1 --2- 172.21.15.78:0/2707698653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a18e54b480 0x55a18e54aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.710+0000 7fd35affd640 1 -- 172.21.15.78:0/2707698653 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a18e549f90 con 0x55a18e54bda0 2024-09-11T00:20:12.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.710+0000 7fd353fff640 1 --2- 172.21.15.78:0/2707698653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a18e557d30 0x55a18e559120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:12.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.710+0000 7fd35affd640 1 --2- 172.21.15.78:0/2707698653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e54bda0 0x55a18e563c80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009230 tx=0x7fd34c0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a1316a06e3ecb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:12.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.710+0000 7fd350ff9640 1 -- 172.21.15.78:0/2707698653 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34c035040 con 0x55a18e54bda0 2024-09-11T00:20:12.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.710+0000 7fd350ff9640 1 -- 172.21.15.78:0/2707698653 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd34c005040 con 0x55a18e54bda0 2024-09-11T00:20:12.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.710+0000 7fd350ff9640 1 -- 172.21.15.78:0/2707698653 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34c004b00 con 0x55a18e54bda0 2024-09-11T00:20:12.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.711+0000 7fd363af2740 1 -- 172.21.15.78:0/2707698653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e54bda0 msgr2=0x55a18e563c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:12.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.711+0000 7fd363af2740 1 --2- 172.21.15.78:0/2707698653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e54bda0 0x55a18e563c80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009230 tx=0x7fd34c0058d0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.711+0000 7fd363af2740 1 -- 172.21.15.78:0/2707698653 shutdown_connections 2024-09-11T00:20:12.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.711+0000 7fd363af2740 1 --2- 172.21.15.78:0/2707698653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a18e557d30 0x55a18e559120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.711+0000 7fd363af2740 1 --2- 172.21.15.78:0/2707698653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e54bda0 0x55a18e563c80 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.711+0000 7fd363af2740 1 --2- 172.21.15.78:0/2707698653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a18e54b480 0x55a18e54aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.711+0000 7fd363af2740 1 -- 172.21.15.78:0/2707698653 >> 172.21.15.78:0/2707698653 conn(0x55a18e5492b0 msgr2=0x55a18e54a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:12.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.711+0000 7fd363af2740 1 -- 172.21.15.78:0/2707698653 shutdown_connections 2024-09-11T00:20:12.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.711+0000 7fd363af2740 1 -- 172.21.15.78:0/2707698653 wait complete. 2024-09-11T00:20:12.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.711+0000 7fd363af2740 1 -- start start 2024-09-11T00:20:12.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.711+0000 7fd363af2740 1 Processor -- start 2024-09-11T00:20:12.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.711+0000 7fd363af2740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a18e54b480 0x55a18e56d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:12.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.711+0000 7fd363af2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a18e54bda0 0x55a18e569560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:12.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.711+0000 7fd363af2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e557d30 0x55a18e569aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:12.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.711+0000 7fd363af2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c1af630 con 0x55a18e557d30 2024-09-11T00:20:12.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.711+0000 7fd363af2740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c1b0aa0 con 0x55a18e54b480 2024-09-11T00:20:12.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.711+0000 7fd363af2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c1afd00 con 0x55a18e54bda0 2024-09-11T00:20:12.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.711+0000 7fd363af2740 10 client.0 _ll_register_callbacks cb 0x7fd34c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:20:12.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.712+0000 7fd353fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e557d30 0x55a18e569aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:12.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.712+0000 7fd353fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e557d30 0x55a18e569aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33282/0 (socket says 172.21.15.78:33282) 2024-09-11T00:20:12.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.712+0000 7fd353fff640 1 -- 172.21.15.78:0/3330895857 learned_addr learned my addr 172.21.15.78:0/3330895857 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:12.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.712+0000 7fd35affd640 1 --2- 172.21.15.78:0/3330895857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a18e54bda0 0x55a18e569560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:12.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.712+0000 7fd353fff640 1 --2- 172.21.15.78:0/3330895857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a18e54b480 0x55a18e56d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:12.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.712+0000 7fd353fff640 1 -- 172.21.15.78:0/3330895857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a18e54bda0 msgr2=0x55a18e569560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:12.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.712+0000 7fd353fff640 1 --2- 172.21.15.78:0/3330895857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a18e54bda0 0x55a18e569560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.712+0000 7fd353fff640 1 -- 172.21.15.78:0/3330895857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a18e54b480 msgr2=0x55a18e56d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:12.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.712+0000 7fd353fff640 1 --2- 172.21.15.78:0/3330895857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a18e54b480 0x55a18e56d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.712+0000 7fd353fff640 1 -- 172.21.15.78:0/3330895857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a18e56a0e0 con 0x55a18e557d30 2024-09-11T00:20:12.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.712+0000 7fd353fff640 1 --2- 172.21.15.78:0/3330895857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e557d30 0x55a18e569aa0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd344005f50 tx=0x7fd344016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0992075a7e2e8ec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:12.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.712+0000 7fd3427fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:20:12.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.712+0000 7fd3427fc640 1 -- 172.21.15.78:0/3330895857 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd344003710 con 0x55a18e557d30 2024-09-11T00:20:12.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.712+0000 7fd3427fc640 1 -- 172.21.15.78:0/3330895857 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fd34400cc80 con 0x55a18e557d30 2024-09-11T00:20:12.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.712+0000 7fd363af2740 1 -- 172.21.15.78:0/3330895857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd34c005040 con 0x55a18e557d30 2024-09-11T00:20:12.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.712+0000 7fd3427fc640 1 -- 172.21.15.78:0/3330895857 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd34400ce80 con 0x55a18e557d30 2024-09-11T00:20:12.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.712+0000 7fd363af2740 10 client.15822 fetch_fsmap learned FSMap version 20 2024-09-11T00:20:12.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.712+0000 7fd363af2740 1 -- 172.21.15.78:0/3330895857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a18e5d5030 con 0x55a18e557d30 2024-09-11T00:20:12.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.713+0000 7fd3427fc640 1 -- 172.21.15.78:0/3330895857 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd34c005040 con 0x55a18e557d30 2024-09-11T00:20:12.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.713+0000 7fd3427fc640 1 -- 172.21.15.78:0/3330895857 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd344041020 con 0x55a18e557d30 2024-09-11T00:20:12.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.713+0000 7fd363af2740 10 client.15822 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:20:12.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.713+0000 7fd363af2740 10 client.15822 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:20:12.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.713+0000 7fd363af2740 20 client.15822 populate_metadata read hostname 'smithi078' 2024-09-11T00:20:12.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.713+0000 7fd363af2740 1 --2- 172.21.15.78:0/3330895857 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a18e5d5760 0x55a18e5d7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:12.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.713+0000 7fd363af2740 4 client.15822 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:20:12.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.713+0000 7fd363af2740 1 -- 172.21.15.78:0/3330895857 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a18e4bf850 con 0x55a18e5d5760 2024-09-11T00:20:12.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.713+0000 7fd35affd640 1 --2- 172.21.15.78:0/3330895857 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a18e5d5760 0x55a18e5d7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:12.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.714+0000 7fd3427fc640 10 client.15822 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:12.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.714+0000 7fd35affd640 1 --2- 172.21.15.78:0/3330895857 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a18e5d5760 0x55a18e5d7b80 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7592305ccb0352ba server_cookie=cf46e74932dc9b34 in_seq=0 out_seq=0 2024-09-11T00:20:12.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.714+0000 7fd3427fc640 1 -- 172.21.15.78:0/3330895857 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x55a18e4bf850 con 0x55a18e5d5760 2024-09-11T00:20:12.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.714+0000 7fd3427fc640 10 client.15822 handle_command_reply: tid=0 2024-09-11T00:20:12.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.714+0000 7fd363af2740 1 client.15822 shutdown 2024-09-11T00:20:12.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.714+0000 7fd363af2740 1 -- 172.21.15.78:0/3330895857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e557d30 msgr2=0x55a18e569aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:12.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.714+0000 7fd363af2740 1 --2- 172.21.15.78:0/3330895857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e557d30 0x55a18e569aa0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd344005f50 tx=0x7fd344016040 comp rx=0 tx=0).stop 2024-09-11T00:20:12.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.714+0000 7fd363af2740 1 -- 172.21.15.78:0/3330895857 shutdown_connections 2024-09-11T00:20:12.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.714+0000 7fd363af2740 1 --2- 172.21.15.78:0/3330895857 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a18e5d5760 0x55a18e5d7b80 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.714+0000 7fd363af2740 1 --2- 172.21.15.78:0/3330895857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a18e557d30 0x55a18e569aa0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.714+0000 7fd363af2740 1 --2- 172.21.15.78:0/3330895857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a18e54bda0 0x55a18e569560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.714+0000 7fd363af2740 1 --2- 172.21.15.78:0/3330895857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a18e54b480 0x55a18e56d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.714+0000 7fd363af2740 1 -- 172.21.15.78:0/3330895857 >> 172.21.15.78:0/3330895857 conn(0x55a18e5492b0 msgr2=0x55a18e547bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:12.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.714+0000 7fd3427fc640 0 client.15822 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:12.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.714+0000 7fd363af2740 1 -- 172.21.15.78:0/3330895857 shutdown_connections 2024-09-11T00:20:12.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.714+0000 7fd363af2740 1 -- 172.21.15.78:0/3330895857 wait complete. 2024-09-11T00:20:12.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.714+0000 7fd363af2740 20 client.15822 trim_cache size 0 max 16384 2024-09-11T00:20:12.722 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:20:12.722 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-11T00:20:12.722 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {}, 2024-09-11T00:20:12.722 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:20:12.722 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:20:12.722 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:20:12.722 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:12.722 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:12.722 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:12.722 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:12.722 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:12.722 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:12.722 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:20:12.723 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:20:12.723 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:12.723 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:12.723 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:12.723 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:12.723 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:12.723 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:12.723 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:20:12.723 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:20:12.723 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:12.723 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:12.723 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:12.723 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:12.723 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:12.724 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:12.724 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:20:12.724 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:20:12.724 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:12.724 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:12.724 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:12.724 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:12.724 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:12.724 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:12.724 INFO:teuthology.orchestra.run.smithi078.stdout: "b854cbd3-8ca7-4277-a205-8887d2ff5567": { 2024-09-11T00:20:12.724 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:11.182949+0000", 2024-09-11T00:20:12.724 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:12.724 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:12.724 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:12.725 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:12.725 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:12.725 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:12.725 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:20:12.725 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:20:12.725 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:12.725 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:12.725 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:12.725 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:12.725 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:12.725 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:12.725 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:20:12.725 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:20:12.725 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:12.725 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:12.726 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:12.726 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:12.726 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:12.726 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:20:12.726 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:20:12.726 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:20:12.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.715+0000 7fd36171d640 1 -- 172.21.15.78:0/250988617 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd3480b5450 msgr2=0x7fd3480b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:12.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.715+0000 7fd36171d640 1 --2- 172.21.15.78:0/250988617 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd3480b5450 0x7fd3480b7910 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd3540ac250 tx=0x7fd354078730 comp rx=0 tx=0).stop 2024-09-11T00:20:12.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.715+0000 7fd36171d640 1 -- 172.21.15.78:0/250988617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd35c108040 msgr2=0x7fd35c198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:12.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.715+0000 7fd36171d640 1 --2- 172.21.15.78:0/250988617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd35c108040 0x7fd35c198900 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd35400cad0 tx=0x7fd35400cf90 comp rx=0 tx=0).stop 2024-09-11T00:20:12.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.715+0000 7fd36171d640 1 -- 172.21.15.78:0/250988617 shutdown_connections 2024-09-11T00:20:12.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.715+0000 7fd36171d640 1 --2- 172.21.15.78:0/250988617 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd3480b5450 0x7fd3480b7910 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.715+0000 7fd36171d640 1 --2- 172.21.15.78:0/250988617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd35c108040 0x7fd35c198900 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.715+0000 7fd36171d640 1 --2- 172.21.15.78:0/250988617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd35c1076c0 0x7fd35c1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.715+0000 7fd36171d640 1 --2- 172.21.15.78:0/250988617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd35c101cb0 0x7fd35c197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:12.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.715+0000 7fd36171d640 1 -- 172.21.15.78:0/250988617 >> 172.21.15.78:0/250988617 conn(0x7fd35c0fd700 msgr2=0x7fd35c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:12.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.715+0000 7fd36171d640 1 -- 172.21.15.78:0/250988617 shutdown_connections 2024-09-11T00:20:12.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:12.715+0000 7fd36171d640 1 -- 172.21.15.78:0/250988617 wait complete. 2024-09-11T00:20:13.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:12 smithi078 ceph-mon[30865]: pgmap v435: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T00:20:13.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:12 smithi112 ceph-mon[35627]: pgmap v435: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T00:20:13.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:12 smithi138 ceph-mon[35019]: pgmap v435: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T00:20:13.644 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:20:13.644 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:20:13.888 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:20:14.008 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:13 smithi078 ceph-mon[30865]: pgmap v436: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 12 KiB/s wr, 3 op/s 2024-09-11T00:20:14.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:13 smithi112 ceph-mon[35627]: pgmap v436: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 12 KiB/s wr, 3 op/s 2024-09-11T00:20:14.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:13 smithi138 ceph-mon[35019]: pgmap v436: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 12 KiB/s wr, 3 op/s 2024-09-11T00:20:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.383+0000 7f325be6e640 1 -- 172.21.15.78:0/3307944961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3254101cd0 msgr2=0x7f32541020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.383+0000 7f325be6e640 1 --2- 172.21.15.78:0/3307944961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3254101cd0 0x7f32541020b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3250009900 tx=0x7f325002a410 comp rx=0 tx=0).stop 2024-09-11T00:20:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.383+0000 7f325be6e640 1 -- 172.21.15.78:0/3307944961 shutdown_connections 2024-09-11T00:20:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.383+0000 7f325be6e640 1 --2- 172.21.15.78:0/3307944961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3254108060 0x7f325410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.383+0000 7f325be6e640 1 --2- 172.21.15.78:0/3307944961 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32541076e0 0x7f3254107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.383+0000 7f325be6e640 1 --2- 172.21.15.78:0/3307944961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3254101cd0 0x7f32541020b0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.383+0000 7f325be6e640 1 -- 172.21.15.78:0/3307944961 >> 172.21.15.78:0/3307944961 conn(0x7f32540fd700 msgr2=0x7f32540ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.383+0000 7f325be6e640 1 -- 172.21.15.78:0/3307944961 shutdown_connections 2024-09-11T00:20:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.383+0000 7f325be6e640 1 -- 172.21.15.78:0/3307944961 wait complete. 2024-09-11T00:20:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.384+0000 7f325be6e640 1 Processor -- start 2024-09-11T00:20:14.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.384+0000 7f325be6e640 1 -- start start 2024-09-11T00:20:14.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.384+0000 7f325be6e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3254101cd0 0x7f32540fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:14.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.384+0000 7f325be6e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32541076e0 0x7f32540fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:14.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.384+0000 7f325be6e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3254108060 0x7f32540fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:14.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.384+0000 7f325be6e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3254111d60 con 0x7f32541076e0 2024-09-11T00:20:14.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.384+0000 7f325be6e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3254111be0 con 0x7f3254108060 2024-09-11T00:20:14.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.384+0000 7f325be6e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3254111ee0 con 0x7f3254101cd0 2024-09-11T00:20:14.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.384+0000 7f3259409640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32541076e0 0x7f32540fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:14.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.384+0000 7f3259409640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32541076e0 0x7f32540fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33296/0 (socket says 172.21.15.78:33296) 2024-09-11T00:20:14.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.384+0000 7f3259409640 1 -- 172.21.15.78:0/542039712 learned_addr learned my addr 172.21.15.78:0/542039712 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:14.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.384+0000 7f3259c0a640 1 --2- 172.21.15.78:0/542039712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3254101cd0 0x7f32540fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.384+0000 7f3259409640 1 -- 172.21.15.78:0/542039712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3254101cd0 msgr2=0x7f32540fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.384+0000 7f3259409640 1 --2- 172.21.15.78:0/542039712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3254101cd0 0x7f32540fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.384+0000 7f3259409640 1 -- 172.21.15.78:0/542039712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3254108060 msgr2=0x7f32540fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.384+0000 7f3259409640 1 --2- 172.21.15.78:0/542039712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3254108060 0x7f32540fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.384+0000 7f3259409640 1 -- 172.21.15.78:0/542039712 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32541a77f0 con 0x7f32541076e0 2024-09-11T00:20:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.385+0000 7f3259409640 1 --2- 172.21.15.78:0/542039712 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32541076e0 0x7f32540fe140 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f324400b4a0 tx=0x7f324400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.385+0000 7f324affd640 1 -- 172.21.15.78:0/542039712 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3244014070 con 0x7f32541076e0 2024-09-11T00:20:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.385+0000 7f324affd640 1 -- 172.21.15.78:0/542039712 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3244010ac0 con 0x7f32541076e0 2024-09-11T00:20:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.385+0000 7f325be6e640 1 -- 172.21.15.78:0/542039712 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32541a7ae0 con 0x7f32541076e0 2024-09-11T00:20:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.385+0000 7f324affd640 1 -- 172.21.15.78:0/542039712 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3244017c30 con 0x7f32541076e0 2024-09-11T00:20:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.385+0000 7f325be6e640 1 -- 172.21.15.78:0/542039712 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32541a8050 con 0x7f32541076e0 2024-09-11T00:20:14.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.386+0000 7f325be6e640 1 -- 172.21.15.78:0/542039712 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3254102130 con 0x7f32541076e0 2024-09-11T00:20:14.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.387+0000 7f324affd640 1 -- 172.21.15.78:0/542039712 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f3244010610 con 0x7f32541076e0 2024-09-11T00:20:14.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.388+0000 7f324affd640 1 --2- 172.21.15.78:0/542039712 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f32400b5450 0x7f32400b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:14.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.388+0000 7f3259c0a640 1 --2- 172.21.15.78:0/542039712 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f32400b5450 0x7f32400b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:14.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.388+0000 7f324affd640 1 -- 172.21.15.78:0/542039712 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f32440e5680 con 0x7f32541076e0 2024-09-11T00:20:14.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.389+0000 7f3259c0a640 1 --2- 172.21.15.78:0/542039712 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f32400b5450 0x7f32400b7910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3250031440 tx=0x7f32500095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:14.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.392+0000 7f324affd640 1 -- 172.21.15.78:0/542039712 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f32440ac1c0 con 0x7f32541076e0 2024-09-11T00:20:14.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.603+0000 7f325be6e640 1 -- 172.21.15.78:0/542039712 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f325402e5c0 con 0x7f32541076e0 2024-09-11T00:20:14.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.604+0000 7f324affd640 1 -- 172.21.15.78:0/542039712 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f32440abac0 con 0x7f32541076e0 2024-09-11T00:20:14.606 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:20:14.606 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:20:14.606 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:20:14.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.606+0000 7f325be6e640 1 -- 172.21.15.78:0/542039712 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f32400b5450 msgr2=0x7f32400b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:14.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.606+0000 7f325be6e640 1 --2- 172.21.15.78:0/542039712 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f32400b5450 0x7f32400b7910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3250031440 tx=0x7f32500095f0 comp rx=0 tx=0).stop 2024-09-11T00:20:14.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.606+0000 7f325be6e640 1 -- 172.21.15.78:0/542039712 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32541076e0 msgr2=0x7f32540fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:14.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.606+0000 7f325be6e640 1 --2- 172.21.15.78:0/542039712 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32541076e0 0x7f32540fe140 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f324400b4a0 tx=0x7f324400b960 comp rx=0 tx=0).stop 2024-09-11T00:20:14.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.606+0000 7f325be6e640 1 -- 172.21.15.78:0/542039712 shutdown_connections 2024-09-11T00:20:14.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.606+0000 7f325be6e640 1 --2- 172.21.15.78:0/542039712 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f32400b5450 0x7f32400b7910 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:14.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.606+0000 7f325be6e640 1 --2- 172.21.15.78:0/542039712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3254108060 0x7f32540fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:14.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.606+0000 7f325be6e640 1 --2- 172.21.15.78:0/542039712 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32541076e0 0x7f32540fe140 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:14.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.606+0000 7f325be6e640 1 --2- 172.21.15.78:0/542039712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3254101cd0 0x7f32540fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:14.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.606+0000 7f325be6e640 1 -- 172.21.15.78:0/542039712 >> 172.21.15.78:0/542039712 conn(0x7f32540fd700 msgr2=0x7f325406b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:14.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.606+0000 7f325be6e640 1 -- 172.21.15.78:0/542039712 shutdown_connections 2024-09-11T00:20:14.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:14.606+0000 7f325be6e640 1 -- 172.21.15.78:0/542039712 wait complete. 2024-09-11T00:20:14.876 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:14 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/542039712' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:20:15.133 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:14 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/542039712' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:20:15.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:14 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/542039712' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:20:15.405 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:20:15.650 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:20:16.073 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:15 smithi078 ceph-mon[30865]: pgmap v437: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-11T00:20:16.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:15 smithi112 ceph-mon[35627]: pgmap v437: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-11T00:20:16.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:15 smithi138 ceph-mon[35019]: pgmap v437: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-11T00:20:16.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.153+0000 7fdbdbe96640 1 -- 172.21.15.78:0/3236757655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbd4101cd0 msgr2=0x7fdbd41020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.153+0000 7fdbdbe96640 1 --2- 172.21.15.78:0/3236757655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbd4101cd0 0x7fdbd41020b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0009900 tx=0x7fdbd002a410 comp rx=0 tx=0).stop 2024-09-11T00:20:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.153+0000 7fdbdbe96640 1 -- 172.21.15.78:0/3236757655 shutdown_connections 2024-09-11T00:20:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.153+0000 7fdbdbe96640 1 --2- 172.21.15.78:0/3236757655 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdbd4108060 0x7fdbd410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.153+0000 7fdbdbe96640 1 --2- 172.21.15.78:0/3236757655 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbd41076e0 0x7fdbd4107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.153+0000 7fdbdbe96640 1 --2- 172.21.15.78:0/3236757655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbd4101cd0 0x7fdbd41020b0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.153+0000 7fdbdbe96640 1 -- 172.21.15.78:0/3236757655 >> 172.21.15.78:0/3236757655 conn(0x7fdbd40fd700 msgr2=0x7fdbd40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.153+0000 7fdbdbe96640 1 -- 172.21.15.78:0/3236757655 shutdown_connections 2024-09-11T00:20:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.153+0000 7fdbdbe96640 1 -- 172.21.15.78:0/3236757655 wait complete. 2024-09-11T00:20:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.154+0000 7fdbdbe96640 1 Processor -- start 2024-09-11T00:20:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.154+0000 7fdbdbe96640 1 -- start start 2024-09-11T00:20:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.154+0000 7fdbdbe96640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdbd4101cd0 0x7fdbd41992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.154+0000 7fdbdbe96640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbd41076e0 0x7fdbd4199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:16.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.154+0000 7fdbdbe96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbd4108060 0x7fdbd419ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:16.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.154+0000 7fdbdbe96640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd4111d20 con 0x7fdbd4108060 2024-09-11T00:20:16.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.154+0000 7fdbdbe96640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd4111ba0 con 0x7fdbd41076e0 2024-09-11T00:20:16.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.154+0000 7fdbdbe96640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd4111ea0 con 0x7fdbd4101cd0 2024-09-11T00:20:16.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.154+0000 7fdbda433640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbd4108060 0x7fdbd419ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:16.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.154+0000 7fdbda433640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbd4108060 0x7fdbd419ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51972/0 (socket says 172.21.15.78:51972) 2024-09-11T00:20:16.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.154+0000 7fdbda433640 1 -- 172.21.15.78:0/3235611982 learned_addr learned my addr 172.21.15.78:0/3235611982 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:16.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.154+0000 7fdbd9c32640 1 --2- 172.21.15.78:0/3235611982 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdbd4101cd0 0x7fdbd41992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:16.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.154+0000 7fdbda433640 1 -- 172.21.15.78:0/3235611982 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdbd4101cd0 msgr2=0x7fdbd41992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:16.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.154+0000 7fdbd9431640 1 --2- 172.21.15.78:0/3235611982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbd41076e0 0x7fdbd4199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:16.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.155+0000 7fdbda433640 1 --2- 172.21.15.78:0/3235611982 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdbd4101cd0 0x7fdbd41992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.155+0000 7fdbda433640 1 -- 172.21.15.78:0/3235611982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbd41076e0 msgr2=0x7fdbd4199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:16.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.155+0000 7fdbda433640 1 --2- 172.21.15.78:0/3235611982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbd41076e0 0x7fdbd4199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.155+0000 7fdbda433640 1 -- 172.21.15.78:0/3235611982 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd419f3a0 con 0x7fdbd4108060 2024-09-11T00:20:16.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.155+0000 7fdbd9c32640 1 --2- 172.21.15.78:0/3235611982 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdbd4101cd0 0x7fdbd41992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:16.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.155+0000 7fdbd9431640 1 --2- 172.21.15.78:0/3235611982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbd41076e0 0x7fdbd4199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:16.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.155+0000 7fdbda433640 1 --2- 172.21.15.78:0/3235611982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbd4108060 0x7fdbd419ebd0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00eaa0 tx=0x7fdbcc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:16.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.155+0000 7fdbcaffd640 1 -- 172.21.15.78:0/3235611982 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc00cdb0 con 0x7fdbd4108060 2024-09-11T00:20:16.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.155+0000 7fdbcaffd640 1 -- 172.21.15.78:0/3235611982 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbcc005020 con 0x7fdbd4108060 2024-09-11T00:20:16.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.155+0000 7fdbcaffd640 1 -- 172.21.15.78:0/3235611982 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc0116d0 con 0x7fdbd4108060 2024-09-11T00:20:16.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.155+0000 7fdbdbe96640 1 -- 172.21.15.78:0/3235611982 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbd419f690 con 0x7fdbd4108060 2024-09-11T00:20:16.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.155+0000 7fdbdbe96640 1 -- 172.21.15.78:0/3235611982 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbd41a5dd0 con 0x7fdbd4108060 2024-09-11T00:20:16.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.157+0000 7fdbde26b740 1 Processor -- start 2024-09-11T00:20:16.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.158+0000 7fdbcaffd640 1 -- 172.21.15.78:0/3235611982 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fdbcc00f040 con 0x7fdbd4108060 2024-09-11T00:20:16.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.158+0000 7fdbde26b740 1 -- start start 2024-09-11T00:20:16.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.158+0000 7fdbde26b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55aa63fb64d0 0x55aa63fb68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:16.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.158+0000 7fdbde26b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fb6df0 0x55aa63fc2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:16.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.158+0000 7fdbde26b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa63fc2d80 0x55aa63fc5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:16.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.158+0000 7fdbde26b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55aa63f2cea0 con 0x55aa63fb6df0 2024-09-11T00:20:16.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.158+0000 7fdbde26b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55aa63f1c2d0 con 0x55aa63fc2d80 2024-09-11T00:20:16.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.158+0000 7fdbde26b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55aa63f200e0 con 0x55aa63fb64d0 2024-09-11T00:20:16.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.158+0000 7fdbd9c32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fb6df0 0x55aa63fc2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:16.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.158+0000 7fdbd9c32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fb6df0 0x55aa63fc2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51976/0 (socket says 172.21.15.78:51976) 2024-09-11T00:20:16.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.158+0000 7fdbd9c32640 1 -- 172.21.15.78:0/865067711 learned_addr learned my addr 172.21.15.78:0/865067711 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:16.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.159+0000 7fdbd9431640 1 --2- 172.21.15.78:0/865067711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55aa63fb64d0 0x55aa63fb68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:16.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.159+0000 7fdbd9431640 1 --2- 172.21.15.78:0/865067711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa63fc2d80 0x55aa63fc5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:16.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.159+0000 7fdbcaffd640 1 --2- 172.21.15.78:0/3235611982 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdbc00b54d0 0x7fdbc00b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:16.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.159+0000 7fdbd9c32640 1 -- 172.21.15.78:0/865067711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55aa63fb64d0 msgr2=0x55aa63fb68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:16.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.159+0000 7fdbd9c32640 1 --2- 172.21.15.78:0/865067711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55aa63fb64d0 0x55aa63fb68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.159+0000 7fdbd9c32640 1 -- 172.21.15.78:0/865067711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa63fc2d80 msgr2=0x55aa63fc5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:16.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.159+0000 7fdbd9c32640 1 --2- 172.21.15.78:0/865067711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa63fc2d80 0x55aa63fc5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.159+0000 7fdbd9c32640 1 -- 172.21.15.78:0/865067711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa63c7a650 con 0x55aa63fb6df0 2024-09-11T00:20:16.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.159+0000 7fdbd9431640 1 --2- 172.21.15.78:0/865067711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa63fc2d80 0x55aa63fc5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:20:16.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.159+0000 7fdbda433640 1 --2- 172.21.15.78:0/3235611982 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdbc00b54d0 0x7fdbc00b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:16.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.159+0000 7fdbd9c32640 1 --2- 172.21.15.78:0/865067711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fb6df0 0x55aa63fc2840 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0000c00 tx=0x7fdbd0032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9a1d22ff76bdc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:16.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.159+0000 7fdbcaffd640 1 -- 172.21.15.78:0/3235611982 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fdbcc0e5e90 con 0x7fdbd4108060 2024-09-11T00:20:16.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.159+0000 7fdbbffff640 1 -- 172.21.15.78:0/865067711 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd003f070 con 0x55aa63fb6df0 2024-09-11T00:20:16.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.159+0000 7fdbbffff640 1 -- 172.21.15.78:0/865067711 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbd00316a0 con 0x55aa63fb6df0 2024-09-11T00:20:16.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.159+0000 7fdbbffff640 1 -- 172.21.15.78:0/865067711 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0035070 con 0x55aa63fb6df0 2024-09-11T00:20:16.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.160+0000 7fdbde26b740 1 -- 172.21.15.78:0/865067711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fb6df0 msgr2=0x55aa63fc2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:16.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.160+0000 7fdbda433640 1 --2- 172.21.15.78:0/3235611982 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdbc00b54d0 0x7fdbc00b7990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc0e36b0 tx=0x7fdbcc078510 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:16.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.160+0000 7fdbde26b740 1 --2- 172.21.15.78:0/865067711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fb6df0 0x55aa63fc2840 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0000c00 tx=0x7fdbd0032ce0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.160+0000 7fdbde26b740 1 -- 172.21.15.78:0/865067711 shutdown_connections 2024-09-11T00:20:16.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.160+0000 7fdbde26b740 1 --2- 172.21.15.78:0/865067711 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa63fc2d80 0x55aa63fc5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.160+0000 7fdbde26b740 1 --2- 172.21.15.78:0/865067711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fb6df0 0x55aa63fc2840 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.160+0000 7fdbde26b740 1 --2- 172.21.15.78:0/865067711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55aa63fb64d0 0x55aa63fb68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.160+0000 7fdbde26b740 1 -- 172.21.15.78:0/865067711 >> 172.21.15.78:0/865067711 conn(0x55aa63fb4300 msgr2=0x55aa63fb54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:16.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.160+0000 7fdbde26b740 1 -- 172.21.15.78:0/865067711 shutdown_connections 2024-09-11T00:20:16.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.160+0000 7fdbde26b740 1 -- 172.21.15.78:0/865067711 wait complete. 2024-09-11T00:20:16.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.160+0000 7fdbde26b740 1 -- start start 2024-09-11T00:20:16.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.160+0000 7fdbde26b740 1 Processor -- start 2024-09-11T00:20:16.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.161+0000 7fdbde26b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55aa63fb64d0 0x55aa63fc2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:16.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.161+0000 7fdbde26b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fb6df0 0x55aa63fbf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:16.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.161+0000 7fdbde26b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa63fc2d80 0x55aa63fbff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:16.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.161+0000 7fdbde26b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55aa63d7d700 con 0x55aa63fb6df0 2024-09-11T00:20:16.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.161+0000 7fdbde26b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55aa63eb7160 con 0x55aa63fc2d80 2024-09-11T00:20:16.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.161+0000 7fdbde26b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55aa63fc59a0 con 0x55aa63fb64d0 2024-09-11T00:20:16.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.161+0000 7fdbde26b740 10 client.0 _ll_register_callbacks cb 0x55aa63ed09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:20:16.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.161+0000 7fdbd9c32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fb6df0 0x55aa63fbf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:16.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.161+0000 7fdbd9c32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fb6df0 0x55aa63fbf9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51984/0 (socket says 172.21.15.78:51984) 2024-09-11T00:20:16.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.161+0000 7fdbd9c32640 1 -- 172.21.15.78:0/4106419050 learned_addr learned my addr 172.21.15.78:0/4106419050 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:16.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.161+0000 7fdbd9431640 1 --2- 172.21.15.78:0/4106419050 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55aa63fb64d0 0x55aa63fc2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:16.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.161+0000 7fdbd9c32640 1 -- 172.21.15.78:0/4106419050 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55aa63fb64d0 msgr2=0x55aa63fc2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:16.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.161+0000 7fdbd9c32640 1 --2- 172.21.15.78:0/4106419050 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55aa63fb64d0 0x55aa63fc2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.161+0000 7fdbd9c32640 1 -- 172.21.15.78:0/4106419050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa63fc2d80 msgr2=0x55aa63fbff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:16.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.161+0000 7fdbd9c32640 1 --2- 172.21.15.78:0/4106419050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa63fc2d80 0x55aa63fbff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.161+0000 7fdbd9c32640 1 -- 172.21.15.78:0/4106419050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa63ee4c90 con 0x55aa63fb6df0 2024-09-11T00:20:16.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.161+0000 7fdbd9c32640 1 --2- 172.21.15.78:0/4106419050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fb6df0 0x55aa63fbf9c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fdbd002a450 tx=0x7fdbd0031590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d051be5c0c28af8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.161+0000 7fdbbd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:20:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.162+0000 7fdbbd7fa640 1 -- 172.21.15.78:0/4106419050 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd003f070 con 0x55aa63fb6df0 2024-09-11T00:20:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.162+0000 7fdbbd7fa640 1 -- 172.21.15.78:0/4106419050 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fdbd0004250 con 0x55aa63fb6df0 2024-09-11T00:20:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.162+0000 7fdbde26b740 1 -- 172.21.15.78:0/4106419050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbd00316a0 con 0x55aa63fb6df0 2024-09-11T00:20:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.162+0000 7fdbbd7fa640 1 -- 172.21.15.78:0/4106419050 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fdbd0035040 con 0x55aa63fb6df0 2024-09-11T00:20:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.162+0000 7fdbde26b740 10 client.15840 fetch_fsmap learned FSMap version 20 2024-09-11T00:20:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.162+0000 7fdbde26b740 1 -- 172.21.15.78:0/4106419050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55aa63fd1200 con 0x55aa63fb6df0 2024-09-11T00:20:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.162+0000 7fdbbd7fa640 1 -- 172.21.15.78:0/4106419050 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbd00316a0 con 0x55aa63fb6df0 2024-09-11T00:20:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.162+0000 7fdbbd7fa640 1 -- 172.21.15.78:0/4106419050 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fdbd0054020 con 0x55aa63fb6df0 2024-09-11T00:20:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.162+0000 7fdbde26b740 10 client.15840 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:20:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.162+0000 7fdbde26b740 10 client.15840 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:20:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.162+0000 7fdbde26b740 20 client.15840 populate_metadata read hostname 'smithi078' 2024-09-11T00:20:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.162+0000 7fdbde26b740 1 --2- 172.21.15.78:0/4106419050 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55aa63fd2550 0x55aa63fd4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:16.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.162+0000 7fdbde26b740 4 client.15840 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:20:16.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.162+0000 7fdbde26b740 1 -- 172.21.15.78:0/4106419050 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa63f2edf0 con 0x55aa63fd2550 2024-09-11T00:20:16.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.162+0000 7fdbd9431640 1 --2- 172.21.15.78:0/4106419050 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55aa63fd2550 0x55aa63fd4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:16.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.163+0000 7fdbbd7fa640 10 client.15840 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:16.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.163+0000 7fdbd9431640 1 --2- 172.21.15.78:0/4106419050 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55aa63fd2550 0x55aa63fd4940 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84dc52eea6225844 server_cookie=be315dea3d57ba9 in_seq=0 out_seq=0 2024-09-11T00:20:16.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.164+0000 7fdbbd7fa640 1 -- 172.21.15.78:0/4106419050 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aa63f2edf0 con 0x55aa63fd2550 2024-09-11T00:20:16.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.164+0000 7fdbbd7fa640 10 client.15840 handle_command_reply: tid=0 2024-09-11T00:20:16.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.164+0000 7fdbde26b740 1 client.15840 shutdown 2024-09-11T00:20:16.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.164+0000 7fdbde26b740 1 -- 172.21.15.78:0/4106419050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fb6df0 msgr2=0x55aa63fbf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:16.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.164+0000 7fdbde26b740 1 --2- 172.21.15.78:0/4106419050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fb6df0 0x55aa63fbf9c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fdbd002a450 tx=0x7fdbd0031590 comp rx=0 tx=0).stop 2024-09-11T00:20:16.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.164+0000 7fdbde26b740 1 -- 172.21.15.78:0/4106419050 shutdown_connections 2024-09-11T00:20:16.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.164+0000 7fdbde26b740 1 --2- 172.21.15.78:0/4106419050 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55aa63fd2550 0x55aa63fd4940 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.164+0000 7fdbde26b740 1 --2- 172.21.15.78:0/4106419050 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa63fc2d80 0x55aa63fbff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.164+0000 7fdbde26b740 1 --2- 172.21.15.78:0/4106419050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fb6df0 0x55aa63fbf9c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.164+0000 7fdbbd7fa640 0 client.15840 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:16.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.164+0000 7fdbde26b740 1 --2- 172.21.15.78:0/4106419050 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55aa63fb64d0 0x55aa63fc2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.164+0000 7fdbde26b740 1 -- 172.21.15.78:0/4106419050 >> 172.21.15.78:0/4106419050 conn(0x55aa63fb4300 msgr2=0x55aa63fb9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:16.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.164+0000 7fdbde26b740 1 -- 172.21.15.78:0/4106419050 shutdown_connections 2024-09-11T00:20:16.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.164+0000 7fdbde26b740 1 -- 172.21.15.78:0/4106419050 wait complete. 2024-09-11T00:20:16.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.164+0000 7fdbde26b740 20 client.15840 trim_cache size 0 max 16384 2024-09-11T00:20:16.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.177+0000 7fdbde26b740 1 Processor -- start 2024-09-11T00:20:16.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.177+0000 7fdbde26b740 1 -- start start 2024-09-11T00:20:16.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.177+0000 7fdbde26b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55aa63fb64d0 0x55aa63faf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:16.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.177+0000 7fdbde26b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fb6df0 0x55aa63fbe260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:16.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.177+0000 7fdbde26b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa63fc2d80 0x55aa63fbe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:16.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.177+0000 7fdbde26b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd41ac7d0 con 0x55aa63fb6df0 2024-09-11T00:20:16.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.177+0000 7fdbde26b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd41af050 con 0x55aa63fc2d80 2024-09-11T00:20:16.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.177+0000 7fdbde26b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd41ace40 con 0x55aa63fb64d0 2024-09-11T00:20:16.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.177+0000 7fdbd9c32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fb6df0 0x55aa63fbe260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:16.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.177+0000 7fdbd9c32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fb6df0 0x55aa63fbe260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51998/0 (socket says 172.21.15.78:51998) 2024-09-11T00:20:16.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.177+0000 7fdbd9c32640 1 -- 172.21.15.78:0/115609805 learned_addr learned my addr 172.21.15.78:0/115609805 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:16.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.178+0000 7fdbd9c32640 1 -- 172.21.15.78:0/115609805 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55aa63fb64d0 msgr2=0x55aa63faf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:16.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.178+0000 7fdbd9c32640 1 --2- 172.21.15.78:0/115609805 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55aa63fb64d0 0x55aa63faf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.178+0000 7fdbd9c32640 1 -- 172.21.15.78:0/115609805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa63fc2d80 msgr2=0x55aa63fbe7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:16.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.178+0000 7fdbd9c32640 1 --2- 172.21.15.78:0/115609805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa63fc2d80 0x55aa63fbe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.178+0000 7fdbd9c32640 1 -- 172.21.15.78:0/115609805 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa63fb6c20 con 0x55aa63fb6df0 2024-09-11T00:20:16.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.178+0000 7fdbd9c32640 1 --2- 172.21.15.78:0/115609805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fb6df0 0x55aa63fbe260 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0005940 tx=0x7fdbd00314c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe680d32c8ee09b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:16.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.178+0000 7fdbbf7fe640 1 -- 172.21.15.78:0/115609805 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd003f070 con 0x55aa63fb6df0 2024-09-11T00:20:16.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.178+0000 7fdbbf7fe640 1 -- 172.21.15.78:0/115609805 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbd0048030 con 0x55aa63fb6df0 2024-09-11T00:20:16.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.178+0000 7fdbbf7fe640 1 -- 172.21.15.78:0/115609805 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd00035f0 con 0x55aa63fb6df0 2024-09-11T00:20:16.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.179+0000 7fdbde26b740 1 -- 172.21.15.78:0/115609805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fb6df0 msgr2=0x55aa63fbe260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:16.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.179+0000 7fdbde26b740 1 --2- 172.21.15.78:0/115609805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fb6df0 0x55aa63fbe260 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0005940 tx=0x7fdbd00314c0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.179+0000 7fdbde26b740 1 -- 172.21.15.78:0/115609805 shutdown_connections 2024-09-11T00:20:16.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.179+0000 7fdbde26b740 1 --2- 172.21.15.78:0/115609805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa63fc2d80 0x55aa63fbe7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.179+0000 7fdbde26b740 1 --2- 172.21.15.78:0/115609805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fb6df0 0x55aa63fbe260 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.179+0000 7fdbde26b740 1 --2- 172.21.15.78:0/115609805 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55aa63fb64d0 0x55aa63faf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.179+0000 7fdbde26b740 1 -- 172.21.15.78:0/115609805 >> 172.21.15.78:0/115609805 conn(0x55aa63fb4300 msgr2=0x55aa63fbac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:16.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.179+0000 7fdbde26b740 1 -- 172.21.15.78:0/115609805 shutdown_connections 2024-09-11T00:20:16.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.179+0000 7fdbde26b740 1 -- 172.21.15.78:0/115609805 wait complete. 2024-09-11T00:20:16.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.179+0000 7fdbde26b740 1 -- start start 2024-09-11T00:20:16.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.179+0000 7fdbde26b740 1 Processor -- start 2024-09-11T00:20:16.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.179+0000 7fdbde26b740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa63fb64d0 0x55aa63fcb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:16.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.179+0000 7fdbde26b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55aa63fb6df0 0x55aa63fcb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:16.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.179+0000 7fdbde26b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fc2d80 0x55aa63fc5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:16.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.179+0000 7fdbde26b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd41ad510 con 0x55aa63fc2d80 2024-09-11T00:20:16.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.179+0000 7fdbde26b740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd41ae980 con 0x55aa63fb64d0 2024-09-11T00:20:16.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.179+0000 7fdbde26b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd41adbe0 con 0x55aa63fb6df0 2024-09-11T00:20:16.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.179+0000 7fdbde26b740 10 client.0 _ll_register_callbacks cb 0x7fdbc400c750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:20:16.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.179+0000 7fdbd9431640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fc2d80 0x55aa63fc5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:16.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.180+0000 7fdbd9431640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fc2d80 0x55aa63fc5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52006/0 (socket says 172.21.15.78:52006) 2024-09-11T00:20:16.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.180+0000 7fdbd9431640 1 -- 172.21.15.78:0/2958063069 learned_addr learned my addr 172.21.15.78:0/2958063069 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:16.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.180+0000 7fdbd9431640 1 --2- 172.21.15.78:0/2958063069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa63fb64d0 0x55aa63fcb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:16.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.180+0000 7fdbd9c32640 1 --2- 172.21.15.78:0/2958063069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55aa63fb6df0 0x55aa63fcb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:16.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.180+0000 7fdbd9431640 1 -- 172.21.15.78:0/2958063069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55aa63fb6df0 msgr2=0x55aa63fcb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:16.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.180+0000 7fdbd9431640 1 --2- 172.21.15.78:0/2958063069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55aa63fb6df0 0x55aa63fcb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.180+0000 7fdbd9431640 1 -- 172.21.15.78:0/2958063069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa63fb64d0 msgr2=0x55aa63fcb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:16.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.180+0000 7fdbd9431640 1 --2- 172.21.15.78:0/2958063069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa63fb64d0 0x55aa63fcb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.180+0000 7fdbd9431640 1 -- 172.21.15.78:0/2958063069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa63fc65e0 con 0x55aa63fc2d80 2024-09-11T00:20:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.180+0000 7fdbd9c32640 1 --2- 172.21.15.78:0/2958063069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55aa63fb6df0 0x55aa63fcb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:20:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.180+0000 7fdbd9431640 1 --2- 172.21.15.78:0/2958063069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fc2d80 0x55aa63fc5db0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400c620 tx=0x7fdbc4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dada965e1e2543cc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.180+0000 7fdbbd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:20:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.180+0000 7fdbbd7fa640 1 -- 172.21.15.78:0/2958063069 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc400f040 con 0x55aa63fc2d80 2024-09-11T00:20:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.180+0000 7fdbbd7fa640 1 -- 172.21.15.78:0/2958063069 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fdbc40169b0 con 0x55aa63fc2d80 2024-09-11T00:20:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.180+0000 7fdbde26b740 1 -- 172.21.15.78:0/2958063069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbd0048030 con 0x55aa63fc2d80 2024-09-11T00:20:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.180+0000 7fdbbd7fa640 1 -- 172.21.15.78:0/2958063069 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fdbc402e050 con 0x55aa63fc2d80 2024-09-11T00:20:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.180+0000 7fdbde26b740 10 client.15846 fetch_fsmap learned FSMap version 20 2024-09-11T00:20:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.180+0000 7fdbde26b740 1 -- 172.21.15.78:0/2958063069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55aa6403fd80 con 0x55aa63fc2d80 2024-09-11T00:20:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.181+0000 7fdbbd7fa640 1 -- 172.21.15.78:0/2958063069 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbd0048030 con 0x55aa63fc2d80 2024-09-11T00:20:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.181+0000 7fdbbd7fa640 1 -- 172.21.15.78:0/2958063069 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fdbc4015040 con 0x55aa63fc2d80 2024-09-11T00:20:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.181+0000 7fdbde26b740 10 client.15846 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:20:16.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.181+0000 7fdbde26b740 10 client.15846 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:20:16.322 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-11T00:20:16.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.181+0000 7fdbde26b740 20 client.15846 populate_metadata read hostname 'smithi078' 2024-09-11T00:20:16.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.181+0000 7fdbde26b740 1 --2- 172.21.15.78:0/2958063069 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55aa64040500 0x55aa64042920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:16.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.181+0000 7fdbde26b740 4 client.15846 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:20:16.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.181+0000 7fdbde26b740 1 -- 172.21.15.78:0/2958063069 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55aa63f2a8a0 con 0x55aa64040500 2024-09-11T00:20:16.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.181+0000 7fdbd9c32640 1 --2- 172.21.15.78:0/2958063069 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55aa64040500 0x55aa64042920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:16.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.182+0000 7fdbbd7fa640 10 client.15846 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:16.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.182+0000 7fdbd9c32640 1 --2- 172.21.15.78:0/2958063069 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55aa64040500 0x55aa64042920 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a07a4a3ef76e65a server_cookie=b193bd1f6e7e8cf2 in_seq=0 out_seq=0 2024-09-11T00:20:16.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.182+0000 7fdbbd7fa640 1 -- 172.21.15.78:0/2958063069 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55aa63f2a8a0 con 0x55aa64040500 2024-09-11T00:20:16.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.182+0000 7fdbbd7fa640 10 client.15846 handle_command_reply: tid=0 2024-09-11T00:20:16.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.182+0000 7fdbde26b740 1 client.15846 shutdown 2024-09-11T00:20:16.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.182+0000 7fdbde26b740 1 -- 172.21.15.78:0/2958063069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fc2d80 msgr2=0x55aa63fc5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:16.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.182+0000 7fdbde26b740 1 --2- 172.21.15.78:0/2958063069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fc2d80 0x55aa63fc5db0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400c620 tx=0x7fdbc4008040 comp rx=0 tx=0).stop 2024-09-11T00:20:16.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.182+0000 7fdbde26b740 1 -- 172.21.15.78:0/2958063069 shutdown_connections 2024-09-11T00:20:16.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.182+0000 7fdbde26b740 1 --2- 172.21.15.78:0/2958063069 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55aa64040500 0x55aa64042920 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.182+0000 7fdbde26b740 1 --2- 172.21.15.78:0/2958063069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aa63fc2d80 0x55aa63fc5db0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.182+0000 7fdbde26b740 1 --2- 172.21.15.78:0/2958063069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55aa63fb6df0 0x55aa63fcb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.182+0000 7fdbde26b740 1 --2- 172.21.15.78:0/2958063069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55aa63fb64d0 0x55aa63fcb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.182+0000 7fdbbd7fa640 0 client.15846 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:16.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.182+0000 7fdbde26b740 1 -- 172.21.15.78:0/2958063069 >> 172.21.15.78:0/2958063069 conn(0x55aa63fb4300 msgr2=0x55aa63fbe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:16.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.182+0000 7fdbde26b740 1 -- 172.21.15.78:0/2958063069 shutdown_connections 2024-09-11T00:20:16.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.182+0000 7fdbde26b740 1 -- 172.21.15.78:0/2958063069 wait complete. 2024-09-11T00:20:16.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.182+0000 7fdbde26b740 20 client.15846 trim_cache size 0 max 16384 2024-09-11T00:20:16.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.183+0000 7fdbdbe96640 1 -- 172.21.15.78:0/3235611982 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdbc00b54d0 msgr2=0x7fdbc00b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:16.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.183+0000 7fdbdbe96640 1 --2- 172.21.15.78:0/3235611982 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdbc00b54d0 0x7fdbc00b7990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc0e36b0 tx=0x7fdbcc078510 comp rx=0 tx=0).stop 2024-09-11T00:20:16.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.183+0000 7fdbdbe96640 1 -- 172.21.15.78:0/3235611982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbd4108060 msgr2=0x7fdbd419ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:16.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.183+0000 7fdbdbe96640 1 --2- 172.21.15.78:0/3235611982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbd4108060 0x7fdbd419ebd0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00eaa0 tx=0x7fdbcc00ef60 comp rx=0 tx=0).stop 2024-09-11T00:20:16.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.183+0000 7fdbdbe96640 1 -- 172.21.15.78:0/3235611982 shutdown_connections 2024-09-11T00:20:16.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.183+0000 7fdbdbe96640 1 --2- 172.21.15.78:0/3235611982 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdbc00b54d0 0x7fdbc00b7990 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.183+0000 7fdbdbe96640 1 --2- 172.21.15.78:0/3235611982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbd4108060 0x7fdbd419ebd0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.183+0000 7fdbdbe96640 1 --2- 172.21.15.78:0/3235611982 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdbd41076e0 0x7fdbd4199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.183+0000 7fdbdbe96640 1 --2- 172.21.15.78:0/3235611982 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdbd4101cd0 0x7fdbd41992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:16.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.183+0000 7fdbdbe96640 1 -- 172.21.15.78:0/3235611982 >> 172.21.15.78:0/3235611982 conn(0x7fdbd40fd700 msgr2=0x7fdbd406b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:16.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.183+0000 7fdbdbe96640 1 -- 172.21.15.78:0/3235611982 shutdown_connections 2024-09-11T00:20:16.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:16.183+0000 7fdbdbe96640 1 -- 172.21.15.78:0/3235611982 wait complete. 2024-09-11T00:20:18.090 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:20:18.090 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:20:18.346 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:20:18.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.849+0000 7f47ec647640 1 -- 172.21.15.78:0/2768007051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47e4108020 msgr2=0x7f47e410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:18.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.849+0000 7f47ec647640 1 --2- 172.21.15.78:0/2768007051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47e4108020 0x7f47e410e820 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009ca0 tx=0x7f47dc02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.849+0000 7f47ec647640 1 -- 172.21.15.78:0/2768007051 shutdown_connections 2024-09-11T00:20:18.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.849+0000 7f47ec647640 1 --2- 172.21.15.78:0/2768007051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47e4108020 0x7f47e410e820 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.849+0000 7f47ec647640 1 --2- 172.21.15.78:0/2768007051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47e41076a0 0x7f47e4107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.849+0000 7f47ec647640 1 --2- 172.21.15.78:0/2768007051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47e4101c90 0x7f47e4102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.849+0000 7f47ec647640 1 -- 172.21.15.78:0/2768007051 >> 172.21.15.78:0/2768007051 conn(0x7f47e40fd700 msgr2=0x7f47e40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:18.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.849+0000 7f47ec647640 1 -- 172.21.15.78:0/2768007051 shutdown_connections 2024-09-11T00:20:18.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.849+0000 7f47ec647640 1 -- 172.21.15.78:0/2768007051 wait complete. 2024-09-11T00:20:18.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.850+0000 7f47ec647640 1 Processor -- start 2024-09-11T00:20:18.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.850+0000 7f47ec647640 1 -- start start 2024-09-11T00:20:18.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.850+0000 7f47ec647640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47e4101c90 0x7f47e419a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.850+0000 7f47ec647640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47e41076a0 0x7f47e419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.850+0000 7f47ec647640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47e4108020 0x7f47e419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.850+0000 7f47ec647640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f47e4111ce0 con 0x7f47e41076a0 2024-09-11T00:20:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.850+0000 7f47ec647640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f47e4111b60 con 0x7f47e4101c90 2024-09-11T00:20:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.850+0000 7f47ec647640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f47e4111e60 con 0x7f47e4108020 2024-09-11T00:20:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.850+0000 7f47e9be2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47e41076a0 0x7f47e419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.850+0000 7f47e9be2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47e41076a0 0x7f47e419a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52028/0 (socket says 172.21.15.78:52028) 2024-09-11T00:20:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.850+0000 7f47e9be2640 1 -- 172.21.15.78:0/2737824633 learned_addr learned my addr 172.21.15.78:0/2737824633 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.850+0000 7f47eabe4640 1 --2- 172.21.15.78:0/2737824633 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47e4108020 0x7f47e419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.851+0000 7f47ea3e3640 1 --2- 172.21.15.78:0/2737824633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47e4101c90 0x7f47e419a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.851+0000 7f47e9be2640 1 -- 172.21.15.78:0/2737824633 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47e4108020 msgr2=0x7f47e419ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.851+0000 7f47e9be2640 1 --2- 172.21.15.78:0/2737824633 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47e4108020 0x7f47e419ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.851+0000 7f47e9be2640 1 -- 172.21.15.78:0/2737824633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47e4101c90 msgr2=0x7f47e419a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:18.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.851+0000 7f47e9be2640 1 --2- 172.21.15.78:0/2737824633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47e4101c90 0x7f47e419a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.851+0000 7f47e9be2640 1 -- 172.21.15.78:0/2737824633 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e41a5490 con 0x7f47e41076a0 2024-09-11T00:20:18.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.851+0000 7f47e9be2640 1 --2- 172.21.15.78:0/2737824633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47e41076a0 0x7f47e419a5f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f47d400b4a0 tx=0x7f47d400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:18.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.851+0000 7f47db7fe640 1 -- 172.21.15.78:0/2737824633 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d4014070 con 0x7f47e41076a0 2024-09-11T00:20:18.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.851+0000 7f47ec647640 1 -- 172.21.15.78:0/2737824633 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47e41a5780 con 0x7f47e41076a0 2024-09-11T00:20:18.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.851+0000 7f47db7fe640 1 -- 172.21.15.78:0/2737824633 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47d4010ac0 con 0x7f47e41076a0 2024-09-11T00:20:18.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.851+0000 7f47db7fe640 1 -- 172.21.15.78:0/2737824633 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d4017c30 con 0x7f47e41076a0 2024-09-11T00:20:18.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.851+0000 7f47ec647640 1 -- 172.21.15.78:0/2737824633 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47e41a5d40 con 0x7f47e41076a0 2024-09-11T00:20:18.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.854+0000 7f47eea1c740 1 Processor -- start 2024-09-11T00:20:18.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.854+0000 7f47db7fe640 1 -- 172.21.15.78:0/2737824633 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f47d4010610 con 0x7f47e41076a0 2024-09-11T00:20:18.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.854+0000 7f47eea1c740 1 -- start start 2024-09-11T00:20:18.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.854+0000 7f47eea1c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154ceee0 0x5628154cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:18.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.854+0000 7f47eea1c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628154cf800 0x5628154df660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:18.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.854+0000 7f47eea1c740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154dfba0 0x5628154e1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:18.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.854+0000 7f47eea1c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x562815445e60 con 0x5628154ceee0 2024-09-11T00:20:18.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.854+0000 7f47eea1c740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562815435290 con 0x5628154dfba0 2024-09-11T00:20:18.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.854+0000 7f47eea1c740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5628154390a0 con 0x5628154cf800 2024-09-11T00:20:18.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.854+0000 7f47eabe4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154ceee0 0x5628154cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:18.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.854+0000 7f47eabe4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154ceee0 0x5628154cf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52040/0 (socket says 172.21.15.78:52040) 2024-09-11T00:20:18.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.854+0000 7f47eabe4640 1 -- 172.21.15.78:0/2277254306 learned_addr learned my addr 172.21.15.78:0/2277254306 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:18.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.855+0000 7f47ea3e3640 1 --2- 172.21.15.78:0/2277254306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628154cf800 0x5628154df660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:18.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.855+0000 7f47eabe4640 1 -- 172.21.15.78:0/2277254306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628154cf800 msgr2=0x5628154df660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:18.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.855+0000 7f47e9be2640 1 --2- 172.21.15.78:0/2277254306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154dfba0 0x5628154e1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:18.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.855+0000 7f47db7fe640 1 --2- 172.21.15.78:0/2737824633 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f47d00b5450 0x7f47d00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:18.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.855+0000 7f47eabe4640 1 --2- 172.21.15.78:0/2277254306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628154cf800 0x5628154df660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.855+0000 7f47eabe4640 1 -- 172.21.15.78:0/2277254306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154dfba0 msgr2=0x5628154e1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:18.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.855+0000 7f47eabe4640 1 --2- 172.21.15.78:0/2277254306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154dfba0 0x5628154e1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.855+0000 7f47eabe4640 1 -- 172.21.15.78:0/2277254306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562815193930 con 0x5628154ceee0 2024-09-11T00:20:18.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.855+0000 7f47ea3e3640 1 --2- 172.21.15.78:0/2277254306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628154cf800 0x5628154df660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:18.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.855+0000 7f47e9be2640 1 --2- 172.21.15.78:0/2277254306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154dfba0 0x5628154e1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:18.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.855+0000 7f47db7fe640 1 -- 172.21.15.78:0/2737824633 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f47d40e5880 con 0x7f47e41076a0 2024-09-11T00:20:18.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.855+0000 7f47eabe4640 1 --2- 172.21.15.78:0/2737824633 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f47d00b5450 0x7f47d00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:18.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.855+0000 7f47eabe4640 1 --2- 172.21.15.78:0/2277254306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154ceee0 0x5628154cf2c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f47dc035000 tx=0x7f47dc02f4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66e267e998ca462 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.855+0000 7f47d8ff9640 1 -- 172.21.15.78:0/2277254306 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc0317f0 con 0x5628154ceee0 2024-09-11T00:20:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.855+0000 7f47d8ff9640 1 -- 172.21.15.78:0/2277254306 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47dc036070 con 0x5628154ceee0 2024-09-11T00:20:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.855+0000 7f47d8ff9640 1 -- 172.21.15.78:0/2277254306 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc02f9d0 con 0x5628154ceee0 2024-09-11T00:20:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.856+0000 7f47eea1c740 1 -- 172.21.15.78:0/2277254306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154ceee0 msgr2=0x5628154cf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.856+0000 7f47eabe4640 1 --2- 172.21.15.78:0/2737824633 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f47d00b5450 0x7f47d00b7910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f47dc047000 tx=0x7f47dc02fd80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.856+0000 7f47eea1c740 1 --2- 172.21.15.78:0/2277254306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154ceee0 0x5628154cf2c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f47dc035000 tx=0x7f47dc02f4c0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.856+0000 7f47eea1c740 1 -- 172.21.15.78:0/2277254306 shutdown_connections 2024-09-11T00:20:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.856+0000 7f47eea1c740 1 --2- 172.21.15.78:0/2277254306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154dfba0 0x5628154e1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.856+0000 7f47eea1c740 1 --2- 172.21.15.78:0/2277254306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628154cf800 0x5628154df660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.856+0000 7f47eea1c740 1 --2- 172.21.15.78:0/2277254306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154ceee0 0x5628154cf2c0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.856+0000 7f47eea1c740 1 -- 172.21.15.78:0/2277254306 >> 172.21.15.78:0/2277254306 conn(0x5628154ccd10 msgr2=0x5628154cdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.856+0000 7f47eea1c740 1 -- 172.21.15.78:0/2277254306 shutdown_connections 2024-09-11T00:20:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.856+0000 7f47eea1c740 1 -- 172.21.15.78:0/2277254306 wait complete. 2024-09-11T00:20:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.856+0000 7f47eea1c740 1 -- start start 2024-09-11T00:20:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.856+0000 7f47eea1c740 1 Processor -- start 2024-09-11T00:20:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.857+0000 7f47eea1c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628154ceee0 0x5628154df4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.857+0000 7f47eea1c740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154cf800 0x5628154dc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.857+0000 7f47eea1c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154dfba0 0x5628154dcf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.857+0000 7f47eea1c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x562815296890 con 0x5628154dfba0 2024-09-11T00:20:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.857+0000 7f47eea1c740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5628153cfd40 con 0x5628154cf800 2024-09-11T00:20:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.857+0000 7f47eea1c740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5628154e26d0 con 0x5628154ceee0 2024-09-11T00:20:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.857+0000 7f47eea1c740 10 client.0 _ll_register_callbacks cb 0x562815433c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:20:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.857+0000 7f47eabe4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154dfba0 0x5628154dcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.857+0000 7f47eabe4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154dfba0 0x5628154dcf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52056/0 (socket says 172.21.15.78:52056) 2024-09-11T00:20:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.857+0000 7f47eabe4640 1 -- 172.21.15.78:0/630282686 learned_addr learned my addr 172.21.15.78:0/630282686 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.857+0000 7f47ea3e3640 1 --2- 172.21.15.78:0/630282686 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628154ceee0 0x5628154df4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.857+0000 7f47e9be2640 1 --2- 172.21.15.78:0/630282686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154cf800 0x5628154dc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:18.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.857+0000 7f47eabe4640 1 -- 172.21.15.78:0/630282686 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628154ceee0 msgr2=0x5628154df4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:18.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.857+0000 7f47eabe4640 1 --2- 172.21.15.78:0/630282686 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628154ceee0 0x5628154df4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.857+0000 7f47eabe4640 1 -- 172.21.15.78:0/630282686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154cf800 msgr2=0x5628154dc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:18.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.857+0000 7f47eabe4640 1 --2- 172.21.15.78:0/630282686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154cf800 0x5628154dc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.857+0000 7f47eabe4640 1 -- 172.21.15.78:0/630282686 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628154eba00 con 0x5628154dfba0 2024-09-11T00:20:18.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.857+0000 7f47e9be2640 1 --2- 172.21.15.78:0/630282686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154cf800 0x5628154dc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:18.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.857+0000 7f47ea3e3640 1 --2- 172.21.15.78:0/630282686 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628154ceee0 0x5628154df4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:20:18.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.857+0000 7f47eabe4640 1 --2- 172.21.15.78:0/630282686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154dfba0 0x5628154dcf30 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0043f0 tx=0x7f47dc040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27da145a1d749c31 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:18.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.857+0000 7f47cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:20:18.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.858+0000 7f47cdffb640 1 -- 172.21.15.78:0/630282686 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc062060 con 0x5628154dfba0 2024-09-11T00:20:18.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.858+0000 7f47eea1c740 1 -- 172.21.15.78:0/630282686 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47dc036070 con 0x5628154dfba0 2024-09-11T00:20:18.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.858+0000 7f47cdffb640 1 -- 172.21.15.78:0/630282686 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f47dc030b60 con 0x5628154dfba0 2024-09-11T00:20:18.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.858+0000 7f47cdffb640 1 -- 172.21.15.78:0/630282686 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f47dc0098d0 con 0x5628154dfba0 2024-09-11T00:20:18.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.858+0000 7f47eea1c740 10 client.15858 fetch_fsmap learned FSMap version 20 2024-09-11T00:20:18.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.858+0000 7f47eea1c740 1 -- 172.21.15.78:0/630282686 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5628154ee170 con 0x5628154dfba0 2024-09-11T00:20:18.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.858+0000 7f47cdffb640 1 -- 172.21.15.78:0/630282686 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47dc036070 con 0x5628154dfba0 2024-09-11T00:20:18.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.858+0000 7f47cdffb640 1 -- 172.21.15.78:0/630282686 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f47dc003970 con 0x5628154dfba0 2024-09-11T00:20:18.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.858+0000 7f47eea1c740 10 client.15858 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:20:18.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.858+0000 7f47eea1c740 10 client.15858 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:20:18.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.858+0000 7f47eea1c740 20 client.15858 populate_metadata read hostname 'smithi078' 2024-09-11T00:20:18.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.858+0000 7f47eea1c740 1 --2- 172.21.15.78:0/630282686 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5628154ef4c0 0x5628154f18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:18.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.858+0000 7f47eea1c740 4 client.15858 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:20:18.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.858+0000 7f47eea1c740 1 -- 172.21.15.78:0/630282686 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562815447db0 con 0x5628154ef4c0 2024-09-11T00:20:18.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.859+0000 7f47ea3e3640 1 --2- 172.21.15.78:0/630282686 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5628154ef4c0 0x5628154f18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:18.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.859+0000 7f47cdffb640 10 client.15858 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:18.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.859+0000 7f47ea3e3640 1 --2- 172.21.15.78:0/630282686 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5628154ef4c0 0x5628154f18b0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68c8fc9da35f51c1 server_cookie=53dd4bf47bd76ecc in_seq=0 out_seq=0 2024-09-11T00:20:18.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.860+0000 7f47cdffb640 1 -- 172.21.15.78:0/630282686 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562815447db0 con 0x5628154ef4c0 2024-09-11T00:20:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.860+0000 7f47cdffb640 10 client.15858 handle_command_reply: tid=0 2024-09-11T00:20:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.860+0000 7f47eea1c740 1 client.15858 shutdown 2024-09-11T00:20:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.860+0000 7f47eea1c740 1 -- 172.21.15.78:0/630282686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154dfba0 msgr2=0x5628154dcf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.860+0000 7f47eea1c740 1 --2- 172.21.15.78:0/630282686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154dfba0 0x5628154dcf30 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0043f0 tx=0x7f47dc040000 comp rx=0 tx=0).stop 2024-09-11T00:20:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.860+0000 7f47eea1c740 1 -- 172.21.15.78:0/630282686 shutdown_connections 2024-09-11T00:20:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.860+0000 7f47eea1c740 1 --2- 172.21.15.78:0/630282686 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5628154ef4c0 0x5628154f18b0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.860+0000 7f47eea1c740 1 --2- 172.21.15.78:0/630282686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154dfba0 0x5628154dcf30 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.860+0000 7f47eea1c740 1 --2- 172.21.15.78:0/630282686 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154cf800 0x5628154dc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.860+0000 7f47cdffb640 0 client.15858 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.860+0000 7f47eea1c740 1 --2- 172.21.15.78:0/630282686 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628154ceee0 0x5628154df4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.860+0000 7f47eea1c740 1 -- 172.21.15.78:0/630282686 >> 172.21.15.78:0/630282686 conn(0x5628154ccd10 msgr2=0x5628154cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.860+0000 7f47eea1c740 1 -- 172.21.15.78:0/630282686 shutdown_connections 2024-09-11T00:20:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.860+0000 7f47eea1c740 1 -- 172.21.15.78:0/630282686 wait complete. 2024-09-11T00:20:18.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.860+0000 7f47eea1c740 20 client.15858 trim_cache size 0 max 16384 2024-09-11T00:20:18.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.877+0000 7f47eea1c740 1 Processor -- start 2024-09-11T00:20:18.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.877+0000 7f47eea1c740 1 -- start start 2024-09-11T00:20:18.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.877+0000 7f47eea1c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628154ceee0 0x5628154ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:18.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.877+0000 7f47eea1c740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154cf800 0x5628154de640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:18.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.877+0000 7f47eea1c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154dfba0 0x5628154dc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:18.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.877+0000 7f47eea1c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f47e41aa550 con 0x5628154dfba0 2024-09-11T00:20:18.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.877+0000 7f47eea1c740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f47e41acdd0 con 0x5628154cf800 2024-09-11T00:20:18.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.877+0000 7f47eea1c740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f47e41aabc0 con 0x5628154ceee0 2024-09-11T00:20:18.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.877+0000 7f47eabe4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154dfba0 0x5628154dc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:18.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.877+0000 7f47eabe4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154dfba0 0x5628154dc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52066/0 (socket says 172.21.15.78:52066) 2024-09-11T00:20:18.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.877+0000 7f47eabe4640 1 -- 172.21.15.78:0/3211237594 learned_addr learned my addr 172.21.15.78:0/3211237594 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:18.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.877+0000 7f47ea3e3640 1 --2- 172.21.15.78:0/3211237594 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628154ceee0 0x5628154ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:18.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.877+0000 7f47e9be2640 1 --2- 172.21.15.78:0/3211237594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154cf800 0x5628154de640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:18.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.878+0000 7f47eabe4640 1 -- 172.21.15.78:0/3211237594 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628154ceee0 msgr2=0x5628154ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:18.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.878+0000 7f47eabe4640 1 --2- 172.21.15.78:0/3211237594 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628154ceee0 0x5628154ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.878+0000 7f47eabe4640 1 -- 172.21.15.78:0/3211237594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154cf800 msgr2=0x5628154de640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:18.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.878+0000 7f47eabe4640 1 --2- 172.21.15.78:0/3211237594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154cf800 0x5628154de640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.878+0000 7f47eabe4640 1 -- 172.21.15.78:0/3211237594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628154cdad0 con 0x5628154dfba0 2024-09-11T00:20:18.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.878+0000 7f47e9be2640 1 --2- 172.21.15.78:0/3211237594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154cf800 0x5628154de640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:18.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.878+0000 7f47eabe4640 1 --2- 172.21.15.78:0/3211237594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154dfba0 0x5628154dc1b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f47dc02a900 tx=0x7f47dc02f4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e913be207a045ec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:18.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.878+0000 7f47cffff640 1 -- 172.21.15.78:0/3211237594 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc062040 con 0x5628154dfba0 2024-09-11T00:20:18.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.878+0000 7f47cffff640 1 -- 172.21.15.78:0/3211237594 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47dc036070 con 0x5628154dfba0 2024-09-11T00:20:18.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.878+0000 7f47cffff640 1 -- 172.21.15.78:0/3211237594 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc02f660 con 0x5628154dfba0 2024-09-11T00:20:18.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.878+0000 7f47eea1c740 1 -- 172.21.15.78:0/3211237594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154dfba0 msgr2=0x5628154dc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:18.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.878+0000 7f47eea1c740 1 --2- 172.21.15.78:0/3211237594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154dfba0 0x5628154dc1b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f47dc02a900 tx=0x7f47dc02f4c0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.879+0000 7f47eea1c740 1 -- 172.21.15.78:0/3211237594 shutdown_connections 2024-09-11T00:20:18.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.879+0000 7f47eea1c740 1 --2- 172.21.15.78:0/3211237594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154dfba0 0x5628154dc1b0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.879+0000 7f47eea1c740 1 --2- 172.21.15.78:0/3211237594 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154cf800 0x5628154de640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.879+0000 7f47eea1c740 1 --2- 172.21.15.78:0/3211237594 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628154ceee0 0x5628154ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.879+0000 7f47eea1c740 1 -- 172.21.15.78:0/3211237594 >> 172.21.15.78:0/3211237594 conn(0x5628154ccd10 msgr2=0x5628154ddf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:18.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.879+0000 7f47eea1c740 1 -- 172.21.15.78:0/3211237594 shutdown_connections 2024-09-11T00:20:18.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.879+0000 7f47eea1c740 1 -- 172.21.15.78:0/3211237594 wait complete. 2024-09-11T00:20:18.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.879+0000 7f47eea1c740 1 -- start start 2024-09-11T00:20:18.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.879+0000 7f47eea1c740 1 Processor -- start 2024-09-11T00:20:18.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.879+0000 7f47eea1c740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154ceee0 0x5628154e7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:18.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.879+0000 7f47eea1c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628154cf800 0x5628154e8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:18.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.879+0000 7f47eea1c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154dfba0 0x5628154e4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:18.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.879+0000 7f47eea1c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f47e41ab290 con 0x5628154dfba0 2024-09-11T00:20:18.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.879+0000 7f47eea1c740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f47e41ac700 con 0x5628154ceee0 2024-09-11T00:20:18.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.879+0000 7f47eea1c740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f47e41ab960 con 0x5628154cf800 2024-09-11T00:20:18.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.879+0000 7f47eea1c740 10 client.0 _ll_register_callbacks cb 0x7f47dc031af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:20:18.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.879+0000 7f47eabe4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154dfba0 0x5628154e4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:18.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.879+0000 7f47eabe4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154dfba0 0x5628154e4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52080/0 (socket says 172.21.15.78:52080) 2024-09-11T00:20:18.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.879+0000 7f47eabe4640 1 -- 172.21.15.78:0/2373410270 learned_addr learned my addr 172.21.15.78:0/2373410270 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:18.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.880+0000 7f47e9be2640 1 --2- 172.21.15.78:0/2373410270 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628154cf800 0x5628154e8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:18.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.880+0000 7f47ea3e3640 1 --2- 172.21.15.78:0/2373410270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154ceee0 0x5628154e7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:18.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.880+0000 7f47eabe4640 1 -- 172.21.15.78:0/2373410270 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628154cf800 msgr2=0x5628154e8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:18.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.880+0000 7f47eabe4640 1 --2- 172.21.15.78:0/2373410270 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628154cf800 0x5628154e8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.880+0000 7f47eabe4640 1 -- 172.21.15.78:0/2373410270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154ceee0 msgr2=0x5628154e7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:18.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.880+0000 7f47eabe4640 1 --2- 172.21.15.78:0/2373410270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154ceee0 0x5628154e7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.880+0000 7f47eabe4640 1 -- 172.21.15.78:0/2373410270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628154e5040 con 0x5628154dfba0 2024-09-11T00:20:18.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.880+0000 7f47ea3e3640 1 --2- 172.21.15.78:0/2373410270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154ceee0 0x5628154e7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:18.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.880+0000 7f47eabe4640 1 --2- 172.21.15.78:0/2373410270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154dfba0 0x5628154e4930 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f47dc060040 tx=0x7f47dc0039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef536bcade75ab3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:18.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.880+0000 7f47cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:20:18.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.880+0000 7f47cdffb640 1 -- 172.21.15.78:0/2373410270 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc062070 con 0x5628154dfba0 2024-09-11T00:20:18.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.880+0000 7f47cdffb640 1 -- 172.21.15.78:0/2373410270 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f47dc030c60 con 0x5628154dfba0 2024-09-11T00:20:18.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.880+0000 7f47eea1c740 1 -- 172.21.15.78:0/2373410270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47dc036070 con 0x5628154dfba0 2024-09-11T00:20:18.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.880+0000 7f47cdffb640 1 -- 172.21.15.78:0/2373410270 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f47dc030e80 con 0x5628154dfba0 2024-09-11T00:20:18.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.880+0000 7f47eea1c740 10 client.15864 fetch_fsmap learned FSMap version 20 2024-09-11T00:20:18.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.880+0000 7f47eea1c740 1 -- 172.21.15.78:0/2373410270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56281555cbe0 con 0x5628154dfba0 2024-09-11T00:20:18.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.880+0000 7f47cdffb640 1 -- 172.21.15.78:0/2373410270 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47dc036070 con 0x5628154dfba0 2024-09-11T00:20:18.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.880+0000 7f47cdffb640 1 -- 172.21.15.78:0/2373410270 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f47dc076030 con 0x5628154dfba0 2024-09-11T00:20:18.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.881+0000 7f47eea1c740 10 client.15864 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:20:18.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.881+0000 7f47eea1c740 10 client.15864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:20:18.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.881+0000 7f47eea1c740 20 client.15864 populate_metadata read hostname 'smithi078' 2024-09-11T00:20:18.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.881+0000 7f47eea1c740 1 --2- 172.21.15.78:0/2373410270 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56281555d230 0x56281555f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:18.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.881+0000 7f47eea1c740 4 client.15864 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:20:18.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.881+0000 7f47eea1c740 1 -- 172.21.15.78:0/2373410270 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562815443860 con 0x56281555d230 2024-09-11T00:20:18.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.881+0000 7f47ea3e3640 1 --2- 172.21.15.78:0/2373410270 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56281555d230 0x56281555f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:18.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.881+0000 7f47ea3e3640 1 --2- 172.21.15.78:0/2373410270 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56281555d230 0x56281555f620 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1a6bdeb4d657e0e server_cookie=232d28da46f894f in_seq=0 out_seq=0 2024-09-11T00:20:18.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.881+0000 7f47cdffb640 10 client.15864 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:18.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.883+0000 7f47cdffb640 1 -- 172.21.15.78:0/2373410270 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562815443860 con 0x56281555d230 2024-09-11T00:20:18.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.883+0000 7f47cdffb640 10 client.15864 handle_command_reply: tid=0 2024-09-11T00:20:18.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.883+0000 7f47eea1c740 1 client.15864 shutdown 2024-09-11T00:20:18.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.883+0000 7f47eea1c740 1 -- 172.21.15.78:0/2373410270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154dfba0 msgr2=0x5628154e4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:18.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.883+0000 7f47eea1c740 1 --2- 172.21.15.78:0/2373410270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154dfba0 0x5628154e4930 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f47dc060040 tx=0x7f47dc0039f0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.883+0000 7f47eea1c740 1 -- 172.21.15.78:0/2373410270 shutdown_connections 2024-09-11T00:20:18.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.883+0000 7f47eea1c740 1 --2- 172.21.15.78:0/2373410270 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56281555d230 0x56281555f620 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.883+0000 7f47eea1c740 1 --2- 172.21.15.78:0/2373410270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628154dfba0 0x5628154e4930 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.883+0000 7f47eea1c740 1 --2- 172.21.15.78:0/2373410270 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628154cf800 0x5628154e8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.883+0000 7f47eea1c740 1 --2- 172.21.15.78:0/2373410270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5628154ceee0 0x5628154e7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.883+0000 7f47eea1c740 1 -- 172.21.15.78:0/2373410270 >> 172.21.15.78:0/2373410270 conn(0x5628154ccd10 msgr2=0x5628154de750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:18.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.883+0000 7f47cdffb640 0 client.15864 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:18.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.883+0000 7f47eea1c740 1 -- 172.21.15.78:0/2373410270 shutdown_connections 2024-09-11T00:20:18.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.883+0000 7f47eea1c740 1 -- 172.21.15.78:0/2373410270 wait complete. 2024-09-11T00:20:18.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.883+0000 7f47eea1c740 20 client.15864 trim_cache size 0 max 16384 2024-09-11T00:20:18.890 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:20:18.890 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-11T00:20:18.890 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "8ec9e858-aa62-420d-a112-e62ea7810e63", 2024-09-11T00:20:18.890 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-11T00:20:18.890 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:20:18.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.884+0000 7f47ec647640 1 -- 172.21.15.78:0/2737824633 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f47d00b5450 msgr2=0x7f47d00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:18.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.884+0000 7f47ec647640 1 --2- 172.21.15.78:0/2737824633 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f47d00b5450 0x7f47d00b7910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f47dc047000 tx=0x7f47dc02fd80 comp rx=0 tx=0).stop 2024-09-11T00:20:18.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.884+0000 7f47ec647640 1 -- 172.21.15.78:0/2737824633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47e41076a0 msgr2=0x7f47e419a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:18.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.884+0000 7f47ec647640 1 --2- 172.21.15.78:0/2737824633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47e41076a0 0x7f47e419a5f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f47d400b4a0 tx=0x7f47d400b960 comp rx=0 tx=0).stop 2024-09-11T00:20:18.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.884+0000 7f47ec647640 1 -- 172.21.15.78:0/2737824633 shutdown_connections 2024-09-11T00:20:18.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.884+0000 7f47ec647640 1 --2- 172.21.15.78:0/2737824633 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f47d00b5450 0x7f47d00b7910 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.884+0000 7f47ec647640 1 --2- 172.21.15.78:0/2737824633 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47e4108020 0x7f47e419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.884+0000 7f47ec647640 1 --2- 172.21.15.78:0/2737824633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47e41076a0 0x7f47e419a5f0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.884+0000 7f47ec647640 1 --2- 172.21.15.78:0/2737824633 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f47e4101c90 0x7f47e419a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:18.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.884+0000 7f47ec647640 1 -- 172.21.15.78:0/2737824633 >> 172.21.15.78:0/2737824633 conn(0x7f47e40fd700 msgr2=0x7f47e40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:18.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.884+0000 7f47ec647640 1 -- 172.21.15.78:0/2737824633 shutdown_connections 2024-09-11T00:20:18.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:18.884+0000 7f47ec647640 1 -- 172.21.15.78:0/2737824633 wait complete. 2024-09-11T00:20:19.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:18 smithi078 ceph-mon[30865]: pgmap v438: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-11T00:20:19.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:18 smithi112 ceph-mon[35627]: pgmap v438: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-11T00:20:19.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:18 smithi138 ceph-mon[35019]: pgmap v438: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-11T00:20:19.691 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:20:19.940 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:20:20.059 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:19 smithi078 ceph-mon[30865]: scrub queued for path: / 2024-09-11T00:20:20.060 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:19 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:20:20.060 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:19 smithi078 ceph-mon[30865]: scrub summary: active paths [/] 2024-09-11T00:20:20.060 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:19 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:20:20.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:19 smithi112 ceph-mon[35627]: scrub queued for path: / 2024-09-11T00:20:20.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:19 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:20:20.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:19 smithi112 ceph-mon[35627]: scrub summary: active paths [/] 2024-09-11T00:20:20.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:19 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:20:20.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:19 smithi138 ceph-mon[35019]: scrub queued for path: / 2024-09-11T00:20:20.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:19 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:20:20.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:19 smithi138 ceph-mon[35019]: scrub summary: active paths [/] 2024-09-11T00:20:20.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:19 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:20:20.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.428+0000 7fd2ed369640 1 -- 172.21.15.78:0/1113571557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2e8103b30 msgr2=0x7fd2e8103f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:20.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.428+0000 7fd2ed369640 1 --2- 172.21.15.78:0/1113571557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2e8103b30 0x7fd2e8103f10 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8009ca0 tx=0x7fd2d802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.428+0000 7fd2ed369640 1 -- 172.21.15.78:0/1113571557 shutdown_connections 2024-09-11T00:20:20.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.428+0000 7fd2ed369640 1 --2- 172.21.15.78:0/1113571557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2e810d0e0 0x7fd2e810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.428+0000 7fd2ed369640 1 --2- 172.21.15.78:0/1113571557 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2e8104530 0x7fd2e810cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.428+0000 7fd2ed369640 1 --2- 172.21.15.78:0/1113571557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2e8103b30 0x7fd2e8103f10 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.428+0000 7fd2ed369640 1 -- 172.21.15.78:0/1113571557 >> 172.21.15.78:0/1113571557 conn(0x7fd2e80fd700 msgr2=0x7fd2e80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:20.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.428+0000 7fd2ed369640 1 -- 172.21.15.78:0/1113571557 shutdown_connections 2024-09-11T00:20:20.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.428+0000 7fd2ed369640 1 -- 172.21.15.78:0/1113571557 wait complete. 2024-09-11T00:20:20.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.429+0000 7fd2ed369640 1 Processor -- start 2024-09-11T00:20:20.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.429+0000 7fd2ed369640 1 -- start start 2024-09-11T00:20:20.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.429+0000 7fd2ed369640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2e8103b30 0x7fd2e81019b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:20.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.429+0000 7fd2ed369640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2e8104530 0x7fd2e8101ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:20.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.429+0000 7fd2ed369640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2e810d0e0 0x7fd2e8102430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:20.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.429+0000 7fd2ed369640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e8112d60 con 0x7fd2e8103b30 2024-09-11T00:20:20.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.429+0000 7fd2ed369640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e8112be0 con 0x7fd2e810d0e0 2024-09-11T00:20:20.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.429+0000 7fd2ed369640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e8112ee0 con 0x7fd2e8104530 2024-09-11T00:20:20.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.429+0000 7fd2e6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2e8103b30 0x7fd2e81019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:20.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.430+0000 7fd2e6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2e8103b30 0x7fd2e81019b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52108/0 (socket says 172.21.15.78:52108) 2024-09-11T00:20:20.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.430+0000 7fd2e6ffd640 1 -- 172.21.15.78:0/1042294549 learned_addr learned my addr 172.21.15.78:0/1042294549 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:20.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.430+0000 7fd2e77fe640 1 --2- 172.21.15.78:0/1042294549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2e810d0e0 0x7fd2e8102430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:20.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.430+0000 7fd2e67fc640 1 --2- 172.21.15.78:0/1042294549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2e8104530 0x7fd2e8101ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:20.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.430+0000 7fd2e6ffd640 1 -- 172.21.15.78:0/1042294549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2e8104530 msgr2=0x7fd2e8101ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:20.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.430+0000 7fd2e6ffd640 1 --2- 172.21.15.78:0/1042294549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2e8104530 0x7fd2e8101ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.430+0000 7fd2e6ffd640 1 -- 172.21.15.78:0/1042294549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2e810d0e0 msgr2=0x7fd2e8102430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:20.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.430+0000 7fd2e6ffd640 1 --2- 172.21.15.78:0/1042294549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2e810d0e0 0x7fd2e8102430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.430+0000 7fd2e6ffd640 1 -- 172.21.15.78:0/1042294549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e81a76d0 con 0x7fd2e8103b30 2024-09-11T00:20:20.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.430+0000 7fd2e6ffd640 1 --2- 172.21.15.78:0/1042294549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2e8103b30 0x7fd2e81019b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8006010 tx=0x7fd2d80319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:20.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.430+0000 7fd2dffff640 1 -- 172.21.15.78:0/1042294549 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8003bf0 con 0x7fd2e8103b30 2024-09-11T00:20:20.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.430+0000 7fd2dffff640 1 -- 172.21.15.78:0/1042294549 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2d8003d90 con 0x7fd2e8103b30 2024-09-11T00:20:20.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.430+0000 7fd2dffff640 1 -- 172.21.15.78:0/1042294549 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d802fc20 con 0x7fd2e8103b30 2024-09-11T00:20:20.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.430+0000 7fd2ed369640 1 -- 172.21.15.78:0/1042294549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e81a7960 con 0x7fd2e8103b30 2024-09-11T00:20:20.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.430+0000 7fd2ed369640 1 -- 172.21.15.78:0/1042294549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e81a7ef0 con 0x7fd2e8103b30 2024-09-11T00:20:20.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.433+0000 7fd2dffff640 1 -- 172.21.15.78:0/1042294549 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fd2d80046a0 con 0x7fd2e8103b30 2024-09-11T00:20:20.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.433+0000 7fd2ef73e740 1 Processor -- start 2024-09-11T00:20:20.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.433+0000 7fd2ef73e740 1 -- start start 2024-09-11T00:20:20.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.433+0000 7fd2ef73e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55667bf3f480 0x55667bf3f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:20.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.433+0000 7fd2ef73e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf3fda0 0x55667bf4b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:20.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.433+0000 7fd2ef73e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55667bf4bd30 0x55667bf4e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:20.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.433+0000 7fd2ef73e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55667beb5e50 con 0x55667bf3fda0 2024-09-11T00:20:20.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.433+0000 7fd2ef73e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55667bea5280 con 0x55667bf3f480 2024-09-11T00:20:20.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.433+0000 7fd2ef73e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55667bea9090 con 0x55667bf4bd30 2024-09-11T00:20:20.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.434+0000 7fd2e6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf3fda0 0x55667bf4b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:20.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.434+0000 7fd2e6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf3fda0 0x55667bf4b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52112/0 (socket says 172.21.15.78:52112) 2024-09-11T00:20:20.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.434+0000 7fd2e6ffd640 1 -- 172.21.15.78:0/2117669253 learned_addr learned my addr 172.21.15.78:0/2117669253 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:20.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.434+0000 7fd2e77fe640 1 --2- 172.21.15.78:0/2117669253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55667bf3f480 0x55667bf3f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:20.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.434+0000 7fd2e67fc640 1 --2- 172.21.15.78:0/2117669253 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55667bf4bd30 0x55667bf4e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:20.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.434+0000 7fd2e6ffd640 1 -- 172.21.15.78:0/2117669253 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55667bf4bd30 msgr2=0x55667bf4e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:20.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.434+0000 7fd2e6ffd640 1 --2- 172.21.15.78:0/2117669253 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55667bf4bd30 0x55667bf4e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.434+0000 7fd2e6ffd640 1 -- 172.21.15.78:0/2117669253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55667bf3f480 msgr2=0x55667bf3f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:20.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.434+0000 7fd2e6ffd640 1 --2- 172.21.15.78:0/2117669253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55667bf3f480 0x55667bf3f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.434+0000 7fd2e6ffd640 1 -- 172.21.15.78:0/2117669253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55667bc03650 con 0x55667bf3fda0 2024-09-11T00:20:20.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.434+0000 7fd2e77fe640 1 --2- 172.21.15.78:0/2117669253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55667bf3f480 0x55667bf3f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:20:20.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.434+0000 7fd2dffff640 1 --2- 172.21.15.78:0/1042294549 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd2d40b54d0 0x7fd2d40b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:20.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.434+0000 7fd2e6ffd640 1 --2- 172.21.15.78:0/2117669253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf3fda0 0x55667bf4b7f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8104980 tx=0x7fd2d810f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1866a1f192b4d3f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:20.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.434+0000 7fd2e77fe640 1 --2- 172.21.15.78:0/1042294549 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd2d40b54d0 0x7fd2d40b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:20.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.434+0000 7fd2dd7fa640 1 -- 172.21.15.78:0/2117669253 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d80c9d90 con 0x55667bf3fda0 2024-09-11T00:20:20.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.434+0000 7fd2dffff640 1 -- 172.21.15.78:0/1042294549 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fd2d81072a0 con 0x7fd2e8103b30 2024-09-11T00:20:20.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.434+0000 7fd2dd7fa640 1 -- 172.21.15.78:0/2117669253 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2d80cd250 con 0x55667bf3fda0 2024-09-11T00:20:20.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.434+0000 7fd2dd7fa640 1 -- 172.21.15.78:0/2117669253 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d80b25e0 con 0x55667bf3fda0 2024-09-11T00:20:20.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.435+0000 7fd2ef73e740 1 -- 172.21.15.78:0/2117669253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf3fda0 msgr2=0x55667bf4b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:20.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.435+0000 7fd2e77fe640 1 --2- 172.21.15.78:0/1042294549 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd2d40b54d0 0x7fd2d40b7990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8103a70 tx=0x7fd2e000b2e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:20.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.435+0000 7fd2ef73e740 1 --2- 172.21.15.78:0/2117669253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf3fda0 0x55667bf4b7f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8104980 tx=0x7fd2d810f430 comp rx=0 tx=0).stop 2024-09-11T00:20:20.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.435+0000 7fd2ef73e740 1 -- 172.21.15.78:0/2117669253 shutdown_connections 2024-09-11T00:20:20.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.435+0000 7fd2ef73e740 1 --2- 172.21.15.78:0/2117669253 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55667bf4bd30 0x55667bf4e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.435+0000 7fd2ef73e740 1 --2- 172.21.15.78:0/2117669253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf3fda0 0x55667bf4b7f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.435+0000 7fd2ef73e740 1 --2- 172.21.15.78:0/2117669253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55667bf3f480 0x55667bf3f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.435+0000 7fd2ef73e740 1 -- 172.21.15.78:0/2117669253 >> 172.21.15.78:0/2117669253 conn(0x55667bf3d2b0 msgr2=0x55667bf3e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:20.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.435+0000 7fd2ef73e740 1 -- 172.21.15.78:0/2117669253 shutdown_connections 2024-09-11T00:20:20.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.435+0000 7fd2ef73e740 1 -- 172.21.15.78:0/2117669253 wait complete. 2024-09-11T00:20:20.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.436+0000 7fd2ef73e740 1 -- start start 2024-09-11T00:20:20.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.436+0000 7fd2ef73e740 1 Processor -- start 2024-09-11T00:20:20.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.436+0000 7fd2ef73e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55667bf3f480 0x55667bf4b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:20.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.436+0000 7fd2ef73e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf3fda0 0x55667bf48a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:20.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.436+0000 7fd2ef73e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55667bf4bd30 0x55667bf49090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:20.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.436+0000 7fd2ef73e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55667bd06700 con 0x55667bf3fda0 2024-09-11T00:20:20.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.436+0000 7fd2ef73e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55667be40110 con 0x55667bf3f480 2024-09-11T00:20:20.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.436+0000 7fd2ef73e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55667beb5e50 con 0x55667bf4bd30 2024-09-11T00:20:20.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.436+0000 7fd2ef73e740 10 client.0 _ll_register_callbacks cb 0x55667be59990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:20:20.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.436+0000 7fd2e67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf3fda0 0x55667bf48a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:20.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.436+0000 7fd2e67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf3fda0 0x55667bf48a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52118/0 (socket says 172.21.15.78:52118) 2024-09-11T00:20:20.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.436+0000 7fd2e67fc640 1 -- 172.21.15.78:0/1893007918 learned_addr learned my addr 172.21.15.78:0/1893007918 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:20.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.436+0000 7fd2e77fe640 1 --2- 172.21.15.78:0/1893007918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55667bf4bd30 0x55667bf49090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:20.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.436+0000 7fd2e6ffd640 1 --2- 172.21.15.78:0/1893007918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55667bf3f480 0x55667bf4b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:20.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.436+0000 7fd2e67fc640 1 -- 172.21.15.78:0/1893007918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55667bf4bd30 msgr2=0x55667bf49090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:20.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.436+0000 7fd2e67fc640 1 --2- 172.21.15.78:0/1893007918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55667bf4bd30 0x55667bf49090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.436+0000 7fd2e67fc640 1 -- 172.21.15.78:0/1893007918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55667bf3f480 msgr2=0x55667bf4b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:20.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.436+0000 7fd2e67fc640 1 --2- 172.21.15.78:0/1893007918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55667bf3f480 0x55667bf4b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.436+0000 7fd2e67fc640 1 -- 172.21.15.78:0/1893007918 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55667be6dc40 con 0x55667bf3fda0 2024-09-11T00:20:20.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.436+0000 7fd2e77fe640 1 --2- 172.21.15.78:0/1893007918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55667bf4bd30 0x55667bf49090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:20.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.437+0000 7fd2e67fc640 1 --2- 172.21.15.78:0/1893007918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf3fda0 0x55667bf48a60 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000bed0 tx=0x7fd2d00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f96a586f855782 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:20.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.437+0000 7fd2ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:20:20.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.437+0000 7fd2ce7fc640 1 -- 172.21.15.78:0/1893007918 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0004220 con 0x55667bf3fda0 2024-09-11T00:20:20.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.437+0000 7fd2ce7fc640 1 -- 172.21.15.78:0/1893007918 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fd2d00043c0 con 0x55667bf3fda0 2024-09-11T00:20:20.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.437+0000 7fd2ef73e740 1 -- 172.21.15.78:0/1893007918 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2d80cd250 con 0x55667bf3fda0 2024-09-11T00:20:20.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.437+0000 7fd2ce7fc640 1 -- 172.21.15.78:0/1893007918 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd2d00035f0 con 0x55667bf3fda0 2024-09-11T00:20:20.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.437+0000 7fd2ef73e740 10 client.15876 fetch_fsmap learned FSMap version 20 2024-09-11T00:20:20.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.437+0000 7fd2ef73e740 1 -- 172.21.15.78:0/1893007918 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55667bf59f30 con 0x55667bf3fda0 2024-09-11T00:20:20.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.437+0000 7fd2ce7fc640 1 -- 172.21.15.78:0/1893007918 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2d80cd250 con 0x55667bf3fda0 2024-09-11T00:20:20.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.437+0000 7fd2ce7fc640 1 -- 172.21.15.78:0/1893007918 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd2d0022020 con 0x55667bf3fda0 2024-09-11T00:20:20.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.437+0000 7fd2ef73e740 10 client.15876 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:20:20.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.437+0000 7fd2ef73e740 10 client.15876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:20:20.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.437+0000 7fd2ef73e740 20 client.15876 populate_metadata read hostname 'smithi078' 2024-09-11T00:20:20.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.437+0000 7fd2ef73e740 1 --2- 172.21.15.78:0/1893007918 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55667bf5b390 0x55667bf5d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:20.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.437+0000 7fd2ef73e740 4 client.15876 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:20:20.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.437+0000 7fd2ef73e740 1 -- 172.21.15.78:0/1893007918 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55667beb7da0 con 0x55667bf5b390 2024-09-11T00:20:20.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.438+0000 7fd2e6ffd640 1 --2- 172.21.15.78:0/1893007918 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55667bf5b390 0x55667bf5d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:20.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.438+0000 7fd2ce7fc640 10 client.15876 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:20.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.438+0000 7fd2e6ffd640 1 --2- 172.21.15.78:0/1893007918 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55667bf5b390 0x55667bf5d780 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f68092930c3f8e6 server_cookie=38ac48918af02bfd in_seq=0 out_seq=0 2024-09-11T00:20:20.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.439+0000 7fd2ce7fc640 1 -- 172.21.15.78:0/1893007918 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55667beb7da0 con 0x55667bf5b390 2024-09-11T00:20:20.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.439+0000 7fd2ce7fc640 10 client.15876 handle_command_reply: tid=0 2024-09-11T00:20:20.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.439+0000 7fd2ef73e740 1 client.15876 shutdown 2024-09-11T00:20:20.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.439+0000 7fd2ef73e740 1 -- 172.21.15.78:0/1893007918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf3fda0 msgr2=0x55667bf48a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:20.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.439+0000 7fd2ef73e740 1 --2- 172.21.15.78:0/1893007918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf3fda0 0x55667bf48a60 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000bed0 tx=0x7fd2d00117b0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.439+0000 7fd2ef73e740 1 -- 172.21.15.78:0/1893007918 shutdown_connections 2024-09-11T00:20:20.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.439+0000 7fd2ef73e740 1 --2- 172.21.15.78:0/1893007918 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55667bf5b390 0x55667bf5d780 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.439+0000 7fd2ef73e740 1 --2- 172.21.15.78:0/1893007918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55667bf4bd30 0x55667bf49090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.439+0000 7fd2ef73e740 1 --2- 172.21.15.78:0/1893007918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf3fda0 0x55667bf48a60 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.439+0000 7fd2ce7fc640 0 client.15876 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:20.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.439+0000 7fd2ef73e740 1 --2- 172.21.15.78:0/1893007918 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55667bf3f480 0x55667bf4b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.439+0000 7fd2ef73e740 1 -- 172.21.15.78:0/1893007918 >> 172.21.15.78:0/1893007918 conn(0x55667bf3d2b0 msgr2=0x55667bf42e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:20.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.439+0000 7fd2ef73e740 1 -- 172.21.15.78:0/1893007918 shutdown_connections 2024-09-11T00:20:20.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.439+0000 7fd2ef73e740 1 -- 172.21.15.78:0/1893007918 wait complete. 2024-09-11T00:20:20.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.439+0000 7fd2ef73e740 20 client.15876 trim_cache size 0 max 16384 2024-09-11T00:20:20.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.456+0000 7fd2ef73e740 1 Processor -- start 2024-09-11T00:20:20.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.456+0000 7fd2ef73e740 1 -- start start 2024-09-11T00:20:20.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.456+0000 7fd2ef73e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55667bf3f480 0x55667bf3e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:20.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.456+0000 7fd2ef73e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf3fda0 0x55667bf382d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:20.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.456+0000 7fd2ef73e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55667bf4bd30 0x55667bf4d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:20.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.456+0000 7fd2ef73e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e81ae910 con 0x55667bf3fda0 2024-09-11T00:20:20.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.456+0000 7fd2ef73e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e81b1190 con 0x55667bf3f480 2024-09-11T00:20:20.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.456+0000 7fd2ef73e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e81aef80 con 0x55667bf4bd30 2024-09-11T00:20:20.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.457+0000 7fd2e67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf3fda0 0x55667bf382d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:20.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.457+0000 7fd2e67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf3fda0 0x55667bf382d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52128/0 (socket says 172.21.15.78:52128) 2024-09-11T00:20:20.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.457+0000 7fd2e67fc640 1 -- 172.21.15.78:0/568024695 learned_addr learned my addr 172.21.15.78:0/568024695 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:20.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.457+0000 7fd2e6ffd640 1 --2- 172.21.15.78:0/568024695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55667bf3f480 0x55667bf3e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:20.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.457+0000 7fd2e77fe640 1 --2- 172.21.15.78:0/568024695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55667bf4bd30 0x55667bf4d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:20.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.457+0000 7fd2e67fc640 1 -- 172.21.15.78:0/568024695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55667bf4bd30 msgr2=0x55667bf4d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:20.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.457+0000 7fd2e67fc640 1 --2- 172.21.15.78:0/568024695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55667bf4bd30 0x55667bf4d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.457+0000 7fd2e67fc640 1 -- 172.21.15.78:0/568024695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55667bf3f480 msgr2=0x55667bf3e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:20.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.457+0000 7fd2e67fc640 1 --2- 172.21.15.78:0/568024695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55667bf3f480 0x55667bf3e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.457+0000 7fd2e67fc640 1 -- 172.21.15.78:0/568024695 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55667bf479c0 con 0x55667bf3fda0 2024-09-11T00:20:20.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.457+0000 7fd2e77fe640 1 --2- 172.21.15.78:0/568024695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55667bf4bd30 0x55667bf4d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:20:20.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.457+0000 7fd2e67fc640 1 --2- 172.21.15.78:0/568024695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf3fda0 0x55667bf382d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000b690 tx=0x7fd2d000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934d91a945f83a23 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:20.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.457+0000 7fd2dcff9640 1 -- 172.21.15.78:0/568024695 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0033070 con 0x55667bf3fda0 2024-09-11T00:20:20.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.457+0000 7fd2dcff9640 1 -- 172.21.15.78:0/568024695 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2d001bdd0 con 0x55667bf3fda0 2024-09-11T00:20:20.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.457+0000 7fd2dcff9640 1 -- 172.21.15.78:0/568024695 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d002a040 con 0x55667bf3fda0 2024-09-11T00:20:20.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.458+0000 7fd2ef73e740 1 -- 172.21.15.78:0/568024695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf3fda0 msgr2=0x55667bf382d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:20.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.458+0000 7fd2ef73e740 1 --2- 172.21.15.78:0/568024695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf3fda0 0x55667bf382d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000b690 tx=0x7fd2d000b6c0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.458+0000 7fd2ef73e740 1 -- 172.21.15.78:0/568024695 shutdown_connections 2024-09-11T00:20:20.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.458+0000 7fd2ef73e740 1 --2- 172.21.15.78:0/568024695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55667bf4bd30 0x55667bf4d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.458+0000 7fd2ef73e740 1 --2- 172.21.15.78:0/568024695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf3fda0 0x55667bf382d0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.458+0000 7fd2ef73e740 1 --2- 172.21.15.78:0/568024695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55667bf3f480 0x55667bf3e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.458+0000 7fd2ef73e740 1 -- 172.21.15.78:0/568024695 >> 172.21.15.78:0/568024695 conn(0x55667bf3d2b0 msgr2=0x55667bf3e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:20.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.458+0000 7fd2ef73e740 1 -- 172.21.15.78:0/568024695 shutdown_connections 2024-09-11T00:20:20.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.458+0000 7fd2ef73e740 1 -- 172.21.15.78:0/568024695 wait complete. 2024-09-11T00:20:20.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.458+0000 7fd2ef73e740 1 -- start start 2024-09-11T00:20:20.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.459+0000 7fd2ef73e740 1 Processor -- start 2024-09-11T00:20:20.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.459+0000 7fd2ef73e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55667bf3f480 0x55667bf54110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:20.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.459+0000 7fd2ef73e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55667bf3fda0 0x55667bf4e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:20.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.459+0000 7fd2ef73e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf4bd30 0x55667bf4ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:20.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.459+0000 7fd2ef73e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e81af650 con 0x55667bf4bd30 2024-09-11T00:20:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.459+0000 7fd2ef73e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e81b0ac0 con 0x55667bf3f480 2024-09-11T00:20:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.459+0000 7fd2ef73e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e81afd20 con 0x55667bf3fda0 2024-09-11T00:20:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.459+0000 7fd2ef73e740 10 client.0 _ll_register_callbacks cb 0x7fd2d000b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:20:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.459+0000 7fd2e77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf4bd30 0x55667bf4ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.459+0000 7fd2e77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf4bd30 0x55667bf4ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52138/0 (socket says 172.21.15.78:52138) 2024-09-11T00:20:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.459+0000 7fd2e77fe640 1 -- 172.21.15.78:0/2597097234 learned_addr learned my addr 172.21.15.78:0/2597097234 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.459+0000 7fd2e67fc640 1 --2- 172.21.15.78:0/2597097234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55667bf3fda0 0x55667bf4e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.459+0000 7fd2e6ffd640 1 --2- 172.21.15.78:0/2597097234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55667bf3f480 0x55667bf54110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.459+0000 7fd2e77fe640 1 -- 172.21.15.78:0/2597097234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55667bf3fda0 msgr2=0x55667bf4e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.459+0000 7fd2e77fe640 1 --2- 172.21.15.78:0/2597097234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55667bf3fda0 0x55667bf4e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.459+0000 7fd2e77fe640 1 -- 172.21.15.78:0/2597097234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55667bf3f480 msgr2=0x55667bf54110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.459+0000 7fd2e77fe640 1 --2- 172.21.15.78:0/2597097234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55667bf3f480 0x55667bf54110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.459+0000 7fd2e77fe640 1 -- 172.21.15.78:0/2597097234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55667bfc8250 con 0x55667bf4bd30 2024-09-11T00:20:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.459+0000 7fd2e6ffd640 1 --2- 172.21.15.78:0/2597097234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55667bf3f480 0x55667bf54110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:20.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.459+0000 7fd2e77fe640 1 --2- 172.21.15.78:0/2597097234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf4bd30 0x55667bf4ee60 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0005d00 tx=0x7fd2e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a72753e87150f35b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:20.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.459+0000 7fd2ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:20:20.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.460+0000 7fd2ce7fc640 1 -- 172.21.15.78:0/2597097234 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e002b060 con 0x55667bf4bd30 2024-09-11T00:20:20.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.460+0000 7fd2ce7fc640 1 -- 172.21.15.78:0/2597097234 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fd2e0012860 con 0x55667bf4bd30 2024-09-11T00:20:20.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.460+0000 7fd2ef73e740 1 -- 172.21.15.78:0/2597097234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2d001bdd0 con 0x55667bf4bd30 2024-09-11T00:20:20.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.460+0000 7fd2ce7fc640 1 -- 172.21.15.78:0/2597097234 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd2e001ce60 con 0x55667bf4bd30 2024-09-11T00:20:20.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.460+0000 7fd2ef73e740 10 client.15882 fetch_fsmap learned FSMap version 20 2024-09-11T00:20:20.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.460+0000 7fd2ef73e740 1 -- 172.21.15.78:0/2597097234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55667bfc93e0 con 0x55667bf4bd30 2024-09-11T00:20:20.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.460+0000 7fd2ce7fc640 1 -- 172.21.15.78:0/2597097234 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2d001bdd0 con 0x55667bf4bd30 2024-09-11T00:20:20.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.460+0000 7fd2ce7fc640 1 -- 172.21.15.78:0/2597097234 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd2e0019040 con 0x55667bf4bd30 2024-09-11T00:20:20.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.460+0000 7fd2ef73e740 10 client.15882 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:20:20.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.460+0000 7fd2ef73e740 10 client.15882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:20:20.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.460+0000 7fd2ef73e740 20 client.15882 populate_metadata read hostname 'smithi078' 2024-09-11T00:20:20.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.460+0000 7fd2ef73e740 1 --2- 172.21.15.78:0/2597097234 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55667bfc9bc0 0x55667bfcbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:20.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.460+0000 7fd2ef73e740 4 client.15882 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:20:20.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.460+0000 7fd2ef73e740 1 -- 172.21.15.78:0/2597097234 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55667beb3850 con 0x55667bfc9bc0 2024-09-11T00:20:20.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.460+0000 7fd2e6ffd640 1 --2- 172.21.15.78:0/2597097234 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55667bfc9bc0 0x55667bfcbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:20.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.461+0000 7fd2e6ffd640 1 --2- 172.21.15.78:0/2597097234 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55667bfc9bc0 0x55667bfcbfe0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccea982047abbbee server_cookie=3e2587faab6f829a in_seq=0 out_seq=0 2024-09-11T00:20:20.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.461+0000 7fd2ce7fc640 10 client.15882 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:20.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.461+0000 7fd2ce7fc640 1 -- 172.21.15.78:0/2597097234 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x55667beb3850 con 0x55667bfc9bc0 2024-09-11T00:20:20.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.461+0000 7fd2ce7fc640 10 client.15882 handle_command_reply: tid=0 2024-09-11T00:20:20.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.461+0000 7fd2ef73e740 1 client.15882 shutdown 2024-09-11T00:20:20.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.461+0000 7fd2ef73e740 1 -- 172.21.15.78:0/2597097234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf4bd30 msgr2=0x55667bf4ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:20.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.461+0000 7fd2ef73e740 1 --2- 172.21.15.78:0/2597097234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf4bd30 0x55667bf4ee60 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0005d00 tx=0x7fd2e00046c0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.461+0000 7fd2ef73e740 1 -- 172.21.15.78:0/2597097234 shutdown_connections 2024-09-11T00:20:20.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.461+0000 7fd2ef73e740 1 --2- 172.21.15.78:0/2597097234 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55667bfc9bc0 0x55667bfcbfe0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.461+0000 7fd2ef73e740 1 --2- 172.21.15.78:0/2597097234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55667bf4bd30 0x55667bf4ee60 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.461+0000 7fd2ef73e740 1 --2- 172.21.15.78:0/2597097234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55667bf3fda0 0x55667bf4e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.461+0000 7fd2ce7fc640 0 client.15882 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:20.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.461+0000 7fd2ef73e740 1 --2- 172.21.15.78:0/2597097234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55667bf3f480 0x55667bf54110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.461+0000 7fd2ef73e740 1 -- 172.21.15.78:0/2597097234 >> 172.21.15.78:0/2597097234 conn(0x55667bf3d2b0 msgr2=0x55667bf4a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:20.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.461+0000 7fd2ef73e740 1 -- 172.21.15.78:0/2597097234 shutdown_connections 2024-09-11T00:20:20.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.461+0000 7fd2ef73e740 1 -- 172.21.15.78:0/2597097234 wait complete. 2024-09-11T00:20:20.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.461+0000 7fd2ef73e740 20 client.15882 trim_cache size 0 max 16384 2024-09-11T00:20:20.469 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:20:20.469 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:20:20.469 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-11T00:20:20.469 INFO:teuthology.orchestra.run.smithi078.stdout: "8ec9e858-aa62-420d-a112-e62ea7810e63": { 2024-09-11T00:20:20.469 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:20.469 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "8ec9e858-aa62-420d-a112-e62ea7810e63", 2024-09-11T00:20:20.470 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-11T00:20:20.470 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:20:20.470 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:20.470 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:20:20.470 INFO:teuthology.orchestra.run.smithi078.stdout: "8ec9e858-aa62-420d-a112-e62ea7810e63": { 2024-09-11T00:20:20.470 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:18.882749+0000", 2024-09-11T00:20:20.470 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:20.470 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:20.470 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:20.470 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:20.470 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:20.470 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:20.470 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:20:20.470 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:20:20.470 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:20.471 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:20.471 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:20.471 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:20.471 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:20.471 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:20.471 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:20:20.471 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:20:20.471 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:20.471 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:20.471 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:20.471 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:20.471 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:20.471 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:20.471 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:20:20.472 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:20:20.472 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:20.472 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:20.472 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:20.472 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:20.472 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:20.472 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:20.472 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:20:20.472 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:20:20.472 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:20.472 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:20.472 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:20.472 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:20.472 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:20.473 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:20.473 INFO:teuthology.orchestra.run.smithi078.stdout: "b854cbd3-8ca7-4277-a205-8887d2ff5567": { 2024-09-11T00:20:20.473 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:11.182949+0000", 2024-09-11T00:20:20.473 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:20.473 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:20.473 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:20.473 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:20.473 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:20.473 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:20.473 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:20:20.473 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:20:20.473 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:20.473 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:20.473 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:20.473 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:20.474 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:20.474 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:20.474 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:20:20.474 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:20:20.474 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:20.474 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:20.474 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:20.474 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:20.474 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:20.474 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:20:20.474 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:20:20.474 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:20:20.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.462+0000 7fd2ed369640 1 -- 172.21.15.78:0/1042294549 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd2d40b54d0 msgr2=0x7fd2d40b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:20.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.462+0000 7fd2ed369640 1 --2- 172.21.15.78:0/1042294549 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd2d40b54d0 0x7fd2d40b7990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8103a70 tx=0x7fd2e000b2e0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.462+0000 7fd2ed369640 1 -- 172.21.15.78:0/1042294549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2e8103b30 msgr2=0x7fd2e81019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:20.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.462+0000 7fd2ed369640 1 --2- 172.21.15.78:0/1042294549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2e8103b30 0x7fd2e81019b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8006010 tx=0x7fd2d80319f0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.462+0000 7fd2ed369640 1 -- 172.21.15.78:0/1042294549 shutdown_connections 2024-09-11T00:20:20.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.462+0000 7fd2ed369640 1 --2- 172.21.15.78:0/1042294549 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd2d40b54d0 0x7fd2d40b7990 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.462+0000 7fd2ed369640 1 --2- 172.21.15.78:0/1042294549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2e810d0e0 0x7fd2e8102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.462+0000 7fd2ed369640 1 --2- 172.21.15.78:0/1042294549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2e8104530 0x7fd2e8101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.462+0000 7fd2ed369640 1 --2- 172.21.15.78:0/1042294549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2e8103b30 0x7fd2e81019b0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:20.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.462+0000 7fd2ed369640 1 -- 172.21.15.78:0/1042294549 >> 172.21.15.78:0/1042294549 conn(0x7fd2e80fd700 msgr2=0x7fd2e80fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:20.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.462+0000 7fd2ed369640 1 -- 172.21.15.78:0/1042294549 shutdown_connections 2024-09-11T00:20:20.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:20.462+0000 7fd2ed369640 1 -- 172.21.15.78:0/1042294549 wait complete. 2024-09-11T00:20:21.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:20 smithi078 ceph-mon[30865]: pgmap v439: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-11T00:20:21.178 INFO:tasks.cephfs.filesystem:scrub status for tag:8ec9e858-aa62-420d-a112-e62ea7810e63 - {'path': '/', 'tag': '8ec9e858-aa62-420d-a112-e62ea7810e63', 'options': 'recursive,force'} 2024-09-11T00:20:21.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:20 smithi112 ceph-mon[35627]: pgmap v439: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-11T00:20:21.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:20 smithi138 ceph-mon[35019]: pgmap v439: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-11T00:20:22.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:21 smithi078 ceph-mon[30865]: scrub summary: idle 2024-09-11T00:20:22.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:21 smithi078 ceph-mon[30865]: pgmap v440: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-11T00:20:22.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:21 smithi112 ceph-mon[35627]: scrub summary: idle 2024-09-11T00:20:22.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:21 smithi112 ceph-mon[35627]: pgmap v440: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-11T00:20:22.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:21 smithi138 ceph-mon[35019]: scrub summary: idle 2024-09-11T00:20:22.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:21 smithi138 ceph-mon[35019]: pgmap v440: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-11T00:20:25.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:24 smithi078 ceph-mon[30865]: pgmap v441: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T00:20:25.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:24 smithi112 ceph-mon[35627]: pgmap v441: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T00:20:25.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:24 smithi138 ceph-mon[35019]: pgmap v441: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T00:20:26.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:25 smithi112 ceph-mon[35627]: pgmap v442: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-11T00:20:26.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:25 smithi138 ceph-mon[35019]: pgmap v442: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-11T00:20:26.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:25 smithi078 ceph-mon[30865]: pgmap v442: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-11T00:20:29.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:28 smithi078 ceph-mon[30865]: pgmap v443: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-11T00:20:29.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:28 smithi112 ceph-mon[35627]: pgmap v443: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-11T00:20:29.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:28 smithi138 ceph-mon[35019]: pgmap v443: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-11T00:20:30.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:29 smithi112 ceph-mon[35627]: pgmap v444: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:20:30.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:29 smithi138 ceph-mon[35019]: pgmap v444: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:20:30.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:29 smithi078 ceph-mon[30865]: pgmap v444: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:20:33.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:32 smithi078 ceph-mon[30865]: pgmap v445: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:20:33.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:32 smithi112 ceph-mon[35627]: pgmap v445: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:20:33.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:32 smithi138 ceph-mon[35019]: pgmap v445: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:20:34.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:33 smithi112 ceph-mon[35627]: pgmap v446: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:34.277 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:33 smithi078 ceph-mon[30865]: pgmap v446: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:34.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:33 smithi138 ceph-mon[35019]: pgmap v446: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:37.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:36 smithi078 ceph-mon[30865]: pgmap v447: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:20:37.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:36 smithi112 ceph-mon[35627]: pgmap v447: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:20:37.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:36 smithi138 ceph-mon[35019]: pgmap v447: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:20:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:37 smithi112 ceph-mon[35627]: pgmap v448: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:38.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:37 smithi138 ceph-mon[35019]: pgmap v448: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:38.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:37 smithi078 ceph-mon[30865]: pgmap v448: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:39.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:38 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:20:39.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:38 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:20:39.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:38 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:20:40.194 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:39 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:20:40.194 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:39 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:20:40.194 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:39 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:20:40.194 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:39 smithi138 ceph-mon[35019]: pgmap v449: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:40.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:39 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:20:40.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:39 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:20:40.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:39 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:20:40.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:39 smithi112 ceph-mon[35627]: pgmap v449: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:40.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:39 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:20:40.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:39 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:20:40.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:39 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:20:40.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:39 smithi078 ceph-mon[30865]: pgmap v449: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:43.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:42 smithi078 ceph-mon[30865]: pgmap v450: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:20:43.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:42 smithi112 ceph-mon[35627]: pgmap v450: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:20:43.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:42 smithi138 ceph-mon[35019]: pgmap v450: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:20:44.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:43 smithi078 ceph-mon[30865]: pgmap v451: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:44.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:43 smithi112 ceph-mon[35627]: pgmap v451: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:44.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:43 smithi138 ceph-mon[35019]: pgmap v451: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:46.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:45 smithi112 ceph-mon[35627]: pgmap v452: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:20:46.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:45 smithi138 ceph-mon[35019]: pgmap v452: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:20:46.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:45 smithi078 ceph-mon[30865]: pgmap v452: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:20:48.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:47 smithi112 ceph-mon[35627]: pgmap v453: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:48.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:47 smithi138 ceph-mon[35019]: pgmap v453: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:48.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:47 smithi078 ceph-mon[30865]: pgmap v453: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:50.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:49 smithi112 ceph-mon[35627]: pgmap v454: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:50.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:49 smithi138 ceph-mon[35019]: pgmap v454: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:50.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:49 smithi078 ceph-mon[30865]: pgmap v454: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:51.178 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:20:51.436 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:20:52.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.961+0000 7f184be7e640 1 -- 172.21.15.78:0/1145497343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1844108020 msgr2=0x7f184410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:52.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.961+0000 7f184be7e640 1 --2- 172.21.15.78:0/1145497343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1844108020 0x7f184410e820 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f183c009ca0 tx=0x7f183c02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.961+0000 7f184be7e640 1 -- 172.21.15.78:0/1145497343 shutdown_connections 2024-09-11T00:20:52.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.961+0000 7f184be7e640 1 --2- 172.21.15.78:0/1145497343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1844108020 0x7f184410e820 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.961+0000 7f184be7e640 1 --2- 172.21.15.78:0/1145497343 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f18441076a0 0x7f1844107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.961+0000 7f184be7e640 1 --2- 172.21.15.78:0/1145497343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1844101c90 0x7f1844102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.961+0000 7f184be7e640 1 -- 172.21.15.78:0/1145497343 >> 172.21.15.78:0/1145497343 conn(0x7f18440fd700 msgr2=0x7f18440ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:52.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.961+0000 7f184be7e640 1 -- 172.21.15.78:0/1145497343 shutdown_connections 2024-09-11T00:20:52.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.961+0000 7f184be7e640 1 -- 172.21.15.78:0/1145497343 wait complete. 2024-09-11T00:20:52.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.962+0000 7f184be7e640 1 Processor -- start 2024-09-11T00:20:52.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.962+0000 7f184be7e640 1 -- start start 2024-09-11T00:20:52.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.962+0000 7f184be7e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1844101c90 0x7f1844197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:52.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.962+0000 7f184be7e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18441076a0 0x7f1844198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:52.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.962+0000 7f184be7e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1844108020 0x7f1844198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:52.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.962+0000 7f184be7e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1844111ce0 con 0x7f18441076a0 2024-09-11T00:20:52.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.962+0000 7f184be7e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1844111b60 con 0x7f1844108020 2024-09-11T00:20:52.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.962+0000 7f184be7e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1844111e60 con 0x7f1844101c90 2024-09-11T00:20:52.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.962+0000 7f1849419640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18441076a0 0x7f1844198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:52.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.962+0000 7f1849419640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18441076a0 0x7f1844198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36086/0 (socket says 172.21.15.78:36086) 2024-09-11T00:20:52.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.962+0000 7f1849419640 1 -- 172.21.15.78:0/757191957 learned_addr learned my addr 172.21.15.78:0/757191957 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:52.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.962+0000 7f1849c1a640 1 --2- 172.21.15.78:0/757191957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1844101c90 0x7f1844197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:52.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.963+0000 7f184a41b640 1 --2- 172.21.15.78:0/757191957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1844108020 0x7f1844198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:52.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.963+0000 7f1849419640 1 -- 172.21.15.78:0/757191957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1844101c90 msgr2=0x7f1844197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:52.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.963+0000 7f1849419640 1 --2- 172.21.15.78:0/757191957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1844101c90 0x7f1844197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.963+0000 7f1849419640 1 -- 172.21.15.78:0/757191957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1844108020 msgr2=0x7f1844198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:52.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.963+0000 7f1849419640 1 --2- 172.21.15.78:0/757191957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1844108020 0x7f1844198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.963+0000 7f1849419640 1 -- 172.21.15.78:0/757191957 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18441a75a0 con 0x7f18441076a0 2024-09-11T00:20:52.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.963+0000 7f184a41b640 1 --2- 172.21.15.78:0/757191957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1844108020 0x7f1844198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:52.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.963+0000 7f1849419640 1 --2- 172.21.15.78:0/757191957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18441076a0 0x7f1844198300 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f183400c920 tx=0x7f183400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:52.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.963+0000 7f183affd640 1 -- 172.21.15.78:0/757191957 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1834007c70 con 0x7f18441076a0 2024-09-11T00:20:52.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.963+0000 7f183affd640 1 -- 172.21.15.78:0/757191957 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1834007e10 con 0x7f18441076a0 2024-09-11T00:20:52.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.963+0000 7f183affd640 1 -- 172.21.15.78:0/757191957 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1834018820 con 0x7f18441076a0 2024-09-11T00:20:52.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.963+0000 7f184be7e640 1 -- 172.21.15.78:0/757191957 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18441a7890 con 0x7f18441076a0 2024-09-11T00:20:52.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.963+0000 7f184be7e640 1 -- 172.21.15.78:0/757191957 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18441a7d80 con 0x7f18441076a0 2024-09-11T00:20:52.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.966+0000 7f184e253740 1 Processor -- start 2024-09-11T00:20:52.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.966+0000 7f184e253740 1 -- start start 2024-09-11T00:20:52.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.966+0000 7f183affd640 1 -- 172.21.15.78:0/757191957 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f183400f450 con 0x7f18441076a0 2024-09-11T00:20:52.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.966+0000 7f184e253740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b111861480 0x55b111861860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:52.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.966+0000 7f184e253740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b111861da0 0x55b11186d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:52.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.966+0000 7f184e253740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b11186dd30 0x55b111870120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:52.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.966+0000 7f184e253740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55b1117d7e50 con 0x55b11186dd30 2024-09-11T00:20:52.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.966+0000 7f184e253740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b1117c7280 con 0x55b111861da0 2024-09-11T00:20:52.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.966+0000 7f184e253740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55b1117cb090 con 0x55b111861480 2024-09-11T00:20:52.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.966+0000 7f1849419640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b11186dd30 0x55b111870120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:52.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.966+0000 7f1849419640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b11186dd30 0x55b111870120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36098/0 (socket says 172.21.15.78:36098) 2024-09-11T00:20:52.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.966+0000 7f1849419640 1 -- 172.21.15.78:0/1925893016 learned_addr learned my addr 172.21.15.78:0/1925893016 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:52.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.966+0000 7f184a41b640 1 --2- 172.21.15.78:0/1925893016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b111861480 0x55b111861860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:52.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.966+0000 7f1849c1a640 1 --2- 172.21.15.78:0/1925893016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b111861da0 0x55b11186d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:52.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.967+0000 7f1849419640 1 -- 172.21.15.78:0/1925893016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b111861480 msgr2=0x55b111861860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:52.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.967+0000 7f1849419640 1 --2- 172.21.15.78:0/1925893016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b111861480 0x55b111861860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.967+0000 7f1849419640 1 -- 172.21.15.78:0/1925893016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b111861da0 msgr2=0x55b11186d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:52.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.967+0000 7f1849419640 1 --2- 172.21.15.78:0/1925893016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b111861da0 0x55b11186d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.967+0000 7f1849419640 1 -- 172.21.15.78:0/1925893016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b111525650 con 0x55b11186dd30 2024-09-11T00:20:52.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.967+0000 7f183affd640 1 --2- 172.21.15.78:0/757191957 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f18300b54d0 0x7f18300b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:52.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.967+0000 7f1849419640 1 --2- 172.21.15.78:0/1925893016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b11186dd30 0x55b111870120 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f18340e3820 tx=0x7f18340ee540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ffaff508f4ebaa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:52.006 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:20:52.006 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-11T00:20:52.006 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {}, 2024-09-11T00:20:52.006 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:20:52.006 INFO:teuthology.orchestra.run.smithi078.stdout: "8ec9e858-aa62-420d-a112-e62ea7810e63": { 2024-09-11T00:20:52.006 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:18.882749+0000", 2024-09-11T00:20:52.006 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:52.006 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:52.006 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:52.006 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:52.007 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:52.007 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:52.007 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:20:52.007 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:20:52.007 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:52.007 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:52.007 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:52.007 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:52.007 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:52.007 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:52.007 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:20:52.007 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:20:52.007 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:52.007 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:52.008 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:52.008 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:52.008 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:52.008 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:52.008 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:20:52.008 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:20:52.008 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:52.008 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:52.008 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:52.008 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:52.008 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:52.008 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:52.008 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:20:52.009 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:20:52.009 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:52.009 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:52.009 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:52.009 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:52.009 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:52.009 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:52.009 INFO:teuthology.orchestra.run.smithi078.stdout: "b854cbd3-8ca7-4277-a205-8887d2ff5567": { 2024-09-11T00:20:52.009 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:11.182949+0000", 2024-09-11T00:20:52.009 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:52.009 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:52.009 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:52.009 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:52.009 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:52.010 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:52.010 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:20:52.010 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:20:52.010 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:52.010 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:52.010 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:52.010 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:52.010 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:52.010 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:52.010 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:20:52.010 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:20:52.010 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:52.010 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:52.010 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:52.010 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:52.011 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:52.011 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:20:52.011 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:20:52.011 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:20:52.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.967+0000 7f184a41b640 1 --2- 172.21.15.78:0/757191957 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f18300b54d0 0x7f18300b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:52.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.967+0000 7f183affd640 1 -- 172.21.15.78:0/757191957 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f18340e60a0 con 0x7f18441076a0 2024-09-11T00:20:52.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.967+0000 7f182ffff640 1 -- 172.21.15.78:0/1925893016 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18340a8c30 con 0x55b11186dd30 2024-09-11T00:20:52.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.967+0000 7f182ffff640 1 -- 172.21.15.78:0/1925893016 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18340ac0f0 con 0x55b11186dd30 2024-09-11T00:20:52.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.967+0000 7f182ffff640 1 -- 172.21.15.78:0/1925893016 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18340abd50 con 0x55b11186dd30 2024-09-11T00:20:52.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.968+0000 7f184e253740 1 -- 172.21.15.78:0/1925893016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b11186dd30 msgr2=0x55b111870120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:52.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.968+0000 7f184a41b640 1 --2- 172.21.15.78:0/757191957 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f18300b54d0 0x7f18300b7990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f183c004af0 tx=0x7f183c005d80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:52.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.968+0000 7f184e253740 1 --2- 172.21.15.78:0/1925893016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b11186dd30 0x55b111870120 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f18340e3820 tx=0x7f18340ee540 comp rx=0 tx=0).stop 2024-09-11T00:20:52.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.968+0000 7f184e253740 1 -- 172.21.15.78:0/1925893016 shutdown_connections 2024-09-11T00:20:52.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.968+0000 7f184e253740 1 --2- 172.21.15.78:0/1925893016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b11186dd30 0x55b111870120 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.968+0000 7f184e253740 1 --2- 172.21.15.78:0/1925893016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b111861da0 0x55b11186d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.968+0000 7f184e253740 1 --2- 172.21.15.78:0/1925893016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b111861480 0x55b111861860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.968+0000 7f184e253740 1 -- 172.21.15.78:0/1925893016 >> 172.21.15.78:0/1925893016 conn(0x55b11185f2b0 msgr2=0x55b111860450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:52.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.968+0000 7f184e253740 1 -- 172.21.15.78:0/1925893016 shutdown_connections 2024-09-11T00:20:52.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.968+0000 7f184e253740 1 -- 172.21.15.78:0/1925893016 wait complete. 2024-09-11T00:20:52.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.969+0000 7f184e253740 1 -- start start 2024-09-11T00:20:52.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.969+0000 7f184e253740 1 Processor -- start 2024-09-11T00:20:52.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.969+0000 7f184e253740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b111861480 0x55b11186d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:52.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.969+0000 7f184e253740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b111861da0 0x55b11186aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:52.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.969+0000 7f184e253740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b11186dd30 0x55b11186b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:52.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.969+0000 7f184e253740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55b111628700 con 0x55b111861da0 2024-09-11T00:20:52.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.969+0000 7f184e253740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b111762110 con 0x55b11186dd30 2024-09-11T00:20:52.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.969+0000 7f184e253740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55b1118709b0 con 0x55b111861480 2024-09-11T00:20:52.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.969+0000 7f184e253740 10 client.0 _ll_register_callbacks cb 0x55b11177b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:20:52.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.969+0000 7f1849419640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b111861da0 0x55b11186aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:52.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.969+0000 7f1849419640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b111861da0 0x55b11186aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36114/0 (socket says 172.21.15.78:36114) 2024-09-11T00:20:52.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.969+0000 7f1849419640 1 -- 172.21.15.78:0/2053724425 learned_addr learned my addr 172.21.15.78:0/2053724425 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:52.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.969+0000 7f1849c1a640 1 --2- 172.21.15.78:0/2053724425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b111861480 0x55b11186d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:52.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.969+0000 7f184a41b640 1 --2- 172.21.15.78:0/2053724425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b11186dd30 0x55b11186b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:52.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.969+0000 7f1849419640 1 -- 172.21.15.78:0/2053724425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b111861480 msgr2=0x55b11186d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:52.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.969+0000 7f1849419640 1 --2- 172.21.15.78:0/2053724425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b111861480 0x55b11186d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.969+0000 7f1849419640 1 -- 172.21.15.78:0/2053724425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b11186dd30 msgr2=0x55b11186b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:52.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.969+0000 7f1849419640 1 --2- 172.21.15.78:0/2053724425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b11186dd30 0x55b11186b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.970+0000 7f1849419640 1 -- 172.21.15.78:0/2053724425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b11178fc40 con 0x55b111861da0 2024-09-11T00:20:52.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.970+0000 7f1849c1a640 1 --2- 172.21.15.78:0/2053724425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b111861480 0x55b11186d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:52.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.970+0000 7f184a41b640 1 --2- 172.21.15.78:0/2053724425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b11186dd30 0x55b11186b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:52.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.970+0000 7f1849419640 1 --2- 172.21.15.78:0/2053724425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b111861da0 0x55b11186aa50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f18340ac2e0 tx=0x7f18340e9f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8493706bc8f3bd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:52.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.970+0000 7f182d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:20:52.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.970+0000 7f182d7fa640 1 -- 172.21.15.78:0/2053724425 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18340abf30 con 0x55b111861da0 2024-09-11T00:20:52.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.970+0000 7f184e253740 1 -- 172.21.15.78:0/2053724425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18340ac0f0 con 0x55b111861da0 2024-09-11T00:20:52.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.970+0000 7f182d7fa640 1 -- 172.21.15.78:0/2053724425 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f18340a8850 con 0x55b111861da0 2024-09-11T00:20:52.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.970+0000 7f182d7fa640 1 -- 172.21.15.78:0/2053724425 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f18340ac3b0 con 0x55b111861da0 2024-09-11T00:20:52.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.970+0000 7f184e253740 10 client.15894 fetch_fsmap learned FSMap version 20 2024-09-11T00:20:52.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.970+0000 7f184e253740 1 -- 172.21.15.78:0/2053724425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b11187c2c0 con 0x55b111861da0 2024-09-11T00:20:52.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.970+0000 7f182d7fa640 1 -- 172.21.15.78:0/2053724425 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18340ac0f0 con 0x55b111861da0 2024-09-11T00:20:52.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.970+0000 7f182d7fa640 1 -- 172.21.15.78:0/2053724425 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f18340a6ce0 con 0x55b111861da0 2024-09-11T00:20:52.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.970+0000 7f184e253740 10 client.15894 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:20:52.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.970+0000 7f184e253740 10 client.15894 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:20:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.970+0000 7f184e253740 20 client.15894 populate_metadata read hostname 'smithi078' 2024-09-11T00:20:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.971+0000 7f184e253740 1 --2- 172.21.15.78:0/2053724425 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b11187d610 0x55b11187fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.971+0000 7f184e253740 4 client.15894 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:20:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.971+0000 7f184e253740 1 -- 172.21.15.78:0/2053724425 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1117d9da0 con 0x55b11187d610 2024-09-11T00:20:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.971+0000 7f1849c1a640 1 --2- 172.21.15.78:0/2053724425 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b11187d610 0x55b11187fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.971+0000 7f182d7fa640 10 client.15894 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.971+0000 7f1849c1a640 1 --2- 172.21.15.78:0/2053724425 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b11187d610 0x55b11187fa00 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d073e5068fb5edb0 server_cookie=7b9c45a932d3a689 in_seq=0 out_seq=0 2024-09-11T00:20:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.972+0000 7f182d7fa640 1 -- 172.21.15.78:0/2053724425 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b1117d9da0 con 0x55b11187d610 2024-09-11T00:20:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.972+0000 7f182d7fa640 10 client.15894 handle_command_reply: tid=0 2024-09-11T00:20:52.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.972+0000 7f184e253740 1 client.15894 shutdown 2024-09-11T00:20:52.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.972+0000 7f184e253740 1 -- 172.21.15.78:0/2053724425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b111861da0 msgr2=0x55b11186aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:52.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.972+0000 7f184e253740 1 --2- 172.21.15.78:0/2053724425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b111861da0 0x55b11186aa50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f18340ac2e0 tx=0x7f18340e9f50 comp rx=0 tx=0).stop 2024-09-11T00:20:52.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.972+0000 7f184e253740 1 -- 172.21.15.78:0/2053724425 shutdown_connections 2024-09-11T00:20:52.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.972+0000 7f184e253740 1 --2- 172.21.15.78:0/2053724425 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b11187d610 0x55b11187fa00 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.972+0000 7f184e253740 1 --2- 172.21.15.78:0/2053724425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b11186dd30 0x55b11186b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.972+0000 7f184e253740 1 --2- 172.21.15.78:0/2053724425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b111861da0 0x55b11186aa50 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.972+0000 7f184e253740 1 --2- 172.21.15.78:0/2053724425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b111861480 0x55b11186d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.972+0000 7f182d7fa640 0 client.15894 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:52.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.972+0000 7f184e253740 1 -- 172.21.15.78:0/2053724425 >> 172.21.15.78:0/2053724425 conn(0x55b11185f2b0 msgr2=0x55b111864e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:52.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.972+0000 7f184e253740 1 -- 172.21.15.78:0/2053724425 shutdown_connections 2024-09-11T00:20:52.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.972+0000 7f184e253740 1 -- 172.21.15.78:0/2053724425 wait complete. 2024-09-11T00:20:52.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.972+0000 7f184e253740 20 client.15894 trim_cache size 0 max 16384 2024-09-11T00:20:52.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.989+0000 7f184e253740 1 Processor -- start 2024-09-11T00:20:52.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.989+0000 7f184e253740 1 -- start start 2024-09-11T00:20:52.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.990+0000 7f184e253740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b111861480 0x55b11185ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:52.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.990+0000 7f184e253740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b111861da0 0x55b11186f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:52.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.990+0000 7f184e253740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b11186dd30 0x55b11186f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:52.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.990+0000 7f184e253740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f18441ae890 con 0x55b11186dd30 2024-09-11T00:20:52.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.990+0000 7f184e253740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f18441b1110 con 0x55b111861da0 2024-09-11T00:20:52.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.990+0000 7f184e253740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f18441aef00 con 0x55b111861480 2024-09-11T00:20:52.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.990+0000 7f184a41b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b11186dd30 0x55b11186f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:52.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.990+0000 7f184a41b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b11186dd30 0x55b11186f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36118/0 (socket says 172.21.15.78:36118) 2024-09-11T00:20:52.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.990+0000 7f184a41b640 1 -- 172.21.15.78:0/2734734191 learned_addr learned my addr 172.21.15.78:0/2734734191 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:52.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.990+0000 7f1849c1a640 1 --2- 172.21.15.78:0/2734734191 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b111861480 0x55b11185ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:52.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.990+0000 7f1849419640 1 --2- 172.21.15.78:0/2734734191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b111861da0 0x55b11186f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:52.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.990+0000 7f184a41b640 1 -- 172.21.15.78:0/2734734191 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b111861480 msgr2=0x55b11185ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:52.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.990+0000 7f184a41b640 1 --2- 172.21.15.78:0/2734734191 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b111861480 0x55b11185ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.990+0000 7f184a41b640 1 -- 172.21.15.78:0/2734734191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b111861da0 msgr2=0x55b11186f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:52.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.990+0000 7f184a41b640 1 --2- 172.21.15.78:0/2734734191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b111861da0 0x55b11186f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.990+0000 7f184a41b640 1 -- 172.21.15.78:0/2734734191 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b11186bd10 con 0x55b11186dd30 2024-09-11T00:20:52.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.990+0000 7f184a41b640 1 --2- 172.21.15.78:0/2734734191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b11186dd30 0x55b11186f660 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f183c032e50 tx=0x7f183c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a5d4155f79c7b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:52.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.990+0000 7f182f7fe640 1 -- 172.21.15.78:0/2734734191 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c031820 con 0x55b11186dd30 2024-09-11T00:20:52.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.991+0000 7f182f7fe640 1 -- 172.21.15.78:0/2734734191 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f183c036050 con 0x55b11186dd30 2024-09-11T00:20:52.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.991+0000 7f182f7fe640 1 -- 172.21.15.78:0/2734734191 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c004170 con 0x55b11186dd30 2024-09-11T00:20:52.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.991+0000 7f184e253740 1 -- 172.21.15.78:0/2734734191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b11186dd30 msgr2=0x55b11186f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:52.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.991+0000 7f184e253740 1 --2- 172.21.15.78:0/2734734191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b11186dd30 0x55b11186f660 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f183c032e50 tx=0x7f183c040000 comp rx=0 tx=0).stop 2024-09-11T00:20:52.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.991+0000 7f184e253740 1 -- 172.21.15.78:0/2734734191 shutdown_connections 2024-09-11T00:20:52.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.991+0000 7f184e253740 1 --2- 172.21.15.78:0/2734734191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b11186dd30 0x55b11186f660 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.991+0000 7f184e253740 1 --2- 172.21.15.78:0/2734734191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b111861da0 0x55b11186f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.991+0000 7f184e253740 1 --2- 172.21.15.78:0/2734734191 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b111861480 0x55b11185ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.991+0000 7f184e253740 1 -- 172.21.15.78:0/2734734191 >> 172.21.15.78:0/2734734191 conn(0x55b11185f2b0 msgr2=0x55b11186c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:52.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.991+0000 7f184e253740 1 -- 172.21.15.78:0/2734734191 shutdown_connections 2024-09-11T00:20:52.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.991+0000 7f184e253740 1 -- 172.21.15.78:0/2734734191 wait complete. 2024-09-11T00:20:52.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.992+0000 7f184e253740 1 -- start start 2024-09-11T00:20:52.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.992+0000 7f184e253740 1 Processor -- start 2024-09-11T00:20:52.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.992+0000 7f184e253740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b111861480 0x55b1118830e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:52.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.992+0000 7f184e253740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b111861da0 0x55b11187f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:52.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.992+0000 7f184e253740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b11186dd30 0x55b11187fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:52.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.992+0000 7f184e253740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f18441af5d0 con 0x55b111861480 2024-09-11T00:20:52.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.992+0000 7f184e253740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f18441b0a40 con 0x55b11186dd30 2024-09-11T00:20:52.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.992+0000 7f184e253740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f18441afca0 con 0x55b111861da0 2024-09-11T00:20:52.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.992+0000 7f184e253740 10 client.0 _ll_register_callbacks cb 0x7f184000b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:20:52.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.992+0000 7f1849c1a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b111861480 0x55b1118830e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:52.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.992+0000 7f1849c1a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b111861480 0x55b1118830e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36120/0 (socket says 172.21.15.78:36120) 2024-09-11T00:20:52.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.992+0000 7f1849c1a640 1 -- 172.21.15.78:0/1715989993 learned_addr learned my addr 172.21.15.78:0/1715989993 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:52.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.992+0000 7f1849419640 1 --2- 172.21.15.78:0/1715989993 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b111861da0 0x55b11187f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:52.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.993+0000 7f184a41b640 1 --2- 172.21.15.78:0/1715989993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b11186dd30 0x55b11187fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:52.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.993+0000 7f1849c1a640 1 -- 172.21.15.78:0/1715989993 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b111861da0 msgr2=0x55b11187f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:52.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.993+0000 7f1849c1a640 1 --2- 172.21.15.78:0/1715989993 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b111861da0 0x55b11187f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.993+0000 7f1849c1a640 1 -- 172.21.15.78:0/1715989993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b11186dd30 msgr2=0x55b11187fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:52.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.993+0000 7f1849c1a640 1 --2- 172.21.15.78:0/1715989993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b11186dd30 0x55b11187fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.993+0000 7f1849c1a640 1 -- 172.21.15.78:0/1715989993 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b111880240 con 0x55b111861480 2024-09-11T00:20:52.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.993+0000 7f1849c1a640 1 --2- 172.21.15.78:0/1715989993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b111861480 0x55b1118830e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f184000b370 tx=0x7f1840012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19803fcfffba3def server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:52.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.993+0000 7f182d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:20:52.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.993+0000 7f182d7fa640 1 -- 172.21.15.78:0/1715989993 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1840005220 con 0x55b111861480 2024-09-11T00:20:52.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.993+0000 7f182d7fa640 1 -- 172.21.15.78:0/1715989993 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f18400053c0 con 0x55b111861480 2024-09-11T00:20:52.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.993+0000 7f184e253740 1 -- 172.21.15.78:0/1715989993 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f183c036050 con 0x55b111861480 2024-09-11T00:20:52.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.993+0000 7f182d7fa640 1 -- 172.21.15.78:0/1715989993 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f18400055c0 con 0x55b111861480 2024-09-11T00:20:52.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.993+0000 7f184e253740 10 client.15900 fetch_fsmap learned FSMap version 20 2024-09-11T00:20:52.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.993+0000 7f184e253740 1 -- 172.21.15.78:0/1715989993 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b1118eb160 con 0x55b111861480 2024-09-11T00:20:52.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.993+0000 7f182d7fa640 1 -- 172.21.15.78:0/1715989993 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f183c036050 con 0x55b111861480 2024-09-11T00:20:52.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.994+0000 7f182d7fa640 1 -- 172.21.15.78:0/1715989993 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f18400119a0 con 0x55b111861480 2024-09-11T00:20:52.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.994+0000 7f184e253740 10 client.15900 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:20:52.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.994+0000 7f184e253740 10 client.15900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:20:52.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.994+0000 7f184e253740 20 client.15900 populate_metadata read hostname 'smithi078' 2024-09-11T00:20:52.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.994+0000 7f184e253740 1 --2- 172.21.15.78:0/1715989993 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b1118eb8c0 0x55b1118edce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:52.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.994+0000 7f184e253740 4 client.15900 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:20:52.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.994+0000 7f184e253740 1 -- 172.21.15.78:0/1715989993 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b1117d5850 con 0x55b1118eb8c0 2024-09-11T00:20:52.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.994+0000 7f1849419640 1 --2- 172.21.15.78:0/1715989993 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b1118eb8c0 0x55b1118edce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:52.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.994+0000 7f182d7fa640 10 client.15900 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:52.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.994+0000 7f1849419640 1 --2- 172.21.15.78:0/1715989993 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b1118eb8c0 0x55b1118edce0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f57b4d2f8e276c2b server_cookie=71a1336155e57b7c in_seq=0 out_seq=0 2024-09-11T00:20:52.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.994+0000 7f182d7fa640 1 -- 172.21.15.78:0/1715989993 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x55b1117d5850 con 0x55b1118eb8c0 2024-09-11T00:20:52.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.994+0000 7f182d7fa640 10 client.15900 handle_command_reply: tid=0 2024-09-11T00:20:52.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.995+0000 7f184e253740 1 client.15900 shutdown 2024-09-11T00:20:52.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.995+0000 7f184e253740 1 -- 172.21.15.78:0/1715989993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b111861480 msgr2=0x55b1118830e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:52.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.995+0000 7f184e253740 1 --2- 172.21.15.78:0/1715989993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b111861480 0x55b1118830e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f184000b370 tx=0x7f1840012820 comp rx=0 tx=0).stop 2024-09-11T00:20:52.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.995+0000 7f184e253740 1 -- 172.21.15.78:0/1715989993 shutdown_connections 2024-09-11T00:20:52.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.995+0000 7f184e253740 1 --2- 172.21.15.78:0/1715989993 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b1118eb8c0 0x55b1118edce0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.995+0000 7f184e253740 1 --2- 172.21.15.78:0/1715989993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b11186dd30 0x55b11187fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.995+0000 7f184e253740 1 --2- 172.21.15.78:0/1715989993 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b111861da0 0x55b11187f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.995+0000 7f184e253740 1 --2- 172.21.15.78:0/1715989993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b111861480 0x55b1118830e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.995+0000 7f182d7fa640 0 client.15900 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:52.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.995+0000 7f184e253740 1 -- 172.21.15.78:0/1715989993 >> 172.21.15.78:0/1715989993 conn(0x55b11185f2b0 msgr2=0x55b1118644e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:52.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.995+0000 7f184e253740 1 -- 172.21.15.78:0/1715989993 shutdown_connections 2024-09-11T00:20:52.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.995+0000 7f184e253740 1 -- 172.21.15.78:0/1715989993 wait complete. 2024-09-11T00:20:52.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.995+0000 7f184e253740 20 client.15900 trim_cache size 0 max 16384 2024-09-11T00:20:52.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.996+0000 7f184be7e640 1 -- 172.21.15.78:0/757191957 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f18300b54d0 msgr2=0x7f18300b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:52.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.996+0000 7f184be7e640 1 --2- 172.21.15.78:0/757191957 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f18300b54d0 0x7f18300b7990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f183c004af0 tx=0x7f183c005d80 comp rx=0 tx=0).stop 2024-09-11T00:20:52.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.996+0000 7f184be7e640 1 -- 172.21.15.78:0/757191957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18441076a0 msgr2=0x7f1844198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:52.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.996+0000 7f184be7e640 1 --2- 172.21.15.78:0/757191957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18441076a0 0x7f1844198300 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f183400c920 tx=0x7f183400cde0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.996+0000 7f184be7e640 1 -- 172.21.15.78:0/757191957 shutdown_connections 2024-09-11T00:20:52.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.996+0000 7f184be7e640 1 --2- 172.21.15.78:0/757191957 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f18300b54d0 0x7f18300b7990 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.996+0000 7f184be7e640 1 --2- 172.21.15.78:0/757191957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1844108020 0x7f1844198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.996+0000 7f184be7e640 1 --2- 172.21.15.78:0/757191957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18441076a0 0x7f1844198300 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.996+0000 7f184be7e640 1 --2- 172.21.15.78:0/757191957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1844101c90 0x7f1844197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:52.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.996+0000 7f184be7e640 1 -- 172.21.15.78:0/757191957 >> 172.21.15.78:0/757191957 conn(0x7f18440fd700 msgr2=0x7f18440ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:52.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.996+0000 7f184be7e640 1 -- 172.21.15.78:0/757191957 shutdown_connections 2024-09-11T00:20:52.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:51.996+0000 7f184be7e640 1 -- 172.21.15.78:0/757191957 wait complete. 2024-09-11T00:20:52.104 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:51 smithi078 ceph-mon[30865]: pgmap v455: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:20:52.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:51 smithi112 ceph-mon[35627]: pgmap v455: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:20:52.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:51 smithi138 ceph-mon[35019]: pgmap v455: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:20:52.817 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:20:52.818 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:20:53.074 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:20:53.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.588+0000 7fedc58a1640 1 -- 172.21.15.78:0/3388833030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc0102dc0 msgr2=0x7fedc01031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:53.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.588+0000 7fedc58a1640 1 --2- 172.21.15.78:0/3388833030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc0102dc0 0x7fedc01031a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fedb0009ca0 tx=0x7fedb002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:20:53.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.588+0000 7fedc58a1640 1 -- 172.21.15.78:0/3388833030 shutdown_connections 2024-09-11T00:20:53.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.588+0000 7fedc58a1640 1 --2- 172.21.15.78:0/3388833030 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedc0109150 0x7fedc010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:53.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.588+0000 7fedc58a1640 1 --2- 172.21.15.78:0/3388833030 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedc01087d0 0x7fedc0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:53.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.588+0000 7fedc58a1640 1 --2- 172.21.15.78:0/3388833030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc0102dc0 0x7fedc01031a0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:53.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.588+0000 7fedc58a1640 1 -- 172.21.15.78:0/3388833030 >> 172.21.15.78:0/3388833030 conn(0x7fedc00fe830 msgr2=0x7fedc0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:53.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.588+0000 7fedc58a1640 1 -- 172.21.15.78:0/3388833030 shutdown_connections 2024-09-11T00:20:53.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.588+0000 7fedc58a1640 1 -- 172.21.15.78:0/3388833030 wait complete. 2024-09-11T00:20:53.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.589+0000 7fedc58a1640 1 Processor -- start 2024-09-11T00:20:53.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.589+0000 7fedc58a1640 1 -- start start 2024-09-11T00:20:53.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.589+0000 7fedc58a1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc0102dc0 0x7fedc0199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:53.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.589+0000 7fedc58a1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedc01087d0 0x7fedc01997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:53.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.589+0000 7fedc58a1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedc0109150 0x7fedc019eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:53.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.589+0000 7fedc58a1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fedc0112e10 con 0x7fedc0102dc0 2024-09-11T00:20:53.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.589+0000 7fedc58a1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fedc0112c90 con 0x7fedc0109150 2024-09-11T00:20:53.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.589+0000 7fedc58a1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fedc0112f90 con 0x7fedc01087d0 2024-09-11T00:20:53.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.589+0000 7fedbeffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc0102dc0 0x7fedc0199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:53.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.589+0000 7fedbeffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc0102dc0 0x7fedc0199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36140/0 (socket says 172.21.15.78:36140) 2024-09-11T00:20:53.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.589+0000 7fedbeffd640 1 -- 172.21.15.78:0/2023504011 learned_addr learned my addr 172.21.15.78:0/2023504011 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:53.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.589+0000 7fedbf7fe640 1 --2- 172.21.15.78:0/2023504011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedc0109150 0x7fedc019eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:53.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.589+0000 7fedbeffd640 1 -- 172.21.15.78:0/2023504011 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedc01087d0 msgr2=0x7fedc01997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:53.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.589+0000 7fedbeffd640 1 --2- 172.21.15.78:0/2023504011 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedc01087d0 0x7fedc01997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:53.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.589+0000 7fedbeffd640 1 -- 172.21.15.78:0/2023504011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedc0109150 msgr2=0x7fedc019eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:53.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.589+0000 7fedbeffd640 1 --2- 172.21.15.78:0/2023504011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedc0109150 0x7fedc019eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:53.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.589+0000 7fedbeffd640 1 -- 172.21.15.78:0/2023504011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc019f330 con 0x7fedc0102dc0 2024-09-11T00:20:53.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.589+0000 7fedbf7fe640 1 --2- 172.21.15.78:0/2023504011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedc0109150 0x7fedc019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:53.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.589+0000 7fedbeffd640 1 --2- 172.21.15.78:0/2023504011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc0102dc0 0x7fedc0199280 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fedb002ade0 tx=0x7fedb0003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:53.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.590+0000 7fedc489f640 1 -- 172.21.15.78:0/2023504011 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0003d60 con 0x7fedc0102dc0 2024-09-11T00:20:53.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.590+0000 7fedc58a1640 1 -- 172.21.15.78:0/2023504011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedc019f5c0 con 0x7fedc0102dc0 2024-09-11T00:20:53.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.590+0000 7fedc489f640 1 -- 172.21.15.78:0/2023504011 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedb00044f0 con 0x7fedc0102dc0 2024-09-11T00:20:53.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.590+0000 7fedc489f640 1 -- 172.21.15.78:0/2023504011 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb002fd10 con 0x7fedc0102dc0 2024-09-11T00:20:53.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.590+0000 7fedc58a1640 1 -- 172.21.15.78:0/2023504011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedc01a5ce0 con 0x7fedc0102dc0 2024-09-11T00:20:53.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.591+0000 7fedc58a1640 1 -- 172.21.15.78:0/2023504011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedc01031a0 con 0x7fedc0102dc0 2024-09-11T00:20:53.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.592+0000 7fedc489f640 1 -- 172.21.15.78:0/2023504011 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fedb0004040 con 0x7fedc0102dc0 2024-09-11T00:20:53.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.593+0000 7fedc489f640 1 --2- 172.21.15.78:0/2023504011 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7feda80b98e0 0x7feda80bbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:53.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.593+0000 7fedbe7fc640 1 --2- 172.21.15.78:0/2023504011 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7feda80b98e0 0x7feda80bbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:53.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.593+0000 7fedc489f640 1 -- 172.21.15.78:0/2023504011 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fedb01076f0 con 0x7fedc0102dc0 2024-09-11T00:20:53.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.593+0000 7fedbe7fc640 1 --2- 172.21.15.78:0/2023504011 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7feda80b98e0 0x7feda80bbda0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fedc0101d90 tx=0x7fedb4005bf0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:53.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.596+0000 7fedc489f640 1 -- 172.21.15.78:0/2023504011 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fedb00ce230 con 0x7fedc0102dc0 2024-09-11T00:20:53.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.809+0000 7fedc58a1640 1 -- 172.21.15.78:0/2023504011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fedc010af60 con 0x7fedc0102dc0 2024-09-11T00:20:53.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.810+0000 7fedc489f640 1 -- 172.21.15.78:0/2023504011 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7fedb00cdb30 con 0x7fedc0102dc0 2024-09-11T00:20:53.812 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:20:53.812 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:20:53.812 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:20:53.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.812+0000 7fedc58a1640 1 -- 172.21.15.78:0/2023504011 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7feda80b98e0 msgr2=0x7feda80bbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:53.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.812+0000 7fedc58a1640 1 --2- 172.21.15.78:0/2023504011 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7feda80b98e0 0x7feda80bbda0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fedc0101d90 tx=0x7fedb4005bf0 comp rx=0 tx=0).stop 2024-09-11T00:20:53.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.812+0000 7fedc58a1640 1 -- 172.21.15.78:0/2023504011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc0102dc0 msgr2=0x7fedc0199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:53.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.812+0000 7fedc58a1640 1 --2- 172.21.15.78:0/2023504011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc0102dc0 0x7fedc0199280 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fedb002ade0 tx=0x7fedb0003970 comp rx=0 tx=0).stop 2024-09-11T00:20:53.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.812+0000 7fedc58a1640 1 -- 172.21.15.78:0/2023504011 shutdown_connections 2024-09-11T00:20:53.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.812+0000 7fedc58a1640 1 --2- 172.21.15.78:0/2023504011 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7feda80b98e0 0x7feda80bbda0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:53.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.812+0000 7fedc58a1640 1 --2- 172.21.15.78:0/2023504011 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fedc0109150 0x7fedc019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:53.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.812+0000 7fedc58a1640 1 --2- 172.21.15.78:0/2023504011 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedc01087d0 0x7fedc01997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:53.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.812+0000 7fedc58a1640 1 --2- 172.21.15.78:0/2023504011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc0102dc0 0x7fedc0199280 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:53.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.812+0000 7fedc58a1640 1 -- 172.21.15.78:0/2023504011 >> 172.21.15.78:0/2023504011 conn(0x7fedc00fe830 msgr2=0x7fedc0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:53.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.813+0000 7fedc58a1640 1 -- 172.21.15.78:0/2023504011 shutdown_connections 2024-09-11T00:20:53.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:53.813+0000 7fedc58a1640 1 -- 172.21.15.78:0/2023504011 wait complete. 2024-09-11T00:20:54.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:53 smithi078 ceph-mon[30865]: pgmap v456: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:54.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:53 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2023504011' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:20:54.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:53 smithi112 ceph-mon[35627]: pgmap v456: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:54.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:53 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2023504011' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:20:54.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:53 smithi138 ceph-mon[35019]: pgmap v456: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:54.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:53 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2023504011' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:20:54.683 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:20:54.937 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:20:55.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.439+0000 7fdb8f407640 1 -- 172.21.15.78:0/1932343398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb88109150 msgr2=0x7fdb8810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.439+0000 7fdb8f407640 1 --2- 172.21.15.78:0/1932343398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb88109150 0x7fdb8810f950 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fdb80009ca0 tx=0x7fdb8002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.439+0000 7fdb8f407640 1 -- 172.21.15.78:0/1932343398 shutdown_connections 2024-09-11T00:20:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.439+0000 7fdb8f407640 1 --2- 172.21.15.78:0/1932343398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb88109150 0x7fdb8810f950 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.439+0000 7fdb8f407640 1 --2- 172.21.15.78:0/1932343398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb881087d0 0x7fdb88108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.439+0000 7fdb8f407640 1 --2- 172.21.15.78:0/1932343398 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb88102dc0 0x7fdb881031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.439+0000 7fdb8f407640 1 -- 172.21.15.78:0/1932343398 >> 172.21.15.78:0/1932343398 conn(0x7fdb880fe830 msgr2=0x7fdb88100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.439+0000 7fdb8f407640 1 -- 172.21.15.78:0/1932343398 shutdown_connections 2024-09-11T00:20:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.439+0000 7fdb8f407640 1 -- 172.21.15.78:0/1932343398 wait complete. 2024-09-11T00:20:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.439+0000 7fdb8f407640 1 Processor -- start 2024-09-11T00:20:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.439+0000 7fdb8f407640 1 -- start start 2024-09-11T00:20:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.440+0000 7fdb8f407640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb88102dc0 0x7fdb881993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.440+0000 7fdb8f407640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb881087d0 0x7fdb88199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.440+0000 7fdb8f407640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb88109150 0x7fdb8819eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:55.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.440+0000 7fdb8f407640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdb88112e50 con 0x7fdb881087d0 2024-09-11T00:20:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.440+0000 7fdb8f407640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdb88112cd0 con 0x7fdb88102dc0 2024-09-11T00:20:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.440+0000 7fdb8f407640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdb88112fd0 con 0x7fdb88109150 2024-09-11T00:20:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.440+0000 7fdb8c9a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb881087d0 0x7fdb88199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.440+0000 7fdb8c9a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb881087d0 0x7fdb88199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53684/0 (socket says 172.21.15.78:53684) 2024-09-11T00:20:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.440+0000 7fdb8c9a2640 1 -- 172.21.15.78:0/3324300554 learned_addr learned my addr 172.21.15.78:0/3324300554 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.440+0000 7fdb8d9a4640 1 --2- 172.21.15.78:0/3324300554 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb88109150 0x7fdb8819eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.440+0000 7fdb8d1a3640 1 --2- 172.21.15.78:0/3324300554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb88102dc0 0x7fdb881993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.440+0000 7fdb8c9a2640 1 -- 172.21.15.78:0/3324300554 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb88109150 msgr2=0x7fdb8819eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.440+0000 7fdb8c9a2640 1 --2- 172.21.15.78:0/3324300554 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb88109150 0x7fdb8819eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.440+0000 7fdb8c9a2640 1 -- 172.21.15.78:0/3324300554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb88102dc0 msgr2=0x7fdb881993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.440+0000 7fdb8c9a2640 1 --2- 172.21.15.78:0/3324300554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb88102dc0 0x7fdb881993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.440+0000 7fdb8c9a2640 1 -- 172.21.15.78:0/3324300554 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8819f470 con 0x7fdb881087d0 2024-09-11T00:20:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.440+0000 7fdb8d1a3640 1 --2- 172.21.15.78:0/3324300554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb88102dc0 0x7fdb881993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:20:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.440+0000 7fdb8c9a2640 1 --2- 172.21.15.78:0/3324300554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb881087d0 0x7fdb88199900 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800b4a0 tx=0x7fdb7800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:55.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.440+0000 7fdb7e7fc640 1 -- 172.21.15.78:0/3324300554 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb78014070 con 0x7fdb881087d0 2024-09-11T00:20:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.440+0000 7fdb7e7fc640 1 -- 172.21.15.78:0/3324300554 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb78010ac0 con 0x7fdb881087d0 2024-09-11T00:20:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.440+0000 7fdb8f407640 1 -- 172.21.15.78:0/3324300554 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb8819f760 con 0x7fdb881087d0 2024-09-11T00:20:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.440+0000 7fdb7e7fc640 1 -- 172.21.15.78:0/3324300554 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb78017c30 con 0x7fdb881087d0 2024-09-11T00:20:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.441+0000 7fdb8f407640 1 -- 172.21.15.78:0/3324300554 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb881a5ea0 con 0x7fdb881087d0 2024-09-11T00:20:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.444+0000 7fdb917dc740 1 Processor -- start 2024-09-11T00:20:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.444+0000 7fdb917dc740 1 -- start start 2024-09-11T00:20:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.444+0000 7fdb7e7fc640 1 -- 172.21.15.78:0/3324300554 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fdb78010610 con 0x7fdb881087d0 2024-09-11T00:20:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.444+0000 7fdb917dc740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a083b854d0 0x55a083b858b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.444+0000 7fdb917dc740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a083b85df0 0x55a083b91840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.444+0000 7fdb917dc740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b91d80 0x55a083b94170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.444+0000 7fdb917dc740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a083afbea0 con 0x55a083b91d80 2024-09-11T00:20:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.444+0000 7fdb917dc740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a083aeb2d0 con 0x55a083b85df0 2024-09-11T00:20:55.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.444+0000 7fdb917dc740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a083aef0e0 con 0x55a083b854d0 2024-09-11T00:20:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.444+0000 7fdb8c9a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b91d80 0x55a083b94170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.444+0000 7fdb8c9a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b91d80 0x55a083b94170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53698/0 (socket says 172.21.15.78:53698) 2024-09-11T00:20:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.444+0000 7fdb8c9a2640 1 -- 172.21.15.78:0/282854235 learned_addr learned my addr 172.21.15.78:0/282854235 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.444+0000 7fdb8d9a4640 1 --2- 172.21.15.78:0/282854235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a083b854d0 0x55a083b858b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.444+0000 7fdb8d1a3640 1 --2- 172.21.15.78:0/282854235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a083b85df0 0x55a083b91840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.444+0000 7fdb8c9a2640 1 -- 172.21.15.78:0/282854235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a083b854d0 msgr2=0x55a083b858b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.444+0000 7fdb8c9a2640 1 --2- 172.21.15.78:0/282854235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a083b854d0 0x55a083b858b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.444+0000 7fdb8c9a2640 1 -- 172.21.15.78:0/282854235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a083b85df0 msgr2=0x55a083b91840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:55.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.444+0000 7fdb8c9a2640 1 --2- 172.21.15.78:0/282854235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a083b85df0 0x55a083b91840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.444+0000 7fdb8c9a2640 1 -- 172.21.15.78:0/282854235 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a083849650 con 0x55a083b91d80 2024-09-11T00:20:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.445+0000 7fdb8d1a3640 1 --2- 172.21.15.78:0/282854235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a083b85df0 0x55a083b91840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:20:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.445+0000 7fdb8c9a2640 1 --2- 172.21.15.78:0/282854235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b91d80 0x55a083b94170 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdb780e3040 tx=0x7fdb780ebcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c4a14d2b61ae38 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.445+0000 7fdb7e7fc640 1 --2- 172.21.15.78:0/3324300554 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdb740b5450 0x7fdb740b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.445+0000 7fdb8d9a4640 1 --2- 172.21.15.78:0/3324300554 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdb740b5450 0x7fdb740b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.445+0000 7fdb737fe640 1 -- 172.21.15.78:0/282854235 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb780f4070 con 0x55a083b91d80 2024-09-11T00:20:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.445+0000 7fdb7e7fc640 1 -- 172.21.15.78:0/3324300554 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fdb780e5960 con 0x7fdb881087d0 2024-09-11T00:20:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.445+0000 7fdb737fe640 1 -- 172.21.15.78:0/282854235 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb78017360 con 0x55a083b91d80 2024-09-11T00:20:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.445+0000 7fdb737fe640 1 -- 172.21.15.78:0/282854235 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb780a8450 con 0x55a083b91d80 2024-09-11T00:20:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.446+0000 7fdb917dc740 1 -- 172.21.15.78:0/282854235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b91d80 msgr2=0x55a083b94170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.446+0000 7fdb8d9a4640 1 --2- 172.21.15.78:0/3324300554 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdb740b5450 0x7fdb740b7910 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdb80005fa0 tx=0x7fdb80005c30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.446+0000 7fdb917dc740 1 --2- 172.21.15.78:0/282854235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b91d80 0x55a083b94170 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdb780e3040 tx=0x7fdb780ebcd0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.446+0000 7fdb917dc740 1 -- 172.21.15.78:0/282854235 shutdown_connections 2024-09-11T00:20:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.446+0000 7fdb917dc740 1 --2- 172.21.15.78:0/282854235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b91d80 0x55a083b94170 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.446+0000 7fdb917dc740 1 --2- 172.21.15.78:0/282854235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a083b85df0 0x55a083b91840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.446+0000 7fdb917dc740 1 --2- 172.21.15.78:0/282854235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a083b854d0 0x55a083b858b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.446+0000 7fdb917dc740 1 -- 172.21.15.78:0/282854235 >> 172.21.15.78:0/282854235 conn(0x55a083b83300 msgr2=0x55a083b844a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.446+0000 7fdb917dc740 1 -- 172.21.15.78:0/282854235 shutdown_connections 2024-09-11T00:20:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.446+0000 7fdb917dc740 1 -- 172.21.15.78:0/282854235 wait complete. 2024-09-11T00:20:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.446+0000 7fdb917dc740 1 -- start start 2024-09-11T00:20:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.446+0000 7fdb917dc740 1 Processor -- start 2024-09-11T00:20:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.447+0000 7fdb917dc740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b854d0 0x55a083b915f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.447+0000 7fdb917dc740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a083b85df0 0x55a083b8ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.447+0000 7fdb917dc740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a083b91d80 0x55a083b8efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.447+0000 7fdb917dc740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a08394c700 con 0x55a083b854d0 2024-09-11T00:20:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.447+0000 7fdb917dc740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a083a86160 con 0x55a083b85df0 2024-09-11T00:20:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.447+0000 7fdb917dc740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a083b94a00 con 0x55a083b91d80 2024-09-11T00:20:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.447+0000 7fdb917dc740 10 client.0 _ll_register_callbacks cb 0x55a083a9f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:20:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.447+0000 7fdb8d1a3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b854d0 0x55a083b915f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.447+0000 7fdb8d1a3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b854d0 0x55a083b915f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53712/0 (socket says 172.21.15.78:53712) 2024-09-11T00:20:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.447+0000 7fdb8d1a3640 1 -- 172.21.15.78:0/3850288154 learned_addr learned my addr 172.21.15.78:0/3850288154 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.447+0000 7fdb8c9a2640 1 --2- 172.21.15.78:0/3850288154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a083b85df0 0x55a083b8ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.447+0000 7fdb8d1a3640 1 -- 172.21.15.78:0/3850288154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a083b91d80 msgr2=0x55a083b8efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.447+0000 7fdb8d1a3640 1 --2- 172.21.15.78:0/3850288154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a083b91d80 0x55a083b8efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.447+0000 7fdb8d1a3640 1 -- 172.21.15.78:0/3850288154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a083b85df0 msgr2=0x55a083b8ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.447+0000 7fdb8d1a3640 1 --2- 172.21.15.78:0/3850288154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a083b85df0 0x55a083b8ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.447+0000 7fdb8d1a3640 1 -- 172.21.15.78:0/3850288154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a083ab3c90 con 0x55a083b854d0 2024-09-11T00:20:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.447+0000 7fdb8c9a2640 1 --2- 172.21.15.78:0/3850288154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a083b85df0 0x55a083b8ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:20:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.447+0000 7fdb8d1a3640 1 --2- 172.21.15.78:0/3850288154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b854d0 0x55a083b915f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400def0 tx=0x7fdb8400f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98705bf08f890ced server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.447+0000 7fdb70ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:20:55.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.448+0000 7fdb70ff9640 1 -- 172.21.15.78:0/3850288154 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb84018020 con 0x55a083b854d0 2024-09-11T00:20:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.448+0000 7fdb917dc740 1 -- 172.21.15.78:0/3850288154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a083afddf0 con 0x55a083b854d0 2024-09-11T00:20:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.448+0000 7fdb70ff9640 1 -- 172.21.15.78:0/3850288154 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fdb84014660 con 0x55a083b854d0 2024-09-11T00:20:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.448+0000 7fdb70ff9640 1 -- 172.21.15.78:0/3850288154 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fdb84023050 con 0x55a083b854d0 2024-09-11T00:20:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.448+0000 7fdb917dc740 10 client.15918 fetch_fsmap learned FSMap version 20 2024-09-11T00:20:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.448+0000 7fdb917dc740 1 -- 172.21.15.78:0/3850288154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a083ba0390 con 0x55a083b854d0 2024-09-11T00:20:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.448+0000 7fdb70ff9640 1 -- 172.21.15.78:0/3850288154 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a083afddf0 con 0x55a083b854d0 2024-09-11T00:20:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.448+0000 7fdb70ff9640 1 -- 172.21.15.78:0/3850288154 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fdb84013a40 con 0x55a083b854d0 2024-09-11T00:20:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.448+0000 7fdb917dc740 10 client.15918 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:20:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.448+0000 7fdb917dc740 10 client.15918 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:20:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.448+0000 7fdb917dc740 20 client.15918 populate_metadata read hostname 'smithi078' 2024-09-11T00:20:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.448+0000 7fdb917dc740 1 --2- 172.21.15.78:0/3850288154 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a083ba1c80 0x55a083ba40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.448+0000 7fdb917dc740 4 client.15918 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:20:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.448+0000 7fdb917dc740 1 -- 172.21.15.78:0/3850288154 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a083af98a0 con 0x55a083ba1c80 2024-09-11T00:20:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.449+0000 7fdb8c9a2640 1 --2- 172.21.15.78:0/3850288154 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a083ba1c80 0x55a083ba40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.449+0000 7fdb8c9a2640 1 --2- 172.21.15.78:0/3850288154 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a083ba1c80 0x55a083ba40e0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e148028ef82c9d4 server_cookie=3283b436ff4af403 in_seq=0 out_seq=0 2024-09-11T00:20:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.449+0000 7fdb70ff9640 10 client.15918 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.450+0000 7fdb70ff9640 1 -- 172.21.15.78:0/3850288154 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a083af98a0 con 0x55a083ba1c80 2024-09-11T00:20:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.450+0000 7fdb70ff9640 10 client.15918 handle_command_reply: tid=0 2024-09-11T00:20:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.450+0000 7fdb917dc740 1 client.15918 shutdown 2024-09-11T00:20:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.450+0000 7fdb917dc740 1 -- 172.21.15.78:0/3850288154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b854d0 msgr2=0x55a083b915f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.450+0000 7fdb917dc740 1 --2- 172.21.15.78:0/3850288154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b854d0 0x55a083b915f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400def0 tx=0x7fdb8400f5b0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.450+0000 7fdb917dc740 1 -- 172.21.15.78:0/3850288154 shutdown_connections 2024-09-11T00:20:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.450+0000 7fdb917dc740 1 --2- 172.21.15.78:0/3850288154 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a083ba1c80 0x55a083ba40e0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.450+0000 7fdb917dc740 1 --2- 172.21.15.78:0/3850288154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a083b91d80 0x55a083b8efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.450+0000 7fdb917dc740 1 --2- 172.21.15.78:0/3850288154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a083b85df0 0x55a083b8ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.450+0000 7fdb917dc740 1 --2- 172.21.15.78:0/3850288154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b854d0 0x55a083b915f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.450+0000 7fdb917dc740 1 -- 172.21.15.78:0/3850288154 >> 172.21.15.78:0/3850288154 conn(0x55a083b83300 msgr2=0x55a083b88e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.450+0000 7fdb70ff9640 0 client.15918 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:55.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.450+0000 7fdb917dc740 1 -- 172.21.15.78:0/3850288154 shutdown_connections 2024-09-11T00:20:55.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.450+0000 7fdb917dc740 1 -- 172.21.15.78:0/3850288154 wait complete. 2024-09-11T00:20:55.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.450+0000 7fdb917dc740 20 client.15918 trim_cache size 0 max 16384 2024-09-11T00:20:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.463+0000 7fdb917dc740 1 Processor -- start 2024-09-11T00:20:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.463+0000 7fdb917dc740 1 -- start start 2024-09-11T00:20:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.463+0000 7fdb917dc740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a083b854d0 0x55a083b8d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.463+0000 7fdb917dc740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a083b85df0 0x55a083b8d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.463+0000 7fdb917dc740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b91d80 0x55a083b93170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.463+0000 7fdb917dc740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdb881ac8a0 con 0x55a083b91d80 2024-09-11T00:20:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.463+0000 7fdb917dc740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdb881af120 con 0x55a083b85df0 2024-09-11T00:20:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.463+0000 7fdb917dc740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdb881acf10 con 0x55a083b854d0 2024-09-11T00:20:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.464+0000 7fdb8d9a4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b91d80 0x55a083b93170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.464+0000 7fdb8d9a4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b91d80 0x55a083b93170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53726/0 (socket says 172.21.15.78:53726) 2024-09-11T00:20:55.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.464+0000 7fdb8d9a4640 1 -- 172.21.15.78:0/2318478851 learned_addr learned my addr 172.21.15.78:0/2318478851 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:55.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.464+0000 7fdb8d1a3640 1 --2- 172.21.15.78:0/2318478851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a083b854d0 0x55a083b8d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:55.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.464+0000 7fdb8c9a2640 1 --2- 172.21.15.78:0/2318478851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a083b85df0 0x55a083b8d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:55.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.464+0000 7fdb8d9a4640 1 -- 172.21.15.78:0/2318478851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a083b854d0 msgr2=0x55a083b8d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:55.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.464+0000 7fdb8d9a4640 1 --2- 172.21.15.78:0/2318478851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a083b854d0 0x55a083b8d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.464+0000 7fdb8d9a4640 1 -- 172.21.15.78:0/2318478851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a083b85df0 msgr2=0x55a083b8d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:55.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.464+0000 7fdb8d9a4640 1 --2- 172.21.15.78:0/2318478851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a083b85df0 0x55a083b8d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.464+0000 7fdb8d9a4640 1 -- 172.21.15.78:0/2318478851 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a083b85c20 con 0x55a083b91d80 2024-09-11T00:20:55.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.464+0000 7fdb8d9a4640 1 --2- 172.21.15.78:0/2318478851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b91d80 0x55a083b93170 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdb80035000 tx=0x7fdb800095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f055b84d56236fa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:55.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.464+0000 7fdb72ffd640 1 -- 172.21.15.78:0/2318478851 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb80003970 con 0x55a083b91d80 2024-09-11T00:20:55.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.464+0000 7fdb72ffd640 1 -- 172.21.15.78:0/2318478851 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb80036040 con 0x55a083b91d80 2024-09-11T00:20:55.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.464+0000 7fdb72ffd640 1 -- 172.21.15.78:0/2318478851 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8002f660 con 0x55a083b91d80 2024-09-11T00:20:55.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.465+0000 7fdb917dc740 1 -- 172.21.15.78:0/2318478851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b91d80 msgr2=0x55a083b93170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:55.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.465+0000 7fdb917dc740 1 --2- 172.21.15.78:0/2318478851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b91d80 0x55a083b93170 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdb80035000 tx=0x7fdb800095c0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.465+0000 7fdb917dc740 1 -- 172.21.15.78:0/2318478851 shutdown_connections 2024-09-11T00:20:55.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.465+0000 7fdb917dc740 1 --2- 172.21.15.78:0/2318478851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b91d80 0x55a083b93170 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.465+0000 7fdb917dc740 1 --2- 172.21.15.78:0/2318478851 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a083b85df0 0x55a083b8d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.465+0000 7fdb917dc740 1 --2- 172.21.15.78:0/2318478851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a083b854d0 0x55a083b8d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.465+0000 7fdb917dc740 1 -- 172.21.15.78:0/2318478851 >> 172.21.15.78:0/2318478851 conn(0x55a083b83300 msgr2=0x55a083b89cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:55.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.465+0000 7fdb917dc740 1 -- 172.21.15.78:0/2318478851 shutdown_connections 2024-09-11T00:20:55.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.465+0000 7fdb917dc740 1 -- 172.21.15.78:0/2318478851 wait complete. 2024-09-11T00:20:55.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.465+0000 7fdb917dc740 1 -- start start 2024-09-11T00:20:55.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.465+0000 7fdb917dc740 1 Processor -- start 2024-09-11T00:20:55.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.466+0000 7fdb917dc740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a083b854d0 0x55a083ba5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:55.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.466+0000 7fdb917dc740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b85df0 0x55a083ba5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:55.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.466+0000 7fdb917dc740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a083b91d80 0x55a083ba64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:55.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.466+0000 7fdb917dc740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdb881ad5e0 con 0x55a083b85df0 2024-09-11T00:20:55.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.466+0000 7fdb917dc740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdb881aea50 con 0x55a083b91d80 2024-09-11T00:20:55.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.466+0000 7fdb917dc740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdb881adcb0 con 0x55a083b854d0 2024-09-11T00:20:55.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.466+0000 7fdb917dc740 10 client.0 _ll_register_callbacks cb 0x7fdb8400d200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:20:55.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.466+0000 7fdb8c9a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b85df0 0x55a083ba5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:55.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.466+0000 7fdb8c9a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b85df0 0x55a083ba5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53734/0 (socket says 172.21.15.78:53734) 2024-09-11T00:20:55.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.466+0000 7fdb8c9a2640 1 -- 172.21.15.78:0/1505417809 learned_addr learned my addr 172.21.15.78:0/1505417809 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:55.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.466+0000 7fdb8d1a3640 1 --2- 172.21.15.78:0/1505417809 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a083b854d0 0x55a083ba5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:55.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.466+0000 7fdb8d9a4640 1 --2- 172.21.15.78:0/1505417809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a083b91d80 0x55a083ba64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:55.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.466+0000 7fdb8c9a2640 1 -- 172.21.15.78:0/1505417809 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a083b854d0 msgr2=0x55a083ba5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:55.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.466+0000 7fdb8c9a2640 1 --2- 172.21.15.78:0/1505417809 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a083b854d0 0x55a083ba5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.466+0000 7fdb8c9a2640 1 -- 172.21.15.78:0/1505417809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a083b91d80 msgr2=0x55a083ba64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:55.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.466+0000 7fdb8c9a2640 1 --2- 172.21.15.78:0/1505417809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a083b91d80 0x55a083ba64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.466+0000 7fdb8c9a2640 1 -- 172.21.15.78:0/1505417809 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a083c0dd70 con 0x55a083b85df0 2024-09-11T00:20:55.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.466+0000 7fdb8c9a2640 1 --2- 172.21.15.78:0/1505417809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b85df0 0x55a083ba5f80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fdb780abb00 tx=0x7fdb78017570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dafd785301f1433 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:55.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.466+0000 7fdb70ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:20:55.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.466+0000 7fdb70ff9640 1 -- 172.21.15.78:0/1505417809 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7801e070 con 0x55a083b85df0 2024-09-11T00:20:55.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.466+0000 7fdb70ff9640 1 -- 172.21.15.78:0/1505417809 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fdb780eb320 con 0x55a083b85df0 2024-09-11T00:20:55.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.466+0000 7fdb917dc740 1 -- 172.21.15.78:0/1505417809 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb80036040 con 0x55a083b85df0 2024-09-11T00:20:55.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.467+0000 7fdb70ff9640 1 -- 172.21.15.78:0/1505417809 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fdb780f4050 con 0x55a083b85df0 2024-09-11T00:20:55.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.467+0000 7fdb917dc740 10 client.15924 fetch_fsmap learned FSMap version 20 2024-09-11T00:20:55.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.467+0000 7fdb917dc740 1 -- 172.21.15.78:0/1505417809 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a083c0f050 con 0x55a083b85df0 2024-09-11T00:20:55.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.467+0000 7fdb70ff9640 1 -- 172.21.15.78:0/1505417809 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb80036040 con 0x55a083b85df0 2024-09-11T00:20:55.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.467+0000 7fdb70ff9640 1 -- 172.21.15.78:0/1505417809 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fdb780e3350 con 0x55a083b85df0 2024-09-11T00:20:55.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.467+0000 7fdb917dc740 10 client.15924 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:20:55.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.467+0000 7fdb917dc740 10 client.15924 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:20:55.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.467+0000 7fdb917dc740 20 client.15924 populate_metadata read hostname 'smithi078' 2024-09-11T00:20:55.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.467+0000 7fdb917dc740 1 --2- 172.21.15.78:0/1505417809 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a083c0f2e0 0x55a083c116d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:55.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.467+0000 7fdb917dc740 4 client.15924 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:20:55.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.467+0000 7fdb917dc740 1 -- 172.21.15.78:0/1505417809 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a083af6cd0 con 0x55a083c0f2e0 2024-09-11T00:20:55.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.467+0000 7fdb8d1a3640 1 --2- 172.21.15.78:0/1505417809 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a083c0f2e0 0x55a083c116d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:55.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.468+0000 7fdb70ff9640 10 client.15924 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:55.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.468+0000 7fdb8d1a3640 1 --2- 172.21.15.78:0/1505417809 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a083c0f2e0 0x55a083c116d0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe0742ef255dbe70 server_cookie=48eca7222df0073a in_seq=0 out_seq=0 2024-09-11T00:20:55.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.468+0000 7fdb70ff9640 1 -- 172.21.15.78:0/1505417809 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a083af6cd0 con 0x55a083c0f2e0 2024-09-11T00:20:55.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.468+0000 7fdb70ff9640 10 client.15924 handle_command_reply: tid=0 2024-09-11T00:20:55.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.468+0000 7fdb917dc740 1 client.15924 shutdown 2024-09-11T00:20:55.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.468+0000 7fdb917dc740 1 -- 172.21.15.78:0/1505417809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b85df0 msgr2=0x55a083ba5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:55.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.468+0000 7fdb917dc740 1 --2- 172.21.15.78:0/1505417809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b85df0 0x55a083ba5f80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fdb780abb00 tx=0x7fdb78017570 comp rx=0 tx=0).stop 2024-09-11T00:20:55.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.468+0000 7fdb917dc740 1 -- 172.21.15.78:0/1505417809 shutdown_connections 2024-09-11T00:20:55.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.468+0000 7fdb917dc740 1 --2- 172.21.15.78:0/1505417809 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a083c0f2e0 0x55a083c116d0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.468+0000 7fdb917dc740 1 --2- 172.21.15.78:0/1505417809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a083b91d80 0x55a083ba64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.468+0000 7fdb917dc740 1 --2- 172.21.15.78:0/1505417809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a083b85df0 0x55a083ba5f80 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.468+0000 7fdb70ff9640 0 client.15924 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:55.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.468+0000 7fdb917dc740 1 --2- 172.21.15.78:0/1505417809 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a083b854d0 0x55a083ba5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.468+0000 7fdb917dc740 1 -- 172.21.15.78:0/1505417809 >> 172.21.15.78:0/1505417809 conn(0x55a083b83300 msgr2=0x55a083b8d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:55.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.468+0000 7fdb917dc740 1 -- 172.21.15.78:0/1505417809 shutdown_connections 2024-09-11T00:20:55.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.468+0000 7fdb917dc740 1 -- 172.21.15.78:0/1505417809 wait complete. 2024-09-11T00:20:55.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.469+0000 7fdb917dc740 20 client.15924 trim_cache size 0 max 16384 2024-09-11T00:20:55.475 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-11T00:20:55.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.469+0000 7fdb8f407640 1 -- 172.21.15.78:0/3324300554 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdb740b5450 msgr2=0x7fdb740b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:55.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.469+0000 7fdb8f407640 1 --2- 172.21.15.78:0/3324300554 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdb740b5450 0x7fdb740b7910 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdb80005fa0 tx=0x7fdb80005c30 comp rx=0 tx=0).stop 2024-09-11T00:20:55.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.469+0000 7fdb8f407640 1 -- 172.21.15.78:0/3324300554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb881087d0 msgr2=0x7fdb88199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:55.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.469+0000 7fdb8f407640 1 --2- 172.21.15.78:0/3324300554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb881087d0 0x7fdb88199900 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800b4a0 tx=0x7fdb7800b960 comp rx=0 tx=0).stop 2024-09-11T00:20:55.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.469+0000 7fdb8f407640 1 -- 172.21.15.78:0/3324300554 shutdown_connections 2024-09-11T00:20:55.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.469+0000 7fdb8f407640 1 --2- 172.21.15.78:0/3324300554 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdb740b5450 0x7fdb740b7910 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.469+0000 7fdb8f407640 1 --2- 172.21.15.78:0/3324300554 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb88109150 0x7fdb8819eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.469+0000 7fdb8f407640 1 --2- 172.21.15.78:0/3324300554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb881087d0 0x7fdb88199900 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.469+0000 7fdb8f407640 1 --2- 172.21.15.78:0/3324300554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdb88102dc0 0x7fdb881993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:55.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.469+0000 7fdb8f407640 1 -- 172.21.15.78:0/3324300554 >> 172.21.15.78:0/3324300554 conn(0x7fdb880fe830 msgr2=0x7fdb88100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:55.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.469+0000 7fdb8f407640 1 -- 172.21.15.78:0/3324300554 shutdown_connections 2024-09-11T00:20:55.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:55.469+0000 7fdb8f407640 1 -- 172.21.15.78:0/3324300554 wait complete. 2024-09-11T00:20:56.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:55 smithi112 ceph-mon[35627]: pgmap v457: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:20:56.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:55 smithi138 ceph-mon[35019]: pgmap v457: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:20:56.316 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:55 smithi078 ceph-mon[30865]: pgmap v457: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:20:57.344 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:20:57.344 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:20:57.602 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:20:58.011 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:57 smithi078 ceph-mon[30865]: pgmap v458: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:58.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.093+0000 7fd4cb0c0640 1 -- 172.21.15.78:0/1992305749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4c41076e0 msgr2=0x7fd4c4107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:58.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.093+0000 7fd4cb0c0640 1 --2- 172.21.15.78:0/1992305749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4c41076e0 0x7fd4c4107b20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009900 tx=0x7fd4b002a410 comp rx=0 tx=0).stop 2024-09-11T00:20:58.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.093+0000 7fd4cb0c0640 1 -- 172.21.15.78:0/1992305749 shutdown_connections 2024-09-11T00:20:58.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.093+0000 7fd4cb0c0640 1 --2- 172.21.15.78:0/1992305749 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4c4108060 0x7fd4c410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.093+0000 7fd4cb0c0640 1 --2- 172.21.15.78:0/1992305749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4c41076e0 0x7fd4c4107b20 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.093+0000 7fd4cb0c0640 1 --2- 172.21.15.78:0/1992305749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4c4101cd0 0x7fd4c41020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.093+0000 7fd4cb0c0640 1 -- 172.21.15.78:0/1992305749 >> 172.21.15.78:0/1992305749 conn(0x7fd4c40fd700 msgr2=0x7fd4c40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:58.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.093+0000 7fd4cb0c0640 1 -- 172.21.15.78:0/1992305749 shutdown_connections 2024-09-11T00:20:58.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.093+0000 7fd4cb0c0640 1 -- 172.21.15.78:0/1992305749 wait complete. 2024-09-11T00:20:58.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.094+0000 7fd4cb0c0640 1 Processor -- start 2024-09-11T00:20:58.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.094+0000 7fd4cb0c0640 1 -- start start 2024-09-11T00:20:58.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.094+0000 7fd4cb0c0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4c4101cd0 0x7fd4c419a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:58.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.094+0000 7fd4cb0c0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4c41076e0 0x7fd4c419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:58.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.094+0000 7fd4cb0c0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4c4108060 0x7fd4c419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:58.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.094+0000 7fd4cb0c0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c4111ce0 con 0x7fd4c41076e0 2024-09-11T00:20:58.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.094+0000 7fd4cb0c0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c4111b60 con 0x7fd4c4101cd0 2024-09-11T00:20:58.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.094+0000 7fd4cb0c0640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c4111e60 con 0x7fd4c4108060 2024-09-11T00:20:58.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.094+0000 7fd4c3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4c41076e0 0x7fd4c419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:58.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.094+0000 7fd4c3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4c41076e0 0x7fd4c419a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53742/0 (socket says 172.21.15.78:53742) 2024-09-11T00:20:58.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.094+0000 7fd4c3fff640 1 -- 172.21.15.78:0/1774097549 learned_addr learned my addr 172.21.15.78:0/1774097549 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:58.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.094+0000 7fd4c965d640 1 --2- 172.21.15.78:0/1774097549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4c4108060 0x7fd4c419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:58.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.094+0000 7fd4c3fff640 1 -- 172.21.15.78:0/1774097549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4c4108060 msgr2=0x7fd4c419ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:58.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.094+0000 7fd4c3fff640 1 --2- 172.21.15.78:0/1774097549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4c4108060 0x7fd4c419ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.094+0000 7fd4c3fff640 1 -- 172.21.15.78:0/1774097549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4c4101cd0 msgr2=0x7fd4c419a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:58.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.094+0000 7fd4c8e5c640 1 --2- 172.21.15.78:0/1774097549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4c4101cd0 0x7fd4c419a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:58.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.094+0000 7fd4c3fff640 1 --2- 172.21.15.78:0/1774097549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4c4101cd0 0x7fd4c419a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.094+0000 7fd4c3fff640 1 -- 172.21.15.78:0/1774097549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c41a5490 con 0x7fd4c41076e0 2024-09-11T00:20:58.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.094+0000 7fd4c8e5c640 1 --2- 172.21.15.78:0/1774097549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4c4101cd0 0x7fd4c419a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:58.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.095+0000 7fd4c3fff640 1 --2- 172.21.15.78:0/1774097549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4c41076e0 0x7fd4c419a5f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0005940 tx=0x7fd4b00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:58.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.095+0000 7fd4c1ffb640 1 -- 172.21.15.78:0/1774097549 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b003f030 con 0x7fd4c41076e0 2024-09-11T00:20:58.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.095+0000 7fd4c1ffb640 1 -- 172.21.15.78:0/1774097549 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4b0003cb0 con 0x7fd4c41076e0 2024-09-11T00:20:58.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.095+0000 7fd4c1ffb640 1 -- 172.21.15.78:0/1774097549 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0035070 con 0x7fd4c41076e0 2024-09-11T00:20:58.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.095+0000 7fd4cb0c0640 1 -- 172.21.15.78:0/1774097549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c41a5720 con 0x7fd4c41076e0 2024-09-11T00:20:58.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.095+0000 7fd4cb0c0640 1 -- 172.21.15.78:0/1774097549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c41a5bb0 con 0x7fd4c41076e0 2024-09-11T00:20:58.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.097+0000 7fd4c1ffb640 1 -- 172.21.15.78:0/1774097549 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fd4b003bbf0 con 0x7fd4c41076e0 2024-09-11T00:20:58.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.097+0000 7fd4cd495740 1 Processor -- start 2024-09-11T00:20:58.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.097+0000 7fd4cd495740 1 -- start start 2024-09-11T00:20:58.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.098+0000 7fd4cd495740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557cd338bee0 0x557cd338c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:58.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.098+0000 7fd4cd495740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557cd338c800 0x557cd3398250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:58.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.098+0000 7fd4cd495740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd3398790 0x557cd339ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:58.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.098+0000 7fd4cd495740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557cd3302e60 con 0x557cd3398790 2024-09-11T00:20:58.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.098+0000 7fd4cd495740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557cd32f2290 con 0x557cd338bee0 2024-09-11T00:20:58.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.098+0000 7fd4cd495740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x557cd32f60a0 con 0x557cd338c800 2024-09-11T00:20:58.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.098+0000 7fd4c3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd3398790 0x557cd339ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:58.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.098+0000 7fd4c3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd3398790 0x557cd339ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53756/0 (socket says 172.21.15.78:53756) 2024-09-11T00:20:58.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.098+0000 7fd4c3fff640 1 -- 172.21.15.78:0/847204846 learned_addr learned my addr 172.21.15.78:0/847204846 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:58.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.098+0000 7fd4c965d640 1 --2- 172.21.15.78:0/847204846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557cd338bee0 0x557cd338c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:58.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.098+0000 7fd4c8e5c640 1 --2- 172.21.15.78:0/847204846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557cd338c800 0x557cd3398250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:58.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.098+0000 7fd4c1ffb640 1 --2- 172.21.15.78:0/1774097549 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd4b40b5450 0x7fd4b40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:58.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.098+0000 7fd4c3fff640 1 -- 172.21.15.78:0/847204846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557cd338c800 msgr2=0x557cd3398250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:58.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.098+0000 7fd4c3fff640 1 --2- 172.21.15.78:0/847204846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557cd338c800 0x557cd3398250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.098+0000 7fd4c3fff640 1 -- 172.21.15.78:0/847204846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557cd338bee0 msgr2=0x557cd338c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:58.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.098+0000 7fd4c3fff640 1 --2- 172.21.15.78:0/847204846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557cd338bee0 0x557cd338c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.098+0000 7fd4c3fff640 1 -- 172.21.15.78:0/847204846 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cd3050930 con 0x557cd3398790 2024-09-11T00:20:58.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.098+0000 7fd4c965d640 1 --2- 172.21.15.78:0/1774097549 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd4b40b5450 0x7fd4b40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:58.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.099+0000 7fd4c3fff640 1 --2- 172.21.15.78:0/847204846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd3398790 0x557cd339ab80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd4b01042a0 tx=0x7fd4b00c96e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d638f9b51467206 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:58.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.099+0000 7fd4c1ffb640 1 -- 172.21.15.78:0/1774097549 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fd4b0106bf0 con 0x7fd4c41076e0 2024-09-11T00:20:58.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.099+0000 7fd4aeffd640 1 -- 172.21.15.78:0/847204846 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b00b2e60 con 0x557cd3398790 2024-09-11T00:20:58.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.099+0000 7fd4c965d640 1 --2- 172.21.15.78:0/1774097549 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd4b40b5450 0x7fd4b40b7910 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd4c419b090 tx=0x7fd4bc004a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:58.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.099+0000 7fd4aeffd640 1 -- 172.21.15.78:0/847204846 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4b00ccba0 con 0x557cd3398790 2024-09-11T00:20:58.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.099+0000 7fd4aeffd640 1 -- 172.21.15.78:0/847204846 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b00cce60 con 0x557cd3398790 2024-09-11T00:20:58.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.100+0000 7fd4cd495740 1 -- 172.21.15.78:0/847204846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd3398790 msgr2=0x557cd339ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:58.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.100+0000 7fd4cd495740 1 --2- 172.21.15.78:0/847204846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd3398790 0x557cd339ab80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd4b01042a0 tx=0x7fd4b00c96e0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.100+0000 7fd4cd495740 1 -- 172.21.15.78:0/847204846 shutdown_connections 2024-09-11T00:20:58.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.100+0000 7fd4cd495740 1 --2- 172.21.15.78:0/847204846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd3398790 0x557cd339ab80 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.100+0000 7fd4cd495740 1 --2- 172.21.15.78:0/847204846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557cd338c800 0x557cd3398250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.100+0000 7fd4cd495740 1 --2- 172.21.15.78:0/847204846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557cd338bee0 0x557cd338c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.100+0000 7fd4cd495740 1 -- 172.21.15.78:0/847204846 >> 172.21.15.78:0/847204846 conn(0x557cd3389d10 msgr2=0x557cd338aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:58.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.100+0000 7fd4cd495740 1 -- 172.21.15.78:0/847204846 shutdown_connections 2024-09-11T00:20:58.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.100+0000 7fd4cd495740 1 -- 172.21.15.78:0/847204846 wait complete. 2024-09-11T00:20:58.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.100+0000 7fd4cd495740 1 -- start start 2024-09-11T00:20:58.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.100+0000 7fd4cd495740 1 Processor -- start 2024-09-11T00:20:58.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.100+0000 7fd4cd495740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd338bee0 0x557cd33957c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:58.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.100+0000 7fd4cd495740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557cd338c800 0x557cd3395d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:58.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.100+0000 7fd4cd495740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557cd3398790 0x557cd3396240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:58.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.100+0000 7fd4cd495740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557cd3153890 con 0x557cd338bee0 2024-09-11T00:20:58.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.100+0000 7fd4cd495740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557cd328cd40 con 0x557cd338c800 2024-09-11T00:20:58.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.100+0000 7fd4cd495740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x557cd339b200 con 0x557cd3398790 2024-09-11T00:20:58.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.101+0000 7fd4cd495740 10 client.0 _ll_register_callbacks cb 0x557cd32f0c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:20:58.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.101+0000 7fd4c8e5c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd338bee0 0x557cd33957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:58.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.101+0000 7fd4c8e5c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd338bee0 0x557cd33957c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53758/0 (socket says 172.21.15.78:53758) 2024-09-11T00:20:58.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.101+0000 7fd4c8e5c640 1 -- 172.21.15.78:0/4009096303 learned_addr learned my addr 172.21.15.78:0/4009096303 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:58.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.101+0000 7fd4c3fff640 1 --2- 172.21.15.78:0/4009096303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557cd338c800 0x557cd3395d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:58.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.101+0000 7fd4c965d640 1 --2- 172.21.15.78:0/4009096303 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557cd3398790 0x557cd3396240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:58.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.101+0000 7fd4c8e5c640 1 -- 172.21.15.78:0/4009096303 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557cd3398790 msgr2=0x557cd3396240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:58.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.101+0000 7fd4c8e5c640 1 --2- 172.21.15.78:0/4009096303 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557cd3398790 0x557cd3396240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.101+0000 7fd4c8e5c640 1 -- 172.21.15.78:0/4009096303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557cd338c800 msgr2=0x557cd3395d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:58.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.101+0000 7fd4c8e5c640 1 --2- 172.21.15.78:0/4009096303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557cd338c800 0x557cd3395d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.101+0000 7fd4c8e5c640 1 -- 172.21.15.78:0/4009096303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cd33a4550 con 0x557cd338bee0 2024-09-11T00:20:58.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.101+0000 7fd4c965d640 1 --2- 172.21.15.78:0/4009096303 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557cd3398790 0x557cd3396240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:20:58.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.101+0000 7fd4c8e5c640 1 --2- 172.21.15.78:0/4009096303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd338bee0 0x557cd33957c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800f7b0 tx=0x7fd4b800fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63f44c38e7cb324 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:58.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.101+0000 7fd4a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:20:58.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.101+0000 7fd4a3fff640 1 -- 172.21.15.78:0/4009096303 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b800bd10 con 0x557cd338bee0 2024-09-11T00:20:58.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.101+0000 7fd4a3fff640 1 -- 172.21.15.78:0/4009096303 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fd4b801b480 con 0x557cd338bee0 2024-09-11T00:20:58.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.101+0000 7fd4cd495740 1 -- 172.21.15.78:0/4009096303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4b00ccba0 con 0x557cd338bee0 2024-09-11T00:20:58.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.101+0000 7fd4a3fff640 1 -- 172.21.15.78:0/4009096303 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd4b801b680 con 0x557cd338bee0 2024-09-11T00:20:58.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.101+0000 7fd4cd495740 10 client.15936 fetch_fsmap learned FSMap version 20 2024-09-11T00:20:58.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.101+0000 7fd4cd495740 1 -- 172.21.15.78:0/4009096303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557cd33a6f40 con 0x557cd338bee0 2024-09-11T00:20:58.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.102+0000 7fd4a3fff640 1 -- 172.21.15.78:0/4009096303 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4b00ccba0 con 0x557cd338bee0 2024-09-11T00:20:58.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.102+0000 7fd4a3fff640 1 -- 172.21.15.78:0/4009096303 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd4b8010800 con 0x557cd338bee0 2024-09-11T00:20:58.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.102+0000 7fd4cd495740 10 client.15936 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:20:58.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.102+0000 7fd4cd495740 10 client.15936 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:20:58.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.102+0000 7fd4cd495740 20 client.15936 populate_metadata read hostname 'smithi078' 2024-09-11T00:20:58.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.102+0000 7fd4cd495740 1 --2- 172.21.15.78:0/4009096303 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557cd33a8450 0x557cd33aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:58.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.102+0000 7fd4cd495740 4 client.15936 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:20:58.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.102+0000 7fd4cd495740 1 -- 172.21.15.78:0/4009096303 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557cd3304db0 con 0x557cd33a8450 2024-09-11T00:20:58.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.102+0000 7fd4c3fff640 1 --2- 172.21.15.78:0/4009096303 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557cd33a8450 0x557cd33aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:58.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.103+0000 7fd4a3fff640 10 client.15936 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:58.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.103+0000 7fd4c3fff640 1 --2- 172.21.15.78:0/4009096303 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557cd33a8450 0x557cd33aa8b0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c0bfa679c9aad05 server_cookie=2bbffaf7e2efbb0 in_seq=0 out_seq=0 2024-09-11T00:20:58.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.103+0000 7fd4a3fff640 1 -- 172.21.15.78:0/4009096303 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557cd3304db0 con 0x557cd33a8450 2024-09-11T00:20:58.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.103+0000 7fd4a3fff640 10 client.15936 handle_command_reply: tid=0 2024-09-11T00:20:58.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.104+0000 7fd4cd495740 1 client.15936 shutdown 2024-09-11T00:20:58.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.104+0000 7fd4cd495740 1 -- 172.21.15.78:0/4009096303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd338bee0 msgr2=0x557cd33957c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:58.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.104+0000 7fd4cd495740 1 --2- 172.21.15.78:0/4009096303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd338bee0 0x557cd33957c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800f7b0 tx=0x7fd4b800fc70 comp rx=0 tx=0).stop 2024-09-11T00:20:58.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.104+0000 7fd4cd495740 1 -- 172.21.15.78:0/4009096303 shutdown_connections 2024-09-11T00:20:58.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.104+0000 7fd4cd495740 1 --2- 172.21.15.78:0/4009096303 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557cd33a8450 0x557cd33aa8b0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.104+0000 7fd4cd495740 1 --2- 172.21.15.78:0/4009096303 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557cd3398790 0x557cd3396240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.104+0000 7fd4a3fff640 0 client.15936 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:58.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.104+0000 7fd4cd495740 1 --2- 172.21.15.78:0/4009096303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557cd338c800 0x557cd3395d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.104+0000 7fd4cd495740 1 --2- 172.21.15.78:0/4009096303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd338bee0 0x557cd33957c0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.104+0000 7fd4cd495740 1 -- 172.21.15.78:0/4009096303 >> 172.21.15.78:0/4009096303 conn(0x557cd3389d10 msgr2=0x557cd3388f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:58.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.104+0000 7fd4cd495740 1 -- 172.21.15.78:0/4009096303 shutdown_connections 2024-09-11T00:20:58.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.104+0000 7fd4cd495740 1 -- 172.21.15.78:0/4009096303 wait complete. 2024-09-11T00:20:58.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.104+0000 7fd4cd495740 20 client.15936 trim_cache size 0 max 16384 2024-09-11T00:20:58.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.122+0000 7fd4cd495740 1 Processor -- start 2024-09-11T00:20:58.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.122+0000 7fd4cd495740 1 -- start start 2024-09-11T00:20:58.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.122+0000 7fd4cd495740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd338bee0 0x557cd3395cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:58.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.122+0000 7fd4cd495740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557cd338c800 0x557cd3396200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:58.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.122+0000 7fd4cd495740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557cd3398790 0x557cd33929d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:58.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.122+0000 7fd4cd495740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c41ac6f0 con 0x557cd338bee0 2024-09-11T00:20:58.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.122+0000 7fd4cd495740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c41aef70 con 0x557cd338c800 2024-09-11T00:20:58.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.122+0000 7fd4cd495740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c41acd60 con 0x557cd3398790 2024-09-11T00:20:58.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.122+0000 7fd4c8e5c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd338bee0 0x557cd3395cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:58.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.122+0000 7fd4c8e5c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd338bee0 0x557cd3395cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53772/0 (socket says 172.21.15.78:53772) 2024-09-11T00:20:58.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.122+0000 7fd4c8e5c640 1 -- 172.21.15.78:0/3017540362 learned_addr learned my addr 172.21.15.78:0/3017540362 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:58.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.122+0000 7fd4c8e5c640 1 -- 172.21.15.78:0/3017540362 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557cd3398790 msgr2=0x557cd33929d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:58.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.122+0000 7fd4c8e5c640 1 --2- 172.21.15.78:0/3017540362 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557cd3398790 0x557cd33929d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.122+0000 7fd4c8e5c640 1 -- 172.21.15.78:0/3017540362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557cd338c800 msgr2=0x557cd3396200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:58.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.122+0000 7fd4c8e5c640 1 --2- 172.21.15.78:0/3017540362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557cd338c800 0x557cd3396200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.122+0000 7fd4c8e5c640 1 -- 172.21.15.78:0/3017540362 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cd3389b40 con 0x557cd338bee0 2024-09-11T00:20:58.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.123+0000 7fd4c8e5c640 1 --2- 172.21.15.78:0/3017540362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd338bee0 0x557cd3395cc0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800f780 tx=0x7fd4b8005ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35f5f0c6738486b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:58.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.123+0000 7fd4ae7fc640 1 -- 172.21.15.78:0/3017540362 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8028040 con 0x557cd338bee0 2024-09-11T00:20:58.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.123+0000 7fd4ae7fc640 1 -- 172.21.15.78:0/3017540362 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4b800b6f0 con 0x557cd338bee0 2024-09-11T00:20:58.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.123+0000 7fd4ae7fc640 1 -- 172.21.15.78:0/3017540362 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b801bb50 con 0x557cd338bee0 2024-09-11T00:20:58.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.123+0000 7fd4cd495740 1 -- 172.21.15.78:0/3017540362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd338bee0 msgr2=0x557cd3395cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:58.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.123+0000 7fd4cd495740 1 --2- 172.21.15.78:0/3017540362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd338bee0 0x557cd3395cc0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800f780 tx=0x7fd4b8005ed0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.124+0000 7fd4cd495740 1 -- 172.21.15.78:0/3017540362 shutdown_connections 2024-09-11T00:20:58.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.124+0000 7fd4cd495740 1 --2- 172.21.15.78:0/3017540362 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557cd3398790 0x557cd33929d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.124+0000 7fd4cd495740 1 --2- 172.21.15.78:0/3017540362 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557cd338c800 0x557cd3396200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.124+0000 7fd4cd495740 1 --2- 172.21.15.78:0/3017540362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd338bee0 0x557cd3395cc0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.124+0000 7fd4cd495740 1 -- 172.21.15.78:0/3017540362 >> 172.21.15.78:0/3017540362 conn(0x557cd3389d10 msgr2=0x557cd3397610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:58.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.124+0000 7fd4cd495740 1 -- 172.21.15.78:0/3017540362 shutdown_connections 2024-09-11T00:20:58.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.124+0000 7fd4cd495740 1 -- 172.21.15.78:0/3017540362 wait complete. 2024-09-11T00:20:58.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.124+0000 7fd4cd495740 1 -- start start 2024-09-11T00:20:58.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.124+0000 7fd4cd495740 1 Processor -- start 2024-09-11T00:20:58.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.124+0000 7fd4cd495740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd338bee0 0x557cd340e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:58.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.124+0000 7fd4cd495740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557cd338c800 0x557cd340ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:58.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.124+0000 7fd4cd495740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557cd3398790 0x557cd339cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:58.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.124+0000 7fd4cd495740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c41ad430 con 0x557cd338bee0 2024-09-11T00:20:58.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.124+0000 7fd4cd495740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c41ae8a0 con 0x557cd338c800 2024-09-11T00:20:58.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.124+0000 7fd4cd495740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c41adb00 con 0x557cd3398790 2024-09-11T00:20:58.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.124+0000 7fd4cd495740 10 client.0 _ll_register_callbacks cb 0x7fd4b800d400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:20:58.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.124+0000 7fd4c8e5c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd338bee0 0x557cd340e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:58.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.125+0000 7fd4c8e5c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd338bee0 0x557cd340e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53782/0 (socket says 172.21.15.78:53782) 2024-09-11T00:20:58.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.125+0000 7fd4c8e5c640 1 -- 172.21.15.78:0/282281082 learned_addr learned my addr 172.21.15.78:0/282281082 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:58.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.125+0000 7fd4c3fff640 1 --2- 172.21.15.78:0/282281082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557cd338c800 0x557cd340ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:58.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.125+0000 7fd4c965d640 1 --2- 172.21.15.78:0/282281082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557cd3398790 0x557cd339cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:58.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.125+0000 7fd4c8e5c640 1 -- 172.21.15.78:0/282281082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557cd3398790 msgr2=0x557cd339cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:58.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.125+0000 7fd4c8e5c640 1 --2- 172.21.15.78:0/282281082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557cd3398790 0x557cd339cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.125+0000 7fd4c8e5c640 1 -- 172.21.15.78:0/282281082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557cd338c800 msgr2=0x557cd340ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.125+0000 7fd4c8e5c640 1 --2- 172.21.15.78:0/282281082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557cd338c800 0x557cd340ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.125+0000 7fd4c8e5c640 1 -- 172.21.15.78:0/282281082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cd339d310 con 0x557cd338bee0 2024-09-11T00:20:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.125+0000 7fd4c3fff640 1 --2- 172.21.15.78:0/282281082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557cd338c800 0x557cd340ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.125+0000 7fd4c8e5c640 1 --2- 172.21.15.78:0/282281082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd338bee0 0x557cd340e650 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8010c70 tx=0x7fd4b8005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c285b37ea58b6c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.125+0000 7fd4a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:20:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.125+0000 7fd4a3fff640 1 -- 172.21.15.78:0/282281082 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b803a060 con 0x557cd338bee0 2024-09-11T00:20:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.125+0000 7fd4a3fff640 1 -- 172.21.15.78:0/282281082 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fd4b801b890 con 0x557cd338bee0 2024-09-11T00:20:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.125+0000 7fd4cd495740 1 -- 172.21.15.78:0/282281082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4b800b6f0 con 0x557cd338bee0 2024-09-11T00:20:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.125+0000 7fd4a3fff640 1 -- 172.21.15.78:0/282281082 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd4b8028070 con 0x557cd338bee0 2024-09-11T00:20:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.125+0000 7fd4cd495740 10 client.15942 fetch_fsmap learned FSMap version 20 2024-09-11T00:20:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.125+0000 7fd4cd495740 1 -- 172.21.15.78:0/282281082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557cd3415fa0 con 0x557cd338bee0 2024-09-11T00:20:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.125+0000 7fd4a3fff640 1 -- 172.21.15.78:0/282281082 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4b800b6f0 con 0x557cd338bee0 2024-09-11T00:20:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.126+0000 7fd4a3fff640 1 -- 172.21.15.78:0/282281082 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd4b802b070 con 0x557cd338bee0 2024-09-11T00:20:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.126+0000 7fd4cd495740 10 client.15942 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:20:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.126+0000 7fd4cd495740 10 client.15942 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:20:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.126+0000 7fd4cd495740 20 client.15942 populate_metadata read hostname 'smithi078' 2024-09-11T00:20:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.126+0000 7fd4cd495740 1 --2- 172.21.15.78:0/282281082 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557cd3416610 0x557cd3418a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.126+0000 7fd4cd495740 4 client.15942 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:20:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.126+0000 7fd4cd495740 1 -- 172.21.15.78:0/282281082 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557cd3300860 con 0x557cd3416610 2024-09-11T00:20:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.126+0000 7fd4c3fff640 1 --2- 172.21.15.78:0/282281082 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557cd3416610 0x557cd3418a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.126+0000 7fd4c3fff640 1 --2- 172.21.15.78:0/282281082 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557cd3416610 0x557cd3418a00 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d46c10d8b3e05ac server_cookie=ea06e865aeeee007 in_seq=0 out_seq=0 2024-09-11T00:20:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.126+0000 7fd4a3fff640 10 client.15942 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.128+0000 7fd4a3fff640 1 -- 172.21.15.78:0/282281082 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557cd3300860 con 0x557cd3416610 2024-09-11T00:20:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.128+0000 7fd4a3fff640 10 client.15942 handle_command_reply: tid=0 2024-09-11T00:20:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.128+0000 7fd4cd495740 1 client.15942 shutdown 2024-09-11T00:20:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.128+0000 7fd4cd495740 1 -- 172.21.15.78:0/282281082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd338bee0 msgr2=0x557cd340e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.128+0000 7fd4cd495740 1 --2- 172.21.15.78:0/282281082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd338bee0 0x557cd340e650 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8010c70 tx=0x7fd4b8005be0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.128+0000 7fd4cd495740 1 -- 172.21.15.78:0/282281082 shutdown_connections 2024-09-11T00:20:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.128+0000 7fd4cd495740 1 --2- 172.21.15.78:0/282281082 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557cd3416610 0x557cd3418a00 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.128+0000 7fd4a3fff640 0 client.15942 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.128+0000 7fd4cd495740 1 --2- 172.21.15.78:0/282281082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557cd3398790 0x557cd339cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.128+0000 7fd4cd495740 1 --2- 172.21.15.78:0/282281082 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557cd338c800 0x557cd340ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.128+0000 7fd4cd495740 1 --2- 172.21.15.78:0/282281082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557cd338bee0 0x557cd340e650 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.128+0000 7fd4cd495740 1 -- 172.21.15.78:0/282281082 >> 172.21.15.78:0/282281082 conn(0x557cd3389d10 msgr2=0x557cd3388750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.128+0000 7fd4cd495740 1 -- 172.21.15.78:0/282281082 shutdown_connections 2024-09-11T00:20:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.128+0000 7fd4cd495740 1 -- 172.21.15.78:0/282281082 wait complete. 2024-09-11T00:20:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.128+0000 7fd4cd495740 20 client.15942 trim_cache size 0 max 16384 2024-09-11T00:20:58.147 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:20:58.147 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-11T00:20:58.147 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "38a1d30d-5f4c-460a-afcd-e6c60b97e43a", 2024-09-11T00:20:58.147 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-11T00:20:58.147 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:20:58.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.129+0000 7fd4cb0c0640 1 -- 172.21.15.78:0/1774097549 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd4b40b5450 msgr2=0x7fd4b40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:58.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.129+0000 7fd4cb0c0640 1 --2- 172.21.15.78:0/1774097549 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd4b40b5450 0x7fd4b40b7910 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd4c419b090 tx=0x7fd4bc004a40 comp rx=0 tx=0).stop 2024-09-11T00:20:58.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.129+0000 7fd4cb0c0640 1 -- 172.21.15.78:0/1774097549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4c41076e0 msgr2=0x7fd4c419a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:58.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.129+0000 7fd4cb0c0640 1 --2- 172.21.15.78:0/1774097549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4c41076e0 0x7fd4c419a5f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0005940 tx=0x7fd4b00042f0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.129+0000 7fd4cb0c0640 1 -- 172.21.15.78:0/1774097549 shutdown_connections 2024-09-11T00:20:58.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.129+0000 7fd4cb0c0640 1 --2- 172.21.15.78:0/1774097549 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd4b40b5450 0x7fd4b40b7910 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.129+0000 7fd4cb0c0640 1 --2- 172.21.15.78:0/1774097549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4c4108060 0x7fd4c419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.129+0000 7fd4cb0c0640 1 --2- 172.21.15.78:0/1774097549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4c41076e0 0x7fd4c419a5f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.129+0000 7fd4cb0c0640 1 --2- 172.21.15.78:0/1774097549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd4c4101cd0 0x7fd4c419a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:58.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.129+0000 7fd4cb0c0640 1 -- 172.21.15.78:0/1774097549 >> 172.21.15.78:0/1774097549 conn(0x7fd4c40fd700 msgr2=0x7fd4c40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:58.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.129+0000 7fd4cb0c0640 1 -- 172.21.15.78:0/1774097549 shutdown_connections 2024-09-11T00:20:58.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:58.129+0000 7fd4cb0c0640 1 -- 172.21.15.78:0/1774097549 wait complete. 2024-09-11T00:20:58.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:57 smithi112 ceph-mon[35627]: pgmap v458: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:58.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:57 smithi138 ceph-mon[35019]: pgmap v458: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:20:58.927 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:20:59.168 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:20:59.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:58 smithi112 ceph-mon[35627]: scrub queued for path: / 2024-09-11T00:20:59.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:58 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:20:59.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:58 smithi112 ceph-mon[35627]: scrub summary: active paths [/] 2024-09-11T00:20:59.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:58 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:20:59.288 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:58 smithi078 ceph-mon[30865]: scrub queued for path: / 2024-09-11T00:20:59.288 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:58 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:20:59.288 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:58 smithi078 ceph-mon[30865]: scrub summary: active paths [/] 2024-09-11T00:20:59.288 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:58 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:20:59.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:58 smithi138 ceph-mon[35019]: scrub queued for path: / 2024-09-11T00:20:59.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:58 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:20:59.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:58 smithi138 ceph-mon[35019]: scrub summary: active paths [/] 2024-09-11T00:20:59.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:58 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:20:59.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.685+0000 7fa564dcc640 1 -- 172.21.15.78:0/1293002071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5601076e0 msgr2=0x7fa560107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:59.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.685+0000 7fa564dcc640 1 --2- 172.21.15.78:0/1293002071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5601076e0 0x7fa560107b20 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa548009900 tx=0x7fa54802a410 comp rx=0 tx=0).stop 2024-09-11T00:20:59.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.685+0000 7fa564dcc640 1 -- 172.21.15.78:0/1293002071 shutdown_connections 2024-09-11T00:20:59.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.685+0000 7fa564dcc640 1 --2- 172.21.15.78:0/1293002071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa560108060 0x7fa56010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.685+0000 7fa564dcc640 1 --2- 172.21.15.78:0/1293002071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5601076e0 0x7fa560107b20 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.685+0000 7fa564dcc640 1 --2- 172.21.15.78:0/1293002071 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa560101cd0 0x7fa5601020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.685+0000 7fa564dcc640 1 -- 172.21.15.78:0/1293002071 >> 172.21.15.78:0/1293002071 conn(0x7fa5600fd700 msgr2=0x7fa5600ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:59.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.685+0000 7fa564dcc640 1 -- 172.21.15.78:0/1293002071 shutdown_connections 2024-09-11T00:20:59.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.685+0000 7fa564dcc640 1 -- 172.21.15.78:0/1293002071 wait complete. 2024-09-11T00:20:59.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.685+0000 7fa564dcc640 1 Processor -- start 2024-09-11T00:20:59.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.685+0000 7fa564dcc640 1 -- start start 2024-09-11T00:20:59.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa564dcc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa560101cd0 0x7fa56019a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:59.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa564dcc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5601076e0 0x7fa56019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:59.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa564dcc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa560108060 0x7fa56019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:59.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa564dcc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa560111d20 con 0x7fa560101cd0 2024-09-11T00:20:59.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa564dcc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa560111ba0 con 0x7fa5601076e0 2024-09-11T00:20:59.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa564dcc640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa560111ea0 con 0x7fa560108060 2024-09-11T00:20:59.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa55e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa560101cd0 0x7fa56019a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:59.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa55e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa560101cd0 0x7fa56019a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53804/0 (socket says 172.21.15.78:53804) 2024-09-11T00:20:59.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa55e59c640 1 -- 172.21.15.78:0/816365790 learned_addr learned my addr 172.21.15.78:0/816365790 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:59.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa557fff640 1 --2- 172.21.15.78:0/816365790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5601076e0 0x7fa56019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:59.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa55ed9d640 1 --2- 172.21.15.78:0/816365790 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa560108060 0x7fa56019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:59.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa55e59c640 1 -- 172.21.15.78:0/816365790 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa560108060 msgr2=0x7fa56019ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:59.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa55e59c640 1 --2- 172.21.15.78:0/816365790 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa560108060 0x7fa56019ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa55e59c640 1 -- 172.21.15.78:0/816365790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5601076e0 msgr2=0x7fa56019a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:59.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa55e59c640 1 --2- 172.21.15.78:0/816365790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5601076e0 0x7fa56019a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa55e59c640 1 -- 172.21.15.78:0/816365790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5601a54d0 con 0x7fa560101cd0 2024-09-11T00:20:59.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa557fff640 1 --2- 172.21.15.78:0/816365790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5601076e0 0x7fa56019a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:59.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa55ed9d640 1 --2- 172.21.15.78:0/816365790 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa560108060 0x7fa56019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:59.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa55e59c640 1 --2- 172.21.15.78:0/816365790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa560101cd0 0x7fa56019a0d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa55000c890 tx=0x7fa55000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:59.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa5577fe640 1 -- 172.21.15.78:0/816365790 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550004220 con 0x7fa560101cd0 2024-09-11T00:20:59.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa5577fe640 1 -- 172.21.15.78:0/816365790 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5500043c0 con 0x7fa560101cd0 2024-09-11T00:20:59.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa564dcc640 1 -- 172.21.15.78:0/816365790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5601a57c0 con 0x7fa560101cd0 2024-09-11T00:20:59.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa5577fe640 1 -- 172.21.15.78:0/816365790 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550004a00 con 0x7fa560101cd0 2024-09-11T00:20:59.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.686+0000 7fa564dcc640 1 -- 172.21.15.78:0/816365790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5601a5d80 con 0x7fa560101cd0 2024-09-11T00:20:59.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.689+0000 7fa5671a1740 1 Processor -- start 2024-09-11T00:20:59.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.689+0000 7fa5577fe640 1 -- 172.21.15.78:0/816365790 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fa5500079b0 con 0x7fa560101cd0 2024-09-11T00:20:59.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.689+0000 7fa5671a1740 1 -- start start 2024-09-11T00:20:59.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.689+0000 7fa5671a1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cbf8011480 0x55cbf8011860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:59.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.689+0000 7fa5671a1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf8011da0 0x55cbf801d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:59.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.689+0000 7fa5671a1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cbf801dd30 0x55cbf8020120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:59.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.689+0000 7fa5671a1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55cbf7f87e50 con 0x55cbf8011da0 2024-09-11T00:20:59.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.689+0000 7fa5671a1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55cbf7f77280 con 0x55cbf801dd30 2024-09-11T00:20:59.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.689+0000 7fa5671a1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55cbf7f7b090 con 0x55cbf8011480 2024-09-11T00:20:59.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.689+0000 7fa55e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf8011da0 0x55cbf801d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:59.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.689+0000 7fa55e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf8011da0 0x55cbf801d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53806/0 (socket says 172.21.15.78:53806) 2024-09-11T00:20:59.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.689+0000 7fa55e59c640 1 -- 172.21.15.78:0/719091383 learned_addr learned my addr 172.21.15.78:0/719091383 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:59.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.690+0000 7fa55ed9d640 1 --2- 172.21.15.78:0/719091383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cbf8011480 0x55cbf8011860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:59.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.690+0000 7fa557fff640 1 --2- 172.21.15.78:0/719091383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cbf801dd30 0x55cbf8020120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:59.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.690+0000 7fa55e59c640 1 -- 172.21.15.78:0/719091383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cbf8011480 msgr2=0x55cbf8011860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:59.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.690+0000 7fa55e59c640 1 --2- 172.21.15.78:0/719091383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cbf8011480 0x55cbf8011860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.690+0000 7fa55e59c640 1 -- 172.21.15.78:0/719091383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cbf801dd30 msgr2=0x55cbf8020120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:59.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.690+0000 7fa55e59c640 1 --2- 172.21.15.78:0/719091383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cbf801dd30 0x55cbf8020120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.690+0000 7fa55e59c640 1 -- 172.21.15.78:0/719091383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbf7cd5650 con 0x55cbf8011da0 2024-09-11T00:20:59.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.690+0000 7fa557fff640 1 --2- 172.21.15.78:0/719091383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cbf801dd30 0x55cbf8020120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:59.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.690+0000 7fa5577fe640 1 --2- 172.21.15.78:0/816365790 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa54c0b5450 0x7fa54c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:59.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.690+0000 7fa55e59c640 1 --2- 172.21.15.78:0/719091383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf8011da0 0x55cbf801d7f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa5500e34f0 tx=0x7fa5500ee5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a110275fd34c38 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:59.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.690+0000 7fa55ed9d640 1 --2- 172.21.15.78:0/816365790 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa54c0b5450 0x7fa54c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:59.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.690+0000 7fa5577fe640 1 -- 172.21.15.78:0/816365790 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fa5500e5e10 con 0x7fa560101cd0 2024-09-11T00:20:59.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.690+0000 7fa554ff9640 1 -- 172.21.15.78:0/719091383 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5500a8900 con 0x55cbf8011da0 2024-09-11T00:20:59.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.690+0000 7fa554ff9640 1 -- 172.21.15.78:0/719091383 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa550005290 con 0x55cbf8011da0 2024-09-11T00:20:59.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.690+0000 7fa554ff9640 1 -- 172.21.15.78:0/719091383 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5500aba20 con 0x55cbf8011da0 2024-09-11T00:20:59.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.691+0000 7fa5671a1740 1 -- 172.21.15.78:0/719091383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf8011da0 msgr2=0x55cbf801d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:59.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.691+0000 7fa5671a1740 1 --2- 172.21.15.78:0/719091383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf8011da0 0x55cbf801d7f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa5500e34f0 tx=0x7fa5500ee5f0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.691+0000 7fa55ed9d640 1 --2- 172.21.15.78:0/816365790 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa54c0b5450 0x7fa54c0b7910 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa558007f90 tx=0x7fa558007520 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:59.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.691+0000 7fa5671a1740 1 -- 172.21.15.78:0/719091383 shutdown_connections 2024-09-11T00:20:59.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.691+0000 7fa5671a1740 1 --2- 172.21.15.78:0/719091383 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cbf801dd30 0x55cbf8020120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.691+0000 7fa5671a1740 1 --2- 172.21.15.78:0/719091383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf8011da0 0x55cbf801d7f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.691+0000 7fa5671a1740 1 --2- 172.21.15.78:0/719091383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cbf8011480 0x55cbf8011860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.691+0000 7fa5671a1740 1 -- 172.21.15.78:0/719091383 >> 172.21.15.78:0/719091383 conn(0x55cbf800f2b0 msgr2=0x55cbf8010450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:59.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.691+0000 7fa5671a1740 1 -- 172.21.15.78:0/719091383 shutdown_connections 2024-09-11T00:20:59.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.691+0000 7fa5671a1740 1 -- 172.21.15.78:0/719091383 wait complete. 2024-09-11T00:20:59.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.691+0000 7fa5671a1740 1 -- start start 2024-09-11T00:20:59.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.692+0000 7fa5671a1740 1 Processor -- start 2024-09-11T00:20:59.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.692+0000 7fa5671a1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cbf8011480 0x55cbf801d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:59.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.692+0000 7fa5671a1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cbf8011da0 0x55cbf801ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:59.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.692+0000 7fa5671a1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf801dd30 0x55cbf801b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:59.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.692+0000 7fa5671a1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55cbf7dd8700 con 0x55cbf801dd30 2024-09-11T00:20:59.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.692+0000 7fa5671a1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55cbf7f12110 con 0x55cbf8011da0 2024-09-11T00:20:59.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.692+0000 7fa5671a1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55cbf80209b0 con 0x55cbf8011480 2024-09-11T00:20:59.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.692+0000 7fa5671a1740 10 client.0 _ll_register_callbacks cb 0x55cbf7f2b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:20:59.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.692+0000 7fa55ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf801dd30 0x55cbf801b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:59.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.692+0000 7fa55ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf801dd30 0x55cbf801b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53820/0 (socket says 172.21.15.78:53820) 2024-09-11T00:20:59.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.692+0000 7fa55ed9d640 1 -- 172.21.15.78:0/1834190180 learned_addr learned my addr 172.21.15.78:0/1834190180 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:59.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.692+0000 7fa557fff640 1 --2- 172.21.15.78:0/1834190180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cbf8011da0 0x55cbf801ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:59.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.692+0000 7fa55e59c640 1 --2- 172.21.15.78:0/1834190180 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cbf8011480 0x55cbf801d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:59.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.692+0000 7fa55ed9d640 1 -- 172.21.15.78:0/1834190180 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cbf8011480 msgr2=0x55cbf801d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:59.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.692+0000 7fa55ed9d640 1 --2- 172.21.15.78:0/1834190180 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cbf8011480 0x55cbf801d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.692+0000 7fa55ed9d640 1 -- 172.21.15.78:0/1834190180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cbf8011da0 msgr2=0x55cbf801ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:59.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.692+0000 7fa55ed9d640 1 --2- 172.21.15.78:0/1834190180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cbf8011da0 0x55cbf801ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.692+0000 7fa55ed9d640 1 -- 172.21.15.78:0/1834190180 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbf7f3fc40 con 0x55cbf801dd30 2024-09-11T00:20:59.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.692+0000 7fa557fff640 1 --2- 172.21.15.78:0/1834190180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cbf8011da0 0x55cbf801ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:20:59.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.692+0000 7fa55ed9d640 1 --2- 172.21.15.78:0/1834190180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf801dd30 0x55cbf801b130 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa558010e10 tx=0x7fa558004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d950825305c939 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:59.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.692+0000 7fa545ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:20:59.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.693+0000 7fa545ffb640 1 -- 172.21.15.78:0/1834190180 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa558021070 con 0x55cbf801dd30 2024-09-11T00:20:59.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.693+0000 7fa545ffb640 1 -- 172.21.15.78:0/1834190180 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fa55801d450 con 0x55cbf801dd30 2024-09-11T00:20:59.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.693+0000 7fa5671a1740 1 -- 172.21.15.78:0/1834190180 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cbf7f89da0 con 0x55cbf801dd30 2024-09-11T00:20:59.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.693+0000 7fa545ffb640 1 -- 172.21.15.78:0/1834190180 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa55802d050 con 0x55cbf801dd30 2024-09-11T00:20:59.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.693+0000 7fa5671a1740 10 client.15954 fetch_fsmap learned FSMap version 20 2024-09-11T00:20:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.693+0000 7fa5671a1740 1 -- 172.21.15.78:0/1834190180 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55cbf802c330 con 0x55cbf801dd30 2024-09-11T00:20:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.693+0000 7fa545ffb640 1 -- 172.21.15.78:0/1834190180 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55cbf7f89da0 con 0x55cbf801dd30 2024-09-11T00:20:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.693+0000 7fa545ffb640 1 -- 172.21.15.78:0/1834190180 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa558025a40 con 0x55cbf801dd30 2024-09-11T00:20:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.693+0000 7fa5671a1740 10 client.15954 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:20:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.693+0000 7fa5671a1740 10 client.15954 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:20:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.693+0000 7fa5671a1740 20 client.15954 populate_metadata read hostname 'smithi078' 2024-09-11T00:20:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.693+0000 7fa5671a1740 1 --2- 172.21.15.78:0/1834190180 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55cbf802d7e0 0x55cbf802fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.693+0000 7fa5671a1740 4 client.15954 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:20:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.693+0000 7fa5671a1740 1 -- 172.21.15.78:0/1834190180 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbf7f85850 con 0x55cbf802d7e0 2024-09-11T00:20:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.694+0000 7fa55e59c640 1 --2- 172.21.15.78:0/1834190180 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55cbf802d7e0 0x55cbf802fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.694+0000 7fa55e59c640 1 --2- 172.21.15.78:0/1834190180 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55cbf802d7e0 0x55cbf802fc20 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67340a0e763205cc server_cookie=61d8f099cbd5c57b in_seq=0 out_seq=0 2024-09-11T00:20:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.694+0000 7fa545ffb640 10 client.15954 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.695+0000 7fa545ffb640 1 -- 172.21.15.78:0/1834190180 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cbf7f85850 con 0x55cbf802d7e0 2024-09-11T00:20:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.695+0000 7fa545ffb640 10 client.15954 handle_command_reply: tid=0 2024-09-11T00:20:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.695+0000 7fa5671a1740 1 client.15954 shutdown 2024-09-11T00:20:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.695+0000 7fa5671a1740 1 -- 172.21.15.78:0/1834190180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf801dd30 msgr2=0x55cbf801b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.695+0000 7fa5671a1740 1 --2- 172.21.15.78:0/1834190180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf801dd30 0x55cbf801b130 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa558010e10 tx=0x7fa558004a40 comp rx=0 tx=0).stop 2024-09-11T00:20:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.695+0000 7fa5671a1740 1 -- 172.21.15.78:0/1834190180 shutdown_connections 2024-09-11T00:20:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.695+0000 7fa5671a1740 1 --2- 172.21.15.78:0/1834190180 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55cbf802d7e0 0x55cbf802fc20 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.695+0000 7fa5671a1740 1 --2- 172.21.15.78:0/1834190180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf801dd30 0x55cbf801b130 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.695+0000 7fa5671a1740 1 --2- 172.21.15.78:0/1834190180 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cbf8011da0 0x55cbf801ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.695+0000 7fa545ffb640 0 client.15954 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.695+0000 7fa5671a1740 1 --2- 172.21.15.78:0/1834190180 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cbf8011480 0x55cbf801d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.695+0000 7fa5671a1740 1 -- 172.21.15.78:0/1834190180 >> 172.21.15.78:0/1834190180 conn(0x55cbf800f2b0 msgr2=0x55cbf8014e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:59.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.695+0000 7fa5671a1740 1 -- 172.21.15.78:0/1834190180 shutdown_connections 2024-09-11T00:20:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.695+0000 7fa5671a1740 1 -- 172.21.15.78:0/1834190180 wait complete. 2024-09-11T00:20:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.695+0000 7fa5671a1740 20 client.15954 trim_cache size 0 max 16384 2024-09-11T00:20:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.712+0000 7fa5671a1740 1 Processor -- start 2024-09-11T00:20:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.712+0000 7fa5671a1740 1 -- start start 2024-09-11T00:20:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.712+0000 7fa5671a1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf8011480 0x55cbf8029be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.712+0000 7fa5671a1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cbf8011da0 0x55cbf8017d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.712+0000 7fa5671a1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cbf801dd30 0x55cbf8018250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.712+0000 7fa5671a1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa5601ac810 con 0x55cbf8011480 2024-09-11T00:20:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.712+0000 7fa5671a1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa5601af090 con 0x55cbf801dd30 2024-09-11T00:20:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.712+0000 7fa5671a1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa5601ace80 con 0x55cbf8011da0 2024-09-11T00:20:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.712+0000 7fa55e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf8011480 0x55cbf8029be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.712+0000 7fa55e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf8011480 0x55cbf8029be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53824/0 (socket says 172.21.15.78:53824) 2024-09-11T00:20:59.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.712+0000 7fa55e59c640 1 -- 172.21.15.78:0/3360787113 learned_addr learned my addr 172.21.15.78:0/3360787113 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.712+0000 7fa557fff640 1 --2- 172.21.15.78:0/3360787113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cbf8011da0 0x55cbf8017d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.712+0000 7fa55e59c640 1 -- 172.21.15.78:0/3360787113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cbf8011da0 msgr2=0x55cbf8017d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.712+0000 7fa55e59c640 1 --2- 172.21.15.78:0/3360787113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cbf8011da0 0x55cbf8017d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.713+0000 7fa55e59c640 1 -- 172.21.15.78:0/3360787113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cbf801dd30 msgr2=0x55cbf8018250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.713+0000 7fa55e59c640 1 --2- 172.21.15.78:0/3360787113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cbf801dd30 0x55cbf8018250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.713+0000 7fa55e59c640 1 -- 172.21.15.78:0/3360787113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbf8011bd0 con 0x55cbf8011480 2024-09-11T00:20:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.713+0000 7fa557fff640 1 --2- 172.21.15.78:0/3360787113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cbf8011da0 0x55cbf8017d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:20:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.713+0000 7fa55e59c640 1 --2- 172.21.15.78:0/3360787113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf8011480 0x55cbf8029be0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa5500e3b80 tx=0x7fa5500e5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774137c6d866b718 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.713+0000 7fa547fff640 1 -- 172.21.15.78:0/3360787113 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55001d040 con 0x55cbf8011480 2024-09-11T00:20:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.713+0000 7fa547fff640 1 -- 172.21.15.78:0/3360787113 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa55005b070 con 0x55cbf8011480 2024-09-11T00:20:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.713+0000 7fa547fff640 1 -- 172.21.15.78:0/3360787113 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5500abc00 con 0x55cbf8011480 2024-09-11T00:20:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.713+0000 7fa5671a1740 1 -- 172.21.15.78:0/3360787113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf8011480 msgr2=0x55cbf8029be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:59.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.713+0000 7fa5671a1740 1 --2- 172.21.15.78:0/3360787113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf8011480 0x55cbf8029be0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa5500e3b80 tx=0x7fa5500e5040 comp rx=0 tx=0).stop 2024-09-11T00:20:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.713+0000 7fa5671a1740 1 -- 172.21.15.78:0/3360787113 shutdown_connections 2024-09-11T00:20:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.713+0000 7fa5671a1740 1 --2- 172.21.15.78:0/3360787113 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cbf801dd30 0x55cbf8018250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.713+0000 7fa5671a1740 1 --2- 172.21.15.78:0/3360787113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cbf8011da0 0x55cbf8017d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.713+0000 7fa5671a1740 1 --2- 172.21.15.78:0/3360787113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf8011480 0x55cbf8029be0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.713+0000 7fa5671a1740 1 -- 172.21.15.78:0/3360787113 >> 172.21.15.78:0/3360787113 conn(0x55cbf800f2b0 msgr2=0x55cbf8019380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.713+0000 7fa5671a1740 1 -- 172.21.15.78:0/3360787113 shutdown_connections 2024-09-11T00:20:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.713+0000 7fa5671a1740 1 -- 172.21.15.78:0/3360787113 wait complete. 2024-09-11T00:20:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.714+0000 7fa5671a1740 1 -- start start 2024-09-11T00:20:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.714+0000 7fa5671a1740 1 Processor -- start 2024-09-11T00:20:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.714+0000 7fa5671a1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cbf8011480 0x55cbf8025f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.714+0000 7fa5671a1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf8011da0 0x55cbf80264b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:59.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.714+0000 7fa5671a1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cbf801dd30 0x55cbf8020c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.714+0000 7fa5671a1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa5601ad550 con 0x55cbf8011da0 2024-09-11T00:20:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.714+0000 7fa5671a1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa5601ae9c0 con 0x55cbf8011480 2024-09-11T00:20:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.714+0000 7fa5671a1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa5601adc20 con 0x55cbf801dd30 2024-09-11T00:20:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.714+0000 7fa5671a1740 10 client.0 _ll_register_callbacks cb 0x7fa558014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:20:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.714+0000 7fa557fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf8011da0 0x55cbf80264b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.714+0000 7fa557fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf8011da0 0x55cbf80264b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53830/0 (socket says 172.21.15.78:53830) 2024-09-11T00:20:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.714+0000 7fa557fff640 1 -- 172.21.15.78:0/1650998396 learned_addr learned my addr 172.21.15.78:0/1650998396 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:20:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.714+0000 7fa55ed9d640 1 --2- 172.21.15.78:0/1650998396 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cbf801dd30 0x55cbf8020c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.714+0000 7fa557fff640 1 -- 172.21.15.78:0/1650998396 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cbf801dd30 msgr2=0x55cbf8020c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.714+0000 7fa55e59c640 1 --2- 172.21.15.78:0/1650998396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cbf8011480 0x55cbf8025f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.714+0000 7fa557fff640 1 --2- 172.21.15.78:0/1650998396 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cbf801dd30 0x55cbf8020c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.714+0000 7fa557fff640 1 -- 172.21.15.78:0/1650998396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cbf8011480 msgr2=0x55cbf8025f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:20:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.714+0000 7fa557fff640 1 --2- 172.21.15.78:0/1650998396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cbf8011480 0x55cbf8025f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.714+0000 7fa557fff640 1 -- 172.21.15.78:0/1650998396 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbf80214b0 con 0x55cbf8011da0 2024-09-11T00:20:59.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.714+0000 7fa55ed9d640 1 --2- 172.21.15.78:0/1650998396 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cbf801dd30 0x55cbf8020c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:20:59.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.715+0000 7fa557fff640 1 --2- 172.21.15.78:0/1650998396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf8011da0 0x55cbf80264b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa548009900 tx=0x7fa548031810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c900e60a0ffcfb8f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:20:59.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.715+0000 7fa545ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:20:59.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.715+0000 7fa545ffb640 1 -- 172.21.15.78:0/1650998396 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54803f070 con 0x55cbf8011da0 2024-09-11T00:20:59.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.715+0000 7fa545ffb640 1 -- 172.21.15.78:0/1650998396 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fa548004450 con 0x55cbf8011da0 2024-09-11T00:20:59.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.715+0000 7fa5671a1740 1 -- 172.21.15.78:0/1650998396 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa55005b070 con 0x55cbf8011da0 2024-09-11T00:20:59.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.715+0000 7fa545ffb640 1 -- 172.21.15.78:0/1650998396 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa548035070 con 0x55cbf8011da0 2024-09-11T00:20:59.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.715+0000 7fa5671a1740 10 client.15960 fetch_fsmap learned FSMap version 20 2024-09-11T00:20:59.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.715+0000 7fa5671a1740 1 -- 172.21.15.78:0/1650998396 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55cbf809b240 con 0x55cbf8011da0 2024-09-11T00:20:59.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.715+0000 7fa545ffb640 1 -- 172.21.15.78:0/1650998396 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa55005b070 con 0x55cbf8011da0 2024-09-11T00:20:59.745 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:20:59.745 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:20:59.745 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-11T00:20:59.745 INFO:teuthology.orchestra.run.smithi078.stdout: "38a1d30d-5f4c-460a-afcd-e6c60b97e43a": { 2024-09-11T00:20:59.745 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:59.745 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "38a1d30d-5f4c-460a-afcd-e6c60b97e43a", 2024-09-11T00:20:59.745 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-11T00:20:59.745 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:20:59.745 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:59.745 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:20:59.746 INFO:teuthology.orchestra.run.smithi078.stdout: "8ec9e858-aa62-420d-a112-e62ea7810e63": { 2024-09-11T00:20:59.746 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:18.882749+0000", 2024-09-11T00:20:59.746 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:59.746 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:59.746 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:59.746 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:59.746 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:59.746 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:59.746 INFO:teuthology.orchestra.run.smithi078.stdout: "38a1d30d-5f4c-460a-afcd-e6c60b97e43a": { 2024-09-11T00:20:59.746 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:58.127727+0000", 2024-09-11T00:20:59.746 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:59.746 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:59.746 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:59.747 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:59.747 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:59.747 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:59.747 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:20:59.747 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:20:59.747 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:59.747 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:59.747 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:59.747 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:59.747 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:59.747 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:59.747 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:20:59.747 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:20:59.747 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:59.747 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:59.748 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:59.748 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:59.748 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:59.748 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:59.748 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:20:59.748 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:20:59.748 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:59.748 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:59.748 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:59.748 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:59.748 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:59.748 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:59.748 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:20:59.748 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:20:59.749 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:59.749 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:59.749 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:59.749 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:59.749 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:59.749 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:59.749 INFO:teuthology.orchestra.run.smithi078.stdout: "b854cbd3-8ca7-4277-a205-8887d2ff5567": { 2024-09-11T00:20:59.749 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:11.182949+0000", 2024-09-11T00:20:59.749 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:59.749 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:59.749 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:59.749 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:59.749 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:59.749 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:59.750 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:20:59.750 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:20:59.750 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:59.750 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:59.750 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:59.750 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:59.750 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:59.750 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:20:59.750 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:20:59.750 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:20:59.750 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:20:59.750 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:20:59.750 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:20:59.750 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:20:59.751 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:20:59.751 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:20:59.751 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:20:59.751 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:20:59.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.715+0000 7fa545ffb640 1 -- 172.21.15.78:0/1650998396 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa548004be0 con 0x55cbf8011da0 2024-09-11T00:20:59.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.715+0000 7fa5671a1740 10 client.15960 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:20:59.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.715+0000 7fa5671a1740 10 client.15960 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:20:59.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.715+0000 7fa5671a1740 20 client.15960 populate_metadata read hostname 'smithi078' 2024-09-11T00:20:59.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.715+0000 7fa5671a1740 1 --2- 172.21.15.78:0/1650998396 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55cbf809b9f0 0x55cbf809de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:20:59.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.715+0000 7fa5671a1740 4 client.15960 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:20:59.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.715+0000 7fa5671a1740 1 -- 172.21.15.78:0/1650998396 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cbf7f82c80 con 0x55cbf809b9f0 2024-09-11T00:20:59.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.716+0000 7fa55e59c640 1 --2- 172.21.15.78:0/1650998396 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55cbf809b9f0 0x55cbf809de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:20:59.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.716+0000 7fa545ffb640 10 client.15960 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:59.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.716+0000 7fa55e59c640 1 --2- 172.21.15.78:0/1650998396 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55cbf809b9f0 0x55cbf809de10 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72ea35e9914bd01d server_cookie=fbffe0f348177583 in_seq=0 out_seq=0 2024-09-11T00:20:59.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.716+0000 7fa545ffb640 1 -- 172.21.15.78:0/1650998396 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x55cbf7f82c80 con 0x55cbf809b9f0 2024-09-11T00:20:59.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.716+0000 7fa545ffb640 10 client.15960 handle_command_reply: tid=0 2024-09-11T00:20:59.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.716+0000 7fa5671a1740 1 client.15960 shutdown 2024-09-11T00:20:59.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.716+0000 7fa5671a1740 1 -- 172.21.15.78:0/1650998396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf8011da0 msgr2=0x55cbf80264b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:59.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.716+0000 7fa5671a1740 1 --2- 172.21.15.78:0/1650998396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf8011da0 0x55cbf80264b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa548009900 tx=0x7fa548031810 comp rx=0 tx=0).stop 2024-09-11T00:20:59.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.716+0000 7fa5671a1740 1 -- 172.21.15.78:0/1650998396 shutdown_connections 2024-09-11T00:20:59.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.716+0000 7fa5671a1740 1 --2- 172.21.15.78:0/1650998396 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55cbf809b9f0 0x55cbf809de10 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.716+0000 7fa5671a1740 1 --2- 172.21.15.78:0/1650998396 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cbf801dd30 0x55cbf8020c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.716+0000 7fa5671a1740 1 --2- 172.21.15.78:0/1650998396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cbf8011da0 0x55cbf80264b0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.716+0000 7fa5671a1740 1 --2- 172.21.15.78:0/1650998396 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55cbf8011480 0x55cbf8025f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.716+0000 7fa545ffb640 0 client.15960 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:20:59.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.716+0000 7fa5671a1740 1 -- 172.21.15.78:0/1650998396 >> 172.21.15.78:0/1650998396 conn(0x55cbf800f2b0 msgr2=0x55cbf800dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:59.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.716+0000 7fa5671a1740 1 -- 172.21.15.78:0/1650998396 shutdown_connections 2024-09-11T00:20:59.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.716+0000 7fa5671a1740 1 -- 172.21.15.78:0/1650998396 wait complete. 2024-09-11T00:20:59.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.717+0000 7fa5671a1740 20 client.15960 trim_cache size 0 max 16384 2024-09-11T00:20:59.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.717+0000 7fa564dcc640 1 -- 172.21.15.78:0/816365790 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa54c0b5450 msgr2=0x7fa54c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:59.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.717+0000 7fa564dcc640 1 --2- 172.21.15.78:0/816365790 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa54c0b5450 0x7fa54c0b7910 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa558007f90 tx=0x7fa558007520 comp rx=0 tx=0).stop 2024-09-11T00:20:59.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.717+0000 7fa564dcc640 1 -- 172.21.15.78:0/816365790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa560101cd0 msgr2=0x7fa56019a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:20:59.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.717+0000 7fa564dcc640 1 --2- 172.21.15.78:0/816365790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa560101cd0 0x7fa56019a0d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa55000c890 tx=0x7fa55000cd50 comp rx=0 tx=0).stop 2024-09-11T00:20:59.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.717+0000 7fa564dcc640 1 -- 172.21.15.78:0/816365790 shutdown_connections 2024-09-11T00:20:59.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.717+0000 7fa564dcc640 1 --2- 172.21.15.78:0/816365790 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa54c0b5450 0x7fa54c0b7910 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.717+0000 7fa564dcc640 1 --2- 172.21.15.78:0/816365790 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa560108060 0x7fa56019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.717+0000 7fa564dcc640 1 --2- 172.21.15.78:0/816365790 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa5601076e0 0x7fa56019a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.717+0000 7fa564dcc640 1 --2- 172.21.15.78:0/816365790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa560101cd0 0x7fa56019a0d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:20:59.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.717+0000 7fa564dcc640 1 -- 172.21.15.78:0/816365790 >> 172.21.15.78:0/816365790 conn(0x7fa5600fd700 msgr2=0x7fa5600ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:20:59.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.717+0000 7fa564dcc640 1 -- 172.21.15.78:0/816365790 shutdown_connections 2024-09-11T00:20:59.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:20:59.717+0000 7fa564dcc640 1 -- 172.21.15.78:0/816365790 wait complete. 2024-09-11T00:21:00.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:20:59 smithi112 ceph-mon[35627]: pgmap v459: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:21:00.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:20:59 smithi138 ceph-mon[35019]: pgmap v459: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:21:00.311 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:20:59 smithi078 ceph-mon[30865]: pgmap v459: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:21:00.476 INFO:tasks.cephfs.filesystem:scrub status for tag:38a1d30d-5f4c-460a-afcd-e6c60b97e43a - {'path': '/', 'tag': '38a1d30d-5f4c-460a-afcd-e6c60b97e43a', 'options': 'recursive,force'} 2024-09-11T00:21:01.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:01 smithi078 ceph-mon[30865]: scrub summary: idle 2024-09-11T00:21:01.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:01 smithi112 ceph-mon[35627]: scrub summary: idle 2024-09-11T00:21:01.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:01 smithi138 ceph-mon[35019]: scrub summary: idle 2024-09-11T00:21:02.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:02 smithi078 ceph-mon[30865]: pgmap v460: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-11T00:21:02.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:02 smithi112 ceph-mon[35627]: pgmap v460: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-11T00:21:02.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:02 smithi138 ceph-mon[35019]: pgmap v460: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-11T00:21:04.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:03 smithi112 ceph-mon[35627]: pgmap v461: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:21:04.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:03 smithi138 ceph-mon[35019]: pgmap v461: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:21:04.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:03 smithi078 ceph-mon[30865]: pgmap v461: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:21:06.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:05 smithi112 ceph-mon[35627]: pgmap v462: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T00:21:06.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:05 smithi138 ceph-mon[35019]: pgmap v462: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T00:21:06.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:05 smithi078 ceph-mon[30865]: pgmap v462: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T00:21:08.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:07 smithi112 ceph-mon[35627]: pgmap v463: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:21:08.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:07 smithi138 ceph-mon[35019]: pgmap v463: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:21:08.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:07 smithi078 ceph-mon[30865]: pgmap v463: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:21:10.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:09 smithi112 ceph-mon[35627]: pgmap v464: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:21:10.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:09 smithi138 ceph-mon[35019]: pgmap v464: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:21:10.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:09 smithi078 ceph-mon[30865]: pgmap v464: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:21:12.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:11 smithi112 ceph-mon[35627]: pgmap v465: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T00:21:12.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:11 smithi138 ceph-mon[35019]: pgmap v465: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T00:21:12.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:11 smithi078 ceph-mon[30865]: pgmap v465: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T00:21:14.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:13 smithi112 ceph-mon[35627]: pgmap v466: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 12 KiB/s wr, 3 op/s 2024-09-11T00:21:14.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:13 smithi138 ceph-mon[35019]: pgmap v466: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 12 KiB/s wr, 3 op/s 2024-09-11T00:21:14.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:13 smithi078 ceph-mon[30865]: pgmap v466: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 12 KiB/s wr, 3 op/s 2024-09-11T00:21:16.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:15 smithi112 ceph-mon[35627]: pgmap v467: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-11T00:21:16.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:15 smithi138 ceph-mon[35019]: pgmap v467: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-11T00:21:16.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:15 smithi078 ceph-mon[30865]: pgmap v467: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-11T00:21:18.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:17 smithi112 ceph-mon[35627]: pgmap v468: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-11T00:21:18.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:17 smithi138 ceph-mon[35019]: pgmap v468: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-11T00:21:18.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:17 smithi078 ceph-mon[30865]: pgmap v468: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-11T00:21:20.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:19 smithi112 ceph-mon[35627]: pgmap v469: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-11T00:21:20.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:19 smithi138 ceph-mon[35019]: pgmap v469: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-11T00:21:20.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:19 smithi078 ceph-mon[30865]: pgmap v469: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-11T00:21:22.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:21 smithi112 ceph-mon[35627]: pgmap v470: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-11T00:21:22.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:21 smithi138 ceph-mon[35019]: pgmap v470: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-11T00:21:22.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:21 smithi078 ceph-mon[30865]: pgmap v470: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-11T00:21:24.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:23 smithi112 ceph-mon[35627]: pgmap v471: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:21:24.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:23 smithi138 ceph-mon[35019]: pgmap v471: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:21:24.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:23 smithi078 ceph-mon[30865]: pgmap v471: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:21:26.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:25 smithi112 ceph-mon[35627]: pgmap v472: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:21:26.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:25 smithi138 ceph-mon[35019]: pgmap v472: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:21:26.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:25 smithi078 ceph-mon[30865]: pgmap v472: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:21:28.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:27 smithi112 ceph-mon[35627]: pgmap v473: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:21:28.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:27 smithi138 ceph-mon[35019]: pgmap v473: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:21:28.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:27 smithi078 ceph-mon[30865]: pgmap v473: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:21:30.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:29 smithi112 ceph-mon[35627]: pgmap v474: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:21:30.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:29 smithi138 ceph-mon[35019]: pgmap v474: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:21:30.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:29 smithi078 ceph-mon[30865]: pgmap v474: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:21:30.477 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:21:30.738 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:21:31.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.325+0000 7f5b8471c640 1 -- 172.21.15.78:0/10490869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b7c10d100 msgr2=0x7f5b7c10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:31.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.325+0000 7f5b8471c640 1 --2- 172.21.15.78:0/10490869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b7c10d100 0x7f5b7c10f560 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009ca0 tx=0x7f5b7402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.325+0000 7f5b8471c640 1 -- 172.21.15.78:0/10490869 shutdown_connections 2024-09-11T00:21:31.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.325+0000 7f5b8471c640 1 --2- 172.21.15.78:0/10490869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b7c10d100 0x7f5b7c10f560 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.325+0000 7f5b8471c640 1 --2- 172.21.15.78:0/10490869 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b7c1045c0 0x7f5b7c10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.325+0000 7f5b8471c640 1 --2- 172.21.15.78:0/10490869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b7c103ca0 0x7f5b7c104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.325+0000 7f5b8471c640 1 -- 172.21.15.78:0/10490869 >> 172.21.15.78:0/10490869 conn(0x7f5b7c0fd700 msgr2=0x7f5b7c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:31.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.325+0000 7f5b8471c640 1 -- 172.21.15.78:0/10490869 shutdown_connections 2024-09-11T00:21:31.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.325+0000 7f5b8471c640 1 -- 172.21.15.78:0/10490869 wait complete. 2024-09-11T00:21:31.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.326+0000 7f5b8471c640 1 Processor -- start 2024-09-11T00:21:31.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.326+0000 7f5b8471c640 1 -- start start 2024-09-11T00:21:31.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.326+0000 7f5b8471c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b7c103ca0 0x7f5b7c101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:31.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.326+0000 7f5b8471c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b7c1045c0 0x7f5b7c101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:31.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.326+0000 7f5b8471c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b7c10d100 0x7f5b7c1023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:31.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.326+0000 7f5b8471c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c112d70 con 0x7f5b7c1045c0 2024-09-11T00:21:31.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.326+0000 7f5b8471c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c112bf0 con 0x7f5b7c10d100 2024-09-11T00:21:31.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.326+0000 7f5b8471c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c112ef0 con 0x7f5b7c103ca0 2024-09-11T00:21:31.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.326+0000 7f5b81cb7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b7c1045c0 0x7f5b7c101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:31.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.326+0000 7f5b81cb7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b7c1045c0 0x7f5b7c101e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38004/0 (socket says 172.21.15.78:38004) 2024-09-11T00:21:31.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.326+0000 7f5b81cb7640 1 -- 172.21.15.78:0/3592362778 learned_addr learned my addr 172.21.15.78:0/3592362778 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:21:31.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.326+0000 7f5b824b8640 1 --2- 172.21.15.78:0/3592362778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b7c103ca0 0x7f5b7c101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:31.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.327+0000 7f5b82cb9640 1 --2- 172.21.15.78:0/3592362778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b7c10d100 0x7f5b7c1023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:31.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.327+0000 7f5b81cb7640 1 -- 172.21.15.78:0/3592362778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b7c103ca0 msgr2=0x7f5b7c101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:31.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.327+0000 7f5b81cb7640 1 --2- 172.21.15.78:0/3592362778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b7c103ca0 0x7f5b7c101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.327+0000 7f5b81cb7640 1 -- 172.21.15.78:0/3592362778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b7c10d100 msgr2=0x7f5b7c1023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:31.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.327+0000 7f5b81cb7640 1 --2- 172.21.15.78:0/3592362778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b7c10d100 0x7f5b7c1023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.327+0000 7f5b81cb7640 1 -- 172.21.15.78:0/3592362778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b7c1a75e0 con 0x7f5b7c1045c0 2024-09-11T00:21:31.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.327+0000 7f5b81cb7640 1 --2- 172.21.15.78:0/3592362778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b7c1045c0 0x7f5b7c101e90 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00c970 tx=0x7f5b6c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:31.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.327+0000 7f5b737fe640 1 -- 172.21.15.78:0/3592362778 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c00ae60 con 0x7f5b7c1045c0 2024-09-11T00:21:31.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.327+0000 7f5b737fe640 1 -- 172.21.15.78:0/3592362778 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b6c004220 con 0x7f5b7c1045c0 2024-09-11T00:21:31.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.327+0000 7f5b8471c640 1 -- 172.21.15.78:0/3592362778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b7c1a78d0 con 0x7f5b7c1045c0 2024-09-11T00:21:31.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.327+0000 7f5b737fe640 1 -- 172.21.15.78:0/3592362778 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c003d60 con 0x7f5b7c1045c0 2024-09-11T00:21:31.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.327+0000 7f5b8471c640 1 -- 172.21.15.78:0/3592362778 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b7c1a7e10 con 0x7f5b7c1045c0 2024-09-11T00:21:31.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.330+0000 7f5b737fe640 1 -- 172.21.15.78:0/3592362778 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f5b6c0079b0 con 0x7f5b7c1045c0 2024-09-11T00:21:31.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.330+0000 7f5b86af1740 1 Processor -- start 2024-09-11T00:21:31.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.330+0000 7f5b86af1740 1 -- start start 2024-09-11T00:21:31.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.330+0000 7f5b86af1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee4fc9c480 0x55ee4fc9c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:31.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.330+0000 7f5b86af1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fc9cda0 0x55ee4fca87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:31.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.330+0000 7f5b86af1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ee4fca8d30 0x55ee4fcab120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:31.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.330+0000 7f5b86af1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ee4fc12e50 con 0x55ee4fc9cda0 2024-09-11T00:21:31.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.330+0000 7f5b86af1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ee4fc02280 con 0x55ee4fc9c480 2024-09-11T00:21:31.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.330+0000 7f5b86af1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55ee4fc06090 con 0x55ee4fca8d30 2024-09-11T00:21:31.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.330+0000 7f5b824b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fc9cda0 0x55ee4fca87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:31.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.330+0000 7f5b824b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fc9cda0 0x55ee4fca87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38010/0 (socket says 172.21.15.78:38010) 2024-09-11T00:21:31.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.330+0000 7f5b824b8640 1 -- 172.21.15.78:0/191493513 learned_addr learned my addr 172.21.15.78:0/191493513 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:21:31.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.330+0000 7f5b82cb9640 1 --2- 172.21.15.78:0/191493513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee4fc9c480 0x55ee4fc9c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:31.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.330+0000 7f5b81cb7640 1 --2- 172.21.15.78:0/191493513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ee4fca8d30 0x55ee4fcab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:31.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.331+0000 7f5b824b8640 1 -- 172.21.15.78:0/191493513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ee4fca8d30 msgr2=0x55ee4fcab120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:31.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.331+0000 7f5b824b8640 1 --2- 172.21.15.78:0/191493513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ee4fca8d30 0x55ee4fcab120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.331+0000 7f5b824b8640 1 -- 172.21.15.78:0/191493513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee4fc9c480 msgr2=0x55ee4fc9c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:31.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.331+0000 7f5b824b8640 1 --2- 172.21.15.78:0/191493513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee4fc9c480 0x55ee4fc9c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.331+0000 7f5b824b8640 1 -- 172.21.15.78:0/191493513 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee4f960650 con 0x55ee4fc9cda0 2024-09-11T00:21:31.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.331+0000 7f5b737fe640 1 --2- 172.21.15.78:0/3592362778 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5b680b5450 0x7f5b680b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:31.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.331+0000 7f5b824b8640 1 --2- 172.21.15.78:0/191493513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fc9cda0 0x55ee4fca87f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800ad00 tx=0x7f5b7800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8afaba7e7ca796 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:31.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.331+0000 7f5b82cb9640 1 --2- 172.21.15.78:0/3592362778 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5b680b5450 0x7f5b680b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:31.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.331+0000 7f5b737fe640 1 -- 172.21.15.78:0/3592362778 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f5b6c0e5bf0 con 0x7f5b7c1045c0 2024-09-11T00:21:31.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.331+0000 7f5b70ff9640 1 -- 172.21.15.78:0/191493513 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7801d070 con 0x55ee4fc9cda0 2024-09-11T00:21:31.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.331+0000 7f5b70ff9640 1 -- 172.21.15.78:0/191493513 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b78018af0 con 0x55ee4fc9cda0 2024-09-11T00:21:31.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.331+0000 7f5b70ff9640 1 -- 172.21.15.78:0/191493513 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b78010b90 con 0x55ee4fc9cda0 2024-09-11T00:21:31.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.332+0000 7f5b86af1740 1 -- 172.21.15.78:0/191493513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fc9cda0 msgr2=0x55ee4fca87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:31.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.332+0000 7f5b82cb9640 1 --2- 172.21.15.78:0/3592362778 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5b680b5450 0x7f5b680b7910 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5b74005fa0 tx=0x7f5b74005c30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:31.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.332+0000 7f5b86af1740 1 --2- 172.21.15.78:0/191493513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fc9cda0 0x55ee4fca87f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800ad00 tx=0x7f5b7800f790 comp rx=0 tx=0).stop 2024-09-11T00:21:31.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.332+0000 7f5b86af1740 1 -- 172.21.15.78:0/191493513 shutdown_connections 2024-09-11T00:21:31.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.332+0000 7f5b86af1740 1 --2- 172.21.15.78:0/191493513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ee4fca8d30 0x55ee4fcab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.332+0000 7f5b86af1740 1 --2- 172.21.15.78:0/191493513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fc9cda0 0x55ee4fca87f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.332+0000 7f5b86af1740 1 --2- 172.21.15.78:0/191493513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee4fc9c480 0x55ee4fc9c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.332+0000 7f5b86af1740 1 -- 172.21.15.78:0/191493513 >> 172.21.15.78:0/191493513 conn(0x55ee4fc9a2b0 msgr2=0x55ee4fc9b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:31.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.332+0000 7f5b86af1740 1 -- 172.21.15.78:0/191493513 shutdown_connections 2024-09-11T00:21:31.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.332+0000 7f5b86af1740 1 -- 172.21.15.78:0/191493513 wait complete. 2024-09-11T00:21:31.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.332+0000 7f5b86af1740 1 -- start start 2024-09-11T00:21:31.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.332+0000 7f5b86af1740 1 Processor -- start 2024-09-11T00:21:31.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.332+0000 7f5b86af1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ee4fc9c480 0x55ee4fca85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:31.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b86af1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee4fc9cda0 0x55ee4fca5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:31.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b86af1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fca8d30 0x55ee4fca5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:31.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b86af1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ee4fa63700 con 0x55ee4fca8d30 2024-09-11T00:21:31.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b86af1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55ee4fb9d110 con 0x55ee4fc9cda0 2024-09-11T00:21:31.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b86af1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55ee4fcab9b0 con 0x55ee4fc9c480 2024-09-11T00:21:31.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b86af1740 10 client.0 _ll_register_callbacks cb 0x55ee4fbb6990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:21:31.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b82cb9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fca8d30 0x55ee4fca5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:31.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b82cb9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fca8d30 0x55ee4fca5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38018/0 (socket says 172.21.15.78:38018) 2024-09-11T00:21:31.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b82cb9640 1 -- 172.21.15.78:0/2169279060 learned_addr learned my addr 172.21.15.78:0/2169279060 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:21:31.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b824b8640 1 --2- 172.21.15.78:0/2169279060 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ee4fc9c480 0x55ee4fca85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:31.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b81cb7640 1 --2- 172.21.15.78:0/2169279060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee4fc9cda0 0x55ee4fca5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:31.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b82cb9640 1 -- 172.21.15.78:0/2169279060 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ee4fc9c480 msgr2=0x55ee4fca85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:31.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b82cb9640 1 --2- 172.21.15.78:0/2169279060 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ee4fc9c480 0x55ee4fca85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b82cb9640 1 -- 172.21.15.78:0/2169279060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee4fc9cda0 msgr2=0x55ee4fca5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:31.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b82cb9640 1 --2- 172.21.15.78:0/2169279060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee4fc9cda0 0x55ee4fca5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b82cb9640 1 -- 172.21.15.78:0/2169279060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee4fbcac40 con 0x55ee4fca8d30 2024-09-11T00:21:31.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b81cb7640 1 --2- 172.21.15.78:0/2169279060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee4fc9cda0 0x55ee4fca5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:21:31.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b824b8640 1 --2- 172.21.15.78:0/2169279060 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ee4fc9c480 0x55ee4fca85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:21:31.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b82cb9640 1 --2- 172.21.15.78:0/2169279060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fca8d30 0x55ee4fca5ff0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009ca0 tx=0x7f5b7402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b89b5854dc3c86 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:31.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:21:31.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b65ffb640 1 -- 172.21.15.78:0/2169279060 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b74003d80 con 0x55ee4fca8d30 2024-09-11T00:21:31.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b65ffb640 1 -- 172.21.15.78:0/2169279060 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f5b74004040 con 0x55ee4fca8d30 2024-09-11T00:21:31.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b86af1740 1 -- 172.21.15.78:0/2169279060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b78018af0 con 0x55ee4fca8d30 2024-09-11T00:21:31.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b65ffb640 1 -- 172.21.15.78:0/2169279060 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5b74004240 con 0x55ee4fca8d30 2024-09-11T00:21:31.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b86af1740 10 client.15972 fetch_fsmap learned FSMap version 20 2024-09-11T00:21:31.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.333+0000 7f5b86af1740 1 -- 172.21.15.78:0/2169279060 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ee4fcb7300 con 0x55ee4fca8d30 2024-09-11T00:21:31.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.334+0000 7f5b65ffb640 1 -- 172.21.15.78:0/2169279060 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b78018af0 con 0x55ee4fca8d30 2024-09-11T00:21:31.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.334+0000 7f5b65ffb640 1 -- 172.21.15.78:0/2169279060 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5b7405a070 con 0x55ee4fca8d30 2024-09-11T00:21:31.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.334+0000 7f5b86af1740 10 client.15972 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:21:31.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.334+0000 7f5b86af1740 10 client.15972 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:21:31.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.334+0000 7f5b86af1740 20 client.15972 populate_metadata read hostname 'smithi078' 2024-09-11T00:21:31.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.334+0000 7f5b86af1740 1 --2- 172.21.15.78:0/2169279060 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ee4fcb87b0 0x55ee4fcbac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:31.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.334+0000 7f5b86af1740 4 client.15972 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:21:31.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.334+0000 7f5b86af1740 1 -- 172.21.15.78:0/2169279060 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee4fc14da0 con 0x55ee4fcb87b0 2024-09-11T00:21:31.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.334+0000 7f5b824b8640 1 --2- 172.21.15.78:0/2169279060 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ee4fcb87b0 0x55ee4fcbac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:31.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.335+0000 7f5b65ffb640 10 client.15972 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:21:31.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.335+0000 7f5b824b8640 1 --2- 172.21.15.78:0/2169279060 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ee4fcb87b0 0x55ee4fcbac30 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12d3dd3b5b73baaa server_cookie=1bad0e328e4a5023 in_seq=0 out_seq=0 2024-09-11T00:21:31.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.335+0000 7f5b65ffb640 1 -- 172.21.15.78:0/2169279060 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ee4fc14da0 con 0x55ee4fcb87b0 2024-09-11T00:21:31.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.335+0000 7f5b65ffb640 10 client.15972 handle_command_reply: tid=0 2024-09-11T00:21:31.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.336+0000 7f5b86af1740 1 client.15972 shutdown 2024-09-11T00:21:31.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.336+0000 7f5b86af1740 1 -- 172.21.15.78:0/2169279060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fca8d30 msgr2=0x55ee4fca5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:31.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.336+0000 7f5b86af1740 1 --2- 172.21.15.78:0/2169279060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fca8d30 0x55ee4fca5ff0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009ca0 tx=0x7f5b7402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.336+0000 7f5b86af1740 1 -- 172.21.15.78:0/2169279060 shutdown_connections 2024-09-11T00:21:31.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.336+0000 7f5b86af1740 1 --2- 172.21.15.78:0/2169279060 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ee4fcb87b0 0x55ee4fcbac30 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.336+0000 7f5b86af1740 1 --2- 172.21.15.78:0/2169279060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fca8d30 0x55ee4fca5ff0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.336+0000 7f5b86af1740 1 --2- 172.21.15.78:0/2169279060 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee4fc9cda0 0x55ee4fca5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.336+0000 7f5b86af1740 1 --2- 172.21.15.78:0/2169279060 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ee4fc9c480 0x55ee4fca85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.336+0000 7f5b86af1740 1 -- 172.21.15.78:0/2169279060 >> 172.21.15.78:0/2169279060 conn(0x55ee4fc9a2b0 msgr2=0x55ee4fc9fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:31.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.336+0000 7f5b65ffb640 0 client.15972 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:21:31.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.336+0000 7f5b86af1740 1 -- 172.21.15.78:0/2169279060 shutdown_connections 2024-09-11T00:21:31.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.336+0000 7f5b86af1740 1 -- 172.21.15.78:0/2169279060 wait complete. 2024-09-11T00:21:31.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.336+0000 7f5b86af1740 20 client.15972 trim_cache size 0 max 16384 2024-09-11T00:21:31.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.353+0000 7f5b86af1740 1 Processor -- start 2024-09-11T00:21:31.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.353+0000 7f5b86af1740 1 -- start start 2024-09-11T00:21:31.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.353+0000 7f5b86af1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fc9c480 0x55ee4fcb4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:31.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.353+0000 7f5b86af1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ee4fc9cda0 0x55ee4fcaa120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:31.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.353+0000 7f5b86af1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee4fca8d30 0x55ee4fcaa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:31.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.354+0000 7f5b86af1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c1ae860 con 0x55ee4fc9c480 2024-09-11T00:21:31.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.354+0000 7f5b86af1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c1b10e0 con 0x55ee4fca8d30 2024-09-11T00:21:31.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.354+0000 7f5b86af1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c1aeed0 con 0x55ee4fc9cda0 2024-09-11T00:21:31.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.354+0000 7f5b824b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fc9c480 0x55ee4fcb4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:31.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.354+0000 7f5b824b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fc9c480 0x55ee4fcb4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38034/0 (socket says 172.21.15.78:38034) 2024-09-11T00:21:31.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.354+0000 7f5b824b8640 1 -- 172.21.15.78:0/1563709510 learned_addr learned my addr 172.21.15.78:0/1563709510 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:21:31.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.354+0000 7f5b81cb7640 1 --2- 172.21.15.78:0/1563709510 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ee4fc9cda0 0x55ee4fcaa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:31.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.354+0000 7f5b82cb9640 1 --2- 172.21.15.78:0/1563709510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee4fca8d30 0x55ee4fcaa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:31.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.354+0000 7f5b824b8640 1 -- 172.21.15.78:0/1563709510 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ee4fc9cda0 msgr2=0x55ee4fcaa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:31.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.354+0000 7f5b824b8640 1 --2- 172.21.15.78:0/1563709510 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ee4fc9cda0 0x55ee4fcaa120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.354+0000 7f5b824b8640 1 -- 172.21.15.78:0/1563709510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee4fca8d30 msgr2=0x55ee4fcaa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:31.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.354+0000 7f5b824b8640 1 --2- 172.21.15.78:0/1563709510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee4fca8d30 0x55ee4fcaa660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.354+0000 7f5b824b8640 1 -- 172.21.15.78:0/1563709510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee4fca8950 con 0x55ee4fc9c480 2024-09-11T00:21:31.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.354+0000 7f5b824b8640 1 --2- 172.21.15.78:0/1563709510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fc9c480 0x55ee4fcb4c40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800aac0 tx=0x7f5b7800a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6371495eb74c3f10 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:31.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.354+0000 7f5b67fff640 1 -- 172.21.15.78:0/1563709510 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7801d040 con 0x55ee4fc9c480 2024-09-11T00:21:31.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.354+0000 7f5b67fff640 1 -- 172.21.15.78:0/1563709510 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b78030070 con 0x55ee4fc9c480 2024-09-11T00:21:31.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.354+0000 7f5b67fff640 1 -- 172.21.15.78:0/1563709510 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b78010690 con 0x55ee4fc9c480 2024-09-11T00:21:31.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.355+0000 7f5b86af1740 1 -- 172.21.15.78:0/1563709510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fc9c480 msgr2=0x55ee4fcb4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:31.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.355+0000 7f5b86af1740 1 --2- 172.21.15.78:0/1563709510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fc9c480 0x55ee4fcb4c40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800aac0 tx=0x7f5b7800a510 comp rx=0 tx=0).stop 2024-09-11T00:21:31.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.355+0000 7f5b86af1740 1 -- 172.21.15.78:0/1563709510 shutdown_connections 2024-09-11T00:21:31.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.355+0000 7f5b86af1740 1 --2- 172.21.15.78:0/1563709510 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee4fca8d30 0x55ee4fcaa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.355+0000 7f5b86af1740 1 --2- 172.21.15.78:0/1563709510 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ee4fc9cda0 0x55ee4fcaa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.355+0000 7f5b86af1740 1 --2- 172.21.15.78:0/1563709510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fc9c480 0x55ee4fcb4c40 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.355+0000 7f5b86af1740 1 -- 172.21.15.78:0/1563709510 >> 172.21.15.78:0/1563709510 conn(0x55ee4fc9a2b0 msgr2=0x55ee4fca5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:31.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.355+0000 7f5b86af1740 1 -- 172.21.15.78:0/1563709510 shutdown_connections 2024-09-11T00:21:31.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.355+0000 7f5b86af1740 1 -- 172.21.15.78:0/1563709510 wait complete. 2024-09-11T00:21:31.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.355+0000 7f5b86af1740 1 -- start start 2024-09-11T00:21:31.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.356+0000 7f5b86af1740 1 Processor -- start 2024-09-11T00:21:31.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.356+0000 7f5b86af1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee4fc9c480 0x55ee4fcb1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:31.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.356+0000 7f5b86af1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ee4fc9cda0 0x55ee4fcc0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:31.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.356+0000 7f5b86af1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fca8d30 0x55ee4fcc0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:31.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.356+0000 7f5b86af1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c1af5a0 con 0x55ee4fca8d30 2024-09-11T00:21:31.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.356+0000 7f5b86af1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c1b0a10 con 0x55ee4fc9c480 2024-09-11T00:21:31.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.356+0000 7f5b86af1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c1afc70 con 0x55ee4fc9cda0 2024-09-11T00:21:31.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.356+0000 7f5b86af1740 10 client.0 _ll_register_callbacks cb 0x7f5b74009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:21:31.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.356+0000 7f5b82cb9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fca8d30 0x55ee4fcc0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:31.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.356+0000 7f5b82cb9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fca8d30 0x55ee4fcc0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38036/0 (socket says 172.21.15.78:38036) 2024-09-11T00:21:31.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.356+0000 7f5b82cb9640 1 -- 172.21.15.78:0/3634191581 learned_addr learned my addr 172.21.15.78:0/3634191581 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:21:31.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.356+0000 7f5b81cb7640 1 --2- 172.21.15.78:0/3634191581 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ee4fc9cda0 0x55ee4fcc0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:31.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.356+0000 7f5b824b8640 1 --2- 172.21.15.78:0/3634191581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee4fc9c480 0x55ee4fcb1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:31.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.356+0000 7f5b82cb9640 1 -- 172.21.15.78:0/3634191581 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ee4fc9cda0 msgr2=0x55ee4fcc0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:31.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.356+0000 7f5b82cb9640 1 --2- 172.21.15.78:0/3634191581 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ee4fc9cda0 0x55ee4fcc0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.356+0000 7f5b82cb9640 1 -- 172.21.15.78:0/3634191581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee4fc9c480 msgr2=0x55ee4fcb1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:31.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.356+0000 7f5b82cb9640 1 --2- 172.21.15.78:0/3634191581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee4fc9c480 0x55ee4fcb1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.356+0000 7f5b82cb9640 1 -- 172.21.15.78:0/3634191581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee4fcc0c80 con 0x55ee4fca8d30 2024-09-11T00:21:31.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.356+0000 7f5b824b8640 1 --2- 172.21.15.78:0/3634191581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee4fc9c480 0x55ee4fcb1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:21:31.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.356+0000 7f5b82cb9640 1 --2- 172.21.15.78:0/3634191581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fca8d30 0x55ee4fcc0570 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5b7402ade0 tx=0x7f5b74004030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afac12635528fca6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:31.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.356+0000 7f5b65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:21:31.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.357+0000 7f5b65ffb640 1 -- 172.21.15.78:0/3634191581 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b74060070 con 0x55ee4fca8d30 2024-09-11T00:21:31.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.357+0000 7f5b65ffb640 1 -- 172.21.15.78:0/3634191581 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f5b740047f0 con 0x55ee4fca8d30 2024-09-11T00:21:31.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.357+0000 7f5b86af1740 1 -- 172.21.15.78:0/3634191581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b78030070 con 0x55ee4fca8d30 2024-09-11T00:21:31.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.357+0000 7f5b65ffb640 1 -- 172.21.15.78:0/3634191581 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5b7406c050 con 0x55ee4fca8d30 2024-09-11T00:21:31.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.357+0000 7f5b86af1740 10 client.15978 fetch_fsmap learned FSMap version 20 2024-09-11T00:21:31.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.357+0000 7f5b86af1740 1 -- 172.21.15.78:0/3634191581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55ee4fd25700 con 0x55ee4fca8d30 2024-09-11T00:21:31.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.357+0000 7f5b65ffb640 1 -- 172.21.15.78:0/3634191581 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b78030070 con 0x55ee4fca8d30 2024-09-11T00:21:31.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.357+0000 7f5b65ffb640 1 -- 172.21.15.78:0/3634191581 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f5b7405a040 con 0x55ee4fca8d30 2024-09-11T00:21:31.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.357+0000 7f5b86af1740 10 client.15978 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:21:31.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.357+0000 7f5b86af1740 10 client.15978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:21:31.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.357+0000 7f5b86af1740 20 client.15978 populate_metadata read hostname 'smithi078' 2024-09-11T00:21:31.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.357+0000 7f5b86af1740 1 --2- 172.21.15.78:0/3634191581 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ee4fd25dc0 0x55ee4fd281e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:31.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.357+0000 7f5b86af1740 4 client.15978 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:21:31.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.357+0000 7f5b86af1740 1 -- 172.21.15.78:0/3634191581 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ee4fc10850 con 0x55ee4fd25dc0 2024-09-11T00:21:31.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.358+0000 7f5b824b8640 1 --2- 172.21.15.78:0/3634191581 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ee4fd25dc0 0x55ee4fd281e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:31.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.358+0000 7f5b65ffb640 10 client.15978 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:21:31.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.358+0000 7f5b824b8640 1 --2- 172.21.15.78:0/3634191581 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ee4fd25dc0 0x55ee4fd281e0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff87692527f66d96 server_cookie=5699cea83d3755a3 in_seq=0 out_seq=0 2024-09-11T00:21:31.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.359+0000 7f5b65ffb640 1 -- 172.21.15.78:0/3634191581 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x55ee4fc10850 con 0x55ee4fd25dc0 2024-09-11T00:21:31.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.359+0000 7f5b65ffb640 10 client.15978 handle_command_reply: tid=0 2024-09-11T00:21:31.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.359+0000 7f5b86af1740 1 client.15978 shutdown 2024-09-11T00:21:31.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.359+0000 7f5b86af1740 1 -- 172.21.15.78:0/3634191581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fca8d30 msgr2=0x55ee4fcc0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:31.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.359+0000 7f5b86af1740 1 --2- 172.21.15.78:0/3634191581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fca8d30 0x55ee4fcc0570 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5b7402ade0 tx=0x7f5b74004030 comp rx=0 tx=0).stop 2024-09-11T00:21:31.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.359+0000 7f5b86af1740 1 -- 172.21.15.78:0/3634191581 shutdown_connections 2024-09-11T00:21:31.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.359+0000 7f5b86af1740 1 --2- 172.21.15.78:0/3634191581 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55ee4fd25dc0 0x55ee4fd281e0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.359+0000 7f5b86af1740 1 --2- 172.21.15.78:0/3634191581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ee4fca8d30 0x55ee4fcc0570 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.359+0000 7f5b86af1740 1 --2- 172.21.15.78:0/3634191581 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ee4fc9cda0 0x55ee4fcc0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.359+0000 7f5b86af1740 1 --2- 172.21.15.78:0/3634191581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55ee4fc9c480 0x55ee4fcb1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.359+0000 7f5b86af1740 1 -- 172.21.15.78:0/3634191581 >> 172.21.15.78:0/3634191581 conn(0x55ee4fc9a2b0 msgr2=0x55ee4fca7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:31.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.359+0000 7f5b65ffb640 0 client.15978 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:21:31.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.359+0000 7f5b86af1740 1 -- 172.21.15.78:0/3634191581 shutdown_connections 2024-09-11T00:21:31.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.359+0000 7f5b86af1740 1 -- 172.21.15.78:0/3634191581 wait complete. 2024-09-11T00:21:31.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.359+0000 7f5b86af1740 20 client.15978 trim_cache size 0 max 16384 2024-09-11T00:21:31.369 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:21:31.369 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-11T00:21:31.369 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {}, 2024-09-11T00:21:31.369 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:21:31.369 INFO:teuthology.orchestra.run.smithi078.stdout: "8ec9e858-aa62-420d-a112-e62ea7810e63": { 2024-09-11T00:21:31.369 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:18.882749+0000", 2024-09-11T00:21:31.369 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:21:31.369 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:21:31.369 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:21:31.369 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:21:31.369 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:21:31.370 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:21:31.370 INFO:teuthology.orchestra.run.smithi078.stdout: "38a1d30d-5f4c-460a-afcd-e6c60b97e43a": { 2024-09-11T00:21:31.370 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:58.127727+0000", 2024-09-11T00:21:31.370 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:21:31.370 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:21:31.370 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:21:31.370 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:21:31.370 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:21:31.370 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:21:31.370 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:21:31.370 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:21:31.371 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:21:31.371 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:21:31.371 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:21:31.371 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:21:31.371 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:21:31.371 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:21:31.371 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:21:31.371 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:21:31.371 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:21:31.371 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:21:31.371 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:21:31.372 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:21:31.372 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:21:31.372 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:21:31.372 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:21:31.372 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:21:31.372 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:21:31.372 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:21:31.372 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:21:31.372 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:21:31.373 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:21:31.373 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:21:31.373 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:21:31.373 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:21:31.373 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:21:31.373 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:21:31.373 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:21:31.373 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:21:31.373 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:21:31.373 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:21:31.373 INFO:teuthology.orchestra.run.smithi078.stdout: "b854cbd3-8ca7-4277-a205-8887d2ff5567": { 2024-09-11T00:21:31.373 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:11.182949+0000", 2024-09-11T00:21:31.374 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:21:31.374 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:21:31.374 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:21:31.374 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:21:31.374 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:21:31.374 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:21:31.374 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:21:31.374 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:21:31.374 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:21:31.374 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:21:31.374 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:21:31.374 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:21:31.375 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:21:31.375 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:21:31.375 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:21:31.375 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:21:31.375 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:21:31.375 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:21:31.375 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:21:31.375 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:21:31.375 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:21:31.375 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:21:31.375 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:21:31.375 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:21:31.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.360+0000 7f5b8471c640 1 -- 172.21.15.78:0/3592362778 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5b680b5450 msgr2=0x7f5b680b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:31.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.360+0000 7f5b8471c640 1 --2- 172.21.15.78:0/3592362778 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5b680b5450 0x7f5b680b7910 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5b74005fa0 tx=0x7f5b74005c30 comp rx=0 tx=0).stop 2024-09-11T00:21:31.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.360+0000 7f5b8471c640 1 -- 172.21.15.78:0/3592362778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b7c1045c0 msgr2=0x7f5b7c101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:31.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.360+0000 7f5b8471c640 1 --2- 172.21.15.78:0/3592362778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b7c1045c0 0x7f5b7c101e90 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00c970 tx=0x7f5b6c00cd70 comp rx=0 tx=0).stop 2024-09-11T00:21:31.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.360+0000 7f5b8471c640 1 -- 172.21.15.78:0/3592362778 shutdown_connections 2024-09-11T00:21:31.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.360+0000 7f5b8471c640 1 --2- 172.21.15.78:0/3592362778 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f5b680b5450 0x7f5b680b7910 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.360+0000 7f5b8471c640 1 --2- 172.21.15.78:0/3592362778 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b7c10d100 0x7f5b7c1023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.360+0000 7f5b8471c640 1 --2- 172.21.15.78:0/3592362778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b7c1045c0 0x7f5b7c101e90 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.360+0000 7f5b8471c640 1 --2- 172.21.15.78:0/3592362778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5b7c103ca0 0x7f5b7c101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:31.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.360+0000 7f5b8471c640 1 -- 172.21.15.78:0/3592362778 >> 172.21.15.78:0/3592362778 conn(0x7f5b7c0fd700 msgr2=0x7f5b7c10f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:31.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.360+0000 7f5b8471c640 1 -- 172.21.15.78:0/3592362778 shutdown_connections 2024-09-11T00:21:31.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:31.360+0000 7f5b8471c640 1 -- 172.21.15.78:0/3592362778 wait complete. 2024-09-11T00:21:32.126 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:31 smithi078 ceph-mon[30865]: pgmap v475: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:21:32.154 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:21:32.154 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:21:32.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:31 smithi112 ceph-mon[35627]: pgmap v475: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:21:32.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:31 smithi138 ceph-mon[35019]: pgmap v475: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:21:32.408 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:21:32.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.908+0000 7f85c3a6b640 1 -- 172.21.15.78:0/2474416096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85bc10f3e0 msgr2=0x7f85bc1117d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:32.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.908+0000 7f85c3a6b640 1 --2- 172.21.15.78:0/2474416096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85bc10f3e0 0x7f85bc1117d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009900 tx=0x7f85b402a410 comp rx=0 tx=0).stop 2024-09-11T00:21:32.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.908+0000 7f85c3a6b640 1 -- 172.21.15.78:0/2474416096 shutdown_connections 2024-09-11T00:21:32.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.908+0000 7f85c3a6b640 1 --2- 172.21.15.78:0/2474416096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85bc10f3e0 0x7f85bc1117d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:32.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.908+0000 7f85c3a6b640 1 --2- 172.21.15.78:0/2474416096 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85bc075f40 0x7f85bc10ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:32.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.908+0000 7f85c3a6b640 1 --2- 172.21.15.78:0/2474416096 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85bc075540 0x7f85bc075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:32.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.908+0000 7f85c3a6b640 1 -- 172.21.15.78:0/2474416096 >> 172.21.15.78:0/2474416096 conn(0x7f85bc0fe830 msgr2=0x7f85bc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:32.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.909+0000 7f85c3a6b640 1 -- 172.21.15.78:0/2474416096 shutdown_connections 2024-09-11T00:21:32.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.909+0000 7f85c3a6b640 1 -- 172.21.15.78:0/2474416096 wait complete. 2024-09-11T00:21:32.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.909+0000 7f85c3a6b640 1 Processor -- start 2024-09-11T00:21:32.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.909+0000 7f85c3a6b640 1 -- start start 2024-09-11T00:21:32.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.909+0000 7f85c3a6b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85bc075540 0x7f85bc19b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:32.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.909+0000 7f85c3a6b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85bc075f40 0x7f85bc19b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:32.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.909+0000 7f85c3a6b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85bc10f3e0 0x7f85bc1a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:32.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.909+0000 7f85c3a6b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc114f70 con 0x7f85bc075f40 2024-09-11T00:21:32.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.910+0000 7f85c3a6b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc114df0 con 0x7f85bc075540 2024-09-11T00:21:32.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.910+0000 7f85c3a6b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc1150f0 con 0x7f85bc10f3e0 2024-09-11T00:21:32.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.910+0000 7f85c1006640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85bc075f40 0x7f85bc19b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:32.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.910+0000 7f85c1006640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85bc075f40 0x7f85bc19b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38066/0 (socket says 172.21.15.78:38066) 2024-09-11T00:21:32.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.910+0000 7f85c1006640 1 -- 172.21.15.78:0/1800779295 learned_addr learned my addr 172.21.15.78:0/1800779295 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:21:32.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.910+0000 7f85c1807640 1 --2- 172.21.15.78:0/1800779295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85bc075540 0x7f85bc19b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:32.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.910+0000 7f85c2008640 1 --2- 172.21.15.78:0/1800779295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85bc10f3e0 0x7f85bc1a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:32.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.910+0000 7f85c1006640 1 -- 172.21.15.78:0/1800779295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85bc10f3e0 msgr2=0x7f85bc1a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:32.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.910+0000 7f85c1006640 1 --2- 172.21.15.78:0/1800779295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85bc10f3e0 0x7f85bc1a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:32.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.910+0000 7f85c1006640 1 -- 172.21.15.78:0/1800779295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85bc075540 msgr2=0x7f85bc19b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:32.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.910+0000 7f85c1006640 1 --2- 172.21.15.78:0/1800779295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85bc075540 0x7f85bc19b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:32.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.910+0000 7f85c1006640 1 -- 172.21.15.78:0/1800779295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85bc1a14f0 con 0x7f85bc075f40 2024-09-11T00:21:32.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.910+0000 7f85c1807640 1 --2- 172.21.15.78:0/1800779295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85bc075540 0x7f85bc19b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:21:32.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.910+0000 7f85c1006640 1 --2- 172.21.15.78:0/1800779295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85bc075f40 0x7f85bc19b980 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00d770 tx=0x7f85ac00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:32.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.910+0000 7f85b2ffd640 1 -- 172.21.15.78:0/1800779295 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac017070 con 0x7f85bc075f40 2024-09-11T00:21:32.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.910+0000 7f85b2ffd640 1 -- 172.21.15.78:0/1800779295 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85ac0054d0 con 0x7f85bc075f40 2024-09-11T00:21:32.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.910+0000 7f85c3a6b640 1 -- 172.21.15.78:0/1800779295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85bc1a17e0 con 0x7f85bc075f40 2024-09-11T00:21:32.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.910+0000 7f85b2ffd640 1 -- 172.21.15.78:0/1800779295 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac004c30 con 0x7f85bc075f40 2024-09-11T00:21:32.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.910+0000 7f85c3a6b640 1 -- 172.21.15.78:0/1800779295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85bc1a7ea0 con 0x7f85bc075f40 2024-09-11T00:21:32.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.911+0000 7f85c3a6b640 1 -- 172.21.15.78:0/1800779295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85bc075920 con 0x7f85bc075f40 2024-09-11T00:21:32.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.913+0000 7f85b2ffd640 1 -- 172.21.15.78:0/1800779295 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f85ac004dd0 con 0x7f85bc075f40 2024-09-11T00:21:32.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.913+0000 7f85b2ffd640 1 --2- 172.21.15.78:0/1800779295 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f85a80b54d0 0x7f85a80b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:32.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.913+0000 7f85c1807640 1 --2- 172.21.15.78:0/1800779295 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f85a80b54d0 0x7f85a80b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:32.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.913+0000 7f85b2ffd640 1 -- 172.21.15.78:0/1800779295 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f85ac0e5e50 con 0x7f85bc075f40 2024-09-11T00:21:32.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.914+0000 7f85c1807640 1 --2- 172.21.15.78:0/1800779295 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f85a80b54d0 0x7f85a80b7990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f85b8005fd0 tx=0x7f85b8009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:32.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:32.916+0000 7f85b2ffd640 1 -- 172.21.15.78:0/1800779295 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f85ac0aca70 con 0x7f85bc075f40 2024-09-11T00:21:33.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:33.130+0000 7f85c3a6b640 1 -- 172.21.15.78:0/1800779295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85bc1a81b0 con 0x7f85bc075f40 2024-09-11T00:21:33.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:33.131+0000 7f85b2ffd640 1 -- 172.21.15.78:0/1800779295 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f85ac0ac370 con 0x7f85bc075f40 2024-09-11T00:21:33.133 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:21:33.133 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:21:33.133 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:21:33.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:33.133+0000 7f85c3a6b640 1 -- 172.21.15.78:0/1800779295 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f85a80b54d0 msgr2=0x7f85a80b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:33.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:33.133+0000 7f85c3a6b640 1 --2- 172.21.15.78:0/1800779295 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f85a80b54d0 0x7f85a80b7990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f85b8005fd0 tx=0x7f85b8009600 comp rx=0 tx=0).stop 2024-09-11T00:21:33.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:33.133+0000 7f85c3a6b640 1 -- 172.21.15.78:0/1800779295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85bc075f40 msgr2=0x7f85bc19b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:33.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:33.133+0000 7f85c3a6b640 1 --2- 172.21.15.78:0/1800779295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85bc075f40 0x7f85bc19b980 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00d770 tx=0x7f85ac00dc30 comp rx=0 tx=0).stop 2024-09-11T00:21:33.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:33.133+0000 7f85c3a6b640 1 -- 172.21.15.78:0/1800779295 shutdown_connections 2024-09-11T00:21:33.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:33.133+0000 7f85c3a6b640 1 --2- 172.21.15.78:0/1800779295 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f85a80b54d0 0x7f85a80b7990 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:33.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:33.133+0000 7f85c3a6b640 1 --2- 172.21.15.78:0/1800779295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85bc10f3e0 0x7f85bc1a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:33.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:33.133+0000 7f85c3a6b640 1 --2- 172.21.15.78:0/1800779295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85bc075f40 0x7f85bc19b980 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:33.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:33.133+0000 7f85c3a6b640 1 --2- 172.21.15.78:0/1800779295 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f85bc075540 0x7f85bc19b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:33.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:33.133+0000 7f85c3a6b640 1 -- 172.21.15.78:0/1800779295 >> 172.21.15.78:0/1800779295 conn(0x7f85bc0fe830 msgr2=0x7f85bc1115e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:33.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:33.133+0000 7f85c3a6b640 1 -- 172.21.15.78:0/1800779295 shutdown_connections 2024-09-11T00:21:33.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:33.133+0000 7f85c3a6b640 1 -- 172.21.15.78:0/1800779295 wait complete. 2024-09-11T00:21:33.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:33 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1800779295' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:21:33.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:33 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1800779295' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:21:33.562 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:33 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1800779295' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:21:33.895 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:21:34.141 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:21:34.441 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:34 smithi078 ceph-mon[30865]: pgmap v476: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:21:34.482 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:34 smithi112 ceph-mon[35627]: pgmap v476: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:21:34.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:34 smithi138 ceph-mon[35019]: pgmap v476: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:21:34.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.633+0000 7f4d8e14c640 1 -- 172.21.15.78:0/492048393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88103b90 msgr2=0x7f4d88103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:34.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.633+0000 7f4d8e14c640 1 --2- 172.21.15.78:0/492048393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88103b90 0x7f4d88103f70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009900 tx=0x7f4d7802a410 comp rx=0 tx=0).stop 2024-09-11T00:21:34.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.633+0000 7f4d8e14c640 1 -- 172.21.15.78:0/492048393 shutdown_connections 2024-09-11T00:21:34.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.633+0000 7f4d8e14c640 1 --2- 172.21.15.78:0/492048393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d8810d140 0x7f4d8810f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.633+0000 7f4d8e14c640 1 --2- 172.21.15.78:0/492048393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d88104590 0x7f4d8810cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.633+0000 7f4d8e14c640 1 --2- 172.21.15.78:0/492048393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88103b90 0x7f4d88103f70 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.633+0000 7f4d8e14c640 1 -- 172.21.15.78:0/492048393 >> 172.21.15.78:0/492048393 conn(0x7f4d880fd700 msgr2=0x7f4d880ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:34.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.633+0000 7f4d8e14c640 1 -- 172.21.15.78:0/492048393 shutdown_connections 2024-09-11T00:21:34.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.634+0000 7f4d8e14c640 1 -- 172.21.15.78:0/492048393 wait complete. 2024-09-11T00:21:34.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.634+0000 7f4d8e14c640 1 Processor -- start 2024-09-11T00:21:34.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.634+0000 7f4d8e14c640 1 -- start start 2024-09-11T00:21:34.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.635+0000 7f4d8e14c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88103b90 0x7f4d88199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:34.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.635+0000 7f4d8e14c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d88104590 0x7f4d881997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:34.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.635+0000 7f4d8e14c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d8810d140 0x7f4d8819eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:34.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.635+0000 7f4d8e14c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4d88112dc0 con 0x7f4d88103b90 2024-09-11T00:21:34.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.635+0000 7f4d8e14c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4d88112c40 con 0x7f4d88104590 2024-09-11T00:21:34.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.635+0000 7f4d8e14c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4d88112f40 con 0x7f4d8810d140 2024-09-11T00:21:34.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.635+0000 7f4d877fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88103b90 0x7f4d88199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:34.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.635+0000 7f4d877fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88103b90 0x7f4d88199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38078/0 (socket says 172.21.15.78:38078) 2024-09-11T00:21:34.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.635+0000 7f4d877fe640 1 -- 172.21.15.78:0/465262620 learned_addr learned my addr 172.21.15.78:0/465262620 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:21:34.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.635+0000 7f4d877fe640 1 -- 172.21.15.78:0/465262620 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d8810d140 msgr2=0x7f4d8819eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:34.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.635+0000 7f4d877fe640 1 --2- 172.21.15.78:0/465262620 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d8810d140 0x7f4d8819eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.635+0000 7f4d877fe640 1 -- 172.21.15.78:0/465262620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d88104590 msgr2=0x7f4d881997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:34.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.635+0000 7f4d877fe640 1 --2- 172.21.15.78:0/465262620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d88104590 0x7f4d881997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.635+0000 7f4d877fe640 1 -- 172.21.15.78:0/465262620 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8819f320 con 0x7f4d88103b90 2024-09-11T00:21:34.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.635+0000 7f4d877fe640 1 --2- 172.21.15.78:0/465262620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88103b90 0x7f4d88199270 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4d78006010 tx=0x7f4d780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:34.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.635+0000 7f4d84ff9640 1 -- 172.21.15.78:0/465262620 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7803f030 con 0x7f4d88103b90 2024-09-11T00:21:34.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.635+0000 7f4d8e14c640 1 -- 172.21.15.78:0/465262620 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d8819f5b0 con 0x7f4d88103b90 2024-09-11T00:21:34.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.635+0000 7f4d84ff9640 1 -- 172.21.15.78:0/465262620 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d78003800 con 0x7f4d88103b90 2024-09-11T00:21:34.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.635+0000 7f4d84ff9640 1 -- 172.21.15.78:0/465262620 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d78035070 con 0x7f4d88103b90 2024-09-11T00:21:34.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.636+0000 7f4d8e14c640 1 -- 172.21.15.78:0/465262620 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d881a5cd0 con 0x7f4d88103b90 2024-09-11T00:21:34.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.638+0000 7f4d84ff9640 1 -- 172.21.15.78:0/465262620 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f4d78031b10 con 0x7f4d88103b90 2024-09-11T00:21:34.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.638+0000 7f4d90521740 1 Processor -- start 2024-09-11T00:21:34.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.638+0000 7f4d90521740 1 -- start start 2024-09-11T00:21:34.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.638+0000 7f4d90521740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5648a703d0f0 0x5648a703d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:34.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.638+0000 7f4d90521740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703da10 0x5648a704d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:34.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.638+0000 7f4d90521740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5648a704ddb0 0x5648a70501a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:34.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.638+0000 7f4d90521740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5648a6fb3ea0 con 0x5648a703da10 2024-09-11T00:21:34.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.639+0000 7f4d90521740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5648a6fa32d0 con 0x5648a704ddb0 2024-09-11T00:21:34.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.639+0000 7f4d90521740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5648a6fa70e0 con 0x5648a703d0f0 2024-09-11T00:21:34.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.639+0000 7f4d877fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703da10 0x5648a704d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:34.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.639+0000 7f4d877fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703da10 0x5648a704d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38094/0 (socket says 172.21.15.78:38094) 2024-09-11T00:21:34.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.639+0000 7f4d877fe640 1 -- 172.21.15.78:0/1961412917 learned_addr learned my addr 172.21.15.78:0/1961412917 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:21:34.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.639+0000 7f4d87fff640 1 --2- 172.21.15.78:0/1961412917 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5648a703d0f0 0x5648a703d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:34.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.639+0000 7f4d86ffd640 1 --2- 172.21.15.78:0/1961412917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5648a704ddb0 0x5648a70501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:34.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.639+0000 7f4d84ff9640 1 --2- 172.21.15.78:0/465262620 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4d700b5450 0x7f4d700b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:34.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.639+0000 7f4d877fe640 1 -- 172.21.15.78:0/1961412917 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5648a703d0f0 msgr2=0x5648a703d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:34.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.639+0000 7f4d877fe640 1 --2- 172.21.15.78:0/1961412917 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5648a703d0f0 0x5648a703d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.639+0000 7f4d877fe640 1 -- 172.21.15.78:0/1961412917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5648a704ddb0 msgr2=0x5648a70501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:34.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.639+0000 7f4d877fe640 1 --2- 172.21.15.78:0/1961412917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5648a704ddb0 0x5648a70501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.639+0000 7f4d877fe640 1 -- 172.21.15.78:0/1961412917 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648a6d01650 con 0x5648a703da10 2024-09-11T00:21:34.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.639+0000 7f4d86ffd640 1 --2- 172.21.15.78:0/1961412917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5648a704ddb0 0x5648a70501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:21:34.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.639+0000 7f4d87fff640 1 --2- 172.21.15.78:0/1961412917 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5648a703d0f0 0x5648a703d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:21:34.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.639+0000 7f4d87fff640 1 --2- 172.21.15.78:0/465262620 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4d700b5450 0x7f4d700b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:34.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.639+0000 7f4d84ff9640 1 -- 172.21.15.78:0/465262620 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f4d78106a20 con 0x7f4d88103b90 2024-09-11T00:21:34.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.639+0000 7f4d877fe640 1 --2- 172.21.15.78:0/1961412917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703da10 0x5648a704d870 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4d780fcd30 tx=0x7f4d780fd2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d21e34be31bbe0f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:34.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.639+0000 7f4d6dffb640 1 -- 172.21.15.78:0/1961412917 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d78049020 con 0x5648a703da10 2024-09-11T00:21:34.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.639+0000 7f4d6dffb640 1 -- 172.21.15.78:0/1961412917 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d780cc970 con 0x5648a703da10 2024-09-11T00:21:34.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.640+0000 7f4d6dffb640 1 -- 172.21.15.78:0/1961412917 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d780cc7b0 con 0x5648a703da10 2024-09-11T00:21:34.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.640+0000 7f4d90521740 1 -- 172.21.15.78:0/1961412917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703da10 msgr2=0x5648a704d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:34.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.640+0000 7f4d87fff640 1 --2- 172.21.15.78:0/465262620 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4d700b5450 0x7f4d700b7910 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4d8000ba30 tx=0x7f4d800046c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:34.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.640+0000 7f4d90521740 1 --2- 172.21.15.78:0/1961412917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703da10 0x5648a704d870 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4d780fcd30 tx=0x7f4d780fd2d0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.640+0000 7f4d90521740 1 -- 172.21.15.78:0/1961412917 shutdown_connections 2024-09-11T00:21:34.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.640+0000 7f4d90521740 1 --2- 172.21.15.78:0/1961412917 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5648a704ddb0 0x5648a70501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.640+0000 7f4d90521740 1 --2- 172.21.15.78:0/1961412917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703da10 0x5648a704d870 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.640+0000 7f4d90521740 1 --2- 172.21.15.78:0/1961412917 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5648a703d0f0 0x5648a703d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.640+0000 7f4d90521740 1 -- 172.21.15.78:0/1961412917 >> 172.21.15.78:0/1961412917 conn(0x5648a703af20 msgr2=0x5648a703c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:34.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.640+0000 7f4d90521740 1 -- 172.21.15.78:0/1961412917 shutdown_connections 2024-09-11T00:21:34.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.640+0000 7f4d90521740 1 -- 172.21.15.78:0/1961412917 wait complete. 2024-09-11T00:21:34.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.641+0000 7f4d90521740 1 -- start start 2024-09-11T00:21:34.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.641+0000 7f4d90521740 1 Processor -- start 2024-09-11T00:21:34.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.641+0000 7f4d90521740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5648a703d0f0 0x5648a704d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:34.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.641+0000 7f4d90521740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703da10 0x5648a704aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:34.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.641+0000 7f4d90521740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5648a704ddb0 0x5648a704af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:34.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.641+0000 7f4d90521740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5648a6e04700 con 0x5648a703da10 2024-09-11T00:21:34.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.641+0000 7f4d90521740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5648a6f3e160 con 0x5648a704ddb0 2024-09-11T00:21:34.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.641+0000 7f4d90521740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5648a7050820 con 0x5648a703d0f0 2024-09-11T00:21:34.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.641+0000 7f4d90521740 10 client.0 _ll_register_callbacks cb 0x5648a6f579e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:21:34.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.641+0000 7f4d86ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703da10 0x5648a704aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:34.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.641+0000 7f4d86ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703da10 0x5648a704aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38098/0 (socket says 172.21.15.78:38098) 2024-09-11T00:21:34.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.641+0000 7f4d86ffd640 1 -- 172.21.15.78:0/3427543506 learned_addr learned my addr 172.21.15.78:0/3427543506 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:21:34.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.641+0000 7f4d877fe640 1 --2- 172.21.15.78:0/3427543506 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5648a703d0f0 0x5648a704d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:34.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.641+0000 7f4d87fff640 1 --2- 172.21.15.78:0/3427543506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5648a704ddb0 0x5648a704af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:34.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.641+0000 7f4d86ffd640 1 -- 172.21.15.78:0/3427543506 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5648a703d0f0 msgr2=0x5648a704d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:34.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.641+0000 7f4d86ffd640 1 --2- 172.21.15.78:0/3427543506 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5648a703d0f0 0x5648a704d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.641+0000 7f4d86ffd640 1 -- 172.21.15.78:0/3427543506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5648a704ddb0 msgr2=0x5648a704af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:34.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.641+0000 7f4d86ffd640 1 --2- 172.21.15.78:0/3427543506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5648a704ddb0 0x5648a704af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.642+0000 7f4d86ffd640 1 -- 172.21.15.78:0/3427543506 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648a6f6bc90 con 0x5648a703da10 2024-09-11T00:21:34.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.642+0000 7f4d86ffd640 1 --2- 172.21.15.78:0/3427543506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703da10 0x5648a704aa30 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00c920 tx=0x7f4d7c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659026361f3a5e08 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:34.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.642+0000 7f4d66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:21:34.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.642+0000 7f4d66ffd640 1 -- 172.21.15.78:0/3427543506 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c008040 con 0x5648a703da10 2024-09-11T00:21:34.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.642+0000 7f4d66ffd640 1 -- 172.21.15.78:0/3427543506 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f4d7c00a9e0 con 0x5648a703da10 2024-09-11T00:21:34.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.642+0000 7f4d90521740 1 -- 172.21.15.78:0/3427543506 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d780cc970 con 0x5648a703da10 2024-09-11T00:21:34.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.642+0000 7f4d66ffd640 1 -- 172.21.15.78:0/3427543506 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4d7c00abe0 con 0x5648a703da10 2024-09-11T00:21:34.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.642+0000 7f4d90521740 10 client.15996 fetch_fsmap learned FSMap version 20 2024-09-11T00:21:34.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.642+0000 7f4d90521740 1 -- 172.21.15.78:0/3427543506 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5648a705bf50 con 0x5648a703da10 2024-09-11T00:21:34.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.642+0000 7f4d66ffd640 1 -- 172.21.15.78:0/3427543506 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d780cc970 con 0x5648a703da10 2024-09-11T00:21:34.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.642+0000 7f4d66ffd640 1 -- 172.21.15.78:0/3427543506 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f4d7c00e040 con 0x5648a703da10 2024-09-11T00:21:34.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.642+0000 7f4d90521740 10 client.15996 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:21:34.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.642+0000 7f4d90521740 10 client.15996 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:21:34.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.642+0000 7f4d90521740 20 client.15996 populate_metadata read hostname 'smithi078' 2024-09-11T00:21:34.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.642+0000 7f4d90521740 1 --2- 172.21.15.78:0/3427543506 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5648a705d460 0x5648a705f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:34.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.642+0000 7f4d90521740 4 client.15996 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:21:34.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.642+0000 7f4d90521740 1 -- 172.21.15.78:0/3427543506 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648a6fb5df0 con 0x5648a705d460 2024-09-11T00:21:34.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.643+0000 7f4d877fe640 1 --2- 172.21.15.78:0/3427543506 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5648a705d460 0x5648a705f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:34.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.643+0000 7f4d877fe640 1 --2- 172.21.15.78:0/3427543506 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5648a705d460 0x5648a705f880 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d36e7c80a7bbe06 server_cookie=6c8bdc5a7231b93f in_seq=0 out_seq=0 2024-09-11T00:21:34.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.643+0000 7f4d66ffd640 10 client.15996 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:21:34.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.644+0000 7f4d66ffd640 1 -- 172.21.15.78:0/3427543506 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5648a6fb5df0 con 0x5648a705d460 2024-09-11T00:21:34.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.644+0000 7f4d66ffd640 10 client.15996 handle_command_reply: tid=0 2024-09-11T00:21:34.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.644+0000 7f4d90521740 1 client.15996 shutdown 2024-09-11T00:21:34.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.644+0000 7f4d90521740 1 -- 172.21.15.78:0/3427543506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703da10 msgr2=0x5648a704aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:34.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.644+0000 7f4d90521740 1 --2- 172.21.15.78:0/3427543506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703da10 0x5648a704aa30 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00c920 tx=0x7f4d7c00cde0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.645+0000 7f4d90521740 1 -- 172.21.15.78:0/3427543506 shutdown_connections 2024-09-11T00:21:34.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.645+0000 7f4d90521740 1 --2- 172.21.15.78:0/3427543506 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5648a705d460 0x5648a705f880 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.645+0000 7f4d90521740 1 --2- 172.21.15.78:0/3427543506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5648a704ddb0 0x5648a704af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.645+0000 7f4d66ffd640 0 client.15996 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:21:34.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.645+0000 7f4d90521740 1 --2- 172.21.15.78:0/3427543506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703da10 0x5648a704aa30 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.645+0000 7f4d90521740 1 --2- 172.21.15.78:0/3427543506 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5648a703d0f0 0x5648a704d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.645+0000 7f4d90521740 1 -- 172.21.15.78:0/3427543506 >> 172.21.15.78:0/3427543506 conn(0x5648a703af20 msgr2=0x5648a7040ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:34.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.645+0000 7f4d90521740 1 -- 172.21.15.78:0/3427543506 shutdown_connections 2024-09-11T00:21:34.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.645+0000 7f4d90521740 1 -- 172.21.15.78:0/3427543506 wait complete. 2024-09-11T00:21:34.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.645+0000 7f4d90521740 20 client.15996 trim_cache size 0 max 16384 2024-09-11T00:21:34.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.658+0000 7f4d90521740 1 Processor -- start 2024-09-11T00:21:34.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.658+0000 7f4d90521740 1 -- start start 2024-09-11T00:21:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.658+0000 7f4d90521740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5648a703d0f0 0x5648a703c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.658+0000 7f4d90521740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703da10 0x5648a7065130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.658+0000 7f4d90521740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5648a704ddb0 0x5648a7065670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.658+0000 7f4d90521740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4d881aa510 con 0x5648a703da10 2024-09-11T00:21:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.658+0000 7f4d90521740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4d881acd90 con 0x5648a703d0f0 2024-09-11T00:21:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.658+0000 7f4d90521740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4d881aab80 con 0x5648a704ddb0 2024-09-11T00:21:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.658+0000 7f4d86ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703da10 0x5648a7065130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.658+0000 7f4d86ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703da10 0x5648a7065130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38104/0 (socket says 172.21.15.78:38104) 2024-09-11T00:21:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.658+0000 7f4d86ffd640 1 -- 172.21.15.78:0/4127050913 learned_addr learned my addr 172.21.15.78:0/4127050913 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:21:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.658+0000 7f4d877fe640 1 --2- 172.21.15.78:0/4127050913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5648a703d0f0 0x5648a703c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.659+0000 7f4d86ffd640 1 -- 172.21.15.78:0/4127050913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5648a704ddb0 msgr2=0x5648a7065670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.659+0000 7f4d86ffd640 1 --2- 172.21.15.78:0/4127050913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5648a704ddb0 0x5648a7065670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.659+0000 7f4d86ffd640 1 -- 172.21.15.78:0/4127050913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5648a703d0f0 msgr2=0x5648a703c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:34.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.659+0000 7f4d86ffd640 1 --2- 172.21.15.78:0/4127050913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5648a703d0f0 0x5648a703c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.659+0000 7f4d86ffd640 1 -- 172.21.15.78:0/4127050913 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648a703ad50 con 0x5648a703da10 2024-09-11T00:21:34.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.659+0000 7f4d86ffd640 1 --2- 172.21.15.78:0/4127050913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703da10 0x5648a7065130 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c002230 tx=0x7f4d7c00ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b9f1d47082bb82 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:34.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.659+0000 7f4d6d7fa640 1 -- 172.21.15.78:0/4127050913 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c025070 con 0x5648a703da10 2024-09-11T00:21:34.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.659+0000 7f4d6d7fa640 1 -- 172.21.15.78:0/4127050913 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d7c00a7e0 con 0x5648a703da10 2024-09-11T00:21:34.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.659+0000 7f4d6d7fa640 1 -- 172.21.15.78:0/4127050913 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c018660 con 0x5648a703da10 2024-09-11T00:21:34.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.660+0000 7f4d90521740 1 -- 172.21.15.78:0/4127050913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703da10 msgr2=0x5648a7065130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:34.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.660+0000 7f4d90521740 1 --2- 172.21.15.78:0/4127050913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703da10 0x5648a7065130 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c002230 tx=0x7f4d7c00ad80 comp rx=0 tx=0).stop 2024-09-11T00:21:34.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.660+0000 7f4d90521740 1 -- 172.21.15.78:0/4127050913 shutdown_connections 2024-09-11T00:21:34.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.660+0000 7f4d90521740 1 --2- 172.21.15.78:0/4127050913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5648a704ddb0 0x5648a7065670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.660+0000 7f4d90521740 1 --2- 172.21.15.78:0/4127050913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703da10 0x5648a7065130 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.660+0000 7f4d90521740 1 --2- 172.21.15.78:0/4127050913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5648a703d0f0 0x5648a703c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.660+0000 7f4d90521740 1 -- 172.21.15.78:0/4127050913 >> 172.21.15.78:0/4127050913 conn(0x5648a703af20 msgr2=0x5648a703c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:34.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.660+0000 7f4d90521740 1 -- 172.21.15.78:0/4127050913 shutdown_connections 2024-09-11T00:21:34.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.660+0000 7f4d90521740 1 -- 172.21.15.78:0/4127050913 wait complete. 2024-09-11T00:21:34.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.660+0000 7f4d90521740 1 -- start start 2024-09-11T00:21:34.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.660+0000 7f4d90521740 1 Processor -- start 2024-09-11T00:21:34.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d90521740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703d0f0 0x5648a70c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:34.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d90521740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5648a703da10 0x5648a70c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:34.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d90521740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5648a704ddb0 0x5648a70558b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:34.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d90521740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4d881ab250 con 0x5648a703d0f0 2024-09-11T00:21:34.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d90521740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4d881ac6c0 con 0x5648a704ddb0 2024-09-11T00:21:34.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d90521740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4d881ab920 con 0x5648a703da10 2024-09-11T00:21:34.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d90521740 10 client.0 _ll_register_callbacks cb 0x7f4d7c007570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:21:34.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d877fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703d0f0 0x5648a70c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:34.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d877fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703d0f0 0x5648a70c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38120/0 (socket says 172.21.15.78:38120) 2024-09-11T00:21:34.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d877fe640 1 -- 172.21.15.78:0/3266349487 learned_addr learned my addr 172.21.15.78:0/3266349487 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:21:34.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d86ffd640 1 --2- 172.21.15.78:0/3266349487 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5648a703da10 0x5648a70c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:34.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d87fff640 1 --2- 172.21.15.78:0/3266349487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5648a704ddb0 0x5648a70558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:34.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d877fe640 1 -- 172.21.15.78:0/3266349487 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5648a703da10 msgr2=0x5648a70c2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:34.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d877fe640 1 --2- 172.21.15.78:0/3266349487 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5648a703da10 0x5648a70c2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d877fe640 1 -- 172.21.15.78:0/3266349487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5648a704ddb0 msgr2=0x5648a70558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:34.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d877fe640 1 --2- 172.21.15.78:0/3266349487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5648a704ddb0 0x5648a70558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d877fe640 1 -- 172.21.15.78:0/3266349487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648a7055ff0 con 0x5648a703d0f0 2024-09-11T00:21:34.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d86ffd640 1 --2- 172.21.15.78:0/3266349487 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5648a703da10 0x5648a70c2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:21:34.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d87fff640 1 --2- 172.21.15.78:0/3266349487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5648a704ddb0 0x5648a70558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:21:34.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d877fe640 1 --2- 172.21.15.78:0/3266349487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703d0f0 0x5648a70c24d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4d780ccb60 tx=0x7f4d78106ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6c1a6706c4114f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:34.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:21:34.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d66ffd640 1 -- 172.21.15.78:0/3266349487 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d78049040 con 0x5648a703d0f0 2024-09-11T00:21:34.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d66ffd640 1 -- 172.21.15.78:0/3266349487 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f4d78103270 con 0x5648a703d0f0 2024-09-11T00:21:34.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.661+0000 7f4d90521740 1 -- 172.21.15.78:0/3266349487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d7c00a7e0 con 0x5648a703d0f0 2024-09-11T00:21:34.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.662+0000 7f4d66ffd640 1 -- 172.21.15.78:0/3266349487 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4d780cc5d0 con 0x5648a703d0f0 2024-09-11T00:21:34.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.662+0000 7f4d90521740 10 client.16002 fetch_fsmap learned FSMap version 20 2024-09-11T00:21:34.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.662+0000 7f4d90521740 1 -- 172.21.15.78:0/3266349487 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5648a70caf60 con 0x5648a703d0f0 2024-09-11T00:21:34.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.662+0000 7f4d66ffd640 1 -- 172.21.15.78:0/3266349487 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d7c00a7e0 con 0x5648a703d0f0 2024-09-11T00:21:34.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.662+0000 7f4d66ffd640 1 -- 172.21.15.78:0/3266349487 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f4d781035f0 con 0x5648a703d0f0 2024-09-11T00:21:34.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.662+0000 7f4d90521740 10 client.16002 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:21:34.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.662+0000 7f4d90521740 10 client.16002 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:21:34.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.662+0000 7f4d90521740 20 client.16002 populate_metadata read hostname 'smithi078' 2024-09-11T00:21:34.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.662+0000 7f4d90521740 1 --2- 172.21.15.78:0/3266349487 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5648a705d460 0x5648a70cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:34.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.662+0000 7f4d90521740 4 client.16002 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:21:34.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.662+0000 7f4d90521740 1 -- 172.21.15.78:0/3266349487 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5648a6fb18a0 con 0x5648a705d460 2024-09-11T00:21:34.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.663+0000 7f4d86ffd640 1 --2- 172.21.15.78:0/3266349487 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5648a705d460 0x5648a70cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:34.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.663+0000 7f4d86ffd640 1 --2- 172.21.15.78:0/3266349487 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5648a705d460 0x5648a70cd600 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=135daf2009b254c4 server_cookie=f52dd86cd5042423 in_seq=0 out_seq=0 2024-09-11T00:21:34.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.663+0000 7f4d66ffd640 10 client.16002 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:21:34.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.663+0000 7f4d66ffd640 1 -- 172.21.15.78:0/3266349487 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5648a6fb18a0 con 0x5648a705d460 2024-09-11T00:21:34.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.663+0000 7f4d66ffd640 10 client.16002 handle_command_reply: tid=0 2024-09-11T00:21:34.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.663+0000 7f4d90521740 1 client.16002 shutdown 2024-09-11T00:21:34.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.663+0000 7f4d90521740 1 -- 172.21.15.78:0/3266349487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703d0f0 msgr2=0x5648a70c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:34.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.663+0000 7f4d90521740 1 --2- 172.21.15.78:0/3266349487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703d0f0 0x5648a70c24d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4d780ccb60 tx=0x7f4d78106ca0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.663+0000 7f4d90521740 1 -- 172.21.15.78:0/3266349487 shutdown_connections 2024-09-11T00:21:34.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.663+0000 7f4d90521740 1 --2- 172.21.15.78:0/3266349487 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5648a705d460 0x5648a70cd600 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.663+0000 7f4d66ffd640 0 client.16002 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:21:34.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.663+0000 7f4d90521740 1 --2- 172.21.15.78:0/3266349487 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5648a704ddb0 0x5648a70558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.663+0000 7f4d90521740 1 --2- 172.21.15.78:0/3266349487 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5648a703da10 0x5648a70c2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.663+0000 7f4d90521740 1 --2- 172.21.15.78:0/3266349487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5648a703d0f0 0x5648a70c24d0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.663+0000 7f4d90521740 1 -- 172.21.15.78:0/3266349487 >> 172.21.15.78:0/3266349487 conn(0x5648a703af20 msgr2=0x5648a704c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:34.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.663+0000 7f4d90521740 1 -- 172.21.15.78:0/3266349487 shutdown_connections 2024-09-11T00:21:34.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.663+0000 7f4d90521740 1 -- 172.21.15.78:0/3266349487 wait complete. 2024-09-11T00:21:34.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.664+0000 7f4d90521740 20 client.16002 trim_cache size 0 max 16384 2024-09-11T00:21:34.671 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-11T00:21:34.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.664+0000 7f4d8e14c640 1 -- 172.21.15.78:0/465262620 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4d700b5450 msgr2=0x7f4d700b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:34.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.664+0000 7f4d8e14c640 1 --2- 172.21.15.78:0/465262620 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4d700b5450 0x7f4d700b7910 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4d8000ba30 tx=0x7f4d800046c0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.664+0000 7f4d8e14c640 1 -- 172.21.15.78:0/465262620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88103b90 msgr2=0x7f4d88199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:34.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.664+0000 7f4d8e14c640 1 --2- 172.21.15.78:0/465262620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88103b90 0x7f4d88199270 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4d78006010 tx=0x7f4d780042f0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.664+0000 7f4d8e14c640 1 -- 172.21.15.78:0/465262620 shutdown_connections 2024-09-11T00:21:34.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.664+0000 7f4d8e14c640 1 --2- 172.21.15.78:0/465262620 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4d700b5450 0x7f4d700b7910 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.664+0000 7f4d8e14c640 1 --2- 172.21.15.78:0/465262620 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d8810d140 0x7f4d8819eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.664+0000 7f4d8e14c640 1 --2- 172.21.15.78:0/465262620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d88104590 0x7f4d881997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.664+0000 7f4d8e14c640 1 --2- 172.21.15.78:0/465262620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d88103b90 0x7f4d88199270 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:34.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.664+0000 7f4d8e14c640 1 -- 172.21.15.78:0/465262620 >> 172.21.15.78:0/465262620 conn(0x7f4d880fd700 msgr2=0x7f4d8810f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:34.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.664+0000 7f4d8e14c640 1 -- 172.21.15.78:0/465262620 shutdown_connections 2024-09-11T00:21:34.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:34.664+0000 7f4d8e14c640 1 -- 172.21.15.78:0/465262620 wait complete. 2024-09-11T00:21:36.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:35 smithi112 ceph-mon[35627]: pgmap v477: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:21:36.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:35 smithi138 ceph-mon[35019]: pgmap v477: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:21:36.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:35 smithi078 ceph-mon[30865]: pgmap v477: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:21:36.379 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:21:36.380 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:21:36.644 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:21:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.128+0000 7fd618917640 1 -- 172.21.15.78:0/488317630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd61410f3e0 msgr2=0x7fd6141117d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.128+0000 7fd618917640 1 --2- 172.21.15.78:0/488317630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd61410f3e0 0x7fd6141117d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd60c009900 tx=0x7fd60c02a480 comp rx=0 tx=0).stop 2024-09-11T00:21:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.128+0000 7fd618917640 1 -- 172.21.15.78:0/488317630 shutdown_connections 2024-09-11T00:21:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.128+0000 7fd618917640 1 --2- 172.21.15.78:0/488317630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd61410f3e0 0x7fd6141117d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.128+0000 7fd618917640 1 --2- 172.21.15.78:0/488317630 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd614102150 0x7fd61410eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.128+0000 7fd618917640 1 --2- 172.21.15.78:0/488317630 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd614101830 0x7fd614101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.128+0000 7fd618917640 1 -- 172.21.15.78:0/488317630 >> 172.21.15.78:0/488317630 conn(0x7fd6140fd700 msgr2=0x7fd6140ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.129+0000 7fd618917640 1 -- 172.21.15.78:0/488317630 shutdown_connections 2024-09-11T00:21:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.129+0000 7fd618917640 1 -- 172.21.15.78:0/488317630 wait complete. 2024-09-11T00:21:37.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.129+0000 7fd618917640 1 Processor -- start 2024-09-11T00:21:37.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.129+0000 7fd618917640 1 -- start start 2024-09-11T00:21:37.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.130+0000 7fd618917640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd614101830 0x7fd61419b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:37.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.130+0000 7fd618917640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd614102150 0x7fd61419b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:37.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.130+0000 7fd618917640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd61410f3e0 0x7fd6141a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:37.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.130+0000 7fd618917640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd614114f40 con 0x7fd614101830 2024-09-11T00:21:37.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.130+0000 7fd618917640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd614114dc0 con 0x7fd614102150 2024-09-11T00:21:37.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.130+0000 7fd618917640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141150c0 con 0x7fd61410f3e0 2024-09-11T00:21:37.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.130+0000 7fd61259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd614101830 0x7fd61419b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:37.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.130+0000 7fd61259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd614101830 0x7fd61419b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57752/0 (socket says 172.21.15.78:57752) 2024-09-11T00:21:37.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.130+0000 7fd61259c640 1 -- 172.21.15.78:0/1751455865 learned_addr learned my addr 172.21.15.78:0/1751455865 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:21:37.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.130+0000 7fd612d9d640 1 --2- 172.21.15.78:0/1751455865 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd61410f3e0 0x7fd6141a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:37.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.130+0000 7fd611d9b640 1 --2- 172.21.15.78:0/1751455865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd614102150 0x7fd61419b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:37.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.130+0000 7fd61259c640 1 -- 172.21.15.78:0/1751455865 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd61410f3e0 msgr2=0x7fd6141a0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:37.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.130+0000 7fd61259c640 1 --2- 172.21.15.78:0/1751455865 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd61410f3e0 0x7fd6141a0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.130+0000 7fd61259c640 1 -- 172.21.15.78:0/1751455865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd614102150 msgr2=0x7fd61419b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:37.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.130+0000 7fd61259c640 1 --2- 172.21.15.78:0/1751455865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd614102150 0x7fd61419b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.130+0000 7fd61259c640 1 -- 172.21.15.78:0/1751455865 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6141a14b0 con 0x7fd614101830 2024-09-11T00:21:37.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.130+0000 7fd61259c640 1 --2- 172.21.15.78:0/1751455865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd614101830 0x7fd61419b400 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd60400eab0 tx=0x7fd60400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:37.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.130+0000 7fd6037fe640 1 -- 172.21.15.78:0/1751455865 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60400ce40 con 0x7fd614101830 2024-09-11T00:21:37.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.130+0000 7fd618917640 1 -- 172.21.15.78:0/1751455865 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6141a17a0 con 0x7fd614101830 2024-09-11T00:21:37.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.130+0000 7fd6037fe640 1 -- 172.21.15.78:0/1751455865 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd604011920 con 0x7fd614101830 2024-09-11T00:21:37.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.131+0000 7fd6037fe640 1 -- 172.21.15.78:0/1751455865 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604010a30 con 0x7fd614101830 2024-09-11T00:21:37.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.131+0000 7fd618917640 1 -- 172.21.15.78:0/1751455865 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6141a7e60 con 0x7fd614101830 2024-09-11T00:21:37.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.133+0000 7fd6037fe640 1 -- 172.21.15.78:0/1751455865 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fd60400f040 con 0x7fd614101830 2024-09-11T00:21:37.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.133+0000 7fd61acec740 1 Processor -- start 2024-09-11T00:21:37.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.133+0000 7fd61acec740 1 -- start start 2024-09-11T00:21:37.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.134+0000 7fd61acec740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602b5e9bee0 0x5602b5e9c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:37.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.134+0000 7fd61acec740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602b5e9c800 0x5602b5ea8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:37.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.134+0000 7fd61acec740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5ea8790 0x5602b5eaab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:37.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.134+0000 7fd61acec740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5602b5e12e60 con 0x5602b5ea8790 2024-09-11T00:21:37.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.134+0000 7fd61acec740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5602b5e02290 con 0x5602b5e9c800 2024-09-11T00:21:37.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.134+0000 7fd61acec740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5602b5e060a0 con 0x5602b5e9bee0 2024-09-11T00:21:37.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.134+0000 7fd611d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5ea8790 0x5602b5eaab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:37.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.134+0000 7fd611d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5ea8790 0x5602b5eaab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57766/0 (socket says 172.21.15.78:57766) 2024-09-11T00:21:37.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.134+0000 7fd611d9b640 1 -- 172.21.15.78:0/2940415912 learned_addr learned my addr 172.21.15.78:0/2940415912 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:21:37.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.134+0000 7fd61259c640 1 --2- 172.21.15.78:0/2940415912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602b5e9c800 0x5602b5ea8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:37.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.134+0000 7fd612d9d640 1 --2- 172.21.15.78:0/2940415912 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602b5e9bee0 0x5602b5e9c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:37.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.134+0000 7fd611d9b640 1 -- 172.21.15.78:0/2940415912 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602b5e9bee0 msgr2=0x5602b5e9c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:37.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.134+0000 7fd611d9b640 1 --2- 172.21.15.78:0/2940415912 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602b5e9bee0 0x5602b5e9c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.134+0000 7fd611d9b640 1 -- 172.21.15.78:0/2940415912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602b5e9c800 msgr2=0x5602b5ea8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:37.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.134+0000 7fd611d9b640 1 --2- 172.21.15.78:0/2940415912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602b5e9c800 0x5602b5ea8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.134+0000 7fd611d9b640 1 -- 172.21.15.78:0/2940415912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602b5b60930 con 0x5602b5ea8790 2024-09-11T00:21:37.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.134+0000 7fd61259c640 1 --2- 172.21.15.78:0/2940415912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602b5e9c800 0x5602b5ea8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:21:37.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.134+0000 7fd6037fe640 1 --2- 172.21.15.78:0/1751455865 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd5fc0b5450 0x7fd5fc0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:37.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.134+0000 7fd611d9b640 1 --2- 172.21.15.78:0/2940415912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5ea8790 0x5602b5eaab80 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd60800b770 tx=0x7fd60800bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62dc0b0bad43c179 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:37.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.134+0000 7fd612d9d640 1 --2- 172.21.15.78:0/1751455865 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd5fc0b5450 0x7fd5fc0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:37.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.134+0000 7fd6037fe640 1 -- 172.21.15.78:0/1751455865 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fd6040e6260 con 0x7fd614101830 2024-09-11T00:21:37.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.135+0000 7fd600ff9640 1 -- 172.21.15.78:0/2940415912 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd608003dd0 con 0x5602b5ea8790 2024-09-11T00:21:37.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.135+0000 7fd600ff9640 1 -- 172.21.15.78:0/2940415912 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd608015070 con 0x5602b5ea8790 2024-09-11T00:21:37.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.135+0000 7fd600ff9640 1 -- 172.21.15.78:0/2940415912 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd608004de0 con 0x5602b5ea8790 2024-09-11T00:21:37.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.135+0000 7fd61acec740 1 -- 172.21.15.78:0/2940415912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5ea8790 msgr2=0x5602b5eaab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:37.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.135+0000 7fd612d9d640 1 --2- 172.21.15.78:0/1751455865 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd5fc0b5450 0x7fd5fc0b7910 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd60c006010 tx=0x7fd60c0058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:37.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.135+0000 7fd61acec740 1 --2- 172.21.15.78:0/2940415912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5ea8790 0x5602b5eaab80 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd60800b770 tx=0x7fd60800bc30 comp rx=0 tx=0).stop 2024-09-11T00:21:37.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.136+0000 7fd61acec740 1 -- 172.21.15.78:0/2940415912 shutdown_connections 2024-09-11T00:21:37.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.136+0000 7fd61acec740 1 --2- 172.21.15.78:0/2940415912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5ea8790 0x5602b5eaab80 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.136+0000 7fd61acec740 1 --2- 172.21.15.78:0/2940415912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602b5e9c800 0x5602b5ea8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.136+0000 7fd61acec740 1 --2- 172.21.15.78:0/2940415912 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602b5e9bee0 0x5602b5e9c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.136+0000 7fd61acec740 1 -- 172.21.15.78:0/2940415912 >> 172.21.15.78:0/2940415912 conn(0x5602b5e99d10 msgr2=0x5602b5e9aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:37.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.136+0000 7fd61acec740 1 -- 172.21.15.78:0/2940415912 shutdown_connections 2024-09-11T00:21:37.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.136+0000 7fd61acec740 1 -- 172.21.15.78:0/2940415912 wait complete. 2024-09-11T00:21:37.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.136+0000 7fd61acec740 1 -- start start 2024-09-11T00:21:37.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.136+0000 7fd61acec740 1 Processor -- start 2024-09-11T00:21:37.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.136+0000 7fd61acec740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5e9bee0 0x5602b5ea5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:37.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.136+0000 7fd61acec740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602b5e9c800 0x5602b5ea5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:37.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.136+0000 7fd61acec740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602b5ea8790 0x5602b5ea6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:37.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.136+0000 7fd61acec740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5602b5c63890 con 0x5602b5e9bee0 2024-09-11T00:21:37.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.136+0000 7fd61acec740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5602b5d9cd40 con 0x5602b5e9c800 2024-09-11T00:21:37.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.136+0000 7fd61acec740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5602b5eab440 con 0x5602b5ea8790 2024-09-11T00:21:37.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.136+0000 7fd61acec740 10 client.0 _ll_register_callbacks cb 0x5602b5e00c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:21:37.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.136+0000 7fd61259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5e9bee0 0x5602b5ea5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:37.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.136+0000 7fd61259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5e9bee0 0x5602b5ea5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57768/0 (socket says 172.21.15.78:57768) 2024-09-11T00:21:37.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.136+0000 7fd61259c640 1 -- 172.21.15.78:0/4285707270 learned_addr learned my addr 172.21.15.78:0/4285707270 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:21:37.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.137+0000 7fd611d9b640 1 --2- 172.21.15.78:0/4285707270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602b5e9c800 0x5602b5ea5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:37.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.137+0000 7fd612d9d640 1 --2- 172.21.15.78:0/4285707270 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602b5ea8790 0x5602b5ea6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:37.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.137+0000 7fd61259c640 1 -- 172.21.15.78:0/4285707270 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602b5ea8790 msgr2=0x5602b5ea6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:37.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.137+0000 7fd61259c640 1 --2- 172.21.15.78:0/4285707270 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602b5ea8790 0x5602b5ea6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.137+0000 7fd61259c640 1 -- 172.21.15.78:0/4285707270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602b5e9c800 msgr2=0x5602b5ea5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:37.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.137+0000 7fd61259c640 1 --2- 172.21.15.78:0/4285707270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602b5e9c800 0x5602b5ea5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.137+0000 7fd61259c640 1 -- 172.21.15.78:0/4285707270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602b5eb4840 con 0x5602b5e9bee0 2024-09-11T00:21:37.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.137+0000 7fd61259c640 1 --2- 172.21.15.78:0/4285707270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5e9bee0 0x5602b5ea5780 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd6040e3a30 tx=0x7fd604011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e25d190d12d908e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:37.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.137+0000 7fd5f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:21:37.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.137+0000 7fd5f9ffb640 1 -- 172.21.15.78:0/4285707270 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6040ac700 con 0x5602b5e9bee0 2024-09-11T00:21:37.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.137+0000 7fd5f9ffb640 1 -- 172.21.15.78:0/4285707270 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fd6040b5800 con 0x5602b5e9bee0 2024-09-11T00:21:37.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.137+0000 7fd61acec740 1 -- 172.21.15.78:0/4285707270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd608015070 con 0x5602b5e9bee0 2024-09-11T00:21:37.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.137+0000 7fd5f9ffb640 1 -- 172.21.15.78:0/4285707270 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd6040b11e0 con 0x5602b5e9bee0 2024-09-11T00:21:37.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.137+0000 7fd61acec740 10 client.16014 fetch_fsmap learned FSMap version 20 2024-09-11T00:21:37.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.137+0000 7fd61acec740 1 -- 172.21.15.78:0/4285707270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5602b5eb7160 con 0x5602b5e9bee0 2024-09-11T00:21:37.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.137+0000 7fd5f9ffb640 1 -- 172.21.15.78:0/4285707270 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd608015070 con 0x5602b5e9bee0 2024-09-11T00:21:37.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.138+0000 7fd5f9ffb640 1 -- 172.21.15.78:0/4285707270 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd6040ab960 con 0x5602b5e9bee0 2024-09-11T00:21:37.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.138+0000 7fd61acec740 10 client.16014 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:21:37.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.138+0000 7fd61acec740 10 client.16014 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:21:37.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.138+0000 7fd61acec740 20 client.16014 populate_metadata read hostname 'smithi078' 2024-09-11T00:21:37.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.138+0000 7fd61acec740 1 --2- 172.21.15.78:0/4285707270 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5602b5eb8570 0x5602b5eba9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:37.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.138+0000 7fd61acec740 4 client.16014 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:21:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.138+0000 7fd61acec740 1 -- 172.21.15.78:0/4285707270 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602b5e14db0 con 0x5602b5eb8570 2024-09-11T00:21:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.138+0000 7fd611d9b640 1 --2- 172.21.15.78:0/4285707270 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5602b5eb8570 0x5602b5eba9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.138+0000 7fd5f9ffb640 10 client.16014 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:21:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.138+0000 7fd611d9b640 1 --2- 172.21.15.78:0/4285707270 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5602b5eb8570 0x5602b5eba9e0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d4bfca31a3f73f0 server_cookie=c4651c00029171f1 in_seq=0 out_seq=0 2024-09-11T00:21:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.139+0000 7fd5f9ffb640 1 -- 172.21.15.78:0/4285707270 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5602b5e14db0 con 0x5602b5eb8570 2024-09-11T00:21:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.139+0000 7fd5f9ffb640 10 client.16014 handle_command_reply: tid=0 2024-09-11T00:21:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.139+0000 7fd61acec740 1 client.16014 shutdown 2024-09-11T00:21:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.139+0000 7fd61acec740 1 -- 172.21.15.78:0/4285707270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5e9bee0 msgr2=0x5602b5ea5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.139+0000 7fd61acec740 1 --2- 172.21.15.78:0/4285707270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5e9bee0 0x5602b5ea5780 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd6040e3a30 tx=0x7fd604011d00 comp rx=0 tx=0).stop 2024-09-11T00:21:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.139+0000 7fd61acec740 1 -- 172.21.15.78:0/4285707270 shutdown_connections 2024-09-11T00:21:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.139+0000 7fd61acec740 1 --2- 172.21.15.78:0/4285707270 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5602b5eb8570 0x5602b5eba9e0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.139+0000 7fd61acec740 1 --2- 172.21.15.78:0/4285707270 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602b5ea8790 0x5602b5ea6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.139+0000 7fd61acec740 1 --2- 172.21.15.78:0/4285707270 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602b5e9c800 0x5602b5ea5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.139+0000 7fd61acec740 1 --2- 172.21.15.78:0/4285707270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5e9bee0 0x5602b5ea5780 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.139+0000 7fd61acec740 1 -- 172.21.15.78:0/4285707270 >> 172.21.15.78:0/4285707270 conn(0x5602b5e99d10 msgr2=0x5602b5e98f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.139+0000 7fd5f9ffb640 0 client.16014 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:21:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.139+0000 7fd61acec740 1 -- 172.21.15.78:0/4285707270 shutdown_connections 2024-09-11T00:21:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.139+0000 7fd61acec740 1 -- 172.21.15.78:0/4285707270 wait complete. 2024-09-11T00:21:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.140+0000 7fd61acec740 20 client.16014 trim_cache size 0 max 16384 2024-09-11T00:21:37.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.156+0000 7fd61acec740 1 Processor -- start 2024-09-11T00:21:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.157+0000 7fd61acec740 1 -- start start 2024-09-11T00:21:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.157+0000 7fd61acec740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602b5e9bee0 0x5602b5ea74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.157+0000 7fd61acec740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602b5e9c800 0x5602b5ea2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.157+0000 7fd61acec740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5ea8790 0x5602b5ea2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.157+0000 7fd61acec740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141ae7c0 con 0x5602b5ea8790 2024-09-11T00:21:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.157+0000 7fd61acec740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141b1040 con 0x5602b5e9c800 2024-09-11T00:21:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.157+0000 7fd61acec740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141aee30 con 0x5602b5e9bee0 2024-09-11T00:21:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.157+0000 7fd612d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5ea8790 0x5602b5ea2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.157+0000 7fd612d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5ea8790 0x5602b5ea2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57784/0 (socket says 172.21.15.78:57784) 2024-09-11T00:21:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.157+0000 7fd612d9d640 1 -- 172.21.15.78:0/3204606326 learned_addr learned my addr 172.21.15.78:0/3204606326 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:21:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.157+0000 7fd611d9b640 1 --2- 172.21.15.78:0/3204606326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602b5e9c800 0x5602b5ea2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.157+0000 7fd612d9d640 1 -- 172.21.15.78:0/3204606326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602b5e9bee0 msgr2=0x5602b5ea74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.157+0000 7fd61259c640 1 --2- 172.21.15.78:0/3204606326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602b5e9bee0 0x5602b5ea74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.157+0000 7fd612d9d640 1 --2- 172.21.15.78:0/3204606326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602b5e9bee0 0x5602b5ea74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.157+0000 7fd612d9d640 1 -- 172.21.15.78:0/3204606326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602b5e9c800 msgr2=0x5602b5ea2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.157+0000 7fd612d9d640 1 --2- 172.21.15.78:0/3204606326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602b5e9c800 0x5602b5ea2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.157+0000 7fd612d9d640 1 -- 172.21.15.78:0/3204606326 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602b5e99b40 con 0x5602b5ea8790 2024-09-11T00:21:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.157+0000 7fd61259c640 1 --2- 172.21.15.78:0/3204606326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602b5e9bee0 0x5602b5ea74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:21:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.157+0000 7fd611d9b640 1 --2- 172.21.15.78:0/3204606326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602b5e9c800 0x5602b5ea2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:21:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.157+0000 7fd612d9d640 1 --2- 172.21.15.78:0/3204606326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5ea8790 0x5602b5ea2ed0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd60c02a9a0 tx=0x7fd60c03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46263d81d8885a7c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.158+0000 7fd5fbfff640 1 -- 172.21.15.78:0/3204606326 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c035040 con 0x5602b5ea8790 2024-09-11T00:21:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.158+0000 7fd5fbfff640 1 -- 172.21.15.78:0/3204606326 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd60c0054f0 con 0x5602b5ea8790 2024-09-11T00:21:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.158+0000 7fd5fbfff640 1 -- 172.21.15.78:0/3204606326 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c0035f0 con 0x5602b5ea8790 2024-09-11T00:21:37.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.158+0000 7fd61acec740 1 -- 172.21.15.78:0/3204606326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5ea8790 msgr2=0x5602b5ea2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:37.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.158+0000 7fd61acec740 1 --2- 172.21.15.78:0/3204606326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5ea8790 0x5602b5ea2ed0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd60c02a9a0 tx=0x7fd60c03e000 comp rx=0 tx=0).stop 2024-09-11T00:21:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.158+0000 7fd61acec740 1 -- 172.21.15.78:0/3204606326 shutdown_connections 2024-09-11T00:21:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.158+0000 7fd61acec740 1 --2- 172.21.15.78:0/3204606326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5ea8790 0x5602b5ea2ed0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.158+0000 7fd61acec740 1 --2- 172.21.15.78:0/3204606326 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602b5e9c800 0x5602b5ea2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.158+0000 7fd61acec740 1 --2- 172.21.15.78:0/3204606326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602b5e9bee0 0x5602b5ea74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.158+0000 7fd61acec740 1 -- 172.21.15.78:0/3204606326 >> 172.21.15.78:0/3204606326 conn(0x5602b5e99d10 msgr2=0x5602b5ea6db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.158+0000 7fd61acec740 1 -- 172.21.15.78:0/3204606326 shutdown_connections 2024-09-11T00:21:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.159+0000 7fd61acec740 1 -- 172.21.15.78:0/3204606326 wait complete. 2024-09-11T00:21:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.159+0000 7fd61acec740 1 -- start start 2024-09-11T00:21:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.159+0000 7fd61acec740 1 Processor -- start 2024-09-11T00:21:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.159+0000 7fd61acec740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5e9bee0 0x5602b5eacdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.159+0000 7fd61acec740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602b5e9c800 0x5602b5ead300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.159+0000 7fd61acec740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602b5ea8790 0x5602b5f244b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.159+0000 7fd61acec740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141af500 con 0x5602b5e9bee0 2024-09-11T00:21:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.159+0000 7fd61acec740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141b0970 con 0x5602b5ea8790 2024-09-11T00:21:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.159+0000 7fd61acec740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141afbd0 con 0x5602b5e9c800 2024-09-11T00:21:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.159+0000 7fd61acec740 10 client.0 _ll_register_callbacks cb 0x7fd6040103d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:21:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.159+0000 7fd61259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5e9bee0 0x5602b5eacdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.159+0000 7fd61259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5e9bee0 0x5602b5eacdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57790/0 (socket says 172.21.15.78:57790) 2024-09-11T00:21:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.159+0000 7fd61259c640 1 -- 172.21.15.78:0/2525944219 learned_addr learned my addr 172.21.15.78:0/2525944219 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:21:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.159+0000 7fd612d9d640 1 --2- 172.21.15.78:0/2525944219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602b5ea8790 0x5602b5f244b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.159+0000 7fd611d9b640 1 --2- 172.21.15.78:0/2525944219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602b5e9c800 0x5602b5ead300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.159+0000 7fd61259c640 1 -- 172.21.15.78:0/2525944219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602b5e9c800 msgr2=0x5602b5ead300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.159+0000 7fd61259c640 1 --2- 172.21.15.78:0/2525944219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602b5e9c800 0x5602b5ead300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.160+0000 7fd61259c640 1 -- 172.21.15.78:0/2525944219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602b5ea8790 msgr2=0x5602b5f244b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.160+0000 7fd61259c640 1 --2- 172.21.15.78:0/2525944219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602b5ea8790 0x5602b5f244b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.160+0000 7fd61259c640 1 -- 172.21.15.78:0/2525944219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602b5f24aa0 con 0x5602b5e9bee0 2024-09-11T00:21:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.160+0000 7fd611d9b640 1 --2- 172.21.15.78:0/2525944219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602b5e9c800 0x5602b5ead300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:21:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.160+0000 7fd61259c640 1 --2- 172.21.15.78:0/2525944219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5e9bee0 0x5602b5eacdc0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd60400c700 tx=0x7fd604010f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9175d70d595553f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.160+0000 7fd5f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:21:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.160+0000 7fd5f9ffb640 1 -- 172.21.15.78:0/2525944219 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6040ac4d0 con 0x5602b5e9bee0 2024-09-11T00:21:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.160+0000 7fd5f9ffb640 1 -- 172.21.15.78:0/2525944219 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fd604010bd0 con 0x5602b5e9bee0 2024-09-11T00:21:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.160+0000 7fd61acec740 1 -- 172.21.15.78:0/2525944219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd60c0054f0 con 0x5602b5e9bee0 2024-09-11T00:21:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.160+0000 7fd5f9ffb640 1 -- 172.21.15.78:0/2525944219 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd6040ac700 con 0x5602b5e9bee0 2024-09-11T00:21:37.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.160+0000 7fd61acec740 10 client.16020 fetch_fsmap learned FSMap version 20 2024-09-11T00:21:37.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.160+0000 7fd61acec740 1 -- 172.21.15.78:0/2525944219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5602b5f25d50 con 0x5602b5e9bee0 2024-09-11T00:21:37.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.160+0000 7fd5f9ffb640 1 -- 172.21.15.78:0/2525944219 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd60c0054f0 con 0x5602b5e9bee0 2024-09-11T00:21:37.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.160+0000 7fd5f9ffb640 1 -- 172.21.15.78:0/2525944219 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd6040ab3d0 con 0x5602b5e9bee0 2024-09-11T00:21:37.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.160+0000 7fd61acec740 10 client.16020 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:21:37.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.160+0000 7fd61acec740 10 client.16020 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:21:37.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.160+0000 7fd61acec740 20 client.16020 populate_metadata read hostname 'smithi078' 2024-09-11T00:21:37.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.160+0000 7fd61acec740 1 --2- 172.21.15.78:0/2525944219 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5602b5f26310 0x5602b5f28730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:37.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.160+0000 7fd61acec740 4 client.16020 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:21:37.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.160+0000 7fd61acec740 1 -- 172.21.15.78:0/2525944219 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5602b5e10860 con 0x5602b5f26310 2024-09-11T00:21:37.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.161+0000 7fd611d9b640 1 --2- 172.21.15.78:0/2525944219 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5602b5f26310 0x5602b5f28730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:37.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.161+0000 7fd611d9b640 1 --2- 172.21.15.78:0/2525944219 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5602b5f26310 0x5602b5f28730 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb10204dd3351436 server_cookie=a480c2ff7103d249 in_seq=0 out_seq=0 2024-09-11T00:21:37.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.161+0000 7fd5f9ffb640 10 client.16020 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:21:37.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.162+0000 7fd5f9ffb640 1 -- 172.21.15.78:0/2525944219 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5602b5e10860 con 0x5602b5f26310 2024-09-11T00:21:37.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.162+0000 7fd5f9ffb640 10 client.16020 handle_command_reply: tid=0 2024-09-11T00:21:37.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.162+0000 7fd61acec740 1 client.16020 shutdown 2024-09-11T00:21:37.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.162+0000 7fd61acec740 1 -- 172.21.15.78:0/2525944219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5e9bee0 msgr2=0x5602b5eacdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:37.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.162+0000 7fd61acec740 1 --2- 172.21.15.78:0/2525944219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5e9bee0 0x5602b5eacdc0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd60400c700 tx=0x7fd604010f00 comp rx=0 tx=0).stop 2024-09-11T00:21:37.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.162+0000 7fd61acec740 1 -- 172.21.15.78:0/2525944219 shutdown_connections 2024-09-11T00:21:37.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.162+0000 7fd61acec740 1 --2- 172.21.15.78:0/2525944219 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5602b5f26310 0x5602b5f28730 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.162+0000 7fd61acec740 1 --2- 172.21.15.78:0/2525944219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5602b5ea8790 0x5602b5f244b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.162+0000 7fd61acec740 1 --2- 172.21.15.78:0/2525944219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5602b5e9c800 0x5602b5ead300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.163+0000 7fd61acec740 1 --2- 172.21.15.78:0/2525944219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5602b5e9bee0 0x5602b5eacdc0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.163+0000 7fd5f9ffb640 0 client.16020 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:21:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.163+0000 7fd61acec740 1 -- 172.21.15.78:0/2525944219 >> 172.21.15.78:0/2525944219 conn(0x5602b5e99d10 msgr2=0x5602b5e98f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.163+0000 7fd61acec740 1 -- 172.21.15.78:0/2525944219 shutdown_connections 2024-09-11T00:21:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.163+0000 7fd61acec740 1 -- 172.21.15.78:0/2525944219 wait complete. 2024-09-11T00:21:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.163+0000 7fd61acec740 20 client.16020 trim_cache size 0 max 16384 2024-09-11T00:21:37.170 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:21:37.170 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-11T00:21:37.170 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "e0002672-e432-4890-ab9f-20c513c5e3b6", 2024-09-11T00:21:37.170 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-11T00:21:37.170 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:21:37.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.163+0000 7fd618917640 1 -- 172.21.15.78:0/1751455865 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd5fc0b5450 msgr2=0x7fd5fc0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:37.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.163+0000 7fd618917640 1 --2- 172.21.15.78:0/1751455865 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd5fc0b5450 0x7fd5fc0b7910 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd60c006010 tx=0x7fd60c0058d0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.163+0000 7fd618917640 1 -- 172.21.15.78:0/1751455865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd614101830 msgr2=0x7fd61419b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:37.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.163+0000 7fd618917640 1 --2- 172.21.15.78:0/1751455865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd614101830 0x7fd61419b400 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd60400eab0 tx=0x7fd60400ef70 comp rx=0 tx=0).stop 2024-09-11T00:21:37.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.163+0000 7fd618917640 1 -- 172.21.15.78:0/1751455865 shutdown_connections 2024-09-11T00:21:37.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.163+0000 7fd618917640 1 --2- 172.21.15.78:0/1751455865 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd5fc0b5450 0x7fd5fc0b7910 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.163+0000 7fd618917640 1 --2- 172.21.15.78:0/1751455865 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd61410f3e0 0x7fd6141a0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.163+0000 7fd618917640 1 --2- 172.21.15.78:0/1751455865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd614102150 0x7fd61419b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.163+0000 7fd618917640 1 --2- 172.21.15.78:0/1751455865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd614101830 0x7fd61419b400 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:37.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.163+0000 7fd618917640 1 -- 172.21.15.78:0/1751455865 >> 172.21.15.78:0/1751455865 conn(0x7fd6140fd700 msgr2=0x7fd614111600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:37.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.164+0000 7fd618917640 1 -- 172.21.15.78:0/1751455865 shutdown_connections 2024-09-11T00:21:37.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:37.164+0000 7fd618917640 1 -- 172.21.15.78:0/1751455865 wait complete. 2024-09-11T00:21:37.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:37 smithi078 ceph-mon[30865]: scrub queued for path: / 2024-09-11T00:21:37.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:37 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:21:37.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:37 smithi078 ceph-mon[30865]: scrub summary: active paths [/] 2024-09-11T00:21:37.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:37 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:21:37.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:37 smithi112 ceph-mon[35627]: scrub queued for path: / 2024-09-11T00:21:37.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:37 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:21:37.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:37 smithi112 ceph-mon[35627]: scrub summary: active paths [/] 2024-09-11T00:21:37.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:37 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:21:37.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:37 smithi138 ceph-mon[35019]: scrub queued for path: / 2024-09-11T00:21:37.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:37 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:21:37.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:37 smithi138 ceph-mon[35019]: scrub summary: active paths [/] 2024-09-11T00:21:37.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:37 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:21:37.880 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:21:38.130 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:21:38.538 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:38 smithi078 ceph-mon[30865]: pgmap v478: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-11T00:21:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.617+0000 7fdf74733640 1 -- 172.21.15.78:0/630090293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf6c108050 msgr2=0x7fdf6c10e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:38.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.617+0000 7fdf74733640 1 --2- 172.21.15.78:0/630090293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf6c108050 0x7fdf6c10e850 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fdf64009ca0 tx=0x7fdf6402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.617+0000 7fdf74733640 1 -- 172.21.15.78:0/630090293 shutdown_connections 2024-09-11T00:21:38.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.617+0000 7fdf74733640 1 --2- 172.21.15.78:0/630090293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf6c108050 0x7fdf6c10e850 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.617+0000 7fdf74733640 1 --2- 172.21.15.78:0/630090293 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf6c1076d0 0x7fdf6c107b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.617+0000 7fdf74733640 1 --2- 172.21.15.78:0/630090293 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf6c1023d0 0x7fdf6c1027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.617+0000 7fdf74733640 1 -- 172.21.15.78:0/630090293 >> 172.21.15.78:0/630090293 conn(0x7fdf6c078060 msgr2=0x7fdf6c0ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:38.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.617+0000 7fdf74733640 1 -- 172.21.15.78:0/630090293 shutdown_connections 2024-09-11T00:21:38.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.617+0000 7fdf74733640 1 -- 172.21.15.78:0/630090293 wait complete. 2024-09-11T00:21:38.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.618+0000 7fdf74733640 1 Processor -- start 2024-09-11T00:21:38.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.618+0000 7fdf74733640 1 -- start start 2024-09-11T00:21:38.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.618+0000 7fdf74733640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf6c1023d0 0x7fdf6c19a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.618+0000 7fdf74733640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf6c1076d0 0x7fdf6c19a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.618+0000 7fdf74733640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf6c108050 0x7fdf6c19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.618+0000 7fdf74733640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6c111d10 con 0x7fdf6c108050 2024-09-11T00:21:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.618+0000 7fdf74733640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6c111b90 con 0x7fdf6c1023d0 2024-09-11T00:21:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.618+0000 7fdf74733640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6c111e90 con 0x7fdf6c1076d0 2024-09-11T00:21:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.618+0000 7fdf72cd0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf6c108050 0x7fdf6c19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.618+0000 7fdf72cd0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf6c108050 0x7fdf6c19aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57812/0 (socket says 172.21.15.78:57812) 2024-09-11T00:21:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.618+0000 7fdf72cd0640 1 -- 172.21.15.78:0/2214825950 learned_addr learned my addr 172.21.15.78:0/2214825950 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:21:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.618+0000 7fdf71cce640 1 --2- 172.21.15.78:0/2214825950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf6c1076d0 0x7fdf6c19a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.618+0000 7fdf724cf640 1 --2- 172.21.15.78:0/2214825950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf6c1023d0 0x7fdf6c19a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.618+0000 7fdf72cd0640 1 -- 172.21.15.78:0/2214825950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf6c1076d0 msgr2=0x7fdf6c19a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.618+0000 7fdf72cd0640 1 --2- 172.21.15.78:0/2214825950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf6c1076d0 0x7fdf6c19a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.618+0000 7fdf72cd0640 1 -- 172.21.15.78:0/2214825950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf6c1023d0 msgr2=0x7fdf6c19a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.618+0000 7fdf72cd0640 1 --2- 172.21.15.78:0/2214825950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf6c1023d0 0x7fdf6c19a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.618+0000 7fdf72cd0640 1 -- 172.21.15.78:0/2214825950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf6c1a5420 con 0x7fdf6c108050 2024-09-11T00:21:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.619+0000 7fdf72cd0640 1 --2- 172.21.15.78:0/2214825950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf6c108050 0x7fdf6c19aae0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fdf64005cc0 tx=0x7fdf6402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.619+0000 7fdf637fe640 1 -- 172.21.15.78:0/2214825950 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf64003bf0 con 0x7fdf6c108050 2024-09-11T00:21:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.619+0000 7fdf74733640 1 -- 172.21.15.78:0/2214825950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf6c1a56b0 con 0x7fdf6c108050 2024-09-11T00:21:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.619+0000 7fdf637fe640 1 -- 172.21.15.78:0/2214825950 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf64003d90 con 0x7fdf6c108050 2024-09-11T00:21:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.619+0000 7fdf637fe640 1 -- 172.21.15.78:0/2214825950 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6402fbc0 con 0x7fdf6c108050 2024-09-11T00:21:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.619+0000 7fdf74733640 1 -- 172.21.15.78:0/2214825950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf6c1a5c40 con 0x7fdf6c108050 2024-09-11T00:21:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.621+0000 7fdf637fe640 1 -- 172.21.15.78:0/2214825950 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fdf64004610 con 0x7fdf6c108050 2024-09-11T00:21:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.621+0000 7fdf76b08740 1 Processor -- start 2024-09-11T00:21:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.622+0000 7fdf76b08740 1 -- start start 2024-09-11T00:21:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.622+0000 7fdf76b08740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560beb4a60a0 0x560beb4a6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.622+0000 7fdf76b08740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4a69c0 0x560beb4b6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.622+0000 7fdf76b08740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560beb4b6d60 0x560beb4b9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.622+0000 7fdf76b08740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x560beb41ce50 con 0x560beb4a69c0 2024-09-11T00:21:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.622+0000 7fdf76b08740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560beb40c280 con 0x560beb4b6d60 2024-09-11T00:21:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.622+0000 7fdf76b08740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x560beb410090 con 0x560beb4a60a0 2024-09-11T00:21:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.622+0000 7fdf724cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4a69c0 0x560beb4b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.622+0000 7fdf724cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4a69c0 0x560beb4b6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57824/0 (socket says 172.21.15.78:57824) 2024-09-11T00:21:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.622+0000 7fdf724cf640 1 -- 172.21.15.78:0/3298156761 learned_addr learned my addr 172.21.15.78:0/3298156761 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:21:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.622+0000 7fdf71cce640 1 --2- 172.21.15.78:0/3298156761 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560beb4a60a0 0x560beb4a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.622+0000 7fdf637fe640 1 --2- 172.21.15.78:0/2214825950 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdf580b5450 0x7fdf580b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.622+0000 7fdf71cce640 1 --2- 172.21.15.78:0/3298156761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560beb4b6d60 0x560beb4b9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.622+0000 7fdf724cf640 1 -- 172.21.15.78:0/3298156761 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560beb4a60a0 msgr2=0x560beb4a6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.622+0000 7fdf724cf640 1 --2- 172.21.15.78:0/3298156761 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560beb4a60a0 0x560beb4a6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.622+0000 7fdf724cf640 1 -- 172.21.15.78:0/3298156761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560beb4b6d60 msgr2=0x560beb4b9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.622+0000 7fdf724cf640 1 --2- 172.21.15.78:0/3298156761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560beb4b6d60 0x560beb4b9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.622+0000 7fdf724cf640 1 -- 172.21.15.78:0/3298156761 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560beb16a650 con 0x560beb4a69c0 2024-09-11T00:21:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.622+0000 7fdf72cd0640 1 --2- 172.21.15.78:0/2214825950 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdf580b5450 0x7fdf580b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.622+0000 7fdf724cf640 1 --2- 172.21.15.78:0/3298156761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4a69c0 0x560beb4b6820 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fdf68009bc0 tx=0x7fdf6800e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8d54b7fd376466 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.622+0000 7fdf637fe640 1 -- 172.21.15.78:0/2214825950 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fdf641075d0 con 0x7fdf6c108050 2024-09-11T00:21:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.623+0000 7fdf60ff9640 1 -- 172.21.15.78:0/3298156761 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf68016070 con 0x560beb4a69c0 2024-09-11T00:21:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.623+0000 7fdf60ff9640 1 -- 172.21.15.78:0/3298156761 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf6800ee90 con 0x560beb4a69c0 2024-09-11T00:21:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.623+0000 7fdf60ff9640 1 -- 172.21.15.78:0/3298156761 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf68010750 con 0x560beb4a69c0 2024-09-11T00:21:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.623+0000 7fdf76b08740 1 -- 172.21.15.78:0/3298156761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4a69c0 msgr2=0x560beb4b6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.623+0000 7fdf72cd0640 1 --2- 172.21.15.78:0/2214825950 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdf580b5450 0x7fdf580b7910 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdf640cda00 tx=0x7fdf64096cd0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.623+0000 7fdf76b08740 1 --2- 172.21.15.78:0/3298156761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4a69c0 0x560beb4b6820 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fdf68009bc0 tx=0x7fdf6800e6c0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.623+0000 7fdf76b08740 1 -- 172.21.15.78:0/3298156761 shutdown_connections 2024-09-11T00:21:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.623+0000 7fdf76b08740 1 --2- 172.21.15.78:0/3298156761 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560beb4b6d60 0x560beb4b9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.623+0000 7fdf76b08740 1 --2- 172.21.15.78:0/3298156761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4a69c0 0x560beb4b6820 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.623+0000 7fdf76b08740 1 --2- 172.21.15.78:0/3298156761 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560beb4a60a0 0x560beb4a6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.623+0000 7fdf76b08740 1 -- 172.21.15.78:0/3298156761 >> 172.21.15.78:0/3298156761 conn(0x560beb4a3ed0 msgr2=0x560beb4a5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:38.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.623+0000 7fdf76b08740 1 -- 172.21.15.78:0/3298156761 shutdown_connections 2024-09-11T00:21:38.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.624+0000 7fdf76b08740 1 -- 172.21.15.78:0/3298156761 wait complete. 2024-09-11T00:21:38.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.624+0000 7fdf76b08740 1 -- start start 2024-09-11T00:21:38.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.624+0000 7fdf76b08740 1 Processor -- start 2024-09-11T00:21:38.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.624+0000 7fdf76b08740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560beb4a60a0 0x560beb4b6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:38.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.624+0000 7fdf76b08740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560beb4a69c0 0x560beb4b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:38.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.624+0000 7fdf76b08740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4b6d60 0x560beb4b4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:38.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.624+0000 7fdf76b08740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x560beb26d700 con 0x560beb4b6d60 2024-09-11T00:21:38.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.624+0000 7fdf76b08740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560beb3a7110 con 0x560beb4a69c0 2024-09-11T00:21:38.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.624+0000 7fdf76b08740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x560beb4b99e0 con 0x560beb4a60a0 2024-09-11T00:21:38.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.624+0000 7fdf76b08740 10 client.0 _ll_register_callbacks cb 0x560beb3c0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:21:38.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.624+0000 7fdf71cce640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4b6d60 0x560beb4b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.624+0000 7fdf71cce640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4b6d60 0x560beb4b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57828/0 (socket says 172.21.15.78:57828) 2024-09-11T00:21:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.624+0000 7fdf71cce640 1 -- 172.21.15.78:0/621958 learned_addr learned my addr 172.21.15.78:0/621958 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:21:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.624+0000 7fdf724cf640 1 --2- 172.21.15.78:0/621958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560beb4a69c0 0x560beb4b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.624+0000 7fdf71cce640 1 --2- 172.21.15.78:0/621958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560beb4a60a0 0x560beb4b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.625+0000 7fdf71cce640 1 -- 172.21.15.78:0/621958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560beb4a60a0 msgr2=0x560beb4b6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.625+0000 7fdf71cce640 1 --2- 172.21.15.78:0/621958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560beb4a60a0 0x560beb4b6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.625+0000 7fdf71cce640 1 -- 172.21.15.78:0/621958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560beb4a69c0 msgr2=0x560beb4b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.625+0000 7fdf71cce640 1 --2- 172.21.15.78:0/621958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560beb4a69c0 0x560beb4b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.625+0000 7fdf71cce640 1 -- 172.21.15.78:0/621958 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560beb3d4c40 con 0x560beb4b6d60 2024-09-11T00:21:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.625+0000 7fdf71cce640 1 --2- 172.21.15.78:0/621958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4b6d60 0x560beb4b4160 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c011e30 tx=0x7fdf5c00eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92ecc4e7a170bed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.625+0000 7fdf55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:21:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.625+0000 7fdf55ffb640 1 -- 172.21.15.78:0/621958 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c005020 con 0x560beb4b6d60 2024-09-11T00:21:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.625+0000 7fdf76b08740 1 -- 172.21.15.78:0/621958 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf6800ee90 con 0x560beb4b6d60 2024-09-11T00:21:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.625+0000 7fdf55ffb640 1 -- 172.21.15.78:0/621958 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fdf5c0051c0 con 0x560beb4b6d60 2024-09-11T00:21:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.625+0000 7fdf55ffb640 1 -- 172.21.15.78:0/621958 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fdf5c0053c0 con 0x560beb4b6d60 2024-09-11T00:21:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.625+0000 7fdf76b08740 10 client.16032 fetch_fsmap learned FSMap version 20 2024-09-11T00:21:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.625+0000 7fdf76b08740 1 -- 172.21.15.78:0/621958 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560beb4c53b0 con 0x560beb4b6d60 2024-09-11T00:21:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.625+0000 7fdf55ffb640 1 -- 172.21.15.78:0/621958 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf6800ee90 con 0x560beb4b6d60 2024-09-11T00:21:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.625+0000 7fdf55ffb640 1 -- 172.21.15.78:0/621958 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fdf5c026020 con 0x560beb4b6d60 2024-09-11T00:21:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.625+0000 7fdf76b08740 10 client.16032 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:21:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.625+0000 7fdf76b08740 10 client.16032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:21:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.625+0000 7fdf76b08740 20 client.16032 populate_metadata read hostname 'smithi078' 2024-09-11T00:21:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.625+0000 7fdf76b08740 1 --2- 172.21.15.78:0/621958 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560beb4c6860 0x560beb4c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.626+0000 7fdf76b08740 4 client.16032 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:21:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.626+0000 7fdf76b08740 1 -- 172.21.15.78:0/621958 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560beb41eda0 con 0x560beb4c6860 2024-09-11T00:21:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.626+0000 7fdf724cf640 1 --2- 172.21.15.78:0/621958 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560beb4c6860 0x560beb4c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.626+0000 7fdf724cf640 1 --2- 172.21.15.78:0/621958 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560beb4c6860 0x560beb4c8c50 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2fa80a64c41dcf1 server_cookie=a7f8c870dc7e3b81 in_seq=0 out_seq=0 2024-09-11T00:21:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.626+0000 7fdf55ffb640 10 client.16032 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:21:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.627+0000 7fdf55ffb640 1 -- 172.21.15.78:0/621958 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560beb41eda0 con 0x560beb4c6860 2024-09-11T00:21:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.627+0000 7fdf55ffb640 10 client.16032 handle_command_reply: tid=0 2024-09-11T00:21:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.627+0000 7fdf76b08740 1 client.16032 shutdown 2024-09-11T00:21:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.627+0000 7fdf76b08740 1 -- 172.21.15.78:0/621958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4b6d60 msgr2=0x560beb4b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.627+0000 7fdf76b08740 1 --2- 172.21.15.78:0/621958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4b6d60 0x560beb4b4160 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c011e30 tx=0x7fdf5c00eb10 comp rx=0 tx=0).stop 2024-09-11T00:21:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.627+0000 7fdf76b08740 1 -- 172.21.15.78:0/621958 shutdown_connections 2024-09-11T00:21:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.627+0000 7fdf76b08740 1 --2- 172.21.15.78:0/621958 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560beb4c6860 0x560beb4c8c50 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.627+0000 7fdf76b08740 1 --2- 172.21.15.78:0/621958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4b6d60 0x560beb4b4160 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.627+0000 7fdf55ffb640 0 client.16032 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:21:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.627+0000 7fdf76b08740 1 --2- 172.21.15.78:0/621958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560beb4a69c0 0x560beb4b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.627+0000 7fdf76b08740 1 --2- 172.21.15.78:0/621958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560beb4a60a0 0x560beb4b6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.627+0000 7fdf76b08740 1 -- 172.21.15.78:0/621958 >> 172.21.15.78:0/621958 conn(0x560beb4a3ed0 msgr2=0x560beb4a9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.627+0000 7fdf76b08740 1 -- 172.21.15.78:0/621958 shutdown_connections 2024-09-11T00:21:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.627+0000 7fdf76b08740 1 -- 172.21.15.78:0/621958 wait complete. 2024-09-11T00:21:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.627+0000 7fdf76b08740 20 client.16032 trim_cache size 0 max 16384 2024-09-11T00:21:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.644+0000 7fdf76b08740 1 Processor -- start 2024-09-11T00:21:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.644+0000 7fdf76b08740 1 -- start start 2024-09-11T00:21:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.644+0000 7fdf76b08740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4a60a0 0x560beb4c2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.644+0000 7fdf76b08740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560beb4a69c0 0x560beb4a3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.644+0000 7fdf76b08740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560beb4b6d60 0x560beb49ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.644+0000 7fdf76b08740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6c1aa410 con 0x560beb4a60a0 2024-09-11T00:21:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.644+0000 7fdf76b08740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6c1acc90 con 0x560beb4a69c0 2024-09-11T00:21:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.644+0000 7fdf76b08740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6c1aaa80 con 0x560beb4b6d60 2024-09-11T00:21:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.645+0000 7fdf71cce640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4a60a0 0x560beb4c2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.645+0000 7fdf71cce640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4a60a0 0x560beb4c2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57840/0 (socket says 172.21.15.78:57840) 2024-09-11T00:21:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.645+0000 7fdf71cce640 1 -- 172.21.15.78:0/1564156045 learned_addr learned my addr 172.21.15.78:0/1564156045 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:21:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.645+0000 7fdf724cf640 1 --2- 172.21.15.78:0/1564156045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560beb4a69c0 0x560beb4a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.645+0000 7fdf71cce640 1 --2- 172.21.15.78:0/1564156045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560beb4b6d60 0x560beb49ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.645+0000 7fdf71cce640 1 -- 172.21.15.78:0/1564156045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560beb4b6d60 msgr2=0x560beb49ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.645+0000 7fdf71cce640 1 --2- 172.21.15.78:0/1564156045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560beb4b6d60 0x560beb49ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.645+0000 7fdf71cce640 1 -- 172.21.15.78:0/1564156045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560beb4a69c0 msgr2=0x560beb4a3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.645+0000 7fdf71cce640 1 --2- 172.21.15.78:0/1564156045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560beb4a69c0 0x560beb4a3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.645+0000 7fdf71cce640 1 -- 172.21.15.78:0/1564156045 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560beb4c8fc0 con 0x560beb4a60a0 2024-09-11T00:21:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.645+0000 7fdf71cce640 1 --2- 172.21.15.78:0/1564156045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4a60a0 0x560beb4c2c10 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c0119d0 tx=0x7fdf5c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f716be6610050b12 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.645+0000 7fdf57fff640 1 -- 172.21.15.78:0/1564156045 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c02e030 con 0x560beb4a60a0 2024-09-11T00:21:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.645+0000 7fdf57fff640 1 -- 172.21.15.78:0/1564156045 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf5c005560 con 0x560beb4a60a0 2024-09-11T00:21:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.645+0000 7fdf57fff640 1 -- 172.21.15.78:0/1564156045 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c0348a0 con 0x560beb4a60a0 2024-09-11T00:21:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.646+0000 7fdf76b08740 1 -- 172.21.15.78:0/1564156045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4a60a0 msgr2=0x560beb4c2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.646+0000 7fdf76b08740 1 --2- 172.21.15.78:0/1564156045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4a60a0 0x560beb4c2c10 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c0119d0 tx=0x7fdf5c001e70 comp rx=0 tx=0).stop 2024-09-11T00:21:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.646+0000 7fdf76b08740 1 -- 172.21.15.78:0/1564156045 shutdown_connections 2024-09-11T00:21:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.646+0000 7fdf76b08740 1 --2- 172.21.15.78:0/1564156045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560beb4b6d60 0x560beb49ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.646+0000 7fdf76b08740 1 --2- 172.21.15.78:0/1564156045 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560beb4a69c0 0x560beb4a3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.646+0000 7fdf76b08740 1 --2- 172.21.15.78:0/1564156045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4a60a0 0x560beb4c2c10 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.646+0000 7fdf76b08740 1 -- 172.21.15.78:0/1564156045 >> 172.21.15.78:0/1564156045 conn(0x560beb4a3ed0 msgr2=0x560beb4b5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.646+0000 7fdf76b08740 1 -- 172.21.15.78:0/1564156045 shutdown_connections 2024-09-11T00:21:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.646+0000 7fdf76b08740 1 -- 172.21.15.78:0/1564156045 wait complete. 2024-09-11T00:21:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.646+0000 7fdf76b08740 1 -- start start 2024-09-11T00:21:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.646+0000 7fdf76b08740 1 Processor -- start 2024-09-11T00:21:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.647+0000 7fdf76b08740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4a60a0 0x560beb4bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.647+0000 7fdf76b08740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560beb4a69c0 0x560beb4bbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.647+0000 7fdf76b08740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560beb4b6d60 0x560beb4bc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.647+0000 7fdf76b08740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6c1ab150 con 0x560beb4a60a0 2024-09-11T00:21:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.647+0000 7fdf76b08740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6c1ac5c0 con 0x560beb4a69c0 2024-09-11T00:21:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.647+0000 7fdf76b08740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6c1ab820 con 0x560beb4b6d60 2024-09-11T00:21:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.647+0000 7fdf76b08740 10 client.0 _ll_register_callbacks cb 0x7fdf5c00ed50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:21:38.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.647+0000 7fdf71cce640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4a60a0 0x560beb4bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:38.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.647+0000 7fdf71cce640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4a60a0 0x560beb4bf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57842/0 (socket says 172.21.15.78:57842) 2024-09-11T00:21:38.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.647+0000 7fdf71cce640 1 -- 172.21.15.78:0/1695396842 learned_addr learned my addr 172.21.15.78:0/1695396842 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:21:38.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.647+0000 7fdf724cf640 1 --2- 172.21.15.78:0/1695396842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560beb4a69c0 0x560beb4bbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:38.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.647+0000 7fdf71cce640 1 -- 172.21.15.78:0/1695396842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560beb4b6d60 msgr2=0x560beb4bc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:38.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.647+0000 7fdf71cce640 1 --2- 172.21.15.78:0/1695396842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560beb4b6d60 0x560beb4bc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.647+0000 7fdf71cce640 1 -- 172.21.15.78:0/1695396842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560beb4a69c0 msgr2=0x560beb4bbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:21:38.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.647+0000 7fdf71cce640 1 --2- 172.21.15.78:0/1695396842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560beb4a69c0 0x560beb4bbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.647+0000 7fdf71cce640 1 -- 172.21.15.78:0/1695396842 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560beb4bc6f0 con 0x560beb4a60a0 2024-09-11T00:21:38.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.647+0000 7fdf724cf640 1 --2- 172.21.15.78:0/1695396842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560beb4a69c0 0x560beb4bbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:21:38.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.647+0000 7fdf71cce640 1 --2- 172.21.15.78:0/1695396842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4a60a0 0x560beb4bf140 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c00e430 tx=0x7fdf5c020c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9029a01078f315b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:21:38.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.647+0000 7fdf55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:21:38.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.647+0000 7fdf55ffb640 1 -- 172.21.15.78:0/1695396842 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c02e050 con 0x560beb4a60a0 2024-09-11T00:21:38.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.647+0000 7fdf55ffb640 1 -- 172.21.15.78:0/1695396842 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fdf5c0343f0 con 0x560beb4a60a0 2024-09-11T00:21:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.647+0000 7fdf76b08740 1 -- 172.21.15.78:0/1695396842 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf5c005560 con 0x560beb4a60a0 2024-09-11T00:21:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.648+0000 7fdf55ffb640 1 -- 172.21.15.78:0/1695396842 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fdf5c011ca0 con 0x560beb4a60a0 2024-09-11T00:21:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.648+0000 7fdf76b08740 10 client.16038 fetch_fsmap learned FSMap version 20 2024-09-11T00:21:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.648+0000 7fdf76b08740 1 -- 172.21.15.78:0/1695396842 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560beb534500 con 0x560beb4a60a0 2024-09-11T00:21:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.648+0000 7fdf55ffb640 1 -- 172.21.15.78:0/1695396842 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf5c005560 con 0x560beb4a60a0 2024-09-11T00:21:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.648+0000 7fdf55ffb640 1 -- 172.21.15.78:0/1695396842 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fdf5c044070 con 0x560beb4a60a0 2024-09-11T00:21:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.648+0000 7fdf76b08740 10 client.16038 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:21:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.648+0000 7fdf76b08740 10 client.16038 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:21:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.648+0000 7fdf76b08740 20 client.16038 populate_metadata read hostname 'smithi078' 2024-09-11T00:21:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.648+0000 7fdf76b08740 1 --2- 172.21.15.78:0/1695396842 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560beb534be0 0x560beb537000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:21:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.648+0000 7fdf76b08740 4 client.16038 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:21:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.648+0000 7fdf76b08740 1 -- 172.21.15.78:0/1695396842 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560beb41a850 con 0x560beb534be0 2024-09-11T00:21:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.648+0000 7fdf724cf640 1 --2- 172.21.15.78:0/1695396842 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560beb534be0 0x560beb537000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:21:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.649+0000 7fdf55ffb640 10 client.16038 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:21:38.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.649+0000 7fdf724cf640 1 --2- 172.21.15.78:0/1695396842 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560beb534be0 0x560beb537000 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1391a5ff300bce6f server_cookie=c2c34f943e31150c in_seq=0 out_seq=0 2024-09-11T00:21:38.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.649+0000 7fdf55ffb640 1 -- 172.21.15.78:0/1695396842 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3126 (crc 0 0 0) 0x560beb41a850 con 0x560beb534be0 2024-09-11T00:21:38.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.649+0000 7fdf55ffb640 10 client.16038 handle_command_reply: tid=0 2024-09-11T00:21:38.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.649+0000 7fdf76b08740 1 client.16038 shutdown 2024-09-11T00:21:38.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.649+0000 7fdf76b08740 1 -- 172.21.15.78:0/1695396842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4a60a0 msgr2=0x560beb4bf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:38.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.649+0000 7fdf76b08740 1 --2- 172.21.15.78:0/1695396842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4a60a0 0x560beb4bf140 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c00e430 tx=0x7fdf5c020c60 comp rx=0 tx=0).stop 2024-09-11T00:21:38.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.649+0000 7fdf76b08740 1 -- 172.21.15.78:0/1695396842 shutdown_connections 2024-09-11T00:21:38.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.649+0000 7fdf76b08740 1 --2- 172.21.15.78:0/1695396842 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560beb534be0 0x560beb537000 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.649+0000 7fdf76b08740 1 --2- 172.21.15.78:0/1695396842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560beb4b6d60 0x560beb4bc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.649+0000 7fdf76b08740 1 --2- 172.21.15.78:0/1695396842 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560beb4a69c0 0x560beb4bbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.649+0000 7fdf76b08740 1 --2- 172.21.15.78:0/1695396842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560beb4a60a0 0x560beb4bf140 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.649+0000 7fdf76b08740 1 -- 172.21.15.78:0/1695396842 >> 172.21.15.78:0/1695396842 conn(0x560beb4a3ed0 msgr2=0x560beb4b5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:38.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.649+0000 7fdf55ffb640 0 client.16038 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:21:38.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.649+0000 7fdf76b08740 1 -- 172.21.15.78:0/1695396842 shutdown_connections 2024-09-11T00:21:38.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.649+0000 7fdf76b08740 1 -- 172.21.15.78:0/1695396842 wait complete. 2024-09-11T00:21:38.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.649+0000 7fdf76b08740 20 client.16038 trim_cache size 0 max 16384 2024-09-11T00:21:38.667 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:21:38.667 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:21:38.667 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-11T00:21:38.667 INFO:teuthology.orchestra.run.smithi078.stdout: "e0002672-e432-4890-ab9f-20c513c5e3b6": { 2024-09-11T00:21:38.667 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:21:38.668 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "e0002672-e432-4890-ab9f-20c513c5e3b6", 2024-09-11T00:21:38.668 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-11T00:21:38.668 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:21:38.668 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:21:38.668 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:21:38.668 INFO:teuthology.orchestra.run.smithi078.stdout: "e0002672-e432-4890-ab9f-20c513c5e3b6": { 2024-09-11T00:21:38.668 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:21:37.161715+0000", 2024-09-11T00:21:38.669 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:21:38.669 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:21:38.669 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:21:38.669 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:21:38.669 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:21:38.669 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:21:38.669 INFO:teuthology.orchestra.run.smithi078.stdout: "8ec9e858-aa62-420d-a112-e62ea7810e63": { 2024-09-11T00:21:38.669 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:18.882749+0000", 2024-09-11T00:21:38.669 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:21:38.669 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:21:38.669 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:21:38.669 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:21:38.670 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:21:38.670 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:21:38.670 INFO:teuthology.orchestra.run.smithi078.stdout: "38a1d30d-5f4c-460a-afcd-e6c60b97e43a": { 2024-09-11T00:21:38.670 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:58.127727+0000", 2024-09-11T00:21:38.670 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:21:38.670 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:21:38.670 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:21:38.670 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:21:38.670 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:21:38.670 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:21:38.670 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:21:38.670 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:21:38.670 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:21:38.670 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:21:38.670 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:21:38.671 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:21:38.671 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:21:38.671 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:21:38.671 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:21:38.671 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:21:38.671 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:21:38.671 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:21:38.671 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:21:38.671 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:21:38.671 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:21:38.671 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:21:38.672 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:21:38.672 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:21:38.672 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:21:38.672 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:21:38.672 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:21:38.672 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:21:38.673 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:21:38.673 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:21:38.673 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:21:38.673 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:21:38.673 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:21:38.673 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:21:38.673 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:21:38.673 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:21:38.673 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:21:38.673 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:21:38.673 INFO:teuthology.orchestra.run.smithi078.stdout: "b854cbd3-8ca7-4277-a205-8887d2ff5567": { 2024-09-11T00:21:38.673 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:11.182949+0000", 2024-09-11T00:21:38.673 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:21:38.674 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:21:38.674 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:21:38.674 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:21:38.674 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:21:38.674 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:21:38.674 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:21:38.674 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:21:38.674 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:21:38.674 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:21:38.674 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:21:38.674 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:21:38.674 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:21:38.674 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:21:38.674 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:21:38.675 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:21:38.675 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:21:38.675 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:21:38.675 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:21:38.675 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:21:38.675 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:21:38.675 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:21:38.675 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:21:38.675 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:21:38.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.650+0000 7fdf74733640 1 -- 172.21.15.78:0/2214825950 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdf580b5450 msgr2=0x7fdf580b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:38.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.650+0000 7fdf74733640 1 --2- 172.21.15.78:0/2214825950 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdf580b5450 0x7fdf580b7910 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdf640cda00 tx=0x7fdf64096cd0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.650+0000 7fdf74733640 1 -- 172.21.15.78:0/2214825950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf6c108050 msgr2=0x7fdf6c19aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:21:38.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.650+0000 7fdf74733640 1 --2- 172.21.15.78:0/2214825950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf6c108050 0x7fdf6c19aae0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fdf64005cc0 tx=0x7fdf6402f380 comp rx=0 tx=0).stop 2024-09-11T00:21:38.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.650+0000 7fdf74733640 1 -- 172.21.15.78:0/2214825950 shutdown_connections 2024-09-11T00:21:38.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.650+0000 7fdf74733640 1 --2- 172.21.15.78:0/2214825950 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdf580b5450 0x7fdf580b7910 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.650+0000 7fdf74733640 1 --2- 172.21.15.78:0/2214825950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf6c108050 0x7fdf6c19aae0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.650+0000 7fdf74733640 1 --2- 172.21.15.78:0/2214825950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf6c1076d0 0x7fdf6c19a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.650+0000 7fdf74733640 1 --2- 172.21.15.78:0/2214825950 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdf6c1023d0 0x7fdf6c19a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:21:38.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.650+0000 7fdf74733640 1 -- 172.21.15.78:0/2214825950 >> 172.21.15.78:0/2214825950 conn(0x7fdf6c078060 msgr2=0x7fdf6c103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:21:38.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.650+0000 7fdf74733640 1 -- 172.21.15.78:0/2214825950 shutdown_connections 2024-09-11T00:21:38.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:21:38.650+0000 7fdf74733640 1 -- 172.21.15.78:0/2214825950 wait complete. 2024-09-11T00:21:38.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:38 smithi112 ceph-mon[35627]: pgmap v478: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-11T00:21:38.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:38 smithi138 ceph-mon[35019]: pgmap v478: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-11T00:21:39.396 INFO:tasks.cephfs.filesystem:scrub status for tag:e0002672-e432-4890-ab9f-20c513c5e3b6 - {'path': '/', 'tag': 'e0002672-e432-4890-ab9f-20c513c5e3b6', 'options': 'recursive,force'} 2024-09-11T00:21:39.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:39 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:21:39.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:39 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:21:39.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:39 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:21:40.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:21:40.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:21:40.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:21:40.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:40 smithi078 ceph-mon[30865]: pgmap v479: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-11T00:21:40.694 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:21:40.694 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:21:40.694 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:21:40.694 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:40 smithi138 ceph-mon[35019]: pgmap v479: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-11T00:21:40.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:21:40.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:21:40.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:21:40.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:40 smithi112 ceph-mon[35627]: pgmap v479: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-11T00:21:41.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:41 smithi078 ceph-mon[30865]: scrub summary: idle 2024-09-11T00:21:41.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:41 smithi112 ceph-mon[35627]: scrub summary: idle 2024-09-11T00:21:42.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:41 smithi138 ceph-mon[35019]: scrub summary: idle 2024-09-11T00:21:42.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:42 smithi078 ceph-mon[30865]: pgmap v480: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-11T00:21:42.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:42 smithi112 ceph-mon[35627]: pgmap v480: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-11T00:21:43.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:42 smithi138 ceph-mon[35019]: pgmap v480: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-11T00:21:44.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:43 smithi112 ceph-mon[35627]: pgmap v481: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-11T00:21:44.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:43 smithi138 ceph-mon[35019]: pgmap v481: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-11T00:21:44.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:43 smithi078 ceph-mon[30865]: pgmap v481: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-11T00:21:46.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:45 smithi112 ceph-mon[35627]: pgmap v482: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-11T00:21:46.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:45 smithi138 ceph-mon[35019]: pgmap v482: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-11T00:21:46.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:45 smithi078 ceph-mon[30865]: pgmap v482: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-11T00:21:48.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:47 smithi112 ceph-mon[35627]: pgmap v483: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:21:48.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:47 smithi138 ceph-mon[35019]: pgmap v483: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:21:48.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:47 smithi078 ceph-mon[30865]: pgmap v483: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:21:50.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:49 smithi112 ceph-mon[35627]: pgmap v484: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:21:50.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:49 smithi138 ceph-mon[35019]: pgmap v484: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:21:50.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:49 smithi078 ceph-mon[30865]: pgmap v484: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:21:52.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:51 smithi112 ceph-mon[35627]: pgmap v485: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:21:52.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:51 smithi138 ceph-mon[35019]: pgmap v485: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:21:52.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:51 smithi078 ceph-mon[30865]: pgmap v485: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:21:54.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:53 smithi112 ceph-mon[35627]: pgmap v486: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:21:54.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:53 smithi138 ceph-mon[35019]: pgmap v486: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:21:54.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:53 smithi078 ceph-mon[30865]: pgmap v486: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:21:56.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:55 smithi112 ceph-mon[35627]: pgmap v487: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:21:56.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:55 smithi138 ceph-mon[35019]: pgmap v487: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:21:56.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:55 smithi078 ceph-mon[30865]: pgmap v487: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:21:58.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:57 smithi112 ceph-mon[35627]: pgmap v488: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:21:58.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:57 smithi138 ceph-mon[35019]: pgmap v488: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:21:58.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:57 smithi078 ceph-mon[30865]: pgmap v488: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:00.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:21:59 smithi112 ceph-mon[35627]: pgmap v489: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:00.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:21:59 smithi138 ceph-mon[35019]: pgmap v489: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:00.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:21:59 smithi078 ceph-mon[30865]: pgmap v489: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:02.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:01 smithi112 ceph-mon[35627]: pgmap v490: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-11T00:22:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:01 smithi138 ceph-mon[35019]: pgmap v490: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-11T00:22:02.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:01 smithi078 ceph-mon[30865]: pgmap v490: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-11T00:22:04.136 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:03 smithi078 ceph-mon[30865]: pgmap v491: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:22:04.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:03 smithi112 ceph-mon[35627]: pgmap v491: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:22:04.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:03 smithi138 ceph-mon[35019]: pgmap v491: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:22:06.236 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:05 smithi112 ceph-mon[35627]: pgmap v492: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T00:22:06.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:05 smithi138 ceph-mon[35019]: pgmap v492: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T00:22:06.336 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:05 smithi078 ceph-mon[30865]: pgmap v492: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T00:22:08.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:07 smithi112 ceph-mon[35627]: pgmap v493: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:22:08.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:07 smithi138 ceph-mon[35019]: pgmap v493: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:22:08.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:07 smithi078 ceph-mon[30865]: pgmap v493: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:22:09.397 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:22:09.657 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:22:10.050 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:09 smithi078 ceph-mon[30865]: pgmap v494: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:22:10.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:09 smithi112 ceph-mon[35627]: pgmap v494: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:22:10.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:09 smithi138 ceph-mon[35019]: pgmap v494: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-11T00:22:10.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.277+0000 7fd70e433640 1 -- 172.21.15.78:0/3931737445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd708108060 msgr2=0x7fd70810e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:10.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.277+0000 7fd70e433640 1 --2- 172.21.15.78:0/3931737445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd708108060 0x7fd70810e860 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd700009ca0 tx=0x7fd70002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.277+0000 7fd70e433640 1 -- 172.21.15.78:0/3931737445 shutdown_connections 2024-09-11T00:22:10.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.277+0000 7fd70e433640 1 --2- 172.21.15.78:0/3931737445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd708108060 0x7fd70810e860 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.277+0000 7fd70e433640 1 --2- 172.21.15.78:0/3931737445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7081076e0 0x7fd708107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.277+0000 7fd70e433640 1 --2- 172.21.15.78:0/3931737445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd708101cd0 0x7fd7081020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.277+0000 7fd70e433640 1 -- 172.21.15.78:0/3931737445 >> 172.21.15.78:0/3931737445 conn(0x7fd7080fd720 msgr2=0x7fd7080ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.277+0000 7fd70e433640 1 -- 172.21.15.78:0/3931737445 shutdown_connections 2024-09-11T00:22:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.277+0000 7fd70e433640 1 -- 172.21.15.78:0/3931737445 wait complete. 2024-09-11T00:22:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.278+0000 7fd70e433640 1 Processor -- start 2024-09-11T00:22:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.278+0000 7fd70e433640 1 -- start start 2024-09-11T00:22:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.278+0000 7fd70e433640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd708101cd0 0x7fd70819a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.278+0000 7fd70e433640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7081076e0 0x7fd70819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.278+0000 7fd70e433640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd708108060 0x7fd70819ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.278+0000 7fd70e433640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd708111ce0 con 0x7fd708108060 2024-09-11T00:22:10.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.278+0000 7fd70e433640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd708111b60 con 0x7fd7081076e0 2024-09-11T00:22:10.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.278+0000 7fd70e433640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd708111e60 con 0x7fd708101cd0 2024-09-11T00:22:10.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.278+0000 7fd70c9d0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd708108060 0x7fd70819ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:10.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.278+0000 7fd70c9d0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd708108060 0x7fd70819ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39450/0 (socket says 172.21.15.78:39450) 2024-09-11T00:22:10.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.278+0000 7fd70c9d0640 1 -- 172.21.15.78:0/1821576961 learned_addr learned my addr 172.21.15.78:0/1821576961 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:10.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.278+0000 7fd7077fe640 1 --2- 172.21.15.78:0/1821576961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7081076e0 0x7fd70819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:10.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.278+0000 7fd707fff640 1 --2- 172.21.15.78:0/1821576961 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd708101cd0 0x7fd70819a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:10.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.279+0000 7fd70c9d0640 1 -- 172.21.15.78:0/1821576961 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd708101cd0 msgr2=0x7fd70819a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:10.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.279+0000 7fd70c9d0640 1 --2- 172.21.15.78:0/1821576961 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd708101cd0 0x7fd70819a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.279+0000 7fd70c9d0640 1 -- 172.21.15.78:0/1821576961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7081076e0 msgr2=0x7fd70819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:10.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.279+0000 7fd70c9d0640 1 --2- 172.21.15.78:0/1821576961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7081076e0 0x7fd70819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.279+0000 7fd70c9d0640 1 -- 172.21.15.78:0/1821576961 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7081a5450 con 0x7fd708108060 2024-09-11T00:22:10.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.279+0000 7fd70c9d0640 1 --2- 172.21.15.78:0/1821576961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd708108060 0x7fd70819ab10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd700005cc0 tx=0x7fd70002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:10.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.279+0000 7fd7057fa640 1 -- 172.21.15.78:0/1821576961 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd700003bf0 con 0x7fd708108060 2024-09-11T00:22:10.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.279+0000 7fd7057fa640 1 -- 172.21.15.78:0/1821576961 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd700003d90 con 0x7fd708108060 2024-09-11T00:22:10.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.279+0000 7fd70e433640 1 -- 172.21.15.78:0/1821576961 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7081a56e0 con 0x7fd708108060 2024-09-11T00:22:10.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.279+0000 7fd7057fa640 1 -- 172.21.15.78:0/1821576961 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70002fb20 con 0x7fd708108060 2024-09-11T00:22:10.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.279+0000 7fd70e433640 1 -- 172.21.15.78:0/1821576961 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7081a5c20 con 0x7fd708108060 2024-09-11T00:22:10.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.282+0000 7fd7057fa640 1 -- 172.21.15.78:0/1821576961 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fd700004580 con 0x7fd708108060 2024-09-11T00:22:10.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.282+0000 7fd710808740 1 Processor -- start 2024-09-11T00:22:10.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.282+0000 7fd710808740 1 -- start start 2024-09-11T00:22:10.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.282+0000 7fd710808740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b23480 0x562741b23860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:10.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.282+0000 7fd710808740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562741b23da0 0x562741b2f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:10.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.282+0000 7fd710808740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562741b2fd30 0x562741b32120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:10.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.282+0000 7fd710808740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x562741a99e50 con 0x562741b23480 2024-09-11T00:22:10.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.282+0000 7fd710808740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562741a89280 con 0x562741b23da0 2024-09-11T00:22:10.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.282+0000 7fd710808740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x562741a8d090 con 0x562741b2fd30 2024-09-11T00:22:10.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.282+0000 7fd7077fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b23480 0x562741b23860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:10.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.282+0000 7fd7077fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b23480 0x562741b23860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39464/0 (socket says 172.21.15.78:39464) 2024-09-11T00:22:10.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.282+0000 7fd7077fe640 1 -- 172.21.15.78:0/1838739545 learned_addr learned my addr 172.21.15.78:0/1838739545 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:10.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.282+0000 7fd7077fe640 1 -- 172.21.15.78:0/1838739545 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562741b2fd30 msgr2=0x562741b32120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:10.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.282+0000 7fd707fff640 1 --2- 172.21.15.78:0/1838739545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562741b23da0 0x562741b2f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:10.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.282+0000 7fd7077fe640 1 --2- 172.21.15.78:0/1838739545 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562741b2fd30 0x562741b32120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.282+0000 7fd7057fa640 1 --2- 172.21.15.78:0/1821576961 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd6f00b5450 0x7fd6f00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:10.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.282+0000 7fd7077fe640 1 -- 172.21.15.78:0/1838739545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562741b23da0 msgr2=0x562741b2f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:10.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.282+0000 7fd7077fe640 1 --2- 172.21.15.78:0/1838739545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562741b23da0 0x562741b2f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.282+0000 7fd7077fe640 1 -- 172.21.15.78:0/1838739545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627417e7650 con 0x562741b23480 2024-09-11T00:22:10.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.282+0000 7fd70c9d0640 1 --2- 172.21.15.78:0/1821576961 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd6f00b5450 0x7fd6f00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:10.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.283+0000 7fd7077fe640 1 --2- 172.21.15.78:0/1838739545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b23480 0x562741b23860 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc004610 tx=0x7fd6fc00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef9b554a3f8f4d4d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.283+0000 7fd7057fa640 1 -- 172.21.15.78:0/1821576961 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fd7001072d0 con 0x7fd708108060 2024-09-11T00:22:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.283+0000 7fd6ee7fc640 1 -- 172.21.15.78:0/1838739545 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc003bd0 con 0x562741b23480 2024-09-11T00:22:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.283+0000 7fd6ee7fc640 1 -- 172.21.15.78:0/1838739545 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6fc016030 con 0x562741b23480 2024-09-11T00:22:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.283+0000 7fd6ee7fc640 1 -- 172.21.15.78:0/1838739545 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc004c90 con 0x562741b23480 2024-09-11T00:22:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.283+0000 7fd710808740 1 -- 172.21.15.78:0/1838739545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b23480 msgr2=0x562741b23860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.283+0000 7fd70c9d0640 1 --2- 172.21.15.78:0/1821576961 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd6f00b5450 0x7fd6f00b7910 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd700104af0 tx=0x7fd7000969d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.283+0000 7fd710808740 1 --2- 172.21.15.78:0/1838739545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b23480 0x562741b23860 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc004610 tx=0x7fd6fc00bc20 comp rx=0 tx=0).stop 2024-09-11T00:22:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.283+0000 7fd710808740 1 -- 172.21.15.78:0/1838739545 shutdown_connections 2024-09-11T00:22:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.283+0000 7fd710808740 1 --2- 172.21.15.78:0/1838739545 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562741b2fd30 0x562741b32120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.284+0000 7fd710808740 1 --2- 172.21.15.78:0/1838739545 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562741b23da0 0x562741b2f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.284+0000 7fd710808740 1 --2- 172.21.15.78:0/1838739545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b23480 0x562741b23860 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.284+0000 7fd710808740 1 -- 172.21.15.78:0/1838739545 >> 172.21.15.78:0/1838739545 conn(0x562741b212b0 msgr2=0x562741b22450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.284+0000 7fd710808740 1 -- 172.21.15.78:0/1838739545 shutdown_connections 2024-09-11T00:22:10.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.284+0000 7fd710808740 1 -- 172.21.15.78:0/1838739545 wait complete. 2024-09-11T00:22:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.284+0000 7fd710808740 1 -- start start 2024-09-11T00:22:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.284+0000 7fd710808740 1 Processor -- start 2024-09-11T00:22:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.284+0000 7fd710808740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562741b23480 0x562741b2f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.284+0000 7fd710808740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562741b23da0 0x562741b2ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.284+0000 7fd710808740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b2fd30 0x562741b2d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.284+0000 7fd710808740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5627418ea700 con 0x562741b2fd30 2024-09-11T00:22:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.284+0000 7fd710808740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x562741a24110 con 0x562741b23480 2024-09-11T00:22:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.284+0000 7fd710808740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x562741b32950 con 0x562741b23da0 2024-09-11T00:22:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.284+0000 7fd710808740 10 client.0 _ll_register_callbacks cb 0x562741a3d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:22:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.285+0000 7fd7077fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b2fd30 0x562741b2d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.285+0000 7fd7077fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b2fd30 0x562741b2d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39466/0 (socket says 172.21.15.78:39466) 2024-09-11T00:22:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.285+0000 7fd7077fe640 1 -- 172.21.15.78:0/1667350504 learned_addr learned my addr 172.21.15.78:0/1667350504 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.285+0000 7fd707fff640 1 --2- 172.21.15.78:0/1667350504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562741b23da0 0x562741b2ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:10.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.285+0000 7fd7077fe640 1 --2- 172.21.15.78:0/1667350504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562741b23480 0x562741b2f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.285+0000 7fd7077fe640 1 -- 172.21.15.78:0/1667350504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562741b23da0 msgr2=0x562741b2ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.285+0000 7fd7077fe640 1 --2- 172.21.15.78:0/1667350504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562741b23da0 0x562741b2ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.285+0000 7fd7077fe640 1 -- 172.21.15.78:0/1667350504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562741b23480 msgr2=0x562741b2f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.285+0000 7fd7077fe640 1 --2- 172.21.15.78:0/1667350504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562741b23480 0x562741b2f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.285+0000 7fd7077fe640 1 -- 172.21.15.78:0/1667350504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562741a51c40 con 0x562741b2fd30 2024-09-11T00:22:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.285+0000 7fd7077fe640 1 --2- 172.21.15.78:0/1667350504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b2fd30 0x562741b2d090 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc005fd0 tx=0x7fd6fc004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8b02f942b6a2ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.285+0000 7fd6e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:22:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.285+0000 7fd6e77fe640 1 -- 172.21.15.78:0/1667350504 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc024040 con 0x562741b2fd30 2024-09-11T00:22:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.285+0000 7fd6e77fe640 1 -- 172.21.15.78:0/1667350504 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fd6fc01b670 con 0x562741b2fd30 2024-09-11T00:22:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.285+0000 7fd710808740 1 -- 172.21.15.78:0/1667350504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6fc016030 con 0x562741b2fd30 2024-09-11T00:22:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.285+0000 7fd6e77fe640 1 -- 172.21.15.78:0/1667350504 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd6fc01b870 con 0x562741b2fd30 2024-09-11T00:22:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.285+0000 7fd710808740 10 client.16050 fetch_fsmap learned FSMap version 20 2024-09-11T00:22:10.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.285+0000 7fd710808740 1 -- 172.21.15.78:0/1667350504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562741b3e270 con 0x562741b2fd30 2024-09-11T00:22:10.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.286+0000 7fd6e77fe640 1 -- 172.21.15.78:0/1667350504 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6fc016030 con 0x562741b2fd30 2024-09-11T00:22:10.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.286+0000 7fd6e77fe640 1 -- 172.21.15.78:0/1667350504 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd6fc010950 con 0x562741b2fd30 2024-09-11T00:22:10.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.286+0000 7fd710808740 10 client.16050 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:22:10.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.286+0000 7fd710808740 10 client.16050 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:22:10.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.286+0000 7fd710808740 20 client.16050 populate_metadata read hostname 'smithi078' 2024-09-11T00:22:10.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.286+0000 7fd710808740 1 --2- 172.21.15.78:0/1667350504 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x562741b3f6d0 0x562741b41ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:10.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.286+0000 7fd710808740 4 client.16050 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:22:10.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.286+0000 7fd710808740 1 -- 172.21.15.78:0/1667350504 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562741a9bda0 con 0x562741b3f6d0 2024-09-11T00:22:10.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.286+0000 7fd707fff640 1 --2- 172.21.15.78:0/1667350504 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x562741b3f6d0 0x562741b41ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:10.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.286+0000 7fd6e77fe640 10 client.16050 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:10.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.286+0000 7fd707fff640 1 --2- 172.21.15.78:0/1667350504 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x562741b3f6d0 0x562741b41ac0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba14e04df8d38c9c server_cookie=6a923a9e2245813b in_seq=0 out_seq=0 2024-09-11T00:22:10.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.287+0000 7fd6e77fe640 1 -- 172.21.15.78:0/1667350504 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562741a9bda0 con 0x562741b3f6d0 2024-09-11T00:22:10.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.287+0000 7fd6e77fe640 10 client.16050 handle_command_reply: tid=0 2024-09-11T00:22:10.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.287+0000 7fd710808740 1 client.16050 shutdown 2024-09-11T00:22:10.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.287+0000 7fd710808740 1 -- 172.21.15.78:0/1667350504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b2fd30 msgr2=0x562741b2d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:10.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.287+0000 7fd710808740 1 --2- 172.21.15.78:0/1667350504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b2fd30 0x562741b2d090 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc005fd0 tx=0x7fd6fc004950 comp rx=0 tx=0).stop 2024-09-11T00:22:10.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.287+0000 7fd710808740 1 -- 172.21.15.78:0/1667350504 shutdown_connections 2024-09-11T00:22:10.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.287+0000 7fd710808740 1 --2- 172.21.15.78:0/1667350504 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x562741b3f6d0 0x562741b41ac0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.287+0000 7fd710808740 1 --2- 172.21.15.78:0/1667350504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b2fd30 0x562741b2d090 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.287+0000 7fd6e77fe640 0 client.16050 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:10.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.287+0000 7fd710808740 1 --2- 172.21.15.78:0/1667350504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562741b23da0 0x562741b2ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.287+0000 7fd710808740 1 --2- 172.21.15.78:0/1667350504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562741b23480 0x562741b2f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.287+0000 7fd710808740 1 -- 172.21.15.78:0/1667350504 >> 172.21.15.78:0/1667350504 conn(0x562741b212b0 msgr2=0x562741b26e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:10.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.288+0000 7fd710808740 1 -- 172.21.15.78:0/1667350504 shutdown_connections 2024-09-11T00:22:10.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.288+0000 7fd710808740 1 -- 172.21.15.78:0/1667350504 wait complete. 2024-09-11T00:22:10.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.288+0000 7fd710808740 20 client.16050 trim_cache size 0 max 16384 2024-09-11T00:22:10.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.305+0000 7fd710808740 1 Processor -- start 2024-09-11T00:22:10.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.305+0000 7fd710808740 1 -- start start 2024-09-11T00:22:10.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.305+0000 7fd710808740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562741b23480 0x562741b3bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:10.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.305+0000 7fd710808740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b23da0 0x562741b31120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:10.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.305+0000 7fd710808740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562741b2fd30 0x562741b31660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:10.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.305+0000 7fd710808740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd7081ac650 con 0x562741b23da0 2024-09-11T00:22:10.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.305+0000 7fd710808740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd7081aeed0 con 0x562741b2fd30 2024-09-11T00:22:10.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.305+0000 7fd710808740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd7081accc0 con 0x562741b23480 2024-09-11T00:22:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.305+0000 7fd707fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b23da0 0x562741b31120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.305+0000 7fd707fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b23da0 0x562741b31120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39478/0 (socket says 172.21.15.78:39478) 2024-09-11T00:22:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.305+0000 7fd707fff640 1 -- 172.21.15.78:0/972576471 learned_addr learned my addr 172.21.15.78:0/972576471 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.305+0000 7fd7077fe640 1 --2- 172.21.15.78:0/972576471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562741b2fd30 0x562741b31660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.305+0000 7fd7077fe640 1 --2- 172.21.15.78:0/972576471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562741b23480 0x562741b3bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.306+0000 7fd707fff640 1 -- 172.21.15.78:0/972576471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562741b23480 msgr2=0x562741b3bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.306+0000 7fd707fff640 1 --2- 172.21.15.78:0/972576471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562741b23480 0x562741b3bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.306+0000 7fd707fff640 1 -- 172.21.15.78:0/972576471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562741b2fd30 msgr2=0x562741b31660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.306+0000 7fd707fff640 1 --2- 172.21.15.78:0/972576471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562741b2fd30 0x562741b31660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.306+0000 7fd707fff640 1 -- 172.21.15.78:0/972576471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562741b21f90 con 0x562741b23da0 2024-09-11T00:22:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.306+0000 7fd707fff640 1 --2- 172.21.15.78:0/972576471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b23da0 0x562741b31120 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8000c00 tx=0x7fd6f8014900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff9c2ab0cd2fb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.306+0000 7fd6edffb640 1 -- 172.21.15.78:0/972576471 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8014190 con 0x562741b23da0 2024-09-11T00:22:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.306+0000 7fd6edffb640 1 -- 172.21.15.78:0/972576471 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6f8012900 con 0x562741b23da0 2024-09-11T00:22:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.306+0000 7fd6edffb640 1 -- 172.21.15.78:0/972576471 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f80247b0 con 0x562741b23da0 2024-09-11T00:22:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.307+0000 7fd710808740 1 -- 172.21.15.78:0/972576471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b23da0 msgr2=0x562741b31120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.307+0000 7fd710808740 1 --2- 172.21.15.78:0/972576471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b23da0 0x562741b31120 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8000c00 tx=0x7fd6f8014900 comp rx=0 tx=0).stop 2024-09-11T00:22:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.307+0000 7fd710808740 1 -- 172.21.15.78:0/972576471 shutdown_connections 2024-09-11T00:22:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.307+0000 7fd710808740 1 --2- 172.21.15.78:0/972576471 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562741b2fd30 0x562741b31660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.307+0000 7fd710808740 1 --2- 172.21.15.78:0/972576471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b23da0 0x562741b31120 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.307+0000 7fd710808740 1 --2- 172.21.15.78:0/972576471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562741b23480 0x562741b3bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.307+0000 7fd710808740 1 -- 172.21.15.78:0/972576471 >> 172.21.15.78:0/972576471 conn(0x562741b212b0 msgr2=0x562741b2e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.307+0000 7fd710808740 1 -- 172.21.15.78:0/972576471 shutdown_connections 2024-09-11T00:22:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.307+0000 7fd710808740 1 -- 172.21.15.78:0/972576471 wait complete. 2024-09-11T00:22:10.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.307+0000 7fd710808740 1 -- start start 2024-09-11T00:22:10.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.307+0000 7fd710808740 1 Processor -- start 2024-09-11T00:22:10.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.308+0000 7fd710808740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562741b23480 0x562741b384b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:10.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.308+0000 7fd710808740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562741b23da0 0x562741b32ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:10.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.308+0000 7fd710808740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b2fd30 0x562741b33200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:10.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.308+0000 7fd710808740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd7081ad390 con 0x562741b2fd30 2024-09-11T00:22:10.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.308+0000 7fd710808740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd7081ae800 con 0x562741b23da0 2024-09-11T00:22:10.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.308+0000 7fd710808740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd7081ada60 con 0x562741b23480 2024-09-11T00:22:10.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.308+0000 7fd710808740 10 client.0 _ll_register_callbacks cb 0x7fd6fc00b690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:22:10.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.308+0000 7fd7077fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b2fd30 0x562741b33200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:10.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.308+0000 7fd7077fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b2fd30 0x562741b33200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39492/0 (socket says 172.21.15.78:39492) 2024-09-11T00:22:10.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.308+0000 7fd7077fe640 1 -- 172.21.15.78:0/848650232 learned_addr learned my addr 172.21.15.78:0/848650232 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:10.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.308+0000 7fd707fff640 1 --2- 172.21.15.78:0/848650232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562741b23da0 0x562741b32ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:10.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.308+0000 7fd7077fe640 1 --2- 172.21.15.78:0/848650232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562741b23480 0x562741b384b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:10.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.308+0000 7fd7077fe640 1 -- 172.21.15.78:0/848650232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562741b23480 msgr2=0x562741b384b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:10.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.308+0000 7fd7077fe640 1 --2- 172.21.15.78:0/848650232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562741b23480 0x562741b384b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.308+0000 7fd7077fe640 1 -- 172.21.15.78:0/848650232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562741b23da0 msgr2=0x562741b32ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:10.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.308+0000 7fd7077fe640 1 --2- 172.21.15.78:0/848650232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562741b23da0 0x562741b32ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.308+0000 7fd7077fe640 1 -- 172.21.15.78:0/848650232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562741bb06f0 con 0x562741b2fd30 2024-09-11T00:22:10.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.308+0000 7fd707fff640 1 --2- 172.21.15.78:0/848650232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562741b23da0 0x562741b32ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:22:10.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.308+0000 7fd7077fe640 1 --2- 172.21.15.78:0/848650232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b2fd30 0x562741b33200 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00b760 tx=0x7fd6fc004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79bf32ea08543ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:10.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.308+0000 7fd6e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:22:10.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.309+0000 7fd6e77fe640 1 -- 172.21.15.78:0/848650232 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc01b680 con 0x562741b2fd30 2024-09-11T00:22:10.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.309+0000 7fd6e77fe640 1 -- 172.21.15.78:0/848650232 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fd6fc003c80 con 0x562741b2fd30 2024-09-11T00:22:10.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.309+0000 7fd710808740 1 -- 172.21.15.78:0/848650232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6f8012900 con 0x562741b2fd30 2024-09-11T00:22:10.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.309+0000 7fd6e77fe640 1 -- 172.21.15.78:0/848650232 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd6fc003e80 con 0x562741b2fd30 2024-09-11T00:22:10.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.309+0000 7fd710808740 10 client.16056 fetch_fsmap learned FSMap version 20 2024-09-11T00:22:10.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.309+0000 7fd710808740 1 -- 172.21.15.78:0/848650232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562741bb1880 con 0x562741b2fd30 2024-09-11T00:22:10.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.309+0000 7fd6e77fe640 1 -- 172.21.15.78:0/848650232 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6f8012900 con 0x562741b2fd30 2024-09-11T00:22:10.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.309+0000 7fd6e77fe640 1 -- 172.21.15.78:0/848650232 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd6fc045050 con 0x562741b2fd30 2024-09-11T00:22:10.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.309+0000 7fd710808740 10 client.16056 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:22:10.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.309+0000 7fd710808740 10 client.16056 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:22:10.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.309+0000 7fd710808740 20 client.16056 populate_metadata read hostname 'smithi078' 2024-09-11T00:22:10.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.309+0000 7fd710808740 1 --2- 172.21.15.78:0/848650232 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x562741bb1f50 0x562741bb4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:10.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.309+0000 7fd710808740 4 client.16056 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:22:10.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.309+0000 7fd710808740 1 -- 172.21.15.78:0/848650232 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562741a97850 con 0x562741bb1f50 2024-09-11T00:22:10.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.310+0000 7fd707fff640 1 --2- 172.21.15.78:0/848650232 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x562741bb1f50 0x562741bb4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:10.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.310+0000 7fd6e77fe640 10 client.16056 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:10.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.310+0000 7fd707fff640 1 --2- 172.21.15.78:0/848650232 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x562741bb1f50 0x562741bb4370 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40e3528294efea61 server_cookie=7e99a0fab5cac3a9 in_seq=0 out_seq=0 2024-09-11T00:22:10.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.310+0000 7fd6e77fe640 1 -- 172.21.15.78:0/848650232 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x562741a97850 con 0x562741bb1f50 2024-09-11T00:22:10.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.310+0000 7fd6e77fe640 10 client.16056 handle_command_reply: tid=0 2024-09-11T00:22:10.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.310+0000 7fd710808740 1 client.16056 shutdown 2024-09-11T00:22:10.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.310+0000 7fd710808740 1 -- 172.21.15.78:0/848650232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b2fd30 msgr2=0x562741b33200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:10.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.310+0000 7fd710808740 1 --2- 172.21.15.78:0/848650232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b2fd30 0x562741b33200 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00b760 tx=0x7fd6fc004950 comp rx=0 tx=0).stop 2024-09-11T00:22:10.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.310+0000 7fd710808740 1 -- 172.21.15.78:0/848650232 shutdown_connections 2024-09-11T00:22:10.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.310+0000 7fd710808740 1 --2- 172.21.15.78:0/848650232 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x562741bb1f50 0x562741bb4370 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.310+0000 7fd710808740 1 --2- 172.21.15.78:0/848650232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562741b2fd30 0x562741b33200 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.311+0000 7fd6e77fe640 0 client.16056 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:10.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.311+0000 7fd710808740 1 --2- 172.21.15.78:0/848650232 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x562741b23da0 0x562741b32ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.311+0000 7fd710808740 1 --2- 172.21.15.78:0/848650232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562741b23480 0x562741b384b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.311+0000 7fd710808740 1 -- 172.21.15.78:0/848650232 >> 172.21.15.78:0/848650232 conn(0x562741b212b0 msgr2=0x562741b1fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:10.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.311+0000 7fd710808740 1 -- 172.21.15.78:0/848650232 shutdown_connections 2024-09-11T00:22:10.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.311+0000 7fd710808740 1 -- 172.21.15.78:0/848650232 wait complete. 2024-09-11T00:22:10.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.311+0000 7fd710808740 20 client.16056 trim_cache size 0 max 16384 2024-09-11T00:22:10.319 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:22:10.319 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-11T00:22:10.319 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {}, 2024-09-11T00:22:10.319 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:22:10.319 INFO:teuthology.orchestra.run.smithi078.stdout: "e0002672-e432-4890-ab9f-20c513c5e3b6": { 2024-09-11T00:22:10.319 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:21:37.161715+0000", 2024-09-11T00:22:10.319 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:10.319 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:10.319 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:10.319 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:10.320 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:10.320 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:10.320 INFO:teuthology.orchestra.run.smithi078.stdout: "8ec9e858-aa62-420d-a112-e62ea7810e63": { 2024-09-11T00:22:10.320 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:18.882749+0000", 2024-09-11T00:22:10.320 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:10.320 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:10.320 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:10.320 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:10.320 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:10.320 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:10.320 INFO:teuthology.orchestra.run.smithi078.stdout: "38a1d30d-5f4c-460a-afcd-e6c60b97e43a": { 2024-09-11T00:22:10.320 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:58.127727+0000", 2024-09-11T00:22:10.321 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:10.321 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:10.321 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:10.321 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:10.321 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:10.321 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:10.321 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:22:10.321 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:22:10.321 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:10.321 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:10.321 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:10.321 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:10.321 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:10.322 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:10.322 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:22:10.322 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:22:10.322 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:10.322 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:10.322 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:10.322 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:10.322 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:10.322 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:10.322 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:22:10.322 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:22:10.322 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:10.322 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:10.322 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:10.323 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:10.323 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:10.323 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:10.323 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:22:10.323 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:22:10.323 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:10.323 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:10.323 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:10.323 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:10.323 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:10.323 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:10.323 INFO:teuthology.orchestra.run.smithi078.stdout: "b854cbd3-8ca7-4277-a205-8887d2ff5567": { 2024-09-11T00:22:10.323 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:11.182949+0000", 2024-09-11T00:22:10.323 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:10.324 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:10.324 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:10.324 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:10.324 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:10.324 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:10.324 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:22:10.324 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:22:10.324 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:10.324 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:10.324 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:10.324 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:10.324 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:10.324 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:10.324 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:22:10.325 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:22:10.325 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:10.325 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:10.325 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:10.325 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:10.325 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:10.325 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:22:10.325 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:22:10.325 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:22:10.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.311+0000 7fd70e433640 1 -- 172.21.15.78:0/1821576961 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd6f00b5450 msgr2=0x7fd6f00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:10.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.311+0000 7fd70e433640 1 --2- 172.21.15.78:0/1821576961 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd6f00b5450 0x7fd6f00b7910 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd700104af0 tx=0x7fd7000969d0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.311+0000 7fd70e433640 1 -- 172.21.15.78:0/1821576961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd708108060 msgr2=0x7fd70819ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:10.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.311+0000 7fd70e433640 1 --2- 172.21.15.78:0/1821576961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd708108060 0x7fd70819ab10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd700005cc0 tx=0x7fd70002f380 comp rx=0 tx=0).stop 2024-09-11T00:22:10.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.311+0000 7fd70e433640 1 -- 172.21.15.78:0/1821576961 shutdown_connections 2024-09-11T00:22:10.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.311+0000 7fd70e433640 1 --2- 172.21.15.78:0/1821576961 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd6f00b5450 0x7fd6f00b7910 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.311+0000 7fd70e433640 1 --2- 172.21.15.78:0/1821576961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd708108060 0x7fd70819ab10 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.311+0000 7fd70e433640 1 --2- 172.21.15.78:0/1821576961 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7081076e0 0x7fd70819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.311+0000 7fd70e433640 1 --2- 172.21.15.78:0/1821576961 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd708101cd0 0x7fd70819a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:10.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.311+0000 7fd70e433640 1 -- 172.21.15.78:0/1821576961 >> 172.21.15.78:0/1821576961 conn(0x7fd7080fd720 msgr2=0x7fd708105d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:10.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.312+0000 7fd70e433640 1 -- 172.21.15.78:0/1821576961 shutdown_connections 2024-09-11T00:22:10.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:10.312+0000 7fd70e433640 1 -- 172.21.15.78:0/1821576961 wait complete. 2024-09-11T00:22:11.255 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:22:11.255 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:22:11.500 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:22:12.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.068+0000 7f60c18aa640 1 -- 172.21.15.78:0/1918192554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60bc103ce0 msgr2=0x7f60bc1040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:12.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.068+0000 7f60c18aa640 1 --2- 172.21.15.78:0/1918192554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60bc103ce0 0x7f60bc1040c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009ca0 tx=0x7f60ac02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:22:12.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.068+0000 7f60c18aa640 1 -- 172.21.15.78:0/1918192554 shutdown_connections 2024-09-11T00:22:12.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.068+0000 7f60c18aa640 1 --2- 172.21.15.78:0/1918192554 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60bc10d140 0x7f60bc10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:12.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.068+0000 7f60c18aa640 1 --2- 172.21.15.78:0/1918192554 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60bc104600 0x7f60bc10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:12.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.068+0000 7f60c18aa640 1 --2- 172.21.15.78:0/1918192554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60bc103ce0 0x7f60bc1040c0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:12.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.068+0000 7f60c18aa640 1 -- 172.21.15.78:0/1918192554 >> 172.21.15.78:0/1918192554 conn(0x7f60bc0fd700 msgr2=0x7f60bc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:12.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.068+0000 7f60c18aa640 1 -- 172.21.15.78:0/1918192554 shutdown_connections 2024-09-11T00:22:12.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.069+0000 7f60c18aa640 1 -- 172.21.15.78:0/1918192554 wait complete. 2024-09-11T00:22:12.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.069+0000 7f60c18aa640 1 Processor -- start 2024-09-11T00:22:12.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.069+0000 7f60c18aa640 1 -- start start 2024-09-11T00:22:12.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60c18aa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60bc103ce0 0x7f60bc199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:12.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60c18aa640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60bc104600 0x7f60bc199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:12.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60c18aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60bc10d140 0x7f60bc19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:12.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60c18aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc112df0 con 0x7f60bc10d140 2024-09-11T00:22:12.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60c18aa640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc112c70 con 0x7f60bc104600 2024-09-11T00:22:12.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60c18aa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc112f70 con 0x7f60bc103ce0 2024-09-11T00:22:12.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60bb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60bc10d140 0x7f60bc19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:12.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60bb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60bc10d140 0x7f60bc19ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39512/0 (socket says 172.21.15.78:39512) 2024-09-11T00:22:12.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60bb7fe640 1 -- 172.21.15.78:0/566187799 learned_addr learned my addr 172.21.15.78:0/566187799 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:12.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60baffd640 1 --2- 172.21.15.78:0/566187799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60bc103ce0 0x7f60bc199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:12.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60ba7fc640 1 --2- 172.21.15.78:0/566187799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60bc104600 0x7f60bc199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:12.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60bb7fe640 1 -- 172.21.15.78:0/566187799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60bc103ce0 msgr2=0x7f60bc199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:12.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60bb7fe640 1 --2- 172.21.15.78:0/566187799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60bc103ce0 0x7f60bc199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:12.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60bb7fe640 1 -- 172.21.15.78:0/566187799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60bc104600 msgr2=0x7f60bc199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:12.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60bb7fe640 1 --2- 172.21.15.78:0/566187799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60bc104600 0x7f60bc199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:12.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60bb7fe640 1 -- 172.21.15.78:0/566187799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60bc19f3b0 con 0x7f60bc10d140 2024-09-11T00:22:12.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60baffd640 1 --2- 172.21.15.78:0/566187799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60bc103ce0 0x7f60bc199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:22:12.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60bb7fe640 1 --2- 172.21.15.78:0/566187799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60bc10d140 0x7f60bc19ebe0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009fd0 tx=0x7f60b400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:12.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60c08a8640 1 -- 172.21.15.78:0/566187799 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b4011830 con 0x7f60bc10d140 2024-09-11T00:22:12.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60c18aa640 1 -- 172.21.15.78:0/566187799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60bc19f6a0 con 0x7f60bc10d140 2024-09-11T00:22:12.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60c18aa640 1 -- 172.21.15.78:0/566187799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60bc1a5d60 con 0x7f60bc10d140 2024-09-11T00:22:12.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60c08a8640 1 -- 172.21.15.78:0/566187799 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60b4016070 con 0x7f60bc10d140 2024-09-11T00:22:12.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.070+0000 7f60c08a8640 1 -- 172.21.15.78:0/566187799 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b4010380 con 0x7f60bc10d140 2024-09-11T00:22:12.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.072+0000 7f60c18aa640 1 -- 172.21.15.78:0/566187799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60bc1040c0 con 0x7f60bc10d140 2024-09-11T00:22:12.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.073+0000 7f60c08a8640 1 -- 172.21.15.78:0/566187799 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f60b40119d0 con 0x7f60bc10d140 2024-09-11T00:22:12.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.073+0000 7f60c08a8640 1 --2- 172.21.15.78:0/566187799 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f60a40b5450 0x7f60a40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:12.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.074+0000 7f60baffd640 1 --2- 172.21.15.78:0/566187799 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f60a40b5450 0x7f60a40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:12.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.074+0000 7f60c08a8640 1 -- 172.21.15.78:0/566187799 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f60b40e5400 con 0x7f60bc10d140 2024-09-11T00:22:12.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.074+0000 7f60baffd640 1 --2- 172.21.15.78:0/566187799 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f60a40b5450 0x7f60a40b7910 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f60ac000f80 tx=0x7f60ac009360 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:12.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.077+0000 7f60c08a8640 1 -- 172.21.15.78:0/566187799 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f60b4021020 con 0x7f60bc10d140 2024-09-11T00:22:12.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:11 smithi112 ceph-mon[35627]: pgmap v495: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T00:22:12.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.288+0000 7f60c18aa640 1 -- 172.21.15.78:0/566187799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60bc1a6110 con 0x7f60bc10d140 2024-09-11T00:22:12.290 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:11 smithi078 ceph-mon[30865]: pgmap v495: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T00:22:12.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.289+0000 7f60c08a8640 1 -- 172.21.15.78:0/566187799 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f60b40ac030 con 0x7f60bc10d140 2024-09-11T00:22:12.291 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:22:12.291 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:22:12.291 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:22:12.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:11 smithi138 ceph-mon[35019]: pgmap v495: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-11T00:22:12.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.292+0000 7f60c18aa640 1 -- 172.21.15.78:0/566187799 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f60a40b5450 msgr2=0x7f60a40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:12.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.292+0000 7f60c18aa640 1 --2- 172.21.15.78:0/566187799 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f60a40b5450 0x7f60a40b7910 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f60ac000f80 tx=0x7f60ac009360 comp rx=0 tx=0).stop 2024-09-11T00:22:12.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.292+0000 7f60c18aa640 1 -- 172.21.15.78:0/566187799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60bc10d140 msgr2=0x7f60bc19ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:12.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.292+0000 7f60c18aa640 1 --2- 172.21.15.78:0/566187799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60bc10d140 0x7f60bc19ebe0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009fd0 tx=0x7f60b400b8e0 comp rx=0 tx=0).stop 2024-09-11T00:22:12.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.293+0000 7f60c18aa640 1 -- 172.21.15.78:0/566187799 shutdown_connections 2024-09-11T00:22:12.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.293+0000 7f60c18aa640 1 --2- 172.21.15.78:0/566187799 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f60a40b5450 0x7f60a40b7910 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:12.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.293+0000 7f60c18aa640 1 --2- 172.21.15.78:0/566187799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60bc10d140 0x7f60bc19ebe0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:12.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.293+0000 7f60c18aa640 1 --2- 172.21.15.78:0/566187799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60bc104600 0x7f60bc199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:12.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.293+0000 7f60c18aa640 1 --2- 172.21.15.78:0/566187799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60bc103ce0 0x7f60bc199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:12.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.293+0000 7f60c18aa640 1 -- 172.21.15.78:0/566187799 >> 172.21.15.78:0/566187799 conn(0x7f60bc0fd700 msgr2=0x7f60bc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:12.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.293+0000 7f60c18aa640 1 -- 172.21.15.78:0/566187799 shutdown_connections 2024-09-11T00:22:12.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:12.293+0000 7f60c18aa640 1 -- 172.21.15.78:0/566187799 wait complete. 2024-09-11T00:22:12.977 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:12 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/566187799' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:22:13.007 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:22:13.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:12 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/566187799' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:22:13.251 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:22:13.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:12 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/566187799' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:22:13.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.752+0000 7f48255af640 1 -- 172.21.15.78:0/3482023013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4820104600 msgr2=0x7f482010caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:13.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.752+0000 7f48255af640 1 --2- 172.21.15.78:0/3482023013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4820104600 0x7f482010caf0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f4808009900 tx=0x7f480802a410 comp rx=0 tx=0).stop 2024-09-11T00:22:13.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.752+0000 7f48255af640 1 -- 172.21.15.78:0/3482023013 shutdown_connections 2024-09-11T00:22:13.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.752+0000 7f48255af640 1 --2- 172.21.15.78:0/3482023013 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f482010d140 0x7f482010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.752+0000 7f48255af640 1 --2- 172.21.15.78:0/3482023013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4820104600 0x7f482010caf0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.752+0000 7f48255af640 1 --2- 172.21.15.78:0/3482023013 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4820103ce0 0x7f48201040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.752+0000 7f48255af640 1 -- 172.21.15.78:0/3482023013 >> 172.21.15.78:0/3482023013 conn(0x7f48200fd720 msgr2=0x7f48200ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:13.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.752+0000 7f48255af640 1 -- 172.21.15.78:0/3482023013 shutdown_connections 2024-09-11T00:22:13.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.752+0000 7f48255af640 1 -- 172.21.15.78:0/3482023013 wait complete. 2024-09-11T00:22:13.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.752+0000 7f48255af640 1 Processor -- start 2024-09-11T00:22:13.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.752+0000 7f48255af640 1 -- start start 2024-09-11T00:22:13.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f48255af640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4820103ce0 0x7f4820199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:13.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f48255af640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4820104600 0x7f48201997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:13.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f48255af640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f482010d140 0x7f482019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:13.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f48255af640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4820112db0 con 0x7f4820104600 2024-09-11T00:22:13.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f48255af640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4820112c30 con 0x7f482010d140 2024-09-11T00:22:13.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f48255af640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4820112f30 con 0x7f4820103ce0 2024-09-11T00:22:13.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f4817fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4820104600 0x7f48201997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:13.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f4817fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4820104600 0x7f48201997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39528/0 (socket says 172.21.15.78:39528) 2024-09-11T00:22:13.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f4817fff640 1 -- 172.21.15.78:0/728315042 learned_addr learned my addr 172.21.15.78:0/728315042 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:13.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f481effd640 1 --2- 172.21.15.78:0/728315042 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4820103ce0 0x7f4820199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:13.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f481f7fe640 1 --2- 172.21.15.78:0/728315042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f482010d140 0x7f482019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:13.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f4817fff640 1 -- 172.21.15.78:0/728315042 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4820103ce0 msgr2=0x7f4820199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:13.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f4817fff640 1 --2- 172.21.15.78:0/728315042 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4820103ce0 0x7f4820199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f4817fff640 1 -- 172.21.15.78:0/728315042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f482010d140 msgr2=0x7f482019eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:13.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f4817fff640 1 --2- 172.21.15.78:0/728315042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f482010d140 0x7f482019eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f4817fff640 1 -- 172.21.15.78:0/728315042 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f482019f310 con 0x7f4820104600 2024-09-11T00:22:13.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f481effd640 1 --2- 172.21.15.78:0/728315042 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4820103ce0 0x7f4820199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:22:13.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f481f7fe640 1 --2- 172.21.15.78:0/728315042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f482010d140 0x7f482019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:22:13.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f4817fff640 1 --2- 172.21.15.78:0/728315042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4820104600 0x7f48201997a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f4808004270 tx=0x7f48080042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:13.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f481cff9640 1 -- 172.21.15.78:0/728315042 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480803f030 con 0x7f4820104600 2024-09-11T00:22:13.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f481cff9640 1 -- 172.21.15.78:0/728315042 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48080044c0 con 0x7f4820104600 2024-09-11T00:22:13.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f48255af640 1 -- 172.21.15.78:0/728315042 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f482019f5a0 con 0x7f4820104600 2024-09-11T00:22:13.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.753+0000 7f481cff9640 1 -- 172.21.15.78:0/728315042 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4808035070 con 0x7f4820104600 2024-09-11T00:22:13.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.754+0000 7f48255af640 1 -- 172.21.15.78:0/728315042 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48201a5cc0 con 0x7f4820104600 2024-09-11T00:22:13.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.756+0000 7f4827984740 1 Processor -- start 2024-09-11T00:22:13.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.756+0000 7f4827984740 1 -- start start 2024-09-11T00:22:13.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.756+0000 7f4827984740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636c0f0 0x55b13636c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:13.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.756+0000 7f4827984740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b13636ca10 0x55b136378460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:13.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.756+0000 7f481cff9640 1 -- 172.21.15.78:0/728315042 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f480803bbe0 con 0x7f4820104600 2024-09-11T00:22:13.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.756+0000 7f4827984740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1363789a0 0x55b13637ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:13.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.756+0000 7f4827984740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55b1362e2ea0 con 0x55b13636c0f0 2024-09-11T00:22:13.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.756+0000 7f4827984740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b1362d22d0 con 0x55b1363789a0 2024-09-11T00:22:13.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.756+0000 7f4827984740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55b1362d60e0 con 0x55b13636ca10 2024-09-11T00:22:13.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.756+0000 7f481f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636c0f0 0x55b13636c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:13.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.757+0000 7f481f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636c0f0 0x55b13636c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39542/0 (socket says 172.21.15.78:39542) 2024-09-11T00:22:13.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.757+0000 7f481f7fe640 1 -- 172.21.15.78:0/593543063 learned_addr learned my addr 172.21.15.78:0/593543063 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:13.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.757+0000 7f4817fff640 1 --2- 172.21.15.78:0/593543063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1363789a0 0x55b13637ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:13.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.757+0000 7f481effd640 1 --2- 172.21.15.78:0/593543063 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b13636ca10 0x55b136378460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:13.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.757+0000 7f481f7fe640 1 -- 172.21.15.78:0/593543063 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b13636ca10 msgr2=0x55b136378460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:13.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.757+0000 7f481f7fe640 1 --2- 172.21.15.78:0/593543063 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b13636ca10 0x55b136378460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.757+0000 7f481f7fe640 1 -- 172.21.15.78:0/593543063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1363789a0 msgr2=0x55b13637ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.757+0000 7f481f7fe640 1 --2- 172.21.15.78:0/593543063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1363789a0 0x55b13637ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.757+0000 7f481f7fe640 1 -- 172.21.15.78:0/593543063 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b136030650 con 0x55b13636c0f0 2024-09-11T00:22:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.757+0000 7f4817fff640 1 --2- 172.21.15.78:0/593543063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1363789a0 0x55b13637ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:22:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.757+0000 7f481f7fe640 1 --2- 172.21.15.78:0/593543063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636c0f0 0x55b13636c4d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f481800af40 tx=0x7f481800e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1834785958c0f0da server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.757+0000 7f48157fa640 1 -- 172.21.15.78:0/593543063 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4818003b70 con 0x55b13636c0f0 2024-09-11T00:22:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.757+0000 7f48157fa640 1 -- 172.21.15.78:0/593543063 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4818003d10 con 0x55b13636c0f0 2024-09-11T00:22:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.757+0000 7f48157fa640 1 -- 172.21.15.78:0/593543063 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4818010b00 con 0x55b13636c0f0 2024-09-11T00:22:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.757+0000 7f481cff9640 1 --2- 172.21.15.78:0/728315042 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f480c0b5450 0x7f480c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.758+0000 7f481effd640 1 --2- 172.21.15.78:0/728315042 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f480c0b5450 0x7f480c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.758+0000 7f481cff9640 1 -- 172.21.15.78:0/728315042 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f4808106920 con 0x7f4820104600 2024-09-11T00:22:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.758+0000 7f4827984740 1 -- 172.21.15.78:0/593543063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636c0f0 msgr2=0x55b13636c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.758+0000 7f481effd640 1 --2- 172.21.15.78:0/728315042 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f480c0b5450 0x7f480c0b7910 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4810005fd0 tx=0x7f4810005f40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:13.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.758+0000 7f4827984740 1 --2- 172.21.15.78:0/593543063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636c0f0 0x55b13636c4d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f481800af40 tx=0x7f481800e7e0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.758+0000 7f4827984740 1 -- 172.21.15.78:0/593543063 shutdown_connections 2024-09-11T00:22:13.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.758+0000 7f4827984740 1 --2- 172.21.15.78:0/593543063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1363789a0 0x55b13637ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.758+0000 7f4827984740 1 --2- 172.21.15.78:0/593543063 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b13636ca10 0x55b136378460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.758+0000 7f4827984740 1 --2- 172.21.15.78:0/593543063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636c0f0 0x55b13636c4d0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.758+0000 7f4827984740 1 -- 172.21.15.78:0/593543063 >> 172.21.15.78:0/593543063 conn(0x55b136369f20 msgr2=0x55b13636b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:13.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.758+0000 7f4827984740 1 -- 172.21.15.78:0/593543063 shutdown_connections 2024-09-11T00:22:13.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.758+0000 7f4827984740 1 -- 172.21.15.78:0/593543063 wait complete. 2024-09-11T00:22:13.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.759+0000 7f4827984740 1 -- start start 2024-09-11T00:22:13.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.759+0000 7f4827984740 1 Processor -- start 2024-09-11T00:22:13.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.759+0000 7f4827984740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b13636c0f0 0x55b136378270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:13.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.759+0000 7f4827984740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636ca10 0x55b1363756c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:13.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.759+0000 7f4827984740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1363789a0 0x55b136375ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:13.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.759+0000 7f4827984740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55b136133700 con 0x55b13636ca10 2024-09-11T00:22:13.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.759+0000 7f4827984740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b13626d160 con 0x55b1363789a0 2024-09-11T00:22:13.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.759+0000 7f4827984740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55b13637b620 con 0x55b13636c0f0 2024-09-11T00:22:13.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.759+0000 7f4827984740 10 client.0 _ll_register_callbacks cb 0x55b1362869e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:22:13.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.759+0000 7f4817fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636ca10 0x55b1363756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:13.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.759+0000 7f4817fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636ca10 0x55b1363756c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39554/0 (socket says 172.21.15.78:39554) 2024-09-11T00:22:13.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.759+0000 7f4817fff640 1 -- 172.21.15.78:0/3862654549 learned_addr learned my addr 172.21.15.78:0/3862654549 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:13.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.759+0000 7f481effd640 1 --2- 172.21.15.78:0/3862654549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b13636c0f0 0x55b136378270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:13.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.759+0000 7f481f7fe640 1 --2- 172.21.15.78:0/3862654549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1363789a0 0x55b136375ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:13.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.759+0000 7f4817fff640 1 -- 172.21.15.78:0/3862654549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b13636c0f0 msgr2=0x55b136378270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:13.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.759+0000 7f4817fff640 1 --2- 172.21.15.78:0/3862654549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b13636c0f0 0x55b136378270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.759+0000 7f4817fff640 1 -- 172.21.15.78:0/3862654549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1363789a0 msgr2=0x55b136375ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:13.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.759+0000 7f4817fff640 1 --2- 172.21.15.78:0/3862654549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1363789a0 0x55b136375ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.759+0000 7f4817fff640 1 -- 172.21.15.78:0/3862654549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b13629ac90 con 0x55b13636ca10 2024-09-11T00:22:13.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.760+0000 7f4817fff640 1 --2- 172.21.15.78:0/3862654549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636ca10 0x55b1363756c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f48080cca20 tx=0x7f4808000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c976ac4f767ddc9f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:13.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.760+0000 7f48067fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:22:13.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.760+0000 7f48067fc640 1 -- 172.21.15.78:0/3862654549 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4808049070 con 0x55b13636ca10 2024-09-11T00:22:13.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.760+0000 7f48067fc640 1 -- 172.21.15.78:0/3862654549 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f48080ccf80 con 0x55b13636ca10 2024-09-11T00:22:13.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.760+0000 7f4827984740 1 -- 172.21.15.78:0/3862654549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4818003d10 con 0x55b13636ca10 2024-09-11T00:22:13.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.760+0000 7f48067fc640 1 -- 172.21.15.78:0/3862654549 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f48080cc670 con 0x55b13636ca10 2024-09-11T00:22:13.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.760+0000 7f4827984740 10 client.16074 fetch_fsmap learned FSMap version 20 2024-09-11T00:22:13.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.760+0000 7f4827984740 1 -- 172.21.15.78:0/3862654549 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b136386f60 con 0x55b13636ca10 2024-09-11T00:22:13.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.760+0000 7f48067fc640 1 -- 172.21.15.78:0/3862654549 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4818003d10 con 0x55b13636ca10 2024-09-11T00:22:13.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.760+0000 7f48067fc640 1 -- 172.21.15.78:0/3862654549 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f48080d5e20 con 0x55b13636ca10 2024-09-11T00:22:13.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.760+0000 7f4827984740 10 client.16074 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:22:13.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.760+0000 7f4827984740 10 client.16074 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:22:13.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.760+0000 7f4827984740 20 client.16074 populate_metadata read hostname 'smithi078' 2024-09-11T00:22:13.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.760+0000 7f4827984740 1 --2- 172.21.15.78:0/3862654549 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b136388370 0x55b13638a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:13.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.760+0000 7f4827984740 4 client.16074 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:22:13.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.760+0000 7f4827984740 1 -- 172.21.15.78:0/3862654549 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1362e4df0 con 0x55b136388370 2024-09-11T00:22:13.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.761+0000 7f481effd640 1 --2- 172.21.15.78:0/3862654549 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b136388370 0x55b13638a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:13.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.761+0000 7f48067fc640 10 client.16074 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:13.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.761+0000 7f481effd640 1 --2- 172.21.15.78:0/3862654549 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b136388370 0x55b13638a760 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f58c8413e242bb6 server_cookie=64d4a5b4f64534fe in_seq=0 out_seq=0 2024-09-11T00:22:13.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.762+0000 7f48067fc640 1 -- 172.21.15.78:0/3862654549 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b1362e4df0 con 0x55b136388370 2024-09-11T00:22:13.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.762+0000 7f48067fc640 10 client.16074 handle_command_reply: tid=0 2024-09-11T00:22:13.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.762+0000 7f4827984740 1 client.16074 shutdown 2024-09-11T00:22:13.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.762+0000 7f4827984740 1 -- 172.21.15.78:0/3862654549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636ca10 msgr2=0x55b1363756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:13.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.762+0000 7f4827984740 1 --2- 172.21.15.78:0/3862654549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636ca10 0x55b1363756c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f48080cca20 tx=0x7f4808000bc0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.762+0000 7f4827984740 1 -- 172.21.15.78:0/3862654549 shutdown_connections 2024-09-11T00:22:13.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.762+0000 7f4827984740 1 --2- 172.21.15.78:0/3862654549 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b136388370 0x55b13638a760 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.762+0000 7f4827984740 1 --2- 172.21.15.78:0/3862654549 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1363789a0 0x55b136375ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.762+0000 7f4827984740 1 --2- 172.21.15.78:0/3862654549 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636ca10 0x55b1363756c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.762+0000 7f48067fc640 0 client.16074 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:13.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.762+0000 7f4827984740 1 --2- 172.21.15.78:0/3862654549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b13636c0f0 0x55b136378270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.762+0000 7f4827984740 1 -- 172.21.15.78:0/3862654549 >> 172.21.15.78:0/3862654549 conn(0x55b136369f20 msgr2=0x55b13636fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:13.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.762+0000 7f4827984740 1 -- 172.21.15.78:0/3862654549 shutdown_connections 2024-09-11T00:22:13.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.762+0000 7f4827984740 1 -- 172.21.15.78:0/3862654549 wait complete. 2024-09-11T00:22:13.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.762+0000 7f4827984740 20 client.16074 trim_cache size 0 max 16384 2024-09-11T00:22:13.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.775+0000 7f4827984740 1 Processor -- start 2024-09-11T00:22:13.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.775+0000 7f4827984740 1 -- start start 2024-09-11T00:22:13.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.775+0000 7f4827984740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636c0f0 0x55b136384880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:13.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.775+0000 7f4827984740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b13636ca10 0x55b136379d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:13.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.775+0000 7f4827984740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1363789a0 0x55b13637a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:13.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.775+0000 7f4827984740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f48201ac5b0 con 0x55b13636c0f0 2024-09-11T00:22:13.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.775+0000 7f4827984740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f48201aee30 con 0x55b13636ca10 2024-09-11T00:22:13.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.775+0000 7f4827984740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f48201acc20 con 0x55b1363789a0 2024-09-11T00:22:13.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.775+0000 7f481effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636c0f0 0x55b136384880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:13.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.775+0000 7f481effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636c0f0 0x55b136384880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39562/0 (socket says 172.21.15.78:39562) 2024-09-11T00:22:13.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.776+0000 7f481effd640 1 -- 172.21.15.78:0/2009122586 learned_addr learned my addr 172.21.15.78:0/2009122586 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:13.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.776+0000 7f4817fff640 1 --2- 172.21.15.78:0/2009122586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b13636ca10 0x55b136379d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:13.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.776+0000 7f481f7fe640 1 --2- 172.21.15.78:0/2009122586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1363789a0 0x55b13637a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:13.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.776+0000 7f481effd640 1 -- 172.21.15.78:0/2009122586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1363789a0 msgr2=0x55b13637a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:13.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.776+0000 7f481effd640 1 --2- 172.21.15.78:0/2009122586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1363789a0 0x55b13637a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.776+0000 7f481effd640 1 -- 172.21.15.78:0/2009122586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b13636ca10 msgr2=0x55b136379d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:13.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.776+0000 7f481effd640 1 --2- 172.21.15.78:0/2009122586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b13636ca10 0x55b136379d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.776+0000 7f481effd640 1 -- 172.21.15.78:0/2009122586 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b136370410 con 0x55b13636c0f0 2024-09-11T00:22:13.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.776+0000 7f4817fff640 1 --2- 172.21.15.78:0/2009122586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b13636ca10 0x55b136379d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:22:13.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.776+0000 7f481effd640 1 --2- 172.21.15.78:0/2009122586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636c0f0 0x55b136384880 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4810011010 tx=0x7f4810013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d52e531653ef48a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:13.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.776+0000 7f4814ff9640 1 -- 172.21.15.78:0/2009122586 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481002c070 con 0x55b13636c0f0 2024-09-11T00:22:13.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.776+0000 7f4814ff9640 1 -- 172.21.15.78:0/2009122586 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f481001ec50 con 0x55b13636c0f0 2024-09-11T00:22:13.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.776+0000 7f4814ff9640 1 -- 172.21.15.78:0/2009122586 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481000ec40 con 0x55b13636c0f0 2024-09-11T00:22:13.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.777+0000 7f4827984740 1 -- 172.21.15.78:0/2009122586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636c0f0 msgr2=0x55b136384880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:13.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.777+0000 7f4827984740 1 --2- 172.21.15.78:0/2009122586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636c0f0 0x55b136384880 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4810011010 tx=0x7f4810013000 comp rx=0 tx=0).stop 2024-09-11T00:22:13.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.777+0000 7f4827984740 1 -- 172.21.15.78:0/2009122586 shutdown_connections 2024-09-11T00:22:13.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.777+0000 7f4827984740 1 --2- 172.21.15.78:0/2009122586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1363789a0 0x55b13637a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.777+0000 7f4827984740 1 --2- 172.21.15.78:0/2009122586 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b13636ca10 0x55b136379d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.777+0000 7f4827984740 1 --2- 172.21.15.78:0/2009122586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636c0f0 0x55b136384880 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.777+0000 7f4827984740 1 -- 172.21.15.78:0/2009122586 >> 172.21.15.78:0/2009122586 conn(0x55b136369f20 msgr2=0x55b136368f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:13.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.777+0000 7f4827984740 1 -- 172.21.15.78:0/2009122586 shutdown_connections 2024-09-11T00:22:13.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.777+0000 7f4827984740 1 -- 172.21.15.78:0/2009122586 wait complete. 2024-09-11T00:22:13.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.777+0000 7f4827984740 1 -- start start 2024-09-11T00:22:13.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.777+0000 7f4827984740 1 Processor -- start 2024-09-11T00:22:13.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f4827984740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636c0f0 0x55b136380e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:13.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f4827984740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b13636ca10 0x55b13637e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:13.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f4827984740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1363789a0 0x55b13637ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:13.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f4827984740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f48201ad2f0 con 0x55b13636c0f0 2024-09-11T00:22:13.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f4827984740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f48201ae760 con 0x55b13636ca10 2024-09-11T00:22:13.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f4827984740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f48201ad9c0 con 0x55b1363789a0 2024-09-11T00:22:13.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f4827984740 10 client.0 _ll_register_callbacks cb 0x7f4808009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:22:13.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f481effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636c0f0 0x55b136380e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:13.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f481effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636c0f0 0x55b136380e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39572/0 (socket says 172.21.15.78:39572) 2024-09-11T00:22:13.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f481effd640 1 -- 172.21.15.78:0/3462151256 learned_addr learned my addr 172.21.15.78:0/3462151256 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:13.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f4817fff640 1 --2- 172.21.15.78:0/3462151256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b13636ca10 0x55b13637e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:13.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f481effd640 1 -- 172.21.15.78:0/3462151256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1363789a0 msgr2=0x55b13637ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:13.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f481effd640 1 --2- 172.21.15.78:0/3462151256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1363789a0 0x55b13637ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f481effd640 1 -- 172.21.15.78:0/3462151256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b13636ca10 msgr2=0x55b13637e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:13.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f481effd640 1 --2- 172.21.15.78:0/3462151256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b13636ca10 0x55b13637e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f481effd640 1 -- 172.21.15.78:0/3462151256 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b13637f3f0 con 0x55b13636c0f0 2024-09-11T00:22:13.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f4817fff640 1 --2- 172.21.15.78:0/3462151256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b13636ca10 0x55b13637e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:22:13.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f481effd640 1 --2- 172.21.15.78:0/3462151256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636c0f0 0x55b136380e20 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f481000c4a0 tx=0x7f481001e5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d87572fcabf3101 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:13.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f48067fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:22:13.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f48067fc640 1 -- 172.21.15.78:0/3462151256 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481002c040 con 0x55b13636c0f0 2024-09-11T00:22:13.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f48067fc640 1 -- 172.21.15.78:0/3462151256 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f481001e910 con 0x55b13636c0f0 2024-09-11T00:22:13.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f4827984740 1 -- 172.21.15.78:0/3462151256 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f481001ec50 con 0x55b13636c0f0 2024-09-11T00:22:13.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.778+0000 7f48067fc640 1 -- 172.21.15.78:0/3462151256 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f481003e050 con 0x55b13636c0f0 2024-09-11T00:22:13.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.779+0000 7f4827984740 10 client.16080 fetch_fsmap learned FSMap version 20 2024-09-11T00:22:13.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.779+0000 7f4827984740 1 -- 172.21.15.78:0/3462151256 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b1363f5f70 con 0x55b13636c0f0 2024-09-11T00:22:13.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.779+0000 7f48067fc640 1 -- 172.21.15.78:0/3462151256 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f481001ec50 con 0x55b13636c0f0 2024-09-11T00:22:13.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.779+0000 7f48067fc640 1 -- 172.21.15.78:0/3462151256 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f48100046c0 con 0x55b13636c0f0 2024-09-11T00:22:13.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.779+0000 7f4827984740 10 client.16080 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:22:13.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.779+0000 7f4827984740 10 client.16080 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:22:13.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.779+0000 7f4827984740 20 client.16080 populate_metadata read hostname 'smithi078' 2024-09-11T00:22:13.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.779+0000 7f4827984740 1 --2- 172.21.15.78:0/3462151256 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b1363f66e0 0x55b1363f8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:13.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.779+0000 7f4827984740 4 client.16080 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:22:13.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.779+0000 7f4827984740 1 -- 172.21.15.78:0/3462151256 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b1362e08a0 con 0x55b1363f66e0 2024-09-11T00:22:13.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.779+0000 7f4817fff640 1 --2- 172.21.15.78:0/3462151256 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b1363f66e0 0x55b1363f8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:13.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.780+0000 7f4817fff640 1 --2- 172.21.15.78:0/3462151256 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b1363f66e0 0x55b1363f8b00 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1d915cefeed050c server_cookie=a9f46efe3576caf1 in_seq=0 out_seq=0 2024-09-11T00:22:13.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.780+0000 7f48067fc640 10 client.16080 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:13.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.780+0000 7f48067fc640 1 -- 172.21.15.78:0/3462151256 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b1362e08a0 con 0x55b1363f66e0 2024-09-11T00:22:13.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.780+0000 7f48067fc640 10 client.16080 handle_command_reply: tid=0 2024-09-11T00:22:13.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.780+0000 7f4827984740 1 client.16080 shutdown 2024-09-11T00:22:13.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.780+0000 7f4827984740 1 -- 172.21.15.78:0/3462151256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636c0f0 msgr2=0x55b136380e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:13.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.780+0000 7f4827984740 1 --2- 172.21.15.78:0/3462151256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636c0f0 0x55b136380e20 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f481000c4a0 tx=0x7f481001e5a0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.780+0000 7f4827984740 1 -- 172.21.15.78:0/3462151256 shutdown_connections 2024-09-11T00:22:13.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.780+0000 7f4827984740 1 --2- 172.21.15.78:0/3462151256 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b1363f66e0 0x55b1363f8b00 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.780+0000 7f4827984740 1 --2- 172.21.15.78:0/3462151256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1363789a0 0x55b13637ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.780+0000 7f4827984740 1 --2- 172.21.15.78:0/3462151256 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b13636ca10 0x55b13637e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.780+0000 7f48067fc640 0 client.16080 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:13.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.780+0000 7f4827984740 1 --2- 172.21.15.78:0/3462151256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b13636c0f0 0x55b136380e20 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.780+0000 7f4827984740 1 -- 172.21.15.78:0/3462151256 >> 172.21.15.78:0/3462151256 conn(0x55b136369f20 msgr2=0x55b13636f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:13.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.780+0000 7f4827984740 1 -- 172.21.15.78:0/3462151256 shutdown_connections 2024-09-11T00:22:13.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.780+0000 7f4827984740 1 -- 172.21.15.78:0/3462151256 wait complete. 2024-09-11T00:22:13.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.780+0000 7f4827984740 20 client.16080 trim_cache size 0 max 16384 2024-09-11T00:22:13.793 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-11T00:22:13.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.781+0000 7f48255af640 1 -- 172.21.15.78:0/728315042 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f480c0b5450 msgr2=0x7f480c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:13.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.781+0000 7f48255af640 1 --2- 172.21.15.78:0/728315042 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f480c0b5450 0x7f480c0b7910 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4810005fd0 tx=0x7f4810005f40 comp rx=0 tx=0).stop 2024-09-11T00:22:13.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.781+0000 7f48255af640 1 -- 172.21.15.78:0/728315042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4820104600 msgr2=0x7f48201997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:13.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.781+0000 7f48255af640 1 --2- 172.21.15.78:0/728315042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4820104600 0x7f48201997a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f4808004270 tx=0x7f48080042a0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.781+0000 7f48255af640 1 -- 172.21.15.78:0/728315042 shutdown_connections 2024-09-11T00:22:13.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.781+0000 7f48255af640 1 --2- 172.21.15.78:0/728315042 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f480c0b5450 0x7f480c0b7910 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.781+0000 7f48255af640 1 --2- 172.21.15.78:0/728315042 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f482010d140 0x7f482019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.781+0000 7f48255af640 1 --2- 172.21.15.78:0/728315042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4820104600 0x7f48201997a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.781+0000 7f48255af640 1 --2- 172.21.15.78:0/728315042 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4820103ce0 0x7f4820199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:13.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.781+0000 7f48255af640 1 -- 172.21.15.78:0/728315042 >> 172.21.15.78:0/728315042 conn(0x7f48200fd720 msgr2=0x7f48200fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:13.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.781+0000 7f48255af640 1 -- 172.21.15.78:0/728315042 shutdown_connections 2024-09-11T00:22:13.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:13.781+0000 7f48255af640 1 -- 172.21.15.78:0/728315042 wait complete. 2024-09-11T00:22:14.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:13 smithi078 ceph-mon[30865]: pgmap v496: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 12 KiB/s wr, 3 op/s 2024-09-11T00:22:14.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:13 smithi112 ceph-mon[35627]: pgmap v496: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 12 KiB/s wr, 3 op/s 2024-09-11T00:22:14.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:13 smithi138 ceph-mon[35019]: pgmap v496: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 12 KiB/s wr, 3 op/s 2024-09-11T00:22:15.503 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:22:15.503 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:22:15.759 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:22:16.181 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:15 smithi078 ceph-mon[30865]: pgmap v497: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-11T00:22:16.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:15 smithi112 ceph-mon[35627]: pgmap v497: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-11T00:22:16.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.263+0000 7f4247bcb640 1 -- 172.21.15.78:0/3599872181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f424010f460 msgr2=0x7f4240111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:16.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.263+0000 7f4247bcb640 1 --2- 172.21.15.78:0/3599872181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f424010f460 0x7f4240111850 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4238009900 tx=0x7f423802a480 comp rx=0 tx=0).stop 2024-09-11T00:22:16.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.263+0000 7f4247bcb640 1 -- 172.21.15.78:0/3599872181 shutdown_connections 2024-09-11T00:22:16.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.263+0000 7f4247bcb640 1 --2- 172.21.15.78:0/3599872181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f424010f460 0x7f4240111850 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.263+0000 7f4247bcb640 1 --2- 172.21.15.78:0/3599872181 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42401021d0 0x7f424010ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.263+0000 7f4247bcb640 1 --2- 172.21.15.78:0/3599872181 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42401018b0 0x7f4240101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.263+0000 7f4247bcb640 1 -- 172.21.15.78:0/3599872181 >> 172.21.15.78:0/3599872181 conn(0x7f42400fd700 msgr2=0x7f42400ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:16.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.263+0000 7f4247bcb640 1 -- 172.21.15.78:0/3599872181 shutdown_connections 2024-09-11T00:22:16.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.263+0000 7f4247bcb640 1 -- 172.21.15.78:0/3599872181 wait complete. 2024-09-11T00:22:16.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.263+0000 7f4247bcb640 1 Processor -- start 2024-09-11T00:22:16.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.263+0000 7f4247bcb640 1 -- start start 2024-09-11T00:22:16.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.264+0000 7f4247bcb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42401018b0 0x7f424019b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:16.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.264+0000 7f4247bcb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42401021d0 0x7f424019b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:16.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.264+0000 7f4247bcb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f424010f460 0x7f42401a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:16.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.264+0000 7f4247bcb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4240114f50 con 0x7f424010f460 2024-09-11T00:22:16.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.264+0000 7f4247bcb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4240114dd0 con 0x7f42401021d0 2024-09-11T00:22:16.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.264+0000 7f4247bcb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f42401150d0 con 0x7f42401018b0 2024-09-11T00:22:16.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.264+0000 7f4246168640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f424010f460 0x7f42401a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:16.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.264+0000 7f4246168640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f424010f460 0x7f42401a0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39984/0 (socket says 172.21.15.78:39984) 2024-09-11T00:22:16.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.264+0000 7f4246168640 1 -- 172.21.15.78:0/1828286271 learned_addr learned my addr 172.21.15.78:0/1828286271 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:16.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.264+0000 7f4245967640 1 --2- 172.21.15.78:0/1828286271 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42401018b0 0x7f424019b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:16.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.264+0000 7f4245166640 1 --2- 172.21.15.78:0/1828286271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42401021d0 0x7f424019b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:16.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.264+0000 7f4246168640 1 -- 172.21.15.78:0/1828286271 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42401018b0 msgr2=0x7f424019b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:16.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.264+0000 7f4246168640 1 --2- 172.21.15.78:0/1828286271 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42401018b0 0x7f424019b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.264+0000 7f4246168640 1 -- 172.21.15.78:0/1828286271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42401021d0 msgr2=0x7f424019b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:16.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.264+0000 7f4246168640 1 --2- 172.21.15.78:0/1828286271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42401021d0 0x7f424019b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.264+0000 7f4246168640 1 -- 172.21.15.78:0/1828286271 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42401a1530 con 0x7f424010f460 2024-09-11T00:22:16.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.264+0000 7f4246168640 1 --2- 172.21.15.78:0/1828286271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f424010f460 0x7f42401a0d60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4238004770 tx=0x7f4238004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:16.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.264+0000 7f423effd640 1 -- 172.21.15.78:0/1828286271 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423803f030 con 0x7f424010f460 2024-09-11T00:22:16.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.265+0000 7f423effd640 1 -- 172.21.15.78:0/1828286271 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4238003aa0 con 0x7f424010f460 2024-09-11T00:22:16.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.265+0000 7f4247bcb640 1 -- 172.21.15.78:0/1828286271 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42401a17c0 con 0x7f424010f460 2024-09-11T00:22:16.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.265+0000 7f423effd640 1 -- 172.21.15.78:0/1828286271 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4238035070 con 0x7f424010f460 2024-09-11T00:22:16.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.265+0000 7f4247bcb640 1 -- 172.21.15.78:0/1828286271 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42401a7ee0 con 0x7f424010f460 2024-09-11T00:22:16.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.267+0000 7f4249fa0740 1 Processor -- start 2024-09-11T00:22:16.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.268+0000 7f423effd640 1 -- 172.21.15.78:0/1828286271 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f42380035f0 con 0x7f424010f460 2024-09-11T00:22:16.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.268+0000 7f4249fa0740 1 -- start start 2024-09-11T00:22:16.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.268+0000 7f4249fa0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fceefd8ee0 0x55fceefd92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:16.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.268+0000 7f4249fa0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefd9800 0x55fceefe5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:16.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.268+0000 7f4249fa0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fceefe5790 0x55fceefe7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:16.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.268+0000 7f4249fa0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55fceef4fe60 con 0x55fceefd9800 2024-09-11T00:22:16.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.268+0000 7f4249fa0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fceef3f290 con 0x55fceefd8ee0 2024-09-11T00:22:16.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.268+0000 7f4249fa0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55fceef430a0 con 0x55fceefe5790 2024-09-11T00:22:16.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.268+0000 7f4245967640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefd9800 0x55fceefe5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:16.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.268+0000 7f4245967640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefd9800 0x55fceefe5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39994/0 (socket says 172.21.15.78:39994) 2024-09-11T00:22:16.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.268+0000 7f4245967640 1 -- 172.21.15.78:0/2847964562 learned_addr learned my addr 172.21.15.78:0/2847964562 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:16.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.269+0000 7f4245166640 1 --2- 172.21.15.78:0/2847964562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fceefd8ee0 0x55fceefd92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:16.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.269+0000 7f4245967640 1 -- 172.21.15.78:0/2847964562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fceefe5790 msgr2=0x55fceefe7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:16.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.269+0000 7f4245967640 1 --2- 172.21.15.78:0/2847964562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fceefe5790 0x55fceefe7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.269+0000 7f4245967640 1 -- 172.21.15.78:0/2847964562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fceefd8ee0 msgr2=0x55fceefd92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:16.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.269+0000 7f4245967640 1 --2- 172.21.15.78:0/2847964562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fceefd8ee0 0x55fceefd92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.269+0000 7f423effd640 1 --2- 172.21.15.78:0/1828286271 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f42280b5450 0x7f42280b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:16.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.269+0000 7f4245967640 1 -- 172.21.15.78:0/2847964562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fceec9d930 con 0x55fceefd9800 2024-09-11T00:22:16.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.269+0000 7f4245166640 1 --2- 172.21.15.78:0/2847964562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fceefd8ee0 0x55fceefd92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:22:16.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.269+0000 7f4245967640 1 --2- 172.21.15.78:0/2847964562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefd9800 0x55fceefe5250 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f423000f390 tx=0x7f423000f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d5657af0a05b32 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:16.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.269+0000 7f4245166640 1 --2- 172.21.15.78:0/1828286271 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f42280b5450 0x7f42280b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:16.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.269+0000 7f423effd640 1 -- 172.21.15.78:0/1828286271 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f4238106b80 con 0x7f424010f460 2024-09-11T00:22:16.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.269+0000 7f4227fff640 1 -- 172.21.15.78:0/2847964562 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4230004d20 con 0x55fceefd9800 2024-09-11T00:22:16.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.269+0000 7f4227fff640 1 -- 172.21.15.78:0/2847964562 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42300119b0 con 0x55fceefd9800 2024-09-11T00:22:16.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.269+0000 7f4227fff640 1 -- 172.21.15.78:0/2847964562 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42300054e0 con 0x55fceefd9800 2024-09-11T00:22:16.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.270+0000 7f4249fa0740 1 -- 172.21.15.78:0/2847964562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefd9800 msgr2=0x55fceefe5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:16.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.270+0000 7f4245166640 1 --2- 172.21.15.78:0/1828286271 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f42280b5450 0x7f42280b7910 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55fceefd8e90 tx=0x7f4234005f10 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:16.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.270+0000 7f4249fa0740 1 --2- 172.21.15.78:0/2847964562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefd9800 0x55fceefe5250 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f423000f390 tx=0x7f423000f850 comp rx=0 tx=0).stop 2024-09-11T00:22:16.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.270+0000 7f4249fa0740 1 -- 172.21.15.78:0/2847964562 shutdown_connections 2024-09-11T00:22:16.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.270+0000 7f4249fa0740 1 --2- 172.21.15.78:0/2847964562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fceefe5790 0x55fceefe7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.270+0000 7f4249fa0740 1 --2- 172.21.15.78:0/2847964562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefd9800 0x55fceefe5250 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.270+0000 7f4249fa0740 1 --2- 172.21.15.78:0/2847964562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fceefd8ee0 0x55fceefd92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.270+0000 7f4249fa0740 1 -- 172.21.15.78:0/2847964562 >> 172.21.15.78:0/2847964562 conn(0x55fceefd6d10 msgr2=0x55fceefd7eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:16.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.270+0000 7f4249fa0740 1 -- 172.21.15.78:0/2847964562 shutdown_connections 2024-09-11T00:22:16.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.270+0000 7f4249fa0740 1 -- 172.21.15.78:0/2847964562 wait complete. 2024-09-11T00:22:16.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.270+0000 7f4249fa0740 1 -- start start 2024-09-11T00:22:16.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.270+0000 7f4249fa0740 1 Processor -- start 2024-09-11T00:22:16.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.271+0000 7f4249fa0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fceefd8ee0 0x55fceefe26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:16.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.271+0000 7f4249fa0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefd9800 0x55fceefe2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:16.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.271+0000 7f4249fa0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fceefe5790 0x55fceefe3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:16.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.271+0000 7f4249fa0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55fceeda0890 con 0x55fceefd9800 2024-09-11T00:22:16.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.271+0000 7f4249fa0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fceeed9d40 con 0x55fceefd8ee0 2024-09-11T00:22:16.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.271+0000 7f4249fa0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55fceefe8440 con 0x55fceefe5790 2024-09-11T00:22:16.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.271+0000 7f4249fa0740 10 client.0 _ll_register_callbacks cb 0x55fceef3dc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:22:16.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.271+0000 7f4245166640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefd9800 0x55fceefe2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:16.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.271+0000 7f4245166640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefd9800 0x55fceefe2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40000/0 (socket says 172.21.15.78:40000) 2024-09-11T00:22:16.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.271+0000 7f4245166640 1 -- 172.21.15.78:0/4206568364 learned_addr learned my addr 172.21.15.78:0/4206568364 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:16.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.271+0000 7f4245967640 1 --2- 172.21.15.78:0/4206568364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fceefd8ee0 0x55fceefe26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:16.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.271+0000 7f4245166640 1 -- 172.21.15.78:0/4206568364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fceefe5790 msgr2=0x55fceefe3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:16.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.271+0000 7f4245166640 1 --2- 172.21.15.78:0/4206568364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fceefe5790 0x55fceefe3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.271+0000 7f4245166640 1 -- 172.21.15.78:0/4206568364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fceefd8ee0 msgr2=0x55fceefe26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:16.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.271+0000 7f4245166640 1 --2- 172.21.15.78:0/4206568364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fceefd8ee0 0x55fceefe26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.271+0000 7f4245166640 1 -- 172.21.15.78:0/4206568364 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fceeff17d0 con 0x55fceefd9800 2024-09-11T00:22:16.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.271+0000 7f4245967640 1 --2- 172.21.15.78:0/4206568364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fceefd8ee0 0x55fceefe26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:22:16.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.271+0000 7f4245166640 1 --2- 172.21.15.78:0/4206568364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefd9800 0x55fceefe2c00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f423400ff50 tx=0x7f4234004420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f3a653708b79e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:16.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.271+0000 7f42257fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:22:16.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.271+0000 7f42257fa640 1 -- 172.21.15.78:0/4206568364 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4234021070 con 0x55fceefd9800 2024-09-11T00:22:16.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.272+0000 7f4249fa0740 1 -- 172.21.15.78:0/4206568364 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42300119b0 con 0x55fceefd9800 2024-09-11T00:22:16.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.272+0000 7f42257fa640 1 -- 172.21.15.78:0/4206568364 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f4234011440 con 0x55fceefd9800 2024-09-11T00:22:16.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.272+0000 7f42257fa640 1 -- 172.21.15.78:0/4206568364 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f423402d050 con 0x55fceefd9800 2024-09-11T00:22:16.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.272+0000 7f4249fa0740 10 client.16092 fetch_fsmap learned FSMap version 20 2024-09-11T00:22:16.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.272+0000 7f4249fa0740 1 -- 172.21.15.78:0/4206568364 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55fceeff4180 con 0x55fceefd9800 2024-09-11T00:22:16.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.272+0000 7f42257fa640 1 -- 172.21.15.78:0/4206568364 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42300119b0 con 0x55fceefd9800 2024-09-11T00:22:16.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.272+0000 7f42257fa640 1 -- 172.21.15.78:0/4206568364 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f4234019070 con 0x55fceefd9800 2024-09-11T00:22:16.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.272+0000 7f4249fa0740 10 client.16092 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:22:16.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.272+0000 7f4249fa0740 10 client.16092 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:22:16.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.272+0000 7f4249fa0740 20 client.16092 populate_metadata read hostname 'smithi078' 2024-09-11T00:22:16.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.272+0000 7f4249fa0740 1 --2- 172.21.15.78:0/4206568364 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fceeff5630 0x55fceeff7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:16.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.272+0000 7f4249fa0740 4 client.16092 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:22:16.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.272+0000 7f4249fa0740 1 -- 172.21.15.78:0/4206568364 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fceef51db0 con 0x55fceeff5630 2024-09-11T00:22:16.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.273+0000 7f4245967640 1 --2- 172.21.15.78:0/4206568364 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fceeff5630 0x55fceeff7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:16.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.273+0000 7f4245967640 1 --2- 172.21.15.78:0/4206568364 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fceeff5630 0x55fceeff7ac0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4edf4b0b0ff533a server_cookie=a5a0a4e694d45536 in_seq=0 out_seq=0 2024-09-11T00:22:16.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.273+0000 7f42257fa640 10 client.16092 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:16.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.274+0000 7f42257fa640 1 -- 172.21.15.78:0/4206568364 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fceef51db0 con 0x55fceeff5630 2024-09-11T00:22:16.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.274+0000 7f42257fa640 10 client.16092 handle_command_reply: tid=0 2024-09-11T00:22:16.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.274+0000 7f4249fa0740 1 client.16092 shutdown 2024-09-11T00:22:16.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.274+0000 7f4249fa0740 1 -- 172.21.15.78:0/4206568364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefd9800 msgr2=0x55fceefe2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:16.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.274+0000 7f4249fa0740 1 --2- 172.21.15.78:0/4206568364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefd9800 0x55fceefe2c00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f423400ff50 tx=0x7f4234004420 comp rx=0 tx=0).stop 2024-09-11T00:22:16.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.274+0000 7f4249fa0740 1 -- 172.21.15.78:0/4206568364 shutdown_connections 2024-09-11T00:22:16.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.274+0000 7f4249fa0740 1 --2- 172.21.15.78:0/4206568364 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fceeff5630 0x55fceeff7ac0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.274+0000 7f4249fa0740 1 --2- 172.21.15.78:0/4206568364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fceefe5790 0x55fceefe3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.274+0000 7f4249fa0740 1 --2- 172.21.15.78:0/4206568364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefd9800 0x55fceefe2c00 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.274+0000 7f42257fa640 0 client.16092 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:16.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.274+0000 7f4249fa0740 1 --2- 172.21.15.78:0/4206568364 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fceefd8ee0 0x55fceefe26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.274+0000 7f4249fa0740 1 -- 172.21.15.78:0/4206568364 >> 172.21.15.78:0/4206568364 conn(0x55fceefd6d10 msgr2=0x55fceefd5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:16.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.274+0000 7f4249fa0740 1 -- 172.21.15.78:0/4206568364 shutdown_connections 2024-09-11T00:22:16.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.274+0000 7f4249fa0740 1 -- 172.21.15.78:0/4206568364 wait complete. 2024-09-11T00:22:16.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.274+0000 7f4249fa0740 20 client.16092 trim_cache size 0 max 16384 2024-09-11T00:22:16.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:15 smithi138 ceph-mon[35019]: pgmap v497: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-11T00:22:16.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.291+0000 7f4249fa0740 1 Processor -- start 2024-09-11T00:22:16.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.291+0000 7f4249fa0740 1 -- start start 2024-09-11T00:22:16.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.292+0000 7f4249fa0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fceefd8ee0 0x55fceefe2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:16.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.292+0000 7f4249fa0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefd9800 0x55fceefdf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:16.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.292+0000 7f4249fa0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fceefe5790 0x55fceefdfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:16.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.292+0000 7f4249fa0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f42401ae8e0 con 0x55fceefd9800 2024-09-11T00:22:16.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.292+0000 7f4249fa0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f42401b1160 con 0x55fceefe5790 2024-09-11T00:22:16.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.292+0000 7f4249fa0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f42401aef50 con 0x55fceefd8ee0 2024-09-11T00:22:16.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.292+0000 7f4245166640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefd9800 0x55fceefdf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:16.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.292+0000 7f4245166640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefd9800 0x55fceefdf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40014/0 (socket says 172.21.15.78:40014) 2024-09-11T00:22:16.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.292+0000 7f4245166640 1 -- 172.21.15.78:0/3755600680 learned_addr learned my addr 172.21.15.78:0/3755600680 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:16.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.292+0000 7f4245967640 1 --2- 172.21.15.78:0/3755600680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fceefd8ee0 0x55fceefe2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:16.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.292+0000 7f4245166640 1 -- 172.21.15.78:0/3755600680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fceefd8ee0 msgr2=0x55fceefe2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:16.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.292+0000 7f4245166640 1 --2- 172.21.15.78:0/3755600680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fceefd8ee0 0x55fceefe2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.292+0000 7f4245166640 1 -- 172.21.15.78:0/3755600680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fceefe5790 msgr2=0x55fceefdfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:16.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.292+0000 7f4245166640 1 --2- 172.21.15.78:0/3755600680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fceefe5790 0x55fceefdfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.292+0000 7f4245166640 1 -- 172.21.15.78:0/3755600680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fceefd7790 con 0x55fceefd9800 2024-09-11T00:22:16.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.292+0000 7f4245166640 1 --2- 172.21.15.78:0/3755600680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefd9800 0x55fceefdf8f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f423400b9c0 tx=0x7f42340039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9fe7082372e478 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:16.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.292+0000 7f42277fe640 1 -- 172.21.15.78:0/3755600680 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4234021070 con 0x55fceefd9800 2024-09-11T00:22:16.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.292+0000 7f42277fe640 1 -- 172.21.15.78:0/3755600680 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4234003d80 con 0x55fceefd9800 2024-09-11T00:22:16.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.292+0000 7f42277fe640 1 -- 172.21.15.78:0/3755600680 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4234015070 con 0x55fceefd9800 2024-09-11T00:22:16.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.293+0000 7f4249fa0740 1 -- 172.21.15.78:0/3755600680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefd9800 msgr2=0x55fceefdf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:16.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.293+0000 7f4249fa0740 1 --2- 172.21.15.78:0/3755600680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefd9800 0x55fceefdf8f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f423400b9c0 tx=0x7f42340039c0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.293+0000 7f4249fa0740 1 -- 172.21.15.78:0/3755600680 shutdown_connections 2024-09-11T00:22:16.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.293+0000 7f4249fa0740 1 --2- 172.21.15.78:0/3755600680 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fceefe5790 0x55fceefdfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.293+0000 7f4249fa0740 1 --2- 172.21.15.78:0/3755600680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefd9800 0x55fceefdf8f0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.293+0000 7f4249fa0740 1 --2- 172.21.15.78:0/3755600680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fceefd8ee0 0x55fceefe2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.293+0000 7f4249fa0740 1 -- 172.21.15.78:0/3755600680 >> 172.21.15.78:0/3755600680 conn(0x55fceefd6d10 msgr2=0x55fceefe2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:16.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.293+0000 7f4249fa0740 1 -- 172.21.15.78:0/3755600680 shutdown_connections 2024-09-11T00:22:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.293+0000 7f4249fa0740 1 -- 172.21.15.78:0/3755600680 wait complete. 2024-09-11T00:22:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.293+0000 7f4249fa0740 1 -- start start 2024-09-11T00:22:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.293+0000 7f4249fa0740 1 Processor -- start 2024-09-11T00:22:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.294+0000 7f4249fa0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fceefd8ee0 0x55fceefede10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.294+0000 7f4249fa0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fceefd9800 0x55fceefea6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.294+0000 7f4249fa0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefe5790 0x55fceefeac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.294+0000 7f4249fa0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f42401af620 con 0x55fceefe5790 2024-09-11T00:22:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.294+0000 7f4249fa0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f42401b0a90 con 0x55fceefd8ee0 2024-09-11T00:22:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.294+0000 7f4249fa0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f42401afcf0 con 0x55fceefd9800 2024-09-11T00:22:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.294+0000 7f4249fa0740 10 client.0 _ll_register_callbacks cb 0x7f423400b300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:22:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.294+0000 7f4246168640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefe5790 0x55fceefeac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.294+0000 7f4246168640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefe5790 0x55fceefeac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40018/0 (socket says 172.21.15.78:40018) 2024-09-11T00:22:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.294+0000 7f4246168640 1 -- 172.21.15.78:0/3345883948 learned_addr learned my addr 172.21.15.78:0/3345883948 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:16.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.294+0000 7f4245166640 1 --2- 172.21.15.78:0/3345883948 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fceefd9800 0x55fceefea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:16.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.294+0000 7f4245967640 1 --2- 172.21.15.78:0/3345883948 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fceefd8ee0 0x55fceefede10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:16.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.294+0000 7f4246168640 1 -- 172.21.15.78:0/3345883948 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fceefd9800 msgr2=0x55fceefea6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:16.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.294+0000 7f4246168640 1 --2- 172.21.15.78:0/3345883948 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fceefd9800 0x55fceefea6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.294+0000 7f4246168640 1 -- 172.21.15.78:0/3345883948 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fceefd8ee0 msgr2=0x55fceefede10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:16.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.294+0000 7f4246168640 1 --2- 172.21.15.78:0/3345883948 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fceefd8ee0 0x55fceefede10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.294+0000 7f4246168640 1 -- 172.21.15.78:0/3345883948 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fceefeb440 con 0x55fceefe5790 2024-09-11T00:22:16.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.294+0000 7f4245166640 1 --2- 172.21.15.78:0/3345883948 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fceefd9800 0x55fceefea6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:22:16.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.295+0000 7f4246168640 1 --2- 172.21.15.78:0/3345883948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefe5790 0x55fceefeac10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f42381043a0 tx=0x7f4238003e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05f79e6d6fe3a79 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:16.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.295+0000 7f42257fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:22:16.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.295+0000 7f42257fa640 1 -- 172.21.15.78:0/3345883948 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4238049070 con 0x55fceefe5790 2024-09-11T00:22:16.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.295+0000 7f42257fa640 1 -- 172.21.15.78:0/3345883948 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f42380c9290 con 0x55fceefe5790 2024-09-11T00:22:16.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.295+0000 7f4249fa0740 1 -- 172.21.15.78:0/3345883948 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4234003d80 con 0x55fceefe5790 2024-09-11T00:22:16.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.295+0000 7f42257fa640 1 -- 172.21.15.78:0/3345883948 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f42380cc970 con 0x55fceefe5790 2024-09-11T00:22:16.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.295+0000 7f4249fa0740 10 client.16098 fetch_fsmap learned FSMap version 20 2024-09-11T00:22:16.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.295+0000 7f4249fa0740 1 -- 172.21.15.78:0/3345883948 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55fcef063670 con 0x55fceefe5790 2024-09-11T00:22:16.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.295+0000 7f42257fa640 1 -- 172.21.15.78:0/3345883948 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4234003d80 con 0x55fceefe5790 2024-09-11T00:22:16.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.295+0000 7f42257fa640 1 -- 172.21.15.78:0/3345883948 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f42380b81a0 con 0x55fceefe5790 2024-09-11T00:22:16.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.295+0000 7f4249fa0740 10 client.16098 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:22:16.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.295+0000 7f4249fa0740 10 client.16098 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:22:16.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.295+0000 7f4249fa0740 20 client.16098 populate_metadata read hostname 'smithi078' 2024-09-11T00:22:16.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.295+0000 7f4249fa0740 1 --2- 172.21.15.78:0/3345883948 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fcef063da0 0x55fcef0661c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:16.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.295+0000 7f4249fa0740 4 client.16098 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:22:16.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.295+0000 7f4249fa0740 1 -- 172.21.15.78:0/3345883948 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fceef4d860 con 0x55fcef063da0 2024-09-11T00:22:16.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.296+0000 7f4245967640 1 --2- 172.21.15.78:0/3345883948 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fcef063da0 0x55fcef0661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:16.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.296+0000 7f42257fa640 10 client.16098 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:16.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.296+0000 7f4245967640 1 --2- 172.21.15.78:0/3345883948 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fcef063da0 0x55fcef0661c0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc5be062b664f824 server_cookie=e4c0ffc4e2af3914 in_seq=0 out_seq=0 2024-09-11T00:22:16.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.297+0000 7f42257fa640 1 -- 172.21.15.78:0/3345883948 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fceef4d860 con 0x55fcef063da0 2024-09-11T00:22:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.297+0000 7f42257fa640 10 client.16098 handle_command_reply: tid=0 2024-09-11T00:22:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.297+0000 7f4249fa0740 1 client.16098 shutdown 2024-09-11T00:22:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.297+0000 7f4249fa0740 1 -- 172.21.15.78:0/3345883948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefe5790 msgr2=0x55fceefeac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.297+0000 7f4249fa0740 1 --2- 172.21.15.78:0/3345883948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefe5790 0x55fceefeac10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f42381043a0 tx=0x7f4238003e80 comp rx=0 tx=0).stop 2024-09-11T00:22:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.298+0000 7f4249fa0740 1 -- 172.21.15.78:0/3345883948 shutdown_connections 2024-09-11T00:22:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.298+0000 7f4249fa0740 1 --2- 172.21.15.78:0/3345883948 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fcef063da0 0x55fcef0661c0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.298+0000 7f4249fa0740 1 --2- 172.21.15.78:0/3345883948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fceefe5790 0x55fceefeac10 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.298+0000 7f4249fa0740 1 --2- 172.21.15.78:0/3345883948 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fceefd9800 0x55fceefea6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.298+0000 7f4249fa0740 1 --2- 172.21.15.78:0/3345883948 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fceefd8ee0 0x55fceefede10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.298+0000 7f4249fa0740 1 -- 172.21.15.78:0/3345883948 >> 172.21.15.78:0/3345883948 conn(0x55fceefd6d10 msgr2=0x55fceeff0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.298+0000 7f42257fa640 0 client.16098 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.298+0000 7f4249fa0740 1 -- 172.21.15.78:0/3345883948 shutdown_connections 2024-09-11T00:22:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.298+0000 7f4249fa0740 1 -- 172.21.15.78:0/3345883948 wait complete. 2024-09-11T00:22:16.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.298+0000 7f4249fa0740 20 client.16098 trim_cache size 0 max 16384 2024-09-11T00:22:16.307 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:22:16.307 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-11T00:22:16.307 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "81d31d3a-c224-4ded-9f00-1a7dfc099ec4", 2024-09-11T00:22:16.307 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-11T00:22:16.307 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:22:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.298+0000 7f4247bcb640 1 -- 172.21.15.78:0/1828286271 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f42280b5450 msgr2=0x7f42280b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.298+0000 7f4247bcb640 1 --2- 172.21.15.78:0/1828286271 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f42280b5450 0x7f42280b7910 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55fceefd8e90 tx=0x7f4234005f10 comp rx=0 tx=0).stop 2024-09-11T00:22:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.298+0000 7f4247bcb640 1 -- 172.21.15.78:0/1828286271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f424010f460 msgr2=0x7f42401a0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.298+0000 7f4247bcb640 1 --2- 172.21.15.78:0/1828286271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f424010f460 0x7f42401a0d60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4238004770 tx=0x7f4238004270 comp rx=0 tx=0).stop 2024-09-11T00:22:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.298+0000 7f4247bcb640 1 -- 172.21.15.78:0/1828286271 shutdown_connections 2024-09-11T00:22:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.298+0000 7f4247bcb640 1 --2- 172.21.15.78:0/1828286271 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f42280b5450 0x7f42280b7910 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.298+0000 7f4247bcb640 1 --2- 172.21.15.78:0/1828286271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f424010f460 0x7f42401a0d60 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.298+0000 7f4247bcb640 1 --2- 172.21.15.78:0/1828286271 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f42401021d0 0x7f424019b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.298+0000 7f4247bcb640 1 --2- 172.21.15.78:0/1828286271 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42401018b0 0x7f424019b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:16.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.298+0000 7f4247bcb640 1 -- 172.21.15.78:0/1828286271 >> 172.21.15.78:0/1828286271 conn(0x7f42400fd700 msgr2=0x7f42401116d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:16.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.299+0000 7f4247bcb640 1 -- 172.21.15.78:0/1828286271 shutdown_connections 2024-09-11T00:22:16.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:16.299+0000 7f4247bcb640 1 -- 172.21.15.78:0/1828286271 wait complete. 2024-09-11T00:22:17.031 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:22:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:22:17.577 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:17 smithi078 ceph-mon[30865]: scrub queued for path: / 2024-09-11T00:22:17.577 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:17 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:22:17.578 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:17 smithi078 ceph-mon[30865]: scrub summary: active paths [/] 2024-09-11T00:22:17.578 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:17 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:22:17.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:17 smithi112 ceph-mon[35627]: scrub queued for path: / 2024-09-11T00:22:17.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:17 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:22:17.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:17 smithi112 ceph-mon[35627]: scrub summary: active paths [/] 2024-09-11T00:22:17.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:17 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:22:17.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.761+0000 7fdcda38f640 1 -- 172.21.15.78:0/3155534664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcd410d0e0 msgr2=0x7fdcd410f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:17.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.761+0000 7fdcda38f640 1 --2- 172.21.15.78:0/3155534664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcd410d0e0 0x7fdcd410f580 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fdccc009ca0 tx=0x7fdccc02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.761+0000 7fdcda38f640 1 -- 172.21.15.78:0/3155534664 shutdown_connections 2024-09-11T00:22:17.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.761+0000 7fdcda38f640 1 --2- 172.21.15.78:0/3155534664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcd410d0e0 0x7fdcd410f580 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.761+0000 7fdcda38f640 1 --2- 172.21.15.78:0/3155534664 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcd4102230 0x7fdcd410c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.761+0000 7fdcda38f640 1 --2- 172.21.15.78:0/3155534664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd4101880 0x7fdcd4101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.761+0000 7fdcda38f640 1 -- 172.21.15.78:0/3155534664 >> 172.21.15.78:0/3155534664 conn(0x7fdcd4076e60 msgr2=0x7fdcd4077270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:17.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.762+0000 7fdcda38f640 1 -- 172.21.15.78:0/3155534664 shutdown_connections 2024-09-11T00:22:17.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.762+0000 7fdcda38f640 1 -- 172.21.15.78:0/3155534664 wait complete. 2024-09-11T00:22:17.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.762+0000 7fdcda38f640 1 Processor -- start 2024-09-11T00:22:17.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.762+0000 7fdcda38f640 1 -- start start 2024-09-11T00:22:17.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.762+0000 7fdcda38f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcd4101880 0x7fdcd41992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:17.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.762+0000 7fdcda38f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd4102230 0x7fdcd4199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:17.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.762+0000 7fdcda38f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcd410d0e0 0x7fdcd419eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:17.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.762+0000 7fdcda38f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd4112df0 con 0x7fdcd4101880 2024-09-11T00:22:17.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.762+0000 7fdcda38f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd4112c70 con 0x7fdcd4102230 2024-09-11T00:22:17.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.762+0000 7fdcda38f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd4112f70 con 0x7fdcd410d0e0 2024-09-11T00:22:17.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.762+0000 7fdcd3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcd4101880 0x7fdcd41992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:17.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.762+0000 7fdcd3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcd4101880 0x7fdcd41992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40042/0 (socket says 172.21.15.78:40042) 2024-09-11T00:22:17.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.762+0000 7fdcd3fff640 1 -- 172.21.15.78:0/2528999966 learned_addr learned my addr 172.21.15.78:0/2528999966 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:17.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.763+0000 7fdccbfff640 1 --2- 172.21.15.78:0/2528999966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd4102230 0x7fdcd4199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:17.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.763+0000 7fdcd892c640 1 --2- 172.21.15.78:0/2528999966 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcd410d0e0 0x7fdcd419eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:17.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.763+0000 7fdcd3fff640 1 -- 172.21.15.78:0/2528999966 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcd410d0e0 msgr2=0x7fdcd419eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:17.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.763+0000 7fdcd3fff640 1 --2- 172.21.15.78:0/2528999966 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcd410d0e0 0x7fdcd419eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.763+0000 7fdcd3fff640 1 -- 172.21.15.78:0/2528999966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd4102230 msgr2=0x7fdcd4199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:17.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.763+0000 7fdcd3fff640 1 --2- 172.21.15.78:0/2528999966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd4102230 0x7fdcd4199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.763+0000 7fdcd3fff640 1 -- 172.21.15.78:0/2528999966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd419f370 con 0x7fdcd4101880 2024-09-11T00:22:17.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.763+0000 7fdcd892c640 1 --2- 172.21.15.78:0/2528999966 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcd410d0e0 0x7fdcd419eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:22:17.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.763+0000 7fdcd3fff640 1 --2- 172.21.15.78:0/2528999966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcd4101880 0x7fdcd41992c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400d950 tx=0x7fdcc400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:17.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.763+0000 7fdcd1ffb640 1 -- 172.21.15.78:0/2528999966 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4017070 con 0x7fdcd4101880 2024-09-11T00:22:17.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.763+0000 7fdcda38f640 1 -- 172.21.15.78:0/2528999966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcd419f660 con 0x7fdcd4101880 2024-09-11T00:22:17.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.763+0000 7fdcd1ffb640 1 -- 172.21.15.78:0/2528999966 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcc400de80 con 0x7fdcd4101880 2024-09-11T00:22:17.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.763+0000 7fdcd1ffb640 1 -- 172.21.15.78:0/2528999966 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc400f620 con 0x7fdcd4101880 2024-09-11T00:22:17.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.763+0000 7fdcda38f640 1 -- 172.21.15.78:0/2528999966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcd41a5ef0 con 0x7fdcd4101880 2024-09-11T00:22:17.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.765+0000 7fdcd1ffb640 1 -- 172.21.15.78:0/2528999966 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fdcc4010460 con 0x7fdcd4101880 2024-09-11T00:22:17.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.766+0000 7fdcdc764740 1 Processor -- start 2024-09-11T00:22:17.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.766+0000 7fdcdc764740 1 -- start start 2024-09-11T00:22:17.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.766+0000 7fdcdc764740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314c9a480 0x55a314c9a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:17.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.766+0000 7fdcdc764740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a314c9ada0 0x55a314caac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:17.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.766+0000 7fdcdc764740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a314cab140 0x55a314cad530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:17.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.766+0000 7fdcdc764740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a314c10e50 con 0x55a314c9a480 2024-09-11T00:22:17.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.766+0000 7fdcdc764740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a314c00280 con 0x55a314c9ada0 2024-09-11T00:22:17.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.766+0000 7fdcdc764740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a314c04090 con 0x55a314cab140 2024-09-11T00:22:17.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.766+0000 7fdcd892c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314c9a480 0x55a314c9a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:17.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.766+0000 7fdcd892c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314c9a480 0x55a314c9a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40056/0 (socket says 172.21.15.78:40056) 2024-09-11T00:22:17.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.766+0000 7fdcd892c640 1 -- 172.21.15.78:0/1050301768 learned_addr learned my addr 172.21.15.78:0/1050301768 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:17.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.766+0000 7fdcd3fff640 1 --2- 172.21.15.78:0/1050301768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a314c9ada0 0x55a314caac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:17.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.766+0000 7fdcd1ffb640 1 --2- 172.21.15.78:0/2528999966 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdcc00b5450 0x7fdcc00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:17.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.766+0000 7fdccbfff640 1 --2- 172.21.15.78:0/1050301768 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a314cab140 0x55a314cad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:17.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.766+0000 7fdcd892c640 1 -- 172.21.15.78:0/1050301768 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a314cab140 msgr2=0x55a314cad530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:17.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.766+0000 7fdcd892c640 1 --2- 172.21.15.78:0/1050301768 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a314cab140 0x55a314cad530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.766+0000 7fdcd892c640 1 -- 172.21.15.78:0/1050301768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a314c9ada0 msgr2=0x55a314caac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:17.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.766+0000 7fdcd892c640 1 --2- 172.21.15.78:0/1050301768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a314c9ada0 0x55a314caac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.766+0000 7fdcd892c640 1 -- 172.21.15.78:0/1050301768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a31495e650 con 0x55a314c9a480 2024-09-11T00:22:17.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.767+0000 7fdccbfff640 1 --2- 172.21.15.78:0/1050301768 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a314cab140 0x55a314cad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:22:17.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.767+0000 7fdcd892c640 1 --2- 172.21.15.78:0/2528999966 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdcc00b5450 0x7fdcc00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:17.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.767+0000 7fdcd1ffb640 1 -- 172.21.15.78:0/2528999966 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fdcc40e5c60 con 0x7fdcd4101880 2024-09-11T00:22:17.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.767+0000 7fdcd892c640 1 --2- 172.21.15.78:0/1050301768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314c9a480 0x55a314c9a860 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0099e0 tx=0x7fdccc009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299d65fd12b0a01e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:17.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.767+0000 7fdcca7fc640 1 -- 172.21.15.78:0/1050301768 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdccc04d070 con 0x55a314c9a480 2024-09-11T00:22:17.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.767+0000 7fdcca7fc640 1 -- 172.21.15.78:0/1050301768 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdccc036040 con 0x55a314c9a480 2024-09-11T00:22:17.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.767+0000 7fdcca7fc640 1 -- 172.21.15.78:0/1050301768 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdccc0305c0 con 0x55a314c9a480 2024-09-11T00:22:17.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.767+0000 7fdcd892c640 1 --2- 172.21.15.78:0/2528999966 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdcc00b5450 0x7fdcc00b7910 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdccc04a000 tx=0x7fdccc047000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:17.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.768+0000 7fdcdc764740 1 -- 172.21.15.78:0/1050301768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314c9a480 msgr2=0x55a314c9a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:17.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.768+0000 7fdcdc764740 1 --2- 172.21.15.78:0/1050301768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314c9a480 0x55a314c9a860 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0099e0 tx=0x7fdccc009a10 comp rx=0 tx=0).stop 2024-09-11T00:22:17.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.768+0000 7fdcdc764740 1 -- 172.21.15.78:0/1050301768 shutdown_connections 2024-09-11T00:22:17.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.768+0000 7fdcdc764740 1 --2- 172.21.15.78:0/1050301768 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a314cab140 0x55a314cad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.768+0000 7fdcdc764740 1 --2- 172.21.15.78:0/1050301768 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a314c9ada0 0x55a314caac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.768+0000 7fdcdc764740 1 --2- 172.21.15.78:0/1050301768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314c9a480 0x55a314c9a860 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.768+0000 7fdcdc764740 1 -- 172.21.15.78:0/1050301768 >> 172.21.15.78:0/1050301768 conn(0x55a314c982b0 msgr2=0x55a314c99450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:17.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.768+0000 7fdcdc764740 1 -- 172.21.15.78:0/1050301768 shutdown_connections 2024-09-11T00:22:17.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.768+0000 7fdcdc764740 1 -- 172.21.15.78:0/1050301768 wait complete. 2024-09-11T00:22:17.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.768+0000 7fdcdc764740 1 -- start start 2024-09-11T00:22:17.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.768+0000 7fdcdc764740 1 Processor -- start 2024-09-11T00:22:17.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcdc764740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314c9a480 0x55a314caaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:17.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcdc764740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a314c9ada0 0x55a314ca7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:17.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcdc764740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a314cab140 0x55a314ca84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:17.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcdc764740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a314a61700 con 0x55a314c9a480 2024-09-11T00:22:17.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcdc764740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a314b9b110 con 0x55a314c9ada0 2024-09-11T00:22:17.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcdc764740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a314cadc70 con 0x55a314cab140 2024-09-11T00:22:17.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcdc764740 10 client.0 _ll_register_callbacks cb 0x55a314bb4990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:22:17.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcd3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314c9a480 0x55a314caaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:17.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcd3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314c9a480 0x55a314caaa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40072/0 (socket says 172.21.15.78:40072) 2024-09-11T00:22:17.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcd3fff640 1 -- 172.21.15.78:0/2744529437 learned_addr learned my addr 172.21.15.78:0/2744529437 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:17.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdccbfff640 1 --2- 172.21.15.78:0/2744529437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a314c9ada0 0x55a314ca7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:17.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcd892c640 1 --2- 172.21.15.78:0/2744529437 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a314cab140 0x55a314ca84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:17.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcd3fff640 1 -- 172.21.15.78:0/2744529437 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a314cab140 msgr2=0x55a314ca84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:17.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcd3fff640 1 --2- 172.21.15.78:0/2744529437 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a314cab140 0x55a314ca84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcd3fff640 1 -- 172.21.15.78:0/2744529437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a314c9ada0 msgr2=0x55a314ca7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:17.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcd3fff640 1 --2- 172.21.15.78:0/2744529437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a314c9ada0 0x55a314ca7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcd3fff640 1 -- 172.21.15.78:0/2744529437 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a314bc8c40 con 0x55a314c9a480 2024-09-11T00:22:17.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcd892c640 1 --2- 172.21.15.78:0/2744529437 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a314cab140 0x55a314ca84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:22:17.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcd3fff640 1 --2- 172.21.15.78:0/2744529437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314c9a480 0x55a314caaa40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40a8670 tx=0x7fdcc40e9240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606c68de59019552 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:17.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:22:17.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcb37fe640 1 -- 172.21.15.78:0/2744529437 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4020070 con 0x55a314c9a480 2024-09-11T00:22:17.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcb37fe640 1 -- 172.21.15.78:0/2744529437 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fdcc40e35f0 con 0x55a314c9a480 2024-09-11T00:22:17.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcdc764740 1 -- 172.21.15.78:0/2744529437 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdccc036040 con 0x55a314c9a480 2024-09-11T00:22:17.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcb37fe640 1 -- 172.21.15.78:0/2744529437 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fdcc40ab9f0 con 0x55a314c9a480 2024-09-11T00:22:17.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcdc764740 10 client.16110 fetch_fsmap learned FSMap version 20 2024-09-11T00:22:17.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.769+0000 7fdcdc764740 1 -- 172.21.15.78:0/2744529437 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a314cb95b0 con 0x55a314c9a480 2024-09-11T00:22:17.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.770+0000 7fdcb37fe640 1 -- 172.21.15.78:0/2744529437 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdccc036040 con 0x55a314c9a480 2024-09-11T00:22:17.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.770+0000 7fdcb37fe640 1 -- 172.21.15.78:0/2744529437 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fdcc40a79f0 con 0x55a314c9a480 2024-09-11T00:22:17.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.770+0000 7fdcdc764740 10 client.16110 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:22:17.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.770+0000 7fdcdc764740 10 client.16110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:22:17.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.770+0000 7fdcdc764740 20 client.16110 populate_metadata read hostname 'smithi078' 2024-09-11T00:22:17.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.770+0000 7fdcdc764740 1 --2- 172.21.15.78:0/2744529437 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a314cbaab0 0x55a314cbcea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:17.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.770+0000 7fdcdc764740 4 client.16110 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:22:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.770+0000 7fdcdc764740 1 -- 172.21.15.78:0/2744529437 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a314c12da0 con 0x55a314cbaab0 2024-09-11T00:22:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.770+0000 7fdccbfff640 1 --2- 172.21.15.78:0/2744529437 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a314cbaab0 0x55a314cbcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.770+0000 7fdcb37fe640 10 client.16110 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.770+0000 7fdccbfff640 1 --2- 172.21.15.78:0/2744529437 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a314cbaab0 0x55a314cbcea0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e85cbf54a0bf66d server_cookie=99b38ae2cdfab7d2 in_seq=0 out_seq=0 2024-09-11T00:22:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.771+0000 7fdcb37fe640 1 -- 172.21.15.78:0/2744529437 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a314c12da0 con 0x55a314cbaab0 2024-09-11T00:22:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.771+0000 7fdcb37fe640 10 client.16110 handle_command_reply: tid=0 2024-09-11T00:22:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.771+0000 7fdcdc764740 1 client.16110 shutdown 2024-09-11T00:22:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.771+0000 7fdcdc764740 1 -- 172.21.15.78:0/2744529437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314c9a480 msgr2=0x55a314caaa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.771+0000 7fdcdc764740 1 --2- 172.21.15.78:0/2744529437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314c9a480 0x55a314caaa40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40a8670 tx=0x7fdcc40e9240 comp rx=0 tx=0).stop 2024-09-11T00:22:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.771+0000 7fdcdc764740 1 -- 172.21.15.78:0/2744529437 shutdown_connections 2024-09-11T00:22:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.771+0000 7fdcdc764740 1 --2- 172.21.15.78:0/2744529437 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a314cbaab0 0x55a314cbcea0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.771+0000 7fdcdc764740 1 --2- 172.21.15.78:0/2744529437 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a314cab140 0x55a314ca84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.771+0000 7fdcdc764740 1 --2- 172.21.15.78:0/2744529437 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a314c9ada0 0x55a314ca7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.771+0000 7fdcdc764740 1 --2- 172.21.15.78:0/2744529437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314c9a480 0x55a314caaa40 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.771+0000 7fdcdc764740 1 -- 172.21.15.78:0/2744529437 >> 172.21.15.78:0/2744529437 conn(0x55a314c982b0 msgr2=0x55a314c9de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:17.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.771+0000 7fdcb37fe640 0 client.16110 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:17.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.771+0000 7fdcdc764740 1 -- 172.21.15.78:0/2744529437 shutdown_connections 2024-09-11T00:22:17.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.771+0000 7fdcdc764740 1 -- 172.21.15.78:0/2744529437 wait complete. 2024-09-11T00:22:17.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.772+0000 7fdcdc764740 20 client.16110 trim_cache size 0 max 16384 2024-09-11T00:22:17.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.789+0000 7fdcdc764740 1 Processor -- start 2024-09-11T00:22:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.789+0000 7fdcdc764740 1 -- start start 2024-09-11T00:22:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.789+0000 7fdcdc764740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a314c9a480 0x55a314cb6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.789+0000 7fdcdc764740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a314c9ada0 0x55a314cbcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.789+0000 7fdcdc764740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314cab140 0x55a314cc2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.789+0000 7fdcdc764740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd41aa530 con 0x55a314cab140 2024-09-11T00:22:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.789+0000 7fdcdc764740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd41acdb0 con 0x55a314c9a480 2024-09-11T00:22:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.789+0000 7fdcdc764740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd41aaba0 con 0x55a314c9ada0 2024-09-11T00:22:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.789+0000 7fdcd892c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314cab140 0x55a314cc2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.789+0000 7fdcd892c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314cab140 0x55a314cc2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40080/0 (socket says 172.21.15.78:40080) 2024-09-11T00:22:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.789+0000 7fdcd892c640 1 -- 172.21.15.78:0/2762579910 learned_addr learned my addr 172.21.15.78:0/2762579910 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.789+0000 7fdcd3fff640 1 --2- 172.21.15.78:0/2762579910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a314c9a480 0x55a314cb6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.789+0000 7fdccbfff640 1 --2- 172.21.15.78:0/2762579910 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a314c9ada0 0x55a314cbcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:17.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.790+0000 7fdcd892c640 1 -- 172.21.15.78:0/2762579910 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a314c9ada0 msgr2=0x55a314cbcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:17.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.790+0000 7fdcd892c640 1 --2- 172.21.15.78:0/2762579910 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a314c9ada0 0x55a314cbcac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.790+0000 7fdcd892c640 1 -- 172.21.15.78:0/2762579910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a314c9a480 msgr2=0x55a314cb6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:17.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.790+0000 7fdcd892c640 1 --2- 172.21.15.78:0/2762579910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a314c9a480 0x55a314cb6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.790+0000 7fdcd892c640 1 -- 172.21.15.78:0/2762579910 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a314cabac0 con 0x55a314cab140 2024-09-11T00:22:17.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.790+0000 7fdcd3fff640 1 --2- 172.21.15.78:0/2762579910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a314c9a480 0x55a314cb6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:22:17.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.790+0000 7fdcd892c640 1 --2- 172.21.15.78:0/2762579910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314cab140 0x55a314cc2770 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fdccc009680 tx=0x7fdccc02fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf37575d17b6eadc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:17.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.790+0000 7fdcc9ffb640 1 -- 172.21.15.78:0/2762579910 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdccc04d040 con 0x55a314cab140 2024-09-11T00:22:17.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.790+0000 7fdcc9ffb640 1 -- 172.21.15.78:0/2762579910 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdccc036070 con 0x55a314cab140 2024-09-11T00:22:17.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.790+0000 7fdcc9ffb640 1 -- 172.21.15.78:0/2762579910 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdccc004810 con 0x55a314cab140 2024-09-11T00:22:17.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:17 smithi138 ceph-mon[35019]: scrub queued for path: / 2024-09-11T00:22:17.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:17 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:22:17.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:17 smithi138 ceph-mon[35019]: scrub summary: active paths [/] 2024-09-11T00:22:17.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:17 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:22:17.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.791+0000 7fdcdc764740 1 -- 172.21.15.78:0/2762579910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314cab140 msgr2=0x55a314cc2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:17.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.791+0000 7fdcdc764740 1 --2- 172.21.15.78:0/2762579910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314cab140 0x55a314cc2770 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fdccc009680 tx=0x7fdccc02fa80 comp rx=0 tx=0).stop 2024-09-11T00:22:17.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.791+0000 7fdcdc764740 1 -- 172.21.15.78:0/2762579910 shutdown_connections 2024-09-11T00:22:17.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.791+0000 7fdcdc764740 1 --2- 172.21.15.78:0/2762579910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314cab140 0x55a314cc2770 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.791+0000 7fdcdc764740 1 --2- 172.21.15.78:0/2762579910 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a314c9ada0 0x55a314cbcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.791+0000 7fdcdc764740 1 --2- 172.21.15.78:0/2762579910 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a314c9a480 0x55a314cb6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.791+0000 7fdcdc764740 1 -- 172.21.15.78:0/2762579910 >> 172.21.15.78:0/2762579910 conn(0x55a314c982b0 msgr2=0x55a314c99070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:17.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.791+0000 7fdcdc764740 1 -- 172.21.15.78:0/2762579910 shutdown_connections 2024-09-11T00:22:17.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.791+0000 7fdcdc764740 1 -- 172.21.15.78:0/2762579910 wait complete. 2024-09-11T00:22:17.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.791+0000 7fdcdc764740 1 -- start start 2024-09-11T00:22:17.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.791+0000 7fdcdc764740 1 Processor -- start 2024-09-11T00:22:17.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.791+0000 7fdcdc764740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a314c9a480 0x55a314cb2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:17.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.791+0000 7fdcdc764740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314c9ada0 0x55a314cb3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:17.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.791+0000 7fdcdc764740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a314cab140 0x55a314caff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:17.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.791+0000 7fdcdc764740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd41ab270 con 0x55a314c9ada0 2024-09-11T00:22:17.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.791+0000 7fdcdc764740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd41ac6e0 con 0x55a314cab140 2024-09-11T00:22:17.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.791+0000 7fdcdc764740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd41ab940 con 0x55a314c9a480 2024-09-11T00:22:17.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.791+0000 7fdcdc764740 10 client.0 _ll_register_callbacks cb 0x7fdcc4009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:22:17.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.792+0000 7fdccbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314c9ada0 0x55a314cb3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:17.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.792+0000 7fdccbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314c9ada0 0x55a314cb3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40096/0 (socket says 172.21.15.78:40096) 2024-09-11T00:22:17.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.792+0000 7fdccbfff640 1 -- 172.21.15.78:0/1542451454 learned_addr learned my addr 172.21.15.78:0/1542451454 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:17.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.792+0000 7fdcd3fff640 1 --2- 172.21.15.78:0/1542451454 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a314c9a480 0x55a314cb2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:17.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.792+0000 7fdcd892c640 1 --2- 172.21.15.78:0/1542451454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a314cab140 0x55a314caff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:17.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.792+0000 7fdccbfff640 1 -- 172.21.15.78:0/1542451454 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a314c9a480 msgr2=0x55a314cb2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:17.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.792+0000 7fdccbfff640 1 --2- 172.21.15.78:0/1542451454 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a314c9a480 0x55a314cb2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.792+0000 7fdccbfff640 1 -- 172.21.15.78:0/1542451454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a314cab140 msgr2=0x55a314caff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:17.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.792+0000 7fdccbfff640 1 --2- 172.21.15.78:0/1542451454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a314cab140 0x55a314caff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.792+0000 7fdccbfff640 1 -- 172.21.15.78:0/1542451454 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a314cb3ab0 con 0x55a314c9ada0 2024-09-11T00:22:17.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.792+0000 7fdccbfff640 1 --2- 172.21.15.78:0/1542451454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314c9ada0 0x55a314cb3470 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4101430 tx=0x7fdcbc016800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea9bb3b77e15bde server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:17.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.792+0000 7fdcb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:22:17.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.792+0000 7fdcb37fe640 1 -- 172.21.15.78:0/1542451454 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc00f040 con 0x55a314c9ada0 2024-09-11T00:22:17.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.792+0000 7fdcb37fe640 1 -- 172.21.15.78:0/1542451454 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fdcbc025610 con 0x55a314c9ada0 2024-09-11T00:22:17.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.792+0000 7fdcdc764740 1 -- 172.21.15.78:0/1542451454 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdccc036070 con 0x55a314c9ada0 2024-09-11T00:22:17.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.792+0000 7fdcb37fe640 1 -- 172.21.15.78:0/1542451454 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fdcbc009e50 con 0x55a314c9ada0 2024-09-11T00:22:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.792+0000 7fdcdc764740 10 client.16116 fetch_fsmap learned FSMap version 20 2024-09-11T00:22:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.792+0000 7fdcdc764740 1 -- 172.21.15.78:0/1542451454 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a314d27e30 con 0x55a314c9ada0 2024-09-11T00:22:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.793+0000 7fdcb37fe640 1 -- 172.21.15.78:0/1542451454 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdccc036070 con 0x55a314c9ada0 2024-09-11T00:22:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.793+0000 7fdcb37fe640 1 -- 172.21.15.78:0/1542451454 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fdcbc02d8f0 con 0x55a314c9ada0 2024-09-11T00:22:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.793+0000 7fdcdc764740 10 client.16116 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:22:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.793+0000 7fdcdc764740 10 client.16116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:22:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.793+0000 7fdcdc764740 20 client.16116 populate_metadata read hostname 'smithi078' 2024-09-11T00:22:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.793+0000 7fdcdc764740 1 --2- 172.21.15.78:0/1542451454 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a314d285e0 0x55a314d2aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.793+0000 7fdcdc764740 4 client.16116 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:22:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.793+0000 7fdcdc764740 1 -- 172.21.15.78:0/1542451454 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a314c0e850 con 0x55a314d285e0 2024-09-11T00:22:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.793+0000 7fdcd3fff640 1 --2- 172.21.15.78:0/1542451454 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a314d285e0 0x55a314d2aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.793+0000 7fdcd3fff640 1 --2- 172.21.15.78:0/1542451454 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a314d285e0 0x55a314d2aa00 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f6917039b297e18 server_cookie=4778e36b85530f7c in_seq=0 out_seq=0 2024-09-11T00:22:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.793+0000 7fdcb37fe640 10 client.16116 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.794+0000 7fdcb37fe640 1 -- 172.21.15.78:0/1542451454 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3410 (crc 0 0 0) 0x55a314c0e850 con 0x55a314d285e0 2024-09-11T00:22:17.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.794+0000 7fdcb37fe640 10 client.16116 handle_command_reply: tid=0 2024-09-11T00:22:17.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.794+0000 7fdcdc764740 1 client.16116 shutdown 2024-09-11T00:22:17.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.794+0000 7fdcdc764740 1 -- 172.21.15.78:0/1542451454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314c9ada0 msgr2=0x55a314cb3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:17.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.794+0000 7fdcdc764740 1 --2- 172.21.15.78:0/1542451454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314c9ada0 0x55a314cb3470 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4101430 tx=0x7fdcbc016800 comp rx=0 tx=0).stop 2024-09-11T00:22:17.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.794+0000 7fdcdc764740 1 -- 172.21.15.78:0/1542451454 shutdown_connections 2024-09-11T00:22:17.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.794+0000 7fdcdc764740 1 --2- 172.21.15.78:0/1542451454 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a314d285e0 0x55a314d2aa00 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.794+0000 7fdcdc764740 1 --2- 172.21.15.78:0/1542451454 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a314cab140 0x55a314caff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.794+0000 7fdcdc764740 1 --2- 172.21.15.78:0/1542451454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a314c9ada0 0x55a314cb3470 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.794+0000 7fdcdc764740 1 --2- 172.21.15.78:0/1542451454 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a314c9a480 0x55a314cb2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.794+0000 7fdcb37fe640 0 client.16116 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:17.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.794+0000 7fdcdc764740 1 -- 172.21.15.78:0/1542451454 >> 172.21.15.78:0/1542451454 conn(0x55a314c982b0 msgr2=0x55a314ca94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:17.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.794+0000 7fdcdc764740 1 -- 172.21.15.78:0/1542451454 shutdown_connections 2024-09-11T00:22:17.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.794+0000 7fdcdc764740 1 -- 172.21.15.78:0/1542451454 wait complete. 2024-09-11T00:22:17.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.794+0000 7fdcdc764740 20 client.16116 trim_cache size 0 max 16384 2024-09-11T00:22:17.802 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:22:17.802 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:22:17.802 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-11T00:22:17.802 INFO:teuthology.orchestra.run.smithi078.stdout: "81d31d3a-c224-4ded-9f00-1a7dfc099ec4": { 2024-09-11T00:22:17.802 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:17.802 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "81d31d3a-c224-4ded-9f00-1a7dfc099ec4", 2024-09-11T00:22:17.802 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-11T00:22:17.802 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:22:17.802 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:17.802 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:22:17.803 INFO:teuthology.orchestra.run.smithi078.stdout: "e0002672-e432-4890-ab9f-20c513c5e3b6": { 2024-09-11T00:22:17.803 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:21:37.161715+0000", 2024-09-11T00:22:17.803 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:17.803 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:17.803 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:17.803 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:17.803 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:17.803 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:17.803 INFO:teuthology.orchestra.run.smithi078.stdout: "8ec9e858-aa62-420d-a112-e62ea7810e63": { 2024-09-11T00:22:17.803 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:18.882749+0000", 2024-09-11T00:22:17.803 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:17.803 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:17.803 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:17.803 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:17.803 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:17.804 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:17.804 INFO:teuthology.orchestra.run.smithi078.stdout: "38a1d30d-5f4c-460a-afcd-e6c60b97e43a": { 2024-09-11T00:22:17.804 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:58.127727+0000", 2024-09-11T00:22:17.804 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:17.804 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:17.804 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:17.804 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:17.804 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:17.804 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:17.804 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:22:17.804 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:22:17.804 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:17.804 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:17.804 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:17.804 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:17.805 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:17.805 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:17.805 INFO:teuthology.orchestra.run.smithi078.stdout: "81d31d3a-c224-4ded-9f00-1a7dfc099ec4": { 2024-09-11T00:22:17.805 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:16.296700+0000", 2024-09-11T00:22:17.805 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:17.805 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:17.805 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:17.805 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:17.805 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:17.805 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:17.805 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:22:17.805 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:22:17.805 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:17.805 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:17.806 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:17.806 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:17.806 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:17.806 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:17.806 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:22:17.806 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:22:17.806 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:17.806 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:17.806 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:17.806 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:17.806 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:17.806 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:17.806 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:22:17.806 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:22:17.807 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:17.807 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:17.807 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:17.807 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:17.807 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:17.807 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:17.807 INFO:teuthology.orchestra.run.smithi078.stdout: "b854cbd3-8ca7-4277-a205-8887d2ff5567": { 2024-09-11T00:22:17.807 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:11.182949+0000", 2024-09-11T00:22:17.807 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:17.807 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:17.807 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:17.807 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:17.807 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:17.807 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:17.808 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:22:17.808 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:22:17.808 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:17.808 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:17.808 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:17.808 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:17.808 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:17.808 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:17.808 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:22:17.808 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:22:17.808 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:17.808 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:17.808 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:17.808 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:17.808 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:17.809 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:22:17.809 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:22:17.809 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:22:17.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.795+0000 7fdcda38f640 1 -- 172.21.15.78:0/2528999966 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdcc00b5450 msgr2=0x7fdcc00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:17.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.795+0000 7fdcda38f640 1 --2- 172.21.15.78:0/2528999966 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdcc00b5450 0x7fdcc00b7910 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdccc04a000 tx=0x7fdccc047000 comp rx=0 tx=0).stop 2024-09-11T00:22:17.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.795+0000 7fdcda38f640 1 -- 172.21.15.78:0/2528999966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcd4101880 msgr2=0x7fdcd41992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:17.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.795+0000 7fdcda38f640 1 --2- 172.21.15.78:0/2528999966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcd4101880 0x7fdcd41992c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400d950 tx=0x7fdcc400dd50 comp rx=0 tx=0).stop 2024-09-11T00:22:17.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.795+0000 7fdcda38f640 1 -- 172.21.15.78:0/2528999966 shutdown_connections 2024-09-11T00:22:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.795+0000 7fdcda38f640 1 --2- 172.21.15.78:0/2528999966 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fdcc00b5450 0x7fdcc00b7910 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.795+0000 7fdcda38f640 1 --2- 172.21.15.78:0/2528999966 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcd410d0e0 0x7fdcd419eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.795+0000 7fdcda38f640 1 --2- 172.21.15.78:0/2528999966 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdcd4102230 0x7fdcd4199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.795+0000 7fdcda38f640 1 --2- 172.21.15.78:0/2528999966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdcd4101880 0x7fdcd41992c0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.795+0000 7fdcda38f640 1 -- 172.21.15.78:0/2528999966 >> 172.21.15.78:0/2528999966 conn(0x7fdcd4076e60 msgr2=0x7fdcd40ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.795+0000 7fdcda38f640 1 -- 172.21.15.78:0/2528999966 shutdown_connections 2024-09-11T00:22:17.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:17.795+0000 7fdcda38f640 1 -- 172.21.15.78:0/2528999966 wait complete. 2024-09-11T00:22:18.546 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:18 smithi078 ceph-mon[30865]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-11T00:22:18.573 INFO:tasks.cephfs.filesystem:scrub status for tag:81d31d3a-c224-4ded-9f00-1a7dfc099ec4 - {'path': '/', 'tag': '81d31d3a-c224-4ded-9f00-1a7dfc099ec4', 'options': 'recursive,force'} 2024-09-11T00:22:18.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:18 smithi112 ceph-mon[35627]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-11T00:22:18.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:18 smithi138 ceph-mon[35019]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-11T00:22:20.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:19 smithi112 ceph-mon[35627]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-11T00:22:20.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:19 smithi138 ceph-mon[35019]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-11T00:22:20.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:19 smithi078 ceph-mon[30865]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-11T00:22:21.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:21 smithi078 ceph-mon[30865]: scrub summary: idle 2024-09-11T00:22:21.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:21 smithi112 ceph-mon[35627]: scrub summary: idle 2024-09-11T00:22:21.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:21 smithi138 ceph-mon[35019]: scrub summary: idle 2024-09-11T00:22:22.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:22 smithi078 ceph-mon[30865]: pgmap v500: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-11T00:22:22.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:22 smithi112 ceph-mon[35627]: pgmap v500: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-11T00:22:22.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:22 smithi138 ceph-mon[35019]: pgmap v500: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-11T00:22:24.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:23 smithi112 ceph-mon[35627]: pgmap v501: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:22:24.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:23 smithi138 ceph-mon[35019]: pgmap v501: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:22:24.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:23 smithi078 ceph-mon[30865]: pgmap v501: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:22:26.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:25 smithi112 ceph-mon[35627]: pgmap v502: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:22:26.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:25 smithi138 ceph-mon[35019]: pgmap v502: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:22:26.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:25 smithi078 ceph-mon[30865]: pgmap v502: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:22:28.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:27 smithi112 ceph-mon[35627]: pgmap v503: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:22:28.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:27 smithi138 ceph-mon[35019]: pgmap v503: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:22:28.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:27 smithi078 ceph-mon[30865]: pgmap v503: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:22:30.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:29 smithi112 ceph-mon[35627]: pgmap v504: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:22:30.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:29 smithi138 ceph-mon[35019]: pgmap v504: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:22:30.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:29 smithi078 ceph-mon[30865]: pgmap v504: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:22:32.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:31 smithi112 ceph-mon[35627]: pgmap v505: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:22:32.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:31 smithi138 ceph-mon[35019]: pgmap v505: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:22:32.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:31 smithi078 ceph-mon[30865]: pgmap v505: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:22:34.136 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:33 smithi078 ceph-mon[30865]: pgmap v506: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:34.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:33 smithi112 ceph-mon[35627]: pgmap v506: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:34.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:33 smithi138 ceph-mon[35019]: pgmap v506: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:36.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:35 smithi112 ceph-mon[35627]: pgmap v507: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:22:36.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:35 smithi138 ceph-mon[35019]: pgmap v507: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:22:36.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:35 smithi078 ceph-mon[30865]: pgmap v507: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:22:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:37 smithi112 ceph-mon[35627]: pgmap v508: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:38.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:37 smithi138 ceph-mon[35019]: pgmap v508: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:38.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:37 smithi078 ceph-mon[30865]: pgmap v508: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:39.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:39 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:22:40.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:39 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:22:40.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:39 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:22:40.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:40 smithi112 ceph-mon[35627]: pgmap v509: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:40.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:22:40.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:22:40.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:22:41.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:40 smithi138 ceph-mon[35019]: pgmap v509: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:41.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:22:41.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:22:41.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:22:41.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:40 smithi078 ceph-mon[30865]: pgmap v509: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:41.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:22:41.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:22:41.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:22:42.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:41 smithi112 ceph-mon[35627]: pgmap v510: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:22:42.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:41 smithi138 ceph-mon[35019]: pgmap v510: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:22:42.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:41 smithi078 ceph-mon[30865]: pgmap v510: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:22:44.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:43 smithi112 ceph-mon[35627]: pgmap v511: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:44.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:43 smithi138 ceph-mon[35019]: pgmap v511: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:44.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:43 smithi078 ceph-mon[30865]: pgmap v511: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:46.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:45 smithi112 ceph-mon[35627]: pgmap v512: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:22:46.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:45 smithi138 ceph-mon[35019]: pgmap v512: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:22:46.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:45 smithi078 ceph-mon[30865]: pgmap v512: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:22:48.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:47 smithi112 ceph-mon[35627]: pgmap v513: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:48.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:47 smithi138 ceph-mon[35019]: pgmap v513: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:48.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:47 smithi078 ceph-mon[30865]: pgmap v513: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:48.574 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:22:48.833 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:22:49.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.318+0000 7f01f0247640 1 -- 172.21.15.78:0/3221704515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01e8102150 msgr2=0x7f01e810eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:49.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.318+0000 7f01f0247640 1 --2- 172.21.15.78:0/3221704515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01e8102150 0x7f01e810eea0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009900 tx=0x7f01d802a480 comp rx=0 tx=0).stop 2024-09-11T00:22:49.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.318+0000 7f01f0247640 1 -- 172.21.15.78:0/3221704515 shutdown_connections 2024-09-11T00:22:49.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.318+0000 7f01f0247640 1 --2- 172.21.15.78:0/3221704515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01e810f3e0 0x7f01e81117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.318+0000 7f01f0247640 1 --2- 172.21.15.78:0/3221704515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01e8102150 0x7f01e810eea0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.318+0000 7f01f0247640 1 --2- 172.21.15.78:0/3221704515 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01e8101830 0x7f01e8101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.318+0000 7f01f0247640 1 -- 172.21.15.78:0/3221704515 >> 172.21.15.78:0/3221704515 conn(0x7f01e80fd700 msgr2=0x7f01e80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:49.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.318+0000 7f01f0247640 1 -- 172.21.15.78:0/3221704515 shutdown_connections 2024-09-11T00:22:49.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.318+0000 7f01f0247640 1 -- 172.21.15.78:0/3221704515 wait complete. 2024-09-11T00:22:49.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.319+0000 7f01f0247640 1 Processor -- start 2024-09-11T00:22:49.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.319+0000 7f01f0247640 1 -- start start 2024-09-11T00:22:49.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.319+0000 7f01f0247640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01e8101830 0x7f01e819b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:49.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.319+0000 7f01f0247640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01e8102150 0x7f01e819ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:49.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.319+0000 7f01f0247640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01e810f3e0 0x7f01e81a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:49.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.319+0000 7f01f0247640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f01e8114f40 con 0x7f01e8102150 2024-09-11T00:22:49.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.319+0000 7f01f0247640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f01e8114dc0 con 0x7f01e810f3e0 2024-09-11T00:22:49.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.319+0000 7f01f0247640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f01e81150c0 con 0x7f01e8101830 2024-09-11T00:22:49.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.319+0000 7f01ed7e2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01e8102150 0x7f01e819ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:49.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.319+0000 7f01ed7e2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01e8102150 0x7f01e819ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34766/0 (socket says 172.21.15.78:34766) 2024-09-11T00:22:49.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.319+0000 7f01ed7e2640 1 -- 172.21.15.78:0/2161451726 learned_addr learned my addr 172.21.15.78:0/2161451726 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:49.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.319+0000 7f01ee7e4640 1 --2- 172.21.15.78:0/2161451726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01e810f3e0 0x7f01e81a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:49.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.319+0000 7f01edfe3640 1 --2- 172.21.15.78:0/2161451726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01e8101830 0x7f01e819b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:49.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.319+0000 7f01ed7e2640 1 -- 172.21.15.78:0/2161451726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01e8101830 msgr2=0x7f01e819b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:49.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.319+0000 7f01ed7e2640 1 --2- 172.21.15.78:0/2161451726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01e8101830 0x7f01e819b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.319+0000 7f01ed7e2640 1 -- 172.21.15.78:0/2161451726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01e810f3e0 msgr2=0x7f01e81a0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:49.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.319+0000 7f01ed7e2640 1 --2- 172.21.15.78:0/2161451726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01e810f3e0 0x7f01e81a0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.319+0000 7f01ed7e2640 1 -- 172.21.15.78:0/2161451726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e81a15c0 con 0x7f01e8102150 2024-09-11T00:22:49.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.319+0000 7f01ee7e4640 1 --2- 172.21.15.78:0/2161451726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01e810f3e0 0x7f01e81a0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:22:49.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.320+0000 7f01ed7e2640 1 --2- 172.21.15.78:0/2161451726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01e8102150 0x7f01e819ba50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f01d8006010 tx=0x7f01d80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:49.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.320+0000 7f01deffd640 1 -- 172.21.15.78:0/2161451726 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d803f030 con 0x7f01e8102150 2024-09-11T00:22:49.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.320+0000 7f01deffd640 1 -- 172.21.15.78:0/2161451726 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01d8003800 con 0x7f01e8102150 2024-09-11T00:22:49.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.320+0000 7f01f0247640 1 -- 172.21.15.78:0/2161451726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e81a1850 con 0x7f01e8102150 2024-09-11T00:22:49.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.320+0000 7f01deffd640 1 -- 172.21.15.78:0/2161451726 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8035070 con 0x7f01e8102150 2024-09-11T00:22:49.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.320+0000 7f01f0247640 1 -- 172.21.15.78:0/2161451726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e81a7f70 con 0x7f01e8102150 2024-09-11T00:22:49.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.322+0000 7f01f261c740 1 Processor -- start 2024-09-11T00:22:49.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.322+0000 7f01f261c740 1 -- start start 2024-09-11T00:22:49.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.322+0000 7f01deffd640 1 -- 172.21.15.78:0/2161451726 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f01d8031b10 con 0x7f01e8102150 2024-09-11T00:22:49.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.323+0000 7f01f261c740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dbea34e0a0 0x55dbea34e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:49.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.323+0000 7f01f261c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dbea34e9c0 0x55dbea35a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:49.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.323+0000 7f01f261c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea35a950 0x55dbea35cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:49.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.323+0000 7f01f261c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55dbea2c4e50 con 0x55dbea35a950 2024-09-11T00:22:49.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.323+0000 7f01f261c740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55dbea2b4280 con 0x55dbea34e0a0 2024-09-11T00:22:49.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.323+0000 7f01f261c740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55dbea2b8090 con 0x55dbea34e9c0 2024-09-11T00:22:49.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.323+0000 7f01ed7e2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea35a950 0x55dbea35cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:49.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.323+0000 7f01ed7e2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea35a950 0x55dbea35cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34768/0 (socket says 172.21.15.78:34768) 2024-09-11T00:22:49.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.323+0000 7f01ed7e2640 1 -- 172.21.15.78:0/2258978777 learned_addr learned my addr 172.21.15.78:0/2258978777 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:49.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.323+0000 7f01ee7e4640 1 --2- 172.21.15.78:0/2258978777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dbea34e0a0 0x55dbea34e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:49.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.323+0000 7f01edfe3640 1 --2- 172.21.15.78:0/2258978777 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dbea34e9c0 0x55dbea35a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:49.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.323+0000 7f01ed7e2640 1 -- 172.21.15.78:0/2258978777 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dbea34e9c0 msgr2=0x55dbea35a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:49.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.323+0000 7f01ed7e2640 1 --2- 172.21.15.78:0/2258978777 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dbea34e9c0 0x55dbea35a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.323+0000 7f01ed7e2640 1 -- 172.21.15.78:0/2258978777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dbea34e0a0 msgr2=0x55dbea34e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:49.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.323+0000 7f01ed7e2640 1 --2- 172.21.15.78:0/2258978777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dbea34e0a0 0x55dbea34e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.323+0000 7f01deffd640 1 --2- 172.21.15.78:0/2161451726 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f01d40b5450 0x7f01d40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:49.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.323+0000 7f01ed7e2640 1 -- 172.21.15.78:0/2258978777 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbea012650 con 0x55dbea35a950 2024-09-11T00:22:49.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.323+0000 7f01ee7e4640 1 --2- 172.21.15.78:0/2161451726 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f01d40b5450 0x7f01d40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:49.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.324+0000 7f01ed7e2640 1 --2- 172.21.15.78:0/2258978777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea35a950 0x55dbea35cd40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f01d81040e0 tx=0x7f01d80c95b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c7070c382366ae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:49.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.324+0000 7f01deffd640 1 -- 172.21.15.78:0/2161451726 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f01d8106a00 con 0x7f01e8102150 2024-09-11T00:22:49.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.324+0000 7f01d3fff640 1 -- 172.21.15.78:0/2258978777 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8049070 con 0x55dbea35a950 2024-09-11T00:22:49.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.324+0000 7f01d3fff640 1 -- 172.21.15.78:0/2258978777 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01d80cc9b0 con 0x55dbea35a950 2024-09-11T00:22:49.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.324+0000 7f01ee7e4640 1 --2- 172.21.15.78:0/2161451726 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f01d40b5450 0x7f01d40b7910 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f01e000afa0 tx=0x7f01e000a730 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:49.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.324+0000 7f01d3fff640 1 -- 172.21.15.78:0/2258978777 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8110040 con 0x55dbea35a950 2024-09-11T00:22:49.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.325+0000 7f01f261c740 1 -- 172.21.15.78:0/2258978777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea35a950 msgr2=0x55dbea35cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:49.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.325+0000 7f01f261c740 1 --2- 172.21.15.78:0/2258978777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea35a950 0x55dbea35cd40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f01d81040e0 tx=0x7f01d80c95b0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.325+0000 7f01f261c740 1 -- 172.21.15.78:0/2258978777 shutdown_connections 2024-09-11T00:22:49.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.325+0000 7f01f261c740 1 --2- 172.21.15.78:0/2258978777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea35a950 0x55dbea35cd40 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.325+0000 7f01f261c740 1 --2- 172.21.15.78:0/2258978777 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dbea34e9c0 0x55dbea35a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.325+0000 7f01f261c740 1 --2- 172.21.15.78:0/2258978777 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dbea34e0a0 0x55dbea34e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.325+0000 7f01f261c740 1 -- 172.21.15.78:0/2258978777 >> 172.21.15.78:0/2258978777 conn(0x55dbea34bed0 msgr2=0x55dbea34d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:49.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.325+0000 7f01f261c740 1 -- 172.21.15.78:0/2258978777 shutdown_connections 2024-09-11T00:22:49.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.325+0000 7f01f261c740 1 -- 172.21.15.78:0/2258978777 wait complete. 2024-09-11T00:22:49.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.325+0000 7f01f261c740 1 -- start start 2024-09-11T00:22:49.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.325+0000 7f01f261c740 1 Processor -- start 2024-09-11T00:22:49.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.325+0000 7f01f261c740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dbea34e0a0 0x55dbea35a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:49.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.325+0000 7f01f261c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dbea34e9c0 0x55dbea3576f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:49.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.325+0000 7f01f261c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea35a950 0x55dbea357d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:49.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.325+0000 7f01f261c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55dbea115700 con 0x55dbea35a950 2024-09-11T00:22:49.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.325+0000 7f01f261c740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55dbea24f110 con 0x55dbea34e0a0 2024-09-11T00:22:49.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.325+0000 7f01f261c740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55dbea2c4e50 con 0x55dbea34e9c0 2024-09-11T00:22:49.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.326+0000 7f01f261c740 10 client.0 _ll_register_callbacks cb 0x55dbea268990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:22:49.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.326+0000 7f01ee7e4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea35a950 0x55dbea357d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:49.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.326+0000 7f01ee7e4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea35a950 0x55dbea357d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34778/0 (socket says 172.21.15.78:34778) 2024-09-11T00:22:49.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.326+0000 7f01ee7e4640 1 -- 172.21.15.78:0/2299469428 learned_addr learned my addr 172.21.15.78:0/2299469428 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:49.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.326+0000 7f01edfe3640 1 --2- 172.21.15.78:0/2299469428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dbea34e0a0 0x55dbea35a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:49.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.326+0000 7f01ee7e4640 1 -- 172.21.15.78:0/2299469428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dbea34e9c0 msgr2=0x55dbea3576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:49.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.326+0000 7f01ed7e2640 1 --2- 172.21.15.78:0/2299469428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dbea34e9c0 0x55dbea3576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:49.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.326+0000 7f01ee7e4640 1 --2- 172.21.15.78:0/2299469428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dbea34e9c0 0x55dbea3576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.326+0000 7f01ee7e4640 1 -- 172.21.15.78:0/2299469428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dbea34e0a0 msgr2=0x55dbea35a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:49.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.326+0000 7f01ee7e4640 1 --2- 172.21.15.78:0/2299469428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dbea34e0a0 0x55dbea35a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.326+0000 7f01ee7e4640 1 -- 172.21.15.78:0/2299469428 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbea27cc40 con 0x55dbea35a950 2024-09-11T00:22:49.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.326+0000 7f01edfe3640 1 --2- 172.21.15.78:0/2299469428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dbea34e0a0 0x55dbea35a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:22:49.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.326+0000 7f01ee7e4640 1 --2- 172.21.15.78:0/2299469428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea35a950 0x55dbea357d50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f01e000fe70 tx=0x7f01e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad8a3365e25d782 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:49.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.326+0000 7f01d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:22:49.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.326+0000 7f01d17fa640 1 -- 172.21.15.78:0/2299469428 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e0029060 con 0x55dbea35a950 2024-09-11T00:22:49.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.326+0000 7f01d17fa640 1 -- 172.21.15.78:0/2299469428 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f01e001a670 con 0x55dbea35a950 2024-09-11T00:22:49.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.326+0000 7f01f261c740 1 -- 172.21.15.78:0/2299469428 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01d80cc9b0 con 0x55dbea35a950 2024-09-11T00:22:49.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.326+0000 7f01d17fa640 1 -- 172.21.15.78:0/2299469428 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f01e001ce10 con 0x55dbea35a950 2024-09-11T00:22:49.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.326+0000 7f01f261c740 10 client.16128 fetch_fsmap learned FSMap version 20 2024-09-11T00:22:49.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.326+0000 7f01f261c740 1 -- 172.21.15.78:0/2299469428 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55dbea368c30 con 0x55dbea35a950 2024-09-11T00:22:49.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.327+0000 7f01d17fa640 1 -- 172.21.15.78:0/2299469428 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01d80cc9b0 con 0x55dbea35a950 2024-09-11T00:22:49.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.327+0000 7f01d17fa640 1 -- 172.21.15.78:0/2299469428 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f01e0018040 con 0x55dbea35a950 2024-09-11T00:22:49.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.327+0000 7f01f261c740 10 client.16128 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:22:49.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.327+0000 7f01f261c740 10 client.16128 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:22:49.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.327+0000 7f01f261c740 20 client.16128 populate_metadata read hostname 'smithi078' 2024-09-11T00:22:49.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.327+0000 7f01f261c740 1 --2- 172.21.15.78:0/2299469428 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55dbea36a140 0x55dbea36c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:49.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.327+0000 7f01f261c740 4 client.16128 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:22:49.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.327+0000 7f01f261c740 1 -- 172.21.15.78:0/2299469428 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbea2c6da0 con 0x55dbea36a140 2024-09-11T00:22:49.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.328+0000 7f01edfe3640 1 --2- 172.21.15.78:0/2299469428 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55dbea36a140 0x55dbea36c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:49.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.328+0000 7f01edfe3640 1 --2- 172.21.15.78:0/2299469428 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55dbea36a140 0x55dbea36c580 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a65db22409562cc server_cookie=e78e13b5a32b529e in_seq=0 out_seq=0 2024-09-11T00:22:49.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.328+0000 7f01d17fa640 10 client.16128 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:49.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.329+0000 7f01d17fa640 1 -- 172.21.15.78:0/2299469428 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dbea2c6da0 con 0x55dbea36a140 2024-09-11T00:22:49.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.329+0000 7f01d17fa640 10 client.16128 handle_command_reply: tid=0 2024-09-11T00:22:49.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.329+0000 7f01f261c740 1 client.16128 shutdown 2024-09-11T00:22:49.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.329+0000 7f01f261c740 1 -- 172.21.15.78:0/2299469428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea35a950 msgr2=0x55dbea357d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:49.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.329+0000 7f01f261c740 1 --2- 172.21.15.78:0/2299469428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea35a950 0x55dbea357d50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f01e000fe70 tx=0x7f01e0004a40 comp rx=0 tx=0).stop 2024-09-11T00:22:49.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.329+0000 7f01f261c740 1 -- 172.21.15.78:0/2299469428 shutdown_connections 2024-09-11T00:22:49.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.329+0000 7f01f261c740 1 --2- 172.21.15.78:0/2299469428 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55dbea36a140 0x55dbea36c580 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.329+0000 7f01f261c740 1 --2- 172.21.15.78:0/2299469428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea35a950 0x55dbea357d50 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.329+0000 7f01f261c740 1 --2- 172.21.15.78:0/2299469428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dbea34e9c0 0x55dbea3576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.329+0000 7f01f261c740 1 --2- 172.21.15.78:0/2299469428 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dbea34e0a0 0x55dbea35a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.329+0000 7f01d17fa640 0 client.16128 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:49.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.329+0000 7f01f261c740 1 -- 172.21.15.78:0/2299469428 >> 172.21.15.78:0/2299469428 conn(0x55dbea34bed0 msgr2=0x55dbea351a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:49.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.329+0000 7f01f261c740 1 -- 172.21.15.78:0/2299469428 shutdown_connections 2024-09-11T00:22:49.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.329+0000 7f01f261c740 1 -- 172.21.15.78:0/2299469428 wait complete. 2024-09-11T00:22:49.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.329+0000 7f01f261c740 20 client.16128 trim_cache size 0 max 16384 2024-09-11T00:22:49.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.347+0000 7f01f261c740 1 Processor -- start 2024-09-11T00:22:49.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.347+0000 7f01f261c740 1 -- start start 2024-09-11T00:22:49.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.347+0000 7f01f261c740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dbea34e0a0 0x55dbea34b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:49.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.347+0000 7f01f261c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea34e9c0 0x55dbea355f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:49.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.347+0000 7f01f261c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dbea35a950 0x55dbea3564b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:49.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.347+0000 7f01f261c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f01e81ae900 con 0x55dbea34e9c0 2024-09-11T00:22:49.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.347+0000 7f01f261c740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f01e81b1180 con 0x55dbea34e0a0 2024-09-11T00:22:49.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.347+0000 7f01f261c740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f01e81aef70 con 0x55dbea35a950 2024-09-11T00:22:49.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.347+0000 7f01ed7e2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea34e9c0 0x55dbea355f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:49.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.348+0000 7f01ed7e2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea34e9c0 0x55dbea355f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34784/0 (socket says 172.21.15.78:34784) 2024-09-11T00:22:49.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.348+0000 7f01ed7e2640 1 -- 172.21.15.78:0/3768302943 learned_addr learned my addr 172.21.15.78:0/3768302943 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:49.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.348+0000 7f01ee7e4640 1 --2- 172.21.15.78:0/3768302943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dbea35a950 0x55dbea3564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:49.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.348+0000 7f01ed7e2640 1 -- 172.21.15.78:0/3768302943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dbea35a950 msgr2=0x55dbea3564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:49.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.348+0000 7f01ed7e2640 1 --2- 172.21.15.78:0/3768302943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dbea35a950 0x55dbea3564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.348+0000 7f01edfe3640 1 --2- 172.21.15.78:0/3768302943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dbea34e0a0 0x55dbea34b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:49.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.348+0000 7f01ed7e2640 1 -- 172.21.15.78:0/3768302943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dbea34e0a0 msgr2=0x55dbea34b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:49.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.348+0000 7f01ed7e2640 1 --2- 172.21.15.78:0/3768302943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dbea34e0a0 0x55dbea34b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.348+0000 7f01ed7e2640 1 -- 172.21.15.78:0/3768302943 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbea355bf0 con 0x55dbea34e9c0 2024-09-11T00:22:49.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.348+0000 7f01ed7e2640 1 --2- 172.21.15.78:0/3768302943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea34e9c0 0x55dbea355f70 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f01d8031ae0 tx=0x7f01d80044e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc3f951f73b69f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:49.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.348+0000 7f01d37fe640 1 -- 172.21.15.78:0/3768302943 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8049070 con 0x55dbea34e9c0 2024-09-11T00:22:49.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.348+0000 7f01d37fe640 1 -- 172.21.15.78:0/3768302943 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01d80cc9b0 con 0x55dbea34e9c0 2024-09-11T00:22:49.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.348+0000 7f01d37fe640 1 -- 172.21.15.78:0/3768302943 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d80cc610 con 0x55dbea34e9c0 2024-09-11T00:22:49.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.349+0000 7f01f261c740 1 -- 172.21.15.78:0/3768302943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea34e9c0 msgr2=0x55dbea355f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:49.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.349+0000 7f01f261c740 1 --2- 172.21.15.78:0/3768302943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea34e9c0 0x55dbea355f70 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f01d8031ae0 tx=0x7f01d80044e0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.349+0000 7f01f261c740 1 -- 172.21.15.78:0/3768302943 shutdown_connections 2024-09-11T00:22:49.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.349+0000 7f01f261c740 1 --2- 172.21.15.78:0/3768302943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dbea35a950 0x55dbea3564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.349+0000 7f01f261c740 1 --2- 172.21.15.78:0/3768302943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea34e9c0 0x55dbea355f70 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.349+0000 7f01f261c740 1 --2- 172.21.15.78:0/3768302943 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dbea34e0a0 0x55dbea34b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.349+0000 7f01f261c740 1 -- 172.21.15.78:0/3768302943 >> 172.21.15.78:0/3768302943 conn(0x55dbea34bed0 msgr2=0x55dbea3576c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:49.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.349+0000 7f01f261c740 1 -- 172.21.15.78:0/3768302943 shutdown_connections 2024-09-11T00:22:49.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.349+0000 7f01f261c740 1 -- 172.21.15.78:0/3768302943 wait complete. 2024-09-11T00:22:49.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.349+0000 7f01f261c740 1 -- start start 2024-09-11T00:22:49.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.349+0000 7f01f261c740 1 Processor -- start 2024-09-11T00:22:49.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.350+0000 7f01f261c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea34e0a0 0x55dbea362750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:49.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.350+0000 7f01f261c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dbea34e9c0 0x55dbea362cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:49.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.350+0000 7f01f261c740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dbea35a950 0x55dbea35d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:49.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.350+0000 7f01f261c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f01e81af640 con 0x55dbea34e0a0 2024-09-11T00:22:49.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.350+0000 7f01f261c740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f01e81b0ab0 con 0x55dbea35a950 2024-09-11T00:22:49.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.350+0000 7f01f261c740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f01e81afd10 con 0x55dbea34e9c0 2024-09-11T00:22:49.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.350+0000 7f01f261c740 10 client.0 _ll_register_callbacks cb 0x7f01e0005e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:22:49.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.350+0000 7f01edfe3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea34e0a0 0x55dbea362750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:49.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.350+0000 7f01edfe3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea34e0a0 0x55dbea362750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34796/0 (socket says 172.21.15.78:34796) 2024-09-11T00:22:49.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.350+0000 7f01edfe3640 1 -- 172.21.15.78:0/2758060016 learned_addr learned my addr 172.21.15.78:0/2758060016 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:49.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.350+0000 7f01ed7e2640 1 --2- 172.21.15.78:0/2758060016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dbea34e9c0 0x55dbea362cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:49.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.350+0000 7f01ee7e4640 1 --2- 172.21.15.78:0/2758060016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dbea35a950 0x55dbea35d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:49.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.350+0000 7f01edfe3640 1 -- 172.21.15.78:0/2758060016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dbea34e9c0 msgr2=0x55dbea362cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:49.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.350+0000 7f01edfe3640 1 --2- 172.21.15.78:0/2758060016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dbea34e9c0 0x55dbea362cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.350+0000 7f01edfe3640 1 -- 172.21.15.78:0/2758060016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dbea35a950 msgr2=0x55dbea35d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:49.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.350+0000 7f01edfe3640 1 --2- 172.21.15.78:0/2758060016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dbea35a950 0x55dbea35d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.350+0000 7f01edfe3640 1 -- 172.21.15.78:0/2758060016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbea35dce0 con 0x55dbea34e0a0 2024-09-11T00:22:49.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.350+0000 7f01ee7e4640 1 --2- 172.21.15.78:0/2758060016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dbea35a950 0x55dbea35d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:22:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.350+0000 7f01edfe3640 1 --2- 172.21.15.78:0/2758060016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea34e0a0 0x55dbea362750 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f01e4004700 tx=0x7f01e4010af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d668bc95930ee9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.350+0000 7f01d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:22:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.350+0000 7f01d17fa640 1 -- 172.21.15.78:0/2758060016 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e401c700 con 0x55dbea34e0a0 2024-09-11T00:22:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.351+0000 7f01d17fa640 1 -- 172.21.15.78:0/2758060016 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f01e401c8a0 con 0x55dbea34e0a0 2024-09-11T00:22:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.351+0000 7f01f261c740 1 -- 172.21.15.78:0/2758060016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01d80cc9b0 con 0x55dbea34e0a0 2024-09-11T00:22:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.351+0000 7f01d17fa640 1 -- 172.21.15.78:0/2758060016 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f01e401caa0 con 0x55dbea34e0a0 2024-09-11T00:22:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.351+0000 7f01f261c740 10 client.16134 fetch_fsmap learned FSMap version 20 2024-09-11T00:22:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.351+0000 7f01f261c740 1 -- 172.21.15.78:0/2758060016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55dbea3d7c00 con 0x55dbea34e0a0 2024-09-11T00:22:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.351+0000 7f01d17fa640 1 -- 172.21.15.78:0/2758060016 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01d80cc9b0 con 0x55dbea34e0a0 2024-09-11T00:22:49.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.351+0000 7f01d17fa640 1 -- 172.21.15.78:0/2758060016 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f01e402a070 con 0x55dbea34e0a0 2024-09-11T00:22:49.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.351+0000 7f01f261c740 10 client.16134 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:22:49.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.351+0000 7f01f261c740 10 client.16134 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:22:49.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.351+0000 7f01f261c740 20 client.16134 populate_metadata read hostname 'smithi078' 2024-09-11T00:22:49.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.351+0000 7f01f261c740 1 --2- 172.21.15.78:0/2758060016 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55dbea3d83b0 0x55dbea3da7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:49.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.351+0000 7f01f261c740 4 client.16134 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:22:49.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.351+0000 7f01f261c740 1 -- 172.21.15.78:0/2758060016 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dbea2c2850 con 0x55dbea3d83b0 2024-09-11T00:22:49.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.351+0000 7f01ed7e2640 1 --2- 172.21.15.78:0/2758060016 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55dbea3d83b0 0x55dbea3da7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:49.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.352+0000 7f01d17fa640 10 client.16134 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:49.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.352+0000 7f01ed7e2640 1 --2- 172.21.15.78:0/2758060016 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55dbea3d83b0 0x55dbea3da7d0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d84e9b724047f4f7 server_cookie=94691cc9301fd286 in_seq=0 out_seq=0 2024-09-11T00:22:49.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.352+0000 7f01d17fa640 1 -- 172.21.15.78:0/2758060016 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x55dbea2c2850 con 0x55dbea3d83b0 2024-09-11T00:22:49.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.352+0000 7f01d17fa640 10 client.16134 handle_command_reply: tid=0 2024-09-11T00:22:49.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.352+0000 7f01f261c740 1 client.16134 shutdown 2024-09-11T00:22:49.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.352+0000 7f01f261c740 1 -- 172.21.15.78:0/2758060016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea34e0a0 msgr2=0x55dbea362750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:49.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.352+0000 7f01f261c740 1 --2- 172.21.15.78:0/2758060016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea34e0a0 0x55dbea362750 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f01e4004700 tx=0x7f01e4010af0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.352+0000 7f01f261c740 1 -- 172.21.15.78:0/2758060016 shutdown_connections 2024-09-11T00:22:49.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.352+0000 7f01f261c740 1 --2- 172.21.15.78:0/2758060016 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55dbea3d83b0 0x55dbea3da7d0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.352+0000 7f01f261c740 1 --2- 172.21.15.78:0/2758060016 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dbea35a950 0x55dbea35d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.352+0000 7f01f261c740 1 --2- 172.21.15.78:0/2758060016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dbea34e9c0 0x55dbea362cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.352+0000 7f01f261c740 1 --2- 172.21.15.78:0/2758060016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dbea34e0a0 0x55dbea362750 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.352+0000 7f01d17fa640 0 client.16134 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:49.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.352+0000 7f01f261c740 1 -- 172.21.15.78:0/2758060016 >> 172.21.15.78:0/2758060016 conn(0x55dbea34bed0 msgr2=0x55dbea355ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:49.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.352+0000 7f01f261c740 1 -- 172.21.15.78:0/2758060016 shutdown_connections 2024-09-11T00:22:49.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.352+0000 7f01f261c740 1 -- 172.21.15.78:0/2758060016 wait complete. 2024-09-11T00:22:49.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.352+0000 7f01f261c740 20 client.16134 trim_cache size 0 max 16384 2024-09-11T00:22:49.370 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:22:49.371 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-11T00:22:49.371 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {}, 2024-09-11T00:22:49.371 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:22:49.371 INFO:teuthology.orchestra.run.smithi078.stdout: "e0002672-e432-4890-ab9f-20c513c5e3b6": { 2024-09-11T00:22:49.371 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:21:37.161715+0000", 2024-09-11T00:22:49.371 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:49.371 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:49.371 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:49.371 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:49.371 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:49.371 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:49.371 INFO:teuthology.orchestra.run.smithi078.stdout: "8ec9e858-aa62-420d-a112-e62ea7810e63": { 2024-09-11T00:22:49.372 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:18.882749+0000", 2024-09-11T00:22:49.372 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:49.372 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:49.372 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:49.372 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:49.372 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:49.372 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:49.372 INFO:teuthology.orchestra.run.smithi078.stdout: "38a1d30d-5f4c-460a-afcd-e6c60b97e43a": { 2024-09-11T00:22:49.372 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:58.127727+0000", 2024-09-11T00:22:49.372 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:49.372 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:49.372 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:49.373 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:49.373 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:49.373 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:49.373 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:22:49.373 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:22:49.373 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:49.373 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:49.373 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:49.373 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:49.373 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:49.373 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:49.373 INFO:teuthology.orchestra.run.smithi078.stdout: "81d31d3a-c224-4ded-9f00-1a7dfc099ec4": { 2024-09-11T00:22:49.374 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:16.296700+0000", 2024-09-11T00:22:49.374 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:49.374 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:49.374 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:49.374 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:49.374 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:49.374 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:49.374 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:22:49.374 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:22:49.374 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:49.374 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:49.374 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:49.374 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:49.374 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:49.375 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:49.375 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:22:49.375 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:22:49.375 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:49.375 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:49.375 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:49.375 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:49.375 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:49.375 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:49.375 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:22:49.375 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:22:49.375 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:49.375 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:49.376 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:49.376 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:49.376 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:49.376 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:49.376 INFO:teuthology.orchestra.run.smithi078.stdout: "b854cbd3-8ca7-4277-a205-8887d2ff5567": { 2024-09-11T00:22:49.376 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:11.182949+0000", 2024-09-11T00:22:49.376 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:49.376 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:49.376 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:49.376 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:49.376 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:49.376 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:49.376 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:22:49.377 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:22:49.377 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:49.377 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:49.377 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:49.377 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:49.377 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:49.377 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:49.377 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:22:49.377 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:22:49.377 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:49.377 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:49.377 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:49.377 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:49.378 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:49.378 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:22:49.378 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:22:49.378 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:22:49.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.353+0000 7f01f0247640 1 -- 172.21.15.78:0/2161451726 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f01d40b5450 msgr2=0x7f01d40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:49.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.353+0000 7f01f0247640 1 --2- 172.21.15.78:0/2161451726 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f01d40b5450 0x7f01d40b7910 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f01e000afa0 tx=0x7f01e000a730 comp rx=0 tx=0).stop 2024-09-11T00:22:49.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.353+0000 7f01f0247640 1 -- 172.21.15.78:0/2161451726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01e8102150 msgr2=0x7f01e819ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:49.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.353+0000 7f01f0247640 1 --2- 172.21.15.78:0/2161451726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01e8102150 0x7f01e819ba50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f01d8006010 tx=0x7f01d80042f0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.353+0000 7f01f0247640 1 -- 172.21.15.78:0/2161451726 shutdown_connections 2024-09-11T00:22:49.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.353+0000 7f01f0247640 1 --2- 172.21.15.78:0/2161451726 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f01d40b5450 0x7f01d40b7910 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.353+0000 7f01f0247640 1 --2- 172.21.15.78:0/2161451726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01e810f3e0 0x7f01e81a0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.353+0000 7f01f0247640 1 --2- 172.21.15.78:0/2161451726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01e8102150 0x7f01e819ba50 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.353+0000 7f01f0247640 1 --2- 172.21.15.78:0/2161451726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01e8101830 0x7f01e819b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:49.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.353+0000 7f01f0247640 1 -- 172.21.15.78:0/2161451726 >> 172.21.15.78:0/2161451726 conn(0x7f01e80fd700 msgr2=0x7f01e80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:49.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.353+0000 7f01f0247640 1 -- 172.21.15.78:0/2161451726 shutdown_connections 2024-09-11T00:22:49.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:49.353+0000 7f01f0247640 1 -- 172.21.15.78:0/2161451726 wait complete. 2024-09-11T00:22:49.983 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:49 smithi078 ceph-mon[30865]: pgmap v514: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:50.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:49 smithi112 ceph-mon[35627]: pgmap v514: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:50.259 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:22:50.260 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:22:50.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:49 smithi138 ceph-mon[35019]: pgmap v514: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:22:51.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.028+0000 7fb090fd9640 1 -- 172.21.15.78:0/2267367625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb08c109150 msgr2=0x7fb08c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:51.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.028+0000 7fb090fd9640 1 --2- 172.21.15.78:0/2267367625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb08c109150 0x7fb08c10f950 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb084009ca0 tx=0x7fb08402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:22:51.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.028+0000 7fb090fd9640 1 -- 172.21.15.78:0/2267367625 shutdown_connections 2024-09-11T00:22:51.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.028+0000 7fb090fd9640 1 --2- 172.21.15.78:0/2267367625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb08c109150 0x7fb08c10f950 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:51.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.028+0000 7fb090fd9640 1 --2- 172.21.15.78:0/2267367625 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb08c1087d0 0x7fb08c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:51.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.028+0000 7fb090fd9640 1 --2- 172.21.15.78:0/2267367625 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb08c102dc0 0x7fb08c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:51.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.028+0000 7fb090fd9640 1 -- 172.21.15.78:0/2267367625 >> 172.21.15.78:0/2267367625 conn(0x7fb08c0fe830 msgr2=0x7fb08c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:51.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.028+0000 7fb090fd9640 1 -- 172.21.15.78:0/2267367625 shutdown_connections 2024-09-11T00:22:51.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.028+0000 7fb090fd9640 1 -- 172.21.15.78:0/2267367625 wait complete. 2024-09-11T00:22:51.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.029+0000 7fb090fd9640 1 Processor -- start 2024-09-11T00:22:51.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.029+0000 7fb090fd9640 1 -- start start 2024-09-11T00:22:51.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.029+0000 7fb090fd9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb08c102dc0 0x7fb08c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:51.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.029+0000 7fb090fd9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb08c1087d0 0x7fb08c199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:51.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.029+0000 7fb090fd9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb08c109150 0x7fb08c19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:51.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.029+0000 7fb090fd9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb08c112e10 con 0x7fb08c102dc0 2024-09-11T00:22:51.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.029+0000 7fb090fd9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb08c112c90 con 0x7fb08c1087d0 2024-09-11T00:22:51.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.029+0000 7fb090fd9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb08c112f90 con 0x7fb08c109150 2024-09-11T00:22:51.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.029+0000 7fb08a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb08c102dc0 0x7fb08c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:51.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.029+0000 7fb08a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb08c102dc0 0x7fb08c199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34820/0 (socket says 172.21.15.78:34820) 2024-09-11T00:22:51.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.029+0000 7fb08a59c640 1 -- 172.21.15.78:0/1097479541 learned_addr learned my addr 172.21.15.78:0/1097479541 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:51.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.029+0000 7fb08ad9d640 1 --2- 172.21.15.78:0/1097479541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb08c109150 0x7fb08c19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:51.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.030+0000 7fb089d9b640 1 --2- 172.21.15.78:0/1097479541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb08c1087d0 0x7fb08c199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:51.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.030+0000 7fb08a59c640 1 -- 172.21.15.78:0/1097479541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb08c109150 msgr2=0x7fb08c19ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:51.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.030+0000 7fb08a59c640 1 --2- 172.21.15.78:0/1097479541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb08c109150 0x7fb08c19ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:51.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.030+0000 7fb08a59c640 1 -- 172.21.15.78:0/1097479541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb08c1087d0 msgr2=0x7fb08c199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:51.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.030+0000 7fb08a59c640 1 --2- 172.21.15.78:0/1097479541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb08c1087d0 0x7fb08c199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.030+0000 7fb08a59c640 1 -- 172.21.15.78:0/1097479541 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb08c19f3b0 con 0x7fb08c102dc0 2024-09-11T00:22:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.030+0000 7fb089d9b640 1 --2- 172.21.15.78:0/1097479541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb08c1087d0 0x7fb08c199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:22:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.030+0000 7fb08a59c640 1 --2- 172.21.15.78:0/1097479541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb08c102dc0 0x7fb08c199300 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb07400d770 tx=0x7fb07400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.030+0000 7fb0837fe640 1 -- 172.21.15.78:0/1097479541 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb074017070 con 0x7fb08c102dc0 2024-09-11T00:22:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.030+0000 7fb0837fe640 1 -- 172.21.15.78:0/1097479541 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0740054d0 con 0x7fb08c102dc0 2024-09-11T00:22:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.030+0000 7fb090fd9640 1 -- 172.21.15.78:0/1097479541 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb08c19f6a0 con 0x7fb08c102dc0 2024-09-11T00:22:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.030+0000 7fb0837fe640 1 -- 172.21.15.78:0/1097479541 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb074004c30 con 0x7fb08c102dc0 2024-09-11T00:22:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.030+0000 7fb090fd9640 1 -- 172.21.15.78:0/1097479541 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb08c1a5d60 con 0x7fb08c102dc0 2024-09-11T00:22:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.031+0000 7fb090fd9640 1 -- 172.21.15.78:0/1097479541 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb08c1031a0 con 0x7fb08c102dc0 2024-09-11T00:22:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.032+0000 7fb0837fe640 1 -- 172.21.15.78:0/1097479541 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fb074004e10 con 0x7fb08c102dc0 2024-09-11T00:22:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.033+0000 7fb0837fe640 1 --2- 172.21.15.78:0/1097479541 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb0780b5450 0x7fb0780b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.033+0000 7fb089d9b640 1 --2- 172.21.15.78:0/1097479541 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb0780b5450 0x7fb0780b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.033+0000 7fb0837fe640 1 -- 172.21.15.78:0/1097479541 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7fb0740e5ac0 con 0x7fb08c102dc0 2024-09-11T00:22:51.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.034+0000 7fb089d9b640 1 --2- 172.21.15.78:0/1097479541 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb0780b5450 0x7fb0780b7910 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb08c102070 tx=0x7fb07c005cb0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:51.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.037+0000 7fb0837fe640 1 -- 172.21.15.78:0/1097479541 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb0740ac660 con 0x7fb08c102dc0 2024-09-11T00:22:51.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.249+0000 7fb090fd9640 1 -- 172.21.15.78:0/1097479541 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb08c19a430 con 0x7fb08c102dc0 2024-09-11T00:22:51.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.250+0000 7fb0837fe640 1 -- 172.21.15.78:0/1097479541 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7fb0740abf60 con 0x7fb08c102dc0 2024-09-11T00:22:51.253 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:22:51.253 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:22:51.253 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:22:51.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.252+0000 7fb090fd9640 1 -- 172.21.15.78:0/1097479541 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb0780b5450 msgr2=0x7fb0780b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:51.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.252+0000 7fb090fd9640 1 --2- 172.21.15.78:0/1097479541 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb0780b5450 0x7fb0780b7910 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb08c102070 tx=0x7fb07c005cb0 comp rx=0 tx=0).stop 2024-09-11T00:22:51.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.252+0000 7fb090fd9640 1 -- 172.21.15.78:0/1097479541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb08c102dc0 msgr2=0x7fb08c199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:51.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.252+0000 7fb090fd9640 1 --2- 172.21.15.78:0/1097479541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb08c102dc0 0x7fb08c199300 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb07400d770 tx=0x7fb07400dc30 comp rx=0 tx=0).stop 2024-09-11T00:22:51.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.252+0000 7fb090fd9640 1 -- 172.21.15.78:0/1097479541 shutdown_connections 2024-09-11T00:22:51.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.252+0000 7fb090fd9640 1 --2- 172.21.15.78:0/1097479541 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb0780b5450 0x7fb0780b7910 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:51.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.252+0000 7fb090fd9640 1 --2- 172.21.15.78:0/1097479541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb08c109150 0x7fb08c19ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:51.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.252+0000 7fb090fd9640 1 --2- 172.21.15.78:0/1097479541 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb08c1087d0 0x7fb08c199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:51.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.252+0000 7fb090fd9640 1 --2- 172.21.15.78:0/1097479541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb08c102dc0 0x7fb08c199300 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:51.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.252+0000 7fb090fd9640 1 -- 172.21.15.78:0/1097479541 >> 172.21.15.78:0/1097479541 conn(0x7fb08c0fe830 msgr2=0x7fb08c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:51.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.252+0000 7fb090fd9640 1 -- 172.21.15.78:0/1097479541 shutdown_connections 2024-09-11T00:22:51.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:51.252+0000 7fb090fd9640 1 -- 172.21.15.78:0/1097479541 wait complete. 2024-09-11T00:22:51.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:51 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1097479541' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:22:51.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:51 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1097479541' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:22:51.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:51 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1097479541' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:22:51.910 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:22:52.156 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:22:52.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:52 smithi078 ceph-mon[30865]: pgmap v515: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:22:52.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.672+0000 7f82316ec640 1 -- 172.21.15.78:0/618855714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f822c108060 msgr2=0x7f822c10e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:52.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.672+0000 7f82316ec640 1 --2- 172.21.15.78:0/618855714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f822c108060 0x7f822c10e860 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f8224009900 tx=0x7f822402a410 comp rx=0 tx=0).stop 2024-09-11T00:22:52.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.672+0000 7f82316ec640 1 -- 172.21.15.78:0/618855714 shutdown_connections 2024-09-11T00:22:52.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.672+0000 7f82316ec640 1 --2- 172.21.15.78:0/618855714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f822c108060 0x7f822c10e860 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.672+0000 7f82316ec640 1 --2- 172.21.15.78:0/618855714 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f822c1076e0 0x7f822c107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.672+0000 7f82316ec640 1 --2- 172.21.15.78:0/618855714 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f822c101cd0 0x7f822c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.672+0000 7f82316ec640 1 -- 172.21.15.78:0/618855714 >> 172.21.15.78:0/618855714 conn(0x7f822c0fd700 msgr2=0x7f822c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:52.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.672+0000 7f82316ec640 1 -- 172.21.15.78:0/618855714 shutdown_connections 2024-09-11T00:22:52.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.672+0000 7f82316ec640 1 -- 172.21.15.78:0/618855714 wait complete. 2024-09-11T00:22:52.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.673+0000 7f82316ec640 1 Processor -- start 2024-09-11T00:22:52.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.673+0000 7f82316ec640 1 -- start start 2024-09-11T00:22:52.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.673+0000 7f82316ec640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f822c101cd0 0x7f822c19a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:52.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.673+0000 7f82316ec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f822c1076e0 0x7f822c19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:52.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.673+0000 7f82316ec640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f822c108060 0x7f822c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:52.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.673+0000 7f82316ec640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f822c111d20 con 0x7f822c1076e0 2024-09-11T00:22:52.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.673+0000 7f82316ec640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f822c111ba0 con 0x7f822c101cd0 2024-09-11T00:22:52.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.673+0000 7f82316ec640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f822c111ea0 con 0x7f822c108060 2024-09-11T00:22:52.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.673+0000 7f822a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f822c1076e0 0x7f822c19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:52.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.673+0000 7f822a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f822c1076e0 0x7f822c19a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34826/0 (socket says 172.21.15.78:34826) 2024-09-11T00:22:52.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.673+0000 7f822a7fc640 1 -- 172.21.15.78:0/3464222089 learned_addr learned my addr 172.21.15.78:0/3464222089 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:52.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.674+0000 7f822affd640 1 --2- 172.21.15.78:0/3464222089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f822c101cd0 0x7f822c19a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:52.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.674+0000 7f822a7fc640 1 -- 172.21.15.78:0/3464222089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f822c108060 msgr2=0x7f822c19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:52.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.674+0000 7f822a7fc640 1 --2- 172.21.15.78:0/3464222089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f822c108060 0x7f822c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.674+0000 7f822a7fc640 1 -- 172.21.15.78:0/3464222089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f822c101cd0 msgr2=0x7f822c19a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:52.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.674+0000 7f822a7fc640 1 --2- 172.21.15.78:0/3464222089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f822c101cd0 0x7f822c19a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.674+0000 7f822a7fc640 1 -- 172.21.15.78:0/3464222089 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822c1a54a0 con 0x7f822c1076e0 2024-09-11T00:22:52.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.674+0000 7f822affd640 1 --2- 172.21.15.78:0/3464222089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f822c101cd0 0x7f822c19a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:22:52.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.674+0000 7f822a7fc640 1 --2- 172.21.15.78:0/3464222089 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f822c1076e0 0x7f822c19a5e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f821400c890 tx=0x7f821400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:52.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.674+0000 7f8223fff640 1 -- 172.21.15.78:0/3464222089 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8214004220 con 0x7f822c1076e0 2024-09-11T00:22:52.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.674+0000 7f82316ec640 1 -- 172.21.15.78:0/3464222089 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f822c1a5790 con 0x7f822c1076e0 2024-09-11T00:22:52.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.674+0000 7f8223fff640 1 -- 172.21.15.78:0/3464222089 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82140043c0 con 0x7f822c1076e0 2024-09-11T00:22:52.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.674+0000 7f8223fff640 1 -- 172.21.15.78:0/3464222089 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8214004a00 con 0x7f822c1076e0 2024-09-11T00:22:52.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.674+0000 7f82316ec640 1 -- 172.21.15.78:0/3464222089 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f822c1a5da0 con 0x7f822c1076e0 2024-09-11T00:22:52.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.676+0000 7f8223fff640 1 -- 172.21.15.78:0/3464222089 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f82140079b0 con 0x7f822c1076e0 2024-09-11T00:22:52.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.677+0000 7f8233ac1740 1 Processor -- start 2024-09-11T00:22:52.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.677+0000 7f8233ac1740 1 -- start start 2024-09-11T00:22:52.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.677+0000 7f8233ac1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56330bfe84d0 0x56330bfe88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:52.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.677+0000 7f8233ac1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bfe8df0 0x56330bff4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:52.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.677+0000 7f8233ac1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56330bff4d80 0x56330bff7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:52.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.677+0000 7f8233ac1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56330bf5eea0 con 0x56330bfe8df0 2024-09-11T00:22:52.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.677+0000 7f8233ac1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56330bf4e2d0 con 0x56330bff4d80 2024-09-11T00:22:52.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.677+0000 7f8233ac1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56330bf520e0 con 0x56330bfe84d0 2024-09-11T00:22:52.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.677+0000 7f822affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bfe8df0 0x56330bff4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:52.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.677+0000 7f822affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bfe8df0 0x56330bff4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34834/0 (socket says 172.21.15.78:34834) 2024-09-11T00:22:52.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.677+0000 7f822affd640 1 -- 172.21.15.78:0/3873018062 learned_addr learned my addr 172.21.15.78:0/3873018062 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:52.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.677+0000 7f8223fff640 1 --2- 172.21.15.78:0/3464222089 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f82180b5450 0x7f82180b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:52.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.677+0000 7f822b7fe640 1 --2- 172.21.15.78:0/3873018062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56330bfe84d0 0x56330bfe88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:52.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.678+0000 7f822a7fc640 1 --2- 172.21.15.78:0/3873018062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56330bff4d80 0x56330bff7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:52.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.678+0000 7f822b7fe640 1 --2- 172.21.15.78:0/3464222089 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f82180b5450 0x7f82180b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:52.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.678+0000 7f822affd640 1 -- 172.21.15.78:0/3873018062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56330bfe84d0 msgr2=0x56330bfe88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:52.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.678+0000 7f822affd640 1 --2- 172.21.15.78:0/3873018062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56330bfe84d0 0x56330bfe88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.678+0000 7f822affd640 1 -- 172.21.15.78:0/3873018062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56330bff4d80 msgr2=0x56330bff7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.678+0000 7f8223fff640 1 -- 172.21.15.78:0/3464222089 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f82140e5e70 con 0x7f822c1076e0 2024-09-11T00:22:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.678+0000 7f822b7fe640 1 --2- 172.21.15.78:0/3464222089 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f82180b5450 0x7f82180b7910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f822402a930 tx=0x7f8224031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:52.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.678+0000 7f822affd640 1 --2- 172.21.15.78:0/3873018062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56330bff4d80 0x56330bff7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.678+0000 7f822affd640 1 -- 172.21.15.78:0/3873018062 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56330bcac650 con 0x56330bfe8df0 2024-09-11T00:22:52.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.678+0000 7f822a7fc640 1 --2- 172.21.15.78:0/3873018062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56330bff4d80 0x56330bff7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:22:52.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.678+0000 7f822affd640 1 --2- 172.21.15.78:0/3873018062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bfe8df0 0x56330bff4840 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f821c00c4a0 tx=0x7f821c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18bc53a0853ba8eb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:52.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.678+0000 7f82217fa640 1 -- 172.21.15.78:0/3873018062 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c01a070 con 0x56330bfe8df0 2024-09-11T00:22:52.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.678+0000 7f82217fa640 1 -- 172.21.15.78:0/3873018062 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f821c0158c0 con 0x56330bfe8df0 2024-09-11T00:22:52.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.678+0000 7f82217fa640 1 -- 172.21.15.78:0/3873018062 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c00a7e0 con 0x56330bfe8df0 2024-09-11T00:22:52.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.679+0000 7f8233ac1740 1 -- 172.21.15.78:0/3873018062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bfe8df0 msgr2=0x56330bff4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:52.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.679+0000 7f8233ac1740 1 --2- 172.21.15.78:0/3873018062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bfe8df0 0x56330bff4840 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f821c00c4a0 tx=0x7f821c00c8a0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.679+0000 7f8233ac1740 1 -- 172.21.15.78:0/3873018062 shutdown_connections 2024-09-11T00:22:52.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.679+0000 7f8233ac1740 1 --2- 172.21.15.78:0/3873018062 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56330bff4d80 0x56330bff7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.679+0000 7f8233ac1740 1 --2- 172.21.15.78:0/3873018062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bfe8df0 0x56330bff4840 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.679+0000 7f8233ac1740 1 --2- 172.21.15.78:0/3873018062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56330bfe84d0 0x56330bfe88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.679+0000 7f8233ac1740 1 -- 172.21.15.78:0/3873018062 >> 172.21.15.78:0/3873018062 conn(0x56330bfe6300 msgr2=0x56330bfe74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:52.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.679+0000 7f8233ac1740 1 -- 172.21.15.78:0/3873018062 shutdown_connections 2024-09-11T00:22:52.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.679+0000 7f8233ac1740 1 -- 172.21.15.78:0/3873018062 wait complete. 2024-09-11T00:22:52.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.679+0000 7f8233ac1740 1 -- start start 2024-09-11T00:22:52.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.680+0000 7f8233ac1740 1 Processor -- start 2024-09-11T00:22:52.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.680+0000 7f8233ac1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bfe84d0 0x56330bff4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:52.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.680+0000 7f8233ac1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56330bfe8df0 0x56330bff1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:52.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.680+0000 7f8233ac1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56330bff4d80 0x56330bff20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:52.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.680+0000 7f8233ac1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56330bdaf700 con 0x56330bfe84d0 2024-09-11T00:22:52.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.680+0000 7f8233ac1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56330bee9160 con 0x56330bff4d80 2024-09-11T00:22:52.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.680+0000 7f8233ac1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56330bff7a00 con 0x56330bfe8df0 2024-09-11T00:22:52.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.680+0000 7f8233ac1740 10 client.0 _ll_register_callbacks cb 0x56330bf029e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:22:52.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.680+0000 7f822affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bfe84d0 0x56330bff4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:52.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.680+0000 7f822affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bfe84d0 0x56330bff4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34840/0 (socket says 172.21.15.78:34840) 2024-09-11T00:22:52.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.680+0000 7f822affd640 1 -- 172.21.15.78:0/2776770740 learned_addr learned my addr 172.21.15.78:0/2776770740 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:52.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.680+0000 7f822a7fc640 1 --2- 172.21.15.78:0/2776770740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56330bfe8df0 0x56330bff1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:52.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.680+0000 7f822affd640 1 -- 172.21.15.78:0/2776770740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56330bfe8df0 msgr2=0x56330bff1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:52.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.680+0000 7f822affd640 1 --2- 172.21.15.78:0/2776770740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56330bfe8df0 0x56330bff1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.680+0000 7f822affd640 1 -- 172.21.15.78:0/2776770740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56330bff4d80 msgr2=0x56330bff20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:52.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.680+0000 7f822affd640 1 --2- 172.21.15.78:0/2776770740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56330bff4d80 0x56330bff20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.680+0000 7f822affd640 1 -- 172.21.15.78:0/2776770740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56330bf16c90 con 0x56330bfe84d0 2024-09-11T00:22:52.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.680+0000 7f822a7fc640 1 --2- 172.21.15.78:0/2776770740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56330bfe8df0 0x56330bff1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:22:52.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.680+0000 7f822affd640 1 --2- 172.21.15.78:0/2776770740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bfe84d0 0x56330bff4670 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f821c004a80 tx=0x7f821c015ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988f52e570db4ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:52.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.680+0000 7f82127fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:22:52.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.680+0000 7f82127fc640 1 -- 172.21.15.78:0/2776770740 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c01a070 con 0x56330bfe84d0 2024-09-11T00:22:52.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.681+0000 7f82127fc640 1 -- 172.21.15.78:0/2776770740 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f821c00a790 con 0x56330bfe84d0 2024-09-11T00:22:52.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.681+0000 7f8233ac1740 1 -- 172.21.15.78:0/2776770740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f821c0158c0 con 0x56330bfe84d0 2024-09-11T00:22:52.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.681+0000 7f82127fc640 1 -- 172.21.15.78:0/2776770740 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f821c009570 con 0x56330bfe84d0 2024-09-11T00:22:52.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.681+0000 7f8233ac1740 10 client.16152 fetch_fsmap learned FSMap version 20 2024-09-11T00:22:52.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.681+0000 7f8233ac1740 1 -- 172.21.15.78:0/2776770740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56330c0032a0 con 0x56330bfe84d0 2024-09-11T00:22:52.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.681+0000 7f82127fc640 1 -- 172.21.15.78:0/2776770740 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f821c0158c0 con 0x56330bfe84d0 2024-09-11T00:22:52.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.681+0000 7f82127fc640 1 -- 172.21.15.78:0/2776770740 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f821c020770 con 0x56330bfe84d0 2024-09-11T00:22:52.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.681+0000 7f8233ac1740 10 client.16152 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:22:52.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.681+0000 7f8233ac1740 10 client.16152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:22:52.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.681+0000 7f8233ac1740 20 client.16152 populate_metadata read hostname 'smithi078' 2024-09-11T00:22:52.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.681+0000 7f8233ac1740 1 --2- 172.21.15.78:0/2776770740 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56330c004650 0x56330c006a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:52.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.681+0000 7f8233ac1740 4 client.16152 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:22:52.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.681+0000 7f8233ac1740 1 -- 172.21.15.78:0/2776770740 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56330bf60df0 con 0x56330c004650 2024-09-11T00:22:52.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.681+0000 7f822a7fc640 1 --2- 172.21.15.78:0/2776770740 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56330c004650 0x56330c006a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:52.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.682+0000 7f82127fc640 10 client.16152 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:52.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.682+0000 7f822a7fc640 1 --2- 172.21.15.78:0/2776770740 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56330c004650 0x56330c006a40 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a55ae32e4e88ec19 server_cookie=8745a7653ecd687e in_seq=0 out_seq=0 2024-09-11T00:22:52.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.683+0000 7f82127fc640 1 -- 172.21.15.78:0/2776770740 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56330bf60df0 con 0x56330c004650 2024-09-11T00:22:52.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.683+0000 7f82127fc640 10 client.16152 handle_command_reply: tid=0 2024-09-11T00:22:52.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.683+0000 7f8233ac1740 1 client.16152 shutdown 2024-09-11T00:22:52.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.683+0000 7f8233ac1740 1 -- 172.21.15.78:0/2776770740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bfe84d0 msgr2=0x56330bff4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:52.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.683+0000 7f8233ac1740 1 --2- 172.21.15.78:0/2776770740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bfe84d0 0x56330bff4670 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f821c004a80 tx=0x7f821c015ca0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.683+0000 7f8233ac1740 1 -- 172.21.15.78:0/2776770740 shutdown_connections 2024-09-11T00:22:52.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.683+0000 7f8233ac1740 1 --2- 172.21.15.78:0/2776770740 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56330c004650 0x56330c006a40 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.683+0000 7f8233ac1740 1 --2- 172.21.15.78:0/2776770740 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56330bff4d80 0x56330bff20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.683+0000 7f8233ac1740 1 --2- 172.21.15.78:0/2776770740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56330bfe8df0 0x56330bff1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.683+0000 7f8233ac1740 1 --2- 172.21.15.78:0/2776770740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bfe84d0 0x56330bff4670 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.683+0000 7f8233ac1740 1 -- 172.21.15.78:0/2776770740 >> 172.21.15.78:0/2776770740 conn(0x56330bfe6300 msgr2=0x56330bfebea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:52.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.683+0000 7f82127fc640 0 client.16152 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:52.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.683+0000 7f8233ac1740 1 -- 172.21.15.78:0/2776770740 shutdown_connections 2024-09-11T00:22:52.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.683+0000 7f8233ac1740 1 -- 172.21.15.78:0/2776770740 wait complete. 2024-09-11T00:22:52.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.683+0000 7f8233ac1740 20 client.16152 trim_cache size 0 max 16384 2024-09-11T00:22:52.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.696+0000 7f8233ac1740 1 Processor -- start 2024-09-11T00:22:52.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.696+0000 7f8233ac1740 1 -- start start 2024-09-11T00:22:52.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.696+0000 7f8233ac1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56330bfe84d0 0x56330c000c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:52.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.696+0000 7f8233ac1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56330bfe8df0 0x56330bfe7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:52.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.696+0000 7f8233ac1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bff4d80 0x56330bff6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:52.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.696+0000 7f8233ac1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f822c1ac840 con 0x56330bff4d80 2024-09-11T00:22:52.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.696+0000 7f8233ac1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f822c1af0c0 con 0x56330bfe8df0 2024-09-11T00:22:52.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.696+0000 7f8233ac1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f822c1aceb0 con 0x56330bfe84d0 2024-09-11T00:22:52.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.696+0000 7f822b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bff4d80 0x56330bff6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:52.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.696+0000 7f822b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bff4d80 0x56330bff6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34842/0 (socket says 172.21.15.78:34842) 2024-09-11T00:22:52.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.696+0000 7f822b7fe640 1 -- 172.21.15.78:0/173873875 learned_addr learned my addr 172.21.15.78:0/173873875 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:52.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.696+0000 7f822affd640 1 --2- 172.21.15.78:0/173873875 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56330bfe84d0 0x56330c000c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:52.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.697+0000 7f822a7fc640 1 --2- 172.21.15.78:0/173873875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56330bfe8df0 0x56330bfe7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:52.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.697+0000 7f822b7fe640 1 -- 172.21.15.78:0/173873875 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56330bfe84d0 msgr2=0x56330c000c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:52.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.697+0000 7f822b7fe640 1 --2- 172.21.15.78:0/173873875 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56330bfe84d0 0x56330c000c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.697+0000 7f822b7fe640 1 -- 172.21.15.78:0/173873875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56330bfe8df0 msgr2=0x56330bfe7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:52.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.697+0000 7f822b7fe640 1 --2- 172.21.15.78:0/173873875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56330bfe8df0 0x56330bfe7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.697+0000 7f822b7fe640 1 -- 172.21.15.78:0/173873875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56330bff2990 con 0x56330bff4d80 2024-09-11T00:22:52.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.697+0000 7f822b7fe640 1 --2- 172.21.15.78:0/173873875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bff4d80 0x56330bff6170 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8224005890 tx=0x7f8224005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54b715e02d4a653 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:52.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.697+0000 7f8220ff9640 1 -- 172.21.15.78:0/173873875 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224035070 con 0x56330bff4d80 2024-09-11T00:22:52.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.697+0000 7f8220ff9640 1 -- 172.21.15.78:0/173873875 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f822404e070 con 0x56330bff4d80 2024-09-11T00:22:52.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.697+0000 7f8220ff9640 1 -- 172.21.15.78:0/173873875 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224003e20 con 0x56330bff4d80 2024-09-11T00:22:52.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.698+0000 7f8233ac1740 1 -- 172.21.15.78:0/173873875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bff4d80 msgr2=0x56330bff6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:52.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.698+0000 7f8233ac1740 1 --2- 172.21.15.78:0/173873875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bff4d80 0x56330bff6170 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8224005890 tx=0x7f8224005fd0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.698+0000 7f8233ac1740 1 -- 172.21.15.78:0/173873875 shutdown_connections 2024-09-11T00:22:52.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.698+0000 7f8233ac1740 1 --2- 172.21.15.78:0/173873875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bff4d80 0x56330bff6170 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.698+0000 7f8233ac1740 1 --2- 172.21.15.78:0/173873875 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56330bfe8df0 0x56330bfe7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.698+0000 7f8233ac1740 1 --2- 172.21.15.78:0/173873875 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56330bfe84d0 0x56330c000c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.698+0000 7f8233ac1740 1 -- 172.21.15.78:0/173873875 >> 172.21.15.78:0/173873875 conn(0x56330bfe6300 msgr2=0x56330bfe7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:52.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.698+0000 7f8233ac1740 1 -- 172.21.15.78:0/173873875 shutdown_connections 2024-09-11T00:22:52.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.698+0000 7f8233ac1740 1 -- 172.21.15.78:0/173873875 wait complete. 2024-09-11T00:22:52.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.698+0000 7f8233ac1740 1 -- start start 2024-09-11T00:22:52.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.698+0000 7f8233ac1740 1 Processor -- start 2024-09-11T00:22:52.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.698+0000 7f8233ac1740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56330bfe84d0 0x56330bffd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:52.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f8233ac1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56330bfe8df0 0x56330c00bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:52.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f8233ac1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bff4d80 0x56330c00c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:52.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f8233ac1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f822c1ad580 con 0x56330bff4d80 2024-09-11T00:22:52.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f8233ac1740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f822c1ae9f0 con 0x56330bfe84d0 2024-09-11T00:22:52.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f8233ac1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f822c1adc50 con 0x56330bfe8df0 2024-09-11T00:22:52.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f8233ac1740 10 client.0 _ll_register_callbacks cb 0x7f821c018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:22:52.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f822b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bff4d80 0x56330c00c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:52.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f822b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bff4d80 0x56330c00c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34844/0 (socket says 172.21.15.78:34844) 2024-09-11T00:22:52.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f822b7fe640 1 -- 172.21.15.78:0/3832443800 learned_addr learned my addr 172.21.15.78:0/3832443800 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:52.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f822affd640 1 --2- 172.21.15.78:0/3832443800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56330bfe84d0 0x56330bffd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:52.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f822a7fc640 1 --2- 172.21.15.78:0/3832443800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56330bfe8df0 0x56330c00bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:52.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f822b7fe640 1 -- 172.21.15.78:0/3832443800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56330bfe8df0 msgr2=0x56330c00bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:52.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f822b7fe640 1 --2- 172.21.15.78:0/3832443800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56330bfe8df0 0x56330c00bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f822b7fe640 1 -- 172.21.15.78:0/3832443800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56330bfe84d0 msgr2=0x56330bffd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:52.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f822b7fe640 1 --2- 172.21.15.78:0/3832443800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56330bfe84d0 0x56330bffd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f822b7fe640 1 -- 172.21.15.78:0/3832443800 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56330bffc190 con 0x56330bff4d80 2024-09-11T00:22:52.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f822b7fe640 1 --2- 172.21.15.78:0/3832443800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bff4d80 0x56330c00c4a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8224009900 tx=0x7f822402ab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97c3ec19209e379 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:52.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f82127fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:22:52.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f82127fc640 1 -- 172.21.15.78:0/3832443800 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224035040 con 0x56330bff4d80 2024-09-11T00:22:52.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f82127fc640 1 -- 172.21.15.78:0/3832443800 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f8224049810 con 0x56330bff4d80 2024-09-11T00:22:52.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f8233ac1740 1 -- 172.21.15.78:0/3832443800 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f822404e070 con 0x56330bff4d80 2024-09-11T00:22:52.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f82127fc640 1 -- 172.21.15.78:0/3832443800 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8224049a30 con 0x56330bff4d80 2024-09-11T00:22:52.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f8233ac1740 10 client.16158 fetch_fsmap learned FSMap version 20 2024-09-11T00:22:52.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.699+0000 7f8233ac1740 1 -- 172.21.15.78:0/3832443800 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56330c071430 con 0x56330bff4d80 2024-09-11T00:22:52.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.700+0000 7f82127fc640 1 -- 172.21.15.78:0/3832443800 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f822404e070 con 0x56330bff4d80 2024-09-11T00:22:52.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.700+0000 7f82127fc640 1 -- 172.21.15.78:0/3832443800 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f8224061020 con 0x56330bff4d80 2024-09-11T00:22:52.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.700+0000 7f8233ac1740 10 client.16158 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:22:52.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.700+0000 7f8233ac1740 10 client.16158 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:22:52.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.700+0000 7f8233ac1740 20 client.16158 populate_metadata read hostname 'smithi078' 2024-09-11T00:22:52.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.700+0000 7f8233ac1740 1 --2- 172.21.15.78:0/3832443800 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56330c071a70 0x56330c073e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:52.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.700+0000 7f8233ac1740 4 client.16158 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:22:52.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.700+0000 7f8233ac1740 1 -- 172.21.15.78:0/3832443800 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56330bf5c8a0 con 0x56330c071a70 2024-09-11T00:22:52.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.700+0000 7f822affd640 1 --2- 172.21.15.78:0/3832443800 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56330c071a70 0x56330c073e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:52.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.700+0000 7f822affd640 1 --2- 172.21.15.78:0/3832443800 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56330c071a70 0x56330c073e90 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32f4345b31626ade server_cookie=f86ef75c98aba734 in_seq=0 out_seq=0 2024-09-11T00:22:52.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.700+0000 7f82127fc640 10 client.16158 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:52.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.701+0000 7f82127fc640 1 -- 172.21.15.78:0/3832443800 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56330bf5c8a0 con 0x56330c071a70 2024-09-11T00:22:52.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.701+0000 7f82127fc640 10 client.16158 handle_command_reply: tid=0 2024-09-11T00:22:52.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.701+0000 7f8233ac1740 1 client.16158 shutdown 2024-09-11T00:22:52.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.701+0000 7f8233ac1740 1 -- 172.21.15.78:0/3832443800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bff4d80 msgr2=0x56330c00c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:52.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.701+0000 7f8233ac1740 1 --2- 172.21.15.78:0/3832443800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bff4d80 0x56330c00c4a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8224009900 tx=0x7f822402ab10 comp rx=0 tx=0).stop 2024-09-11T00:22:52.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.701+0000 7f8233ac1740 1 -- 172.21.15.78:0/3832443800 shutdown_connections 2024-09-11T00:22:52.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.701+0000 7f8233ac1740 1 --2- 172.21.15.78:0/3832443800 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56330c071a70 0x56330c073e90 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.701+0000 7f82127fc640 0 client.16158 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:52.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.701+0000 7f8233ac1740 1 --2- 172.21.15.78:0/3832443800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56330bff4d80 0x56330c00c4a0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.701+0000 7f8233ac1740 1 --2- 172.21.15.78:0/3832443800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56330bfe8df0 0x56330c00bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.701+0000 7f8233ac1740 1 --2- 172.21.15.78:0/3832443800 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56330bfe84d0 0x56330bffd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.701+0000 7f8233ac1740 1 -- 172.21.15.78:0/3832443800 >> 172.21.15.78:0/3832443800 conn(0x56330bfe6300 msgr2=0x56330bfe4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:52.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.701+0000 7f8233ac1740 1 -- 172.21.15.78:0/3832443800 shutdown_connections 2024-09-11T00:22:52.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.701+0000 7f8233ac1740 1 -- 172.21.15.78:0/3832443800 wait complete. 2024-09-11T00:22:52.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.701+0000 7f8233ac1740 20 client.16158 trim_cache size 0 max 16384 2024-09-11T00:22:52.724 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-11T00:22:52.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.702+0000 7f82316ec640 1 -- 172.21.15.78:0/3464222089 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f82180b5450 msgr2=0x7f82180b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:52.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.702+0000 7f82316ec640 1 --2- 172.21.15.78:0/3464222089 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f82180b5450 0x7f82180b7910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f822402a930 tx=0x7f8224031400 comp rx=0 tx=0).stop 2024-09-11T00:22:52.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.702+0000 7f82316ec640 1 -- 172.21.15.78:0/3464222089 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f822c1076e0 msgr2=0x7f822c19a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:52.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.702+0000 7f82316ec640 1 --2- 172.21.15.78:0/3464222089 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f822c1076e0 0x7f822c19a5e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f821400c890 tx=0x7f821400cd50 comp rx=0 tx=0).stop 2024-09-11T00:22:52.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.702+0000 7f82316ec640 1 -- 172.21.15.78:0/3464222089 shutdown_connections 2024-09-11T00:22:52.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.702+0000 7f82316ec640 1 --2- 172.21.15.78:0/3464222089 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f82180b5450 0x7f82180b7910 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.702+0000 7f82316ec640 1 --2- 172.21.15.78:0/3464222089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f822c108060 0x7f822c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.702+0000 7f82316ec640 1 --2- 172.21.15.78:0/3464222089 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f822c1076e0 0x7f822c19a5e0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.702+0000 7f82316ec640 1 --2- 172.21.15.78:0/3464222089 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f822c101cd0 0x7f822c19a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:52.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.702+0000 7f82316ec640 1 -- 172.21.15.78:0/3464222089 >> 172.21.15.78:0/3464222089 conn(0x7f822c0fd700 msgr2=0x7f822c104da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:52.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.702+0000 7f82316ec640 1 -- 172.21.15.78:0/3464222089 shutdown_connections 2024-09-11T00:22:52.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:52.702+0000 7f82316ec640 1 -- 172.21.15.78:0/3464222089 wait complete. 2024-09-11T00:22:52.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:52 smithi112 ceph-mon[35627]: pgmap v515: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:22:52.794 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:52 smithi138 ceph-mon[35019]: pgmap v515: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:22:54.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:53 smithi112 ceph-mon[35627]: pgmap v516: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:54.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:53 smithi138 ceph-mon[35019]: pgmap v516: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:54.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:53 smithi078 ceph-mon[30865]: pgmap v516: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:22:54.419 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:22:54.419 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:22:54.676 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:22:55.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.217+0000 7f3eaadf8640 1 -- 172.21.15.78:0/1821867853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea4102dc0 msgr2=0x7f3ea41031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:55.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.217+0000 7f3eaadf8640 1 --2- 172.21.15.78:0/1821867853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea4102dc0 0x7f3ea41031a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009900 tx=0x7f3e9402a410 comp rx=0 tx=0).stop 2024-09-11T00:22:55.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.217+0000 7f3eaadf8640 1 -- 172.21.15.78:0/1821867853 shutdown_connections 2024-09-11T00:22:55.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.217+0000 7f3eaadf8640 1 --2- 172.21.15.78:0/1821867853 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ea4109150 0x7f3ea410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.217+0000 7f3eaadf8640 1 --2- 172.21.15.78:0/1821867853 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ea41087d0 0x7f3ea4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.217+0000 7f3eaadf8640 1 --2- 172.21.15.78:0/1821867853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea4102dc0 0x7f3ea41031a0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.217+0000 7f3eaadf8640 1 -- 172.21.15.78:0/1821867853 >> 172.21.15.78:0/1821867853 conn(0x7f3ea40fe830 msgr2=0x7f3ea4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:55.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.218+0000 7f3eaadf8640 1 -- 172.21.15.78:0/1821867853 shutdown_connections 2024-09-11T00:22:55.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.218+0000 7f3eaadf8640 1 -- 172.21.15.78:0/1821867853 wait complete. 2024-09-11T00:22:55.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.218+0000 7f3eaadf8640 1 Processor -- start 2024-09-11T00:22:55.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.218+0000 7f3eaadf8640 1 -- start start 2024-09-11T00:22:55.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.219+0000 7f3eaadf8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea4102dc0 0x7f3ea41991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:55.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.219+0000 7f3eaadf8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ea41087d0 0x7f3ea4199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:55.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.219+0000 7f3eaadf8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ea4109150 0x7f3ea419eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:55.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.219+0000 7f3eaadf8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea4112e10 con 0x7f3ea4102dc0 2024-09-11T00:22:55.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.219+0000 7f3eaadf8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea4112c90 con 0x7f3ea41087d0 2024-09-11T00:22:55.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.219+0000 7f3eaadf8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea4112f90 con 0x7f3ea4109150 2024-09-11T00:22:55.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.219+0000 7f3ea8b94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea4102dc0 0x7f3ea41991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:55.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.219+0000 7f3ea8b94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea4102dc0 0x7f3ea41991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47882/0 (socket says 172.21.15.78:47882) 2024-09-11T00:22:55.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.219+0000 7f3ea8b94640 1 -- 172.21.15.78:0/1564997179 learned_addr learned my addr 172.21.15.78:0/1564997179 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:55.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.219+0000 7f3ea3fff640 1 --2- 172.21.15.78:0/1564997179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ea41087d0 0x7f3ea4199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:55.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.219+0000 7f3ea8b94640 1 -- 172.21.15.78:0/1564997179 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ea4109150 msgr2=0x7f3ea419eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:55.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.219+0000 7f3ea8b94640 1 --2- 172.21.15.78:0/1564997179 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ea4109150 0x7f3ea419eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.219+0000 7f3ea8b94640 1 -- 172.21.15.78:0/1564997179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ea41087d0 msgr2=0x7f3ea4199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:55.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.219+0000 7f3ea8b94640 1 --2- 172.21.15.78:0/1564997179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ea41087d0 0x7f3ea4199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.219+0000 7f3ea8b94640 1 -- 172.21.15.78:0/1564997179 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea419f290 con 0x7f3ea4102dc0 2024-09-11T00:22:55.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.219+0000 7f3ea8b94640 1 --2- 172.21.15.78:0/1564997179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea4102dc0 0x7f3ea41991e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3e94005940 tx=0x7f3e940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:55.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.219+0000 7f3ea1ffb640 1 -- 172.21.15.78:0/1564997179 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9403f030 con 0x7f3ea4102dc0 2024-09-11T00:22:55.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.219+0000 7f3eaadf8640 1 -- 172.21.15.78:0/1564997179 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea419f520 con 0x7f3ea4102dc0 2024-09-11T00:22:55.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.219+0000 7f3ea1ffb640 1 -- 172.21.15.78:0/1564997179 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e94003cb0 con 0x7f3ea4102dc0 2024-09-11T00:22:55.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.219+0000 7f3ea1ffb640 1 -- 172.21.15.78:0/1564997179 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94035070 con 0x7f3ea4102dc0 2024-09-11T00:22:55.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.220+0000 7f3eaadf8640 1 -- 172.21.15.78:0/1564997179 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea41a5c40 con 0x7f3ea4102dc0 2024-09-11T00:22:55.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.223+0000 7f3ead1cd740 1 Processor -- start 2024-09-11T00:22:55.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.223+0000 7f3ea1ffb640 1 -- 172.21.15.78:0/1564997179 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f3e9403bbf0 con 0x7f3ea4102dc0 2024-09-11T00:22:55.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.223+0000 7f3ead1cd740 1 -- start start 2024-09-11T00:22:55.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.223+0000 7f3ead1cd740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5587bda43ee0 0x5587bda442c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:55.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.223+0000 7f3ead1cd740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5587bda44800 0x5587bda50250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:55.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.223+0000 7f3ead1cd740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda50790 0x5587bda52b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:55.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.223+0000 7f3ead1cd740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5587bd9bae60 con 0x5587bda50790 2024-09-11T00:22:55.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.223+0000 7f3ead1cd740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5587bd9aa290 con 0x5587bda43ee0 2024-09-11T00:22:55.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.223+0000 7f3ead1cd740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5587bd9ae0a0 con 0x5587bda44800 2024-09-11T00:22:55.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.223+0000 7f3ea3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda50790 0x5587bda52b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:55.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.223+0000 7f3ea3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda50790 0x5587bda52b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47898/0 (socket says 172.21.15.78:47898) 2024-09-11T00:22:55.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.223+0000 7f3ea3fff640 1 -- 172.21.15.78:0/4252096702 learned_addr learned my addr 172.21.15.78:0/4252096702 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:55.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.223+0000 7f3ea9395640 1 --2- 172.21.15.78:0/4252096702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5587bda43ee0 0x5587bda442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:55.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.223+0000 7f3ea8b94640 1 --2- 172.21.15.78:0/4252096702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5587bda44800 0x5587bda50250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:55.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.224+0000 7f3ea3fff640 1 -- 172.21.15.78:0/4252096702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5587bda44800 msgr2=0x5587bda50250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:55.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.224+0000 7f3ea3fff640 1 --2- 172.21.15.78:0/4252096702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5587bda44800 0x5587bda50250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.224+0000 7f3ea3fff640 1 -- 172.21.15.78:0/4252096702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5587bda43ee0 msgr2=0x5587bda442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:55.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.224+0000 7f3ea3fff640 1 --2- 172.21.15.78:0/4252096702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5587bda43ee0 0x5587bda442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.224+0000 7f3ea3fff640 1 -- 172.21.15.78:0/4252096702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587bd708930 con 0x5587bda50790 2024-09-11T00:22:55.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.224+0000 7f3ea3fff640 1 --2- 172.21.15.78:0/4252096702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda50790 0x5587bda52b80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3e9800cc70 tx=0x7f3e9800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a3f31fded0bcb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:55.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.224+0000 7f3ea1ffb640 1 --2- 172.21.15.78:0/1564997179 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3e8c0b5450 0x7f3e8c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:55.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.224+0000 7f3e8affd640 1 -- 172.21.15.78:0/4252096702 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e98014070 con 0x5587bda50790 2024-09-11T00:22:55.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.224+0000 7f3ea9395640 1 --2- 172.21.15.78:0/1564997179 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3e8c0b5450 0x7f3e8c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:55.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.224+0000 7f3e8affd640 1 -- 172.21.15.78:0/4252096702 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e980047a0 con 0x5587bda50790 2024-09-11T00:22:55.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.224+0000 7f3e8affd640 1 -- 172.21.15.78:0/4252096702 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e98010690 con 0x5587bda50790 2024-09-11T00:22:55.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.224+0000 7f3ea1ffb640 1 -- 172.21.15.78:0/1564997179 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f3e94106bf0 con 0x7f3ea4102dc0 2024-09-11T00:22:55.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.225+0000 7f3ead1cd740 1 -- 172.21.15.78:0/4252096702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda50790 msgr2=0x5587bda52b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:55.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.225+0000 7f3ea9395640 1 --2- 172.21.15.78:0/1564997179 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3e8c0b5450 0x7f3e8c0b7910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c009270 tx=0x7f3e9c0095e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:55.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.225+0000 7f3ead1cd740 1 --2- 172.21.15.78:0/4252096702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda50790 0x5587bda52b80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3e9800cc70 tx=0x7f3e9800e720 comp rx=0 tx=0).stop 2024-09-11T00:22:55.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.225+0000 7f3ead1cd740 1 -- 172.21.15.78:0/4252096702 shutdown_connections 2024-09-11T00:22:55.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.225+0000 7f3ead1cd740 1 --2- 172.21.15.78:0/4252096702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda50790 0x5587bda52b80 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.225+0000 7f3ead1cd740 1 --2- 172.21.15.78:0/4252096702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5587bda44800 0x5587bda50250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.225+0000 7f3ead1cd740 1 --2- 172.21.15.78:0/4252096702 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5587bda43ee0 0x5587bda442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.225+0000 7f3ead1cd740 1 -- 172.21.15.78:0/4252096702 >> 172.21.15.78:0/4252096702 conn(0x5587bda41d10 msgr2=0x5587bda42eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:55.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.225+0000 7f3ead1cd740 1 -- 172.21.15.78:0/4252096702 shutdown_connections 2024-09-11T00:22:55.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.225+0000 7f3ead1cd740 1 -- 172.21.15.78:0/4252096702 wait complete. 2024-09-11T00:22:55.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.225+0000 7f3ead1cd740 1 -- start start 2024-09-11T00:22:55.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.225+0000 7f3ead1cd740 1 Processor -- start 2024-09-11T00:22:55.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.226+0000 7f3ead1cd740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda43ee0 0x5587bda4d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:55.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.226+0000 7f3ead1cd740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5587bda44800 0x5587bda4dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:55.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.226+0000 7f3ead1cd740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5587bda50790 0x5587bda4e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:55.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.226+0000 7f3ead1cd740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5587bd80b890 con 0x5587bda43ee0 2024-09-11T00:22:55.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.226+0000 7f3ead1cd740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5587bd944d40 con 0x5587bda50790 2024-09-11T00:22:55.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.226+0000 7f3ead1cd740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5587bda53440 con 0x5587bda44800 2024-09-11T00:22:55.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.226+0000 7f3ead1cd740 10 client.0 _ll_register_callbacks cb 0x5587bd9a8c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:22:55.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.226+0000 7f3ea8b94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda43ee0 0x5587bda4d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:55.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.226+0000 7f3ea8b94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda43ee0 0x5587bda4d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47914/0 (socket says 172.21.15.78:47914) 2024-09-11T00:22:55.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.226+0000 7f3ea8b94640 1 -- 172.21.15.78:0/3166047200 learned_addr learned my addr 172.21.15.78:0/3166047200 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:55.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.226+0000 7f3ea3fff640 1 --2- 172.21.15.78:0/3166047200 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5587bda44800 0x5587bda4dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:55.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.226+0000 7f3ea9395640 1 --2- 172.21.15.78:0/3166047200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5587bda50790 0x5587bda4e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:55.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.226+0000 7f3ea8b94640 1 -- 172.21.15.78:0/3166047200 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5587bda44800 msgr2=0x5587bda4dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:55.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.226+0000 7f3ea8b94640 1 --2- 172.21.15.78:0/3166047200 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5587bda44800 0x5587bda4dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.226+0000 7f3ea8b94640 1 -- 172.21.15.78:0/3166047200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5587bda50790 msgr2=0x5587bda4e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:55.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.226+0000 7f3ea8b94640 1 --2- 172.21.15.78:0/3166047200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5587bda50790 0x5587bda4e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.226+0000 7f3ea8b94640 1 -- 172.21.15.78:0/3166047200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587bda5c7f0 con 0x5587bda43ee0 2024-09-11T00:22:55.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.226+0000 7f3ea8b94640 1 --2- 172.21.15.78:0/3166047200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda43ee0 0x5587bda4d730 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3e94006010 tx=0x7f3e9410a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91be1198e3f4c244 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:55.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.226+0000 7f3e83fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:22:55.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.227+0000 7f3e83fff640 1 -- 172.21.15.78:0/3166047200 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94049030 con 0x5587bda43ee0 2024-09-11T00:22:55.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.227+0000 7f3e83fff640 1 -- 172.21.15.78:0/3166047200 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f3e940cd2f0 con 0x5587bda43ee0 2024-09-11T00:22:55.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.227+0000 7f3ead1cd740 1 -- 172.21.15.78:0/3166047200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e980047a0 con 0x5587bda43ee0 2024-09-11T00:22:55.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.227+0000 7f3e83fff640 1 -- 172.21.15.78:0/3166047200 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3e940b2e60 con 0x5587bda43ee0 2024-09-11T00:22:55.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.227+0000 7f3ead1cd740 10 client.16170 fetch_fsmap learned FSMap version 20 2024-09-11T00:22:55.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.227+0000 7f3ead1cd740 1 -- 172.21.15.78:0/3166047200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5587bda5f1a0 con 0x5587bda43ee0 2024-09-11T00:22:55.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.227+0000 7f3e83fff640 1 -- 172.21.15.78:0/3166047200 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e980047a0 con 0x5587bda43ee0 2024-09-11T00:22:55.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.227+0000 7f3e83fff640 1 -- 172.21.15.78:0/3166047200 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3e940d6190 con 0x5587bda43ee0 2024-09-11T00:22:55.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.227+0000 7f3ead1cd740 10 client.16170 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:22:55.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.227+0000 7f3ead1cd740 10 client.16170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:22:55.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.227+0000 7f3ead1cd740 20 client.16170 populate_metadata read hostname 'smithi078' 2024-09-11T00:22:55.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.227+0000 7f3ead1cd740 1 --2- 172.21.15.78:0/3166047200 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5587bda605b0 0x5587bda629c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:55.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.227+0000 7f3ead1cd740 4 client.16170 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:22:55.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.227+0000 7f3ead1cd740 1 -- 172.21.15.78:0/3166047200 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587bd9bcdb0 con 0x5587bda605b0 2024-09-11T00:22:55.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.227+0000 7f3ea3fff640 1 --2- 172.21.15.78:0/3166047200 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5587bda605b0 0x5587bda629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:55.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.228+0000 7f3ea3fff640 1 --2- 172.21.15.78:0/3166047200 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5587bda605b0 0x5587bda629c0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c06445576c7ae5fb server_cookie=770b41b92be4ae7a in_seq=0 out_seq=0 2024-09-11T00:22:55.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.228+0000 7f3e83fff640 10 client.16170 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:55.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.228+0000 7f3e83fff640 1 -- 172.21.15.78:0/3166047200 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5587bd9bcdb0 con 0x5587bda605b0 2024-09-11T00:22:55.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.228+0000 7f3e83fff640 10 client.16170 handle_command_reply: tid=0 2024-09-11T00:22:55.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.228+0000 7f3ead1cd740 1 client.16170 shutdown 2024-09-11T00:22:55.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.229+0000 7f3ead1cd740 1 -- 172.21.15.78:0/3166047200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda43ee0 msgr2=0x5587bda4d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:55.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.229+0000 7f3ead1cd740 1 --2- 172.21.15.78:0/3166047200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda43ee0 0x5587bda4d730 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3e94006010 tx=0x7f3e9410a330 comp rx=0 tx=0).stop 2024-09-11T00:22:55.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.229+0000 7f3ead1cd740 1 -- 172.21.15.78:0/3166047200 shutdown_connections 2024-09-11T00:22:55.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.229+0000 7f3ead1cd740 1 --2- 172.21.15.78:0/3166047200 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5587bda605b0 0x5587bda629c0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.229+0000 7f3ead1cd740 1 --2- 172.21.15.78:0/3166047200 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5587bda50790 0x5587bda4e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.229+0000 7f3ead1cd740 1 --2- 172.21.15.78:0/3166047200 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5587bda44800 0x5587bda4dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.229+0000 7f3ead1cd740 1 --2- 172.21.15.78:0/3166047200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda43ee0 0x5587bda4d730 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.229+0000 7f3e83fff640 0 client.16170 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:55.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.229+0000 7f3ead1cd740 1 -- 172.21.15.78:0/3166047200 >> 172.21.15.78:0/3166047200 conn(0x5587bda41d10 msgr2=0x5587bda40f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:55.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.229+0000 7f3ead1cd740 1 -- 172.21.15.78:0/3166047200 shutdown_connections 2024-09-11T00:22:55.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.229+0000 7f3ead1cd740 1 -- 172.21.15.78:0/3166047200 wait complete. 2024-09-11T00:22:55.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.229+0000 7f3ead1cd740 20 client.16170 trim_cache size 0 max 16384 2024-09-11T00:22:55.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.246+0000 7f3ead1cd740 1 Processor -- start 2024-09-11T00:22:55.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.246+0000 7f3ead1cd740 1 -- start start 2024-09-11T00:22:55.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.247+0000 7f3ead1cd740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda43ee0 0x5587bda58ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:55.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.247+0000 7f3ead1cd740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5587bda44800 0x5587bda58ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:55.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.247+0000 7f3ead1cd740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5587bda50790 0x5587bda4a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:55.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.247+0000 7f3ead1cd740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea41ac630 con 0x5587bda43ee0 2024-09-11T00:22:55.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.247+0000 7f3ead1cd740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea41aeeb0 con 0x5587bda50790 2024-09-11T00:22:55.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.247+0000 7f3ead1cd740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea41acca0 con 0x5587bda44800 2024-09-11T00:22:55.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.247+0000 7f3ea8b94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda43ee0 0x5587bda58ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:55.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.247+0000 7f3ea8b94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda43ee0 0x5587bda58ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47930/0 (socket says 172.21.15.78:47930) 2024-09-11T00:22:55.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.247+0000 7f3ea8b94640 1 -- 172.21.15.78:0/2725210543 learned_addr learned my addr 172.21.15.78:0/2725210543 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:55.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.247+0000 7f3ea9395640 1 --2- 172.21.15.78:0/2725210543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5587bda50790 0x5587bda4a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:55.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.247+0000 7f3ea8b94640 1 -- 172.21.15.78:0/2725210543 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5587bda44800 msgr2=0x5587bda58ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:55.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.247+0000 7f3ea8b94640 1 --2- 172.21.15.78:0/2725210543 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5587bda44800 0x5587bda58ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.247+0000 7f3ea8b94640 1 -- 172.21.15.78:0/2725210543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5587bda50790 msgr2=0x5587bda4a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:55.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.247+0000 7f3ea8b94640 1 --2- 172.21.15.78:0/2725210543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5587bda50790 0x5587bda4a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.247+0000 7f3ea8b94640 1 -- 172.21.15.78:0/2725210543 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587bda438c0 con 0x5587bda43ee0 2024-09-11T00:22:55.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.247+0000 7f3ea9395640 1 --2- 172.21.15.78:0/2725210543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5587bda50790 0x5587bda4a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:22:55.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.247+0000 7f3ea8b94640 1 --2- 172.21.15.78:0/2725210543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda43ee0 0x5587bda58ab0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3e940ccd90 tx=0x7f3e9402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f11691de3d52b61 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:55.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.247+0000 7f3e8a7fc640 1 -- 172.21.15.78:0/2725210543 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94049070 con 0x5587bda43ee0 2024-09-11T00:22:55.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.247+0000 7f3e8a7fc640 1 -- 172.21.15.78:0/2725210543 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e940cd790 con 0x5587bda43ee0 2024-09-11T00:22:55.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.247+0000 7f3e8a7fc640 1 -- 172.21.15.78:0/2725210543 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e940cd090 con 0x5587bda43ee0 2024-09-11T00:22:55.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.248+0000 7f3ead1cd740 1 -- 172.21.15.78:0/2725210543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda43ee0 msgr2=0x5587bda58ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:55.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.248+0000 7f3ead1cd740 1 --2- 172.21.15.78:0/2725210543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda43ee0 0x5587bda58ab0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3e940ccd90 tx=0x7f3e9402a410 comp rx=0 tx=0).stop 2024-09-11T00:22:55.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.248+0000 7f3ead1cd740 1 -- 172.21.15.78:0/2725210543 shutdown_connections 2024-09-11T00:22:55.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.248+0000 7f3ead1cd740 1 --2- 172.21.15.78:0/2725210543 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5587bda50790 0x5587bda4a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.248+0000 7f3ead1cd740 1 --2- 172.21.15.78:0/2725210543 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5587bda44800 0x5587bda58ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.248+0000 7f3ead1cd740 1 --2- 172.21.15.78:0/2725210543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda43ee0 0x5587bda58ab0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.248+0000 7f3ead1cd740 1 -- 172.21.15.78:0/2725210543 >> 172.21.15.78:0/2725210543 conn(0x5587bda41d10 msgr2=0x5587bda4bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:55.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.248+0000 7f3ead1cd740 1 -- 172.21.15.78:0/2725210543 shutdown_connections 2024-09-11T00:22:55.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.248+0000 7f3ead1cd740 1 -- 172.21.15.78:0/2725210543 wait complete. 2024-09-11T00:22:55.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.248+0000 7f3ead1cd740 1 -- start start 2024-09-11T00:22:55.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.248+0000 7f3ead1cd740 1 Processor -- start 2024-09-11T00:22:55.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.249+0000 7f3ead1cd740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5587bda43ee0 0x5587bdac5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:55.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.249+0000 7f3ead1cd740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5587bda44800 0x5587bdac5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:55.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.249+0000 7f3ead1cd740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda50790 0x5587bdac8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:55.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.249+0000 7f3ead1cd740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea41ad370 con 0x5587bda50790 2024-09-11T00:22:55.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.249+0000 7f3ead1cd740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea41ae7e0 con 0x5587bda44800 2024-09-11T00:22:55.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.249+0000 7f3ead1cd740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea41ada40 con 0x5587bda43ee0 2024-09-11T00:22:55.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.249+0000 7f3ead1cd740 10 client.0 _ll_register_callbacks cb 0x7f3e9403bf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:22:55.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.249+0000 7f3ea9395640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda50790 0x5587bdac8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:55.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.249+0000 7f3ea9395640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda50790 0x5587bdac8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47936/0 (socket says 172.21.15.78:47936) 2024-09-11T00:22:55.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.249+0000 7f3ea9395640 1 -- 172.21.15.78:0/2218254459 learned_addr learned my addr 172.21.15.78:0/2218254459 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:55.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.249+0000 7f3ea8b94640 1 --2- 172.21.15.78:0/2218254459 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5587bda43ee0 0x5587bdac5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:55.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.249+0000 7f3ea3fff640 1 --2- 172.21.15.78:0/2218254459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5587bda44800 0x5587bdac5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:55.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.249+0000 7f3ea9395640 1 -- 172.21.15.78:0/2218254459 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5587bda43ee0 msgr2=0x5587bdac5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:55.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.249+0000 7f3ea9395640 1 --2- 172.21.15.78:0/2218254459 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5587bda43ee0 0x5587bdac5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.249+0000 7f3ea9395640 1 -- 172.21.15.78:0/2218254459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5587bda44800 msgr2=0x5587bdac5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:55.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.249+0000 7f3ea9395640 1 --2- 172.21.15.78:0/2218254459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5587bda44800 0x5587bdac5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.249+0000 7f3ea9395640 1 -- 172.21.15.78:0/2218254459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587bdac8d50 con 0x5587bda50790 2024-09-11T00:22:55.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.249+0000 7f3ea3fff640 1 --2- 172.21.15.78:0/2218254459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5587bda44800 0x5587bdac5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:22:55.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.249+0000 7f3ea8b94640 1 --2- 172.21.15.78:0/2218254459 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5587bda43ee0 0x5587bdac5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:22:55.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.249+0000 7f3ea9395640 1 --2- 172.21.15.78:0/2218254459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda50790 0x5587bdac8610 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c0129e0 tx=0x7f3e9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1f279f464883a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:55.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.249+0000 7f3e83fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:22:55.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.250+0000 7f3e83fff640 1 -- 172.21.15.78:0/2218254459 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c020c00 con 0x5587bda50790 2024-09-11T00:22:55.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.250+0000 7f3e83fff640 1 -- 172.21.15.78:0/2218254459 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f3e9c020da0 con 0x5587bda50790 2024-09-11T00:22:55.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.250+0000 7f3ead1cd740 1 -- 172.21.15.78:0/2218254459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e940cd790 con 0x5587bda50790 2024-09-11T00:22:55.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.250+0000 7f3e83fff640 1 -- 172.21.15.78:0/2218254459 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3e9c003970 con 0x5587bda50790 2024-09-11T00:22:55.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.250+0000 7f3ead1cd740 10 client.16176 fetch_fsmap learned FSMap version 20 2024-09-11T00:22:55.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.250+0000 7f3ead1cd740 1 -- 172.21.15.78:0/2218254459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5587bdad2450 con 0x5587bda50790 2024-09-11T00:22:55.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.250+0000 7f3e83fff640 1 -- 172.21.15.78:0/2218254459 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e940cd790 con 0x5587bda50790 2024-09-11T00:22:55.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.250+0000 7f3e83fff640 1 -- 172.21.15.78:0/2218254459 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3e9c030020 con 0x5587bda50790 2024-09-11T00:22:55.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.250+0000 7f3ead1cd740 10 client.16176 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:22:55.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.250+0000 7f3ead1cd740 10 client.16176 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:22:55.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.250+0000 7f3ead1cd740 20 client.16176 populate_metadata read hostname 'smithi078' 2024-09-11T00:22:55.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.250+0000 7f3ead1cd740 1 --2- 172.21.15.78:0/2218254459 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5587bdad2c20 0x5587bdad5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:55.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.250+0000 7f3ead1cd740 4 client.16176 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:22:55.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.250+0000 7f3ead1cd740 1 -- 172.21.15.78:0/2218254459 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5587bd9b8860 con 0x5587bdad2c20 2024-09-11T00:22:55.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.251+0000 7f3ea8b94640 1 --2- 172.21.15.78:0/2218254459 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5587bdad2c20 0x5587bdad5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:55.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.251+0000 7f3ea8b94640 1 --2- 172.21.15.78:0/2218254459 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5587bdad2c20 0x5587bdad5040 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cbdfcdc07511152 server_cookie=900c4c7deeb4f5b9 in_seq=0 out_seq=0 2024-09-11T00:22:55.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.251+0000 7f3e83fff640 10 client.16176 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:55.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.253+0000 7f3e83fff640 1 -- 172.21.15.78:0/2218254459 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5587bd9b8860 con 0x5587bdad2c20 2024-09-11T00:22:55.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.253+0000 7f3e83fff640 10 client.16176 handle_command_reply: tid=0 2024-09-11T00:22:55.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.253+0000 7f3ead1cd740 1 client.16176 shutdown 2024-09-11T00:22:55.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.253+0000 7f3ead1cd740 1 -- 172.21.15.78:0/2218254459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda50790 msgr2=0x5587bdac8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:55.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.253+0000 7f3ead1cd740 1 --2- 172.21.15.78:0/2218254459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda50790 0x5587bdac8610 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c0129e0 tx=0x7f3e9c004a40 comp rx=0 tx=0).stop 2024-09-11T00:22:55.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.253+0000 7f3ead1cd740 1 -- 172.21.15.78:0/2218254459 shutdown_connections 2024-09-11T00:22:55.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.253+0000 7f3ead1cd740 1 --2- 172.21.15.78:0/2218254459 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5587bdad2c20 0x5587bdad5040 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.253+0000 7f3ead1cd740 1 --2- 172.21.15.78:0/2218254459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5587bda50790 0x5587bdac8610 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.253+0000 7f3e83fff640 0 client.16176 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:55.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.253+0000 7f3ead1cd740 1 --2- 172.21.15.78:0/2218254459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5587bda44800 0x5587bdac5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.253+0000 7f3ead1cd740 1 --2- 172.21.15.78:0/2218254459 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5587bda43ee0 0x5587bdac5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.253+0000 7f3ead1cd740 1 -- 172.21.15.78:0/2218254459 >> 172.21.15.78:0/2218254459 conn(0x5587bda41d10 msgr2=0x5587bda4ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:55.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.253+0000 7f3ead1cd740 1 -- 172.21.15.78:0/2218254459 shutdown_connections 2024-09-11T00:22:55.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.253+0000 7f3ead1cd740 1 -- 172.21.15.78:0/2218254459 wait complete. 2024-09-11T00:22:55.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.253+0000 7f3ead1cd740 20 client.16176 trim_cache size 0 max 16384 2024-09-11T00:22:55.262 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:22:55.262 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-11T00:22:55.262 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "f494d5ed-e0dc-44bb-8aba-a861b3e751f4", 2024-09-11T00:22:55.262 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-11T00:22:55.262 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:22:55.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.254+0000 7f3eaadf8640 1 -- 172.21.15.78:0/1564997179 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3e8c0b5450 msgr2=0x7f3e8c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:55.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.254+0000 7f3eaadf8640 1 --2- 172.21.15.78:0/1564997179 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3e8c0b5450 0x7f3e8c0b7910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c009270 tx=0x7f3e9c0095e0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.254+0000 7f3eaadf8640 1 -- 172.21.15.78:0/1564997179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea4102dc0 msgr2=0x7f3ea41991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:55.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.254+0000 7f3eaadf8640 1 --2- 172.21.15.78:0/1564997179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea4102dc0 0x7f3ea41991e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3e94005940 tx=0x7f3e940042f0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.254+0000 7f3eaadf8640 1 -- 172.21.15.78:0/1564997179 shutdown_connections 2024-09-11T00:22:55.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.254+0000 7f3eaadf8640 1 --2- 172.21.15.78:0/1564997179 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3e8c0b5450 0x7f3e8c0b7910 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.254+0000 7f3eaadf8640 1 --2- 172.21.15.78:0/1564997179 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ea4109150 0x7f3ea419eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.254+0000 7f3eaadf8640 1 --2- 172.21.15.78:0/1564997179 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ea41087d0 0x7f3ea4199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.254+0000 7f3eaadf8640 1 --2- 172.21.15.78:0/1564997179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea4102dc0 0x7f3ea41991e0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:55.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.254+0000 7f3eaadf8640 1 -- 172.21.15.78:0/1564997179 >> 172.21.15.78:0/1564997179 conn(0x7f3ea40fe830 msgr2=0x7f3ea4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:55.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.254+0000 7f3eaadf8640 1 -- 172.21.15.78:0/1564997179 shutdown_connections 2024-09-11T00:22:55.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:55.254+0000 7f3eaadf8640 1 -- 172.21.15.78:0/1564997179 wait complete. 2024-09-11T00:22:55.564 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:55 smithi078 ceph-mon[30865]: scrub queued for path: / 2024-09-11T00:22:55.564 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:55 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:22:55.564 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:55 smithi078 ceph-mon[30865]: scrub summary: active paths [/] 2024-09-11T00:22:55.564 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:55 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:22:55.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:55 smithi112 ceph-mon[35627]: scrub queued for path: / 2024-09-11T00:22:55.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:55 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:22:55.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:55 smithi112 ceph-mon[35627]: scrub summary: active paths [/] 2024-09-11T00:22:55.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:55 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:22:55.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:55 smithi138 ceph-mon[35019]: scrub queued for path: / 2024-09-11T00:22:55.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:55 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:22:55.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:55 smithi138 ceph-mon[35019]: scrub summary: active paths [/] 2024-09-11T00:22:55.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:55 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:22:55.931 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:22:56.178 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:22:56.583 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:56 smithi078 ceph-mon[30865]: pgmap v517: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-11T00:22:56.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:56 smithi078 ceph-mon[30865]: scrub summary: idle 2024-09-11T00:22:56.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:56 smithi112 ceph-mon[35627]: pgmap v517: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-11T00:22:56.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:56 smithi112 ceph-mon[35627]: scrub summary: idle 2024-09-11T00:22:56.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.715+0000 7ff74d629640 1 -- 172.21.15.78:0/748116495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7481087d0 msgr2=0x7ff748108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:56.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.715+0000 7ff74d629640 1 --2- 172.21.15.78:0/748116495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7481087d0 0x7ff748108c10 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff738009900 tx=0x7ff73802a410 comp rx=0 tx=0).stop 2024-09-11T00:22:56.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.715+0000 7ff74d629640 1 -- 172.21.15.78:0/748116495 shutdown_connections 2024-09-11T00:22:56.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.715+0000 7ff74d629640 1 --2- 172.21.15.78:0/748116495 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff748109150 0x7ff74810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.715+0000 7ff74d629640 1 --2- 172.21.15.78:0/748116495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7481087d0 0x7ff748108c10 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.715+0000 7ff74d629640 1 --2- 172.21.15.78:0/748116495 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff748102dc0 0x7ff7481031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.715+0000 7ff74d629640 1 -- 172.21.15.78:0/748116495 >> 172.21.15.78:0/748116495 conn(0x7ff7480fe830 msgr2=0x7ff748100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:56.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.715+0000 7ff74d629640 1 -- 172.21.15.78:0/748116495 shutdown_connections 2024-09-11T00:22:56.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.715+0000 7ff74d629640 1 -- 172.21.15.78:0/748116495 wait complete. 2024-09-11T00:22:56.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.716+0000 7ff74d629640 1 Processor -- start 2024-09-11T00:22:56.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.716+0000 7ff74d629640 1 -- start start 2024-09-11T00:22:56.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.716+0000 7ff74d629640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff748102dc0 0x7ff748199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:56.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.716+0000 7ff74d629640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7481087d0 0x7ff748199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:56.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.716+0000 7ff74d629640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff748109150 0x7ff74819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:56.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.716+0000 7ff74d629640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff748112e10 con 0x7ff7481087d0 2024-09-11T00:22:56.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.716+0000 7ff74d629640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff748112c90 con 0x7ff748102dc0 2024-09-11T00:22:56.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.716+0000 7ff74d629640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff748112f90 con 0x7ff748109150 2024-09-11T00:22:56.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.716+0000 7ff7467fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7481087d0 0x7ff748199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:56.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.716+0000 7ff7467fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7481087d0 0x7ff748199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47966/0 (socket says 172.21.15.78:47966) 2024-09-11T00:22:56.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.716+0000 7ff7467fc640 1 -- 172.21.15.78:0/1428977410 learned_addr learned my addr 172.21.15.78:0/1428977410 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:56.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.716+0000 7ff7477fe640 1 --2- 172.21.15.78:0/1428977410 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff748109150 0x7ff74819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:56.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.717+0000 7ff746ffd640 1 --2- 172.21.15.78:0/1428977410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff748102dc0 0x7ff748199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:56.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.717+0000 7ff7467fc640 1 -- 172.21.15.78:0/1428977410 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff748109150 msgr2=0x7ff74819ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:56.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.717+0000 7ff7467fc640 1 --2- 172.21.15.78:0/1428977410 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff748109150 0x7ff74819ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.717+0000 7ff7467fc640 1 -- 172.21.15.78:0/1428977410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff748102dc0 msgr2=0x7ff748199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:56.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.717+0000 7ff7467fc640 1 --2- 172.21.15.78:0/1428977410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff748102dc0 0x7ff748199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.717+0000 7ff7467fc640 1 -- 172.21.15.78:0/1428977410 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74819f3b0 con 0x7ff7481087d0 2024-09-11T00:22:56.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.717+0000 7ff746ffd640 1 --2- 172.21.15.78:0/1428977410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff748102dc0 0x7ff748199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:22:56.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.717+0000 7ff7467fc640 1 --2- 172.21.15.78:0/1428977410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7481087d0 0x7ff748199840 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff738006010 tx=0x7ff7380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:56.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.717+0000 7ff72ffff640 1 -- 172.21.15.78:0/1428977410 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73803f030 con 0x7ff7481087d0 2024-09-11T00:22:56.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.717+0000 7ff74d629640 1 -- 172.21.15.78:0/1428977410 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff74819f640 con 0x7ff7481087d0 2024-09-11T00:22:56.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.717+0000 7ff72ffff640 1 -- 172.21.15.78:0/1428977410 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff738003800 con 0x7ff7481087d0 2024-09-11T00:22:56.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.717+0000 7ff72ffff640 1 -- 172.21.15.78:0/1428977410 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738035070 con 0x7ff7481087d0 2024-09-11T00:22:56.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.717+0000 7ff74d629640 1 -- 172.21.15.78:0/1428977410 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7481a5d60 con 0x7ff7481087d0 2024-09-11T00:22:56.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.719+0000 7ff72ffff640 1 -- 172.21.15.78:0/1428977410 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7ff738031b10 con 0x7ff7481087d0 2024-09-11T00:22:56.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.719+0000 7ff74f9fe740 1 Processor -- start 2024-09-11T00:22:56.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.719+0000 7ff74f9fe740 1 -- start start 2024-09-11T00:22:56.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff74f9fe740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da1b3de480 0x55da1b3de860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:56.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff74f9fe740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3deda0 0x55da1b3ea7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:56.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff74f9fe740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da1b3ead30 0x55da1b3ed120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:56.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff74f9fe740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55da1b354e50 con 0x55da1b3deda0 2024-09-11T00:22:56.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff74f9fe740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55da1b344280 con 0x55da1b3de480 2024-09-11T00:22:56.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff74f9fe740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55da1b348090 con 0x55da1b3ead30 2024-09-11T00:22:56.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff746ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3deda0 0x55da1b3ea7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:56.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff7477fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da1b3de480 0x55da1b3de860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:56.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff746ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3deda0 0x55da1b3ea7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47974/0 (socket says 172.21.15.78:47974) 2024-09-11T00:22:56.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff746ffd640 1 -- 172.21.15.78:0/1631772335 learned_addr learned my addr 172.21.15.78:0/1631772335 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:56.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff7467fc640 1 --2- 172.21.15.78:0/1631772335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da1b3ead30 0x55da1b3ed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:56.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff746ffd640 1 -- 172.21.15.78:0/1631772335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da1b3ead30 msgr2=0x55da1b3ed120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:56.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff746ffd640 1 --2- 172.21.15.78:0/1631772335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da1b3ead30 0x55da1b3ed120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff746ffd640 1 -- 172.21.15.78:0/1631772335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da1b3de480 msgr2=0x55da1b3de860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:56.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff746ffd640 1 --2- 172.21.15.78:0/1631772335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da1b3de480 0x55da1b3de860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff746ffd640 1 -- 172.21.15.78:0/1631772335 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da1b0a2650 con 0x55da1b3deda0 2024-09-11T00:22:56.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff746ffd640 1 --2- 172.21.15.78:0/1631772335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3deda0 0x55da1b3ea7f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00aa10 tx=0x7ff73c00aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560562949f01db42 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:56.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff72ffff640 1 --2- 172.21.15.78:0/1428977410 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff7300b5450 0x7ff7300b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:56.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff7477fe640 1 --2- 172.21.15.78:0/1428977410 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff7300b5450 0x7ff7300b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:56.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff72d7fa640 1 -- 172.21.15.78:0/1631772335 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c015070 con 0x55da1b3deda0 2024-09-11T00:22:56.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff72d7fa640 1 -- 172.21.15.78:0/1631772335 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff73c00cc60 con 0x55da1b3deda0 2024-09-11T00:22:56.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff72ffff640 1 -- 172.21.15.78:0/1428977410 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7ff7381069c0 con 0x7ff7481087d0 2024-09-11T00:22:56.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.720+0000 7ff72d7fa640 1 -- 172.21.15.78:0/1631772335 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c0185c0 con 0x55da1b3deda0 2024-09-11T00:22:56.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.721+0000 7ff74f9fe740 1 -- 172.21.15.78:0/1631772335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3deda0 msgr2=0x55da1b3ea7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:56.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.721+0000 7ff7477fe640 1 --2- 172.21.15.78:0/1428977410 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff7300b5450 0x7ff7300b7910 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff740008e40 tx=0x7ff7400085f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:56.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.721+0000 7ff74f9fe740 1 --2- 172.21.15.78:0/1631772335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3deda0 0x55da1b3ea7f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00aa10 tx=0x7ff73c00aed0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.721+0000 7ff74f9fe740 1 -- 172.21.15.78:0/1631772335 shutdown_connections 2024-09-11T00:22:56.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.721+0000 7ff74f9fe740 1 --2- 172.21.15.78:0/1631772335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da1b3ead30 0x55da1b3ed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.721+0000 7ff74f9fe740 1 --2- 172.21.15.78:0/1631772335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3deda0 0x55da1b3ea7f0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.721+0000 7ff74f9fe740 1 --2- 172.21.15.78:0/1631772335 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da1b3de480 0x55da1b3de860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.721+0000 7ff74f9fe740 1 -- 172.21.15.78:0/1631772335 >> 172.21.15.78:0/1631772335 conn(0x55da1b3dc2b0 msgr2=0x55da1b3dd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:56.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.721+0000 7ff74f9fe740 1 -- 172.21.15.78:0/1631772335 shutdown_connections 2024-09-11T00:22:56.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.721+0000 7ff74f9fe740 1 -- 172.21.15.78:0/1631772335 wait complete. 2024-09-11T00:22:56.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.722+0000 7ff74f9fe740 1 -- start start 2024-09-11T00:22:56.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.722+0000 7ff74f9fe740 1 Processor -- start 2024-09-11T00:22:56.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.722+0000 7ff74f9fe740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da1b3de480 0x55da1b3ea610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:56.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.722+0000 7ff74f9fe740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3deda0 0x55da1b3e7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:56.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.722+0000 7ff74f9fe740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da1b3ead30 0x55da1b3e8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:56.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.722+0000 7ff74f9fe740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55da1b1a5700 con 0x55da1b3deda0 2024-09-11T00:22:56.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.722+0000 7ff74f9fe740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55da1b2df110 con 0x55da1b3ead30 2024-09-11T00:22:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.722+0000 7ff74f9fe740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55da1b3ed9b0 con 0x55da1b3de480 2024-09-11T00:22:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.722+0000 7ff74f9fe740 10 client.0 _ll_register_callbacks cb 0x55da1b2f8990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:22:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.722+0000 7ff7467fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3deda0 0x55da1b3e7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.722+0000 7ff7467fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3deda0 0x55da1b3e7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47986/0 (socket says 172.21.15.78:47986) 2024-09-11T00:22:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.722+0000 7ff7467fc640 1 -- 172.21.15.78:0/1293938067 learned_addr learned my addr 172.21.15.78:0/1293938067 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.722+0000 7ff7467fc640 1 -- 172.21.15.78:0/1293938067 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da1b3de480 msgr2=0x55da1b3ea610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.722+0000 7ff7467fc640 1 --2- 172.21.15.78:0/1293938067 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da1b3de480 0x55da1b3ea610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.722+0000 7ff7467fc640 1 -- 172.21.15.78:0/1293938067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da1b3ead30 msgr2=0x55da1b3e8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.722+0000 7ff7467fc640 1 --2- 172.21.15.78:0/1293938067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da1b3ead30 0x55da1b3e8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.722+0000 7ff7467fc640 1 -- 172.21.15.78:0/1293938067 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da1b30cc40 con 0x55da1b3deda0 2024-09-11T00:22:56.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.722+0000 7ff7467fc640 1 --2- 172.21.15.78:0/1293938067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3deda0 0x55da1b3e7a60 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff7380ccb60 tx=0x7ff738031ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd55f7c938a992be server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.722+0000 7ff72aff5640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:22:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.722+0000 7ff72aff5640 1 -- 172.21.15.78:0/1293938067 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738049070 con 0x55da1b3deda0 2024-09-11T00:22:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.723+0000 7ff72aff5640 1 -- 172.21.15.78:0/1293938067 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7ff7380c90d0 con 0x55da1b3deda0 2024-09-11T00:22:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.723+0000 7ff74f9fe740 1 -- 172.21.15.78:0/1293938067 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff73c00cc60 con 0x55da1b3deda0 2024-09-11T00:22:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.723+0000 7ff72aff5640 1 -- 172.21.15.78:0/1293938067 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff7380cc7b0 con 0x55da1b3deda0 2024-09-11T00:22:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.723+0000 7ff74f9fe740 10 client.16188 fetch_fsmap learned FSMap version 20 2024-09-11T00:22:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.723+0000 7ff74f9fe740 1 -- 172.21.15.78:0/1293938067 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55da1b3f92d0 con 0x55da1b3deda0 2024-09-11T00:22:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.723+0000 7ff72aff5640 1 -- 172.21.15.78:0/1293938067 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff73c00cc60 con 0x55da1b3deda0 2024-09-11T00:22:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.723+0000 7ff72aff5640 1 -- 172.21.15.78:0/1293938067 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff7380b40b0 con 0x55da1b3deda0 2024-09-11T00:22:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.723+0000 7ff74f9fe740 10 client.16188 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:22:56.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.723+0000 7ff74f9fe740 10 client.16188 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:22:56.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.723+0000 7ff74f9fe740 20 client.16188 populate_metadata read hostname 'smithi078' 2024-09-11T00:22:56.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.723+0000 7ff74f9fe740 1 --2- 172.21.15.78:0/1293938067 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55da1b3fa730 0x55da1b3fcba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:56.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.723+0000 7ff74f9fe740 4 client.16188 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:22:56.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.723+0000 7ff74f9fe740 1 -- 172.21.15.78:0/1293938067 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da1b356da0 con 0x55da1b3fa730 2024-09-11T00:22:56.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.723+0000 7ff746ffd640 1 --2- 172.21.15.78:0/1293938067 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55da1b3fa730 0x55da1b3fcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:56.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.724+0000 7ff72aff5640 10 client.16188 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:56.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.724+0000 7ff746ffd640 1 --2- 172.21.15.78:0/1293938067 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55da1b3fa730 0x55da1b3fcba0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7362a95c573108d7 server_cookie=b3e49411f7dbcf9 in_seq=0 out_seq=0 2024-09-11T00:22:56.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.725+0000 7ff72aff5640 1 -- 172.21.15.78:0/1293938067 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55da1b356da0 con 0x55da1b3fa730 2024-09-11T00:22:56.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.725+0000 7ff72aff5640 10 client.16188 handle_command_reply: tid=0 2024-09-11T00:22:56.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.725+0000 7ff74f9fe740 1 client.16188 shutdown 2024-09-11T00:22:56.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.725+0000 7ff74f9fe740 1 -- 172.21.15.78:0/1293938067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3deda0 msgr2=0x55da1b3e7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.725+0000 7ff74f9fe740 1 --2- 172.21.15.78:0/1293938067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3deda0 0x55da1b3e7a60 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff7380ccb60 tx=0x7ff738031ef0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.725+0000 7ff74f9fe740 1 -- 172.21.15.78:0/1293938067 shutdown_connections 2024-09-11T00:22:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.725+0000 7ff74f9fe740 1 --2- 172.21.15.78:0/1293938067 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55da1b3fa730 0x55da1b3fcba0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.725+0000 7ff74f9fe740 1 --2- 172.21.15.78:0/1293938067 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da1b3ead30 0x55da1b3e8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.725+0000 7ff72aff5640 0 client.16188 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.725+0000 7ff74f9fe740 1 --2- 172.21.15.78:0/1293938067 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3deda0 0x55da1b3e7a60 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.725+0000 7ff74f9fe740 1 --2- 172.21.15.78:0/1293938067 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da1b3de480 0x55da1b3ea610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.725+0000 7ff74f9fe740 1 -- 172.21.15.78:0/1293938067 >> 172.21.15.78:0/1293938067 conn(0x55da1b3dc2b0 msgr2=0x55da1b3e1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.725+0000 7ff74f9fe740 1 -- 172.21.15.78:0/1293938067 shutdown_connections 2024-09-11T00:22:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.725+0000 7ff74f9fe740 1 -- 172.21.15.78:0/1293938067 wait complete. 2024-09-11T00:22:56.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.725+0000 7ff74f9fe740 20 client.16188 trim_cache size 0 max 16384 2024-09-11T00:22:56.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.742+0000 7ff74f9fe740 1 Processor -- start 2024-09-11T00:22:56.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.742+0000 7ff74f9fe740 1 -- start start 2024-09-11T00:22:56.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.743+0000 7ff74f9fe740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da1b3de480 0x55da1b3f6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:56.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.743+0000 7ff74f9fe740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da1b3deda0 0x55da1b3e97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:56.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.743+0000 7ff74f9fe740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3ead30 0x55da1b3e4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:56.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.743+0000 7ff74f9fe740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff7481ac730 con 0x55da1b3ead30 2024-09-11T00:22:56.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.743+0000 7ff74f9fe740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff7481aefb0 con 0x55da1b3deda0 2024-09-11T00:22:56.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.743+0000 7ff74f9fe740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff7481acda0 con 0x55da1b3de480 2024-09-11T00:22:56.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.743+0000 7ff7477fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3ead30 0x55da1b3e4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:56.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.743+0000 7ff7477fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3ead30 0x55da1b3e4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47996/0 (socket says 172.21.15.78:47996) 2024-09-11T00:22:56.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.743+0000 7ff7477fe640 1 -- 172.21.15.78:0/987628321 learned_addr learned my addr 172.21.15.78:0/987628321 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:56.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.743+0000 7ff7467fc640 1 --2- 172.21.15.78:0/987628321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da1b3deda0 0x55da1b3e97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:56.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.743+0000 7ff746ffd640 1 --2- 172.21.15.78:0/987628321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da1b3de480 0x55da1b3f6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:56.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.743+0000 7ff7477fe640 1 -- 172.21.15.78:0/987628321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da1b3de480 msgr2=0x55da1b3f6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:56.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.743+0000 7ff7477fe640 1 --2- 172.21.15.78:0/987628321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da1b3de480 0x55da1b3f6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.743+0000 7ff7477fe640 1 -- 172.21.15.78:0/987628321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da1b3deda0 msgr2=0x55da1b3e97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:56.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.743+0000 7ff7477fe640 1 --2- 172.21.15.78:0/987628321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da1b3deda0 0x55da1b3e97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.743+0000 7ff7477fe640 1 -- 172.21.15.78:0/987628321 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da1b3dcd30 con 0x55da1b3ead30 2024-09-11T00:22:56.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.743+0000 7ff7477fe640 1 --2- 172.21.15.78:0/987628321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3ead30 0x55da1b3e4c70 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff74000e570 tx=0x7ff740013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a6990cb279e6742 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:56.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.743+0000 7ff72cff9640 1 -- 172.21.15.78:0/987628321 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74000ee60 con 0x55da1b3ead30 2024-09-11T00:22:56.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.744+0000 7ff72cff9640 1 -- 172.21.15.78:0/987628321 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff740026930 con 0x55da1b3ead30 2024-09-11T00:22:56.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.744+0000 7ff72cff9640 1 -- 172.21.15.78:0/987628321 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74001da30 con 0x55da1b3ead30 2024-09-11T00:22:56.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.744+0000 7ff74f9fe740 1 -- 172.21.15.78:0/987628321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3ead30 msgr2=0x55da1b3e4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.744+0000 7ff74f9fe740 1 --2- 172.21.15.78:0/987628321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3ead30 0x55da1b3e4c70 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff74000e570 tx=0x7ff740013040 comp rx=0 tx=0).stop 2024-09-11T00:22:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.744+0000 7ff74f9fe740 1 -- 172.21.15.78:0/987628321 shutdown_connections 2024-09-11T00:22:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.744+0000 7ff74f9fe740 1 --2- 172.21.15.78:0/987628321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3ead30 0x55da1b3e4c70 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.744+0000 7ff74f9fe740 1 --2- 172.21.15.78:0/987628321 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da1b3deda0 0x55da1b3e97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.744+0000 7ff74f9fe740 1 --2- 172.21.15.78:0/987628321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da1b3de480 0x55da1b3f6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.744+0000 7ff74f9fe740 1 -- 172.21.15.78:0/987628321 >> 172.21.15.78:0/987628321 conn(0x55da1b3dc2b0 msgr2=0x55da1b3e9090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.744+0000 7ff74f9fe740 1 -- 172.21.15.78:0/987628321 shutdown_connections 2024-09-11T00:22:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.744+0000 7ff74f9fe740 1 -- 172.21.15.78:0/987628321 wait complete. 2024-09-11T00:22:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.744+0000 7ff74f9fe740 1 -- start start 2024-09-11T00:22:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.745+0000 7ff74f9fe740 1 Processor -- start 2024-09-11T00:22:56.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.745+0000 7ff74f9fe740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da1b3de480 0x55da1b3ef7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:56.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.745+0000 7ff74f9fe740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3deda0 0x55da1b3efd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:56.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.745+0000 7ff74f9fe740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da1b3ead30 0x55da1b4607a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:56.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.745+0000 7ff74f9fe740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff7481ad470 con 0x55da1b3deda0 2024-09-11T00:22:56.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.745+0000 7ff7467fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3deda0 0x55da1b3efd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:56.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.745+0000 7ff74f9fe740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff7481ae8e0 con 0x55da1b3de480 2024-09-11T00:22:56.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.745+0000 7ff74f9fe740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff7481adb40 con 0x55da1b3ead30 2024-09-11T00:22:56.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.745+0000 7ff746ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da1b3de480 0x55da1b3ef7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:56.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.745+0000 7ff7467fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3deda0 0x55da1b3efd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48006/0 (socket says 172.21.15.78:48006) 2024-09-11T00:22:56.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.745+0000 7ff7467fc640 1 -- 172.21.15.78:0/2404473425 learned_addr learned my addr 172.21.15.78:0/2404473425 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:56.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.745+0000 7ff74f9fe740 10 client.0 _ll_register_callbacks cb 0x7ff738005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:22:56.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.745+0000 7ff7477fe640 1 --2- 172.21.15.78:0/2404473425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da1b3ead30 0x55da1b4607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:56.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.746+0000 7ff7467fc640 1 -- 172.21.15.78:0/2404473425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da1b3ead30 msgr2=0x55da1b4607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:56.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.746+0000 7ff7467fc640 1 --2- 172.21.15.78:0/2404473425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da1b3ead30 0x55da1b4607a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.746+0000 7ff7467fc640 1 -- 172.21.15.78:0/2404473425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da1b3de480 msgr2=0x55da1b3ef7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:56.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.746+0000 7ff7467fc640 1 --2- 172.21.15.78:0/2404473425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da1b3de480 0x55da1b3ef7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.746+0000 7ff7467fc640 1 -- 172.21.15.78:0/2404473425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da1b460ee0 con 0x55da1b3deda0 2024-09-11T00:22:56.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.746+0000 7ff746ffd640 1 --2- 172.21.15.78:0/2404473425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da1b3de480 0x55da1b3ef7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:22:56.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.746+0000 7ff7467fc640 1 --2- 172.21.15.78:0/2404473425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3deda0 0x55da1b3efd40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff7380ccf50 tx=0x7ff7380c9360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a823ef72fdee4d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:56.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.746+0000 7ff72aff5640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:22:56.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.746+0000 7ff72aff5640 1 -- 172.21.15.78:0/2404473425 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738049040 con 0x55da1b3deda0 2024-09-11T00:22:56.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.746+0000 7ff72aff5640 1 -- 172.21.15.78:0/2404473425 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7ff7380d5f60 con 0x55da1b3deda0 2024-09-11T00:22:56.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.746+0000 7ff74f9fe740 1 -- 172.21.15.78:0/2404473425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff740026930 con 0x55da1b3deda0 2024-09-11T00:22:56.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.746+0000 7ff72aff5640 1 -- 172.21.15.78:0/2404473425 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff7380cc5d0 con 0x55da1b3deda0 2024-09-11T00:22:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.746+0000 7ff74f9fe740 10 client.16194 fetch_fsmap learned FSMap version 20 2024-09-11T00:22:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.746+0000 7ff74f9fe740 1 -- 172.21.15.78:0/2404473425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55da1b468370 con 0x55da1b3deda0 2024-09-11T00:22:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.746+0000 7ff72aff5640 1 -- 172.21.15.78:0/2404473425 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff740026930 con 0x55da1b3deda0 2024-09-11T00:22:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.746+0000 7ff72aff5640 1 -- 172.21.15.78:0/2404473425 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff7380c87b0 con 0x55da1b3deda0 2024-09-11T00:22:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.746+0000 7ff74f9fe740 10 client.16194 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:22:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.746+0000 7ff74f9fe740 10 client.16194 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:22:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.746+0000 7ff74f9fe740 20 client.16194 populate_metadata read hostname 'smithi078' 2024-09-11T00:22:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.746+0000 7ff74f9fe740 1 --2- 172.21.15.78:0/2404473425 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55da1b468850 0x55da1b46ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.746+0000 7ff74f9fe740 4 client.16194 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:22:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.746+0000 7ff74f9fe740 1 -- 172.21.15.78:0/2404473425 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55da1b352850 con 0x55da1b468850 2024-09-11T00:22:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.747+0000 7ff746ffd640 1 --2- 172.21.15.78:0/2404473425 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55da1b468850 0x55da1b46ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:56.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.747+0000 7ff72aff5640 10 client.16194 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:56.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.747+0000 7ff746ffd640 1 --2- 172.21.15.78:0/2404473425 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55da1b468850 0x55da1b46ac40 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1eccfb1c4bc08cfc server_cookie=175573b178e79f65 in_seq=0 out_seq=0 2024-09-11T00:22:56.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.747+0000 7ff72aff5640 1 -- 172.21.15.78:0/2404473425 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x55da1b352850 con 0x55da1b468850 2024-09-11T00:22:56.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.747+0000 7ff72aff5640 10 client.16194 handle_command_reply: tid=0 2024-09-11T00:22:56.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.747+0000 7ff74f9fe740 1 client.16194 shutdown 2024-09-11T00:22:56.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.747+0000 7ff74f9fe740 1 -- 172.21.15.78:0/2404473425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3deda0 msgr2=0x55da1b3efd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:56.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.747+0000 7ff74f9fe740 1 --2- 172.21.15.78:0/2404473425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3deda0 0x55da1b3efd40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff7380ccf50 tx=0x7ff7380c9360 comp rx=0 tx=0).stop 2024-09-11T00:22:56.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.747+0000 7ff74f9fe740 1 -- 172.21.15.78:0/2404473425 shutdown_connections 2024-09-11T00:22:56.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.748+0000 7ff74f9fe740 1 --2- 172.21.15.78:0/2404473425 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55da1b468850 0x55da1b46ac40 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.748+0000 7ff74f9fe740 1 --2- 172.21.15.78:0/2404473425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da1b3ead30 0x55da1b4607a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.748+0000 7ff74f9fe740 1 --2- 172.21.15.78:0/2404473425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da1b3deda0 0x55da1b3efd40 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.748+0000 7ff74f9fe740 1 --2- 172.21.15.78:0/2404473425 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55da1b3de480 0x55da1b3ef7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.748+0000 7ff72aff5640 0 client.16194 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:56.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.748+0000 7ff74f9fe740 1 -- 172.21.15.78:0/2404473425 >> 172.21.15.78:0/2404473425 conn(0x55da1b3dc2b0 msgr2=0x55da1b3e9090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:56.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.748+0000 7ff74f9fe740 1 -- 172.21.15.78:0/2404473425 shutdown_connections 2024-09-11T00:22:56.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.748+0000 7ff74f9fe740 1 -- 172.21.15.78:0/2404473425 wait complete. 2024-09-11T00:22:56.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.748+0000 7ff74f9fe740 20 client.16194 trim_cache size 0 max 16384 2024-09-11T00:22:56.760 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:22:56.760 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-11T00:22:56.760 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {}, 2024-09-11T00:22:56.760 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:22:56.760 INFO:teuthology.orchestra.run.smithi078.stdout: "f494d5ed-e0dc-44bb-8aba-a861b3e751f4": { 2024-09-11T00:22:56.760 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:55.251691+0000", 2024-09-11T00:22:56.760 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:56.761 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:56.761 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:56.761 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:56.761 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:56.761 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:56.761 INFO:teuthology.orchestra.run.smithi078.stdout: "e0002672-e432-4890-ab9f-20c513c5e3b6": { 2024-09-11T00:22:56.761 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:21:37.161715+0000", 2024-09-11T00:22:56.761 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:56.761 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:56.761 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:56.762 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:56.762 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:56.762 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:56.762 INFO:teuthology.orchestra.run.smithi078.stdout: "8ec9e858-aa62-420d-a112-e62ea7810e63": { 2024-09-11T00:22:56.762 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:18.882749+0000", 2024-09-11T00:22:56.762 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:56.762 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:56.762 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:56.762 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:56.762 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:56.762 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:56.762 INFO:teuthology.orchestra.run.smithi078.stdout: "38a1d30d-5f4c-460a-afcd-e6c60b97e43a": { 2024-09-11T00:22:56.763 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:58.127727+0000", 2024-09-11T00:22:56.763 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:56.763 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:56.763 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:56.763 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:56.763 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:56.763 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:56.763 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:22:56.763 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:22:56.763 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:56.763 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:56.763 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:56.764 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:56.764 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:56.764 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:56.764 INFO:teuthology.orchestra.run.smithi078.stdout: "81d31d3a-c224-4ded-9f00-1a7dfc099ec4": { 2024-09-11T00:22:56.764 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:16.296700+0000", 2024-09-11T00:22:56.764 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:56.764 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:56.764 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:56.764 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:56.764 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:56.764 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:56.764 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:22:56.765 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:22:56.765 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:56.765 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:56.765 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:56.765 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:56.765 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:56.765 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:56.765 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:22:56.765 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:22:56.765 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:56.765 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:56.766 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:56.766 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:56.766 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:56.766 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:56.766 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:22:56.766 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:22:56.766 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:56.766 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:56.766 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:56.766 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:56.766 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:56.766 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:56.767 INFO:teuthology.orchestra.run.smithi078.stdout: "b854cbd3-8ca7-4277-a205-8887d2ff5567": { 2024-09-11T00:22:56.767 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:11.182949+0000", 2024-09-11T00:22:56.767 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:56.767 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:56.767 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:56.767 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:56.767 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:56.767 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:56.767 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:22:56.767 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:22:56.767 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:56.767 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:56.768 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:56.768 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:56.768 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:56.768 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:22:56.768 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:22:56.768 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:22:56.768 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:22:56.768 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:22:56.768 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:22:56.768 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:22:56.768 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:22:56.769 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:22:56.769 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:22:56.769 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:22:56.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.748+0000 7ff74d629640 1 -- 172.21.15.78:0/1428977410 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff7300b5450 msgr2=0x7ff7300b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:56.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.748+0000 7ff74d629640 1 --2- 172.21.15.78:0/1428977410 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff7300b5450 0x7ff7300b7910 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff740008e40 tx=0x7ff7400085f0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.748+0000 7ff74d629640 1 -- 172.21.15.78:0/1428977410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7481087d0 msgr2=0x7ff748199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:56.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.748+0000 7ff74d629640 1 --2- 172.21.15.78:0/1428977410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7481087d0 0x7ff748199840 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff738006010 tx=0x7ff7380042f0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.748+0000 7ff74d629640 1 -- 172.21.15.78:0/1428977410 shutdown_connections 2024-09-11T00:22:56.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.748+0000 7ff74d629640 1 --2- 172.21.15.78:0/1428977410 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff7300b5450 0x7ff7300b7910 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.748+0000 7ff74d629640 1 --2- 172.21.15.78:0/1428977410 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff748109150 0x7ff74819ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.748+0000 7ff74d629640 1 --2- 172.21.15.78:0/1428977410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7481087d0 0x7ff748199840 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.748+0000 7ff74d629640 1 --2- 172.21.15.78:0/1428977410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff748102dc0 0x7ff748199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:56.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.748+0000 7ff74d629640 1 -- 172.21.15.78:0/1428977410 >> 172.21.15.78:0/1428977410 conn(0x7ff7480fe830 msgr2=0x7ff748100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:56.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.748+0000 7ff74d629640 1 -- 172.21.15.78:0/1428977410 shutdown_connections 2024-09-11T00:22:56.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:56.748+0000 7ff74d629640 1 -- 172.21.15.78:0/1428977410 wait complete. 2024-09-11T00:22:56.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:56 smithi138 ceph-mon[35019]: pgmap v517: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-11T00:22:56.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:56 smithi138 ceph-mon[35019]: scrub summary: idle 2024-09-11T00:22:57.502 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:22:57.503 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:22:57.747 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:22:58.137 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:57 smithi078 ceph-mon[30865]: pgmap v518: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-11T00:22:58.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:57 smithi112 ceph-mon[35627]: pgmap v518: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-11T00:22:58.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.215+0000 7ff29795c640 1 -- 172.21.15.78:0/3758793303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff290101870 msgr2=0x7ff290101c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:58.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.215+0000 7ff29795c640 1 --2- 172.21.15.78:0/3758793303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff290101870 0x7ff290101c50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff284009900 tx=0x7ff28402a410 comp rx=0 tx=0).stop 2024-09-11T00:22:58.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.215+0000 7ff29795c640 1 -- 172.21.15.78:0/3758793303 shutdown_connections 2024-09-11T00:22:58.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.215+0000 7ff29795c640 1 --2- 172.21.15.78:0/3758793303 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff29010f420 0x7ff290111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:58.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.215+0000 7ff29795c640 1 --2- 172.21.15.78:0/3758793303 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff290102190 0x7ff29010eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:58.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.215+0000 7ff29795c640 1 --2- 172.21.15.78:0/3758793303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff290101870 0x7ff290101c50 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:58.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.215+0000 7ff29795c640 1 -- 172.21.15.78:0/3758793303 >> 172.21.15.78:0/3758793303 conn(0x7ff2900fd700 msgr2=0x7ff2900ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:58.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.215+0000 7ff29795c640 1 -- 172.21.15.78:0/3758793303 shutdown_connections 2024-09-11T00:22:58.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.215+0000 7ff29795c640 1 -- 172.21.15.78:0/3758793303 wait complete. 2024-09-11T00:22:58.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.216+0000 7ff29795c640 1 Processor -- start 2024-09-11T00:22:58.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.216+0000 7ff29795c640 1 -- start start 2024-09-11T00:22:58.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.216+0000 7ff29795c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff290101870 0x7ff29019b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:58.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.216+0000 7ff29795c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff290102190 0x7ff29019ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:58.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.216+0000 7ff29795c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff29010f420 0x7ff2901a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:58.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.216+0000 7ff29795c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff290115000 con 0x7ff290102190 2024-09-11T00:22:58.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.216+0000 7ff29795c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff290114e80 con 0x7ff290101870 2024-09-11T00:22:58.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.216+0000 7ff29795c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff290115180 con 0x7ff29010f420 2024-09-11T00:22:58.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.216+0000 7ff294ef7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff290102190 0x7ff29019ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:58.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.216+0000 7ff294ef7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff290102190 0x7ff29019ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48026/0 (socket says 172.21.15.78:48026) 2024-09-11T00:22:58.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.216+0000 7ff294ef7640 1 -- 172.21.15.78:0/952985220 learned_addr learned my addr 172.21.15.78:0/952985220 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:58.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.216+0000 7ff2956f8640 1 --2- 172.21.15.78:0/952985220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff290101870 0x7ff29019b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:58.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.216+0000 7ff295ef9640 1 --2- 172.21.15.78:0/952985220 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff29010f420 0x7ff2901a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:58.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.216+0000 7ff294ef7640 1 -- 172.21.15.78:0/952985220 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff29010f420 msgr2=0x7ff2901a0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.216+0000 7ff294ef7640 1 --2- 172.21.15.78:0/952985220 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff29010f420 0x7ff2901a0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.217+0000 7ff294ef7640 1 -- 172.21.15.78:0/952985220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff290101870 msgr2=0x7ff29019b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.217+0000 7ff294ef7640 1 --2- 172.21.15.78:0/952985220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff290101870 0x7ff29019b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.217+0000 7ff294ef7640 1 -- 172.21.15.78:0/952985220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2901a1600 con 0x7ff290102190 2024-09-11T00:22:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.217+0000 7ff294ef7640 1 --2- 172.21.15.78:0/952985220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff290102190 0x7ff29019ba90 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00cce0 tx=0x7ff28c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.217+0000 7ff2827fc640 1 -- 172.21.15.78:0/952985220 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c004b20 con 0x7ff290102190 2024-09-11T00:22:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.217+0000 7ff2827fc640 1 -- 172.21.15.78:0/952985220 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff28c004cc0 con 0x7ff290102190 2024-09-11T00:22:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.217+0000 7ff29795c640 1 -- 172.21.15.78:0/952985220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2901a18f0 con 0x7ff290102190 2024-09-11T00:22:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.217+0000 7ff2827fc640 1 -- 172.21.15.78:0/952985220 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c00f6b0 con 0x7ff290102190 2024-09-11T00:22:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.217+0000 7ff29795c640 1 -- 172.21.15.78:0/952985220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2901a7fb0 con 0x7ff290102190 2024-09-11T00:22:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.218+0000 7ff29795c640 1 -- 172.21.15.78:0/952985220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff290101c50 con 0x7ff290102190 2024-09-11T00:22:58.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.219+0000 7ff2827fc640 1 -- 172.21.15.78:0/952985220 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7ff28c00f850 con 0x7ff290102190 2024-09-11T00:22:58.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.220+0000 7ff2827fc640 1 --2- 172.21.15.78:0/952985220 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff27c0b5450 0x7ff27c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:58.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.220+0000 7ff2956f8640 1 --2- 172.21.15.78:0/952985220 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff27c0b5450 0x7ff27c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:58.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.220+0000 7ff2827fc640 1 -- 172.21.15.78:0/952985220 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7ff28c0e6430 con 0x7ff290102190 2024-09-11T00:22:58.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.220+0000 7ff2956f8640 1 --2- 172.21.15.78:0/952985220 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff27c0b5450 0x7ff27c0b7910 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff284031440 tx=0x7ff284005e80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:58.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.223+0000 7ff2827fc640 1 -- 172.21.15.78:0/952985220 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff28c014030 con 0x7ff290102190 2024-09-11T00:22:58.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:57 smithi138 ceph-mon[35019]: pgmap v518: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-11T00:22:58.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.434+0000 7ff29795c640 1 -- 172.21.15.78:0/952985220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2901a8340 con 0x7ff290102190 2024-09-11T00:22:58.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.434+0000 7ff2827fc640 1 -- 172.21.15.78:0/952985220 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7ff28c0acfd0 con 0x7ff290102190 2024-09-11T00:22:58.436 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:22:58.436 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:22:58.437 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:22:58.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.436+0000 7ff29795c640 1 -- 172.21.15.78:0/952985220 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff27c0b5450 msgr2=0x7ff27c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:58.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.436+0000 7ff29795c640 1 --2- 172.21.15.78:0/952985220 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff27c0b5450 0x7ff27c0b7910 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff284031440 tx=0x7ff284005e80 comp rx=0 tx=0).stop 2024-09-11T00:22:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.436+0000 7ff29795c640 1 -- 172.21.15.78:0/952985220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff290102190 msgr2=0x7ff29019ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.436+0000 7ff29795c640 1 --2- 172.21.15.78:0/952985220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff290102190 0x7ff29019ba90 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00cce0 tx=0x7ff28c00a620 comp rx=0 tx=0).stop 2024-09-11T00:22:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.437+0000 7ff29795c640 1 -- 172.21.15.78:0/952985220 shutdown_connections 2024-09-11T00:22:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.437+0000 7ff29795c640 1 --2- 172.21.15.78:0/952985220 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff27c0b5450 0x7ff27c0b7910 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.437+0000 7ff29795c640 1 --2- 172.21.15.78:0/952985220 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff29010f420 0x7ff2901a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.437+0000 7ff29795c640 1 --2- 172.21.15.78:0/952985220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff290102190 0x7ff29019ba90 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.437+0000 7ff29795c640 1 --2- 172.21.15.78:0/952985220 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff290101870 0x7ff29019b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.437+0000 7ff29795c640 1 -- 172.21.15.78:0/952985220 >> 172.21.15.78:0/952985220 conn(0x7ff2900fd700 msgr2=0x7ff2900ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.437+0000 7ff29795c640 1 -- 172.21.15.78:0/952985220 shutdown_connections 2024-09-11T00:22:58.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:58.437+0000 7ff29795c640 1 -- 172.21.15.78:0/952985220 wait complete. 2024-09-11T00:22:59.120 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:22:59.142 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:58 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/952985220' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:22:59.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:58 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/952985220' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:22:59.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:58 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/952985220' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:22:59.366 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:22:59.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.834+0000 7f56417db640 1 -- 172.21.15.78:0/4224124954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f563c1087d0 msgr2=0x7f563c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:59.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.834+0000 7f56417db640 1 --2- 172.21.15.78:0/4224124954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f563c1087d0 0x7f563c108c10 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5624009900 tx=0x7f562402a410 comp rx=0 tx=0).stop 2024-09-11T00:22:59.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.834+0000 7f56417db640 1 -- 172.21.15.78:0/4224124954 shutdown_connections 2024-09-11T00:22:59.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.834+0000 7f56417db640 1 --2- 172.21.15.78:0/4224124954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f563c109150 0x7f563c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.834+0000 7f56417db640 1 --2- 172.21.15.78:0/4224124954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f563c1087d0 0x7f563c108c10 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.834+0000 7f56417db640 1 --2- 172.21.15.78:0/4224124954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f563c102dc0 0x7f563c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.834+0000 7f56417db640 1 -- 172.21.15.78:0/4224124954 >> 172.21.15.78:0/4224124954 conn(0x7f563c0fe830 msgr2=0x7f563c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:59.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.834+0000 7f56417db640 1 -- 172.21.15.78:0/4224124954 shutdown_connections 2024-09-11T00:22:59.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.834+0000 7f56417db640 1 -- 172.21.15.78:0/4224124954 wait complete. 2024-09-11T00:22:59.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.835+0000 7f56417db640 1 Processor -- start 2024-09-11T00:22:59.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.835+0000 7f56417db640 1 -- start start 2024-09-11T00:22:59.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.835+0000 7f56417db640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f563c102dc0 0x7f563c199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:59.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.835+0000 7f56417db640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f563c1087d0 0x7f563c1997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:59.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.835+0000 7f56417db640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f563c109150 0x7f563c19eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:59.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.835+0000 7f56417db640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f563c112e10 con 0x7f563c109150 2024-09-11T00:22:59.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.835+0000 7f56417db640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f563c112c90 con 0x7f563c102dc0 2024-09-11T00:22:59.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.835+0000 7f56417db640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f563c112f90 con 0x7f563c1087d0 2024-09-11T00:22:59.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.835+0000 7f563b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f563c109150 0x7f563c19eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:59.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.835+0000 7f563b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f563c109150 0x7f563c19eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48042/0 (socket says 172.21.15.78:48042) 2024-09-11T00:22:59.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.835+0000 7f563b7fe640 1 -- 172.21.15.78:0/3275277810 learned_addr learned my addr 172.21.15.78:0/3275277810 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:59.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.835+0000 7f5633fff640 1 --2- 172.21.15.78:0/3275277810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f563c1087d0 0x7f563c1997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:59.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.835+0000 7f563affd640 1 --2- 172.21.15.78:0/3275277810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f563c102dc0 0x7f563c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:59.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.835+0000 7f563b7fe640 1 -- 172.21.15.78:0/3275277810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f563c1087d0 msgr2=0x7f563c1997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:59.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.835+0000 7f563b7fe640 1 --2- 172.21.15.78:0/3275277810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f563c1087d0 0x7f563c1997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.835+0000 7f563b7fe640 1 -- 172.21.15.78:0/3275277810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f563c102dc0 msgr2=0x7f563c199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:59.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.835+0000 7f563b7fe640 1 --2- 172.21.15.78:0/3275277810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f563c102dc0 0x7f563c199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.835+0000 7f563b7fe640 1 -- 172.21.15.78:0/3275277810 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f563c19f340 con 0x7f563c109150 2024-09-11T00:22:59.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.835+0000 7f563affd640 1 --2- 172.21.15.78:0/3275277810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f563c102dc0 0x7f563c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:22:59.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.836+0000 7f563b7fe640 1 --2- 172.21.15.78:0/3275277810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f563c109150 0x7f563c19eb70 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f563400cce0 tx=0x7f563400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:59.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.836+0000 7f5638ff9640 1 -- 172.21.15.78:0/3275277810 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563400f450 con 0x7f563c109150 2024-09-11T00:22:59.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.836+0000 7f5638ff9640 1 -- 172.21.15.78:0/3275277810 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f563400faa0 con 0x7f563c109150 2024-09-11T00:22:59.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.836+0000 7f5638ff9640 1 -- 172.21.15.78:0/3275277810 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5634018b70 con 0x7f563c109150 2024-09-11T00:22:59.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.836+0000 7f56417db640 1 -- 172.21.15.78:0/3275277810 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f563c19f630 con 0x7f563c109150 2024-09-11T00:22:59.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.836+0000 7f56417db640 1 -- 172.21.15.78:0/3275277810 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f563c1a5d70 con 0x7f563c109150 2024-09-11T00:22:59.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.838+0000 7f5643bb0740 1 Processor -- start 2024-09-11T00:22:59.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.838+0000 7f5638ff9640 1 -- 172.21.15.78:0/3275277810 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f563400f5f0 con 0x7f563c109150 2024-09-11T00:22:59.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.838+0000 7f5643bb0740 1 -- start start 2024-09-11T00:22:59.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.839+0000 7f5643bb0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5635c2af24d0 0x5635c2af28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:59.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.839+0000 7f5643bb0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2af2df0 0x5635c2b02c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:59.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.839+0000 7f5643bb0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2b03190 0x5635c2b05580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:59.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.839+0000 7f5643bb0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5635c2a68ea0 con 0x5635c2af2df0 2024-09-11T00:22:59.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.839+0000 7f5643bb0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5635c2a582d0 con 0x5635c2b03190 2024-09-11T00:22:59.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.839+0000 7f5643bb0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5635c2a5c0e0 con 0x5635c2af24d0 2024-09-11T00:22:59.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.839+0000 7f563affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2af2df0 0x5635c2b02c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:59.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.839+0000 7f563affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2af2df0 0x5635c2b02c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48048/0 (socket says 172.21.15.78:48048) 2024-09-11T00:22:59.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.839+0000 7f563affd640 1 -- 172.21.15.78:0/752156073 learned_addr learned my addr 172.21.15.78:0/752156073 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:59.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.839+0000 7f5633fff640 1 --2- 172.21.15.78:0/752156073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5635c2af24d0 0x5635c2af28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:59.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.839+0000 7f563affd640 1 -- 172.21.15.78:0/752156073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5635c2af24d0 msgr2=0x5635c2af28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:59.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.839+0000 7f5633fff640 1 --2- 172.21.15.78:0/752156073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2b03190 0x5635c2b05580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:59.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.839+0000 7f563affd640 1 --2- 172.21.15.78:0/752156073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5635c2af24d0 0x5635c2af28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.839+0000 7f563affd640 1 -- 172.21.15.78:0/752156073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2b03190 msgr2=0x5635c2b05580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:59.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.839+0000 7f563affd640 1 --2- 172.21.15.78:0/752156073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2b03190 0x5635c2b05580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.839+0000 7f563affd640 1 -- 172.21.15.78:0/752156073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635c27b6650 con 0x5635c2af2df0 2024-09-11T00:22:59.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.839+0000 7f5633fff640 1 --2- 172.21.15.78:0/752156073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2b03190 0x5635c2b05580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:22:59.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.839+0000 7f563affd640 1 --2- 172.21.15.78:0/752156073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2af2df0 0x5635c2b02c50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f562c00aa40 tx=0x7f562c00af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c940b508c95b0ce1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:59.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.840+0000 7f56317fa640 1 -- 172.21.15.78:0/752156073 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c015070 con 0x5635c2af2df0 2024-09-11T00:22:59.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.840+0000 7f5638ff9640 1 --2- 172.21.15.78:0/3275277810 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f56280b54d0 0x7f56280b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:59.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.840+0000 7f56317fa640 1 -- 172.21.15.78:0/752156073 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f562c00ccc0 con 0x5635c2af2df0 2024-09-11T00:22:59.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.840+0000 7f56317fa640 1 -- 172.21.15.78:0/752156073 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c0185c0 con 0x5635c2af2df0 2024-09-11T00:22:59.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.840+0000 7f5633fff640 1 --2- 172.21.15.78:0/3275277810 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f56280b54d0 0x7f56280b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:59.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.840+0000 7f5638ff9640 1 -- 172.21.15.78:0/3275277810 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f56340e67b0 con 0x7f563c109150 2024-09-11T00:22:59.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.840+0000 7f5643bb0740 1 -- 172.21.15.78:0/752156073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2af2df0 msgr2=0x5635c2b02c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:59.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.840+0000 7f5633fff640 1 --2- 172.21.15.78:0/3275277810 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f56280b54d0 0x7f56280b7990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5624031440 tx=0x7f5624009260 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:59.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.840+0000 7f5643bb0740 1 --2- 172.21.15.78:0/752156073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2af2df0 0x5635c2b02c50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f562c00aa40 tx=0x7f562c00af00 comp rx=0 tx=0).stop 2024-09-11T00:22:59.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.840+0000 7f5643bb0740 1 -- 172.21.15.78:0/752156073 shutdown_connections 2024-09-11T00:22:59.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.840+0000 7f5643bb0740 1 --2- 172.21.15.78:0/752156073 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2b03190 0x5635c2b05580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.840+0000 7f5643bb0740 1 --2- 172.21.15.78:0/752156073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2af2df0 0x5635c2b02c50 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.840+0000 7f5643bb0740 1 --2- 172.21.15.78:0/752156073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5635c2af24d0 0x5635c2af28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.840+0000 7f5643bb0740 1 -- 172.21.15.78:0/752156073 >> 172.21.15.78:0/752156073 conn(0x5635c2af0300 msgr2=0x5635c2af14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:59.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.840+0000 7f5643bb0740 1 -- 172.21.15.78:0/752156073 shutdown_connections 2024-09-11T00:22:59.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.841+0000 7f5643bb0740 1 -- 172.21.15.78:0/752156073 wait complete. 2024-09-11T00:22:59.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.841+0000 7f5643bb0740 1 -- start start 2024-09-11T00:22:59.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.841+0000 7f5643bb0740 1 Processor -- start 2024-09-11T00:22:59.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.841+0000 7f5643bb0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2af24d0 0x5635c2b02a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:59.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.841+0000 7f5643bb0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5635c2af2df0 0x5635c2affeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:59.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.841+0000 7f5643bb0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2b03190 0x5635c2b00490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:59.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.841+0000 7f5643bb0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5635c28b9700 con 0x5635c2b03190 2024-09-11T00:22:59.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.841+0000 7f5643bb0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5635c29f3160 con 0x5635c2af24d0 2024-09-11T00:22:59.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.841+0000 7f5643bb0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5635c2b05e40 con 0x5635c2af2df0 2024-09-11T00:22:59.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.841+0000 7f5643bb0740 10 client.0 _ll_register_callbacks cb 0x5635c2a0c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:22:59.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.841+0000 7f563b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2b03190 0x5635c2b00490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:59.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.841+0000 7f563b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2b03190 0x5635c2b00490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48052/0 (socket says 172.21.15.78:48052) 2024-09-11T00:22:59.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.841+0000 7f563b7fe640 1 -- 172.21.15.78:0/647770034 learned_addr learned my addr 172.21.15.78:0/647770034 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:59.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.841+0000 7f5633fff640 1 --2- 172.21.15.78:0/647770034 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5635c2af2df0 0x5635c2affeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:59.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.841+0000 7f563b7fe640 1 -- 172.21.15.78:0/647770034 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5635c2af2df0 msgr2=0x5635c2affeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:59.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.841+0000 7f563b7fe640 1 --2- 172.21.15.78:0/647770034 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5635c2af2df0 0x5635c2affeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.841+0000 7f563b7fe640 1 -- 172.21.15.78:0/647770034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2af24d0 msgr2=0x5635c2b02a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:59.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.841+0000 7f563affd640 1 --2- 172.21.15.78:0/647770034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2af24d0 0x5635c2b02a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:59.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.842+0000 7f563b7fe640 1 --2- 172.21.15.78:0/647770034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2af24d0 0x5635c2b02a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.842+0000 7f563b7fe640 1 -- 172.21.15.78:0/647770034 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635c2a20c90 con 0x5635c2b03190 2024-09-11T00:22:59.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.842+0000 7f563affd640 1 --2- 172.21.15.78:0/647770034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2af24d0 0x5635c2b02a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:22:59.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.842+0000 7f563b7fe640 1 --2- 172.21.15.78:0/647770034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2b03190 0x5635c2b00490 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f563400ccb0 tx=0x7f56340a8b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d75a8ceb991f93 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:59.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.842+0000 7f56227fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:22:59.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.842+0000 7f56227fc640 1 -- 172.21.15.78:0/647770034 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56340a8360 con 0x5635c2b03190 2024-09-11T00:22:59.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.842+0000 7f56227fc640 1 -- 172.21.15.78:0/647770034 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f56340b5ef0 con 0x5635c2b03190 2024-09-11T00:22:59.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.842+0000 7f5643bb0740 1 -- 172.21.15.78:0/647770034 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f562c00ccc0 con 0x5635c2b03190 2024-09-11T00:22:59.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.842+0000 7f56227fc640 1 -- 172.21.15.78:0/647770034 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f56340ac700 con 0x5635c2b03190 2024-09-11T00:22:59.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.842+0000 7f5643bb0740 10 client.16212 fetch_fsmap learned FSMap version 20 2024-09-11T00:22:59.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.842+0000 7f5643bb0740 1 -- 172.21.15.78:0/647770034 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5635c2b11720 con 0x5635c2b03190 2024-09-11T00:22:59.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.842+0000 7f56227fc640 1 -- 172.21.15.78:0/647770034 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f562c00ccc0 con 0x5635c2b03190 2024-09-11T00:22:59.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.842+0000 7f56227fc640 1 -- 172.21.15.78:0/647770034 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f56340a8040 con 0x5635c2b03190 2024-09-11T00:22:59.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.842+0000 7f5643bb0740 10 client.16212 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:22:59.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.842+0000 7f5643bb0740 10 client.16212 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:22:59.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.842+0000 7f5643bb0740 20 client.16212 populate_metadata read hostname 'smithi078' 2024-09-11T00:22:59.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.842+0000 7f5643bb0740 1 --2- 172.21.15.78:0/647770034 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5635c2b12c30 0x5635c2b150b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:59.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.842+0000 7f5643bb0740 4 client.16212 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:22:59.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.842+0000 7f5643bb0740 1 -- 172.21.15.78:0/647770034 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635c2a6adf0 con 0x5635c2b12c30 2024-09-11T00:22:59.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.843+0000 7f563affd640 1 --2- 172.21.15.78:0/647770034 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5635c2b12c30 0x5635c2b150b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:59.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.843+0000 7f563affd640 1 --2- 172.21.15.78:0/647770034 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5635c2b12c30 0x5635c2b150b0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6365c7cdd0e2fc3 server_cookie=f70a3c4da5d52816 in_seq=0 out_seq=0 2024-09-11T00:22:59.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.843+0000 7f56227fc640 10 client.16212 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:59.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.844+0000 7f56227fc640 1 -- 172.21.15.78:0/647770034 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5635c2a6adf0 con 0x5635c2b12c30 2024-09-11T00:22:59.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.844+0000 7f56227fc640 10 client.16212 handle_command_reply: tid=0 2024-09-11T00:22:59.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.844+0000 7f5643bb0740 1 client.16212 shutdown 2024-09-11T00:22:59.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.844+0000 7f5643bb0740 1 -- 172.21.15.78:0/647770034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2b03190 msgr2=0x5635c2b00490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:59.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.844+0000 7f5643bb0740 1 --2- 172.21.15.78:0/647770034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2b03190 0x5635c2b00490 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f563400ccb0 tx=0x7f56340a8b50 comp rx=0 tx=0).stop 2024-09-11T00:22:59.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.844+0000 7f5643bb0740 1 -- 172.21.15.78:0/647770034 shutdown_connections 2024-09-11T00:22:59.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.844+0000 7f5643bb0740 1 --2- 172.21.15.78:0/647770034 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5635c2b12c30 0x5635c2b150b0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.844+0000 7f5643bb0740 1 --2- 172.21.15.78:0/647770034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2b03190 0x5635c2b00490 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.844+0000 7f5643bb0740 1 --2- 172.21.15.78:0/647770034 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5635c2af2df0 0x5635c2affeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.844+0000 7f56227fc640 0 client.16212 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:59.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.844+0000 7f5643bb0740 1 --2- 172.21.15.78:0/647770034 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2af24d0 0x5635c2b02a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.844+0000 7f5643bb0740 1 -- 172.21.15.78:0/647770034 >> 172.21.15.78:0/647770034 conn(0x5635c2af0300 msgr2=0x5635c2aef420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:59.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.844+0000 7f5643bb0740 1 -- 172.21.15.78:0/647770034 shutdown_connections 2024-09-11T00:22:59.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.844+0000 7f5643bb0740 1 -- 172.21.15.78:0/647770034 wait complete. 2024-09-11T00:22:59.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.844+0000 7f5643bb0740 20 client.16212 trim_cache size 0 max 16384 2024-09-11T00:22:59.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.857+0000 7f5643bb0740 1 Processor -- start 2024-09-11T00:22:59.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.857+0000 7f5643bb0740 1 -- start start 2024-09-11T00:22:59.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.857+0000 7f5643bb0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5635c2af24d0 0x5635c2aefc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:59.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.857+0000 7f5643bb0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2af2df0 0x5635c2b0f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:59.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.857+0000 7f5643bb0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2b03190 0x5635c2af1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:59.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.857+0000 7f5643bb0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f563c1aa380 con 0x5635c2b03190 2024-09-11T00:22:59.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.857+0000 7f5643bb0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f563c1acc00 con 0x5635c2af2df0 2024-09-11T00:22:59.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.857+0000 7f5643bb0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f563c1aa9f0 con 0x5635c2af24d0 2024-09-11T00:22:59.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.857+0000 7f563b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2b03190 0x5635c2af1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:59.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.857+0000 7f563b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2b03190 0x5635c2af1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48060/0 (socket says 172.21.15.78:48060) 2024-09-11T00:22:59.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.857+0000 7f563b7fe640 1 -- 172.21.15.78:0/3587120435 learned_addr learned my addr 172.21.15.78:0/3587120435 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:59.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.857+0000 7f5633fff640 1 --2- 172.21.15.78:0/3587120435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2af2df0 0x5635c2b0f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:59.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.857+0000 7f563affd640 1 --2- 172.21.15.78:0/3587120435 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5635c2af24d0 0x5635c2aefc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:59.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.857+0000 7f563b7fe640 1 -- 172.21.15.78:0/3587120435 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5635c2af24d0 msgr2=0x5635c2aefc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:59.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.857+0000 7f563b7fe640 1 --2- 172.21.15.78:0/3587120435 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5635c2af24d0 0x5635c2aefc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.857+0000 7f563b7fe640 1 -- 172.21.15.78:0/3587120435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2af2df0 msgr2=0x5635c2b0f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:59.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.858+0000 7f563b7fe640 1 --2- 172.21.15.78:0/3587120435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2af2df0 0x5635c2b0f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.858+0000 7f563b7fe640 1 -- 172.21.15.78:0/3587120435 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635c2aebde0 con 0x5635c2b03190 2024-09-11T00:22:59.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.858+0000 7f563affd640 1 --2- 172.21.15.78:0/3587120435 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5635c2af24d0 0x5635c2aefc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:22:59.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.858+0000 7f5633fff640 1 --2- 172.21.15.78:0/3587120435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2af2df0 0x5635c2b0f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:22:59.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.858+0000 7f563b7fe640 1 --2- 172.21.15.78:0/3587120435 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2b03190 0x5635c2af1350 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f56340a91c0 tx=0x7f56340941a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77754ad20d32d97b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:59.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.858+0000 7f5630ff9640 1 -- 172.21.15.78:0/3587120435 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56340a8360 con 0x5635c2b03190 2024-09-11T00:22:59.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.858+0000 7f5630ff9640 1 -- 172.21.15.78:0/3587120435 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56340b1450 con 0x5635c2b03190 2024-09-11T00:22:59.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.858+0000 7f5630ff9640 1 -- 172.21.15.78:0/3587120435 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56340abe50 con 0x5635c2b03190 2024-09-11T00:22:59.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.858+0000 7f5643bb0740 1 -- 172.21.15.78:0/3587120435 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2b03190 msgr2=0x5635c2af1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:59.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.858+0000 7f5643bb0740 1 --2- 172.21.15.78:0/3587120435 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2b03190 0x5635c2af1350 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f56340a91c0 tx=0x7f56340941a0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.859+0000 7f5643bb0740 1 -- 172.21.15.78:0/3587120435 shutdown_connections 2024-09-11T00:22:59.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.859+0000 7f5643bb0740 1 --2- 172.21.15.78:0/3587120435 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2b03190 0x5635c2af1350 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.859+0000 7f5643bb0740 1 --2- 172.21.15.78:0/3587120435 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2af2df0 0x5635c2b0f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.859+0000 7f5643bb0740 1 --2- 172.21.15.78:0/3587120435 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5635c2af24d0 0x5635c2aefc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.859+0000 7f5643bb0740 1 -- 172.21.15.78:0/3587120435 >> 172.21.15.78:0/3587120435 conn(0x5635c2af0300 msgr2=0x5635c2afe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:59.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.859+0000 7f5643bb0740 1 -- 172.21.15.78:0/3587120435 shutdown_connections 2024-09-11T00:22:59.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.859+0000 7f5643bb0740 1 -- 172.21.15.78:0/3587120435 wait complete. 2024-09-11T00:22:59.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.859+0000 7f5643bb0740 1 -- start start 2024-09-11T00:22:59.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.859+0000 7f5643bb0740 1 Processor -- start 2024-09-11T00:22:59.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.859+0000 7f5643bb0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2af24d0 0x5635c2b0b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:59.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.859+0000 7f5643bb0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5635c2af2df0 0x5635c2b0b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:59.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.859+0000 7f5643bb0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2b03190 0x5635c2b080a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:59.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.859+0000 7f5643bb0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f563c1ab0c0 con 0x5635c2af24d0 2024-09-11T00:22:59.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.859+0000 7f5643bb0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f563c1ac530 con 0x5635c2b03190 2024-09-11T00:22:59.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.859+0000 7f5643bb0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f563c1ab790 con 0x5635c2af2df0 2024-09-11T00:22:59.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.859+0000 7f5643bb0740 10 client.0 _ll_register_callbacks cb 0x7f5634018510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:22:59.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.859+0000 7f563affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2af24d0 0x5635c2b0b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:59.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.859+0000 7f563affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2af24d0 0x5635c2b0b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48066/0 (socket says 172.21.15.78:48066) 2024-09-11T00:22:59.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.859+0000 7f563affd640 1 -- 172.21.15.78:0/3236109290 learned_addr learned my addr 172.21.15.78:0/3236109290 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:22:59.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.859+0000 7f5633fff640 1 --2- 172.21.15.78:0/3236109290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5635c2af2df0 0x5635c2b0b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:59.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.859+0000 7f563b7fe640 1 --2- 172.21.15.78:0/3236109290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2b03190 0x5635c2b080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:59.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.860+0000 7f563affd640 1 -- 172.21.15.78:0/3236109290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5635c2af2df0 msgr2=0x5635c2b0b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:59.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.860+0000 7f563affd640 1 --2- 172.21.15.78:0/3236109290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5635c2af2df0 0x5635c2b0b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.860+0000 7f563affd640 1 -- 172.21.15.78:0/3236109290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2b03190 msgr2=0x5635c2b080a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:22:59.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.860+0000 7f563affd640 1 --2- 172.21.15.78:0/3236109290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2b03190 0x5635c2b080a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.860+0000 7f563affd640 1 -- 172.21.15.78:0/3236109290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635c2b0be80 con 0x5635c2af24d0 2024-09-11T00:22:59.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.860+0000 7f5633fff640 1 --2- 172.21.15.78:0/3236109290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5635c2af2df0 0x5635c2b0b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:22:59.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.860+0000 7f563affd640 1 --2- 172.21.15.78:0/3236109290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2af24d0 0x5635c2b0b0d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f562c00a6a0 tx=0x7f562c00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc2d05db6f0b34d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:22:59.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.860+0000 7f56227fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:22:59.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.860+0000 7f56227fc640 1 -- 172.21.15.78:0/3236109290 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c015040 con 0x5635c2af24d0 2024-09-11T00:22:59.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.860+0000 7f56227fc640 1 -- 172.21.15.78:0/3236109290 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f562c011800 con 0x5635c2af24d0 2024-09-11T00:22:59.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.860+0000 7f5643bb0740 1 -- 172.21.15.78:0/3236109290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56340b1450 con 0x5635c2af24d0 2024-09-11T00:22:59.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.860+0000 7f56227fc640 1 -- 172.21.15.78:0/3236109290 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f562c00ce60 con 0x5635c2af24d0 2024-09-11T00:22:59.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.860+0000 7f5643bb0740 10 client.16218 fetch_fsmap learned FSMap version 20 2024-09-11T00:22:59.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.860+0000 7f5643bb0740 1 -- 172.21.15.78:0/3236109290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5635c2b801c0 con 0x5635c2af24d0 2024-09-11T00:22:59.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.860+0000 7f56227fc640 1 -- 172.21.15.78:0/3236109290 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56340b1450 con 0x5635c2af24d0 2024-09-11T00:22:59.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.861+0000 7f56227fc640 1 -- 172.21.15.78:0/3236109290 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f562c02da70 con 0x5635c2af24d0 2024-09-11T00:22:59.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.861+0000 7f5643bb0740 10 client.16218 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:22:59.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.861+0000 7f5643bb0740 10 client.16218 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:22:59.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.861+0000 7f5643bb0740 20 client.16218 populate_metadata read hostname 'smithi078' 2024-09-11T00:22:59.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.861+0000 7f5643bb0740 1 --2- 172.21.15.78:0/3236109290 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5635c2b80610 0x5635c2b82a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:22:59.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.861+0000 7f5643bb0740 4 client.16218 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:22:59.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.861+0000 7f5643bb0740 1 -- 172.21.15.78:0/3236109290 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5635c2a668a0 con 0x5635c2b80610 2024-09-11T00:22:59.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.861+0000 7f5633fff640 1 --2- 172.21.15.78:0/3236109290 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5635c2b80610 0x5635c2b82a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:22:59.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.861+0000 7f56227fc640 10 client.16218 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:59.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.861+0000 7f5633fff640 1 --2- 172.21.15.78:0/3236109290 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5635c2b80610 0x5635c2b82a00 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3159fc3b5016119f server_cookie=f28fe83ac1731d00 in_seq=0 out_seq=0 2024-09-11T00:22:59.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.862+0000 7f56227fc640 1 -- 172.21.15.78:0/3236109290 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5635c2a668a0 con 0x5635c2b80610 2024-09-11T00:22:59.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.862+0000 7f56227fc640 10 client.16218 handle_command_reply: tid=0 2024-09-11T00:22:59.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.862+0000 7f5643bb0740 1 client.16218 shutdown 2024-09-11T00:22:59.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.862+0000 7f5643bb0740 1 -- 172.21.15.78:0/3236109290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2af24d0 msgr2=0x5635c2b0b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:59.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.862+0000 7f5643bb0740 1 --2- 172.21.15.78:0/3236109290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2af24d0 0x5635c2b0b0d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f562c00a6a0 tx=0x7f562c00ccf0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.862+0000 7f5643bb0740 1 -- 172.21.15.78:0/3236109290 shutdown_connections 2024-09-11T00:22:59.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.862+0000 7f5643bb0740 1 --2- 172.21.15.78:0/3236109290 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5635c2b80610 0x5635c2b82a00 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.862+0000 7f5643bb0740 1 --2- 172.21.15.78:0/3236109290 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5635c2b03190 0x5635c2b080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.862+0000 7f5643bb0740 1 --2- 172.21.15.78:0/3236109290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5635c2af2df0 0x5635c2b0b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.862+0000 7f56227fc640 0 client.16218 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:22:59.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.862+0000 7f5643bb0740 1 --2- 172.21.15.78:0/3236109290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5635c2af24d0 0x5635c2b0b0d0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.862+0000 7f5643bb0740 1 -- 172.21.15.78:0/3236109290 >> 172.21.15.78:0/3236109290 conn(0x5635c2af0300 msgr2=0x5635c2afe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:59.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.862+0000 7f5643bb0740 1 -- 172.21.15.78:0/3236109290 shutdown_connections 2024-09-11T00:22:59.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.862+0000 7f5643bb0740 1 -- 172.21.15.78:0/3236109290 wait complete. 2024-09-11T00:22:59.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.862+0000 7f5643bb0740 20 client.16218 trim_cache size 0 max 16384 2024-09-11T00:22:59.881 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-11T00:22:59.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.862+0000 7f56417db640 1 -- 172.21.15.78:0/3275277810 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f56280b54d0 msgr2=0x7f56280b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:59.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.862+0000 7f56417db640 1 --2- 172.21.15.78:0/3275277810 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f56280b54d0 0x7f56280b7990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5624031440 tx=0x7f5624009260 comp rx=0 tx=0).stop 2024-09-11T00:22:59.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.862+0000 7f56417db640 1 -- 172.21.15.78:0/3275277810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f563c109150 msgr2=0x7f563c19eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:22:59.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.862+0000 7f56417db640 1 --2- 172.21.15.78:0/3275277810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f563c109150 0x7f563c19eb70 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f563400cce0 tx=0x7f563400a620 comp rx=0 tx=0).stop 2024-09-11T00:22:59.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.862+0000 7f56417db640 1 -- 172.21.15.78:0/3275277810 shutdown_connections 2024-09-11T00:22:59.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.862+0000 7f56417db640 1 --2- 172.21.15.78:0/3275277810 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f56280b54d0 0x7f56280b7990 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.862+0000 7f56417db640 1 --2- 172.21.15.78:0/3275277810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f563c109150 0x7f563c19eb70 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.863+0000 7f56417db640 1 --2- 172.21.15.78:0/3275277810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f563c1087d0 0x7f563c1997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.863+0000 7f56417db640 1 --2- 172.21.15.78:0/3275277810 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f563c102dc0 0x7f563c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:22:59.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.863+0000 7f56417db640 1 -- 172.21.15.78:0/3275277810 >> 172.21.15.78:0/3275277810 conn(0x7f563c0fe830 msgr2=0x7f563c105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:22:59.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.863+0000 7f56417db640 1 -- 172.21.15.78:0/3275277810 shutdown_connections 2024-09-11T00:22:59.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:22:59.863+0000 7f56417db640 1 -- 172.21.15.78:0/3275277810 wait complete. 2024-09-11T00:23:00.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:22:59 smithi078 ceph-mon[30865]: pgmap v519: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-11T00:23:00.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:22:59 smithi112 ceph-mon[35627]: pgmap v519: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-11T00:23:00.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:22:59 smithi138 ceph-mon[35019]: pgmap v519: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-11T00:23:01.568 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:23:01.568 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:23:01.828 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:23:02.212 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:01 smithi078 ceph-mon[30865]: pgmap v520: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-11T00:23:02.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:01 smithi112 ceph-mon[35627]: pgmap v520: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-11T00:23:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:01 smithi138 ceph-mon[35019]: pgmap v520: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-11T00:23:02.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.293+0000 7f0323eb9640 1 -- 172.21.15.78:0/1636571826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f031c108020 msgr2=0x7f031c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:02.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.293+0000 7f0323eb9640 1 --2- 172.21.15.78:0/1636571826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f031c108020 0x7f031c10e820 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0314009ca0 tx=0x7f031402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.294+0000 7f0323eb9640 1 -- 172.21.15.78:0/1636571826 shutdown_connections 2024-09-11T00:23:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.294+0000 7f0323eb9640 1 --2- 172.21.15.78:0/1636571826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f031c108020 0x7f031c10e820 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.294+0000 7f0323eb9640 1 --2- 172.21.15.78:0/1636571826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f031c1076a0 0x7f031c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.294+0000 7f0323eb9640 1 --2- 172.21.15.78:0/1636571826 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f031c101c90 0x7f031c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.294+0000 7f0323eb9640 1 -- 172.21.15.78:0/1636571826 >> 172.21.15.78:0/1636571826 conn(0x7f031c0fd700 msgr2=0x7f031c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.294+0000 7f0323eb9640 1 -- 172.21.15.78:0/1636571826 shutdown_connections 2024-09-11T00:23:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.294+0000 7f0323eb9640 1 -- 172.21.15.78:0/1636571826 wait complete. 2024-09-11T00:23:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.294+0000 7f0323eb9640 1 Processor -- start 2024-09-11T00:23:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.294+0000 7f0323eb9640 1 -- start start 2024-09-11T00:23:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.295+0000 7f0323eb9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f031c101c90 0x7f031c1980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.295+0000 7f0323eb9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f031c1076a0 0x7f031c198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.295+0000 7f0323eb9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f031c108020 0x7f031c19d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.295+0000 7f0323eb9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f031c111ce0 con 0x7f031c1076a0 2024-09-11T00:23:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.295+0000 7f0323eb9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f031c111b60 con 0x7f031c101c90 2024-09-11T00:23:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.295+0000 7f0323eb9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f031c111e60 con 0x7f031c108020 2024-09-11T00:23:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.295+0000 7f0321454640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f031c1076a0 0x7f031c198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.295+0000 7f0321454640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f031c1076a0 0x7f031c198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48094/0 (socket says 172.21.15.78:48094) 2024-09-11T00:23:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.295+0000 7f0321454640 1 -- 172.21.15.78:0/3416231177 learned_addr learned my addr 172.21.15.78:0/3416231177 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.295+0000 7f0321c55640 1 --2- 172.21.15.78:0/3416231177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f031c101c90 0x7f031c1980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.295+0000 7f0321454640 1 -- 172.21.15.78:0/3416231177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f031c108020 msgr2=0x7f031c19d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.295+0000 7f0321454640 1 --2- 172.21.15.78:0/3416231177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f031c108020 0x7f031c19d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.295+0000 7f0321454640 1 -- 172.21.15.78:0/3416231177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f031c101c90 msgr2=0x7f031c1980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.295+0000 7f0321454640 1 --2- 172.21.15.78:0/3416231177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f031c101c90 0x7f031c1980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.295+0000 7f0321454640 1 -- 172.21.15.78:0/3416231177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031c19e1a0 con 0x7f031c1076a0 2024-09-11T00:23:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.295+0000 7f0321c55640 1 --2- 172.21.15.78:0/3416231177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f031c101c90 0x7f031c1980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.295+0000 7f0321454640 1 --2- 172.21.15.78:0/3416231177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f031c1076a0 0x7f031c198630 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f030c007b50 tx=0x7f030c00e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.295+0000 7f0312ffd640 1 -- 172.21.15.78:0/3416231177 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f030c007c40 con 0x7f031c1076a0 2024-09-11T00:23:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.295+0000 7f0312ffd640 1 -- 172.21.15.78:0/3416231177 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f030c007de0 con 0x7f031c1076a0 2024-09-11T00:23:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.295+0000 7f0323eb9640 1 -- 172.21.15.78:0/3416231177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f031c19e490 con 0x7f031c1076a0 2024-09-11T00:23:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.295+0000 7f0312ffd640 1 -- 172.21.15.78:0/3416231177 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f030c00ace0 con 0x7f031c1076a0 2024-09-11T00:23:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.295+0000 7f0323eb9640 1 -- 172.21.15.78:0/3416231177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f031c06ab30 con 0x7f031c1076a0 2024-09-11T00:23:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.298+0000 7f0312ffd640 1 -- 172.21.15.78:0/3416231177 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f030c014070 con 0x7f031c1076a0 2024-09-11T00:23:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.298+0000 7f032628e740 1 Processor -- start 2024-09-11T00:23:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.298+0000 7f032628e740 1 -- start start 2024-09-11T00:23:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.298+0000 7f032628e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56371eef1ee0 0x56371eef22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.298+0000 7f032628e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56371eef2800 0x56371eefe250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.298+0000 7f032628e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eefe790 0x56371ef00b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.298+0000 7f032628e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56371ee68e60 con 0x56371eefe790 2024-09-11T00:23:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.298+0000 7f032628e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56371ee58290 con 0x56371eef2800 2024-09-11T00:23:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.298+0000 7f032628e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56371ee5c0a0 con 0x56371eef1ee0 2024-09-11T00:23:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.299+0000 7f0321454640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eefe790 0x56371ef00b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.299+0000 7f0321454640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eefe790 0x56371ef00b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48102/0 (socket says 172.21.15.78:48102) 2024-09-11T00:23:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.299+0000 7f0321454640 1 -- 172.21.15.78:0/377716775 learned_addr learned my addr 172.21.15.78:0/377716775 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.299+0000 7f0321c55640 1 --2- 172.21.15.78:0/377716775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56371eef2800 0x56371eefe250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.299+0000 7f0322456640 1 --2- 172.21.15.78:0/377716775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56371eef1ee0 0x56371eef22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.299+0000 7f0321454640 1 -- 172.21.15.78:0/377716775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56371eef1ee0 msgr2=0x56371eef22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.299+0000 7f0321454640 1 --2- 172.21.15.78:0/377716775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56371eef1ee0 0x56371eef22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.299+0000 7f0321454640 1 -- 172.21.15.78:0/377716775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56371eef2800 msgr2=0x56371eefe250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.299+0000 7f0321454640 1 --2- 172.21.15.78:0/377716775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56371eef2800 0x56371eefe250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.299+0000 7f0321454640 1 -- 172.21.15.78:0/377716775 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56371ebb6930 con 0x56371eefe790 2024-09-11T00:23:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.299+0000 7f0312ffd640 1 --2- 172.21.15.78:0/3416231177 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f03080b5450 0x7f03080b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.299+0000 7f0322456640 1 --2- 172.21.15.78:0/3416231177 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f03080b5450 0x7f03080b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:02.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.299+0000 7f0321454640 1 --2- 172.21.15.78:0/377716775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eefe790 0x56371ef00b80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f030c0e49d0 tx=0x7f030c0ed8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed268756c46827e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:02.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.299+0000 7f0312ffd640 1 -- 172.21.15.78:0/3416231177 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f030c0e7320 con 0x7f031c1076a0 2024-09-11T00:23:02.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.299+0000 7f0307fff640 1 -- 172.21.15.78:0/377716775 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f030c0a96f0 con 0x56371eefe790 2024-09-11T00:23:02.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.299+0000 7f0307fff640 1 -- 172.21.15.78:0/377716775 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f030c0ad360 con 0x56371eefe790 2024-09-11T00:23:02.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.299+0000 7f0307fff640 1 -- 172.21.15.78:0/377716775 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f030c0acfc0 con 0x56371eefe790 2024-09-11T00:23:02.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.300+0000 7f032628e740 1 -- 172.21.15.78:0/377716775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eefe790 msgr2=0x56371ef00b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:02.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.300+0000 7f0322456640 1 --2- 172.21.15.78:0/3416231177 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f03080b5450 0x7f03080b7910 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0314009430 tx=0x7f031402f3d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:02.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.300+0000 7f032628e740 1 --2- 172.21.15.78:0/377716775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eefe790 0x56371ef00b80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f030c0e49d0 tx=0x7f030c0ed8e0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.300+0000 7f032628e740 1 -- 172.21.15.78:0/377716775 shutdown_connections 2024-09-11T00:23:02.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.300+0000 7f032628e740 1 --2- 172.21.15.78:0/377716775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eefe790 0x56371ef00b80 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.300+0000 7f032628e740 1 --2- 172.21.15.78:0/377716775 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56371eef2800 0x56371eefe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.300+0000 7f032628e740 1 --2- 172.21.15.78:0/377716775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56371eef1ee0 0x56371eef22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.300+0000 7f032628e740 1 -- 172.21.15.78:0/377716775 >> 172.21.15.78:0/377716775 conn(0x56371eeefd10 msgr2=0x56371eef0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.300+0000 7f032628e740 1 -- 172.21.15.78:0/377716775 shutdown_connections 2024-09-11T00:23:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.300+0000 7f032628e740 1 -- 172.21.15.78:0/377716775 wait complete. 2024-09-11T00:23:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.301+0000 7f032628e740 1 -- start start 2024-09-11T00:23:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.301+0000 7f032628e740 1 Processor -- start 2024-09-11T00:23:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.301+0000 7f032628e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56371eef1ee0 0x56371eefb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.301+0000 7f032628e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56371eef2800 0x56371eefbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.301+0000 7f032628e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eefe790 0x56371eefc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.301+0000 7f032628e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56371ecb9890 con 0x56371eefe790 2024-09-11T00:23:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.301+0000 7f032628e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56371edf2d40 con 0x56371eef2800 2024-09-11T00:23:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.301+0000 7f032628e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56371ef01440 con 0x56371eef1ee0 2024-09-11T00:23:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.301+0000 7f032628e740 10 client.0 _ll_register_callbacks cb 0x56371ee56c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:23:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.301+0000 7f0322456640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eefe790 0x56371eefc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.301+0000 7f0322456640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eefe790 0x56371eefc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48118/0 (socket says 172.21.15.78:48118) 2024-09-11T00:23:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.301+0000 7f0322456640 1 -- 172.21.15.78:0/4067053486 learned_addr learned my addr 172.21.15.78:0/4067053486 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.301+0000 7f0321454640 1 --2- 172.21.15.78:0/4067053486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56371eef2800 0x56371eefbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.302+0000 7f0321c55640 1 --2- 172.21.15.78:0/4067053486 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56371eef1ee0 0x56371eefb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.302+0000 7f0322456640 1 -- 172.21.15.78:0/4067053486 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56371eef1ee0 msgr2=0x56371eefb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.302+0000 7f0322456640 1 --2- 172.21.15.78:0/4067053486 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56371eef1ee0 0x56371eefb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.302+0000 7f0322456640 1 -- 172.21.15.78:0/4067053486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56371eef2800 msgr2=0x56371eefbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.302+0000 7f0322456640 1 --2- 172.21.15.78:0/4067053486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56371eef2800 0x56371eefbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.302+0000 7f0322456640 1 -- 172.21.15.78:0/4067053486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56371ef0a870 con 0x56371eefe790 2024-09-11T00:23:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.302+0000 7f0321c55640 1 --2- 172.21.15.78:0/4067053486 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56371eef1ee0 0x56371eefb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.302+0000 7f0322456640 1 --2- 172.21.15.78:0/4067053486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eefe790 0x56371eefc210 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f03140316f0 tx=0x7f0314009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ca7919168077c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.302+0000 7f03057fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:23:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.302+0000 7f03057fa640 1 -- 172.21.15.78:0/4067053486 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031404e070 con 0x56371eefe790 2024-09-11T00:23:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.302+0000 7f03057fa640 1 -- 172.21.15.78:0/4067053486 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f03140047c0 con 0x56371eefe790 2024-09-11T00:23:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.302+0000 7f032628e740 1 -- 172.21.15.78:0/4067053486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f030c0ad360 con 0x56371eefe790 2024-09-11T00:23:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.302+0000 7f03057fa640 1 -- 172.21.15.78:0/4067053486 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f031402f660 con 0x56371eefe790 2024-09-11T00:23:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.302+0000 7f032628e740 10 client.16230 fetch_fsmap learned FSMap version 20 2024-09-11T00:23:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.302+0000 7f032628e740 1 -- 172.21.15.78:0/4067053486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56371ef0d200 con 0x56371eefe790 2024-09-11T00:23:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.303+0000 7f03057fa640 1 -- 172.21.15.78:0/4067053486 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f030c0ad360 con 0x56371eefe790 2024-09-11T00:23:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.303+0000 7f03057fa640 1 -- 172.21.15.78:0/4067053486 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f0314043040 con 0x56371eefe790 2024-09-11T00:23:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.303+0000 7f032628e740 10 client.16230 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:23:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.303+0000 7f032628e740 10 client.16230 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:23:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.303+0000 7f032628e740 20 client.16230 populate_metadata read hostname 'smithi078' 2024-09-11T00:23:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.303+0000 7f032628e740 1 --2- 172.21.15.78:0/4067053486 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56371ef0e6b0 0x56371ef10b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.303+0000 7f032628e740 4 client.16230 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:23:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.303+0000 7f032628e740 1 -- 172.21.15.78:0/4067053486 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56371ee6adb0 con 0x56371ef0e6b0 2024-09-11T00:23:02.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.303+0000 7f0321c55640 1 --2- 172.21.15.78:0/4067053486 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56371ef0e6b0 0x56371ef10b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:02.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.304+0000 7f0321c55640 1 --2- 172.21.15.78:0/4067053486 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56371ef0e6b0 0x56371ef10b10 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61a22fa33743da82 server_cookie=396ab4273309081d in_seq=0 out_seq=0 2024-09-11T00:23:02.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.304+0000 7f03057fa640 10 client.16230 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.304+0000 7f03057fa640 1 -- 172.21.15.78:0/4067053486 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56371ee6adb0 con 0x56371ef0e6b0 2024-09-11T00:23:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.304+0000 7f03057fa640 10 client.16230 handle_command_reply: tid=0 2024-09-11T00:23:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.305+0000 7f032628e740 1 client.16230 shutdown 2024-09-11T00:23:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.305+0000 7f032628e740 1 -- 172.21.15.78:0/4067053486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eefe790 msgr2=0x56371eefc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.305+0000 7f032628e740 1 --2- 172.21.15.78:0/4067053486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eefe790 0x56371eefc210 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f03140316f0 tx=0x7f0314009360 comp rx=0 tx=0).stop 2024-09-11T00:23:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.305+0000 7f032628e740 1 -- 172.21.15.78:0/4067053486 shutdown_connections 2024-09-11T00:23:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.305+0000 7f032628e740 1 --2- 172.21.15.78:0/4067053486 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56371ef0e6b0 0x56371ef10b10 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.305+0000 7f032628e740 1 --2- 172.21.15.78:0/4067053486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eefe790 0x56371eefc210 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.305+0000 7f032628e740 1 --2- 172.21.15.78:0/4067053486 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56371eef2800 0x56371eefbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.305+0000 7f03057fa640 0 client.16230 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.305+0000 7f032628e740 1 --2- 172.21.15.78:0/4067053486 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56371eef1ee0 0x56371eefb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.305+0000 7f032628e740 1 -- 172.21.15.78:0/4067053486 >> 172.21.15.78:0/4067053486 conn(0x56371eeefd10 msgr2=0x56371eeeef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.305+0000 7f032628e740 1 -- 172.21.15.78:0/4067053486 shutdown_connections 2024-09-11T00:23:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.305+0000 7f032628e740 1 -- 172.21.15.78:0/4067053486 wait complete. 2024-09-11T00:23:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.305+0000 7f032628e740 20 client.16230 trim_cache size 0 max 16384 2024-09-11T00:23:02.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.322+0000 7f032628e740 1 Processor -- start 2024-09-11T00:23:02.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.322+0000 7f032628e740 1 -- start start 2024-09-11T00:23:02.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.323+0000 7f032628e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56371eef1ee0 0x56371eef1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:02.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.323+0000 7f032628e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56371eef2800 0x56371ef06ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:02.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.323+0000 7f032628e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eefe790 0x56371ef06ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:02.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.323+0000 7f032628e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1aa540 con 0x56371eefe790 2024-09-11T00:23:02.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.323+0000 7f032628e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1acdc0 con 0x56371eef1ee0 2024-09-11T00:23:02.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.323+0000 7f032628e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1aabb0 con 0x56371eef2800 2024-09-11T00:23:02.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.323+0000 7f0322456640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eefe790 0x56371ef06ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:02.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.323+0000 7f0322456640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eefe790 0x56371ef06ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48128/0 (socket says 172.21.15.78:48128) 2024-09-11T00:23:02.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.323+0000 7f0322456640 1 -- 172.21.15.78:0/1398101564 learned_addr learned my addr 172.21.15.78:0/1398101564 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:02.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.323+0000 7f0322456640 1 -- 172.21.15.78:0/1398101564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56371eef2800 msgr2=0x56371ef06ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:02.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.323+0000 7f0322456640 1 --2- 172.21.15.78:0/1398101564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56371eef2800 0x56371ef06ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.323+0000 7f0322456640 1 -- 172.21.15.78:0/1398101564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56371eef1ee0 msgr2=0x56371eef1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:02.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.323+0000 7f0322456640 1 --2- 172.21.15.78:0/1398101564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56371eef1ee0 0x56371eef1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.323+0000 7f0322456640 1 -- 172.21.15.78:0/1398101564 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56371eef9c90 con 0x56371eefe790 2024-09-11T00:23:02.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.323+0000 7f0322456640 1 --2- 172.21.15.78:0/1398101564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eefe790 0x56371ef06ff0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f031402ade0 tx=0x7f0314030e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b74dbf17c54e898 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:02.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.323+0000 7f03077fe640 1 -- 172.21.15.78:0/1398101564 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031404e070 con 0x56371eefe790 2024-09-11T00:23:02.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.323+0000 7f03077fe640 1 -- 172.21.15.78:0/1398101564 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0314036040 con 0x56371eefe790 2024-09-11T00:23:02.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.323+0000 7f03077fe640 1 -- 172.21.15.78:0/1398101564 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031402fa60 con 0x56371eefe790 2024-09-11T00:23:02.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.324+0000 7f032628e740 1 -- 172.21.15.78:0/1398101564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eefe790 msgr2=0x56371ef06ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:02.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.324+0000 7f032628e740 1 --2- 172.21.15.78:0/1398101564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eefe790 0x56371ef06ff0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f031402ade0 tx=0x7f0314030e90 comp rx=0 tx=0).stop 2024-09-11T00:23:02.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.324+0000 7f032628e740 1 -- 172.21.15.78:0/1398101564 shutdown_connections 2024-09-11T00:23:02.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.324+0000 7f032628e740 1 --2- 172.21.15.78:0/1398101564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eefe790 0x56371ef06ff0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.324+0000 7f032628e740 1 --2- 172.21.15.78:0/1398101564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56371eef2800 0x56371ef06ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.324+0000 7f032628e740 1 --2- 172.21.15.78:0/1398101564 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56371eef1ee0 0x56371eef1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.324+0000 7f032628e740 1 -- 172.21.15.78:0/1398101564 >> 172.21.15.78:0/1398101564 conn(0x56371eeefd10 msgr2=0x56371eef0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:02.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.324+0000 7f032628e740 1 -- 172.21.15.78:0/1398101564 shutdown_connections 2024-09-11T00:23:02.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.324+0000 7f032628e740 1 -- 172.21.15.78:0/1398101564 wait complete. 2024-09-11T00:23:02.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.324+0000 7f032628e740 1 -- start start 2024-09-11T00:23:02.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.324+0000 7f032628e740 1 Processor -- start 2024-09-11T00:23:02.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.325+0000 7f032628e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eef1ee0 0x56371ef15500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:02.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.325+0000 7f032628e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56371eef2800 0x56371ef15a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:02.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.325+0000 7f032628e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56371eefe790 0x56371ef15f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:02.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.325+0000 7f032628e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1ab280 con 0x56371eef1ee0 2024-09-11T00:23:02.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.325+0000 7f032628e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1ac6f0 con 0x56371eefe790 2024-09-11T00:23:02.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.325+0000 7f032628e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1ab950 con 0x56371eef2800 2024-09-11T00:23:02.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.325+0000 7f032628e740 10 client.0 _ll_register_callbacks cb 0x7f0314009920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:23:02.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.325+0000 7f0321c55640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eef1ee0 0x56371ef15500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:02.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.325+0000 7f0321c55640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eef1ee0 0x56371ef15500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48144/0 (socket says 172.21.15.78:48144) 2024-09-11T00:23:02.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.325+0000 7f0321c55640 1 -- 172.21.15.78:0/368393623 learned_addr learned my addr 172.21.15.78:0/368393623 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:02.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.325+0000 7f0322456640 1 --2- 172.21.15.78:0/368393623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56371eefe790 0x56371ef15f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:02.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.325+0000 7f0321454640 1 --2- 172.21.15.78:0/368393623 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56371eef2800 0x56371ef15a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:02.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.325+0000 7f0321c55640 1 -- 172.21.15.78:0/368393623 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56371eef2800 msgr2=0x56371ef15a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:02.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.325+0000 7f0321c55640 1 --2- 172.21.15.78:0/368393623 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56371eef2800 0x56371ef15a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.325+0000 7f0321c55640 1 -- 172.21.15.78:0/368393623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56371eefe790 msgr2=0x56371ef15f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:02.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.325+0000 7f0321c55640 1 --2- 172.21.15.78:0/368393623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56371eefe790 0x56371ef15f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.325+0000 7f0321c55640 1 -- 172.21.15.78:0/368393623 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56371ef7f820 con 0x56371eef1ee0 2024-09-11T00:23:02.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.325+0000 7f0321454640 1 --2- 172.21.15.78:0/368393623 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56371eef2800 0x56371ef15a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:02.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.325+0000 7f0322456640 1 --2- 172.21.15.78:0/368393623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56371eefe790 0x56371ef15f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:02.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.325+0000 7f0321c55640 1 --2- 172.21.15.78:0/368393623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eef1ee0 0x56371ef15500 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f031800aa30 tx=0x7f0318016800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7089dd30140b3b8e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:02.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.325+0000 7f03057fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:23:02.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.326+0000 7f03057fa640 1 -- 172.21.15.78:0/368393623 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03180059c0 con 0x56371eef1ee0 2024-09-11T00:23:02.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.326+0000 7f03057fa640 1 -- 172.21.15.78:0/368393623 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f0318005b60 con 0x56371eef1ee0 2024-09-11T00:23:02.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.326+0000 7f032628e740 1 -- 172.21.15.78:0/368393623 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0314036040 con 0x56371eef1ee0 2024-09-11T00:23:02.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.326+0000 7f03057fa640 1 -- 172.21.15.78:0/368393623 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0318005d60 con 0x56371eef1ee0 2024-09-11T00:23:02.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.326+0000 7f032628e740 10 client.16236 fetch_fsmap learned FSMap version 20 2024-09-11T00:23:02.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.326+0000 7f032628e740 1 -- 172.21.15.78:0/368393623 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56371ef80bc0 con 0x56371eef1ee0 2024-09-11T00:23:02.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.326+0000 7f03057fa640 1 -- 172.21.15.78:0/368393623 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0314036040 con 0x56371eef1ee0 2024-09-11T00:23:02.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.326+0000 7f03057fa640 1 -- 172.21.15.78:0/368393623 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f031802b020 con 0x56371eef1ee0 2024-09-11T00:23:02.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.326+0000 7f032628e740 10 client.16236 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:23:02.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.326+0000 7f032628e740 10 client.16236 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:23:02.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.326+0000 7f032628e740 20 client.16236 populate_metadata read hostname 'smithi078' 2024-09-11T00:23:02.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.326+0000 7f032628e740 1 --2- 172.21.15.78:0/368393623 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56371ef81320 0x56371ef83740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:02.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.326+0000 7f032628e740 4 client.16236 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:23:02.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.326+0000 7f032628e740 1 -- 172.21.15.78:0/368393623 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56371ee66860 con 0x56371ef81320 2024-09-11T00:23:02.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.327+0000 7f0321454640 1 --2- 172.21.15.78:0/368393623 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56371ef81320 0x56371ef83740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:02.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.327+0000 7f0321454640 1 --2- 172.21.15.78:0/368393623 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56371ef81320 0x56371ef83740 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e8fbfd4e4b7d392 server_cookie=80d3d7852487ab22 in_seq=0 out_seq=0 2024-09-11T00:23:02.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.327+0000 7f03057fa640 10 client.16236 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:02.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.328+0000 7f03057fa640 1 -- 172.21.15.78:0/368393623 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56371ee66860 con 0x56371ef81320 2024-09-11T00:23:02.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.328+0000 7f03057fa640 10 client.16236 handle_command_reply: tid=0 2024-09-11T00:23:02.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.328+0000 7f032628e740 1 client.16236 shutdown 2024-09-11T00:23:02.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.329+0000 7f032628e740 1 -- 172.21.15.78:0/368393623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eef1ee0 msgr2=0x56371ef15500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:02.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.329+0000 7f032628e740 1 --2- 172.21.15.78:0/368393623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eef1ee0 0x56371ef15500 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f031800aa30 tx=0x7f0318016800 comp rx=0 tx=0).stop 2024-09-11T00:23:02.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.329+0000 7f032628e740 1 -- 172.21.15.78:0/368393623 shutdown_connections 2024-09-11T00:23:02.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.329+0000 7f032628e740 1 --2- 172.21.15.78:0/368393623 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56371ef81320 0x56371ef83740 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.329+0000 7f032628e740 1 --2- 172.21.15.78:0/368393623 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56371eefe790 0x56371ef15f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.329+0000 7f032628e740 1 --2- 172.21.15.78:0/368393623 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56371eef2800 0x56371ef15a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.329+0000 7f032628e740 1 --2- 172.21.15.78:0/368393623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56371eef1ee0 0x56371ef15500 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.329+0000 7f03057fa640 0 client.16236 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:02.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.329+0000 7f032628e740 1 -- 172.21.15.78:0/368393623 >> 172.21.15.78:0/368393623 conn(0x56371eeefd10 msgr2=0x56371eefcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:02.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.329+0000 7f032628e740 1 -- 172.21.15.78:0/368393623 shutdown_connections 2024-09-11T00:23:02.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.329+0000 7f032628e740 1 -- 172.21.15.78:0/368393623 wait complete. 2024-09-11T00:23:02.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.329+0000 7f032628e740 20 client.16236 trim_cache size 0 max 16384 2024-09-11T00:23:02.336 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:23:02.336 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-11T00:23:02.336 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "1b9391c2-08f3-479a-9538-deea28f7743b", 2024-09-11T00:23:02.336 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-11T00:23:02.336 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:23:02.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.330+0000 7f0323eb9640 1 -- 172.21.15.78:0/3416231177 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f03080b5450 msgr2=0x7f03080b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:02.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.330+0000 7f0323eb9640 1 --2- 172.21.15.78:0/3416231177 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f03080b5450 0x7f03080b7910 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0314009430 tx=0x7f031402f3d0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.330+0000 7f0323eb9640 1 -- 172.21.15.78:0/3416231177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f031c1076a0 msgr2=0x7f031c198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:02.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.330+0000 7f0323eb9640 1 --2- 172.21.15.78:0/3416231177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f031c1076a0 0x7f031c198630 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f030c007b50 tx=0x7f030c00e420 comp rx=0 tx=0).stop 2024-09-11T00:23:02.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.330+0000 7f0323eb9640 1 -- 172.21.15.78:0/3416231177 shutdown_connections 2024-09-11T00:23:02.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.330+0000 7f0323eb9640 1 --2- 172.21.15.78:0/3416231177 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f03080b5450 0x7f03080b7910 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.330+0000 7f0323eb9640 1 --2- 172.21.15.78:0/3416231177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f031c108020 0x7f031c19d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.330+0000 7f0323eb9640 1 --2- 172.21.15.78:0/3416231177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f031c1076a0 0x7f031c198630 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.330+0000 7f0323eb9640 1 --2- 172.21.15.78:0/3416231177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f031c101c90 0x7f031c1980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:02.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.330+0000 7f0323eb9640 1 -- 172.21.15.78:0/3416231177 >> 172.21.15.78:0/3416231177 conn(0x7f031c0fd700 msgr2=0x7f031c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:02.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.330+0000 7f0323eb9640 1 -- 172.21.15.78:0/3416231177 shutdown_connections 2024-09-11T00:23:02.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:02.330+0000 7f0323eb9640 1 -- 172.21.15.78:0/3416231177 wait complete. 2024-09-11T00:23:03.012 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:23:03.256 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:23:03.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:03 smithi078 ceph-mon[30865]: scrub queued for path: / 2024-09-11T00:23:03.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:03 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:23:03.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:03 smithi078 ceph-mon[30865]: scrub summary: active paths [/] 2024-09-11T00:23:03.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:03 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:23:03.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:03 smithi112 ceph-mon[35627]: scrub queued for path: / 2024-09-11T00:23:03.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:03 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:23:03.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:03 smithi112 ceph-mon[35627]: scrub summary: active paths [/] 2024-09-11T00:23:03.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:03 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:23:03.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.758+0000 7f36abf91640 1 -- 172.21.15.78:0/1632165069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36a4101880 msgr2=0x7f36a4101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:03.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.758+0000 7f36abf91640 1 --2- 172.21.15.78:0/1632165069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36a4101880 0x7f36a4101c60 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3698009900 tx=0x7f369802a410 comp rx=0 tx=0).stop 2024-09-11T00:23:03.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.758+0000 7f36abf91640 1 -- 172.21.15.78:0/1632165069 shutdown_connections 2024-09-11T00:23:03.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.758+0000 7f36abf91640 1 --2- 172.21.15.78:0/1632165069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36a410d0e0 0x7f36a410f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.758+0000 7f36abf91640 1 --2- 172.21.15.78:0/1632165069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36a4102230 0x7f36a410c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.758+0000 7f36abf91640 1 --2- 172.21.15.78:0/1632165069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36a4101880 0x7f36a4101c60 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.758+0000 7f36abf91640 1 -- 172.21.15.78:0/1632165069 >> 172.21.15.78:0/1632165069 conn(0x7f36a4076e60 msgr2=0x7f36a4077270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:03.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.758+0000 7f36abf91640 1 -- 172.21.15.78:0/1632165069 shutdown_connections 2024-09-11T00:23:03.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.758+0000 7f36abf91640 1 -- 172.21.15.78:0/1632165069 wait complete. 2024-09-11T00:23:03.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.759+0000 7f36abf91640 1 Processor -- start 2024-09-11T00:23:03.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.759+0000 7f36abf91640 1 -- start start 2024-09-11T00:23:03.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.759+0000 7f36abf91640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36a4101880 0x7f36a4102850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:03.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.759+0000 7f36abf91640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36a4102230 0x7f36a4102d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:03.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.759+0000 7f36abf91640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36a410d0e0 0x7f36a41032d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:03.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.759+0000 7f36abf91640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f36a4112e70 con 0x7f36a410d0e0 2024-09-11T00:23:03.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.759+0000 7f36abf91640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f36a4112cf0 con 0x7f36a4101880 2024-09-11T00:23:03.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.759+0000 7f36abf91640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f36a4112ff0 con 0x7f36a4102230 2024-09-11T00:23:03.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.759+0000 7f36aa52e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36a410d0e0 0x7f36a41032d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:03.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.759+0000 7f36aa52e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36a410d0e0 0x7f36a41032d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48174/0 (socket says 172.21.15.78:48174) 2024-09-11T00:23:03.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.759+0000 7f36aa52e640 1 -- 172.21.15.78:0/127124658 learned_addr learned my addr 172.21.15.78:0/127124658 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:03.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.759+0000 7f36a9d2d640 1 --2- 172.21.15.78:0/127124658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36a4101880 0x7f36a4102850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:03.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.759+0000 7f36a952c640 1 --2- 172.21.15.78:0/127124658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36a4102230 0x7f36a4102d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:03.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.759+0000 7f36aa52e640 1 -- 172.21.15.78:0/127124658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36a4102230 msgr2=0x7f36a4102d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.759+0000 7f36aa52e640 1 --2- 172.21.15.78:0/127124658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36a4102230 0x7f36a4102d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.759+0000 7f36aa52e640 1 -- 172.21.15.78:0/127124658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36a4101880 msgr2=0x7f36a4102850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.759+0000 7f36aa52e640 1 --2- 172.21.15.78:0/127124658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36a4101880 0x7f36a4102850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.759+0000 7f36aa52e640 1 -- 172.21.15.78:0/127124658 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a41a78a0 con 0x7f36a410d0e0 2024-09-11T00:23:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.759+0000 7f36a952c640 1 --2- 172.21.15.78:0/127124658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36a4102230 0x7f36a4102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.759+0000 7f36a9d2d640 1 --2- 172.21.15.78:0/127124658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36a4101880 0x7f36a4102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.760+0000 7f36aa52e640 1 --2- 172.21.15.78:0/127124658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36a410d0e0 0x7f36a41032d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f369c00b970 tx=0x7f369c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.760+0000 7f3696ffd640 1 -- 172.21.15.78:0/127124658 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c019070 con 0x7f36a410d0e0 2024-09-11T00:23:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.760+0000 7f3696ffd640 1 -- 172.21.15.78:0/127124658 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f369c014440 con 0x7f36a410d0e0 2024-09-11T00:23:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.760+0000 7f36abf91640 1 -- 172.21.15.78:0/127124658 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36a41a7b90 con 0x7f36a410d0e0 2024-09-11T00:23:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.760+0000 7f3696ffd640 1 -- 172.21.15.78:0/127124658 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c0075d0 con 0x7f36a410d0e0 2024-09-11T00:23:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.760+0000 7f36abf91640 1 -- 172.21.15.78:0/127124658 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36a41a80d0 con 0x7f36a410d0e0 2024-09-11T00:23:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.763+0000 7f36ae366740 1 Processor -- start 2024-09-11T00:23:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.763+0000 7f3696ffd640 1 -- 172.21.15.78:0/127124658 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f369c00cb40 con 0x7f36a410d0e0 2024-09-11T00:23:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.763+0000 7f36ae366740 1 -- start start 2024-09-11T00:23:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.763+0000 7f36ae366740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dd786220a0 0x55dd78622480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.763+0000 7f36ae366740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dd786229c0 0x55dd7862e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.763+0000 7f36ae366740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd7862e950 0x55dd78630d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.763+0000 7f36ae366740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55dd78598e50 con 0x55dd7862e950 2024-09-11T00:23:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.764+0000 7f36ae366740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55dd78588280 con 0x55dd786220a0 2024-09-11T00:23:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.764+0000 7f36ae366740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55dd7858c090 con 0x55dd786229c0 2024-09-11T00:23:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.764+0000 7f36a952c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd7862e950 0x55dd78630d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.764+0000 7f36a952c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd7862e950 0x55dd78630d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48176/0 (socket says 172.21.15.78:48176) 2024-09-11T00:23:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.764+0000 7f36a952c640 1 -- 172.21.15.78:0/1596697762 learned_addr learned my addr 172.21.15.78:0/1596697762 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.764+0000 7f36a9d2d640 1 --2- 172.21.15.78:0/1596697762 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dd786229c0 0x55dd7862e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.764+0000 7f36a952c640 1 --2- 172.21.15.78:0/1596697762 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dd786220a0 0x55dd78622480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.764+0000 7f3696ffd640 1 --2- 172.21.15.78:0/127124658 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f36900b54d0 0x7f36900b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.764+0000 7f36a952c640 1 -- 172.21.15.78:0/1596697762 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dd786229c0 msgr2=0x55dd7862e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.764+0000 7f36a952c640 1 --2- 172.21.15.78:0/1596697762 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dd786229c0 0x55dd7862e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.764+0000 7f36a952c640 1 -- 172.21.15.78:0/1596697762 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dd786220a0 msgr2=0x55dd78622480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.764+0000 7f36a952c640 1 --2- 172.21.15.78:0/1596697762 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dd786220a0 0x55dd78622480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.764+0000 7f36a952c640 1 -- 172.21.15.78:0/1596697762 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd782e6650 con 0x55dd7862e950 2024-09-11T00:23:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.764+0000 7f36aa52e640 1 --2- 172.21.15.78:0/127124658 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f36900b54d0 0x7f36900b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.764+0000 7f3696ffd640 1 -- 172.21.15.78:0/127124658 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f369c0e57b0 con 0x7f36a410d0e0 2024-09-11T00:23:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.764+0000 7f36a952c640 1 --2- 172.21.15.78:0/1596697762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd7862e950 0x55dd78630d40 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f36a000cf60 tx=0x7f36a000c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce95b32051fb43b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.765+0000 7f368ffff640 1 -- 172.21.15.78:0/1596697762 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a001b070 con 0x55dd7862e950 2024-09-11T00:23:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.765+0000 7f368ffff640 1 -- 172.21.15.78:0/1596697762 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36a00168a0 con 0x55dd7862e950 2024-09-11T00:23:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.765+0000 7f368ffff640 1 -- 172.21.15.78:0/1596697762 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a000f040 con 0x55dd7862e950 2024-09-11T00:23:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.765+0000 7f36aa52e640 1 --2- 172.21.15.78:0/127124658 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f36900b54d0 0x7f36900b7990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f369c0e2fd0 tx=0x7f369c011000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.765+0000 7f36ae366740 1 -- 172.21.15.78:0/1596697762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd7862e950 msgr2=0x55dd78630d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.765+0000 7f36ae366740 1 --2- 172.21.15.78:0/1596697762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd7862e950 0x55dd78630d40 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f36a000cf60 tx=0x7f36a000c3d0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.765+0000 7f36ae366740 1 -- 172.21.15.78:0/1596697762 shutdown_connections 2024-09-11T00:23:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.765+0000 7f36ae366740 1 --2- 172.21.15.78:0/1596697762 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd7862e950 0x55dd78630d40 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.765+0000 7f36ae366740 1 --2- 172.21.15.78:0/1596697762 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dd786229c0 0x55dd7862e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.765+0000 7f36ae366740 1 --2- 172.21.15.78:0/1596697762 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dd786220a0 0x55dd78622480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.765+0000 7f36ae366740 1 -- 172.21.15.78:0/1596697762 >> 172.21.15.78:0/1596697762 conn(0x55dd7861fed0 msgr2=0x55dd78621070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.766+0000 7f36ae366740 1 -- 172.21.15.78:0/1596697762 shutdown_connections 2024-09-11T00:23:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.766+0000 7f36ae366740 1 -- 172.21.15.78:0/1596697762 wait complete. 2024-09-11T00:23:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.766+0000 7f36ae366740 1 -- start start 2024-09-11T00:23:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.766+0000 7f36ae366740 1 Processor -- start 2024-09-11T00:23:03.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.766+0000 7f36ae366740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd786220a0 0x55dd7862e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:03.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.766+0000 7f36ae366740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dd786229c0 0x55dd7862b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:03.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.766+0000 7f36ae366740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dd7862e950 0x55dd7862bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:03.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.766+0000 7f36ae366740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55dd783e9700 con 0x55dd786220a0 2024-09-11T00:23:03.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.766+0000 7f36ae366740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55dd78523110 con 0x55dd786229c0 2024-09-11T00:23:03.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.766+0000 7f36ae366740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55dd786315d0 con 0x55dd7862e950 2024-09-11T00:23:03.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.766+0000 7f36ae366740 10 client.0 _ll_register_callbacks cb 0x55dd7853c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:23:03.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.767+0000 7f36a952c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd786220a0 0x55dd7862e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:03.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.767+0000 7f36a952c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd786220a0 0x55dd7862e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48178/0 (socket says 172.21.15.78:48178) 2024-09-11T00:23:03.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.767+0000 7f36a952c640 1 -- 172.21.15.78:0/95845542 learned_addr learned my addr 172.21.15.78:0/95845542 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:03.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.767+0000 7f36a9d2d640 1 --2- 172.21.15.78:0/95845542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dd786229c0 0x55dd7862b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:03.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.767+0000 7f36a952c640 1 --2- 172.21.15.78:0/95845542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dd7862e950 0x55dd7862bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:03.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.767+0000 7f36a952c640 1 -- 172.21.15.78:0/95845542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dd7862e950 msgr2=0x55dd7862bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:03.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.767+0000 7f36a952c640 1 --2- 172.21.15.78:0/95845542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dd7862e950 0x55dd7862bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.767+0000 7f36a952c640 1 -- 172.21.15.78:0/95845542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dd786229c0 msgr2=0x55dd7862b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:03.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.767+0000 7f36a952c640 1 --2- 172.21.15.78:0/95845542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dd786229c0 0x55dd7862b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.767+0000 7f36a952c640 1 -- 172.21.15.78:0/95845542 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd78550c40 con 0x55dd786220a0 2024-09-11T00:23:03.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.767+0000 7f36a952c640 1 --2- 172.21.15.78:0/95845542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd786220a0 0x55dd7862e270 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f36a0015490 tx=0x7f36a0015390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9280fcd35aabb175 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:03.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.767+0000 7f368d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:23:03.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.767+0000 7f368d7fa640 1 -- 172.21.15.78:0/95845542 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a001b070 con 0x55dd786220a0 2024-09-11T00:23:03.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.767+0000 7f368d7fa640 1 -- 172.21.15.78:0/95845542 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f36a0015530 con 0x55dd786220a0 2024-09-11T00:23:03.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.767+0000 7f36ae366740 1 -- 172.21.15.78:0/95845542 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36a00168a0 con 0x55dd786220a0 2024-09-11T00:23:03.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.768+0000 7f368d7fa640 1 -- 172.21.15.78:0/95845542 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f36a000c040 con 0x55dd786220a0 2024-09-11T00:23:03.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.768+0000 7f36ae366740 10 client.16248 fetch_fsmap learned FSMap version 20 2024-09-11T00:23:03.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.768+0000 7f36ae366740 1 -- 172.21.15.78:0/95845542 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55dd7863cf60 con 0x55dd786220a0 2024-09-11T00:23:03.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.768+0000 7f368d7fa640 1 -- 172.21.15.78:0/95845542 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36a00168a0 con 0x55dd786220a0 2024-09-11T00:23:03.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.768+0000 7f368d7fa640 1 -- 172.21.15.78:0/95845542 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f36a002b030 con 0x55dd786220a0 2024-09-11T00:23:03.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.768+0000 7f36ae366740 10 client.16248 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:23:03.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.768+0000 7f36ae366740 10 client.16248 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:23:03.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.768+0000 7f36ae366740 20 client.16248 populate_metadata read hostname 'smithi078' 2024-09-11T00:23:03.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.768+0000 7f36ae366740 1 --2- 172.21.15.78:0/95845542 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55dd7863e310 0x55dd78640700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:03.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.768+0000 7f36ae366740 4 client.16248 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:23:03.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.768+0000 7f36ae366740 1 -- 172.21.15.78:0/95845542 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd7859ada0 con 0x55dd7863e310 2024-09-11T00:23:03.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.768+0000 7f36a9d2d640 1 --2- 172.21.15.78:0/95845542 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55dd7863e310 0x55dd78640700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:03.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.769+0000 7f368d7fa640 10 client.16248 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:03.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.769+0000 7f36a9d2d640 1 --2- 172.21.15.78:0/95845542 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55dd7863e310 0x55dd78640700 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28a220b23599366e server_cookie=2c4ca72f87b652f8 in_seq=0 out_seq=0 2024-09-11T00:23:03.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.769+0000 7f368d7fa640 1 -- 172.21.15.78:0/95845542 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dd7859ada0 con 0x55dd7863e310 2024-09-11T00:23:03.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.769+0000 7f368d7fa640 10 client.16248 handle_command_reply: tid=0 2024-09-11T00:23:03.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.769+0000 7f36ae366740 1 client.16248 shutdown 2024-09-11T00:23:03.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.769+0000 7f36ae366740 1 -- 172.21.15.78:0/95845542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd786220a0 msgr2=0x55dd7862e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:03.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.769+0000 7f36ae366740 1 --2- 172.21.15.78:0/95845542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd786220a0 0x55dd7862e270 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f36a0015490 tx=0x7f36a0015390 comp rx=0 tx=0).stop 2024-09-11T00:23:03.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.770+0000 7f36ae366740 1 -- 172.21.15.78:0/95845542 shutdown_connections 2024-09-11T00:23:03.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.770+0000 7f36ae366740 1 --2- 172.21.15.78:0/95845542 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55dd7863e310 0x55dd78640700 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.770+0000 7f36ae366740 1 --2- 172.21.15.78:0/95845542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dd7862e950 0x55dd7862bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.770+0000 7f36ae366740 1 --2- 172.21.15.78:0/95845542 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dd786229c0 0x55dd7862b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.770+0000 7f368d7fa640 0 client.16248 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:03.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.770+0000 7f36ae366740 1 --2- 172.21.15.78:0/95845542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd786220a0 0x55dd7862e270 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.770+0000 7f36ae366740 1 -- 172.21.15.78:0/95845542 >> 172.21.15.78:0/95845542 conn(0x55dd7861fed0 msgr2=0x55dd78625a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:03.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.770+0000 7f36ae366740 1 -- 172.21.15.78:0/95845542 shutdown_connections 2024-09-11T00:23:03.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.770+0000 7f36ae366740 1 -- 172.21.15.78:0/95845542 wait complete. 2024-09-11T00:23:03.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.770+0000 7f36ae366740 20 client.16248 trim_cache size 0 max 16384 2024-09-11T00:23:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.787+0000 7f36ae366740 1 Processor -- start 2024-09-11T00:23:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.787+0000 7f36ae366740 1 -- start start 2024-09-11T00:23:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.788+0000 7f36ae366740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd786220a0 0x55dd7861f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.788+0000 7f36ae366740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dd786229c0 0x55dd786288d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.788+0000 7f36ae366740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dd7862e950 0x55dd78628e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.788+0000 7f36ae366740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f36a41aea20 con 0x55dd786220a0 2024-09-11T00:23:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.788+0000 7f36ae366740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f36a41b12a0 con 0x55dd786229c0 2024-09-11T00:23:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.788+0000 7f36ae366740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f36a41af090 con 0x55dd7862e950 2024-09-11T00:23:03.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.788+0000 7f36a952c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd786220a0 0x55dd7861f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:03.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.788+0000 7f36a952c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd786220a0 0x55dd7861f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48186/0 (socket says 172.21.15.78:48186) 2024-09-11T00:23:03.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.788+0000 7f36a952c640 1 -- 172.21.15.78:0/2724755719 learned_addr learned my addr 172.21.15.78:0/2724755719 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:03.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.788+0000 7f36a952c640 1 -- 172.21.15.78:0/2724755719 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dd7862e950 msgr2=0x55dd78628e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:03.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.788+0000 7f36a952c640 1 --2- 172.21.15.78:0/2724755719 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dd7862e950 0x55dd78628e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.788+0000 7f36a952c640 1 -- 172.21.15.78:0/2724755719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dd786229c0 msgr2=0x55dd786288d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:03.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.788+0000 7f36a9d2d640 1 --2- 172.21.15.78:0/2724755719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dd786229c0 0x55dd786288d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:03.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.788+0000 7f36a952c640 1 --2- 172.21.15.78:0/2724755719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dd786229c0 0x55dd786288d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.788+0000 7f36a952c640 1 -- 172.21.15.78:0/2724755719 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd7861b790 con 0x55dd786220a0 2024-09-11T00:23:03.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.788+0000 7f36a952c640 1 --2- 172.21.15.78:0/2724755719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd786220a0 0x55dd7861f710 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f36a0024a10 tx=0x7f36a0024a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd32adb4df8d48b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:03.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.788+0000 7f368f7fe640 1 -- 172.21.15.78:0/2724755719 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a001b040 con 0x55dd786220a0 2024-09-11T00:23:03.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.788+0000 7f368f7fe640 1 -- 172.21.15.78:0/2724755719 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36a0024400 con 0x55dd786220a0 2024-09-11T00:23:03.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.788+0000 7f368f7fe640 1 -- 172.21.15.78:0/2724755719 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a0015bd0 con 0x55dd786220a0 2024-09-11T00:23:03.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.789+0000 7f36ae366740 1 -- 172.21.15.78:0/2724755719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd786220a0 msgr2=0x55dd7861f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:03.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.789+0000 7f36ae366740 1 --2- 172.21.15.78:0/2724755719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd786220a0 0x55dd7861f710 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f36a0024a10 tx=0x7f36a0024a40 comp rx=0 tx=0).stop 2024-09-11T00:23:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.789+0000 7f36ae366740 1 -- 172.21.15.78:0/2724755719 shutdown_connections 2024-09-11T00:23:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.789+0000 7f36ae366740 1 --2- 172.21.15.78:0/2724755719 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dd7862e950 0x55dd78628e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.789+0000 7f36ae366740 1 --2- 172.21.15.78:0/2724755719 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dd786229c0 0x55dd786288d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.789+0000 7f36ae366740 1 --2- 172.21.15.78:0/2724755719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd786220a0 0x55dd7861f710 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.789+0000 7f36ae366740 1 -- 172.21.15.78:0/2724755719 >> 172.21.15.78:0/2724755719 conn(0x55dd7861fed0 msgr2=0x55dd7862ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.789+0000 7f36ae366740 1 -- 172.21.15.78:0/2724755719 shutdown_connections 2024-09-11T00:23:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.789+0000 7f36ae366740 1 -- 172.21.15.78:0/2724755719 wait complete. 2024-09-11T00:23:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.789+0000 7f36ae366740 1 -- start start 2024-09-11T00:23:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.789+0000 7f36ae366740 1 Processor -- start 2024-09-11T00:23:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.790+0000 7f36ae366740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd786220a0 0x55dd78632fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.790+0000 7f36ae366740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dd786229c0 0x55dd786334e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.790+0000 7f36ae366740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dd7862e950 0x55dd786a9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.790+0000 7f36ae366740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f36a41af760 con 0x55dd786220a0 2024-09-11T00:23:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.790+0000 7f36ae366740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f36a41b0bd0 con 0x55dd7862e950 2024-09-11T00:23:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.790+0000 7f36ae366740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f36a41afe30 con 0x55dd786229c0 2024-09-11T00:23:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.790+0000 7f36ae366740 10 client.0 _ll_register_callbacks cb 0x7f36a0019070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:23:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.790+0000 7f36a952c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd786220a0 0x55dd78632fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.790+0000 7f36a952c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd786220a0 0x55dd78632fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48196/0 (socket says 172.21.15.78:48196) 2024-09-11T00:23:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.790+0000 7f36a952c640 1 -- 172.21.15.78:0/1864164556 learned_addr learned my addr 172.21.15.78:0/1864164556 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.790+0000 7f36a9d2d640 1 --2- 172.21.15.78:0/1864164556 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dd786229c0 0x55dd786334e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.790+0000 7f36a952c640 1 --2- 172.21.15.78:0/1864164556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dd7862e950 0x55dd786a9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.790+0000 7f36a952c640 1 -- 172.21.15.78:0/1864164556 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dd786229c0 msgr2=0x55dd786334e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.790+0000 7f36a952c640 1 --2- 172.21.15.78:0/1864164556 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dd786229c0 0x55dd786334e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.790+0000 7f36a952c640 1 -- 172.21.15.78:0/1864164556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dd7862e950 msgr2=0x55dd786a9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.790+0000 7f36a952c640 1 --2- 172.21.15.78:0/1864164556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dd7862e950 0x55dd786a9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.790+0000 7f36a952c640 1 -- 172.21.15.78:0/1864164556 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd786aa510 con 0x55dd786220a0 2024-09-11T00:23:03.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.790+0000 7f36a952c640 1 --2- 172.21.15.78:0/1864164556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd786220a0 0x55dd78632fa0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f36a0024990 tx=0x7f36a0016700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2530bbe4b0748cc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:03.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.790+0000 7f368d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:23:03.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.790+0000 7f368d7fa640 1 -- 172.21.15.78:0/1864164556 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a001b070 con 0x55dd786220a0 2024-09-11T00:23:03.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.790+0000 7f368d7fa640 1 -- 172.21.15.78:0/1864164556 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8492+0+0 (secure 0 0 0) 0x7f36a0035840 con 0x55dd786220a0 2024-09-11T00:23:03.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.790+0000 7f36ae366740 1 -- 172.21.15.78:0/1864164556 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36a0024400 con 0x55dd786220a0 2024-09-11T00:23:03.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.791+0000 7f368d7fa640 1 -- 172.21.15.78:0/1864164556 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f36a0035a40 con 0x55dd786220a0 2024-09-11T00:23:03.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.791+0000 7f36ae366740 10 client.16254 fetch_fsmap learned FSMap version 20 2024-09-11T00:23:03.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.791+0000 7f36ae366740 1 -- 172.21.15.78:0/1864164556 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55dd786ab820 con 0x55dd786220a0 2024-09-11T00:23:03.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.791+0000 7f368d7fa640 1 -- 172.21.15.78:0/1864164556 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36a0024400 con 0x55dd786220a0 2024-09-11T00:23:03.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.791+0000 7f368d7fa640 1 -- 172.21.15.78:0/1864164556 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f36a0006ce0 con 0x55dd786220a0 2024-09-11T00:23:03.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.791+0000 7f36ae366740 10 client.16254 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:23:03.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.791+0000 7f36ae366740 10 client.16254 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:23:03.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.791+0000 7f36ae366740 20 client.16254 populate_metadata read hostname 'smithi078' 2024-09-11T00:23:03.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.791+0000 7f36ae366740 1 --2- 172.21.15.78:0/1864164556 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55dd786abe60 0x55dd786ae280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:03.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.791+0000 7f36ae366740 4 client.16254 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:23:03.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.791+0000 7f36ae366740 1 -- 172.21.15.78:0/1864164556 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dd78596850 con 0x55dd786abe60 2024-09-11T00:23:03.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.791+0000 7f36a9d2d640 1 --2- 172.21.15.78:0/1864164556 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55dd786abe60 0x55dd786ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:03.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.792+0000 7f368d7fa640 10 client.16254 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:03.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.792+0000 7f36a9d2d640 1 --2- 172.21.15.78:0/1864164556 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55dd786abe60 0x55dd786ae280 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef999e04de48045a server_cookie=a272dce53c3fbd04 in_seq=0 out_seq=0 2024-09-11T00:23:03.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.792+0000 7f368d7fa640 1 -- 172.21.15.78:0/1864164556 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3978 (crc 0 0 0) 0x55dd78596850 con 0x55dd786abe60 2024-09-11T00:23:03.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.792+0000 7f368d7fa640 10 client.16254 handle_command_reply: tid=0 2024-09-11T00:23:03.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.792+0000 7f36ae366740 1 client.16254 shutdown 2024-09-11T00:23:03.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.792+0000 7f36ae366740 1 -- 172.21.15.78:0/1864164556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd786220a0 msgr2=0x55dd78632fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:03.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.792+0000 7f36ae366740 1 --2- 172.21.15.78:0/1864164556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd786220a0 0x55dd78632fa0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f36a0024990 tx=0x7f36a0016700 comp rx=0 tx=0).stop 2024-09-11T00:23:03.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.792+0000 7f36ae366740 1 -- 172.21.15.78:0/1864164556 shutdown_connections 2024-09-11T00:23:03.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.792+0000 7f36ae366740 1 --2- 172.21.15.78:0/1864164556 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55dd786abe60 0x55dd786ae280 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.792+0000 7f36ae366740 1 --2- 172.21.15.78:0/1864164556 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55dd7862e950 0x55dd786a9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.792+0000 7f36ae366740 1 --2- 172.21.15.78:0/1864164556 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55dd786229c0 0x55dd786334e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.792+0000 7f368d7fa640 0 client.16254 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:03.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.792+0000 7f36ae366740 1 --2- 172.21.15.78:0/1864164556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dd786220a0 0x55dd78632fa0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.792+0000 7f36ae366740 1 -- 172.21.15.78:0/1864164556 >> 172.21.15.78:0/1864164556 conn(0x55dd7861fed0 msgr2=0x55dd78629e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:03.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.792+0000 7f36ae366740 1 -- 172.21.15.78:0/1864164556 shutdown_connections 2024-09-11T00:23:03.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.792+0000 7f36ae366740 1 -- 172.21.15.78:0/1864164556 wait complete. 2024-09-11T00:23:03.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.792+0000 7f36ae366740 20 client.16254 trim_cache size 0 max 16384 2024-09-11T00:23:03.800 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:23:03.800 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:23:03.800 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-11T00:23:03.800 INFO:teuthology.orchestra.run.smithi078.stdout: "1b9391c2-08f3-479a-9538-deea28f7743b": { 2024-09-11T00:23:03.801 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:03.801 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "1b9391c2-08f3-479a-9538-deea28f7743b", 2024-09-11T00:23:03.801 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-11T00:23:03.801 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:23:03.801 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:03.801 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:23:03.801 INFO:teuthology.orchestra.run.smithi078.stdout: "f494d5ed-e0dc-44bb-8aba-a861b3e751f4": { 2024-09-11T00:23:03.801 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:55.251691+0000", 2024-09-11T00:23:03.801 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:03.801 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:03.801 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:03.801 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:03.801 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:03.802 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:03.802 INFO:teuthology.orchestra.run.smithi078.stdout: "e0002672-e432-4890-ab9f-20c513c5e3b6": { 2024-09-11T00:23:03.802 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:21:37.161715+0000", 2024-09-11T00:23:03.802 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:03.802 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:03.802 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:03.802 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:03.802 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:03.802 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:03.802 INFO:teuthology.orchestra.run.smithi078.stdout: "1b9391c2-08f3-479a-9538-deea28f7743b": { 2024-09-11T00:23:03.802 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:02.327508+0000", 2024-09-11T00:23:03.802 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:03.802 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:03.803 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:03.803 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:03.803 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:03.803 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:03.803 INFO:teuthology.orchestra.run.smithi078.stdout: "8ec9e858-aa62-420d-a112-e62ea7810e63": { 2024-09-11T00:23:03.803 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:18.882749+0000", 2024-09-11T00:23:03.803 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:03.803 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:03.803 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:03.803 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:03.803 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:03.803 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:03.803 INFO:teuthology.orchestra.run.smithi078.stdout: "38a1d30d-5f4c-460a-afcd-e6c60b97e43a": { 2024-09-11T00:23:03.803 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:58.127727+0000", 2024-09-11T00:23:03.804 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:03.804 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:03.804 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:03.804 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:03.804 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:03.804 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:03.804 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:23:03.804 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:23:03.804 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:03.804 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:03.804 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:03.804 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:03.804 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:03.805 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:03.805 INFO:teuthology.orchestra.run.smithi078.stdout: "81d31d3a-c224-4ded-9f00-1a7dfc099ec4": { 2024-09-11T00:23:03.805 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:16.296700+0000", 2024-09-11T00:23:03.805 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:03.805 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:03.805 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:03.805 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:03.805 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:03.805 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:03.805 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:23:03.805 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:23:03.805 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:03.805 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:03.806 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:03.806 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:03.806 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:03.806 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:03.806 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:23:03.806 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:23:03.806 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:03.806 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:03.806 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:03.806 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:03.806 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:03.806 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:03.807 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:23:03.807 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:23:03.807 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:03.807 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:03.807 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:03.807 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:03.807 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:03.807 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:03.807 INFO:teuthology.orchestra.run.smithi078.stdout: "b854cbd3-8ca7-4277-a205-8887d2ff5567": { 2024-09-11T00:23:03.807 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:11.182949+0000", 2024-09-11T00:23:03.808 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:03.808 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:03.808 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:03.808 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:03.808 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:03.808 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:03.808 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:23:03.808 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:23:03.808 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:03.808 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:03.808 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:03.808 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:03.808 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:03.808 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:03.809 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:23:03.809 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:23:03.809 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:03.809 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:03.809 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:03.809 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:03.809 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:03.809 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:23:03.809 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:23:03.809 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:23:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.793+0000 7f36abf91640 1 -- 172.21.15.78:0/127124658 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f36900b54d0 msgr2=0x7f36900b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.793+0000 7f36abf91640 1 --2- 172.21.15.78:0/127124658 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f36900b54d0 0x7f36900b7990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f369c0e2fd0 tx=0x7f369c011000 comp rx=0 tx=0).stop 2024-09-11T00:23:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.793+0000 7f36abf91640 1 -- 172.21.15.78:0/127124658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36a410d0e0 msgr2=0x7f36a41032d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.793+0000 7f36abf91640 1 --2- 172.21.15.78:0/127124658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36a410d0e0 0x7f36a41032d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f369c00b970 tx=0x7f369c00be30 comp rx=0 tx=0).stop 2024-09-11T00:23:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.793+0000 7f36abf91640 1 -- 172.21.15.78:0/127124658 shutdown_connections 2024-09-11T00:23:03.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.793+0000 7f36abf91640 1 --2- 172.21.15.78:0/127124658 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f36900b54d0 0x7f36900b7990 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.793+0000 7f36abf91640 1 --2- 172.21.15.78:0/127124658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36a410d0e0 0x7f36a41032d0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.793+0000 7f36abf91640 1 --2- 172.21.15.78:0/127124658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f36a4102230 0x7f36a4102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.793+0000 7f36abf91640 1 --2- 172.21.15.78:0/127124658 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36a4101880 0x7f36a4102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:03.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.793+0000 7f36abf91640 1 -- 172.21.15.78:0/127124658 >> 172.21.15.78:0/127124658 conn(0x7f36a4076e60 msgr2=0x7f36a40ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:03.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.793+0000 7f36abf91640 1 -- 172.21.15.78:0/127124658 shutdown_connections 2024-09-11T00:23:03.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:03.793+0000 7f36abf91640 1 -- 172.21.15.78:0/127124658 wait complete. 2024-09-11T00:23:03.812 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:03 smithi138 ceph-mon[35019]: scrub queued for path: / 2024-09-11T00:23:03.812 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:03 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:23:03.812 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:03 smithi138 ceph-mon[35019]: scrub summary: active paths [/] 2024-09-11T00:23:03.812 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:03 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:23:04.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:04 smithi078 ceph-mon[30865]: pgmap v521: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-11T00:23:04.613 INFO:tasks.cephfs.filesystem:scrub status for tag:1b9391c2-08f3-479a-9538-deea28f7743b - {'path': '/', 'tag': '1b9391c2-08f3-479a-9538-deea28f7743b', 'options': 'recursive,force'} 2024-09-11T00:23:04.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:04 smithi112 ceph-mon[35627]: pgmap v521: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-11T00:23:04.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:04 smithi138 ceph-mon[35019]: pgmap v521: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-11T00:23:06.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:05 smithi112 ceph-mon[35627]: pgmap v522: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-11T00:23:06.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:05 smithi138 ceph-mon[35019]: pgmap v522: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-11T00:23:06.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:05 smithi078 ceph-mon[30865]: pgmap v522: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 20 op/s 2024-09-11T00:23:07.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:06 smithi112 ceph-mon[35627]: scrub summary: idle 2024-09-11T00:23:07.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:06 smithi138 ceph-mon[35019]: scrub summary: idle 2024-09-11T00:23:07.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:06 smithi078 ceph-mon[30865]: scrub summary: idle 2024-09-11T00:23:08.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:07 smithi112 ceph-mon[35627]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T00:23:08.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:07 smithi112 ceph-mon[35627]: pgmap v524: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-11T00:23:08.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:07 smithi138 ceph-mon[35019]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T00:23:08.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:07 smithi138 ceph-mon[35019]: pgmap v524: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-11T00:23:08.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:07 smithi078 ceph-mon[30865]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T00:23:08.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:07 smithi078 ceph-mon[30865]: pgmap v524: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-11T00:23:10.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:09 smithi112 ceph-mon[35627]: pgmap v525: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-11T00:23:10.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:09 smithi138 ceph-mon[35019]: pgmap v525: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-11T00:23:10.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:09 smithi078 ceph-mon[30865]: pgmap v525: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-11T00:23:12.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:11 smithi112 ceph-mon[35627]: pgmap v526: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 28 KiB/s wr, 5 op/s 2024-09-11T00:23:12.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:11 smithi138 ceph-mon[35019]: pgmap v526: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 28 KiB/s wr, 5 op/s 2024-09-11T00:23:12.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:11 smithi078 ceph-mon[30865]: pgmap v526: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 28 KiB/s wr, 5 op/s 2024-09-11T00:23:14.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:13 smithi112 ceph-mon[35627]: pgmap v527: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-11T00:23:14.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:13 smithi138 ceph-mon[35019]: pgmap v527: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-11T00:23:14.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:13 smithi078 ceph-mon[30865]: pgmap v527: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-11T00:23:16.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:16 smithi078 ceph-mon[30865]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T00:23:16.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:16 smithi078 ceph-mon[30865]: pgmap v529: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 229 B/s wr, 2 op/s 2024-09-11T00:23:16.935 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:16 smithi112 ceph-mon[35627]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T00:23:16.935 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:16 smithi112 ceph-mon[35627]: pgmap v529: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 229 B/s wr, 2 op/s 2024-09-11T00:23:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:16 smithi138 ceph-mon[35019]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T00:23:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:16 smithi138 ceph-mon[35019]: pgmap v529: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 229 B/s wr, 2 op/s 2024-09-11T00:23:18.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:17 smithi112 ceph-mon[35627]: pgmap v530: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T00:23:18.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:17 smithi138 ceph-mon[35019]: pgmap v530: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T00:23:18.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:17 smithi078 ceph-mon[30865]: pgmap v530: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T00:23:20.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:19 smithi112 ceph-mon[35627]: pgmap v531: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T00:23:20.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:19 smithi138 ceph-mon[35019]: pgmap v531: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T00:23:20.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:19 smithi078 ceph-mon[30865]: pgmap v531: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T00:23:22.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:21 smithi112 ceph-mon[35627]: pgmap v532: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T00:23:22.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:21 smithi138 ceph-mon[35019]: pgmap v532: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T00:23:22.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:21 smithi078 ceph-mon[30865]: pgmap v532: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T00:23:24.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:23 smithi112 ceph-mon[35627]: pgmap v533: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T00:23:24.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:23 smithi138 ceph-mon[35019]: pgmap v533: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T00:23:24.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:23 smithi078 ceph-mon[30865]: pgmap v533: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T00:23:26.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:25 smithi112 ceph-mon[35627]: pgmap v534: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 B/s rd, 1 op/s 2024-09-11T00:23:26.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:25 smithi138 ceph-mon[35019]: pgmap v534: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 B/s rd, 1 op/s 2024-09-11T00:23:26.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:25 smithi078 ceph-mon[30865]: pgmap v534: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 B/s rd, 1 op/s 2024-09-11T00:23:28.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:27 smithi112 ceph-mon[35627]: pgmap v535: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:23:28.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:27 smithi138 ceph-mon[35019]: pgmap v535: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:23:28.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:27 smithi078 ceph-mon[30865]: pgmap v535: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:23:30.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:29 smithi112 ceph-mon[35627]: pgmap v536: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:23:30.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:29 smithi138 ceph-mon[35019]: pgmap v536: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:23:30.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:29 smithi078 ceph-mon[30865]: pgmap v536: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:23:32.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:31 smithi112 ceph-mon[35627]: pgmap v537: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:23:32.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:31 smithi138 ceph-mon[35019]: pgmap v537: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:23:32.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:31 smithi078 ceph-mon[30865]: pgmap v537: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:23:34.157 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:33 smithi078 ceph-mon[30865]: pgmap v538: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:23:34.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:33 smithi112 ceph-mon[35627]: pgmap v538: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:23:34.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:33 smithi138 ceph-mon[35019]: pgmap v538: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:23:34.614 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:23:34.868 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:23:35.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.338+0000 7fc8d64fd640 1 -- 172.21.15.78:0/1353723599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8d0103b70 msgr2=0x7fc8d0103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:35.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.338+0000 7fc8d64fd640 1 --2- 172.21.15.78:0/1353723599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8d0103b70 0x7fc8d0103f50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009900 tx=0x7fc8c002a410 comp rx=0 tx=0).stop 2024-09-11T00:23:35.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.338+0000 7fc8d64fd640 1 -- 172.21.15.78:0/1353723599 shutdown_connections 2024-09-11T00:23:35.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.338+0000 7fc8d64fd640 1 --2- 172.21.15.78:0/1353723599 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8d010d120 0x7fc8d010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.338+0000 7fc8d64fd640 1 --2- 172.21.15.78:0/1353723599 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8d0104570 0x7fc8d010cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.338+0000 7fc8d64fd640 1 --2- 172.21.15.78:0/1353723599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8d0103b70 0x7fc8d0103f50 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.338+0000 7fc8d64fd640 1 -- 172.21.15.78:0/1353723599 >> 172.21.15.78:0/1353723599 conn(0x7fc8d00fd700 msgr2=0x7fc8d00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:35.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.338+0000 7fc8d64fd640 1 -- 172.21.15.78:0/1353723599 shutdown_connections 2024-09-11T00:23:35.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.338+0000 7fc8d64fd640 1 -- 172.21.15.78:0/1353723599 wait complete. 2024-09-11T00:23:35.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.338+0000 7fc8d64fd640 1 Processor -- start 2024-09-11T00:23:35.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.338+0000 7fc8d64fd640 1 -- start start 2024-09-11T00:23:35.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.339+0000 7fc8d64fd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8d0103b70 0x7fc8d0199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:35.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.339+0000 7fc8d64fd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8d0104570 0x7fc8d0199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:35.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.339+0000 7fc8d64fd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8d010d120 0x7fc8d019ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:35.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.339+0000 7fc8d64fd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d0112db0 con 0x7fc8d0104570 2024-09-11T00:23:35.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.339+0000 7fc8d64fd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d0112c30 con 0x7fc8d010d120 2024-09-11T00:23:35.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.339+0000 7fc8d64fd640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d0112f30 con 0x7fc8d0103b70 2024-09-11T00:23:35.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.339+0000 7fc8c7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8d0104570 0x7fc8d0199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:35.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.339+0000 7fc8c7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8d0104570 0x7fc8d0199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40378/0 (socket says 172.21.15.78:40378) 2024-09-11T00:23:35.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.339+0000 7fc8c7fff640 1 -- 172.21.15.78:0/3595326394 learned_addr learned my addr 172.21.15.78:0/3595326394 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:35.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.339+0000 7fc8d4a9a640 1 --2- 172.21.15.78:0/3595326394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8d010d120 0x7fc8d019ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:35.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.339+0000 7fc8cffff640 1 --2- 172.21.15.78:0/3595326394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8d0103b70 0x7fc8d0199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:35.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.339+0000 7fc8c7fff640 1 -- 172.21.15.78:0/3595326394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8d0103b70 msgr2=0x7fc8d0199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:35.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.339+0000 7fc8c7fff640 1 --2- 172.21.15.78:0/3595326394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8d0103b70 0x7fc8d0199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.339+0000 7fc8c7fff640 1 -- 172.21.15.78:0/3595326394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8d010d120 msgr2=0x7fc8d019ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:35.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.339+0000 7fc8c7fff640 1 --2- 172.21.15.78:0/3595326394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8d010d120 0x7fc8d019ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.339+0000 7fc8c7fff640 1 -- 172.21.15.78:0/3595326394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d019f3b0 con 0x7fc8d0104570 2024-09-11T00:23:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.339+0000 7fc8d4a9a640 1 --2- 172.21.15.78:0/3595326394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8d010d120 0x7fc8d019ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.339+0000 7fc8c7fff640 1 --2- 172.21.15.78:0/3595326394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8d0104570 0x7fc8d0199840 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800c890 tx=0x7fc8b800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.339+0000 7fc8cdffb640 1 -- 172.21.15.78:0/3595326394 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8004220 con 0x7fc8d0104570 2024-09-11T00:23:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.340+0000 7fc8cdffb640 1 -- 172.21.15.78:0/3595326394 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8b80043c0 con 0x7fc8d0104570 2024-09-11T00:23:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.340+0000 7fc8d64fd640 1 -- 172.21.15.78:0/3595326394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8d019f6a0 con 0x7fc8d0104570 2024-09-11T00:23:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.340+0000 7fc8cdffb640 1 -- 172.21.15.78:0/3595326394 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8004a00 con 0x7fc8d0104570 2024-09-11T00:23:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.340+0000 7fc8d64fd640 1 -- 172.21.15.78:0/3595326394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8d01a5d60 con 0x7fc8d0104570 2024-09-11T00:23:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.342+0000 7fc8d88d2740 1 Processor -- start 2024-09-11T00:23:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.342+0000 7fc8d88d2740 1 -- start start 2024-09-11T00:23:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.342+0000 7fc8d88d2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d492480 0x55de9d492860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.342+0000 7fc8d88d2740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9d492da0 0x55de9d49e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.342+0000 7fc8d88d2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d49ed30 0x55de9d4a1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.342+0000 7fc8d88d2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55de9d408e50 con 0x55de9d49ed30 2024-09-11T00:23:35.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.342+0000 7fc8d88d2740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55de9d3f8280 con 0x55de9d492da0 2024-09-11T00:23:35.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.342+0000 7fc8d88d2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55de9d3fc090 con 0x55de9d492480 2024-09-11T00:23:35.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.343+0000 7fc8d4a9a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d492480 0x55de9d492860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:35.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.343+0000 7fc8cffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9d492da0 0x55de9d49e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:35.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.343+0000 7fc8d4a9a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d492480 0x55de9d492860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.78:44746/0 (socket says 172.21.15.78:44746) 2024-09-11T00:23:35.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.343+0000 7fc8d4a9a640 1 -- 172.21.15.78:0/2255446689 learned_addr learned my addr 172.21.15.78:0/2255446689 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:35.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.343+0000 7fc8cdffb640 1 -- 172.21.15.78:0/3595326394 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fc8b80079b0 con 0x7fc8d0104570 2024-09-11T00:23:35.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.343+0000 7fc8c7fff640 1 --2- 172.21.15.78:0/2255446689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d49ed30 0x55de9d4a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:35.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.343+0000 7fc8d4a9a640 1 -- 172.21.15.78:0/2255446689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9d492da0 msgr2=0x55de9d49e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:35.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.343+0000 7fc8d4a9a640 1 --2- 172.21.15.78:0/2255446689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9d492da0 0x55de9d49e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.343+0000 7fc8d4a9a640 1 -- 172.21.15.78:0/2255446689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d49ed30 msgr2=0x55de9d4a1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:35.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.343+0000 7fc8d4a9a640 1 --2- 172.21.15.78:0/2255446689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d49ed30 0x55de9d4a1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.343+0000 7fc8d4a9a640 1 -- 172.21.15.78:0/2255446689 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de9d156650 con 0x55de9d492480 2024-09-11T00:23:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.343+0000 7fc8c7fff640 1 --2- 172.21.15.78:0/2255446689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d49ed30 0x55de9d4a1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.344+0000 7fc8d4a9a640 1 --2- 172.21.15.78:0/2255446689 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d492480 0x55de9d492860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8009f30 tx=0x7fc8c8010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7811a861be80cbf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.344+0000 7fc8c67fc640 1 -- 172.21.15.78:0/2255446689 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8016070 con 0x55de9d492480 2024-09-11T00:23:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.344+0000 7fc8c67fc640 1 -- 172.21.15.78:0/2255446689 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8c801bb10 con 0x55de9d492480 2024-09-11T00:23:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.344+0000 7fc8c67fc640 1 -- 172.21.15.78:0/2255446689 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8012bc0 con 0x55de9d492480 2024-09-11T00:23:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.344+0000 7fc8cdffb640 1 --2- 172.21.15.78:0/3595326394 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc8bc0b5450 0x7fc8bc0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.344+0000 7fc8cffff640 1 --2- 172.21.15.78:0/3595326394 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc8bc0b5450 0x7fc8bc0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.344+0000 7fc8cdffb640 1 -- 172.21.15.78:0/3595326394 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7fc8b80e5e40 con 0x7fc8d0104570 2024-09-11T00:23:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.345+0000 7fc8cffff640 1 --2- 172.21.15.78:0/3595326394 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc8bc0b5450 0x7fc8bc0b7910 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0000c00 tx=0x7fc8c0005a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.345+0000 7fc8d88d2740 1 -- 172.21.15.78:0/2255446689 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d492480 msgr2=0x55de9d492860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.345+0000 7fc8d88d2740 1 --2- 172.21.15.78:0/2255446689 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d492480 0x55de9d492860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8009f30 tx=0x7fc8c8010800 comp rx=0 tx=0).stop 2024-09-11T00:23:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.345+0000 7fc8d88d2740 1 -- 172.21.15.78:0/2255446689 shutdown_connections 2024-09-11T00:23:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.345+0000 7fc8d88d2740 1 --2- 172.21.15.78:0/2255446689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d49ed30 0x55de9d4a1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.345+0000 7fc8d88d2740 1 --2- 172.21.15.78:0/2255446689 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9d492da0 0x55de9d49e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.345+0000 7fc8d88d2740 1 --2- 172.21.15.78:0/2255446689 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d492480 0x55de9d492860 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.345+0000 7fc8d88d2740 1 -- 172.21.15.78:0/2255446689 >> 172.21.15.78:0/2255446689 conn(0x55de9d4902b0 msgr2=0x55de9d491450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:35.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.345+0000 7fc8d88d2740 1 -- 172.21.15.78:0/2255446689 shutdown_connections 2024-09-11T00:23:35.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.345+0000 7fc8d88d2740 1 -- 172.21.15.78:0/2255446689 wait complete. 2024-09-11T00:23:35.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.345+0000 7fc8d88d2740 1 -- start start 2024-09-11T00:23:35.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.346+0000 7fc8d88d2740 1 Processor -- start 2024-09-11T00:23:35.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.346+0000 7fc8d88d2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d492480 0x55de9d49e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:35.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.346+0000 7fc8d88d2740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9d492da0 0x55de9d49b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:35.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.346+0000 7fc8d88d2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d49ed30 0x55de9d49bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:35.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.346+0000 7fc8d88d2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55de9d259700 con 0x55de9d49ed30 2024-09-11T00:23:35.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.346+0000 7fc8d88d2740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55de9d393110 con 0x55de9d492da0 2024-09-11T00:23:35.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.346+0000 7fc8d88d2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55de9d4a19b0 con 0x55de9d492480 2024-09-11T00:23:35.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.346+0000 7fc8d88d2740 10 client.0 _ll_register_callbacks cb 0x55de9d3ac990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:23:35.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.346+0000 7fc8d4a9a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d49ed30 0x55de9d49bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:35.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.346+0000 7fc8d4a9a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d49ed30 0x55de9d49bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40392/0 (socket says 172.21.15.78:40392) 2024-09-11T00:23:35.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.346+0000 7fc8d4a9a640 1 -- 172.21.15.78:0/1292643374 learned_addr learned my addr 172.21.15.78:0/1292643374 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:35.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.346+0000 7fc8cffff640 1 --2- 172.21.15.78:0/1292643374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d492480 0x55de9d49e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:35.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.347+0000 7fc8c7fff640 1 --2- 172.21.15.78:0/1292643374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9d492da0 0x55de9d49b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:35.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.347+0000 7fc8d4a9a640 1 -- 172.21.15.78:0/1292643374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d492480 msgr2=0x55de9d49e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:35.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.347+0000 7fc8d4a9a640 1 --2- 172.21.15.78:0/1292643374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d492480 0x55de9d49e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.347+0000 7fc8d4a9a640 1 -- 172.21.15.78:0/1292643374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9d492da0 msgr2=0x55de9d49b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:35.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.347+0000 7fc8d4a9a640 1 --2- 172.21.15.78:0/1292643374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9d492da0 0x55de9d49b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.347+0000 7fc8d4a9a640 1 -- 172.21.15.78:0/1292643374 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de9d3c0c40 con 0x55de9d49ed30 2024-09-11T00:23:35.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.347+0000 7fc8c7fff640 1 --2- 172.21.15.78:0/1292643374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9d492da0 0x55de9d49b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:35.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.347+0000 7fc8d4a9a640 1 --2- 172.21.15.78:0/1292643374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d49ed30 0x55de9d49bf70 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80128a0 tx=0x7fc8c8009c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ee06dd7a540ae5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:35.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.347+0000 7fc8af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:23:35.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.347+0000 7fc8af7fe640 1 -- 172.21.15.78:0/1292643374 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8029060 con 0x55de9d49ed30 2024-09-11T00:23:35.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.347+0000 7fc8d88d2740 1 -- 172.21.15.78:0/1292643374 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8c801bb10 con 0x55de9d49ed30 2024-09-11T00:23:35.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.347+0000 7fc8af7fe640 1 -- 172.21.15.78:0/1292643374 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7fc8c8004d90 con 0x55de9d49ed30 2024-09-11T00:23:35.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.347+0000 7fc8af7fe640 1 -- 172.21.15.78:0/1292643374 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc8c8016070 con 0x55de9d49ed30 2024-09-11T00:23:35.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.347+0000 7fc8d88d2740 10 client.16263 fetch_fsmap learned FSMap version 20 2024-09-11T00:23:35.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.347+0000 7fc8d88d2740 1 -- 172.21.15.78:0/1292643374 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55de9d4ad200 con 0x55de9d49ed30 2024-09-11T00:23:35.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.347+0000 7fc8af7fe640 1 -- 172.21.15.78:0/1292643374 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8c801bb10 con 0x55de9d49ed30 2024-09-11T00:23:35.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.348+0000 7fc8af7fe640 1 -- 172.21.15.78:0/1292643374 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc8c800f040 con 0x55de9d49ed30 2024-09-11T00:23:35.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.348+0000 7fc8d88d2740 10 client.16263 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:23:35.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.348+0000 7fc8d88d2740 10 client.16263 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:23:35.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.348+0000 7fc8d88d2740 20 client.16263 populate_metadata read hostname 'smithi078' 2024-09-11T00:23:35.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.348+0000 7fc8d88d2740 1 --2- 172.21.15.78:0/1292643374 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55de9d4ae600 0x55de9d4b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:35.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.348+0000 7fc8d88d2740 4 client.16263 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:23:35.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.348+0000 7fc8d88d2740 1 -- 172.21.15.78:0/1292643374 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de9d40ada0 con 0x55de9d4ae600 2024-09-11T00:23:35.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.348+0000 7fc8cffff640 1 --2- 172.21.15.78:0/1292643374 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55de9d4ae600 0x55de9d4b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:35.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.348+0000 7fc8cffff640 1 --2- 172.21.15.78:0/1292643374 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55de9d4ae600 0x55de9d4b09f0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=691f65e6743a1c34 server_cookie=25180ec50883bd4b in_seq=0 out_seq=0 2024-09-11T00:23:35.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.348+0000 7fc8af7fe640 10 client.16263 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:35.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.349+0000 7fc8af7fe640 1 -- 172.21.15.78:0/1292643374 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55de9d40ada0 con 0x55de9d4ae600 2024-09-11T00:23:35.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.349+0000 7fc8af7fe640 10 client.16263 handle_command_reply: tid=0 2024-09-11T00:23:35.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.349+0000 7fc8d88d2740 1 client.16263 shutdown 2024-09-11T00:23:35.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.349+0000 7fc8d88d2740 1 -- 172.21.15.78:0/1292643374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d49ed30 msgr2=0x55de9d49bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:35.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.349+0000 7fc8d88d2740 1 --2- 172.21.15.78:0/1292643374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d49ed30 0x55de9d49bf70 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80128a0 tx=0x7fc8c8009c70 comp rx=0 tx=0).stop 2024-09-11T00:23:35.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.349+0000 7fc8d88d2740 1 -- 172.21.15.78:0/1292643374 shutdown_connections 2024-09-11T00:23:35.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.349+0000 7fc8d88d2740 1 --2- 172.21.15.78:0/1292643374 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55de9d4ae600 0x55de9d4b09f0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.349+0000 7fc8d88d2740 1 --2- 172.21.15.78:0/1292643374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d49ed30 0x55de9d49bf70 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.349+0000 7fc8d88d2740 1 --2- 172.21.15.78:0/1292643374 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9d492da0 0x55de9d49b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.349+0000 7fc8d88d2740 1 --2- 172.21.15.78:0/1292643374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d492480 0x55de9d49e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.349+0000 7fc8d88d2740 1 -- 172.21.15.78:0/1292643374 >> 172.21.15.78:0/1292643374 conn(0x55de9d4902b0 msgr2=0x55de9d495e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:35.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.349+0000 7fc8af7fe640 0 client.16263 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:35.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.350+0000 7fc8d88d2740 1 -- 172.21.15.78:0/1292643374 shutdown_connections 2024-09-11T00:23:35.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.350+0000 7fc8d88d2740 1 -- 172.21.15.78:0/1292643374 wait complete. 2024-09-11T00:23:35.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.350+0000 7fc8d88d2740 20 client.16263 trim_cache size 0 max 16384 2024-09-11T00:23:35.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.383+0000 7fc8d88d2740 1 Processor -- start 2024-09-11T00:23:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.383+0000 7fc8d88d2740 1 -- start start 2024-09-11T00:23:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.384+0000 7fc8d88d2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d492480 0x55de9d48fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.384+0000 7fc8d88d2740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9d492da0 0x55de9d49d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.384+0000 7fc8d88d2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d49ed30 0x55de9d498c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.384+0000 7fc8d88d2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d01ac850 con 0x55de9d492480 2024-09-11T00:23:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.384+0000 7fc8d88d2740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d01af0b0 con 0x55de9d492da0 2024-09-11T00:23:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.384+0000 7fc8d88d2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d01acea0 con 0x55de9d49ed30 2024-09-11T00:23:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.384+0000 7fc8cffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d492480 0x55de9d48fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.384+0000 7fc8cffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d492480 0x55de9d48fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40398/0 (socket says 172.21.15.78:40398) 2024-09-11T00:23:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.384+0000 7fc8cffff640 1 -- 172.21.15.78:0/1860545746 learned_addr learned my addr 172.21.15.78:0/1860545746 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:35.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.384+0000 7fc8d4a9a640 1 --2- 172.21.15.78:0/1860545746 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d49ed30 0x55de9d498c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:35.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.384+0000 7fc8c7fff640 1 --2- 172.21.15.78:0/1860545746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9d492da0 0x55de9d49d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:35.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.384+0000 7fc8cffff640 1 -- 172.21.15.78:0/1860545746 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d49ed30 msgr2=0x55de9d498c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:35.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.384+0000 7fc8cffff640 1 --2- 172.21.15.78:0/1860545746 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d49ed30 0x55de9d498c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.384+0000 7fc8cffff640 1 -- 172.21.15.78:0/1860545746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9d492da0 msgr2=0x55de9d49d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:35.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.384+0000 7fc8cffff640 1 --2- 172.21.15.78:0/1860545746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9d492da0 0x55de9d49d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.384+0000 7fc8cffff640 1 -- 172.21.15.78:0/1860545746 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de9d49b7a0 con 0x55de9d492480 2024-09-11T00:23:35.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.384+0000 7fc8c7fff640 1 --2- 172.21.15.78:0/1860545746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9d492da0 0x55de9d49d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:35.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.384+0000 7fc8d4a9a640 1 --2- 172.21.15.78:0/1860545746 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d49ed30 0x55de9d498c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:35.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.384+0000 7fc8cffff640 1 --2- 172.21.15.78:0/1860545746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d492480 0x55de9d48fbc0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009230 tx=0x7fc8c003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ca8772dbde69fa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:35.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.385+0000 7fc8c5ffb640 1 -- 172.21.15.78:0/1860545746 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0035040 con 0x55de9d492480 2024-09-11T00:23:35.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.385+0000 7fc8c5ffb640 1 -- 172.21.15.78:0/1860545746 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8c0056070 con 0x55de9d492480 2024-09-11T00:23:35.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.385+0000 7fc8c5ffb640 1 -- 172.21.15.78:0/1860545746 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0003e90 con 0x55de9d492480 2024-09-11T00:23:35.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.385+0000 7fc8d88d2740 1 -- 172.21.15.78:0/1860545746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d492480 msgr2=0x55de9d48fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:35.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.386+0000 7fc8d88d2740 1 --2- 172.21.15.78:0/1860545746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d492480 0x55de9d48fbc0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009230 tx=0x7fc8c003e000 comp rx=0 tx=0).stop 2024-09-11T00:23:35.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.386+0000 7fc8d88d2740 1 -- 172.21.15.78:0/1860545746 shutdown_connections 2024-09-11T00:23:35.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.386+0000 7fc8d88d2740 1 --2- 172.21.15.78:0/1860545746 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d49ed30 0x55de9d498c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.386+0000 7fc8d88d2740 1 --2- 172.21.15.78:0/1860545746 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9d492da0 0x55de9d49d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.386+0000 7fc8d88d2740 1 --2- 172.21.15.78:0/1860545746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d492480 0x55de9d48fbc0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.386+0000 7fc8d88d2740 1 -- 172.21.15.78:0/1860545746 >> 172.21.15.78:0/1860545746 conn(0x55de9d4902b0 msgr2=0x55de9d49d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:35.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.386+0000 7fc8d88d2740 1 -- 172.21.15.78:0/1860545746 shutdown_connections 2024-09-11T00:23:35.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.386+0000 7fc8d88d2740 1 -- 172.21.15.78:0/1860545746 wait complete. 2024-09-11T00:23:35.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.386+0000 7fc8d88d2740 1 -- start start 2024-09-11T00:23:35.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.386+0000 7fc8d88d2740 1 Processor -- start 2024-09-11T00:23:35.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.386+0000 7fc8d88d2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d492480 0x55de9d4a7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:35.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.386+0000 7fc8d88d2740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9d492da0 0x55de9d4a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:35.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.386+0000 7fc8d88d2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d49ed30 0x55de9d4a30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:35.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.386+0000 7fc8d88d2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d01ad570 con 0x55de9d492480 2024-09-11T00:23:35.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.386+0000 7fc8d88d2740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d01ae9e0 con 0x55de9d492da0 2024-09-11T00:23:35.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.386+0000 7fc8d88d2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d01adc40 con 0x55de9d49ed30 2024-09-11T00:23:35.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.387+0000 7fc8d88d2740 10 client.0 _ll_register_callbacks cb 0x7fc8c0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:23:35.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.387+0000 7fc8cffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d492480 0x55de9d4a7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:35.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.387+0000 7fc8cffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d492480 0x55de9d4a7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40410/0 (socket says 172.21.15.78:40410) 2024-09-11T00:23:35.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.387+0000 7fc8cffff640 1 -- 172.21.15.78:0/1239273700 learned_addr learned my addr 172.21.15.78:0/1239273700 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:35.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.387+0000 7fc8c7fff640 1 --2- 172.21.15.78:0/1239273700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9d492da0 0x55de9d4a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:35.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.387+0000 7fc8d4a9a640 1 --2- 172.21.15.78:0/1239273700 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d49ed30 0x55de9d4a30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:35.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.387+0000 7fc8cffff640 1 -- 172.21.15.78:0/1239273700 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d49ed30 msgr2=0x55de9d4a30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:35.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.387+0000 7fc8cffff640 1 --2- 172.21.15.78:0/1239273700 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d49ed30 0x55de9d4a30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.387+0000 7fc8cffff640 1 -- 172.21.15.78:0/1239273700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9d492da0 msgr2=0x55de9d4a2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:35.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.387+0000 7fc8cffff640 1 --2- 172.21.15.78:0/1239273700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9d492da0 0x55de9d4a2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.387+0000 7fc8cffff640 1 -- 172.21.15.78:0/1239273700 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de9d51e5a0 con 0x55de9d492480 2024-09-11T00:23:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.387+0000 7fc8cffff640 1 --2- 172.21.15.78:0/1239273700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d492480 0x55de9d4a7550 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0005c00 tx=0x7fc8c002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c5aadd6f94703e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.387+0000 7fc8af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:23:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.387+0000 7fc8af7fe640 1 -- 172.21.15.78:0/1239273700 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0063070 con 0x55de9d492480 2024-09-11T00:23:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.387+0000 7fc8af7fe640 1 -- 172.21.15.78:0/1239273700 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7fc8c0003d10 con 0x55de9d492480 2024-09-11T00:23:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.387+0000 7fc8d88d2740 1 -- 172.21.15.78:0/1239273700 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8c0056070 con 0x55de9d492480 2024-09-11T00:23:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.388+0000 7fc8af7fe640 1 -- 172.21.15.78:0/1239273700 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc8c006f050 con 0x55de9d492480 2024-09-11T00:23:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.388+0000 7fc8d88d2740 10 client.16269 fetch_fsmap learned FSMap version 20 2024-09-11T00:23:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.388+0000 7fc8d88d2740 1 -- 172.21.15.78:0/1239273700 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55de9d51f6c0 con 0x55de9d492480 2024-09-11T00:23:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.388+0000 7fc8af7fe640 1 -- 172.21.15.78:0/1239273700 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8c0056070 con 0x55de9d492480 2024-09-11T00:23:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.388+0000 7fc8af7fe640 1 -- 172.21.15.78:0/1239273700 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fc8c00327e0 con 0x55de9d492480 2024-09-11T00:23:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.388+0000 7fc8d88d2740 10 client.16269 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:23:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.388+0000 7fc8d88d2740 10 client.16269 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:23:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.388+0000 7fc8d88d2740 20 client.16269 populate_metadata read hostname 'smithi078' 2024-09-11T00:23:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.388+0000 7fc8d88d2740 1 --2- 172.21.15.78:0/1239273700 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55de9d51fd30 0x55de9d522150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.388+0000 7fc8d88d2740 4 client.16269 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:23:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.388+0000 7fc8d88d2740 1 -- 172.21.15.78:0/1239273700 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55de9d406850 con 0x55de9d51fd30 2024-09-11T00:23:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.388+0000 7fc8c7fff640 1 --2- 172.21.15.78:0/1239273700 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55de9d51fd30 0x55de9d522150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.389+0000 7fc8af7fe640 10 client.16269 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.389+0000 7fc8c7fff640 1 --2- 172.21.15.78:0/1239273700 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55de9d51fd30 0x55de9d522150 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5ded8291b0b4530 server_cookie=86e2d3628fbed7e0 in_seq=0 out_seq=0 2024-09-11T00:23:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.389+0000 7fc8af7fe640 1 -- 172.21.15.78:0/1239273700 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x55de9d406850 con 0x55de9d51fd30 2024-09-11T00:23:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.389+0000 7fc8af7fe640 10 client.16269 handle_command_reply: tid=0 2024-09-11T00:23:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.389+0000 7fc8d88d2740 1 client.16269 shutdown 2024-09-11T00:23:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.389+0000 7fc8d88d2740 1 -- 172.21.15.78:0/1239273700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d492480 msgr2=0x55de9d4a7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.389+0000 7fc8d88d2740 1 --2- 172.21.15.78:0/1239273700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d492480 0x55de9d4a7550 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0005c00 tx=0x7fc8c002a410 comp rx=0 tx=0).stop 2024-09-11T00:23:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.389+0000 7fc8d88d2740 1 -- 172.21.15.78:0/1239273700 shutdown_connections 2024-09-11T00:23:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.389+0000 7fc8d88d2740 1 --2- 172.21.15.78:0/1239273700 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55de9d51fd30 0x55de9d522150 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.389+0000 7fc8d88d2740 1 --2- 172.21.15.78:0/1239273700 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de9d49ed30 0x55de9d4a30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.389+0000 7fc8d88d2740 1 --2- 172.21.15.78:0/1239273700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de9d492da0 0x55de9d4a2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.389+0000 7fc8af7fe640 0 client.16269 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:35.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.389+0000 7fc8d88d2740 1 --2- 172.21.15.78:0/1239273700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de9d492480 0x55de9d4a7550 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.389+0000 7fc8d88d2740 1 -- 172.21.15.78:0/1239273700 >> 172.21.15.78:0/1239273700 conn(0x55de9d4902b0 msgr2=0x55de9d49d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:35.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.389+0000 7fc8d88d2740 1 -- 172.21.15.78:0/1239273700 shutdown_connections 2024-09-11T00:23:35.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.389+0000 7fc8d88d2740 1 -- 172.21.15.78:0/1239273700 wait complete. 2024-09-11T00:23:35.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.389+0000 7fc8d88d2740 20 client.16269 trim_cache size 0 max 16384 2024-09-11T00:23:35.398 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:23:35.398 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-11T00:23:35.398 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {}, 2024-09-11T00:23:35.398 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:23:35.398 INFO:teuthology.orchestra.run.smithi078.stdout: "f494d5ed-e0dc-44bb-8aba-a861b3e751f4": { 2024-09-11T00:23:35.399 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:55.251691+0000", 2024-09-11T00:23:35.399 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:35.399 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:35.399 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:35.399 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:35.399 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:35.399 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:35.399 INFO:teuthology.orchestra.run.smithi078.stdout: "e0002672-e432-4890-ab9f-20c513c5e3b6": { 2024-09-11T00:23:35.399 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:21:37.161715+0000", 2024-09-11T00:23:35.399 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:35.399 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:35.399 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:35.399 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:35.399 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:35.400 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:35.400 INFO:teuthology.orchestra.run.smithi078.stdout: "1b9391c2-08f3-479a-9538-deea28f7743b": { 2024-09-11T00:23:35.400 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:02.327508+0000", 2024-09-11T00:23:35.400 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:35.400 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:35.400 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:35.400 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:35.400 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:35.400 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:35.400 INFO:teuthology.orchestra.run.smithi078.stdout: "8ec9e858-aa62-420d-a112-e62ea7810e63": { 2024-09-11T00:23:35.400 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:18.882749+0000", 2024-09-11T00:23:35.400 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:35.400 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:35.400 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:35.401 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:35.401 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:35.401 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:35.401 INFO:teuthology.orchestra.run.smithi078.stdout: "38a1d30d-5f4c-460a-afcd-e6c60b97e43a": { 2024-09-11T00:23:35.401 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:58.127727+0000", 2024-09-11T00:23:35.401 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:35.401 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:35.401 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:35.401 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:35.401 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:35.401 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:35.401 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:23:35.401 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:23:35.401 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:35.402 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:35.402 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:35.402 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:35.402 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:35.402 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:35.402 INFO:teuthology.orchestra.run.smithi078.stdout: "81d31d3a-c224-4ded-9f00-1a7dfc099ec4": { 2024-09-11T00:23:35.402 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:16.296700+0000", 2024-09-11T00:23:35.402 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:35.402 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:35.402 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:35.402 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:35.402 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:35.402 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:35.402 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:23:35.402 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:23:35.403 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:35.403 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:35.403 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:35.403 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:35.403 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:35.403 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:35.403 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:23:35.403 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:23:35.403 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:35.403 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:35.403 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:35.403 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:35.403 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:35.403 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:35.403 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:23:35.404 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:23:35.404 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:35.404 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:35.404 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:35.404 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:35.404 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:35.404 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:35.404 INFO:teuthology.orchestra.run.smithi078.stdout: "b854cbd3-8ca7-4277-a205-8887d2ff5567": { 2024-09-11T00:23:35.404 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:11.182949+0000", 2024-09-11T00:23:35.404 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:35.404 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:35.404 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:35.404 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:35.404 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:35.404 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:35.405 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:23:35.405 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:23:35.405 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:35.405 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:35.405 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:35.405 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:35.405 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:35.405 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:35.405 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:23:35.405 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:23:35.405 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:35.405 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:35.405 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:35.406 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:35.406 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:35.406 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:23:35.406 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:23:35.406 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:23:35.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.390+0000 7fc8d64fd640 1 -- 172.21.15.78:0/3595326394 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc8bc0b5450 msgr2=0x7fc8bc0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:35.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.390+0000 7fc8d64fd640 1 --2- 172.21.15.78:0/3595326394 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc8bc0b5450 0x7fc8bc0b7910 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0000c00 tx=0x7fc8c0005a40 comp rx=0 tx=0).stop 2024-09-11T00:23:35.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.390+0000 7fc8d64fd640 1 -- 172.21.15.78:0/3595326394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8d0104570 msgr2=0x7fc8d0199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.390+0000 7fc8d64fd640 1 --2- 172.21.15.78:0/3595326394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8d0104570 0x7fc8d0199840 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800c890 tx=0x7fc8b800cd50 comp rx=0 tx=0).stop 2024-09-11T00:23:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.390+0000 7fc8d64fd640 1 -- 172.21.15.78:0/3595326394 shutdown_connections 2024-09-11T00:23:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.390+0000 7fc8d64fd640 1 --2- 172.21.15.78:0/3595326394 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc8bc0b5450 0x7fc8bc0b7910 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.390+0000 7fc8d64fd640 1 --2- 172.21.15.78:0/3595326394 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8d010d120 0x7fc8d019ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.390+0000 7fc8d64fd640 1 --2- 172.21.15.78:0/3595326394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8d0104570 0x7fc8d0199840 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.390+0000 7fc8d64fd640 1 --2- 172.21.15.78:0/3595326394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8d0103b70 0x7fc8d0199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.390+0000 7fc8d64fd640 1 -- 172.21.15.78:0/3595326394 >> 172.21.15.78:0/3595326394 conn(0x7fc8d00fd700 msgr2=0x7fc8d00fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.390+0000 7fc8d64fd640 1 -- 172.21.15.78:0/3595326394 shutdown_connections 2024-09-11T00:23:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:35.390+0000 7fc8d64fd640 1 -- 172.21.15.78:0/3595326394 wait complete. 2024-09-11T00:23:36.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:35 smithi078 ceph-mon[30865]: pgmap v539: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:23:36.207 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:23:36.208 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:23:36.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:35 smithi112 ceph-mon[35627]: pgmap v539: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:23:36.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:35 smithi138 ceph-mon[35019]: pgmap v539: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:23:36.453 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:23:36.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.960+0000 7f93a022f640 1 -- 172.21.15.78:0/2427751924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93981087d0 msgr2=0x7f9398108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:36.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.960+0000 7f93a022f640 1 --2- 172.21.15.78:0/2427751924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93981087d0 0x7f9398108c10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9388009900 tx=0x7f938802a410 comp rx=0 tx=0).stop 2024-09-11T00:23:36.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.961+0000 7f93a022f640 1 -- 172.21.15.78:0/2427751924 shutdown_connections 2024-09-11T00:23:36.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.961+0000 7f93a022f640 1 --2- 172.21.15.78:0/2427751924 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9398109150 0x7f939810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:36.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.961+0000 7f93a022f640 1 --2- 172.21.15.78:0/2427751924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93981087d0 0x7f9398108c10 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:36.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.961+0000 7f93a022f640 1 --2- 172.21.15.78:0/2427751924 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9398102dc0 0x7f93981031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:36.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.961+0000 7f93a022f640 1 -- 172.21.15.78:0/2427751924 >> 172.21.15.78:0/2427751924 conn(0x7f93980fe830 msgr2=0x7f9398100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:36.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.961+0000 7f93a022f640 1 -- 172.21.15.78:0/2427751924 shutdown_connections 2024-09-11T00:23:36.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.961+0000 7f93a022f640 1 -- 172.21.15.78:0/2427751924 wait complete. 2024-09-11T00:23:36.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.961+0000 7f93a022f640 1 Processor -- start 2024-09-11T00:23:36.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.961+0000 7f93a022f640 1 -- start start 2024-09-11T00:23:36.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.961+0000 7f93a022f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9398102dc0 0x7f93980754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:36.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.962+0000 7f93a022f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93981087d0 0x7f93980759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:36.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.962+0000 7f93a022f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9398109150 0x7f9398075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:36.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.962+0000 7f93a022f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9398112e50 con 0x7f9398102dc0 2024-09-11T00:23:36.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.962+0000 7f93a022f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9398112cd0 con 0x7f9398109150 2024-09-11T00:23:36.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.962+0000 7f93a022f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9398112fd0 con 0x7f93981087d0 2024-09-11T00:23:36.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.962+0000 7f939dfcb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9398102dc0 0x7f93980754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:36.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.962+0000 7f939dfcb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9398102dc0 0x7f93980754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40428/0 (socket says 172.21.15.78:40428) 2024-09-11T00:23:36.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.962+0000 7f939dfcb640 1 -- 172.21.15.78:0/3448910575 learned_addr learned my addr 172.21.15.78:0/3448910575 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:36.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.962+0000 7f939e7cc640 1 --2- 172.21.15.78:0/3448910575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9398109150 0x7f9398075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:36.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.962+0000 7f939d7ca640 1 --2- 172.21.15.78:0/3448910575 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93981087d0 0x7f93980759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:36.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.962+0000 7f939dfcb640 1 -- 172.21.15.78:0/3448910575 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93981087d0 msgr2=0x7f93980759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:36.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.962+0000 7f939dfcb640 1 --2- 172.21.15.78:0/3448910575 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93981087d0 0x7f93980759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:36.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.962+0000 7f939dfcb640 1 -- 172.21.15.78:0/3448910575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9398109150 msgr2=0x7f9398075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:36.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.962+0000 7f939dfcb640 1 --2- 172.21.15.78:0/3448910575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9398109150 0x7f9398075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:36.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.962+0000 7f939dfcb640 1 -- 172.21.15.78:0/3448910575 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93981a7860 con 0x7f9398102dc0 2024-09-11T00:23:36.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.962+0000 7f939e7cc640 1 --2- 172.21.15.78:0/3448910575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9398109150 0x7f9398075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:36.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.962+0000 7f939dfcb640 1 --2- 172.21.15.78:0/3448910575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9398102dc0 0x7f93980754a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f939400ba50 tx=0x7f939400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:36.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.962+0000 7f938effd640 1 -- 172.21.15.78:0/3448910575 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9394019070 con 0x7f9398102dc0 2024-09-11T00:23:36.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.962+0000 7f93a022f640 1 -- 172.21.15.78:0/3448910575 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93981a7b50 con 0x7f9398102dc0 2024-09-11T00:23:36.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.962+0000 7f938effd640 1 -- 172.21.15.78:0/3448910575 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f939400cbe0 con 0x7f9398102dc0 2024-09-11T00:23:36.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.962+0000 7f938effd640 1 -- 172.21.15.78:0/3448910575 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93940075d0 con 0x7f9398102dc0 2024-09-11T00:23:36.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.962+0000 7f93a022f640 1 -- 172.21.15.78:0/3448910575 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93981a80b0 con 0x7f9398102dc0 2024-09-11T00:23:36.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.963+0000 7f93a022f640 1 -- 172.21.15.78:0/3448910575 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9398103220 con 0x7f9398102dc0 2024-09-11T00:23:36.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.965+0000 7f938effd640 1 -- 172.21.15.78:0/3448910575 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f9394007830 con 0x7f9398102dc0 2024-09-11T00:23:36.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.966+0000 7f938effd640 1 --2- 172.21.15.78:0/3448910575 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f93840b5450 0x7f93840b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:36.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.966+0000 7f939d7ca640 1 --2- 172.21.15.78:0/3448910575 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f93840b5450 0x7f93840b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:36.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.966+0000 7f938effd640 1 -- 172.21.15.78:0/3448910575 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7f93940e5d50 con 0x7f9398102dc0 2024-09-11T00:23:36.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.966+0000 7f939d7ca640 1 --2- 172.21.15.78:0/3448910575 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f93840b5450 0x7f93840b7910 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9388031440 tx=0x7f93880095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:36.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:36.969+0000 7f938effd640 1 -- 172.21.15.78:0/3448910575 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f93940ac8a0 con 0x7f9398102dc0 2024-09-11T00:23:37.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:37.178+0000 7f93a022f640 1 -- 172.21.15.78:0/3448910575 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93980767a0 con 0x7f9398102dc0 2024-09-11T00:23:37.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:37.179+0000 7f938effd640 1 -- 172.21.15.78:0/3448910575 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f93980767a0 con 0x7f9398102dc0 2024-09-11T00:23:37.181 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:23:37.181 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:23:37.181 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:23:37.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:37.181+0000 7f93a022f640 1 -- 172.21.15.78:0/3448910575 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f93840b5450 msgr2=0x7f93840b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:37.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:37.181+0000 7f93a022f640 1 --2- 172.21.15.78:0/3448910575 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f93840b5450 0x7f93840b7910 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9388031440 tx=0x7f93880095f0 comp rx=0 tx=0).stop 2024-09-11T00:23:37.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:37.181+0000 7f93a022f640 1 -- 172.21.15.78:0/3448910575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9398102dc0 msgr2=0x7f93980754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:37.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:37.181+0000 7f93a022f640 1 --2- 172.21.15.78:0/3448910575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9398102dc0 0x7f93980754a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f939400ba50 tx=0x7f939400bf10 comp rx=0 tx=0).stop 2024-09-11T00:23:37.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:37.181+0000 7f93a022f640 1 -- 172.21.15.78:0/3448910575 shutdown_connections 2024-09-11T00:23:37.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:37.181+0000 7f93a022f640 1 --2- 172.21.15.78:0/3448910575 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f93840b5450 0x7f93840b7910 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:37.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:37.181+0000 7f93a022f640 1 --2- 172.21.15.78:0/3448910575 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9398109150 0x7f9398075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:37.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:37.181+0000 7f93a022f640 1 --2- 172.21.15.78:0/3448910575 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93981087d0 0x7f93980759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:37.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:37.181+0000 7f93a022f640 1 --2- 172.21.15.78:0/3448910575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9398102dc0 0x7f93980754a0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:37.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:37.181+0000 7f93a022f640 1 -- 172.21.15.78:0/3448910575 >> 172.21.15.78:0/3448910575 conn(0x7f93980fe830 msgr2=0x7f9398100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:37.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:37.181+0000 7f93a022f640 1 -- 172.21.15.78:0/3448910575 shutdown_connections 2024-09-11T00:23:37.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:37.181+0000 7f93a022f640 1 -- 172.21.15.78:0/3448910575 wait complete. 2024-09-11T00:23:37.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:37 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3448910575' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:23:37.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:37 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3448910575' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:23:37.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:37 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3448910575' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:23:37.866 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:23:38.116 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:23:38.508 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:38 smithi078 ceph-mon[30865]: pgmap v540: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:23:38.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:38 smithi138 ceph-mon[35019]: pgmap v540: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:23:38.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.587+0000 7f765658c640 1 -- 172.21.15.78:0/1892637288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f765010d250 msgr2=0x7f765010f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:38.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.587+0000 7f765658c640 1 --2- 172.21.15.78:0/1892637288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f765010d250 0x7f765010f640 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f7648009ca0 tx=0x7f764802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.587+0000 7f765658c640 1 -- 172.21.15.78:0/1892637288 shutdown_connections 2024-09-11T00:23:38.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.587+0000 7f765658c640 1 --2- 172.21.15.78:0/1892637288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f765010d250 0x7f765010f640 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.587+0000 7f765658c640 1 --2- 172.21.15.78:0/1892637288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f765010a920 0x7f765010cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.587+0000 7f765658c640 1 --2- 172.21.15.78:0/1892637288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7650101810 0x7f7650101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.587+0000 7f765658c640 1 -- 172.21.15.78:0/1892637288 >> 172.21.15.78:0/1892637288 conn(0x7f7650076f50 msgr2=0x7f7650077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:38.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.587+0000 7f765658c640 1 -- 172.21.15.78:0/1892637288 shutdown_connections 2024-09-11T00:23:38.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.587+0000 7f765658c640 1 -- 172.21.15.78:0/1892637288 wait complete. 2024-09-11T00:23:38.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.588+0000 7f765658c640 1 Processor -- start 2024-09-11T00:23:38.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.588+0000 7f765658c640 1 -- start start 2024-09-11T00:23:38.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.588+0000 7f765658c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7650101810 0x7f7650199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:38.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.588+0000 7f765658c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f765010a920 0x7f7650199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:38.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.588+0000 7f765658c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f765010d250 0x7f765019eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:38.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.588+0000 7f765658c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7650112d90 con 0x7f765010d250 2024-09-11T00:23:38.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.588+0000 7f765658c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7650112c10 con 0x7f765010a920 2024-09-11T00:23:38.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.588+0000 7f765658c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7650112f10 con 0x7f7650101810 2024-09-11T00:23:38.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.588+0000 7f7654b29640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f765010d250 0x7f765019eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:38.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.588+0000 7f7654b29640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f765010d250 0x7f765019eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40444/0 (socket says 172.21.15.78:40444) 2024-09-11T00:23:38.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.588+0000 7f7654b29640 1 -- 172.21.15.78:0/614960402 learned_addr learned my addr 172.21.15.78:0/614960402 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:38.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.588+0000 7f764ffff640 1 --2- 172.21.15.78:0/614960402 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7650101810 0x7f7650199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:38.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.588+0000 7f764f7fe640 1 --2- 172.21.15.78:0/614960402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f765010a920 0x7f7650199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:38.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.588+0000 7f7654b29640 1 -- 172.21.15.78:0/614960402 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7650101810 msgr2=0x7f7650199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:38.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.588+0000 7f7654b29640 1 --2- 172.21.15.78:0/614960402 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7650101810 0x7f7650199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.589+0000 7f7654b29640 1 -- 172.21.15.78:0/614960402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f765010a920 msgr2=0x7f7650199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:38.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.589+0000 7f7654b29640 1 --2- 172.21.15.78:0/614960402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f765010a920 0x7f7650199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.589+0000 7f7654b29640 1 -- 172.21.15.78:0/614960402 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f765019f2f0 con 0x7f765010d250 2024-09-11T00:23:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.589+0000 7f764f7fe640 1 --2- 172.21.15.78:0/614960402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f765010a920 0x7f7650199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.589+0000 7f7654b29640 1 --2- 172.21.15.78:0/614960402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f765010d250 0x7f765019eb20 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7648005cc0 tx=0x7f764802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.589+0000 7f764d7fa640 1 -- 172.21.15.78:0/614960402 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7648003bf0 con 0x7f765010d250 2024-09-11T00:23:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.589+0000 7f764d7fa640 1 -- 172.21.15.78:0/614960402 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7648003d90 con 0x7f765010d250 2024-09-11T00:23:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.589+0000 7f765658c640 1 -- 172.21.15.78:0/614960402 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f765019f580 con 0x7f765010d250 2024-09-11T00:23:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.589+0000 7f764d7fa640 1 -- 172.21.15.78:0/614960402 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764802fbc0 con 0x7f765010d250 2024-09-11T00:23:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.589+0000 7f765658c640 1 -- 172.21.15.78:0/614960402 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76501a5ca0 con 0x7f765010d250 2024-09-11T00:23:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.591+0000 7f764d7fa640 1 -- 172.21.15.78:0/614960402 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f7648004610 con 0x7f765010d250 2024-09-11T00:23:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.591+0000 7f7658961740 1 Processor -- start 2024-09-11T00:23:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.592+0000 7f7658961740 1 -- start start 2024-09-11T00:23:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.592+0000 7f7658961740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e184ff34d0 0x55e184ff38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.592+0000 7f7658961740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e184ff3df0 0x55e185003c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.592+0000 7f7658961740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e185004190 0x55e185006580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:38.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.592+0000 7f7658961740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55e184f69ea0 con 0x55e184ff3df0 2024-09-11T00:23:38.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.592+0000 7f7658961740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e184f592d0 con 0x55e185004190 2024-09-11T00:23:38.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.592+0000 7f7658961740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55e184f5d0e0 con 0x55e184ff34d0 2024-09-11T00:23:38.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.592+0000 7f764ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e184ff3df0 0x55e185003c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:38.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.592+0000 7f764ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e184ff3df0 0x55e185003c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40456/0 (socket says 172.21.15.78:40456) 2024-09-11T00:23:38.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.592+0000 7f764ffff640 1 -- 172.21.15.78:0/979090111 learned_addr learned my addr 172.21.15.78:0/979090111 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:38.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.592+0000 7f764f7fe640 1 --2- 172.21.15.78:0/979090111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e185004190 0x55e185006580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:38.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.592+0000 7f764d7fa640 1 --2- 172.21.15.78:0/614960402 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f763c0b5450 0x7f763c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:38.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.592+0000 7f764f7fe640 1 --2- 172.21.15.78:0/979090111 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e184ff34d0 0x55e184ff38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:38.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.592+0000 7f764ffff640 1 -- 172.21.15.78:0/979090111 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e184ff34d0 msgr2=0x55e184ff38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:38.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.592+0000 7f764ffff640 1 --2- 172.21.15.78:0/979090111 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e184ff34d0 0x55e184ff38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.592+0000 7f764ffff640 1 -- 172.21.15.78:0/979090111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e185004190 msgr2=0x55e185006580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:38.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.592+0000 7f764ffff640 1 --2- 172.21.15.78:0/979090111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e185004190 0x55e185006580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.592+0000 7f764ffff640 1 -- 172.21.15.78:0/979090111 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e184cb7650 con 0x55e184ff3df0 2024-09-11T00:23:38.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.592+0000 7f7654b29640 1 --2- 172.21.15.78:0/614960402 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f763c0b5450 0x7f763c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:38.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.592+0000 7f764ffff640 1 --2- 172.21.15.78:0/979090111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e184ff3df0 0x55e185003c50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f764000bd40 tx=0x7f76400107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b700d962d57f4886 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:38.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.592+0000 7f764d7fa640 1 -- 172.21.15.78:0/614960402 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7f7648107570 con 0x7f765010d250 2024-09-11T00:23:38.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.593+0000 7f76467fc640 1 -- 172.21.15.78:0/979090111 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7640004230 con 0x55e184ff3df0 2024-09-11T00:23:38.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.593+0000 7f76467fc640 1 -- 172.21.15.78:0/979090111 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f764000be30 con 0x55e184ff3df0 2024-09-11T00:23:38.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.593+0000 7f76467fc640 1 -- 172.21.15.78:0/979090111 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764001a7a0 con 0x55e184ff3df0 2024-09-11T00:23:38.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.593+0000 7f7658961740 1 -- 172.21.15.78:0/979090111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e184ff3df0 msgr2=0x55e185003c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:38.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.593+0000 7f7654b29640 1 --2- 172.21.15.78:0/614960402 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f763c0b5450 0x7f763c0b7910 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f76480cd680 tx=0x7f7648099c70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:38.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.593+0000 7f7658961740 1 --2- 172.21.15.78:0/979090111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e184ff3df0 0x55e185003c50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f764000bd40 tx=0x7f76400107a0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.593+0000 7f7658961740 1 -- 172.21.15.78:0/979090111 shutdown_connections 2024-09-11T00:23:38.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.593+0000 7f7658961740 1 --2- 172.21.15.78:0/979090111 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e185004190 0x55e185006580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.593+0000 7f7658961740 1 --2- 172.21.15.78:0/979090111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e184ff3df0 0x55e185003c50 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.593+0000 7f7658961740 1 --2- 172.21.15.78:0/979090111 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e184ff34d0 0x55e184ff38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.593+0000 7f7658961740 1 -- 172.21.15.78:0/979090111 >> 172.21.15.78:0/979090111 conn(0x55e184ff1300 msgr2=0x55e184ff24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:38.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.593+0000 7f7658961740 1 -- 172.21.15.78:0/979090111 shutdown_connections 2024-09-11T00:23:38.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.593+0000 7f7658961740 1 -- 172.21.15.78:0/979090111 wait complete. 2024-09-11T00:23:38.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.594+0000 7f7658961740 1 -- start start 2024-09-11T00:23:38.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.594+0000 7f7658961740 1 Processor -- start 2024-09-11T00:23:38.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.594+0000 7f7658961740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e184ff34d0 0x55e185003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:38.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.594+0000 7f7658961740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e184ff3df0 0x55e185000ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:38.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.594+0000 7f7658961740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e185004190 0x55e185001480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:38.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.594+0000 7f7658961740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55e184dba700 con 0x55e185004190 2024-09-11T00:23:38.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.594+0000 7f7658961740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e184ef4160 con 0x55e184ff34d0 2024-09-11T00:23:38.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.594+0000 7f7658961740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55e185006e40 con 0x55e184ff3df0 2024-09-11T00:23:38.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.594+0000 7f7658961740 10 client.0 _ll_register_callbacks cb 0x55e184f0d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:23:38.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.595+0000 7f764f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e185004190 0x55e185001480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:38.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.595+0000 7f764f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e185004190 0x55e185001480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40458/0 (socket says 172.21.15.78:40458) 2024-09-11T00:23:38.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.595+0000 7f764f7fe640 1 -- 172.21.15.78:0/529341660 learned_addr learned my addr 172.21.15.78:0/529341660 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:38.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.595+0000 7f764f7fe640 1 --2- 172.21.15.78:0/529341660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e184ff34d0 0x55e185003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:38.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.595+0000 7f764ffff640 1 --2- 172.21.15.78:0/529341660 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e184ff3df0 0x55e185000ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:38.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.595+0000 7f764f7fe640 1 -- 172.21.15.78:0/529341660 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e184ff3df0 msgr2=0x55e185000ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:38.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.595+0000 7f764f7fe640 1 --2- 172.21.15.78:0/529341660 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e184ff3df0 0x55e185000ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.595+0000 7f764f7fe640 1 -- 172.21.15.78:0/529341660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e184ff34d0 msgr2=0x55e185003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:38.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.595+0000 7f764f7fe640 1 --2- 172.21.15.78:0/529341660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e184ff34d0 0x55e185003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.595+0000 7f764f7fe640 1 -- 172.21.15.78:0/529341660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e184f21c90 con 0x55e185004190 2024-09-11T00:23:38.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.595+0000 7f764f7fe640 1 --2- 172.21.15.78:0/529341660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e185004190 0x55e185001480 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7638013cd0 tx=0x7f76380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119a6d2e9c82aea6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:38.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.595+0000 7f762f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:23:38.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.595+0000 7f762f7fe640 1 -- 172.21.15.78:0/529341660 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763800ebe0 con 0x55e185004190 2024-09-11T00:23:38.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.595+0000 7f762f7fe640 1 -- 172.21.15.78:0/529341660 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7f763800ed80 con 0x55e185004190 2024-09-11T00:23:38.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.595+0000 7f7658961740 1 -- 172.21.15.78:0/529341660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f764000be30 con 0x55e185004190 2024-09-11T00:23:38.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.595+0000 7f762f7fe640 1 -- 172.21.15.78:0/529341660 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7638004020 con 0x55e185004190 2024-09-11T00:23:38.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.595+0000 7f7658961740 10 client.16287 fetch_fsmap learned FSMap version 20 2024-09-11T00:23:38.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.595+0000 7f7658961740 1 -- 172.21.15.78:0/529341660 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e1850127d0 con 0x55e185004190 2024-09-11T00:23:38.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.596+0000 7f762f7fe640 1 -- 172.21.15.78:0/529341660 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f764000be30 con 0x55e185004190 2024-09-11T00:23:38.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.596+0000 7f762f7fe640 1 -- 172.21.15.78:0/529341660 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f7638004830 con 0x55e185004190 2024-09-11T00:23:38.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.596+0000 7f7658961740 10 client.16287 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:23:38.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.596+0000 7f7658961740 10 client.16287 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:23:38.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.596+0000 7f7658961740 20 client.16287 populate_metadata read hostname 'smithi078' 2024-09-11T00:23:38.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.596+0000 7f7658961740 1 --2- 172.21.15.78:0/529341660 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55e185013c80 0x55e1850160e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:38.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.596+0000 7f7658961740 4 client.16287 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:23:38.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.596+0000 7f7658961740 1 -- 172.21.15.78:0/529341660 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e184f6bdf0 con 0x55e185013c80 2024-09-11T00:23:38.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.596+0000 7f764ffff640 1 --2- 172.21.15.78:0/529341660 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55e185013c80 0x55e1850160e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:38.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.597+0000 7f764ffff640 1 --2- 172.21.15.78:0/529341660 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55e185013c80 0x55e1850160e0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69db5b0ed902b42a server_cookie=236672a7a87664 in_seq=0 out_seq=0 2024-09-11T00:23:38.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.597+0000 7f762f7fe640 10 client.16287 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:38.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.597+0000 7f762f7fe640 1 -- 172.21.15.78:0/529341660 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e184f6bdf0 con 0x55e185013c80 2024-09-11T00:23:38.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.597+0000 7f762f7fe640 10 client.16287 handle_command_reply: tid=0 2024-09-11T00:23:38.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.597+0000 7f7658961740 1 client.16287 shutdown 2024-09-11T00:23:38.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.597+0000 7f7658961740 1 -- 172.21.15.78:0/529341660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e185004190 msgr2=0x55e185001480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:38.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.597+0000 7f7658961740 1 --2- 172.21.15.78:0/529341660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e185004190 0x55e185001480 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7638013cd0 tx=0x7f76380046c0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.597+0000 7f7658961740 1 -- 172.21.15.78:0/529341660 shutdown_connections 2024-09-11T00:23:38.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.597+0000 7f7658961740 1 --2- 172.21.15.78:0/529341660 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55e185013c80 0x55e1850160e0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.597+0000 7f7658961740 1 --2- 172.21.15.78:0/529341660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e185004190 0x55e185001480 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.597+0000 7f7658961740 1 --2- 172.21.15.78:0/529341660 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e184ff3df0 0x55e185000ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.597+0000 7f762f7fe640 0 client.16287 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:38.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.597+0000 7f7658961740 1 --2- 172.21.15.78:0/529341660 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e184ff34d0 0x55e185003a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.597+0000 7f7658961740 1 -- 172.21.15.78:0/529341660 >> 172.21.15.78:0/529341660 conn(0x55e184ff1300 msgr2=0x55e184ff0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:38.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.598+0000 7f7658961740 1 -- 172.21.15.78:0/529341660 shutdown_connections 2024-09-11T00:23:38.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.598+0000 7f7658961740 1 -- 172.21.15.78:0/529341660 wait complete. 2024-09-11T00:23:38.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.598+0000 7f7658961740 20 client.16287 trim_cache size 0 max 16384 2024-09-11T00:23:38.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.610+0000 7f7658961740 1 Processor -- start 2024-09-11T00:23:38.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.610+0000 7f7658961740 1 -- start start 2024-09-11T00:23:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.611+0000 7f7658961740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e184ff34d0 0x55e1850100a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.611+0000 7f7658961740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e184ff3df0 0x55e184ff26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.611+0000 7f7658961740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e185004190 0x55e18501b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.611+0000 7f7658961740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f76501aa590 con 0x55e185004190 2024-09-11T00:23:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.611+0000 7f7658961740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f76501acdd0 con 0x55e184ff34d0 2024-09-11T00:23:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.611+0000 7f7658961740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f76501aabe0 con 0x55e184ff3df0 2024-09-11T00:23:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.611+0000 7f764f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e185004190 0x55e18501b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.611+0000 7f764f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e185004190 0x55e18501b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40468/0 (socket says 172.21.15.78:40468) 2024-09-11T00:23:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.611+0000 7f764f7fe640 1 -- 172.21.15.78:0/3720911734 learned_addr learned my addr 172.21.15.78:0/3720911734 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.611+0000 7f764ffff640 1 --2- 172.21.15.78:0/3720911734 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e184ff3df0 0x55e184ff26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.611+0000 7f764f7fe640 1 --2- 172.21.15.78:0/3720911734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e184ff34d0 0x55e1850100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.611+0000 7f764f7fe640 1 -- 172.21.15.78:0/3720911734 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e184ff3df0 msgr2=0x55e184ff26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:38.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.611+0000 7f764f7fe640 1 --2- 172.21.15.78:0/3720911734 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e184ff3df0 0x55e184ff26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.611+0000 7f764f7fe640 1 -- 172.21.15.78:0/3720911734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e184ff34d0 msgr2=0x55e1850100a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:38.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.611+0000 7f764f7fe640 1 --2- 172.21.15.78:0/3720911734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e184ff34d0 0x55e1850100a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.611+0000 7f764f7fe640 1 -- 172.21.15.78:0/3720911734 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e184ff1110 con 0x55e185004190 2024-09-11T00:23:38.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.611+0000 7f764f7fe640 1 --2- 172.21.15.78:0/3720911734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e185004190 0x55e18501b9b0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7638013710 tx=0x7f7638013680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b7b31155bf1e24 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:38.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.611+0000 7f7645ffb640 1 -- 172.21.15.78:0/3720911734 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763802e070 con 0x55e185004190 2024-09-11T00:23:38.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.611+0000 7f7645ffb640 1 -- 172.21.15.78:0/3720911734 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f763802f040 con 0x55e185004190 2024-09-11T00:23:38.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.611+0000 7f7645ffb640 1 -- 172.21.15.78:0/3720911734 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7638004400 con 0x55e185004190 2024-09-11T00:23:38.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.612+0000 7f7658961740 1 -- 172.21.15.78:0/3720911734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e185004190 msgr2=0x55e18501b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:38.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.612+0000 7f7658961740 1 --2- 172.21.15.78:0/3720911734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e185004190 0x55e18501b9b0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7638013710 tx=0x7f7638013680 comp rx=0 tx=0).stop 2024-09-11T00:23:38.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.612+0000 7f7658961740 1 -- 172.21.15.78:0/3720911734 shutdown_connections 2024-09-11T00:23:38.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.612+0000 7f7658961740 1 --2- 172.21.15.78:0/3720911734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e185004190 0x55e18501b9b0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.612+0000 7f7658961740 1 --2- 172.21.15.78:0/3720911734 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e184ff3df0 0x55e184ff26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.612+0000 7f7658961740 1 --2- 172.21.15.78:0/3720911734 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e184ff34d0 0x55e1850100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.612+0000 7f7658961740 1 -- 172.21.15.78:0/3720911734 >> 172.21.15.78:0/3720911734 conn(0x55e184ff1300 msgr2=0x55e184ff1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:38.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.612+0000 7f7658961740 1 -- 172.21.15.78:0/3720911734 shutdown_connections 2024-09-11T00:23:38.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.612+0000 7f7658961740 1 -- 172.21.15.78:0/3720911734 wait complete. 2024-09-11T00:23:38.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.612+0000 7f7658961740 1 -- start start 2024-09-11T00:23:38.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.612+0000 7f7658961740 1 Processor -- start 2024-09-11T00:23:38.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.613+0000 7f7658961740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e184ff34d0 0x55e18500cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:38.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.613+0000 7f7658961740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e184ff3df0 0x55e1850090d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:38.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.613+0000 7f7658961740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e185004190 0x55e185009860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:38.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.613+0000 7f7658961740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f76501ab290 con 0x55e185004190 2024-09-11T00:23:38.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.613+0000 7f7658961740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f76501ac700 con 0x55e184ff34d0 2024-09-11T00:23:38.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.613+0000 7f7658961740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f76501ab960 con 0x55e184ff3df0 2024-09-11T00:23:38.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.613+0000 7f7658961740 10 client.0 _ll_register_callbacks cb 0x7f763800dc00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:23:38.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.613+0000 7f764f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e185004190 0x55e185009860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:38.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.613+0000 7f764f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e185004190 0x55e185009860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40476/0 (socket says 172.21.15.78:40476) 2024-09-11T00:23:38.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.613+0000 7f764f7fe640 1 -- 172.21.15.78:0/680089233 learned_addr learned my addr 172.21.15.78:0/680089233 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:38.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.613+0000 7f764ffff640 1 --2- 172.21.15.78:0/680089233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e184ff3df0 0x55e1850090d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:38.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.613+0000 7f764f7fe640 1 --2- 172.21.15.78:0/680089233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e184ff34d0 0x55e18500cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:38.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.613+0000 7f764f7fe640 1 -- 172.21.15.78:0/680089233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e184ff3df0 msgr2=0x55e1850090d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:38.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.613+0000 7f764f7fe640 1 --2- 172.21.15.78:0/680089233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e184ff3df0 0x55e1850090d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.613+0000 7f764f7fe640 1 -- 172.21.15.78:0/680089233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e184ff34d0 msgr2=0x55e18500cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:38.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.613+0000 7f764f7fe640 1 --2- 172.21.15.78:0/680089233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e184ff34d0 0x55e18500cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.613+0000 7f764f7fe640 1 -- 172.21.15.78:0/680089233 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e185080bc0 con 0x55e185004190 2024-09-11T00:23:38.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.613+0000 7f764f7fe640 1 --2- 172.21.15.78:0/680089233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e185004190 0x55e185009860 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f763800dd60 tx=0x7f76380139e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b60e015fcad6cb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:38.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.613+0000 7f762f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:23:38.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.613+0000 7f762f7fe640 1 -- 172.21.15.78:0/680089233 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763802e040 con 0x55e185004190 2024-09-11T00:23:38.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.614+0000 7f762f7fe640 1 -- 172.21.15.78:0/680089233 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7f7638004680 con 0x55e185004190 2024-09-11T00:23:38.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.614+0000 7f7658961740 1 -- 172.21.15.78:0/680089233 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f763802f040 con 0x55e185004190 2024-09-11T00:23:38.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.614+0000 7f762f7fe640 1 -- 172.21.15.78:0/680089233 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7638005c50 con 0x55e185004190 2024-09-11T00:23:38.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.614+0000 7f7658961740 10 client.16293 fetch_fsmap learned FSMap version 20 2024-09-11T00:23:38.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.614+0000 7f7658961740 1 -- 172.21.15.78:0/680089233 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e185081e70 con 0x55e185004190 2024-09-11T00:23:38.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.614+0000 7f762f7fe640 1 -- 172.21.15.78:0/680089233 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f763802f040 con 0x55e185004190 2024-09-11T00:23:38.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.614+0000 7f762f7fe640 1 -- 172.21.15.78:0/680089233 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f76380036e0 con 0x55e185004190 2024-09-11T00:23:38.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.614+0000 7f7658961740 10 client.16293 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:23:38.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.614+0000 7f7658961740 10 client.16293 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:23:38.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.614+0000 7f7658961740 20 client.16293 populate_metadata read hostname 'smithi078' 2024-09-11T00:23:38.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.614+0000 7f7658961740 1 --2- 172.21.15.78:0/680089233 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55e185082480 0x55e1850848a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:38.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.614+0000 7f7658961740 4 client.16293 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:23:38.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.614+0000 7f7658961740 1 -- 172.21.15.78:0/680089233 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e184f678a0 con 0x55e185082480 2024-09-11T00:23:38.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.615+0000 7f764ffff640 1 --2- 172.21.15.78:0/680089233 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55e185082480 0x55e1850848a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:38.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.615+0000 7f762f7fe640 10 client.16293 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:38.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.615+0000 7f764ffff640 1 --2- 172.21.15.78:0/680089233 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55e185082480 0x55e1850848a0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a282b3ca5bcb0a46 server_cookie=c84c178cd60f120e in_seq=0 out_seq=0 2024-09-11T00:23:38.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.615+0000 7f762f7fe640 1 -- 172.21.15.78:0/680089233 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e184f678a0 con 0x55e185082480 2024-09-11T00:23:38.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.615+0000 7f762f7fe640 10 client.16293 handle_command_reply: tid=0 2024-09-11T00:23:38.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.615+0000 7f7658961740 1 client.16293 shutdown 2024-09-11T00:23:38.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.615+0000 7f7658961740 1 -- 172.21.15.78:0/680089233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e185004190 msgr2=0x55e185009860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:38.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.615+0000 7f7658961740 1 --2- 172.21.15.78:0/680089233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e185004190 0x55e185009860 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f763800dd60 tx=0x7f76380139e0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.615+0000 7f7658961740 1 -- 172.21.15.78:0/680089233 shutdown_connections 2024-09-11T00:23:38.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.615+0000 7f7658961740 1 --2- 172.21.15.78:0/680089233 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55e185082480 0x55e1850848a0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.615+0000 7f7658961740 1 --2- 172.21.15.78:0/680089233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e185004190 0x55e185009860 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.615+0000 7f762f7fe640 0 client.16293 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:38.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.615+0000 7f7658961740 1 --2- 172.21.15.78:0/680089233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e184ff3df0 0x55e1850090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.615+0000 7f7658961740 1 --2- 172.21.15.78:0/680089233 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e184ff34d0 0x55e18500cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.615+0000 7f7658961740 1 -- 172.21.15.78:0/680089233 >> 172.21.15.78:0/680089233 conn(0x55e184ff1300 msgr2=0x55e184ff2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:38.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.615+0000 7f7658961740 1 -- 172.21.15.78:0/680089233 shutdown_connections 2024-09-11T00:23:38.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.615+0000 7f7658961740 1 -- 172.21.15.78:0/680089233 wait complete. 2024-09-11T00:23:38.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.616+0000 7f7658961740 20 client.16293 trim_cache size 0 max 16384 2024-09-11T00:23:38.634 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-11T00:23:38.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.616+0000 7f765658c640 1 -- 172.21.15.78:0/614960402 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f763c0b5450 msgr2=0x7f763c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:38.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.616+0000 7f765658c640 1 --2- 172.21.15.78:0/614960402 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f763c0b5450 0x7f763c0b7910 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f76480cd680 tx=0x7f7648099c70 comp rx=0 tx=0).stop 2024-09-11T00:23:38.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.616+0000 7f765658c640 1 -- 172.21.15.78:0/614960402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f765010d250 msgr2=0x7f765019eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:38.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.616+0000 7f765658c640 1 --2- 172.21.15.78:0/614960402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f765010d250 0x7f765019eb20 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7648005cc0 tx=0x7f764802f380 comp rx=0 tx=0).stop 2024-09-11T00:23:38.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.616+0000 7f765658c640 1 -- 172.21.15.78:0/614960402 shutdown_connections 2024-09-11T00:23:38.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.616+0000 7f765658c640 1 --2- 172.21.15.78:0/614960402 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f763c0b5450 0x7f763c0b7910 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.616+0000 7f765658c640 1 --2- 172.21.15.78:0/614960402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f765010d250 0x7f765019eb20 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.616+0000 7f765658c640 1 --2- 172.21.15.78:0/614960402 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f765010a920 0x7f7650199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.616+0000 7f765658c640 1 --2- 172.21.15.78:0/614960402 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7650101810 0x7f7650199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:38.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.616+0000 7f765658c640 1 -- 172.21.15.78:0/614960402 >> 172.21.15.78:0/614960402 conn(0x7f7650076f50 msgr2=0x7f76501005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:38.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.616+0000 7f765658c640 1 -- 172.21.15.78:0/614960402 shutdown_connections 2024-09-11T00:23:38.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:38.616+0000 7f765658c640 1 -- 172.21.15.78:0/614960402 wait complete. 2024-09-11T00:23:38.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:38 smithi112 ceph-mon[35627]: pgmap v540: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:23:40.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:39 smithi112 ceph-mon[35627]: pgmap v541: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:23:40.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:39 smithi138 ceph-mon[35019]: pgmap v541: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:23:40.298 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:23:40.299 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:23:40.321 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:39 smithi078 ceph-mon[30865]: pgmap v541: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:23:40.555 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:23:41.017 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:23:41.017 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.017 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.017 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.017 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.017 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.017 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.017 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.017 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.017 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.017 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.018 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.018 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.018 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:40 smithi078 ceph-mon[30865]: Adjusting osd_memory_target on smithi078 to 176.0M 2024-09-11T00:23:41.018 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:40 smithi078 ceph-mon[30865]: Adjusting osd_memory_target on smithi112 to 176.0M 2024-09-11T00:23:41.018 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:40 smithi078 ceph-mon[30865]: Adjusting osd_memory_target on smithi138 to 176.0M 2024-09-11T00:23:41.018 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:40 smithi078 ceph-mon[30865]: Unable to set osd_memory_target on smithi078 to 184556646: error parsing value: Value '184556646' is below minimum 939524096 2024-09-11T00:23:41.018 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:40 smithi078 ceph-mon[30865]: Unable to set osd_memory_target on smithi112 to 184568115: error parsing value: Value '184568115' is below minimum 939524096 2024-09-11T00:23:41.018 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:40 smithi078 ceph-mon[30865]: Unable to set osd_memory_target on smithi138 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-11T00:23:41.018 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:23:41.018 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:23:41.018 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:40 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:23:41.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.098+0000 7fd9782d2640 1 -- 172.21.15.78:0/2692611473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd970101cd0 msgr2=0x7fd9701020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:41.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.098+0000 7fd9782d2640 1 --2- 172.21.15.78:0/2692611473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd970101cd0 0x7fd9701020b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd96c009900 tx=0x7fd96c02a410 comp rx=0 tx=0).stop 2024-09-11T00:23:41.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.098+0000 7fd9782d2640 1 -- 172.21.15.78:0/2692611473 shutdown_connections 2024-09-11T00:23:41.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.098+0000 7fd9782d2640 1 --2- 172.21.15.78:0/2692611473 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd970108060 0x7fd97010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.098+0000 7fd9782d2640 1 --2- 172.21.15.78:0/2692611473 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9701076e0 0x7fd970107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.098+0000 7fd9782d2640 1 --2- 172.21.15.78:0/2692611473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd970101cd0 0x7fd9701020b0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.098+0000 7fd9782d2640 1 -- 172.21.15.78:0/2692611473 >> 172.21.15.78:0/2692611473 conn(0x7fd9700fd700 msgr2=0x7fd9700ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:41.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.098+0000 7fd9782d2640 1 -- 172.21.15.78:0/2692611473 shutdown_connections 2024-09-11T00:23:41.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.098+0000 7fd9782d2640 1 -- 172.21.15.78:0/2692611473 wait complete. 2024-09-11T00:23:41.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.099+0000 7fd9782d2640 1 Processor -- start 2024-09-11T00:23:41.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.099+0000 7fd9782d2640 1 -- start start 2024-09-11T00:23:41.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.099+0000 7fd9782d2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd970101cd0 0x7fd97019a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:41.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.099+0000 7fd9782d2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9701076e0 0x7fd97019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:41.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.099+0000 7fd9782d2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd970108060 0x7fd9701a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:41.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.099+0000 7fd9782d2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd970111d20 con 0x7fd970108060 2024-09-11T00:23:41.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.099+0000 7fd9782d2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd970111ba0 con 0x7fd970101cd0 2024-09-11T00:23:41.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.099+0000 7fd9782d2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd970111ea0 con 0x7fd9701076e0 2024-09-11T00:23:41.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.099+0000 7fd97686f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd970108060 0x7fd9701a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:41.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.099+0000 7fd97686f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd970108060 0x7fd9701a50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40494/0 (socket says 172.21.15.78:40494) 2024-09-11T00:23:41.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.099+0000 7fd97686f640 1 -- 172.21.15.78:0/3927720107 learned_addr learned my addr 172.21.15.78:0/3927720107 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:41.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.099+0000 7fd97586d640 1 --2- 172.21.15.78:0/3927720107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9701076e0 0x7fd97019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:41.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.099+0000 7fd97606e640 1 --2- 172.21.15.78:0/3927720107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd970101cd0 0x7fd97019a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:41.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.100+0000 7fd97686f640 1 -- 172.21.15.78:0/3927720107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9701076e0 msgr2=0x7fd97019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:41.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.100+0000 7fd97686f640 1 --2- 172.21.15.78:0/3927720107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9701076e0 0x7fd97019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.100+0000 7fd97686f640 1 -- 172.21.15.78:0/3927720107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd970101cd0 msgr2=0x7fd97019a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:41.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.100+0000 7fd97686f640 1 --2- 172.21.15.78:0/3927720107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd970101cd0 0x7fd97019a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.100+0000 7fd97686f640 1 -- 172.21.15.78:0/3927720107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9701a5630 con 0x7fd970108060 2024-09-11T00:23:41.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.100+0000 7fd97606e640 1 --2- 172.21.15.78:0/3927720107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd970101cd0 0x7fd97019a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:41.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.100+0000 7fd97686f640 1 --2- 172.21.15.78:0/3927720107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd970108060 0x7fd9701a50f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd968009fd0 tx=0x7fd96800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:41.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.100+0000 7fd9677fe640 1 -- 172.21.15.78:0/3927720107 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd968017070 con 0x7fd970108060 2024-09-11T00:23:41.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.100+0000 7fd9782d2640 1 -- 172.21.15.78:0/3927720107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9701a5800 con 0x7fd970108060 2024-09-11T00:23:41.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.100+0000 7fd9677fe640 1 -- 172.21.15.78:0/3927720107 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd968003e20 con 0x7fd970108060 2024-09-11T00:23:41.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.100+0000 7fd9677fe640 1 -- 172.21.15.78:0/3927720107 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd968010460 con 0x7fd970108060 2024-09-11T00:23:41.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.100+0000 7fd9782d2640 1 -- 172.21.15.78:0/3927720107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9701a5ce0 con 0x7fd970108060 2024-09-11T00:23:41.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.102+0000 7fd9677fe640 1 -- 172.21.15.78:0/3927720107 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fd968003970 con 0x7fd970108060 2024-09-11T00:23:41.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.102+0000 7fd97a6a7740 1 Processor -- start 2024-09-11T00:23:41.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.103+0000 7fd97a6a7740 1 -- start start 2024-09-11T00:23:41.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.103+0000 7fd97a6a7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1e8285ee0 0x55b1e82862c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:41.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.103+0000 7fd97a6a7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8286800 0x55b1e8292250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:41.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.103+0000 7fd97a6a7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1e8292790 0x55b1e8294b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:41.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.103+0000 7fd97a6a7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55b1e81fce60 con 0x55b1e8286800 2024-09-11T00:23:41.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.103+0000 7fd97a6a7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b1e81ec290 con 0x55b1e8285ee0 2024-09-11T00:23:41.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.103+0000 7fd97a6a7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55b1e81f00a0 con 0x55b1e8292790 2024-09-11T00:23:41.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.103+0000 7fd97606e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8286800 0x55b1e8292250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:41.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.103+0000 7fd97606e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8286800 0x55b1e8292250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40498/0 (socket says 172.21.15.78:40498) 2024-09-11T00:23:41.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.103+0000 7fd97606e640 1 -- 172.21.15.78:0/4140858697 learned_addr learned my addr 172.21.15.78:0/4140858697 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:41.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.103+0000 7fd97586d640 1 --2- 172.21.15.78:0/4140858697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1e8292790 0x55b1e8294b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:41.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.103+0000 7fd9677fe640 1 --2- 172.21.15.78:0/3927720107 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd95c0b5450 0x7fd95c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:41.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.103+0000 7fd97606e640 1 -- 172.21.15.78:0/4140858697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1e8292790 msgr2=0x55b1e8294b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:41.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.103+0000 7fd97606e640 1 --2- 172.21.15.78:0/4140858697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1e8292790 0x55b1e8294b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.103+0000 7fd97586d640 1 --2- 172.21.15.78:0/4140858697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1e8285ee0 0x55b1e82862c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:41.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.103+0000 7fd97606e640 1 -- 172.21.15.78:0/4140858697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1e8285ee0 msgr2=0x55b1e82862c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:41.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.103+0000 7fd97606e640 1 --2- 172.21.15.78:0/4140858697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1e8285ee0 0x55b1e82862c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.103+0000 7fd97606e640 1 -- 172.21.15.78:0/4140858697 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1e7f4a930 con 0x55b1e8286800 2024-09-11T00:23:41.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.103+0000 7fd97586d640 1 --2- 172.21.15.78:0/4140858697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1e8285ee0 0x55b1e82862c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:41.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.104+0000 7fd97686f640 1 --2- 172.21.15.78:0/3927720107 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd95c0b5450 0x7fd95c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:41.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.104+0000 7fd97606e640 1 --2- 172.21.15.78:0/4140858697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8286800 0x55b1e8292250 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd96c033000 tx=0x7fd96c032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c532c8de00a3d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:41.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.104+0000 7fd9677fe640 1 -- 172.21.15.78:0/3927720107 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7fd9680e5d90 con 0x7fd970108060 2024-09-11T00:23:41.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.104+0000 7fd964de6640 1 -- 172.21.15.78:0/4140858697 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c035030 con 0x55b1e8286800 2024-09-11T00:23:41.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.104+0000 7fd964de6640 1 -- 172.21.15.78:0/4140858697 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd96c0316a0 con 0x55b1e8286800 2024-09-11T00:23:41.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.104+0000 7fd964de6640 1 -- 172.21.15.78:0/4140858697 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c0046c0 con 0x55b1e8286800 2024-09-11T00:23:41.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.105+0000 7fd97a6a7740 1 -- 172.21.15.78:0/4140858697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8286800 msgr2=0x55b1e8292250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:41.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.105+0000 7fd97a6a7740 1 --2- 172.21.15.78:0/4140858697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8286800 0x55b1e8292250 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd96c033000 tx=0x7fd96c032cd0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.105+0000 7fd97686f640 1 --2- 172.21.15.78:0/3927720107 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd95c0b5450 0x7fd95c0b7910 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd9680a9410 tx=0x7fd968078380 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:41.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.105+0000 7fd97a6a7740 1 -- 172.21.15.78:0/4140858697 shutdown_connections 2024-09-11T00:23:41.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.105+0000 7fd97a6a7740 1 --2- 172.21.15.78:0/4140858697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1e8292790 0x55b1e8294b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.105+0000 7fd97a6a7740 1 --2- 172.21.15.78:0/4140858697 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8286800 0x55b1e8292250 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.105+0000 7fd97a6a7740 1 --2- 172.21.15.78:0/4140858697 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1e8285ee0 0x55b1e82862c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.105+0000 7fd97a6a7740 1 -- 172.21.15.78:0/4140858697 >> 172.21.15.78:0/4140858697 conn(0x55b1e8283d10 msgr2=0x55b1e8284eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:41.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.105+0000 7fd97a6a7740 1 -- 172.21.15.78:0/4140858697 shutdown_connections 2024-09-11T00:23:41.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.105+0000 7fd97a6a7740 1 -- 172.21.15.78:0/4140858697 wait complete. 2024-09-11T00:23:41.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.105+0000 7fd97a6a7740 1 -- start start 2024-09-11T00:23:41.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.105+0000 7fd97a6a7740 1 Processor -- start 2024-09-11T00:23:41.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd97a6a7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1e8285ee0 0x55b1e828f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:41.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd97a6a7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8286800 0x55b1e828fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:41.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd97a6a7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1e8292790 0x55b1e8290260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:41.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd97a6a7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55b1e804d890 con 0x55b1e8286800 2024-09-11T00:23:41.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd97a6a7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55b1e8186d40 con 0x55b1e8292790 2024-09-11T00:23:41.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd97a6a7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55b1e82953e0 con 0x55b1e8285ee0 2024-09-11T00:23:41.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd97a6a7740 10 client.0 _ll_register_callbacks cb 0x55b1e81eac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:23:41.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd97606e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8286800 0x55b1e828fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:41.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd97606e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8286800 0x55b1e828fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40506/0 (socket says 172.21.15.78:40506) 2024-09-11T00:23:41.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd97606e640 1 -- 172.21.15.78:0/1382924726 learned_addr learned my addr 172.21.15.78:0/1382924726 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:41.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd97586d640 1 --2- 172.21.15.78:0/1382924726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1e8285ee0 0x55b1e828f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:41.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd97586d640 1 --2- 172.21.15.78:0/1382924726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1e8292790 0x55b1e8290260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:41.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd97606e640 1 -- 172.21.15.78:0/1382924726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1e8285ee0 msgr2=0x55b1e828f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:41.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd97606e640 1 --2- 172.21.15.78:0/1382924726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1e8285ee0 0x55b1e828f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd97606e640 1 -- 172.21.15.78:0/1382924726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1e8292790 msgr2=0x55b1e8290260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:41.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd97606e640 1 --2- 172.21.15.78:0/1382924726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1e8292790 0x55b1e8290260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd97606e640 1 -- 172.21.15.78:0/1382924726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1e829e840 con 0x55b1e8286800 2024-09-11T00:23:41.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd97606e640 1 --2- 172.21.15.78:0/1382924726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8286800 0x55b1e828fd20 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd96c000c00 tx=0x7fd96c031850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8354bd1e5382107 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:41.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd959ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:23:41.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd959ffb640 1 -- 172.21.15.78:0/1382924726 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c04b020 con 0x55b1e8286800 2024-09-11T00:23:41.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd959ffb640 1 -- 172.21.15.78:0/1382924726 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7fd96c004460 con 0x55b1e8286800 2024-09-11T00:23:41.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd97a6a7740 1 -- 172.21.15.78:0/1382924726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd96c0316a0 con 0x55b1e8286800 2024-09-11T00:23:41.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd959ffb640 1 -- 172.21.15.78:0/1382924726 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd96c056050 con 0x55b1e8286800 2024-09-11T00:23:41.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd97a6a7740 10 client.16305 fetch_fsmap learned FSMap version 20 2024-09-11T00:23:41.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.106+0000 7fd97a6a7740 1 -- 172.21.15.78:0/1382924726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b1e82a1160 con 0x55b1e8286800 2024-09-11T00:23:41.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.107+0000 7fd959ffb640 1 -- 172.21.15.78:0/1382924726 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd96c0316a0 con 0x55b1e8286800 2024-09-11T00:23:41.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.107+0000 7fd959ffb640 1 -- 172.21.15.78:0/1382924726 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd96c003990 con 0x55b1e8286800 2024-09-11T00:23:41.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.107+0000 7fd97a6a7740 10 client.16305 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:23:41.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.107+0000 7fd97a6a7740 10 client.16305 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:23:41.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.107+0000 7fd97a6a7740 20 client.16305 populate_metadata read hostname 'smithi078' 2024-09-11T00:23:41.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.107+0000 7fd97a6a7740 1 --2- 172.21.15.78:0/1382924726 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b1e82a24b0 0x55b1e82a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:41.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.107+0000 7fd97a6a7740 4 client.16305 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:23:41.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.107+0000 7fd97a6a7740 1 -- 172.21.15.78:0/1382924726 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1e81fedb0 con 0x55b1e82a24b0 2024-09-11T00:23:41.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.107+0000 7fd97586d640 1 --2- 172.21.15.78:0/1382924726 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b1e82a24b0 0x55b1e82a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:41.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.108+0000 7fd959ffb640 10 client.16305 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:41.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.108+0000 7fd97586d640 1 --2- 172.21.15.78:0/1382924726 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b1e82a24b0 0x55b1e82a48a0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f996e63f5d74df02 server_cookie=e8b0b94031e50d51 in_seq=0 out_seq=0 2024-09-11T00:23:41.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.108+0000 7fd959ffb640 1 -- 172.21.15.78:0/1382924726 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b1e81fedb0 con 0x55b1e82a24b0 2024-09-11T00:23:41.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.108+0000 7fd959ffb640 10 client.16305 handle_command_reply: tid=0 2024-09-11T00:23:41.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.108+0000 7fd97a6a7740 1 client.16305 shutdown 2024-09-11T00:23:41.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.108+0000 7fd97a6a7740 1 -- 172.21.15.78:0/1382924726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8286800 msgr2=0x55b1e828fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:41.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.108+0000 7fd97a6a7740 1 --2- 172.21.15.78:0/1382924726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8286800 0x55b1e828fd20 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd96c000c00 tx=0x7fd96c031850 comp rx=0 tx=0).stop 2024-09-11T00:23:41.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.108+0000 7fd97a6a7740 1 -- 172.21.15.78:0/1382924726 shutdown_connections 2024-09-11T00:23:41.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.108+0000 7fd97a6a7740 1 --2- 172.21.15.78:0/1382924726 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b1e82a24b0 0x55b1e82a48a0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.108+0000 7fd97a6a7740 1 --2- 172.21.15.78:0/1382924726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1e8292790 0x55b1e8290260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.108+0000 7fd97a6a7740 1 --2- 172.21.15.78:0/1382924726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8286800 0x55b1e828fd20 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.108+0000 7fd959ffb640 0 client.16305 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:41.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.108+0000 7fd97a6a7740 1 --2- 172.21.15.78:0/1382924726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1e8285ee0 0x55b1e828f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.108+0000 7fd97a6a7740 1 -- 172.21.15.78:0/1382924726 >> 172.21.15.78:0/1382924726 conn(0x55b1e8283d10 msgr2=0x55b1e8282f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:41.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.108+0000 7fd97a6a7740 1 -- 172.21.15.78:0/1382924726 shutdown_connections 2024-09-11T00:23:41.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.108+0000 7fd97a6a7740 1 -- 172.21.15.78:0/1382924726 wait complete. 2024-09-11T00:23:41.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.109+0000 7fd97a6a7740 20 client.16305 trim_cache size 0 max 16384 2024-09-11T00:23:41.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.126+0000 7fd97a6a7740 1 Processor -- start 2024-09-11T00:23:41.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.126+0000 7fd97a6a7740 1 -- start start 2024-09-11T00:23:41.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.126+0000 7fd97a6a7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8285ee0 0x55b1e8291520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:41.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.126+0000 7fd97a6a7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1e8286800 0x55b1e829aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:41.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.126+0000 7fd97a6a7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1e8292790 0x55b1e829af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:41.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.126+0000 7fd97a6a7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd9701ac690 con 0x55b1e8285ee0 2024-09-11T00:23:41.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.126+0000 7fd97a6a7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd9701aeef0 con 0x55b1e8286800 2024-09-11T00:23:41.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.126+0000 7fd97a6a7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd9701acce0 con 0x55b1e8292790 2024-09-11T00:23:41.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.126+0000 7fd97586d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8285ee0 0x55b1e8291520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:41.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.126+0000 7fd97586d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8285ee0 0x55b1e8291520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40520/0 (socket says 172.21.15.78:40520) 2024-09-11T00:23:41.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.126+0000 7fd97586d640 1 -- 172.21.15.78:0/725503432 learned_addr learned my addr 172.21.15.78:0/725503432 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:41.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.127+0000 7fd97606e640 1 --2- 172.21.15.78:0/725503432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1e8286800 0x55b1e829aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:41.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.127+0000 7fd97586d640 1 -- 172.21.15.78:0/725503432 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1e8292790 msgr2=0x55b1e829af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:41.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.127+0000 7fd97586d640 1 --2- 172.21.15.78:0/725503432 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1e8292790 0x55b1e829af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.127+0000 7fd97586d640 1 -- 172.21.15.78:0/725503432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1e8286800 msgr2=0x55b1e829aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:41.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.127+0000 7fd97586d640 1 --2- 172.21.15.78:0/725503432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1e8286800 0x55b1e829aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.127+0000 7fd97586d640 1 -- 172.21.15.78:0/725503432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1e8283b40 con 0x55b1e8285ee0 2024-09-11T00:23:41.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.127+0000 7fd97586d640 1 --2- 172.21.15.78:0/725503432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8285ee0 0x55b1e8291520 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd960005d00 tx=0x7fd96000bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=263f07f44f4ad30f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:41.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.127+0000 7fd95bfff640 1 -- 172.21.15.78:0/725503432 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96002b020 con 0x55b1e8285ee0 2024-09-11T00:23:41.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.127+0000 7fd95bfff640 1 -- 172.21.15.78:0/725503432 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9600054d0 con 0x55b1e8285ee0 2024-09-11T00:23:41.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.127+0000 7fd95bfff640 1 -- 172.21.15.78:0/725503432 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd960004d30 con 0x55b1e8285ee0 2024-09-11T00:23:41.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.128+0000 7fd97a6a7740 1 -- 172.21.15.78:0/725503432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8285ee0 msgr2=0x55b1e8291520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:41.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.128+0000 7fd97a6a7740 1 --2- 172.21.15.78:0/725503432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8285ee0 0x55b1e8291520 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd960005d00 tx=0x7fd96000bc10 comp rx=0 tx=0).stop 2024-09-11T00:23:41.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.128+0000 7fd97a6a7740 1 -- 172.21.15.78:0/725503432 shutdown_connections 2024-09-11T00:23:41.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.128+0000 7fd97a6a7740 1 --2- 172.21.15.78:0/725503432 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1e8292790 0x55b1e829af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.128+0000 7fd97a6a7740 1 --2- 172.21.15.78:0/725503432 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1e8286800 0x55b1e829aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.128+0000 7fd97a6a7740 1 --2- 172.21.15.78:0/725503432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8285ee0 0x55b1e8291520 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.128+0000 7fd97a6a7740 1 -- 172.21.15.78:0/725503432 >> 172.21.15.78:0/725503432 conn(0x55b1e8283d10 msgr2=0x55b1e8290e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:41.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.128+0000 7fd97a6a7740 1 -- 172.21.15.78:0/725503432 shutdown_connections 2024-09-11T00:23:41.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.128+0000 7fd97a6a7740 1 -- 172.21.15.78:0/725503432 wait complete. 2024-09-11T00:23:41.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.128+0000 7fd97a6a7740 1 -- start start 2024-09-11T00:23:41.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.128+0000 7fd97a6a7740 1 Processor -- start 2024-09-11T00:23:41.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.128+0000 7fd97a6a7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8285ee0 0x55b1e8292fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:41.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.128+0000 7fd97a6a7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1e8286800 0x55b1e82934e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:41.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.128+0000 7fd97a6a7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1e8292790 0x55b1e8293a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:41.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.128+0000 7fd97a6a7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd9701ad3b0 con 0x55b1e8285ee0 2024-09-11T00:23:41.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.128+0000 7fd97a6a7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd9701ae820 con 0x55b1e8292790 2024-09-11T00:23:41.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.128+0000 7fd97a6a7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd9701ada80 con 0x55b1e8286800 2024-09-11T00:23:41.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.129+0000 7fd97a6a7740 10 client.0 _ll_register_callbacks cb 0x7fd96c032b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:23:41.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.129+0000 7fd97586d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8285ee0 0x55b1e8292fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:41.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.129+0000 7fd97586d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8285ee0 0x55b1e8292fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40524/0 (socket says 172.21.15.78:40524) 2024-09-11T00:23:41.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.129+0000 7fd97586d640 1 -- 172.21.15.78:0/1957405307 learned_addr learned my addr 172.21.15.78:0/1957405307 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:41.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.129+0000 7fd97606e640 1 --2- 172.21.15.78:0/1957405307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1e8286800 0x55b1e82934e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:41.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.129+0000 7fd97586d640 1 --2- 172.21.15.78:0/1957405307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1e8292790 0x55b1e8293a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:41.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.129+0000 7fd97606e640 1 -- 172.21.15.78:0/1957405307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1e8292790 msgr2=0x55b1e8293a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:41.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.129+0000 7fd97606e640 1 --2- 172.21.15.78:0/1957405307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1e8292790 0x55b1e8293a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.129+0000 7fd97606e640 1 -- 172.21.15.78:0/1957405307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8285ee0 msgr2=0x55b1e8292fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:41.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.129+0000 7fd97606e640 1 --2- 172.21.15.78:0/1957405307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8285ee0 0x55b1e8292fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.129+0000 7fd97606e640 1 -- 172.21.15.78:0/1957405307 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1e8284790 con 0x55b1e8286800 2024-09-11T00:23:41.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.129+0000 7fd97586d640 1 --2- 172.21.15.78:0/1957405307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8285ee0 0x55b1e8292fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:23:41.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.129+0000 7fd97606e640 1 --2- 172.21.15.78:0/1957405307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1e8286800 0x55b1e82934e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd96c003de0 tx=0x7fd96c032f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=181ddb57bfdfc9d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:41.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.129+0000 7fd959ffb640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-11T00:23:41.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.129+0000 7fd959ffb640 1 -- 172.21.15.78:0/1957405307 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c04b030 con 0x55b1e8286800 2024-09-11T00:23:41.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.129+0000 7fd97a6a7740 1 -- 172.21.15.78:0/1957405307 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9600054d0 con 0x55b1e8286800 2024-09-11T00:23:41.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.129+0000 7fd959ffb640 1 -- 172.21.15.78:0/1957405307 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7fd96c004460 con 0x55b1e8286800 2024-09-11T00:23:41.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.130+0000 7fd959ffb640 1 -- 172.21.15.78:0/1957405307 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd96c062050 con 0x55b1e8286800 2024-09-11T00:23:41.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.130+0000 7fd97a6a7740 10 client.25588 fetch_fsmap learned FSMap version 20 2024-09-11T00:23:41.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.130+0000 7fd97a6a7740 1 -- 172.21.15.78:0/1957405307 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55b1e8314320 con 0x55b1e8286800 2024-09-11T00:23:41.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.130+0000 7fd959ffb640 1 -- 172.21.15.78:0/1957405307 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9600054d0 con 0x55b1e8286800 2024-09-11T00:23:41.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.130+0000 7fd959ffb640 1 -- 172.21.15.78:0/1957405307 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd96c031aa0 con 0x55b1e8286800 2024-09-11T00:23:41.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.130+0000 7fd97a6a7740 10 client.25588 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:23:41.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.130+0000 7fd97a6a7740 10 client.25588 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:23:41.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.130+0000 7fd97a6a7740 20 client.25588 populate_metadata read hostname 'smithi078' 2024-09-11T00:23:41.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.130+0000 7fd97a6a7740 1 --2- 172.21.15.78:0/1957405307 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b1e8314ad0 0x55b1e8316ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:41.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.130+0000 7fd97a6a7740 4 client.25588 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:23:41.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.130+0000 7fd97a6a7740 1 -- 172.21.15.78:0/1957405307 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b1e81fa860 con 0x55b1e8314ad0 2024-09-11T00:23:41.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.130+0000 7fd97586d640 1 --2- 172.21.15.78:0/1957405307 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b1e8314ad0 0x55b1e8316ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:41.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.130+0000 7fd97586d640 1 --2- 172.21.15.78:0/1957405307 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b1e8314ad0 0x55b1e8316ef0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca7f13398f955b52 server_cookie=eac8afb88ff1f7cc in_seq=0 out_seq=0 2024-09-11T00:23:41.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.130+0000 7fd959ffb640 10 client.25588 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:41.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.132+0000 7fd959ffb640 1 -- 172.21.15.78:0/1957405307 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b1e81fa860 con 0x55b1e8314ad0 2024-09-11T00:23:41.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.132+0000 7fd959ffb640 10 client.25588 handle_command_reply: tid=0 2024-09-11T00:23:41.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.132+0000 7fd97a6a7740 1 client.25588 shutdown 2024-09-11T00:23:41.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.132+0000 7fd97a6a7740 1 -- 172.21.15.78:0/1957405307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1e8286800 msgr2=0x55b1e82934e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:41.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.132+0000 7fd97a6a7740 1 --2- 172.21.15.78:0/1957405307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1e8286800 0x55b1e82934e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd96c003de0 tx=0x7fd96c032f60 comp rx=0 tx=0).stop 2024-09-11T00:23:41.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.132+0000 7fd97a6a7740 1 -- 172.21.15.78:0/1957405307 shutdown_connections 2024-09-11T00:23:41.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.132+0000 7fd97a6a7740 1 --2- 172.21.15.78:0/1957405307 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55b1e8314ad0 0x55b1e8316ef0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.132+0000 7fd97a6a7740 1 --2- 172.21.15.78:0/1957405307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55b1e8292790 0x55b1e8293a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.132+0000 7fd97a6a7740 1 --2- 172.21.15.78:0/1957405307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b1e8286800 0x55b1e82934e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.132+0000 7fd97a6a7740 1 --2- 172.21.15.78:0/1957405307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b1e8285ee0 0x55b1e8292fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.132+0000 7fd959ffb640 0 client.25588 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:41.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.132+0000 7fd97a6a7740 1 -- 172.21.15.78:0/1957405307 >> 172.21.15.78:0/1957405307 conn(0x55b1e8283d10 msgr2=0x55b1e8291630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:41.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.132+0000 7fd97a6a7740 1 -- 172.21.15.78:0/1957405307 shutdown_connections 2024-09-11T00:23:41.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.132+0000 7fd97a6a7740 1 -- 172.21.15.78:0/1957405307 wait complete. 2024-09-11T00:23:41.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.132+0000 7fd97a6a7740 20 client.25588 trim_cache size 0 max 16384 2024-09-11T00:23:41.145 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:23:41.145 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-11T00:23:41.145 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "e21db329-a274-4cfd-924a-8ec929e04bd1", 2024-09-11T00:23:41.145 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-11T00:23:41.145 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:23:41.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.133+0000 7fd9782d2640 1 -- 172.21.15.78:0/3927720107 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd95c0b5450 msgr2=0x7fd95c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:41.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.133+0000 7fd9782d2640 1 --2- 172.21.15.78:0/3927720107 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd95c0b5450 0x7fd95c0b7910 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd9680a9410 tx=0x7fd968078380 comp rx=0 tx=0).stop 2024-09-11T00:23:41.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.133+0000 7fd9782d2640 1 -- 172.21.15.78:0/3927720107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd970108060 msgr2=0x7fd9701a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:41.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.133+0000 7fd9782d2640 1 --2- 172.21.15.78:0/3927720107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd970108060 0x7fd9701a50f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd968009fd0 tx=0x7fd96800b260 comp rx=0 tx=0).stop 2024-09-11T00:23:41.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.133+0000 7fd9782d2640 1 -- 172.21.15.78:0/3927720107 shutdown_connections 2024-09-11T00:23:41.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.133+0000 7fd9782d2640 1 --2- 172.21.15.78:0/3927720107 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd95c0b5450 0x7fd95c0b7910 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.133+0000 7fd9782d2640 1 --2- 172.21.15.78:0/3927720107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd970108060 0x7fd9701a50f0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.133+0000 7fd9782d2640 1 --2- 172.21.15.78:0/3927720107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9701076e0 0x7fd97019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.133+0000 7fd9782d2640 1 --2- 172.21.15.78:0/3927720107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd970101cd0 0x7fd97019a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:41.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.133+0000 7fd9782d2640 1 -- 172.21.15.78:0/3927720107 >> 172.21.15.78:0/3927720107 conn(0x7fd9700fd700 msgr2=0x7fd9700ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:41.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.133+0000 7fd9782d2640 1 -- 172.21.15.78:0/3927720107 shutdown_connections 2024-09-11T00:23:41.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:41.133+0000 7fd9782d2640 1 -- 172.21.15.78:0/3927720107 wait complete. 2024-09-11T00:23:41.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:23:41.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:40 smithi112 ceph-mon[35627]: Adjusting osd_memory_target on smithi078 to 176.0M 2024-09-11T00:23:41.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:40 smithi112 ceph-mon[35627]: Adjusting osd_memory_target on smithi112 to 176.0M 2024-09-11T00:23:41.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:40 smithi112 ceph-mon[35627]: Adjusting osd_memory_target on smithi138 to 176.0M 2024-09-11T00:23:41.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:40 smithi112 ceph-mon[35627]: Unable to set osd_memory_target on smithi078 to 184556646: error parsing value: Value '184556646' is below minimum 939524096 2024-09-11T00:23:41.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:40 smithi112 ceph-mon[35627]: Unable to set osd_memory_target on smithi112 to 184568115: error parsing value: Value '184568115' is below minimum 939524096 2024-09-11T00:23:41.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:40 smithi112 ceph-mon[35627]: Unable to set osd_memory_target on smithi138 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-11T00:23:41.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:23:41.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:23:41.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:40 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:23:41.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:23:41.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-11T00:23:41.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:40 smithi138 ceph-mon[35019]: Adjusting osd_memory_target on smithi078 to 176.0M 2024-09-11T00:23:41.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:40 smithi138 ceph-mon[35019]: Adjusting osd_memory_target on smithi112 to 176.0M 2024-09-11T00:23:41.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:40 smithi138 ceph-mon[35019]: Adjusting osd_memory_target on smithi138 to 176.0M 2024-09-11T00:23:41.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:40 smithi138 ceph-mon[35019]: Unable to set osd_memory_target on smithi078 to 184556646: error parsing value: Value '184556646' is below minimum 939524096 2024-09-11T00:23:41.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:40 smithi138 ceph-mon[35019]: Unable to set osd_memory_target on smithi112 to 184568115: error parsing value: Value '184568115' is below minimum 939524096 2024-09-11T00:23:41.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:40 smithi138 ceph-mon[35019]: Unable to set osd_memory_target on smithi138 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-11T00:23:41.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:23:41.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:23:41.295 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:40 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:23:41.815 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:23:42.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:41 smithi078 ceph-mon[30865]: scrub queued for path: / 2024-09-11T00:23:42.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:41 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:23:42.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:41 smithi078 ceph-mon[30865]: scrub summary: active paths [/] 2024-09-11T00:23:42.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:41 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:23:42.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:41 smithi078 ceph-mon[30865]: scrub summary: idle 2024-09-11T00:23:42.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:41 smithi078 ceph-mon[30865]: pgmap v542: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:23:42.102 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:23:42.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:41 smithi112 ceph-mon[35627]: scrub queued for path: / 2024-09-11T00:23:42.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:41 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:23:42.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:41 smithi112 ceph-mon[35627]: scrub summary: active paths [/] 2024-09-11T00:23:42.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:41 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:23:42.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:41 smithi112 ceph-mon[35627]: scrub summary: idle 2024-09-11T00:23:42.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:41 smithi112 ceph-mon[35627]: pgmap v542: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:23:42.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:41 smithi138 ceph-mon[35019]: scrub queued for path: / 2024-09-11T00:23:42.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:41 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:23:42.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:41 smithi138 ceph-mon[35019]: scrub summary: active paths [/] 2024-09-11T00:23:42.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:41 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:23:42.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:41 smithi138 ceph-mon[35019]: scrub summary: idle 2024-09-11T00:23:42.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:41 smithi138 ceph-mon[35019]: pgmap v542: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:23:42.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.620+0000 7fcbeeec5640 1 -- 172.21.15.78:0/4248997861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbe81076a0 msgr2=0x7fcbe8107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:42.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.620+0000 7fcbeeec5640 1 --2- 172.21.15.78:0/4248997861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbe81076a0 0x7fcbe8107ae0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009900 tx=0x7fcbd002a410 comp rx=0 tx=0).stop 2024-09-11T00:23:42.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.620+0000 7fcbeeec5640 1 -- 172.21.15.78:0/4248997861 shutdown_connections 2024-09-11T00:23:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.620+0000 7fcbeeec5640 1 --2- 172.21.15.78:0/4248997861 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbe8108020 0x7fcbe810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.620+0000 7fcbeeec5640 1 --2- 172.21.15.78:0/4248997861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbe81076a0 0x7fcbe8107ae0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.620+0000 7fcbeeec5640 1 --2- 172.21.15.78:0/4248997861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbe8101c90 0x7fcbe8102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.620+0000 7fcbeeec5640 1 -- 172.21.15.78:0/4248997861 >> 172.21.15.78:0/4248997861 conn(0x7fcbe80fd700 msgr2=0x7fcbe80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.620+0000 7fcbeeec5640 1 -- 172.21.15.78:0/4248997861 shutdown_connections 2024-09-11T00:23:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.620+0000 7fcbeeec5640 1 -- 172.21.15.78:0/4248997861 wait complete. 2024-09-11T00:23:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.620+0000 7fcbeeec5640 1 Processor -- start 2024-09-11T00:23:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.620+0000 7fcbeeec5640 1 -- start start 2024-09-11T00:23:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.621+0000 7fcbeeec5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbe8101c90 0x7fcbe81992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.621+0000 7fcbeeec5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbe81076a0 0x7fcbe8199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.621+0000 7fcbeeec5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbe8108020 0x7fcbe819ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.621+0000 7fcbeeec5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe8112dc0 con 0x7fcbe8101c90 2024-09-11T00:23:42.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.621+0000 7fcbeeec5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe8112c40 con 0x7fcbe81076a0 2024-09-11T00:23:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.621+0000 7fcbeeec5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe8112f40 con 0x7fcbe8108020 2024-09-11T00:23:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.621+0000 7fcbecc61640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbe8101c90 0x7fcbe81992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.621+0000 7fcbecc61640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbe8101c90 0x7fcbe81992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40540/0 (socket says 172.21.15.78:40540) 2024-09-11T00:23:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.621+0000 7fcbecc61640 1 -- 172.21.15.78:0/1598781650 learned_addr learned my addr 172.21.15.78:0/1598781650 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.621+0000 7fcbe7fff640 1 --2- 172.21.15.78:0/1598781650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbe81076a0 0x7fcbe8199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.621+0000 7fcbecc61640 1 -- 172.21.15.78:0/1598781650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbe8108020 msgr2=0x7fcbe819ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.621+0000 7fcbecc61640 1 --2- 172.21.15.78:0/1598781650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbe8108020 0x7fcbe819ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.621+0000 7fcbecc61640 1 -- 172.21.15.78:0/1598781650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbe81076a0 msgr2=0x7fcbe8199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.621+0000 7fcbecc61640 1 --2- 172.21.15.78:0/1598781650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbe81076a0 0x7fcbe8199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.621+0000 7fcbecc61640 1 -- 172.21.15.78:0/1598781650 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe819f3a0 con 0x7fcbe8101c90 2024-09-11T00:23:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.621+0000 7fcbecc61640 1 --2- 172.21.15.78:0/1598781650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbe8101c90 0x7fcbe81992f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800cce0 tx=0x7fcbd800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.621+0000 7fcbe5ffb640 1 -- 172.21.15.78:0/1598781650 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8004b20 con 0x7fcbe8101c90 2024-09-11T00:23:42.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.621+0000 7fcbe5ffb640 1 -- 172.21.15.78:0/1598781650 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbd8004cc0 con 0x7fcbe8101c90 2024-09-11T00:23:42.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.621+0000 7fcbeeec5640 1 -- 172.21.15.78:0/1598781650 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe819f690 con 0x7fcbe8101c90 2024-09-11T00:23:42.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.621+0000 7fcbe5ffb640 1 -- 172.21.15.78:0/1598781650 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd800f7c0 con 0x7fcbe8101c90 2024-09-11T00:23:42.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.622+0000 7fcbeeec5640 1 -- 172.21.15.78:0/1598781650 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe81a5d50 con 0x7fcbe8101c90 2024-09-11T00:23:42.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.624+0000 7fcbe5ffb640 1 -- 172.21.15.78:0/1598781650 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fcbd8005560 con 0x7fcbe8101c90 2024-09-11T00:23:42.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.624+0000 7fcbf129a740 1 Processor -- start 2024-09-11T00:23:42.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.624+0000 7fcbf129a740 1 -- start start 2024-09-11T00:23:42.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.624+0000 7fcbf129a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56069344c0a0 0x56069344c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.624+0000 7fcbf129a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56069344c9c0 0x560693458410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.624+0000 7fcbf129a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560693458950 0x56069345ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.624+0000 7fcbf129a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5606933c2e50 con 0x560693458950 2024-09-11T00:23:42.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.624+0000 7fcbf129a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5606933b2280 con 0x56069344c0a0 2024-09-11T00:23:42.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.624+0000 7fcbf129a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5606933b6090 con 0x56069344c9c0 2024-09-11T00:23:42.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.625+0000 7fcbe7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560693458950 0x56069345ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.625+0000 7fcbe7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560693458950 0x56069345ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40550/0 (socket says 172.21.15.78:40550) 2024-09-11T00:23:42.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.625+0000 7fcbe7fff640 1 -- 172.21.15.78:0/1270631937 learned_addr learned my addr 172.21.15.78:0/1270631937 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:42.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.625+0000 7fcbecc61640 1 --2- 172.21.15.78:0/1270631937 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56069344c9c0 0x560693458410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.625+0000 7fcbed462640 1 --2- 172.21.15.78:0/1270631937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56069344c0a0 0x56069344c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.625+0000 7fcbe7fff640 1 -- 172.21.15.78:0/1270631937 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56069344c9c0 msgr2=0x560693458410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:42.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.625+0000 7fcbe5ffb640 1 --2- 172.21.15.78:0/1598781650 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcbd40b5450 0x7fcbd40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.625+0000 7fcbe7fff640 1 --2- 172.21.15.78:0/1270631937 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56069344c9c0 0x560693458410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.625+0000 7fcbe7fff640 1 -- 172.21.15.78:0/1270631937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56069344c0a0 msgr2=0x56069344c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:42.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.625+0000 7fcbe7fff640 1 --2- 172.21.15.78:0/1270631937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56069344c0a0 0x56069344c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.625+0000 7fcbe7fff640 1 -- 172.21.15.78:0/1270631937 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560693110650 con 0x560693458950 2024-09-11T00:23:42.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.625+0000 7fcbed462640 1 --2- 172.21.15.78:0/1270631937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56069344c0a0 0x56069344c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:42.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.625+0000 7fcbed462640 1 --2- 172.21.15.78:0/1598781650 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcbd40b5450 0x7fcbd40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.625+0000 7fcbe7fff640 1 --2- 172.21.15.78:0/1270631937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560693458950 0x56069345ad40 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fcbd002a930 tx=0x7fcbd0032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82347d227f5f25c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.625+0000 7fcbe5ffb640 1 -- 172.21.15.78:0/1598781650 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7fcbd80e60e0 con 0x7fcbe8101c90 2024-09-11T00:23:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.625+0000 7fcbdeffd640 1 -- 172.21.15.78:0/1270631937 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd003f070 con 0x560693458950 2024-09-11T00:23:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.625+0000 7fcbdeffd640 1 -- 172.21.15.78:0/1270631937 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbd00316a0 con 0x560693458950 2024-09-11T00:23:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.625+0000 7fcbdeffd640 1 -- 172.21.15.78:0/1270631937 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0035070 con 0x560693458950 2024-09-11T00:23:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.626+0000 7fcbf129a740 1 -- 172.21.15.78:0/1270631937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560693458950 msgr2=0x56069345ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.626+0000 7fcbf129a740 1 --2- 172.21.15.78:0/1270631937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560693458950 0x56069345ad40 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fcbd002a930 tx=0x7fcbd0032ce0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.626+0000 7fcbed462640 1 --2- 172.21.15.78:0/1598781650 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcbd40b5450 0x7fcbd40b7910 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0005fd0 tx=0x7fcbe00046c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.626+0000 7fcbf129a740 1 -- 172.21.15.78:0/1270631937 shutdown_connections 2024-09-11T00:23:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.626+0000 7fcbf129a740 1 --2- 172.21.15.78:0/1270631937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560693458950 0x56069345ad40 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.626+0000 7fcbf129a740 1 --2- 172.21.15.78:0/1270631937 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56069344c9c0 0x560693458410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.626+0000 7fcbf129a740 1 --2- 172.21.15.78:0/1270631937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56069344c0a0 0x56069344c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.626+0000 7fcbf129a740 1 -- 172.21.15.78:0/1270631937 >> 172.21.15.78:0/1270631937 conn(0x560693449ed0 msgr2=0x56069344b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:42.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.626+0000 7fcbf129a740 1 -- 172.21.15.78:0/1270631937 shutdown_connections 2024-09-11T00:23:42.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.626+0000 7fcbf129a740 1 -- 172.21.15.78:0/1270631937 wait complete. 2024-09-11T00:23:42.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.626+0000 7fcbf129a740 1 -- start start 2024-09-11T00:23:42.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.626+0000 7fcbf129a740 1 Processor -- start 2024-09-11T00:23:42.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.627+0000 7fcbf129a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56069344c0a0 0x560693458280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.627+0000 7fcbf129a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56069344c9c0 0x5606934556d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.627+0000 7fcbf129a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560693458950 0x560693455d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.627+0000 7fcbf129a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x560693213700 con 0x56069344c0a0 2024-09-11T00:23:42.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.627+0000 7fcbf129a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x56069334d110 con 0x560693458950 2024-09-11T00:23:42.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.627+0000 7fcbf129a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56069345b570 con 0x56069344c9c0 2024-09-11T00:23:42.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.627+0000 7fcbf129a740 10 client.0 _ll_register_callbacks cb 0x560693366990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:23:42.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.627+0000 7fcbecc61640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56069344c0a0 0x560693458280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.627+0000 7fcbecc61640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56069344c0a0 0x560693458280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40558/0 (socket says 172.21.15.78:40558) 2024-09-11T00:23:42.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.627+0000 7fcbecc61640 1 -- 172.21.15.78:0/2846092235 learned_addr learned my addr 172.21.15.78:0/2846092235 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:42.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.627+0000 7fcbed462640 1 --2- 172.21.15.78:0/2846092235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560693458950 0x560693455d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.627+0000 7fcbe7fff640 1 --2- 172.21.15.78:0/2846092235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56069344c9c0 0x5606934556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.627+0000 7fcbecc61640 1 -- 172.21.15.78:0/2846092235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56069344c9c0 msgr2=0x5606934556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:42.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.627+0000 7fcbecc61640 1 --2- 172.21.15.78:0/2846092235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56069344c9c0 0x5606934556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.627+0000 7fcbecc61640 1 -- 172.21.15.78:0/2846092235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560693458950 msgr2=0x560693455d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:42.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.627+0000 7fcbecc61640 1 --2- 172.21.15.78:0/2846092235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560693458950 0x560693455d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.627+0000 7fcbecc61640 1 -- 172.21.15.78:0/2846092235 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56069337ac40 con 0x56069344c0a0 2024-09-11T00:23:42.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.627+0000 7fcbe7fff640 1 --2- 172.21.15.78:0/2846092235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56069344c9c0 0x5606934556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:42.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.627+0000 7fcbed462640 1 --2- 172.21.15.78:0/2846092235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560693458950 0x560693455d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:42.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.627+0000 7fcbecc61640 1 --2- 172.21.15.78:0/2846092235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56069344c0a0 0x560693458280 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80a9860 tx=0x7fcbd80e97f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d9b46b3a423319 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:42.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.627+0000 7fcbc7fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:23:42.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.628+0000 7fcbc7fff640 1 -- 172.21.15.78:0/2846092235 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd801d070 con 0x56069344c0a0 2024-09-11T00:23:42.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.628+0000 7fcbc7fff640 1 -- 172.21.15.78:0/2846092235 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7fcbd80aba50 con 0x56069344c0a0 2024-09-11T00:23:42.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.628+0000 7fcbf129a740 1 -- 172.21.15.78:0/2846092235 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbd00316a0 con 0x56069344c0a0 2024-09-11T00:23:42.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.628+0000 7fcbc7fff640 1 -- 172.21.15.78:0/2846092235 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcbd80ac3c0 con 0x56069344c0a0 2024-09-11T00:23:42.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.628+0000 7fcbf129a740 10 client.16323 fetch_fsmap learned FSMap version 20 2024-09-11T00:23:42.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.628+0000 7fcbf129a740 1 -- 172.21.15.78:0/2846092235 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x560693466eb0 con 0x56069344c0a0 2024-09-11T00:23:42.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.628+0000 7fcbc7fff640 1 -- 172.21.15.78:0/2846092235 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbd00316a0 con 0x56069344c0a0 2024-09-11T00:23:42.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.628+0000 7fcbc7fff640 1 -- 172.21.15.78:0/2846092235 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fcbd80e80f0 con 0x56069344c0a0 2024-09-11T00:23:42.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.628+0000 7fcbf129a740 10 client.16323 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:23:42.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.628+0000 7fcbf129a740 10 client.16323 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:23:42.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.628+0000 7fcbf129a740 20 client.16323 populate_metadata read hostname 'smithi078' 2024-09-11T00:23:42.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.628+0000 7fcbf129a740 1 --2- 172.21.15.78:0/2846092235 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560693468250 0x56069346a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.628+0000 7fcbf129a740 4 client.16323 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:23:42.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.628+0000 7fcbf129a740 1 -- 172.21.15.78:0/2846092235 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606933c4da0 con 0x560693468250 2024-09-11T00:23:42.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.628+0000 7fcbe7fff640 1 --2- 172.21.15.78:0/2846092235 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560693468250 0x56069346a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.629+0000 7fcbc7fff640 10 client.16323 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:42.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.629+0000 7fcbe7fff640 1 --2- 172.21.15.78:0/2846092235 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560693468250 0x56069346a6e0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=133167c3d4619fff server_cookie=ec6a0bcd9ab5568a in_seq=0 out_seq=0 2024-09-11T00:23:42.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.629+0000 7fcbc7fff640 1 -- 172.21.15.78:0/2846092235 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5606933c4da0 con 0x560693468250 2024-09-11T00:23:42.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.629+0000 7fcbc7fff640 10 client.16323 handle_command_reply: tid=0 2024-09-11T00:23:42.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.630+0000 7fcbf129a740 1 client.16323 shutdown 2024-09-11T00:23:42.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.630+0000 7fcbf129a740 1 -- 172.21.15.78:0/2846092235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56069344c0a0 msgr2=0x560693458280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:42.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.630+0000 7fcbf129a740 1 --2- 172.21.15.78:0/2846092235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56069344c0a0 0x560693458280 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80a9860 tx=0x7fcbd80e97f0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.630+0000 7fcbf129a740 1 -- 172.21.15.78:0/2846092235 shutdown_connections 2024-09-11T00:23:42.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.630+0000 7fcbf129a740 1 --2- 172.21.15.78:0/2846092235 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x560693468250 0x56069346a6e0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.630+0000 7fcbf129a740 1 --2- 172.21.15.78:0/2846092235 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x560693458950 0x560693455d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.630+0000 7fcbf129a740 1 --2- 172.21.15.78:0/2846092235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56069344c9c0 0x5606934556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.630+0000 7fcbc7fff640 0 client.16323 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:42.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.630+0000 7fcbf129a740 1 --2- 172.21.15.78:0/2846092235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56069344c0a0 0x560693458280 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.630+0000 7fcbf129a740 1 -- 172.21.15.78:0/2846092235 >> 172.21.15.78:0/2846092235 conn(0x560693449ed0 msgr2=0x56069344fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:42.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.630+0000 7fcbf129a740 1 -- 172.21.15.78:0/2846092235 shutdown_connections 2024-09-11T00:23:42.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.630+0000 7fcbf129a740 1 -- 172.21.15.78:0/2846092235 wait complete. 2024-09-11T00:23:42.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.630+0000 7fcbf129a740 20 client.16323 trim_cache size 0 max 16384 2024-09-11T00:23:42.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.647+0000 7fcbf129a740 1 Processor -- start 2024-09-11T00:23:42.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.647+0000 7fcbf129a740 1 -- start start 2024-09-11T00:23:42.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.647+0000 7fcbf129a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56069344c0a0 0x5606934647a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.647+0000 7fcbf129a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56069344c9c0 0x560693459d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.647+0000 7fcbf129a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560693458950 0x56069345a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.647+0000 7fcbf129a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe81ac710 con 0x56069344c9c0 2024-09-11T00:23:42.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.647+0000 7fcbf129a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe81aef70 con 0x56069344c0a0 2024-09-11T00:23:42.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.647+0000 7fcbf129a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe81acd60 con 0x560693458950 2024-09-11T00:23:42.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.647+0000 7fcbe7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56069344c9c0 0x560693459d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.647+0000 7fcbe7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56069344c9c0 0x560693459d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40562/0 (socket says 172.21.15.78:40562) 2024-09-11T00:23:42.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.647+0000 7fcbe7fff640 1 -- 172.21.15.78:0/2580278786 learned_addr learned my addr 172.21.15.78:0/2580278786 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:42.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.648+0000 7fcbecc61640 1 --2- 172.21.15.78:0/2580278786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56069344c0a0 0x5606934647a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.648+0000 7fcbe7fff640 1 -- 172.21.15.78:0/2580278786 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560693458950 msgr2=0x56069345a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:42.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.648+0000 7fcbe7fff640 1 --2- 172.21.15.78:0/2580278786 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560693458950 0x56069345a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.648+0000 7fcbe7fff640 1 -- 172.21.15.78:0/2580278786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56069344c0a0 msgr2=0x5606934647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:42.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.648+0000 7fcbe7fff640 1 --2- 172.21.15.78:0/2580278786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56069344c0a0 0x5606934647a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.648+0000 7fcbe7fff640 1 -- 172.21.15.78:0/2580278786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56069344c7f0 con 0x56069344c9c0 2024-09-11T00:23:42.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.648+0000 7fcbe7fff640 1 --2- 172.21.15.78:0/2580278786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56069344c9c0 0x560693459d40 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fcbd00052c0 tx=0x7fcbd00052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c53c4ff0e374ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:42.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.648+0000 7fcbde7fc640 1 -- 172.21.15.78:0/2580278786 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd004f020 con 0x56069344c9c0 2024-09-11T00:23:42.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.648+0000 7fcbde7fc640 1 -- 172.21.15.78:0/2580278786 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbd0005620 con 0x56069344c9c0 2024-09-11T00:23:42.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.648+0000 7fcbde7fc640 1 -- 172.21.15.78:0/2580278786 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd003f070 con 0x56069344c9c0 2024-09-11T00:23:42.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.649+0000 7fcbf129a740 1 -- 172.21.15.78:0/2580278786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56069344c9c0 msgr2=0x560693459d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:42.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.649+0000 7fcbf129a740 1 --2- 172.21.15.78:0/2580278786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56069344c9c0 0x560693459d40 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fcbd00052c0 tx=0x7fcbd00052f0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.649+0000 7fcbf129a740 1 -- 172.21.15.78:0/2580278786 shutdown_connections 2024-09-11T00:23:42.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.649+0000 7fcbf129a740 1 --2- 172.21.15.78:0/2580278786 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560693458950 0x56069345a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.649+0000 7fcbf129a740 1 --2- 172.21.15.78:0/2580278786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56069344c9c0 0x560693459d40 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.649+0000 7fcbf129a740 1 --2- 172.21.15.78:0/2580278786 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56069344c0a0 0x5606934647a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.649+0000 7fcbf129a740 1 -- 172.21.15.78:0/2580278786 >> 172.21.15.78:0/2580278786 conn(0x560693449ed0 msgr2=0x560693450920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:42.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.649+0000 7fcbf129a740 1 -- 172.21.15.78:0/2580278786 shutdown_connections 2024-09-11T00:23:42.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.649+0000 7fcbf129a740 1 -- 172.21.15.78:0/2580278786 wait complete. 2024-09-11T00:23:42.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.649+0000 7fcbf129a740 1 -- start start 2024-09-11T00:23:42.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.649+0000 7fcbf129a740 1 Processor -- start 2024-09-11T00:23:42.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.649+0000 7fcbf129a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56069344c0a0 0x5606934609f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbf129a740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56069344c9c0 0x560693460f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbf129a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560693458950 0x56069345b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbf129a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe81ad430 con 0x56069344c0a0 2024-09-11T00:23:42.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbf129a740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe81ae8a0 con 0x56069344c9c0 2024-09-11T00:23:42.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbf129a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe81adb00 con 0x560693458950 2024-09-11T00:23:42.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbf129a740 10 client.0 _ll_register_callbacks cb 0x7fcbd800cc30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:23:42.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbecc61640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56069344c0a0 0x5606934609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbecc61640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56069344c0a0 0x5606934609f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40572/0 (socket says 172.21.15.78:40572) 2024-09-11T00:23:42.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbecc61640 1 -- 172.21.15.78:0/245799606 learned_addr learned my addr 172.21.15.78:0/245799606 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:42.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbe7fff640 1 --2- 172.21.15.78:0/245799606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56069344c9c0 0x560693460f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbed462640 1 --2- 172.21.15.78:0/245799606 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560693458950 0x56069345b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbecc61640 1 -- 172.21.15.78:0/245799606 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560693458950 msgr2=0x56069345b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:42.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbecc61640 1 --2- 172.21.15.78:0/245799606 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560693458950 0x56069345b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbecc61640 1 -- 172.21.15.78:0/245799606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56069344c9c0 msgr2=0x560693460f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:42.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbecc61640 1 --2- 172.21.15.78:0/245799606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56069344c9c0 0x560693460f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbecc61640 1 -- 172.21.15.78:0/245799606 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56069345bdd0 con 0x56069344c0a0 2024-09-11T00:23:42.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbecc61640 1 --2- 172.21.15.78:0/245799606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56069344c0a0 0x5606934609f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80ac580 tx=0x7fcbd80a8d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2eafb10b669aec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:42.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbc7fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:23:42.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbc7fff640 1 -- 172.21.15.78:0/245799606 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd801d070 con 0x56069344c0a0 2024-09-11T00:23:42.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbc7fff640 1 -- 172.21.15.78:0/245799606 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7fcbd80e9db0 con 0x56069344c0a0 2024-09-11T00:23:42.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbf129a740 1 -- 172.21.15.78:0/245799606 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbd0005620 con 0x56069344c0a0 2024-09-11T00:23:42.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbc7fff640 1 -- 172.21.15.78:0/245799606 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcbd80c3050 con 0x56069344c0a0 2024-09-11T00:23:42.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbf129a740 10 client.16329 fetch_fsmap learned FSMap version 20 2024-09-11T00:23:42.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.650+0000 7fcbf129a740 1 -- 172.21.15.78:0/245799606 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5606934d9ed0 con 0x56069344c0a0 2024-09-11T00:23:42.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.651+0000 7fcbc7fff640 1 -- 172.21.15.78:0/245799606 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbd0005620 con 0x56069344c0a0 2024-09-11T00:23:42.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.651+0000 7fcbc7fff640 1 -- 172.21.15.78:0/245799606 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fcbd80b2260 con 0x56069344c0a0 2024-09-11T00:23:42.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.651+0000 7fcbf129a740 10 client.16329 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:23:42.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.651+0000 7fcbf129a740 10 client.16329 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:23:42.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.651+0000 7fcbf129a740 20 client.16329 populate_metadata read hostname 'smithi078' 2024-09-11T00:23:42.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.651+0000 7fcbf129a740 1 --2- 172.21.15.78:0/245799606 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5606934da5f0 0x5606934dca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:42.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.651+0000 7fcbf129a740 4 client.16329 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:23:42.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.651+0000 7fcbf129a740 1 -- 172.21.15.78:0/245799606 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5606933c0850 con 0x5606934da5f0 2024-09-11T00:23:42.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.651+0000 7fcbe7fff640 1 --2- 172.21.15.78:0/245799606 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5606934da5f0 0x5606934dca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:42.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.651+0000 7fcbe7fff640 1 --2- 172.21.15.78:0/245799606 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5606934da5f0 0x5606934dca10 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29df9ca707cd6b86 server_cookie=2c4d91957fec4675 in_seq=0 out_seq=0 2024-09-11T00:23:42.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.651+0000 7fcbc7fff640 10 client.16329 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:42.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.652+0000 7fcbc7fff640 1 -- 172.21.15.78:0/245799606 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x5606933c0850 con 0x5606934da5f0 2024-09-11T00:23:42.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.652+0000 7fcbc7fff640 10 client.16329 handle_command_reply: tid=0 2024-09-11T00:23:42.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.652+0000 7fcbf129a740 1 client.16329 shutdown 2024-09-11T00:23:42.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.652+0000 7fcbf129a740 1 -- 172.21.15.78:0/245799606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56069344c0a0 msgr2=0x5606934609f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:42.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.652+0000 7fcbf129a740 1 --2- 172.21.15.78:0/245799606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56069344c0a0 0x5606934609f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80ac580 tx=0x7fcbd80a8d70 comp rx=0 tx=0).stop 2024-09-11T00:23:42.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.652+0000 7fcbf129a740 1 -- 172.21.15.78:0/245799606 shutdown_connections 2024-09-11T00:23:42.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.652+0000 7fcbf129a740 1 --2- 172.21.15.78:0/245799606 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5606934da5f0 0x5606934dca10 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.652+0000 7fcbc7fff640 0 client.16329 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:42.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.652+0000 7fcbf129a740 1 --2- 172.21.15.78:0/245799606 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560693458950 0x56069345b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.652+0000 7fcbf129a740 1 --2- 172.21.15.78:0/245799606 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56069344c9c0 0x560693460f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.652+0000 7fcbf129a740 1 --2- 172.21.15.78:0/245799606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56069344c0a0 0x5606934609f0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.652+0000 7fcbf129a740 1 -- 172.21.15.78:0/245799606 >> 172.21.15.78:0/245799606 conn(0x560693449ed0 msgr2=0x560693448700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:42.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.652+0000 7fcbf129a740 1 -- 172.21.15.78:0/245799606 shutdown_connections 2024-09-11T00:23:42.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.652+0000 7fcbf129a740 1 -- 172.21.15.78:0/245799606 wait complete. 2024-09-11T00:23:42.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.652+0000 7fcbf129a740 20 client.16329 trim_cache size 0 max 16384 2024-09-11T00:23:42.662 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:23:42.662 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-11T00:23:42.662 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {}, 2024-09-11T00:23:42.662 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:23:42.662 INFO:teuthology.orchestra.run.smithi078.stdout: "e21db329-a274-4cfd-924a-8ec929e04bd1": { 2024-09-11T00:23:42.662 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:41.131504+0000", 2024-09-11T00:23:42.663 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:42.663 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:42.663 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:42.663 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:42.663 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:42.663 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:42.663 INFO:teuthology.orchestra.run.smithi078.stdout: "b854cbd3-8ca7-4277-a205-8887d2ff5567": { 2024-09-11T00:23:42.663 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:11.182949+0000", 2024-09-11T00:23:42.663 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:42.663 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:42.663 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:42.663 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:42.663 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:42.664 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:42.664 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:23:42.664 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:23:42.664 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:42.664 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:42.664 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:42.664 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:42.664 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:42.664 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:42.664 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:23:42.664 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:23:42.664 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:42.664 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:42.665 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:42.665 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:42.665 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:42.665 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:42.665 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:23:42.665 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:23:42.665 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:42.665 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:42.665 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:42.665 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:42.665 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:42.665 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:42.665 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:23:42.665 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:23:42.666 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:42.666 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:42.666 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:42.666 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:42.666 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:42.666 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:42.666 INFO:teuthology.orchestra.run.smithi078.stdout: "81d31d3a-c224-4ded-9f00-1a7dfc099ec4": { 2024-09-11T00:23:42.666 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:16.296700+0000", 2024-09-11T00:23:42.666 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:42.666 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:42.666 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:42.666 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:42.666 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:42.666 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:42.667 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:23:42.667 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:23:42.667 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:42.667 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:42.667 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:42.667 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:42.667 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:42.667 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:42.667 INFO:teuthology.orchestra.run.smithi078.stdout: "38a1d30d-5f4c-460a-afcd-e6c60b97e43a": { 2024-09-11T00:23:42.667 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:58.127727+0000", 2024-09-11T00:23:42.667 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:42.667 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:42.667 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:42.668 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:42.668 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:42.668 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:42.668 INFO:teuthology.orchestra.run.smithi078.stdout: "8ec9e858-aa62-420d-a112-e62ea7810e63": { 2024-09-11T00:23:42.668 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:18.882749+0000", 2024-09-11T00:23:42.668 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:42.668 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:42.668 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:42.668 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:42.668 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:42.668 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:42.668 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:23:42.668 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:23:42.669 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:42.669 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:42.669 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:42.669 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:42.669 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:42.669 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:42.669 INFO:teuthology.orchestra.run.smithi078.stdout: "1b9391c2-08f3-479a-9538-deea28f7743b": { 2024-09-11T00:23:42.669 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:02.327508+0000", 2024-09-11T00:23:42.669 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:42.669 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:42.669 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:42.669 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:42.669 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:42.669 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:42.670 INFO:teuthology.orchestra.run.smithi078.stdout: "e0002672-e432-4890-ab9f-20c513c5e3b6": { 2024-09-11T00:23:42.670 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:21:37.161715+0000", 2024-09-11T00:23:42.670 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:42.670 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:42.670 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:42.670 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:42.670 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:42.670 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:42.670 INFO:teuthology.orchestra.run.smithi078.stdout: "f494d5ed-e0dc-44bb-8aba-a861b3e751f4": { 2024-09-11T00:23:42.670 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:55.251691+0000", 2024-09-11T00:23:42.670 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:42.670 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:42.670 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:42.671 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:42.671 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:42.671 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:23:42.671 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:23:42.671 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:23:42.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.653+0000 7fcbeeec5640 1 -- 172.21.15.78:0/1598781650 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcbd40b5450 msgr2=0x7fcbd40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:42.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.653+0000 7fcbeeec5640 1 --2- 172.21.15.78:0/1598781650 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcbd40b5450 0x7fcbd40b7910 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0005fd0 tx=0x7fcbe00046c0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.653+0000 7fcbeeec5640 1 -- 172.21.15.78:0/1598781650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbe8101c90 msgr2=0x7fcbe81992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:42.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.653+0000 7fcbeeec5640 1 --2- 172.21.15.78:0/1598781650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbe8101c90 0x7fcbe81992f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800cce0 tx=0x7fcbd800a620 comp rx=0 tx=0).stop 2024-09-11T00:23:42.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.653+0000 7fcbeeec5640 1 -- 172.21.15.78:0/1598781650 shutdown_connections 2024-09-11T00:23:42.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.653+0000 7fcbeeec5640 1 --2- 172.21.15.78:0/1598781650 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcbd40b5450 0x7fcbd40b7910 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.653+0000 7fcbeeec5640 1 --2- 172.21.15.78:0/1598781650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbe8108020 0x7fcbe819ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.653+0000 7fcbeeec5640 1 --2- 172.21.15.78:0/1598781650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcbe81076a0 0x7fcbe8199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.653+0000 7fcbeeec5640 1 --2- 172.21.15.78:0/1598781650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbe8101c90 0x7fcbe81992f0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:42.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.653+0000 7fcbeeec5640 1 -- 172.21.15.78:0/1598781650 >> 172.21.15.78:0/1598781650 conn(0x7fcbe80fd700 msgr2=0x7fcbe80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:42.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.653+0000 7fcbeeec5640 1 -- 172.21.15.78:0/1598781650 shutdown_connections 2024-09-11T00:23:42.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:42.653+0000 7fcbeeec5640 1 -- 172.21.15.78:0/1598781650 wait complete. 2024-09-11T00:23:43.341 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:23:43.342 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:23:43.586 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:23:44.041 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:43 smithi078 ceph-mon[30865]: pgmap v543: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:23:44.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.119+0000 7f35cd8ee640 1 -- 172.21.15.78:0/2224889513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35c8102dc0 msgr2=0x7f35c81031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:44.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.119+0000 7f35cd8ee640 1 --2- 172.21.15.78:0/2224889513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35c8102dc0 0x7f35c81031a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009900 tx=0x7f35b802a410 comp rx=0 tx=0).stop 2024-09-11T00:23:44.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.119+0000 7f35cd8ee640 1 -- 172.21.15.78:0/2224889513 shutdown_connections 2024-09-11T00:23:44.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.119+0000 7f35cd8ee640 1 --2- 172.21.15.78:0/2224889513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35c8109150 0x7f35c810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:44.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.119+0000 7f35cd8ee640 1 --2- 172.21.15.78:0/2224889513 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c81087d0 0x7f35c8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:44.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.119+0000 7f35cd8ee640 1 --2- 172.21.15.78:0/2224889513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35c8102dc0 0x7f35c81031a0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:44.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.119+0000 7f35cd8ee640 1 -- 172.21.15.78:0/2224889513 >> 172.21.15.78:0/2224889513 conn(0x7f35c80fe830 msgr2=0x7f35c8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:44.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.119+0000 7f35cd8ee640 1 -- 172.21.15.78:0/2224889513 shutdown_connections 2024-09-11T00:23:44.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.119+0000 7f35cd8ee640 1 -- 172.21.15.78:0/2224889513 wait complete. 2024-09-11T00:23:44.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.120+0000 7f35cd8ee640 1 Processor -- start 2024-09-11T00:23:44.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.120+0000 7f35cd8ee640 1 -- start start 2024-09-11T00:23:44.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.120+0000 7f35cd8ee640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c8102dc0 0x7f35c8199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:44.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.120+0000 7f35cd8ee640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35c81087d0 0x7f35c81997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:44.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.120+0000 7f35cd8ee640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35c8109150 0x7f35c819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:44.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.120+0000 7f35cd8ee640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f35c8112e10 con 0x7f35c81087d0 2024-09-11T00:23:44.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.120+0000 7f35cd8ee640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f35c8112c90 con 0x7f35c8102dc0 2024-09-11T00:23:44.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.120+0000 7f35cd8ee640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f35c8112f90 con 0x7f35c8109150 2024-09-11T00:23:44.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.120+0000 7f35c67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35c81087d0 0x7f35c81997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:44.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.120+0000 7f35c67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35c81087d0 0x7f35c81997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40596/0 (socket says 172.21.15.78:40596) 2024-09-11T00:23:44.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.120+0000 7f35c67fc640 1 -- 172.21.15.78:0/15154856 learned_addr learned my addr 172.21.15.78:0/15154856 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:44.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.120+0000 7f35c67fc640 1 -- 172.21.15.78:0/15154856 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35c8109150 msgr2=0x7f35c819eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.120+0000 7f35c67fc640 1 --2- 172.21.15.78:0/15154856 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35c8109150 0x7f35c819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.120+0000 7f35c67fc640 1 -- 172.21.15.78:0/15154856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c8102dc0 msgr2=0x7f35c8199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.120+0000 7f35c67fc640 1 --2- 172.21.15.78:0/15154856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c8102dc0 0x7f35c8199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.120+0000 7f35c67fc640 1 -- 172.21.15.78:0/15154856 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c819f330 con 0x7f35c81087d0 2024-09-11T00:23:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.121+0000 7f35c67fc640 1 --2- 172.21.15.78:0/15154856 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35c81087d0 0x7f35c81997c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00b4a0 tx=0x7f35bc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.121+0000 7f35cc8ec640 1 -- 172.21.15.78:0/15154856 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc014070 con 0x7f35c81087d0 2024-09-11T00:23:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.121+0000 7f35cc8ec640 1 -- 172.21.15.78:0/15154856 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35bc010ac0 con 0x7f35c81087d0 2024-09-11T00:23:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.121+0000 7f35cc8ec640 1 -- 172.21.15.78:0/15154856 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc017c30 con 0x7f35c81087d0 2024-09-11T00:23:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.121+0000 7f35cd8ee640 1 -- 172.21.15.78:0/15154856 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c819f620 con 0x7f35c81087d0 2024-09-11T00:23:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.121+0000 7f35cd8ee640 1 -- 172.21.15.78:0/15154856 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c81a5d60 con 0x7f35c81087d0 2024-09-11T00:23:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.122+0000 7f35cd8ee640 1 -- 172.21.15.78:0/15154856 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35c81031a0 con 0x7f35c81087d0 2024-09-11T00:23:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.123+0000 7f35cc8ec640 1 -- 172.21.15.78:0/15154856 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f35bc010610 con 0x7f35c81087d0 2024-09-11T00:23:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.124+0000 7f35cc8ec640 1 --2- 172.21.15.78:0/15154856 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f35b00b5450 0x7f35b00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.124+0000 7f35c6ffd640 1 --2- 172.21.15.78:0/15154856 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f35b00b5450 0x7f35b00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:44.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.124+0000 7f35cc8ec640 1 -- 172.21.15.78:0/15154856 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7f35bc0e5970 con 0x7f35c81087d0 2024-09-11T00:23:44.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.124+0000 7f35c6ffd640 1 --2- 172.21.15.78:0/15154856 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f35b00b5450 0x7f35b00b7910 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f35b80096c0 tx=0x7f35b8031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:44.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.127+0000 7f35cc8ec640 1 -- 172.21.15.78:0/15154856 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f35bc0ac4e0 con 0x7f35c81087d0 2024-09-11T00:23:44.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:43 smithi112 ceph-mon[35627]: pgmap v543: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:23:44.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:43 smithi138 ceph-mon[35019]: pgmap v543: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:23:44.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.339+0000 7f35cd8ee640 1 -- 172.21.15.78:0/15154856 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35c802e5c0 con 0x7f35c81087d0 2024-09-11T00:23:44.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.340+0000 7f35cc8ec640 1 -- 172.21.15.78:0/15154856 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f35bc0abde0 con 0x7f35c81087d0 2024-09-11T00:23:44.342 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:23:44.342 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:23:44.343 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:23:44.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.343+0000 7f35cd8ee640 1 -- 172.21.15.78:0/15154856 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f35b00b5450 msgr2=0x7f35b00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:44.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.343+0000 7f35cd8ee640 1 --2- 172.21.15.78:0/15154856 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f35b00b5450 0x7f35b00b7910 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f35b80096c0 tx=0x7f35b8031400 comp rx=0 tx=0).stop 2024-09-11T00:23:44.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.343+0000 7f35cd8ee640 1 -- 172.21.15.78:0/15154856 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35c81087d0 msgr2=0x7f35c81997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:44.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.343+0000 7f35cd8ee640 1 --2- 172.21.15.78:0/15154856 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35c81087d0 0x7f35c81997c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00b4a0 tx=0x7f35bc00b960 comp rx=0 tx=0).stop 2024-09-11T00:23:44.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.343+0000 7f35cd8ee640 1 -- 172.21.15.78:0/15154856 shutdown_connections 2024-09-11T00:23:44.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.343+0000 7f35cd8ee640 1 --2- 172.21.15.78:0/15154856 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f35b00b5450 0x7f35b00b7910 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:44.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.343+0000 7f35cd8ee640 1 --2- 172.21.15.78:0/15154856 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35c8109150 0x7f35c819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:44.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.343+0000 7f35cd8ee640 1 --2- 172.21.15.78:0/15154856 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35c81087d0 0x7f35c81997c0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:44.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.343+0000 7f35cd8ee640 1 --2- 172.21.15.78:0/15154856 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f35c8102dc0 0x7f35c8199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:44.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.343+0000 7f35cd8ee640 1 -- 172.21.15.78:0/15154856 >> 172.21.15.78:0/15154856 conn(0x7f35c80fe830 msgr2=0x7f35c8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:44.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.343+0000 7f35cd8ee640 1 -- 172.21.15.78:0/15154856 shutdown_connections 2024-09-11T00:23:44.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:44.343+0000 7f35cd8ee640 1 -- 172.21.15.78:0/15154856 wait complete. 2024-09-11T00:23:44.981 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:23:45.003 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:44 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/15154856' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:23:45.225 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:23:45.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:44 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/15154856' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:23:45.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:44 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/15154856' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:23:45.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.703+0000 7f3fefe99640 1 -- 172.21.15.78:0/3385308344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe810d140 msgr2=0x7f3fe810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:45.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.703+0000 7f3fefe99640 1 --2- 172.21.15.78:0/3385308344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe810d140 0x7f3fe810f5a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009ca0 tx=0x7f3fe002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.703+0000 7f3fefe99640 1 -- 172.21.15.78:0/3385308344 shutdown_connections 2024-09-11T00:23:45.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.703+0000 7f3fefe99640 1 --2- 172.21.15.78:0/3385308344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe810d140 0x7f3fe810f5a0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.703+0000 7f3fefe99640 1 --2- 172.21.15.78:0/3385308344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fe8104600 0x7f3fe810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.703+0000 7f3fefe99640 1 --2- 172.21.15.78:0/3385308344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fe8103ce0 0x7f3fe81040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.703+0000 7f3fefe99640 1 -- 172.21.15.78:0/3385308344 >> 172.21.15.78:0/3385308344 conn(0x7f3fe80fd700 msgr2=0x7f3fe80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:45.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.703+0000 7f3fefe99640 1 -- 172.21.15.78:0/3385308344 shutdown_connections 2024-09-11T00:23:45.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.703+0000 7f3fefe99640 1 -- 172.21.15.78:0/3385308344 wait complete. 2024-09-11T00:23:45.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.704+0000 7f3fefe99640 1 Processor -- start 2024-09-11T00:23:45.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.704+0000 7f3fefe99640 1 -- start start 2024-09-11T00:23:45.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.704+0000 7f3fefe99640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe8103ce0 0x7f3fe8199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.704+0000 7f3fefe99640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fe8104600 0x7f3fe81997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.704+0000 7f3fefe99640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fe810d140 0x7f3fe819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.704+0000 7f3fefe99640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe8112db0 con 0x7f3fe8103ce0 2024-09-11T00:23:45.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.704+0000 7f3fefe99640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe8112c30 con 0x7f3fe810d140 2024-09-11T00:23:45.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.704+0000 7f3fefe99640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe8112f30 con 0x7f3fe8104600 2024-09-11T00:23:45.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.704+0000 7f3fedc35640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe8103ce0 0x7f3fe8199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.704+0000 7f3fedc35640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe8103ce0 0x7f3fe8199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39482/0 (socket says 172.21.15.78:39482) 2024-09-11T00:23:45.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.704+0000 7f3fedc35640 1 -- 172.21.15.78:0/1425015498 learned_addr learned my addr 172.21.15.78:0/1425015498 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:45.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.704+0000 7f3fed434640 1 --2- 172.21.15.78:0/1425015498 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fe8104600 0x7f3fe81997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.704+0000 7f3fee436640 1 --2- 172.21.15.78:0/1425015498 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fe810d140 0x7f3fe819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.704+0000 7f3fedc35640 1 -- 172.21.15.78:0/1425015498 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fe8104600 msgr2=0x7f3fe81997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:45.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.704+0000 7f3fedc35640 1 --2- 172.21.15.78:0/1425015498 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fe8104600 0x7f3fe81997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.704+0000 7f3fedc35640 1 -- 172.21.15.78:0/1425015498 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fe810d140 msgr2=0x7f3fe819eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:45.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.704+0000 7f3fedc35640 1 --2- 172.21.15.78:0/1425015498 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fe810d140 0x7f3fe819eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.704+0000 7f3fedc35640 1 -- 172.21.15.78:0/1425015498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe819f310 con 0x7f3fe8103ce0 2024-09-11T00:23:45.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.705+0000 7f3fee436640 1 --2- 172.21.15.78:0/1425015498 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fe810d140 0x7f3fe819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:45.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.705+0000 7f3fedc35640 1 --2- 172.21.15.78:0/1425015498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe8103ce0 0x7f3fe8199260 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400c890 tx=0x7f3fe400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:45.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.705+0000 7f3fdeffd640 1 -- 172.21.15.78:0/1425015498 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4004220 con 0x7f3fe8103ce0 2024-09-11T00:23:45.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.705+0000 7f3fdeffd640 1 -- 172.21.15.78:0/1425015498 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fe40043c0 con 0x7f3fe8103ce0 2024-09-11T00:23:45.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.705+0000 7f3fefe99640 1 -- 172.21.15.78:0/1425015498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe819f600 con 0x7f3fe8103ce0 2024-09-11T00:23:45.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.705+0000 7f3fdeffd640 1 -- 172.21.15.78:0/1425015498 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4004a00 con 0x7f3fe8103ce0 2024-09-11T00:23:45.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.705+0000 7f3fefe99640 1 -- 172.21.15.78:0/1425015498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe81a5cc0 con 0x7f3fe8103ce0 2024-09-11T00:23:45.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.708+0000 7f3ff226e740 1 Processor -- start 2024-09-11T00:23:45.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.708+0000 7f3ff226e740 1 -- start start 2024-09-11T00:23:45.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.708+0000 7f3fdeffd640 1 -- 172.21.15.78:0/1425015498 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f3fe40079b0 con 0x7f3fe8103ce0 2024-09-11T00:23:45.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.708+0000 7f3ff226e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ee4d0 0x563ded8ee8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.708+0000 7f3ff226e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563ded8eedf0 0x563ded8fec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.708+0000 7f3ff226e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ded8ff190 0x563ded901580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.708+0000 7f3ff226e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x563ded864ea0 con 0x563ded8ee4d0 2024-09-11T00:23:45.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.708+0000 7f3ff226e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x563ded8542d0 con 0x563ded8eedf0 2024-09-11T00:23:45.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.708+0000 7f3ff226e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x563ded8580e0 con 0x563ded8ff190 2024-09-11T00:23:45.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.708+0000 7f3fee436640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ee4d0 0x563ded8ee8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.708+0000 7f3fee436640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ee4d0 0x563ded8ee8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39490/0 (socket says 172.21.15.78:39490) 2024-09-11T00:23:45.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.708+0000 7f3fee436640 1 -- 172.21.15.78:0/1230540159 learned_addr learned my addr 172.21.15.78:0/1230540159 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:45.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.709+0000 7f3fedc35640 1 --2- 172.21.15.78:0/1230540159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563ded8eedf0 0x563ded8fec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.709+0000 7f3fed434640 1 --2- 172.21.15.78:0/1230540159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ded8ff190 0x563ded901580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.709+0000 7f3fee436640 1 -- 172.21.15.78:0/1230540159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ded8ff190 msgr2=0x563ded901580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:45.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.709+0000 7f3fee436640 1 --2- 172.21.15.78:0/1230540159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ded8ff190 0x563ded901580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.709+0000 7f3fee436640 1 -- 172.21.15.78:0/1230540159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563ded8eedf0 msgr2=0x563ded8fec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:45.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.709+0000 7f3fee436640 1 --2- 172.21.15.78:0/1230540159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563ded8eedf0 0x563ded8fec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.709+0000 7f3fee436640 1 -- 172.21.15.78:0/1230540159 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ded5b2650 con 0x563ded8ee4d0 2024-09-11T00:23:45.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.709+0000 7f3fee436640 1 --2- 172.21.15.78:0/1230540159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ee4d0 0x563ded8ee8b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0031ba0 tx=0x7f3fe0009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b524d857b75e5870 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:45.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.709+0000 7f3fdeffd640 1 --2- 172.21.15.78:0/1425015498 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3fd40b5450 0x7f3fd40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.709+0000 7f3fd3fff640 1 -- 172.21.15.78:0/1230540159 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0031710 con 0x563ded8ee4d0 2024-09-11T00:23:45.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.709+0000 7f3fedc35640 1 --2- 172.21.15.78:0/1425015498 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3fd40b5450 0x7f3fd40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.709+0000 7f3fd3fff640 1 -- 172.21.15.78:0/1230540159 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fe0040070 con 0x563ded8ee4d0 2024-09-11T00:23:45.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.709+0000 7f3fd3fff640 1 -- 172.21.15.78:0/1230540159 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe00047a0 con 0x563ded8ee4d0 2024-09-11T00:23:45.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.709+0000 7f3fdeffd640 1 -- 172.21.15.78:0/1425015498 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7f3fe40e5d90 con 0x7f3fe8103ce0 2024-09-11T00:23:45.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.710+0000 7f3ff226e740 1 -- 172.21.15.78:0/1230540159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ee4d0 msgr2=0x563ded8ee8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:45.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.710+0000 7f3fedc35640 1 --2- 172.21.15.78:0/1425015498 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3fd40b5450 0x7f3fd40b7910 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3fe40e3580 tx=0x7f3fe4000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:45.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.710+0000 7f3ff226e740 1 --2- 172.21.15.78:0/1230540159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ee4d0 0x563ded8ee8b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0031ba0 tx=0x7f3fe0009a20 comp rx=0 tx=0).stop 2024-09-11T00:23:45.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.710+0000 7f3ff226e740 1 -- 172.21.15.78:0/1230540159 shutdown_connections 2024-09-11T00:23:45.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.710+0000 7f3ff226e740 1 --2- 172.21.15.78:0/1230540159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ded8ff190 0x563ded901580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.710+0000 7f3ff226e740 1 --2- 172.21.15.78:0/1230540159 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563ded8eedf0 0x563ded8fec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.710+0000 7f3ff226e740 1 --2- 172.21.15.78:0/1230540159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ee4d0 0x563ded8ee8b0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.710+0000 7f3ff226e740 1 -- 172.21.15.78:0/1230540159 >> 172.21.15.78:0/1230540159 conn(0x563ded8ec300 msgr2=0x563ded8ed4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:45.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.710+0000 7f3ff226e740 1 -- 172.21.15.78:0/1230540159 shutdown_connections 2024-09-11T00:23:45.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.710+0000 7f3ff226e740 1 -- 172.21.15.78:0/1230540159 wait complete. 2024-09-11T00:23:45.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.710+0000 7f3ff226e740 1 -- start start 2024-09-11T00:23:45.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.711+0000 7f3ff226e740 1 Processor -- start 2024-09-11T00:23:45.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.711+0000 7f3ff226e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ee4d0 0x563ded8fe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.711+0000 7f3ff226e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563ded8eedf0 0x563ded8fbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.711+0000 7f3ff226e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ded8ff190 0x563ded8fc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.711+0000 7f3ff226e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x563ded6b5700 con 0x563ded8ee4d0 2024-09-11T00:23:45.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.711+0000 7f3ff226e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x563ded7ef160 con 0x563ded8eedf0 2024-09-11T00:23:45.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.711+0000 7f3ff226e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x563ded901e30 con 0x563ded8ff190 2024-09-11T00:23:45.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.711+0000 7f3ff226e740 10 client.0 _ll_register_callbacks cb 0x563ded8089e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:23:45.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.711+0000 7f3fee436640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ee4d0 0x563ded8fe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.711+0000 7f3fee436640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ee4d0 0x563ded8fe9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39500/0 (socket says 172.21.15.78:39500) 2024-09-11T00:23:45.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.711+0000 7f3fee436640 1 -- 172.21.15.78:0/3777572340 learned_addr learned my addr 172.21.15.78:0/3777572340 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:45.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.711+0000 7f3fed434640 1 --2- 172.21.15.78:0/3777572340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563ded8eedf0 0x563ded8fbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.711+0000 7f3fee436640 1 -- 172.21.15.78:0/3777572340 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ded8ff190 msgr2=0x563ded8fc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:45.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.711+0000 7f3fee436640 1 --2- 172.21.15.78:0/3777572340 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ded8ff190 0x563ded8fc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.711+0000 7f3fee436640 1 -- 172.21.15.78:0/3777572340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563ded8eedf0 msgr2=0x563ded8fbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:45.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.711+0000 7f3fee436640 1 --2- 172.21.15.78:0/3777572340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563ded8eedf0 0x563ded8fbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.711+0000 7f3fee436640 1 -- 172.21.15.78:0/3777572340 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ded81cc90 con 0x563ded8ee4d0 2024-09-11T00:23:45.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.711+0000 7f3fed434640 1 --2- 172.21.15.78:0/3777572340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563ded8eedf0 0x563ded8fbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:45.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.712+0000 7f3fee436640 1 --2- 172.21.15.78:0/3777572340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ee4d0 0x563ded8fe9d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00042a0 tx=0x7f3fe0031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed922892771d08c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:45.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.712+0000 7f3fd17fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:23:45.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.712+0000 7f3fd17fa640 1 -- 172.21.15.78:0/3777572340 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0053060 con 0x563ded8ee4d0 2024-09-11T00:23:45.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.712+0000 7f3fd17fa640 1 -- 172.21.15.78:0/3777572340 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7f3fe0003b80 con 0x563ded8ee4d0 2024-09-11T00:23:45.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.712+0000 7f3ff226e740 1 -- 172.21.15.78:0/3777572340 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fe0040070 con 0x563ded8ee4d0 2024-09-11T00:23:45.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.712+0000 7f3fd17fa640 1 -- 172.21.15.78:0/3777572340 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3fe0003d80 con 0x563ded8ee4d0 2024-09-11T00:23:45.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.712+0000 7f3ff226e740 10 client.16347 fetch_fsmap learned FSMap version 20 2024-09-11T00:23:45.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.712+0000 7f3ff226e740 1 -- 172.21.15.78:0/3777572340 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x563ded90d6c0 con 0x563ded8ee4d0 2024-09-11T00:23:45.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.712+0000 7f3fd17fa640 1 -- 172.21.15.78:0/3777572340 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fe0040070 con 0x563ded8ee4d0 2024-09-11T00:23:45.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.712+0000 7f3fd17fa640 1 -- 172.21.15.78:0/3777572340 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3fe00305c0 con 0x563ded8ee4d0 2024-09-11T00:23:45.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.712+0000 7f3ff226e740 10 client.16347 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:23:45.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.712+0000 7f3ff226e740 10 client.16347 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:23:45.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.712+0000 7f3ff226e740 20 client.16347 populate_metadata read hostname 'smithi078' 2024-09-11T00:23:45.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.712+0000 7f3ff226e740 1 --2- 172.21.15.78:0/3777572340 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x563ded90ea10 0x563ded910e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.712+0000 7f3ff226e740 4 client.16347 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:23:45.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.712+0000 7f3ff226e740 1 -- 172.21.15.78:0/3777572340 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ded866df0 con 0x563ded90ea10 2024-09-11T00:23:45.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.712+0000 7f3fed434640 1 --2- 172.21.15.78:0/3777572340 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x563ded90ea10 0x563ded910e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.713+0000 7f3fd17fa640 10 client.16347 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:45.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.713+0000 7f3fed434640 1 --2- 172.21.15.78:0/3777572340 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x563ded90ea10 0x563ded910e00 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55b12a1f6dc5aa1a server_cookie=cfa0c6764a0b6738 in_seq=0 out_seq=0 2024-09-11T00:23:45.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.714+0000 7f3fd17fa640 1 -- 172.21.15.78:0/3777572340 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563ded866df0 con 0x563ded90ea10 2024-09-11T00:23:45.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.714+0000 7f3fd17fa640 10 client.16347 handle_command_reply: tid=0 2024-09-11T00:23:45.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.714+0000 7f3ff226e740 1 client.16347 shutdown 2024-09-11T00:23:45.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.714+0000 7f3ff226e740 1 -- 172.21.15.78:0/3777572340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ee4d0 msgr2=0x563ded8fe9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:45.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.714+0000 7f3ff226e740 1 --2- 172.21.15.78:0/3777572340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ee4d0 0x563ded8fe9d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00042a0 tx=0x7f3fe0031740 comp rx=0 tx=0).stop 2024-09-11T00:23:45.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.714+0000 7f3ff226e740 1 -- 172.21.15.78:0/3777572340 shutdown_connections 2024-09-11T00:23:45.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.714+0000 7f3ff226e740 1 --2- 172.21.15.78:0/3777572340 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x563ded90ea10 0x563ded910e00 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.714+0000 7f3ff226e740 1 --2- 172.21.15.78:0/3777572340 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ded8ff190 0x563ded8fc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.714+0000 7f3ff226e740 1 --2- 172.21.15.78:0/3777572340 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563ded8eedf0 0x563ded8fbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.714+0000 7f3fd17fa640 0 client.16347 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:45.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.714+0000 7f3ff226e740 1 --2- 172.21.15.78:0/3777572340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ee4d0 0x563ded8fe9d0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.714+0000 7f3ff226e740 1 -- 172.21.15.78:0/3777572340 >> 172.21.15.78:0/3777572340 conn(0x563ded8ec300 msgr2=0x563ded8f1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:45.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.714+0000 7f3ff226e740 1 -- 172.21.15.78:0/3777572340 shutdown_connections 2024-09-11T00:23:45.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.714+0000 7f3ff226e740 1 -- 172.21.15.78:0/3777572340 wait complete. 2024-09-11T00:23:45.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.714+0000 7f3ff226e740 20 client.16347 trim_cache size 0 max 16384 2024-09-11T00:23:45.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.727+0000 7f3ff226e740 1 Processor -- start 2024-09-11T00:23:45.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.727+0000 7f3ff226e740 1 -- start start 2024-09-11T00:23:45.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.727+0000 7f3ff226e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ded8ee4d0 0x563ded900ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.727+0000 7f3ff226e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563ded8eedf0 0x563ded901410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.727+0000 7f3ff226e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ff190 0x563ded913e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.727+0000 7f3ff226e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe81aa5e0 con 0x563ded8ff190 2024-09-11T00:23:45.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.727+0000 7f3ff226e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe81ace40 con 0x563ded8eedf0 2024-09-11T00:23:45.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.727+0000 7f3ff226e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe81aac30 con 0x563ded8ee4d0 2024-09-11T00:23:45.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.727+0000 7f3fee436640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ff190 0x563ded913e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.727+0000 7f3fee436640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ff190 0x563ded913e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39506/0 (socket says 172.21.15.78:39506) 2024-09-11T00:23:45.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.727+0000 7f3fee436640 1 -- 172.21.15.78:0/1651601888 learned_addr learned my addr 172.21.15.78:0/1651601888 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:45.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.727+0000 7f3fed434640 1 --2- 172.21.15.78:0/1651601888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563ded8eedf0 0x563ded901410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.727+0000 7f3fee436640 1 --2- 172.21.15.78:0/1651601888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ded8ee4d0 0x563ded900ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.727+0000 7f3fee436640 1 -- 172.21.15.78:0/1651601888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ded8ee4d0 msgr2=0x563ded900ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:45.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.727+0000 7f3fee436640 1 --2- 172.21.15.78:0/1651601888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ded8ee4d0 0x563ded900ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.727+0000 7f3fee436640 1 -- 172.21.15.78:0/1651601888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563ded8eedf0 msgr2=0x563ded901410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:45.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.727+0000 7f3fee436640 1 --2- 172.21.15.78:0/1651601888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563ded8eedf0 0x563ded901410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.727+0000 7f3fee436640 1 -- 172.21.15.78:0/1651601888 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ded8eec20 con 0x563ded8ff190 2024-09-11T00:23:45.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.728+0000 7f3fee436640 1 --2- 172.21.15.78:0/1651601888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ff190 0x563ded913e20 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0002230 tx=0x7f3fe0047040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb0ea36f3019dd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:45.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.728+0000 7f3fd37fe640 1 -- 172.21.15.78:0/1651601888 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0053070 con 0x563ded8ff190 2024-09-11T00:23:45.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.728+0000 7f3fd37fe640 1 -- 172.21.15.78:0/1651601888 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fe0040070 con 0x563ded8ff190 2024-09-11T00:23:45.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.728+0000 7f3fd37fe640 1 -- 172.21.15.78:0/1651601888 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe002f660 con 0x563ded8ff190 2024-09-11T00:23:45.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.728+0000 7f3ff226e740 1 -- 172.21.15.78:0/1651601888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ff190 msgr2=0x563ded913e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:45.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.728+0000 7f3ff226e740 1 --2- 172.21.15.78:0/1651601888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ff190 0x563ded913e20 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0002230 tx=0x7f3fe0047040 comp rx=0 tx=0).stop 2024-09-11T00:23:45.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.728+0000 7f3ff226e740 1 -- 172.21.15.78:0/1651601888 shutdown_connections 2024-09-11T00:23:45.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.728+0000 7f3ff226e740 1 --2- 172.21.15.78:0/1651601888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ff190 0x563ded913e20 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.728+0000 7f3ff226e740 1 --2- 172.21.15.78:0/1651601888 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563ded8eedf0 0x563ded901410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.728+0000 7f3ff226e740 1 --2- 172.21.15.78:0/1651601888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ded8ee4d0 0x563ded900ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.728+0000 7f3ff226e740 1 -- 172.21.15.78:0/1651601888 >> 172.21.15.78:0/1651601888 conn(0x563ded8ec300 msgr2=0x563ded8ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:45.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.728+0000 7f3ff226e740 1 -- 172.21.15.78:0/1651601888 shutdown_connections 2024-09-11T00:23:45.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.729+0000 7f3ff226e740 1 -- 172.21.15.78:0/1651601888 wait complete. 2024-09-11T00:23:45.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.729+0000 7f3ff226e740 1 -- start start 2024-09-11T00:23:45.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.729+0000 7f3ff226e740 1 Processor -- start 2024-09-11T00:23:45.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.729+0000 7f3ff226e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ee4d0 0x563ded911f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.729+0000 7f3ff226e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ded8eedf0 0x563ded9124a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.729+0000 7f3ff226e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563ded8ff190 0x563ded9129e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.729+0000 7f3ff226e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe81ab300 con 0x563ded8ee4d0 2024-09-11T00:23:45.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.729+0000 7f3ff226e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe81ac770 con 0x563ded8ff190 2024-09-11T00:23:45.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.729+0000 7f3ff226e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe81ab9d0 con 0x563ded8eedf0 2024-09-11T00:23:45.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.729+0000 7f3ff226e740 10 client.0 _ll_register_callbacks cb 0x7f3fe002f420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:23:45.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.729+0000 7f3fee436640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ee4d0 0x563ded911f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.730+0000 7f3fee436640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ee4d0 0x563ded911f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39522/0 (socket says 172.21.15.78:39522) 2024-09-11T00:23:45.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.730+0000 7f3fee436640 1 -- 172.21.15.78:0/1237339721 learned_addr learned my addr 172.21.15.78:0/1237339721 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:45.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.730+0000 7f3fee436640 1 --2- 172.21.15.78:0/1237339721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563ded8ff190 0x563ded9129e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.730+0000 7f3fed434640 1 --2- 172.21.15.78:0/1237339721 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ded8eedf0 0x563ded9124a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.730+0000 7f3fee436640 1 -- 172.21.15.78:0/1237339721 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ded8eedf0 msgr2=0x563ded9124a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:45.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.730+0000 7f3fee436640 1 --2- 172.21.15.78:0/1237339721 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ded8eedf0 0x563ded9124a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.730+0000 7f3fee436640 1 -- 172.21.15.78:0/1237339721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563ded8ff190 msgr2=0x563ded9129e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:45.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.730+0000 7f3fee436640 1 --2- 172.21.15.78:0/1237339721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563ded8ff190 0x563ded9129e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.730+0000 7f3fee436640 1 -- 172.21.15.78:0/1237339721 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ded97a730 con 0x563ded8ee4d0 2024-09-11T00:23:45.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.730+0000 7f3fee436640 1 --2- 172.21.15.78:0/1237339721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ee4d0 0x563ded911f60 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0004470 tx=0x7f3fe0005d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ece458bd54f6bf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:45.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.730+0000 7f3fd17fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:23:45.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.730+0000 7f3fd17fa640 1 -- 172.21.15.78:0/1237339721 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0053050 con 0x563ded8ee4d0 2024-09-11T00:23:45.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.730+0000 7f3fd17fa640 1 -- 172.21.15.78:0/1237339721 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7f3fe0003b80 con 0x563ded8ee4d0 2024-09-11T00:23:45.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.730+0000 7f3ff226e740 1 -- 172.21.15.78:0/1237339721 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fe0040070 con 0x563ded8ee4d0 2024-09-11T00:23:45.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.730+0000 7f3fd17fa640 1 -- 172.21.15.78:0/1237339721 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3fe0004b40 con 0x563ded8ee4d0 2024-09-11T00:23:45.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.730+0000 7f3ff226e740 10 client.16353 fetch_fsmap learned FSMap version 20 2024-09-11T00:23:45.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.730+0000 7f3ff226e740 1 -- 172.21.15.78:0/1237339721 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x563ded97ba30 con 0x563ded8ee4d0 2024-09-11T00:23:45.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.730+0000 7f3fd17fa640 1 -- 172.21.15.78:0/1237339721 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fe0040070 con 0x563ded8ee4d0 2024-09-11T00:23:45.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.731+0000 7f3fd17fa640 1 -- 172.21.15.78:0/1237339721 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f3fe002f9a0 con 0x563ded8ee4d0 2024-09-11T00:23:45.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.731+0000 7f3ff226e740 10 client.16353 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:23:45.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.731+0000 7f3ff226e740 10 client.16353 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:23:45.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.731+0000 7f3ff226e740 20 client.16353 populate_metadata read hostname 'smithi078' 2024-09-11T00:23:45.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.731+0000 7f3ff226e740 1 --2- 172.21.15.78:0/1237339721 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x563ded97bf30 0x563ded97e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:45.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.731+0000 7f3ff226e740 4 client.16353 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:23:45.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.731+0000 7f3ff226e740 1 -- 172.21.15.78:0/1237339721 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563ded8628a0 con 0x563ded97bf30 2024-09-11T00:23:45.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.731+0000 7f3fed434640 1 --2- 172.21.15.78:0/1237339721 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x563ded97bf30 0x563ded97e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:45.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.731+0000 7f3fd17fa640 10 client.16353 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:45.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.731+0000 7f3fed434640 1 --2- 172.21.15.78:0/1237339721 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x563ded97bf30 0x563ded97e350 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da2d8ef9e158b28d server_cookie=93ce3dc4433bcb75 in_seq=0 out_seq=0 2024-09-11T00:23:45.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.732+0000 7f3fd17fa640 1 -- 172.21.15.78:0/1237339721 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563ded8628a0 con 0x563ded97bf30 2024-09-11T00:23:45.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.732+0000 7f3fd17fa640 10 client.16353 handle_command_reply: tid=0 2024-09-11T00:23:45.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.732+0000 7f3ff226e740 1 client.16353 shutdown 2024-09-11T00:23:45.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.732+0000 7f3ff226e740 1 -- 172.21.15.78:0/1237339721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ee4d0 msgr2=0x563ded911f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:45.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.732+0000 7f3ff226e740 1 --2- 172.21.15.78:0/1237339721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ee4d0 0x563ded911f60 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0004470 tx=0x7f3fe0005d10 comp rx=0 tx=0).stop 2024-09-11T00:23:45.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.732+0000 7f3ff226e740 1 -- 172.21.15.78:0/1237339721 shutdown_connections 2024-09-11T00:23:45.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.732+0000 7f3ff226e740 1 --2- 172.21.15.78:0/1237339721 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x563ded97bf30 0x563ded97e350 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.732+0000 7f3ff226e740 1 --2- 172.21.15.78:0/1237339721 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x563ded8ff190 0x563ded9129e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.732+0000 7f3ff226e740 1 --2- 172.21.15.78:0/1237339721 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ded8eedf0 0x563ded9124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.732+0000 7f3ff226e740 1 --2- 172.21.15.78:0/1237339721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563ded8ee4d0 0x563ded911f60 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.732+0000 7f3ff226e740 1 -- 172.21.15.78:0/1237339721 >> 172.21.15.78:0/1237339721 conn(0x563ded8ec300 msgr2=0x563ded8ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:45.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.732+0000 7f3fd17fa640 0 client.16353 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:45.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.732+0000 7f3ff226e740 1 -- 172.21.15.78:0/1237339721 shutdown_connections 2024-09-11T00:23:45.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.732+0000 7f3ff226e740 1 -- 172.21.15.78:0/1237339721 wait complete. 2024-09-11T00:23:45.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.732+0000 7f3ff226e740 20 client.16353 trim_cache size 0 max 16384 2024-09-11T00:23:45.750 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-11T00:23:45.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.732+0000 7f3fefe99640 1 -- 172.21.15.78:0/1425015498 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3fd40b5450 msgr2=0x7f3fd40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:45.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.732+0000 7f3fefe99640 1 --2- 172.21.15.78:0/1425015498 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3fd40b5450 0x7f3fd40b7910 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3fe40e3580 tx=0x7f3fe4000bc0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.732+0000 7f3fefe99640 1 -- 172.21.15.78:0/1425015498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe8103ce0 msgr2=0x7f3fe8199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:45.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.732+0000 7f3fefe99640 1 --2- 172.21.15.78:0/1425015498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe8103ce0 0x7f3fe8199260 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400c890 tx=0x7f3fe400cd50 comp rx=0 tx=0).stop 2024-09-11T00:23:45.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.733+0000 7f3fefe99640 1 -- 172.21.15.78:0/1425015498 shutdown_connections 2024-09-11T00:23:45.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.733+0000 7f3fefe99640 1 --2- 172.21.15.78:0/1425015498 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f3fd40b5450 0x7f3fd40b7910 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.733+0000 7f3fefe99640 1 --2- 172.21.15.78:0/1425015498 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3fe810d140 0x7f3fe819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.733+0000 7f3fefe99640 1 --2- 172.21.15.78:0/1425015498 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3fe8104600 0x7f3fe81997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.733+0000 7f3fefe99640 1 --2- 172.21.15.78:0/1425015498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3fe8103ce0 0x7f3fe8199260 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:45.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.733+0000 7f3fefe99640 1 -- 172.21.15.78:0/1425015498 >> 172.21.15.78:0/1425015498 conn(0x7f3fe80fd700 msgr2=0x7f3fe80fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:45.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.733+0000 7f3fefe99640 1 -- 172.21.15.78:0/1425015498 shutdown_connections 2024-09-11T00:23:45.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:45.733+0000 7f3fefe99640 1 -- 172.21.15.78:0/1425015498 wait complete. 2024-09-11T00:23:46.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:45 smithi112 ceph-mon[35627]: pgmap v544: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:23:46.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:45 smithi138 ceph-mon[35019]: pgmap v544: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:23:46.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:45 smithi078 ceph-mon[30865]: pgmap v544: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:23:47.524 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:23:47.525 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:23:47.781 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:23:48.174 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:47 smithi078 ceph-mon[30865]: pgmap v545: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:23:48.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:47 smithi112 ceph-mon[35627]: pgmap v545: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:23:48.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.257+0000 7f737aafb640 1 -- 172.21.15.78:0/2381082209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f737410d100 msgr2=0x7f737410f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:48.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.257+0000 7f737aafb640 1 --2- 172.21.15.78:0/2381082209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f737410d100 0x7f737410f560 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f736c009900 tx=0x7f736c02a410 comp rx=0 tx=0).stop 2024-09-11T00:23:48.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.257+0000 7f737aafb640 1 -- 172.21.15.78:0/2381082209 shutdown_connections 2024-09-11T00:23:48.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.257+0000 7f737aafb640 1 --2- 172.21.15.78:0/2381082209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f737410d100 0x7f737410f560 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.257+0000 7f737aafb640 1 --2- 172.21.15.78:0/2381082209 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73741045c0 0x7f737410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.257+0000 7f737aafb640 1 --2- 172.21.15.78:0/2381082209 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7374103ca0 0x7f7374104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.257+0000 7f737aafb640 1 -- 172.21.15.78:0/2381082209 >> 172.21.15.78:0/2381082209 conn(0x7f73740fd700 msgr2=0x7f73740ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:48.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.257+0000 7f737aafb640 1 -- 172.21.15.78:0/2381082209 shutdown_connections 2024-09-11T00:23:48.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.257+0000 7f737aafb640 1 -- 172.21.15.78:0/2381082209 wait complete. 2024-09-11T00:23:48.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.257+0000 7f737aafb640 1 Processor -- start 2024-09-11T00:23:48.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.257+0000 7f737aafb640 1 -- start start 2024-09-11T00:23:48.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.257+0000 7f737aafb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7374103ca0 0x7f73741991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:48.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.257+0000 7f737aafb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73741045c0 0x7f7374199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:48.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.257+0000 7f737aafb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f737410d100 0x7f737419eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:48.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.257+0000 7f737aafb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7374112d70 con 0x7f73741045c0 2024-09-11T00:23:48.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.257+0000 7f737aafb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7374112bf0 con 0x7f737410d100 2024-09-11T00:23:48.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.257+0000 7f737aafb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7374112ef0 con 0x7f7374103ca0 2024-09-11T00:23:48.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.258+0000 7f7373fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73741045c0 0x7f7374199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:48.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.258+0000 7f7373fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73741045c0 0x7f7374199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39540/0 (socket says 172.21.15.78:39540) 2024-09-11T00:23:48.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.258+0000 7f7373fff640 1 -- 172.21.15.78:0/737858003 learned_addr learned my addr 172.21.15.78:0/737858003 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:48.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.258+0000 7f7379098640 1 --2- 172.21.15.78:0/737858003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f737410d100 0x7f737419eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:48.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.258+0000 7f7378897640 1 --2- 172.21.15.78:0/737858003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7374103ca0 0x7f73741991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:48.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.258+0000 7f7373fff640 1 -- 172.21.15.78:0/737858003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7374103ca0 msgr2=0x7f73741991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:48.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.258+0000 7f7373fff640 1 --2- 172.21.15.78:0/737858003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7374103ca0 0x7f73741991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.258+0000 7f7373fff640 1 -- 172.21.15.78:0/737858003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f737410d100 msgr2=0x7f737419eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:48.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.258+0000 7f7373fff640 1 --2- 172.21.15.78:0/737858003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f737410d100 0x7f737419eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.258+0000 7f7373fff640 1 -- 172.21.15.78:0/737858003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f737419f270 con 0x7f73741045c0 2024-09-11T00:23:48.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.258+0000 7f7379098640 1 --2- 172.21.15.78:0/737858003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f737410d100 0x7f737419eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:48.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.258+0000 7f7378897640 1 --2- 172.21.15.78:0/737858003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7374103ca0 0x7f73741991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:48.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.258+0000 7f7373fff640 1 --2- 172.21.15.78:0/737858003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73741045c0 0x7f7374199700 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f735c00c970 tx=0x7f735c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:48.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.258+0000 7f7371ffb640 1 -- 172.21.15.78:0/737858003 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c007bb0 con 0x7f73741045c0 2024-09-11T00:23:48.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.258+0000 7f7371ffb640 1 -- 172.21.15.78:0/737858003 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f735c007d50 con 0x7f73741045c0 2024-09-11T00:23:48.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.258+0000 7f737aafb640 1 -- 172.21.15.78:0/737858003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f737419f560 con 0x7f73741045c0 2024-09-11T00:23:48.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.258+0000 7f7371ffb640 1 -- 172.21.15.78:0/737858003 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c00f720 con 0x7f73741045c0 2024-09-11T00:23:48.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.258+0000 7f737aafb640 1 -- 172.21.15.78:0/737858003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73741a5c20 con 0x7f73741045c0 2024-09-11T00:23:48.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.261+0000 7f7371ffb640 1 -- 172.21.15.78:0/737858003 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f735c00f900 con 0x7f73741045c0 2024-09-11T00:23:48.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.261+0000 7f737ced0740 1 Processor -- start 2024-09-11T00:23:48.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.261+0000 7f737ced0740 1 -- start start 2024-09-11T00:23:48.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.261+0000 7f737ced0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a106ee0 0x55879a1072c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:48.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.261+0000 7f737ced0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55879a107800 0x55879a113250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:48.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.261+0000 7f737ced0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55879a113790 0x55879a115b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:48.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.261+0000 7f737ced0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55879a07de60 con 0x55879a106ee0 2024-09-11T00:23:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.261+0000 7f737ced0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55879a06d290 con 0x55879a107800 2024-09-11T00:23:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.261+0000 7f737ced0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55879a0710a0 con 0x55879a113790 2024-09-11T00:23:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.261+0000 7f7379098640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a106ee0 0x55879a1072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.261+0000 7f7379098640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a106ee0 0x55879a1072c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39544/0 (socket says 172.21.15.78:39544) 2024-09-11T00:23:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.261+0000 7f7379098640 1 -- 172.21.15.78:0/3559726391 learned_addr learned my addr 172.21.15.78:0/3559726391 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.261+0000 7f7373fff640 1 --2- 172.21.15.78:0/3559726391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55879a113790 0x55879a115b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.262+0000 7f7378897640 1 --2- 172.21.15.78:0/3559726391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55879a107800 0x55879a113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.262+0000 7f7371ffb640 1 --2- 172.21.15.78:0/737858003 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f73600b5450 0x7f73600b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.262+0000 7f7379098640 1 -- 172.21.15.78:0/3559726391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55879a113790 msgr2=0x55879a115b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.262+0000 7f7379098640 1 --2- 172.21.15.78:0/3559726391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55879a113790 0x55879a115b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.262+0000 7f7379098640 1 -- 172.21.15.78:0/3559726391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55879a107800 msgr2=0x55879a113250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:48.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.262+0000 7f7379098640 1 --2- 172.21.15.78:0/3559726391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55879a107800 0x55879a113250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.262+0000 7f7379098640 1 -- 172.21.15.78:0/3559726391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558799dcb930 con 0x55879a106ee0 2024-09-11T00:23:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.262+0000 7f7379098640 1 --2- 172.21.15.78:0/737858003 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f73600b5450 0x7f73600b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.262+0000 7f7371ffb640 1 -- 172.21.15.78:0/737858003 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7f735c0e63d0 con 0x7f73741045c0 2024-09-11T00:23:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.262+0000 7f7379098640 1 --2- 172.21.15.78:0/3559726391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a106ee0 0x55879a1072c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f736c033000 tx=0x7f736c032f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87177d2211d4e7f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.262+0000 7f736affd640 1 -- 172.21.15.78:0/3559726391 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c04c070 con 0x55879a106ee0 2024-09-11T00:23:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.262+0000 7f736affd640 1 -- 172.21.15.78:0/3559726391 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f736c005380 con 0x55879a106ee0 2024-09-11T00:23:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.262+0000 7f736affd640 1 -- 172.21.15.78:0/3559726391 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c035070 con 0x55879a106ee0 2024-09-11T00:23:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.263+0000 7f737ced0740 1 -- 172.21.15.78:0/3559726391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a106ee0 msgr2=0x55879a1072c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.263+0000 7f7379098640 1 --2- 172.21.15.78:0/737858003 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f73600b5450 0x7f73600b7910 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f736c049000 tx=0x7f736c04a000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.263+0000 7f737ced0740 1 --2- 172.21.15.78:0/3559726391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a106ee0 0x55879a1072c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f736c033000 tx=0x7f736c032f80 comp rx=0 tx=0).stop 2024-09-11T00:23:48.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.263+0000 7f737ced0740 1 -- 172.21.15.78:0/3559726391 shutdown_connections 2024-09-11T00:23:48.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.263+0000 7f737ced0740 1 --2- 172.21.15.78:0/3559726391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55879a113790 0x55879a115b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.263+0000 7f737ced0740 1 --2- 172.21.15.78:0/3559726391 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55879a107800 0x55879a113250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.263+0000 7f737ced0740 1 --2- 172.21.15.78:0/3559726391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a106ee0 0x55879a1072c0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.263+0000 7f737ced0740 1 -- 172.21.15.78:0/3559726391 >> 172.21.15.78:0/3559726391 conn(0x55879a104d10 msgr2=0x55879a105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:48.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.263+0000 7f737ced0740 1 -- 172.21.15.78:0/3559726391 shutdown_connections 2024-09-11T00:23:48.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.263+0000 7f737ced0740 1 -- 172.21.15.78:0/3559726391 wait complete. 2024-09-11T00:23:48.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.263+0000 7f737ced0740 1 -- start start 2024-09-11T00:23:48.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.263+0000 7f737ced0740 1 Processor -- start 2024-09-11T00:23:48.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.264+0000 7f737ced0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55879a106ee0 0x55879a1106c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:48.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.264+0000 7f737ced0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55879a107800 0x55879a110c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:48.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.264+0000 7f737ced0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a113790 0x55879a111140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:48.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.264+0000 7f737ced0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x558799ece890 con 0x55879a113790 2024-09-11T00:23:48.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.264+0000 7f737ced0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55879a007d40 con 0x55879a107800 2024-09-11T00:23:48.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.264+0000 7f737ced0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55879a116440 con 0x55879a106ee0 2024-09-11T00:23:48.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.264+0000 7f737ced0740 10 client.0 _ll_register_callbacks cb 0x55879a06bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:23:48.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.264+0000 7f7379098640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a113790 0x55879a111140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:48.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.264+0000 7f7379098640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a113790 0x55879a111140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39558/0 (socket says 172.21.15.78:39558) 2024-09-11T00:23:48.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.264+0000 7f7379098640 1 -- 172.21.15.78:0/3661447411 learned_addr learned my addr 172.21.15.78:0/3661447411 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:48.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.264+0000 7f7373fff640 1 --2- 172.21.15.78:0/3661447411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55879a107800 0x55879a110c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:48.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.264+0000 7f7378897640 1 --2- 172.21.15.78:0/3661447411 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55879a106ee0 0x55879a1106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:48.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.264+0000 7f7379098640 1 -- 172.21.15.78:0/3661447411 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55879a106ee0 msgr2=0x55879a1106c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:48.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.264+0000 7f7379098640 1 --2- 172.21.15.78:0/3661447411 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55879a106ee0 0x55879a1106c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.264+0000 7f7379098640 1 -- 172.21.15.78:0/3661447411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55879a107800 msgr2=0x55879a110c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:48.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.264+0000 7f7379098640 1 --2- 172.21.15.78:0/3661447411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55879a107800 0x55879a110c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.264+0000 7f7379098640 1 -- 172.21.15.78:0/3661447411 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55879a11f7a0 con 0x55879a113790 2024-09-11T00:23:48.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.265+0000 7f7379098640 1 --2- 172.21.15.78:0/3661447411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a113790 0x55879a111140 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f736c031440 tx=0x7f736c005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716113a9f32169af server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:48.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.265+0000 7f7353fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:23:48.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.265+0000 7f7353fff640 1 -- 172.21.15.78:0/3661447411 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c059060 con 0x55879a113790 2024-09-11T00:23:48.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.265+0000 7f7353fff640 1 -- 172.21.15.78:0/3661447411 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7f736c005180 con 0x55879a113790 2024-09-11T00:23:48.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.265+0000 7f737ced0740 1 -- 172.21.15.78:0/3661447411 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f736c005380 con 0x55879a113790 2024-09-11T00:23:48.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.265+0000 7f7353fff640 1 -- 172.21.15.78:0/3661447411 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f736c04c070 con 0x55879a113790 2024-09-11T00:23:48.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.265+0000 7f737ced0740 10 client.16365 fetch_fsmap learned FSMap version 20 2024-09-11T00:23:48.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.265+0000 7f737ced0740 1 -- 172.21.15.78:0/3661447411 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55879a122130 con 0x55879a113790 2024-09-11T00:23:48.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.265+0000 7f7353fff640 1 -- 172.21.15.78:0/3661447411 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f736c005380 con 0x55879a113790 2024-09-11T00:23:48.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.265+0000 7f7353fff640 1 -- 172.21.15.78:0/3661447411 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f736c044040 con 0x55879a113790 2024-09-11T00:23:48.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.265+0000 7f737ced0740 10 client.16365 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:23:48.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.265+0000 7f737ced0740 10 client.16365 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:23:48.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.265+0000 7f737ced0740 20 client.16365 populate_metadata read hostname 'smithi078' 2024-09-11T00:23:48.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.265+0000 7f737ced0740 1 --2- 172.21.15.78:0/3661447411 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55879a123480 0x55879a125870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:48.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.265+0000 7f737ced0740 4 client.16365 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:23:48.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.265+0000 7f737ced0740 1 -- 172.21.15.78:0/3661447411 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55879a07fdb0 con 0x55879a123480 2024-09-11T00:23:48.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.266+0000 7f7378897640 1 --2- 172.21.15.78:0/3661447411 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55879a123480 0x55879a125870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:48.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.266+0000 7f7353fff640 10 client.16365 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:48.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.266+0000 7f7378897640 1 --2- 172.21.15.78:0/3661447411 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55879a123480 0x55879a125870 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b22d1a3c957f34e server_cookie=74fb854f85edf7b8 in_seq=0 out_seq=0 2024-09-11T00:23:48.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.267+0000 7f7353fff640 1 -- 172.21.15.78:0/3661447411 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55879a07fdb0 con 0x55879a123480 2024-09-11T00:23:48.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.267+0000 7f7353fff640 10 client.16365 handle_command_reply: tid=0 2024-09-11T00:23:48.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.267+0000 7f737ced0740 1 client.16365 shutdown 2024-09-11T00:23:48.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.267+0000 7f737ced0740 1 -- 172.21.15.78:0/3661447411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a113790 msgr2=0x55879a111140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:48.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.267+0000 7f737ced0740 1 --2- 172.21.15.78:0/3661447411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a113790 0x55879a111140 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f736c031440 tx=0x7f736c005760 comp rx=0 tx=0).stop 2024-09-11T00:23:48.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.267+0000 7f737ced0740 1 -- 172.21.15.78:0/3661447411 shutdown_connections 2024-09-11T00:23:48.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.267+0000 7f737ced0740 1 --2- 172.21.15.78:0/3661447411 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55879a123480 0x55879a125870 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.267+0000 7f737ced0740 1 --2- 172.21.15.78:0/3661447411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a113790 0x55879a111140 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.267+0000 7f7353fff640 0 client.16365 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:48.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.267+0000 7f737ced0740 1 --2- 172.21.15.78:0/3661447411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55879a107800 0x55879a110c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.267+0000 7f737ced0740 1 --2- 172.21.15.78:0/3661447411 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55879a106ee0 0x55879a1106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.267+0000 7f737ced0740 1 -- 172.21.15.78:0/3661447411 >> 172.21.15.78:0/3661447411 conn(0x55879a104d10 msgr2=0x55879a103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:48.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.268+0000 7f737ced0740 1 -- 172.21.15.78:0/3661447411 shutdown_connections 2024-09-11T00:23:48.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.268+0000 7f737ced0740 1 -- 172.21.15.78:0/3661447411 wait complete. 2024-09-11T00:23:48.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.268+0000 7f737ced0740 20 client.16365 trim_cache size 0 max 16384 2024-09-11T00:23:48.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.285+0000 7f737ced0740 1 Processor -- start 2024-09-11T00:23:48.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.285+0000 7f737ced0740 1 -- start start 2024-09-11T00:23:48.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.285+0000 7f737ced0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a106ee0 0x55879a110bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:48.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.285+0000 7f737ced0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55879a107800 0x55879a111100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:48.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.285+0000 7f737ced0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55879a113790 0x55879a10d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:48.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.285+0000 7f737ced0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f73741ac6c0 con 0x55879a106ee0 2024-09-11T00:23:48.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.285+0000 7f737ced0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f73741aef20 con 0x55879a107800 2024-09-11T00:23:48.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.285+0000 7f737ced0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f73741acd10 con 0x55879a113790 2024-09-11T00:23:48.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.285+0000 7f7378897640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a106ee0 0x55879a110bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:48.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.285+0000 7f7378897640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a106ee0 0x55879a110bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39564/0 (socket says 172.21.15.78:39564) 2024-09-11T00:23:48.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.285+0000 7f7378897640 1 -- 172.21.15.78:0/3199981751 learned_addr learned my addr 172.21.15.78:0/3199981751 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:48.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.285+0000 7f7378897640 1 -- 172.21.15.78:0/3199981751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55879a113790 msgr2=0x55879a10d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:48.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.285+0000 7f7378897640 1 --2- 172.21.15.78:0/3199981751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55879a113790 0x55879a10d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.285+0000 7f7378897640 1 -- 172.21.15.78:0/3199981751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55879a107800 msgr2=0x55879a111100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:48.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.285+0000 7f7378897640 1 --2- 172.21.15.78:0/3199981751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55879a107800 0x55879a111100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.285+0000 7f7378897640 1 -- 172.21.15.78:0/3199981751 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55879a105790 con 0x55879a106ee0 2024-09-11T00:23:48.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.285+0000 7f7378897640 1 --2- 172.21.15.78:0/3199981751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a106ee0 0x55879a110bc0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7364003970 tx=0x7f7364003e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee59de3362b25c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:48.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.286+0000 7f736a7fc640 1 -- 172.21.15.78:0/3199981751 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7364022040 con 0x55879a106ee0 2024-09-11T00:23:48.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.286+0000 7f736a7fc640 1 -- 172.21.15.78:0/3199981751 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73640047b0 con 0x55879a106ee0 2024-09-11T00:23:48.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.286+0000 7f736a7fc640 1 -- 172.21.15.78:0/3199981751 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7364027430 con 0x55879a106ee0 2024-09-11T00:23:48.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.286+0000 7f737ced0740 1 -- 172.21.15.78:0/3199981751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a106ee0 msgr2=0x55879a110bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:48.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.286+0000 7f737ced0740 1 --2- 172.21.15.78:0/3199981751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a106ee0 0x55879a110bc0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7364003970 tx=0x7f7364003e30 comp rx=0 tx=0).stop 2024-09-11T00:23:48.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.286+0000 7f737ced0740 1 -- 172.21.15.78:0/3199981751 shutdown_connections 2024-09-11T00:23:48.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.286+0000 7f737ced0740 1 --2- 172.21.15.78:0/3199981751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55879a113790 0x55879a10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.286+0000 7f737ced0740 1 --2- 172.21.15.78:0/3199981751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55879a107800 0x55879a111100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.286+0000 7f737ced0740 1 --2- 172.21.15.78:0/3199981751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a106ee0 0x55879a110bc0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.286+0000 7f737ced0740 1 -- 172.21.15.78:0/3199981751 >> 172.21.15.78:0/3199981751 conn(0x55879a104d10 msgr2=0x55879a112510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:48.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.286+0000 7f737ced0740 1 -- 172.21.15.78:0/3199981751 shutdown_connections 2024-09-11T00:23:48.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.286+0000 7f737ced0740 1 -- 172.21.15.78:0/3199981751 wait complete. 2024-09-11T00:23:48.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.287+0000 7f737ced0740 1 -- start start 2024-09-11T00:23:48.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.287+0000 7f737ced0740 1 Processor -- start 2024-09-11T00:23:48.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.287+0000 7f737ced0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55879a106ee0 0x55879a127370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:48.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.287+0000 7f737ced0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a107800 0x55879a1278f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:48.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.287+0000 7f737ced0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55879a113790 0x55879a187fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:48.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.287+0000 7f737ced0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f73741ad3e0 con 0x55879a107800 2024-09-11T00:23:48.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.287+0000 7f737ced0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f73741ae850 con 0x55879a113790 2024-09-11T00:23:48.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.287+0000 7f737ced0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f73741adab0 con 0x55879a106ee0 2024-09-11T00:23:48.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.287+0000 7f737ced0740 10 client.0 _ll_register_callbacks cb 0x7f736c04a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:23:48.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.287+0000 7f7373fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a107800 0x55879a1278f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:48.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.287+0000 7f7373fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a107800 0x55879a1278f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39578/0 (socket says 172.21.15.78:39578) 2024-09-11T00:23:48.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.287+0000 7f7373fff640 1 -- 172.21.15.78:0/2402082927 learned_addr learned my addr 172.21.15.78:0/2402082927 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:48.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.287+0000 7f7379098640 1 --2- 172.21.15.78:0/2402082927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55879a113790 0x55879a187fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:48.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.287+0000 7f7378897640 1 --2- 172.21.15.78:0/2402082927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55879a106ee0 0x55879a127370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:48.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.287+0000 7f7373fff640 1 -- 172.21.15.78:0/2402082927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55879a106ee0 msgr2=0x55879a127370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:48.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.287+0000 7f7373fff640 1 --2- 172.21.15.78:0/2402082927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55879a106ee0 0x55879a127370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.287+0000 7f7373fff640 1 -- 172.21.15.78:0/2402082927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55879a113790 msgr2=0x55879a187fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:48.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.287+0000 7f7373fff640 1 --2- 172.21.15.78:0/2402082927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55879a113790 0x55879a187fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.288+0000 7f7373fff640 1 -- 172.21.15.78:0/2402082927 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55879a1886c0 con 0x55879a107800 2024-09-11T00:23:48.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.288+0000 7f7379098640 1 --2- 172.21.15.78:0/2402082927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55879a113790 0x55879a187fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:48.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.288+0000 7f7373fff640 1 --2- 172.21.15.78:0/2402082927 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a107800 0x55879a1278f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f735c0ac530 tx=0x7f735c0e67b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac302b9b6c3feb43 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:48.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.288+0000 7f7353fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:23:48.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.288+0000 7f7353fff640 1 -- 172.21.15.78:0/2402082927 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c0b1020 con 0x55879a107800 2024-09-11T00:23:48.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.288+0000 7f7353fff640 1 -- 172.21.15.78:0/2402082927 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7f735c0b58a0 con 0x55879a107800 2024-09-11T00:23:48.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.288+0000 7f737ced0740 1 -- 172.21.15.78:0/2402082927 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73640047b0 con 0x55879a107800 2024-09-11T00:23:48.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.288+0000 7f7353fff640 1 -- 172.21.15.78:0/2402082927 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f735c0ac180 con 0x55879a107800 2024-09-11T00:23:48.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.288+0000 7f737ced0740 10 client.16371 fetch_fsmap learned FSMap version 20 2024-09-11T00:23:48.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.288+0000 7f737ced0740 1 -- 172.21.15.78:0/2402082927 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55879a190ca0 con 0x55879a107800 2024-09-11T00:23:48.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.288+0000 7f7353fff640 1 -- 172.21.15.78:0/2402082927 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73640047b0 con 0x55879a107800 2024-09-11T00:23:48.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.288+0000 7f7353fff640 1 -- 172.21.15.78:0/2402082927 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f735c0adb60 con 0x55879a107800 2024-09-11T00:23:48.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.288+0000 7f737ced0740 10 client.16371 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:23:48.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.288+0000 7f737ced0740 10 client.16371 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:23:48.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.288+0000 7f737ced0740 20 client.16371 populate_metadata read hostname 'smithi078' 2024-09-11T00:23:48.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.288+0000 7f737ced0740 1 --2- 172.21.15.78:0/2402082927 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55879a123480 0x55879a193460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:48.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.288+0000 7f737ced0740 4 client.16371 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:23:48.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.288+0000 7f737ced0740 1 -- 172.21.15.78:0/2402082927 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55879a07b860 con 0x55879a123480 2024-09-11T00:23:48.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.289+0000 7f7378897640 1 --2- 172.21.15.78:0/2402082927 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55879a123480 0x55879a193460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:48.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.289+0000 7f7378897640 1 --2- 172.21.15.78:0/2402082927 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55879a123480 0x55879a193460 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da54174ea43f9a47 server_cookie=3f0c60758ef10815 in_seq=0 out_seq=0 2024-09-11T00:23:48.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.289+0000 7f7353fff640 10 client.16371 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:48.296 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:47 smithi138 ceph-mon[35019]: pgmap v545: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:23:48.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.291+0000 7f7353fff640 1 -- 172.21.15.78:0/2402082927 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55879a07b860 con 0x55879a123480 2024-09-11T00:23:48.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.291+0000 7f7353fff640 10 client.16371 handle_command_reply: tid=0 2024-09-11T00:23:48.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.291+0000 7f737ced0740 1 client.16371 shutdown 2024-09-11T00:23:48.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.291+0000 7f737ced0740 1 -- 172.21.15.78:0/2402082927 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a107800 msgr2=0x55879a1278f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:48.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.291+0000 7f737ced0740 1 --2- 172.21.15.78:0/2402082927 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a107800 0x55879a1278f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f735c0ac530 tx=0x7f735c0e67b0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.291+0000 7f737ced0740 1 -- 172.21.15.78:0/2402082927 shutdown_connections 2024-09-11T00:23:48.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.291+0000 7f737ced0740 1 --2- 172.21.15.78:0/2402082927 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55879a123480 0x55879a193460 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.291+0000 7f7353fff640 0 client.16371 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:48.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.291+0000 7f737ced0740 1 --2- 172.21.15.78:0/2402082927 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55879a113790 0x55879a187fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.291+0000 7f737ced0740 1 --2- 172.21.15.78:0/2402082927 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55879a107800 0x55879a1278f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.291+0000 7f737ced0740 1 --2- 172.21.15.78:0/2402082927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55879a106ee0 0x55879a127370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.291+0000 7f737ced0740 1 -- 172.21.15.78:0/2402082927 >> 172.21.15.78:0/2402082927 conn(0x55879a104d10 msgr2=0x55879a11e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:48.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.291+0000 7f737ced0740 1 -- 172.21.15.78:0/2402082927 shutdown_connections 2024-09-11T00:23:48.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.291+0000 7f737ced0740 1 -- 172.21.15.78:0/2402082927 wait complete. 2024-09-11T00:23:48.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.292+0000 7f737ced0740 20 client.16371 trim_cache size 0 max 16384 2024-09-11T00:23:48.299 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:23:48.299 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-11T00:23:48.299 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "f6eb5d15-216e-4f8b-b451-2f71b931998f", 2024-09-11T00:23:48.299 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-11T00:23:48.299 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:23:48.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.292+0000 7f737aafb640 1 -- 172.21.15.78:0/737858003 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f73600b5450 msgr2=0x7f73600b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:48.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.292+0000 7f737aafb640 1 --2- 172.21.15.78:0/737858003 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f73600b5450 0x7f73600b7910 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f736c049000 tx=0x7f736c04a000 comp rx=0 tx=0).stop 2024-09-11T00:23:48.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.292+0000 7f737aafb640 1 -- 172.21.15.78:0/737858003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73741045c0 msgr2=0x7f7374199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:48.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.292+0000 7f737aafb640 1 --2- 172.21.15.78:0/737858003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73741045c0 0x7f7374199700 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f735c00c970 tx=0x7f735c00ce30 comp rx=0 tx=0).stop 2024-09-11T00:23:48.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.292+0000 7f737aafb640 1 -- 172.21.15.78:0/737858003 shutdown_connections 2024-09-11T00:23:48.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.292+0000 7f737aafb640 1 --2- 172.21.15.78:0/737858003 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f73600b5450 0x7f73600b7910 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.292+0000 7f737aafb640 1 --2- 172.21.15.78:0/737858003 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f737410d100 0x7f737419eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.292+0000 7f737aafb640 1 --2- 172.21.15.78:0/737858003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73741045c0 0x7f7374199700 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.292+0000 7f737aafb640 1 --2- 172.21.15.78:0/737858003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7374103ca0 0x7f73741991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:48.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.292+0000 7f737aafb640 1 -- 172.21.15.78:0/737858003 >> 172.21.15.78:0/737858003 conn(0x7f73740fd700 msgr2=0x7f737410f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:48.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.292+0000 7f737aafb640 1 -- 172.21.15.78:0/737858003 shutdown_connections 2024-09-11T00:23:48.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:48.292+0000 7f737aafb640 1 -- 172.21.15.78:0/737858003 wait complete. 2024-09-11T00:23:49.135 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:23:49.381 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:23:49.501 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:49 smithi078 ceph-mon[30865]: scrub queued for path: / 2024-09-11T00:23:49.501 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:49 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:23:49.501 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:49 smithi078 ceph-mon[30865]: scrub summary: active paths [/] 2024-09-11T00:23:49.501 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:49 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:23:49.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:49 smithi112 ceph-mon[35627]: scrub queued for path: / 2024-09-11T00:23:49.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:49 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:23:49.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:49 smithi112 ceph-mon[35627]: scrub summary: active paths [/] 2024-09-11T00:23:49.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:49 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:23:49.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:49 smithi138 ceph-mon[35019]: scrub queued for path: / 2024-09-11T00:23:49.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:49 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:23:49.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:49 smithi138 ceph-mon[35019]: scrub summary: active paths [/] 2024-09-11T00:23:49.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:49 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:23:49.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.887+0000 7f0dd98d7640 1 -- 172.21.15.78:0/2848522253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd410d130 msgr2=0x7f0dd410f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:49.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.887+0000 7f0dd98d7640 1 --2- 172.21.15.78:0/2848522253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd410d130 0x7f0dd410f590 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4009900 tx=0x7f0dc402a410 comp rx=0 tx=0).stop 2024-09-11T00:23:49.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.887+0000 7f0dd98d7640 1 -- 172.21.15.78:0/2848522253 shutdown_connections 2024-09-11T00:23:49.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.887+0000 7f0dd98d7640 1 --2- 172.21.15.78:0/2848522253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd410d130 0x7f0dd410f590 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.887+0000 7f0dd98d7640 1 --2- 172.21.15.78:0/2848522253 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dd41045f0 0x7f0dd410cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.887+0000 7f0dd98d7640 1 --2- 172.21.15.78:0/2848522253 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dd4103cd0 0x7f0dd41040b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.887+0000 7f0dd98d7640 1 -- 172.21.15.78:0/2848522253 >> 172.21.15.78:0/2848522253 conn(0x7f0dd40fd750 msgr2=0x7f0dd40ffb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:49.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.887+0000 7f0dd98d7640 1 -- 172.21.15.78:0/2848522253 shutdown_connections 2024-09-11T00:23:49.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.887+0000 7f0dd98d7640 1 -- 172.21.15.78:0/2848522253 wait complete. 2024-09-11T00:23:49.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.888+0000 7f0dd98d7640 1 Processor -- start 2024-09-11T00:23:49.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.888+0000 7f0dd98d7640 1 -- start start 2024-09-11T00:23:49.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.888+0000 7f0dd98d7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd4103cd0 0x7f0dd4199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.888+0000 7f0dd98d7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dd41045f0 0x7f0dd41997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.888+0000 7f0dd98d7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dd410d130 0x7f0dd419eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.888+0000 7f0dd98d7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd4112da0 con 0x7f0dd4103cd0 2024-09-11T00:23:49.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.888+0000 7f0dd98d7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd4112c20 con 0x7f0dd41045f0 2024-09-11T00:23:49.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.888+0000 7f0dd98d7640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd4112f20 con 0x7f0dd410d130 2024-09-11T00:23:49.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.888+0000 7f0dd2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd4103cd0 0x7f0dd4199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.889+0000 7f0dd2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd4103cd0 0x7f0dd4199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39582/0 (socket says 172.21.15.78:39582) 2024-09-11T00:23:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.889+0000 7f0dd2ffd640 1 -- 172.21.15.78:0/3105537121 learned_addr learned my addr 172.21.15.78:0/3105537121 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.889+0000 7f0dd37fe640 1 --2- 172.21.15.78:0/3105537121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dd410d130 0x7f0dd419eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.889+0000 7f0dd27fc640 1 --2- 172.21.15.78:0/3105537121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dd41045f0 0x7f0dd41997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.889+0000 7f0dd2ffd640 1 -- 172.21.15.78:0/3105537121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dd410d130 msgr2=0x7f0dd419eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.889+0000 7f0dd2ffd640 1 --2- 172.21.15.78:0/3105537121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dd410d130 0x7f0dd419eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.889+0000 7f0dd2ffd640 1 -- 172.21.15.78:0/3105537121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dd41045f0 msgr2=0x7f0dd41997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.889+0000 7f0dd2ffd640 1 --2- 172.21.15.78:0/3105537121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dd41045f0 0x7f0dd41997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.889+0000 7f0dd2ffd640 1 -- 172.21.15.78:0/3105537121 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd419f340 con 0x7f0dd4103cd0 2024-09-11T00:23:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.889+0000 7f0dd27fc640 1 --2- 172.21.15.78:0/3105537121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dd41045f0 0x7f0dd41997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.889+0000 7f0dd2ffd640 1 --2- 172.21.15.78:0/3105537121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd4103cd0 0x7f0dd4199290 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00c890 tx=0x7f0dcc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:49.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.889+0000 7f0dd88d5640 1 -- 172.21.15.78:0/3105537121 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc004220 con 0x7f0dd4103cd0 2024-09-11T00:23:49.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.889+0000 7f0dd88d5640 1 -- 172.21.15.78:0/3105537121 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dcc0043c0 con 0x7f0dd4103cd0 2024-09-11T00:23:49.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.889+0000 7f0dd98d7640 1 -- 172.21.15.78:0/3105537121 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dd419f630 con 0x7f0dd4103cd0 2024-09-11T00:23:49.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.889+0000 7f0dd88d5640 1 -- 172.21.15.78:0/3105537121 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc004a00 con 0x7f0dd4103cd0 2024-09-11T00:23:49.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.889+0000 7f0dd98d7640 1 -- 172.21.15.78:0/3105537121 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dd41a5cf0 con 0x7f0dd4103cd0 2024-09-11T00:23:49.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.892+0000 7f0dd88d5640 1 -- 172.21.15.78:0/3105537121 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f0dcc0079b0 con 0x7f0dd4103cd0 2024-09-11T00:23:49.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.892+0000 7f0ddbcac740 1 Processor -- start 2024-09-11T00:23:49.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.892+0000 7f0ddbcac740 1 -- start start 2024-09-11T00:23:49.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.892+0000 7f0ddbcac740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557e975620a0 0x557e97562480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.892+0000 7f0ddbcac740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e975629c0 0x557e9756e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.892+0000 7f0ddbcac740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e9756e950 0x557e97570d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.892+0000 7f0ddbcac740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557e974d8e50 con 0x557e9756e950 2024-09-11T00:23:49.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.892+0000 7f0ddbcac740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557e974c8280 con 0x557e975629c0 2024-09-11T00:23:49.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.892+0000 7f0ddbcac740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x557e974cc090 con 0x557e975620a0 2024-09-11T00:23:49.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.892+0000 7f0dd27fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e9756e950 0x557e97570d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.892+0000 7f0dd27fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e9756e950 0x557e97570d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39590/0 (socket says 172.21.15.78:39590) 2024-09-11T00:23:49.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.892+0000 7f0dd27fc640 1 -- 172.21.15.78:0/1639495283 learned_addr learned my addr 172.21.15.78:0/1639495283 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:49.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.892+0000 7f0dd2ffd640 1 --2- 172.21.15.78:0/1639495283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e975629c0 0x557e9756e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.892+0000 7f0dd37fe640 1 --2- 172.21.15.78:0/1639495283 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557e975620a0 0x557e97562480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.892+0000 7f0dd88d5640 1 --2- 172.21.15.78:0/3105537121 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f0dbc0b5450 0x7f0dbc0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.892+0000 7f0dd27fc640 1 -- 172.21.15.78:0/1639495283 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557e975620a0 msgr2=0x557e97562480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:49.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.892+0000 7f0dd27fc640 1 --2- 172.21.15.78:0/1639495283 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557e975620a0 0x557e97562480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.893+0000 7f0dd27fc640 1 -- 172.21.15.78:0/1639495283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e975629c0 msgr2=0x557e9756e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:49.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.893+0000 7f0dd27fc640 1 --2- 172.21.15.78:0/1639495283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e975629c0 0x557e9756e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.893+0000 7f0dd27fc640 1 -- 172.21.15.78:0/1639495283 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e97226650 con 0x557e9756e950 2024-09-11T00:23:49.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.893+0000 7f0dd37fe640 1 --2- 172.21.15.78:0/3105537121 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f0dbc0b5450 0x7f0dbc0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.893+0000 7f0dd88d5640 1 -- 172.21.15.78:0/3105537121 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7f0dcc0e5df0 con 0x7f0dd4103cd0 2024-09-11T00:23:49.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.893+0000 7f0dd27fc640 1 --2- 172.21.15.78:0/1639495283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e9756e950 0x557e97570d40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009f60 tx=0x7f0dc8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f47ee1159b80dd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:49.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.893+0000 7f0db9ffb640 1 -- 172.21.15.78:0/1639495283 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc801a680 con 0x557e9756e950 2024-09-11T00:23:49.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.893+0000 7f0db9ffb640 1 -- 172.21.15.78:0/1639495283 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dc80118f0 con 0x557e9756e950 2024-09-11T00:23:49.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.893+0000 7f0db9ffb640 1 -- 172.21.15.78:0/1639495283 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc80108f0 con 0x557e9756e950 2024-09-11T00:23:49.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.894+0000 7f0ddbcac740 1 -- 172.21.15.78:0/1639495283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e9756e950 msgr2=0x557e97570d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:49.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.894+0000 7f0dd37fe640 1 --2- 172.21.15.78:0/3105537121 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f0dbc0b5450 0x7f0dbc0b7910 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4006010 tx=0x7f0dc4009260 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:49.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.894+0000 7f0ddbcac740 1 --2- 172.21.15.78:0/1639495283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e9756e950 0x557e97570d40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009f60 tx=0x7f0dc8009f90 comp rx=0 tx=0).stop 2024-09-11T00:23:49.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.894+0000 7f0ddbcac740 1 -- 172.21.15.78:0/1639495283 shutdown_connections 2024-09-11T00:23:49.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.894+0000 7f0ddbcac740 1 --2- 172.21.15.78:0/1639495283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e9756e950 0x557e97570d40 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.894+0000 7f0ddbcac740 1 --2- 172.21.15.78:0/1639495283 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e975629c0 0x557e9756e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.894+0000 7f0ddbcac740 1 --2- 172.21.15.78:0/1639495283 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557e975620a0 0x557e97562480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.894+0000 7f0ddbcac740 1 -- 172.21.15.78:0/1639495283 >> 172.21.15.78:0/1639495283 conn(0x557e9755fed0 msgr2=0x557e97561070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:49.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.894+0000 7f0ddbcac740 1 -- 172.21.15.78:0/1639495283 shutdown_connections 2024-09-11T00:23:49.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.894+0000 7f0ddbcac740 1 -- 172.21.15.78:0/1639495283 wait complete. 2024-09-11T00:23:49.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.894+0000 7f0ddbcac740 1 -- start start 2024-09-11T00:23:49.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.894+0000 7f0ddbcac740 1 Processor -- start 2024-09-11T00:23:49.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0ddbcac740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e975620a0 0x557e9756e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0ddbcac740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e975629c0 0x557e9756b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0ddbcac740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557e9756e950 0x557e9756bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0ddbcac740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557e97329700 con 0x557e975629c0 2024-09-11T00:23:49.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0ddbcac740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557e97463110 con 0x557e975620a0 2024-09-11T00:23:49.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0ddbcac740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x557e975715d0 con 0x557e9756e950 2024-09-11T00:23:49.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0ddbcac740 10 client.0 _ll_register_callbacks cb 0x557e9747c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:23:49.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0dd27fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e975629c0 0x557e9756b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0dd27fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e975629c0 0x557e9756b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39596/0 (socket says 172.21.15.78:39596) 2024-09-11T00:23:49.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0dd27fc640 1 -- 172.21.15.78:0/2179309896 learned_addr learned my addr 172.21.15.78:0/2179309896 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:49.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0dd2ffd640 1 --2- 172.21.15.78:0/2179309896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e975620a0 0x557e9756e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0dd37fe640 1 --2- 172.21.15.78:0/2179309896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557e9756e950 0x557e9756bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0dd27fc640 1 -- 172.21.15.78:0/2179309896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557e9756e950 msgr2=0x557e9756bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:49.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0dd27fc640 1 --2- 172.21.15.78:0/2179309896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557e9756e950 0x557e9756bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0dd27fc640 1 -- 172.21.15.78:0/2179309896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e975620a0 msgr2=0x557e9756e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:49.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0dd27fc640 1 --2- 172.21.15.78:0/2179309896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e975620a0 0x557e9756e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0dd27fc640 1 -- 172.21.15.78:0/2179309896 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e97490c40 con 0x557e975629c0 2024-09-11T00:23:49.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0dd37fe640 1 --2- 172.21.15.78:0/2179309896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557e9756e950 0x557e9756bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:49.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0dd27fc640 1 --2- 172.21.15.78:0/2179309896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e975629c0 0x557e9756b690 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009ca0 tx=0x7f0dc8009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1279dcbdb51658 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:49.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0db2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:23:49.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0db2ffd640 1 -- 172.21.15.78:0/2179309896 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8011ca0 con 0x557e975629c0 2024-09-11T00:23:49.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0db2ffd640 1 -- 172.21.15.78:0/2179309896 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7f0dc8004a40 con 0x557e975629c0 2024-09-11T00:23:49.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.895+0000 7f0ddbcac740 1 -- 172.21.15.78:0/2179309896 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dc80118f0 con 0x557e975629c0 2024-09-11T00:23:49.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.896+0000 7f0db2ffd640 1 -- 172.21.15.78:0/2179309896 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0dc8031050 con 0x557e975629c0 2024-09-11T00:23:49.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.896+0000 7f0ddbcac740 10 client.16383 fetch_fsmap learned FSMap version 20 2024-09-11T00:23:49.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.896+0000 7f0ddbcac740 1 -- 172.21.15.78:0/2179309896 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557e9757cf30 con 0x557e975629c0 2024-09-11T00:23:49.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.896+0000 7f0db2ffd640 1 -- 172.21.15.78:0/2179309896 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dc80118f0 con 0x557e975629c0 2024-09-11T00:23:49.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.896+0000 7f0db2ffd640 1 -- 172.21.15.78:0/2179309896 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f0dc8005040 con 0x557e975629c0 2024-09-11T00:23:49.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.896+0000 7f0ddbcac740 10 client.16383 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:23:49.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.896+0000 7f0ddbcac740 10 client.16383 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:23:49.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.896+0000 7f0ddbcac740 20 client.16383 populate_metadata read hostname 'smithi078' 2024-09-11T00:23:49.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.896+0000 7f0ddbcac740 1 --2- 172.21.15.78:0/2179309896 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557e9757e280 0x557e97580670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.896+0000 7f0ddbcac740 4 client.16383 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:23:49.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.896+0000 7f0ddbcac740 1 -- 172.21.15.78:0/2179309896 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e974dada0 con 0x557e9757e280 2024-09-11T00:23:49.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.896+0000 7f0dd2ffd640 1 --2- 172.21.15.78:0/2179309896 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557e9757e280 0x557e97580670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.897+0000 7f0db2ffd640 10 client.16383 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:49.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.897+0000 7f0dd2ffd640 1 --2- 172.21.15.78:0/2179309896 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557e9757e280 0x557e97580670 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=373034d19ef734f7 server_cookie=7027a0dcb2c793e in_seq=0 out_seq=0 2024-09-11T00:23:49.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.897+0000 7f0db2ffd640 1 -- 172.21.15.78:0/2179309896 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557e974dada0 con 0x557e9757e280 2024-09-11T00:23:49.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.897+0000 7f0db2ffd640 10 client.16383 handle_command_reply: tid=0 2024-09-11T00:23:49.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.897+0000 7f0ddbcac740 1 client.16383 shutdown 2024-09-11T00:23:49.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.898+0000 7f0ddbcac740 1 -- 172.21.15.78:0/2179309896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e975629c0 msgr2=0x557e9756b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:49.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.898+0000 7f0ddbcac740 1 --2- 172.21.15.78:0/2179309896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e975629c0 0x557e9756b690 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009ca0 tx=0x7f0dc8009540 comp rx=0 tx=0).stop 2024-09-11T00:23:49.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.898+0000 7f0ddbcac740 1 -- 172.21.15.78:0/2179309896 shutdown_connections 2024-09-11T00:23:49.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.898+0000 7f0ddbcac740 1 --2- 172.21.15.78:0/2179309896 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557e9757e280 0x557e97580670 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.898+0000 7f0ddbcac740 1 --2- 172.21.15.78:0/2179309896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557e9756e950 0x557e9756bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.898+0000 7f0ddbcac740 1 --2- 172.21.15.78:0/2179309896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e975629c0 0x557e9756b690 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.898+0000 7f0db2ffd640 0 client.16383 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:49.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.898+0000 7f0ddbcac740 1 --2- 172.21.15.78:0/2179309896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e975620a0 0x557e9756e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.898+0000 7f0ddbcac740 1 -- 172.21.15.78:0/2179309896 >> 172.21.15.78:0/2179309896 conn(0x557e9755fed0 msgr2=0x557e97565a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:49.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.898+0000 7f0ddbcac740 1 -- 172.21.15.78:0/2179309896 shutdown_connections 2024-09-11T00:23:49.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.898+0000 7f0ddbcac740 1 -- 172.21.15.78:0/2179309896 wait complete. 2024-09-11T00:23:49.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.898+0000 7f0ddbcac740 20 client.16383 trim_cache size 0 max 16384 2024-09-11T00:23:49.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.915+0000 7f0ddbcac740 1 Processor -- start 2024-09-11T00:23:49.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.915+0000 7f0ddbcac740 1 -- start start 2024-09-11T00:23:49.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.915+0000 7f0ddbcac740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e975620a0 0x557e9757a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.915+0000 7f0ddbcac740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e975629c0 0x557e9755f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.915+0000 7f0ddbcac740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557e9756e950 0x557e97576c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.915+0000 7f0ddbcac740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd41ac7c0 con 0x557e975620a0 2024-09-11T00:23:49.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.915+0000 7f0ddbcac740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd41af020 con 0x557e975629c0 2024-09-11T00:23:49.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.915+0000 7f0ddbcac740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd41ace10 con 0x557e9756e950 2024-09-11T00:23:49.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.916+0000 7f0dd2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e975620a0 0x557e9757a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.916+0000 7f0dd2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e975620a0 0x557e9757a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39610/0 (socket says 172.21.15.78:39610) 2024-09-11T00:23:49.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.916+0000 7f0dd2ffd640 1 -- 172.21.15.78:0/3952802497 learned_addr learned my addr 172.21.15.78:0/3952802497 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:49.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.916+0000 7f0dd27fc640 1 --2- 172.21.15.78:0/3952802497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e975629c0 0x557e9755f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.916+0000 7f0dd2ffd640 1 -- 172.21.15.78:0/3952802497 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557e9756e950 msgr2=0x557e97576c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:49.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.916+0000 7f0dd2ffd640 1 --2- 172.21.15.78:0/3952802497 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557e9756e950 0x557e97576c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.916+0000 7f0dd2ffd640 1 -- 172.21.15.78:0/3952802497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e975629c0 msgr2=0x557e9755f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:49.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.916+0000 7f0dd2ffd640 1 --2- 172.21.15.78:0/3952802497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e975629c0 0x557e9755f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.916+0000 7f0dd2ffd640 1 -- 172.21.15.78:0/3952802497 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e9756b440 con 0x557e975620a0 2024-09-11T00:23:49.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.916+0000 7f0dd27fc640 1 --2- 172.21.15.78:0/3952802497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e975629c0 0x557e9755f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:49.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.916+0000 7f0dd2ffd640 1 --2- 172.21.15.78:0/3952802497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e975620a0 0x557e9757a830 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0058c0 tx=0x7f0dcc0e8240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57034bd4d6c34a6c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:49.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.916+0000 7f0db97fa640 1 -- 172.21.15.78:0/3952802497 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc08cf90 con 0x557e975620a0 2024-09-11T00:23:49.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.916+0000 7f0db97fa640 1 -- 172.21.15.78:0/3952802497 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dcc005290 con 0x557e975620a0 2024-09-11T00:23:49.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.916+0000 7f0db97fa640 1 -- 172.21.15.78:0/3952802497 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc01d040 con 0x557e975620a0 2024-09-11T00:23:49.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.917+0000 7f0ddbcac740 1 -- 172.21.15.78:0/3952802497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e975620a0 msgr2=0x557e9757a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:49.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.917+0000 7f0ddbcac740 1 --2- 172.21.15.78:0/3952802497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e975620a0 0x557e9757a830 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0058c0 tx=0x7f0dcc0e8240 comp rx=0 tx=0).stop 2024-09-11T00:23:49.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.917+0000 7f0ddbcac740 1 -- 172.21.15.78:0/3952802497 shutdown_connections 2024-09-11T00:23:49.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.917+0000 7f0ddbcac740 1 --2- 172.21.15.78:0/3952802497 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557e9756e950 0x557e97576c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.917+0000 7f0ddbcac740 1 --2- 172.21.15.78:0/3952802497 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e975629c0 0x557e9755f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.917+0000 7f0ddbcac740 1 --2- 172.21.15.78:0/3952802497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e975620a0 0x557e9757a830 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.917+0000 7f0ddbcac740 1 -- 172.21.15.78:0/3952802497 >> 172.21.15.78:0/3952802497 conn(0x557e9755fed0 msgr2=0x557e97560bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:49.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.917+0000 7f0ddbcac740 1 -- 172.21.15.78:0/3952802497 shutdown_connections 2024-09-11T00:23:49.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.917+0000 7f0ddbcac740 1 -- 172.21.15.78:0/3952802497 wait complete. 2024-09-11T00:23:49.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.917+0000 7f0ddbcac740 1 -- start start 2024-09-11T00:23:49.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.917+0000 7f0ddbcac740 1 Processor -- start 2024-09-11T00:23:49.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.918+0000 7f0ddbcac740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e975620a0 0x557e975e2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.918+0000 7f0ddbcac740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557e975629c0 0x557e975e33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.918+0000 7f0ddbcac740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e9756e950 0x557e975e3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.918+0000 7f0ddbcac740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd41ad4e0 con 0x557e9756e950 2024-09-11T00:23:49.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.918+0000 7f0ddbcac740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd41ae950 con 0x557e975620a0 2024-09-11T00:23:49.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.918+0000 7f0ddbcac740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd41adbb0 con 0x557e975629c0 2024-09-11T00:23:49.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.918+0000 7f0ddbcac740 10 client.0 _ll_register_callbacks cb 0x7f0dcc0e9770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:23:49.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.918+0000 7f0dd37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e9756e950 0x557e975e3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.918+0000 7f0dd37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e9756e950 0x557e975e3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39618/0 (socket says 172.21.15.78:39618) 2024-09-11T00:23:49.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.918+0000 7f0dd37fe640 1 -- 172.21.15.78:0/2482913642 learned_addr learned my addr 172.21.15.78:0/2482913642 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:23:49.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.918+0000 7f0dd27fc640 1 --2- 172.21.15.78:0/2482913642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557e975629c0 0x557e975e33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.918+0000 7f0dd2ffd640 1 --2- 172.21.15.78:0/2482913642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e975620a0 0x557e975e2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.918+0000 7f0dd37fe640 1 -- 172.21.15.78:0/2482913642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557e975629c0 msgr2=0x557e975e33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:49.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.918+0000 7f0dd37fe640 1 --2- 172.21.15.78:0/2482913642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557e975629c0 0x557e975e33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.918+0000 7f0dd37fe640 1 -- 172.21.15.78:0/2482913642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e975620a0 msgr2=0x557e975e2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:23:49.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.918+0000 7f0dd37fe640 1 --2- 172.21.15.78:0/2482913642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e975620a0 0x557e975e2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.918+0000 7f0dd37fe640 1 -- 172.21.15.78:0/2482913642 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e975ee110 con 0x557e9756e950 2024-09-11T00:23:49.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.918+0000 7f0dd2ffd640 1 --2- 172.21.15.78:0/2482913642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e975620a0 0x557e975e2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:23:49.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.918+0000 7f0dd27fc640 1 --2- 172.21.15.78:0/2482913642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557e975629c0 0x557e975e33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:23:49.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.918+0000 7f0dd37fe640 1 --2- 172.21.15.78:0/2482913642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e9756e950 0x557e975e3910 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4031440 tx=0x7f0dc40058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ba7be75f515b83 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:23:49.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.918+0000 7f0db2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:23:49.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.919+0000 7f0db2ffd640 1 -- 172.21.15.78:0/2482913642 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4035040 con 0x557e9756e950 2024-09-11T00:23:49.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.919+0000 7f0db2ffd640 1 -- 172.21.15.78:0/2482913642 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8536+0+0 (secure 0 0 0) 0x7f0dc4004460 con 0x557e9756e950 2024-09-11T00:23:49.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.919+0000 7f0ddbcac740 1 -- 172.21.15.78:0/2482913642 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557e974d6850 con 0x557e9756e950 2024-09-11T00:23:49.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.919+0000 7f0db2ffd640 1 -- 172.21.15.78:0/2482913642 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0dc4005180 con 0x557e9756e950 2024-09-11T00:23:49.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.919+0000 7f0ddbcac740 10 client.16389 fetch_fsmap learned FSMap version 20 2024-09-11T00:23:49.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.919+0000 7f0ddbcac740 1 -- 172.21.15.78:0/2482913642 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557e975ef3e0 con 0x557e9756e950 2024-09-11T00:23:49.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.919+0000 7f0db2ffd640 1 -- 172.21.15.78:0/2482913642 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557e974d6850 con 0x557e9756e950 2024-09-11T00:23:49.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.919+0000 7f0db2ffd640 1 -- 172.21.15.78:0/2482913642 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f0dc4003630 con 0x557e9756e950 2024-09-11T00:23:49.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.919+0000 7f0ddbcac740 10 client.16389 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:23:49.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.919+0000 7f0ddbcac740 10 client.16389 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:23:49.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.919+0000 7f0ddbcac740 20 client.16389 populate_metadata read hostname 'smithi078' 2024-09-11T00:23:49.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.919+0000 7f0ddbcac740 1 --2- 172.21.15.78:0/2482913642 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557e975efb90 0x557e975f1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:23:49.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.919+0000 7f0ddbcac740 4 client.16389 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:23:49.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.919+0000 7f0ddbcac740 1 -- 172.21.15.78:0/2482913642 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557e974d3c80 con 0x557e975efb90 2024-09-11T00:23:49.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.919+0000 7f0dd2ffd640 1 --2- 172.21.15.78:0/2482913642 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557e975efb90 0x557e975f1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:23:49.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.920+0000 7f0dd2ffd640 1 --2- 172.21.15.78:0/2482913642 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557e975efb90 0x557e975f1fb0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=113012569147e3c9 server_cookie=6068c8677cd84de8 in_seq=0 out_seq=0 2024-09-11T00:23:49.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.920+0000 7f0db2ffd640 10 client.16389 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:49.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.920+0000 7f0db2ffd640 1 -- 172.21.15.78:0/2482913642 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4546 (crc 0 0 0) 0x557e974d3c80 con 0x557e975efb90 2024-09-11T00:23:49.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.920+0000 7f0db2ffd640 10 client.16389 handle_command_reply: tid=0 2024-09-11T00:23:49.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.920+0000 7f0ddbcac740 1 client.16389 shutdown 2024-09-11T00:23:49.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.920+0000 7f0ddbcac740 1 -- 172.21.15.78:0/2482913642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e9756e950 msgr2=0x557e975e3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:49.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.920+0000 7f0ddbcac740 1 --2- 172.21.15.78:0/2482913642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e9756e950 0x557e975e3910 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4031440 tx=0x7f0dc40058d0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.920+0000 7f0ddbcac740 1 -- 172.21.15.78:0/2482913642 shutdown_connections 2024-09-11T00:23:49.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.920+0000 7f0ddbcac740 1 --2- 172.21.15.78:0/2482913642 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557e975efb90 0x557e975f1fb0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.920+0000 7f0ddbcac740 1 --2- 172.21.15.78:0/2482913642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557e9756e950 0x557e975e3910 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.920+0000 7f0ddbcac740 1 --2- 172.21.15.78:0/2482913642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557e975629c0 0x557e975e33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.920+0000 7f0ddbcac740 1 --2- 172.21.15.78:0/2482913642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557e975620a0 0x557e975e2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.920+0000 7f0ddbcac740 1 -- 172.21.15.78:0/2482913642 >> 172.21.15.78:0/2482913642 conn(0x557e9755fed0 msgr2=0x557e9756ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:49.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.920+0000 7f0db2ffd640 0 client.16389 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:23:49.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.920+0000 7f0ddbcac740 1 -- 172.21.15.78:0/2482913642 shutdown_connections 2024-09-11T00:23:49.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.920+0000 7f0ddbcac740 1 -- 172.21.15.78:0/2482913642 wait complete. 2024-09-11T00:23:49.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.921+0000 7f0ddbcac740 20 client.16389 trim_cache size 0 max 16384 2024-09-11T00:23:49.939 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:23:49.939 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:23:49.939 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-11T00:23:49.939 INFO:teuthology.orchestra.run.smithi078.stdout: "f6eb5d15-216e-4f8b-b451-2f71b931998f": { 2024-09-11T00:23:49.939 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:49.939 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "f6eb5d15-216e-4f8b-b451-2f71b931998f", 2024-09-11T00:23:49.939 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-11T00:23:49.939 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:23:49.939 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:49.939 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:23:49.939 INFO:teuthology.orchestra.run.smithi078.stdout: "f6eb5d15-216e-4f8b-b451-2f71b931998f": { 2024-09-11T00:23:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:48.289319+0000", 2024-09-11T00:23:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: "e21db329-a274-4cfd-924a-8ec929e04bd1": { 2024-09-11T00:23:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:41.131504+0000", 2024-09-11T00:23:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:49.940 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:49.941 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:49.941 INFO:teuthology.orchestra.run.smithi078.stdout: "b854cbd3-8ca7-4277-a205-8887d2ff5567": { 2024-09-11T00:23:49.941 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:11.182949+0000", 2024-09-11T00:23:49.941 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:49.941 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:49.941 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:49.941 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:49.941 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:49.941 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:49.941 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:23:49.941 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:23:49.942 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:49.942 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:49.942 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:49.942 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:49.942 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:49.942 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:49.942 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:23:49.942 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:23:49.942 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:49.942 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:49.942 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:49.942 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:49.942 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:49.942 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:49.943 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:23:49.943 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:23:49.943 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:49.943 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:49.943 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:49.943 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:49.943 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:49.943 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:49.943 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:23:49.943 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:23:49.943 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:49.943 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:49.943 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:49.943 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:49.944 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:49.944 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:49.944 INFO:teuthology.orchestra.run.smithi078.stdout: "81d31d3a-c224-4ded-9f00-1a7dfc099ec4": { 2024-09-11T00:23:49.944 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:16.296700+0000", 2024-09-11T00:23:49.944 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:49.944 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:49.944 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:49.944 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:49.944 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:49.944 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:49.944 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:23:49.944 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:23:49.944 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:49.945 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:49.945 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:49.945 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:49.945 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:49.945 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:49.945 INFO:teuthology.orchestra.run.smithi078.stdout: "38a1d30d-5f4c-460a-afcd-e6c60b97e43a": { 2024-09-11T00:23:49.945 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:58.127727+0000", 2024-09-11T00:23:49.945 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:49.945 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:49.945 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:49.945 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:49.946 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:49.946 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:49.946 INFO:teuthology.orchestra.run.smithi078.stdout: "8ec9e858-aa62-420d-a112-e62ea7810e63": { 2024-09-11T00:23:49.946 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:18.882749+0000", 2024-09-11T00:23:49.946 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:49.946 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:49.946 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:49.946 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:49.946 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:49.946 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:49.946 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:23:49.946 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:23:49.946 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:49.946 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:49.947 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:49.947 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:49.947 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:49.947 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:49.947 INFO:teuthology.orchestra.run.smithi078.stdout: "1b9391c2-08f3-479a-9538-deea28f7743b": { 2024-09-11T00:23:49.947 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:02.327508+0000", 2024-09-11T00:23:49.947 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:49.947 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:49.947 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:49.947 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:49.947 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:49.947 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:49.947 INFO:teuthology.orchestra.run.smithi078.stdout: "e0002672-e432-4890-ab9f-20c513c5e3b6": { 2024-09-11T00:23:49.947 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:21:37.161715+0000", 2024-09-11T00:23:49.948 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:49.948 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:49.948 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:49.948 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:49.948 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:49.948 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:23:49.948 INFO:teuthology.orchestra.run.smithi078.stdout: "f494d5ed-e0dc-44bb-8aba-a861b3e751f4": { 2024-09-11T00:23:49.948 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:55.251691+0000", 2024-09-11T00:23:49.948 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:23:49.948 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:23:49.948 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:23:49.948 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:23:49.948 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:23:49.948 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:23:49.949 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:23:49.949 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:23:49.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.921+0000 7f0dd98d7640 1 -- 172.21.15.78:0/3105537121 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f0dbc0b5450 msgr2=0x7f0dbc0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:49.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.921+0000 7f0dd98d7640 1 --2- 172.21.15.78:0/3105537121 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f0dbc0b5450 0x7f0dbc0b7910 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4006010 tx=0x7f0dc4009260 comp rx=0 tx=0).stop 2024-09-11T00:23:49.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.921+0000 7f0dd98d7640 1 -- 172.21.15.78:0/3105537121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd4103cd0 msgr2=0x7f0dd4199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:23:49.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.921+0000 7f0dd98d7640 1 --2- 172.21.15.78:0/3105537121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd4103cd0 0x7f0dd4199290 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00c890 tx=0x7f0dcc00cd50 comp rx=0 tx=0).stop 2024-09-11T00:23:49.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.921+0000 7f0dd98d7640 1 -- 172.21.15.78:0/3105537121 shutdown_connections 2024-09-11T00:23:49.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.921+0000 7f0dd98d7640 1 --2- 172.21.15.78:0/3105537121 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f0dbc0b5450 0x7f0dbc0b7910 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.921+0000 7f0dd98d7640 1 --2- 172.21.15.78:0/3105537121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dd410d130 0x7f0dd419eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.921+0000 7f0dd98d7640 1 --2- 172.21.15.78:0/3105537121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0dd41045f0 0x7f0dd41997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.921+0000 7f0dd98d7640 1 --2- 172.21.15.78:0/3105537121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd4103cd0 0x7f0dd4199290 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:23:49.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.921+0000 7f0dd98d7640 1 -- 172.21.15.78:0/3105537121 >> 172.21.15.78:0/3105537121 conn(0x7f0dd40fd750 msgr2=0x7f0dd40fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:23:49.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.921+0000 7f0dd98d7640 1 -- 172.21.15.78:0/3105537121 shutdown_connections 2024-09-11T00:23:49.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:23:49.921+0000 7f0dd98d7640 1 -- 172.21.15.78:0/3105537121 wait complete. 2024-09-11T00:23:50.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:50 smithi112 ceph-mon[35627]: pgmap v546: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:23:50.732 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:50 smithi078 ceph-mon[30865]: pgmap v546: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:23:50.761 INFO:tasks.cephfs.filesystem:scrub status for tag:f6eb5d15-216e-4f8b-b451-2f71b931998f - {'path': '/', 'tag': 'f6eb5d15-216e-4f8b-b451-2f71b931998f', 'options': 'recursive,force'} 2024-09-11T00:23:50.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:50 smithi138 ceph-mon[35019]: pgmap v546: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:23:51.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:51 smithi112 ceph-mon[35627]: scrub summary: idle 2024-09-11T00:23:51.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:51 smithi138 ceph-mon[35019]: scrub summary: idle 2024-09-11T00:23:51.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:51 smithi078 ceph-mon[30865]: scrub summary: idle 2024-09-11T00:23:52.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:52 smithi112 ceph-mon[35627]: pgmap v547: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-11T00:23:52.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:52 smithi138 ceph-mon[35019]: pgmap v547: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-11T00:23:52.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:52 smithi078 ceph-mon[30865]: pgmap v547: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-11T00:23:54.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:53 smithi112 ceph-mon[35627]: pgmap v548: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T00:23:54.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:53 smithi138 ceph-mon[35019]: pgmap v548: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T00:23:54.335 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:53 smithi078 ceph-mon[30865]: pgmap v548: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T00:23:56.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:55 smithi112 ceph-mon[35627]: pgmap v549: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-11T00:23:56.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:55 smithi138 ceph-mon[35019]: pgmap v549: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-11T00:23:56.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:55 smithi078 ceph-mon[30865]: pgmap v549: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-11T00:23:58.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:57 smithi112 ceph-mon[35627]: pgmap v550: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:23:58.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:57 smithi138 ceph-mon[35019]: pgmap v550: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:23:58.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:57 smithi078 ceph-mon[30865]: pgmap v550: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:24:00.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:23:59 smithi112 ceph-mon[35627]: pgmap v551: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:24:00.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:23:59 smithi138 ceph-mon[35019]: pgmap v551: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:24:00.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:23:59 smithi078 ceph-mon[30865]: pgmap v551: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:24:02.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:01 smithi112 ceph-mon[35627]: pgmap v552: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-11T00:24:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:01 smithi138 ceph-mon[35019]: pgmap v552: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-11T00:24:02.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:01 smithi078 ceph-mon[30865]: pgmap v552: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-11T00:24:04.154 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:03 smithi078 ceph-mon[30865]: pgmap v553: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-11T00:24:04.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:03 smithi112 ceph-mon[35627]: pgmap v553: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-11T00:24:04.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:03 smithi138 ceph-mon[35019]: pgmap v553: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-11T00:24:06.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:05 smithi112 ceph-mon[35627]: pgmap v554: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T00:24:06.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:05 smithi138 ceph-mon[35019]: pgmap v554: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T00:24:06.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:05 smithi078 ceph-mon[30865]: pgmap v554: 97 pgs: 97 active+clean; 1.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T00:24:08.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:07 smithi112 ceph-mon[35627]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T00:24:08.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:07 smithi112 ceph-mon[35627]: pgmap v556: 97 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 85 active+clean; 1.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T00:24:08.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:07 smithi138 ceph-mon[35019]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T00:24:08.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:07 smithi138 ceph-mon[35019]: pgmap v556: 97 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 85 active+clean; 1.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T00:24:08.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:07 smithi078 ceph-mon[30865]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T00:24:08.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:07 smithi078 ceph-mon[30865]: pgmap v556: 97 pgs: 4 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 85 active+clean; 1.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T00:24:10.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:09 smithi112 ceph-mon[35627]: pgmap v557: 97 pgs: 7 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 76 active+clean; 994 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T00:24:10.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:09 smithi138 ceph-mon[35019]: pgmap v557: 97 pgs: 7 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 76 active+clean; 994 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T00:24:10.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:09 smithi078 ceph-mon[30865]: pgmap v557: 97 pgs: 7 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 76 active+clean; 994 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T00:24:12.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:11 smithi112 ceph-mon[35627]: pgmap v558: 97 pgs: 7 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 76 active+clean; 502 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 28 KiB/s wr, 5 op/s 2024-09-11T00:24:12.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:11 smithi138 ceph-mon[35019]: pgmap v558: 97 pgs: 7 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 76 active+clean; 502 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 28 KiB/s wr, 5 op/s 2024-09-11T00:24:12.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:11 smithi078 ceph-mon[30865]: pgmap v558: 97 pgs: 7 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 76 active+clean; 502 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 28 KiB/s wr, 5 op/s 2024-09-11T00:24:14.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:13 smithi112 ceph-mon[35627]: pgmap v559: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-11T00:24:14.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:13 smithi138 ceph-mon[35019]: pgmap v559: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-11T00:24:14.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:13 smithi078 ceph-mon[30865]: pgmap v559: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-11T00:24:16.934 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:16 smithi112 ceph-mon[35627]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T00:24:16.935 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:16 smithi112 ceph-mon[35627]: pgmap v561: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 229 B/s wr, 2 op/s 2024-09-11T00:24:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:16 smithi138 ceph-mon[35019]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T00:24:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:16 smithi138 ceph-mon[35019]: pgmap v561: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 229 B/s wr, 2 op/s 2024-09-11T00:24:17.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:16 smithi078 ceph-mon[30865]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T00:24:17.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:16 smithi078 ceph-mon[30865]: pgmap v561: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 229 B/s wr, 2 op/s 2024-09-11T00:24:18.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:17 smithi112 ceph-mon[35627]: pgmap v562: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T00:24:18.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:17 smithi138 ceph-mon[35019]: pgmap v562: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T00:24:18.337 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:17 smithi078 ceph-mon[30865]: pgmap v562: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T00:24:20.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:19 smithi112 ceph-mon[35627]: pgmap v563: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T00:24:20.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:19 smithi138 ceph-mon[35019]: pgmap v563: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T00:24:20.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:19 smithi078 ceph-mon[30865]: pgmap v563: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T00:24:20.762 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:24:21.025 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:24:21.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.623+0000 7f1e575ad640 1 -- 172.21.15.78:0/1647664937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e50104600 msgr2=0x7f1e5010caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:21.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.623+0000 7f1e575ad640 1 --2- 172.21.15.78:0/1647664937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e50104600 0x7f1e5010caf0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c009900 tx=0x7f1e4c02a410 comp rx=0 tx=0).stop 2024-09-11T00:24:21.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.623+0000 7f1e575ad640 1 -- 172.21.15.78:0/1647664937 shutdown_connections 2024-09-11T00:24:21.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.623+0000 7f1e575ad640 1 --2- 172.21.15.78:0/1647664937 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e5010d140 0x7f1e5010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.623+0000 7f1e575ad640 1 --2- 172.21.15.78:0/1647664937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e50104600 0x7f1e5010caf0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.623+0000 7f1e575ad640 1 --2- 172.21.15.78:0/1647664937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e50103ce0 0x7f1e501040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.623+0000 7f1e575ad640 1 -- 172.21.15.78:0/1647664937 >> 172.21.15.78:0/1647664937 conn(0x7f1e500fd700 msgr2=0x7f1e500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:21.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.623+0000 7f1e575ad640 1 -- 172.21.15.78:0/1647664937 shutdown_connections 2024-09-11T00:24:21.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.623+0000 7f1e575ad640 1 -- 172.21.15.78:0/1647664937 wait complete. 2024-09-11T00:24:21.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.624+0000 7f1e575ad640 1 Processor -- start 2024-09-11T00:24:21.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.624+0000 7f1e575ad640 1 -- start start 2024-09-11T00:24:21.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.624+0000 7f1e575ad640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e50103ce0 0x7f1e50199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.624+0000 7f1e575ad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e50104600 0x7f1e50199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.624+0000 7f1e575ad640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e5010d140 0x7f1e5019ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.624+0000 7f1e575ad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1e50112e10 con 0x7f1e50104600 2024-09-11T00:24:21.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.624+0000 7f1e575ad640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1e50112c90 con 0x7f1e50103ce0 2024-09-11T00:24:21.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.624+0000 7f1e575ad640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1e50112f90 con 0x7f1e5010d140 2024-09-11T00:24:21.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.624+0000 7f1e54b48640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e50104600 0x7f1e50199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.624+0000 7f1e54b48640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e50104600 0x7f1e50199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54718/0 (socket says 172.21.15.78:54718) 2024-09-11T00:24:21.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.624+0000 7f1e54b48640 1 -- 172.21.15.78:0/2271419639 learned_addr learned my addr 172.21.15.78:0/2271419639 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:24:21.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.624+0000 7f1e55b4a640 1 --2- 172.21.15.78:0/2271419639 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e5010d140 0x7f1e5019ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.624+0000 7f1e55349640 1 --2- 172.21.15.78:0/2271419639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e50103ce0 0x7f1e50199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.624+0000 7f1e54b48640 1 -- 172.21.15.78:0/2271419639 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e5010d140 msgr2=0x7f1e5019ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:21.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.624+0000 7f1e54b48640 1 --2- 172.21.15.78:0/2271419639 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e5010d140 0x7f1e5019ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.624+0000 7f1e54b48640 1 -- 172.21.15.78:0/2271419639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e50103ce0 msgr2=0x7f1e50199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:21.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.624+0000 7f1e54b48640 1 --2- 172.21.15.78:0/2271419639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e50103ce0 0x7f1e50199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.624+0000 7f1e54b48640 1 -- 172.21.15.78:0/2271419639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e5019f3f0 con 0x7f1e50104600 2024-09-11T00:24:21.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.624+0000 7f1e55349640 1 --2- 172.21.15.78:0/2271419639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e50103ce0 0x7f1e50199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:21.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.625+0000 7f1e54b48640 1 --2- 172.21.15.78:0/2271419639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e50104600 0x7f1e50199880 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c006010 tx=0x7f1e4c004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:21.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.625+0000 7f1e427fc640 1 -- 172.21.15.78:0/2271419639 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c03f030 con 0x7f1e50104600 2024-09-11T00:24:21.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.625+0000 7f1e575ad640 1 -- 172.21.15.78:0/2271419639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e5019f680 con 0x7f1e50104600 2024-09-11T00:24:21.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.625+0000 7f1e427fc640 1 -- 172.21.15.78:0/2271419639 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e4c003aa0 con 0x7f1e50104600 2024-09-11T00:24:21.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.625+0000 7f1e427fc640 1 -- 172.21.15.78:0/2271419639 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c035070 con 0x7f1e50104600 2024-09-11T00:24:21.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.625+0000 7f1e575ad640 1 -- 172.21.15.78:0/2271419639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e501a5da0 con 0x7f1e50104600 2024-09-11T00:24:21.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.628+0000 7f1e59982740 1 Processor -- start 2024-09-11T00:24:21.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.628+0000 7f1e427fc640 1 -- 172.21.15.78:0/2271419639 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f1e4c0035f0 con 0x7f1e50104600 2024-09-11T00:24:21.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.628+0000 7f1e59982740 1 -- start start 2024-09-11T00:24:21.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.628+0000 7f1e59982740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558990522480 0x558990522860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.628+0000 7f1e59982740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558990522da0 0x55899052e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.628+0000 7f1e59982740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55899052ed30 0x558990531120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.628+0000 7f1e59982740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x558990498e50 con 0x558990522da0 2024-09-11T00:24:21.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.628+0000 7f1e59982740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558990488280 con 0x55899052ed30 2024-09-11T00:24:21.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.628+0000 7f1e59982740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55899048c090 con 0x558990522480 2024-09-11T00:24:21.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.628+0000 7f1e55349640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558990522da0 0x55899052e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.628+0000 7f1e55349640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558990522da0 0x55899052e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54726/0 (socket says 172.21.15.78:54726) 2024-09-11T00:24:21.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.628+0000 7f1e55349640 1 -- 172.21.15.78:0/2553262884 learned_addr learned my addr 172.21.15.78:0/2553262884 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:24:21.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.628+0000 7f1e55b4a640 1 --2- 172.21.15.78:0/2553262884 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558990522480 0x558990522860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.628+0000 7f1e54b48640 1 --2- 172.21.15.78:0/2553262884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55899052ed30 0x558990531120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.628+0000 7f1e55349640 1 -- 172.21.15.78:0/2553262884 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558990522480 msgr2=0x558990522860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:21.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.628+0000 7f1e55349640 1 --2- 172.21.15.78:0/2553262884 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558990522480 0x558990522860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.628+0000 7f1e55349640 1 -- 172.21.15.78:0/2553262884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55899052ed30 msgr2=0x558990531120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:21.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.628+0000 7f1e55349640 1 --2- 172.21.15.78:0/2553262884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55899052ed30 0x558990531120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.628+0000 7f1e55349640 1 -- 172.21.15.78:0/2553262884 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589901e6650 con 0x558990522da0 2024-09-11T00:24:21.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.628+0000 7f1e427fc640 1 --2- 172.21.15.78:0/2271419639 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1e3c0b5450 0x7f1e3c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.629+0000 7f1e55349640 1 --2- 172.21.15.78:0/2553262884 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558990522da0 0x55899052e7f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400aa10 tx=0x7f1e4400aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f9d2bcf110697c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:21.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.629+0000 7f1e55b4a640 1 --2- 172.21.15.78:0/2271419639 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1e3c0b5450 0x7f1e3c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.664 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:24:21.665 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-11T00:24:21.665 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {}, 2024-09-11T00:24:21.665 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:24:21.665 INFO:teuthology.orchestra.run.smithi078.stdout: "f6eb5d15-216e-4f8b-b451-2f71b931998f": { 2024-09-11T00:24:21.665 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:48.289319+0000", 2024-09-11T00:24:21.665 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:21.665 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:21.665 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:21.665 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:21.665 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:21.665 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:21.665 INFO:teuthology.orchestra.run.smithi078.stdout: "e21db329-a274-4cfd-924a-8ec929e04bd1": { 2024-09-11T00:24:21.666 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:41.131504+0000", 2024-09-11T00:24:21.666 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:21.666 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:21.666 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:21.666 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:21.666 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:21.666 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:21.666 INFO:teuthology.orchestra.run.smithi078.stdout: "b854cbd3-8ca7-4277-a205-8887d2ff5567": { 2024-09-11T00:24:21.666 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:11.182949+0000", 2024-09-11T00:24:21.666 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:21.666 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:21.666 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:21.667 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:21.667 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:21.667 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:21.667 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:24:21.667 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:24:21.667 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:21.667 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:21.667 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:21.667 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:21.667 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:21.667 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:21.667 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:24:21.667 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:24:21.668 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:21.668 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:21.668 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:21.668 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:21.668 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:21.668 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:21.668 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:24:21.668 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:24:21.668 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:21.668 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:21.668 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:21.668 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:21.668 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:21.669 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:21.669 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:24:21.669 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:24:21.669 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:21.669 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:21.669 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:21.669 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:21.669 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:21.669 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:21.669 INFO:teuthology.orchestra.run.smithi078.stdout: "81d31d3a-c224-4ded-9f00-1a7dfc099ec4": { 2024-09-11T00:24:21.669 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:16.296700+0000", 2024-09-11T00:24:21.669 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:21.669 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:21.670 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:21.670 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:21.670 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:21.670 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:21.670 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:24:21.670 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:24:21.670 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:21.670 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:21.670 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:21.670 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:21.670 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:21.670 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:21.671 INFO:teuthology.orchestra.run.smithi078.stdout: "38a1d30d-5f4c-460a-afcd-e6c60b97e43a": { 2024-09-11T00:24:21.671 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:58.127727+0000", 2024-09-11T00:24:21.671 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:21.671 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:21.671 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:21.671 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:21.671 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:21.671 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:21.671 INFO:teuthology.orchestra.run.smithi078.stdout: "8ec9e858-aa62-420d-a112-e62ea7810e63": { 2024-09-11T00:24:21.671 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:18.882749+0000", 2024-09-11T00:24:21.671 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:21.671 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:21.672 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:21.672 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:21.672 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:21.672 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:21.672 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:24:21.672 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:24:21.672 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:21.672 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:21.672 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:21.672 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:21.672 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:21.672 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:21.672 INFO:teuthology.orchestra.run.smithi078.stdout: "1b9391c2-08f3-479a-9538-deea28f7743b": { 2024-09-11T00:24:21.673 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:02.327508+0000", 2024-09-11T00:24:21.673 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:21.673 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:21.673 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:21.673 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:21.673 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:21.673 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:21.673 INFO:teuthology.orchestra.run.smithi078.stdout: "e0002672-e432-4890-ab9f-20c513c5e3b6": { 2024-09-11T00:24:21.673 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:21:37.161715+0000", 2024-09-11T00:24:21.673 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:21.673 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:21.673 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:21.674 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:21.674 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:21.674 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:21.674 INFO:teuthology.orchestra.run.smithi078.stdout: "f494d5ed-e0dc-44bb-8aba-a861b3e751f4": { 2024-09-11T00:24:21.674 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:55.251691+0000", 2024-09-11T00:24:21.674 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:21.674 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:21.674 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:21.674 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:21.674 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:21.674 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:24:21.675 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:24:21.675 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:24:21.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.629+0000 7f1e427fc640 1 -- 172.21.15.78:0/2271419639 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7f1e4c106810 con 0x7f1e50104600 2024-09-11T00:24:21.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.629+0000 7f1e3b7fe640 1 -- 172.21.15.78:0/2553262884 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e44015070 con 0x558990522da0 2024-09-11T00:24:21.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.629+0000 7f1e3b7fe640 1 -- 172.21.15.78:0/2553262884 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e4400cc60 con 0x558990522da0 2024-09-11T00:24:21.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.629+0000 7f1e3b7fe640 1 -- 172.21.15.78:0/2553262884 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e440185c0 con 0x558990522da0 2024-09-11T00:24:21.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.630+0000 7f1e59982740 1 -- 172.21.15.78:0/2553262884 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558990522da0 msgr2=0x55899052e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:21.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.630+0000 7f1e55b4a640 1 --2- 172.21.15.78:0/2271419639 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1e3c0b5450 0x7f1e3c0b7910 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1e48005fd0 tx=0x7f1e48009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:21.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.630+0000 7f1e59982740 1 --2- 172.21.15.78:0/2553262884 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558990522da0 0x55899052e7f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400aa10 tx=0x7f1e4400aed0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.630+0000 7f1e59982740 1 -- 172.21.15.78:0/2553262884 shutdown_connections 2024-09-11T00:24:21.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.630+0000 7f1e59982740 1 --2- 172.21.15.78:0/2553262884 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55899052ed30 0x558990531120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.630+0000 7f1e59982740 1 --2- 172.21.15.78:0/2553262884 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558990522da0 0x55899052e7f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.630+0000 7f1e59982740 1 --2- 172.21.15.78:0/2553262884 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558990522480 0x558990522860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.630+0000 7f1e59982740 1 -- 172.21.15.78:0/2553262884 >> 172.21.15.78:0/2553262884 conn(0x5589905202b0 msgr2=0x558990521450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:21.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.630+0000 7f1e59982740 1 -- 172.21.15.78:0/2553262884 shutdown_connections 2024-09-11T00:24:21.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.630+0000 7f1e59982740 1 -- 172.21.15.78:0/2553262884 wait complete. 2024-09-11T00:24:21.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.630+0000 7f1e59982740 1 -- start start 2024-09-11T00:24:21.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.630+0000 7f1e59982740 1 Processor -- start 2024-09-11T00:24:21.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.630+0000 7f1e59982740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558990522480 0x55899052e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e59982740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558990522da0 0x55899052ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e59982740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55899052ed30 0x55899052bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e59982740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5589902e9700 con 0x558990522480 2024-09-11T00:24:21.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e59982740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558990423110 con 0x55899052ed30 2024-09-11T00:24:21.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e59982740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5589905319b0 con 0x558990522da0 2024-09-11T00:24:21.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e59982740 10 client.0 _ll_register_callbacks cb 0x55899043c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:24:21.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e55349640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558990522480 0x55899052e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e55349640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558990522480 0x55899052e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54730/0 (socket says 172.21.15.78:54730) 2024-09-11T00:24:21.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e55349640 1 -- 172.21.15.78:0/3917445026 learned_addr learned my addr 172.21.15.78:0/3917445026 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:24:21.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e55b4a640 1 --2- 172.21.15.78:0/3917445026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55899052ed30 0x55899052bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e54b48640 1 --2- 172.21.15.78:0/3917445026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558990522da0 0x55899052ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e55349640 1 -- 172.21.15.78:0/3917445026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558990522da0 msgr2=0x55899052ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:21.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e55349640 1 --2- 172.21.15.78:0/3917445026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558990522da0 0x55899052ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e55349640 1 -- 172.21.15.78:0/3917445026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55899052ed30 msgr2=0x55899052bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:21.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e55349640 1 --2- 172.21.15.78:0/3917445026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55899052ed30 0x55899052bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e55349640 1 -- 172.21.15.78:0/3917445026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558990450c40 con 0x558990522480 2024-09-11T00:24:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e55b4a640 1 --2- 172.21.15.78:0/3917445026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55899052ed30 0x55899052bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e55349640 1 --2- 172.21.15.78:0/3917445026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558990522480 0x55899052e5d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1e44008010 tx=0x7f1e44011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e765d3effeee42b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:24:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e38ff9640 1 -- 172.21.15.78:0/3917445026 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e44020070 con 0x558990522480 2024-09-11T00:24:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e38ff9640 1 -- 172.21.15.78:0/3917445026 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7f1e4401a450 con 0x558990522480 2024-09-11T00:24:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e59982740 1 -- 172.21.15.78:0/3917445026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e4400cc60 con 0x558990522480 2024-09-11T00:24:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e38ff9640 1 -- 172.21.15.78:0/3917445026 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1e44015040 con 0x558990522480 2024-09-11T00:24:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e59982740 10 client.16401 fetch_fsmap learned FSMap version 20 2024-09-11T00:24:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.631+0000 7f1e59982740 1 -- 172.21.15.78:0/3917445026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55899053d2d0 con 0x558990522480 2024-09-11T00:24:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.632+0000 7f1e38ff9640 1 -- 172.21.15.78:0/3917445026 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e4400cc60 con 0x558990522480 2024-09-11T00:24:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.632+0000 7f1e38ff9640 1 -- 172.21.15.78:0/3917445026 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1e4402c6f0 con 0x558990522480 2024-09-11T00:24:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.632+0000 7f1e59982740 10 client.16401 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:24:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.632+0000 7f1e59982740 10 client.16401 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:24:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.632+0000 7f1e59982740 20 client.16401 populate_metadata read hostname 'smithi078' 2024-09-11T00:24:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.632+0000 7f1e59982740 1 --2- 172.21.15.78:0/3917445026 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55899053e6d0 0x558990540ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.632+0000 7f1e59982740 4 client.16401 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:24:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.632+0000 7f1e59982740 1 -- 172.21.15.78:0/3917445026 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55899049ada0 con 0x55899053e6d0 2024-09-11T00:24:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.632+0000 7f1e54b48640 1 --2- 172.21.15.78:0/3917445026 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55899053e6d0 0x558990540ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.633+0000 7f1e38ff9640 10 client.16401 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:24:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.633+0000 7f1e54b48640 1 --2- 172.21.15.78:0/3917445026 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55899053e6d0 0x558990540ac0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7238640fdfbd104 server_cookie=fbbc31b411d99008 in_seq=0 out_seq=0 2024-09-11T00:24:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.633+0000 7f1e38ff9640 1 -- 172.21.15.78:0/3917445026 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55899049ada0 con 0x55899053e6d0 2024-09-11T00:24:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.633+0000 7f1e38ff9640 10 client.16401 handle_command_reply: tid=0 2024-09-11T00:24:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.633+0000 7f1e59982740 1 client.16401 shutdown 2024-09-11T00:24:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.633+0000 7f1e59982740 1 -- 172.21.15.78:0/3917445026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558990522480 msgr2=0x55899052e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.633+0000 7f1e59982740 1 --2- 172.21.15.78:0/3917445026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558990522480 0x55899052e5d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1e44008010 tx=0x7f1e44011b00 comp rx=0 tx=0).stop 2024-09-11T00:24:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.634+0000 7f1e59982740 1 -- 172.21.15.78:0/3917445026 shutdown_connections 2024-09-11T00:24:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.634+0000 7f1e59982740 1 --2- 172.21.15.78:0/3917445026 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55899053e6d0 0x558990540ac0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.634+0000 7f1e59982740 1 --2- 172.21.15.78:0/3917445026 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55899052ed30 0x55899052bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.634+0000 7f1e59982740 1 --2- 172.21.15.78:0/3917445026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558990522da0 0x55899052ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.634+0000 7f1e38ff9640 0 client.16401 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:24:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.634+0000 7f1e59982740 1 --2- 172.21.15.78:0/3917445026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558990522480 0x55899052e5d0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.634+0000 7f1e59982740 1 -- 172.21.15.78:0/3917445026 >> 172.21.15.78:0/3917445026 conn(0x5589905202b0 msgr2=0x558990525e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.634+0000 7f1e59982740 1 -- 172.21.15.78:0/3917445026 shutdown_connections 2024-09-11T00:24:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.634+0000 7f1e59982740 1 -- 172.21.15.78:0/3917445026 wait complete. 2024-09-11T00:24:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.634+0000 7f1e59982740 20 client.16401 trim_cache size 0 max 16384 2024-09-11T00:24:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.651+0000 7f1e59982740 1 Processor -- start 2024-09-11T00:24:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.651+0000 7f1e59982740 1 -- start start 2024-09-11T00:24:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.651+0000 7f1e59982740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558990522480 0x55899053ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.651+0000 7f1e59982740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558990522da0 0x55899051b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.651+0000 7f1e59982740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55899052ed30 0x558990521350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.651+0000 7f1e59982740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1e501ac8c0 con 0x55899052ed30 2024-09-11T00:24:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.651+0000 7f1e59982740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1e501af120 con 0x558990522480 2024-09-11T00:24:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.651+0000 7f1e59982740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1e501acf10 con 0x558990522da0 2024-09-11T00:24:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.651+0000 7f1e55b4a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55899052ed30 0x558990521350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.651+0000 7f1e55b4a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55899052ed30 0x558990521350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54740/0 (socket says 172.21.15.78:54740) 2024-09-11T00:24:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.651+0000 7f1e55b4a640 1 -- 172.21.15.78:0/63649344 learned_addr learned my addr 172.21.15.78:0/63649344 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:24:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.651+0000 7f1e54b48640 1 --2- 172.21.15.78:0/63649344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558990522da0 0x55899051b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.651+0000 7f1e55349640 1 --2- 172.21.15.78:0/63649344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558990522480 0x55899053ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.651+0000 7f1e55b4a640 1 -- 172.21.15.78:0/63649344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558990522da0 msgr2=0x55899051b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.651+0000 7f1e55b4a640 1 --2- 172.21.15.78:0/63649344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558990522da0 0x55899051b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.651+0000 7f1e55b4a640 1 -- 172.21.15.78:0/63649344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558990522480 msgr2=0x55899053ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.651+0000 7f1e55b4a640 1 --2- 172.21.15.78:0/63649344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558990522480 0x55899053ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.652+0000 7f1e55b4a640 1 -- 172.21.15.78:0/63649344 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55899052e200 con 0x55899052ed30 2024-09-11T00:24:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.652+0000 7f1e55b4a640 1 --2- 172.21.15.78:0/63649344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55899052ed30 0x558990521350 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1e48011820 tx=0x7f1e48016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e084646aa76559 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.652+0000 7f1e3affd640 1 -- 172.21.15.78:0/63649344 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e48004d20 con 0x55899052ed30 2024-09-11T00:24:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.652+0000 7f1e3affd640 1 -- 172.21.15.78:0/63649344 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e48021a60 con 0x55899052ed30 2024-09-11T00:24:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.652+0000 7f1e3affd640 1 -- 172.21.15.78:0/63649344 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e48005730 con 0x55899052ed30 2024-09-11T00:24:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.652+0000 7f1e59982740 1 -- 172.21.15.78:0/63649344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55899052ed30 msgr2=0x558990521350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.652+0000 7f1e59982740 1 --2- 172.21.15.78:0/63649344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55899052ed30 0x558990521350 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1e48011820 tx=0x7f1e48016000 comp rx=0 tx=0).stop 2024-09-11T00:24:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.652+0000 7f1e59982740 1 -- 172.21.15.78:0/63649344 shutdown_connections 2024-09-11T00:24:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.652+0000 7f1e59982740 1 --2- 172.21.15.78:0/63649344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55899052ed30 0x558990521350 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.652+0000 7f1e59982740 1 --2- 172.21.15.78:0/63649344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558990522da0 0x55899051b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.652+0000 7f1e59982740 1 --2- 172.21.15.78:0/63649344 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558990522480 0x55899053ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.652+0000 7f1e59982740 1 -- 172.21.15.78:0/63649344 >> 172.21.15.78:0/63649344 conn(0x5589905202b0 msgr2=0x55899052a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:21.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.652+0000 7f1e59982740 1 -- 172.21.15.78:0/63649344 shutdown_connections 2024-09-11T00:24:21.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.652+0000 7f1e59982740 1 -- 172.21.15.78:0/63649344 wait complete. 2024-09-11T00:24:21.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.653+0000 7f1e59982740 1 -- start start 2024-09-11T00:24:21.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.653+0000 7f1e59982740 1 Processor -- start 2024-09-11T00:24:21.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.653+0000 7f1e59982740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558990522480 0x558990532df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.653+0000 7f1e59982740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558990522da0 0x558990533330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.653+0000 7f1e59982740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55899052ed30 0x558990533870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.653+0000 7f1e59982740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1e501ad5e0 con 0x558990522da0 2024-09-11T00:24:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.653+0000 7f1e59982740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1e501aea50 con 0x55899052ed30 2024-09-11T00:24:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.653+0000 7f1e59982740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1e501adcb0 con 0x558990522480 2024-09-11T00:24:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.653+0000 7f1e59982740 10 client.0 _ll_register_callbacks cb 0x7f1e48009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:24:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.653+0000 7f1e54b48640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558990522da0 0x558990533330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.653+0000 7f1e54b48640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558990522da0 0x558990533330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54742/0 (socket says 172.21.15.78:54742) 2024-09-11T00:24:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.653+0000 7f1e54b48640 1 -- 172.21.15.78:0/1518776687 learned_addr learned my addr 172.21.15.78:0/1518776687 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:24:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.653+0000 7f1e55349640 1 --2- 172.21.15.78:0/1518776687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558990522480 0x558990532df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.654+0000 7f1e55b4a640 1 --2- 172.21.15.78:0/1518776687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55899052ed30 0x558990533870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.654+0000 7f1e54b48640 1 -- 172.21.15.78:0/1518776687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558990522480 msgr2=0x558990532df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.654+0000 7f1e54b48640 1 --2- 172.21.15.78:0/1518776687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558990522480 0x558990532df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.654+0000 7f1e54b48640 1 -- 172.21.15.78:0/1518776687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55899052ed30 msgr2=0x558990533870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.654+0000 7f1e54b48640 1 --2- 172.21.15.78:0/1518776687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55899052ed30 0x558990533870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.654+0000 7f1e54b48640 1 -- 172.21.15.78:0/1518776687 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589905aa560 con 0x558990522da0 2024-09-11T00:24:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.654+0000 7f1e55b4a640 1 --2- 172.21.15.78:0/1518776687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55899052ed30 0x558990533870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.654+0000 7f1e54b48640 1 --2- 172.21.15.78:0/1518776687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558990522da0 0x558990533330 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c004650 tx=0x7f1e4c003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8c600e73bb91b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.654+0000 7f1e38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:24:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.654+0000 7f1e38ff9640 1 -- 172.21.15.78:0/1518776687 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c049040 con 0x558990522da0 2024-09-11T00:24:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.654+0000 7f1e38ff9640 1 -- 172.21.15.78:0/1518776687 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7f1e4c104170 con 0x558990522da0 2024-09-11T00:24:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.654+0000 7f1e59982740 1 -- 172.21.15.78:0/1518776687 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e48021a60 con 0x558990522da0 2024-09-11T00:24:21.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.654+0000 7f1e38ff9640 1 -- 172.21.15.78:0/1518776687 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1e4c104370 con 0x558990522da0 2024-09-11T00:24:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.654+0000 7f1e59982740 10 client.16407 fetch_fsmap learned FSMap version 20 2024-09-11T00:24:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.654+0000 7f1e59982740 1 -- 172.21.15.78:0/1518776687 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5589905ab860 con 0x558990522da0 2024-09-11T00:24:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.654+0000 7f1e38ff9640 1 -- 172.21.15.78:0/1518776687 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e48021a60 con 0x558990522da0 2024-09-11T00:24:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.654+0000 7f1e38ff9640 1 -- 172.21.15.78:0/1518776687 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f1e4c0ccde0 con 0x558990522da0 2024-09-11T00:24:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.655+0000 7f1e59982740 10 client.16407 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:24:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.655+0000 7f1e59982740 10 client.16407 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:24:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.655+0000 7f1e59982740 20 client.16407 populate_metadata read hostname 'smithi078' 2024-09-11T00:24:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.655+0000 7f1e59982740 1 --2- 172.21.15.78:0/1518776687 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5589905abfe0 0x5589905ae400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.655+0000 7f1e59982740 4 client.16407 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:24:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.655+0000 7f1e59982740 1 -- 172.21.15.78:0/1518776687 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558990496850 con 0x5589905abfe0 2024-09-11T00:24:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.655+0000 7f1e55349640 1 --2- 172.21.15.78:0/1518776687 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5589905abfe0 0x5589905ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.655+0000 7f1e38ff9640 10 client.16407 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:24:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.655+0000 7f1e55349640 1 --2- 172.21.15.78:0/1518776687 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5589905abfe0 0x5589905ae400 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=768f443d9556f43 server_cookie=de1b7eeec5ea7267 in_seq=0 out_seq=0 2024-09-11T00:24:21.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.656+0000 7f1e38ff9640 1 -- 172.21.15.78:0/1518776687 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4350 (crc 0 0 0) 0x558990496850 con 0x5589905abfe0 2024-09-11T00:24:21.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.656+0000 7f1e38ff9640 10 client.16407 handle_command_reply: tid=0 2024-09-11T00:24:21.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.656+0000 7f1e59982740 1 client.16407 shutdown 2024-09-11T00:24:21.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.656+0000 7f1e59982740 1 -- 172.21.15.78:0/1518776687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558990522da0 msgr2=0x558990533330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:21.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.656+0000 7f1e59982740 1 --2- 172.21.15.78:0/1518776687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558990522da0 0x558990533330 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c004650 tx=0x7f1e4c003f50 comp rx=0 tx=0).stop 2024-09-11T00:24:21.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.656+0000 7f1e59982740 1 -- 172.21.15.78:0/1518776687 shutdown_connections 2024-09-11T00:24:21.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.656+0000 7f1e59982740 1 --2- 172.21.15.78:0/1518776687 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5589905abfe0 0x5589905ae400 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.656+0000 7f1e59982740 1 --2- 172.21.15.78:0/1518776687 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55899052ed30 0x558990533870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.656+0000 7f1e59982740 1 --2- 172.21.15.78:0/1518776687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558990522da0 0x558990533330 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.656+0000 7f1e38ff9640 0 client.16407 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:24:21.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.656+0000 7f1e59982740 1 --2- 172.21.15.78:0/1518776687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558990522480 0x558990532df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.656+0000 7f1e59982740 1 -- 172.21.15.78:0/1518776687 >> 172.21.15.78:0/1518776687 conn(0x5589905202b0 msgr2=0x558990521350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:21.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.656+0000 7f1e59982740 1 -- 172.21.15.78:0/1518776687 shutdown_connections 2024-09-11T00:24:21.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.656+0000 7f1e59982740 1 -- 172.21.15.78:0/1518776687 wait complete. 2024-09-11T00:24:21.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.656+0000 7f1e59982740 20 client.16407 trim_cache size 0 max 16384 2024-09-11T00:24:21.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.656+0000 7f1e575ad640 1 -- 172.21.15.78:0/2271419639 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1e3c0b5450 msgr2=0x7f1e3c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:21.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.656+0000 7f1e575ad640 1 --2- 172.21.15.78:0/2271419639 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1e3c0b5450 0x7f1e3c0b7910 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1e48005fd0 tx=0x7f1e48009600 comp rx=0 tx=0).stop 2024-09-11T00:24:21.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.657+0000 7f1e575ad640 1 -- 172.21.15.78:0/2271419639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e50104600 msgr2=0x7f1e50199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:21.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.657+0000 7f1e575ad640 1 --2- 172.21.15.78:0/2271419639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e50104600 0x7f1e50199880 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c006010 tx=0x7f1e4c004060 comp rx=0 tx=0).stop 2024-09-11T00:24:21.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.657+0000 7f1e575ad640 1 -- 172.21.15.78:0/2271419639 shutdown_connections 2024-09-11T00:24:21.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.657+0000 7f1e575ad640 1 --2- 172.21.15.78:0/2271419639 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1e3c0b5450 0x7f1e3c0b7910 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.657+0000 7f1e575ad640 1 --2- 172.21.15.78:0/2271419639 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1e5010d140 0x7f1e5019ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.657+0000 7f1e575ad640 1 --2- 172.21.15.78:0/2271419639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e50104600 0x7f1e50199880 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.657+0000 7f1e575ad640 1 --2- 172.21.15.78:0/2271419639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e50103ce0 0x7f1e50199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:21.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.657+0000 7f1e575ad640 1 -- 172.21.15.78:0/2271419639 >> 172.21.15.78:0/2271419639 conn(0x7f1e500fd700 msgr2=0x7f1e500fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:21.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.657+0000 7f1e575ad640 1 -- 172.21.15.78:0/2271419639 shutdown_connections 2024-09-11T00:24:21.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:21.657+0000 7f1e575ad640 1 -- 172.21.15.78:0/2271419639 wait complete. 2024-09-11T00:24:22.155 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:21 smithi078 ceph-mon[30865]: pgmap v564: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T00:24:22.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:21 smithi112 ceph-mon[35627]: pgmap v564: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T00:24:22.296 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:21 smithi138 ceph-mon[35019]: pgmap v564: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T00:24:22.485 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:24:22.486 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:24:22.747 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:24:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.264+0000 7fc4ee816640 1 -- 172.21.15.78:0/680730341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4e8108040 msgr2=0x7fc4e810e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.264+0000 7fc4ee816640 1 --2- 172.21.15.78:0/680730341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4e8108040 0x7fc4e810e840 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0009ca0 tx=0x7fc4e002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.264+0000 7fc4ee816640 1 -- 172.21.15.78:0/680730341 shutdown_connections 2024-09-11T00:24:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.264+0000 7fc4ee816640 1 --2- 172.21.15.78:0/680730341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4e8108040 0x7fc4e810e840 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.264+0000 7fc4ee816640 1 --2- 172.21.15.78:0/680730341 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4e81076c0 0x7fc4e8107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.264+0000 7fc4ee816640 1 --2- 172.21.15.78:0/680730341 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4e8101cb0 0x7fc4e8102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.264+0000 7fc4ee816640 1 -- 172.21.15.78:0/680730341 >> 172.21.15.78:0/680730341 conn(0x7fc4e80fd700 msgr2=0x7fc4e80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:23.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.264+0000 7fc4ee816640 1 -- 172.21.15.78:0/680730341 shutdown_connections 2024-09-11T00:24:23.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.264+0000 7fc4ee816640 1 -- 172.21.15.78:0/680730341 wait complete. 2024-09-11T00:24:23.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.265+0000 7fc4ee816640 1 Processor -- start 2024-09-11T00:24:23.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.265+0000 7fc4ee816640 1 -- start start 2024-09-11T00:24:23.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.265+0000 7fc4ee816640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4e8101cb0 0x7fc4e819a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:23.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.265+0000 7fc4ee816640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4e81076c0 0x7fc4e819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:23.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.265+0000 7fc4ee816640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4e8108040 0x7fc4e819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:23.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.265+0000 7fc4ee816640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e8111d50 con 0x7fc4e8108040 2024-09-11T00:24:23.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.265+0000 7fc4ee816640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e8111bd0 con 0x7fc4e81076c0 2024-09-11T00:24:23.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.265+0000 7fc4ee816640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e8111ed0 con 0x7fc4e8101cb0 2024-09-11T00:24:23.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.265+0000 7fc4ecdb3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4e8108040 0x7fc4e819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:23.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.265+0000 7fc4ecdb3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4e8108040 0x7fc4e819ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54752/0 (socket says 172.21.15.78:54752) 2024-09-11T00:24:23.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.265+0000 7fc4ecdb3640 1 -- 172.21.15.78:0/2326125557 learned_addr learned my addr 172.21.15.78:0/2326125557 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:24:23.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.265+0000 7fc4e7fff640 1 --2- 172.21.15.78:0/2326125557 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4e8101cb0 0x7fc4e819a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:23.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.265+0000 7fc4dffff640 1 --2- 172.21.15.78:0/2326125557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4e81076c0 0x7fc4e819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:23.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.265+0000 7fc4ecdb3640 1 -- 172.21.15.78:0/2326125557 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4e8101cb0 msgr2=0x7fc4e819a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:23.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.265+0000 7fc4ecdb3640 1 --2- 172.21.15.78:0/2326125557 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4e8101cb0 0x7fc4e819a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.265+0000 7fc4ecdb3640 1 -- 172.21.15.78:0/2326125557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4e81076c0 msgr2=0x7fc4e819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:23.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.265+0000 7fc4ecdb3640 1 --2- 172.21.15.78:0/2326125557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4e81076c0 0x7fc4e819a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.265+0000 7fc4ecdb3640 1 -- 172.21.15.78:0/2326125557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e81a54c0 con 0x7fc4e8108040 2024-09-11T00:24:23.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.265+0000 7fc4dffff640 1 --2- 172.21.15.78:0/2326125557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4e81076c0 0x7fc4e819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:23.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.265+0000 7fc4ecdb3640 1 --2- 172.21.15.78:0/2326125557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4e8108040 0x7fc4e819ab80 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0009430 tx=0x7fc4e00317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:23.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.265+0000 7fc4e5ffb640 1 -- 172.21.15.78:0/2326125557 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0003b70 con 0x7fc4e8108040 2024-09-11T00:24:23.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.266+0000 7fc4e5ffb640 1 -- 172.21.15.78:0/2326125557 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4e0003d10 con 0x7fc4e8108040 2024-09-11T00:24:23.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.266+0000 7fc4ee816640 1 -- 172.21.15.78:0/2326125557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e81a5750 con 0x7fc4e8108040 2024-09-11T00:24:23.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.266+0000 7fc4e5ffb640 1 -- 172.21.15.78:0/2326125557 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e002fa30 con 0x7fc4e8108040 2024-09-11T00:24:23.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.266+0000 7fc4ee816640 1 -- 172.21.15.78:0/2326125557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e81a5c90 con 0x7fc4e8108040 2024-09-11T00:24:23.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.267+0000 7fc4ee816640 1 -- 172.21.15.78:0/2326125557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4e8102090 con 0x7fc4e8108040 2024-09-11T00:24:23.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.268+0000 7fc4e5ffb640 1 -- 172.21.15.78:0/2326125557 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fc4e002fbd0 con 0x7fc4e8108040 2024-09-11T00:24:23.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.269+0000 7fc4e5ffb640 1 --2- 172.21.15.78:0/2326125557 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc4d40b5450 0x7fc4d40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:23.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.269+0000 7fc4e7fff640 1 --2- 172.21.15.78:0/2326125557 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc4d40b5450 0x7fc4d40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:23.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.269+0000 7fc4e5ffb640 1 -- 172.21.15.78:0/2326125557 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7fc4e01073a0 con 0x7fc4e8108040 2024-09-11T00:24:23.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.269+0000 7fc4e7fff640 1 --2- 172.21.15.78:0/2326125557 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc4d40b5450 0x7fc4d40b7910 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009b60 tx=0x7fc4d8005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:23.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.273+0000 7fc4e5ffb640 1 -- 172.21.15.78:0/2326125557 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc4e00cdf10 con 0x7fc4e8108040 2024-09-11T00:24:23.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.483+0000 7fc4ee816640 1 -- 172.21.15.78:0/2326125557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4e802e5c0 con 0x7fc4e8108040 2024-09-11T00:24:23.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.483+0000 7fc4e5ffb640 1 -- 172.21.15.78:0/2326125557 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7fc4e00cd810 con 0x7fc4e8108040 2024-09-11T00:24:23.485 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:24:23.485 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:24:23.486 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:24:23.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.486+0000 7fc4ee816640 1 -- 172.21.15.78:0/2326125557 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc4d40b5450 msgr2=0x7fc4d40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:23.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.486+0000 7fc4ee816640 1 --2- 172.21.15.78:0/2326125557 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc4d40b5450 0x7fc4d40b7910 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009b60 tx=0x7fc4d8005f90 comp rx=0 tx=0).stop 2024-09-11T00:24:23.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.486+0000 7fc4ee816640 1 -- 172.21.15.78:0/2326125557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4e8108040 msgr2=0x7fc4e819ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:23.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.486+0000 7fc4ee816640 1 --2- 172.21.15.78:0/2326125557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4e8108040 0x7fc4e819ab80 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0009430 tx=0x7fc4e00317c0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.486+0000 7fc4ee816640 1 -- 172.21.15.78:0/2326125557 shutdown_connections 2024-09-11T00:24:23.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.486+0000 7fc4ee816640 1 --2- 172.21.15.78:0/2326125557 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc4d40b5450 0x7fc4d40b7910 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.486+0000 7fc4ee816640 1 --2- 172.21.15.78:0/2326125557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4e8108040 0x7fc4e819ab80 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.486+0000 7fc4ee816640 1 --2- 172.21.15.78:0/2326125557 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc4e81076c0 0x7fc4e819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.486+0000 7fc4ee816640 1 --2- 172.21.15.78:0/2326125557 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4e8101cb0 0x7fc4e819a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:23.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.486+0000 7fc4ee816640 1 -- 172.21.15.78:0/2326125557 >> 172.21.15.78:0/2326125557 conn(0x7fc4e80fd700 msgr2=0x7fc4e80fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:23.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.486+0000 7fc4ee816640 1 -- 172.21.15.78:0/2326125557 shutdown_connections 2024-09-11T00:24:23.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:23.486+0000 7fc4ee816640 1 -- 172.21.15.78:0/2326125557 wait complete. 2024-09-11T00:24:23.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:23 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2326125557' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:24:23.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:23 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2326125557' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:24:23.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:23 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2326125557' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:24:24.183 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:24:24.430 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:24:24.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:24 smithi078 ceph-mon[30865]: pgmap v565: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T00:24:24.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.938+0000 7fe2e293c640 1 -- 172.21.15.78:0/561230191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2dc101cb0 msgr2=0x7fe2dc102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:24.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.938+0000 7fe2e293c640 1 --2- 172.21.15.78:0/561230191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2dc101cb0 0x7fe2dc102090 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009900 tx=0x7fe2cc02a410 comp rx=0 tx=0).stop 2024-09-11T00:24:24.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.938+0000 7fe2e293c640 1 -- 172.21.15.78:0/561230191 shutdown_connections 2024-09-11T00:24:24.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.938+0000 7fe2e293c640 1 --2- 172.21.15.78:0/561230191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2dc108040 0x7fe2dc10e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.938+0000 7fe2e293c640 1 --2- 172.21.15.78:0/561230191 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2dc1076c0 0x7fe2dc107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.938+0000 7fe2e293c640 1 --2- 172.21.15.78:0/561230191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2dc101cb0 0x7fe2dc102090 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.938+0000 7fe2e293c640 1 -- 172.21.15.78:0/561230191 >> 172.21.15.78:0/561230191 conn(0x7fe2dc0fd700 msgr2=0x7fe2dc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:24.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.938+0000 7fe2e293c640 1 -- 172.21.15.78:0/561230191 shutdown_connections 2024-09-11T00:24:24.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.938+0000 7fe2e293c640 1 -- 172.21.15.78:0/561230191 wait complete. 2024-09-11T00:24:24.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.939+0000 7fe2e293c640 1 Processor -- start 2024-09-11T00:24:24.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.939+0000 7fe2e293c640 1 -- start start 2024-09-11T00:24:24.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.939+0000 7fe2e293c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2dc101cb0 0x7fe2dc113fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.939+0000 7fe2e293c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2dc1076c0 0x7fe2dc112480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.939+0000 7fe2e293c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2dc108040 0x7fe2dc112ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.939+0000 7fe2e293c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc111d00 con 0x7fe2dc101cb0 2024-09-11T00:24:24.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.939+0000 7fe2e293c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc111b80 con 0x7fe2dc108040 2024-09-11T00:24:24.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.939+0000 7fe2e293c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc111e80 con 0x7fe2dc1076c0 2024-09-11T00:24:24.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.939+0000 7fe2dbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2dc101cb0 0x7fe2dc113fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.940+0000 7fe2dbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2dc101cb0 0x7fe2dc113fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60536/0 (socket says 172.21.15.78:60536) 2024-09-11T00:24:24.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.940+0000 7fe2dbfff640 1 -- 172.21.15.78:0/1064480033 learned_addr learned my addr 172.21.15.78:0/1064480033 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:24:24.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.940+0000 7fe2e0ed9640 1 --2- 172.21.15.78:0/1064480033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2dc108040 0x7fe2dc112ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.940+0000 7fe2db7fe640 1 --2- 172.21.15.78:0/1064480033 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2dc1076c0 0x7fe2dc112480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.940+0000 7fe2dbfff640 1 -- 172.21.15.78:0/1064480033 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2dc1076c0 msgr2=0x7fe2dc112480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:24.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.940+0000 7fe2dbfff640 1 --2- 172.21.15.78:0/1064480033 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2dc1076c0 0x7fe2dc112480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.940+0000 7fe2dbfff640 1 -- 172.21.15.78:0/1064480033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2dc108040 msgr2=0x7fe2dc112ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:24.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.940+0000 7fe2dbfff640 1 --2- 172.21.15.78:0/1064480033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2dc108040 0x7fe2dc112ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.940+0000 7fe2dbfff640 1 -- 172.21.15.78:0/1064480033 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2dc1a7820 con 0x7fe2dc101cb0 2024-09-11T00:24:24.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.940+0000 7fe2db7fe640 1 --2- 172.21.15.78:0/1064480033 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2dc1076c0 0x7fe2dc112480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:24.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.940+0000 7fe2dbfff640 1 --2- 172.21.15.78:0/1064480033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2dc101cb0 0x7fe2dc113fb0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc005940 tx=0x7fe2cc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:24.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.940+0000 7fe2d97fa640 1 -- 172.21.15.78:0/1064480033 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc03f030 con 0x7fe2dc101cb0 2024-09-11T00:24:24.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.940+0000 7fe2e293c640 1 -- 172.21.15.78:0/1064480033 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2dc1a79f0 con 0x7fe2dc101cb0 2024-09-11T00:24:24.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.940+0000 7fe2d97fa640 1 -- 172.21.15.78:0/1064480033 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2cc003cb0 con 0x7fe2dc101cb0 2024-09-11T00:24:24.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.940+0000 7fe2d97fa640 1 -- 172.21.15.78:0/1064480033 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc035070 con 0x7fe2dc101cb0 2024-09-11T00:24:24.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.940+0000 7fe2e293c640 1 -- 172.21.15.78:0/1064480033 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2dc1a7f70 con 0x7fe2dc101cb0 2024-09-11T00:24:24.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.943+0000 7fe2e4d11740 1 Processor -- start 2024-09-11T00:24:24.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.943+0000 7fe2d97fa640 1 -- 172.21.15.78:0/1064480033 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fe2cc03bb70 con 0x7fe2dc101cb0 2024-09-11T00:24:24.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.943+0000 7fe2e4d11740 1 -- start start 2024-09-11T00:24:24.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.943+0000 7fe2e4d11740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c3c972d0f0 0x55c3c972d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.943+0000 7fe2e4d11740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972da10 0x55c3c9739460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.943+0000 7fe2e4d11740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c97399a0 0x55c3c973bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.943+0000 7fe2e4d11740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55c3c96a3ea0 con 0x55c3c97399a0 2024-09-11T00:24:24.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.943+0000 7fe2e4d11740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c3c96932d0 con 0x55c3c972da10 2024-09-11T00:24:24.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.943+0000 7fe2e4d11740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55c3c96970e0 con 0x55c3c972d0f0 2024-09-11T00:24:24.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.943+0000 7fe2db7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c97399a0 0x55c3c973bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.943+0000 7fe2db7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c97399a0 0x55c3c973bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60542/0 (socket says 172.21.15.78:60542) 2024-09-11T00:24:24.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.943+0000 7fe2db7fe640 1 -- 172.21.15.78:0/1062352563 learned_addr learned my addr 172.21.15.78:0/1062352563 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:24:24.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.943+0000 7fe2dbfff640 1 --2- 172.21.15.78:0/1062352563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972da10 0x55c3c9739460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.943+0000 7fe2e0ed9640 1 --2- 172.21.15.78:0/1062352563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c3c972d0f0 0x55c3c972d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.944+0000 7fe2db7fe640 1 -- 172.21.15.78:0/1062352563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c3c972d0f0 msgr2=0x55c3c972d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:24.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.944+0000 7fe2db7fe640 1 --2- 172.21.15.78:0/1062352563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c3c972d0f0 0x55c3c972d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.944+0000 7fe2db7fe640 1 -- 172.21.15.78:0/1062352563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972da10 msgr2=0x55c3c9739460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:24.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.944+0000 7fe2db7fe640 1 --2- 172.21.15.78:0/1062352563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972da10 0x55c3c9739460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.944+0000 7fe2db7fe640 1 -- 172.21.15.78:0/1062352563 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3c93f1650 con 0x55c3c97399a0 2024-09-11T00:24:24.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.944+0000 7fe2d97fa640 1 --2- 172.21.15.78:0/1064480033 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe2c80b5450 0x7fe2c80b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.944+0000 7fe2dbfff640 1 --2- 172.21.15.78:0/1062352563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972da10 0x55c3c9739460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:24:24.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.944+0000 7fe2e0ed9640 1 --2- 172.21.15.78:0/1064480033 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe2c80b5450 0x7fe2c80b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.944+0000 7fe2db7fe640 1 --2- 172.21.15.78:0/1062352563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c97399a0 0x55c3c973bd90 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4007800 tx=0x7fe2c4007cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61c22bf29ed23e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:24.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.944+0000 7fe2d97fa640 1 -- 172.21.15.78:0/1064480033 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7fe2cc106b60 con 0x7fe2dc101cb0 2024-09-11T00:24:24.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.944+0000 7fe2d27fc640 1 -- 172.21.15.78:0/1062352563 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c400d950 con 0x55c3c97399a0 2024-09-11T00:24:24.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.944+0000 7fe2d27fc640 1 -- 172.21.15.78:0/1062352563 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2c4018070 con 0x55c3c97399a0 2024-09-11T00:24:24.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.944+0000 7fe2d27fc640 1 -- 172.21.15.78:0/1062352563 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4013e50 con 0x55c3c97399a0 2024-09-11T00:24:24.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.945+0000 7fe2e4d11740 1 -- 172.21.15.78:0/1062352563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c97399a0 msgr2=0x55c3c973bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:24.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.945+0000 7fe2e0ed9640 1 --2- 172.21.15.78:0/1064480033 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe2c80b5450 0x7fe2c80b7910 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4005fd0 tx=0x7fe2d4009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:24.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.945+0000 7fe2e4d11740 1 --2- 172.21.15.78:0/1062352563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c97399a0 0x55c3c973bd90 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4007800 tx=0x7fe2c4007cc0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.945+0000 7fe2e4d11740 1 -- 172.21.15.78:0/1062352563 shutdown_connections 2024-09-11T00:24:24.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.945+0000 7fe2e4d11740 1 --2- 172.21.15.78:0/1062352563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c97399a0 0x55c3c973bd90 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.945+0000 7fe2e4d11740 1 --2- 172.21.15.78:0/1062352563 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972da10 0x55c3c9739460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.945+0000 7fe2e4d11740 1 --2- 172.21.15.78:0/1062352563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c3c972d0f0 0x55c3c972d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.945+0000 7fe2e4d11740 1 -- 172.21.15.78:0/1062352563 >> 172.21.15.78:0/1062352563 conn(0x55c3c972af20 msgr2=0x55c3c972c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:24.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.945+0000 7fe2e4d11740 1 -- 172.21.15.78:0/1062352563 shutdown_connections 2024-09-11T00:24:24.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.945+0000 7fe2e4d11740 1 -- 172.21.15.78:0/1062352563 wait complete. 2024-09-11T00:24:24.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.945+0000 7fe2e4d11740 1 -- start start 2024-09-11T00:24:24.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.946+0000 7fe2e4d11740 1 Processor -- start 2024-09-11T00:24:24.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.946+0000 7fe2e4d11740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972d0f0 0x55c3c9739230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.946+0000 7fe2e4d11740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c3c972da10 0x55c3c9736680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.946+0000 7fe2e4d11740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c97399a0 0x55c3c9736c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.946+0000 7fe2e4d11740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55c3c94f4700 con 0x55c3c97399a0 2024-09-11T00:24:24.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.946+0000 7fe2e4d11740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55c3c962e160 con 0x55c3c972d0f0 2024-09-11T00:24:24.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.946+0000 7fe2e4d11740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55c3c973c620 con 0x55c3c972da10 2024-09-11T00:24:24.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.946+0000 7fe2e4d11740 10 client.0 _ll_register_callbacks cb 0x55c3c96479e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:24:24.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.946+0000 7fe2e0ed9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c97399a0 0x55c3c9736c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.946+0000 7fe2e0ed9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c97399a0 0x55c3c9736c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60548/0 (socket says 172.21.15.78:60548) 2024-09-11T00:24:24.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.946+0000 7fe2e0ed9640 1 -- 172.21.15.78:0/775450076 learned_addr learned my addr 172.21.15.78:0/775450076 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:24:24.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.946+0000 7fe2dbfff640 1 --2- 172.21.15.78:0/775450076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972d0f0 0x55c3c9739230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.946+0000 7fe2db7fe640 1 --2- 172.21.15.78:0/775450076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c3c972da10 0x55c3c9736680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.946+0000 7fe2e0ed9640 1 -- 172.21.15.78:0/775450076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c3c972da10 msgr2=0x55c3c9736680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:24.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.946+0000 7fe2e0ed9640 1 --2- 172.21.15.78:0/775450076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c3c972da10 0x55c3c9736680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.946+0000 7fe2e0ed9640 1 -- 172.21.15.78:0/775450076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972d0f0 msgr2=0x55c3c9739230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:24.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.946+0000 7fe2e0ed9640 1 --2- 172.21.15.78:0/775450076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972d0f0 0x55c3c9739230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.946+0000 7fe2e0ed9640 1 -- 172.21.15.78:0/775450076 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3c965bc90 con 0x55c3c97399a0 2024-09-11T00:24:24.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.946+0000 7fe2dbfff640 1 --2- 172.21.15.78:0/775450076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972d0f0 0x55c3c9739230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:24.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.946+0000 7fe2e0ed9640 1 --2- 172.21.15.78:0/775450076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c97399a0 0x55c3c9736c20 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4011d30 tx=0x7fe2d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac420fd719365708 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:24.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.946+0000 7fe2bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:24:24.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.947+0000 7fe2bb7fe640 1 -- 172.21.15.78:0/775450076 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4020620 con 0x55c3c97399a0 2024-09-11T00:24:24.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.947+0000 7fe2bb7fe640 1 -- 172.21.15.78:0/775450076 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7fe2d40207c0 con 0x55c3c97399a0 2024-09-11T00:24:24.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.947+0000 7fe2e4d11740 1 -- 172.21.15.78:0/775450076 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2c4018070 con 0x55c3c97399a0 2024-09-11T00:24:24.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.947+0000 7fe2bb7fe640 1 -- 172.21.15.78:0/775450076 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe2d40209c0 con 0x55c3c97399a0 2024-09-11T00:24:24.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.947+0000 7fe2e4d11740 10 client.16425 fetch_fsmap learned FSMap version 20 2024-09-11T00:24:24.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.947+0000 7fe2e4d11740 1 -- 172.21.15.78:0/775450076 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c3c9747f50 con 0x55c3c97399a0 2024-09-11T00:24:24.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.947+0000 7fe2bb7fe640 1 -- 172.21.15.78:0/775450076 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2c4018070 con 0x55c3c97399a0 2024-09-11T00:24:24.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.947+0000 7fe2bb7fe640 1 -- 172.21.15.78:0/775450076 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe2d400f040 con 0x55c3c97399a0 2024-09-11T00:24:24.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.947+0000 7fe2e4d11740 10 client.16425 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:24:24.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.947+0000 7fe2e4d11740 10 client.16425 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:24:24.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.947+0000 7fe2e4d11740 20 client.16425 populate_metadata read hostname 'smithi078' 2024-09-11T00:24:24.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.947+0000 7fe2e4d11740 1 --2- 172.21.15.78:0/775450076 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55c3c97494b0 0x55c3c974b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.947+0000 7fe2e4d11740 4 client.16425 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:24:24.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.947+0000 7fe2e4d11740 1 -- 172.21.15.78:0/775450076 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3c96a5df0 con 0x55c3c97494b0 2024-09-11T00:24:24.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.947+0000 7fe2dbfff640 1 --2- 172.21.15.78:0/775450076 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55c3c97494b0 0x55c3c974b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.948+0000 7fe2bb7fe640 10 client.16425 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:24:24.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.948+0000 7fe2dbfff640 1 --2- 172.21.15.78:0/775450076 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55c3c97494b0 0x55c3c974b910 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=144ce1f8b5dc1374 server_cookie=66d9e3463a4a35fa in_seq=0 out_seq=0 2024-09-11T00:24:24.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.949+0000 7fe2bb7fe640 1 -- 172.21.15.78:0/775450076 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c3c96a5df0 con 0x55c3c97494b0 2024-09-11T00:24:24.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.949+0000 7fe2bb7fe640 10 client.16425 handle_command_reply: tid=0 2024-09-11T00:24:24.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.949+0000 7fe2e4d11740 1 client.16425 shutdown 2024-09-11T00:24:24.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.949+0000 7fe2e4d11740 1 -- 172.21.15.78:0/775450076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c97399a0 msgr2=0x55c3c9736c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:24.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.949+0000 7fe2e4d11740 1 --2- 172.21.15.78:0/775450076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c97399a0 0x55c3c9736c20 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4011d30 tx=0x7fe2d4004a40 comp rx=0 tx=0).stop 2024-09-11T00:24:24.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.949+0000 7fe2e4d11740 1 -- 172.21.15.78:0/775450076 shutdown_connections 2024-09-11T00:24:24.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.949+0000 7fe2e4d11740 1 --2- 172.21.15.78:0/775450076 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55c3c97494b0 0x55c3c974b910 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.949+0000 7fe2e4d11740 1 --2- 172.21.15.78:0/775450076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c97399a0 0x55c3c9736c20 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.949+0000 7fe2e4d11740 1 --2- 172.21.15.78:0/775450076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c3c972da10 0x55c3c9736680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.949+0000 7fe2bb7fe640 0 client.16425 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:24:24.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.949+0000 7fe2e4d11740 1 --2- 172.21.15.78:0/775450076 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972d0f0 0x55c3c9739230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.949+0000 7fe2e4d11740 1 -- 172.21.15.78:0/775450076 >> 172.21.15.78:0/775450076 conn(0x55c3c972af20 msgr2=0x55c3c9730ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:24.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.949+0000 7fe2e4d11740 1 -- 172.21.15.78:0/775450076 shutdown_connections 2024-09-11T00:24:24.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.949+0000 7fe2e4d11740 1 -- 172.21.15.78:0/775450076 wait complete. 2024-09-11T00:24:24.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.949+0000 7fe2e4d11740 20 client.16425 trim_cache size 0 max 16384 2024-09-11T00:24:24.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.962+0000 7fe2e4d11740 1 Processor -- start 2024-09-11T00:24:24.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.962+0000 7fe2e4d11740 1 -- start start 2024-09-11T00:24:24.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.962+0000 7fe2e4d11740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972d0f0 0x55c3c972a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.962+0000 7fe2e4d11740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c972da10 0x55c3c9733890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.962+0000 7fe2e4d11740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c3c97399a0 0x55c3c9733dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.962+0000 7fe2e4d11740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc1ae990 con 0x55c3c972da10 2024-09-11T00:24:24.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.962+0000 7fe2e4d11740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc1b11f0 con 0x55c3c972d0f0 2024-09-11T00:24:24.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.962+0000 7fe2e4d11740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc1aefe0 con 0x55c3c97399a0 2024-09-11T00:24:24.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.962+0000 7fe2db7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c972da10 0x55c3c9733890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.962+0000 7fe2db7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c972da10 0x55c3c9733890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60564/0 (socket says 172.21.15.78:60564) 2024-09-11T00:24:24.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.962+0000 7fe2db7fe640 1 -- 172.21.15.78:0/2455164268 learned_addr learned my addr 172.21.15.78:0/2455164268 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:24:24.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.962+0000 7fe2e0ed9640 1 --2- 172.21.15.78:0/2455164268 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c3c97399a0 0x55c3c9733dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.962+0000 7fe2db7fe640 1 -- 172.21.15.78:0/2455164268 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c3c97399a0 msgr2=0x55c3c9733dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:24.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.962+0000 7fe2dbfff640 1 --2- 172.21.15.78:0/2455164268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972d0f0 0x55c3c972a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.962+0000 7fe2db7fe640 1 --2- 172.21.15.78:0/2455164268 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c3c97399a0 0x55c3c9733dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.962+0000 7fe2db7fe640 1 -- 172.21.15.78:0/2455164268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972d0f0 msgr2=0x55c3c972a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:24.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.962+0000 7fe2db7fe640 1 --2- 172.21.15.78:0/2455164268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972d0f0 0x55c3c972a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.962+0000 7fe2db7fe640 1 -- 172.21.15.78:0/2455164268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3c972aca0 con 0x55c3c972da10 2024-09-11T00:24:24.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.962+0000 7fe2e0ed9640 1 --2- 172.21.15.78:0/2455164268 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c3c97399a0 0x55c3c9733dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:24.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.962+0000 7fe2dbfff640 1 --2- 172.21.15.78:0/2455164268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972d0f0 0x55c3c972a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:24.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.963+0000 7fe2db7fe640 1 --2- 172.21.15.78:0/2455164268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c972da10 0x55c3c9733890 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4007fd0 tx=0x7fe2c40071c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678ed4a7061c9fbe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:24.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.963+0000 7fe2d1ffb640 1 -- 172.21.15.78:0/2455164268 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c400db50 con 0x55c3c972da10 2024-09-11T00:24:24.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.963+0000 7fe2d1ffb640 1 -- 172.21.15.78:0/2455164268 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2c4018040 con 0x55c3c972da10 2024-09-11T00:24:24.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.963+0000 7fe2d1ffb640 1 -- 172.21.15.78:0/2455164268 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c401d400 con 0x55c3c972da10 2024-09-11T00:24:24.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.963+0000 7fe2e4d11740 1 -- 172.21.15.78:0/2455164268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c972da10 msgr2=0x55c3c9733890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:24.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.963+0000 7fe2e4d11740 1 --2- 172.21.15.78:0/2455164268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c972da10 0x55c3c9733890 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4007fd0 tx=0x7fe2c40071c0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.963+0000 7fe2e4d11740 1 -- 172.21.15.78:0/2455164268 shutdown_connections 2024-09-11T00:24:24.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.963+0000 7fe2e4d11740 1 --2- 172.21.15.78:0/2455164268 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c3c97399a0 0x55c3c9733dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.963+0000 7fe2e4d11740 1 --2- 172.21.15.78:0/2455164268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c972da10 0x55c3c9733890 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.963+0000 7fe2e4d11740 1 --2- 172.21.15.78:0/2455164268 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972d0f0 0x55c3c972a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.963+0000 7fe2e4d11740 1 -- 172.21.15.78:0/2455164268 >> 172.21.15.78:0/2455164268 conn(0x55c3c972af20 msgr2=0x55c3c97384d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:24.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.964+0000 7fe2e4d11740 1 -- 172.21.15.78:0/2455164268 shutdown_connections 2024-09-11T00:24:24.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.964+0000 7fe2e4d11740 1 -- 172.21.15.78:0/2455164268 wait complete. 2024-09-11T00:24:24.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.964+0000 7fe2e4d11740 1 -- start start 2024-09-11T00:24:24.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.964+0000 7fe2e4d11740 1 Processor -- start 2024-09-11T00:24:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.964+0000 7fe2e4d11740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972d0f0 0x55c3c973e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.964+0000 7fe2e4d11740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c972da10 0x55c3c973e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.964+0000 7fe2e4d11740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c3c97399a0 0x55c3c97af560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.964+0000 7fe2e4d11740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc1af6b0 con 0x55c3c972da10 2024-09-11T00:24:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.964+0000 7fe2e4d11740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc1b0b20 con 0x55c3c972d0f0 2024-09-11T00:24:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.964+0000 7fe2e4d11740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe2dc1afd80 con 0x55c3c97399a0 2024-09-11T00:24:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.964+0000 7fe2e4d11740 10 client.0 _ll_register_callbacks cb 0x7fe2d40119e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:24:24.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.964+0000 7fe2db7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c972da10 0x55c3c973e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.964+0000 7fe2db7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c972da10 0x55c3c973e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60576/0 (socket says 172.21.15.78:60576) 2024-09-11T00:24:24.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.964+0000 7fe2db7fe640 1 -- 172.21.15.78:0/1357819656 learned_addr learned my addr 172.21.15.78:0/1357819656 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:24:24.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.965+0000 7fe2dbfff640 1 --2- 172.21.15.78:0/1357819656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972d0f0 0x55c3c973e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.965+0000 7fe2e0ed9640 1 --2- 172.21.15.78:0/1357819656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c3c97399a0 0x55c3c97af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.965+0000 7fe2db7fe640 1 -- 172.21.15.78:0/1357819656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c3c97399a0 msgr2=0x55c3c97af560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:24.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.965+0000 7fe2db7fe640 1 --2- 172.21.15.78:0/1357819656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c3c97399a0 0x55c3c97af560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.965+0000 7fe2db7fe640 1 -- 172.21.15.78:0/1357819656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972d0f0 msgr2=0x55c3c973e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:24.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.965+0000 7fe2db7fe640 1 --2- 172.21.15.78:0/1357819656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972d0f0 0x55c3c973e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.965+0000 7fe2db7fe640 1 -- 172.21.15.78:0/1357819656 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3c97afca0 con 0x55c3c972da10 2024-09-11T00:24:24.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.965+0000 7fe2db7fe640 1 --2- 172.21.15.78:0/1357819656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c972da10 0x55c3c973e9b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4006a70 tx=0x7fe2c4007550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a554459f69ff33bc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:24.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.965+0000 7fe2bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:24:24.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.965+0000 7fe2bb7fe640 1 -- 172.21.15.78:0/1357819656 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c402d070 con 0x55c3c972da10 2024-09-11T00:24:24.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.965+0000 7fe2e4d11740 1 -- 172.21.15.78:0/1357819656 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2c4018040 con 0x55c3c972da10 2024-09-11T00:24:24.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.965+0000 7fe2bb7fe640 1 -- 172.21.15.78:0/1357819656 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7fe2c4013890 con 0x55c3c972da10 2024-09-11T00:24:24.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.965+0000 7fe2bb7fe640 1 -- 172.21.15.78:0/1357819656 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe2c4013a90 con 0x55c3c972da10 2024-09-11T00:24:24.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.965+0000 7fe2e4d11740 10 client.16431 fetch_fsmap learned FSMap version 20 2024-09-11T00:24:24.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.965+0000 7fe2e4d11740 1 -- 172.21.15.78:0/1357819656 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c3c97b7090 con 0x55c3c972da10 2024-09-11T00:24:24.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.966+0000 7fe2bb7fe640 1 -- 172.21.15.78:0/1357819656 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2c4018040 con 0x55c3c972da10 2024-09-11T00:24:24.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.966+0000 7fe2bb7fe640 1 -- 172.21.15.78:0/1357819656 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe2c4027410 con 0x55c3c972da10 2024-09-11T00:24:24.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.966+0000 7fe2e4d11740 10 client.16431 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:24:24.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.966+0000 7fe2e4d11740 10 client.16431 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:24:24.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.966+0000 7fe2e4d11740 20 client.16431 populate_metadata read hostname 'smithi078' 2024-09-11T00:24:24.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.966+0000 7fe2e4d11740 1 --2- 172.21.15.78:0/1357819656 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55c3c97b75b0 0x55c3c97b99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:24.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.966+0000 7fe2e4d11740 4 client.16431 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:24:24.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.966+0000 7fe2e4d11740 1 -- 172.21.15.78:0/1357819656 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c3c96a18a0 con 0x55c3c97b75b0 2024-09-11T00:24:24.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.966+0000 7fe2dbfff640 1 --2- 172.21.15.78:0/1357819656 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55c3c97b75b0 0x55c3c97b99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:24.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.966+0000 7fe2dbfff640 1 --2- 172.21.15.78:0/1357819656 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55c3c97b75b0 0x55c3c97b99d0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ec9e9a458ee70f0 server_cookie=9f0df5121e74c43 in_seq=0 out_seq=0 2024-09-11T00:24:24.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.966+0000 7fe2bb7fe640 10 client.16431 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:24:24.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.967+0000 7fe2bb7fe640 1 -- 172.21.15.78:0/1357819656 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c3c96a18a0 con 0x55c3c97b75b0 2024-09-11T00:24:24.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.967+0000 7fe2bb7fe640 10 client.16431 handle_command_reply: tid=0 2024-09-11T00:24:24.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.967+0000 7fe2e4d11740 1 client.16431 shutdown 2024-09-11T00:24:24.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.967+0000 7fe2e4d11740 1 -- 172.21.15.78:0/1357819656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c972da10 msgr2=0x55c3c973e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:24.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.967+0000 7fe2e4d11740 1 --2- 172.21.15.78:0/1357819656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c972da10 0x55c3c973e9b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4006a70 tx=0x7fe2c4007550 comp rx=0 tx=0).stop 2024-09-11T00:24:24.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.967+0000 7fe2e4d11740 1 -- 172.21.15.78:0/1357819656 shutdown_connections 2024-09-11T00:24:24.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.967+0000 7fe2e4d11740 1 --2- 172.21.15.78:0/1357819656 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55c3c97b75b0 0x55c3c97b99d0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.967+0000 7fe2e4d11740 1 --2- 172.21.15.78:0/1357819656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c3c97399a0 0x55c3c97af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.967+0000 7fe2bb7fe640 0 client.16431 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:24:24.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.967+0000 7fe2e4d11740 1 --2- 172.21.15.78:0/1357819656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c3c972da10 0x55c3c973e9b0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.967+0000 7fe2e4d11740 1 --2- 172.21.15.78:0/1357819656 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55c3c972d0f0 0x55c3c973e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.967+0000 7fe2e4d11740 1 -- 172.21.15.78:0/1357819656 >> 172.21.15.78:0/1357819656 conn(0x55c3c972af20 msgr2=0x55c3c9730150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:24.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.967+0000 7fe2e4d11740 1 -- 172.21.15.78:0/1357819656 shutdown_connections 2024-09-11T00:24:24.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.967+0000 7fe2e4d11740 1 -- 172.21.15.78:0/1357819656 wait complete. 2024-09-11T00:24:24.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.967+0000 7fe2e4d11740 20 client.16431 trim_cache size 0 max 16384 2024-09-11T00:24:24.978 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-11T00:24:24.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.967+0000 7fe2e293c640 1 -- 172.21.15.78:0/1064480033 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe2c80b5450 msgr2=0x7fe2c80b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:24.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.967+0000 7fe2e293c640 1 --2- 172.21.15.78:0/1064480033 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe2c80b5450 0x7fe2c80b7910 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4005fd0 tx=0x7fe2d4009600 comp rx=0 tx=0).stop 2024-09-11T00:24:24.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.967+0000 7fe2e293c640 1 -- 172.21.15.78:0/1064480033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2dc101cb0 msgr2=0x7fe2dc113fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:24.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.967+0000 7fe2e293c640 1 --2- 172.21.15.78:0/1064480033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2dc101cb0 0x7fe2dc113fb0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc005940 tx=0x7fe2cc0042f0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.968+0000 7fe2e293c640 1 -- 172.21.15.78:0/1064480033 shutdown_connections 2024-09-11T00:24:24.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.968+0000 7fe2e293c640 1 --2- 172.21.15.78:0/1064480033 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe2c80b5450 0x7fe2c80b7910 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.968+0000 7fe2e293c640 1 --2- 172.21.15.78:0/1064480033 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2dc108040 0x7fe2dc112ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.968+0000 7fe2e293c640 1 --2- 172.21.15.78:0/1064480033 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2dc1076c0 0x7fe2dc112480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.968+0000 7fe2e293c640 1 --2- 172.21.15.78:0/1064480033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2dc101cb0 0x7fe2dc113fb0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.968+0000 7fe2e293c640 1 -- 172.21.15.78:0/1064480033 >> 172.21.15.78:0/1064480033 conn(0x7fe2dc0fd700 msgr2=0x7fe2dc06ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.968+0000 7fe2e293c640 1 -- 172.21.15.78:0/1064480033 shutdown_connections 2024-09-11T00:24:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:24.968+0000 7fe2e293c640 1 -- 172.21.15.78:0/1064480033 wait complete. 2024-09-11T00:24:24.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:24 smithi112 ceph-mon[35627]: pgmap v565: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T00:24:25.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:24 smithi138 ceph-mon[35019]: pgmap v565: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T00:24:26.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:25 smithi112 ceph-mon[35627]: pgmap v566: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 B/s rd, 1 op/s 2024-09-11T00:24:26.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:25 smithi138 ceph-mon[35019]: pgmap v566: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 B/s rd, 1 op/s 2024-09-11T00:24:26.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:25 smithi078 ceph-mon[30865]: pgmap v566: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 B/s rd, 1 op/s 2024-09-11T00:24:26.779 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:24:26.779 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:24:27.034 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:24:27.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.558+0000 7fa782cc7640 1 -- 172.21.15.78:0/544023008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa77c108060 msgr2=0x7fa77c10e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:27.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.558+0000 7fa782cc7640 1 --2- 172.21.15.78:0/544023008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa77c108060 0x7fa77c10e860 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fa774009ca0 tx=0x7fa77402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.558+0000 7fa782cc7640 1 -- 172.21.15.78:0/544023008 shutdown_connections 2024-09-11T00:24:27.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.558+0000 7fa782cc7640 1 --2- 172.21.15.78:0/544023008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa77c108060 0x7fa77c10e860 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.558+0000 7fa782cc7640 1 --2- 172.21.15.78:0/544023008 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa77c1076e0 0x7fa77c107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.558+0000 7fa782cc7640 1 --2- 172.21.15.78:0/544023008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa77c101cd0 0x7fa77c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.558+0000 7fa782cc7640 1 -- 172.21.15.78:0/544023008 >> 172.21.15.78:0/544023008 conn(0x7fa77c0fd700 msgr2=0x7fa77c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:27.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.558+0000 7fa782cc7640 1 -- 172.21.15.78:0/544023008 shutdown_connections 2024-09-11T00:24:27.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.558+0000 7fa782cc7640 1 -- 172.21.15.78:0/544023008 wait complete. 2024-09-11T00:24:27.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.559+0000 7fa782cc7640 1 Processor -- start 2024-09-11T00:24:27.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.559+0000 7fa782cc7640 1 -- start start 2024-09-11T00:24:27.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.559+0000 7fa782cc7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa77c101cd0 0x7fa77c199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.559+0000 7fa782cc7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa77c1076e0 0x7fa77c1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.559+0000 7fa782cc7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa77c108060 0x7fa77c19eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.559+0000 7fa782cc7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa77c111d20 con 0x7fa77c101cd0 2024-09-11T00:24:27.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.559+0000 7fa782cc7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa77c111ba0 con 0x7fa77c1076e0 2024-09-11T00:24:27.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.559+0000 7fa782cc7640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa77c111ea0 con 0x7fa77c108060 2024-09-11T00:24:27.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.559+0000 7fa780a63640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa77c101cd0 0x7fa77c199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.559+0000 7fa780a63640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa77c101cd0 0x7fa77c199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60590/0 (socket says 172.21.15.78:60590) 2024-09-11T00:24:27.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.559+0000 7fa780a63640 1 -- 172.21.15.78:0/3721902839 learned_addr learned my addr 172.21.15.78:0/3721902839 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:24:27.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.559+0000 7fa781264640 1 --2- 172.21.15.78:0/3721902839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa77c108060 0x7fa77c19eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.559+0000 7fa77bfff640 1 --2- 172.21.15.78:0/3721902839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa77c1076e0 0x7fa77c1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.560+0000 7fa780a63640 1 -- 172.21.15.78:0/3721902839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa77c108060 msgr2=0x7fa77c19eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:27.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.560+0000 7fa780a63640 1 --2- 172.21.15.78:0/3721902839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa77c108060 0x7fa77c19eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.560+0000 7fa780a63640 1 -- 172.21.15.78:0/3721902839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa77c1076e0 msgr2=0x7fa77c1997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:27.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.560+0000 7fa780a63640 1 --2- 172.21.15.78:0/3721902839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa77c1076e0 0x7fa77c1997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.560+0000 7fa780a63640 1 -- 172.21.15.78:0/3721902839 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa77c19f310 con 0x7fa77c101cd0 2024-09-11T00:24:27.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.560+0000 7fa77bfff640 1 --2- 172.21.15.78:0/3721902839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa77c1076e0 0x7fa77c1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:27.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.560+0000 7fa780a63640 1 --2- 172.21.15.78:0/3721902839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa77c101cd0 0x7fa77c199260 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00b4a0 tx=0x7fa76c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:27.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.560+0000 7fa779ffb640 1 -- 172.21.15.78:0/3721902839 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c014070 con 0x7fa77c101cd0 2024-09-11T00:24:27.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.560+0000 7fa782cc7640 1 -- 172.21.15.78:0/3721902839 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa77c19f600 con 0x7fa77c101cd0 2024-09-11T00:24:27.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.560+0000 7fa779ffb640 1 -- 172.21.15.78:0/3721902839 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa76c010ac0 con 0x7fa77c101cd0 2024-09-11T00:24:27.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.560+0000 7fa779ffb640 1 -- 172.21.15.78:0/3721902839 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c017c30 con 0x7fa77c101cd0 2024-09-11T00:24:27.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.560+0000 7fa782cc7640 1 -- 172.21.15.78:0/3721902839 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa77c1a5e90 con 0x7fa77c101cd0 2024-09-11T00:24:27.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.563+0000 7fa779ffb640 1 -- 172.21.15.78:0/3721902839 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fa76c010610 con 0x7fa77c101cd0 2024-09-11T00:24:27.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.563+0000 7fa78509c740 1 Processor -- start 2024-09-11T00:24:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.563+0000 7fa78509c740 1 -- start start 2024-09-11T00:24:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.563+0000 7fa78509c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab83ee0 0x55fd7ab842c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.563+0000 7fa78509c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fd7ab84800 0x55fd7ab90250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.563+0000 7fa78509c740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab90790 0x55fd7ab92b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.563+0000 7fa78509c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55fd7aafae60 con 0x55fd7ab83ee0 2024-09-11T00:24:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.563+0000 7fa78509c740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fd7aaea290 con 0x55fd7ab90790 2024-09-11T00:24:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.563+0000 7fa78509c740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55fd7aaee0a0 con 0x55fd7ab84800 2024-09-11T00:24:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.563+0000 7fa781264640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab83ee0 0x55fd7ab842c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.563+0000 7fa781264640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab83ee0 0x55fd7ab842c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60600/0 (socket says 172.21.15.78:60600) 2024-09-11T00:24:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.563+0000 7fa781264640 1 -- 172.21.15.78:0/1889007693 learned_addr learned my addr 172.21.15.78:0/1889007693 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:24:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.563+0000 7fa780a63640 1 --2- 172.21.15.78:0/1889007693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fd7ab84800 0x55fd7ab90250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.564+0000 7fa77bfff640 1 --2- 172.21.15.78:0/1889007693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab90790 0x55fd7ab92b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.564+0000 7fa779ffb640 1 --2- 172.21.15.78:0/3721902839 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa7640b5450 0x7fa7640b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.564+0000 7fa781264640 1 -- 172.21.15.78:0/1889007693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fd7ab84800 msgr2=0x55fd7ab90250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.564+0000 7fa781264640 1 --2- 172.21.15.78:0/1889007693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fd7ab84800 0x55fd7ab90250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.564+0000 7fa781264640 1 -- 172.21.15.78:0/1889007693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab90790 msgr2=0x55fd7ab92b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.564+0000 7fa781264640 1 --2- 172.21.15.78:0/1889007693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab90790 0x55fd7ab92b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.564+0000 7fa781264640 1 -- 172.21.15.78:0/1889007693 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd7a848930 con 0x55fd7ab83ee0 2024-09-11T00:24:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.564+0000 7fa77bfff640 1 --2- 172.21.15.78:0/1889007693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab90790 0x55fd7ab92b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.564+0000 7fa781264640 1 --2- 172.21.15.78:0/3721902839 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa7640b5450 0x7fa7640b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.564+0000 7fa779ffb640 1 -- 172.21.15.78:0/3721902839 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7fa76c0e59c0 con 0x7fa77c101cd0 2024-09-11T00:24:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.564+0000 7fa781264640 1 --2- 172.21.15.78:0/1889007693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab83ee0 0x55fd7ab842c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa7740011c0 tx=0x7fa774031af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3431a09a7bb2850 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.564+0000 7fa762ffd640 1 -- 172.21.15.78:0/1889007693 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa774003ab0 con 0x55fd7ab83ee0 2024-09-11T00:24:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.564+0000 7fa762ffd640 1 -- 172.21.15.78:0/1889007693 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa774036040 con 0x55fd7ab83ee0 2024-09-11T00:24:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.564+0000 7fa762ffd640 1 -- 172.21.15.78:0/1889007693 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77402f660 con 0x55fd7ab83ee0 2024-09-11T00:24:27.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.564+0000 7fa781264640 1 --2- 172.21.15.78:0/3721902839 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa7640b5450 0x7fa7640b7910 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa77404c000 tx=0x7fa774049000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.565+0000 7fa78509c740 1 -- 172.21.15.78:0/1889007693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab83ee0 msgr2=0x55fd7ab842c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.565+0000 7fa78509c740 1 --2- 172.21.15.78:0/1889007693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab83ee0 0x55fd7ab842c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa7740011c0 tx=0x7fa774031af0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.565+0000 7fa78509c740 1 -- 172.21.15.78:0/1889007693 shutdown_connections 2024-09-11T00:24:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.565+0000 7fa78509c740 1 --2- 172.21.15.78:0/1889007693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab90790 0x55fd7ab92b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.565+0000 7fa78509c740 1 --2- 172.21.15.78:0/1889007693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fd7ab84800 0x55fd7ab90250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.565+0000 7fa78509c740 1 --2- 172.21.15.78:0/1889007693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab83ee0 0x55fd7ab842c0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.565+0000 7fa78509c740 1 -- 172.21.15.78:0/1889007693 >> 172.21.15.78:0/1889007693 conn(0x55fd7ab81d10 msgr2=0x55fd7ab82eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.565+0000 7fa78509c740 1 -- 172.21.15.78:0/1889007693 shutdown_connections 2024-09-11T00:24:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.565+0000 7fa78509c740 1 -- 172.21.15.78:0/1889007693 wait complete. 2024-09-11T00:24:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.565+0000 7fa78509c740 1 -- start start 2024-09-11T00:24:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.565+0000 7fa78509c740 1 Processor -- start 2024-09-11T00:24:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.566+0000 7fa78509c740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab83ee0 0x55fd7ab8d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.566+0000 7fa78509c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab84800 0x55fd7ab8dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.566+0000 7fa78509c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fd7ab90790 0x55fd7ab8e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.566+0000 7fa78509c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55fd7a94b890 con 0x55fd7ab84800 2024-09-11T00:24:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.566+0000 7fa78509c740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fd7aa84d40 con 0x55fd7ab83ee0 2024-09-11T00:24:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.566+0000 7fa78509c740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55fd7ab932c0 con 0x55fd7ab90790 2024-09-11T00:24:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.566+0000 7fa78509c740 10 client.0 _ll_register_callbacks cb 0x55fd7aae8c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:24:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.566+0000 7fa77bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab84800 0x55fd7ab8dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.566+0000 7fa77bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab84800 0x55fd7ab8dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60604/0 (socket says 172.21.15.78:60604) 2024-09-11T00:24:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.566+0000 7fa77bfff640 1 -- 172.21.15.78:0/4266944289 learned_addr learned my addr 172.21.15.78:0/4266944289 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:24:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.566+0000 7fa780a63640 1 --2- 172.21.15.78:0/4266944289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab83ee0 0x55fd7ab8d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.566+0000 7fa781264640 1 --2- 172.21.15.78:0/4266944289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fd7ab90790 0x55fd7ab8e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.566+0000 7fa77bfff640 1 -- 172.21.15.78:0/4266944289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fd7ab90790 msgr2=0x55fd7ab8e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.566+0000 7fa77bfff640 1 --2- 172.21.15.78:0/4266944289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fd7ab90790 0x55fd7ab8e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.566+0000 7fa77bfff640 1 -- 172.21.15.78:0/4266944289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab83ee0 msgr2=0x55fd7ab8d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.566+0000 7fa77bfff640 1 --2- 172.21.15.78:0/4266944289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab83ee0 0x55fd7ab8d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.566+0000 7fa77bfff640 1 -- 172.21.15.78:0/4266944289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd7ab9c6a0 con 0x55fd7ab84800 2024-09-11T00:24:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.566+0000 7fa780a63640 1 --2- 172.21.15.78:0/4266944289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab83ee0 0x55fd7ab8d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.566+0000 7fa77bfff640 1 --2- 172.21.15.78:0/4266944289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab84800 0x55fd7ab8dc50 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa77000f760 tx=0x7fa77000fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa6fc16c7471e3d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.566+0000 7fa75bfff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:24:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.566+0000 7fa75bfff640 1 -- 172.21.15.78:0/4266944289 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa770016070 con 0x55fd7ab84800 2024-09-11T00:24:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.567+0000 7fa78509c740 1 -- 172.21.15.78:0/4266944289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa774036040 con 0x55fd7ab84800 2024-09-11T00:24:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.567+0000 7fa75bfff640 1 -- 172.21.15.78:0/4266944289 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7fa77000bd10 con 0x55fd7ab84800 2024-09-11T00:24:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.567+0000 7fa75bfff640 1 -- 172.21.15.78:0/4266944289 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa77000fe70 con 0x55fd7ab84800 2024-09-11T00:24:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.567+0000 7fa78509c740 10 client.16443 fetch_fsmap learned FSMap version 20 2024-09-11T00:24:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.567+0000 7fa78509c740 1 -- 172.21.15.78:0/4266944289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55fd7ab9f0e0 con 0x55fd7ab84800 2024-09-11T00:24:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.567+0000 7fa75bfff640 1 -- 172.21.15.78:0/4266944289 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa774036040 con 0x55fd7ab84800 2024-09-11T00:24:27.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.567+0000 7fa75bfff640 1 -- 172.21.15.78:0/4266944289 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa77001a640 con 0x55fd7ab84800 2024-09-11T00:24:27.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.567+0000 7fa78509c740 10 client.16443 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:24:27.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.567+0000 7fa78509c740 10 client.16443 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:24:27.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.567+0000 7fa78509c740 20 client.16443 populate_metadata read hostname 'smithi078' 2024-09-11T00:24:27.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.567+0000 7fa78509c740 1 --2- 172.21.15.78:0/4266944289 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fd7aba04f0 0x55fd7aba2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.567+0000 7fa78509c740 4 client.16443 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:24:27.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.567+0000 7fa78509c740 1 -- 172.21.15.78:0/4266944289 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd7aafcdb0 con 0x55fd7aba04f0 2024-09-11T00:24:27.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.567+0000 7fa780a63640 1 --2- 172.21.15.78:0/4266944289 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fd7aba04f0 0x55fd7aba2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.568+0000 7fa780a63640 1 --2- 172.21.15.78:0/4266944289 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fd7aba04f0 0x55fd7aba2970 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeb1e653884d159d server_cookie=25d9fcfafd783bae in_seq=0 out_seq=0 2024-09-11T00:24:27.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.568+0000 7fa75bfff640 10 client.16443 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:24:27.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.569+0000 7fa75bfff640 1 -- 172.21.15.78:0/4266944289 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fd7aafcdb0 con 0x55fd7aba04f0 2024-09-11T00:24:27.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.569+0000 7fa75bfff640 10 client.16443 handle_command_reply: tid=0 2024-09-11T00:24:27.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.569+0000 7fa78509c740 1 client.16443 shutdown 2024-09-11T00:24:27.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.569+0000 7fa78509c740 1 -- 172.21.15.78:0/4266944289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab84800 msgr2=0x55fd7ab8dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:27.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.569+0000 7fa78509c740 1 --2- 172.21.15.78:0/4266944289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab84800 0x55fd7ab8dc50 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa77000f760 tx=0x7fa77000fc20 comp rx=0 tx=0).stop 2024-09-11T00:24:27.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.569+0000 7fa78509c740 1 -- 172.21.15.78:0/4266944289 shutdown_connections 2024-09-11T00:24:27.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.569+0000 7fa78509c740 1 --2- 172.21.15.78:0/4266944289 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fd7aba04f0 0x55fd7aba2970 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.569+0000 7fa78509c740 1 --2- 172.21.15.78:0/4266944289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fd7ab90790 0x55fd7ab8e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.569+0000 7fa78509c740 1 --2- 172.21.15.78:0/4266944289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab84800 0x55fd7ab8dc50 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.569+0000 7fa78509c740 1 --2- 172.21.15.78:0/4266944289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab83ee0 0x55fd7ab8d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.569+0000 7fa75bfff640 0 client.16443 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:24:27.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.569+0000 7fa78509c740 1 -- 172.21.15.78:0/4266944289 >> 172.21.15.78:0/4266944289 conn(0x55fd7ab81d10 msgr2=0x55fd7ab80f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:27.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.569+0000 7fa78509c740 1 -- 172.21.15.78:0/4266944289 shutdown_connections 2024-09-11T00:24:27.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.569+0000 7fa78509c740 1 -- 172.21.15.78:0/4266944289 wait complete. 2024-09-11T00:24:27.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.569+0000 7fa78509c740 20 client.16443 trim_cache size 0 max 16384 2024-09-11T00:24:27.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.586+0000 7fa78509c740 1 Processor -- start 2024-09-11T00:24:27.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.586+0000 7fa78509c740 1 -- start start 2024-09-11T00:24:27.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.587+0000 7fa78509c740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab83ee0 0x55fd7ab8f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.587+0000 7fa78509c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fd7ab84800 0x55fd7ab8dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.587+0000 7fa78509c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab90790 0x55fd7ab8a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.587+0000 7fa78509c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa77c1ac7e0 con 0x55fd7ab90790 2024-09-11T00:24:27.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.587+0000 7fa78509c740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa77c1af040 con 0x55fd7ab83ee0 2024-09-11T00:24:27.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.587+0000 7fa78509c740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa77c1ace30 con 0x55fd7ab84800 2024-09-11T00:24:27.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.587+0000 7fa781264640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab90790 0x55fd7ab8a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.587+0000 7fa781264640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab90790 0x55fd7ab8a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60608/0 (socket says 172.21.15.78:60608) 2024-09-11T00:24:27.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.587+0000 7fa781264640 1 -- 172.21.15.78:0/4271054460 learned_addr learned my addr 172.21.15.78:0/4271054460 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:24:27.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.587+0000 7fa780a63640 1 --2- 172.21.15.78:0/4271054460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab83ee0 0x55fd7ab8f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.587+0000 7fa77bfff640 1 --2- 172.21.15.78:0/4271054460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fd7ab84800 0x55fd7ab8dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.587+0000 7fa781264640 1 -- 172.21.15.78:0/4271054460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fd7ab84800 msgr2=0x55fd7ab8dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:27.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.587+0000 7fa781264640 1 --2- 172.21.15.78:0/4271054460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fd7ab84800 0x55fd7ab8dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.587+0000 7fa781264640 1 -- 172.21.15.78:0/4271054460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab83ee0 msgr2=0x55fd7ab8f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:27.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.587+0000 7fa781264640 1 --2- 172.21.15.78:0/4271054460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab83ee0 0x55fd7ab8f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.587+0000 7fa781264640 1 -- 172.21.15.78:0/4271054460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd7ab81b40 con 0x55fd7ab90790 2024-09-11T00:24:27.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.587+0000 7fa77bfff640 1 --2- 172.21.15.78:0/4271054460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fd7ab84800 0x55fd7ab8dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:27.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.587+0000 7fa780a63640 1 --2- 172.21.15.78:0/4271054460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab83ee0 0x55fd7ab8f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:27.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.587+0000 7fa781264640 1 --2- 172.21.15.78:0/4271054460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab90790 0x55fd7ab8a940 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa774009b80 tx=0x7fa774005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2d20c370d34975 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:27.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.587+0000 7fa7627fc640 1 -- 172.21.15.78:0/4271054460 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77402f660 con 0x55fd7ab90790 2024-09-11T00:24:27.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.587+0000 7fa7627fc640 1 -- 172.21.15.78:0/4271054460 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa774036050 con 0x55fd7ab90790 2024-09-11T00:24:27.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.587+0000 7fa7627fc640 1 -- 172.21.15.78:0/4271054460 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa774004040 con 0x55fd7ab90790 2024-09-11T00:24:27.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.588+0000 7fa78509c740 1 -- 172.21.15.78:0/4271054460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab90790 msgr2=0x55fd7ab8a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:27.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.588+0000 7fa78509c740 1 --2- 172.21.15.78:0/4271054460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab90790 0x55fd7ab8a940 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa774009b80 tx=0x7fa774005c30 comp rx=0 tx=0).stop 2024-09-11T00:24:27.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.588+0000 7fa78509c740 1 -- 172.21.15.78:0/4271054460 shutdown_connections 2024-09-11T00:24:27.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.588+0000 7fa78509c740 1 --2- 172.21.15.78:0/4271054460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab90790 0x55fd7ab8a940 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.588+0000 7fa78509c740 1 --2- 172.21.15.78:0/4271054460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fd7ab84800 0x55fd7ab8dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.588+0000 7fa78509c740 1 --2- 172.21.15.78:0/4271054460 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab83ee0 0x55fd7ab8f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.588+0000 7fa78509c740 1 -- 172.21.15.78:0/4271054460 >> 172.21.15.78:0/4271054460 conn(0x55fd7ab81d10 msgr2=0x55fd7ab8d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:27.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.588+0000 7fa78509c740 1 -- 172.21.15.78:0/4271054460 shutdown_connections 2024-09-11T00:24:27.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.588+0000 7fa78509c740 1 -- 172.21.15.78:0/4271054460 wait complete. 2024-09-11T00:24:27.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.588+0000 7fa78509c740 1 -- start start 2024-09-11T00:24:27.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.588+0000 7fa78509c740 1 Processor -- start 2024-09-11T00:24:27.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.589+0000 7fa78509c740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab83ee0 0x55fd7ab93d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.589+0000 7fa78509c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fd7ab84800 0x55fd7ab94270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.589+0000 7fa78509c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab90790 0x55fd7ac0d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.589+0000 7fa78509c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa77c1ad500 con 0x55fd7ab90790 2024-09-11T00:24:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.589+0000 7fa78509c740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa77c1ae970 con 0x55fd7ab83ee0 2024-09-11T00:24:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.589+0000 7fa78509c740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa77c1adbd0 con 0x55fd7ab84800 2024-09-11T00:24:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.589+0000 7fa78509c740 10 client.0 _ll_register_callbacks cb 0x7fa77000d380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:24:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.589+0000 7fa781264640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab90790 0x55fd7ac0d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.589+0000 7fa781264640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab90790 0x55fd7ac0d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60616/0 (socket says 172.21.15.78:60616) 2024-09-11T00:24:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.589+0000 7fa781264640 1 -- 172.21.15.78:0/2349385098 learned_addr learned my addr 172.21.15.78:0/2349385098 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:24:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.589+0000 7fa77bfff640 1 --2- 172.21.15.78:0/2349385098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fd7ab84800 0x55fd7ab94270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.589+0000 7fa780a63640 1 --2- 172.21.15.78:0/2349385098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab83ee0 0x55fd7ab93d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.589+0000 7fa781264640 1 -- 172.21.15.78:0/2349385098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fd7ab84800 msgr2=0x55fd7ab94270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.589+0000 7fa781264640 1 --2- 172.21.15.78:0/2349385098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fd7ab84800 0x55fd7ab94270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.589+0000 7fa781264640 1 -- 172.21.15.78:0/2349385098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab83ee0 msgr2=0x55fd7ab93d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.589+0000 7fa781264640 1 --2- 172.21.15.78:0/2349385098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab83ee0 0x55fd7ab93d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.589+0000 7fa781264640 1 -- 172.21.15.78:0/2349385098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd7ac0d9f0 con 0x55fd7ab90790 2024-09-11T00:24:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.589+0000 7fa781264640 1 --2- 172.21.15.78:0/2349385098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab90790 0x55fd7ac0d480 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa77402a900 tx=0x7fa774005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60967656ea39bc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.589+0000 7fa75bfff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:24:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.590+0000 7fa75bfff640 1 -- 172.21.15.78:0/2349385098 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77402fed0 con 0x55fd7ab90790 2024-09-11T00:24:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.590+0000 7fa75bfff640 1 -- 172.21.15.78:0/2349385098 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7fa774058040 con 0x55fd7ab90790 2024-09-11T00:24:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.590+0000 7fa78509c740 1 -- 172.21.15.78:0/2349385098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa774036050 con 0x55fd7ab90790 2024-09-11T00:24:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.590+0000 7fa75bfff640 1 -- 172.21.15.78:0/2349385098 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa774003cc0 con 0x55fd7ab90790 2024-09-11T00:24:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.590+0000 7fa78509c740 10 client.16449 fetch_fsmap learned FSMap version 20 2024-09-11T00:24:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.590+0000 7fa78509c740 1 -- 172.21.15.78:0/2349385098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55fd7ac0ec80 con 0x55fd7ab90790 2024-09-11T00:24:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.590+0000 7fa75bfff640 1 -- 172.21.15.78:0/2349385098 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa774036050 con 0x55fd7ab90790 2024-09-11T00:24:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.590+0000 7fa75bfff640 1 -- 172.21.15.78:0/2349385098 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fa7740307c0 con 0x55fd7ab90790 2024-09-11T00:24:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.590+0000 7fa78509c740 10 client.16449 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:24:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.590+0000 7fa78509c740 10 client.16449 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:24:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.590+0000 7fa78509c740 20 client.16449 populate_metadata read hostname 'smithi078' 2024-09-11T00:24:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.590+0000 7fa78509c740 1 --2- 172.21.15.78:0/2349385098 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fd7ac0f090 0x55fd7ac114b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.590+0000 7fa78509c740 4 client.16449 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:24:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.590+0000 7fa78509c740 1 -- 172.21.15.78:0/2349385098 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fd7aaf8860 con 0x55fd7ac0f090 2024-09-11T00:24:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.590+0000 7fa780a63640 1 --2- 172.21.15.78:0/2349385098 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fd7ac0f090 0x55fd7ac114b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.591+0000 7fa75bfff640 10 client.16449 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:24:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.591+0000 7fa780a63640 1 --2- 172.21.15.78:0/2349385098 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fd7ac0f090 0x55fd7ac114b0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=198afedf829a66f5 server_cookie=7e901de855032f in_seq=0 out_seq=0 2024-09-11T00:24:27.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.592+0000 7fa75bfff640 1 -- 172.21.15.78:0/2349385098 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fd7aaf8860 con 0x55fd7ac0f090 2024-09-11T00:24:27.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.592+0000 7fa75bfff640 10 client.16449 handle_command_reply: tid=0 2024-09-11T00:24:27.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.592+0000 7fa78509c740 1 client.16449 shutdown 2024-09-11T00:24:27.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.593+0000 7fa78509c740 1 -- 172.21.15.78:0/2349385098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab90790 msgr2=0x55fd7ac0d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:27.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.593+0000 7fa78509c740 1 --2- 172.21.15.78:0/2349385098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab90790 0x55fd7ac0d480 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa77402a900 tx=0x7fa774005d80 comp rx=0 tx=0).stop 2024-09-11T00:24:27.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.593+0000 7fa78509c740 1 -- 172.21.15.78:0/2349385098 shutdown_connections 2024-09-11T00:24:27.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.593+0000 7fa78509c740 1 --2- 172.21.15.78:0/2349385098 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55fd7ac0f090 0x55fd7ac114b0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.593+0000 7fa78509c740 1 --2- 172.21.15.78:0/2349385098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd7ab90790 0x55fd7ac0d480 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.593+0000 7fa78509c740 1 --2- 172.21.15.78:0/2349385098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fd7ab84800 0x55fd7ab94270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.593+0000 7fa78509c740 1 --2- 172.21.15.78:0/2349385098 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fd7ab83ee0 0x55fd7ab93d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.593+0000 7fa75bfff640 0 client.16449 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:24:27.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.593+0000 7fa78509c740 1 -- 172.21.15.78:0/2349385098 >> 172.21.15.78:0/2349385098 conn(0x55fd7ab81d10 msgr2=0x55fd7ab8d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:27.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.593+0000 7fa78509c740 1 -- 172.21.15.78:0/2349385098 shutdown_connections 2024-09-11T00:24:27.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.593+0000 7fa78509c740 1 -- 172.21.15.78:0/2349385098 wait complete. 2024-09-11T00:24:27.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.593+0000 7fa78509c740 20 client.16449 trim_cache size 0 max 16384 2024-09-11T00:24:27.601 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:24:27.601 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-11T00:24:27.601 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "1c04b4f1-c4c4-4289-b172-fba45b64018a", 2024-09-11T00:24:27.605 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-11T00:24:27.605 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:24:27.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.593+0000 7fa782cc7640 1 -- 172.21.15.78:0/3721902839 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa7640b5450 msgr2=0x7fa7640b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:27.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.593+0000 7fa782cc7640 1 --2- 172.21.15.78:0/3721902839 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa7640b5450 0x7fa7640b7910 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa77404c000 tx=0x7fa774049000 comp rx=0 tx=0).stop 2024-09-11T00:24:27.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.593+0000 7fa782cc7640 1 -- 172.21.15.78:0/3721902839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa77c101cd0 msgr2=0x7fa77c199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:27.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.593+0000 7fa782cc7640 1 --2- 172.21.15.78:0/3721902839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa77c101cd0 0x7fa77c199260 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00b4a0 tx=0x7fa76c00b960 comp rx=0 tx=0).stop 2024-09-11T00:24:27.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.594+0000 7fa782cc7640 1 -- 172.21.15.78:0/3721902839 shutdown_connections 2024-09-11T00:24:27.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.594+0000 7fa782cc7640 1 --2- 172.21.15.78:0/3721902839 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa7640b5450 0x7fa7640b7910 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.594+0000 7fa782cc7640 1 --2- 172.21.15.78:0/3721902839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa77c108060 0x7fa77c19eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.594+0000 7fa782cc7640 1 --2- 172.21.15.78:0/3721902839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa77c1076e0 0x7fa77c1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.594+0000 7fa782cc7640 1 --2- 172.21.15.78:0/3721902839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa77c101cd0 0x7fa77c199260 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:27.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.594+0000 7fa782cc7640 1 -- 172.21.15.78:0/3721902839 >> 172.21.15.78:0/3721902839 conn(0x7fa77c0fd700 msgr2=0x7fa77c06b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:27.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.594+0000 7fa782cc7640 1 -- 172.21.15.78:0/3721902839 shutdown_connections 2024-09-11T00:24:27.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:27.594+0000 7fa782cc7640 1 -- 172.21.15.78:0/3721902839 wait complete. 2024-09-11T00:24:28.194 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:27 smithi078 ceph-mon[30865]: pgmap v567: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:24:28.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:27 smithi112 ceph-mon[35627]: pgmap v567: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:24:28.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:27 smithi138 ceph-mon[35019]: pgmap v567: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:24:28.387 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:24:28.633 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:24:29.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:28 smithi078 ceph-mon[30865]: scrub queued for path: / 2024-09-11T00:24:29.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:28 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:24:29.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:28 smithi078 ceph-mon[30865]: scrub summary: active paths [/] 2024-09-11T00:24:29.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:28 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:24:29.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.165+0000 7fe16a323640 1 -- 172.21.15.78:0/1818027395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1641076a0 msgr2=0x7fe164107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:29.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.166+0000 7fe16a323640 1 --2- 172.21.15.78:0/1818027395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1641076a0 0x7fe164107ae0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe158009900 tx=0x7fe15802a410 comp rx=0 tx=0).stop 2024-09-11T00:24:29.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.166+0000 7fe16a323640 1 -- 172.21.15.78:0/1818027395 shutdown_connections 2024-09-11T00:24:29.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.166+0000 7fe16a323640 1 --2- 172.21.15.78:0/1818027395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe164108020 0x7fe16410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.166+0000 7fe16a323640 1 --2- 172.21.15.78:0/1818027395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1641076a0 0x7fe164107ae0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.166+0000 7fe16a323640 1 --2- 172.21.15.78:0/1818027395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe164101c90 0x7fe164102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.166+0000 7fe16a323640 1 -- 172.21.15.78:0/1818027395 >> 172.21.15.78:0/1818027395 conn(0x7fe1640fd700 msgr2=0x7fe1640ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:29.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.166+0000 7fe16a323640 1 -- 172.21.15.78:0/1818027395 shutdown_connections 2024-09-11T00:24:29.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.166+0000 7fe16a323640 1 -- 172.21.15.78:0/1818027395 wait complete. 2024-09-11T00:24:29.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.166+0000 7fe16a323640 1 Processor -- start 2024-09-11T00:24:29.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.166+0000 7fe16a323640 1 -- start start 2024-09-11T00:24:29.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.167+0000 7fe16a323640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe164101c90 0x7fe16419a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.167+0000 7fe16a323640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1641076a0 0x7fe16419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.167+0000 7fe16a323640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe164108020 0x7fe16419ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.167+0000 7fe16a323640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe164111d20 con 0x7fe164101c90 2024-09-11T00:24:29.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.167+0000 7fe16a323640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe164111ba0 con 0x7fe1641076a0 2024-09-11T00:24:29.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.167+0000 7fe16a323640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe164111ea0 con 0x7fe164108020 2024-09-11T00:24:29.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.167+0000 7fe163fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe164101c90 0x7fe16419a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.167+0000 7fe163fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe164101c90 0x7fe16419a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60636/0 (socket says 172.21.15.78:60636) 2024-09-11T00:24:29.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.167+0000 7fe163fff640 1 -- 172.21.15.78:0/2200612418 learned_addr learned my addr 172.21.15.78:0/2200612418 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:24:29.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.167+0000 7fe1637fe640 1 --2- 172.21.15.78:0/2200612418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1641076a0 0x7fe16419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.167+0000 7fe163fff640 1 -- 172.21.15.78:0/2200612418 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe164108020 msgr2=0x7fe16419ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:29.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.167+0000 7fe163fff640 1 --2- 172.21.15.78:0/2200612418 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe164108020 0x7fe16419ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.167+0000 7fe163fff640 1 -- 172.21.15.78:0/2200612418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1641076a0 msgr2=0x7fe16419a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:29.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.167+0000 7fe163fff640 1 --2- 172.21.15.78:0/2200612418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1641076a0 0x7fe16419a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.167+0000 7fe163fff640 1 -- 172.21.15.78:0/2200612418 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1641a55d0 con 0x7fe164101c90 2024-09-11T00:24:29.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.167+0000 7fe1637fe640 1 --2- 172.21.15.78:0/2200612418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1641076a0 0x7fe16419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:29.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.167+0000 7fe163fff640 1 --2- 172.21.15.78:0/2200612418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe164101c90 0x7fe16419a1f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe15400b4a0 tx=0x7fe15400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:29.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.167+0000 7fe1617fa640 1 -- 172.21.15.78:0/2200612418 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe154014070 con 0x7fe164101c90 2024-09-11T00:24:29.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.167+0000 7fe16a323640 1 -- 172.21.15.78:0/2200612418 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1641a58c0 con 0x7fe164101c90 2024-09-11T00:24:29.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.167+0000 7fe1617fa640 1 -- 172.21.15.78:0/2200612418 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe154010ac0 con 0x7fe164101c90 2024-09-11T00:24:29.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.167+0000 7fe1617fa640 1 -- 172.21.15.78:0/2200612418 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe154017c30 con 0x7fe164101c90 2024-09-11T00:24:29.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.168+0000 7fe16a323640 1 -- 172.21.15.78:0/2200612418 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1641a5e80 con 0x7fe164101c90 2024-09-11T00:24:29.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.170+0000 7fe1617fa640 1 -- 172.21.15.78:0/2200612418 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fe154010610 con 0x7fe164101c90 2024-09-11T00:24:29.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.170+0000 7fe16c6f8740 1 Processor -- start 2024-09-11T00:24:29.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.170+0000 7fe16c6f8740 1 -- start start 2024-09-11T00:24:29.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.170+0000 7fe16c6f8740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558e9dd4c480 0x558e9dd4c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.170+0000 7fe16c6f8740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558e9dd4cda0 0x558e9dd5cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.170+0000 7fe16c6f8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd5f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.170+0000 7fe16c6f8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x558e9dcc2e50 con 0x558e9dd5d140 2024-09-11T00:24:29.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.170+0000 7fe16c6f8740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558e9dcb2280 con 0x558e9dd4c480 2024-09-11T00:24:29.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.170+0000 7fe16c6f8740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x558e9dcb6090 con 0x558e9dd4cda0 2024-09-11T00:24:29.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.171+0000 7fe1637fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd5f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.171+0000 7fe1637fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd5f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60648/0 (socket says 172.21.15.78:60648) 2024-09-11T00:24:29.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.171+0000 7fe1637fe640 1 -- 172.21.15.78:0/2686223923 learned_addr learned my addr 172.21.15.78:0/2686223923 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:24:29.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.171+0000 7fe1688c0640 1 --2- 172.21.15.78:0/2686223923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558e9dd4c480 0x558e9dd4c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.171+0000 7fe163fff640 1 --2- 172.21.15.78:0/2686223923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558e9dd4cda0 0x558e9dd5cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.171+0000 7fe1637fe640 1 -- 172.21.15.78:0/2686223923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558e9dd4cda0 msgr2=0x558e9dd5cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:29.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.171+0000 7fe1637fe640 1 --2- 172.21.15.78:0/2686223923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558e9dd4cda0 0x558e9dd5cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.171+0000 7fe1637fe640 1 -- 172.21.15.78:0/2686223923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558e9dd4c480 msgr2=0x558e9dd4c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:29.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.171+0000 7fe1637fe640 1 --2- 172.21.15.78:0/2686223923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558e9dd4c480 0x558e9dd4c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.171+0000 7fe1637fe640 1 -- 172.21.15.78:0/2686223923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e9da10650 con 0x558e9dd5d140 2024-09-11T00:24:29.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.171+0000 7fe163fff640 1 --2- 172.21.15.78:0/2686223923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558e9dd4cda0 0x558e9dd5cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:29.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.171+0000 7fe1688c0640 1 --2- 172.21.15.78:0/2686223923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558e9dd4c480 0x558e9dd4c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:29.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.171+0000 7fe1617fa640 1 --2- 172.21.15.78:0/2200612418 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe14c0b54d0 0x7fe14c0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.171+0000 7fe1637fe640 1 --2- 172.21.15.78:0/2686223923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd5f530 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe158006010 tx=0x7fe158032e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92372725fcfc2482 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:29.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.171+0000 7fe1688c0640 1 --2- 172.21.15.78:0/2200612418 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe14c0b54d0 0x7fe14c0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.171+0000 7fe14a7fc640 1 -- 172.21.15.78:0/2686223923 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe158035030 con 0x558e9dd5d140 2024-09-11T00:24:29.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.171+0000 7fe1617fa640 1 -- 172.21.15.78:0/2200612418 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7fe1540e55e0 con 0x7fe164101c90 2024-09-11T00:24:29.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.171+0000 7fe14a7fc640 1 -- 172.21.15.78:0/2686223923 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe158031760 con 0x558e9dd5d140 2024-09-11T00:24:29.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.171+0000 7fe14a7fc640 1 -- 172.21.15.78:0/2686223923 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1580046c0 con 0x558e9dd5d140 2024-09-11T00:24:29.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.172+0000 7fe16c6f8740 1 -- 172.21.15.78:0/2686223923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 msgr2=0x558e9dd5f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:29.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.172+0000 7fe1688c0640 1 --2- 172.21.15.78:0/2200612418 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe14c0b54d0 0x7fe14c0b7990 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe16419b1d0 tx=0x7fe15c009430 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:29.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.172+0000 7fe16c6f8740 1 --2- 172.21.15.78:0/2686223923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd5f530 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe158006010 tx=0x7fe158032e70 comp rx=0 tx=0).stop 2024-09-11T00:24:29.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.172+0000 7fe16c6f8740 1 -- 172.21.15.78:0/2686223923 shutdown_connections 2024-09-11T00:24:29.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.172+0000 7fe16c6f8740 1 --2- 172.21.15.78:0/2686223923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd5f530 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.172+0000 7fe16c6f8740 1 --2- 172.21.15.78:0/2686223923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558e9dd4cda0 0x558e9dd5cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.172+0000 7fe16c6f8740 1 --2- 172.21.15.78:0/2686223923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558e9dd4c480 0x558e9dd4c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.172+0000 7fe16c6f8740 1 -- 172.21.15.78:0/2686223923 >> 172.21.15.78:0/2686223923 conn(0x558e9dd4a2b0 msgr2=0x558e9dd4b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:29.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.172+0000 7fe16c6f8740 1 -- 172.21.15.78:0/2686223923 shutdown_connections 2024-09-11T00:24:29.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.172+0000 7fe16c6f8740 1 -- 172.21.15.78:0/2686223923 wait complete. 2024-09-11T00:24:29.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.173+0000 7fe16c6f8740 1 -- start start 2024-09-11T00:24:29.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.173+0000 7fe16c6f8740 1 Processor -- start 2024-09-11T00:24:29.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.173+0000 7fe16c6f8740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558e9dd4c480 0x558e9dd5c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.173+0000 7fe16c6f8740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558e9dd4cda0 0x558e9dd59e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.173+0000 7fe16c6f8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd5a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.173+0000 7fe16c6f8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x558e9db13700 con 0x558e9dd5d140 2024-09-11T00:24:29.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.173+0000 7fe16c6f8740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558e9dc4d110 con 0x558e9dd4c480 2024-09-11T00:24:29.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.173+0000 7fe16c6f8740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x558e9dd5fd90 con 0x558e9dd4cda0 2024-09-11T00:24:29.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.173+0000 7fe16c6f8740 10 client.0 _ll_register_callbacks cb 0x558e9dc66990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:24:29.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.173+0000 7fe1688c0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd5a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.173+0000 7fe1688c0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd5a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60658/0 (socket says 172.21.15.78:60658) 2024-09-11T00:24:29.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.173+0000 7fe1688c0640 1 -- 172.21.15.78:0/1153593584 learned_addr learned my addr 172.21.15.78:0/1153593584 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:24:29.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.173+0000 7fe1637fe640 1 --2- 172.21.15.78:0/1153593584 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558e9dd4cda0 0x558e9dd59e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.173+0000 7fe1688c0640 1 -- 172.21.15.78:0/1153593584 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558e9dd4cda0 msgr2=0x558e9dd59e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:29.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.173+0000 7fe1688c0640 1 --2- 172.21.15.78:0/1153593584 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558e9dd4cda0 0x558e9dd59e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.173+0000 7fe1688c0640 1 -- 172.21.15.78:0/1153593584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558e9dd4c480 msgr2=0x558e9dd5c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:29.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.173+0000 7fe1688c0640 1 --2- 172.21.15.78:0/1153593584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558e9dd4c480 0x558e9dd5c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.174+0000 7fe1688c0640 1 -- 172.21.15.78:0/1153593584 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e9dc7ac40 con 0x558e9dd5d140 2024-09-11T00:24:29.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.174+0000 7fe1688c0640 1 --2- 172.21.15.78:0/1153593584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd5a3f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe15c0097b0 tx=0x7fe15c004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86166d313c5df83f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:29.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.174+0000 7fe1437fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:24:29.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.174+0000 7fe1437fe640 1 -- 172.21.15.78:0/1153593584 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15c027060 con 0x558e9dd5d140 2024-09-11T00:24:29.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.174+0000 7fe1437fe640 1 -- 172.21.15.78:0/1153593584 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7fe15c012030 con 0x558e9dd5d140 2024-09-11T00:24:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.174+0000 7fe16c6f8740 1 -- 172.21.15.78:0/1153593584 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe158031760 con 0x558e9dd5d140 2024-09-11T00:24:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.174+0000 7fe1437fe640 1 -- 172.21.15.78:0/1153593584 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe15c017d70 con 0x558e9dd5d140 2024-09-11T00:24:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.174+0000 7fe16c6f8740 10 client.16461 fetch_fsmap learned FSMap version 20 2024-09-11T00:24:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.174+0000 7fe16c6f8740 1 -- 172.21.15.78:0/1153593584 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558e9dd6b650 con 0x558e9dd5d140 2024-09-11T00:24:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.174+0000 7fe1437fe640 1 -- 172.21.15.78:0/1153593584 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe158031760 con 0x558e9dd5d140 2024-09-11T00:24:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.174+0000 7fe1437fe640 1 -- 172.21.15.78:0/1153593584 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe15c022930 con 0x558e9dd5d140 2024-09-11T00:24:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.174+0000 7fe16c6f8740 10 client.16461 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:24:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.174+0000 7fe16c6f8740 10 client.16461 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:24:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.174+0000 7fe16c6f8740 20 client.16461 populate_metadata read hostname 'smithi078' 2024-09-11T00:24:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.174+0000 7fe16c6f8740 1 --2- 172.21.15.78:0/1153593584 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x558e9dd6cb10 0x558e9dd6ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.174+0000 7fe16c6f8740 4 client.16461 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:24:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.174+0000 7fe16c6f8740 1 -- 172.21.15.78:0/1153593584 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e9dcc4da0 con 0x558e9dd6cb10 2024-09-11T00:24:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.175+0000 7fe163fff640 1 --2- 172.21.15.78:0/1153593584 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x558e9dd6cb10 0x558e9dd6ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.175+0000 7fe163fff640 1 --2- 172.21.15.78:0/1153593584 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x558e9dd6cb10 0x558e9dd6ef70 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=618ef8725c77d344 server_cookie=6356318d524727e5 in_seq=0 out_seq=0 2024-09-11T00:24:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.175+0000 7fe1437fe640 10 client.16461 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:24:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.176+0000 7fe1437fe640 1 -- 172.21.15.78:0/1153593584 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558e9dcc4da0 con 0x558e9dd6cb10 2024-09-11T00:24:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.176+0000 7fe1437fe640 10 client.16461 handle_command_reply: tid=0 2024-09-11T00:24:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.176+0000 7fe16c6f8740 1 client.16461 shutdown 2024-09-11T00:24:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.176+0000 7fe16c6f8740 1 -- 172.21.15.78:0/1153593584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 msgr2=0x558e9dd5a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.176+0000 7fe16c6f8740 1 --2- 172.21.15.78:0/1153593584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd5a3f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe15c0097b0 tx=0x7fe15c004bc0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.176+0000 7fe16c6f8740 1 -- 172.21.15.78:0/1153593584 shutdown_connections 2024-09-11T00:24:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.176+0000 7fe16c6f8740 1 --2- 172.21.15.78:0/1153593584 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x558e9dd6cb10 0x558e9dd6ef70 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.176+0000 7fe16c6f8740 1 --2- 172.21.15.78:0/1153593584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd5a3f0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.176+0000 7fe16c6f8740 1 --2- 172.21.15.78:0/1153593584 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558e9dd4cda0 0x558e9dd59e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.176+0000 7fe1437fe640 0 client.16461 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:24:29.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.176+0000 7fe16c6f8740 1 --2- 172.21.15.78:0/1153593584 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558e9dd4c480 0x558e9dd5c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.176+0000 7fe16c6f8740 1 -- 172.21.15.78:0/1153593584 >> 172.21.15.78:0/1153593584 conn(0x558e9dd4a2b0 msgr2=0x558e9dd4fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:29.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.176+0000 7fe16c6f8740 1 -- 172.21.15.78:0/1153593584 shutdown_connections 2024-09-11T00:24:29.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.176+0000 7fe16c6f8740 1 -- 172.21.15.78:0/1153593584 wait complete. 2024-09-11T00:24:29.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.176+0000 7fe16c6f8740 20 client.16461 trim_cache size 0 max 16384 2024-09-11T00:24:29.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.194+0000 7fe16c6f8740 1 Processor -- start 2024-09-11T00:24:29.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.194+0000 7fe16c6f8740 1 -- start start 2024-09-11T00:24:29.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.194+0000 7fe16c6f8740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558e9dd4c480 0x558e9dd68fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.194+0000 7fe16c6f8740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558e9dd4cda0 0x558e9dd74840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.194+0000 7fe16c6f8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd74d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.194+0000 7fe16c6f8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe1641aa690 con 0x558e9dd5d140 2024-09-11T00:24:29.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.194+0000 7fe16c6f8740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe1641acef0 con 0x558e9dd4c480 2024-09-11T00:24:29.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.194+0000 7fe16c6f8740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe1641aace0 con 0x558e9dd4cda0 2024-09-11T00:24:29.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.194+0000 7fe1688c0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd74d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.194+0000 7fe1688c0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd74d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60666/0 (socket says 172.21.15.78:60666) 2024-09-11T00:24:29.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.194+0000 7fe1688c0640 1 -- 172.21.15.78:0/2558835177 learned_addr learned my addr 172.21.15.78:0/2558835177 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:24:29.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.194+0000 7fe163fff640 1 --2- 172.21.15.78:0/2558835177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558e9dd4c480 0x558e9dd68fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.194+0000 7fe1637fe640 1 --2- 172.21.15.78:0/2558835177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558e9dd4cda0 0x558e9dd74840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.194+0000 7fe1688c0640 1 -- 172.21.15.78:0/2558835177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558e9dd4cda0 msgr2=0x558e9dd74840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:29.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.194+0000 7fe1688c0640 1 --2- 172.21.15.78:0/2558835177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558e9dd4cda0 0x558e9dd74840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.194+0000 7fe1688c0640 1 -- 172.21.15.78:0/2558835177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558e9dd4c480 msgr2=0x558e9dd68fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:29.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.194+0000 7fe1688c0640 1 --2- 172.21.15.78:0/2558835177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558e9dd4c480 0x558e9dd68fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.194+0000 7fe1688c0640 1 -- 172.21.15.78:0/2558835177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e9dd525e0 con 0x558e9dd5d140 2024-09-11T00:24:29.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.194+0000 7fe1637fe640 1 --2- 172.21.15.78:0/2558835177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558e9dd4cda0 0x558e9dd74840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:24:29.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.194+0000 7fe163fff640 1 --2- 172.21.15.78:0/2558835177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558e9dd4c480 0x558e9dd68fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:24:29.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.195+0000 7fe1688c0640 1 --2- 172.21.15.78:0/2558835177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd74d80 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe15c0071a0 tx=0x7fe15c009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ea558afd85332a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.195+0000 7fe149ffb640 1 -- 172.21.15.78:0/2558835177 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15c016770 con 0x558e9dd5d140 2024-09-11T00:24:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.195+0000 7fe149ffb640 1 -- 172.21.15.78:0/2558835177 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe15c016dc0 con 0x558e9dd5d140 2024-09-11T00:24:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.195+0000 7fe149ffb640 1 -- 172.21.15.78:0/2558835177 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15c02a6d0 con 0x558e9dd5d140 2024-09-11T00:24:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.195+0000 7fe16c6f8740 1 -- 172.21.15.78:0/2558835177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 msgr2=0x558e9dd74d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.195+0000 7fe16c6f8740 1 --2- 172.21.15.78:0/2558835177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd74d80 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe15c0071a0 tx=0x7fe15c009c40 comp rx=0 tx=0).stop 2024-09-11T00:24:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.196+0000 7fe16c6f8740 1 -- 172.21.15.78:0/2558835177 shutdown_connections 2024-09-11T00:24:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.196+0000 7fe16c6f8740 1 --2- 172.21.15.78:0/2558835177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd74d80 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.196+0000 7fe16c6f8740 1 --2- 172.21.15.78:0/2558835177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558e9dd4cda0 0x558e9dd74840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.196+0000 7fe16c6f8740 1 --2- 172.21.15.78:0/2558835177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558e9dd4c480 0x558e9dd68fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.196+0000 7fe16c6f8740 1 -- 172.21.15.78:0/2558835177 >> 172.21.15.78:0/2558835177 conn(0x558e9dd4a2b0 msgr2=0x558e9dd5bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.196+0000 7fe16c6f8740 1 -- 172.21.15.78:0/2558835177 shutdown_connections 2024-09-11T00:24:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.196+0000 7fe16c6f8740 1 -- 172.21.15.78:0/2558835177 wait complete. 2024-09-11T00:24:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.196+0000 7fe16c6f8740 1 -- start start 2024-09-11T00:24:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.196+0000 7fe16c6f8740 1 Processor -- start 2024-09-11T00:24:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.196+0000 7fe16c6f8740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558e9dd4c480 0x558e9dd62100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.196+0000 7fe16c6f8740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558e9dd4cda0 0x558e9dd62640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.196+0000 7fe16c6f8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd62b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.196+0000 7fe16c6f8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe1641ab3b0 con 0x558e9dd5d140 2024-09-11T00:24:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.196+0000 7fe16c6f8740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe1641ac820 con 0x558e9dd4cda0 2024-09-11T00:24:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.196+0000 7fe16c6f8740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe1641aba80 con 0x558e9dd4c480 2024-09-11T00:24:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.196+0000 7fe16c6f8740 10 client.0 _ll_register_callbacks cb 0x7fe15c009a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:24:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.197+0000 7fe1688c0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd62b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.197+0000 7fe1688c0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd62b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60674/0 (socket says 172.21.15.78:60674) 2024-09-11T00:24:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.197+0000 7fe1688c0640 1 -- 172.21.15.78:0/202408744 learned_addr learned my addr 172.21.15.78:0/202408744 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:24:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.197+0000 7fe163fff640 1 --2- 172.21.15.78:0/202408744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558e9dd4c480 0x558e9dd62100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.197+0000 7fe1637fe640 1 --2- 172.21.15.78:0/202408744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558e9dd4cda0 0x558e9dd62640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.197+0000 7fe1688c0640 1 -- 172.21.15.78:0/202408744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558e9dd4c480 msgr2=0x558e9dd62100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:29.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.197+0000 7fe1688c0640 1 --2- 172.21.15.78:0/202408744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558e9dd4c480 0x558e9dd62100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.197+0000 7fe1688c0640 1 -- 172.21.15.78:0/202408744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558e9dd4cda0 msgr2=0x558e9dd62640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:24:29.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.197+0000 7fe1688c0640 1 --2- 172.21.15.78:0/202408744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558e9dd4cda0 0x558e9dd62640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.197+0000 7fe1688c0640 1 -- 172.21.15.78:0/202408744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e9ddd9c00 con 0x558e9dd5d140 2024-09-11T00:24:29.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.197+0000 7fe1688c0640 1 --2- 172.21.15.78:0/202408744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd62b80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe15c017010 tx=0x7fe15c0178d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ff85f9676bbfdd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:24:29.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.197+0000 7fe1437fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:24:29.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.197+0000 7fe1437fe640 1 -- 172.21.15.78:0/202408744 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15c042060 con 0x558e9dd5d140 2024-09-11T00:24:29.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.197+0000 7fe1437fe640 1 -- 172.21.15.78:0/202408744 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7fe15c01d040 con 0x558e9dd5d140 2024-09-11T00:24:29.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.197+0000 7fe16c6f8740 1 -- 172.21.15.78:0/202408744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe15c016dc0 con 0x558e9dd5d140 2024-09-11T00:24:29.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.197+0000 7fe1437fe640 1 -- 172.21.15.78:0/202408744 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe15c027040 con 0x558e9dd5d140 2024-09-11T00:24:29.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.197+0000 7fe16c6f8740 10 client.16467 fetch_fsmap learned FSMap version 20 2024-09-11T00:24:29.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.197+0000 7fe16c6f8740 1 -- 172.21.15.78:0/202408744 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558e9dddae80 con 0x558e9dd5d140 2024-09-11T00:24:29.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.198+0000 7fe1437fe640 1 -- 172.21.15.78:0/202408744 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe15c016dc0 con 0x558e9dd5d140 2024-09-11T00:24:29.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.198+0000 7fe1437fe640 1 -- 172.21.15.78:0/202408744 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe15c03c070 con 0x558e9dd5d140 2024-09-11T00:24:29.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.198+0000 7fe16c6f8740 10 client.16467 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:24:29.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.198+0000 7fe16c6f8740 10 client.16467 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:24:29.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.198+0000 7fe16c6f8740 20 client.16467 populate_metadata read hostname 'smithi078' 2024-09-11T00:24:29.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.198+0000 7fe16c6f8740 1 --2- 172.21.15.78:0/202408744 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x558e9dddb4c0 0x558e9dddd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:24:29.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.198+0000 7fe16c6f8740 4 client.16467 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:24:29.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.198+0000 7fe16c6f8740 1 -- 172.21.15.78:0/202408744 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558e9dcc0850 con 0x558e9dddb4c0 2024-09-11T00:24:29.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.198+0000 7fe163fff640 1 --2- 172.21.15.78:0/202408744 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x558e9dddb4c0 0x558e9dddd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:24:29.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.199+0000 7fe163fff640 1 --2- 172.21.15.78:0/202408744 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x558e9dddb4c0 0x558e9dddd8e0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=161d993c89f89953 server_cookie=5e969f19eaf5b323 in_seq=0 out_seq=0 2024-09-11T00:24:29.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.199+0000 7fe1437fe640 10 client.16467 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:24:29.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.199+0000 7fe1437fe640 1 -- 172.21.15.78:0/202408744 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4830 (crc 0 0 0) 0x558e9dcc0850 con 0x558e9dddb4c0 2024-09-11T00:24:29.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.199+0000 7fe1437fe640 10 client.16467 handle_command_reply: tid=0 2024-09-11T00:24:29.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.199+0000 7fe16c6f8740 1 client.16467 shutdown 2024-09-11T00:24:29.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.199+0000 7fe16c6f8740 1 -- 172.21.15.78:0/202408744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 msgr2=0x558e9dd62b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:29.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.199+0000 7fe16c6f8740 1 --2- 172.21.15.78:0/202408744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd62b80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe15c017010 tx=0x7fe15c0178d0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.199+0000 7fe16c6f8740 1 -- 172.21.15.78:0/202408744 shutdown_connections 2024-09-11T00:24:29.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.199+0000 7fe16c6f8740 1 --2- 172.21.15.78:0/202408744 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x558e9dddb4c0 0x558e9dddd8e0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.199+0000 7fe16c6f8740 1 --2- 172.21.15.78:0/202408744 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e9dd5d140 0x558e9dd62b80 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.199+0000 7fe16c6f8740 1 --2- 172.21.15.78:0/202408744 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558e9dd4cda0 0x558e9dd62640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.199+0000 7fe16c6f8740 1 --2- 172.21.15.78:0/202408744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558e9dd4c480 0x558e9dd62100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.199+0000 7fe16c6f8740 1 -- 172.21.15.78:0/202408744 >> 172.21.15.78:0/202408744 conn(0x558e9dd4a2b0 msgr2=0x558e9dd5b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:29.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.199+0000 7fe1437fe640 0 client.16467 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:24:29.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.199+0000 7fe16c6f8740 1 -- 172.21.15.78:0/202408744 shutdown_connections 2024-09-11T00:24:29.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.199+0000 7fe16c6f8740 1 -- 172.21.15.78:0/202408744 wait complete. 2024-09-11T00:24:29.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.199+0000 7fe16c6f8740 20 client.16467 trim_cache size 0 max 16384 2024-09-11T00:24:29.211 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:24:29.211 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:24:29.211 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-11T00:24:29.211 INFO:teuthology.orchestra.run.smithi078.stdout: "1c04b4f1-c4c4-4289-b172-fba45b64018a": { 2024-09-11T00:24:29.211 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:29.211 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "1c04b4f1-c4c4-4289-b172-fba45b64018a", 2024-09-11T00:24:29.211 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-11T00:24:29.212 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:24:29.212 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:29.212 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:24:29.212 INFO:teuthology.orchestra.run.smithi078.stdout: "f6eb5d15-216e-4f8b-b451-2f71b931998f": { 2024-09-11T00:24:29.212 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:48.289319+0000", 2024-09-11T00:24:29.212 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:29.212 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:29.212 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:29.213 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:29.213 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:29.213 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:29.213 INFO:teuthology.orchestra.run.smithi078.stdout: "e21db329-a274-4cfd-924a-8ec929e04bd1": { 2024-09-11T00:24:29.213 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:41.131504+0000", 2024-09-11T00:24:29.213 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:29.213 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:29.213 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:29.213 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:29.213 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:29.213 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:29.213 INFO:teuthology.orchestra.run.smithi078.stdout: "b854cbd3-8ca7-4277-a205-8887d2ff5567": { 2024-09-11T00:24:29.213 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:11.182949+0000", 2024-09-11T00:24:29.214 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:29.214 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:29.214 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:29.214 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:29.214 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:29.214 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:29.214 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:24:29.214 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:24:29.214 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:29.214 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:29.214 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:29.214 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:29.214 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:29.215 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:29.215 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:24:29.215 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:24:29.215 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:29.215 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:29.215 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:29.216 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:29.216 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:29.216 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:29.216 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:24:29.216 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:24:29.217 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:29.217 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:29.217 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:29.217 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:29.217 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:29.217 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:29.217 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:24:29.217 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:24:29.217 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:29.217 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:29.217 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:29.217 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:29.217 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:29.218 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:29.218 INFO:teuthology.orchestra.run.smithi078.stdout: "81d31d3a-c224-4ded-9f00-1a7dfc099ec4": { 2024-09-11T00:24:29.218 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:16.296700+0000", 2024-09-11T00:24:29.218 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:29.218 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:29.218 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:29.218 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:29.218 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:29.218 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:29.218 INFO:teuthology.orchestra.run.smithi078.stdout: "1c04b4f1-c4c4-4289-b172-fba45b64018a": { 2024-09-11T00:24:29.218 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:24:27.591301+0000", 2024-09-11T00:24:29.218 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:29.218 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:29.218 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:29.219 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:29.219 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:29.219 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:29.219 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:24:29.219 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:24:29.219 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:29.219 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:29.219 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:29.219 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:29.220 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:29.220 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:29.220 INFO:teuthology.orchestra.run.smithi078.stdout: "38a1d30d-5f4c-460a-afcd-e6c60b97e43a": { 2024-09-11T00:24:29.220 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:58.127727+0000", 2024-09-11T00:24:29.220 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:29.220 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:29.220 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:29.220 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:29.220 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:29.220 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:29.220 INFO:teuthology.orchestra.run.smithi078.stdout: "8ec9e858-aa62-420d-a112-e62ea7810e63": { 2024-09-11T00:24:29.220 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:18.882749+0000", 2024-09-11T00:24:29.220 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:29.220 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:29.221 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:29.221 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:29.221 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:29.221 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:29.221 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:24:29.221 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:24:29.221 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:29.221 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:29.221 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:29.221 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:29.222 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:29.222 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:29.222 INFO:teuthology.orchestra.run.smithi078.stdout: "1b9391c2-08f3-479a-9538-deea28f7743b": { 2024-09-11T00:24:29.222 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:02.327508+0000", 2024-09-11T00:24:29.222 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:29.222 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:29.222 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:29.222 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:29.222 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:29.222 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:29.222 INFO:teuthology.orchestra.run.smithi078.stdout: "e0002672-e432-4890-ab9f-20c513c5e3b6": { 2024-09-11T00:24:29.222 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:21:37.161715+0000", 2024-09-11T00:24:29.222 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:29.222 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:29.223 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:29.223 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:29.223 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:29.223 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:24:29.223 INFO:teuthology.orchestra.run.smithi078.stdout: "f494d5ed-e0dc-44bb-8aba-a861b3e751f4": { 2024-09-11T00:24:29.223 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:55.251691+0000", 2024-09-11T00:24:29.223 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:24:29.223 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:24:29.223 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:24:29.223 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:24:29.224 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:24:29.224 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:24:29.224 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:24:29.224 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:24:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.200+0000 7fe16a323640 1 -- 172.21.15.78:0/2200612418 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe14c0b54d0 msgr2=0x7fe14c0b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:29.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.200+0000 7fe16a323640 1 --2- 172.21.15.78:0/2200612418 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe14c0b54d0 0x7fe14c0b7990 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe16419b1d0 tx=0x7fe15c009430 comp rx=0 tx=0).stop 2024-09-11T00:24:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.200+0000 7fe16a323640 1 -- 172.21.15.78:0/2200612418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe164101c90 msgr2=0x7fe16419a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:24:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.200+0000 7fe16a323640 1 --2- 172.21.15.78:0/2200612418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe164101c90 0x7fe16419a1f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe15400b4a0 tx=0x7fe15400b960 comp rx=0 tx=0).stop 2024-09-11T00:24:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.200+0000 7fe16a323640 1 -- 172.21.15.78:0/2200612418 shutdown_connections 2024-09-11T00:24:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.200+0000 7fe16a323640 1 --2- 172.21.15.78:0/2200612418 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe14c0b54d0 0x7fe14c0b7990 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.200+0000 7fe16a323640 1 --2- 172.21.15.78:0/2200612418 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe164108020 0x7fe16419ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.200+0000 7fe16a323640 1 --2- 172.21.15.78:0/2200612418 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe1641076a0 0x7fe16419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.200+0000 7fe16a323640 1 --2- 172.21.15.78:0/2200612418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe164101c90 0x7fe16419a1f0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:24:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.200+0000 7fe16a323640 1 -- 172.21.15.78:0/2200612418 >> 172.21.15.78:0/2200612418 conn(0x7fe1640fd700 msgr2=0x7fe1640ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:24:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.200+0000 7fe16a323640 1 -- 172.21.15.78:0/2200612418 shutdown_connections 2024-09-11T00:24:29.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:24:29.200+0000 7fe16a323640 1 -- 172.21.15.78:0/2200612418 wait complete. 2024-09-11T00:24:29.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:28 smithi112 ceph-mon[35627]: scrub queued for path: / 2024-09-11T00:24:29.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:28 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:24:29.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:28 smithi112 ceph-mon[35627]: scrub summary: active paths [/] 2024-09-11T00:24:29.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:28 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:24:29.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:28 smithi138 ceph-mon[35019]: scrub queued for path: / 2024-09-11T00:24:29.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:28 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:24:29.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:28 smithi138 ceph-mon[35019]: scrub summary: active paths [/] 2024-09-11T00:24:29.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:28 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:24:30.046 INFO:tasks.cephfs.filesystem:scrub status for tag:1c04b4f1-c4c4-4289-b172-fba45b64018a - {'path': '/', 'tag': '1c04b4f1-c4c4-4289-b172-fba45b64018a', 'options': 'recursive,force'} 2024-09-11T00:24:30.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:29 smithi112 ceph-mon[35627]: pgmap v568: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:24:30.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:29 smithi138 ceph-mon[35019]: pgmap v568: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:24:30.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:29 smithi078 ceph-mon[30865]: pgmap v568: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:24:31.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:31 smithi112 ceph-mon[35627]: scrub summary: idle 2024-09-11T00:24:31.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:31 smithi138 ceph-mon[35019]: scrub summary: idle 2024-09-11T00:24:31.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:31 smithi078 ceph-mon[30865]: scrub summary: idle 2024-09-11T00:24:32.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:32 smithi112 ceph-mon[35627]: pgmap v569: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:24:32.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:32 smithi138 ceph-mon[35019]: pgmap v569: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:24:32.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:32 smithi078 ceph-mon[30865]: pgmap v569: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:24:34.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:33 smithi112 ceph-mon[35627]: pgmap v570: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:24:34.235 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:33 smithi078 ceph-mon[30865]: pgmap v570: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:24:34.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:33 smithi138 ceph-mon[35019]: pgmap v570: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:24:36.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:35 smithi112 ceph-mon[35627]: pgmap v571: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:24:36.303 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:35 smithi138 ceph-mon[35019]: pgmap v571: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:24:36.339 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:35 smithi078 ceph-mon[30865]: pgmap v571: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:24:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:37 smithi112 ceph-mon[35627]: pgmap v572: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:24:38.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:37 smithi138 ceph-mon[35019]: pgmap v572: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:24:38.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:37 smithi078 ceph-mon[30865]: pgmap v572: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:24:40.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:39 smithi112 ceph-mon[35627]: pgmap v573: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:24:40.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:39 smithi138 ceph-mon[35019]: pgmap v573: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:24:40.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:39 smithi078 ceph-mon[30865]: pgmap v573: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:24:41.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:41 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:24:41.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:41 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:24:41.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:41 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:24:41.983 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:41 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:24:42.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:41 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:24:42.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:41 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:24:42.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:41 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:24:42.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:41 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:24:42.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:41 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:24:42.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:41 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:24:42.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:41 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:24:42.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:41 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:24:42.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:42 smithi112 ceph-mon[35627]: pgmap v574: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:24:43.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:42 smithi138 ceph-mon[35019]: pgmap v574: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:24:43.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:42 smithi078 ceph-mon[30865]: pgmap v574: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:24:44.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:43 smithi112 ceph-mon[35627]: pgmap v575: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:24:44.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:43 smithi138 ceph-mon[35019]: pgmap v575: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:24:44.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:43 smithi078 ceph-mon[30865]: pgmap v575: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:24:46.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:45 smithi112 ceph-mon[35627]: pgmap v576: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:24:46.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:45 smithi138 ceph-mon[35019]: pgmap v576: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:24:46.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:45 smithi078 ceph-mon[30865]: pgmap v576: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:24:48.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:47 smithi112 ceph-mon[35627]: pgmap v577: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:24:48.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:47 smithi138 ceph-mon[35019]: pgmap v577: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:24:48.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:47 smithi078 ceph-mon[30865]: pgmap v577: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:24:50.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:49 smithi112 ceph-mon[35627]: pgmap v578: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:24:50.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:49 smithi138 ceph-mon[35019]: pgmap v578: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:24:50.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:49 smithi078 ceph-mon[30865]: pgmap v578: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:24:52.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:51 smithi112 ceph-mon[35627]: pgmap v579: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:24:52.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:51 smithi138 ceph-mon[35019]: pgmap v579: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:24:52.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:51 smithi078 ceph-mon[30865]: pgmap v579: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:24:54.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:53 smithi112 ceph-mon[35627]: pgmap v580: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:24:54.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:53 smithi138 ceph-mon[35019]: pgmap v580: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:24:54.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:53 smithi078 ceph-mon[30865]: pgmap v580: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:24:56.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:55 smithi112 ceph-mon[35627]: pgmap v581: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:24:56.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:55 smithi138 ceph-mon[35019]: pgmap v581: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:24:56.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:55 smithi078 ceph-mon[30865]: pgmap v581: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:24:58.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:57 smithi112 ceph-mon[35627]: pgmap v582: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:24:58.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:57 smithi138 ceph-mon[35019]: pgmap v582: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:24:58.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:57 smithi078 ceph-mon[30865]: pgmap v582: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:00.048 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:25:00.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:24:59 smithi112 ceph-mon[35627]: pgmap v583: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:00.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:24:59 smithi138 ceph-mon[35019]: pgmap v583: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:00.312 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:25:00.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:24:59 smithi078 ceph-mon[30865]: pgmap v583: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:00.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.823+0000 7f71b7a1e640 1 -- 172.21.15.78:0/3197595227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b0108020 msgr2=0x7f71b010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:00.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.823+0000 7f71b7a1e640 1 --2- 172.21.15.78:0/3197595227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b0108020 0x7f71b010e820 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009900 tx=0x7f71a802a410 comp rx=0 tx=0).stop 2024-09-11T00:25:00.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.823+0000 7f71b7a1e640 1 -- 172.21.15.78:0/3197595227 shutdown_connections 2024-09-11T00:25:00.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.823+0000 7f71b7a1e640 1 --2- 172.21.15.78:0/3197595227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b0108020 0x7f71b010e820 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.823+0000 7f71b7a1e640 1 --2- 172.21.15.78:0/3197595227 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f71b01076a0 0x7f71b0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.823+0000 7f71b7a1e640 1 --2- 172.21.15.78:0/3197595227 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71b0101c90 0x7f71b0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.823+0000 7f71b7a1e640 1 -- 172.21.15.78:0/3197595227 >> 172.21.15.78:0/3197595227 conn(0x7f71b00fd700 msgr2=0x7f71b00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:00.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.823+0000 7f71b7a1e640 1 -- 172.21.15.78:0/3197595227 shutdown_connections 2024-09-11T00:25:00.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.823+0000 7f71b7a1e640 1 -- 172.21.15.78:0/3197595227 wait complete. 2024-09-11T00:25:00.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.823+0000 7f71b7a1e640 1 Processor -- start 2024-09-11T00:25:00.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.823+0000 7f71b7a1e640 1 -- start start 2024-09-11T00:25:00.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.824+0000 7f71b7a1e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f71b0101c90 0x7f71b01992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:00.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.824+0000 7f71b7a1e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b01076a0 0x7f71b0199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:00.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.824+0000 7f71b7a1e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71b0108020 0x7f71b019ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:00.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.824+0000 7f71b7a1e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f71b0111ce0 con 0x7f71b01076a0 2024-09-11T00:25:00.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.824+0000 7f71b7a1e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f71b0111b60 con 0x7f71b0108020 2024-09-11T00:25:00.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.824+0000 7f71b7a1e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f71b0111e60 con 0x7f71b0101c90 2024-09-11T00:25:00.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.824+0000 7f71b4fb9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b01076a0 0x7f71b0199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:00.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.824+0000 7f71b4fb9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b01076a0 0x7f71b0199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43192/0 (socket says 172.21.15.78:43192) 2024-09-11T00:25:00.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.824+0000 7f71b4fb9640 1 -- 172.21.15.78:0/3177888063 learned_addr learned my addr 172.21.15.78:0/3177888063 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:00.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.824+0000 7f71b57ba640 1 --2- 172.21.15.78:0/3177888063 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f71b0101c90 0x7f71b01992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:00.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.824+0000 7f71b5fbb640 1 --2- 172.21.15.78:0/3177888063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71b0108020 0x7f71b019ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:00.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.824+0000 7f71b4fb9640 1 -- 172.21.15.78:0/3177888063 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f71b0101c90 msgr2=0x7f71b01992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:00.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.824+0000 7f71b4fb9640 1 --2- 172.21.15.78:0/3177888063 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f71b0101c90 0x7f71b01992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.824+0000 7f71b4fb9640 1 -- 172.21.15.78:0/3177888063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71b0108020 msgr2=0x7f71b019ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:00.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.824+0000 7f71b4fb9640 1 --2- 172.21.15.78:0/3177888063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71b0108020 0x7f71b019ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.824+0000 7f71b4fb9640 1 -- 172.21.15.78:0/3177888063 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b019f3a0 con 0x7f71b01076a0 2024-09-11T00:25:00.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.824+0000 7f71b4fb9640 1 --2- 172.21.15.78:0/3177888063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b01076a0 0x7f71b0199830 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f71a000c970 tx=0x7f71a000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:00.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.825+0000 7f71a67fc640 1 -- 172.21.15.78:0/3177888063 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a0007bb0 con 0x7f71b01076a0 2024-09-11T00:25:00.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.825+0000 7f71b7a1e640 1 -- 172.21.15.78:0/3177888063 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b019f690 con 0x7f71b01076a0 2024-09-11T00:25:00.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.825+0000 7f71a67fc640 1 -- 172.21.15.78:0/3177888063 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71a0007d50 con 0x7f71b01076a0 2024-09-11T00:25:00.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.825+0000 7f71a67fc640 1 -- 172.21.15.78:0/3177888063 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a000f450 con 0x7f71b01076a0 2024-09-11T00:25:00.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.825+0000 7f71b7a1e640 1 -- 172.21.15.78:0/3177888063 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b01a5d50 con 0x7f71b01076a0 2024-09-11T00:25:00.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.828+0000 7f71b9df3740 1 Processor -- start 2024-09-11T00:25:00.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.828+0000 7f71b9df3740 1 -- start start 2024-09-11T00:25:00.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.828+0000 7f71b9df3740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27480 0x55de7cc27860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:00.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.828+0000 7f71b9df3740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de7cc27da0 0x55de7cc37c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:00.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.828+0000 7f71b9df3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de7cc38140 0x55de7cc3a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:00.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.828+0000 7f71b9df3740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55de7cb9de50 con 0x55de7cc27480 2024-09-11T00:25:00.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.828+0000 7f71b9df3740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55de7cb8d280 con 0x55de7cc27da0 2024-09-11T00:25:00.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.828+0000 7f71b9df3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55de7cb91090 con 0x55de7cc38140 2024-09-11T00:25:00.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.828+0000 7f71b5fbb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27480 0x55de7cc27860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:00.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.828+0000 7f71b5fbb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27480 0x55de7cc27860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43196/0 (socket says 172.21.15.78:43196) 2024-09-11T00:25:00.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.828+0000 7f71b5fbb640 1 -- 172.21.15.78:0/749061445 learned_addr learned my addr 172.21.15.78:0/749061445 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:00.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.828+0000 7f71b57ba640 1 --2- 172.21.15.78:0/749061445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de7cc27da0 0x55de7cc37c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:00.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.828+0000 7f71a67fc640 1 -- 172.21.15.78:0/3177888063 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f71a0004f20 con 0x7f71b01076a0 2024-09-11T00:25:00.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.829+0000 7f71b5fbb640 1 -- 172.21.15.78:0/749061445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de7cc38140 msgr2=0x55de7cc3a530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T00:25:00.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.829+0000 7f71b5fbb640 1 --2- 172.21.15.78:0/749061445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de7cc38140 0x55de7cc3a530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.829+0000 7f71b5fbb640 1 -- 172.21.15.78:0/749061445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de7cc27da0 msgr2=0x55de7cc37c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:00.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.829+0000 7f71b5fbb640 1 --2- 172.21.15.78:0/749061445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de7cc27da0 0x55de7cc37c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.829+0000 7f71b5fbb640 1 -- 172.21.15.78:0/749061445 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de7c8eb650 con 0x55de7cc27480 2024-09-11T00:25:00.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.829+0000 7f71b5fbb640 1 --2- 172.21.15.78:0/749061445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27480 0x55de7cc27860 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009900 tx=0x7f71a8032e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4736f80936d19d3f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:00.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.829+0000 7f719b7fe640 1 -- 172.21.15.78:0/749061445 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a803f070 con 0x55de7cc27480 2024-09-11T00:25:00.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.829+0000 7f719b7fe640 1 -- 172.21.15.78:0/749061445 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71a80316a0 con 0x55de7cc27480 2024-09-11T00:25:00.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.829+0000 7f719b7fe640 1 -- 172.21.15.78:0/749061445 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a8035070 con 0x55de7cc27480 2024-09-11T00:25:00.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.829+0000 7f71a67fc640 1 --2- 172.21.15.78:0/3177888063 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f719c0b5450 0x7f719c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:00.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.829+0000 7f71b57ba640 1 --2- 172.21.15.78:0/3177888063 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f719c0b5450 0x7f719c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:00.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.830+0000 7f71a67fc640 1 -- 172.21.15.78:0/3177888063 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7f71a00e5ca0 con 0x7f71b01076a0 2024-09-11T00:25:00.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.830+0000 7f71b9df3740 1 -- 172.21.15.78:0/749061445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27480 msgr2=0x55de7cc27860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:00.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.830+0000 7f71b9df3740 1 --2- 172.21.15.78:0/749061445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27480 0x55de7cc27860 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009900 tx=0x7f71a8032e70 comp rx=0 tx=0).stop 2024-09-11T00:25:00.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.830+0000 7f71b9df3740 1 -- 172.21.15.78:0/749061445 shutdown_connections 2024-09-11T00:25:00.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.830+0000 7f71b9df3740 1 --2- 172.21.15.78:0/749061445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de7cc38140 0x55de7cc3a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.830+0000 7f71b9df3740 1 --2- 172.21.15.78:0/749061445 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de7cc27da0 0x55de7cc37c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.830+0000 7f71b9df3740 1 --2- 172.21.15.78:0/749061445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27480 0x55de7cc27860 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.830+0000 7f71b9df3740 1 -- 172.21.15.78:0/749061445 >> 172.21.15.78:0/749061445 conn(0x55de7cc252b0 msgr2=0x55de7cc26450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:00.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.830+0000 7f71b9df3740 1 -- 172.21.15.78:0/749061445 shutdown_connections 2024-09-11T00:25:00.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.830+0000 7f71b9df3740 1 -- 172.21.15.78:0/749061445 wait complete. 2024-09-11T00:25:00.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.830+0000 7f71b57ba640 1 --2- 172.21.15.78:0/3177888063 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f719c0b5450 0x7f719c0b7910 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55de7cc2b6c0 tx=0x7f71ac009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:00.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.830+0000 7f71b9df3740 1 -- start start 2024-09-11T00:25:00.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.830+0000 7f71b9df3740 1 Processor -- start 2024-09-11T00:25:00.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f71b9df3740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de7cc27480 0x55de7cc37a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:00.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f71b9df3740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27da0 0x55de7cc34ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:00.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f71b9df3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de7cc38140 0x55de7cc35540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:00.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f71b9df3740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55de7c9ee700 con 0x55de7cc27da0 2024-09-11T00:25:00.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f71b9df3740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55de7cb28110 con 0x55de7cc27480 2024-09-11T00:25:00.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f71b9df3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55de7cc3ad90 con 0x55de7cc38140 2024-09-11T00:25:00.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f71b9df3740 10 client.0 _ll_register_callbacks cb 0x55de7cb41990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:25:00.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f71b4fb9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27da0 0x55de7cc34ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:00.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f71b4fb9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27da0 0x55de7cc34ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43212/0 (socket says 172.21.15.78:43212) 2024-09-11T00:25:00.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f71b4fb9640 1 -- 172.21.15.78:0/485945912 learned_addr learned my addr 172.21.15.78:0/485945912 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:00.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f71b57ba640 1 --2- 172.21.15.78:0/485945912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de7cc27480 0x55de7cc37a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:00.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f71b5fbb640 1 --2- 172.21.15.78:0/485945912 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de7cc38140 0x55de7cc35540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:00.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f71b4fb9640 1 -- 172.21.15.78:0/485945912 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de7cc38140 msgr2=0x55de7cc35540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:00.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f71b4fb9640 1 --2- 172.21.15.78:0/485945912 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de7cc38140 0x55de7cc35540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f71b4fb9640 1 -- 172.21.15.78:0/485945912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de7cc27480 msgr2=0x55de7cc37a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:00.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f71b4fb9640 1 --2- 172.21.15.78:0/485945912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de7cc27480 0x55de7cc37a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f71b4fb9640 1 -- 172.21.15.78:0/485945912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de7cb55c40 con 0x55de7cc27da0 2024-09-11T00:25:00.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f71b5fbb640 1 --2- 172.21.15.78:0/485945912 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de7cc38140 0x55de7cc35540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:25:00.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f71b57ba640 1 --2- 172.21.15.78:0/485945912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de7cc27480 0x55de7cc37a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:25:00.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f71b4fb9640 1 --2- 172.21.15.78:0/485945912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27da0 0x55de7cc34ec0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f71a00e3490 tx=0x7f71a00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97cbf99ec1b4ec36 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:00.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f7198ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:25:00.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f7198ff9640 1 -- 172.21.15.78:0/485945912 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a001d040 con 0x55de7cc27da0 2024-09-11T00:25:00.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.831+0000 7f7198ff9640 1 -- 172.21.15.78:0/485945912 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7f71a0005240 con 0x55de7cc27da0 2024-09-11T00:25:00.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.832+0000 7f71b9df3740 1 -- 172.21.15.78:0/485945912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71a80316a0 con 0x55de7cc27da0 2024-09-11T00:25:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.832+0000 7f7198ff9640 1 -- 172.21.15.78:0/485945912 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f71a00abc20 con 0x55de7cc27da0 2024-09-11T00:25:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.832+0000 7f71b9df3740 10 client.16479 fetch_fsmap learned FSMap version 20 2024-09-11T00:25:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.832+0000 7f71b9df3740 1 -- 172.21.15.78:0/485945912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55de7cc467e0 con 0x55de7cc27da0 2024-09-11T00:25:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.832+0000 7f7198ff9640 1 -- 172.21.15.78:0/485945912 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71a80316a0 con 0x55de7cc27da0 2024-09-11T00:25:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.832+0000 7f7198ff9640 1 -- 172.21.15.78:0/485945912 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f71a00971a0 con 0x55de7cc27da0 2024-09-11T00:25:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.832+0000 7f71b9df3740 10 client.16479 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:25:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.832+0000 7f71b9df3740 10 client.16479 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:25:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.832+0000 7f71b9df3740 20 client.16479 populate_metadata read hostname 'smithi078' 2024-09-11T00:25:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.832+0000 7f71b9df3740 1 --2- 172.21.15.78:0/485945912 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55de7cc47ca0 0x55de7cc4a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.832+0000 7f71b9df3740 4 client.16479 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:25:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.832+0000 7f71b9df3740 1 -- 172.21.15.78:0/485945912 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de7cb9fda0 con 0x55de7cc47ca0 2024-09-11T00:25:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.832+0000 7f71b57ba640 1 --2- 172.21.15.78:0/485945912 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55de7cc47ca0 0x55de7cc4a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.833+0000 7f71b57ba640 1 --2- 172.21.15.78:0/485945912 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55de7cc47ca0 0x55de7cc4a090 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d52a6a1cd292ee87 server_cookie=4afa9200e5260acc in_seq=0 out_seq=0 2024-09-11T00:25:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.833+0000 7f7198ff9640 10 client.16479 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.833+0000 7f7198ff9640 1 -- 172.21.15.78:0/485945912 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55de7cb9fda0 con 0x55de7cc47ca0 2024-09-11T00:25:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.833+0000 7f7198ff9640 10 client.16479 handle_command_reply: tid=0 2024-09-11T00:25:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.833+0000 7f71b9df3740 1 client.16479 shutdown 2024-09-11T00:25:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.833+0000 7f71b9df3740 1 -- 172.21.15.78:0/485945912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27da0 msgr2=0x55de7cc34ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.833+0000 7f71b9df3740 1 --2- 172.21.15.78:0/485945912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27da0 0x55de7cc34ec0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f71a00e3490 tx=0x7f71a00048f0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.834+0000 7f71b9df3740 1 -- 172.21.15.78:0/485945912 shutdown_connections 2024-09-11T00:25:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.834+0000 7f71b9df3740 1 --2- 172.21.15.78:0/485945912 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55de7cc47ca0 0x55de7cc4a090 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.834+0000 7f71b9df3740 1 --2- 172.21.15.78:0/485945912 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de7cc38140 0x55de7cc35540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.834+0000 7f71b9df3740 1 --2- 172.21.15.78:0/485945912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27da0 0x55de7cc34ec0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.834+0000 7f71b9df3740 1 --2- 172.21.15.78:0/485945912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de7cc27480 0x55de7cc37a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.834+0000 7f7198ff9640 0 client.16479 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.834+0000 7f71b9df3740 1 -- 172.21.15.78:0/485945912 >> 172.21.15.78:0/485945912 conn(0x55de7cc252b0 msgr2=0x55de7cc2ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.834+0000 7f71b9df3740 1 -- 172.21.15.78:0/485945912 shutdown_connections 2024-09-11T00:25:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.834+0000 7f71b9df3740 1 -- 172.21.15.78:0/485945912 wait complete. 2024-09-11T00:25:00.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.834+0000 7f71b9df3740 20 client.16479 trim_cache size 0 max 16384 2024-09-11T00:25:00.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.851+0000 7f71b9df3740 1 Processor -- start 2024-09-11T00:25:00.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.851+0000 7f71b9df3740 1 -- start start 2024-09-11T00:25:00.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.851+0000 7f71b9df3740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27480 0x55de7cc26af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:00.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.851+0000 7f71b9df3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de7cc27da0 0x55de7cc43ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:00.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.851+0000 7f71b9df3740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de7cc38140 0x55de7cc202d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:00.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.851+0000 7f71b9df3740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f71b01aa570 con 0x55de7cc27480 2024-09-11T00:25:00.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.851+0000 7f71b9df3740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f71b01acdd0 con 0x55de7cc38140 2024-09-11T00:25:00.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.851+0000 7f71b9df3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f71b01aabc0 con 0x55de7cc27da0 2024-09-11T00:25:00.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.852+0000 7f71b57ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27480 0x55de7cc26af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:00.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.852+0000 7f71b57ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27480 0x55de7cc26af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43224/0 (socket says 172.21.15.78:43224) 2024-09-11T00:25:00.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.852+0000 7f71b57ba640 1 -- 172.21.15.78:0/3972986577 learned_addr learned my addr 172.21.15.78:0/3972986577 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:00.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.852+0000 7f71b57ba640 1 -- 172.21.15.78:0/3972986577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de7cc27da0 msgr2=0x55de7cc43ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:00.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.852+0000 7f71b4fb9640 1 --2- 172.21.15.78:0/3972986577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de7cc27da0 0x55de7cc43ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:00.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.852+0000 7f71b5fbb640 1 --2- 172.21.15.78:0/3972986577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de7cc38140 0x55de7cc202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:00.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.852+0000 7f71b57ba640 1 --2- 172.21.15.78:0/3972986577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de7cc27da0 0x55de7cc43ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.852+0000 7f71b57ba640 1 -- 172.21.15.78:0/3972986577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de7cc38140 msgr2=0x55de7cc202d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.852+0000 7f71b57ba640 1 --2- 172.21.15.78:0/3972986577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de7cc38140 0x55de7cc202d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.852+0000 7f71b57ba640 1 -- 172.21.15.78:0/3972986577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de7cc27b90 con 0x55de7cc27480 2024-09-11T00:25:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.852+0000 7f71b57ba640 1 --2- 172.21.15.78:0/3972986577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27480 0x55de7cc26af0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f71ac0049d0 tx=0x7f71ac015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af06d9071914c9d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.852+0000 7f719affd640 1 -- 172.21.15.78:0/3972986577 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac02c070 con 0x55de7cc27480 2024-09-11T00:25:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.852+0000 7f719affd640 1 -- 172.21.15.78:0/3972986577 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71ac004d20 con 0x55de7cc27480 2024-09-11T00:25:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.852+0000 7f719affd640 1 -- 172.21.15.78:0/3972986577 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0053a0 con 0x55de7cc27480 2024-09-11T00:25:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.853+0000 7f71b9df3740 1 -- 172.21.15.78:0/3972986577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27480 msgr2=0x55de7cc26af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.853+0000 7f71b9df3740 1 --2- 172.21.15.78:0/3972986577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27480 0x55de7cc26af0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f71ac0049d0 tx=0x7f71ac015000 comp rx=0 tx=0).stop 2024-09-11T00:25:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.853+0000 7f71b9df3740 1 -- 172.21.15.78:0/3972986577 shutdown_connections 2024-09-11T00:25:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.853+0000 7f71b9df3740 1 --2- 172.21.15.78:0/3972986577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de7cc38140 0x55de7cc202d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.853+0000 7f71b9df3740 1 --2- 172.21.15.78:0/3972986577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de7cc27da0 0x55de7cc43ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.853+0000 7f71b9df3740 1 --2- 172.21.15.78:0/3972986577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27480 0x55de7cc26af0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.853+0000 7f71b9df3740 1 -- 172.21.15.78:0/3972986577 >> 172.21.15.78:0/3972986577 conn(0x55de7cc252b0 msgr2=0x55de7cc263e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.853+0000 7f71b9df3740 1 -- 172.21.15.78:0/3972986577 shutdown_connections 2024-09-11T00:25:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.853+0000 7f71b9df3740 1 -- 172.21.15.78:0/3972986577 wait complete. 2024-09-11T00:25:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.853+0000 7f71b9df3740 1 -- start start 2024-09-11T00:25:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.854+0000 7f71b9df3740 1 Processor -- start 2024-09-11T00:25:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.854+0000 7f71b9df3740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27480 0x55de7cc402e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.854+0000 7f71b9df3740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de7cc27da0 0x55de7cc40820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.854+0000 7f71b9df3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de7cc38140 0x55de7cc3d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.854+0000 7f71b9df3740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f71b01ab290 con 0x55de7cc27480 2024-09-11T00:25:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.854+0000 7f71b9df3740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f71b01ac700 con 0x55de7cc27da0 2024-09-11T00:25:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.854+0000 7f71b9df3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f71b01ab960 con 0x55de7cc38140 2024-09-11T00:25:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.854+0000 7f71b9df3740 10 client.0 _ll_register_callbacks cb 0x7f71a00058c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:25:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.854+0000 7f71b57ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27480 0x55de7cc402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.854+0000 7f71b57ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27480 0x55de7cc402e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43236/0 (socket says 172.21.15.78:43236) 2024-09-11T00:25:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.854+0000 7f71b57ba640 1 -- 172.21.15.78:0/2522326642 learned_addr learned my addr 172.21.15.78:0/2522326642 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.854+0000 7f71b4fb9640 1 --2- 172.21.15.78:0/2522326642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de7cc27da0 0x55de7cc40820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:00.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.854+0000 7f71b57ba640 1 -- 172.21.15.78:0/2522326642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de7cc38140 msgr2=0x55de7cc3d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:00.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.854+0000 7f71b57ba640 1 --2- 172.21.15.78:0/2522326642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de7cc38140 0x55de7cc3d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.854+0000 7f71b57ba640 1 -- 172.21.15.78:0/2522326642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de7cc27da0 msgr2=0x55de7cc40820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:00.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.854+0000 7f71b57ba640 1 --2- 172.21.15.78:0/2522326642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de7cc27da0 0x55de7cc40820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.854+0000 7f71b57ba640 1 -- 172.21.15.78:0/2522326642 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de7cc3d850 con 0x55de7cc27480 2024-09-11T00:25:00.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.855+0000 7f71b57ba640 1 --2- 172.21.15.78:0/2522326642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27480 0x55de7cc402e0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f71ac005f20 tx=0x7f71ac02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df365491531ff40 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:00.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.855+0000 7f7198ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:25:00.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.855+0000 7f7198ff9640 1 -- 172.21.15.78:0/2522326642 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac03e060 con 0x55de7cc27480 2024-09-11T00:25:00.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.855+0000 7f7198ff9640 1 -- 172.21.15.78:0/2522326642 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7f71ac005120 con 0x55de7cc27480 2024-09-11T00:25:00.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.855+0000 7f71b9df3740 1 -- 172.21.15.78:0/2522326642 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71ac004d20 con 0x55de7cc27480 2024-09-11T00:25:00.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.855+0000 7f7198ff9640 1 -- 172.21.15.78:0/2522326642 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f71ac02c070 con 0x55de7cc27480 2024-09-11T00:25:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.855+0000 7f71b9df3740 10 client.16485 fetch_fsmap learned FSMap version 20 2024-09-11T00:25:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.855+0000 7f71b9df3740 1 -- 172.21.15.78:0/2522326642 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55de7ccb5610 con 0x55de7cc27480 2024-09-11T00:25:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.855+0000 7f7198ff9640 1 -- 172.21.15.78:0/2522326642 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71ac004d20 con 0x55de7cc27480 2024-09-11T00:25:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.855+0000 7f7198ff9640 1 -- 172.21.15.78:0/2522326642 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f71ac038030 con 0x55de7cc27480 2024-09-11T00:25:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.855+0000 7f71b9df3740 10 client.16485 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:25:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.855+0000 7f71b9df3740 10 client.16485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:25:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.855+0000 7f71b9df3740 20 client.16485 populate_metadata read hostname 'smithi078' 2024-09-11T00:25:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.855+0000 7f71b9df3740 1 --2- 172.21.15.78:0/2522326642 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55de7ccb5d00 0x55de7ccb8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.855+0000 7f71b9df3740 4 client.16485 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:25:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.855+0000 7f71b9df3740 1 -- 172.21.15.78:0/2522326642 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55de7cb9b850 con 0x55de7ccb5d00 2024-09-11T00:25:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.856+0000 7f71b4fb9640 1 --2- 172.21.15.78:0/2522326642 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55de7ccb5d00 0x55de7ccb8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.856+0000 7f71b4fb9640 1 --2- 172.21.15.78:0/2522326642 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55de7ccb5d00 0x55de7ccb8120 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7c1692e56c0efa server_cookie=a14c4d852bbc2a16 in_seq=0 out_seq=0 2024-09-11T00:25:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.856+0000 7f7198ff9640 10 client.16485 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.856+0000 7f7198ff9640 1 -- 172.21.15.78:0/2522326642 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4634 (crc 0 0 0) 0x55de7cb9b850 con 0x55de7ccb5d00 2024-09-11T00:25:00.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.856+0000 7f7198ff9640 10 client.16485 handle_command_reply: tid=0 2024-09-11T00:25:00.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.856+0000 7f71b9df3740 1 client.16485 shutdown 2024-09-11T00:25:00.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.856+0000 7f71b9df3740 1 -- 172.21.15.78:0/2522326642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27480 msgr2=0x55de7cc402e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:00.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.856+0000 7f71b9df3740 1 --2- 172.21.15.78:0/2522326642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27480 0x55de7cc402e0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f71ac005f20 tx=0x7f71ac02a730 comp rx=0 tx=0).stop 2024-09-11T00:25:00.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.856+0000 7f71b9df3740 1 -- 172.21.15.78:0/2522326642 shutdown_connections 2024-09-11T00:25:00.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.856+0000 7f71b9df3740 1 --2- 172.21.15.78:0/2522326642 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55de7ccb5d00 0x55de7ccb8120 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.856+0000 7f71b9df3740 1 --2- 172.21.15.78:0/2522326642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55de7cc38140 0x55de7cc3d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.856+0000 7f71b9df3740 1 --2- 172.21.15.78:0/2522326642 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55de7cc27da0 0x55de7cc40820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.856+0000 7f7198ff9640 0 client.16485 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:00.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.856+0000 7f71b9df3740 1 --2- 172.21.15.78:0/2522326642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55de7cc27480 0x55de7cc402e0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.856+0000 7f71b9df3740 1 -- 172.21.15.78:0/2522326642 >> 172.21.15.78:0/2522326642 conn(0x55de7cc252b0 msgr2=0x55de7cc23bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:00.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.857+0000 7f71b9df3740 1 -- 172.21.15.78:0/2522326642 shutdown_connections 2024-09-11T00:25:00.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.857+0000 7f71b9df3740 1 -- 172.21.15.78:0/2522326642 wait complete. 2024-09-11T00:25:00.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.857+0000 7f71b9df3740 20 client.16485 trim_cache size 0 max 16384 2024-09-11T00:25:00.915 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:25:00.915 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-11T00:25:00.916 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {}, 2024-09-11T00:25:00.916 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:25:00.916 INFO:teuthology.orchestra.run.smithi078.stdout: "f6eb5d15-216e-4f8b-b451-2f71b931998f": { 2024-09-11T00:25:00.916 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:48.289319+0000", 2024-09-11T00:25:00.916 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:00.916 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:00.916 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:00.916 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:00.916 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:00.916 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:00.916 INFO:teuthology.orchestra.run.smithi078.stdout: "e21db329-a274-4cfd-924a-8ec929e04bd1": { 2024-09-11T00:25:00.916 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:41.131504+0000", 2024-09-11T00:25:00.917 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:00.917 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:00.917 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:00.917 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:00.917 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:00.917 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:00.917 INFO:teuthology.orchestra.run.smithi078.stdout: "b854cbd3-8ca7-4277-a205-8887d2ff5567": { 2024-09-11T00:25:00.917 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:11.182949+0000", 2024-09-11T00:25:00.917 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:00.917 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:00.917 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:00.918 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:00.918 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:00.918 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:00.918 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:25:00.918 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:25:00.918 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:00.918 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:00.918 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:00.918 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:00.918 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:00.918 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:00.918 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:25:00.919 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:25:00.919 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:00.919 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:00.919 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:00.919 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:00.919 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:00.919 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:00.919 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:25:00.919 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:25:00.919 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:00.919 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:00.919 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:00.919 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:00.919 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:00.920 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:00.920 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:25:00.920 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:25:00.920 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:00.920 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:00.920 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:00.920 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:00.920 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:00.920 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:00.920 INFO:teuthology.orchestra.run.smithi078.stdout: "81d31d3a-c224-4ded-9f00-1a7dfc099ec4": { 2024-09-11T00:25:00.920 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:16.296700+0000", 2024-09-11T00:25:00.920 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:00.920 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:00.921 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:00.921 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:00.921 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:00.921 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:00.921 INFO:teuthology.orchestra.run.smithi078.stdout: "1c04b4f1-c4c4-4289-b172-fba45b64018a": { 2024-09-11T00:25:00.921 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:24:27.591301+0000", 2024-09-11T00:25:00.921 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:00.921 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:00.921 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:00.921 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:00.921 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:00.921 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:00.921 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:25:00.921 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:25:00.922 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:00.922 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:00.922 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:00.922 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:00.922 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:00.922 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:00.922 INFO:teuthology.orchestra.run.smithi078.stdout: "38a1d30d-5f4c-460a-afcd-e6c60b97e43a": { 2024-09-11T00:25:00.922 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:58.127727+0000", 2024-09-11T00:25:00.922 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:00.922 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:00.922 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:00.922 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:00.922 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:00.922 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:00.923 INFO:teuthology.orchestra.run.smithi078.stdout: "8ec9e858-aa62-420d-a112-e62ea7810e63": { 2024-09-11T00:25:00.923 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:18.882749+0000", 2024-09-11T00:25:00.923 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:00.923 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:00.923 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:00.923 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:00.923 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:00.923 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:00.923 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:25:00.923 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:25:00.923 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:00.923 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:00.924 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:00.924 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:00.924 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:00.924 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:00.924 INFO:teuthology.orchestra.run.smithi078.stdout: "1b9391c2-08f3-479a-9538-deea28f7743b": { 2024-09-11T00:25:00.924 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:02.327508+0000", 2024-09-11T00:25:00.924 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:00.924 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:00.924 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:00.924 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:00.924 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:00.924 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:00.924 INFO:teuthology.orchestra.run.smithi078.stdout: "e0002672-e432-4890-ab9f-20c513c5e3b6": { 2024-09-11T00:25:00.925 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:21:37.161715+0000", 2024-09-11T00:25:00.925 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:00.925 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:00.925 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:00.925 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:00.925 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:00.925 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:00.925 INFO:teuthology.orchestra.run.smithi078.stdout: "f494d5ed-e0dc-44bb-8aba-a861b3e751f4": { 2024-09-11T00:25:00.925 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:55.251691+0000", 2024-09-11T00:25:00.925 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:00.925 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:00.925 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:00.926 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:00.926 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:00.926 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:25:00.926 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:25:00.926 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:25:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.857+0000 7f71b7a1e640 1 -- 172.21.15.78:0/3177888063 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f719c0b5450 msgr2=0x7f719c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.857+0000 7f71b7a1e640 1 --2- 172.21.15.78:0/3177888063 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f719c0b5450 0x7f719c0b7910 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55de7cc2b6c0 tx=0x7f71ac009680 comp rx=0 tx=0).stop 2024-09-11T00:25:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.857+0000 7f71b7a1e640 1 -- 172.21.15.78:0/3177888063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b01076a0 msgr2=0x7f71b0199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.857+0000 7f71b7a1e640 1 --2- 172.21.15.78:0/3177888063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b01076a0 0x7f71b0199830 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f71a000c970 tx=0x7f71a000ce30 comp rx=0 tx=0).stop 2024-09-11T00:25:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.857+0000 7f71b7a1e640 1 -- 172.21.15.78:0/3177888063 shutdown_connections 2024-09-11T00:25:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.857+0000 7f71b7a1e640 1 --2- 172.21.15.78:0/3177888063 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f719c0b5450 0x7f719c0b7910 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.857+0000 7f71b7a1e640 1 --2- 172.21.15.78:0/3177888063 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71b0108020 0x7f71b019ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.857+0000 7f71b7a1e640 1 --2- 172.21.15.78:0/3177888063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b01076a0 0x7f71b0199830 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.857+0000 7f71b7a1e640 1 --2- 172.21.15.78:0/3177888063 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f71b0101c90 0x7f71b01992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:00.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.857+0000 7f71b7a1e640 1 -- 172.21.15.78:0/3177888063 >> 172.21.15.78:0/3177888063 conn(0x7f71b00fd700 msgr2=0x7f71b006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:00.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.857+0000 7f71b7a1e640 1 -- 172.21.15.78:0/3177888063 shutdown_connections 2024-09-11T00:25:00.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:00.857+0000 7f71b7a1e640 1 -- 172.21.15.78:0/3177888063 wait complete. 2024-09-11T00:25:01.806 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:25:01.806 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:25:02.058 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:25:02.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:01 smithi078 ceph-mon[30865]: pgmap v584: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-11T00:25:02.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:01 smithi112 ceph-mon[35627]: pgmap v584: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-11T00:25:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:01 smithi138 ceph-mon[35019]: pgmap v584: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-11T00:25:02.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.592+0000 7f2fdbbae640 1 -- 172.21.15.78:0/2625269998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fd4108060 msgr2=0x7f2fd410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:02.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.592+0000 7f2fdbbae640 1 --2- 172.21.15.78:0/2625269998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fd4108060 0x7f2fd410e860 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009900 tx=0x7f2fc402a410 comp rx=0 tx=0).stop 2024-09-11T00:25:02.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.592+0000 7f2fdbbae640 1 -- 172.21.15.78:0/2625269998 shutdown_connections 2024-09-11T00:25:02.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.592+0000 7f2fdbbae640 1 --2- 172.21.15.78:0/2625269998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fd4108060 0x7f2fd410e860 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:02.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.592+0000 7f2fdbbae640 1 --2- 172.21.15.78:0/2625269998 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd41076e0 0x7f2fd4107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:02.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.592+0000 7f2fdbbae640 1 --2- 172.21.15.78:0/2625269998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fd4101cd0 0x7f2fd41020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:02.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.592+0000 7f2fdbbae640 1 -- 172.21.15.78:0/2625269998 >> 172.21.15.78:0/2625269998 conn(0x7f2fd40fd720 msgr2=0x7f2fd40ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:02.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.592+0000 7f2fdbbae640 1 -- 172.21.15.78:0/2625269998 shutdown_connections 2024-09-11T00:25:02.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.592+0000 7f2fdbbae640 1 -- 172.21.15.78:0/2625269998 wait complete. 2024-09-11T00:25:02.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.593+0000 7f2fdbbae640 1 Processor -- start 2024-09-11T00:25:02.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.593+0000 7f2fdbbae640 1 -- start start 2024-09-11T00:25:02.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.593+0000 7f2fdbbae640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd4101cd0 0x7f2fd41981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:02.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.594+0000 7f2fdbbae640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fd41076e0 0x7f2fd4198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:02.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.594+0000 7f2fdbbae640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fd4108060 0x7f2fd419dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:02.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.594+0000 7f2fdbbae640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd4111d20 con 0x7f2fd4108060 2024-09-11T00:25:02.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.594+0000 7f2fdbbae640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd4111ba0 con 0x7f2fd4101cd0 2024-09-11T00:25:02.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.594+0000 7f2fdbbae640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd4111ea0 con 0x7f2fd41076e0 2024-09-11T00:25:02.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.594+0000 7f2fda14b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fd4108060 0x7f2fd419dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:02.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.594+0000 7f2fda14b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fd4108060 0x7f2fd419dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43252/0 (socket says 172.21.15.78:43252) 2024-09-11T00:25:02.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.594+0000 7f2fda14b640 1 -- 172.21.15.78:0/2955121528 learned_addr learned my addr 172.21.15.78:0/2955121528 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:02.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.594+0000 7f2fd994a640 1 --2- 172.21.15.78:0/2955121528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd4101cd0 0x7f2fd41981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:02.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.594+0000 7f2fd9149640 1 --2- 172.21.15.78:0/2955121528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fd41076e0 0x7f2fd4198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:02.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.594+0000 7f2fda14b640 1 -- 172.21.15.78:0/2955121528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fd41076e0 msgr2=0x7f2fd4198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:02.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.594+0000 7f2fda14b640 1 --2- 172.21.15.78:0/2955121528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fd41076e0 0x7f2fd4198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:02.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.594+0000 7f2fda14b640 1 -- 172.21.15.78:0/2955121528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd4101cd0 msgr2=0x7f2fd41981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:02.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.594+0000 7f2fda14b640 1 --2- 172.21.15.78:0/2955121528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd4101cd0 0x7f2fd41981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:02.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.594+0000 7f2fda14b640 1 -- 172.21.15.78:0/2955121528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd419e2a0 con 0x7f2fd4108060 2024-09-11T00:25:02.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.594+0000 7f2fd9149640 1 --2- 172.21.15.78:0/2955121528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fd41076e0 0x7f2fd4198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:25:02.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.594+0000 7f2fda14b640 1 --2- 172.21.15.78:0/2955121528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fd4108060 0x7f2fd419dad0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4004770 tx=0x7f2fc4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:02.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.594+0000 7f2fd2ffd640 1 -- 172.21.15.78:0/2955121528 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc403f030 con 0x7f2fd4108060 2024-09-11T00:25:02.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.594+0000 7f2fd2ffd640 1 -- 172.21.15.78:0/2955121528 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fc4003aa0 con 0x7f2fd4108060 2024-09-11T00:25:02.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.594+0000 7f2fdbbae640 1 -- 172.21.15.78:0/2955121528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fd419e530 con 0x7f2fd4108060 2024-09-11T00:25:02.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.594+0000 7f2fd2ffd640 1 -- 172.21.15.78:0/2955121528 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4035070 con 0x7f2fd4108060 2024-09-11T00:25:02.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.594+0000 7f2fdbbae640 1 -- 172.21.15.78:0/2955121528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fd41a4c50 con 0x7f2fd4108060 2024-09-11T00:25:02.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.595+0000 7f2fdbbae640 1 -- 172.21.15.78:0/2955121528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fd41020b0 con 0x7f2fd4108060 2024-09-11T00:25:02.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.597+0000 7f2fd2ffd640 1 -- 172.21.15.78:0/2955121528 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f2fc40035f0 con 0x7f2fd4108060 2024-09-11T00:25:02.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.597+0000 7f2fd2ffd640 1 --2- 172.21.15.78:0/2955121528 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2fbc0b5450 0x7f2fbc0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:02.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.597+0000 7f2fd994a640 1 --2- 172.21.15.78:0/2955121528 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2fbc0b5450 0x7f2fbc0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:02.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.597+0000 7f2fd2ffd640 1 -- 172.21.15.78:0/2955121528 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7f2fc4106aa0 con 0x7f2fd4108060 2024-09-11T00:25:02.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.598+0000 7f2fd994a640 1 --2- 172.21.15.78:0/2955121528 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2fbc0b5450 0x7f2fbc0b7910 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc005d00 tx=0x7f2fcc00b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:02.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.601+0000 7f2fd2ffd640 1 -- 172.21.15.78:0/2955121528 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2fc40cd5b0 con 0x7f2fd4108060 2024-09-11T00:25:02.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.813+0000 7f2fdbbae640 1 -- 172.21.15.78:0/2955121528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fd4109e40 con 0x7f2fd4108060 2024-09-11T00:25:02.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.813+0000 7f2fd2ffd640 1 -- 172.21.15.78:0/2955121528 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f2fc40cceb0 con 0x7f2fd4108060 2024-09-11T00:25:02.816 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:25:02.816 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:25:02.817 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:25:02.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.815+0000 7f2fdbbae640 1 -- 172.21.15.78:0/2955121528 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2fbc0b5450 msgr2=0x7f2fbc0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:02.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.815+0000 7f2fdbbae640 1 --2- 172.21.15.78:0/2955121528 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2fbc0b5450 0x7f2fbc0b7910 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc005d00 tx=0x7f2fcc00b410 comp rx=0 tx=0).stop 2024-09-11T00:25:02.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.815+0000 7f2fdbbae640 1 -- 172.21.15.78:0/2955121528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fd4108060 msgr2=0x7f2fd419dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:02.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.815+0000 7f2fdbbae640 1 --2- 172.21.15.78:0/2955121528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fd4108060 0x7f2fd419dad0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4004770 tx=0x7f2fc4004270 comp rx=0 tx=0).stop 2024-09-11T00:25:02.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.815+0000 7f2fdbbae640 1 -- 172.21.15.78:0/2955121528 shutdown_connections 2024-09-11T00:25:02.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.815+0000 7f2fdbbae640 1 --2- 172.21.15.78:0/2955121528 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f2fbc0b5450 0x7f2fbc0b7910 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:02.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.815+0000 7f2fdbbae640 1 --2- 172.21.15.78:0/2955121528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fd4108060 0x7f2fd419dad0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:02.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.815+0000 7f2fdbbae640 1 --2- 172.21.15.78:0/2955121528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2fd41076e0 0x7f2fd4198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:02.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.815+0000 7f2fdbbae640 1 --2- 172.21.15.78:0/2955121528 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2fd4101cd0 0x7f2fd41981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:02.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.815+0000 7f2fdbbae640 1 -- 172.21.15.78:0/2955121528 >> 172.21.15.78:0/2955121528 conn(0x7f2fd40fd720 msgr2=0x7f2fd40ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:02.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.816+0000 7f2fdbbae640 1 -- 172.21.15.78:0/2955121528 shutdown_connections 2024-09-11T00:25:02.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:02.816+0000 7f2fdbbae640 1 -- 172.21.15.78:0/2955121528 wait complete. 2024-09-11T00:25:03.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:02 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2955121528' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:25:03.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:02 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2955121528' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:25:03.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:02 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2955121528' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:25:03.516 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:25:03.765 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:25:04.198 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:03 smithi078 ceph-mon[30865]: pgmap v585: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-11T00:25:04.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:03 smithi112 ceph-mon[35627]: pgmap v585: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-11T00:25:04.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:03 smithi138 ceph-mon[35019]: pgmap v585: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-11T00:25:04.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.277+0000 7f06fcc21640 1 -- 172.21.15.78:0/486951004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06f8108020 msgr2=0x7f06f810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:04.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.277+0000 7f06fcc21640 1 --2- 172.21.15.78:0/486951004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06f8108020 0x7f06f810e820 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f06e8009ca0 tx=0x7f06e802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.277+0000 7f06fcc21640 1 -- 172.21.15.78:0/486951004 shutdown_connections 2024-09-11T00:25:04.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.277+0000 7f06fcc21640 1 --2- 172.21.15.78:0/486951004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06f8108020 0x7f06f810e820 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.277+0000 7f06fcc21640 1 --2- 172.21.15.78:0/486951004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06f81076a0 0x7f06f8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.277+0000 7f06fcc21640 1 --2- 172.21.15.78:0/486951004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06f8101c90 0x7f06f8102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.277+0000 7f06fcc21640 1 -- 172.21.15.78:0/486951004 >> 172.21.15.78:0/486951004 conn(0x7f06f80fd700 msgr2=0x7f06f80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:04.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.277+0000 7f06fcc21640 1 -- 172.21.15.78:0/486951004 shutdown_connections 2024-09-11T00:25:04.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.277+0000 7f06fcc21640 1 -- 172.21.15.78:0/486951004 wait complete. 2024-09-11T00:25:04.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.278+0000 7f06fcc21640 1 Processor -- start 2024-09-11T00:25:04.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.278+0000 7f06fcc21640 1 -- start start 2024-09-11T00:25:04.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.278+0000 7f06fcc21640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06f8101c90 0x7f06f819a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:04.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.278+0000 7f06fcc21640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06f81076a0 0x7f06f819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:04.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.278+0000 7f06fcc21640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06f8108020 0x7f06f819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:04.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.278+0000 7f06fcc21640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f06f8111ce0 con 0x7f06f8101c90 2024-09-11T00:25:04.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.278+0000 7f06fcc21640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f06f8111b60 con 0x7f06f81076a0 2024-09-11T00:25:04.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.278+0000 7f06fcc21640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f06f8111e60 con 0x7f06f8108020 2024-09-11T00:25:04.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.278+0000 7f06f659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06f8101c90 0x7f06f819a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:04.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.278+0000 7f06f659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06f8101c90 0x7f06f819a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43264/0 (socket says 172.21.15.78:43264) 2024-09-11T00:25:04.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.278+0000 7f06f659c640 1 -- 172.21.15.78:0/1534509562 learned_addr learned my addr 172.21.15.78:0/1534509562 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:04.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.279+0000 7f06f6d9d640 1 --2- 172.21.15.78:0/1534509562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06f8108020 0x7f06f819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:04.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.279+0000 7f06f5d9b640 1 --2- 172.21.15.78:0/1534509562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06f81076a0 0x7f06f819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:04.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.279+0000 7f06f659c640 1 -- 172.21.15.78:0/1534509562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06f8108020 msgr2=0x7f06f819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:04.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.279+0000 7f06f659c640 1 --2- 172.21.15.78:0/1534509562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06f8108020 0x7f06f819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.279+0000 7f06f659c640 1 -- 172.21.15.78:0/1534509562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06f81076a0 msgr2=0x7f06f819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:04.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.279+0000 7f06f659c640 1 --2- 172.21.15.78:0/1534509562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06f81076a0 0x7f06f819a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.279+0000 7f06f659c640 1 -- 172.21.15.78:0/1534509562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f81a5440 con 0x7f06f8101c90 2024-09-11T00:25:04.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.279+0000 7f06f659c640 1 --2- 172.21.15.78:0/1534509562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06f8101c90 0x7f06f819a060 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f06f000c890 tx=0x7f06f000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:04.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.279+0000 7f06ef7fe640 1 -- 172.21.15.78:0/1534509562 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f0004220 con 0x7f06f8101c90 2024-09-11T00:25:04.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.279+0000 7f06fcc21640 1 -- 172.21.15.78:0/1534509562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f81a5730 con 0x7f06f8101c90 2024-09-11T00:25:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.279+0000 7f06ef7fe640 1 -- 172.21.15.78:0/1534509562 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06f00043c0 con 0x7f06f8101c90 2024-09-11T00:25:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.279+0000 7f06ef7fe640 1 -- 172.21.15.78:0/1534509562 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f0004a00 con 0x7f06f8101c90 2024-09-11T00:25:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.279+0000 7f06fcc21640 1 -- 172.21.15.78:0/1534509562 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f81a5cc0 con 0x7f06f8101c90 2024-09-11T00:25:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.281+0000 7f06ef7fe640 1 -- 172.21.15.78:0/1534509562 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f06f00079b0 con 0x7f06f8101c90 2024-09-11T00:25:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.282+0000 7f06feff6740 1 Processor -- start 2024-09-11T00:25:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.282+0000 7f06feff6740 1 -- start start 2024-09-11T00:25:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.282+0000 7f06feff6740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f1a036a4d0 0x55f1a036a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.282+0000 7f06feff6740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a036adf0 0x55f1a037ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.282+0000 7f06feff6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1a037b190 0x55f1a037d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.282+0000 7f06feff6740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f1a02e0ea0 con 0x55f1a036adf0 2024-09-11T00:25:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.282+0000 7f06feff6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f1a02d02d0 con 0x55f1a037b190 2024-09-11T00:25:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.282+0000 7f06feff6740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55f1a02d40e0 con 0x55f1a036a4d0 2024-09-11T00:25:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.282+0000 7f06f659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a036adf0 0x55f1a037ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.282+0000 7f06f659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a036adf0 0x55f1a037ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43270/0 (socket says 172.21.15.78:43270) 2024-09-11T00:25:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.282+0000 7f06f659c640 1 -- 172.21.15.78:0/2753780152 learned_addr learned my addr 172.21.15.78:0/2753780152 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.282+0000 7f06ef7fe640 1 --2- 172.21.15.78:0/1534509562 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f06e40b5450 0x7f06e40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.282+0000 7f06f6d9d640 1 --2- 172.21.15.78:0/2753780152 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f1a036a4d0 0x55f1a036a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.283+0000 7f06f6d9d640 1 --2- 172.21.15.78:0/1534509562 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f06e40b5450 0x7f06e40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.283+0000 7f06f659c640 1 -- 172.21.15.78:0/2753780152 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f1a036a4d0 msgr2=0x55f1a036a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.283+0000 7f06f659c640 1 --2- 172.21.15.78:0/2753780152 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f1a036a4d0 0x55f1a036a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.283+0000 7f06f659c640 1 -- 172.21.15.78:0/2753780152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1a037b190 msgr2=0x55f1a037d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.283+0000 7f06f5d9b640 1 --2- 172.21.15.78:0/2753780152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1a037b190 0x55f1a037d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.283+0000 7f06f659c640 1 --2- 172.21.15.78:0/2753780152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1a037b190 0x55f1a037d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.283+0000 7f06f659c640 1 -- 172.21.15.78:0/2753780152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1a002e650 con 0x55f1a036adf0 2024-09-11T00:25:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.283+0000 7f06f5d9b640 1 --2- 172.21.15.78:0/2753780152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1a037b190 0x55f1a037d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:25:04.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.283+0000 7f06ef7fe640 1 -- 172.21.15.78:0/1534509562 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7f06f00e5ea0 con 0x7f06f8101c90 2024-09-11T00:25:04.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.283+0000 7f06f659c640 1 --2- 172.21.15.78:0/2753780152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a036adf0 0x55f1a037ac50 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f06f00e34c0 tx=0x7f06f001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a73dfc6f13ea80 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:04.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.283+0000 7f06f6d9d640 1 --2- 172.21.15.78:0/1534509562 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f06e40b5450 0x7f06e40b7910 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f06e802f500 tx=0x7f06e80095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:04.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.283+0000 7f06ecff9640 1 -- 172.21.15.78:0/2753780152 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f00aba20 con 0x55f1a036adf0 2024-09-11T00:25:04.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.283+0000 7f06ecff9640 1 -- 172.21.15.78:0/2753780152 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06f0056730 con 0x55f1a036adf0 2024-09-11T00:25:04.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.283+0000 7f06ecff9640 1 -- 172.21.15.78:0/2753780152 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f001b120 con 0x55f1a036adf0 2024-09-11T00:25:04.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.284+0000 7f06feff6740 1 -- 172.21.15.78:0/2753780152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a036adf0 msgr2=0x55f1a037ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:04.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.284+0000 7f06feff6740 1 --2- 172.21.15.78:0/2753780152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a036adf0 0x55f1a037ac50 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f06f00e34c0 tx=0x7f06f001f000 comp rx=0 tx=0).stop 2024-09-11T00:25:04.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.284+0000 7f06feff6740 1 -- 172.21.15.78:0/2753780152 shutdown_connections 2024-09-11T00:25:04.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.284+0000 7f06feff6740 1 --2- 172.21.15.78:0/2753780152 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1a037b190 0x55f1a037d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.284+0000 7f06feff6740 1 --2- 172.21.15.78:0/2753780152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a036adf0 0x55f1a037ac50 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.284+0000 7f06feff6740 1 --2- 172.21.15.78:0/2753780152 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f1a036a4d0 0x55f1a036a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.284+0000 7f06feff6740 1 -- 172.21.15.78:0/2753780152 >> 172.21.15.78:0/2753780152 conn(0x55f1a0368300 msgr2=0x55f1a03694a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:04.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.284+0000 7f06feff6740 1 -- 172.21.15.78:0/2753780152 shutdown_connections 2024-09-11T00:25:04.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.284+0000 7f06feff6740 1 -- 172.21.15.78:0/2753780152 wait complete. 2024-09-11T00:25:04.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.284+0000 7f06feff6740 1 -- start start 2024-09-11T00:25:04.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.284+0000 7f06feff6740 1 Processor -- start 2024-09-11T00:25:04.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06feff6740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a036a4d0 0x55f1a037aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:04.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06feff6740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f1a036adf0 0x55f1a0377eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:04.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06feff6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1a037b190 0x55f1a0378490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:04.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06feff6740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f1a0131700 con 0x55f1a036a4d0 2024-09-11T00:25:04.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06feff6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55f1a026b160 con 0x55f1a037b190 2024-09-11T00:25:04.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06feff6740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55f1a037dde0 con 0x55f1a036adf0 2024-09-11T00:25:04.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06feff6740 10 client.0 _ll_register_callbacks cb 0x55f1a02849e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:25:04.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06f659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a036a4d0 0x55f1a037aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:04.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06f659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a036a4d0 0x55f1a037aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43280/0 (socket says 172.21.15.78:43280) 2024-09-11T00:25:04.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06f659c640 1 -- 172.21.15.78:0/4115786465 learned_addr learned my addr 172.21.15.78:0/4115786465 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:04.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06f5d9b640 1 --2- 172.21.15.78:0/4115786465 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f1a036adf0 0x55f1a0377eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:04.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06f6d9d640 1 --2- 172.21.15.78:0/4115786465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1a037b190 0x55f1a0378490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:04.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06f659c640 1 -- 172.21.15.78:0/4115786465 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f1a036adf0 msgr2=0x55f1a0377eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:04.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06f659c640 1 --2- 172.21.15.78:0/4115786465 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f1a036adf0 0x55f1a0377eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06f659c640 1 -- 172.21.15.78:0/4115786465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1a037b190 msgr2=0x55f1a0378490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:04.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06f659c640 1 --2- 172.21.15.78:0/4115786465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1a037b190 0x55f1a0378490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06f659c640 1 -- 172.21.15.78:0/4115786465 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1a0298c90 con 0x55f1a036a4d0 2024-09-11T00:25:04.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06f5d9b640 1 --2- 172.21.15.78:0/4115786465 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f1a036adf0 0x55f1a0377eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:25:04.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06f659c640 1 --2- 172.21.15.78:0/4115786465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a036a4d0 0x55f1a037aa60 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f06f0005760 tx=0x7f06f00abea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956cd0a2e03a1cef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:04.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:25:04.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06ddffb640 1 -- 172.21.15.78:0/4115786465 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f00aba20 con 0x55f1a036a4d0 2024-09-11T00:25:04.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06ddffb640 1 -- 172.21.15.78:0/4115786465 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7f06f00cf110 con 0x55f1a036a4d0 2024-09-11T00:25:04.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06feff6740 1 -- 172.21.15.78:0/4115786465 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f1a02e2df0 con 0x55f1a036a4d0 2024-09-11T00:25:04.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06ddffb640 1 -- 172.21.15.78:0/4115786465 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f06f00e3a00 con 0x55f1a036a4d0 2024-09-11T00:25:04.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06feff6740 10 client.16503 fetch_fsmap learned FSMap version 20 2024-09-11T00:25:04.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.285+0000 7f06feff6740 1 -- 172.21.15.78:0/4115786465 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f1a0389660 con 0x55f1a036a4d0 2024-09-11T00:25:04.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.286+0000 7f06ddffb640 1 -- 172.21.15.78:0/4115786465 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f1a02e2df0 con 0x55f1a036a4d0 2024-09-11T00:25:04.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.286+0000 7f06ddffb640 1 -- 172.21.15.78:0/4115786465 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f06f00e4ce0 con 0x55f1a036a4d0 2024-09-11T00:25:04.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.286+0000 7f06feff6740 10 client.16503 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:25:04.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.286+0000 7f06feff6740 10 client.16503 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:25:04.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.286+0000 7f06feff6740 20 client.16503 populate_metadata read hostname 'smithi078' 2024-09-11T00:25:04.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.286+0000 7f06feff6740 1 --2- 172.21.15.78:0/4115786465 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55f1a038a9b0 0x55f1a038cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:04.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.286+0000 7f06feff6740 4 client.16503 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:25:04.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.286+0000 7f06feff6740 1 -- 172.21.15.78:0/4115786465 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1a02de8a0 con 0x55f1a038a9b0 2024-09-11T00:25:04.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.286+0000 7f06f5d9b640 1 --2- 172.21.15.78:0/4115786465 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55f1a038a9b0 0x55f1a038cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:04.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.286+0000 7f06ddffb640 10 client.16503 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:04.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.286+0000 7f06f5d9b640 1 --2- 172.21.15.78:0/4115786465 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55f1a038a9b0 0x55f1a038cda0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dab1be9d2bef22d8 server_cookie=4495742d4da7e8f4 in_seq=0 out_seq=0 2024-09-11T00:25:04.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.287+0000 7f06ddffb640 1 -- 172.21.15.78:0/4115786465 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f1a02de8a0 con 0x55f1a038a9b0 2024-09-11T00:25:04.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.287+0000 7f06ddffb640 10 client.16503 handle_command_reply: tid=0 2024-09-11T00:25:04.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.287+0000 7f06feff6740 1 client.16503 shutdown 2024-09-11T00:25:04.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.287+0000 7f06feff6740 1 -- 172.21.15.78:0/4115786465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a036a4d0 msgr2=0x55f1a037aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:04.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.287+0000 7f06feff6740 1 --2- 172.21.15.78:0/4115786465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a036a4d0 0x55f1a037aa60 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f06f0005760 tx=0x7f06f00abea0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.287+0000 7f06feff6740 1 -- 172.21.15.78:0/4115786465 shutdown_connections 2024-09-11T00:25:04.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.287+0000 7f06feff6740 1 --2- 172.21.15.78:0/4115786465 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55f1a038a9b0 0x55f1a038cda0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.287+0000 7f06feff6740 1 --2- 172.21.15.78:0/4115786465 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1a037b190 0x55f1a0378490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.287+0000 7f06ddffb640 0 client.16503 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:04.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.287+0000 7f06feff6740 1 --2- 172.21.15.78:0/4115786465 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f1a036adf0 0x55f1a0377eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.287+0000 7f06feff6740 1 --2- 172.21.15.78:0/4115786465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a036a4d0 0x55f1a037aa60 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.287+0000 7f06feff6740 1 -- 172.21.15.78:0/4115786465 >> 172.21.15.78:0/4115786465 conn(0x55f1a0368300 msgr2=0x55f1a036dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:04.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.287+0000 7f06feff6740 1 -- 172.21.15.78:0/4115786465 shutdown_connections 2024-09-11T00:25:04.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.287+0000 7f06feff6740 1 -- 172.21.15.78:0/4115786465 wait complete. 2024-09-11T00:25:04.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.288+0000 7f06feff6740 20 client.16503 trim_cache size 0 max 16384 2024-09-11T00:25:04.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.300+0000 7f06feff6740 1 Processor -- start 2024-09-11T00:25:04.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.300+0000 7f06feff6740 1 -- start start 2024-09-11T00:25:04.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.301+0000 7f06feff6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1a036a4d0 0x55f1a0387080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:04.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.301+0000 7f06feff6740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f1a036adf0 0x55f1a0363390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:04.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.301+0000 7f06feff6740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a037b190 0x55f1a0376730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:04.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.301+0000 7f06feff6740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f06f81aa610 con 0x55f1a037b190 2024-09-11T00:25:04.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.301+0000 7f06feff6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f06f81ace70 con 0x55f1a036a4d0 2024-09-11T00:25:04.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.301+0000 7f06feff6740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f06f81aac60 con 0x55f1a036adf0 2024-09-11T00:25:04.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.301+0000 7f06f6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a037b190 0x55f1a0376730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:04.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.301+0000 7f06f6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a037b190 0x55f1a0376730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43294/0 (socket says 172.21.15.78:43294) 2024-09-11T00:25:04.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.301+0000 7f06f6d9d640 1 -- 172.21.15.78:0/1943511316 learned_addr learned my addr 172.21.15.78:0/1943511316 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:04.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.301+0000 7f06f659c640 1 --2- 172.21.15.78:0/1943511316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1a036a4d0 0x55f1a0387080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:04.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.301+0000 7f06f5d9b640 1 --2- 172.21.15.78:0/1943511316 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f1a036adf0 0x55f1a0363390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:04.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.301+0000 7f06f6d9d640 1 -- 172.21.15.78:0/1943511316 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f1a036adf0 msgr2=0x55f1a0363390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:04.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.301+0000 7f06f6d9d640 1 --2- 172.21.15.78:0/1943511316 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f1a036adf0 0x55f1a0363390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.301+0000 7f06f6d9d640 1 -- 172.21.15.78:0/1943511316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1a036a4d0 msgr2=0x55f1a0387080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:04.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.301+0000 7f06f6d9d640 1 --2- 172.21.15.78:0/1943511316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1a036a4d0 0x55f1a0387080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.301+0000 7f06f6d9d640 1 -- 172.21.15.78:0/1943511316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1a0377c60 con 0x55f1a037b190 2024-09-11T00:25:04.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.301+0000 7f06f5d9b640 1 --2- 172.21.15.78:0/1943511316 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f1a036adf0 0x55f1a0363390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:25:04.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.301+0000 7f06f6d9d640 1 --2- 172.21.15.78:0/1943511316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a037b190 0x55f1a0376730 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f06e8035000 tx=0x7f06e803c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0d7c2b4270e7f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:04.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.301+0000 7f06dffff640 1 -- 172.21.15.78:0/1943511316 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e8032ea0 con 0x55f1a037b190 2024-09-11T00:25:04.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.301+0000 7f06dffff640 1 -- 172.21.15.78:0/1943511316 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06e8036040 con 0x55f1a037b190 2024-09-11T00:25:04.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.301+0000 7f06dffff640 1 -- 172.21.15.78:0/1943511316 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e802f9e0 con 0x55f1a037b190 2024-09-11T00:25:04.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.302+0000 7f06feff6740 1 -- 172.21.15.78:0/1943511316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a037b190 msgr2=0x55f1a0376730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:04.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.302+0000 7f06feff6740 1 --2- 172.21.15.78:0/1943511316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a037b190 0x55f1a0376730 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f06e8035000 tx=0x7f06e803c000 comp rx=0 tx=0).stop 2024-09-11T00:25:04.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.302+0000 7f06feff6740 1 -- 172.21.15.78:0/1943511316 shutdown_connections 2024-09-11T00:25:04.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.302+0000 7f06feff6740 1 --2- 172.21.15.78:0/1943511316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a037b190 0x55f1a0376730 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.302+0000 7f06feff6740 1 --2- 172.21.15.78:0/1943511316 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f1a036adf0 0x55f1a0363390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.302+0000 7f06feff6740 1 --2- 172.21.15.78:0/1943511316 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1a036a4d0 0x55f1a0387080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.302+0000 7f06feff6740 1 -- 172.21.15.78:0/1943511316 >> 172.21.15.78:0/1943511316 conn(0x55f1a0368300 msgr2=0x55f1a037cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:04.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.302+0000 7f06feff6740 1 -- 172.21.15.78:0/1943511316 shutdown_connections 2024-09-11T00:25:04.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.302+0000 7f06feff6740 1 -- 172.21.15.78:0/1943511316 wait complete. 2024-09-11T00:25:04.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.302+0000 7f06feff6740 1 -- start start 2024-09-11T00:25:04.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.302+0000 7f06feff6740 1 Processor -- start 2024-09-11T00:25:04.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.302+0000 7f06feff6740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a036a4d0 0x55f1a038e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:04.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.302+0000 7f06feff6740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f1a036adf0 0x55f1a038e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:04.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.302+0000 7f06feff6740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1a037b190 0x55f1a03f6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:04.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.302+0000 7f06feff6740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f06f81ab330 con 0x55f1a036a4d0 2024-09-11T00:25:04.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.302+0000 7f06feff6740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f06f81ac7a0 con 0x55f1a037b190 2024-09-11T00:25:04.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.303+0000 7f06feff6740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f06f81aba00 con 0x55f1a036adf0 2024-09-11T00:25:04.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.303+0000 7f06feff6740 10 client.0 _ll_register_callbacks cb 0x7f06f0093070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:25:04.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.303+0000 7f06f659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a036a4d0 0x55f1a038e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:04.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.303+0000 7f06f659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a036a4d0 0x55f1a038e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43304/0 (socket says 172.21.15.78:43304) 2024-09-11T00:25:04.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.303+0000 7f06f659c640 1 -- 172.21.15.78:0/228294105 learned_addr learned my addr 172.21.15.78:0/228294105 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:04.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.303+0000 7f06f6d9d640 1 --2- 172.21.15.78:0/228294105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1a037b190 0x55f1a03f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:04.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.303+0000 7f06f5d9b640 1 --2- 172.21.15.78:0/228294105 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f1a036adf0 0x55f1a038e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:04.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.303+0000 7f06f659c640 1 -- 172.21.15.78:0/228294105 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f1a036adf0 msgr2=0x55f1a038e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:04.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.303+0000 7f06f659c640 1 --2- 172.21.15.78:0/228294105 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f1a036adf0 0x55f1a038e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.303+0000 7f06f659c640 1 -- 172.21.15.78:0/228294105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1a037b190 msgr2=0x55f1a03f6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:04.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.303+0000 7f06f659c640 1 --2- 172.21.15.78:0/228294105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1a037b190 0x55f1a03f6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.303+0000 7f06f659c640 1 -- 172.21.15.78:0/228294105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1a03f6ae0 con 0x55f1a036a4d0 2024-09-11T00:25:04.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.303+0000 7f06f659c640 1 --2- 172.21.15.78:0/228294105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a036a4d0 0x55f1a038e4b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f06f0011ee0 tx=0x7f06f00e9920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9bc791e827c326 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:04.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.303+0000 7f06ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:25:04.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.303+0000 7f06ddffb640 1 -- 172.21.15.78:0/228294105 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f001d040 con 0x55f1a036a4d0 2024-09-11T00:25:04.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.303+0000 7f06feff6740 1 -- 172.21.15.78:0/228294105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06e8036040 con 0x55f1a036a4d0 2024-09-11T00:25:04.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.303+0000 7f06ddffb640 1 -- 172.21.15.78:0/228294105 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7f06f00b53b0 con 0x55f1a036a4d0 2024-09-11T00:25:04.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.303+0000 7f06ddffb640 1 -- 172.21.15.78:0/228294105 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f06f00ac080 con 0x55f1a036a4d0 2024-09-11T00:25:04.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.303+0000 7f06feff6740 10 client.16509 fetch_fsmap learned FSMap version 20 2024-09-11T00:25:04.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.303+0000 7f06feff6740 1 -- 172.21.15.78:0/228294105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55f1a03f7d50 con 0x55f1a036a4d0 2024-09-11T00:25:04.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.304+0000 7f06ddffb640 1 -- 172.21.15.78:0/228294105 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06e8036040 con 0x55f1a036a4d0 2024-09-11T00:25:04.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.304+0000 7f06ddffb640 1 -- 172.21.15.78:0/228294105 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f06f00e9030 con 0x55f1a036a4d0 2024-09-11T00:25:04.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.304+0000 7f06feff6740 10 client.16509 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:25:04.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.304+0000 7f06feff6740 10 client.16509 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:25:04.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.304+0000 7f06feff6740 20 client.16509 populate_metadata read hostname 'smithi078' 2024-09-11T00:25:04.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.304+0000 7f06feff6740 1 --2- 172.21.15.78:0/228294105 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55f1a03f82b0 0x55f1a03fa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:04.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.304+0000 7f06feff6740 4 client.16509 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:25:04.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.304+0000 7f06feff6740 1 -- 172.21.15.78:0/228294105 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f1a02dbcd0 con 0x55f1a03f82b0 2024-09-11T00:25:04.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.304+0000 7f06f5d9b640 1 --2- 172.21.15.78:0/228294105 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55f1a03f82b0 0x55f1a03fa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:04.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.305+0000 7f06f5d9b640 1 --2- 172.21.15.78:0/228294105 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55f1a03f82b0 0x55f1a03fa6d0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28286628c7f4edb2 server_cookie=2e2a9142a0a3b760 in_seq=0 out_seq=0 2024-09-11T00:25:04.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.305+0000 7f06ddffb640 10 client.16509 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:04.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.305+0000 7f06ddffb640 1 -- 172.21.15.78:0/228294105 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f1a02dbcd0 con 0x55f1a03f82b0 2024-09-11T00:25:04.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.305+0000 7f06ddffb640 10 client.16509 handle_command_reply: tid=0 2024-09-11T00:25:04.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.305+0000 7f06feff6740 1 client.16509 shutdown 2024-09-11T00:25:04.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.305+0000 7f06feff6740 1 -- 172.21.15.78:0/228294105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a036a4d0 msgr2=0x55f1a038e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:04.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.305+0000 7f06feff6740 1 --2- 172.21.15.78:0/228294105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a036a4d0 0x55f1a038e4b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f06f0011ee0 tx=0x7f06f00e9920 comp rx=0 tx=0).stop 2024-09-11T00:25:04.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.305+0000 7f06feff6740 1 -- 172.21.15.78:0/228294105 shutdown_connections 2024-09-11T00:25:04.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.305+0000 7f06feff6740 1 --2- 172.21.15.78:0/228294105 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55f1a03f82b0 0x55f1a03fa6d0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.305+0000 7f06feff6740 1 --2- 172.21.15.78:0/228294105 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55f1a037b190 0x55f1a03f6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.305+0000 7f06feff6740 1 --2- 172.21.15.78:0/228294105 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f1a036adf0 0x55f1a038e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.305+0000 7f06feff6740 1 --2- 172.21.15.78:0/228294105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a036a4d0 0x55f1a038e4b0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.305+0000 7f06feff6740 1 -- 172.21.15.78:0/228294105 >> 172.21.15.78:0/228294105 conn(0x55f1a0368300 msgr2=0x55f1a0376660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:04.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.305+0000 7f06ddffb640 0 client.16509 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:04.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.305+0000 7f06feff6740 1 -- 172.21.15.78:0/228294105 shutdown_connections 2024-09-11T00:25:04.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.305+0000 7f06feff6740 1 -- 172.21.15.78:0/228294105 wait complete. 2024-09-11T00:25:04.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.305+0000 7f06feff6740 20 client.16509 trim_cache size 0 max 16384 2024-09-11T00:25:04.327 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-11T00:25:04.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.306+0000 7f06fcc21640 1 -- 172.21.15.78:0/1534509562 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f06e40b5450 msgr2=0x7f06e40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:04.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.306+0000 7f06fcc21640 1 --2- 172.21.15.78:0/1534509562 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f06e40b5450 0x7f06e40b7910 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f06e802f500 tx=0x7f06e80095c0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.306+0000 7f06fcc21640 1 -- 172.21.15.78:0/1534509562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06f8101c90 msgr2=0x7f06f819a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:04.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.306+0000 7f06fcc21640 1 --2- 172.21.15.78:0/1534509562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06f8101c90 0x7f06f819a060 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f06f000c890 tx=0x7f06f000cd50 comp rx=0 tx=0).stop 2024-09-11T00:25:04.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.306+0000 7f06fcc21640 1 -- 172.21.15.78:0/1534509562 shutdown_connections 2024-09-11T00:25:04.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.306+0000 7f06fcc21640 1 --2- 172.21.15.78:0/1534509562 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f06e40b5450 0x7f06e40b7910 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.306+0000 7f06fcc21640 1 --2- 172.21.15.78:0/1534509562 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06f8108020 0x7f06f819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.306+0000 7f06fcc21640 1 --2- 172.21.15.78:0/1534509562 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f06f81076a0 0x7f06f819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.306+0000 7f06fcc21640 1 --2- 172.21.15.78:0/1534509562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06f8101c90 0x7f06f819a060 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:04.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.306+0000 7f06fcc21640 1 -- 172.21.15.78:0/1534509562 >> 172.21.15.78:0/1534509562 conn(0x7f06f80fd700 msgr2=0x7f06f80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:04.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.306+0000 7f06fcc21640 1 -- 172.21.15.78:0/1534509562 shutdown_connections 2024-09-11T00:25:04.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:04.306+0000 7f06fcc21640 1 -- 172.21.15.78:0/1534509562 wait complete. 2024-09-11T00:25:06.038 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:25:06.039 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:25:06.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:05 smithi112 ceph-mon[35627]: pgmap v586: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T00:25:06.291 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:25:06.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:05 smithi138 ceph-mon[35019]: pgmap v586: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T00:25:06.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:05 smithi078 ceph-mon[30865]: pgmap v586: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T00:25:06.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.821+0000 7fbc1a4bc640 1 -- 172.21.15.78:0/1740598131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc141076c0 msgr2=0x7fbc14107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:06.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.821+0000 7fbc1a4bc640 1 --2- 172.21.15.78:0/1740598131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc141076c0 0x7fbc14107b00 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc009900 tx=0x7fbbfc02a410 comp rx=0 tx=0).stop 2024-09-11T00:25:06.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.821+0000 7fbc1a4bc640 1 -- 172.21.15.78:0/1740598131 shutdown_connections 2024-09-11T00:25:06.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.821+0000 7fbc1a4bc640 1 --2- 172.21.15.78:0/1740598131 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc14108040 0x7fbc1410e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.821+0000 7fbc1a4bc640 1 --2- 172.21.15.78:0/1740598131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc141076c0 0x7fbc14107b00 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.821+0000 7fbc1a4bc640 1 --2- 172.21.15.78:0/1740598131 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc14101cb0 0x7fbc14102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.821+0000 7fbc1a4bc640 1 -- 172.21.15.78:0/1740598131 >> 172.21.15.78:0/1740598131 conn(0x7fbc140fd700 msgr2=0x7fbc140ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:06.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.821+0000 7fbc1a4bc640 1 -- 172.21.15.78:0/1740598131 shutdown_connections 2024-09-11T00:25:06.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.821+0000 7fbc1a4bc640 1 -- 172.21.15.78:0/1740598131 wait complete. 2024-09-11T00:25:06.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.822+0000 7fbc1a4bc640 1 Processor -- start 2024-09-11T00:25:06.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.822+0000 7fbc1a4bc640 1 -- start start 2024-09-11T00:25:06.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.822+0000 7fbc1a4bc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc14101cb0 0x7fbc14199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:06.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.822+0000 7fbc1a4bc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc141076c0 0x7fbc14199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:06.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.822+0000 7fbc1a4bc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc14108040 0x7fbc1419eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:06.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.822+0000 7fbc1a4bc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbc14112e20 con 0x7fbc141076c0 2024-09-11T00:25:06.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.822+0000 7fbc1a4bc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbc14112ca0 con 0x7fbc14101cb0 2024-09-11T00:25:06.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.822+0000 7fbc1a4bc640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbc14112fa0 con 0x7fbc14108040 2024-09-11T00:25:06.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.822+0000 7fbc0bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc141076c0 0x7fbc14199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.822+0000 7fbc0bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc141076c0 0x7fbc14199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46304/0 (socket says 172.21.15.78:46304) 2024-09-11T00:25:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.822+0000 7fbc0bfff640 1 -- 172.21.15.78:0/1735813279 learned_addr learned my addr 172.21.15.78:0/1735813279 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.823+0000 7fbc18a59640 1 --2- 172.21.15.78:0/1735813279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc14108040 0x7fbc1419eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.823+0000 7fbc13fff640 1 --2- 172.21.15.78:0/1735813279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc14101cb0 0x7fbc14199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.823+0000 7fbc0bfff640 1 -- 172.21.15.78:0/1735813279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc14108040 msgr2=0x7fbc1419eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.823+0000 7fbc0bfff640 1 --2- 172.21.15.78:0/1735813279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc14108040 0x7fbc1419eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.823+0000 7fbc0bfff640 1 -- 172.21.15.78:0/1735813279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc14101cb0 msgr2=0x7fbc14199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.823+0000 7fbc0bfff640 1 --2- 172.21.15.78:0/1735813279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc14101cb0 0x7fbc14199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.823+0000 7fbc0bfff640 1 -- 172.21.15.78:0/1735813279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc1419f300 con 0x7fbc141076c0 2024-09-11T00:25:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.823+0000 7fbc0bfff640 1 --2- 172.21.15.78:0/1735813279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc141076c0 0x7fbc14199790 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc005940 tx=0x7fbbfc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.823+0000 7fbc11ffb640 1 -- 172.21.15.78:0/1735813279 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc03f030 con 0x7fbc141076c0 2024-09-11T00:25:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.823+0000 7fbc1a4bc640 1 -- 172.21.15.78:0/1735813279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc1419f590 con 0x7fbc141076c0 2024-09-11T00:25:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.823+0000 7fbc11ffb640 1 -- 172.21.15.78:0/1735813279 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbfc003cb0 con 0x7fbc141076c0 2024-09-11T00:25:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.823+0000 7fbc11ffb640 1 -- 172.21.15.78:0/1735813279 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc035070 con 0x7fbc141076c0 2024-09-11T00:25:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.823+0000 7fbc1a4bc640 1 -- 172.21.15.78:0/1735813279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc141a5cb0 con 0x7fbc141076c0 2024-09-11T00:25:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.825+0000 7fbc11ffb640 1 -- 172.21.15.78:0/1735813279 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fbbfc03bbf0 con 0x7fbc141076c0 2024-09-11T00:25:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.826+0000 7fbc1c891740 1 Processor -- start 2024-09-11T00:25:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.826+0000 7fbc1c891740 1 -- start start 2024-09-11T00:25:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.826+0000 7fbc1c891740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5626b47d3ee0 0x5626b47d42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.826+0000 7fbc1c891740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b47d4800 0x5626b47e4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.826+0000 7fbc1c891740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47e4ba0 0x5626b47e6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.826+0000 7fbc1c891740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5626b474ae60 con 0x5626b47e4ba0 2024-09-11T00:25:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.826+0000 7fbc1c891740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5626b473a290 con 0x5626b47d4800 2024-09-11T00:25:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.826+0000 7fbc1c891740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5626b473e0a0 con 0x5626b47d3ee0 2024-09-11T00:25:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.826+0000 7fbc0bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47e4ba0 0x5626b47e6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.826+0000 7fbc0bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47e4ba0 0x5626b47e6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46306/0 (socket says 172.21.15.78:46306) 2024-09-11T00:25:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.826+0000 7fbc0bfff640 1 -- 172.21.15.78:0/4031072219 learned_addr learned my addr 172.21.15.78:0/4031072219 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.826+0000 7fbc13fff640 1 --2- 172.21.15.78:0/4031072219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b47d4800 0x5626b47e4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.826+0000 7fbc18a59640 1 --2- 172.21.15.78:0/4031072219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5626b47d3ee0 0x5626b47d42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.826+0000 7fbc11ffb640 1 --2- 172.21.15.78:0/1735813279 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbc000b5450 0x7fbc000b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.827+0000 7fbc0bfff640 1 -- 172.21.15.78:0/4031072219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5626b47d3ee0 msgr2=0x5626b47d42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.827+0000 7fbc0bfff640 1 --2- 172.21.15.78:0/4031072219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5626b47d3ee0 0x5626b47d42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.827+0000 7fbc0bfff640 1 -- 172.21.15.78:0/4031072219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b47d4800 msgr2=0x5626b47e4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.827+0000 7fbc18a59640 1 --2- 172.21.15.78:0/1735813279 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbc000b5450 0x7fbc000b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.827+0000 7fbc0bfff640 1 --2- 172.21.15.78:0/4031072219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b47d4800 0x5626b47e4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.827+0000 7fbc0bfff640 1 -- 172.21.15.78:0/4031072219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626b4498930 con 0x5626b47e4ba0 2024-09-11T00:25:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.827+0000 7fbc13fff640 1 --2- 172.21.15.78:0/4031072219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b47d4800 0x5626b47e4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:25:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.827+0000 7fbc11ffb640 1 -- 172.21.15.78:0/1735813279 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7fbbfc106b20 con 0x7fbc141076c0 2024-09-11T00:25:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.827+0000 7fbc0bfff640 1 --2- 172.21.15.78:0/4031072219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47e4ba0 0x5626b47e6f90 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0c95b0 tx=0x7fbbfc0045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec398595b833af3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.827+0000 7fbc18a59640 1 --2- 172.21.15.78:0/1735813279 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbc000b5450 0x7fbc000b7910 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c007310 tx=0x7fbc0c004ab0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.827+0000 7fbc0a7fc640 1 -- 172.21.15.78:0/4031072219 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc049070 con 0x5626b47e4ba0 2024-09-11T00:25:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.827+0000 7fbc0a7fc640 1 -- 172.21.15.78:0/4031072219 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbfc0ccaf0 con 0x5626b47e4ba0 2024-09-11T00:25:06.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.827+0000 7fbc0a7fc640 1 -- 172.21.15.78:0/4031072219 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc02f300 con 0x5626b47e4ba0 2024-09-11T00:25:06.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.828+0000 7fbc1c891740 1 -- 172.21.15.78:0/4031072219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47e4ba0 msgr2=0x5626b47e6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:06.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.828+0000 7fbc1c891740 1 --2- 172.21.15.78:0/4031072219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47e4ba0 0x5626b47e6f90 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0c95b0 tx=0x7fbbfc0045a0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.828+0000 7fbc1c891740 1 -- 172.21.15.78:0/4031072219 shutdown_connections 2024-09-11T00:25:06.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.828+0000 7fbc1c891740 1 --2- 172.21.15.78:0/4031072219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47e4ba0 0x5626b47e6f90 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.828+0000 7fbc1c891740 1 --2- 172.21.15.78:0/4031072219 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b47d4800 0x5626b47e4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.828+0000 7fbc1c891740 1 --2- 172.21.15.78:0/4031072219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5626b47d3ee0 0x5626b47d42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.828+0000 7fbc1c891740 1 -- 172.21.15.78:0/4031072219 >> 172.21.15.78:0/4031072219 conn(0x5626b47d1d10 msgr2=0x5626b47d2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:06.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.828+0000 7fbc1c891740 1 -- 172.21.15.78:0/4031072219 shutdown_connections 2024-09-11T00:25:06.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.828+0000 7fbc1c891740 1 -- 172.21.15.78:0/4031072219 wait complete. 2024-09-11T00:25:06.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.828+0000 7fbc1c891740 1 -- start start 2024-09-11T00:25:06.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.829+0000 7fbc1c891740 1 Processor -- start 2024-09-11T00:25:06.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.829+0000 7fbc1c891740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47d3ee0 0x5626b47e1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:06.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.829+0000 7fbc1c891740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b47d4800 0x5626b47e2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:06.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.829+0000 7fbc1c891740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5626b47e4ba0 0x5626b47e25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:06.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.829+0000 7fbc1c891740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5626b459b890 con 0x5626b47d3ee0 2024-09-11T00:25:06.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.829+0000 7fbc1c891740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5626b46d4d40 con 0x5626b47d4800 2024-09-11T00:25:06.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.829+0000 7fbc1c891740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5626b47e7610 con 0x5626b47e4ba0 2024-09-11T00:25:06.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.829+0000 7fbc1c891740 10 client.0 _ll_register_callbacks cb 0x5626b4738c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:25:06.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.829+0000 7fbc13fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47d3ee0 0x5626b47e1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:06.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.829+0000 7fbc13fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47d3ee0 0x5626b47e1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46318/0 (socket says 172.21.15.78:46318) 2024-09-11T00:25:06.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.829+0000 7fbc13fff640 1 -- 172.21.15.78:0/3831325504 learned_addr learned my addr 172.21.15.78:0/3831325504 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:06.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.829+0000 7fbc0bfff640 1 --2- 172.21.15.78:0/3831325504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b47d4800 0x5626b47e2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:06.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.829+0000 7fbc18a59640 1 --2- 172.21.15.78:0/3831325504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5626b47e4ba0 0x5626b47e25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:06.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.829+0000 7fbc13fff640 1 -- 172.21.15.78:0/3831325504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5626b47e4ba0 msgr2=0x5626b47e25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:06.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.829+0000 7fbc13fff640 1 --2- 172.21.15.78:0/3831325504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5626b47e4ba0 0x5626b47e25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.829+0000 7fbc13fff640 1 -- 172.21.15.78:0/3831325504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b47d4800 msgr2=0x5626b47e2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:06.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.829+0000 7fbc13fff640 1 --2- 172.21.15.78:0/3831325504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b47d4800 0x5626b47e2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.829+0000 7fbc13fff640 1 -- 172.21.15.78:0/3831325504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626b47f08b0 con 0x5626b47d3ee0 2024-09-11T00:25:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.829+0000 7fbc13fff640 1 --2- 172.21.15.78:0/3831325504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47d3ee0 0x5626b47e1b30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fbc0400b9e0 tx=0x7fbc0400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5208d85e3f117d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.829+0000 7fbbf37fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:25:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.830+0000 7fbbf37fe640 1 -- 172.21.15.78:0/3831325504 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc04003e50 con 0x5626b47d3ee0 2024-09-11T00:25:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.830+0000 7fbc1c891740 1 -- 172.21.15.78:0/3831325504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbfc0ccaf0 con 0x5626b47d3ee0 2024-09-11T00:25:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.830+0000 7fbbf37fe640 1 -- 172.21.15.78:0/3831325504 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7fbc04011440 con 0x5626b47d3ee0 2024-09-11T00:25:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.830+0000 7fbbf37fe640 1 -- 172.21.15.78:0/3831325504 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbc04011640 con 0x5626b47d3ee0 2024-09-11T00:25:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.830+0000 7fbc1c891740 10 client.16521 fetch_fsmap learned FSMap version 20 2024-09-11T00:25:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.830+0000 7fbc1c891740 1 -- 172.21.15.78:0/3831325504 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5626b47f3310 con 0x5626b47d3ee0 2024-09-11T00:25:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.830+0000 7fbbf37fe640 1 -- 172.21.15.78:0/3831325504 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbfc0ccaf0 con 0x5626b47d3ee0 2024-09-11T00:25:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.830+0000 7fbbf37fe640 1 -- 172.21.15.78:0/3831325504 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fbc0401b9f0 con 0x5626b47d3ee0 2024-09-11T00:25:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.830+0000 7fbc1c891740 10 client.16521 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:25:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.830+0000 7fbc1c891740 10 client.16521 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:25:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.830+0000 7fbc1c891740 20 client.16521 populate_metadata read hostname 'smithi078' 2024-09-11T00:25:06.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.830+0000 7fbc1c891740 1 --2- 172.21.15.78:0/3831325504 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5626b47f47e0 0x5626b47f6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.830+0000 7fbc1c891740 4 client.16521 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:25:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.830+0000 7fbc1c891740 1 -- 172.21.15.78:0/3831325504 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626b474cdb0 con 0x5626b47f47e0 2024-09-11T00:25:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.830+0000 7fbc0bfff640 1 --2- 172.21.15.78:0/3831325504 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5626b47f47e0 0x5626b47f6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.831+0000 7fbc0bfff640 1 --2- 172.21.15.78:0/3831325504 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5626b47f47e0 0x5626b47f6c30 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e0c5ebb240dc596 server_cookie=5d1285d361d8980 in_seq=0 out_seq=0 2024-09-11T00:25:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.831+0000 7fbbf37fe640 10 client.16521 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.831+0000 7fbbf37fe640 1 -- 172.21.15.78:0/3831325504 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5626b474cdb0 con 0x5626b47f47e0 2024-09-11T00:25:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.831+0000 7fbbf37fe640 10 client.16521 handle_command_reply: tid=0 2024-09-11T00:25:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.832+0000 7fbc1c891740 1 client.16521 shutdown 2024-09-11T00:25:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.832+0000 7fbc1c891740 1 -- 172.21.15.78:0/3831325504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47d3ee0 msgr2=0x5626b47e1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.832+0000 7fbc1c891740 1 --2- 172.21.15.78:0/3831325504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47d3ee0 0x5626b47e1b30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fbc0400b9e0 tx=0x7fbc0400bea0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.832+0000 7fbc1c891740 1 -- 172.21.15.78:0/3831325504 shutdown_connections 2024-09-11T00:25:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.832+0000 7fbc1c891740 1 --2- 172.21.15.78:0/3831325504 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5626b47f47e0 0x5626b47f6c30 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.832+0000 7fbc1c891740 1 --2- 172.21.15.78:0/3831325504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5626b47e4ba0 0x5626b47e25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.832+0000 7fbc1c891740 1 --2- 172.21.15.78:0/3831325504 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b47d4800 0x5626b47e2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.832+0000 7fbbf37fe640 0 client.16521 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.832+0000 7fbc1c891740 1 --2- 172.21.15.78:0/3831325504 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47d3ee0 0x5626b47e1b30 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.832+0000 7fbc1c891740 1 -- 172.21.15.78:0/3831325504 >> 172.21.15.78:0/3831325504 conn(0x5626b47d1d10 msgr2=0x5626b47d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.832+0000 7fbc1c891740 1 -- 172.21.15.78:0/3831325504 shutdown_connections 2024-09-11T00:25:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.832+0000 7fbc1c891740 1 -- 172.21.15.78:0/3831325504 wait complete. 2024-09-11T00:25:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.832+0000 7fbc1c891740 20 client.16521 trim_cache size 0 max 16384 2024-09-11T00:25:06.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.849+0000 7fbc1c891740 1 Processor -- start 2024-09-11T00:25:06.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.849+0000 7fbc1c891740 1 -- start start 2024-09-11T00:25:06.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.849+0000 7fbc1c891740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5626b47d3ee0 0x5626b47df630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:06.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.849+0000 7fbc1c891740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b47d4800 0x5626b47e3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:06.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.849+0000 7fbc1c891740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47e4ba0 0x5626b47d5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:06.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.849+0000 7fbc1c891740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbc141aa470 con 0x5626b47e4ba0 2024-09-11T00:25:06.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.849+0000 7fbc1c891740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbc141accd0 con 0x5626b47d4800 2024-09-11T00:25:06.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.849+0000 7fbc1c891740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbc141aaac0 con 0x5626b47d3ee0 2024-09-11T00:25:06.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.850+0000 7fbc18a59640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47e4ba0 0x5626b47d5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:06.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.850+0000 7fbc18a59640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47e4ba0 0x5626b47d5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46330/0 (socket says 172.21.15.78:46330) 2024-09-11T00:25:06.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.850+0000 7fbc18a59640 1 -- 172.21.15.78:0/752341121 learned_addr learned my addr 172.21.15.78:0/752341121 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:06.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.850+0000 7fbc13fff640 1 --2- 172.21.15.78:0/752341121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5626b47d3ee0 0x5626b47df630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:06.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.850+0000 7fbc0bfff640 1 --2- 172.21.15.78:0/752341121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b47d4800 0x5626b47e3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:06.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.850+0000 7fbc18a59640 1 -- 172.21.15.78:0/752341121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5626b47d3ee0 msgr2=0x5626b47df630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:06.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.850+0000 7fbc18a59640 1 --2- 172.21.15.78:0/752341121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5626b47d3ee0 0x5626b47df630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.850+0000 7fbc18a59640 1 -- 172.21.15.78:0/752341121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b47d4800 msgr2=0x5626b47e3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:06.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.850+0000 7fbc18a59640 1 --2- 172.21.15.78:0/752341121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b47d4800 0x5626b47e3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.850+0000 7fbc18a59640 1 -- 172.21.15.78:0/752341121 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626b47d3070 con 0x5626b47e4ba0 2024-09-11T00:25:06.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.850+0000 7fbc0bfff640 1 --2- 172.21.15.78:0/752341121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b47d4800 0x5626b47e3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:25:06.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.850+0000 7fbc18a59640 1 --2- 172.21.15.78:0/752341121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47e4ba0 0x5626b47d5f40 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c011a90 tx=0x7fbc0c0079f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee434e9bd0b253a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:06.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.850+0000 7fbc09ffb640 1 -- 172.21.15.78:0/752341121 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c019070 con 0x5626b47e4ba0 2024-09-11T00:25:06.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.850+0000 7fbc09ffb640 1 -- 172.21.15.78:0/752341121 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc0c025070 con 0x5626b47e4ba0 2024-09-11T00:25:06.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.850+0000 7fbc09ffb640 1 -- 172.21.15.78:0/752341121 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c005470 con 0x5626b47e4ba0 2024-09-11T00:25:06.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.851+0000 7fbc1c891740 1 -- 172.21.15.78:0/752341121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47e4ba0 msgr2=0x5626b47d5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:06.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.851+0000 7fbc1c891740 1 --2- 172.21.15.78:0/752341121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47e4ba0 0x5626b47d5f40 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c011a90 tx=0x7fbc0c0079f0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.851+0000 7fbc1c891740 1 -- 172.21.15.78:0/752341121 shutdown_connections 2024-09-11T00:25:06.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.851+0000 7fbc1c891740 1 --2- 172.21.15.78:0/752341121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47e4ba0 0x5626b47d5f40 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.851+0000 7fbc1c891740 1 --2- 172.21.15.78:0/752341121 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b47d4800 0x5626b47e3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.851+0000 7fbc1c891740 1 --2- 172.21.15.78:0/752341121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5626b47d3ee0 0x5626b47df630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.851+0000 7fbc1c891740 1 -- 172.21.15.78:0/752341121 >> 172.21.15.78:0/752341121 conn(0x5626b47d1d10 msgr2=0x5626b47e3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:06.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.851+0000 7fbc1c891740 1 -- 172.21.15.78:0/752341121 shutdown_connections 2024-09-11T00:25:06.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.851+0000 7fbc1c891740 1 -- 172.21.15.78:0/752341121 wait complete. 2024-09-11T00:25:06.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.851+0000 7fbc1c891740 1 -- start start 2024-09-11T00:25:06.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.851+0000 7fbc1c891740 1 Processor -- start 2024-09-11T00:25:06.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.852+0000 7fbc1c891740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b47d3ee0 0x5626b47ecbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:06.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.852+0000 7fbc1c891740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47d4800 0x5626b47ed130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:06.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.852+0000 7fbc1c891740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5626b47e4ba0 0x5626b47e98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:06.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.852+0000 7fbc1c891740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbc141ab190 con 0x5626b47d4800 2024-09-11T00:25:06.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.852+0000 7fbc1c891740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbc141ac600 con 0x5626b47d3ee0 2024-09-11T00:25:06.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.852+0000 7fbc1c891740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbc141ab860 con 0x5626b47e4ba0 2024-09-11T00:25:06.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.852+0000 7fbc1c891740 10 client.0 _ll_register_callbacks cb 0x7fbc04004480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:25:06.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.852+0000 7fbc0bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47d4800 0x5626b47ed130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:06.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.852+0000 7fbc0bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47d4800 0x5626b47ed130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46334/0 (socket says 172.21.15.78:46334) 2024-09-11T00:25:06.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.852+0000 7fbc0bfff640 1 -- 172.21.15.78:0/3436286395 learned_addr learned my addr 172.21.15.78:0/3436286395 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:06.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.852+0000 7fbc18a59640 1 --2- 172.21.15.78:0/3436286395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5626b47e4ba0 0x5626b47e98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:06.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.852+0000 7fbc13fff640 1 --2- 172.21.15.78:0/3436286395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b47d3ee0 0x5626b47ecbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:06.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.852+0000 7fbc0bfff640 1 -- 172.21.15.78:0/3436286395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5626b47e4ba0 msgr2=0x5626b47e98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:06.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.852+0000 7fbc0bfff640 1 --2- 172.21.15.78:0/3436286395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5626b47e4ba0 0x5626b47e98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.852+0000 7fbc0bfff640 1 -- 172.21.15.78:0/3436286395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b47d3ee0 msgr2=0x5626b47ecbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:06.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.852+0000 7fbc0bfff640 1 --2- 172.21.15.78:0/3436286395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b47d3ee0 0x5626b47ecbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.852+0000 7fbc0bfff640 1 -- 172.21.15.78:0/3436286395 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626b47ea100 con 0x5626b47d4800 2024-09-11T00:25:06.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.852+0000 7fbc0bfff640 1 --2- 172.21.15.78:0/3436286395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47d4800 0x5626b47ed130 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc004650 tx=0x7fbbfc03b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d346de22587a5f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:06.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.852+0000 7fbbf37fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:25:06.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.852+0000 7fbbf37fe640 1 -- 172.21.15.78:0/3436286395 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc10c060 con 0x5626b47d4800 2024-09-11T00:25:06.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.852+0000 7fbbf37fe640 1 -- 172.21.15.78:0/3436286395 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8536+0+0 (secure 0 0 0) 0x7fbbfc10a2c0 con 0x5626b47d4800 2024-09-11T00:25:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.852+0000 7fbc1c891740 1 -- 172.21.15.78:0/3436286395 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc0c025070 con 0x5626b47d4800 2024-09-11T00:25:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.853+0000 7fbbf37fe640 1 -- 172.21.15.78:0/3436286395 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbbfc049040 con 0x5626b47d4800 2024-09-11T00:25:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.853+0000 7fbc1c891740 10 client.16527 fetch_fsmap learned FSMap version 20 2024-09-11T00:25:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.853+0000 7fbc1c891740 1 -- 172.21.15.78:0/3436286395 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5626b4862350 con 0x5626b47d4800 2024-09-11T00:25:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.853+0000 7fbbf37fe640 1 -- 172.21.15.78:0/3436286395 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc0c025070 con 0x5626b47d4800 2024-09-11T00:25:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.853+0000 7fbbf37fe640 1 -- 172.21.15.78:0/3436286395 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fbbfc0b8170 con 0x5626b47d4800 2024-09-11T00:25:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.853+0000 7fbc1c891740 10 client.16527 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:25:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.853+0000 7fbc1c891740 10 client.16527 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:25:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.853+0000 7fbc1c891740 20 client.16527 populate_metadata read hostname 'smithi078' 2024-09-11T00:25:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.853+0000 7fbc1c891740 1 --2- 172.21.15.78:0/3436286395 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5626b4862940 0x5626b4864d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.853+0000 7fbc1c891740 4 client.16527 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:25:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.853+0000 7fbc1c891740 1 -- 172.21.15.78:0/3436286395 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5626b4748860 con 0x5626b4862940 2024-09-11T00:25:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.853+0000 7fbc13fff640 1 --2- 172.21.15.78:0/3436286395 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5626b4862940 0x5626b4864d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.854+0000 7fbc13fff640 1 --2- 172.21.15.78:0/3436286395 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5626b4862940 0x5626b4864d60 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ceb43701f841d47 server_cookie=67f77a6eb131a254 in_seq=0 out_seq=0 2024-09-11T00:25:06.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.854+0000 7fbbf37fe640 10 client.16527 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.855+0000 7fbbf37fe640 1 -- 172.21.15.78:0/3436286395 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5626b4748860 con 0x5626b4862940 2024-09-11T00:25:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.855+0000 7fbbf37fe640 10 client.16527 handle_command_reply: tid=0 2024-09-11T00:25:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.855+0000 7fbc1c891740 1 client.16527 shutdown 2024-09-11T00:25:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.856+0000 7fbc1c891740 1 -- 172.21.15.78:0/3436286395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47d4800 msgr2=0x5626b47ed130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.856+0000 7fbc1c891740 1 --2- 172.21.15.78:0/3436286395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47d4800 0x5626b47ed130 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc004650 tx=0x7fbbfc03b6b0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.856+0000 7fbc1c891740 1 -- 172.21.15.78:0/3436286395 shutdown_connections 2024-09-11T00:25:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.856+0000 7fbc1c891740 1 --2- 172.21.15.78:0/3436286395 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5626b4862940 0x5626b4864d60 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.856+0000 7fbc1c891740 1 --2- 172.21.15.78:0/3436286395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5626b47e4ba0 0x5626b47e98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.856+0000 7fbc1c891740 1 --2- 172.21.15.78:0/3436286395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5626b47d4800 0x5626b47ed130 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.856+0000 7fbc1c891740 1 --2- 172.21.15.78:0/3436286395 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5626b47d3ee0 0x5626b47ecbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.856+0000 7fbc1c891740 1 -- 172.21.15.78:0/3436286395 >> 172.21.15.78:0/3436286395 conn(0x5626b47d1d10 msgr2=0x5626b47e3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.856+0000 7fbbf37fe640 0 client.16527 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.856+0000 7fbc1c891740 1 -- 172.21.15.78:0/3436286395 shutdown_connections 2024-09-11T00:25:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.856+0000 7fbc1c891740 1 -- 172.21.15.78:0/3436286395 wait complete. 2024-09-11T00:25:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.856+0000 7fbc1c891740 20 client.16527 trim_cache size 0 max 16384 2024-09-11T00:25:06.863 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:25:06.863 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-11T00:25:06.863 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "59d341c2-815c-48b1-a216-aa6fac6078a0", 2024-09-11T00:25:06.863 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-11T00:25:06.863 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:25:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.856+0000 7fbc1a4bc640 1 -- 172.21.15.78:0/1735813279 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbc000b5450 msgr2=0x7fbc000b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.856+0000 7fbc1a4bc640 1 --2- 172.21.15.78:0/1735813279 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbc000b5450 0x7fbc000b7910 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c007310 tx=0x7fbc0c004ab0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.856+0000 7fbc1a4bc640 1 -- 172.21.15.78:0/1735813279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc141076c0 msgr2=0x7fbc14199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.856+0000 7fbc1a4bc640 1 --2- 172.21.15.78:0/1735813279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc141076c0 0x7fbc14199790 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc005940 tx=0x7fbbfc0042f0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.856+0000 7fbc1a4bc640 1 -- 172.21.15.78:0/1735813279 shutdown_connections 2024-09-11T00:25:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.856+0000 7fbc1a4bc640 1 --2- 172.21.15.78:0/1735813279 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbc000b5450 0x7fbc000b7910 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.856+0000 7fbc1a4bc640 1 --2- 172.21.15.78:0/1735813279 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc14108040 0x7fbc1419eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.856+0000 7fbc1a4bc640 1 --2- 172.21.15.78:0/1735813279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc141076c0 0x7fbc14199790 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.856+0000 7fbc1a4bc640 1 --2- 172.21.15.78:0/1735813279 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbc14101cb0 0x7fbc14199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.856+0000 7fbc1a4bc640 1 -- 172.21.15.78:0/1735813279 >> 172.21.15.78:0/1735813279 conn(0x7fbc140fd700 msgr2=0x7fbc140ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.857+0000 7fbc1a4bc640 1 -- 172.21.15.78:0/1735813279 shutdown_connections 2024-09-11T00:25:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:06.857+0000 7fbc1a4bc640 1 -- 172.21.15.78:0/1735813279 wait complete. 2024-09-11T00:25:07.707 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:25:07.956 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:25:08.076 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:07 smithi078 ceph-mon[30865]: scrub queued for path: / 2024-09-11T00:25:08.076 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:07 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:25:08.076 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:07 smithi078 ceph-mon[30865]: scrub summary: active paths [/] 2024-09-11T00:25:08.076 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:07 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:25:08.076 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:07 smithi078 ceph-mon[30865]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T00:25:08.076 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:07 smithi078 ceph-mon[30865]: pgmap v588: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T00:25:08.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:07 smithi112 ceph-mon[35627]: scrub queued for path: / 2024-09-11T00:25:08.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:07 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:25:08.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:07 smithi112 ceph-mon[35627]: scrub summary: active paths [/] 2024-09-11T00:25:08.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:07 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:25:08.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:07 smithi112 ceph-mon[35627]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T00:25:08.234 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:07 smithi112 ceph-mon[35627]: pgmap v588: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T00:25:08.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:07 smithi138 ceph-mon[35019]: scrub queued for path: / 2024-09-11T00:25:08.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:07 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:25:08.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:07 smithi138 ceph-mon[35019]: scrub summary: active paths [/] 2024-09-11T00:25:08.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:07 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:25:08.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:07 smithi138 ceph-mon[35019]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T00:25:08.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:07 smithi138 ceph-mon[35019]: pgmap v588: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T00:25:08.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.461+0000 7fcf5759e640 1 -- 172.21.15.78:0/398001769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf58105dd0 msgr2=0x7fcf5810f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:08.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.461+0000 7fcf5759e640 1 --2- 172.21.15.78:0/398001769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf58105dd0 0x7fcf5810f7d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fcf50009ca0 tx=0x7fcf5002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.461+0000 7fcf5759e640 1 -- 172.21.15.78:0/398001769 shutdown_connections 2024-09-11T00:25:08.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.461+0000 7fcf5759e640 1 --2- 172.21.15.78:0/398001769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf58105dd0 0x7fcf5810f7d0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.461+0000 7fcf5759e640 1 --2- 172.21.15.78:0/398001769 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf58105410 0x7fcf58105890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.461+0000 7fcf5759e640 1 --2- 172.21.15.78:0/398001769 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf58101230 0x7fcf58101610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.461+0000 7fcf5759e640 1 -- 172.21.15.78:0/398001769 >> 172.21.15.78:0/398001769 conn(0x7fcf580fd2f0 msgr2=0x7fcf580ff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:08.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.462+0000 7fcf5759e640 1 -- 172.21.15.78:0/398001769 shutdown_connections 2024-09-11T00:25:08.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.462+0000 7fcf5759e640 1 -- 172.21.15.78:0/398001769 wait complete. 2024-09-11T00:25:08.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.462+0000 7fcf5759e640 1 Processor -- start 2024-09-11T00:25:08.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.462+0000 7fcf5759e640 1 -- start start 2024-09-11T00:25:08.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.463+0000 7fcf5759e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf58101230 0x7fcf58102200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:08.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.463+0000 7fcf5759e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf58105410 0x7fcf58102740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:08.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.463+0000 7fcf5759e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf58105dd0 0x7fcf58102c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:08.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.463+0000 7fcf5759e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcf58112bc0 con 0x7fcf58105dd0 2024-09-11T00:25:08.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.463+0000 7fcf5759e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcf58112a40 con 0x7fcf58105410 2024-09-11T00:25:08.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.463+0000 7fcf5759e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcf58112d40 con 0x7fcf58101230 2024-09-11T00:25:08.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.463+0000 7fcf56d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf58105dd0 0x7fcf58102c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:08.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.463+0000 7fcf56d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf58105dd0 0x7fcf58102c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46348/0 (socket says 172.21.15.78:46348) 2024-09-11T00:25:08.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.463+0000 7fcf56d9d640 1 -- 172.21.15.78:0/2981195954 learned_addr learned my addr 172.21.15.78:0/2981195954 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:08.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.463+0000 7fcf5659c640 1 --2- 172.21.15.78:0/2981195954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf58101230 0x7fcf58102200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:08.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.463+0000 7fcf55d9b640 1 --2- 172.21.15.78:0/2981195954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf58105410 0x7fcf58102740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:08.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.463+0000 7fcf56d9d640 1 -- 172.21.15.78:0/2981195954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf58101230 msgr2=0x7fcf58102200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:08.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.463+0000 7fcf56d9d640 1 --2- 172.21.15.78:0/2981195954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf58101230 0x7fcf58102200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.463+0000 7fcf56d9d640 1 -- 172.21.15.78:0/2981195954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf58105410 msgr2=0x7fcf58102740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:08.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.463+0000 7fcf56d9d640 1 --2- 172.21.15.78:0/2981195954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf58105410 0x7fcf58102740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.463+0000 7fcf56d9d640 1 -- 172.21.15.78:0/2981195954 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf581a73e0 con 0x7fcf58105dd0 2024-09-11T00:25:08.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.463+0000 7fcf56d9d640 1 --2- 172.21.15.78:0/2981195954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf58105dd0 0x7fcf58102c80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fcf50005cc0 tx=0x7fcf5002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:08.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.463+0000 7fcf477fe640 1 -- 172.21.15.78:0/2981195954 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf50003bf0 con 0x7fcf58105dd0 2024-09-11T00:25:08.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.463+0000 7fcf477fe640 1 -- 172.21.15.78:0/2981195954 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf50003d90 con 0x7fcf58105dd0 2024-09-11T00:25:08.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.463+0000 7fcf5759e640 1 -- 172.21.15.78:0/2981195954 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf581a7670 con 0x7fcf58105dd0 2024-09-11T00:25:08.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.463+0000 7fcf477fe640 1 -- 172.21.15.78:0/2981195954 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5002fbc0 con 0x7fcf58105dd0 2024-09-11T00:25:08.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.464+0000 7fcf5759e640 1 -- 172.21.15.78:0/2981195954 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf581a7bb0 con 0x7fcf58105dd0 2024-09-11T00:25:08.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.466+0000 7fcf477fe640 1 -- 172.21.15.78:0/2981195954 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fcf50004610 con 0x7fcf58105dd0 2024-09-11T00:25:08.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.466+0000 7fcf5ebd7740 1 Processor -- start 2024-09-11T00:25:08.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.466+0000 7fcf5ebd7740 1 -- start start 2024-09-11T00:25:08.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.466+0000 7fcf5ebd7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5a3650 0x55a13f5a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:08.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.466+0000 7fcf5ebd7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 0x55a13f5af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:08.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.466+0000 7fcf5ebd7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a13f5aff00 0x55a13f5b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:08.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.466+0000 7fcf5ebd7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a13f519e50 con 0x55a13f5a3650 2024-09-11T00:25:08.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.466+0000 7fcf5ebd7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a13f509280 con 0x55a13f5aff00 2024-09-11T00:25:08.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.466+0000 7fcf5ebd7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a13f50d090 con 0x55a13f5a3f70 2024-09-11T00:25:08.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.467+0000 7fcf55d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5a3650 0x55a13f5a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:08.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.467+0000 7fcf55d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5a3650 0x55a13f5a3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46360/0 (socket says 172.21.15.78:46360) 2024-09-11T00:25:08.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.467+0000 7fcf55d9b640 1 -- 172.21.15.78:0/450572705 learned_addr learned my addr 172.21.15.78:0/450572705 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:08.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.467+0000 7fcf5659c640 1 --2- 172.21.15.78:0/450572705 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 0x55a13f5af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:08.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.467+0000 7fcf477fe640 1 --2- 172.21.15.78:0/2981195954 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcf400b5500 0x7fcf400b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.467+0000 7fcf55d9b640 1 -- 172.21.15.78:0/450572705 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 msgr2=0x55a13f5af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.467+0000 7fcf55d9b640 1 --2- 172.21.15.78:0/450572705 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 0x55a13f5af9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.467+0000 7fcf55d9b640 1 -- 172.21.15.78:0/450572705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a13f5aff00 msgr2=0x55a13f5b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.467+0000 7fcf55d9b640 1 --2- 172.21.15.78:0/450572705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a13f5aff00 0x55a13f5b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.467+0000 7fcf55d9b640 1 -- 172.21.15.78:0/450572705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a13f267650 con 0x55a13f5a3650 2024-09-11T00:25:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.467+0000 7fcf5659c640 1 --2- 172.21.15.78:0/450572705 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 0x55a13f5af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:25:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.467+0000 7fcf56d9d640 1 --2- 172.21.15.78:0/2981195954 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcf400b5500 0x7fcf400b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.467+0000 7fcf55d9b640 1 --2- 172.21.15.78:0/450572705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5a3650 0x55a13f5a3a30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00aca0 tx=0x7fcf4c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb68eeb2be7e1ac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:08.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.467+0000 7fcf477fe640 1 -- 172.21.15.78:0/2981195954 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8580+0+0 (secure 0 0 0) 0x7fcf50107490 con 0x7fcf58105dd0 2024-09-11T00:25:08.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.467+0000 7fcf44ff9640 1 -- 172.21.15.78:0/450572705 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c005020 con 0x55a13f5a3650 2024-09-11T00:25:08.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.467+0000 7fcf44ff9640 1 -- 172.21.15.78:0/450572705 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf4c0047a0 con 0x55a13f5a3650 2024-09-11T00:25:08.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.468+0000 7fcf44ff9640 1 -- 172.21.15.78:0/450572705 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c012670 con 0x55a13f5a3650 2024-09-11T00:25:08.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.468+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/450572705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5a3650 msgr2=0x55a13f5a3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:08.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.468+0000 7fcf56d9d640 1 --2- 172.21.15.78:0/2981195954 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcf400b5500 0x7fcf400b79c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcf500cd5d0 tx=0x7fcf50092040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:08.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.468+0000 7fcf5ebd7740 1 --2- 172.21.15.78:0/450572705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5a3650 0x55a13f5a3a30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00aca0 tx=0x7fcf4c0117b0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.468+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/450572705 shutdown_connections 2024-09-11T00:25:08.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.468+0000 7fcf5ebd7740 1 --2- 172.21.15.78:0/450572705 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a13f5aff00 0x55a13f5b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.468+0000 7fcf5ebd7740 1 --2- 172.21.15.78:0/450572705 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 0x55a13f5af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.468+0000 7fcf5ebd7740 1 --2- 172.21.15.78:0/450572705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5a3650 0x55a13f5a3a30 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.468+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/450572705 >> 172.21.15.78:0/450572705 conn(0x55a13f5a1480 msgr2=0x55a13f5a2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:08.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.468+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/450572705 shutdown_connections 2024-09-11T00:25:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.468+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/450572705 wait complete. 2024-09-11T00:25:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.469+0000 7fcf5ebd7740 1 -- start start 2024-09-11T00:25:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.469+0000 7fcf5ebd7740 1 Processor -- start 2024-09-11T00:25:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.469+0000 7fcf5ebd7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5a3650 0x55a13f5af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.469+0000 7fcf5ebd7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 0x55a13f5acb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.469+0000 7fcf5ebd7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a13f5aff00 0x55a13f5ad040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.469+0000 7fcf5ebd7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a13f36a700 con 0x55a13f5a3650 2024-09-11T00:25:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.469+0000 7fcf5ebd7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55a13f4a4110 con 0x55a13f5aff00 2024-09-11T00:25:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.469+0000 7fcf5ebd7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a13f5b2b80 con 0x55a13f5a3f70 2024-09-11T00:25:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.469+0000 7fcf5ebd7740 10 client.0 _ll_register_callbacks cb 0x55a13f4bd990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:25:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.469+0000 7fcf55d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5a3650 0x55a13f5af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.469+0000 7fcf55d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5a3650 0x55a13f5af6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46364/0 (socket says 172.21.15.78:46364) 2024-09-11T00:25:08.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.469+0000 7fcf55d9b640 1 -- 172.21.15.78:0/2958715874 learned_addr learned my addr 172.21.15.78:0/2958715874 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.469+0000 7fcf5659c640 1 --2- 172.21.15.78:0/2958715874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 0x55a13f5acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.469+0000 7fcf55d9b640 1 -- 172.21.15.78:0/2958715874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 msgr2=0x55a13f5acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.469+0000 7fcf55d9b640 1 --2- 172.21.15.78:0/2958715874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 0x55a13f5acb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.469+0000 7fcf55d9b640 1 -- 172.21.15.78:0/2958715874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a13f5aff00 msgr2=0x55a13f5ad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.469+0000 7fcf55d9b640 1 --2- 172.21.15.78:0/2958715874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a13f5aff00 0x55a13f5ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.469+0000 7fcf55d9b640 1 -- 172.21.15.78:0/2958715874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a13f4d1c40 con 0x55a13f5a3650 2024-09-11T00:25:08.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.469+0000 7fcf5659c640 1 --2- 172.21.15.78:0/2958715874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 0x55a13f5acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:25:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.470+0000 7fcf55d9b640 1 --2- 172.21.15.78:0/2958715874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5a3650 0x55a13f5af6b0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00a830 tx=0x7fcf4c005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d311ebedaeec2425 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.470+0000 7fcf3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:25:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.470+0000 7fcf3dffb640 1 -- 172.21.15.78:0/2958715874 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c0051e0 con 0x55a13f5a3650 2024-09-11T00:25:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.470+0000 7fcf3dffb640 1 -- 172.21.15.78:0/2958715874 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8580+0+0 (secure 0 0 0) 0x7fcf4c005380 con 0x55a13f5a3650 2024-09-11T00:25:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.470+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/2958715874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf4c0047a0 con 0x55a13f5a3650 2024-09-11T00:25:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.470+0000 7fcf3dffb640 1 -- 172.21.15.78:0/2958715874 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcf4c012450 con 0x55a13f5a3650 2024-09-11T00:25:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.470+0000 7fcf5ebd7740 10 client.16539 fetch_fsmap learned FSMap version 20 2024-09-11T00:25:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.470+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/2958715874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a13f5be400 con 0x55a13f5a3650 2024-09-11T00:25:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.470+0000 7fcf3dffb640 1 -- 172.21.15.78:0/2958715874 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf4c0047a0 con 0x55a13f5a3650 2024-09-11T00:25:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.470+0000 7fcf3dffb640 1 -- 172.21.15.78:0/2958715874 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fcf4c00f650 con 0x55a13f5a3650 2024-09-11T00:25:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.470+0000 7fcf5ebd7740 10 client.16539 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:25:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.470+0000 7fcf5ebd7740 10 client.16539 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:25:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.470+0000 7fcf5ebd7740 20 client.16539 populate_metadata read hostname 'smithi078' 2024-09-11T00:25:08.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.470+0000 7fcf5ebd7740 1 --2- 172.21.15.78:0/2958715874 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a13f5bfb90 0x55a13f5c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.470+0000 7fcf5ebd7740 4 client.16539 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:25:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.470+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/2958715874 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a13f51bda0 con 0x55a13f5bfb90 2024-09-11T00:25:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.471+0000 7fcf5659c640 1 --2- 172.21.15.78:0/2958715874 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a13f5bfb90 0x55a13f5c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.471+0000 7fcf5659c640 1 --2- 172.21.15.78:0/2958715874 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a13f5bfb90 0x55a13f5c1fd0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38908887cfa5cca2 server_cookie=dc6081cd16552072 in_seq=0 out_seq=0 2024-09-11T00:25:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.471+0000 7fcf3dffb640 10 client.16539 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.472+0000 7fcf3dffb640 1 -- 172.21.15.78:0/2958715874 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a13f51bda0 con 0x55a13f5bfb90 2024-09-11T00:25:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.472+0000 7fcf3dffb640 10 client.16539 handle_command_reply: tid=0 2024-09-11T00:25:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.472+0000 7fcf5ebd7740 1 client.16539 shutdown 2024-09-11T00:25:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.472+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/2958715874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5a3650 msgr2=0x55a13f5af6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.472+0000 7fcf5ebd7740 1 --2- 172.21.15.78:0/2958715874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5a3650 0x55a13f5af6b0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00a830 tx=0x7fcf4c005700 comp rx=0 tx=0).stop 2024-09-11T00:25:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.472+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/2958715874 shutdown_connections 2024-09-11T00:25:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.472+0000 7fcf5ebd7740 1 --2- 172.21.15.78:0/2958715874 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a13f5bfb90 0x55a13f5c1fd0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.472+0000 7fcf5ebd7740 1 --2- 172.21.15.78:0/2958715874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a13f5aff00 0x55a13f5ad040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.472+0000 7fcf5ebd7740 1 --2- 172.21.15.78:0/2958715874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 0x55a13f5acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.472+0000 7fcf5ebd7740 1 --2- 172.21.15.78:0/2958715874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5a3650 0x55a13f5af6b0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.472+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/2958715874 >> 172.21.15.78:0/2958715874 conn(0x55a13f5a1480 msgr2=0x55a13f5a6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.472+0000 7fcf3dffb640 0 client.16539 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.472+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/2958715874 shutdown_connections 2024-09-11T00:25:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.472+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/2958715874 wait complete. 2024-09-11T00:25:08.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.472+0000 7fcf5ebd7740 20 client.16539 trim_cache size 0 max 16384 2024-09-11T00:25:08.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.489+0000 7fcf5ebd7740 1 Processor -- start 2024-09-11T00:25:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.489+0000 7fcf5ebd7740 1 -- start start 2024-09-11T00:25:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.489+0000 7fcf5ebd7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5a3650 0x55a13f5a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.489+0000 7fcf5ebd7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 0x55a13f5a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.489+0000 7fcf5ebd7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a13f5aff00 0x55a13f5aa250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.489+0000 7fcf5ebd7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcf581ae740 con 0x55a13f5a3650 2024-09-11T00:25:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.489+0000 7fcf5ebd7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcf581b0fa0 con 0x55a13f5aff00 2024-09-11T00:25:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.489+0000 7fcf5ebd7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcf581aed90 con 0x55a13f5a3f70 2024-09-11T00:25:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.489+0000 7fcf55d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5a3650 0x55a13f5a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.490+0000 7fcf55d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5a3650 0x55a13f5a0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46380/0 (socket says 172.21.15.78:46380) 2024-09-11T00:25:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.490+0000 7fcf55d9b640 1 -- 172.21.15.78:0/3605313289 learned_addr learned my addr 172.21.15.78:0/3605313289 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.490+0000 7fcf5659c640 1 --2- 172.21.15.78:0/3605313289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 0x55a13f5a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:08.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.490+0000 7fcf55d9b640 1 -- 172.21.15.78:0/3605313289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 msgr2=0x55a13f5a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.490+0000 7fcf55d9b640 1 --2- 172.21.15.78:0/3605313289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 0x55a13f5a9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.490+0000 7fcf55d9b640 1 -- 172.21.15.78:0/3605313289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a13f5aff00 msgr2=0x55a13f5aa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.490+0000 7fcf55d9b640 1 --2- 172.21.15.78:0/3605313289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a13f5aff00 0x55a13f5aa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.490+0000 7fcf55d9b640 1 -- 172.21.15.78:0/3605313289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a13f5ac8b0 con 0x55a13f5a3650 2024-09-11T00:25:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.490+0000 7fcf5659c640 1 --2- 172.21.15.78:0/3605313289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 0x55a13f5a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:25:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.490+0000 7fcf55d9b640 1 --2- 172.21.15.78:0/3605313289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5a3650 0x55a13f5a0e10 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00fa20 tx=0x7fcf4c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d30faba607f325 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.490+0000 7fcf3ffff640 1 -- 172.21.15.78:0/3605313289 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c033030 con 0x55a13f5a3650 2024-09-11T00:25:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.490+0000 7fcf3ffff640 1 -- 172.21.15.78:0/3605313289 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf4c022030 con 0x55a13f5a3650 2024-09-11T00:25:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.490+0000 7fcf3ffff640 1 -- 172.21.15.78:0/3605313289 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c0125f0 con 0x55a13f5a3650 2024-09-11T00:25:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.491+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/3605313289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5a3650 msgr2=0x55a13f5a0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.491+0000 7fcf5ebd7740 1 --2- 172.21.15.78:0/3605313289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5a3650 0x55a13f5a0e10 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00fa20 tx=0x7fcf4c000bc0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.491+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/3605313289 shutdown_connections 2024-09-11T00:25:08.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.491+0000 7fcf5ebd7740 1 --2- 172.21.15.78:0/3605313289 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a13f5aff00 0x55a13f5aa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.491+0000 7fcf5ebd7740 1 --2- 172.21.15.78:0/3605313289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 0x55a13f5a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.491+0000 7fcf5ebd7740 1 --2- 172.21.15.78:0/3605313289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5a3650 0x55a13f5a0e10 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.491+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/3605313289 >> 172.21.15.78:0/3605313289 conn(0x55a13f5a1480 msgr2=0x55a13f5ab380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:08.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.491+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/3605313289 shutdown_connections 2024-09-11T00:25:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.491+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/3605313289 wait complete. 2024-09-11T00:25:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.491+0000 7fcf5ebd7740 1 -- start start 2024-09-11T00:25:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.491+0000 7fcf5ebd7740 1 Processor -- start 2024-09-11T00:25:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.491+0000 7fcf5ebd7740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a13f5a3650 0x55a13f5b8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.491+0000 7fcf5ebd7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 0x55a13f5b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.491+0000 7fcf5ebd7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5aff00 0x55a13f5b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.491+0000 7fcf5ebd7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcf581af460 con 0x55a13f5aff00 2024-09-11T00:25:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.491+0000 7fcf5ebd7740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcf581b08d0 con 0x55a13f5a3650 2024-09-11T00:25:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.491+0000 7fcf5ebd7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcf581afb30 con 0x55a13f5a3f70 2024-09-11T00:25:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.491+0000 7fcf5ebd7740 10 client.0 _ll_register_callbacks cb 0x7fcf4800b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:25:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.492+0000 7fcf55d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5aff00 0x55a13f5b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.492+0000 7fcf55d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5aff00 0x55a13f5b3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46384/0 (socket says 172.21.15.78:46384) 2024-09-11T00:25:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.492+0000 7fcf55d9b640 1 -- 172.21.15.78:0/2752249571 learned_addr learned my addr 172.21.15.78:0/2752249571 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.492+0000 7fcf55d9b640 1 --2- 172.21.15.78:0/2752249571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a13f5a3650 0x55a13f5b8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.492+0000 7fcf5659c640 1 --2- 172.21.15.78:0/2752249571 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 0x55a13f5b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.492+0000 7fcf55d9b640 1 -- 172.21.15.78:0/2752249571 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 msgr2=0x55a13f5b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.492+0000 7fcf55d9b640 1 --2- 172.21.15.78:0/2752249571 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 0x55a13f5b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.492+0000 7fcf55d9b640 1 -- 172.21.15.78:0/2752249571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a13f5a3650 msgr2=0x55a13f5b8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.492+0000 7fcf55d9b640 1 --2- 172.21.15.78:0/2752249571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a13f5a3650 0x55a13f5b8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.492+0000 7fcf55d9b640 1 -- 172.21.15.78:0/2752249571 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a13f5b44f0 con 0x55a13f5aff00 2024-09-11T00:25:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.492+0000 7fcf55d9b640 1 --2- 172.21.15.78:0/2752249571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5aff00 0x55a13f5b3e80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c0058c0 tx=0x7fcf4c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77cac2fce2659741 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.492+0000 7fcf3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:25:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.492+0000 7fcf3dffb640 1 -- 172.21.15.78:0/2752249571 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c033070 con 0x55a13f5aff00 2024-09-11T00:25:08.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.492+0000 7fcf3dffb640 1 -- 172.21.15.78:0/2752249571 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8580+0+0 (secure 0 0 0) 0x7fcf4c0127f0 con 0x55a13f5aff00 2024-09-11T00:25:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.492+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/2752249571 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf4c022030 con 0x55a13f5aff00 2024-09-11T00:25:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.492+0000 7fcf3dffb640 1 -- 172.21.15.78:0/2752249571 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcf4c01e040 con 0x55a13f5aff00 2024-09-11T00:25:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.492+0000 7fcf5ebd7740 10 client.16545 fetch_fsmap learned FSMap version 20 2024-09-11T00:25:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.492+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/2752249571 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a13f62c8f0 con 0x55a13f5aff00 2024-09-11T00:25:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.493+0000 7fcf3dffb640 1 -- 172.21.15.78:0/2752249571 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf4c022030 con 0x55a13f5aff00 2024-09-11T00:25:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.493+0000 7fcf3dffb640 1 -- 172.21.15.78:0/2752249571 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fcf4c038810 con 0x55a13f5aff00 2024-09-11T00:25:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.493+0000 7fcf5ebd7740 10 client.16545 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:25:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.493+0000 7fcf5ebd7740 10 client.16545 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:25:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.493+0000 7fcf5ebd7740 20 client.16545 populate_metadata read hostname 'smithi078' 2024-09-11T00:25:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.493+0000 7fcf5ebd7740 1 --2- 172.21.15.78:0/2752249571 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a13f62cf20 0x55a13f62f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.493+0000 7fcf5ebd7740 4 client.16545 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:25:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.493+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/2752249571 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a13f517850 con 0x55a13f62cf20 2024-09-11T00:25:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.493+0000 7fcf5659c640 1 --2- 172.21.15.78:0/2752249571 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a13f62cf20 0x55a13f62f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.494+0000 7fcf3dffb640 10 client.16545 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.494+0000 7fcf5659c640 1 --2- 172.21.15.78:0/2752249571 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a13f62cf20 0x55a13f62f340 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a13e0f355dbb36e7 server_cookie=89059659f78fdc1c in_seq=0 out_seq=0 2024-09-11T00:25:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.494+0000 7fcf3dffb640 1 -- 172.21.15.78:0/2752249571 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5114 (crc 0 0 0) 0x55a13f517850 con 0x55a13f62cf20 2024-09-11T00:25:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.494+0000 7fcf3dffb640 10 client.16545 handle_command_reply: tid=0 2024-09-11T00:25:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.494+0000 7fcf5ebd7740 1 client.16545 shutdown 2024-09-11T00:25:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.494+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/2752249571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5aff00 msgr2=0x55a13f5b3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.494+0000 7fcf5ebd7740 1 --2- 172.21.15.78:0/2752249571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5aff00 0x55a13f5b3e80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c0058c0 tx=0x7fcf4c005a50 comp rx=0 tx=0).stop 2024-09-11T00:25:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.494+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/2752249571 shutdown_connections 2024-09-11T00:25:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.494+0000 7fcf5ebd7740 1 --2- 172.21.15.78:0/2752249571 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55a13f62cf20 0x55a13f62f340 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.494+0000 7fcf5ebd7740 1 --2- 172.21.15.78:0/2752249571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a13f5aff00 0x55a13f5b3e80 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.494+0000 7fcf5ebd7740 1 --2- 172.21.15.78:0/2752249571 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a13f5a3f70 0x55a13f5b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.494+0000 7fcf5ebd7740 1 --2- 172.21.15.78:0/2752249571 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55a13f5a3650 0x55a13f5b8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.494+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/2752249571 >> 172.21.15.78:0/2752249571 conn(0x55a13f5a1480 msgr2=0x55a13f5ae130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.494+0000 7fcf3dffb640 0 client.16545 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.494+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/2752249571 shutdown_connections 2024-09-11T00:25:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.494+0000 7fcf5ebd7740 1 -- 172.21.15.78:0/2752249571 wait complete. 2024-09-11T00:25:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.494+0000 7fcf5ebd7740 20 client.16545 trim_cache size 0 max 16384 2024-09-11T00:25:08.504 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:25:08.504 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:25:08.504 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-11T00:25:08.504 INFO:teuthology.orchestra.run.smithi078.stdout: "59d341c2-815c-48b1-a216-aa6fac6078a0": { 2024-09-11T00:25:08.504 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:08.504 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "59d341c2-815c-48b1-a216-aa6fac6078a0", 2024-09-11T00:25:08.505 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-11T00:25:08.505 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:25:08.505 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:08.505 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:25:08.505 INFO:teuthology.orchestra.run.smithi078.stdout: "f6eb5d15-216e-4f8b-b451-2f71b931998f": { 2024-09-11T00:25:08.505 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:48.289319+0000", 2024-09-11T00:25:08.505 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:08.505 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:08.505 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:08.505 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:08.505 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:08.505 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:08.505 INFO:teuthology.orchestra.run.smithi078.stdout: "e21db329-a274-4cfd-924a-8ec929e04bd1": { 2024-09-11T00:25:08.506 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:41.131504+0000", 2024-09-11T00:25:08.506 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:08.506 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:08.506 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:08.506 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:08.506 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:08.506 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:08.506 INFO:teuthology.orchestra.run.smithi078.stdout: "b854cbd3-8ca7-4277-a205-8887d2ff5567": { 2024-09-11T00:25:08.506 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:11.182949+0000", 2024-09-11T00:25:08.506 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:08.506 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:08.506 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:08.506 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:08.506 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:08.507 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:08.507 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:25:08.507 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:25:08.507 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:08.507 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:08.507 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:08.507 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:08.507 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:08.507 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:08.507 INFO:teuthology.orchestra.run.smithi078.stdout: "59d341c2-815c-48b1-a216-aa6fac6078a0": { 2024-09-11T00:25:08.507 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:25:06.855284+0000", 2024-09-11T00:25:08.507 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:08.507 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:08.507 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:08.508 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:08.508 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:08.508 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:08.508 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:25:08.508 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:25:08.508 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:08.508 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:08.508 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:08.508 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:08.508 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:08.508 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:08.508 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:25:08.508 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:25:08.508 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:08.509 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:08.509 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:08.509 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:08.509 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:08.509 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:08.509 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:25:08.509 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:25:08.509 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:08.509 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:08.509 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:08.509 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:08.509 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:08.509 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:08.509 INFO:teuthology.orchestra.run.smithi078.stdout: "81d31d3a-c224-4ded-9f00-1a7dfc099ec4": { 2024-09-11T00:25:08.510 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:16.296700+0000", 2024-09-11T00:25:08.510 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:08.510 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:08.510 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:08.510 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:08.510 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:08.510 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:08.510 INFO:teuthology.orchestra.run.smithi078.stdout: "1c04b4f1-c4c4-4289-b172-fba45b64018a": { 2024-09-11T00:25:08.510 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:24:27.591301+0000", 2024-09-11T00:25:08.510 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:08.510 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:08.510 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:08.510 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:08.510 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:08.511 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:08.511 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:25:08.511 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:25:08.511 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:08.511 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:08.511 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:08.511 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:08.511 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:08.511 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:08.511 INFO:teuthology.orchestra.run.smithi078.stdout: "38a1d30d-5f4c-460a-afcd-e6c60b97e43a": { 2024-09-11T00:25:08.511 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:58.127727+0000", 2024-09-11T00:25:08.511 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:08.511 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:08.512 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:08.512 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:08.512 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:08.512 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:08.512 INFO:teuthology.orchestra.run.smithi078.stdout: "8ec9e858-aa62-420d-a112-e62ea7810e63": { 2024-09-11T00:25:08.512 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:18.882749+0000", 2024-09-11T00:25:08.512 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:08.512 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:08.512 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:08.512 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:08.512 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:08.513 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:08.513 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:25:08.513 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:25:08.513 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:08.513 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:08.513 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:08.513 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:08.513 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:08.513 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:08.513 INFO:teuthology.orchestra.run.smithi078.stdout: "1b9391c2-08f3-479a-9538-deea28f7743b": { 2024-09-11T00:25:08.513 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:02.327508+0000", 2024-09-11T00:25:08.514 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:08.514 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:08.514 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:08.514 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:08.514 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:08.514 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:08.514 INFO:teuthology.orchestra.run.smithi078.stdout: "e0002672-e432-4890-ab9f-20c513c5e3b6": { 2024-09-11T00:25:08.514 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:21:37.161715+0000", 2024-09-11T00:25:08.514 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:08.514 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:08.514 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:08.514 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:08.514 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:08.515 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:08.515 INFO:teuthology.orchestra.run.smithi078.stdout: "f494d5ed-e0dc-44bb-8aba-a861b3e751f4": { 2024-09-11T00:25:08.515 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:55.251691+0000", 2024-09-11T00:25:08.515 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:08.515 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:08.515 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:08.515 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:08.515 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:08.515 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:25:08.515 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:25:08.515 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:25:08.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.495+0000 7fcf5759e640 1 -- 172.21.15.78:0/2981195954 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcf400b5500 msgr2=0x7fcf400b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:08.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.495+0000 7fcf5759e640 1 --2- 172.21.15.78:0/2981195954 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcf400b5500 0x7fcf400b79c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcf500cd5d0 tx=0x7fcf50092040 comp rx=0 tx=0).stop 2024-09-11T00:25:08.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.495+0000 7fcf5759e640 1 -- 172.21.15.78:0/2981195954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf58105dd0 msgr2=0x7fcf58102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:08.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.495+0000 7fcf5759e640 1 --2- 172.21.15.78:0/2981195954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf58105dd0 0x7fcf58102c80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fcf50005cc0 tx=0x7fcf5002f380 comp rx=0 tx=0).stop 2024-09-11T00:25:08.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.495+0000 7fcf5759e640 1 -- 172.21.15.78:0/2981195954 shutdown_connections 2024-09-11T00:25:08.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.495+0000 7fcf5759e640 1 --2- 172.21.15.78:0/2981195954 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcf400b5500 0x7fcf400b79c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.495+0000 7fcf5759e640 1 --2- 172.21.15.78:0/2981195954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf58105dd0 0x7fcf58102c80 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.495+0000 7fcf5759e640 1 --2- 172.21.15.78:0/2981195954 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf58105410 0x7fcf58102740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.495+0000 7fcf5759e640 1 --2- 172.21.15.78:0/2981195954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf58101230 0x7fcf58102200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:08.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.495+0000 7fcf5759e640 1 -- 172.21.15.78:0/2981195954 >> 172.21.15.78:0/2981195954 conn(0x7fcf580fd2f0 msgr2=0x7fcf58106d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:08.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.495+0000 7fcf5759e640 1 -- 172.21.15.78:0/2981195954 shutdown_connections 2024-09-11T00:25:08.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:08.495+0000 7fcf5759e640 1 -- 172.21.15.78:0/2981195954 wait complete. 2024-09-11T00:25:09.401 INFO:tasks.cephfs.filesystem:scrub status for tag:59d341c2-815c-48b1-a216-aa6fac6078a0 - {'path': '/', 'tag': '59d341c2-815c-48b1-a216-aa6fac6078a0', 'options': 'recursive,force'} 2024-09-11T00:25:10.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:09 smithi112 ceph-mon[35627]: pgmap v589: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T00:25:10.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:09 smithi138 ceph-mon[35019]: pgmap v589: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T00:25:10.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:09 smithi078 ceph-mon[30865]: pgmap v589: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T00:25:11.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:11 smithi112 ceph-mon[35627]: scrub summary: idle 2024-09-11T00:25:11.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:11 smithi138 ceph-mon[35019]: scrub summary: idle 2024-09-11T00:25:11.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:11 smithi078 ceph-mon[30865]: scrub summary: idle 2024-09-11T00:25:12.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:12 smithi112 ceph-mon[35627]: pgmap v590: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 28 KiB/s wr, 5 op/s 2024-09-11T00:25:12.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:12 smithi138 ceph-mon[35019]: pgmap v590: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 28 KiB/s wr, 5 op/s 2024-09-11T00:25:12.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:12 smithi078 ceph-mon[30865]: pgmap v590: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 28 KiB/s wr, 5 op/s 2024-09-11T00:25:14.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:13 smithi112 ceph-mon[35627]: pgmap v591: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 921 B/s wr, 3 op/s 2024-09-11T00:25:14.258 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:13 smithi078 ceph-mon[30865]: pgmap v591: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 921 B/s wr, 3 op/s 2024-09-11T00:25:14.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:13 smithi138 ceph-mon[35019]: pgmap v591: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 921 B/s wr, 3 op/s 2024-09-11T00:25:16.935 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:16 smithi112 ceph-mon[35627]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T00:25:16.935 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:16 smithi112 ceph-mon[35627]: pgmap v593: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 229 B/s wr, 2 op/s 2024-09-11T00:25:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:16 smithi138 ceph-mon[35019]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T00:25:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:16 smithi138 ceph-mon[35019]: pgmap v593: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 229 B/s wr, 2 op/s 2024-09-11T00:25:17.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:16 smithi078 ceph-mon[30865]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T00:25:17.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:16 smithi078 ceph-mon[30865]: pgmap v593: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 229 B/s wr, 2 op/s 2024-09-11T00:25:18.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:17 smithi112 ceph-mon[35627]: pgmap v594: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T00:25:18.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:17 smithi138 ceph-mon[35019]: pgmap v594: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T00:25:18.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:17 smithi078 ceph-mon[30865]: pgmap v594: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T00:25:20.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:19 smithi112 ceph-mon[35627]: pgmap v595: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T00:25:20.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:19 smithi138 ceph-mon[35019]: pgmap v595: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T00:25:20.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:19 smithi078 ceph-mon[30865]: pgmap v595: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-11T00:25:22.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:21 smithi112 ceph-mon[35627]: pgmap v596: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T00:25:22.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:21 smithi138 ceph-mon[35019]: pgmap v596: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T00:25:22.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:21 smithi078 ceph-mon[30865]: pgmap v596: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T00:25:24.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:23 smithi112 ceph-mon[35627]: pgmap v597: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T00:25:24.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:23 smithi138 ceph-mon[35019]: pgmap v597: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T00:25:24.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:23 smithi078 ceph-mon[30865]: pgmap v597: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-11T00:25:26.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:25 smithi112 ceph-mon[35627]: pgmap v598: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 B/s rd, 1 op/s 2024-09-11T00:25:26.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:25 smithi138 ceph-mon[35019]: pgmap v598: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 B/s rd, 1 op/s 2024-09-11T00:25:26.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:25 smithi078 ceph-mon[30865]: pgmap v598: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 B/s rd, 1 op/s 2024-09-11T00:25:28.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:27 smithi112 ceph-mon[35627]: pgmap v599: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:28.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:27 smithi138 ceph-mon[35019]: pgmap v599: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:28.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:27 smithi078 ceph-mon[30865]: pgmap v599: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:30.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:29 smithi112 ceph-mon[35627]: pgmap v600: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:30.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:29 smithi138 ceph-mon[35019]: pgmap v600: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:30.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:29 smithi078 ceph-mon[30865]: pgmap v600: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:32.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:31 smithi112 ceph-mon[35627]: pgmap v601: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:25:32.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:31 smithi138 ceph-mon[35019]: pgmap v601: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:25:32.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:31 smithi078 ceph-mon[30865]: pgmap v601: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:25:34.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:33 smithi112 ceph-mon[35627]: pgmap v602: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:34.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:33 smithi138 ceph-mon[35019]: pgmap v602: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:34.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:33 smithi078 ceph-mon[30865]: pgmap v602: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:36.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:35 smithi112 ceph-mon[35627]: pgmap v603: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:25:36.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:35 smithi138 ceph-mon[35019]: pgmap v603: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:25:36.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:35 smithi078 ceph-mon[30865]: pgmap v603: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:25:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:37 smithi112 ceph-mon[35627]: pgmap v604: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:38.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:37 smithi138 ceph-mon[35019]: pgmap v604: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:38.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:37 smithi078 ceph-mon[30865]: pgmap v604: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:39.403 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:25:39.659 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:25:40.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:39 smithi078 ceph-mon[30865]: pgmap v605: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:40.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.173+0000 7fdddb4eb640 1 -- 172.21.15.78:0/1870622956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd4109150 msgr2=0x7fddd410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:40.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.173+0000 7fdddb4eb640 1 --2- 172.21.15.78:0/1870622956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd4109150 0x7fddd410f950 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009900 tx=0x7fddcc02a410 comp rx=0 tx=0).stop 2024-09-11T00:25:40.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.173+0000 7fdddb4eb640 1 -- 172.21.15.78:0/1870622956 shutdown_connections 2024-09-11T00:25:40.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.173+0000 7fdddb4eb640 1 --2- 172.21.15.78:0/1870622956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd4109150 0x7fddd410f950 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.173+0000 7fdddb4eb640 1 --2- 172.21.15.78:0/1870622956 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddd41087d0 0x7fddd4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.173+0000 7fdddb4eb640 1 --2- 172.21.15.78:0/1870622956 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddd4102dc0 0x7fddd41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.173+0000 7fdddb4eb640 1 -- 172.21.15.78:0/1870622956 >> 172.21.15.78:0/1870622956 conn(0x7fddd40fe830 msgr2=0x7fddd4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:40.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.173+0000 7fdddb4eb640 1 -- 172.21.15.78:0/1870622956 shutdown_connections 2024-09-11T00:25:40.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.173+0000 7fdddb4eb640 1 -- 172.21.15.78:0/1870622956 wait complete. 2024-09-11T00:25:40.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.173+0000 7fdddb4eb640 1 Processor -- start 2024-09-11T00:25:40.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.173+0000 7fdddb4eb640 1 -- start start 2024-09-11T00:25:40.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.174+0000 7fdddb4eb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddd4102dc0 0x7fddd4199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:40.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.174+0000 7fdddb4eb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd41087d0 0x7fddd41997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:40.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.174+0000 7fdddb4eb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddd4109150 0x7fddd419eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:40.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.174+0000 7fdddb4eb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fddd4112e10 con 0x7fddd41087d0 2024-09-11T00:25:40.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.174+0000 7fdddb4eb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fddd4112c90 con 0x7fddd4109150 2024-09-11T00:25:40.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.174+0000 7fdddb4eb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fddd4112f90 con 0x7fddd4102dc0 2024-09-11T00:25:40.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.174+0000 7fddd8a86640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd41087d0 0x7fddd41997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:40.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.174+0000 7fddd8a86640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd41087d0 0x7fddd41997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43300/0 (socket says 172.21.15.78:43300) 2024-09-11T00:25:40.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.174+0000 7fddd8a86640 1 -- 172.21.15.78:0/4092875608 learned_addr learned my addr 172.21.15.78:0/4092875608 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:40.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.174+0000 7fddd9287640 1 --2- 172.21.15.78:0/4092875608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddd4102dc0 0x7fddd4199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:40.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.174+0000 7fddd8a86640 1 -- 172.21.15.78:0/4092875608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddd4102dc0 msgr2=0x7fddd4199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:40.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.174+0000 7fddd8a86640 1 --2- 172.21.15.78:0/4092875608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddd4102dc0 0x7fddd4199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.174+0000 7fddd9a88640 1 --2- 172.21.15.78:0/4092875608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddd4109150 0x7fddd419eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:40.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.174+0000 7fddd8a86640 1 -- 172.21.15.78:0/4092875608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddd4109150 msgr2=0x7fddd419eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:40.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.174+0000 7fddd8a86640 1 --2- 172.21.15.78:0/4092875608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddd4109150 0x7fddd419eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.174+0000 7fddd8a86640 1 -- 172.21.15.78:0/4092875608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd419f340 con 0x7fddd41087d0 2024-09-11T00:25:40.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.174+0000 7fddd8a86640 1 --2- 172.21.15.78:0/4092875608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd41087d0 0x7fddd41997d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fddc800d950 tx=0x7fddc800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:40.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.175+0000 7fddd27fc640 1 -- 172.21.15.78:0/4092875608 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8017070 con 0x7fddd41087d0 2024-09-11T00:25:40.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.175+0000 7fddd27fc640 1 -- 172.21.15.78:0/4092875608 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddc8009c30 con 0x7fddd41087d0 2024-09-11T00:25:40.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.175+0000 7fddd27fc640 1 -- 172.21.15.78:0/4092875608 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc800f620 con 0x7fddd41087d0 2024-09-11T00:25:40.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.175+0000 7fdddb4eb640 1 -- 172.21.15.78:0/4092875608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd419f630 con 0x7fddd41087d0 2024-09-11T00:25:40.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.175+0000 7fdddb4eb640 1 -- 172.21.15.78:0/4092875608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd41a5d70 con 0x7fddd41087d0 2024-09-11T00:25:40.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.177+0000 7fddd27fc640 1 -- 172.21.15.78:0/4092875608 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fddc8010460 con 0x7fddd41087d0 2024-09-11T00:25:40.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.177+0000 7fdddd8c0740 1 Processor -- start 2024-09-11T00:25:40.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.177+0000 7fdddd8c0740 1 -- start start 2024-09-11T00:25:40.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fdddd8c0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d287a2f0a0 0x55d287a2f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:40.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fdddd8c0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f9c0 0x55d287a3f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:40.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fdddd8c0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d287a3fd60 0x55d287a42150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:40.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fdddd8c0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55d2879a5e50 con 0x55d287a2f9c0 2024-09-11T00:25:40.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fdddd8c0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d287995280 con 0x55d287a3fd60 2024-09-11T00:25:40.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fdddd8c0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55d287999090 con 0x55d287a2f0a0 2024-09-11T00:25:40.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fddd9287640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f9c0 0x55d287a3f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:40.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fddd9287640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f9c0 0x55d287a3f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43312/0 (socket says 172.21.15.78:43312) 2024-09-11T00:25:40.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fddd9287640 1 -- 172.21.15.78:0/1690818747 learned_addr learned my addr 172.21.15.78:0/1690818747 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:40.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fddd27fc640 1 --2- 172.21.15.78:0/4092875608 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fddbc0b5450 0x7fddbc0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:40.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fddd9a88640 1 --2- 172.21.15.78:0/1690818747 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d287a2f0a0 0x55d287a2f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:40.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fddd8a86640 1 --2- 172.21.15.78:0/1690818747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d287a3fd60 0x55d287a42150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:40.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fddd9287640 1 -- 172.21.15.78:0/1690818747 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d287a2f0a0 msgr2=0x55d287a2f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:40.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fddd9287640 1 --2- 172.21.15.78:0/1690818747 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d287a2f0a0 0x55d287a2f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fddd9287640 1 -- 172.21.15.78:0/1690818747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d287a3fd60 msgr2=0x55d287a42150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:40.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fddd9287640 1 --2- 172.21.15.78:0/1690818747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d287a3fd60 0x55d287a42150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fddd9287640 1 -- 172.21.15.78:0/1690818747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2876f3650 con 0x55d287a2f9c0 2024-09-11T00:25:40.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fddd9a88640 1 --2- 172.21.15.78:0/4092875608 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fddbc0b5450 0x7fddbc0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:40.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fddd27fc640 1 -- 172.21.15.78:0/4092875608 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7fddc80e5cf0 con 0x7fddd41087d0 2024-09-11T00:25:40.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fddd9287640 1 --2- 172.21.15.78:0/1690818747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f9c0 0x55d287a3f820 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fddc400a4e0 tx=0x7fddc40096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb3cf312501ade2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:40.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fddbb7fe640 1 -- 172.21.15.78:0/1690818747 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4018020 con 0x55d287a2f9c0 2024-09-11T00:25:40.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fddbb7fe640 1 -- 172.21.15.78:0/1690818747 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddc4014cc0 con 0x55d287a2f9c0 2024-09-11T00:25:40.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.178+0000 7fddbb7fe640 1 -- 172.21.15.78:0/1690818747 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4013c90 con 0x55d287a2f9c0 2024-09-11T00:25:40.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.179+0000 7fdddd8c0740 1 -- 172.21.15.78:0/1690818747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f9c0 msgr2=0x55d287a3f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:40.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.179+0000 7fddd9a88640 1 --2- 172.21.15.78:0/4092875608 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fddbc0b5450 0x7fddbc0b7910 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fddcc005940 tx=0x7fddcc009260 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:40.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.179+0000 7fdddd8c0740 1 --2- 172.21.15.78:0/1690818747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f9c0 0x55d287a3f820 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fddc400a4e0 tx=0x7fddc40096d0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.179+0000 7fdddd8c0740 1 -- 172.21.15.78:0/1690818747 shutdown_connections 2024-09-11T00:25:40.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.179+0000 7fdddd8c0740 1 --2- 172.21.15.78:0/1690818747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d287a3fd60 0x55d287a42150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.179+0000 7fdddd8c0740 1 --2- 172.21.15.78:0/1690818747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f9c0 0x55d287a3f820 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.179+0000 7fdddd8c0740 1 --2- 172.21.15.78:0/1690818747 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d287a2f0a0 0x55d287a2f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.179+0000 7fdddd8c0740 1 -- 172.21.15.78:0/1690818747 >> 172.21.15.78:0/1690818747 conn(0x55d287a2ced0 msgr2=0x55d287a2e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:40.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.179+0000 7fdddd8c0740 1 -- 172.21.15.78:0/1690818747 shutdown_connections 2024-09-11T00:25:40.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.179+0000 7fdddd8c0740 1 -- 172.21.15.78:0/1690818747 wait complete. 2024-09-11T00:25:40.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.180+0000 7fdddd8c0740 1 -- start start 2024-09-11T00:25:40.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.180+0000 7fdddd8c0740 1 Processor -- start 2024-09-11T00:25:40.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.180+0000 7fdddd8c0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f0a0 0x55d287a3f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:40.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.180+0000 7fdddd8c0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d287a2f9c0 0x55d287a3ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:40.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.180+0000 7fdddd8c0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d287a3fd60 0x55d287a3d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:40.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.180+0000 7fdddd8c0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55d2877f6700 con 0x55d287a2f0a0 2024-09-11T00:25:40.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.180+0000 7fdddd8c0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55d287930110 con 0x55d287a2f9c0 2024-09-11T00:25:40.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.180+0000 7fdddd8c0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55d287a42a10 con 0x55d287a3fd60 2024-09-11T00:25:40.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.180+0000 7fdddd8c0740 10 client.0 _ll_register_callbacks cb 0x55d287949990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:25:40.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.180+0000 7fddd9287640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f0a0 0x55d287a3f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:40.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.180+0000 7fddd9287640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f0a0 0x55d287a3f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43316/0 (socket says 172.21.15.78:43316) 2024-09-11T00:25:40.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.180+0000 7fddd9287640 1 -- 172.21.15.78:0/1216990669 learned_addr learned my addr 172.21.15.78:0/1216990669 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:40.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.180+0000 7fddd9287640 1 -- 172.21.15.78:0/1216990669 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d287a3fd60 msgr2=0x55d287a3d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:40.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.180+0000 7fddd9287640 1 --2- 172.21.15.78:0/1216990669 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d287a3fd60 0x55d287a3d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.180+0000 7fddd9287640 1 -- 172.21.15.78:0/1216990669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d287a2f9c0 msgr2=0x55d287a3ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:40.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.180+0000 7fddd9287640 1 --2- 172.21.15.78:0/1216990669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d287a2f9c0 0x55d287a3ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.180+0000 7fddd9287640 1 -- 172.21.15.78:0/1216990669 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d28795dc40 con 0x55d287a2f0a0 2024-09-11T00:25:40.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.181+0000 7fddd9287640 1 --2- 172.21.15.78:0/1216990669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f0a0 0x55d287a3f620 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fddc4004a80 tx=0x7fddc4013590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b5d512e698aa77 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:40.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.181+0000 7fddb8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:25:40.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.181+0000 7fddb8ff9640 1 -- 172.21.15.78:0/1216990669 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4014a20 con 0x55d287a2f0a0 2024-09-11T00:25:40.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.181+0000 7fddb8ff9640 1 -- 172.21.15.78:0/1216990669 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7fddc4028480 con 0x55d287a2f0a0 2024-09-11T00:25:40.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.181+0000 7fdddd8c0740 1 -- 172.21.15.78:0/1216990669 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddc4014cc0 con 0x55d287a2f0a0 2024-09-11T00:25:40.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.181+0000 7fddb8ff9640 1 -- 172.21.15.78:0/1216990669 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fddc4009390 con 0x55d287a2f0a0 2024-09-11T00:25:40.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.181+0000 7fdddd8c0740 10 client.16557 fetch_fsmap learned FSMap version 20 2024-09-11T00:25:40.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.181+0000 7fdddd8c0740 1 -- 172.21.15.78:0/1216990669 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d287a4e310 con 0x55d287a2f0a0 2024-09-11T00:25:40.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.181+0000 7fddb8ff9640 1 -- 172.21.15.78:0/1216990669 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddc4014cc0 con 0x55d287a2f0a0 2024-09-11T00:25:40.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.181+0000 7fddb8ff9640 1 -- 172.21.15.78:0/1216990669 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fddc401d5e0 con 0x55d287a2f0a0 2024-09-11T00:25:40.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.181+0000 7fdddd8c0740 10 client.16557 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:25:40.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.181+0000 7fdddd8c0740 10 client.16557 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:25:40.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.181+0000 7fdddd8c0740 20 client.16557 populate_metadata read hostname 'smithi078' 2024-09-11T00:25:40.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.181+0000 7fdddd8c0740 1 --2- 172.21.15.78:0/1216990669 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55d287a4f770 0x55d287a51b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:40.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.181+0000 7fdddd8c0740 4 client.16557 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:25:40.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.181+0000 7fdddd8c0740 1 -- 172.21.15.78:0/1216990669 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2879a7da0 con 0x55d287a4f770 2024-09-11T00:25:40.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.182+0000 7fddd8a86640 1 --2- 172.21.15.78:0/1216990669 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55d287a4f770 0x55d287a51b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:40.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.182+0000 7fddb8ff9640 10 client.16557 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:40.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.182+0000 7fddd8a86640 1 --2- 172.21.15.78:0/1216990669 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55d287a4f770 0x55d287a51b60 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b3ea9caf1026077 server_cookie=9b2297088b4b6ca1 in_seq=0 out_seq=0 2024-09-11T00:25:40.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.183+0000 7fddb8ff9640 1 -- 172.21.15.78:0/1216990669 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d2879a7da0 con 0x55d287a4f770 2024-09-11T00:25:40.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.183+0000 7fddb8ff9640 10 client.16557 handle_command_reply: tid=0 2024-09-11T00:25:40.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.183+0000 7fdddd8c0740 1 client.16557 shutdown 2024-09-11T00:25:40.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.183+0000 7fdddd8c0740 1 -- 172.21.15.78:0/1216990669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f0a0 msgr2=0x55d287a3f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:40.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.183+0000 7fdddd8c0740 1 --2- 172.21.15.78:0/1216990669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f0a0 0x55d287a3f620 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fddc4004a80 tx=0x7fddc4013590 comp rx=0 tx=0).stop 2024-09-11T00:25:40.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.183+0000 7fdddd8c0740 1 -- 172.21.15.78:0/1216990669 shutdown_connections 2024-09-11T00:25:40.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.183+0000 7fdddd8c0740 1 --2- 172.21.15.78:0/1216990669 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55d287a4f770 0x55d287a51b60 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.183+0000 7fdddd8c0740 1 --2- 172.21.15.78:0/1216990669 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d287a3fd60 0x55d287a3d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.183+0000 7fdddd8c0740 1 --2- 172.21.15.78:0/1216990669 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d287a2f9c0 0x55d287a3ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.183+0000 7fddb8ff9640 0 client.16557 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:40.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.183+0000 7fdddd8c0740 1 --2- 172.21.15.78:0/1216990669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f0a0 0x55d287a3f620 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.183+0000 7fdddd8c0740 1 -- 172.21.15.78:0/1216990669 >> 172.21.15.78:0/1216990669 conn(0x55d287a2ced0 msgr2=0x55d287a32a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:40.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.183+0000 7fdddd8c0740 1 -- 172.21.15.78:0/1216990669 shutdown_connections 2024-09-11T00:25:40.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.183+0000 7fdddd8c0740 1 -- 172.21.15.78:0/1216990669 wait complete. 2024-09-11T00:25:40.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.183+0000 7fdddd8c0740 20 client.16557 trim_cache size 0 max 16384 2024-09-11T00:25:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.200+0000 7fdddd8c0740 1 Processor -- start 2024-09-11T00:25:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.200+0000 7fdddd8c0740 1 -- start start 2024-09-11T00:25:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.200+0000 7fdddd8c0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d287a2f0a0 0x55d287a4bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.200+0000 7fdddd8c0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f9c0 0x55d287a2e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.200+0000 7fdddd8c0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d287a3fd60 0x55d287a57250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.201+0000 7fdddd8c0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41aa5d0 con 0x55d287a2f9c0 2024-09-11T00:25:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.201+0000 7fdddd8c0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41ace30 con 0x55d287a2f0a0 2024-09-11T00:25:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.201+0000 7fdddd8c0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41aac20 con 0x55d287a3fd60 2024-09-11T00:25:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.201+0000 7fddd8a86640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f9c0 0x55d287a2e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:40.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.201+0000 7fddd8a86640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f9c0 0x55d287a2e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43322/0 (socket says 172.21.15.78:43322) 2024-09-11T00:25:40.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.201+0000 7fddd8a86640 1 -- 172.21.15.78:0/1627032693 learned_addr learned my addr 172.21.15.78:0/1627032693 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:40.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.201+0000 7fddd9a88640 1 --2- 172.21.15.78:0/1627032693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d287a3fd60 0x55d287a57250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:40.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.201+0000 7fddd9287640 1 --2- 172.21.15.78:0/1627032693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d287a2f0a0 0x55d287a4bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:40.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.201+0000 7fddd8a86640 1 -- 172.21.15.78:0/1627032693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d287a3fd60 msgr2=0x55d287a57250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:40.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.201+0000 7fddd8a86640 1 --2- 172.21.15.78:0/1627032693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d287a3fd60 0x55d287a57250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.201+0000 7fddd8a86640 1 -- 172.21.15.78:0/1627032693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d287a2f0a0 msgr2=0x55d287a4bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:40.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.201+0000 7fddd8a86640 1 --2- 172.21.15.78:0/1627032693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d287a2f0a0 0x55d287a4bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.201+0000 7fddd8a86640 1 -- 172.21.15.78:0/1627032693 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d287a3d3c0 con 0x55d287a2f9c0 2024-09-11T00:25:40.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.201+0000 7fddd9a88640 1 --2- 172.21.15.78:0/1627032693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d287a3fd60 0x55d287a57250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:25:40.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.201+0000 7fddd9287640 1 --2- 172.21.15.78:0/1627032693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d287a2f0a0 0x55d287a4bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:25:40.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.201+0000 7fddd8a86640 1 --2- 172.21.15.78:0/1627032693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f9c0 0x55d287a2e000 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fddc80a88c0 tx=0x7fddc80a8750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586387bffb3ddec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:40.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.201+0000 7fddbaffd640 1 -- 172.21.15.78:0/1627032693 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8020040 con 0x55d287a2f9c0 2024-09-11T00:25:40.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.201+0000 7fddbaffd640 1 -- 172.21.15.78:0/1627032693 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddc8009de0 con 0x55d287a2f9c0 2024-09-11T00:25:40.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.201+0000 7fddbaffd640 1 -- 172.21.15.78:0/1627032693 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc80e3b20 con 0x55d287a2f9c0 2024-09-11T00:25:40.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.202+0000 7fdddd8c0740 1 -- 172.21.15.78:0/1627032693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f9c0 msgr2=0x55d287a2e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:40.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.202+0000 7fdddd8c0740 1 --2- 172.21.15.78:0/1627032693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f9c0 0x55d287a2e000 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fddc80a88c0 tx=0x7fddc80a8750 comp rx=0 tx=0).stop 2024-09-11T00:25:40.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.202+0000 7fdddd8c0740 1 -- 172.21.15.78:0/1627032693 shutdown_connections 2024-09-11T00:25:40.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.202+0000 7fdddd8c0740 1 --2- 172.21.15.78:0/1627032693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d287a3fd60 0x55d287a57250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.202+0000 7fdddd8c0740 1 --2- 172.21.15.78:0/1627032693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f9c0 0x55d287a2e000 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.202+0000 7fdddd8c0740 1 --2- 172.21.15.78:0/1627032693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d287a2f0a0 0x55d287a4bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.202+0000 7fdddd8c0740 1 -- 172.21.15.78:0/1627032693 >> 172.21.15.78:0/1627032693 conn(0x55d287a2ced0 msgr2=0x55d287a40b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:40.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.202+0000 7fdddd8c0740 1 -- 172.21.15.78:0/1627032693 shutdown_connections 2024-09-11T00:25:40.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.202+0000 7fdddd8c0740 1 -- 172.21.15.78:0/1627032693 wait complete. 2024-09-11T00:25:40.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.202+0000 7fdddd8c0740 1 -- start start 2024-09-11T00:25:40.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.202+0000 7fdddd8c0740 1 Processor -- start 2024-09-11T00:25:40.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.203+0000 7fdddd8c0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f0a0 0x55d287a47ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:40.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.203+0000 7fdddd8c0740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d287a2f9c0 0x55d287a481e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:40.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.203+0000 7fdddd8c0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d287a3fd60 0x55d287a44c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:40.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.203+0000 7fdddd8c0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41ab2f0 con 0x55d287a2f0a0 2024-09-11T00:25:40.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.203+0000 7fdddd8c0740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41ac760 con 0x55d287a2f9c0 2024-09-11T00:25:40.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.203+0000 7fdddd8c0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41ab9c0 con 0x55d287a3fd60 2024-09-11T00:25:40.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.203+0000 7fdddd8c0740 10 client.0 _ll_register_callbacks cb 0x7fddc4009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:25:40.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.203+0000 7fddd9287640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f0a0 0x55d287a47ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:40.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.203+0000 7fddd9287640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f0a0 0x55d287a47ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43326/0 (socket says 172.21.15.78:43326) 2024-09-11T00:25:40.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.203+0000 7fddd9287640 1 -- 172.21.15.78:0/3613110431 learned_addr learned my addr 172.21.15.78:0/3613110431 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:40.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.203+0000 7fddd8a86640 1 --2- 172.21.15.78:0/3613110431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d287a2f9c0 0x55d287a481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:40.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.203+0000 7fddd9287640 1 -- 172.21.15.78:0/3613110431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d287a3fd60 msgr2=0x55d287a44c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:40.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.203+0000 7fddd9287640 1 --2- 172.21.15.78:0/3613110431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d287a3fd60 0x55d287a44c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.203+0000 7fddd9287640 1 -- 172.21.15.78:0/3613110431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d287a2f9c0 msgr2=0x55d287a481e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:40.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.203+0000 7fddd9287640 1 --2- 172.21.15.78:0/3613110431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d287a2f9c0 0x55d287a481e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.203+0000 7fddd9287640 1 -- 172.21.15.78:0/3613110431 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d287a487f0 con 0x55d287a2f0a0 2024-09-11T00:25:40.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.203+0000 7fddd9287640 1 --2- 172.21.15.78:0/3613110431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f0a0 0x55d287a47ca0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009710 tx=0x7fddc4009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3271de4ed9ad66f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:40.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.203+0000 7fddb8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:25:40.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.203+0000 7fddb8ff9640 1 -- 172.21.15.78:0/3613110431 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4035020 con 0x55d287a2f0a0 2024-09-11T00:25:40.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.203+0000 7fddb8ff9640 1 -- 172.21.15.78:0/3613110431 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7fddc4014820 con 0x55d287a2f0a0 2024-09-11T00:25:40.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.203+0000 7fdddd8c0740 1 -- 172.21.15.78:0/3613110431 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddc8009de0 con 0x55d287a2f0a0 2024-09-11T00:25:40.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.204+0000 7fddb8ff9640 1 -- 172.21.15.78:0/3613110431 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fddc4040050 con 0x55d287a2f0a0 2024-09-11T00:25:40.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.204+0000 7fdddd8c0740 10 client.16563 fetch_fsmap learned FSMap version 20 2024-09-11T00:25:40.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.204+0000 7fdddd8c0740 1 -- 172.21.15.78:0/3613110431 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d287abc7f0 con 0x55d287a2f0a0 2024-09-11T00:25:40.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.204+0000 7fddb8ff9640 1 -- 172.21.15.78:0/3613110431 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddc8009de0 con 0x55d287a2f0a0 2024-09-11T00:25:40.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.204+0000 7fddb8ff9640 1 -- 172.21.15.78:0/3613110431 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fddc4028c60 con 0x55d287a2f0a0 2024-09-11T00:25:40.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.204+0000 7fdddd8c0740 10 client.16563 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:25:40.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.204+0000 7fdddd8c0740 10 client.16563 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:25:40.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.204+0000 7fdddd8c0740 20 client.16563 populate_metadata read hostname 'smithi078' 2024-09-11T00:25:40.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.204+0000 7fdddd8c0740 1 --2- 172.21.15.78:0/3613110431 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55d287abcf90 0x55d287abf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:40.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.204+0000 7fdddd8c0740 4 client.16563 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:25:40.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.204+0000 7fdddd8c0740 1 -- 172.21.15.78:0/3613110431 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d2879a3850 con 0x55d287abcf90 2024-09-11T00:25:40.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.204+0000 7fddd8a86640 1 --2- 172.21.15.78:0/3613110431 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55d287abcf90 0x55d287abf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:40.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.205+0000 7fddb8ff9640 10 client.16563 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:40.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.205+0000 7fddd8a86640 1 --2- 172.21.15.78:0/3613110431 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55d287abcf90 0x55d287abf3b0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da0be6e49e9b5d59 server_cookie=ad7ce9f891d88a7a in_seq=0 out_seq=0 2024-09-11T00:25:40.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.205+0000 7fddb8ff9640 1 -- 172.21.15.78:0/3613110431 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4918 (crc 0 0 0) 0x55d2879a3850 con 0x55d287abcf90 2024-09-11T00:25:40.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.205+0000 7fddb8ff9640 10 client.16563 handle_command_reply: tid=0 2024-09-11T00:25:40.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.205+0000 7fdddd8c0740 1 client.16563 shutdown 2024-09-11T00:25:40.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.205+0000 7fdddd8c0740 1 -- 172.21.15.78:0/3613110431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f0a0 msgr2=0x55d287a47ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:40.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.205+0000 7fdddd8c0740 1 --2- 172.21.15.78:0/3613110431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f0a0 0x55d287a47ca0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009710 tx=0x7fddc4009e00 comp rx=0 tx=0).stop 2024-09-11T00:25:40.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.205+0000 7fdddd8c0740 1 -- 172.21.15.78:0/3613110431 shutdown_connections 2024-09-11T00:25:40.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.205+0000 7fdddd8c0740 1 --2- 172.21.15.78:0/3613110431 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55d287abcf90 0x55d287abf3b0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.205+0000 7fdddd8c0740 1 --2- 172.21.15.78:0/3613110431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d287a3fd60 0x55d287a44c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.205+0000 7fdddd8c0740 1 --2- 172.21.15.78:0/3613110431 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55d287a2f9c0 0x55d287a481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.205+0000 7fdddd8c0740 1 --2- 172.21.15.78:0/3613110431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d287a2f0a0 0x55d287a47ca0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.205+0000 7fdddd8c0740 1 -- 172.21.15.78:0/3613110431 >> 172.21.15.78:0/3613110431 conn(0x55d287a2ced0 msgr2=0x55d287a2b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:40.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.205+0000 7fddb8ff9640 0 client.16563 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:40.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.205+0000 7fdddd8c0740 1 -- 172.21.15.78:0/3613110431 shutdown_connections 2024-09-11T00:25:40.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.205+0000 7fdddd8c0740 1 -- 172.21.15.78:0/3613110431 wait complete. 2024-09-11T00:25:40.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.205+0000 7fdddd8c0740 20 client.16563 trim_cache size 0 max 16384 2024-09-11T00:25:40.224 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:25:40.224 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-11T00:25:40.224 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {}, 2024-09-11T00:25:40.225 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:25:40.225 INFO:teuthology.orchestra.run.smithi078.stdout: "f6eb5d15-216e-4f8b-b451-2f71b931998f": { 2024-09-11T00:25:40.225 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:48.289319+0000", 2024-09-11T00:25:40.225 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:40.225 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:40.225 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:40.225 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:40.225 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:40.225 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "e21db329-a274-4cfd-924a-8ec929e04bd1": { 2024-09-11T00:25:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:41.131504+0000", 2024-09-11T00:25:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "b854cbd3-8ca7-4277-a205-8887d2ff5567": { 2024-09-11T00:25:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:11.182949+0000", 2024-09-11T00:25:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:40.226 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:25:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:25:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "59d341c2-815c-48b1-a216-aa6fac6078a0": { 2024-09-11T00:25:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:25:06.855284+0000", 2024-09-11T00:25:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:40.227 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:25:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:25:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:25:40.228 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:25:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:25:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:25:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:40.229 INFO:teuthology.orchestra.run.smithi078.stdout: "81d31d3a-c224-4ded-9f00-1a7dfc099ec4": { 2024-09-11T00:25:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:16.296700+0000", 2024-09-11T00:25:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "1c04b4f1-c4c4-4289-b172-fba45b64018a": { 2024-09-11T00:25:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:24:27.591301+0000", 2024-09-11T00:25:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:40.230 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:25:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:25:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "38a1d30d-5f4c-460a-afcd-e6c60b97e43a": { 2024-09-11T00:25:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:58.127727+0000", 2024-09-11T00:25:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:40.231 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "8ec9e858-aa62-420d-a112-e62ea7810e63": { 2024-09-11T00:25:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:18.882749+0000", 2024-09-11T00:25:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:25:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:25:40.232 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "1b9391c2-08f3-479a-9538-deea28f7743b": { 2024-09-11T00:25:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:02.327508+0000", 2024-09-11T00:25:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:40.233 INFO:teuthology.orchestra.run.smithi078.stdout: "e0002672-e432-4890-ab9f-20c513c5e3b6": { 2024-09-11T00:25:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:21:37.161715+0000", 2024-09-11T00:25:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "f494d5ed-e0dc-44bb-8aba-a861b3e751f4": { 2024-09-11T00:25:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:55.251691+0000", 2024-09-11T00:25:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:40.234 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:25:40.235 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:25:40.235 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:25:40.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.206+0000 7fdddb4eb640 1 -- 172.21.15.78:0/4092875608 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fddbc0b5450 msgr2=0x7fddbc0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:40.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.206+0000 7fdddb4eb640 1 --2- 172.21.15.78:0/4092875608 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fddbc0b5450 0x7fddbc0b7910 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fddcc005940 tx=0x7fddcc009260 comp rx=0 tx=0).stop 2024-09-11T00:25:40.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.206+0000 7fdddb4eb640 1 -- 172.21.15.78:0/4092875608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd41087d0 msgr2=0x7fddd41997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:40.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.206+0000 7fdddb4eb640 1 --2- 172.21.15.78:0/4092875608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd41087d0 0x7fddd41997d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fddc800d950 tx=0x7fddc800de10 comp rx=0 tx=0).stop 2024-09-11T00:25:40.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.206+0000 7fdddb4eb640 1 -- 172.21.15.78:0/4092875608 shutdown_connections 2024-09-11T00:25:40.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.206+0000 7fdddb4eb640 1 --2- 172.21.15.78:0/4092875608 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fddbc0b5450 0x7fddbc0b7910 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.206+0000 7fdddb4eb640 1 --2- 172.21.15.78:0/4092875608 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fddd4109150 0x7fddd419eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.206+0000 7fdddb4eb640 1 --2- 172.21.15.78:0/4092875608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddd41087d0 0x7fddd41997d0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.206+0000 7fdddb4eb640 1 --2- 172.21.15.78:0/4092875608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddd4102dc0 0x7fddd4199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:40.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.206+0000 7fdddb4eb640 1 -- 172.21.15.78:0/4092875608 >> 172.21.15.78:0/4092875608 conn(0x7fddd40fe830 msgr2=0x7fddd4105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:40.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.206+0000 7fdddb4eb640 1 -- 172.21.15.78:0/4092875608 shutdown_connections 2024-09-11T00:25:40.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:40.206+0000 7fdddb4eb640 1 -- 172.21.15.78:0/4092875608 wait complete. 2024-09-11T00:25:40.237 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:39 smithi112 ceph-mon[35627]: pgmap v605: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:40.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:39 smithi138 ceph-mon[35019]: pgmap v605: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:41.066 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:25:41.067 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:25:41.310 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:25:41.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:41 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:25:41.769 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:41 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:25:41.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:41 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:25:41.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.851+0000 7efcdbde7640 1 -- 172.21.15.78:0/824517229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd4101ac0 msgr2=0x7efcd4101ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:41.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.851+0000 7efcdbde7640 1 --2- 172.21.15.78:0/824517229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd4101ac0 0x7efcd4101ea0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7efcd0009900 tx=0x7efcd002a410 comp rx=0 tx=0).stop 2024-09-11T00:25:41.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.851+0000 7efcdbde7640 1 -- 172.21.15.78:0/824517229 shutdown_connections 2024-09-11T00:25:41.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.851+0000 7efcdbde7640 1 --2- 172.21.15.78:0/824517229 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd4106f00 0x7efcd4107350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:41.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.851+0000 7efcdbde7640 1 --2- 172.21.15.78:0/824517229 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcd41023e0 0x7efcd41068b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:41.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.851+0000 7efcdbde7640 1 --2- 172.21.15.78:0/824517229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd4101ac0 0x7efcd4101ea0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:41.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.851+0000 7efcdbde7640 1 -- 172.21.15.78:0/824517229 >> 172.21.15.78:0/824517229 conn(0x7efcd40fd770 msgr2=0x7efcd40ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:41.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.851+0000 7efcdbde7640 1 -- 172.21.15.78:0/824517229 shutdown_connections 2024-09-11T00:25:41.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.851+0000 7efcdbde7640 1 -- 172.21.15.78:0/824517229 wait complete. 2024-09-11T00:25:41.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.852+0000 7efcdbde7640 1 Processor -- start 2024-09-11T00:25:41.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.852+0000 7efcdbde7640 1 -- start start 2024-09-11T00:25:41.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.852+0000 7efcdbde7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd4101ac0 0x7efcd419f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:41.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.852+0000 7efcdbde7640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcd41023e0 0x7efcd419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:41.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.852+0000 7efcdbde7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd4106f00 0x7efcd41a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:41.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.852+0000 7efcdbde7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efcd4119370 con 0x7efcd4106f00 2024-09-11T00:25:41.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.852+0000 7efcdbde7640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efcd41191f0 con 0x7efcd41023e0 2024-09-11T00:25:41.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.852+0000 7efcdbde7640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7efcd41194f0 con 0x7efcd4101ac0 2024-09-11T00:25:41.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.852+0000 7efcda384640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd4106f00 0x7efcd41a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:41.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.852+0000 7efcda384640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd4106f00 0x7efcd41a5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43342/0 (socket says 172.21.15.78:43342) 2024-09-11T00:25:41.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.852+0000 7efcda384640 1 -- 172.21.15.78:0/2019212446 learned_addr learned my addr 172.21.15.78:0/2019212446 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:41.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.852+0000 7efcd9b83640 1 --2- 172.21.15.78:0/2019212446 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd4101ac0 0x7efcd419f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:41.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.852+0000 7efcd9382640 1 --2- 172.21.15.78:0/2019212446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcd41023e0 0x7efcd419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:41.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.853+0000 7efcda384640 1 -- 172.21.15.78:0/2019212446 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd4101ac0 msgr2=0x7efcd419f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:41.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.853+0000 7efcda384640 1 --2- 172.21.15.78:0/2019212446 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd4101ac0 0x7efcd419f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:41.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.853+0000 7efcda384640 1 -- 172.21.15.78:0/2019212446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcd41023e0 msgr2=0x7efcd419fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:41.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.853+0000 7efcda384640 1 --2- 172.21.15.78:0/2019212446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcd41023e0 0x7efcd419fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:41.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.853+0000 7efcda384640 1 -- 172.21.15.78:0/2019212446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd41a5950 con 0x7efcd4106f00 2024-09-11T00:25:41.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.853+0000 7efcd9382640 1 --2- 172.21.15.78:0/2019212446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcd41023e0 0x7efcd419fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:25:41.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.853+0000 7efcda384640 1 --2- 172.21.15.78:0/2019212446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd4106f00 0x7efcd41a5180 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7efccc009fd0 tx=0x7efccc00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:41.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.853+0000 7efccaffd640 1 -- 172.21.15.78:0/2019212446 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efccc017070 con 0x7efcd4106f00 2024-09-11T00:25:41.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.853+0000 7efcdbde7640 1 -- 172.21.15.78:0/2019212446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd41a5c40 con 0x7efcd4106f00 2024-09-11T00:25:41.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.853+0000 7efccaffd640 1 -- 172.21.15.78:0/2019212446 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efccc003e20 con 0x7efcd4106f00 2024-09-11T00:25:41.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.853+0000 7efccaffd640 1 -- 172.21.15.78:0/2019212446 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efccc010460 con 0x7efcd4106f00 2024-09-11T00:25:41.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.853+0000 7efcdbde7640 1 -- 172.21.15.78:0/2019212446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd41ac300 con 0x7efcd4106f00 2024-09-11T00:25:41.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.854+0000 7efcdbde7640 1 -- 172.21.15.78:0/2019212446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcd41068b0 con 0x7efcd4106f00 2024-09-11T00:25:41.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.855+0000 7efccaffd640 1 -- 172.21.15.78:0/2019212446 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7efccc003970 con 0x7efcd4106f00 2024-09-11T00:25:41.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.856+0000 7efccaffd640 1 --2- 172.21.15.78:0/2019212446 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efcc00b5450 0x7efcc00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:41.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.856+0000 7efcd9b83640 1 --2- 172.21.15.78:0/2019212446 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efcc00b5450 0x7efcc00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:41.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.856+0000 7efccaffd640 1 -- 172.21.15.78:0/2019212446 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7efccc0e5dd0 con 0x7efcd4106f00 2024-09-11T00:25:41.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.857+0000 7efcd9b83640 1 --2- 172.21.15.78:0/2019212446 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efcc00b5450 0x7efcc00b7910 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efcd0031440 tx=0x7efcd0005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:41.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:41.860+0000 7efccaffd640 1 -- 172.21.15.78:0/2019212446 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efccc0ac8e0 con 0x7efcd4106f00 2024-09-11T00:25:42.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:42.072+0000 7efcdbde7640 1 -- 172.21.15.78:0/2019212446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efcd41ac640 con 0x7efcd4106f00 2024-09-11T00:25:42.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:42.073+0000 7efccaffd640 1 -- 172.21.15.78:0/2019212446 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7efccc0ac1e0 con 0x7efcd4106f00 2024-09-11T00:25:42.075 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:25:42.075 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:25:42.075 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:25:42.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:42.075+0000 7efcdbde7640 1 -- 172.21.15.78:0/2019212446 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efcc00b5450 msgr2=0x7efcc00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:42.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:42.075+0000 7efcdbde7640 1 --2- 172.21.15.78:0/2019212446 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efcc00b5450 0x7efcc00b7910 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efcd0031440 tx=0x7efcd0005b50 comp rx=0 tx=0).stop 2024-09-11T00:25:42.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:42.075+0000 7efcdbde7640 1 -- 172.21.15.78:0/2019212446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd4106f00 msgr2=0x7efcd41a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:42.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:42.075+0000 7efcdbde7640 1 --2- 172.21.15.78:0/2019212446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd4106f00 0x7efcd41a5180 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7efccc009fd0 tx=0x7efccc00b260 comp rx=0 tx=0).stop 2024-09-11T00:25:42.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:42.075+0000 7efcdbde7640 1 -- 172.21.15.78:0/2019212446 shutdown_connections 2024-09-11T00:25:42.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:42.075+0000 7efcdbde7640 1 --2- 172.21.15.78:0/2019212446 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7efcc00b5450 0x7efcc00b7910 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:42.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:42.075+0000 7efcdbde7640 1 --2- 172.21.15.78:0/2019212446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcd4106f00 0x7efcd41a5180 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:42.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:42.075+0000 7efcdbde7640 1 --2- 172.21.15.78:0/2019212446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efcd41023e0 0x7efcd419fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:42.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:42.075+0000 7efcdbde7640 1 --2- 172.21.15.78:0/2019212446 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efcd4101ac0 0x7efcd419f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:42.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:42.075+0000 7efcdbde7640 1 -- 172.21.15.78:0/2019212446 >> 172.21.15.78:0/2019212446 conn(0x7efcd40fd770 msgr2=0x7efcd4104880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:42.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:42.075+0000 7efcdbde7640 1 -- 172.21.15.78:0/2019212446 shutdown_connections 2024-09-11T00:25:42.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:42.075+0000 7efcdbde7640 1 -- 172.21.15.78:0/2019212446 wait complete. 2024-09-11T00:25:42.716 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:42 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:25:42.716 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:42 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:25:42.716 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:42 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:25:42.716 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:42 smithi078 ceph-mon[30865]: pgmap v606: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:25:42.716 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:42 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2019212446' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:25:42.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:42 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:25:42.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:42 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:25:42.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:42 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:25:42.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:42 smithi112 ceph-mon[35627]: pgmap v606: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:25:42.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:42 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2019212446' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:25:42.744 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:25:42.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:42 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:25:42.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:42 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:25:42.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:42 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:25:42.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:42 smithi138 ceph-mon[35019]: pgmap v606: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:25:42.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:42 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2019212446' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:25:42.992 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:25:43.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.482+0000 7fbb52d29640 1 -- 172.21.15.78:0/1777342828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb4c108020 msgr2=0x7fbb4c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:43.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.482+0000 7fbb52d29640 1 --2- 172.21.15.78:0/1777342828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb4c108020 0x7fbb4c10e820 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009ca0 tx=0x7fbb4402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.482+0000 7fbb52d29640 1 -- 172.21.15.78:0/1777342828 shutdown_connections 2024-09-11T00:25:43.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.482+0000 7fbb52d29640 1 --2- 172.21.15.78:0/1777342828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb4c108020 0x7fbb4c10e820 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.483+0000 7fbb52d29640 1 --2- 172.21.15.78:0/1777342828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb4c1076a0 0x7fbb4c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.483+0000 7fbb52d29640 1 --2- 172.21.15.78:0/1777342828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb4c101c90 0x7fbb4c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.483+0000 7fbb52d29640 1 -- 172.21.15.78:0/1777342828 >> 172.21.15.78:0/1777342828 conn(0x7fbb4c0fd700 msgr2=0x7fbb4c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:43.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.483+0000 7fbb52d29640 1 -- 172.21.15.78:0/1777342828 shutdown_connections 2024-09-11T00:25:43.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.483+0000 7fbb52d29640 1 -- 172.21.15.78:0/1777342828 wait complete. 2024-09-11T00:25:43.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.483+0000 7fbb52d29640 1 Processor -- start 2024-09-11T00:25:43.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.483+0000 7fbb52d29640 1 -- start start 2024-09-11T00:25:43.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.483+0000 7fbb52d29640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb4c101c90 0x7fbb4c1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:43.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.483+0000 7fbb52d29640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb4c1076a0 0x7fbb4c1997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:43.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.483+0000 7fbb52d29640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb4c108020 0x7fbb4c19eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:43.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.483+0000 7fbb52d29640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c112e00 con 0x7fbb4c108020 2024-09-11T00:25:43.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.483+0000 7fbb52d29640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c112c80 con 0x7fbb4c1076a0 2024-09-11T00:25:43.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.483+0000 7fbb52d29640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c112f80 con 0x7fbb4c101c90 2024-09-11T00:25:43.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.483+0000 7fbb512c6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb4c108020 0x7fbb4c19eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:43.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.484+0000 7fbb512c6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb4c108020 0x7fbb4c19eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43370/0 (socket says 172.21.15.78:43370) 2024-09-11T00:25:43.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.484+0000 7fbb512c6640 1 -- 172.21.15.78:0/1721053272 learned_addr learned my addr 172.21.15.78:0/1721053272 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:43.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.484+0000 7fbb50ac5640 1 --2- 172.21.15.78:0/1721053272 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb4c101c90 0x7fbb4c1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:43.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.484+0000 7fbb4bfff640 1 --2- 172.21.15.78:0/1721053272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb4c1076a0 0x7fbb4c1997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:43.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.484+0000 7fbb512c6640 1 -- 172.21.15.78:0/1721053272 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb4c101c90 msgr2=0x7fbb4c1992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:43.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.484+0000 7fbb512c6640 1 --2- 172.21.15.78:0/1721053272 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb4c101c90 0x7fbb4c1992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.484+0000 7fbb512c6640 1 -- 172.21.15.78:0/1721053272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb4c1076a0 msgr2=0x7fbb4c1997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:43.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.484+0000 7fbb512c6640 1 --2- 172.21.15.78:0/1721053272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb4c1076a0 0x7fbb4c1997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.484+0000 7fbb512c6640 1 -- 172.21.15.78:0/1721053272 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4c19f350 con 0x7fbb4c108020 2024-09-11T00:25:43.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.484+0000 7fbb512c6640 1 --2- 172.21.15.78:0/1721053272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb4c108020 0x7fbb4c19eb80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fbb44005cc0 tx=0x7fbb4402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:43.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.484+0000 7fbb49ffb640 1 -- 172.21.15.78:0/1721053272 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb44003bf0 con 0x7fbb4c108020 2024-09-11T00:25:43.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.484+0000 7fbb49ffb640 1 -- 172.21.15.78:0/1721053272 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb44003d90 con 0x7fbb4c108020 2024-09-11T00:25:43.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.484+0000 7fbb52d29640 1 -- 172.21.15.78:0/1721053272 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb4c19f5e0 con 0x7fbb4c108020 2024-09-11T00:25:43.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.484+0000 7fbb49ffb640 1 -- 172.21.15.78:0/1721053272 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4402fb20 con 0x7fbb4c108020 2024-09-11T00:25:43.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.484+0000 7fbb52d29640 1 -- 172.21.15.78:0/1721053272 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb4c1a5d80 con 0x7fbb4c108020 2024-09-11T00:25:43.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.487+0000 7fbb550fe740 1 Processor -- start 2024-09-11T00:25:43.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.487+0000 7fbb49ffb640 1 -- 172.21.15.78:0/1721053272 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fbb44004580 con 0x7fbb4c108020 2024-09-11T00:25:43.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.488+0000 7fbb550fe740 1 -- start start 2024-09-11T00:25:43.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.488+0000 7fbb550fe740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e7879624d0 0x55e7879628b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.488+0000 7fbb550fe740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e787962df0 0x55e787972c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.488+0000 7fbb550fe740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e787973190 0x55e787975580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.488+0000 7fbb550fe740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55e7878d8ea0 con 0x55e7879624d0 2024-09-11T00:25:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.488+0000 7fbb550fe740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e7878c82d0 con 0x55e787973190 2024-09-11T00:25:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.488+0000 7fbb550fe740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55e7878cc0e0 con 0x55e787962df0 2024-09-11T00:25:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.488+0000 7fbb4bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e7879624d0 0x55e7879628b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.488+0000 7fbb4bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e7879624d0 0x55e7879628b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43372/0 (socket says 172.21.15.78:43372) 2024-09-11T00:25:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.488+0000 7fbb4bfff640 1 -- 172.21.15.78:0/2357356818 learned_addr learned my addr 172.21.15.78:0/2357356818 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.488+0000 7fbb50ac5640 1 --2- 172.21.15.78:0/2357356818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e787962df0 0x55e787972c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.488+0000 7fbb4bfff640 1 -- 172.21.15.78:0/2357356818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e787962df0 msgr2=0x55e787972c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.488+0000 7fbb4bfff640 1 --2- 172.21.15.78:0/2357356818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e787962df0 0x55e787972c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.488+0000 7fbb49ffb640 1 --2- 172.21.15.78:0/1721053272 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbb3c0b5450 0x7fbb3c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:43.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.488+0000 7fbb4bfff640 1 -- 172.21.15.78:0/2357356818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e787973190 msgr2=0x55e787975580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:43.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.488+0000 7fbb4bfff640 1 --2- 172.21.15.78:0/2357356818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e787973190 0x55e787975580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.488+0000 7fbb4bfff640 1 -- 172.21.15.78:0/2357356818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e787626650 con 0x55e7879624d0 2024-09-11T00:25:43.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.488+0000 7fbb50ac5640 1 --2- 172.21.15.78:0/2357356818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e787962df0 0x55e787972c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:25:43.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.488+0000 7fbb512c6640 1 --2- 172.21.15.78:0/1721053272 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbb3c0b5450 0x7fbb3c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:43.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.488+0000 7fbb4bfff640 1 --2- 172.21.15.78:0/2357356818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e7879624d0 0x55e7879628b0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800bd30 tx=0x7fbb38011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575c70f30e865f73 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:43.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.489+0000 7fbb49ffb640 1 -- 172.21.15.78:0/1721053272 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7fbb441073c0 con 0x7fbb4c108020 2024-09-11T00:25:43.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.489+0000 7fbb36ffd640 1 -- 172.21.15.78:0/2357356818 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3801a400 con 0x55e7879624d0 2024-09-11T00:25:43.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.489+0000 7fbb36ffd640 1 -- 172.21.15.78:0/2357356818 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb3801aa50 con 0x55e7879624d0 2024-09-11T00:25:43.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.489+0000 7fbb36ffd640 1 -- 172.21.15.78:0/2357356818 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38012a60 con 0x55e7879624d0 2024-09-11T00:25:43.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.489+0000 7fbb550fe740 1 -- 172.21.15.78:0/2357356818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e7879624d0 msgr2=0x55e7879628b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:43.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.489+0000 7fbb512c6640 1 --2- 172.21.15.78:0/1721053272 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbb3c0b5450 0x7fbb3c0b7910 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbb44105100 tx=0x7fbb4402a8c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:43.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.489+0000 7fbb550fe740 1 --2- 172.21.15.78:0/2357356818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e7879624d0 0x55e7879628b0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800bd30 tx=0x7fbb38011750 comp rx=0 tx=0).stop 2024-09-11T00:25:43.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.489+0000 7fbb550fe740 1 -- 172.21.15.78:0/2357356818 shutdown_connections 2024-09-11T00:25:43.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.489+0000 7fbb550fe740 1 --2- 172.21.15.78:0/2357356818 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e787973190 0x55e787975580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.489+0000 7fbb550fe740 1 --2- 172.21.15.78:0/2357356818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e787962df0 0x55e787972c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.489+0000 7fbb550fe740 1 --2- 172.21.15.78:0/2357356818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e7879624d0 0x55e7879628b0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.489+0000 7fbb550fe740 1 -- 172.21.15.78:0/2357356818 >> 172.21.15.78:0/2357356818 conn(0x55e787960300 msgr2=0x55e7879614a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:43.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.489+0000 7fbb550fe740 1 -- 172.21.15.78:0/2357356818 shutdown_connections 2024-09-11T00:25:43.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.489+0000 7fbb550fe740 1 -- 172.21.15.78:0/2357356818 wait complete. 2024-09-11T00:25:43.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.490+0000 7fbb550fe740 1 -- start start 2024-09-11T00:25:43.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.490+0000 7fbb550fe740 1 Processor -- start 2024-09-11T00:25:43.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.490+0000 7fbb550fe740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e7879624d0 0x55e787972ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:43.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.490+0000 7fbb550fe740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e787962df0 0x55e78796ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:43.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.490+0000 7fbb550fe740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e787973190 0x55e787970590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:43.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.490+0000 7fbb550fe740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55e787729700 con 0x55e787973190 2024-09-11T00:25:43.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.490+0000 7fbb550fe740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55e787863160 con 0x55e787962df0 2024-09-11T00:25:43.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.490+0000 7fbb550fe740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55e787975e10 con 0x55e7879624d0 2024-09-11T00:25:43.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.490+0000 7fbb550fe740 10 client.0 _ll_register_callbacks cb 0x55e78787c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:25:43.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.491+0000 7fbb4bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e787973190 0x55e787970590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:43.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.491+0000 7fbb4bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e787973190 0x55e787970590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43380/0 (socket says 172.21.15.78:43380) 2024-09-11T00:25:43.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.491+0000 7fbb4bfff640 1 -- 172.21.15.78:0/4128107986 learned_addr learned my addr 172.21.15.78:0/4128107986 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:43.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.491+0000 7fbb4bfff640 1 --2- 172.21.15.78:0/4128107986 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e7879624d0 0x55e787972ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:43.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.491+0000 7fbb50ac5640 1 --2- 172.21.15.78:0/4128107986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e787962df0 0x55e78796ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:43.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.491+0000 7fbb4bfff640 1 -- 172.21.15.78:0/4128107986 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e7879624d0 msgr2=0x55e787972ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:43.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.491+0000 7fbb4bfff640 1 --2- 172.21.15.78:0/4128107986 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e7879624d0 0x55e787972ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.491+0000 7fbb4bfff640 1 -- 172.21.15.78:0/4128107986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e787962df0 msgr2=0x55e78796ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:43.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.491+0000 7fbb4bfff640 1 --2- 172.21.15.78:0/4128107986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e787962df0 0x55e78796ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.491+0000 7fbb4bfff640 1 -- 172.21.15.78:0/4128107986 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e787890c90 con 0x55e787973190 2024-09-11T00:25:43.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.491+0000 7fbb4bfff640 1 --2- 172.21.15.78:0/4128107986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e787973190 0x55e787970590 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fbb380126c0 tx=0x7fbb380123f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39c8305224cc795 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:43.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.491+0000 7fbb2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:25:43.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.491+0000 7fbb2bfff640 1 -- 172.21.15.78:0/4128107986 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38012c10 con 0x55e787973190 2024-09-11T00:25:43.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.491+0000 7fbb2bfff640 1 -- 172.21.15.78:0/4128107986 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7fbb38012db0 con 0x55e787973190 2024-09-11T00:25:43.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.491+0000 7fbb550fe740 1 -- 172.21.15.78:0/4128107986 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb3801aa50 con 0x55e787973190 2024-09-11T00:25:43.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.491+0000 7fbb2bfff640 1 -- 172.21.15.78:0/4128107986 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbb38013ec0 con 0x55e787973190 2024-09-11T00:25:43.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.491+0000 7fbb550fe740 10 client.16581 fetch_fsmap learned FSMap version 20 2024-09-11T00:25:43.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.491+0000 7fbb550fe740 1 -- 172.21.15.78:0/4128107986 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e787981720 con 0x55e787973190 2024-09-11T00:25:43.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.492+0000 7fbb2bfff640 1 -- 172.21.15.78:0/4128107986 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb3801aa50 con 0x55e787973190 2024-09-11T00:25:43.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.492+0000 7fbb2bfff640 1 -- 172.21.15.78:0/4128107986 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fbb3802b700 con 0x55e787973190 2024-09-11T00:25:43.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.492+0000 7fbb550fe740 10 client.16581 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:25:43.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.492+0000 7fbb550fe740 10 client.16581 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:25:43.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.492+0000 7fbb550fe740 20 client.16581 populate_metadata read hostname 'smithi078' 2024-09-11T00:25:43.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.492+0000 7fbb550fe740 1 --2- 172.21.15.78:0/4128107986 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55e787982b80 0x55e787984f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:43.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.492+0000 7fbb550fe740 4 client.16581 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:25:43.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.492+0000 7fbb550fe740 1 -- 172.21.15.78:0/4128107986 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7878dadf0 con 0x55e787982b80 2024-09-11T00:25:43.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.492+0000 7fbb50ac5640 1 --2- 172.21.15.78:0/4128107986 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55e787982b80 0x55e787984f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:43.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.493+0000 7fbb2bfff640 10 client.16581 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:43.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.493+0000 7fbb50ac5640 1 --2- 172.21.15.78:0/4128107986 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55e787982b80 0x55e787984f70 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23ba85b2c655a50b server_cookie=72ae1f5fc064efa1 in_seq=0 out_seq=0 2024-09-11T00:25:43.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.493+0000 7fbb2bfff640 1 -- 172.21.15.78:0/4128107986 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e7878dadf0 con 0x55e787982b80 2024-09-11T00:25:43.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.493+0000 7fbb2bfff640 10 client.16581 handle_command_reply: tid=0 2024-09-11T00:25:43.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.493+0000 7fbb550fe740 1 client.16581 shutdown 2024-09-11T00:25:43.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.493+0000 7fbb550fe740 1 -- 172.21.15.78:0/4128107986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e787973190 msgr2=0x55e787970590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:43.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.493+0000 7fbb550fe740 1 --2- 172.21.15.78:0/4128107986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e787973190 0x55e787970590 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fbb380126c0 tx=0x7fbb380123f0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.493+0000 7fbb550fe740 1 -- 172.21.15.78:0/4128107986 shutdown_connections 2024-09-11T00:25:43.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.493+0000 7fbb550fe740 1 --2- 172.21.15.78:0/4128107986 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55e787982b80 0x55e787984f70 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.493+0000 7fbb550fe740 1 --2- 172.21.15.78:0/4128107986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e787973190 0x55e787970590 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.493+0000 7fbb550fe740 1 --2- 172.21.15.78:0/4128107986 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e787962df0 0x55e78796ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.493+0000 7fbb2bfff640 0 client.16581 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:43.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.493+0000 7fbb550fe740 1 --2- 172.21.15.78:0/4128107986 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e7879624d0 0x55e787972ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.493+0000 7fbb550fe740 1 -- 172.21.15.78:0/4128107986 >> 172.21.15.78:0/4128107986 conn(0x55e787960300 msgr2=0x55e787965e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:43.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.494+0000 7fbb550fe740 1 -- 172.21.15.78:0/4128107986 shutdown_connections 2024-09-11T00:25:43.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.494+0000 7fbb550fe740 1 -- 172.21.15.78:0/4128107986 wait complete. 2024-09-11T00:25:43.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.494+0000 7fbb550fe740 20 client.16581 trim_cache size 0 max 16384 2024-09-11T00:25:43.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.507+0000 7fbb550fe740 1 Processor -- start 2024-09-11T00:25:43.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.507+0000 7fbb550fe740 1 -- start start 2024-09-11T00:25:43.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.507+0000 7fbb550fe740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e7879624d0 0x55e78797f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:43.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.507+0000 7fbb550fe740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e787962df0 0x55e787974060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:43.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.507+0000 7fbb550fe740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e787973190 0x55e7879745a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:43.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.507+0000 7fbb550fe740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c1aa580 con 0x55e7879624d0 2024-09-11T00:25:43.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.507+0000 7fbb550fe740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c1acde0 con 0x55e787962df0 2024-09-11T00:25:43.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.507+0000 7fbb550fe740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c1aabd0 con 0x55e787973190 2024-09-11T00:25:43.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.507+0000 7fbb4bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e7879624d0 0x55e78797f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:43.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.507+0000 7fbb4bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e7879624d0 0x55e78797f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43384/0 (socket says 172.21.15.78:43384) 2024-09-11T00:25:43.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.507+0000 7fbb4bfff640 1 -- 172.21.15.78:0/3806580422 learned_addr learned my addr 172.21.15.78:0/3806580422 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:43.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.507+0000 7fbb50ac5640 1 --2- 172.21.15.78:0/3806580422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e787962df0 0x55e787974060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:43.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.507+0000 7fbb4bfff640 1 -- 172.21.15.78:0/3806580422 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e787973190 msgr2=0x55e7879745a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:43.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.507+0000 7fbb4bfff640 1 --2- 172.21.15.78:0/3806580422 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e787973190 0x55e7879745a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.507+0000 7fbb4bfff640 1 -- 172.21.15.78:0/3806580422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e787962df0 msgr2=0x55e787974060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:43.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.507+0000 7fbb4bfff640 1 --2- 172.21.15.78:0/3806580422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e787962df0 0x55e787974060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.507+0000 7fbb4bfff640 1 -- 172.21.15.78:0/3806580422 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e787960cc0 con 0x55e7879624d0 2024-09-11T00:25:43.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.507+0000 7fbb4bfff640 1 --2- 172.21.15.78:0/3806580422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e7879624d0 0x55e78797f070 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fbb38012750 tx=0x7fbb380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeed9a23a6917962 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:43.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.507+0000 7fbb367fc640 1 -- 172.21.15.78:0/3806580422 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38038040 con 0x55e7879624d0 2024-09-11T00:25:43.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.508+0000 7fbb367fc640 1 -- 172.21.15.78:0/3806580422 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb3802b8d0 con 0x55e7879624d0 2024-09-11T00:25:43.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.508+0000 7fbb367fc640 1 -- 172.21.15.78:0/3806580422 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3801a400 con 0x55e7879624d0 2024-09-11T00:25:43.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.508+0000 7fbb550fe740 1 -- 172.21.15.78:0/3806580422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e7879624d0 msgr2=0x55e78797f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:43.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.508+0000 7fbb550fe740 1 --2- 172.21.15.78:0/3806580422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e7879624d0 0x55e78797f070 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fbb38012750 tx=0x7fbb380057f0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.508+0000 7fbb550fe740 1 -- 172.21.15.78:0/3806580422 shutdown_connections 2024-09-11T00:25:43.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.508+0000 7fbb550fe740 1 --2- 172.21.15.78:0/3806580422 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e787973190 0x55e7879745a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.508+0000 7fbb550fe740 1 --2- 172.21.15.78:0/3806580422 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e787962df0 0x55e787974060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.508+0000 7fbb550fe740 1 --2- 172.21.15.78:0/3806580422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e7879624d0 0x55e78797f070 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.508+0000 7fbb550fe740 1 -- 172.21.15.78:0/3806580422 >> 172.21.15.78:0/3806580422 conn(0x55e787960300 msgr2=0x55e787973570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:43.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.508+0000 7fbb550fe740 1 -- 172.21.15.78:0/3806580422 shutdown_connections 2024-09-11T00:25:43.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.508+0000 7fbb550fe740 1 -- 172.21.15.78:0/3806580422 wait complete. 2024-09-11T00:25:43.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.508+0000 7fbb550fe740 1 -- start start 2024-09-11T00:25:43.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.509+0000 7fbb550fe740 1 Processor -- start 2024-09-11T00:25:43.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.509+0000 7fbb550fe740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7879624d0 0x55e78797b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:43.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.509+0000 7fbb550fe740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e787962df0 0x55e78797b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:43.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.509+0000 7fbb550fe740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e787973190 0x55e787976090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:43.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.509+0000 7fbb550fe740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c1ab2a0 con 0x55e787973190 2024-09-11T00:25:43.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.509+0000 7fbb550fe740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c1ac710 con 0x55e7879624d0 2024-09-11T00:25:43.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.509+0000 7fbb550fe740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c1ab970 con 0x55e787962df0 2024-09-11T00:25:43.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.509+0000 7fbb550fe740 10 client.0 _ll_register_callbacks cb 0x7fbb3800bc30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:25:43.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.509+0000 7fbb4bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e787973190 0x55e787976090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:43.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.509+0000 7fbb4bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e787973190 0x55e787976090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43398/0 (socket says 172.21.15.78:43398) 2024-09-11T00:25:43.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.509+0000 7fbb4bfff640 1 -- 172.21.15.78:0/1474931803 learned_addr learned my addr 172.21.15.78:0/1474931803 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:43.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.509+0000 7fbb50ac5640 1 --2- 172.21.15.78:0/1474931803 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e787962df0 0x55e78797b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:43.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.509+0000 7fbb4bfff640 1 --2- 172.21.15.78:0/1474931803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7879624d0 0x55e78797b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:43.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.510+0000 7fbb4bfff640 1 -- 172.21.15.78:0/1474931803 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e787962df0 msgr2=0x55e78797b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:43.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.510+0000 7fbb4bfff640 1 --2- 172.21.15.78:0/1474931803 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e787962df0 0x55e78797b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.510+0000 7fbb4bfff640 1 -- 172.21.15.78:0/1474931803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7879624d0 msgr2=0x55e78797b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:43.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.510+0000 7fbb4bfff640 1 --2- 172.21.15.78:0/1474931803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7879624d0 0x55e78797b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.510+0000 7fbb4bfff640 1 -- 172.21.15.78:0/1474931803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7879765d0 con 0x55e787973190 2024-09-11T00:25:43.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.510+0000 7fbb50ac5640 1 --2- 172.21.15.78:0/1474931803 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e787962df0 0x55e78797b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:25:43.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.510+0000 7fbb4bfff640 1 --2- 172.21.15.78:0/1474931803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e787973190 0x55e787976090 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fbb38033480 tx=0x7fbb38005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142069b56776c543 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:43.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.510+0000 7fbb2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:25:43.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.510+0000 7fbb2bfff640 1 -- 172.21.15.78:0/1474931803 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38038070 con 0x55e787973190 2024-09-11T00:25:43.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.510+0000 7fbb2bfff640 1 -- 172.21.15.78:0/1474931803 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7fbb38004030 con 0x55e787973190 2024-09-11T00:25:43.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.510+0000 7fbb550fe740 1 -- 172.21.15.78:0/1474931803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb3802b8d0 con 0x55e787973190 2024-09-11T00:25:43.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.510+0000 7fbb2bfff640 1 -- 172.21.15.78:0/1474931803 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fbb380123f0 con 0x55e787973190 2024-09-11T00:25:43.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.510+0000 7fbb550fe740 10 client.16587 fetch_fsmap learned FSMap version 20 2024-09-11T00:25:43.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.510+0000 7fbb550fe740 1 -- 172.21.15.78:0/1474931803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e7879eff70 con 0x55e787973190 2024-09-11T00:25:43.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.510+0000 7fbb2bfff640 1 -- 172.21.15.78:0/1474931803 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb3802b8d0 con 0x55e787973190 2024-09-11T00:25:43.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.510+0000 7fbb2bfff640 1 -- 172.21.15.78:0/1474931803 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fbb38003ba0 con 0x55e787973190 2024-09-11T00:25:43.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.510+0000 7fbb550fe740 10 client.16587 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:25:43.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.510+0000 7fbb550fe740 10 client.16587 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:25:43.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.510+0000 7fbb550fe740 20 client.16587 populate_metadata read hostname 'smithi078' 2024-09-11T00:25:43.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.510+0000 7fbb550fe740 1 --2- 172.21.15.78:0/1474931803 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55e7879f0520 0x55e7879f2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:43.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.510+0000 7fbb550fe740 4 client.16587 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:25:43.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.510+0000 7fbb550fe740 1 -- 172.21.15.78:0/1474931803 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e7878d68a0 con 0x55e7879f0520 2024-09-11T00:25:43.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.511+0000 7fbb50ac5640 1 --2- 172.21.15.78:0/1474931803 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55e7879f0520 0x55e7879f2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:43.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.511+0000 7fbb2bfff640 10 client.16587 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:43.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.511+0000 7fbb50ac5640 1 --2- 172.21.15.78:0/1474931803 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55e7879f0520 0x55e7879f2910 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b9b0648af083e9b server_cookie=a8bf6fd13d90ffb2 in_seq=0 out_seq=0 2024-09-11T00:25:43.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.511+0000 7fbb2bfff640 1 -- 172.21.15.78:0/1474931803 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e7878d68a0 con 0x55e7879f0520 2024-09-11T00:25:43.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.511+0000 7fbb2bfff640 10 client.16587 handle_command_reply: tid=0 2024-09-11T00:25:43.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.511+0000 7fbb550fe740 1 client.16587 shutdown 2024-09-11T00:25:43.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.511+0000 7fbb550fe740 1 -- 172.21.15.78:0/1474931803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e787973190 msgr2=0x55e787976090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:43.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.511+0000 7fbb550fe740 1 --2- 172.21.15.78:0/1474931803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e787973190 0x55e787976090 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fbb38033480 tx=0x7fbb38005c30 comp rx=0 tx=0).stop 2024-09-11T00:25:43.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.511+0000 7fbb550fe740 1 -- 172.21.15.78:0/1474931803 shutdown_connections 2024-09-11T00:25:43.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.511+0000 7fbb550fe740 1 --2- 172.21.15.78:0/1474931803 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x55e7879f0520 0x55e7879f2910 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.511+0000 7fbb2bfff640 0 client.16587 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:43.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.511+0000 7fbb550fe740 1 --2- 172.21.15.78:0/1474931803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e787973190 0x55e787976090 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.511+0000 7fbb550fe740 1 --2- 172.21.15.78:0/1474931803 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e787962df0 0x55e78797b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.511+0000 7fbb550fe740 1 --2- 172.21.15.78:0/1474931803 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55e7879624d0 0x55e78797b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.512+0000 7fbb550fe740 1 -- 172.21.15.78:0/1474931803 >> 172.21.15.78:0/1474931803 conn(0x55e787960300 msgr2=0x55e787974fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:43.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.512+0000 7fbb550fe740 1 -- 172.21.15.78:0/1474931803 shutdown_connections 2024-09-11T00:25:43.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.512+0000 7fbb550fe740 1 -- 172.21.15.78:0/1474931803 wait complete. 2024-09-11T00:25:43.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.512+0000 7fbb550fe740 20 client.16587 trim_cache size 0 max 16384 2024-09-11T00:25:43.521 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-11T00:25:43.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.512+0000 7fbb52d29640 1 -- 172.21.15.78:0/1721053272 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbb3c0b5450 msgr2=0x7fbb3c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:43.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.512+0000 7fbb52d29640 1 --2- 172.21.15.78:0/1721053272 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbb3c0b5450 0x7fbb3c0b7910 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbb44105100 tx=0x7fbb4402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.512+0000 7fbb52d29640 1 -- 172.21.15.78:0/1721053272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb4c108020 msgr2=0x7fbb4c19eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:43.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.512+0000 7fbb52d29640 1 --2- 172.21.15.78:0/1721053272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb4c108020 0x7fbb4c19eb80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fbb44005cc0 tx=0x7fbb4402f380 comp rx=0 tx=0).stop 2024-09-11T00:25:43.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.512+0000 7fbb52d29640 1 -- 172.21.15.78:0/1721053272 shutdown_connections 2024-09-11T00:25:43.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.512+0000 7fbb52d29640 1 --2- 172.21.15.78:0/1721053272 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fbb3c0b5450 0x7fbb3c0b7910 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.512+0000 7fbb52d29640 1 --2- 172.21.15.78:0/1721053272 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbb4c108020 0x7fbb4c19eb80 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.512+0000 7fbb52d29640 1 --2- 172.21.15.78:0/1721053272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbb4c1076a0 0x7fbb4c1997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.512+0000 7fbb52d29640 1 --2- 172.21.15.78:0/1721053272 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb4c101c90 0x7fbb4c1992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:43.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.512+0000 7fbb52d29640 1 -- 172.21.15.78:0/1721053272 >> 172.21.15.78:0/1721053272 conn(0x7fbb4c0fd700 msgr2=0x7fbb4c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:43.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.513+0000 7fbb52d29640 1 -- 172.21.15.78:0/1721053272 shutdown_connections 2024-09-11T00:25:43.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:43.513+0000 7fbb52d29640 1 -- 172.21.15.78:0/1721053272 wait complete. 2024-09-11T00:25:44.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:43 smithi078 ceph-mon[30865]: pgmap v607: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:44.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:43 smithi112 ceph-mon[35627]: pgmap v607: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:44.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:43 smithi138 ceph-mon[35019]: pgmap v607: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:45.245 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:25:45.246 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:25:45.504 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:25:46.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.045+0000 7fcfe3918640 1 -- 172.21.15.78:0/3585354136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfdc1087d0 msgr2=0x7fcfdc108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:46.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.045+0000 7fcfe3918640 1 --2- 172.21.15.78:0/3585354136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfdc1087d0 0x7fcfdc108c10 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009900 tx=0x7fcfcc02a410 comp rx=0 tx=0).stop 2024-09-11T00:25:46.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.045+0000 7fcfe3918640 1 -- 172.21.15.78:0/3585354136 shutdown_connections 2024-09-11T00:25:46.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.045+0000 7fcfe3918640 1 --2- 172.21.15.78:0/3585354136 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfdc109150 0x7fcfdc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.045+0000 7fcfe3918640 1 --2- 172.21.15.78:0/3585354136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfdc1087d0 0x7fcfdc108c10 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.045+0000 7fcfe3918640 1 --2- 172.21.15.78:0/3585354136 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfdc102dc0 0x7fcfdc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.045+0000 7fcfe3918640 1 -- 172.21.15.78:0/3585354136 >> 172.21.15.78:0/3585354136 conn(0x7fcfdc0fe830 msgr2=0x7fcfdc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:46.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.045+0000 7fcfe3918640 1 -- 172.21.15.78:0/3585354136 shutdown_connections 2024-09-11T00:25:46.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.045+0000 7fcfe3918640 1 -- 172.21.15.78:0/3585354136 wait complete. 2024-09-11T00:25:46.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.045+0000 7fcfe3918640 1 Processor -- start 2024-09-11T00:25:46.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.045+0000 7fcfe3918640 1 -- start start 2024-09-11T00:25:46.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfe3918640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfdc102dc0 0x7fcfdc0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:46.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfe3918640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfdc1087d0 0x7fcfdc0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:46.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfe3918640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfdc109150 0x7fcfdc075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:46.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfe3918640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc112e10 con 0x7fcfdc109150 2024-09-11T00:25:46.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfe3918640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc112c90 con 0x7fcfdc102dc0 2024-09-11T00:25:46.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfe3918640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc112f90 con 0x7fcfdc1087d0 2024-09-11T00:25:46.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfe1eb5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfdc109150 0x7fcfdc075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:46.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfe1eb5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfdc109150 0x7fcfdc075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40914/0 (socket says 172.21.15.78:40914) 2024-09-11T00:25:46.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfe1eb5640 1 -- 172.21.15.78:0/1297862532 learned_addr learned my addr 172.21.15.78:0/1297862532 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:46.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfe16b4640 1 --2- 172.21.15.78:0/1297862532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfdc102dc0 0x7fcfdc0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:46.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfe0eb3640 1 --2- 172.21.15.78:0/1297862532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfdc1087d0 0x7fcfdc0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:46.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfe1eb5640 1 -- 172.21.15.78:0/1297862532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfdc1087d0 msgr2=0x7fcfdc0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:46.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfe1eb5640 1 --2- 172.21.15.78:0/1297862532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfdc1087d0 0x7fcfdc0759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfe1eb5640 1 -- 172.21.15.78:0/1297862532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfdc102dc0 msgr2=0x7fcfdc0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:46.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfe1eb5640 1 --2- 172.21.15.78:0/1297862532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfdc102dc0 0x7fcfdc0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfe1eb5640 1 -- 172.21.15.78:0/1297862532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfdc1a7660 con 0x7fcfdc109150 2024-09-11T00:25:46.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfe16b4640 1 --2- 172.21.15.78:0/1297862532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfdc102dc0 0x7fcfdc0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:25:46.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfe1eb5640 1 --2- 172.21.15.78:0/1297862532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfdc109150 0x7fcfdc075f20 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400c970 tx=0x7fcfd400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:46.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfd27fc640 1 -- 172.21.15.78:0/1297862532 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4007bb0 con 0x7fcfdc109150 2024-09-11T00:25:46.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfd27fc640 1 -- 172.21.15.78:0/1297862532 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfd4007d50 con 0x7fcfdc109150 2024-09-11T00:25:46.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfd27fc640 1 -- 172.21.15.78:0/1297862532 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4018770 con 0x7fcfdc109150 2024-09-11T00:25:46.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfe3918640 1 -- 172.21.15.78:0/1297862532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfdc1a7950 con 0x7fcfdc109150 2024-09-11T00:25:46.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.046+0000 7fcfe3918640 1 -- 172.21.15.78:0/1297862532 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfdc1a7e40 con 0x7fcfdc109150 2024-09-11T00:25:46.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.049+0000 7fcfe5ced740 1 Processor -- start 2024-09-11T00:25:46.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.049+0000 7fcfd27fc640 1 -- 172.21.15.78:0/1297862532 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fcfd400f990 con 0x7fcfdc109150 2024-09-11T00:25:46.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.049+0000 7fcfe5ced740 1 -- start start 2024-09-11T00:25:46.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.049+0000 7fcfe5ced740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960d92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:46.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.049+0000 7fcfe5ced740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b960d9800 0x559b960e5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:46.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.049+0000 7fcfe5ced740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559b960e5790 0x559b960e7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:46.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.049+0000 7fcfe5ced740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x559b9604fe60 con 0x559b960d8ee0 2024-09-11T00:25:46.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.050+0000 7fcfe5ced740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559b9603f290 con 0x559b960d9800 2024-09-11T00:25:46.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.050+0000 7fcfe5ced740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x559b960430a0 con 0x559b960e5790 2024-09-11T00:25:46.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.050+0000 7fcfe0eb3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960d92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:46.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.050+0000 7fcfe0eb3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960d92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40920/0 (socket says 172.21.15.78:40920) 2024-09-11T00:25:46.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.050+0000 7fcfe0eb3640 1 -- 172.21.15.78:0/3270107015 learned_addr learned my addr 172.21.15.78:0/3270107015 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:46.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.050+0000 7fcfe16b4640 1 --2- 172.21.15.78:0/3270107015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b960d9800 0x559b960e5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:46.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.050+0000 7fcfe0eb3640 1 -- 172.21.15.78:0/3270107015 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559b960e5790 msgr2=0x559b960e7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:46.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.050+0000 7fcfe0eb3640 1 --2- 172.21.15.78:0/3270107015 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559b960e5790 0x559b960e7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.050+0000 7fcfe0eb3640 1 -- 172.21.15.78:0/3270107015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b960d9800 msgr2=0x559b960e5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:46.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.050+0000 7fcfe0eb3640 1 --2- 172.21.15.78:0/3270107015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b960d9800 0x559b960e5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.050+0000 7fcfe0eb3640 1 -- 172.21.15.78:0/3270107015 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b95d9d930 con 0x559b960d8ee0 2024-09-11T00:25:46.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.050+0000 7fcfd27fc640 1 --2- 172.21.15.78:0/1297862532 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcfc80b5450 0x7fcfc80b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:46.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.050+0000 7fcfe16b4640 1 --2- 172.21.15.78:0/1297862532 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcfc80b5450 0x7fcfc80b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:46.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.050+0000 7fcfe0eb3640 1 --2- 172.21.15.78:0/3270107015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960d92c0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc006010 tx=0x7fcfcc009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f102f3ae2ec026 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:46.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.050+0000 7fcfd27fc640 1 -- 172.21.15.78:0/1297862532 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7fcfd40e61b0 con 0x7fcfdc109150 2024-09-11T00:25:46.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.050+0000 7fcfc77fe640 1 -- 172.21.15.78:0/3270107015 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc035050 con 0x559b960d8ee0 2024-09-11T00:25:46.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.050+0000 7fcfc77fe640 1 -- 172.21.15.78:0/3270107015 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfcc0316a0 con 0x559b960d8ee0 2024-09-11T00:25:46.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.050+0000 7fcfc77fe640 1 -- 172.21.15.78:0/3270107015 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc0055a0 con 0x559b960d8ee0 2024-09-11T00:25:46.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.051+0000 7fcfe5ced740 1 -- 172.21.15.78:0/3270107015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 msgr2=0x559b960d92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:46.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.051+0000 7fcfe16b4640 1 --2- 172.21.15.78:0/1297862532 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcfc80b5450 0x7fcfc80b7910 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x559b960dc060 tx=0x7fcfd8009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:46.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.051+0000 7fcfe5ced740 1 --2- 172.21.15.78:0/3270107015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960d92c0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc006010 tx=0x7fcfcc009670 comp rx=0 tx=0).stop 2024-09-11T00:25:46.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.051+0000 7fcfe5ced740 1 -- 172.21.15.78:0/3270107015 shutdown_connections 2024-09-11T00:25:46.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.051+0000 7fcfe5ced740 1 --2- 172.21.15.78:0/3270107015 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559b960e5790 0x559b960e7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.051+0000 7fcfe5ced740 1 --2- 172.21.15.78:0/3270107015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b960d9800 0x559b960e5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.051+0000 7fcfe5ced740 1 --2- 172.21.15.78:0/3270107015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960d92c0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.051+0000 7fcfe5ced740 1 -- 172.21.15.78:0/3270107015 >> 172.21.15.78:0/3270107015 conn(0x559b960d6d10 msgr2=0x559b960d7eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:46.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.051+0000 7fcfe5ced740 1 -- 172.21.15.78:0/3270107015 shutdown_connections 2024-09-11T00:25:46.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.051+0000 7fcfe5ced740 1 -- 172.21.15.78:0/3270107015 wait complete. 2024-09-11T00:25:46.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.052+0000 7fcfe5ced740 1 -- start start 2024-09-11T00:25:46.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.052+0000 7fcfe5ced740 1 Processor -- start 2024-09-11T00:25:46.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.052+0000 7fcfe5ced740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960e2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:46.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.052+0000 7fcfe5ced740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559b960d9800 0x559b960e2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:46.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.052+0000 7fcfe5ced740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b960e5790 0x559b960e31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:46.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.052+0000 7fcfe5ced740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x559b95ea0890 con 0x559b960d8ee0 2024-09-11T00:25:46.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.052+0000 7fcfe5ced740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x559b95fd9d40 con 0x559b960e5790 2024-09-11T00:25:46.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.052+0000 7fcfe5ced740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x559b960e83e0 con 0x559b960d9800 2024-09-11T00:25:46.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.052+0000 7fcfe5ced740 10 client.0 _ll_register_callbacks cb 0x559b9603dc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:25:46.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.052+0000 7fcfe16b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960e2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:46.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.052+0000 7fcfe16b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960e2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40936/0 (socket says 172.21.15.78:40936) 2024-09-11T00:25:46.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.052+0000 7fcfe16b4640 1 -- 172.21.15.78:0/2893161958 learned_addr learned my addr 172.21.15.78:0/2893161958 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:46.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.053+0000 7fcfe1eb5640 1 --2- 172.21.15.78:0/2893161958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b960e5790 0x559b960e31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:46.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.053+0000 7fcfe0eb3640 1 --2- 172.21.15.78:0/2893161958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559b960d9800 0x559b960e2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:46.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.053+0000 7fcfe16b4640 1 -- 172.21.15.78:0/2893161958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559b960d9800 msgr2=0x559b960e2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:46.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.053+0000 7fcfe16b4640 1 --2- 172.21.15.78:0/2893161958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559b960d9800 0x559b960e2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.053+0000 7fcfe16b4640 1 -- 172.21.15.78:0/2893161958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b960e5790 msgr2=0x559b960e31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:46.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.053+0000 7fcfe16b4640 1 --2- 172.21.15.78:0/2893161958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b960e5790 0x559b960e31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.053+0000 7fcfe16b4640 1 -- 172.21.15.78:0/2893161958 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b960f1810 con 0x559b960d8ee0 2024-09-11T00:25:46.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.053+0000 7fcfe16b4640 1 --2- 172.21.15.78:0/2893161958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960e2770 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fcfd801fa40 tx=0x7fcfd8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc21a9923b841c14 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:46.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.053+0000 7fcfc4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:25:46.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.053+0000 7fcfc4ff9640 1 -- 172.21.15.78:0/2893161958 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8011b50 con 0x559b960d8ee0 2024-09-11T00:25:46.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.053+0000 7fcfc4ff9640 1 -- 172.21.15.78:0/2893161958 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7fcfd8011cf0 con 0x559b960d8ee0 2024-09-11T00:25:46.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.053+0000 7fcfe5ced740 1 -- 172.21.15.78:0/2893161958 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfcc0316a0 con 0x559b960d8ee0 2024-09-11T00:25:46.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.053+0000 7fcfc4ff9640 1 -- 172.21.15.78:0/2893161958 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcfd8028430 con 0x559b960d8ee0 2024-09-11T00:25:46.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.053+0000 7fcfe5ced740 10 client.16599 fetch_fsmap learned FSMap version 20 2024-09-11T00:25:46.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.053+0000 7fcfe5ced740 1 -- 172.21.15.78:0/2893161958 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559b960f4220 con 0x559b960d8ee0 2024-09-11T00:25:46.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.053+0000 7fcfc4ff9640 1 -- 172.21.15.78:0/2893161958 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfcc0316a0 con 0x559b960d8ee0 2024-09-11T00:25:46.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.053+0000 7fcfc4ff9640 1 -- 172.21.15.78:0/2893161958 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fcfd801c6a0 con 0x559b960d8ee0 2024-09-11T00:25:46.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.053+0000 7fcfe5ced740 10 client.16599 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:25:46.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.054+0000 7fcfe5ced740 10 client.16599 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:25:46.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.054+0000 7fcfe5ced740 20 client.16599 populate_metadata read hostname 'smithi078' 2024-09-11T00:25:46.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.054+0000 7fcfe5ced740 1 --2- 172.21.15.78:0/2893161958 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x559b960f5780 0x559b960f7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:46.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.054+0000 7fcfe5ced740 4 client.16599 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:25:46.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.054+0000 7fcfe5ced740 1 -- 172.21.15.78:0/2893161958 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b96051db0 con 0x559b960f5780 2024-09-11T00:25:46.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.054+0000 7fcfe0eb3640 1 --2- 172.21.15.78:0/2893161958 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x559b960f5780 0x559b960f7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:46.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.054+0000 7fcfe0eb3640 1 --2- 172.21.15.78:0/2893161958 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x559b960f5780 0x559b960f7b70 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b22888f3bdcf3678 server_cookie=ba2da0f92a9300c9 in_seq=0 out_seq=0 2024-09-11T00:25:46.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.054+0000 7fcfc4ff9640 10 client.16599 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:46.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.055+0000 7fcfc4ff9640 1 -- 172.21.15.78:0/2893161958 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559b96051db0 con 0x559b960f5780 2024-09-11T00:25:46.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.055+0000 7fcfc4ff9640 10 client.16599 handle_command_reply: tid=0 2024-09-11T00:25:46.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.055+0000 7fcfe5ced740 1 client.16599 shutdown 2024-09-11T00:25:46.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.055+0000 7fcfe5ced740 1 -- 172.21.15.78:0/2893161958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 msgr2=0x559b960e2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:46.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.055+0000 7fcfe5ced740 1 --2- 172.21.15.78:0/2893161958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960e2770 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fcfd801fa40 tx=0x7fcfd8004a40 comp rx=0 tx=0).stop 2024-09-11T00:25:46.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.055+0000 7fcfe5ced740 1 -- 172.21.15.78:0/2893161958 shutdown_connections 2024-09-11T00:25:46.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.055+0000 7fcfe5ced740 1 --2- 172.21.15.78:0/2893161958 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x559b960f5780 0x559b960f7b70 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.055+0000 7fcfe5ced740 1 --2- 172.21.15.78:0/2893161958 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b960e5790 0x559b960e31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.055+0000 7fcfe5ced740 1 --2- 172.21.15.78:0/2893161958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559b960d9800 0x559b960e2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.055+0000 7fcfc4ff9640 0 client.16599 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:46.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.055+0000 7fcfe5ced740 1 --2- 172.21.15.78:0/2893161958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960e2770 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.055+0000 7fcfe5ced740 1 -- 172.21.15.78:0/2893161958 >> 172.21.15.78:0/2893161958 conn(0x559b960d6d10 msgr2=0x559b960d5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:46.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.055+0000 7fcfe5ced740 1 -- 172.21.15.78:0/2893161958 shutdown_connections 2024-09-11T00:25:46.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.055+0000 7fcfe5ced740 1 -- 172.21.15.78:0/2893161958 wait complete. 2024-09-11T00:25:46.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.055+0000 7fcfe5ced740 20 client.16599 trim_cache size 0 max 16384 2024-09-11T00:25:46.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.073+0000 7fcfe5ced740 1 Processor -- start 2024-09-11T00:25:46.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.073+0000 7fcfe5ced740 1 -- start start 2024-09-11T00:25:46.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.073+0000 7fcfe5ced740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960e44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:46.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.073+0000 7fcfe5ced740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b960d9800 0x559b960df980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:46.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.073+0000 7fcfe5ced740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559b960e5790 0x559b960dfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:46.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.073+0000 7fcfe5ced740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc1ae8a0 con 0x559b960d8ee0 2024-09-11T00:25:46.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.073+0000 7fcfe5ced740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc1b1100 con 0x559b960d9800 2024-09-11T00:25:46.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.073+0000 7fcfe5ced740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc1aeef0 con 0x559b960e5790 2024-09-11T00:25:46.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.073+0000 7fcfe16b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960e44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:46.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.073+0000 7fcfe16b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960e44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40952/0 (socket says 172.21.15.78:40952) 2024-09-11T00:25:46.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.073+0000 7fcfe16b4640 1 -- 172.21.15.78:0/3616594137 learned_addr learned my addr 172.21.15.78:0/3616594137 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:46.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.073+0000 7fcfe0eb3640 1 --2- 172.21.15.78:0/3616594137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b960d9800 0x559b960df980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:46.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.073+0000 7fcfe16b4640 1 -- 172.21.15.78:0/3616594137 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559b960e5790 msgr2=0x559b960dfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:46.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.073+0000 7fcfe1eb5640 1 --2- 172.21.15.78:0/3616594137 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559b960e5790 0x559b960dfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:46.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.074+0000 7fcfe16b4640 1 --2- 172.21.15.78:0/3616594137 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559b960e5790 0x559b960dfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.074+0000 7fcfe16b4640 1 -- 172.21.15.78:0/3616594137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b960d9800 msgr2=0x559b960df980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:46.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.074+0000 7fcfe16b4640 1 --2- 172.21.15.78:0/3616594137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b960d9800 0x559b960df980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.074+0000 7fcfe16b4640 1 -- 172.21.15.78:0/3616594137 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b960d6b40 con 0x559b960d8ee0 2024-09-11T00:25:46.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.074+0000 7fcfe0eb3640 1 --2- 172.21.15.78:0/3616594137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b960d9800 0x559b960df980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:25:46.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.074+0000 7fcfe1eb5640 1 --2- 172.21.15.78:0/3616594137 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559b960e5790 0x559b960dfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:25:46.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.074+0000 7fcfe16b4640 1 --2- 172.21.15.78:0/3616594137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960e44b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fcfd801cb60 tx=0x7fcfd8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310374ebefd545cb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:46.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.074+0000 7fcfc6ffd640 1 -- 172.21.15.78:0/3616594137 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8034070 con 0x559b960d8ee0 2024-09-11T00:25:46.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.074+0000 7fcfc6ffd640 1 -- 172.21.15.78:0/3616594137 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfd801ce50 con 0x559b960d8ee0 2024-09-11T00:25:46.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.074+0000 7fcfc6ffd640 1 -- 172.21.15.78:0/3616594137 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80285d0 con 0x559b960d8ee0 2024-09-11T00:25:46.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.075+0000 7fcfe5ced740 1 -- 172.21.15.78:0/3616594137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 msgr2=0x559b960e44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:46.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.075+0000 7fcfe5ced740 1 --2- 172.21.15.78:0/3616594137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960e44b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fcfd801cb60 tx=0x7fcfd8011810 comp rx=0 tx=0).stop 2024-09-11T00:25:46.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.075+0000 7fcfe5ced740 1 -- 172.21.15.78:0/3616594137 shutdown_connections 2024-09-11T00:25:46.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.075+0000 7fcfe5ced740 1 --2- 172.21.15.78:0/3616594137 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559b960e5790 0x559b960dfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.075+0000 7fcfe5ced740 1 --2- 172.21.15.78:0/3616594137 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b960d9800 0x559b960df980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.075+0000 7fcfe5ced740 1 --2- 172.21.15.78:0/3616594137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960e44b0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.075+0000 7fcfe5ced740 1 -- 172.21.15.78:0/3616594137 >> 172.21.15.78:0/3616594137 conn(0x559b960d6d10 msgr2=0x559b960e3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:46.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.075+0000 7fcfe5ced740 1 -- 172.21.15.78:0/3616594137 shutdown_connections 2024-09-11T00:25:46.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.075+0000 7fcfe5ced740 1 -- 172.21.15.78:0/3616594137 wait complete. 2024-09-11T00:25:46.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.075+0000 7fcfe5ced740 1 -- start start 2024-09-11T00:25:46.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.075+0000 7fcfe5ced740 1 Processor -- start 2024-09-11T00:25:46.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.076+0000 7fcfe5ced740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960e9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:46.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.076+0000 7fcfe5ced740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b960d9800 0x559b960ea560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:46.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.076+0000 7fcfe5ced740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559b960e5790 0x559b9615b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:46.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.076+0000 7fcfe5ced740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc1af5c0 con 0x559b960d8ee0 2024-09-11T00:25:46.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.076+0000 7fcfe5ced740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc1b0a30 con 0x559b960d9800 2024-09-11T00:25:46.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.076+0000 7fcfe5ced740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc1afc90 con 0x559b960e5790 2024-09-11T00:25:46.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.076+0000 7fcfe5ced740 10 client.0 _ll_register_callbacks cb 0x7fcfd8009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:25:46.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.076+0000 7fcfe16b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960e9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:46.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.076+0000 7fcfe16b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960e9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40968/0 (socket says 172.21.15.78:40968) 2024-09-11T00:25:46.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.076+0000 7fcfe16b4640 1 -- 172.21.15.78:0/170659041 learned_addr learned my addr 172.21.15.78:0/170659041 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:46.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.076+0000 7fcfe0eb3640 1 --2- 172.21.15.78:0/170659041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b960d9800 0x559b960ea560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:46.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.076+0000 7fcfe16b4640 1 -- 172.21.15.78:0/170659041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559b960e5790 msgr2=0x559b9615b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:46.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.076+0000 7fcfe16b4640 1 --2- 172.21.15.78:0/170659041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559b960e5790 0x559b9615b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.076+0000 7fcfe16b4640 1 -- 172.21.15.78:0/170659041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b960d9800 msgr2=0x559b960ea560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:46.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.076+0000 7fcfe16b4640 1 --2- 172.21.15.78:0/170659041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b960d9800 0x559b960ea560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.076+0000 7fcfe16b4640 1 -- 172.21.15.78:0/170659041 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b9615bdb0 con 0x559b960d8ee0 2024-09-11T00:25:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.076+0000 7fcfe16b4640 1 --2- 172.21.15.78:0/170659041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960e9fe0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8022040 tx=0x7fcfd801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308e8caa7b309de4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.076+0000 7fcfc4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:25:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.076+0000 7fcfc4ff9640 1 -- 172.21.15.78:0/170659041 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd803d070 con 0x559b960d8ee0 2024-09-11T00:25:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.076+0000 7fcfc4ff9640 1 -- 172.21.15.78:0/170659041 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7fcfd8004a20 con 0x559b960d8ee0 2024-09-11T00:25:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.076+0000 7fcfe5ced740 1 -- 172.21.15.78:0/170659041 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfd801ce50 con 0x559b960d8ee0 2024-09-11T00:25:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.077+0000 7fcfc4ff9640 1 -- 172.21.15.78:0/170659041 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcfd8034050 con 0x559b960d8ee0 2024-09-11T00:25:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.077+0000 7fcfe5ced740 10 client.16605 fetch_fsmap learned FSMap version 20 2024-09-11T00:25:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.077+0000 7fcfe5ced740 1 -- 172.21.15.78:0/170659041 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x559b96163100 con 0x559b960d8ee0 2024-09-11T00:25:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.077+0000 7fcfc4ff9640 1 -- 172.21.15.78:0/170659041 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfd801ce50 con 0x559b960d8ee0 2024-09-11T00:25:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.077+0000 7fcfc4ff9640 1 -- 172.21.15.78:0/170659041 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fcfd8005040 con 0x559b960d8ee0 2024-09-11T00:25:46.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.077+0000 7fcfe5ced740 10 client.16605 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:25:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.077+0000 7fcfe5ced740 10 client.16605 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:25:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.077+0000 7fcfe5ced740 20 client.16605 populate_metadata read hostname 'smithi078' 2024-09-11T00:25:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.077+0000 7fcfe5ced740 1 --2- 172.21.15.78:0/170659041 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x559b96163790 0x559b96165bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.077+0000 7fcfe5ced740 4 client.16605 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:25:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.077+0000 7fcfe5ced740 1 -- 172.21.15.78:0/170659041 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559b9604d860 con 0x559b96163790 2024-09-11T00:25:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.077+0000 7fcfe0eb3640 1 --2- 172.21.15.78:0/170659041 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x559b96163790 0x559b96165bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.078+0000 7fcfe0eb3640 1 --2- 172.21.15.78:0/170659041 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x559b96163790 0x559b96165bb0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d366c40c320a38cd server_cookie=aabbaa406260f477 in_seq=0 out_seq=0 2024-09-11T00:25:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.078+0000 7fcfc4ff9640 10 client.16605 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.079+0000 7fcfc4ff9640 1 -- 172.21.15.78:0/170659041 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559b9604d860 con 0x559b96163790 2024-09-11T00:25:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.079+0000 7fcfc4ff9640 10 client.16605 handle_command_reply: tid=0 2024-09-11T00:25:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.079+0000 7fcfe5ced740 1 client.16605 shutdown 2024-09-11T00:25:46.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.079+0000 7fcfe5ced740 1 -- 172.21.15.78:0/170659041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 msgr2=0x559b960e9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.079+0000 7fcfe5ced740 1 --2- 172.21.15.78:0/170659041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960e9fe0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8022040 tx=0x7fcfd801c960 comp rx=0 tx=0).stop 2024-09-11T00:25:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.079+0000 7fcfe5ced740 1 -- 172.21.15.78:0/170659041 shutdown_connections 2024-09-11T00:25:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.079+0000 7fcfe5ced740 1 --2- 172.21.15.78:0/170659041 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x559b96163790 0x559b96165bb0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.079+0000 7fcfe5ced740 1 --2- 172.21.15.78:0/170659041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559b960e5790 0x559b9615b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.079+0000 7fcfe5ced740 1 --2- 172.21.15.78:0/170659041 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x559b960d9800 0x559b960ea560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.079+0000 7fcfe5ced740 1 --2- 172.21.15.78:0/170659041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559b960d8ee0 0x559b960e9fe0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.079+0000 7fcfe5ced740 1 -- 172.21.15.78:0/170659041 >> 172.21.15.78:0/170659041 conn(0x559b960d6d10 msgr2=0x559b960e45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.079+0000 7fcfc4ff9640 0 client.16605 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.080+0000 7fcfe5ced740 1 -- 172.21.15.78:0/170659041 shutdown_connections 2024-09-11T00:25:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.080+0000 7fcfe5ced740 1 -- 172.21.15.78:0/170659041 wait complete. 2024-09-11T00:25:46.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.080+0000 7fcfe5ced740 20 client.16605 trim_cache size 0 max 16384 2024-09-11T00:25:46.089 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:25:46.089 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-11T00:25:46.089 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "d570d2aa-a4ac-43b2-b13a-66aa0f566bb6", 2024-09-11T00:25:46.089 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-11T00:25:46.089 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:25:46.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.080+0000 7fcfe3918640 1 -- 172.21.15.78:0/1297862532 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcfc80b5450 msgr2=0x7fcfc80b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:46.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.080+0000 7fcfe3918640 1 --2- 172.21.15.78:0/1297862532 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcfc80b5450 0x7fcfc80b7910 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x559b960dc060 tx=0x7fcfd8009500 comp rx=0 tx=0).stop 2024-09-11T00:25:46.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.080+0000 7fcfe3918640 1 -- 172.21.15.78:0/1297862532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfdc109150 msgr2=0x7fcfdc075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:46.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.080+0000 7fcfe3918640 1 --2- 172.21.15.78:0/1297862532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfdc109150 0x7fcfdc075f20 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400c970 tx=0x7fcfd400ce30 comp rx=0 tx=0).stop 2024-09-11T00:25:46.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.080+0000 7fcfe3918640 1 -- 172.21.15.78:0/1297862532 shutdown_connections 2024-09-11T00:25:46.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.080+0000 7fcfe3918640 1 --2- 172.21.15.78:0/1297862532 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fcfc80b5450 0x7fcfc80b7910 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.080+0000 7fcfe3918640 1 --2- 172.21.15.78:0/1297862532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfdc109150 0x7fcfdc075f20 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.080+0000 7fcfe3918640 1 --2- 172.21.15.78:0/1297862532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfdc1087d0 0x7fcfdc0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.080+0000 7fcfe3918640 1 --2- 172.21.15.78:0/1297862532 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfdc102dc0 0x7fcfdc0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:46.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.080+0000 7fcfe3918640 1 -- 172.21.15.78:0/1297862532 >> 172.21.15.78:0/1297862532 conn(0x7fcfdc0fe830 msgr2=0x7fcfdc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:46.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.080+0000 7fcfe3918640 1 -- 172.21.15.78:0/1297862532 shutdown_connections 2024-09-11T00:25:46.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:46.080+0000 7fcfe3918640 1 -- 172.21.15.78:0/1297862532 wait complete. 2024-09-11T00:25:46.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:45 smithi112 ceph-mon[35627]: pgmap v608: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:25:46.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:45 smithi138 ceph-mon[35019]: pgmap v608: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:25:46.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:45 smithi078 ceph-mon[30865]: pgmap v608: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:25:46.788 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:25:47.041 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:25:47.185 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:46 smithi078 ceph-mon[30865]: scrub queued for path: / 2024-09-11T00:25:47.185 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:46 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:25:47.186 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:46 smithi078 ceph-mon[30865]: scrub summary: active paths [/] 2024-09-11T00:25:47.186 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:46 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:25:47.186 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:46 smithi078 ceph-mon[30865]: scrub summary: idle 2024-09-11T00:25:47.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:46 smithi112 ceph-mon[35627]: scrub queued for path: / 2024-09-11T00:25:47.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:46 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:25:47.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:46 smithi112 ceph-mon[35627]: scrub summary: active paths [/] 2024-09-11T00:25:47.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:46 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:25:47.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:46 smithi112 ceph-mon[35627]: scrub summary: idle 2024-09-11T00:25:47.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:46 smithi138 ceph-mon[35019]: scrub queued for path: / 2024-09-11T00:25:47.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:46 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:25:47.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:46 smithi138 ceph-mon[35019]: scrub summary: active paths [/] 2024-09-11T00:25:47.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:46 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:25:47.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:46 smithi138 ceph-mon[35019]: scrub summary: idle 2024-09-11T00:25:47.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.584+0000 7fe234e09640 1 -- 172.21.15.78:0/2541790552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2301076a0 msgr2=0x7fe230107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:47.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.584+0000 7fe234e09640 1 --2- 172.21.15.78:0/2541790552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2301076a0 0x7fe230107ae0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe218009900 tx=0x7fe21802a410 comp rx=0 tx=0).stop 2024-09-11T00:25:47.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.585+0000 7fe234e09640 1 -- 172.21.15.78:0/2541790552 shutdown_connections 2024-09-11T00:25:47.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.585+0000 7fe234e09640 1 --2- 172.21.15.78:0/2541790552 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe230108020 0x7fe23010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.585+0000 7fe234e09640 1 --2- 172.21.15.78:0/2541790552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2301076a0 0x7fe230107ae0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.585+0000 7fe234e09640 1 --2- 172.21.15.78:0/2541790552 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe230101c90 0x7fe230102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.585+0000 7fe234e09640 1 -- 172.21.15.78:0/2541790552 >> 172.21.15.78:0/2541790552 conn(0x7fe2300fd700 msgr2=0x7fe2300ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:47.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.585+0000 7fe234e09640 1 -- 172.21.15.78:0/2541790552 shutdown_connections 2024-09-11T00:25:47.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.585+0000 7fe234e09640 1 -- 172.21.15.78:0/2541790552 wait complete. 2024-09-11T00:25:47.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.585+0000 7fe234e09640 1 Processor -- start 2024-09-11T00:25:47.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.585+0000 7fe234e09640 1 -- start start 2024-09-11T00:25:47.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.585+0000 7fe234e09640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe230101c90 0x7fe23010f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:47.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.586+0000 7fe234e09640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2301076a0 0x7fe23010f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:47.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.586+0000 7fe234e09640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe230108020 0x7fe23010fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:47.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.586+0000 7fe234e09640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe230112e20 con 0x7fe2301076a0 2024-09-11T00:25:47.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.586+0000 7fe234e09640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe230112ca0 con 0x7fe230108020 2024-09-11T00:25:47.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.586+0000 7fe234e09640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe230112fa0 con 0x7fe230101c90 2024-09-11T00:25:47.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.586+0000 7fe22dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2301076a0 0x7fe23010f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:47.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.586+0000 7fe22dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2301076a0 0x7fe23010f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40988/0 (socket says 172.21.15.78:40988) 2024-09-11T00:25:47.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.586+0000 7fe22dd9b640 1 -- 172.21.15.78:0/897168962 learned_addr learned my addr 172.21.15.78:0/897168962 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:47.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.586+0000 7fe22e59c640 1 --2- 172.21.15.78:0/897168962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe230101c90 0x7fe23010f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:47.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.586+0000 7fe22ed9d640 1 --2- 172.21.15.78:0/897168962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe230108020 0x7fe23010fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:47.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.586+0000 7fe22dd9b640 1 -- 172.21.15.78:0/897168962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe230101c90 msgr2=0x7fe23010f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:47.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.586+0000 7fe22dd9b640 1 --2- 172.21.15.78:0/897168962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe230101c90 0x7fe23010f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.586+0000 7fe22dd9b640 1 -- 172.21.15.78:0/897168962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe230108020 msgr2=0x7fe23010fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:47.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.586+0000 7fe22dd9b640 1 --2- 172.21.15.78:0/897168962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe230108020 0x7fe23010fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.586+0000 7fe22dd9b640 1 -- 172.21.15.78:0/897168962 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2301a77f0 con 0x7fe2301076a0 2024-09-11T00:25:47.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.586+0000 7fe22ed9d640 1 --2- 172.21.15.78:0/897168962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe230108020 0x7fe23010fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:25:47.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.586+0000 7fe22dd9b640 1 --2- 172.21.15.78:0/897168962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2301076a0 0x7fe23010f870 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe218006010 tx=0x7fe2180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:47.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.586+0000 7fe2277fe640 1 -- 172.21.15.78:0/897168962 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21803f030 con 0x7fe2301076a0 2024-09-11T00:25:47.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.586+0000 7fe2277fe640 1 -- 172.21.15.78:0/897168962 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe218003800 con 0x7fe2301076a0 2024-09-11T00:25:47.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.586+0000 7fe234e09640 1 -- 172.21.15.78:0/897168962 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2301a7a80 con 0x7fe2301076a0 2024-09-11T00:25:47.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.586+0000 7fe2277fe640 1 -- 172.21.15.78:0/897168962 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe218035070 con 0x7fe2301076a0 2024-09-11T00:25:47.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.586+0000 7fe234e09640 1 -- 172.21.15.78:0/897168962 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2301a8030 con 0x7fe2301076a0 2024-09-11T00:25:47.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.589+0000 7fe2277fe640 1 -- 172.21.15.78:0/897168962 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fe218003cb0 con 0x7fe2301076a0 2024-09-11T00:25:47.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.589+0000 7fe2371de740 1 Processor -- start 2024-09-11T00:25:47.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.589+0000 7fe2371de740 1 -- start start 2024-09-11T00:25:47.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.589+0000 7fe2371de740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608478310a0 0x560847831480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:47.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.589+0000 7fe2371de740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608478319c0 0x56084783d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:47.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.589+0000 7fe2371de740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084783d950 0x56084783fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:47.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.589+0000 7fe2371de740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5608477a7e50 con 0x5608478319c0 2024-09-11T00:25:47.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.589+0000 7fe2371de740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560847797280 con 0x56084783d950 2024-09-11T00:25:47.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.589+0000 7fe2371de740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56084779b090 con 0x5608478310a0 2024-09-11T00:25:47.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.590+0000 7fe22e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608478319c0 0x56084783d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:47.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.590+0000 7fe22e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608478319c0 0x56084783d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40990/0 (socket says 172.21.15.78:40990) 2024-09-11T00:25:47.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.590+0000 7fe22e59c640 1 -- 172.21.15.78:0/3278918004 learned_addr learned my addr 172.21.15.78:0/3278918004 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:47.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.590+0000 7fe22ed9d640 1 --2- 172.21.15.78:0/3278918004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608478310a0 0x560847831480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:47.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.590+0000 7fe22dd9b640 1 --2- 172.21.15.78:0/3278918004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084783d950 0x56084783fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:47.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.590+0000 7fe22e59c640 1 -- 172.21.15.78:0/3278918004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608478310a0 msgr2=0x560847831480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:47.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.590+0000 7fe22e59c640 1 --2- 172.21.15.78:0/3278918004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608478310a0 0x560847831480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.590+0000 7fe22e59c640 1 -- 172.21.15.78:0/3278918004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084783d950 msgr2=0x56084783fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:47.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.590+0000 7fe22e59c640 1 --2- 172.21.15.78:0/3278918004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084783d950 0x56084783fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.590+0000 7fe22e59c640 1 -- 172.21.15.78:0/3278918004 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608474f5650 con 0x5608478319c0 2024-09-11T00:25:47.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.590+0000 7fe22dd9b640 1 --2- 172.21.15.78:0/3278918004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084783d950 0x56084783fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:25:47.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.590+0000 7fe2277fe640 1 --2- 172.21.15.78:0/897168962 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe21c0b54d0 0x7fe21c0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:47.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.590+0000 7fe22e59c640 1 --2- 172.21.15.78:0/3278918004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608478319c0 0x56084783d410 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe220009a70 tx=0x7fe220009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=719eee24abcf40d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:47.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.590+0000 7fe22ed9d640 1 --2- 172.21.15.78:0/897168962 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe21c0b54d0 0x7fe21c0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:47.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.590+0000 7fe2277fe640 1 -- 172.21.15.78:0/897168962 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7fe2181068a0 con 0x7fe2301076a0 2024-09-11T00:25:47.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.590+0000 7fe224ff9640 1 -- 172.21.15.78:0/3278918004 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe220017070 con 0x5608478319c0 2024-09-11T00:25:47.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.590+0000 7fe224ff9640 1 -- 172.21.15.78:0/3278918004 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe220013470 con 0x5608478319c0 2024-09-11T00:25:47.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.590+0000 7fe224ff9640 1 -- 172.21.15.78:0/3278918004 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe220012630 con 0x5608478319c0 2024-09-11T00:25:47.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.591+0000 7fe2371de740 1 -- 172.21.15.78:0/3278918004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608478319c0 msgr2=0x56084783d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:47.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.591+0000 7fe22ed9d640 1 --2- 172.21.15.78:0/897168962 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe21c0b54d0 0x7fe21c0b7990 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe2301113f0 tx=0x7fe22800e040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:47.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.591+0000 7fe2371de740 1 --2- 172.21.15.78:0/3278918004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608478319c0 0x56084783d410 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe220009a70 tx=0x7fe220009f30 comp rx=0 tx=0).stop 2024-09-11T00:25:47.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.591+0000 7fe2371de740 1 -- 172.21.15.78:0/3278918004 shutdown_connections 2024-09-11T00:25:47.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.591+0000 7fe2371de740 1 --2- 172.21.15.78:0/3278918004 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084783d950 0x56084783fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.591+0000 7fe2371de740 1 --2- 172.21.15.78:0/3278918004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608478319c0 0x56084783d410 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.591+0000 7fe2371de740 1 --2- 172.21.15.78:0/3278918004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608478310a0 0x560847831480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.591+0000 7fe2371de740 1 -- 172.21.15.78:0/3278918004 >> 172.21.15.78:0/3278918004 conn(0x56084782eed0 msgr2=0x560847830070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:47.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.591+0000 7fe2371de740 1 -- 172.21.15.78:0/3278918004 shutdown_connections 2024-09-11T00:25:47.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.591+0000 7fe2371de740 1 -- 172.21.15.78:0/3278918004 wait complete. 2024-09-11T00:25:47.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.591+0000 7fe2371de740 1 -- start start 2024-09-11T00:25:47.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.592+0000 7fe2371de740 1 Processor -- start 2024-09-11T00:25:47.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.592+0000 7fe2371de740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608478310a0 0x56084783d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:47.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.592+0000 7fe2371de740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608478319c0 0x56084783a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:47.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.592+0000 7fe2371de740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084783d950 0x56084783ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:47.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.592+0000 7fe2371de740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5608475f8700 con 0x5608478319c0 2024-09-11T00:25:47.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.592+0000 7fe2371de740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x560847732110 con 0x56084783d950 2024-09-11T00:25:47.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.592+0000 7fe2371de740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5608478405d0 con 0x5608478310a0 2024-09-11T00:25:47.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.592+0000 7fe2371de740 10 client.0 _ll_register_callbacks cb 0x56084774b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:25:47.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.592+0000 7fe22dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608478319c0 0x56084783a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:47.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.592+0000 7fe22dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608478319c0 0x56084783a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41000/0 (socket says 172.21.15.78:41000) 2024-09-11T00:25:47.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.592+0000 7fe22dd9b640 1 -- 172.21.15.78:0/3380736257 learned_addr learned my addr 172.21.15.78:0/3380736257 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:47.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.592+0000 7fe22ed9d640 1 --2- 172.21.15.78:0/3380736257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084783d950 0x56084783ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:47.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.592+0000 7fe22e59c640 1 --2- 172.21.15.78:0/3380736257 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608478310a0 0x56084783d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:47.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.592+0000 7fe22dd9b640 1 -- 172.21.15.78:0/3380736257 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608478310a0 msgr2=0x56084783d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:47.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.592+0000 7fe22dd9b640 1 --2- 172.21.15.78:0/3380736257 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608478310a0 0x56084783d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.592+0000 7fe22dd9b640 1 -- 172.21.15.78:0/3380736257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084783d950 msgr2=0x56084783ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:47.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.592+0000 7fe22dd9b640 1 --2- 172.21.15.78:0/3380736257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084783d950 0x56084783ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.592+0000 7fe22dd9b640 1 -- 172.21.15.78:0/3380736257 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56084775fc40 con 0x5608478319c0 2024-09-11T00:25:47.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.592+0000 7fe22dd9b640 1 --2- 172.21.15.78:0/3380736257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608478319c0 0x56084783a6b0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe2180cca10 tx=0x7fe2180c9420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1881f43395874c2d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:47.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.592+0000 7fe215ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:25:47.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.592+0000 7fe215ffb640 1 -- 172.21.15.78:0/3380736257 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe218049040 con 0x5608478319c0 2024-09-11T00:25:47.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.593+0000 7fe215ffb640 1 -- 172.21.15.78:0/3380736257 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7fe2180c8f80 con 0x5608478319c0 2024-09-11T00:25:47.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.593+0000 7fe2371de740 1 -- 172.21.15.78:0/3380736257 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe220013470 con 0x5608478319c0 2024-09-11T00:25:47.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.593+0000 7fe215ffb640 1 -- 172.21.15.78:0/3380736257 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe2180cc480 con 0x5608478319c0 2024-09-11T00:25:47.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.593+0000 7fe2371de740 10 client.16617 fetch_fsmap learned FSMap version 20 2024-09-11T00:25:47.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.593+0000 7fe2371de740 1 -- 172.21.15.78:0/3380736257 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56084784bf60 con 0x5608478319c0 2024-09-11T00:25:47.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.593+0000 7fe215ffb640 1 -- 172.21.15.78:0/3380736257 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe220013470 con 0x5608478319c0 2024-09-11T00:25:47.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.593+0000 7fe215ffb640 1 -- 172.21.15.78:0/3380736257 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe2180ccf70 con 0x5608478319c0 2024-09-11T00:25:47.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.593+0000 7fe2371de740 10 client.16617 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:25:47.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.593+0000 7fe2371de740 10 client.16617 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:25:47.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.593+0000 7fe2371de740 20 client.16617 populate_metadata read hostname 'smithi078' 2024-09-11T00:25:47.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.593+0000 7fe2371de740 1 --2- 172.21.15.78:0/3380736257 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56084784d370 0x56084784f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:47.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.593+0000 7fe2371de740 4 client.16617 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:25:47.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.593+0000 7fe2371de740 1 -- 172.21.15.78:0/3380736257 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608477a9da0 con 0x56084784d370 2024-09-11T00:25:47.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.593+0000 7fe22e59c640 1 --2- 172.21.15.78:0/3380736257 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56084784d370 0x56084784f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:47.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.594+0000 7fe215ffb640 10 client.16617 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:47.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.594+0000 7fe22e59c640 1 --2- 172.21.15.78:0/3380736257 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56084784d370 0x56084784f7a0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b755052d803fe66 server_cookie=f77298982b39f58a in_seq=0 out_seq=0 2024-09-11T00:25:47.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.595+0000 7fe215ffb640 1 -- 172.21.15.78:0/3380736257 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5608477a9da0 con 0x56084784d370 2024-09-11T00:25:47.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.595+0000 7fe215ffb640 10 client.16617 handle_command_reply: tid=0 2024-09-11T00:25:47.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.595+0000 7fe2371de740 1 client.16617 shutdown 2024-09-11T00:25:47.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.595+0000 7fe2371de740 1 -- 172.21.15.78:0/3380736257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608478319c0 msgr2=0x56084783a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:47.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.595+0000 7fe2371de740 1 --2- 172.21.15.78:0/3380736257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608478319c0 0x56084783a6b0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe2180cca10 tx=0x7fe2180c9420 comp rx=0 tx=0).stop 2024-09-11T00:25:47.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.595+0000 7fe2371de740 1 -- 172.21.15.78:0/3380736257 shutdown_connections 2024-09-11T00:25:47.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.595+0000 7fe2371de740 1 --2- 172.21.15.78:0/3380736257 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x56084784d370 0x56084784f7a0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.595+0000 7fe2371de740 1 --2- 172.21.15.78:0/3380736257 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x56084783d950 0x56084783ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.595+0000 7fe2371de740 1 --2- 172.21.15.78:0/3380736257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608478319c0 0x56084783a6b0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.595+0000 7fe2371de740 1 --2- 172.21.15.78:0/3380736257 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608478310a0 0x56084783d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.595+0000 7fe215ffb640 0 client.16617 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:47.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.595+0000 7fe2371de740 1 -- 172.21.15.78:0/3380736257 >> 172.21.15.78:0/3380736257 conn(0x56084782eed0 msgr2=0x560847834a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:47.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.595+0000 7fe2371de740 1 -- 172.21.15.78:0/3380736257 shutdown_connections 2024-09-11T00:25:47.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.595+0000 7fe2371de740 1 -- 172.21.15.78:0/3380736257 wait complete. 2024-09-11T00:25:47.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.595+0000 7fe2371de740 20 client.16617 trim_cache size 0 max 16384 2024-09-11T00:25:47.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.612+0000 7fe2371de740 1 Processor -- start 2024-09-11T00:25:47.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.612+0000 7fe2371de740 1 -- start start 2024-09-11T00:25:47.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.613+0000 7fe2371de740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608478310a0 0x560847849830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:47.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.613+0000 7fe2371de740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608478319c0 0x56084783ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:47.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.613+0000 7fe2371de740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56084783d950 0x56084783f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:47.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.613+0000 7fe2371de740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe2301aea10 con 0x56084783d950 2024-09-11T00:25:47.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.613+0000 7fe2371de740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe2301b1270 con 0x5608478310a0 2024-09-11T00:25:47.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.613+0000 7fe2371de740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe2301af060 con 0x5608478319c0 2024-09-11T00:25:47.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.613+0000 7fe22ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56084783d950 0x56084783f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:47.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.613+0000 7fe22ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56084783d950 0x56084783f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41010/0 (socket says 172.21.15.78:41010) 2024-09-11T00:25:47.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.613+0000 7fe22ed9d640 1 -- 172.21.15.78:0/1416591446 learned_addr learned my addr 172.21.15.78:0/1416591446 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:47.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.613+0000 7fe22e59c640 1 --2- 172.21.15.78:0/1416591446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608478310a0 0x560847849830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:47.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.613+0000 7fe22dd9b640 1 --2- 172.21.15.78:0/1416591446 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608478319c0 0x56084783ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:47.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.613+0000 7fe22ed9d640 1 -- 172.21.15.78:0/1416591446 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608478319c0 msgr2=0x56084783ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:47.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.613+0000 7fe22ed9d640 1 --2- 172.21.15.78:0/1416591446 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608478319c0 0x56084783ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.613+0000 7fe22ed9d640 1 -- 172.21.15.78:0/1416591446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608478310a0 msgr2=0x560847849830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:47.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.613+0000 7fe22ed9d640 1 --2- 172.21.15.78:0/1416591446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608478310a0 0x560847849830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.613+0000 7fe22ed9d640 1 -- 172.21.15.78:0/1416591446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56084783a460 con 0x56084783d950 2024-09-11T00:25:47.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.613+0000 7fe22ed9d640 1 --2- 172.21.15.78:0/1416591446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56084783d950 0x56084783f280 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fe228007780 tx=0x7fe228014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985c2b9b34f818a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:47.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.613+0000 7fe217fff640 1 -- 172.21.15.78:0/1416591446 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22801e050 con 0x56084783d950 2024-09-11T00:25:47.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.614+0000 7fe217fff640 1 -- 172.21.15.78:0/1416591446 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe228028070 con 0x56084783d950 2024-09-11T00:25:47.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.614+0000 7fe217fff640 1 -- 172.21.15.78:0/1416591446 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe228023e20 con 0x56084783d950 2024-09-11T00:25:47.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.614+0000 7fe2371de740 1 -- 172.21.15.78:0/1416591446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56084783d950 msgr2=0x56084783f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:47.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.614+0000 7fe2371de740 1 --2- 172.21.15.78:0/1416591446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56084783d950 0x56084783f280 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fe228007780 tx=0x7fe228014000 comp rx=0 tx=0).stop 2024-09-11T00:25:47.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.614+0000 7fe2371de740 1 -- 172.21.15.78:0/1416591446 shutdown_connections 2024-09-11T00:25:47.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.614+0000 7fe2371de740 1 --2- 172.21.15.78:0/1416591446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56084783d950 0x56084783f280 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.614+0000 7fe2371de740 1 --2- 172.21.15.78:0/1416591446 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608478319c0 0x56084783ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.614+0000 7fe2371de740 1 --2- 172.21.15.78:0/1416591446 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608478310a0 0x560847849830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.614+0000 7fe2371de740 1 -- 172.21.15.78:0/1416591446 >> 172.21.15.78:0/1416591446 conn(0x56084782eed0 msgr2=0x560847835960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:47.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.614+0000 7fe2371de740 1 -- 172.21.15.78:0/1416591446 shutdown_connections 2024-09-11T00:25:47.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.614+0000 7fe2371de740 1 -- 172.21.15.78:0/1416591446 wait complete. 2024-09-11T00:25:47.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.615+0000 7fe2371de740 1 -- start start 2024-09-11T00:25:47.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.615+0000 7fe2371de740 1 Processor -- start 2024-09-11T00:25:47.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.615+0000 7fe2371de740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608478310a0 0x5608478458a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:47.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.615+0000 7fe2371de740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608478319c0 0x560847845de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:47.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.615+0000 7fe2371de740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56084783d950 0x560847840850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:47.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.615+0000 7fe2371de740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe2301af730 con 0x56084783d950 2024-09-11T00:25:47.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.615+0000 7fe2371de740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe2301b0ba0 con 0x5608478319c0 2024-09-11T00:25:47.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.615+0000 7fe2371de740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe2301afe00 con 0x5608478310a0 2024-09-11T00:25:47.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.615+0000 7fe2371de740 10 client.0 _ll_register_callbacks cb 0x7fe218005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:25:47.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.615+0000 7fe22ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56084783d950 0x560847840850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:47.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.615+0000 7fe22ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56084783d950 0x560847840850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41026/0 (socket says 172.21.15.78:41026) 2024-09-11T00:25:47.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.615+0000 7fe22ed9d640 1 -- 172.21.15.78:0/2995919020 learned_addr learned my addr 172.21.15.78:0/2995919020 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:47.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.615+0000 7fe22e59c640 1 --2- 172.21.15.78:0/2995919020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608478310a0 0x5608478458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:47.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.615+0000 7fe22dd9b640 1 --2- 172.21.15.78:0/2995919020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608478319c0 0x560847845de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:47.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.615+0000 7fe22ed9d640 1 -- 172.21.15.78:0/2995919020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608478310a0 msgr2=0x5608478458a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:47.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.615+0000 7fe22ed9d640 1 --2- 172.21.15.78:0/2995919020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608478310a0 0x5608478458a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.615+0000 7fe22ed9d640 1 -- 172.21.15.78:0/2995919020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608478319c0 msgr2=0x560847845de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:47.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.615+0000 7fe22ed9d640 1 --2- 172.21.15.78:0/2995919020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608478319c0 0x560847845de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.615+0000 7fe22ed9d640 1 -- 172.21.15.78:0/2995919020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560847840d90 con 0x56084783d950 2024-09-11T00:25:47.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.616+0000 7fe22ed9d640 1 --2- 172.21.15.78:0/2995919020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56084783d950 0x560847840850 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fe22800a010 tx=0x7fe2280236b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c44a6e3ed72611 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:47.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.616+0000 7fe215ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:25:47.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.616+0000 7fe215ffb640 1 -- 172.21.15.78:0/2995919020 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2280363f0 con 0x56084783d950 2024-09-11T00:25:47.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.616+0000 7fe2371de740 1 -- 172.21.15.78:0/2995919020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe228028070 con 0x56084783d950 2024-09-11T00:25:47.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.616+0000 7fe215ffb640 1 -- 172.21.15.78:0/2995919020 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7fe22802c3f0 con 0x56084783d950 2024-09-11T00:25:47.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.616+0000 7fe215ffb640 1 -- 172.21.15.78:0/2995919020 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe22801e030 con 0x56084783d950 2024-09-11T00:25:47.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.616+0000 7fe2371de740 10 client.16623 fetch_fsmap learned FSMap version 20 2024-09-11T00:25:47.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.616+0000 7fe2371de740 1 -- 172.21.15.78:0/2995919020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5608478ba9c0 con 0x56084783d950 2024-09-11T00:25:47.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.616+0000 7fe215ffb640 1 -- 172.21.15.78:0/2995919020 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe228028070 con 0x56084783d950 2024-09-11T00:25:47.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.616+0000 7fe215ffb640 1 -- 172.21.15.78:0/2995919020 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fe22802cce0 con 0x56084783d950 2024-09-11T00:25:47.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.616+0000 7fe2371de740 10 client.16623 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:25:47.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.616+0000 7fe2371de740 10 client.16623 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:25:47.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.616+0000 7fe2371de740 20 client.16623 populate_metadata read hostname 'smithi078' 2024-09-11T00:25:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.616+0000 7fe2371de740 1 --2- 172.21.15.78:0/2995919020 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5608478bb1c0 0x5608478bd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.616+0000 7fe2371de740 4 client.16623 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:25:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.616+0000 7fe2371de740 1 -- 172.21.15.78:0/2995919020 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5608477a5850 con 0x5608478bb1c0 2024-09-11T00:25:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.617+0000 7fe22e59c640 1 --2- 172.21.15.78:0/2995919020 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5608478bb1c0 0x5608478bd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.617+0000 7fe215ffb640 10 client.16623 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.617+0000 7fe22e59c640 1 --2- 172.21.15.78:0/2995919020 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5608478bb1c0 0x5608478bd5e0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2db1751684370e2c server_cookie=855d6fec5d4a728f in_seq=0 out_seq=0 2024-09-11T00:25:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.617+0000 7fe215ffb640 1 -- 172.21.15.78:0/2995919020 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5202 (crc 0 0 0) 0x5608477a5850 con 0x5608478bb1c0 2024-09-11T00:25:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.617+0000 7fe215ffb640 10 client.16623 handle_command_reply: tid=0 2024-09-11T00:25:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.617+0000 7fe2371de740 1 client.16623 shutdown 2024-09-11T00:25:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.617+0000 7fe2371de740 1 -- 172.21.15.78:0/2995919020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56084783d950 msgr2=0x560847840850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.617+0000 7fe2371de740 1 --2- 172.21.15.78:0/2995919020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56084783d950 0x560847840850 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fe22800a010 tx=0x7fe2280236b0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.617+0000 7fe2371de740 1 -- 172.21.15.78:0/2995919020 shutdown_connections 2024-09-11T00:25:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.617+0000 7fe2371de740 1 --2- 172.21.15.78:0/2995919020 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5608478bb1c0 0x5608478bd5e0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.617+0000 7fe2371de740 1 --2- 172.21.15.78:0/2995919020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56084783d950 0x560847840850 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.617+0000 7fe2371de740 1 --2- 172.21.15.78:0/2995919020 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608478319c0 0x560847845de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.617+0000 7fe2371de740 1 --2- 172.21.15.78:0/2995919020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608478310a0 0x5608478458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.617+0000 7fe215ffb640 0 client.16623 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.617+0000 7fe2371de740 1 -- 172.21.15.78:0/2995919020 >> 172.21.15.78:0/2995919020 conn(0x56084782eed0 msgr2=0x56084783bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.617+0000 7fe2371de740 1 -- 172.21.15.78:0/2995919020 shutdown_connections 2024-09-11T00:25:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.618+0000 7fe2371de740 1 -- 172.21.15.78:0/2995919020 wait complete. 2024-09-11T00:25:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.618+0000 7fe2371de740 20 client.16623 trim_cache size 0 max 16384 2024-09-11T00:25:47.630 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:25:47.630 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-11T00:25:47.630 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {}, 2024-09-11T00:25:47.630 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:25:47.630 INFO:teuthology.orchestra.run.smithi078.stdout: "d570d2aa-a4ac-43b2-b13a-66aa0f566bb6": { 2024-09-11T00:25:47.630 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:25:46.078268+0000", 2024-09-11T00:25:47.630 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:47.630 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:47.630 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:47.630 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:47.630 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:47.631 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:47.631 INFO:teuthology.orchestra.run.smithi078.stdout: "f6eb5d15-216e-4f8b-b451-2f71b931998f": { 2024-09-11T00:25:47.631 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:48.289319+0000", 2024-09-11T00:25:47.631 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:47.631 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:47.631 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:47.631 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:47.631 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:47.631 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:47.631 INFO:teuthology.orchestra.run.smithi078.stdout: "e21db329-a274-4cfd-924a-8ec929e04bd1": { 2024-09-11T00:25:47.631 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:41.131504+0000", 2024-09-11T00:25:47.631 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:47.632 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:47.632 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:47.632 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:47.632 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:47.632 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:47.632 INFO:teuthology.orchestra.run.smithi078.stdout: "b854cbd3-8ca7-4277-a205-8887d2ff5567": { 2024-09-11T00:25:47.632 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:11.182949+0000", 2024-09-11T00:25:47.632 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:47.632 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:47.632 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:47.632 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:47.632 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:47.633 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:47.633 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:25:47.633 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:25:47.633 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:47.633 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:47.633 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:47.633 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:47.633 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:47.633 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:47.633 INFO:teuthology.orchestra.run.smithi078.stdout: "59d341c2-815c-48b1-a216-aa6fac6078a0": { 2024-09-11T00:25:47.633 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:25:06.855284+0000", 2024-09-11T00:25:47.633 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:47.633 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:47.634 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:47.634 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:47.634 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:47.634 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:47.634 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:25:47.634 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:25:47.634 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:47.634 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:47.634 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:47.634 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:47.634 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:47.634 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:47.634 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:25:47.635 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:25:47.635 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:47.635 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:47.635 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:47.635 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:47.635 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:47.635 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:47.635 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:25:47.635 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:25:47.635 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:47.635 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:47.635 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:47.636 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:47.636 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:47.636 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:47.636 INFO:teuthology.orchestra.run.smithi078.stdout: "81d31d3a-c224-4ded-9f00-1a7dfc099ec4": { 2024-09-11T00:25:47.636 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:16.296700+0000", 2024-09-11T00:25:47.636 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:47.636 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:47.636 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:47.636 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:47.636 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:47.636 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:47.636 INFO:teuthology.orchestra.run.smithi078.stdout: "1c04b4f1-c4c4-4289-b172-fba45b64018a": { 2024-09-11T00:25:47.636 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:24:27.591301+0000", 2024-09-11T00:25:47.637 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:47.637 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:47.637 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:47.637 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:47.637 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:47.637 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:47.637 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:25:47.637 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:25:47.637 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:47.637 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:47.637 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:47.637 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:47.637 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:47.638 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:47.638 INFO:teuthology.orchestra.run.smithi078.stdout: "38a1d30d-5f4c-460a-afcd-e6c60b97e43a": { 2024-09-11T00:25:47.638 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:58.127727+0000", 2024-09-11T00:25:47.638 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:47.638 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:47.638 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:47.638 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:47.638 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:47.638 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:47.638 INFO:teuthology.orchestra.run.smithi078.stdout: "8ec9e858-aa62-420d-a112-e62ea7810e63": { 2024-09-11T00:25:47.638 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:18.882749+0000", 2024-09-11T00:25:47.638 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:47.639 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:47.639 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:47.639 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:47.639 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:47.639 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:47.639 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:25:47.639 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:25:47.639 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:47.639 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:47.639 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:47.639 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:47.639 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:47.639 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:47.640 INFO:teuthology.orchestra.run.smithi078.stdout: "1b9391c2-08f3-479a-9538-deea28f7743b": { 2024-09-11T00:25:47.640 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:02.327508+0000", 2024-09-11T00:25:47.640 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:47.640 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:47.640 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:47.640 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:47.640 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:47.640 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:47.640 INFO:teuthology.orchestra.run.smithi078.stdout: "e0002672-e432-4890-ab9f-20c513c5e3b6": { 2024-09-11T00:25:47.640 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:21:37.161715+0000", 2024-09-11T00:25:47.640 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:47.640 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:47.641 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:47.641 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:47.641 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:47.641 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:47.641 INFO:teuthology.orchestra.run.smithi078.stdout: "f494d5ed-e0dc-44bb-8aba-a861b3e751f4": { 2024-09-11T00:25:47.641 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:55.251691+0000", 2024-09-11T00:25:47.641 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:47.641 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:47.641 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:47.641 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:47.641 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:47.641 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:25:47.641 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:25:47.642 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:25:47.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.618+0000 7fe234e09640 1 -- 172.21.15.78:0/897168962 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe21c0b54d0 msgr2=0x7fe21c0b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:47.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.618+0000 7fe234e09640 1 --2- 172.21.15.78:0/897168962 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe21c0b54d0 0x7fe21c0b7990 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe2301113f0 tx=0x7fe22800e040 comp rx=0 tx=0).stop 2024-09-11T00:25:47.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.618+0000 7fe234e09640 1 -- 172.21.15.78:0/897168962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2301076a0 msgr2=0x7fe23010f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:47.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.618+0000 7fe234e09640 1 --2- 172.21.15.78:0/897168962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2301076a0 0x7fe23010f870 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe218006010 tx=0x7fe2180042f0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.618+0000 7fe234e09640 1 -- 172.21.15.78:0/897168962 shutdown_connections 2024-09-11T00:25:47.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.618+0000 7fe234e09640 1 --2- 172.21.15.78:0/897168962 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fe21c0b54d0 0x7fe21c0b7990 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.618+0000 7fe234e09640 1 --2- 172.21.15.78:0/897168962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe230108020 0x7fe23010fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.618+0000 7fe234e09640 1 --2- 172.21.15.78:0/897168962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2301076a0 0x7fe23010f870 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.618+0000 7fe234e09640 1 --2- 172.21.15.78:0/897168962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe230101c90 0x7fe23010f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:47.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.618+0000 7fe234e09640 1 -- 172.21.15.78:0/897168962 >> 172.21.15.78:0/897168962 conn(0x7fe2300fd700 msgr2=0x7fe2300ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:47.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.618+0000 7fe234e09640 1 -- 172.21.15.78:0/897168962 shutdown_connections 2024-09-11T00:25:47.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:47.618+0000 7fe234e09640 1 -- 172.21.15.78:0/897168962 wait complete. 2024-09-11T00:25:48.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:47 smithi112 ceph-mon[35627]: pgmap v609: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:48.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:47 smithi138 ceph-mon[35019]: pgmap v609: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:48.317 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:47 smithi078 ceph-mon[30865]: pgmap v609: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:48.346 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:25:48.346 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:25:48.591 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:25:49.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.099+0000 7f261515d640 1 -- 172.21.15.78:0/140757230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2610102dc0 msgr2=0x7f26101031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:49.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.099+0000 7f261515d640 1 --2- 172.21.15.78:0/140757230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2610102dc0 0x7f26101031a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f25f8009900 tx=0x7f25f802a3f0 comp rx=0 tx=0).stop 2024-09-11T00:25:49.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.099+0000 7f261515d640 1 -- 172.21.15.78:0/140757230 shutdown_connections 2024-09-11T00:25:49.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.099+0000 7f261515d640 1 --2- 172.21.15.78:0/140757230 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2610109150 0x7f261010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:49.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.099+0000 7f261515d640 1 --2- 172.21.15.78:0/140757230 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26101087d0 0x7f2610108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:49.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.099+0000 7f261515d640 1 --2- 172.21.15.78:0/140757230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2610102dc0 0x7f26101031a0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:49.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.099+0000 7f261515d640 1 -- 172.21.15.78:0/140757230 >> 172.21.15.78:0/140757230 conn(0x7f26100fe830 msgr2=0x7f2610100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:49.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.099+0000 7f261515d640 1 -- 172.21.15.78:0/140757230 shutdown_connections 2024-09-11T00:25:49.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.099+0000 7f261515d640 1 -- 172.21.15.78:0/140757230 wait complete. 2024-09-11T00:25:49.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.099+0000 7f261515d640 1 Processor -- start 2024-09-11T00:25:49.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.100+0000 7f261515d640 1 -- start start 2024-09-11T00:25:49.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.100+0000 7f261515d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2610102dc0 0x7f2610199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:49.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.100+0000 7f261515d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26101087d0 0x7f2610199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.100+0000 7f261515d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2610109150 0x7f261019ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.100+0000 7f261515d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2610112e50 con 0x7f2610102dc0 2024-09-11T00:25:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.100+0000 7f261515d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2610112cd0 con 0x7f26101087d0 2024-09-11T00:25:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.100+0000 7f261515d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2610112fd0 con 0x7f2610109150 2024-09-11T00:25:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.100+0000 7f260ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2610102dc0 0x7f2610199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.100+0000 7f260ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2610102dc0 0x7f2610199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41046/0 (socket says 172.21.15.78:41046) 2024-09-11T00:25:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.100+0000 7f260ed9d640 1 -- 172.21.15.78:0/1389239865 learned_addr learned my addr 172.21.15.78:0/1389239865 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.100+0000 7f260e59c640 1 --2- 172.21.15.78:0/1389239865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26101087d0 0x7f2610199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.100+0000 7f260f59e640 1 --2- 172.21.15.78:0/1389239865 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2610109150 0x7f261019ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.100+0000 7f260ed9d640 1 -- 172.21.15.78:0/1389239865 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2610109150 msgr2=0x7f261019ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.100+0000 7f260ed9d640 1 --2- 172.21.15.78:0/1389239865 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2610109150 0x7f261019ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.100+0000 7f260ed9d640 1 -- 172.21.15.78:0/1389239865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26101087d0 msgr2=0x7f2610199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.100+0000 7f260ed9d640 1 --2- 172.21.15.78:0/1389239865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26101087d0 0x7f2610199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.100+0000 7f260ed9d640 1 -- 172.21.15.78:0/1389239865 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f261019f4f0 con 0x7f2610102dc0 2024-09-11T00:25:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.100+0000 7f260e59c640 1 --2- 172.21.15.78:0/1389239865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26101087d0 0x7f2610199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:25:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.100+0000 7f260ed9d640 1 --2- 172.21.15.78:0/1389239865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2610102dc0 0x7f2610199440 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f25f8006010 tx=0x7f25f80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.101+0000 7f2607fff640 1 -- 172.21.15.78:0/1389239865 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f803f030 con 0x7f2610102dc0 2024-09-11T00:25:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.101+0000 7f2607fff640 1 -- 172.21.15.78:0/1389239865 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25f8003800 con 0x7f2610102dc0 2024-09-11T00:25:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.101+0000 7f2607fff640 1 -- 172.21.15.78:0/1389239865 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f8035070 con 0x7f2610102dc0 2024-09-11T00:25:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.101+0000 7f261515d640 1 -- 172.21.15.78:0/1389239865 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f261019f780 con 0x7f2610102dc0 2024-09-11T00:25:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.101+0000 7f261515d640 1 -- 172.21.15.78:0/1389239865 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26101a5ea0 con 0x7f2610102dc0 2024-09-11T00:25:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.102+0000 7f261515d640 1 -- 172.21.15.78:0/1389239865 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2610103220 con 0x7f2610102dc0 2024-09-11T00:25:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.103+0000 7f2607fff640 1 -- 172.21.15.78:0/1389239865 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f25f8031b10 con 0x7f2610102dc0 2024-09-11T00:25:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.104+0000 7f2607fff640 1 --2- 172.21.15.78:0/1389239865 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f25fc0b5450 0x7f25fc0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.104+0000 7f260e59c640 1 --2- 172.21.15.78:0/1389239865 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f25fc0b5450 0x7f25fc0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.104+0000 7f2607fff640 1 -- 172.21.15.78:0/1389239865 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7f25f8106c70 con 0x7f2610102dc0 2024-09-11T00:25:49.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.104+0000 7f260e59c640 1 --2- 172.21.15.78:0/1389239865 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f25fc0b5450 0x7f25fc0b7910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f26101082f0 tx=0x7f2600008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:49.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.107+0000 7f2607fff640 1 -- 172.21.15.78:0/1389239865 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f25f80cd7e0 con 0x7f2610102dc0 2024-09-11T00:25:49.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.318+0000 7f261515d640 1 -- 172.21.15.78:0/1389239865 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f261019a570 con 0x7f2610102dc0 2024-09-11T00:25:49.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.319+0000 7f2607fff640 1 -- 172.21.15.78:0/1389239865 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f261019a570 con 0x7f2610102dc0 2024-09-11T00:25:49.321 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:25:49.321 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:25:49.322 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:25:49.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.321+0000 7f261515d640 1 -- 172.21.15.78:0/1389239865 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f25fc0b5450 msgr2=0x7f25fc0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:49.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.321+0000 7f261515d640 1 --2- 172.21.15.78:0/1389239865 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f25fc0b5450 0x7f25fc0b7910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f26101082f0 tx=0x7f2600008040 comp rx=0 tx=0).stop 2024-09-11T00:25:49.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.321+0000 7f261515d640 1 -- 172.21.15.78:0/1389239865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2610102dc0 msgr2=0x7f2610199440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:49.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.321+0000 7f261515d640 1 --2- 172.21.15.78:0/1389239865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2610102dc0 0x7f2610199440 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f25f8006010 tx=0x7f25f80042f0 comp rx=0 tx=0).stop 2024-09-11T00:25:49.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.321+0000 7f261515d640 1 -- 172.21.15.78:0/1389239865 shutdown_connections 2024-09-11T00:25:49.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.321+0000 7f261515d640 1 --2- 172.21.15.78:0/1389239865 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f25fc0b5450 0x7f25fc0b7910 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:49.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.321+0000 7f261515d640 1 --2- 172.21.15.78:0/1389239865 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2610109150 0x7f261019ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:49.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.321+0000 7f261515d640 1 --2- 172.21.15.78:0/1389239865 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26101087d0 0x7f2610199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:49.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.321+0000 7f261515d640 1 --2- 172.21.15.78:0/1389239865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2610102dc0 0x7f2610199440 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:49.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.321+0000 7f261515d640 1 -- 172.21.15.78:0/1389239865 >> 172.21.15.78:0/1389239865 conn(0x7f26100fe830 msgr2=0x7f2610100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:49.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.321+0000 7f261515d640 1 -- 172.21.15.78:0/1389239865 shutdown_connections 2024-09-11T00:25:49.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:49.321+0000 7f261515d640 1 -- 172.21.15.78:0/1389239865 wait complete. 2024-09-11T00:25:49.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:49 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1389239865' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:25:49.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:49 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1389239865' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:25:49.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:49 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1389239865' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:25:50.021 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:25:50.274 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:25:50.688 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:50 smithi078 ceph-mon[30865]: pgmap v610: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:50.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:50 smithi112 ceph-mon[35627]: pgmap v610: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:50.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:50 smithi138 ceph-mon[35019]: pgmap v610: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:25:50.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.768+0000 7ff3b81c9640 1 -- 172.21.15.78:0/2043755133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3b01076b0 msgr2=0x7ff3b0107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:50.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.768+0000 7ff3b81c9640 1 --2- 172.21.15.78:0/2043755133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3b01076b0 0x7ff3b0107af0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009900 tx=0x7ff3a002a410 comp rx=0 tx=0).stop 2024-09-11T00:25:50.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.768+0000 7ff3b81c9640 1 -- 172.21.15.78:0/2043755133 shutdown_connections 2024-09-11T00:25:50.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.768+0000 7ff3b81c9640 1 --2- 172.21.15.78:0/2043755133 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3b0108030 0x7ff3b010e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.768+0000 7ff3b81c9640 1 --2- 172.21.15.78:0/2043755133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3b01076b0 0x7ff3b0107af0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.768+0000 7ff3b81c9640 1 --2- 172.21.15.78:0/2043755133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3b0101ca0 0x7ff3b0102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.768+0000 7ff3b81c9640 1 -- 172.21.15.78:0/2043755133 >> 172.21.15.78:0/2043755133 conn(0x7ff3b00fd6f0 msgr2=0x7ff3b00ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:50.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.768+0000 7ff3b81c9640 1 -- 172.21.15.78:0/2043755133 shutdown_connections 2024-09-11T00:25:50.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.768+0000 7ff3b81c9640 1 -- 172.21.15.78:0/2043755133 wait complete. 2024-09-11T00:25:50.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3b81c9640 1 Processor -- start 2024-09-11T00:25:50.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3b81c9640 1 -- start start 2024-09-11T00:25:50.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3b81c9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3b0101ca0 0x7ff3b00fdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:50.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3b81c9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3b01076b0 0x7ff3b00fe130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:50.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3b81c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3b0108030 0x7ff3b00fe670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:50.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3b81c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b0111d30 con 0x7ff3b0108030 2024-09-11T00:25:50.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3b81c9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b0111bb0 con 0x7ff3b0101ca0 2024-09-11T00:25:50.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3b81c9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b0111eb0 con 0x7ff3b01076b0 2024-09-11T00:25:50.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3b6766640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3b0108030 0x7ff3b00fe670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:50.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3b6766640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3b0108030 0x7ff3b00fe670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41070/0 (socket says 172.21.15.78:41070) 2024-09-11T00:25:50.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3b6766640 1 -- 172.21.15.78:0/434145537 learned_addr learned my addr 172.21.15.78:0/434145537 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:50.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3b5f65640 1 --2- 172.21.15.78:0/434145537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3b0101ca0 0x7ff3b00fdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:50.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3b5764640 1 --2- 172.21.15.78:0/434145537 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3b01076b0 0x7ff3b00fe130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:50.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3b6766640 1 -- 172.21.15.78:0/434145537 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3b01076b0 msgr2=0x7ff3b00fe130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:50.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3b6766640 1 --2- 172.21.15.78:0/434145537 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3b01076b0 0x7ff3b00fe130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3b6766640 1 -- 172.21.15.78:0/434145537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3b0101ca0 msgr2=0x7ff3b00fdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:50.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3b6766640 1 --2- 172.21.15.78:0/434145537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3b0101ca0 0x7ff3b00fdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3b6766640 1 -- 172.21.15.78:0/434145537 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b01a78b0 con 0x7ff3b0108030 2024-09-11T00:25:50.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3b5f65640 1 --2- 172.21.15.78:0/434145537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3b0101ca0 0x7ff3b00fdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:25:50.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3b5764640 1 --2- 172.21.15.78:0/434145537 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3b01076b0 0x7ff3b00fe130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:25:50.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3b6766640 1 --2- 172.21.15.78:0/434145537 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3b0108030 0x7ff3b00fe670 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff3a800b970 tx=0x7ff3a800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:50.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3a6ffd640 1 -- 172.21.15.78:0/434145537 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a8019070 con 0x7ff3b0108030 2024-09-11T00:25:50.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.769+0000 7ff3a6ffd640 1 -- 172.21.15.78:0/434145537 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3a8014440 con 0x7ff3b0108030 2024-09-11T00:25:50.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.770+0000 7ff3b81c9640 1 -- 172.21.15.78:0/434145537 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3b01a7ba0 con 0x7ff3b0108030 2024-09-11T00:25:50.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.770+0000 7ff3a6ffd640 1 -- 172.21.15.78:0/434145537 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a80075d0 con 0x7ff3b0108030 2024-09-11T00:25:50.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.770+0000 7ff3b81c9640 1 -- 172.21.15.78:0/434145537 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3b01a8090 con 0x7ff3b0108030 2024-09-11T00:25:50.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.772+0000 7ff3a6ffd640 1 -- 172.21.15.78:0/434145537 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7ff3a800cb40 con 0x7ff3b0108030 2024-09-11T00:25:50.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.772+0000 7ff3ba59e740 1 Processor -- start 2024-09-11T00:25:50.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.772+0000 7ff3ba59e740 1 -- start start 2024-09-11T00:25:50.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.773+0000 7ff3ba59e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564644adc4d0 0x564644adc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:50.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.773+0000 7ff3ba59e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564644adcdf0 0x564644ae8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:50.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.773+0000 7ff3ba59e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644aeb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:50.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.773+0000 7ff3ba59e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x564644a52ea0 con 0x564644ae8d80 2024-09-11T00:25:50.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.773+0000 7ff3ba59e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x564644a422d0 con 0x564644adcdf0 2024-09-11T00:25:50.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.773+0000 7ff3ba59e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564644a460e0 con 0x564644adc4d0 2024-09-11T00:25:50.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.773+0000 7ff3a6ffd640 1 --2- 172.21.15.78:0/434145537 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff39c0b5450 0x7ff39c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:50.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.773+0000 7ff3b5764640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644aeb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:50.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.773+0000 7ff3b5764640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644aeb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41074/0 (socket says 172.21.15.78:41074) 2024-09-11T00:25:50.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.773+0000 7ff3b5764640 1 -- 172.21.15.78:0/932150895 learned_addr learned my addr 172.21.15.78:0/932150895 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:50.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.773+0000 7ff3b6766640 1 --2- 172.21.15.78:0/434145537 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff39c0b5450 0x7ff39c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:50.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.773+0000 7ff3b5f65640 1 --2- 172.21.15.78:0/932150895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564644adcdf0 0x564644ae8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:50.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.773+0000 7ff3b5764640 1 --2- 172.21.15.78:0/932150895 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564644adc4d0 0x564644adc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:50.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.773+0000 7ff3a6ffd640 1 -- 172.21.15.78:0/434145537 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7ff3a80e5840 con 0x7ff3b0108030 2024-09-11T00:25:50.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.773+0000 7ff3b5764640 1 -- 172.21.15.78:0/932150895 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564644adc4d0 msgr2=0x564644adc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:50.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.773+0000 7ff3b5764640 1 --2- 172.21.15.78:0/932150895 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564644adc4d0 0x564644adc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.773+0000 7ff3b5764640 1 -- 172.21.15.78:0/932150895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564644adcdf0 msgr2=0x564644ae8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:50.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.773+0000 7ff3b5764640 1 --2- 172.21.15.78:0/932150895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564644adcdf0 0x564644ae8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.773+0000 7ff3b5764640 1 -- 172.21.15.78:0/932150895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646447a0650 con 0x564644ae8d80 2024-09-11T00:25:50.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.773+0000 7ff3b5f65640 1 --2- 172.21.15.78:0/932150895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564644adcdf0 0x564644ae8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:25:50.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.773+0000 7ff3b5764640 1 --2- 172.21.15.78:0/932150895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644aeb170 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0032fd0 tx=0x7ff3a0031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e26d17874a4c35 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:50.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.773+0000 7ff3b6766640 1 --2- 172.21.15.78:0/434145537 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff39c0b5450 0x7ff39c0b7910 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff3a80abc40 tx=0x7ff3a80dc120 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:50.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.774+0000 7ff39bfff640 1 -- 172.21.15.78:0/932150895 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0045070 con 0x564644ae8d80 2024-09-11T00:25:50.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.774+0000 7ff39bfff640 1 -- 172.21.15.78:0/932150895 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3a0031850 con 0x564644ae8d80 2024-09-11T00:25:50.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.774+0000 7ff39bfff640 1 -- 172.21.15.78:0/932150895 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0035040 con 0x564644ae8d80 2024-09-11T00:25:50.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.774+0000 7ff3ba59e740 1 -- 172.21.15.78:0/932150895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 msgr2=0x564644aeb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:50.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.774+0000 7ff3ba59e740 1 --2- 172.21.15.78:0/932150895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644aeb170 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0032fd0 tx=0x7ff3a0031400 comp rx=0 tx=0).stop 2024-09-11T00:25:50.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.774+0000 7ff3ba59e740 1 -- 172.21.15.78:0/932150895 shutdown_connections 2024-09-11T00:25:50.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.774+0000 7ff3ba59e740 1 --2- 172.21.15.78:0/932150895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644aeb170 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.774+0000 7ff3ba59e740 1 --2- 172.21.15.78:0/932150895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564644adcdf0 0x564644ae8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.774+0000 7ff3ba59e740 1 --2- 172.21.15.78:0/932150895 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564644adc4d0 0x564644adc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.774+0000 7ff3ba59e740 1 -- 172.21.15.78:0/932150895 >> 172.21.15.78:0/932150895 conn(0x564644ada300 msgr2=0x564644adb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:50.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.774+0000 7ff3ba59e740 1 -- 172.21.15.78:0/932150895 shutdown_connections 2024-09-11T00:25:50.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.774+0000 7ff3ba59e740 1 -- 172.21.15.78:0/932150895 wait complete. 2024-09-11T00:25:50.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.775+0000 7ff3ba59e740 1 -- start start 2024-09-11T00:25:50.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.775+0000 7ff3ba59e740 1 Processor -- start 2024-09-11T00:25:50.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.775+0000 7ff3ba59e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564644adc4d0 0x564644ae86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:50.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.775+0000 7ff3ba59e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564644adcdf0 0x564644ae5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:50.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.775+0000 7ff3ba59e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644ae61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:50.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.775+0000 7ff3ba59e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5646448a3700 con 0x564644ae8d80 2024-09-11T00:25:50.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.775+0000 7ff3ba59e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5646449dd160 con 0x564644adc4d0 2024-09-11T00:25:50.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.775+0000 7ff3ba59e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564644aeb9a0 con 0x564644adcdf0 2024-09-11T00:25:50.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.775+0000 7ff3ba59e740 10 client.0 _ll_register_callbacks cb 0x5646449f69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:25:50.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.775+0000 7ff3b5764640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644ae61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:50.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.775+0000 7ff3b5764640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644ae61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41084/0 (socket says 172.21.15.78:41084) 2024-09-11T00:25:50.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.775+0000 7ff3b5764640 1 -- 172.21.15.78:0/2394222107 learned_addr learned my addr 172.21.15.78:0/2394222107 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:50.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.776+0000 7ff3b5f65640 1 --2- 172.21.15.78:0/2394222107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564644adcdf0 0x564644ae5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:50.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.776+0000 7ff3b5764640 1 --2- 172.21.15.78:0/2394222107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564644adc4d0 0x564644ae86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:50.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.776+0000 7ff3b5764640 1 -- 172.21.15.78:0/2394222107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564644adcdf0 msgr2=0x564644ae5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:50.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.776+0000 7ff3b5764640 1 --2- 172.21.15.78:0/2394222107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564644adcdf0 0x564644ae5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.776+0000 7ff3b5764640 1 -- 172.21.15.78:0/2394222107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564644adc4d0 msgr2=0x564644ae86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:50.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.776+0000 7ff3b5764640 1 --2- 172.21.15.78:0/2394222107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564644adc4d0 0x564644ae86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.776+0000 7ff3b5764640 1 -- 172.21.15.78:0/2394222107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564644a0ac90 con 0x564644ae8d80 2024-09-11T00:25:50.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.776+0000 7ff3b5f65640 1 --2- 172.21.15.78:0/2394222107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564644adcdf0 0x564644ae5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:25:50.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.776+0000 7ff3b5764640 1 --2- 172.21.15.78:0/2394222107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644ae61c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0005ec0 tx=0x7ff3a0005680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce9bba5469607e58 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:50.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.776+0000 7ff3997fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:25:50.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.776+0000 7ff3997fa640 1 -- 172.21.15.78:0/2394222107 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0045070 con 0x564644ae8d80 2024-09-11T00:25:50.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.776+0000 7ff3997fa640 1 -- 172.21.15.78:0/2394222107 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7ff3a0003800 con 0x564644ae8d80 2024-09-11T00:25:50.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.776+0000 7ff3ba59e740 1 -- 172.21.15.78:0/2394222107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3a0031850 con 0x564644ae8d80 2024-09-11T00:25:50.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.776+0000 7ff3997fa640 1 -- 172.21.15.78:0/2394222107 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff3a0003a00 con 0x564644ae8d80 2024-09-11T00:25:50.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.776+0000 7ff3ba59e740 10 client.16641 fetch_fsmap learned FSMap version 20 2024-09-11T00:25:50.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.776+0000 7ff3ba59e740 1 -- 172.21.15.78:0/2394222107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564644af73b0 con 0x564644ae8d80 2024-09-11T00:25:50.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.776+0000 7ff3997fa640 1 -- 172.21.15.78:0/2394222107 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3a0031850 con 0x564644ae8d80 2024-09-11T00:25:50.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.777+0000 7ff3997fa640 1 -- 172.21.15.78:0/2394222107 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff3a003a070 con 0x564644ae8d80 2024-09-11T00:25:50.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.777+0000 7ff3ba59e740 10 client.16641 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:25:50.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.777+0000 7ff3ba59e740 10 client.16641 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:25:50.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.777+0000 7ff3ba59e740 20 client.16641 populate_metadata read hostname 'smithi078' 2024-09-11T00:25:50.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.777+0000 7ff3ba59e740 1 --2- 172.21.15.78:0/2394222107 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564644af8700 0x564644afaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:50.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.777+0000 7ff3ba59e740 4 client.16641 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:25:50.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.777+0000 7ff3ba59e740 1 -- 172.21.15.78:0/2394222107 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564644a54df0 con 0x564644af8700 2024-09-11T00:25:50.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.777+0000 7ff3b5f65640 1 --2- 172.21.15.78:0/2394222107 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564644af8700 0x564644afaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:50.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.777+0000 7ff3997fa640 10 client.16641 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:50.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.777+0000 7ff3b5f65640 1 --2- 172.21.15.78:0/2394222107 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564644af8700 0x564644afaaf0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f44c2c8618d13d75 server_cookie=4c62bfa31c9d2311 in_seq=0 out_seq=0 2024-09-11T00:25:50.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.778+0000 7ff3997fa640 1 -- 172.21.15.78:0/2394222107 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564644a54df0 con 0x564644af8700 2024-09-11T00:25:50.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.778+0000 7ff3997fa640 10 client.16641 handle_command_reply: tid=0 2024-09-11T00:25:50.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.778+0000 7ff3ba59e740 1 client.16641 shutdown 2024-09-11T00:25:50.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.778+0000 7ff3ba59e740 1 -- 172.21.15.78:0/2394222107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 msgr2=0x564644ae61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:50.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.778+0000 7ff3ba59e740 1 --2- 172.21.15.78:0/2394222107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644ae61c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0005ec0 tx=0x7ff3a0005680 comp rx=0 tx=0).stop 2024-09-11T00:25:50.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.778+0000 7ff3ba59e740 1 -- 172.21.15.78:0/2394222107 shutdown_connections 2024-09-11T00:25:50.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.778+0000 7ff3ba59e740 1 --2- 172.21.15.78:0/2394222107 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564644af8700 0x564644afaaf0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.778+0000 7ff3ba59e740 1 --2- 172.21.15.78:0/2394222107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644ae61c0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.778+0000 7ff3ba59e740 1 --2- 172.21.15.78:0/2394222107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564644adcdf0 0x564644ae5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.778+0000 7ff3ba59e740 1 --2- 172.21.15.78:0/2394222107 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564644adc4d0 0x564644ae86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.778+0000 7ff3997fa640 0 client.16641 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:50.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.778+0000 7ff3ba59e740 1 -- 172.21.15.78:0/2394222107 >> 172.21.15.78:0/2394222107 conn(0x564644ada300 msgr2=0x564644adfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:50.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.779+0000 7ff3ba59e740 1 -- 172.21.15.78:0/2394222107 shutdown_connections 2024-09-11T00:25:50.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.779+0000 7ff3ba59e740 1 -- 172.21.15.78:0/2394222107 wait complete. 2024-09-11T00:25:50.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.779+0000 7ff3ba59e740 20 client.16641 trim_cache size 0 max 16384 2024-09-11T00:25:50.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.791+0000 7ff3ba59e740 1 Processor -- start 2024-09-11T00:25:50.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.791+0000 7ff3ba59e740 1 -- start start 2024-09-11T00:25:50.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.792+0000 7ff3ba59e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564644adc4d0 0x564644ad9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:50.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.792+0000 7ff3ba59e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564644adcdf0 0x564644ae7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:50.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.792+0000 7ff3ba59e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644aea170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:50.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.792+0000 7ff3ba59e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b01aea40 con 0x564644ae8d80 2024-09-11T00:25:50.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.792+0000 7ff3ba59e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b01b12a0 con 0x564644adc4d0 2024-09-11T00:25:50.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.792+0000 7ff3ba59e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b01af090 con 0x564644adcdf0 2024-09-11T00:25:50.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.792+0000 7ff3b5764640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644aea170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:50.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.792+0000 7ff3b5764640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644aea170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41090/0 (socket says 172.21.15.78:41090) 2024-09-11T00:25:50.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.792+0000 7ff3b5764640 1 -- 172.21.15.78:0/2265585967 learned_addr learned my addr 172.21.15.78:0/2265585967 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:50.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.792+0000 7ff3b5764640 1 --2- 172.21.15.78:0/2265585967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564644adc4d0 0x564644ad9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:50.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.792+0000 7ff3b5f65640 1 --2- 172.21.15.78:0/2265585967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564644adcdf0 0x564644ae7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:50.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.792+0000 7ff3b5764640 1 -- 172.21.15.78:0/2265585967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564644adcdf0 msgr2=0x564644ae7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:50.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.792+0000 7ff3b5764640 1 --2- 172.21.15.78:0/2265585967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564644adcdf0 0x564644ae7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.792+0000 7ff3b5764640 1 -- 172.21.15.78:0/2265585967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564644adc4d0 msgr2=0x564644ad9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:50.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.792+0000 7ff3b5764640 1 --2- 172.21.15.78:0/2265585967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564644adc4d0 0x564644ad9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.792+0000 7ff3b5764640 1 -- 172.21.15.78:0/2265585967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564644adafe0 con 0x564644ae8d80 2024-09-11T00:25:50.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.792+0000 7ff3b5764640 1 --2- 172.21.15.78:0/2265585967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644aea170 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0005650 tx=0x7ff3a002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bafee1c07b59355 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:50.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.792+0000 7ff39b7fe640 1 -- 172.21.15.78:0/2265585967 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0035030 con 0x564644ae8d80 2024-09-11T00:25:50.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.792+0000 7ff39b7fe640 1 -- 172.21.15.78:0/2265585967 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3a0003ba0 con 0x564644ae8d80 2024-09-11T00:25:50.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.792+0000 7ff39b7fe640 1 -- 172.21.15.78:0/2265585967 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0045070 con 0x564644ae8d80 2024-09-11T00:25:50.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.793+0000 7ff3ba59e740 1 -- 172.21.15.78:0/2265585967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 msgr2=0x564644aea170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:50.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.793+0000 7ff3ba59e740 1 --2- 172.21.15.78:0/2265585967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644aea170 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0005650 tx=0x7ff3a002a410 comp rx=0 tx=0).stop 2024-09-11T00:25:50.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.793+0000 7ff3ba59e740 1 -- 172.21.15.78:0/2265585967 shutdown_connections 2024-09-11T00:25:50.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.793+0000 7ff3ba59e740 1 --2- 172.21.15.78:0/2265585967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644aea170 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.793+0000 7ff3ba59e740 1 --2- 172.21.15.78:0/2265585967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564644adcdf0 0x564644ae7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.793+0000 7ff3ba59e740 1 --2- 172.21.15.78:0/2265585967 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564644adc4d0 0x564644ad9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.793+0000 7ff3ba59e740 1 -- 172.21.15.78:0/2265585967 >> 172.21.15.78:0/2265585967 conn(0x564644ada300 msgr2=0x564644ae7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:50.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.793+0000 7ff3ba59e740 1 -- 172.21.15.78:0/2265585967 shutdown_connections 2024-09-11T00:25:50.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.793+0000 7ff3ba59e740 1 -- 172.21.15.78:0/2265585967 wait complete. 2024-09-11T00:25:50.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.793+0000 7ff3ba59e740 1 -- start start 2024-09-11T00:25:50.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.793+0000 7ff3ba59e740 1 Processor -- start 2024-09-11T00:25:50.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.794+0000 7ff3ba59e740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564644adc4d0 0x564644af9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:50.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.794+0000 7ff3ba59e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564644adcdf0 0x564644afa270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:50.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.794+0000 7ff3ba59e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644b64260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:50.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.794+0000 7ff3ba59e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b01af760 con 0x564644ae8d80 2024-09-11T00:25:50.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.794+0000 7ff3ba59e740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b01b0bd0 con 0x564644adc4d0 2024-09-11T00:25:50.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.794+0000 7ff3ba59e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b01afe30 con 0x564644adcdf0 2024-09-11T00:25:50.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.794+0000 7ff3ba59e740 10 client.0 _ll_register_callbacks cb 0x7ff3a0043070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:25:50.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.794+0000 7ff3b5764640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644b64260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:50.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.794+0000 7ff3b5764640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644b64260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41094/0 (socket says 172.21.15.78:41094) 2024-09-11T00:25:50.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.794+0000 7ff3b5764640 1 -- 172.21.15.78:0/2146469393 learned_addr learned my addr 172.21.15.78:0/2146469393 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:50.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.794+0000 7ff3b5f65640 1 --2- 172.21.15.78:0/2146469393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564644adcdf0 0x564644afa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:50.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.794+0000 7ff3b5764640 1 --2- 172.21.15.78:0/2146469393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564644adc4d0 0x564644af9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:50.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.794+0000 7ff3b5764640 1 -- 172.21.15.78:0/2146469393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564644adcdf0 msgr2=0x564644afa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:50.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.794+0000 7ff3b5764640 1 --2- 172.21.15.78:0/2146469393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564644adcdf0 0x564644afa270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.794+0000 7ff3b5764640 1 -- 172.21.15.78:0/2146469393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564644adc4d0 msgr2=0x564644af9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:50.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.794+0000 7ff3b5764640 1 --2- 172.21.15.78:0/2146469393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564644adc4d0 0x564644af9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.794+0000 7ff3b5764640 1 -- 172.21.15.78:0/2146469393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564644afab00 con 0x564644ae8d80 2024-09-11T00:25:50.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.794+0000 7ff3b5f65640 1 --2- 172.21.15.78:0/2146469393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564644adcdf0 0x564644afa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:25:50.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.794+0000 7ff3b5764640 1 --2- 172.21.15.78:0/2146469393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644b64260 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0056ba0 tx=0x7ff3a0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0cae0a4ebb1287 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:50.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.794+0000 7ff3997fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:25:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.795+0000 7ff3997fa640 1 -- 172.21.15.78:0/2146469393 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0035070 con 0x564644ae8d80 2024-09-11T00:25:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.795+0000 7ff3997fa640 1 -- 172.21.15.78:0/2146469393 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7ff3a0056610 con 0x564644ae8d80 2024-09-11T00:25:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.795+0000 7ff3ba59e740 1 -- 172.21.15.78:0/2146469393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3a0003ba0 con 0x564644ae8d80 2024-09-11T00:25:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.795+0000 7ff3997fa640 1 -- 172.21.15.78:0/2146469393 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff3a0045070 con 0x564644ae8d80 2024-09-11T00:25:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.795+0000 7ff3ba59e740 10 client.16647 fetch_fsmap learned FSMap version 20 2024-09-11T00:25:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.795+0000 7ff3ba59e740 1 -- 172.21.15.78:0/2146469393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x564644b65870 con 0x564644ae8d80 2024-09-11T00:25:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.795+0000 7ff3997fa640 1 -- 172.21.15.78:0/2146469393 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3a0003ba0 con 0x564644ae8d80 2024-09-11T00:25:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.795+0000 7ff3997fa640 1 -- 172.21.15.78:0/2146469393 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7ff3a003a040 con 0x564644ae8d80 2024-09-11T00:25:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.795+0000 7ff3ba59e740 10 client.16647 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:25:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.795+0000 7ff3ba59e740 10 client.16647 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:25:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.795+0000 7ff3ba59e740 20 client.16647 populate_metadata read hostname 'smithi078' 2024-09-11T00:25:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.795+0000 7ff3ba59e740 1 --2- 172.21.15.78:0/2146469393 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564644b65ea0 0x564644b682c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.795+0000 7ff3ba59e740 4 client.16647 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:25:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.795+0000 7ff3ba59e740 1 -- 172.21.15.78:0/2146469393 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564644a508a0 con 0x564644b65ea0 2024-09-11T00:25:50.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.795+0000 7ff3b5f65640 1 --2- 172.21.15.78:0/2146469393 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564644b65ea0 0x564644b682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:50.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.796+0000 7ff3b5f65640 1 --2- 172.21.15.78:0/2146469393 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564644b65ea0 0x564644b682c0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62cfac72d5481e32 server_cookie=7121faea173a01ee in_seq=0 out_seq=0 2024-09-11T00:25:50.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.796+0000 7ff3997fa640 10 client.16647 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:50.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.796+0000 7ff3997fa640 1 -- 172.21.15.78:0/2146469393 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564644a508a0 con 0x564644b65ea0 2024-09-11T00:25:50.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.796+0000 7ff3997fa640 10 client.16647 handle_command_reply: tid=0 2024-09-11T00:25:50.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.796+0000 7ff3ba59e740 1 client.16647 shutdown 2024-09-11T00:25:50.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.796+0000 7ff3ba59e740 1 -- 172.21.15.78:0/2146469393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 msgr2=0x564644b64260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:50.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.796+0000 7ff3ba59e740 1 --2- 172.21.15.78:0/2146469393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644b64260 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0056ba0 tx=0x7ff3a0000bc0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.796+0000 7ff3ba59e740 1 -- 172.21.15.78:0/2146469393 shutdown_connections 2024-09-11T00:25:50.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.796+0000 7ff3ba59e740 1 --2- 172.21.15.78:0/2146469393 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x564644b65ea0 0x564644b682c0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.796+0000 7ff3ba59e740 1 --2- 172.21.15.78:0/2146469393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564644ae8d80 0x564644b64260 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.796+0000 7ff3997fa640 0 client.16647 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:50.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.796+0000 7ff3ba59e740 1 --2- 172.21.15.78:0/2146469393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564644adcdf0 0x564644afa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.796+0000 7ff3ba59e740 1 --2- 172.21.15.78:0/2146469393 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x564644adc4d0 0x564644af9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.796+0000 7ff3ba59e740 1 -- 172.21.15.78:0/2146469393 >> 172.21.15.78:0/2146469393 conn(0x564644ada300 msgr2=0x564644ae7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:50.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.797+0000 7ff3ba59e740 1 -- 172.21.15.78:0/2146469393 shutdown_connections 2024-09-11T00:25:50.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.797+0000 7ff3ba59e740 1 -- 172.21.15.78:0/2146469393 wait complete. 2024-09-11T00:25:50.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.797+0000 7ff3ba59e740 20 client.16647 trim_cache size 0 max 16384 2024-09-11T00:25:50.815 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-11T00:25:50.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.797+0000 7ff3b81c9640 1 -- 172.21.15.78:0/434145537 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff39c0b5450 msgr2=0x7ff39c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:50.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.797+0000 7ff3b81c9640 1 --2- 172.21.15.78:0/434145537 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff39c0b5450 0x7ff39c0b7910 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff3a80abc40 tx=0x7ff3a80dc120 comp rx=0 tx=0).stop 2024-09-11T00:25:50.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.797+0000 7ff3b81c9640 1 -- 172.21.15.78:0/434145537 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3b0108030 msgr2=0x7ff3b00fe670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:50.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.797+0000 7ff3b81c9640 1 --2- 172.21.15.78:0/434145537 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3b0108030 0x7ff3b00fe670 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff3a800b970 tx=0x7ff3a800be30 comp rx=0 tx=0).stop 2024-09-11T00:25:50.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.797+0000 7ff3b81c9640 1 -- 172.21.15.78:0/434145537 shutdown_connections 2024-09-11T00:25:50.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.797+0000 7ff3b81c9640 1 --2- 172.21.15.78:0/434145537 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff39c0b5450 0x7ff39c0b7910 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.797+0000 7ff3b81c9640 1 --2- 172.21.15.78:0/434145537 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3b0108030 0x7ff3b00fe670 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.797+0000 7ff3b81c9640 1 --2- 172.21.15.78:0/434145537 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3b01076b0 0x7ff3b00fe130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.797+0000 7ff3b81c9640 1 --2- 172.21.15.78:0/434145537 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3b0101ca0 0x7ff3b00fdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:50.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.797+0000 7ff3b81c9640 1 -- 172.21.15.78:0/434145537 >> 172.21.15.78:0/434145537 conn(0x7ff3b00fd6f0 msgr2=0x7ff3b006b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:50.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.797+0000 7ff3b81c9640 1 -- 172.21.15.78:0/434145537 shutdown_connections 2024-09-11T00:25:50.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:50.797+0000 7ff3b81c9640 1 -- 172.21.15.78:0/434145537 wait complete. 2024-09-11T00:25:52.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:51 smithi112 ceph-mon[35627]: pgmap v611: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:25:52.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:51 smithi138 ceph-mon[35019]: pgmap v611: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:25:52.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:51 smithi078 ceph-mon[30865]: pgmap v611: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-11T00:25:52.505 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T00:25:52.505 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T00:25:52.753 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:25:53.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.235+0000 7fd48ecc1640 1 -- 172.21.15.78:0/3268559743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4881087d0 msgr2=0x7fd488108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:53.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.235+0000 7fd48ecc1640 1 --2- 172.21.15.78:0/3268559743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4881087d0 0x7fd488108c10 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd478009900 tx=0x7fd47802a410 comp rx=0 tx=0).stop 2024-09-11T00:25:53.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.235+0000 7fd48ecc1640 1 -- 172.21.15.78:0/3268559743 shutdown_connections 2024-09-11T00:25:53.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.235+0000 7fd48ecc1640 1 --2- 172.21.15.78:0/3268559743 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd488109150 0x7fd48810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.235+0000 7fd48ecc1640 1 --2- 172.21.15.78:0/3268559743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4881087d0 0x7fd488108c10 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.235+0000 7fd48ecc1640 1 --2- 172.21.15.78:0/3268559743 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd488102dc0 0x7fd4881031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.235+0000 7fd48ecc1640 1 -- 172.21.15.78:0/3268559743 >> 172.21.15.78:0/3268559743 conn(0x7fd4880fe830 msgr2=0x7fd488100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:53.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.235+0000 7fd48ecc1640 1 -- 172.21.15.78:0/3268559743 shutdown_connections 2024-09-11T00:25:53.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.235+0000 7fd48ecc1640 1 -- 172.21.15.78:0/3268559743 wait complete. 2024-09-11T00:25:53.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.236+0000 7fd48ecc1640 1 Processor -- start 2024-09-11T00:25:53.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.236+0000 7fd48ecc1640 1 -- start start 2024-09-11T00:25:53.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.236+0000 7fd48ecc1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd488102dc0 0x7fd4881992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:53.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.236+0000 7fd48ecc1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4881087d0 0x7fd488199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:53.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.236+0000 7fd48ecc1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd488109150 0x7fd48819ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:53.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.236+0000 7fd48ecc1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd488112e10 con 0x7fd4881087d0 2024-09-11T00:25:53.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.236+0000 7fd48ecc1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd488112c90 con 0x7fd488102dc0 2024-09-11T00:25:53.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.236+0000 7fd48ecc1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd488112f90 con 0x7fd488109150 2024-09-11T00:25:53.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.236+0000 7fd47ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4881087d0 0x7fd488199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:53.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.236+0000 7fd47ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4881087d0 0x7fd488199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41102/0 (socket says 172.21.15.78:41102) 2024-09-11T00:25:53.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.237+0000 7fd47ffff640 1 -- 172.21.15.78:0/883842983 learned_addr learned my addr 172.21.15.78:0/883842983 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:53.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.237+0000 7fd48ca5d640 1 --2- 172.21.15.78:0/883842983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd488102dc0 0x7fd4881992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:53.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.237+0000 7fd48d25e640 1 --2- 172.21.15.78:0/883842983 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd488109150 0x7fd48819ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:53.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.237+0000 7fd47ffff640 1 -- 172.21.15.78:0/883842983 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd488109150 msgr2=0x7fd48819ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:53.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.237+0000 7fd47ffff640 1 --2- 172.21.15.78:0/883842983 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd488109150 0x7fd48819ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.237+0000 7fd47ffff640 1 -- 172.21.15.78:0/883842983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd488102dc0 msgr2=0x7fd4881992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:53.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.237+0000 7fd47ffff640 1 --2- 172.21.15.78:0/883842983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd488102dc0 0x7fd4881992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.237+0000 7fd47ffff640 1 -- 172.21.15.78:0/883842983 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48819f390 con 0x7fd4881087d0 2024-09-11T00:25:53.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.237+0000 7fd47ffff640 1 --2- 172.21.15.78:0/883842983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4881087d0 0x7fd488199820 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fd478006010 tx=0x7fd4780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:53.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.237+0000 7fd47dffb640 1 -- 172.21.15.78:0/883842983 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47803f030 con 0x7fd4881087d0 2024-09-11T00:25:53.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.237+0000 7fd47dffb640 1 -- 172.21.15.78:0/883842983 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd478003800 con 0x7fd4881087d0 2024-09-11T00:25:53.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.237+0000 7fd48ecc1640 1 -- 172.21.15.78:0/883842983 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd48819f620 con 0x7fd4881087d0 2024-09-11T00:25:53.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.237+0000 7fd47dffb640 1 -- 172.21.15.78:0/883842983 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd478035070 con 0x7fd4881087d0 2024-09-11T00:25:53.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.237+0000 7fd48ecc1640 1 -- 172.21.15.78:0/883842983 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4881a5d40 con 0x7fd4881087d0 2024-09-11T00:25:53.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.240+0000 7fd491096740 1 Processor -- start 2024-09-11T00:25:53.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.240+0000 7fd47dffb640 1 -- 172.21.15.78:0/883842983 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fd478031b10 con 0x7fd4881087d0 2024-09-11T00:25:53.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.240+0000 7fd491096740 1 -- start start 2024-09-11T00:25:53.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.240+0000 7fd491096740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558591645ee0 0x5585916462c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:53.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.240+0000 7fd491096740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591646800 0x558591652250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:53.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.240+0000 7fd491096740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558591652790 0x558591654b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:53.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.240+0000 7fd491096740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5585915bce60 con 0x558591646800 2024-09-11T00:25:53.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.240+0000 7fd491096740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5585915ac290 con 0x558591652790 2024-09-11T00:25:53.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.240+0000 7fd491096740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5585915b00a0 con 0x558591645ee0 2024-09-11T00:25:53.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.240+0000 7fd48ca5d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591646800 0x558591652250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:53.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.240+0000 7fd48ca5d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591646800 0x558591652250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41106/0 (socket says 172.21.15.78:41106) 2024-09-11T00:25:53.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.240+0000 7fd48ca5d640 1 -- 172.21.15.78:0/3856678921 learned_addr learned my addr 172.21.15.78:0/3856678921 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:53.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.241+0000 7fd48d25e640 1 --2- 172.21.15.78:0/3856678921 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558591645ee0 0x5585916462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:53.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.241+0000 7fd47ffff640 1 --2- 172.21.15.78:0/3856678921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558591652790 0x558591654b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:53.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.241+0000 7fd48ca5d640 1 -- 172.21.15.78:0/3856678921 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558591645ee0 msgr2=0x5585916462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:53.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.241+0000 7fd48ca5d640 1 --2- 172.21.15.78:0/3856678921 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558591645ee0 0x5585916462c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.241+0000 7fd48ca5d640 1 -- 172.21.15.78:0/3856678921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558591652790 msgr2=0x558591654b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:53.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.241+0000 7fd48ca5d640 1 --2- 172.21.15.78:0/3856678921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558591652790 0x558591654b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.241+0000 7fd48ca5d640 1 -- 172.21.15.78:0/3856678921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55859130a930 con 0x558591646800 2024-09-11T00:25:53.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.241+0000 7fd47dffb640 1 --2- 172.21.15.78:0/883842983 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd4700b5450 0x7fd4700b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:53.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.241+0000 7fd48ca5d640 1 --2- 172.21.15.78:0/3856678921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591646800 0x558591652250 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd48400ac50 tx=0x7fd48400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e9e7ae712cf5c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:53.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.241+0000 7fd48d25e640 1 --2- 172.21.15.78:0/883842983 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd4700b5450 0x7fd4700b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:53.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.241+0000 7fd47dffb640 1 -- 172.21.15.78:0/883842983 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7fd478106890 con 0x7fd4881087d0 2024-09-11T00:25:53.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.241+0000 7fd46effd640 1 -- 172.21.15.78:0/3856678921 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48401d070 con 0x558591646800 2024-09-11T00:25:53.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.241+0000 7fd46effd640 1 -- 172.21.15.78:0/3856678921 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd484018af0 con 0x558591646800 2024-09-11T00:25:53.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.241+0000 7fd46effd640 1 -- 172.21.15.78:0/3856678921 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484010b30 con 0x558591646800 2024-09-11T00:25:53.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.242+0000 7fd491096740 1 -- 172.21.15.78:0/3856678921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591646800 msgr2=0x558591652250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:53.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.242+0000 7fd48d25e640 1 --2- 172.21.15.78:0/883842983 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd4700b5450 0x7fd4700b7910 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd48000a510 tx=0x7fd48000d040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:53.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.242+0000 7fd491096740 1 --2- 172.21.15.78:0/3856678921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591646800 0x558591652250 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd48400ac50 tx=0x7fd48400f790 comp rx=0 tx=0).stop 2024-09-11T00:25:53.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.242+0000 7fd491096740 1 -- 172.21.15.78:0/3856678921 shutdown_connections 2024-09-11T00:25:53.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.242+0000 7fd491096740 1 --2- 172.21.15.78:0/3856678921 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558591652790 0x558591654b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.242+0000 7fd491096740 1 --2- 172.21.15.78:0/3856678921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591646800 0x558591652250 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.242+0000 7fd491096740 1 --2- 172.21.15.78:0/3856678921 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558591645ee0 0x5585916462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.242+0000 7fd491096740 1 -- 172.21.15.78:0/3856678921 >> 172.21.15.78:0/3856678921 conn(0x558591643d10 msgr2=0x558591644eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:53.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.242+0000 7fd491096740 1 -- 172.21.15.78:0/3856678921 shutdown_connections 2024-09-11T00:25:53.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.242+0000 7fd491096740 1 -- 172.21.15.78:0/3856678921 wait complete. 2024-09-11T00:25:53.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.242+0000 7fd491096740 1 -- start start 2024-09-11T00:25:53.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.242+0000 7fd491096740 1 Processor -- start 2024-09-11T00:25:53.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.243+0000 7fd491096740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558591645ee0 0x55859164f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:53.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.243+0000 7fd491096740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558591646800 0x55859164fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:53.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.243+0000 7fd491096740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591652790 0x5585916501d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:53.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.243+0000 7fd491096740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55859140d890 con 0x558591652790 2024-09-11T00:25:53.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.243+0000 7fd491096740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x558591546d40 con 0x558591645ee0 2024-09-11T00:25:53.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.243+0000 7fd491096740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x558591655440 con 0x558591646800 2024-09-11T00:25:53.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.243+0000 7fd491096740 10 client.0 _ll_register_callbacks cb 0x5585915aac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:25:53.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.243+0000 7fd48d25e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591652790 0x5585916501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:53.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.243+0000 7fd48d25e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591652790 0x5585916501d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41108/0 (socket says 172.21.15.78:41108) 2024-09-11T00:25:53.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.243+0000 7fd48d25e640 1 -- 172.21.15.78:0/1369523836 learned_addr learned my addr 172.21.15.78:0/1369523836 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:53.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.243+0000 7fd48ca5d640 1 --2- 172.21.15.78:0/1369523836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558591645ee0 0x55859164f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:53.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.243+0000 7fd47ffff640 1 --2- 172.21.15.78:0/1369523836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558591646800 0x55859164fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:53.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.243+0000 7fd48d25e640 1 -- 172.21.15.78:0/1369523836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558591646800 msgr2=0x55859164fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:53.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.243+0000 7fd48d25e640 1 --2- 172.21.15.78:0/1369523836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558591646800 0x55859164fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.243+0000 7fd48d25e640 1 -- 172.21.15.78:0/1369523836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558591645ee0 msgr2=0x55859164f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:53.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.243+0000 7fd48d25e640 1 --2- 172.21.15.78:0/1369523836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558591645ee0 0x55859164f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.243+0000 7fd48d25e640 1 -- 172.21.15.78:0/1369523836 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55859165e820 con 0x558591652790 2024-09-11T00:25:53.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.243+0000 7fd47ffff640 1 --2- 172.21.15.78:0/1369523836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558591646800 0x55859164fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:25:53.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.243+0000 7fd48d25e640 1 --2- 172.21.15.78:0/1369523836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591652790 0x5585916501d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd480018a90 tx=0x7fd480004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902c1ecec0873444 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:53.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.243+0000 7fd467fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:25:53.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.244+0000 7fd467fff640 1 -- 172.21.15.78:0/1369523836 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd480028060 con 0x558591652790 2024-09-11T00:25:53.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.244+0000 7fd467fff640 1 -- 172.21.15.78:0/1369523836 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7fd480023440 con 0x558591652790 2024-09-11T00:25:53.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.244+0000 7fd491096740 1 -- 172.21.15.78:0/1369523836 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd484018af0 con 0x558591652790 2024-09-11T00:25:53.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.244+0000 7fd467fff640 1 -- 172.21.15.78:0/1369523836 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd480007e80 con 0x558591652790 2024-09-11T00:25:53.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.244+0000 7fd491096740 10 client.16659 fetch_fsmap learned FSMap version 20 2024-09-11T00:25:53.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.244+0000 7fd491096740 1 -- 172.21.15.78:0/1369523836 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x558591661230 con 0x558591652790 2024-09-11T00:25:53.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.244+0000 7fd467fff640 1 -- 172.21.15.78:0/1369523836 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd484018af0 con 0x558591652790 2024-09-11T00:25:53.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.244+0000 7fd467fff640 1 -- 172.21.15.78:0/1369523836 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd480016730 con 0x558591652790 2024-09-11T00:25:53.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.244+0000 7fd491096740 10 client.16659 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:25:53.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.244+0000 7fd491096740 10 client.16659 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:25:53.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.244+0000 7fd491096740 20 client.16659 populate_metadata read hostname 'smithi078' 2024-09-11T00:25:53.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.244+0000 7fd491096740 1 --2- 172.21.15.78:0/1369523836 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x558591662790 0x558591664bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:53.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.244+0000 7fd491096740 4 client.16659 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:25:53.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.244+0000 7fd491096740 1 -- 172.21.15.78:0/1369523836 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585915bedb0 con 0x558591662790 2024-09-11T00:25:53.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.244+0000 7fd48ca5d640 1 --2- 172.21.15.78:0/1369523836 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x558591662790 0x558591664bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:53.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.245+0000 7fd467fff640 10 client.16659 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:53.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.245+0000 7fd48ca5d640 1 --2- 172.21.15.78:0/1369523836 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x558591662790 0x558591664bc0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36b869d32f768d11 server_cookie=1eefec03b720a68b in_seq=0 out_seq=0 2024-09-11T00:25:53.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.246+0000 7fd467fff640 1 -- 172.21.15.78:0/1369523836 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5585915bedb0 con 0x558591662790 2024-09-11T00:25:53.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.246+0000 7fd467fff640 10 client.16659 handle_command_reply: tid=0 2024-09-11T00:25:53.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.246+0000 7fd491096740 1 client.16659 shutdown 2024-09-11T00:25:53.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.246+0000 7fd491096740 1 -- 172.21.15.78:0/1369523836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591652790 msgr2=0x5585916501d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:53.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.246+0000 7fd491096740 1 --2- 172.21.15.78:0/1369523836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591652790 0x5585916501d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd480018a90 tx=0x7fd480004a40 comp rx=0 tx=0).stop 2024-09-11T00:25:53.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.246+0000 7fd491096740 1 -- 172.21.15.78:0/1369523836 shutdown_connections 2024-09-11T00:25:53.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.246+0000 7fd491096740 1 --2- 172.21.15.78:0/1369523836 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x558591662790 0x558591664bc0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.246+0000 7fd491096740 1 --2- 172.21.15.78:0/1369523836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591652790 0x5585916501d0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.246+0000 7fd467fff640 0 client.16659 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:53.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.246+0000 7fd491096740 1 --2- 172.21.15.78:0/1369523836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558591646800 0x55859164fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.246+0000 7fd491096740 1 --2- 172.21.15.78:0/1369523836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558591645ee0 0x55859164f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.246+0000 7fd491096740 1 -- 172.21.15.78:0/1369523836 >> 172.21.15.78:0/1369523836 conn(0x558591643d10 msgr2=0x558591642f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:53.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.246+0000 7fd491096740 1 -- 172.21.15.78:0/1369523836 shutdown_connections 2024-09-11T00:25:53.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.246+0000 7fd491096740 1 -- 172.21.15.78:0/1369523836 wait complete. 2024-09-11T00:25:53.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.246+0000 7fd491096740 20 client.16659 trim_cache size 0 max 16384 2024-09-11T00:25:53.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.263+0000 7fd491096740 1 Processor -- start 2024-09-11T00:25:53.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.263+0000 7fd491096740 1 -- start start 2024-09-11T00:25:53.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.263+0000 7fd491096740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591645ee0 0x558591642e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:53.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.264+0000 7fd491096740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558591646800 0x5585916433a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:53.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.264+0000 7fd491096740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558591652790 0x55859166a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:53.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.264+0000 7fd491096740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd4881ac870 con 0x558591645ee0 2024-09-11T00:25:53.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.264+0000 7fd491096740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd4881af0d0 con 0x558591646800 2024-09-11T00:25:53.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.264+0000 7fd491096740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd4881acec0 con 0x558591652790 2024-09-11T00:25:53.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.264+0000 7fd48ca5d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591645ee0 0x558591642e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:53.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.264+0000 7fd48ca5d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591645ee0 0x558591642e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41112/0 (socket says 172.21.15.78:41112) 2024-09-11T00:25:53.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.264+0000 7fd48ca5d640 1 -- 172.21.15.78:0/1811074329 learned_addr learned my addr 172.21.15.78:0/1811074329 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:53.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.264+0000 7fd48d25e640 1 --2- 172.21.15.78:0/1811074329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558591652790 0x55859166a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:53.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.264+0000 7fd47ffff640 1 --2- 172.21.15.78:0/1811074329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558591646800 0x5585916433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:53.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.264+0000 7fd48ca5d640 1 -- 172.21.15.78:0/1811074329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558591652790 msgr2=0x55859166a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:53.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.264+0000 7fd48ca5d640 1 --2- 172.21.15.78:0/1811074329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558591652790 0x55859166a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.264+0000 7fd48ca5d640 1 -- 172.21.15.78:0/1811074329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558591646800 msgr2=0x5585916433a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:53.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.264+0000 7fd48ca5d640 1 --2- 172.21.15.78:0/1811074329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558591646800 0x5585916433a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.264+0000 7fd48ca5d640 1 -- 172.21.15.78:0/1811074329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558591643b40 con 0x558591645ee0 2024-09-11T00:25:53.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.264+0000 7fd48ca5d640 1 --2- 172.21.15.78:0/1811074329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591645ee0 0x558591642e60 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd48400ac20 tx=0x7fd48400a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf27e8504d6dbdc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:53.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.264+0000 7fd46e7fc640 1 -- 172.21.15.78:0/1811074329 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48402e020 con 0x558591645ee0 2024-09-11T00:25:53.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.264+0000 7fd46e7fc640 1 -- 172.21.15.78:0/1811074329 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4840054f0 con 0x558591645ee0 2024-09-11T00:25:53.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.264+0000 7fd46e7fc640 1 -- 172.21.15.78:0/1811074329 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48401d040 con 0x558591645ee0 2024-09-11T00:25:53.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.265+0000 7fd491096740 1 -- 172.21.15.78:0/1811074329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591645ee0 msgr2=0x558591642e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.265+0000 7fd491096740 1 --2- 172.21.15.78:0/1811074329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591645ee0 0x558591642e60 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd48400ac20 tx=0x7fd48400a2d0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.265+0000 7fd491096740 1 -- 172.21.15.78:0/1811074329 shutdown_connections 2024-09-11T00:25:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.265+0000 7fd491096740 1 --2- 172.21.15.78:0/1811074329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558591652790 0x55859166a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.265+0000 7fd491096740 1 --2- 172.21.15.78:0/1811074329 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558591646800 0x5585916433a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.265+0000 7fd491096740 1 --2- 172.21.15.78:0/1811074329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591645ee0 0x558591642e60 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.265+0000 7fd491096740 1 -- 172.21.15.78:0/1811074329 >> 172.21.15.78:0/1811074329 conn(0x558591643d10 msgr2=0x558591642750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.265+0000 7fd491096740 1 -- 172.21.15.78:0/1811074329 shutdown_connections 2024-09-11T00:25:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.265+0000 7fd491096740 1 -- 172.21.15.78:0/1811074329 wait complete. 2024-09-11T00:25:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.265+0000 7fd491096740 1 -- start start 2024-09-11T00:25:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.265+0000 7fd491096740 1 Processor -- start 2024-09-11T00:25:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.266+0000 7fd491096740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558591645ee0 0x55859165aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.266+0000 7fd491096740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558591646800 0x5585916593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.266+0000 7fd491096740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591652790 0x5585916599b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.266+0000 7fd491096740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd4881ad590 con 0x558591652790 2024-09-11T00:25:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.266+0000 7fd491096740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd4881aea00 con 0x558591646800 2024-09-11T00:25:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.266+0000 7fd491096740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd4881adc60 con 0x558591645ee0 2024-09-11T00:25:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.266+0000 7fd491096740 10 client.0 _ll_register_callbacks cb 0x7fd480009cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:25:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.266+0000 7fd48d25e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591652790 0x5585916599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.266+0000 7fd48d25e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591652790 0x5585916599b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41128/0 (socket says 172.21.15.78:41128) 2024-09-11T00:25:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.266+0000 7fd48d25e640 1 -- 172.21.15.78:0/2898172373 learned_addr learned my addr 172.21.15.78:0/2898172373 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.266+0000 7fd47ffff640 1 --2- 172.21.15.78:0/2898172373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558591646800 0x5585916593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:53.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.266+0000 7fd48d25e640 1 -- 172.21.15.78:0/2898172373 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558591645ee0 msgr2=0x55859165aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:53.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.266+0000 7fd48ca5d640 1 --2- 172.21.15.78:0/2898172373 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558591645ee0 0x55859165aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:53.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.266+0000 7fd48d25e640 1 --2- 172.21.15.78:0/2898172373 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558591645ee0 0x55859165aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.266+0000 7fd48d25e640 1 -- 172.21.15.78:0/2898172373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558591646800 msgr2=0x5585916593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:53.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.266+0000 7fd48d25e640 1 --2- 172.21.15.78:0/2898172373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558591646800 0x5585916593f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.266+0000 7fd48d25e640 1 -- 172.21.15.78:0/2898172373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558591644790 con 0x558591652790 2024-09-11T00:25:53.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.266+0000 7fd47ffff640 1 --2- 172.21.15.78:0/2898172373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558591646800 0x5585916593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:25:53.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.266+0000 7fd48ca5d640 1 --2- 172.21.15.78:0/2898172373 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558591645ee0 0x55859165aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:25:53.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.266+0000 7fd48d25e640 1 --2- 172.21.15.78:0/2898172373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591652790 0x5585916599b0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd48000aec0 tx=0x7fd4800168e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecdc5151b54ffb27 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:53.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.266+0000 7fd467fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:25:53.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.267+0000 7fd467fff640 1 -- 172.21.15.78:0/2898172373 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48003a060 con 0x558591652790 2024-09-11T00:25:53.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.267+0000 7fd467fff640 1 -- 172.21.15.78:0/2898172373 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7fd48002b5a0 con 0x558591652790 2024-09-11T00:25:53.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.267+0000 7fd491096740 1 -- 172.21.15.78:0/2898172373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4840054f0 con 0x558591652790 2024-09-11T00:25:53.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.267+0000 7fd467fff640 1 -- 172.21.15.78:0/2898172373 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd480007800 con 0x558591652790 2024-09-11T00:25:53.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.267+0000 7fd491096740 10 client.16665 fetch_fsmap learned FSMap version 20 2024-09-11T00:25:53.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.267+0000 7fd491096740 1 -- 172.21.15.78:0/2898172373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5585916d0600 con 0x558591652790 2024-09-11T00:25:53.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.267+0000 7fd467fff640 1 -- 172.21.15.78:0/2898172373 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4840054f0 con 0x558591652790 2024-09-11T00:25:53.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.267+0000 7fd467fff640 1 -- 172.21.15.78:0/2898172373 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fd480035510 con 0x558591652790 2024-09-11T00:25:53.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.267+0000 7fd491096740 10 client.16665 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:25:53.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.267+0000 7fd491096740 10 client.16665 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:25:53.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.267+0000 7fd491096740 20 client.16665 populate_metadata read hostname 'smithi078' 2024-09-11T00:25:53.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.267+0000 7fd491096740 1 --2- 172.21.15.78:0/2898172373 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x558591662790 0x5585916d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:53.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.267+0000 7fd491096740 4 client.16665 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T00:25:53.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.267+0000 7fd491096740 1 -- 172.21.15.78:0/2898172373 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5585915ba860 con 0x558591662790 2024-09-11T00:25:53.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.268+0000 7fd48ca5d640 1 --2- 172.21.15.78:0/2898172373 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x558591662790 0x5585916d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:53.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.268+0000 7fd48ca5d640 1 --2- 172.21.15.78:0/2898172373 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x558591662790 0x5585916d2dc0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96144398c0753ab7 server_cookie=6a89eb9adf702155 in_seq=0 out_seq=0 2024-09-11T00:25:53.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.268+0000 7fd467fff640 10 client.16665 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:53.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.269+0000 7fd467fff640 1 -- 172.21.15.78:0/2898172373 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5585915ba860 con 0x558591662790 2024-09-11T00:25:53.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.269+0000 7fd467fff640 10 client.16665 handle_command_reply: tid=0 2024-09-11T00:25:53.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.269+0000 7fd491096740 1 client.16665 shutdown 2024-09-11T00:25:53.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.270+0000 7fd491096740 1 -- 172.21.15.78:0/2898172373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591652790 msgr2=0x5585916599b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:53.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.270+0000 7fd491096740 1 --2- 172.21.15.78:0/2898172373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591652790 0x5585916599b0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd48000aec0 tx=0x7fd4800168e0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.270+0000 7fd491096740 1 -- 172.21.15.78:0/2898172373 shutdown_connections 2024-09-11T00:25:53.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.270+0000 7fd491096740 1 --2- 172.21.15.78:0/2898172373 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x558591662790 0x5585916d2dc0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.270+0000 7fd491096740 1 --2- 172.21.15.78:0/2898172373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558591652790 0x5585916599b0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.270+0000 7fd467fff640 0 client.16665 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:53.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.270+0000 7fd491096740 1 --2- 172.21.15.78:0/2898172373 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x558591646800 0x5585916593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.270+0000 7fd491096740 1 --2- 172.21.15.78:0/2898172373 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558591645ee0 0x55859165aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.270+0000 7fd491096740 1 -- 172.21.15.78:0/2898172373 >> 172.21.15.78:0/2898172373 conn(0x558591643d10 msgr2=0x558591642f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:53.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.270+0000 7fd491096740 1 -- 172.21.15.78:0/2898172373 shutdown_connections 2024-09-11T00:25:53.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.270+0000 7fd491096740 1 -- 172.21.15.78:0/2898172373 wait complete. 2024-09-11T00:25:53.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.270+0000 7fd491096740 20 client.16665 trim_cache size 0 max 16384 2024-09-11T00:25:53.279 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:25:53.279 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-11T00:25:53.279 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "9920e47e-5aad-446c-9450-0057a7201a30", 2024-09-11T00:25:53.280 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-11T00:25:53.280 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:25:53.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.270+0000 7fd48ecc1640 1 -- 172.21.15.78:0/883842983 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd4700b5450 msgr2=0x7fd4700b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:53.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.270+0000 7fd48ecc1640 1 --2- 172.21.15.78:0/883842983 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd4700b5450 0x7fd4700b7910 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd48000a510 tx=0x7fd48000d040 comp rx=0 tx=0).stop 2024-09-11T00:25:53.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.270+0000 7fd48ecc1640 1 -- 172.21.15.78:0/883842983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4881087d0 msgr2=0x7fd488199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:53.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.270+0000 7fd48ecc1640 1 --2- 172.21.15.78:0/883842983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4881087d0 0x7fd488199820 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fd478006010 tx=0x7fd4780042f0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.271+0000 7fd48ecc1640 1 -- 172.21.15.78:0/883842983 shutdown_connections 2024-09-11T00:25:53.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.271+0000 7fd48ecc1640 1 --2- 172.21.15.78:0/883842983 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fd4700b5450 0x7fd4700b7910 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.271+0000 7fd48ecc1640 1 --2- 172.21.15.78:0/883842983 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd488109150 0x7fd48819ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.271+0000 7fd48ecc1640 1 --2- 172.21.15.78:0/883842983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4881087d0 0x7fd488199820 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.271+0000 7fd48ecc1640 1 --2- 172.21.15.78:0/883842983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd488102dc0 0x7fd4881992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:53.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.271+0000 7fd48ecc1640 1 -- 172.21.15.78:0/883842983 >> 172.21.15.78:0/883842983 conn(0x7fd4880fe830 msgr2=0x7fd488100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:53.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.271+0000 7fd48ecc1640 1 -- 172.21.15.78:0/883842983 shutdown_connections 2024-09-11T00:25:53.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:53.271+0000 7fd48ecc1640 1 -- 172.21.15.78:0/883842983 wait complete. 2024-09-11T00:25:53.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:53 smithi078 ceph-mon[30865]: scrub queued for path: / 2024-09-11T00:25:53.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:53 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:25:53.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:53 smithi078 ceph-mon[30865]: scrub summary: active paths [/] 2024-09-11T00:25:53.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:53 smithi078 ceph-mon[30865]: scrub summary: idle+waiting paths [/] 2024-09-11T00:25:53.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:53 smithi112 ceph-mon[35627]: scrub queued for path: / 2024-09-11T00:25:53.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:53 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:25:53.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:53 smithi112 ceph-mon[35627]: scrub summary: active paths [/] 2024-09-11T00:25:53.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:53 smithi112 ceph-mon[35627]: scrub summary: idle+waiting paths [/] 2024-09-11T00:25:53.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:53 smithi138 ceph-mon[35019]: scrub queued for path: / 2024-09-11T00:25:53.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:53 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:25:53.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:53 smithi138 ceph-mon[35019]: scrub summary: active paths [/] 2024-09-11T00:25:53.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:53 smithi138 ceph-mon[35019]: scrub summary: idle+waiting paths [/] 2024-09-11T00:25:54.132 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:25:54.378 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:25:54.498 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:54 smithi078 ceph-mon[30865]: pgmap v612: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:25:54.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:54 smithi112 ceph-mon[35627]: pgmap v612: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:25:54.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:54 smithi138 ceph-mon[35019]: pgmap v612: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:25:54.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.894+0000 7fb3bcc31640 1 -- 172.21.15.78:0/3741940988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3b8101cb0 msgr2=0x7fb3b8102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:54.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.894+0000 7fb3bcc31640 1 --2- 172.21.15.78:0/3741940988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3b8101cb0 0x7fb3b8102090 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009900 tx=0x7fb3a802a410 comp rx=0 tx=0).stop 2024-09-11T00:25:54.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.894+0000 7fb3bcc31640 1 -- 172.21.15.78:0/3741940988 shutdown_connections 2024-09-11T00:25:54.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.894+0000 7fb3bcc31640 1 --2- 172.21.15.78:0/3741940988 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3b8108040 0x7fb3b810e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.894+0000 7fb3bcc31640 1 --2- 172.21.15.78:0/3741940988 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3b81076c0 0x7fb3b8107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.894+0000 7fb3bcc31640 1 --2- 172.21.15.78:0/3741940988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3b8101cb0 0x7fb3b8102090 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.894+0000 7fb3bcc31640 1 -- 172.21.15.78:0/3741940988 >> 172.21.15.78:0/3741940988 conn(0x7fb3b80fd700 msgr2=0x7fb3b80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:54.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.894+0000 7fb3bcc31640 1 -- 172.21.15.78:0/3741940988 shutdown_connections 2024-09-11T00:25:54.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.894+0000 7fb3bcc31640 1 -- 172.21.15.78:0/3741940988 wait complete. 2024-09-11T00:25:54.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.895+0000 7fb3bcc31640 1 Processor -- start 2024-09-11T00:25:54.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.895+0000 7fb3bcc31640 1 -- start start 2024-09-11T00:25:54.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.895+0000 7fb3bcc31640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3b8101cb0 0x7fb3b81992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:54.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.895+0000 7fb3bcc31640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3b81076c0 0x7fb3b8199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:54.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.895+0000 7fb3bcc31640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3b8108040 0x7fb3b819ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:54.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.895+0000 7fb3bcc31640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b8111d00 con 0x7fb3b8108040 2024-09-11T00:25:54.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.895+0000 7fb3bcc31640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b8111b80 con 0x7fb3b81076c0 2024-09-11T00:25:54.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.895+0000 7fb3bcc31640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b8111e80 con 0x7fb3b8101cb0 2024-09-11T00:25:54.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.895+0000 7fb3b6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3b8108040 0x7fb3b819ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:54.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.895+0000 7fb3b6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3b8108040 0x7fb3b819ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54430/0 (socket says 172.21.15.78:54430) 2024-09-11T00:25:54.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.895+0000 7fb3b6d9d640 1 -- 172.21.15.78:0/631502911 learned_addr learned my addr 172.21.15.78:0/631502911 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:54.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.895+0000 7fb3b6d9d640 1 -- 172.21.15.78:0/631502911 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3b8101cb0 msgr2=0x7fb3b81992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:54.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.895+0000 7fb3b659c640 1 --2- 172.21.15.78:0/631502911 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3b8101cb0 0x7fb3b81992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:54.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.895+0000 7fb3b5d9b640 1 --2- 172.21.15.78:0/631502911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3b81076c0 0x7fb3b8199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:54.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.895+0000 7fb3b6d9d640 1 --2- 172.21.15.78:0/631502911 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3b8101cb0 0x7fb3b81992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.895+0000 7fb3b6d9d640 1 -- 172.21.15.78:0/631502911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3b81076c0 msgr2=0x7fb3b8199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:54.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.895+0000 7fb3b6d9d640 1 --2- 172.21.15.78:0/631502911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3b81076c0 0x7fb3b8199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.895+0000 7fb3b6d9d640 1 -- 172.21.15.78:0/631502911 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b819f3a0 con 0x7fb3b8108040 2024-09-11T00:25:54.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.896+0000 7fb3b659c640 1 --2- 172.21.15.78:0/631502911 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3b8101cb0 0x7fb3b81992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:25:54.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.896+0000 7fb3b5d9b640 1 --2- 172.21.15.78:0/631502911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3b81076c0 0x7fb3b8199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:25:54.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.896+0000 7fb3b6d9d640 1 --2- 172.21.15.78:0/631502911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3b8108040 0x7fb3b819ebd0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000b970 tx=0x7fb3b000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:54.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.896+0000 7fb3a77fe640 1 -- 172.21.15.78:0/631502911 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0019070 con 0x7fb3b8108040 2024-09-11T00:25:54.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.896+0000 7fb3a77fe640 1 -- 172.21.15.78:0/631502911 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3b0014440 con 0x7fb3b8108040 2024-09-11T00:25:54.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.896+0000 7fb3bcc31640 1 -- 172.21.15.78:0/631502911 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b819f690 con 0x7fb3b8108040 2024-09-11T00:25:54.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.896+0000 7fb3a77fe640 1 -- 172.21.15.78:0/631502911 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00075d0 con 0x7fb3b8108040 2024-09-11T00:25:54.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.896+0000 7fb3bcc31640 1 -- 172.21.15.78:0/631502911 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b81a5f20 con 0x7fb3b8108040 2024-09-11T00:25:54.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.898+0000 7fb3a77fe640 1 -- 172.21.15.78:0/631502911 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fb3b000cb40 con 0x7fb3b8108040 2024-09-11T00:25:54.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.899+0000 7fb3bf006740 1 Processor -- start 2024-09-11T00:25:54.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.899+0000 7fb3bf006740 1 -- start start 2024-09-11T00:25:54.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.899+0000 7fb3bf006740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608e46770a0 0x5608e4677480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:54.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.899+0000 7fb3bf006740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e46779c0 0x5608e4683410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:54.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.899+0000 7fb3bf006740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608e4683950 0x5608e4685d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:54.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.899+0000 7fb3bf006740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5608e45ede50 con 0x5608e46779c0 2024-09-11T00:25:54.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.899+0000 7fb3bf006740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5608e45dd280 con 0x5608e4683950 2024-09-11T00:25:54.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.899+0000 7fb3bf006740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5608e45e1090 con 0x5608e46770a0 2024-09-11T00:25:54.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.899+0000 7fb3a77fe640 1 --2- 172.21.15.78:0/631502911 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb3a00b54d0 0x7fb3a00b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:54.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.899+0000 7fb3b659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e46779c0 0x5608e4683410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:54.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.899+0000 7fb3b659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e46779c0 0x5608e4683410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54434/0 (socket says 172.21.15.78:54434) 2024-09-11T00:25:54.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.899+0000 7fb3b659c640 1 -- 172.21.15.78:0/1109102647 learned_addr learned my addr 172.21.15.78:0/1109102647 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:54.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.900+0000 7fb3b6d9d640 1 --2- 172.21.15.78:0/631502911 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb3a00b54d0 0x7fb3a00b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:54.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.900+0000 7fb3b5d9b640 1 --2- 172.21.15.78:0/1109102647 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608e46770a0 0x5608e4677480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:54.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.900+0000 7fb3b5d9b640 1 --2- 172.21.15.78:0/1109102647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608e4683950 0x5608e4685d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:54.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.900+0000 7fb3a77fe640 1 -- 172.21.15.78:0/631502911 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7fb3b00e57b0 con 0x7fb3b8108040 2024-09-11T00:25:54.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.900+0000 7fb3b659c640 1 -- 172.21.15.78:0/1109102647 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608e46770a0 msgr2=0x5608e4677480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:54.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.900+0000 7fb3b659c640 1 --2- 172.21.15.78:0/1109102647 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608e46770a0 0x5608e4677480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.900+0000 7fb3b659c640 1 -- 172.21.15.78:0/1109102647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608e4683950 msgr2=0x5608e4685d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:54.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.900+0000 7fb3b659c640 1 --2- 172.21.15.78:0/1109102647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608e4683950 0x5608e4685d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.900+0000 7fb3b659c640 1 -- 172.21.15.78:0/1109102647 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608e433b650 con 0x5608e46779c0 2024-09-11T00:25:54.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.900+0000 7fb3b6d9d640 1 --2- 172.21.15.78:0/631502911 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb3a00b54d0 0x7fb3a00b7990 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb3b00e2fa0 tx=0x7fb3b0074d70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:54.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.900+0000 7fb3b659c640 1 --2- 172.21.15.78:0/1109102647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e46779c0 0x5608e4683410 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8000c00 tx=0x7fb3a8032e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272fe2fdd5000145 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:54.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.900+0000 7fb3a4ff9640 1 -- 172.21.15.78:0/1109102647 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a803f070 con 0x5608e46779c0 2024-09-11T00:25:54.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.900+0000 7fb3a4ff9640 1 -- 172.21.15.78:0/1109102647 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3a8031760 con 0x5608e46779c0 2024-09-11T00:25:54.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.900+0000 7fb3a4ff9640 1 -- 172.21.15.78:0/1109102647 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8035070 con 0x5608e46779c0 2024-09-11T00:25:54.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.901+0000 7fb3bf006740 1 -- 172.21.15.78:0/1109102647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e46779c0 msgr2=0x5608e4683410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:54.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.901+0000 7fb3bf006740 1 --2- 172.21.15.78:0/1109102647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e46779c0 0x5608e4683410 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8000c00 tx=0x7fb3a8032e90 comp rx=0 tx=0).stop 2024-09-11T00:25:54.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.901+0000 7fb3bf006740 1 -- 172.21.15.78:0/1109102647 shutdown_connections 2024-09-11T00:25:54.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.901+0000 7fb3bf006740 1 --2- 172.21.15.78:0/1109102647 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608e4683950 0x5608e4685d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.901+0000 7fb3bf006740 1 --2- 172.21.15.78:0/1109102647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e46779c0 0x5608e4683410 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.901+0000 7fb3bf006740 1 --2- 172.21.15.78:0/1109102647 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608e46770a0 0x5608e4677480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.901+0000 7fb3bf006740 1 -- 172.21.15.78:0/1109102647 >> 172.21.15.78:0/1109102647 conn(0x5608e4674ed0 msgr2=0x5608e4676070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:54.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.901+0000 7fb3bf006740 1 -- 172.21.15.78:0/1109102647 shutdown_connections 2024-09-11T00:25:54.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.901+0000 7fb3bf006740 1 -- 172.21.15.78:0/1109102647 wait complete. 2024-09-11T00:25:54.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.901+0000 7fb3bf006740 1 -- start start 2024-09-11T00:25:54.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.902+0000 7fb3bf006740 1 Processor -- start 2024-09-11T00:25:54.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.902+0000 7fb3bf006740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e46770a0 0x5608e46831f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:54.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.902+0000 7fb3bf006740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608e46779c0 0x5608e4680640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:54.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.902+0000 7fb3bf006740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608e4683950 0x5608e4680c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:54.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.902+0000 7fb3bf006740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5608e443e700 con 0x5608e46770a0 2024-09-11T00:25:54.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.902+0000 7fb3bf006740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5608e4578110 con 0x5608e46779c0 2024-09-11T00:25:54.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.902+0000 7fb3bf006740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5608e4686570 con 0x5608e4683950 2024-09-11T00:25:54.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.902+0000 7fb3bf006740 10 client.0 _ll_register_callbacks cb 0x5608e4591990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:25:54.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.902+0000 7fb3b5d9b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608e4683950 0x5608e4680c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:54.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.902+0000 7fb3b5d9b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608e4683950 0x5608e4680c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.78:46408/0 (socket says 172.21.15.78:46408) 2024-09-11T00:25:54.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.902+0000 7fb3b5d9b640 1 -- 172.21.15.78:0/811203331 learned_addr learned my addr 172.21.15.78:0/811203331 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:54.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.902+0000 7fb3b5d9b640 1 --2- 172.21.15.78:0/811203331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e46770a0 0x5608e46831f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:54.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.902+0000 7fb3b659c640 1 --2- 172.21.15.78:0/811203331 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608e46779c0 0x5608e4680640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:54.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.903+0000 7fb3b5d9b640 1 -- 172.21.15.78:0/811203331 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608e4683950 msgr2=0x5608e4680c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:54.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.903+0000 7fb3b5d9b640 1 --2- 172.21.15.78:0/811203331 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608e4683950 0x5608e4680c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.903+0000 7fb3b5d9b640 1 -- 172.21.15.78:0/811203331 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608e46779c0 msgr2=0x5608e4680640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:54.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.903+0000 7fb3b5d9b640 1 --2- 172.21.15.78:0/811203331 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608e46779c0 0x5608e4680640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.903+0000 7fb3b5d9b640 1 -- 172.21.15.78:0/811203331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608e45a5c40 con 0x5608e46770a0 2024-09-11T00:25:54.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.903+0000 7fb3b5d9b640 1 --2- 172.21.15.78:0/811203331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e46770a0 0x5608e46831f0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac012e40 tx=0x7fb3ac005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e734f5f8ef4dbb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:54.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.903+0000 7fb39dffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:25:54.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.903+0000 7fb39dffb640 1 -- 172.21.15.78:0/811203331 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac00f670 con 0x5608e46770a0 2024-09-11T00:25:54.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.903+0000 7fb39dffb640 1 -- 172.21.15.78:0/811203331 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7fb3ac00f810 con 0x5608e46770a0 2024-09-11T00:25:54.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.903+0000 7fb3bf006740 1 -- 172.21.15.78:0/811203331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3a8031760 con 0x5608e46770a0 2024-09-11T00:25:54.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.903+0000 7fb39dffb640 1 -- 172.21.15.78:0/811203331 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb3ac00fa10 con 0x5608e46770a0 2024-09-11T00:25:54.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.903+0000 7fb3bf006740 10 client.16677 fetch_fsmap learned FSMap version 20 2024-09-11T00:25:54.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.903+0000 7fb3bf006740 1 -- 172.21.15.78:0/811203331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5608e4691ef0 con 0x5608e46770a0 2024-09-11T00:25:54.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.903+0000 7fb39dffb640 1 -- 172.21.15.78:0/811203331 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3a8031760 con 0x5608e46770a0 2024-09-11T00:25:54.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.904+0000 7fb39dffb640 1 -- 172.21.15.78:0/811203331 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb3ac027930 con 0x5608e46770a0 2024-09-11T00:25:54.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.904+0000 7fb3bf006740 10 client.16677 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:25:54.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.904+0000 7fb3bf006740 10 client.16677 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:25:54.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.904+0000 7fb3bf006740 20 client.16677 populate_metadata read hostname 'smithi078' 2024-09-11T00:25:54.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.904+0000 7fb3bf006740 1 --2- 172.21.15.78:0/811203331 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5608e4693400 0x5608e46957f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:54.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.904+0000 7fb3bf006740 4 client.16677 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:25:54.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.904+0000 7fb3bf006740 1 -- 172.21.15.78:0/811203331 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608e45efda0 con 0x5608e4693400 2024-09-11T00:25:54.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.904+0000 7fb3b659c640 1 --2- 172.21.15.78:0/811203331 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5608e4693400 0x5608e46957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:54.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.904+0000 7fb39dffb640 10 client.16677 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:54.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.904+0000 7fb3b659c640 1 --2- 172.21.15.78:0/811203331 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5608e4693400 0x5608e46957f0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1541a2b43b3bbd22 server_cookie=c74d5c3eb294027d in_seq=0 out_seq=0 2024-09-11T00:25:54.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.905+0000 7fb39dffb640 1 -- 172.21.15.78:0/811203331 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5608e45efda0 con 0x5608e4693400 2024-09-11T00:25:54.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.905+0000 7fb39dffb640 10 client.16677 handle_command_reply: tid=0 2024-09-11T00:25:54.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.905+0000 7fb3bf006740 1 client.16677 shutdown 2024-09-11T00:25:54.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.905+0000 7fb3bf006740 1 -- 172.21.15.78:0/811203331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e46770a0 msgr2=0x5608e46831f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:54.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.905+0000 7fb3bf006740 1 --2- 172.21.15.78:0/811203331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e46770a0 0x5608e46831f0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac012e40 tx=0x7fb3ac005b50 comp rx=0 tx=0).stop 2024-09-11T00:25:54.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.905+0000 7fb3bf006740 1 -- 172.21.15.78:0/811203331 shutdown_connections 2024-09-11T00:25:54.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.905+0000 7fb3bf006740 1 --2- 172.21.15.78:0/811203331 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5608e4693400 0x5608e46957f0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.905+0000 7fb3bf006740 1 --2- 172.21.15.78:0/811203331 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608e4683950 0x5608e4680c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.905+0000 7fb39dffb640 0 client.16677 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:54.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.905+0000 7fb3bf006740 1 --2- 172.21.15.78:0/811203331 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608e46779c0 0x5608e4680640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.905+0000 7fb3bf006740 1 --2- 172.21.15.78:0/811203331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e46770a0 0x5608e46831f0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.905+0000 7fb3bf006740 1 -- 172.21.15.78:0/811203331 >> 172.21.15.78:0/811203331 conn(0x5608e4674ed0 msgr2=0x5608e467aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:54.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.906+0000 7fb3bf006740 1 -- 172.21.15.78:0/811203331 shutdown_connections 2024-09-11T00:25:54.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.906+0000 7fb3bf006740 1 -- 172.21.15.78:0/811203331 wait complete. 2024-09-11T00:25:54.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.906+0000 7fb3bf006740 20 client.16677 trim_cache size 0 max 16384 2024-09-11T00:25:54.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.923+0000 7fb3bf006740 1 Processor -- start 2024-09-11T00:25:54.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.923+0000 7fb3bf006740 1 -- start start 2024-09-11T00:25:54.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.923+0000 7fb3bf006740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608e46770a0 0x5608e468f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:54.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.923+0000 7fb3bf006740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608e46779c0 0x5608e4676630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:54.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.923+0000 7fb3bf006740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e4683950 0x5608e467fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:54.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.924+0000 7fb3bf006740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b81ac890 con 0x5608e4683950 2024-09-11T00:25:54.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.924+0000 7fb3bf006740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b81af0f0 con 0x5608e46770a0 2024-09-11T00:25:54.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.924+0000 7fb3bf006740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b81acee0 con 0x5608e46779c0 2024-09-11T00:25:54.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.924+0000 7fb3b5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e4683950 0x5608e467fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:54.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.924+0000 7fb3b5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e4683950 0x5608e467fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54450/0 (socket says 172.21.15.78:54450) 2024-09-11T00:25:54.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.924+0000 7fb3b5d9b640 1 -- 172.21.15.78:0/4191586053 learned_addr learned my addr 172.21.15.78:0/4191586053 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:54.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.924+0000 7fb3b5d9b640 1 --2- 172.21.15.78:0/4191586053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608e46770a0 0x5608e468f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:54.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.924+0000 7fb3b659c640 1 --2- 172.21.15.78:0/4191586053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608e46779c0 0x5608e4676630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:54.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.924+0000 7fb3b5d9b640 1 -- 172.21.15.78:0/4191586053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608e46779c0 msgr2=0x5608e4676630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:54.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.924+0000 7fb3b5d9b640 1 --2- 172.21.15.78:0/4191586053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608e46779c0 0x5608e4676630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.924+0000 7fb3b5d9b640 1 -- 172.21.15.78:0/4191586053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608e46770a0 msgr2=0x5608e468f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:54.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.924+0000 7fb3b5d9b640 1 --2- 172.21.15.78:0/4191586053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608e46770a0 0x5608e468f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.924+0000 7fb3b5d9b640 1 -- 172.21.15.78:0/4191586053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608e467f5a0 con 0x5608e4683950 2024-09-11T00:25:54.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.924+0000 7fb3b5d9b640 1 --2- 172.21.15.78:0/4191586053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e4683950 0x5608e467fb30 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac0058c0 tx=0x7fb3ac012f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=342777bb45ae477f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:54.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.924+0000 7fb39ffff640 1 -- 172.21.15.78:0/4191586053 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac00f670 con 0x5608e4683950 2024-09-11T00:25:54.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.924+0000 7fb39ffff640 1 -- 172.21.15.78:0/4191586053 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3ac00f810 con 0x5608e4683950 2024-09-11T00:25:54.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.924+0000 7fb39ffff640 1 -- 172.21.15.78:0/4191586053 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac0306e0 con 0x5608e4683950 2024-09-11T00:25:54.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.925+0000 7fb3bf006740 1 -- 172.21.15.78:0/4191586053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e4683950 msgr2=0x5608e467fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:54.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.925+0000 7fb3bf006740 1 --2- 172.21.15.78:0/4191586053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e4683950 0x5608e467fb30 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac0058c0 tx=0x7fb3ac012f30 comp rx=0 tx=0).stop 2024-09-11T00:25:54.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.925+0000 7fb3bf006740 1 -- 172.21.15.78:0/4191586053 shutdown_connections 2024-09-11T00:25:54.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.925+0000 7fb3bf006740 1 --2- 172.21.15.78:0/4191586053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e4683950 0x5608e467fb30 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.925+0000 7fb3bf006740 1 --2- 172.21.15.78:0/4191586053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608e46779c0 0x5608e4676630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.925+0000 7fb3bf006740 1 --2- 172.21.15.78:0/4191586053 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608e46770a0 0x5608e468f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.925+0000 7fb3bf006740 1 -- 172.21.15.78:0/4191586053 >> 172.21.15.78:0/4191586053 conn(0x5608e4674ed0 msgr2=0x5608e4675f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:54.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.925+0000 7fb3bf006740 1 -- 172.21.15.78:0/4191586053 shutdown_connections 2024-09-11T00:25:54.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.925+0000 7fb3bf006740 1 -- 172.21.15.78:0/4191586053 wait complete. 2024-09-11T00:25:54.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.925+0000 7fb3bf006740 1 -- start start 2024-09-11T00:25:54.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.925+0000 7fb3bf006740 1 Processor -- start 2024-09-11T00:25:54.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.926+0000 7fb3bf006740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608e46770a0 0x5608e4688020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:54.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.926+0000 7fb3bf006740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608e46779c0 0x5608e4688560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:54.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.926+0000 7fb3bf006740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e4683950 0x5608e46ff2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:54.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.926+0000 7fb3bf006740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b81ad5b0 con 0x5608e4683950 2024-09-11T00:25:54.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.926+0000 7fb3bf006740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b81aea20 con 0x5608e46770a0 2024-09-11T00:25:54.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.926+0000 7fb3bf006740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b81adc80 con 0x5608e46779c0 2024-09-11T00:25:54.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.926+0000 7fb3bf006740 10 client.0 _ll_register_callbacks cb 0x7fb3ac00ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:25:54.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.926+0000 7fb3b5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e4683950 0x5608e46ff2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:54.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.926+0000 7fb3b5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e4683950 0x5608e46ff2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54452/0 (socket says 172.21.15.78:54452) 2024-09-11T00:25:54.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.926+0000 7fb3b5d9b640 1 -- 172.21.15.78:0/38673516 learned_addr learned my addr 172.21.15.78:0/38673516 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:25:54.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.926+0000 7fb3b659c640 1 --2- 172.21.15.78:0/38673516 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608e46779c0 0x5608e4688560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:54.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.926+0000 7fb3b5d9b640 1 --2- 172.21.15.78:0/38673516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608e46770a0 0x5608e4688020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:54.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.926+0000 7fb3b5d9b640 1 -- 172.21.15.78:0/38673516 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608e46779c0 msgr2=0x5608e4688560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:54.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.926+0000 7fb3b5d9b640 1 --2- 172.21.15.78:0/38673516 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608e46779c0 0x5608e4688560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.926+0000 7fb3b5d9b640 1 -- 172.21.15.78:0/38673516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608e46770a0 msgr2=0x5608e4688020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:25:54.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.926+0000 7fb3b5d9b640 1 --2- 172.21.15.78:0/38673516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608e46770a0 0x5608e4688020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.926+0000 7fb3b5d9b640 1 -- 172.21.15.78:0/38673516 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608e4695b60 con 0x5608e4683950 2024-09-11T00:25:54.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.926+0000 7fb3b659c640 1 --2- 172.21.15.78:0/38673516 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608e46779c0 0x5608e4688560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:25:54.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.926+0000 7fb3b5d9b640 1 --2- 172.21.15.78:0/38673516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e4683950 0x5608e46ff2e0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac00f9e0 tx=0x7fb3ac00fc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a27d73092a7102 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:25:54.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.926+0000 7fb39dffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:25:54.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.926+0000 7fb39dffb640 1 -- 172.21.15.78:0/38673516 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac00f670 con 0x5608e4683950 2024-09-11T00:25:54.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.927+0000 7fb39dffb640 1 -- 172.21.15.78:0/38673516 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8536+0+0 (secure 0 0 0) 0x7fb3ac030680 con 0x5608e4683950 2024-09-11T00:25:54.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.927+0000 7fb3bf006740 1 -- 172.21.15.78:0/38673516 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3ac00f810 con 0x5608e4683950 2024-09-11T00:25:54.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.927+0000 7fb39dffb640 1 -- 172.21.15.78:0/38673516 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb3ac00fe50 con 0x5608e4683950 2024-09-11T00:25:54.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.927+0000 7fb3bf006740 10 client.16683 fetch_fsmap learned FSMap version 20 2024-09-11T00:25:54.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.927+0000 7fb3bf006740 1 -- 172.21.15.78:0/38673516 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5608e4700ac0 con 0x5608e4683950 2024-09-11T00:25:54.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.927+0000 7fb39dffb640 1 -- 172.21.15.78:0/38673516 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3ac00f810 con 0x5608e4683950 2024-09-11T00:25:54.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.927+0000 7fb39dffb640 1 -- 172.21.15.78:0/38673516 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fb3ac005140 con 0x5608e4683950 2024-09-11T00:25:54.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.927+0000 7fb3bf006740 10 client.16683 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:25:54.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.927+0000 7fb3bf006740 10 client.16683 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:25:54.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.927+0000 7fb3bf006740 20 client.16683 populate_metadata read hostname 'smithi078' 2024-09-11T00:25:54.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.927+0000 7fb3bf006740 1 --2- 172.21.15.78:0/38673516 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5608e47011a0 0x5608e47035c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:25:54.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.927+0000 7fb3bf006740 4 client.16683 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:25:54.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.927+0000 7fb3bf006740 1 -- 172.21.15.78:0/38673516 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5608e45eb850 con 0x5608e47011a0 2024-09-11T00:25:54.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.927+0000 7fb3b659c640 1 --2- 172.21.15.78:0/38673516 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5608e47011a0 0x5608e47035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:25:54.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.928+0000 7fb39dffb640 10 client.16683 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:54.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.928+0000 7fb3b659c640 1 --2- 172.21.15.78:0/38673516 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5608e47011a0 0x5608e47035c0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba9c22ee5704f10c server_cookie=45691224d4a939d8 in_seq=0 out_seq=0 2024-09-11T00:25:54.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.928+0000 7fb39dffb640 1 -- 172.21.15.78:0/38673516 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5682 (crc 0 0 0) 0x5608e45eb850 con 0x5608e47011a0 2024-09-11T00:25:54.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.928+0000 7fb39dffb640 10 client.16683 handle_command_reply: tid=0 2024-09-11T00:25:54.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.928+0000 7fb3bf006740 1 client.16683 shutdown 2024-09-11T00:25:54.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.928+0000 7fb3bf006740 1 -- 172.21.15.78:0/38673516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e4683950 msgr2=0x5608e46ff2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:54.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.928+0000 7fb3bf006740 1 --2- 172.21.15.78:0/38673516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e4683950 0x5608e46ff2e0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac00f9e0 tx=0x7fb3ac00fc50 comp rx=0 tx=0).stop 2024-09-11T00:25:54.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.928+0000 7fb3bf006740 1 -- 172.21.15.78:0/38673516 shutdown_connections 2024-09-11T00:25:54.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.928+0000 7fb3bf006740 1 --2- 172.21.15.78:0/38673516 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x5608e47011a0 0x5608e47035c0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.928+0000 7fb3bf006740 1 --2- 172.21.15.78:0/38673516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5608e4683950 0x5608e46ff2e0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.928+0000 7fb3bf006740 1 --2- 172.21.15.78:0/38673516 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5608e46779c0 0x5608e4688560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.928+0000 7fb39dffb640 0 client.16683 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:25:54.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.928+0000 7fb3bf006740 1 --2- 172.21.15.78:0/38673516 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5608e46770a0 0x5608e4688020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.928+0000 7fb3bf006740 1 -- 172.21.15.78:0/38673516 >> 172.21.15.78:0/38673516 conn(0x5608e4674ed0 msgr2=0x5608e4681c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:54.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.928+0000 7fb3bf006740 1 -- 172.21.15.78:0/38673516 shutdown_connections 2024-09-11T00:25:54.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.928+0000 7fb3bf006740 1 -- 172.21.15.78:0/38673516 wait complete. 2024-09-11T00:25:54.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.928+0000 7fb3bf006740 20 client.16683 trim_cache size 0 max 16384 2024-09-11T00:25:54.948 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:25:54.949 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T00:25:54.949 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-11T00:25:54.949 INFO:teuthology.orchestra.run.smithi078.stdout: "9920e47e-5aad-446c-9450-0057a7201a30": { 2024-09-11T00:25:54.949 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:54.949 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "9920e47e-5aad-446c-9450-0057a7201a30", 2024-09-11T00:25:54.949 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-11T00:25:54.949 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:25:54.949 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:54.949 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:25:54.949 INFO:teuthology.orchestra.run.smithi078.stdout: "9920e47e-5aad-446c-9450-0057a7201a30": { 2024-09-11T00:25:54.949 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:25:53.268082+0000", 2024-09-11T00:25:54.949 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:54.949 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:54.950 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:54.950 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:54.950 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:54.950 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:54.950 INFO:teuthology.orchestra.run.smithi078.stdout: "d570d2aa-a4ac-43b2-b13a-66aa0f566bb6": { 2024-09-11T00:25:54.950 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:25:46.078268+0000", 2024-09-11T00:25:54.950 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:54.950 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:54.950 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:54.950 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:54.950 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:54.950 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:54.950 INFO:teuthology.orchestra.run.smithi078.stdout: "f6eb5d15-216e-4f8b-b451-2f71b931998f": { 2024-09-11T00:25:54.951 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:48.289319+0000", 2024-09-11T00:25:54.951 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:54.951 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:54.951 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:54.951 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:54.951 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:54.951 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:54.951 INFO:teuthology.orchestra.run.smithi078.stdout: "e21db329-a274-4cfd-924a-8ec929e04bd1": { 2024-09-11T00:25:54.951 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:41.131504+0000", 2024-09-11T00:25:54.951 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:54.951 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:54.951 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:54.951 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:54.951 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:54.952 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:54.952 INFO:teuthology.orchestra.run.smithi078.stdout: "b854cbd3-8ca7-4277-a205-8887d2ff5567": { 2024-09-11T00:25:54.952 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:11.182949+0000", 2024-09-11T00:25:54.952 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:54.952 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:54.952 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:54.952 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:54.952 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:54.952 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:54.952 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:25:54.953 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:25:54.953 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:54.953 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:54.953 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:54.953 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:54.953 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:54.953 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:54.953 INFO:teuthology.orchestra.run.smithi078.stdout: "59d341c2-815c-48b1-a216-aa6fac6078a0": { 2024-09-11T00:25:54.953 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:25:06.855284+0000", 2024-09-11T00:25:54.954 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:54.954 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:54.954 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:54.954 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:54.954 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:54.954 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:54.954 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:25:54.954 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:25:54.954 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:54.954 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:54.954 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:54.954 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:54.954 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:54.954 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:54.955 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:25:54.955 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:25:54.955 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:54.955 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:54.955 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:54.955 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:54.955 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:54.955 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:54.955 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:25:54.955 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:25:54.955 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:54.955 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:54.955 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:54.955 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:54.955 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:54.956 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:54.956 INFO:teuthology.orchestra.run.smithi078.stdout: "81d31d3a-c224-4ded-9f00-1a7dfc099ec4": { 2024-09-11T00:25:54.956 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:16.296700+0000", 2024-09-11T00:25:54.956 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:54.956 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:54.956 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:54.956 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:54.956 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:54.956 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:54.957 INFO:teuthology.orchestra.run.smithi078.stdout: "1c04b4f1-c4c4-4289-b172-fba45b64018a": { 2024-09-11T00:25:54.957 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:24:27.591301+0000", 2024-09-11T00:25:54.957 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:54.957 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:54.957 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:54.957 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:54.957 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:54.957 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:54.957 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:25:54.957 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:25:54.957 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:54.957 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:54.958 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:54.958 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:54.958 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:54.958 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:54.958 INFO:teuthology.orchestra.run.smithi078.stdout: "38a1d30d-5f4c-460a-afcd-e6c60b97e43a": { 2024-09-11T00:25:54.958 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:58.127727+0000", 2024-09-11T00:25:54.958 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:54.958 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:54.958 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:54.958 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:54.958 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:54.958 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:54.958 INFO:teuthology.orchestra.run.smithi078.stdout: "8ec9e858-aa62-420d-a112-e62ea7810e63": { 2024-09-11T00:25:54.958 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:18.882749+0000", 2024-09-11T00:25:54.959 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:54.959 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:54.959 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:54.959 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:54.959 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:54.959 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:54.959 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:25:54.959 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:25:54.959 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:54.959 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:54.959 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:54.959 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:54.959 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:54.959 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:54.960 INFO:teuthology.orchestra.run.smithi078.stdout: "1b9391c2-08f3-479a-9538-deea28f7743b": { 2024-09-11T00:25:54.960 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:02.327508+0000", 2024-09-11T00:25:54.960 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:54.960 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:54.960 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:54.960 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:54.960 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:54.960 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:54.960 INFO:teuthology.orchestra.run.smithi078.stdout: "e0002672-e432-4890-ab9f-20c513c5e3b6": { 2024-09-11T00:25:54.960 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:21:37.161715+0000", 2024-09-11T00:25:54.960 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:54.960 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:54.960 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:54.961 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:54.961 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:54.961 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:25:54.961 INFO:teuthology.orchestra.run.smithi078.stdout: "f494d5ed-e0dc-44bb-8aba-a861b3e751f4": { 2024-09-11T00:25:54.961 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:55.251691+0000", 2024-09-11T00:25:54.961 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:25:54.961 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:25:54.961 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:25:54.961 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:25:54.961 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:25:54.961 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:25:54.961 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:25:54.961 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:25:54.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.929+0000 7fb3bcc31640 1 -- 172.21.15.78:0/631502911 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb3a00b54d0 msgr2=0x7fb3a00b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:54.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.929+0000 7fb3bcc31640 1 --2- 172.21.15.78:0/631502911 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb3a00b54d0 0x7fb3a00b7990 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb3b00e2fa0 tx=0x7fb3b0074d70 comp rx=0 tx=0).stop 2024-09-11T00:25:54.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.929+0000 7fb3bcc31640 1 -- 172.21.15.78:0/631502911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3b8108040 msgr2=0x7fb3b819ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:25:54.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.929+0000 7fb3bcc31640 1 --2- 172.21.15.78:0/631502911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3b8108040 0x7fb3b819ebd0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000b970 tx=0x7fb3b000be30 comp rx=0 tx=0).stop 2024-09-11T00:25:54.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.929+0000 7fb3bcc31640 1 -- 172.21.15.78:0/631502911 shutdown_connections 2024-09-11T00:25:54.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.929+0000 7fb3bcc31640 1 --2- 172.21.15.78:0/631502911 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fb3a00b54d0 0x7fb3a00b7990 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.929+0000 7fb3bcc31640 1 --2- 172.21.15.78:0/631502911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3b8108040 0x7fb3b819ebd0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.929+0000 7fb3bcc31640 1 --2- 172.21.15.78:0/631502911 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3b81076c0 0x7fb3b8199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.929+0000 7fb3bcc31640 1 --2- 172.21.15.78:0/631502911 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb3b8101cb0 0x7fb3b81992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:25:54.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.929+0000 7fb3bcc31640 1 -- 172.21.15.78:0/631502911 >> 172.21.15.78:0/631502911 conn(0x7fb3b80fd700 msgr2=0x7fb3b806b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:25:54.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.929+0000 7fb3bcc31640 1 -- 172.21.15.78:0/631502911 shutdown_connections 2024-09-11T00:25:54.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:25:54.929+0000 7fb3bcc31640 1 -- 172.21.15.78:0/631502911 wait complete. 2024-09-11T00:25:55.731 INFO:tasks.cephfs.filesystem:scrub status for tag:9920e47e-5aad-446c-9450-0057a7201a30 - {'path': '/', 'tag': '9920e47e-5aad-446c-9450-0057a7201a30', 'options': 'recursive,force'} 2024-09-11T00:25:56.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:55 smithi078 ceph-mon[30865]: pgmap v613: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-11T00:25:56.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:55 smithi112 ceph-mon[35627]: pgmap v613: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-11T00:25:56.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:55 smithi138 ceph-mon[35019]: pgmap v613: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-11T00:25:57.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:56 smithi112 ceph-mon[35627]: scrub summary: idle 2024-09-11T00:25:57.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:56 smithi138 ceph-mon[35019]: scrub summary: idle 2024-09-11T00:25:57.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:56 smithi078 ceph-mon[30865]: scrub summary: idle 2024-09-11T00:25:58.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:57 smithi112 ceph-mon[35627]: pgmap v614: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T00:25:58.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:57 smithi138 ceph-mon[35019]: pgmap v614: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T00:25:58.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:57 smithi078 ceph-mon[30865]: pgmap v614: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T00:26:00.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:25:59 smithi112 ceph-mon[35627]: pgmap v615: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T00:26:00.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:25:59 smithi138 ceph-mon[35019]: pgmap v615: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T00:26:00.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:25:59 smithi078 ceph-mon[30865]: pgmap v615: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-11T00:26:02.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:01 smithi112 ceph-mon[35627]: pgmap v616: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 21 KiB/s wr, 17 op/s 2024-09-11T00:26:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:01 smithi138 ceph-mon[35019]: pgmap v616: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 21 KiB/s wr, 17 op/s 2024-09-11T00:26:02.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:01 smithi078 ceph-mon[30865]: pgmap v616: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 21 KiB/s wr, 17 op/s 2024-09-11T00:26:04.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:03 smithi112 ceph-mon[35627]: pgmap v617: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-11T00:26:04.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:03 smithi138 ceph-mon[35019]: pgmap v617: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-11T00:26:04.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:03 smithi078 ceph-mon[30865]: pgmap v617: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-11T00:26:06.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:05 smithi112 ceph-mon[35627]: pgmap v618: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T00:26:06.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:05 smithi138 ceph-mon[35019]: pgmap v618: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T00:26:06.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:05 smithi078 ceph-mon[30865]: pgmap v618: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-11T00:26:08.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:07 smithi112 ceph-mon[35627]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T00:26:08.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:07 smithi112 ceph-mon[35627]: pgmap v620: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T00:26:08.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:07 smithi138 ceph-mon[35019]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T00:26:08.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:07 smithi138 ceph-mon[35019]: pgmap v620: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T00:26:08.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:07 smithi078 ceph-mon[30865]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T00:26:08.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:07 smithi078 ceph-mon[30865]: pgmap v620: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T00:26:10.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:09 smithi112 ceph-mon[35627]: pgmap v621: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T00:26:10.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:09 smithi138 ceph-mon[35019]: pgmap v621: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T00:26:10.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:09 smithi078 ceph-mon[30865]: pgmap v621: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-11T00:26:12.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:11 smithi112 ceph-mon[35627]: pgmap v622: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 28 KiB/s wr, 5 op/s 2024-09-11T00:26:12.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:11 smithi138 ceph-mon[35019]: pgmap v622: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 28 KiB/s wr, 5 op/s 2024-09-11T00:26:12.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:11 smithi078 ceph-mon[30865]: pgmap v622: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 28 KiB/s wr, 5 op/s 2024-09-11T00:26:14.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:13 smithi112 ceph-mon[35627]: pgmap v623: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 921 B/s wr, 2 op/s 2024-09-11T00:26:14.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:13 smithi138 ceph-mon[35019]: pgmap v623: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 921 B/s wr, 2 op/s 2024-09-11T00:26:14.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:13 smithi078 ceph-mon[30865]: pgmap v623: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 921 B/s wr, 2 op/s 2024-09-11T00:26:15.054 DEBUG:teuthology.orchestra.run.smithi078:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-11T00:26:15.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.166+0000 7f7159332640 1 -- 172.21.15.78:0/2064720581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7154102cf0 msgr2=0x7f71541030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:15.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.166+0000 7f7159332640 1 --2- 172.21.15.78:0/2064720581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7154102cf0 0x7f71541030d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f7144009900 tx=0x7f714402a410 comp rx=0 tx=0).stop 2024-09-11T00:26:15.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.166+0000 7f7159332640 1 -- 172.21.15.78:0/2064720581 shutdown_connections 2024-09-11T00:26:15.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.166+0000 7f7159332640 1 --2- 172.21.15.78:0/2064720581 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7154109070 0x7f715410f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:15.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.166+0000 7f7159332640 1 --2- 172.21.15.78:0/2064720581 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f71541086f0 0x7f7154108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:15.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.166+0000 7f7159332640 1 --2- 172.21.15.78:0/2064720581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7154102cf0 0x7f71541030d0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:15.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.166+0000 7f7159332640 1 -- 172.21.15.78:0/2064720581 >> 172.21.15.78:0/2064720581 conn(0x7f71540fe730 msgr2=0x7f7154100b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:15.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.166+0000 7f7159332640 1 -- 172.21.15.78:0/2064720581 shutdown_connections 2024-09-11T00:26:15.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.166+0000 7f7159332640 1 -- 172.21.15.78:0/2064720581 wait complete. 2024-09-11T00:26:15.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.166+0000 7f7159332640 1 Processor -- start 2024-09-11T00:26:15.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.166+0000 7f7159332640 1 -- start start 2024-09-11T00:26:15.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.167+0000 7f7159332640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7154102cf0 0x7f71541991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:15.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.167+0000 7f7159332640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71541086f0 0x7f71541996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:15.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.167+0000 7f7159332640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7154109070 0x7f715419ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:15.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.167+0000 7f7159332640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7154112d30 con 0x7f7154109070 2024-09-11T00:26:15.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.167+0000 7f7159332640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7154112bb0 con 0x7f71541086f0 2024-09-11T00:26:15.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.167+0000 7f7159332640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7154112eb0 con 0x7f7154102cf0 2024-09-11T00:26:15.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.167+0000 7f71537fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7154109070 0x7f715419ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:15.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.167+0000 7f71537fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7154109070 0x7f715419ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60672/0 (socket says 172.21.15.78:60672) 2024-09-11T00:26:15.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.167+0000 7f71537fe640 1 -- 172.21.15.78:0/1936782207 learned_addr learned my addr 172.21.15.78:0/1936782207 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:26:15.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.167+0000 7f714a7fc640 1 --2- 172.21.15.78:0/1936782207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71541086f0 0x7f71541996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:15.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.167+0000 7f7152ffd640 1 --2- 172.21.15.78:0/1936782207 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7154102cf0 0x7f71541991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:15.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.167+0000 7f71537fe640 1 -- 172.21.15.78:0/1936782207 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7154102cf0 msgr2=0x7f71541991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:15.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.167+0000 7f71537fe640 1 --2- 172.21.15.78:0/1936782207 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7154102cf0 0x7f71541991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:15.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.167+0000 7f71537fe640 1 -- 172.21.15.78:0/1936782207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71541086f0 msgr2=0x7f71541996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:15.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.167+0000 7f71537fe640 1 --2- 172.21.15.78:0/1936782207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71541086f0 0x7f71541996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:15.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.167+0000 7f71537fe640 1 -- 172.21.15.78:0/1936782207 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715419f250 con 0x7f7154109070 2024-09-11T00:26:15.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.167+0000 7f71537fe640 1 --2- 172.21.15.78:0/1936782207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7154109070 0x7f715419ea80 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f714c00cce0 tx=0x7f714c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:15.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.167+0000 7f7150ff9640 1 -- 172.21.15.78:0/1936782207 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c00f450 con 0x7f7154109070 2024-09-11T00:26:15.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.167+0000 7f7150ff9640 1 -- 172.21.15.78:0/1936782207 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f714c00faa0 con 0x7f7154109070 2024-09-11T00:26:15.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.167+0000 7f7159332640 1 -- 172.21.15.78:0/1936782207 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f715419f540 con 0x7f7154109070 2024-09-11T00:26:15.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.167+0000 7f7150ff9640 1 -- 172.21.15.78:0/1936782207 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c018b70 con 0x7f7154109070 2024-09-11T00:26:15.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.167+0000 7f7159332640 1 -- 172.21.15.78:0/1936782207 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71541a5c00 con 0x7f7154109070 2024-09-11T00:26:15.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.168+0000 7f7159332640 1 -- 172.21.15.78:0/1936782207 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71541030d0 con 0x7f7154109070 2024-09-11T00:26:15.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.170+0000 7f7150ff9640 1 -- 172.21.15.78:0/1936782207 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f714c00f5f0 con 0x7f7154109070 2024-09-11T00:26:15.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.171+0000 7f7150ff9640 1 --2- 172.21.15.78:0/1936782207 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f71400b5450 0x7f71400b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:15.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.171+0000 7f7152ffd640 1 --2- 172.21.15.78:0/1936782207 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f71400b5450 0x7f71400b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:15.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.171+0000 7f7150ff9640 1 -- 172.21.15.78:0/1936782207 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8580+0+0 (secure 0 0 0) 0x7f714c0e6870 con 0x7f7154109070 2024-09-11T00:26:15.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.171+0000 7f7152ffd640 1 --2- 172.21.15.78:0/1936782207 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f71400b5450 0x7f71400b7910 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7144031440 tx=0x7f71440095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:15.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.175+0000 7f7150ff9640 1 -- 172.21.15.78:0/1936782207 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f714c014030 con 0x7f7154109070 2024-09-11T00:26:15.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.371+0000 7f7159332640 1 -- 172.21.15.78:0/1936782207 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f7154100660 con 0x7f71400b5450 2024-09-11T00:26:15.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.379+0000 7f7150ff9640 1 -- 172.21.15.78:0/1936782207 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f7154100660 con 0x7f71400b5450 2024-09-11T00:26:15.382 INFO:teuthology.orchestra.run.smithi078.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-11T00:00:00", "created": "2024-09-11T00:16:13", "first": "2024-09-11T00:17:00", "last": "2024-09-11T00:26:00", "last_pruned": "2024-09-11T00:26:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-11T00:26:15.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.381+0000 7f7159332640 1 -- 172.21.15.78:0/1936782207 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f71400b5450 msgr2=0x7f71400b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:15.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.381+0000 7f7159332640 1 --2- 172.21.15.78:0/1936782207 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f71400b5450 0x7f71400b7910 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7144031440 tx=0x7f71440095f0 comp rx=0 tx=0).stop 2024-09-11T00:26:15.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.381+0000 7f7159332640 1 -- 172.21.15.78:0/1936782207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7154109070 msgr2=0x7f715419ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:15.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.381+0000 7f7159332640 1 --2- 172.21.15.78:0/1936782207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7154109070 0x7f715419ea80 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f714c00cce0 tx=0x7f714c00a620 comp rx=0 tx=0).stop 2024-09-11T00:26:15.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.381+0000 7f7159332640 1 -- 172.21.15.78:0/1936782207 shutdown_connections 2024-09-11T00:26:15.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.381+0000 7f7159332640 1 --2- 172.21.15.78:0/1936782207 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f71400b5450 0x7f71400b7910 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:15.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.381+0000 7f7159332640 1 --2- 172.21.15.78:0/1936782207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7154109070 0x7f715419ea80 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:15.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.381+0000 7f7159332640 1 --2- 172.21.15.78:0/1936782207 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71541086f0 0x7f71541996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:15.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.381+0000 7f7159332640 1 --2- 172.21.15.78:0/1936782207 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7154102cf0 0x7f71541991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:15.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.381+0000 7f7159332640 1 -- 172.21.15.78:0/1936782207 >> 172.21.15.78:0/1936782207 conn(0x7f71540fe730 msgr2=0x7f71540fff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:15.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.381+0000 7f7159332640 1 -- 172.21.15.78:0/1936782207 shutdown_connections 2024-09-11T00:26:15.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.381+0000 7f7159332640 1 -- 172.21.15.78:0/1936782207 wait complete. 2024-09-11T00:26:15.395 DEBUG:teuthology.orchestra.run.smithi078:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-11T00:26:15.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.497+0000 7f272dfcd640 1 -- 172.21.15.78:0/3745993572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2728104530 msgr2=0x7f272810ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:15.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.497+0000 7f272dfcd640 1 --2- 172.21.15.78:0/3745993572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2728104530 0x7f272810ca10 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f271c009900 tx=0x7f271c02a410 comp rx=0 tx=0).stop 2024-09-11T00:26:15.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.497+0000 7f272dfcd640 1 -- 172.21.15.78:0/3745993572 shutdown_connections 2024-09-11T00:26:15.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.497+0000 7f272dfcd640 1 --2- 172.21.15.78:0/3745993572 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f272810d060 0x7f272810f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:15.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.497+0000 7f272dfcd640 1 --2- 172.21.15.78:0/3745993572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2728104530 0x7f272810ca10 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:15.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.497+0000 7f272dfcd640 1 --2- 172.21.15.78:0/3745993572 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2728103c10 0x7f2728103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:15.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.497+0000 7f272dfcd640 1 -- 172.21.15.78:0/3745993572 >> 172.21.15.78:0/3745993572 conn(0x7f27280fd680 msgr2=0x7f27280ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:15.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.497+0000 7f272dfcd640 1 -- 172.21.15.78:0/3745993572 shutdown_connections 2024-09-11T00:26:15.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.497+0000 7f272dfcd640 1 -- 172.21.15.78:0/3745993572 wait complete. 2024-09-11T00:26:15.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.498+0000 7f272dfcd640 1 Processor -- start 2024-09-11T00:26:15.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.498+0000 7f272dfcd640 1 -- start start 2024-09-11T00:26:15.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.498+0000 7f272dfcd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2728103c10 0x7f2728199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:15.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.498+0000 7f272dfcd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2728104530 0x7f27281997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:15.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.498+0000 7f272dfcd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f272810d060 0x7f272819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:15.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.498+0000 7f272dfcd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2728112d30 con 0x7f272810d060 2024-09-11T00:26:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.498+0000 7f272dfcd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2728112bb0 con 0x7f2728103c10 2024-09-11T00:26:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.498+0000 7f272dfcd640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2728112eb0 con 0x7f2728104530 2024-09-11T00:26:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.498+0000 7f2727fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f272810d060 0x7f272819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.498+0000 7f2727fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f272810d060 0x7f272819eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60692/0 (socket says 172.21.15.78:60692) 2024-09-11T00:26:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.498+0000 7f2727fff640 1 -- 172.21.15.78:0/1841991661 learned_addr learned my addr 172.21.15.78:0/1841991661 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:26:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.498+0000 7f27277fe640 1 --2- 172.21.15.78:0/1841991661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2728103c10 0x7f2728199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.499+0000 7f2726ffd640 1 --2- 172.21.15.78:0/1841991661 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2728104530 0x7f27281997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.499+0000 7f2727fff640 1 -- 172.21.15.78:0/1841991661 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2728104530 msgr2=0x7f27281997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.499+0000 7f2727fff640 1 --2- 172.21.15.78:0/1841991661 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2728104530 0x7f27281997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.499+0000 7f2727fff640 1 -- 172.21.15.78:0/1841991661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2728103c10 msgr2=0x7f2728199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.499+0000 7f2727fff640 1 --2- 172.21.15.78:0/1841991661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2728103c10 0x7f2728199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.499+0000 7f2727fff640 1 -- 172.21.15.78:0/1841991661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f272819f330 con 0x7f272810d060 2024-09-11T00:26:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.499+0000 7f27277fe640 1 --2- 172.21.15.78:0/1841991661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2728103c10 0x7f2728199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:26:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.499+0000 7f2727fff640 1 --2- 172.21.15.78:0/1841991661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f272810d060 0x7f272819eb60 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2720009fd0 tx=0x7f272000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.499+0000 7f2724ff9640 1 -- 172.21.15.78:0/1841991661 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2720011830 con 0x7f272810d060 2024-09-11T00:26:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.499+0000 7f2724ff9640 1 -- 172.21.15.78:0/1841991661 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2720016070 con 0x7f272810d060 2024-09-11T00:26:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.499+0000 7f272dfcd640 1 -- 172.21.15.78:0/1841991661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f272819f620 con 0x7f272810d060 2024-09-11T00:26:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.499+0000 7f2724ff9640 1 -- 172.21.15.78:0/1841991661 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2720010de0 con 0x7f272810d060 2024-09-11T00:26:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.499+0000 7f272dfcd640 1 -- 172.21.15.78:0/1841991661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27281a5d60 con 0x7f272810d060 2024-09-11T00:26:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.500+0000 7f272dfcd640 1 -- 172.21.15.78:0/1841991661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f272806bab0 con 0x7f272810d060 2024-09-11T00:26:15.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.501+0000 7f2724ff9640 1 -- 172.21.15.78:0/1841991661 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f27200119d0 con 0x7f272810d060 2024-09-11T00:26:15.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.502+0000 7f2724ff9640 1 --2- 172.21.15.78:0/1841991661 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f27100b54d0 0x7f27100b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:15.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.502+0000 7f27277fe640 1 --2- 172.21.15.78:0/1841991661 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f27100b54d0 0x7f27100b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:15.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.502+0000 7f2724ff9640 1 -- 172.21.15.78:0/1841991661 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8580+0+0 (secure 0 0 0) 0x7f27200e5d20 con 0x7f272810d060 2024-09-11T00:26:15.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.503+0000 7f27277fe640 1 --2- 172.21.15.78:0/1841991661 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f27100b54d0 0x7f27100b7990 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2718005fd0 tx=0x7f2718009520 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:15.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.505+0000 7f2724ff9640 1 -- 172.21.15.78:0/1841991661 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f27200ac860 con 0x7f272810d060 2024-09-11T00:26:15.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.705+0000 7f272dfcd640 1 -- 172.21.15.78:0/1841991661 --> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f2728063590 con 0x7f27100b54d0 2024-09-11T00:26:15.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.717+0000 7f2724ff9640 1 -- 172.21.15.78:0/1841991661 <== mgr.14220 v2:172.21.15.78:6800/3195506449 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f2728063590 con 0x7f27100b54d0 2024-09-11T00:26:15.719 INFO:teuthology.orchestra.run.smithi078.stdout:/ 1m 6m3h 2024-09-11T00:26:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.720+0000 7f272dfcd640 1 -- 172.21.15.78:0/1841991661 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f27100b54d0 msgr2=0x7f27100b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.720+0000 7f272dfcd640 1 --2- 172.21.15.78:0/1841991661 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f27100b54d0 0x7f27100b7990 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2718005fd0 tx=0x7f2718009520 comp rx=0 tx=0).stop 2024-09-11T00:26:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.720+0000 7f272dfcd640 1 -- 172.21.15.78:0/1841991661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f272810d060 msgr2=0x7f272819eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.720+0000 7f272dfcd640 1 --2- 172.21.15.78:0/1841991661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f272810d060 0x7f272819eb60 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2720009fd0 tx=0x7f272000b8e0 comp rx=0 tx=0).stop 2024-09-11T00:26:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.720+0000 7f272dfcd640 1 -- 172.21.15.78:0/1841991661 shutdown_connections 2024-09-11T00:26:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.720+0000 7f272dfcd640 1 --2- 172.21.15.78:0/1841991661 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f27100b54d0 0x7f27100b7990 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.720+0000 7f272dfcd640 1 --2- 172.21.15.78:0/1841991661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f272810d060 0x7f272819eb60 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.720+0000 7f272dfcd640 1 --2- 172.21.15.78:0/1841991661 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2728104530 0x7f27281997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.720+0000 7f272dfcd640 1 --2- 172.21.15.78:0/1841991661 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2728103c10 0x7f2728199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.720+0000 7f272dfcd640 1 -- 172.21.15.78:0/1841991661 >> 172.21.15.78:0/1841991661 conn(0x7f27280fd680 msgr2=0x7f27280fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.720+0000 7f272dfcd640 1 -- 172.21.15.78:0/1841991661 shutdown_connections 2024-09-11T00:26:15.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:15.720+0000 7f272dfcd640 1 -- 172.21.15.78:0/1841991661 wait complete. 2024-09-11T00:26:15.732 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-11T00:26:15.743 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-11T00:26:16.934 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:16 smithi112 ceph-mon[35627]: from='client.16689 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:26:16.935 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:16 smithi112 ceph-mon[35627]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T00:26:16.935 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:16 smithi112 ceph-mon[35627]: from='client.16695 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:26:16.935 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:16 smithi112 ceph-mon[35627]: pgmap v625: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 229 B/s wr, 5 op/s 2024-09-11T00:26:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:16 smithi138 ceph-mon[35019]: from='client.16689 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:26:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:16 smithi138 ceph-mon[35019]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T00:26:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:16 smithi138 ceph-mon[35019]: from='client.16695 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:26:17.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:16 smithi138 ceph-mon[35019]: pgmap v625: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 229 B/s wr, 5 op/s 2024-09-11T00:26:17.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:16 smithi078 ceph-mon[30865]: from='client.16689 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:26:17.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:16 smithi078 ceph-mon[30865]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T00:26:17.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:16 smithi078 ceph-mon[30865]: from='client.16695 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:26:17.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:16 smithi078 ceph-mon[30865]: pgmap v625: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 229 B/s wr, 5 op/s 2024-09-11T00:26:18.235 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:17 smithi112 ceph-mon[35627]: pgmap v626: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-11T00:26:18.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:17 smithi138 ceph-mon[35019]: pgmap v626: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-11T00:26:18.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:17 smithi078 ceph-mon[30865]: pgmap v626: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-11T00:26:20.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:19 smithi112 ceph-mon[35627]: pgmap v627: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-11T00:26:20.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:19 smithi138 ceph-mon[35019]: pgmap v627: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-11T00:26:20.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:19 smithi078 ceph-mon[30865]: pgmap v627: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 5 op/s 2024-09-11T00:26:22.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:21 smithi112 ceph-mon[35627]: pgmap v628: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 5 op/s 2024-09-11T00:26:22.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:21 smithi138 ceph-mon[35019]: pgmap v628: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 5 op/s 2024-09-11T00:26:22.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:21 smithi078 ceph-mon[30865]: pgmap v628: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 5 op/s 2024-09-11T00:26:24.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:23 smithi112 ceph-mon[35627]: pgmap v629: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 5 op/s 2024-09-11T00:26:24.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:23 smithi138 ceph-mon[35019]: pgmap v629: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 5 op/s 2024-09-11T00:26:24.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:23 smithi078 ceph-mon[30865]: pgmap v629: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 5 op/s 2024-09-11T00:26:25.732 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T00:26:25.994 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:26:26.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:25 smithi078 ceph-mon[30865]: pgmap v630: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-11T00:26:26.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:25 smithi112 ceph-mon[35627]: pgmap v630: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-11T00:26:26.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:25 smithi138 ceph-mon[35019]: pgmap v630: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-11T00:26:26.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.482+0000 7fec46b71640 1 -- 172.21.15.78:0/92537305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec40108020 msgr2=0x7fec4010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:26.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.482+0000 7fec46b71640 1 --2- 172.21.15.78:0/92537305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec40108020 0x7fec4010e820 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fec38009ca0 tx=0x7fec3802a8c0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.482+0000 7fec46b71640 1 -- 172.21.15.78:0/92537305 shutdown_connections 2024-09-11T00:26:26.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.482+0000 7fec46b71640 1 --2- 172.21.15.78:0/92537305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec40108020 0x7fec4010e820 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.482+0000 7fec46b71640 1 --2- 172.21.15.78:0/92537305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec401076a0 0x7fec40107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.482+0000 7fec46b71640 1 --2- 172.21.15.78:0/92537305 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec40101c90 0x7fec40102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.482+0000 7fec46b71640 1 -- 172.21.15.78:0/92537305 >> 172.21.15.78:0/92537305 conn(0x7fec400fd700 msgr2=0x7fec400ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:26.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.482+0000 7fec46b71640 1 -- 172.21.15.78:0/92537305 shutdown_connections 2024-09-11T00:26:26.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.482+0000 7fec46b71640 1 -- 172.21.15.78:0/92537305 wait complete. 2024-09-11T00:26:26.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.483+0000 7fec46b71640 1 Processor -- start 2024-09-11T00:26:26.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.483+0000 7fec46b71640 1 -- start start 2024-09-11T00:26:26.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.483+0000 7fec46b71640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec40101c90 0x7fec400fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:26.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.483+0000 7fec46b71640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec401076a0 0x7fec400fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:26.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.483+0000 7fec46b71640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec40108020 0x7fec400fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:26.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.483+0000 7fec46b71640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fec40111ce0 con 0x7fec401076a0 2024-09-11T00:26:26.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.483+0000 7fec46b71640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fec40111b60 con 0x7fec40101c90 2024-09-11T00:26:26.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.483+0000 7fec46b71640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fec40111e60 con 0x7fec40108020 2024-09-11T00:26:26.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.483+0000 7fec3ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec401076a0 0x7fec400fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:26.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.483+0000 7fec3ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec401076a0 0x7fec400fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60744/0 (socket says 172.21.15.78:60744) 2024-09-11T00:26:26.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.483+0000 7fec3ffff640 1 -- 172.21.15.78:0/1247925410 learned_addr learned my addr 172.21.15.78:0/1247925410 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:26:26.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.483+0000 7fec4510e640 1 --2- 172.21.15.78:0/1247925410 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec40108020 0x7fec400fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:26.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.483+0000 7fec4490d640 1 --2- 172.21.15.78:0/1247925410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec40101c90 0x7fec400fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:26.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.483+0000 7fec3ffff640 1 -- 172.21.15.78:0/1247925410 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec40108020 msgr2=0x7fec400fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:26.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.483+0000 7fec3ffff640 1 --2- 172.21.15.78:0/1247925410 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec40108020 0x7fec400fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.483+0000 7fec3ffff640 1 -- 172.21.15.78:0/1247925410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec40101c90 msgr2=0x7fec400fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:26.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.483+0000 7fec3ffff640 1 --2- 172.21.15.78:0/1247925410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec40101c90 0x7fec400fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.483+0000 7fec3ffff640 1 -- 172.21.15.78:0/1247925410 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec401a7690 con 0x7fec401076a0 2024-09-11T00:26:26.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.484+0000 7fec3ffff640 1 --2- 172.21.15.78:0/1247925410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec401076a0 0x7fec400fe140 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fec2c00b4a0 tx=0x7fec2c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:26.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.484+0000 7fec3dffb640 1 -- 172.21.15.78:0/1247925410 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2c015020 con 0x7fec401076a0 2024-09-11T00:26:26.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.484+0000 7fec46b71640 1 -- 172.21.15.78:0/1247925410 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec401a7980 con 0x7fec401076a0 2024-09-11T00:26:26.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.484+0000 7fec3dffb640 1 -- 172.21.15.78:0/1247925410 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec2c011ce0 con 0x7fec401076a0 2024-09-11T00:26:26.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.484+0000 7fec3dffb640 1 -- 172.21.15.78:0/1247925410 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2c010dc0 con 0x7fec401076a0 2024-09-11T00:26:26.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.484+0000 7fec46b71640 1 -- 172.21.15.78:0/1247925410 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec401a7f90 con 0x7fec401076a0 2024-09-11T00:26:26.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.486+0000 7fec3dffb640 1 -- 172.21.15.78:0/1247925410 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fec2c011830 con 0x7fec401076a0 2024-09-11T00:26:26.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.487+0000 7fec48f46740 1 Processor -- start 2024-09-11T00:26:26.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.487+0000 7fec48f46740 1 -- start start 2024-09-11T00:26:26.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.487+0000 7fec48f46740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260480 0x556ef1260860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:26.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.487+0000 7fec48f46740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556ef1260da0 0x556ef126c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:26.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.487+0000 7fec3dffb640 1 --2- 172.21.15.78:0/1247925410 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fec300b5450 0x7fec300b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:26.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.487+0000 7fec48f46740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ef126cd30 0x556ef126f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:26.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.487+0000 7fec48f46740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x556ef11d6e50 con 0x556ef1260480 2024-09-11T00:26:26.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.487+0000 7fec48f46740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556ef11c6280 con 0x556ef1260da0 2024-09-11T00:26:26.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.487+0000 7fec48f46740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x556ef11ca090 con 0x556ef126cd30 2024-09-11T00:26:26.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.487+0000 7fec4510e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260480 0x556ef1260860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:26.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.487+0000 7fec4510e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260480 0x556ef1260860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60754/0 (socket says 172.21.15.78:60754) 2024-09-11T00:26:26.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.487+0000 7fec4510e640 1 -- 172.21.15.78:0/1326807170 learned_addr learned my addr 172.21.15.78:0/1326807170 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:26:26.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.487+0000 7fec3ffff640 1 --2- 172.21.15.78:0/1247925410 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fec300b5450 0x7fec300b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:26.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.487+0000 7fec3dffb640 1 -- 172.21.15.78:0/1247925410 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8536+0+0 (secure 0 0 0) 0x7fec2c0e5a10 con 0x7fec401076a0 2024-09-11T00:26:26.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.487+0000 7fec4490d640 1 --2- 172.21.15.78:0/1326807170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556ef1260da0 0x556ef126c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:26.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.487+0000 7fec4510e640 1 -- 172.21.15.78:0/1326807170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ef126cd30 msgr2=0x556ef126f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:26:26.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.487+0000 7fec4510e640 1 --2- 172.21.15.78:0/1326807170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ef126cd30 0x556ef126f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.488+0000 7fec4510e640 1 -- 172.21.15.78:0/1326807170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556ef1260da0 msgr2=0x556ef126c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:26:26.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.488+0000 7fec4510e640 1 --2- 172.21.15.78:0/1326807170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556ef1260da0 0x556ef126c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.488+0000 7fec4510e640 1 -- 172.21.15.78:0/1326807170 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ef0f24650 con 0x556ef1260480 2024-09-11T00:26:26.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.488+0000 7fec4510e640 1 --2- 172.21.15.78:0/1326807170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260480 0x556ef1260860 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fec38035000 tx=0x7fec38031af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa098a9808c931d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:26.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.488+0000 7fec3ffff640 1 --2- 172.21.15.78:0/1247925410 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fec300b5450 0x7fec300b7910 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fec2c0e3200 tx=0x7fec2c010380 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:26.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.488+0000 7fec2affd640 1 -- 172.21.15.78:0/1326807170 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec38031450 con 0x556ef1260480 2024-09-11T00:26:26.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.488+0000 7fec2affd640 1 -- 172.21.15.78:0/1326807170 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec38042030 con 0x556ef1260480 2024-09-11T00:26:26.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.488+0000 7fec2affd640 1 -- 172.21.15.78:0/1326807170 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec380043f0 con 0x556ef1260480 2024-09-11T00:26:26.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.489+0000 7fec48f46740 1 -- 172.21.15.78:0/1326807170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260480 msgr2=0x556ef1260860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:26.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.489+0000 7fec48f46740 1 --2- 172.21.15.78:0/1326807170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260480 0x556ef1260860 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fec38035000 tx=0x7fec38031af0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.489+0000 7fec48f46740 1 -- 172.21.15.78:0/1326807170 shutdown_connections 2024-09-11T00:26:26.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.489+0000 7fec48f46740 1 --2- 172.21.15.78:0/1326807170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ef126cd30 0x556ef126f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.489+0000 7fec48f46740 1 --2- 172.21.15.78:0/1326807170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556ef1260da0 0x556ef126c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.489+0000 7fec48f46740 1 --2- 172.21.15.78:0/1326807170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260480 0x556ef1260860 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.489+0000 7fec48f46740 1 -- 172.21.15.78:0/1326807170 >> 172.21.15.78:0/1326807170 conn(0x556ef125e2b0 msgr2=0x556ef125f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:26.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.489+0000 7fec48f46740 1 -- 172.21.15.78:0/1326807170 shutdown_connections 2024-09-11T00:26:26.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.489+0000 7fec48f46740 1 -- 172.21.15.78:0/1326807170 wait complete. 2024-09-11T00:26:26.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.489+0000 7fec48f46740 1 -- start start 2024-09-11T00:26:26.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.489+0000 7fec48f46740 1 Processor -- start 2024-09-11T00:26:26.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.490+0000 7fec48f46740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556ef1260480 0x556ef126c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:26.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.490+0000 7fec48f46740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260da0 0x556ef12699b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:26.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.490+0000 7fec48f46740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ef126cd30 0x556ef1269ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:26.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.490+0000 7fec48f46740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x556ef1027700 con 0x556ef1260da0 2024-09-11T00:26:26.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.490+0000 7fec48f46740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x556ef1161110 con 0x556ef1260480 2024-09-11T00:26:26.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.490+0000 7fec48f46740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x556ef126f950 con 0x556ef126cd30 2024-09-11T00:26:26.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.490+0000 7fec48f46740 10 client.0 _ll_register_callbacks cb 0x556ef117a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:26:26.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.490+0000 7fec4490d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260da0 0x556ef12699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:26.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.490+0000 7fec4510e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556ef1260480 0x556ef126c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:26.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.490+0000 7fec4490d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260da0 0x556ef12699b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60760/0 (socket says 172.21.15.78:60760) 2024-09-11T00:26:26.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.490+0000 7fec4490d640 1 -- 172.21.15.78:0/1909742119 learned_addr learned my addr 172.21.15.78:0/1909742119 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:26:26.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.490+0000 7fec4510e640 1 --2- 172.21.15.78:0/1909742119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ef126cd30 0x556ef1269ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:26.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.490+0000 7fec4490d640 1 -- 172.21.15.78:0/1909742119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ef126cd30 msgr2=0x556ef1269ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:26:26.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.490+0000 7fec4490d640 1 --2- 172.21.15.78:0/1909742119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ef126cd30 0x556ef1269ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.490+0000 7fec4490d640 1 -- 172.21.15.78:0/1909742119 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556ef1260480 msgr2=0x556ef126c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:26:26.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.490+0000 7fec4490d640 1 --2- 172.21.15.78:0/1909742119 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556ef1260480 0x556ef126c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.490+0000 7fec4490d640 1 -- 172.21.15.78:0/1909742119 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ef118ec40 con 0x556ef1260da0 2024-09-11T00:26:26.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.490+0000 7fec4490d640 1 --2- 172.21.15.78:0/1909742119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260da0 0x556ef12699b0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fec340116d0 tx=0x7fec34011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52340bc0e51083b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:26.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.490+0000 7fec1ffff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:26:26.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.490+0000 7fec1ffff640 1 -- 172.21.15.78:0/1909742119 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3401f060 con 0x556ef1260da0 2024-09-11T00:26:26.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.490+0000 7fec1ffff640 1 -- 172.21.15.78:0/1909742119 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8536+0+0 (secure 0 0 0) 0x7fec3400fac0 con 0x556ef1260da0 2024-09-11T00:26:26.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.490+0000 7fec48f46740 1 -- 172.21.15.78:0/1909742119 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec38042030 con 0x556ef1260da0 2024-09-11T00:26:26.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.491+0000 7fec1ffff640 1 -- 172.21.15.78:0/1909742119 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fec3400fcc0 con 0x556ef1260da0 2024-09-11T00:26:26.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.491+0000 7fec48f46740 10 client.16707 fetch_fsmap learned FSMap version 20 2024-09-11T00:26:26.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.491+0000 7fec48f46740 1 -- 172.21.15.78:0/1909742119 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556ef127b250 con 0x556ef1260da0 2024-09-11T00:26:26.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.491+0000 7fec1ffff640 1 -- 172.21.15.78:0/1909742119 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec38042030 con 0x556ef1260da0 2024-09-11T00:26:26.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.491+0000 7fec1ffff640 1 -- 172.21.15.78:0/1909742119 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fec340223e0 con 0x556ef1260da0 2024-09-11T00:26:26.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.491+0000 7fec48f46740 10 client.16707 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:26:26.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.491+0000 7fec48f46740 10 client.16707 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:26:26.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.491+0000 7fec48f46740 20 client.16707 populate_metadata read hostname 'smithi078' 2024-09-11T00:26:26.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.491+0000 7fec48f46740 1 --2- 172.21.15.78:0/1909742119 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x556ef127c710 0x556ef127eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:26.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.491+0000 7fec48f46740 4 client.16707 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:26:26.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.491+0000 7fec48f46740 1 -- 172.21.15.78:0/1909742119 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ef11d8da0 con 0x556ef127c710 2024-09-11T00:26:26.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.491+0000 7fec4510e640 1 --2- 172.21.15.78:0/1909742119 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x556ef127c710 0x556ef127eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:26.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.492+0000 7fec1ffff640 10 client.16707 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:26:26.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.492+0000 7fec4510e640 1 --2- 172.21.15.78:0/1909742119 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x556ef127c710 0x556ef127eb60 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fc203d5f60d06ae server_cookie=c3a28324b6182a5 in_seq=0 out_seq=0 2024-09-11T00:26:26.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.492+0000 7fec1ffff640 1 -- 172.21.15.78:0/1909742119 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556ef11d8da0 con 0x556ef127c710 2024-09-11T00:26:26.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.492+0000 7fec1ffff640 10 client.16707 handle_command_reply: tid=0 2024-09-11T00:26:26.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.492+0000 7fec48f46740 1 client.16707 shutdown 2024-09-11T00:26:26.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.493+0000 7fec48f46740 1 -- 172.21.15.78:0/1909742119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260da0 msgr2=0x556ef12699b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:26.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.493+0000 7fec48f46740 1 --2- 172.21.15.78:0/1909742119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260da0 0x556ef12699b0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fec340116d0 tx=0x7fec34011b90 comp rx=0 tx=0).stop 2024-09-11T00:26:26.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.493+0000 7fec48f46740 1 -- 172.21.15.78:0/1909742119 shutdown_connections 2024-09-11T00:26:26.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.493+0000 7fec48f46740 1 --2- 172.21.15.78:0/1909742119 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x556ef127c710 0x556ef127eb60 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.493+0000 7fec48f46740 1 --2- 172.21.15.78:0/1909742119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ef126cd30 0x556ef1269ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.493+0000 7fec1ffff640 0 client.16707 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:26:26.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.493+0000 7fec48f46740 1 --2- 172.21.15.78:0/1909742119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260da0 0x556ef12699b0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.493+0000 7fec48f46740 1 --2- 172.21.15.78:0/1909742119 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556ef1260480 0x556ef126c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.493+0000 7fec48f46740 1 -- 172.21.15.78:0/1909742119 >> 172.21.15.78:0/1909742119 conn(0x556ef125e2b0 msgr2=0x556ef1263e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:26.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.493+0000 7fec48f46740 1 -- 172.21.15.78:0/1909742119 shutdown_connections 2024-09-11T00:26:26.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.493+0000 7fec48f46740 1 -- 172.21.15.78:0/1909742119 wait complete. 2024-09-11T00:26:26.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.493+0000 7fec48f46740 20 client.16707 trim_cache size 0 max 16384 2024-09-11T00:26:26.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.510+0000 7fec48f46740 1 Processor -- start 2024-09-11T00:26:26.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.510+0000 7fec48f46740 1 -- start start 2024-09-11T00:26:26.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.510+0000 7fec48f46740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ef1260480 0x556ef1278bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:26.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.510+0000 7fec48f46740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260da0 0x556ef12592d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:26.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.510+0000 7fec48f46740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556ef126cd30 0x556ef125f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:26.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.510+0000 7fec48f46740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fec401ae950 con 0x556ef1260da0 2024-09-11T00:26:26.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.510+0000 7fec48f46740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fec401b11b0 con 0x556ef126cd30 2024-09-11T00:26:26.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.510+0000 7fec48f46740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fec401aefa0 con 0x556ef1260480 2024-09-11T00:26:26.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.510+0000 7fec4490d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260da0 0x556ef12592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:26.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.510+0000 7fec4490d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260da0 0x556ef12592d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60776/0 (socket says 172.21.15.78:60776) 2024-09-11T00:26:26.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.510+0000 7fec4490d640 1 -- 172.21.15.78:0/1771162795 learned_addr learned my addr 172.21.15.78:0/1771162795 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:26:26.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.511+0000 7fec4510e640 1 --2- 172.21.15.78:0/1771162795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ef1260480 0x556ef1278bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:26.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.511+0000 7fec4510e640 1 --2- 172.21.15.78:0/1771162795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556ef126cd30 0x556ef125f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:26.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.511+0000 7fec4490d640 1 -- 172.21.15.78:0/1771162795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ef1260480 msgr2=0x556ef1278bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:26:26.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.511+0000 7fec4490d640 1 --2- 172.21.15.78:0/1771162795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ef1260480 0x556ef1278bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.511+0000 7fec4490d640 1 -- 172.21.15.78:0/1771162795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556ef126cd30 msgr2=0x556ef125f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:26:26.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.511+0000 7fec4490d640 1 --2- 172.21.15.78:0/1771162795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556ef126cd30 0x556ef125f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.511+0000 7fec4490d640 1 -- 172.21.15.78:0/1771162795 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ef1264730 con 0x556ef1260da0 2024-09-11T00:26:26.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.511+0000 7fec4510e640 1 --2- 172.21.15.78:0/1771162795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556ef126cd30 0x556ef125f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:26:26.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.511+0000 7fec4490d640 1 --2- 172.21.15.78:0/1771162795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260da0 0x556ef12592d0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fec34000c00 tx=0x7fec34005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234a95e85e45b48f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:26.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.511+0000 7fec2a7fc640 1 -- 172.21.15.78:0/1771162795 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec34022580 con 0x556ef1260da0 2024-09-11T00:26:26.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.511+0000 7fec2a7fc640 1 -- 172.21.15.78:0/1771162795 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec34030070 con 0x556ef1260da0 2024-09-11T00:26:26.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.511+0000 7fec2a7fc640 1 -- 172.21.15.78:0/1771162795 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec34005330 con 0x556ef1260da0 2024-09-11T00:26:26.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.512+0000 7fec48f46740 1 -- 172.21.15.78:0/1771162795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260da0 msgr2=0x556ef12592d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:26.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.512+0000 7fec48f46740 1 --2- 172.21.15.78:0/1771162795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260da0 0x556ef12592d0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fec34000c00 tx=0x7fec34005b90 comp rx=0 tx=0).stop 2024-09-11T00:26:26.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.512+0000 7fec48f46740 1 -- 172.21.15.78:0/1771162795 shutdown_connections 2024-09-11T00:26:26.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.512+0000 7fec48f46740 1 --2- 172.21.15.78:0/1771162795 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556ef126cd30 0x556ef125f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.512+0000 7fec48f46740 1 --2- 172.21.15.78:0/1771162795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260da0 0x556ef12592d0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.512+0000 7fec48f46740 1 --2- 172.21.15.78:0/1771162795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ef1260480 0x556ef1278bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.512+0000 7fec48f46740 1 -- 172.21.15.78:0/1771162795 >> 172.21.15.78:0/1771162795 conn(0x556ef125e2b0 msgr2=0x556ef1268230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:26.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.512+0000 7fec48f46740 1 -- 172.21.15.78:0/1771162795 shutdown_connections 2024-09-11T00:26:26.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.512+0000 7fec48f46740 1 -- 172.21.15.78:0/1771162795 wait complete. 2024-09-11T00:26:26.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.512+0000 7fec48f46740 1 -- start start 2024-09-11T00:26:26.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.512+0000 7fec48f46740 1 Processor -- start 2024-09-11T00:26:26.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.513+0000 7fec48f46740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ef1260480 0x556ef1274c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:26.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.513+0000 7fec48f46740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260da0 0x556ef12751a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:26.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.513+0000 7fec48f46740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556ef126cd30 0x556ef126fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:26.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.513+0000 7fec48f46740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fec401af670 con 0x556ef1260da0 2024-09-11T00:26:26.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.513+0000 7fec48f46740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fec401b0ae0 con 0x556ef126cd30 2024-09-11T00:26:26.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.513+0000 7fec48f46740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fec401afd40 con 0x556ef1260480 2024-09-11T00:26:26.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.513+0000 7fec48f46740 10 client.0 _ll_register_callbacks cb 0x7fec3400aef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:26:26.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.513+0000 7fec4490d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260da0 0x556ef12751a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:26.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.513+0000 7fec4490d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260da0 0x556ef12751a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60784/0 (socket says 172.21.15.78:60784) 2024-09-11T00:26:26.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.513+0000 7fec4490d640 1 -- 172.21.15.78:0/3090071337 learned_addr learned my addr 172.21.15.78:0/3090071337 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:26:26.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.513+0000 7fec4510e640 1 --2- 172.21.15.78:0/3090071337 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ef1260480 0x556ef1274c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:26.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.513+0000 7fec4510e640 1 --2- 172.21.15.78:0/3090071337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556ef126cd30 0x556ef126fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:26.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.513+0000 7fec4490d640 1 -- 172.21.15.78:0/3090071337 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ef1260480 msgr2=0x556ef1274c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:26:26.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.513+0000 7fec4490d640 1 --2- 172.21.15.78:0/3090071337 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ef1260480 0x556ef1274c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.513+0000 7fec4490d640 1 -- 172.21.15.78:0/3090071337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556ef126cd30 msgr2=0x556ef126fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:26:26.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.513+0000 7fec4490d640 1 --2- 172.21.15.78:0/3090071337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556ef126cd30 0x556ef126fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.538 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:26:26.538 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-11T00:26:26.539 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {}, 2024-09-11T00:26:26.539 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-11T00:26:26.539 INFO:teuthology.orchestra.run.smithi078.stdout: "9920e47e-5aad-446c-9450-0057a7201a30": { 2024-09-11T00:26:26.539 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:25:53.268082+0000", 2024-09-11T00:26:26.539 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:26:26.539 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:26:26.539 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:26:26.539 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:26:26.539 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:26:26.539 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:26.539 INFO:teuthology.orchestra.run.smithi078.stdout: "d570d2aa-a4ac-43b2-b13a-66aa0f566bb6": { 2024-09-11T00:26:26.539 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:25:46.078268+0000", 2024-09-11T00:26:26.539 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:26:26.539 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:26:26.540 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:26:26.540 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:26:26.540 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:26:26.540 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:26.540 INFO:teuthology.orchestra.run.smithi078.stdout: "f6eb5d15-216e-4f8b-b451-2f71b931998f": { 2024-09-11T00:26:26.540 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:48.289319+0000", 2024-09-11T00:26:26.540 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:26:26.540 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:26:26.540 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:26:26.540 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:26:26.540 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:26:26.540 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:26.540 INFO:teuthology.orchestra.run.smithi078.stdout: "e21db329-a274-4cfd-924a-8ec929e04bd1": { 2024-09-11T00:26:26.540 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:41.131504+0000", 2024-09-11T00:26:26.541 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:26:26.541 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:26:26.541 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:26:26.541 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:26:26.541 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:26:26.541 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:26.541 INFO:teuthology.orchestra.run.smithi078.stdout: "b854cbd3-8ca7-4277-a205-8887d2ff5567": { 2024-09-11T00:26:26.541 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:11.182949+0000", 2024-09-11T00:26:26.541 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:26:26.541 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:26:26.541 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:26:26.542 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:26:26.542 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:26:26.542 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:26.542 INFO:teuthology.orchestra.run.smithi078.stdout: "6289bc2a-a628-43bc-9b8b-2559c2c49db7": { 2024-09-11T00:26:26.542 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:53.829090+0000", 2024-09-11T00:26:26.542 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:26:26.542 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:26:26.542 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:26:26.542 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:26:26.542 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:26:26.542 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:26.542 INFO:teuthology.orchestra.run.smithi078.stdout: "59d341c2-815c-48b1-a216-aa6fac6078a0": { 2024-09-11T00:26:26.542 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:25:06.855284+0000", 2024-09-11T00:26:26.542 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:26:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:26:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:26:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:26:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:26:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: "a682c96e-1acb-43c1-884d-6ae3d81cba47": { 2024-09-11T00:26:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:13.384021+0000", 2024-09-11T00:26:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:26:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:26:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:26:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:26:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:26:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: "7d270da9-0d55-460a-8497-50641dd07117": { 2024-09-11T00:26:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:17:33.894050+0000", 2024-09-11T00:26:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:26:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:26:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:26:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:26:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:26:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: "e5be74b1-4915-468d-a739-e995b5d71e26": { 2024-09-11T00:26:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:19:31.653981+0000", 2024-09-11T00:26:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:26:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:26:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:26:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:26:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:26:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: "81d31d3a-c224-4ded-9f00-1a7dfc099ec4": { 2024-09-11T00:26:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:16.296700+0000", 2024-09-11T00:26:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:26:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:26:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:26:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:26:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:26:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: "1c04b4f1-c4c4-4289-b172-fba45b64018a": { 2024-09-11T00:26:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:24:27.591301+0000", 2024-09-11T00:26:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:26:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:26:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:26:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:26:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:26:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: "f1ebd0fe-5c40-4eb1-aaa0-169e4d5cf458": { 2024-09-11T00:26:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:18:52.611998+0000", 2024-09-11T00:26:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:26:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:26:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:26:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:26:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:26:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: "38a1d30d-5f4c-460a-afcd-e6c60b97e43a": { 2024-09-11T00:26:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:58.127727+0000", 2024-09-11T00:26:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:26:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:26:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:26:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:26:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:26:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: "8ec9e858-aa62-420d-a112-e62ea7810e63": { 2024-09-11T00:26:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:20:18.882749+0000", 2024-09-11T00:26:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:26:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:26:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:26:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:26:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:26:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: "550cfcf7-9c57-47a1-9ac1-d89a0970cd67": { 2024-09-11T00:26:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:16:13.870127+0000", 2024-09-11T00:26:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:26:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:26:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:26:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:26:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:26:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: "1b9391c2-08f3-479a-9538-deea28f7743b": { 2024-09-11T00:26:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:23:02.327508+0000", 2024-09-11T00:26:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:26:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:26:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:26:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:26:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:26:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: "e0002672-e432-4890-ab9f-20c513c5e3b6": { 2024-09-11T00:26:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:21:37.161715+0000", 2024-09-11T00:26:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:26:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:26:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:26:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:26:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:26:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: "f494d5ed-e0dc-44bb-8aba-a861b3e751f4": { 2024-09-11T00:26:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-11T00:22:55.251691+0000", 2024-09-11T00:26:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-11T00:26:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-11T00:26:26.550 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-11T00:26:26.550 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-11T00:26:26.550 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-11T00:26:26.550 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:26.550 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:26.550 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:26:26.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.513+0000 7fec4490d640 1 -- 172.21.15.78:0/3090071337 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ef12701c0 con 0x556ef1260da0 2024-09-11T00:26:26.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.514+0000 7fec4490d640 1 --2- 172.21.15.78:0/3090071337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260da0 0x556ef12751a0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fec340116d0 tx=0x7fec3400faf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1dbc9f22209150 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:26.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.514+0000 7fec1ffff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:26:26.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.514+0000 7fec1ffff640 1 -- 172.21.15.78:0/3090071337 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec34038020 con 0x556ef1260da0 2024-09-11T00:26:26.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.514+0000 7fec1ffff640 1 -- 172.21.15.78:0/3090071337 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8536+0+0 (secure 0 0 0) 0x7fec34022dd0 con 0x556ef1260da0 2024-09-11T00:26:26.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.514+0000 7fec48f46740 1 -- 172.21.15.78:0/3090071337 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec34030070 con 0x556ef1260da0 2024-09-11T00:26:26.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.514+0000 7fec1ffff640 1 -- 172.21.15.78:0/3090071337 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fec3401f070 con 0x556ef1260da0 2024-09-11T00:26:26.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.514+0000 7fec48f46740 10 client.16713 fetch_fsmap learned FSMap version 20 2024-09-11T00:26:26.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.514+0000 7fec48f46740 1 -- 172.21.15.78:0/3090071337 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x556ef12e9eb0 con 0x556ef1260da0 2024-09-11T00:26:26.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.514+0000 7fec1ffff640 1 -- 172.21.15.78:0/3090071337 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec34030070 con 0x556ef1260da0 2024-09-11T00:26:26.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.514+0000 7fec1ffff640 1 -- 172.21.15.78:0/3090071337 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7fec34004b50 con 0x556ef1260da0 2024-09-11T00:26:26.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.514+0000 7fec48f46740 10 client.16713 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:26:26.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.514+0000 7fec48f46740 10 client.16713 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:26:26.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.514+0000 7fec48f46740 20 client.16713 populate_metadata read hostname 'smithi078' 2024-09-11T00:26:26.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.514+0000 7fec48f46740 1 --2- 172.21.15.78:0/3090071337 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x556ef12ea5c0 0x556ef12ec9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:26.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.514+0000 7fec48f46740 4 client.16713 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T00:26:26.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.514+0000 7fec48f46740 1 -- 172.21.15.78:0/3090071337 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556ef11d4850 con 0x556ef12ea5c0 2024-09-11T00:26:26.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.515+0000 7fec4510e640 1 --2- 172.21.15.78:0/3090071337 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x556ef12ea5c0 0x556ef12ec9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:26.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.515+0000 7fec4510e640 1 --2- 172.21.15.78:0/3090071337 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x556ef12ea5c0 0x556ef12ec9e0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=658ff1c904576f86 server_cookie=aa72a8457142f09e in_seq=0 out_seq=0 2024-09-11T00:26:26.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.515+0000 7fec1ffff640 10 client.16713 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:26:26.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.515+0000 7fec1ffff640 1 -- 172.21.15.78:0/3090071337 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5486 (crc 0 0 0) 0x556ef11d4850 con 0x556ef12ea5c0 2024-09-11T00:26:26.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.515+0000 7fec1ffff640 10 client.16713 handle_command_reply: tid=0 2024-09-11T00:26:26.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.515+0000 7fec48f46740 1 client.16713 shutdown 2024-09-11T00:26:26.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.515+0000 7fec48f46740 1 -- 172.21.15.78:0/3090071337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260da0 msgr2=0x556ef12751a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:26.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.515+0000 7fec48f46740 1 --2- 172.21.15.78:0/3090071337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260da0 0x556ef12751a0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fec340116d0 tx=0x7fec3400faf0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.515+0000 7fec48f46740 1 -- 172.21.15.78:0/3090071337 shutdown_connections 2024-09-11T00:26:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.515+0000 7fec48f46740 1 --2- 172.21.15.78:0/3090071337 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x556ef12ea5c0 0x556ef12ec9e0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.515+0000 7fec48f46740 1 --2- 172.21.15.78:0/3090071337 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x556ef126cd30 0x556ef126fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.515+0000 7fec48f46740 1 --2- 172.21.15.78:0/3090071337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556ef1260da0 0x556ef12751a0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.515+0000 7fec1ffff640 0 client.16713 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:26:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.515+0000 7fec48f46740 1 --2- 172.21.15.78:0/3090071337 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ef1260480 0x556ef1274c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.515+0000 7fec48f46740 1 -- 172.21.15.78:0/3090071337 >> 172.21.15.78:0/3090071337 conn(0x556ef125e2b0 msgr2=0x556ef125f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.516+0000 7fec48f46740 1 -- 172.21.15.78:0/3090071337 shutdown_connections 2024-09-11T00:26:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.516+0000 7fec48f46740 1 -- 172.21.15.78:0/3090071337 wait complete. 2024-09-11T00:26:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.516+0000 7fec48f46740 20 client.16713 trim_cache size 0 max 16384 2024-09-11T00:26:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.516+0000 7fec46b71640 1 -- 172.21.15.78:0/1247925410 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fec300b5450 msgr2=0x7fec300b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.516+0000 7fec46b71640 1 --2- 172.21.15.78:0/1247925410 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fec300b5450 0x7fec300b7910 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fec2c0e3200 tx=0x7fec2c010380 comp rx=0 tx=0).stop 2024-09-11T00:26:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.516+0000 7fec46b71640 1 -- 172.21.15.78:0/1247925410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec401076a0 msgr2=0x7fec400fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.516+0000 7fec46b71640 1 --2- 172.21.15.78:0/1247925410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec401076a0 0x7fec400fe140 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fec2c00b4a0 tx=0x7fec2c00b8a0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.516+0000 7fec46b71640 1 -- 172.21.15.78:0/1247925410 shutdown_connections 2024-09-11T00:26:26.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.516+0000 7fec46b71640 1 --2- 172.21.15.78:0/1247925410 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fec300b5450 0x7fec300b7910 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.516+0000 7fec46b71640 1 --2- 172.21.15.78:0/1247925410 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec40108020 0x7fec400fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.516+0000 7fec46b71640 1 --2- 172.21.15.78:0/1247925410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec401076a0 0x7fec400fe140 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.516+0000 7fec46b71640 1 --2- 172.21.15.78:0/1247925410 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec40101c90 0x7fec400fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:26.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.516+0000 7fec46b71640 1 -- 172.21.15.78:0/1247925410 >> 172.21.15.78:0/1247925410 conn(0x7fec400fd700 msgr2=0x7fec401005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:26.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.517+0000 7fec46b71640 1 -- 172.21.15.78:0/1247925410 shutdown_connections 2024-09-11T00:26:26.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:26.517+0000 7fec46b71640 1 -- 172.21.15.78:0/1247925410 wait complete. 2024-09-11T00:26:27.317 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-11T00:26:27.318 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:26:27.569 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:26:28.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.030+0000 7f96e3cdc640 1 -- 172.21.15.78:0/2909649758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96dc102dc0 msgr2=0x7f96dc1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:28.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.030+0000 7f96e3cdc640 1 --2- 172.21.15.78:0/2909649758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96dc102dc0 0x7f96dc1031a0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009900 tx=0x7f96d802a410 comp rx=0 tx=0).stop 2024-09-11T00:26:28.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.030+0000 7f96e3cdc640 1 -- 172.21.15.78:0/2909649758 shutdown_connections 2024-09-11T00:26:28.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.030+0000 7f96e3cdc640 1 --2- 172.21.15.78:0/2909649758 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96dc109150 0x7f96dc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:28.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.030+0000 7f96e3cdc640 1 --2- 172.21.15.78:0/2909649758 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96dc1087d0 0x7f96dc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:28.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.030+0000 7f96e3cdc640 1 --2- 172.21.15.78:0/2909649758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96dc102dc0 0x7f96dc1031a0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:28.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.030+0000 7f96e3cdc640 1 -- 172.21.15.78:0/2909649758 >> 172.21.15.78:0/2909649758 conn(0x7f96dc0fe830 msgr2=0x7f96dc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:28.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.030+0000 7f96e3cdc640 1 -- 172.21.15.78:0/2909649758 shutdown_connections 2024-09-11T00:26:28.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.030+0000 7f96e3cdc640 1 -- 172.21.15.78:0/2909649758 wait complete. 2024-09-11T00:26:28.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.031+0000 7f96e3cdc640 1 Processor -- start 2024-09-11T00:26:28.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.031+0000 7f96e3cdc640 1 -- start start 2024-09-11T00:26:28.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.031+0000 7f96e3cdc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96dc102dc0 0x7f96dc199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:28.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.031+0000 7f96e3cdc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96dc1087d0 0x7f96dc199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:28.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.031+0000 7f96e3cdc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96dc109150 0x7f96dc19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:28.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.031+0000 7f96e3cdc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc112e10 con 0x7f96dc1087d0 2024-09-11T00:26:28.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.031+0000 7f96e3cdc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc112c90 con 0x7f96dc109150 2024-09-11T00:26:28.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.031+0000 7f96e3cdc640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc112f90 con 0x7f96dc102dc0 2024-09-11T00:26:28.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.031+0000 7f96e1277640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96dc1087d0 0x7f96dc199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:28.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.031+0000 7f96e1277640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96dc1087d0 0x7f96dc199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60804/0 (socket says 172.21.15.78:60804) 2024-09-11T00:26:28.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.031+0000 7f96e1277640 1 -- 172.21.15.78:0/2866157371 learned_addr learned my addr 172.21.15.78:0/2866157371 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:26:28.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.031+0000 7f96e2279640 1 --2- 172.21.15.78:0/2866157371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96dc109150 0x7f96dc19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:28.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.031+0000 7f96e1a78640 1 --2- 172.21.15.78:0/2866157371 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96dc102dc0 0x7f96dc199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:28.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.031+0000 7f96e1277640 1 -- 172.21.15.78:0/2866157371 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96dc102dc0 msgr2=0x7f96dc199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:28.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.031+0000 7f96e1277640 1 --2- 172.21.15.78:0/2866157371 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96dc102dc0 0x7f96dc199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:28.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.031+0000 7f96e1277640 1 -- 172.21.15.78:0/2866157371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96dc109150 msgr2=0x7f96dc19ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:28.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.031+0000 7f96e1277640 1 --2- 172.21.15.78:0/2866157371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96dc109150 0x7f96dc19ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:28.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.031+0000 7f96e1277640 1 -- 172.21.15.78:0/2866157371 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96dc19f3b0 con 0x7f96dc1087d0 2024-09-11T00:26:28.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.031+0000 7f96e2279640 1 --2- 172.21.15.78:0/2866157371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96dc109150 0x7f96dc19ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:26:28.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.031+0000 7f96e1a78640 1 --2- 172.21.15.78:0/2866157371 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96dc102dc0 0x7f96dc199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:26:28.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.032+0000 7f96e1277640 1 --2- 172.21.15.78:0/2866157371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96dc1087d0 0x7f96dc199840 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00b4a0 tx=0x7f96cc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:28.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.032+0000 7f96d2ffd640 1 -- 172.21.15.78:0/2866157371 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc014070 con 0x7f96dc1087d0 2024-09-11T00:26:28.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.032+0000 7f96d2ffd640 1 -- 172.21.15.78:0/2866157371 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96cc010ac0 con 0x7f96dc1087d0 2024-09-11T00:26:28.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.032+0000 7f96e3cdc640 1 -- 172.21.15.78:0/2866157371 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96dc19f6a0 con 0x7f96dc1087d0 2024-09-11T00:26:28.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.032+0000 7f96d2ffd640 1 -- 172.21.15.78:0/2866157371 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc017c30 con 0x7f96dc1087d0 2024-09-11T00:26:28.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.032+0000 7f96e3cdc640 1 -- 172.21.15.78:0/2866157371 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96dc1a5d60 con 0x7f96dc1087d0 2024-09-11T00:26:28.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.033+0000 7f96e3cdc640 1 -- 172.21.15.78:0/2866157371 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96dc1031a0 con 0x7f96dc1087d0 2024-09-11T00:26:28.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.035+0000 7f96d2ffd640 1 -- 172.21.15.78:0/2866157371 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f96cc010610 con 0x7f96dc1087d0 2024-09-11T00:26:28.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.036+0000 7f96d2ffd640 1 --2- 172.21.15.78:0/2866157371 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f96c80b5450 0x7f96c80b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:28.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.036+0000 7f96e1a78640 1 --2- 172.21.15.78:0/2866157371 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f96c80b5450 0x7f96c80b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:28.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.036+0000 7f96d2ffd640 1 -- 172.21.15.78:0/2866157371 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8536+0+0 (secure 0 0 0) 0x7f96cc0e5970 con 0x7f96dc1087d0 2024-09-11T00:26:28.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.037+0000 7f96e1a78640 1 --2- 172.21.15.78:0/2866157371 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f96c80b5450 0x7f96c80b7910 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f96d8000c00 tx=0x7f96d8031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:28.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.039+0000 7f96d2ffd640 1 -- 172.21.15.78:0/2866157371 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f96cc0ac4e0 con 0x7f96dc1087d0 2024-09-11T00:26:28.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:27 smithi112 ceph-mon[35627]: pgmap v631: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:26:28.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.250+0000 7f96e3cdc640 1 -- 172.21.15.78:0/2866157371 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96dc02e5c0 con 0x7f96dc1087d0 2024-09-11T00:26:28.252 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:27 smithi078 ceph-mon[30865]: pgmap v631: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:26:28.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.251+0000 7f96d2ffd640 1 -- 172.21.15.78:0/2866157371 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f96cc0abde0 con 0x7f96dc1087d0 2024-09-11T00:26:28.253 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:26:28.254 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:26:28.254 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:26:28.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.253+0000 7f96e3cdc640 1 -- 172.21.15.78:0/2866157371 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f96c80b5450 msgr2=0x7f96c80b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:28.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.253+0000 7f96e3cdc640 1 --2- 172.21.15.78:0/2866157371 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f96c80b5450 0x7f96c80b7910 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f96d8000c00 tx=0x7f96d8031400 comp rx=0 tx=0).stop 2024-09-11T00:26:28.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.253+0000 7f96e3cdc640 1 -- 172.21.15.78:0/2866157371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96dc1087d0 msgr2=0x7f96dc199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:28.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.253+0000 7f96e3cdc640 1 --2- 172.21.15.78:0/2866157371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96dc1087d0 0x7f96dc199840 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00b4a0 tx=0x7f96cc00b960 comp rx=0 tx=0).stop 2024-09-11T00:26:28.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.253+0000 7f96e3cdc640 1 -- 172.21.15.78:0/2866157371 shutdown_connections 2024-09-11T00:26:28.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.253+0000 7f96e3cdc640 1 --2- 172.21.15.78:0/2866157371 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f96c80b5450 0x7f96c80b7910 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:28.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.253+0000 7f96e3cdc640 1 --2- 172.21.15.78:0/2866157371 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f96dc109150 0x7f96dc19ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:28.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.253+0000 7f96e3cdc640 1 --2- 172.21.15.78:0/2866157371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96dc1087d0 0x7f96dc199840 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:28.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.253+0000 7f96e3cdc640 1 --2- 172.21.15.78:0/2866157371 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f96dc102dc0 0x7f96dc199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:28.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.253+0000 7f96e3cdc640 1 -- 172.21.15.78:0/2866157371 >> 172.21.15.78:0/2866157371 conn(0x7f96dc0fe830 msgr2=0x7f96dc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:28.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.254+0000 7f96e3cdc640 1 -- 172.21.15.78:0/2866157371 shutdown_connections 2024-09-11T00:26:28.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:28.254+0000 7f96e3cdc640 1 -- 172.21.15.78:0/2866157371 wait complete. 2024-09-11T00:26:28.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:27 smithi138 ceph-mon[35019]: pgmap v631: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:26:28.975 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-11T00:26:29.220 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:26:29.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:28 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2866157371' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:26:29.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:28 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2866157371' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:26:29.333 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:28 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2866157371' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:26:29.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.712+0000 7f4f2d88f640 1 -- 172.21.15.78:0/89992682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f281045e0 msgr2=0x7f4f2810cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:29.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.712+0000 7f4f2d88f640 1 --2- 172.21.15.78:0/89992682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f281045e0 0x7f4f2810cad0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4f10009900 tx=0x7f4f1002a410 comp rx=0 tx=0).stop 2024-09-11T00:26:29.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.712+0000 7f4f2d88f640 1 -- 172.21.15.78:0/89992682 shutdown_connections 2024-09-11T00:26:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.712+0000 7f4f2d88f640 1 --2- 172.21.15.78:0/89992682 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f2810d120 0x7f4f2810f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.712+0000 7f4f2d88f640 1 --2- 172.21.15.78:0/89992682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f281045e0 0x7f4f2810cad0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.712+0000 7f4f2d88f640 1 --2- 172.21.15.78:0/89992682 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f28103cc0 0x7f4f281040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.712+0000 7f4f2d88f640 1 -- 172.21.15.78:0/89992682 >> 172.21.15.78:0/89992682 conn(0x7f4f280fd700 msgr2=0x7f4f280ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.712+0000 7f4f2d88f640 1 -- 172.21.15.78:0/89992682 shutdown_connections 2024-09-11T00:26:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.712+0000 7f4f2d88f640 1 -- 172.21.15.78:0/89992682 wait complete. 2024-09-11T00:26:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.712+0000 7f4f2d88f640 1 Processor -- start 2024-09-11T00:26:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.712+0000 7f4f2d88f640 1 -- start start 2024-09-11T00:26:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.713+0000 7f4f2d88f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f28103cc0 0x7f4f28199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.713+0000 7f4f2d88f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f281045e0 0x7f4f281998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.713+0000 7f4f2d88f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f2810d120 0x7f4f2819ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.713+0000 7f4f2d88f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4f28112d90 con 0x7f4f2810d120 2024-09-11T00:26:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.713+0000 7f4f2d88f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4f28112c10 con 0x7f4f28103cc0 2024-09-11T00:26:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.713+0000 7f4f2d88f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4f28112f10 con 0x7f4f281045e0 2024-09-11T00:26:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.713+0000 7f4f277fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f2810d120 0x7f4f2819ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.713+0000 7f4f277fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f2810d120 0x7f4f2819ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60822/0 (socket says 172.21.15.78:60822) 2024-09-11T00:26:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.713+0000 7f4f277fe640 1 -- 172.21.15.78:0/1931297880 learned_addr learned my addr 172.21.15.78:0/1931297880 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:26:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.713+0000 7f4f26ffd640 1 --2- 172.21.15.78:0/1931297880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f28103cc0 0x7f4f28199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.713+0000 7f4f267fc640 1 --2- 172.21.15.78:0/1931297880 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f281045e0 0x7f4f281998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.713+0000 7f4f277fe640 1 -- 172.21.15.78:0/1931297880 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f281045e0 msgr2=0x7f4f281998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.713+0000 7f4f277fe640 1 --2- 172.21.15.78:0/1931297880 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f281045e0 0x7f4f281998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.713+0000 7f4f277fe640 1 -- 172.21.15.78:0/1931297880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f28103cc0 msgr2=0x7f4f28199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.713+0000 7f4f277fe640 1 --2- 172.21.15.78:0/1931297880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f28103cc0 0x7f4f28199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.713+0000 7f4f277fe640 1 -- 172.21.15.78:0/1931297880 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2819f410 con 0x7f4f2810d120 2024-09-11T00:26:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.713+0000 7f4f277fe640 1 --2- 172.21.15.78:0/1931297880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f2810d120 0x7f4f2819ec40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000eaa0 tx=0x7f4f2000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.713+0000 7f4f2c88d640 1 -- 172.21.15.78:0/1931297880 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000cdb0 con 0x7f4f2810d120 2024-09-11T00:26:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.713+0000 7f4f2c88d640 1 -- 172.21.15.78:0/1931297880 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f20005020 con 0x7f4f2810d120 2024-09-11T00:26:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.713+0000 7f4f2d88f640 1 -- 172.21.15.78:0/1931297880 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f2819f700 con 0x7f4f2810d120 2024-09-11T00:26:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.714+0000 7f4f2c88d640 1 -- 172.21.15.78:0/1931297880 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f200116d0 con 0x7f4f2810d120 2024-09-11T00:26:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.714+0000 7f4f2d88f640 1 -- 172.21.15.78:0/1931297880 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f281a5dc0 con 0x7f4f2810d120 2024-09-11T00:26:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.716+0000 7f4f2c88d640 1 -- 172.21.15.78:0/1931297880 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f4f2000f040 con 0x7f4f2810d120 2024-09-11T00:26:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.716+0000 7f4f2fc64740 1 Processor -- start 2024-09-11T00:26:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.717+0000 7f4f2fc64740 1 -- start start 2024-09-11T00:26:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.717+0000 7f4f2fc64740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557b3b09e4d0 0x557b3b09e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.717+0000 7f4f2fc64740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b3b09edf0 0x557b3b0aa840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.717+0000 7f4f2fc64740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b0aad80 0x557b3b0ad170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.717+0000 7f4f2fc64740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557b3b014ea0 con 0x557b3b0aad80 2024-09-11T00:26:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.717+0000 7f4f2fc64740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557b3b0042d0 con 0x557b3b09edf0 2024-09-11T00:26:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.717+0000 7f4f2fc64740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x557b3b0080e0 con 0x557b3b09e4d0 2024-09-11T00:26:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.717+0000 7f4f267fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b0aad80 0x557b3b0ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.717+0000 7f4f267fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b0aad80 0x557b3b0ad170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60838/0 (socket says 172.21.15.78:60838) 2024-09-11T00:26:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.717+0000 7f4f267fc640 1 -- 172.21.15.78:0/1256367170 learned_addr learned my addr 172.21.15.78:0/1256367170 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:26:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.717+0000 7f4f26ffd640 1 --2- 172.21.15.78:0/1256367170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b3b09edf0 0x557b3b0aa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.717+0000 7f4f267fc640 1 --2- 172.21.15.78:0/1256367170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557b3b09e4d0 0x557b3b09e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.717+0000 7f4f2c88d640 1 --2- 172.21.15.78:0/1931297880 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4f140b54d0 0x7f4f140b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.717+0000 7f4f267fc640 1 -- 172.21.15.78:0/1256367170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557b3b09e4d0 msgr2=0x557b3b09e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:26:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.717+0000 7f4f267fc640 1 --2- 172.21.15.78:0/1256367170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557b3b09e4d0 0x557b3b09e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.717+0000 7f4f267fc640 1 -- 172.21.15.78:0/1256367170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b3b09edf0 msgr2=0x557b3b0aa840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:26:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.717+0000 7f4f267fc640 1 --2- 172.21.15.78:0/1256367170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b3b09edf0 0x557b3b0aa840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.717+0000 7f4f267fc640 1 -- 172.21.15.78:0/1256367170 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b3ad62650 con 0x557b3b0aad80 2024-09-11T00:26:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.717+0000 7f4f277fe640 1 --2- 172.21.15.78:0/1931297880 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4f140b54d0 0x7f4f140b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:29.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.718+0000 7f4f267fc640 1 --2- 172.21.15.78:0/1256367170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b0aad80 0x557b3b0ad170 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f4f2806c330 tx=0x7f4f10005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31f193890e8eef0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:29.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.718+0000 7f4f2c88d640 1 -- 172.21.15.78:0/1931297880 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8536+0+0 (secure 0 0 0) 0x7f4f200e5d50 con 0x7f4f2810d120 2024-09-11T00:26:29.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.718+0000 7f4f1dffb640 1 -- 172.21.15.78:0/1256367170 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10035070 con 0x557b3b0aad80 2024-09-11T00:26:29.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.718+0000 7f4f1dffb640 1 -- 172.21.15.78:0/1256367170 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f10004030 con 0x557b3b0aad80 2024-09-11T00:26:29.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.718+0000 7f4f1dffb640 1 -- 172.21.15.78:0/1256367170 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10003ab0 con 0x557b3b0aad80 2024-09-11T00:26:29.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.719+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1256367170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b0aad80 msgr2=0x557b3b0ad170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:29.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.719+0000 7f4f277fe640 1 --2- 172.21.15.78:0/1931297880 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4f140b54d0 0x7f4f140b7990 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4f200a9480 tx=0x7f4f20097040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:29.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.719+0000 7f4f2fc64740 1 --2- 172.21.15.78:0/1256367170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b0aad80 0x557b3b0ad170 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f4f2806c330 tx=0x7f4f10005780 comp rx=0 tx=0).stop 2024-09-11T00:26:29.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.719+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1256367170 shutdown_connections 2024-09-11T00:26:29.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.719+0000 7f4f2fc64740 1 --2- 172.21.15.78:0/1256367170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b0aad80 0x557b3b0ad170 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.719+0000 7f4f2fc64740 1 --2- 172.21.15.78:0/1256367170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b3b09edf0 0x557b3b0aa840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.719+0000 7f4f2fc64740 1 --2- 172.21.15.78:0/1256367170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557b3b09e4d0 0x557b3b09e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.719+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1256367170 >> 172.21.15.78:0/1256367170 conn(0x557b3b09c300 msgr2=0x557b3b09d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.719+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1256367170 shutdown_connections 2024-09-11T00:26:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.719+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1256367170 wait complete. 2024-09-11T00:26:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.719+0000 7f4f2fc64740 1 -- start start 2024-09-11T00:26:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.719+0000 7f4f2fc64740 1 Processor -- start 2024-09-11T00:26:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.719+0000 7f4f2fc64740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b3b09e4d0 0x557b3b0aa710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.719+0000 7f4f2fc64740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557b3b09edf0 0x557b3b0a7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.719+0000 7f4f2fc64740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b0aad80 0x557b3b0a8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.719+0000 7f4f2fc64740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557b3ae65700 con 0x557b3b0aad80 2024-09-11T00:26:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.719+0000 7f4f2fc64740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x557b3af9f160 con 0x557b3b09e4d0 2024-09-11T00:26:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.719+0000 7f4f2fc64740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x557b3b0ad9a0 con 0x557b3b09edf0 2024-09-11T00:26:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.719+0000 7f4f2fc64740 10 client.0 _ll_register_callbacks cb 0x557b3afb89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:26:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.720+0000 7f4f267fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b0aad80 0x557b3b0a8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.720+0000 7f4f267fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b0aad80 0x557b3b0a8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60848/0 (socket says 172.21.15.78:60848) 2024-09-11T00:26:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.720+0000 7f4f267fc640 1 -- 172.21.15.78:0/1657645720 learned_addr learned my addr 172.21.15.78:0/1657645720 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:26:29.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.720+0000 7f4f26ffd640 1 --2- 172.21.15.78:0/1657645720 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557b3b09edf0 0x557b3b0a7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:29.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.720+0000 7f4f267fc640 1 --2- 172.21.15.78:0/1657645720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b3b09e4d0 0x557b3b0aa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:29.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.720+0000 7f4f267fc640 1 -- 172.21.15.78:0/1657645720 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557b3b09edf0 msgr2=0x557b3b0a7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:26:29.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.720+0000 7f4f267fc640 1 --2- 172.21.15.78:0/1657645720 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557b3b09edf0 0x557b3b0a7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.720+0000 7f4f267fc640 1 -- 172.21.15.78:0/1657645720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b3b09e4d0 msgr2=0x557b3b0aa710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:26:29.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.720+0000 7f4f267fc640 1 --2- 172.21.15.78:0/1657645720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b3b09e4d0 0x557b3b0aa710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.720+0000 7f4f267fc640 1 -- 172.21.15.78:0/1657645720 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b3afccc90 con 0x557b3b0aad80 2024-09-11T00:26:29.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.720+0000 7f4f267fc640 1 --2- 172.21.15.78:0/1657645720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b0aad80 0x557b3b0a8230 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f4f10006010 tx=0x7f4f10031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36385d34842aed6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:29.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.720+0000 7f4f06ffd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:26:29.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.720+0000 7f4f06ffd640 1 -- 172.21.15.78:0/1657645720 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10035050 con 0x557b3b0aad80 2024-09-11T00:26:29.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.720+0000 7f4f06ffd640 1 -- 172.21.15.78:0/1657645720 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8536+0+0 (secure 0 0 0) 0x7f4f100317b0 con 0x557b3b0aad80 2024-09-11T00:26:29.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.720+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1657645720 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f10004030 con 0x557b3b0aad80 2024-09-11T00:26:29.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.720+0000 7f4f06ffd640 1 -- 172.21.15.78:0/1657645720 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4f10004490 con 0x557b3b0aad80 2024-09-11T00:26:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.720+0000 7f4f2fc64740 10 client.16731 fetch_fsmap learned FSMap version 20 2024-09-11T00:26:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.720+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1657645720 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557b3b0b93d0 con 0x557b3b0aad80 2024-09-11T00:26:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.720+0000 7f4f06ffd640 1 -- 172.21.15.78:0/1657645720 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f10004030 con 0x557b3b0aad80 2024-09-11T00:26:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.721+0000 7f4f06ffd640 1 -- 172.21.15.78:0/1657645720 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f4f1003d860 con 0x557b3b0aad80 2024-09-11T00:26:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.721+0000 7f4f2fc64740 10 client.16731 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:26:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.721+0000 7f4f2fc64740 10 client.16731 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:26:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.721+0000 7f4f2fc64740 20 client.16731 populate_metadata read hostname 'smithi078' 2024-09-11T00:26:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.721+0000 7f4f2fc64740 1 --2- 172.21.15.78:0/1657645720 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557b3b0ba720 0x557b3b0bcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.721+0000 7f4f2fc64740 4 client.16731 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T00:26:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.721+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1657645720 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b3b016df0 con 0x557b3b0ba720 2024-09-11T00:26:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.721+0000 7f4f26ffd640 1 --2- 172.21.15.78:0/1657645720 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557b3b0ba720 0x557b3b0bcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.722+0000 7f4f06ffd640 10 client.16731 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:26:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.722+0000 7f4f26ffd640 1 --2- 172.21.15.78:0/1657645720 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557b3b0ba720 0x557b3b0bcb10 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=685d2f85da42c062 server_cookie=21971c9c0952bed9 in_seq=0 out_seq=0 2024-09-11T00:26:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.722+0000 7f4f06ffd640 1 -- 172.21.15.78:0/1657645720 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557b3b016df0 con 0x557b3b0ba720 2024-09-11T00:26:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.722+0000 7f4f06ffd640 10 client.16731 handle_command_reply: tid=0 2024-09-11T00:26:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.722+0000 7f4f2fc64740 1 client.16731 shutdown 2024-09-11T00:26:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.723+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1657645720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b0aad80 msgr2=0x557b3b0a8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.723+0000 7f4f2fc64740 1 --2- 172.21.15.78:0/1657645720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b0aad80 0x557b3b0a8230 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f4f10006010 tx=0x7f4f10031400 comp rx=0 tx=0).stop 2024-09-11T00:26:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.723+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1657645720 shutdown_connections 2024-09-11T00:26:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.723+0000 7f4f2fc64740 1 --2- 172.21.15.78:0/1657645720 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557b3b0ba720 0x557b3b0bcb10 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.723+0000 7f4f2fc64740 1 --2- 172.21.15.78:0/1657645720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b0aad80 0x557b3b0a8230 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.723+0000 7f4f2fc64740 1 --2- 172.21.15.78:0/1657645720 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557b3b09edf0 0x557b3b0a7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.723+0000 7f4f06ffd640 0 client.16731 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:26:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.723+0000 7f4f2fc64740 1 --2- 172.21.15.78:0/1657645720 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b3b09e4d0 0x557b3b0aa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.723+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1657645720 >> 172.21.15.78:0/1657645720 conn(0x557b3b09c300 msgr2=0x557b3b0a1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.723+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1657645720 shutdown_connections 2024-09-11T00:26:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.723+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1657645720 wait complete. 2024-09-11T00:26:29.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.723+0000 7f4f2fc64740 20 client.16731 trim_cache size 0 max 16384 2024-09-11T00:26:29.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.737+0000 7f4f2fc64740 1 Processor -- start 2024-09-11T00:26:29.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.737+0000 7f4f2fc64740 1 -- start start 2024-09-11T00:26:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.737+0000 7f4f2fc64740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b3b09e4d0 0x557b3b0b6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.737+0000 7f4f2fc64740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557b3b09edf0 0x557b3b09b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.737+0000 7f4f2fc64740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b0aad80 0x557b3b0ac170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.737+0000 7f4f2fc64740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281ac7c0 con 0x557b3b0aad80 2024-09-11T00:26:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.737+0000 7f4f2fc64740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281af020 con 0x557b3b09e4d0 2024-09-11T00:26:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.737+0000 7f4f2fc64740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281ace10 con 0x557b3b09edf0 2024-09-11T00:26:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.737+0000 7f4f267fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b0aad80 0x557b3b0ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.737+0000 7f4f267fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b0aad80 0x557b3b0ac170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60858/0 (socket says 172.21.15.78:60858) 2024-09-11T00:26:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.737+0000 7f4f267fc640 1 -- 172.21.15.78:0/1792305299 learned_addr learned my addr 172.21.15.78:0/1792305299 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:26:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.738+0000 7f4f267fc640 1 --2- 172.21.15.78:0/1792305299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b3b09e4d0 0x557b3b0b6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.738+0000 7f4f26ffd640 1 --2- 172.21.15.78:0/1792305299 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557b3b09edf0 0x557b3b09b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.738+0000 7f4f267fc640 1 -- 172.21.15.78:0/1792305299 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557b3b09edf0 msgr2=0x557b3b09b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:26:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.738+0000 7f4f267fc640 1 --2- 172.21.15.78:0/1792305299 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557b3b09edf0 0x557b3b09b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.738+0000 7f4f267fc640 1 -- 172.21.15.78:0/1792305299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b3b09e4d0 msgr2=0x557b3b0b6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:26:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.738+0000 7f4f267fc640 1 --2- 172.21.15.78:0/1792305299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b3b09e4d0 0x557b3b0b6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.738+0000 7f4f267fc640 1 -- 172.21.15.78:0/1792305299 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b3b09cfe0 con 0x557b3b0aad80 2024-09-11T00:26:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.738+0000 7f4f267fc640 1 --2- 172.21.15.78:0/1792305299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b0aad80 0x557b3b0ac170 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f4f1002a930 tx=0x7f4f10040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1500bb4c720ea0cf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.738+0000 7f4f1d7fa640 1 -- 172.21.15.78:0/1792305299 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f100043f0 con 0x557b3b0aad80 2024-09-11T00:26:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.738+0000 7f4f1d7fa640 1 -- 172.21.15.78:0/1792305299 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f1004e040 con 0x557b3b0aad80 2024-09-11T00:26:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.738+0000 7f4f1d7fa640 1 -- 172.21.15.78:0/1792305299 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1003d6b0 con 0x557b3b0aad80 2024-09-11T00:26:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.739+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1792305299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b0aad80 msgr2=0x557b3b0ac170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.739+0000 7f4f2fc64740 1 --2- 172.21.15.78:0/1792305299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b0aad80 0x557b3b0ac170 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f4f1002a930 tx=0x7f4f10040040 comp rx=0 tx=0).stop 2024-09-11T00:26:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.739+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1792305299 shutdown_connections 2024-09-11T00:26:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.739+0000 7f4f2fc64740 1 --2- 172.21.15.78:0/1792305299 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b0aad80 0x557b3b0ac170 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.739+0000 7f4f2fc64740 1 --2- 172.21.15.78:0/1792305299 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557b3b09edf0 0x557b3b09b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.739+0000 7f4f2fc64740 1 --2- 172.21.15.78:0/1792305299 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b3b09e4d0 0x557b3b0b6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.739+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1792305299 >> 172.21.15.78:0/1792305299 conn(0x557b3b09c300 msgr2=0x557b3b09ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.739+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1792305299 shutdown_connections 2024-09-11T00:26:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.739+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1792305299 wait complete. 2024-09-11T00:26:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.739+0000 7f4f2fc64740 1 -- start start 2024-09-11T00:26:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.739+0000 7f4f2fc64740 1 Processor -- start 2024-09-11T00:26:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f2fc64740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557b3b09e4d0 0x557b3b0bbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f2fc64740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b09edf0 0x557b3b0bc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f2fc64740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b3b0aad80 0x557b3b0bc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f2fc64740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281ad4e0 con 0x557b3b09edf0 2024-09-11T00:26:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f2fc64740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281ae950 con 0x557b3b0aad80 2024-09-11T00:26:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f2fc64740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281adbb0 con 0x557b3b09e4d0 2024-09-11T00:26:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f2fc64740 10 client.0 _ll_register_callbacks cb 0x7f4f1800a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T00:26:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f26ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b09edf0 0x557b3b0bc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f26ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b09edf0 0x557b3b0bc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60866/0 (socket says 172.21.15.78:60866) 2024-09-11T00:26:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f26ffd640 1 -- 172.21.15.78:0/1360480530 learned_addr learned my addr 172.21.15.78:0/1360480530 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:26:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f267fc640 1 --2- 172.21.15.78:0/1360480530 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557b3b09e4d0 0x557b3b0bbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f267fc640 1 --2- 172.21.15.78:0/1360480530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b3b0aad80 0x557b3b0bc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f26ffd640 1 -- 172.21.15.78:0/1360480530 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557b3b09e4d0 msgr2=0x557b3b0bbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:26:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f26ffd640 1 --2- 172.21.15.78:0/1360480530 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557b3b09e4d0 0x557b3b0bbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f26ffd640 1 -- 172.21.15.78:0/1360480530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b3b0aad80 msgr2=0x557b3b0bc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T00:26:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f26ffd640 1 --2- 172.21.15.78:0/1360480530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b3b0aad80 0x557b3b0bc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f26ffd640 1 -- 172.21.15.78:0/1360480530 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b3b1262b0 con 0x557b3b09edf0 2024-09-11T00:26:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f267fc640 1 --2- 172.21.15.78:0/1360480530 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557b3b09e4d0 0x557b3b0bbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:26:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f26ffd640 1 --2- 172.21.15.78:0/1360480530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b09edf0 0x557b3b0bc050 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x557b3af9f210 tx=0x7f4f18020ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7750eb6265d9349b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f06ffd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-11T00:26:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f06ffd640 1 -- 172.21.15.78:0/1360480530 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f18029030 con 0x557b3b09edf0 2024-09-11T00:26:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f06ffd640 1 -- 172.21.15.78:0/1360480530 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8536+0+0 (secure 0 0 0) 0x7f4f18010900 con 0x557b3b09edf0 2024-09-11T00:26:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.740+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1360480530 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f1004e040 con 0x557b3b09edf0 2024-09-11T00:26:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.741+0000 7f4f06ffd640 1 -- 172.21.15.78:0/1360480530 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4f18033050 con 0x557b3b09edf0 2024-09-11T00:26:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.741+0000 7f4f2fc64740 10 client.16737 fetch_fsmap learned FSMap version 20 2024-09-11T00:26:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.741+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1360480530 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x557b3b127620 con 0x557b3b09edf0 2024-09-11T00:26:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.741+0000 7f4f06ffd640 1 -- 172.21.15.78:0/1360480530 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f1004e040 con 0x557b3b09edf0 2024-09-11T00:26:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.741+0000 7f4f06ffd640 1 -- 172.21.15.78:0/1360480530 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 8330+0+0 (secure 0 0 0) 0x7f4f180048c0 con 0x557b3b09edf0 2024-09-11T00:26:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.741+0000 7f4f2fc64740 10 client.16737 fetch_fsmap finished waiting for FSMap version 20 2024-09-11T00:26:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.741+0000 7f4f2fc64740 10 client.16737 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T00:26:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.741+0000 7f4f2fc64740 20 client.16737 populate_metadata read hostname 'smithi078' 2024-09-11T00:26:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.741+0000 7f4f2fc64740 1 --2- 172.21.15.78:0/1360480530 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557b3b127e20 0x557b3b12a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.741+0000 7f4f2fc64740 4 client.16737 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-11T00:26:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.741+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1360480530 --> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557b3b0128a0 con 0x557b3b127e20 2024-09-11T00:26:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.741+0000 7f4f267fc640 1 --2- 172.21.15.78:0/1360480530 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557b3b127e20 0x557b3b12a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.742+0000 7f4f06ffd640 10 client.16737 ms_handle_connect on v2:172.21.15.112:6838/433500133 2024-09-11T00:26:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.742+0000 7f4f267fc640 1 --2- 172.21.15.78:0/1360480530 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557b3b127e20 0x557b3b12a240 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f6030244a72007b server_cookie=aded45ecb160fb75 in_seq=0 out_seq=0 2024-09-11T00:26:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.742+0000 7f4f06ffd640 1 -- 172.21.15.78:0/1360480530 <== mds.0 v2:172.21.15.112:6838/433500133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557b3b0128a0 con 0x557b3b127e20 2024-09-11T00:26:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.742+0000 7f4f06ffd640 10 client.16737 handle_command_reply: tid=0 2024-09-11T00:26:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.742+0000 7f4f2fc64740 1 client.16737 shutdown 2024-09-11T00:26:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.742+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1360480530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b09edf0 msgr2=0x557b3b0bc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.742+0000 7f4f2fc64740 1 --2- 172.21.15.78:0/1360480530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b09edf0 0x557b3b0bc050 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x557b3af9f210 tx=0x7f4f18020ac0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.742+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1360480530 shutdown_connections 2024-09-11T00:26:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.742+0000 7f4f2fc64740 1 --2- 172.21.15.78:0/1360480530 >> [v2:172.21.15.112:6838/433500133,v1:172.21.15.112:6839/433500133] conn(0x557b3b127e20 0x557b3b12a240 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.742+0000 7f4f2fc64740 1 --2- 172.21.15.78:0/1360480530 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x557b3b0aad80 0x557b3b0bc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.742+0000 7f4f2fc64740 1 --2- 172.21.15.78:0/1360480530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557b3b09edf0 0x557b3b0bc050 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.742+0000 7f4f2fc64740 1 --2- 172.21.15.78:0/1360480530 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557b3b09e4d0 0x557b3b0bbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.742+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1360480530 >> 172.21.15.78:0/1360480530 conn(0x557b3b09c300 msgr2=0x557b3b0a99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.742+0000 7f4f06ffd640 0 client.16737 ms_handle_reset on v2:172.21.15.112:6838/433500133 2024-09-11T00:26:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.742+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1360480530 shutdown_connections 2024-09-11T00:26:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.742+0000 7f4f2fc64740 1 -- 172.21.15.78:0/1360480530 wait complete. 2024-09-11T00:26:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.742+0000 7f4f2fc64740 20 client.16737 trim_cache size 0 max 16384 2024-09-11T00:26:29.753 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-11T00:26:29.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.743+0000 7f4f2d88f640 1 -- 172.21.15.78:0/1931297880 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4f140b54d0 msgr2=0x7f4f140b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:29.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.743+0000 7f4f2d88f640 1 --2- 172.21.15.78:0/1931297880 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4f140b54d0 0x7f4f140b7990 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4f200a9480 tx=0x7f4f20097040 comp rx=0 tx=0).stop 2024-09-11T00:26:29.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.743+0000 7f4f2d88f640 1 -- 172.21.15.78:0/1931297880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f2810d120 msgr2=0x7f4f2819ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:29.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.743+0000 7f4f2d88f640 1 --2- 172.21.15.78:0/1931297880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f2810d120 0x7f4f2819ec40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000eaa0 tx=0x7f4f2000ef60 comp rx=0 tx=0).stop 2024-09-11T00:26:29.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.743+0000 7f4f2d88f640 1 -- 172.21.15.78:0/1931297880 shutdown_connections 2024-09-11T00:26:29.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.743+0000 7f4f2d88f640 1 --2- 172.21.15.78:0/1931297880 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f4f140b54d0 0x7f4f140b7990 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.743+0000 7f4f2d88f640 1 --2- 172.21.15.78:0/1931297880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f2810d120 0x7f4f2819ec40 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.743+0000 7f4f2d88f640 1 --2- 172.21.15.78:0/1931297880 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f281045e0 0x7f4f281998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.743+0000 7f4f2d88f640 1 --2- 172.21.15.78:0/1931297880 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f28103cc0 0x7f4f28199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:29.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.743+0000 7f4f2d88f640 1 -- 172.21.15.78:0/1931297880 >> 172.21.15.78:0/1931297880 conn(0x7f4f280fd700 msgr2=0x7f4f280fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:29.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.743+0000 7f4f2d88f640 1 -- 172.21.15.78:0/1931297880 shutdown_connections 2024-09-11T00:26:29.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:29.743+0000 7f4f2d88f640 1 -- 172.21.15.78:0/1931297880 wait complete. 2024-09-11T00:26:30.212 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:29 smithi078 ceph-mon[30865]: pgmap v632: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:26:30.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:29 smithi112 ceph-mon[35627]: pgmap v632: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:26:30.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:29 smithi138 ceph-mon[35019]: pgmap v632: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-11T00:26:30.574 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-11T00:26:30.575 INFO:tasks.fwd_scrub:done joining 2024-09-11T00:26:30.575 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-11T00:26:30.587 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T00:26:30.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.689+0000 7f0508fc6640 1 -- 172.21.15.78:0/3959109612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05041075c0 msgr2=0x7f0504107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:30.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.689+0000 7f0508fc6640 1 --2- 172.21.15.78:0/3959109612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05041075c0 0x7f0504107a00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f04ec009900 tx=0x7f04ec02a410 comp rx=0 tx=0).stop 2024-09-11T00:26:30.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.689+0000 7f0508fc6640 1 -- 172.21.15.78:0/3959109612 shutdown_connections 2024-09-11T00:26:30.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.689+0000 7f0508fc6640 1 --2- 172.21.15.78:0/3959109612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0504107f40 0x7f050410e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:30.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.689+0000 7f0508fc6640 1 --2- 172.21.15.78:0/3959109612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05041075c0 0x7f0504107a00 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:30.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.689+0000 7f0508fc6640 1 --2- 172.21.15.78:0/3959109612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0504101fe0 0x7f05041023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:30.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.689+0000 7f0508fc6640 1 -- 172.21.15.78:0/3959109612 >> 172.21.15.78:0/3959109612 conn(0x7f0504077670 msgr2=0x7f0504077a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:30.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.689+0000 7f0508fc6640 1 -- 172.21.15.78:0/3959109612 shutdown_connections 2024-09-11T00:26:30.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.689+0000 7f0508fc6640 1 -- 172.21.15.78:0/3959109612 wait complete. 2024-09-11T00:26:30.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.690+0000 7f0508fc6640 1 Processor -- start 2024-09-11T00:26:30.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.690+0000 7f0508fc6640 1 -- start start 2024-09-11T00:26:30.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.690+0000 7f0508fc6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0504101fe0 0x7f05041991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:30.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.690+0000 7f0508fc6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05041075c0 0x7f0504199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:30.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.690+0000 7f0508fc6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0504107f40 0x7f050419eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:30.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.690+0000 7f0508fc6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0504112d70 con 0x7f0504107f40 2024-09-11T00:26:30.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.690+0000 7f0508fc6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0504112bf0 con 0x7f05041075c0 2024-09-11T00:26:30.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.690+0000 7f0508fc6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0504112ef0 con 0x7f0504101fe0 2024-09-11T00:26:30.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.690+0000 7f0502d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0504107f40 0x7f050419eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:30.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.690+0000 7f0502d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0504107f40 0x7f050419eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60876/0 (socket says 172.21.15.78:60876) 2024-09-11T00:26:30.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.690+0000 7f0502d9d640 1 -- 172.21.15.78:0/438083054 learned_addr learned my addr 172.21.15.78:0/438083054 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:26:30.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.690+0000 7f0501d9b640 1 --2- 172.21.15.78:0/438083054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05041075c0 0x7f0504199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:30.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.690+0000 7f0502d9d640 1 -- 172.21.15.78:0/438083054 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0504101fe0 msgr2=0x7f05041991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:30.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.690+0000 7f050259c640 1 --2- 172.21.15.78:0/438083054 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0504101fe0 0x7f05041991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:30.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.690+0000 7f0502d9d640 1 --2- 172.21.15.78:0/438083054 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0504101fe0 0x7f05041991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:30.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.690+0000 7f0502d9d640 1 -- 172.21.15.78:0/438083054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05041075c0 msgr2=0x7f0504199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:30.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.690+0000 7f0502d9d640 1 --2- 172.21.15.78:0/438083054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05041075c0 0x7f0504199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:30.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.690+0000 7f0502d9d640 1 -- 172.21.15.78:0/438083054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050419f270 con 0x7f0504107f40 2024-09-11T00:26:30.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.690+0000 7f0501d9b640 1 --2- 172.21.15.78:0/438083054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05041075c0 0x7f0504199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:26:30.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.690+0000 7f050259c640 1 --2- 172.21.15.78:0/438083054 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0504101fe0 0x7f05041991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:26:30.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.691+0000 7f0502d9d640 1 --2- 172.21.15.78:0/438083054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0504107f40 0x7f050419eaa0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f04f400cce0 tx=0x7f04f400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:30.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.691+0000 7f04fb7fe640 1 -- 172.21.15.78:0/438083054 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f400f450 con 0x7f0504107f40 2024-09-11T00:26:30.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.691+0000 7f0508fc6640 1 -- 172.21.15.78:0/438083054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f050419f560 con 0x7f0504107f40 2024-09-11T00:26:30.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.691+0000 7f04fb7fe640 1 -- 172.21.15.78:0/438083054 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04f400faa0 con 0x7f0504107f40 2024-09-11T00:26:30.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.691+0000 7f04fb7fe640 1 -- 172.21.15.78:0/438083054 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f4018b70 con 0x7f0504107f40 2024-09-11T00:26:30.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.691+0000 7f0508fc6640 1 -- 172.21.15.78:0/438083054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05041a5c20 con 0x7f0504107f40 2024-09-11T00:26:30.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.692+0000 7f0508fc6640 1 -- 172.21.15.78:0/438083054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05041023c0 con 0x7f0504107f40 2024-09-11T00:26:30.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.694+0000 7f04fb7fe640 1 -- 172.21.15.78:0/438083054 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f04f400f5f0 con 0x7f0504107f40 2024-09-11T00:26:30.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.695+0000 7f04fb7fe640 1 --2- 172.21.15.78:0/438083054 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f04f00b5450 0x7f04f00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:30.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.695+0000 7f050259c640 1 --2- 172.21.15.78:0/438083054 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f04f00b5450 0x7f04f00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:30.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.695+0000 7f04fb7fe640 1 -- 172.21.15.78:0/438083054 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8536+0+0 (secure 0 0 0) 0x7f04f40e68d0 con 0x7f0504107f40 2024-09-11T00:26:30.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.695+0000 7f050259c640 1 --2- 172.21.15.78:0/438083054 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f04f00b5450 0x7f04f00b7910 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f04fc009b40 tx=0x7f04fc005e50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:30.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.697+0000 7f04fb7fe640 1 -- 172.21.15.78:0/438083054 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f04f4014030 con 0x7f0504107f40 2024-09-11T00:26:30.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.877+0000 7f0508fc6640 1 -- 172.21.15.78:0/438083054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f050419a2f0 con 0x7f0504107f40 2024-09-11T00:26:30.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.878+0000 7f04fb7fe640 1 -- 172.21.15.78:0/438083054 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+23308 (secure 0 0 0) 0x7f050419a2f0 con 0x7f0504107f40 2024-09-11T00:26:30.880 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:26:30.881 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":87,"fsid":"85a53860-6fd1-11ef-bcea-c7b262605968","created":"2024-09-11T00:06:05.704745+0000","modified":"2024-09-11T00:26:15.619172+0000","last_up_change":"2024-09-11T00:13:35.307216+0000","last_in_change":"2024-09-11T00:13:12.730667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:09:47.891696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:22.345345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:24.446029+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":86,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d260c219-52f2-4e7f-9188-9e66ee01dacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6803","nonce":3736366730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6805","nonce":3736366730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6809","nonce":3736366730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6807","nonce":3736366730}]},"public_addr":"172.21.15.78:6803/3736366730","cluster_addr":"172.21.15.78:6805/3736366730","heartbeat_back_addr":"172.21.15.78:6809/3736366730","heartbeat_front_addr":"172.21.15.78:6807/3736366730","state":["exists","up"]},{"osd":1,"uuid":"d0f286a2-a121-40ee-8134-67ef01b1bc9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6801","nonce":3186321784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6803","nonce":3186321784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6807","nonce":3186321784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6805","nonce":3186321784}]},"public_addr":"172.21.15.112:6801/3186321784","cluster_addr":"172.21.15.112:6803/3186321784","heartbeat_back_addr":"172.21.15.112:6807/3186321784","heartbeat_front_addr":"172.21.15.112:6805/3186321784","state":["exists","up"]},{"osd":2,"uuid":"0eadcce5-12af-4af6-9b4e-159e84454d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6801","nonce":3206386630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6803","nonce":3206386630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6807","nonce":3206386630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6805","nonce":3206386630}]},"public_addr":"172.21.15.138:6801/3206386630","cluster_addr":"172.21.15.138:6803/3206386630","heartbeat_back_addr":"172.21.15.138:6807/3206386630","heartbeat_front_addr":"172.21.15.138:6805/3206386630","state":["exists","up"]},{"osd":3,"uuid":"5f3f683d-6306-43da-8bbd-c103eca442ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6811","nonce":3832405256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6813","nonce":3832405256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6817","nonce":3832405256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6815","nonce":3832405256}]},"public_addr":"172.21.15.78:6811/3832405256","cluster_addr":"172.21.15.78:6813/3832405256","heartbeat_back_addr":"172.21.15.78:6817/3832405256","heartbeat_front_addr":"172.21.15.78:6815/3832405256","state":["exists","up"]},{"osd":4,"uuid":"4575a0a5-821e-4346-84ac-5396042b0550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6809","nonce":2650243435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6811","nonce":2650243435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6815","nonce":2650243435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6813","nonce":2650243435}]},"public_addr":"172.21.15.112:6809/2650243435","cluster_addr":"172.21.15.112:6811/2650243435","heartbeat_back_addr":"172.21.15.112:6815/2650243435","heartbeat_front_addr":"172.21.15.112:6813/2650243435","state":["exists","up"]},{"osd":5,"uuid":"e81eb98f-76eb-4da5-8047-f160888720e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6809","nonce":3033110975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6811","nonce":3033110975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6815","nonce":3033110975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6813","nonce":3033110975}]},"public_addr":"172.21.15.138:6809/3033110975","cluster_addr":"172.21.15.138:6811/3033110975","heartbeat_back_addr":"172.21.15.138:6815/3033110975","heartbeat_front_addr":"172.21.15.138:6813/3033110975","state":["exists","up"]},{"osd":6,"uuid":"7442a091-4dba-45c4-808b-7c3b97087aa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6819","nonce":477087575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6821","nonce":477087575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6825","nonce":477087575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6823","nonce":477087575}]},"public_addr":"172.21.15.78:6819/477087575","cluster_addr":"172.21.15.78:6821/477087575","heartbeat_back_addr":"172.21.15.78:6825/477087575","heartbeat_front_addr":"172.21.15.78:6823/477087575","state":["exists","up"]},{"osd":7,"uuid":"220c1f03-ace9-4dd0-a06d-485b0d2d08bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6817","nonce":1481363296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6819","nonce":1481363296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6823","nonce":1481363296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6821","nonce":1481363296}]},"public_addr":"172.21.15.112:6817/1481363296","cluster_addr":"172.21.15.112:6819/1481363296","heartbeat_back_addr":"172.21.15.112:6823/1481363296","heartbeat_front_addr":"172.21.15.112:6821/1481363296","state":["exists","up"]},{"osd":8,"uuid":"adb6edaa-9a8c-4b0b-aa6a-26dc77a3a7cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6817","nonce":2195149036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6819","nonce":2195149036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6823","nonce":2195149036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6821","nonce":2195149036}]},"public_addr":"172.21.15.138:6817/2195149036","cluster_addr":"172.21.15.138:6819/2195149036","heartbeat_back_addr":"172.21.15.138:6823/2195149036","heartbeat_front_addr":"172.21.15.138:6821/2195149036","state":["exists","up"]},{"osd":9,"uuid":"dd01f408-3712-410e-acbd-c797b7ea5058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6827","nonce":3367249449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6829","nonce":3367249449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6833","nonce":3367249449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6831","nonce":3367249449}]},"public_addr":"172.21.15.78:6827/3367249449","cluster_addr":"172.21.15.78:6829/3367249449","heartbeat_back_addr":"172.21.15.78:6833/3367249449","heartbeat_front_addr":"172.21.15.78:6831/3367249449","state":["exists","up"]},{"osd":10,"uuid":"243c6483-1b0e-49f2-b99c-116d9e9c0617","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6825","nonce":775023408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6827","nonce":775023408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6831","nonce":775023408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6829","nonce":775023408}]},"public_addr":"172.21.15.112:6825/775023408","cluster_addr":"172.21.15.112:6827/775023408","heartbeat_back_addr":"172.21.15.112:6831/775023408","heartbeat_front_addr":"172.21.15.112:6829/775023408","state":["exists","up"]},{"osd":11,"uuid":"fa20ac9e-b5f7-4b3a-bb51-31569f909609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6825","nonce":4046089012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6827","nonce":4046089012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6831","nonce":4046089012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6829","nonce":4046089012}]},"public_addr":"172.21.15.138:6825/4046089012","cluster_addr":"172.21.15.138:6827/4046089012","heartbeat_back_addr":"172.21.15.138:6831/4046089012","heartbeat_front_addr":"172.21.15.138:6829/4046089012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:08:55.896475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:20.695819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:44.785187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:10.858705+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:35.855800+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:01.353037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:27.492985+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:52.860532+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:17.946878+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:43.188966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:08.369978+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:34.192288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":8}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6801/2525199237":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/1476776463":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1949658157":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2276853910":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/4205790529":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6800/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/4286825123":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6801/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1304243506":"2024-09-12T00:06:56.062555+0000","172.21.15.78:6800/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1614270050":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6801/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1679390655":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2957982486":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6800/2525199237":"2024-09-12T00:07:55.586578+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:26:30.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.880+0000 7f0508fc6640 1 -- 172.21.15.78:0/438083054 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f04f00b5450 msgr2=0x7f04f00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:30.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.880+0000 7f0508fc6640 1 --2- 172.21.15.78:0/438083054 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f04f00b5450 0x7f04f00b7910 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f04fc009b40 tx=0x7f04fc005e50 comp rx=0 tx=0).stop 2024-09-11T00:26:30.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.880+0000 7f0508fc6640 1 -- 172.21.15.78:0/438083054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0504107f40 msgr2=0x7f050419eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:30.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.880+0000 7f0508fc6640 1 --2- 172.21.15.78:0/438083054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0504107f40 0x7f050419eaa0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f04f400cce0 tx=0x7f04f400a620 comp rx=0 tx=0).stop 2024-09-11T00:26:30.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.880+0000 7f0508fc6640 1 -- 172.21.15.78:0/438083054 shutdown_connections 2024-09-11T00:26:30.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.880+0000 7f0508fc6640 1 --2- 172.21.15.78:0/438083054 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f04f00b5450 0x7f04f00b7910 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:30.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.880+0000 7f0508fc6640 1 --2- 172.21.15.78:0/438083054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0504107f40 0x7f050419eaa0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:30.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.880+0000 7f0508fc6640 1 --2- 172.21.15.78:0/438083054 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f05041075c0 0x7f0504199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:30.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.880+0000 7f0508fc6640 1 --2- 172.21.15.78:0/438083054 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0504101fe0 0x7f05041991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:30.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.880+0000 7f0508fc6640 1 -- 172.21.15.78:0/438083054 >> 172.21.15.78:0/438083054 conn(0x7f0504077670 msgr2=0x7f0504103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:30.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.880+0000 7f0508fc6640 1 -- 172.21.15.78:0/438083054 shutdown_connections 2024-09-11T00:26:30.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.880+0000 7f0508fc6640 1 -- 172.21.15.78:0/438083054 wait complete. 2024-09-11T00:26:30.893 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T00:09:47.891696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-11T00:14:22.345345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-11T00:14:24.446029+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 86, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T00:26:30.894 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T00:26:30.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.995+0000 7fc73c31f640 1 -- 172.21.15.78:0/1126347126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc734101be0 msgr2=0x7fc734101fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:31.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.995+0000 7fc73c31f640 1 --2- 172.21.15.78:0/1126347126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc734101be0 0x7fc734101fc0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fc730009900 tx=0x7fc73002a410 comp rx=0 tx=0).stop 2024-09-11T00:26:31.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.995+0000 7fc73c31f640 1 -- 172.21.15.78:0/1126347126 shutdown_connections 2024-09-11T00:26:31.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.995+0000 7fc73c31f640 1 --2- 172.21.15.78:0/1126347126 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc734107f60 0x7fc73410e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.995+0000 7fc73c31f640 1 --2- 172.21.15.78:0/1126347126 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc7341075e0 0x7fc734107a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.995+0000 7fc73c31f640 1 --2- 172.21.15.78:0/1126347126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc734101be0 0x7fc734101fc0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.995+0000 7fc73c31f640 1 -- 172.21.15.78:0/1126347126 >> 172.21.15.78:0/1126347126 conn(0x7fc7340fd640 msgr2=0x7fc7340ffa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:31.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.995+0000 7fc73c31f640 1 -- 172.21.15.78:0/1126347126 shutdown_connections 2024-09-11T00:26:31.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.995+0000 7fc73c31f640 1 -- 172.21.15.78:0/1126347126 wait complete. 2024-09-11T00:26:31.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.996+0000 7fc73c31f640 1 Processor -- start 2024-09-11T00:26:31.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.996+0000 7fc73c31f640 1 -- start start 2024-09-11T00:26:31.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.996+0000 7fc73c31f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc734101be0 0x7fc734199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:31.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.996+0000 7fc73c31f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7341075e0 0x7fc734199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:31.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.996+0000 7fc73c31f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc734107f60 0x7fc73419eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:31.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.996+0000 7fc73c31f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc734111c20 con 0x7fc7341075e0 2024-09-11T00:26:31.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.996+0000 7fc73c31f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc734111aa0 con 0x7fc734107f60 2024-09-11T00:26:31.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.996+0000 7fc73c31f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc734111da0 con 0x7fc734101be0 2024-09-11T00:26:31.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.996+0000 7fc7398ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7341075e0 0x7fc734199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:31.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.996+0000 7fc7398ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7341075e0 0x7fc734199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60894/0 (socket says 172.21.15.78:60894) 2024-09-11T00:26:31.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.996+0000 7fc7398ba640 1 -- 172.21.15.78:0/3293099695 learned_addr learned my addr 172.21.15.78:0/3293099695 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:26:31.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.996+0000 7fc73a8bc640 1 --2- 172.21.15.78:0/3293099695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc734107f60 0x7fc73419eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:31.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.997+0000 7fc73a0bb640 1 --2- 172.21.15.78:0/3293099695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc734101be0 0x7fc734199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:31.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.997+0000 7fc7398ba640 1 -- 172.21.15.78:0/3293099695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc734101be0 msgr2=0x7fc734199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:31.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.997+0000 7fc7398ba640 1 --2- 172.21.15.78:0/3293099695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc734101be0 0x7fc734199210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.997+0000 7fc7398ba640 1 -- 172.21.15.78:0/3293099695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc734107f60 msgr2=0x7fc73419eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:31.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.997+0000 7fc7398ba640 1 --2- 172.21.15.78:0/3293099695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc734107f60 0x7fc73419eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.997+0000 7fc7398ba640 1 -- 172.21.15.78:0/3293099695 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc73419f2b0 con 0x7fc7341075e0 2024-09-11T00:26:31.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.997+0000 7fc7398ba640 1 --2- 172.21.15.78:0/3293099695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7341075e0 0x7fc734199750 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc72400d950 tx=0x7fc72400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:31.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.997+0000 7fc72b7fe640 1 -- 172.21.15.78:0/3293099695 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc724017070 con 0x7fc7341075e0 2024-09-11T00:26:31.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.997+0000 7fc72b7fe640 1 -- 172.21.15.78:0/3293099695 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc724009c30 con 0x7fc7341075e0 2024-09-11T00:26:31.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.997+0000 7fc73c31f640 1 -- 172.21.15.78:0/3293099695 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc73419f5a0 con 0x7fc7341075e0 2024-09-11T00:26:31.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.997+0000 7fc72b7fe640 1 -- 172.21.15.78:0/3293099695 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72400f620 con 0x7fc7341075e0 2024-09-11T00:26:31.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.997+0000 7fc73c31f640 1 -- 172.21.15.78:0/3293099695 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7341a5e40 con 0x7fc7341075e0 2024-09-11T00:26:31.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.998+0000 7fc73c31f640 1 -- 172.21.15.78:0/3293099695 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc734101fc0 con 0x7fc7341075e0 2024-09-11T00:26:31.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:30.999+0000 7fc72b7fe640 1 -- 172.21.15.78:0/3293099695 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fc724010460 con 0x7fc7341075e0 2024-09-11T00:26:31.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.001+0000 7fc72b7fe640 1 --2- 172.21.15.78:0/3293099695 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc7200b54d0 0x7fc7200b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:31.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.001+0000 7fc73a0bb640 1 --2- 172.21.15.78:0/3293099695 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc7200b54d0 0x7fc7200b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:31.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.001+0000 7fc72b7fe640 1 -- 172.21.15.78:0/3293099695 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8536+0+0 (secure 0 0 0) 0x7fc7240e5c60 con 0x7fc7341075e0 2024-09-11T00:26:31.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.001+0000 7fc73a0bb640 1 --2- 172.21.15.78:0/3293099695 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc7200b54d0 0x7fc7200b7990 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc730006010 tx=0x7fc730000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:31.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.004+0000 7fc72b7fe640 1 -- 172.21.15.78:0/3293099695 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc7240ac850 con 0x7fc7341075e0 2024-09-11T00:26:31.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.178+0000 7fc73c31f640 1 -- 172.21.15.78:0/3293099695 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc7341a6010 con 0x7fc7341075e0 2024-09-11T00:26:31.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.179+0000 7fc72b7fe640 1 -- 172.21.15.78:0/3293099695 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7fc724009de0 con 0x7fc7341075e0 2024-09-11T00:26:31.180 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-09-11T00:26:31.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.181+0000 7fc73c31f640 1 -- 172.21.15.78:0/3293099695 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc7200b54d0 msgr2=0x7fc7200b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:31.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.181+0000 7fc73c31f640 1 --2- 172.21.15.78:0/3293099695 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc7200b54d0 0x7fc7200b7990 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc730006010 tx=0x7fc730000bc0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.181+0000 7fc73c31f640 1 -- 172.21.15.78:0/3293099695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7341075e0 msgr2=0x7fc734199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:31.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.181+0000 7fc73c31f640 1 --2- 172.21.15.78:0/3293099695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7341075e0 0x7fc734199750 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc72400d950 tx=0x7fc72400de10 comp rx=0 tx=0).stop 2024-09-11T00:26:31.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.181+0000 7fc73c31f640 1 -- 172.21.15.78:0/3293099695 shutdown_connections 2024-09-11T00:26:31.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.181+0000 7fc73c31f640 1 --2- 172.21.15.78:0/3293099695 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fc7200b54d0 0x7fc7200b7990 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.181+0000 7fc73c31f640 1 --2- 172.21.15.78:0/3293099695 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc734107f60 0x7fc73419eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.181+0000 7fc73c31f640 1 --2- 172.21.15.78:0/3293099695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7341075e0 0x7fc734199750 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.181+0000 7fc73c31f640 1 --2- 172.21.15.78:0/3293099695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc734101be0 0x7fc734199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.181+0000 7fc73c31f640 1 -- 172.21.15.78:0/3293099695 >> 172.21.15.78:0/3293099695 conn(0x7fc7340fd640 msgr2=0x7fc73406b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:31.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.181+0000 7fc73c31f640 1 -- 172.21.15.78:0/3293099695 shutdown_connections 2024-09-11T00:26:31.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.181+0000 7fc73c31f640 1 -- 172.21.15.78:0/3293099695 wait complete. 2024-09-11T00:26:31.192 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:30 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/438083054' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:26:31.193 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-11T00:26:31.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:30 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/438083054' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:26:31.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:30 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/438083054' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:26:31.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.293+0000 7fa9d3f94640 1 -- 172.21.15.78:0/855125793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9cc109080 msgr2=0x7fa9cc10f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:31.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.293+0000 7fa9d3f94640 1 --2- 172.21.15.78:0/855125793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9cc109080 0x7fa9cc10f880 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009ca0 tx=0x7fa9c402a8c0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.293+0000 7fa9d3f94640 1 -- 172.21.15.78:0/855125793 shutdown_connections 2024-09-11T00:26:31.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.293+0000 7fa9d3f94640 1 --2- 172.21.15.78:0/855125793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9cc109080 0x7fa9cc10f880 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.293+0000 7fa9d3f94640 1 --2- 172.21.15.78:0/855125793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9cc108700 0x7fa9cc108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.293+0000 7fa9d3f94640 1 --2- 172.21.15.78:0/855125793 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9cc102d00 0x7fa9cc1030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.293+0000 7fa9d3f94640 1 -- 172.21.15.78:0/855125793 >> 172.21.15.78:0/855125793 conn(0x7fa9cc0fe740 msgr2=0x7fa9cc100b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:31.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.293+0000 7fa9d3f94640 1 -- 172.21.15.78:0/855125793 shutdown_connections 2024-09-11T00:26:31.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.293+0000 7fa9d3f94640 1 -- 172.21.15.78:0/855125793 wait complete. 2024-09-11T00:26:31.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.294+0000 7fa9d3f94640 1 Processor -- start 2024-09-11T00:26:31.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.294+0000 7fa9d3f94640 1 -- start start 2024-09-11T00:26:31.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.294+0000 7fa9d3f94640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9cc102d00 0x7fa9cc199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:31.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.294+0000 7fa9d3f94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9cc108700 0x7fa9cc199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:31.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.294+0000 7fa9d3f94640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9cc109080 0x7fa9cc19ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:31.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.294+0000 7fa9d3f94640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc112d40 con 0x7fa9cc108700 2024-09-11T00:26:31.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.294+0000 7fa9d3f94640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc112bc0 con 0x7fa9cc109080 2024-09-11T00:26:31.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.294+0000 7fa9d3f94640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc112ec0 con 0x7fa9cc102d00 2024-09-11T00:26:31.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.294+0000 7fa9d152f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9cc108700 0x7fa9cc199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:31.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.294+0000 7fa9d152f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9cc108700 0x7fa9cc199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60908/0 (socket says 172.21.15.78:60908) 2024-09-11T00:26:31.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.294+0000 7fa9d152f640 1 -- 172.21.15.78:0/3824657785 learned_addr learned my addr 172.21.15.78:0/3824657785 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:26:31.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.294+0000 7fa9d1d30640 1 --2- 172.21.15.78:0/3824657785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9cc102d00 0x7fa9cc199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:31.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.294+0000 7fa9d2531640 1 --2- 172.21.15.78:0/3824657785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9cc109080 0x7fa9cc19ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:31.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.294+0000 7fa9d152f640 1 -- 172.21.15.78:0/3824657785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9cc102d00 msgr2=0x7fa9cc199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:31.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.294+0000 7fa9d152f640 1 --2- 172.21.15.78:0/3824657785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9cc102d00 0x7fa9cc199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.294+0000 7fa9d152f640 1 -- 172.21.15.78:0/3824657785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9cc109080 msgr2=0x7fa9cc19ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:31.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.294+0000 7fa9d152f640 1 --2- 172.21.15.78:0/3824657785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9cc109080 0x7fa9cc19ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.294+0000 7fa9d152f640 1 -- 172.21.15.78:0/3824657785 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9cc19f2a0 con 0x7fa9cc108700 2024-09-11T00:26:31.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.294+0000 7fa9d152f640 1 --2- 172.21.15.78:0/3824657785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9cc108700 0x7fa9cc199740 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800d950 tx=0x7fa9c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:31.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.295+0000 7fa9beffd640 1 -- 172.21.15.78:0/3824657785 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8017030 con 0x7fa9cc108700 2024-09-11T00:26:31.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.295+0000 7fa9beffd640 1 -- 172.21.15.78:0/3824657785 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9c8004020 con 0x7fa9cc108700 2024-09-11T00:26:31.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.295+0000 7fa9d3f94640 1 -- 172.21.15.78:0/3824657785 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9cc19f590 con 0x7fa9cc108700 2024-09-11T00:26:31.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.295+0000 7fa9beffd640 1 -- 172.21.15.78:0/3824657785 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c80047a0 con 0x7fa9cc108700 2024-09-11T00:26:31.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.295+0000 7fa9d3f94640 1 -- 172.21.15.78:0/3824657785 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9cc1a5c50 con 0x7fa9cc108700 2024-09-11T00:26:31.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.296+0000 7fa9d3f94640 1 -- 172.21.15.78:0/3824657785 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9cc1030e0 con 0x7fa9cc108700 2024-09-11T00:26:31.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.297+0000 7fa9beffd640 1 -- 172.21.15.78:0/3824657785 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fa9c8009a30 con 0x7fa9cc108700 2024-09-11T00:26:31.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.298+0000 7fa9beffd640 1 --2- 172.21.15.78:0/3824657785 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa9b80b5450 0x7fa9b80b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:31.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.298+0000 7fa9d1d30640 1 --2- 172.21.15.78:0/3824657785 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa9b80b5450 0x7fa9b80b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:31.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.298+0000 7fa9beffd640 1 -- 172.21.15.78:0/3824657785 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8536+0+0 (secure 0 0 0) 0x7fa9c80e6110 con 0x7fa9cc108700 2024-09-11T00:26:31.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.298+0000 7fa9d1d30640 1 --2- 172.21.15.78:0/3824657785 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa9b80b5450 0x7fa9b80b7910 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009890 tx=0x7fa9c0008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:31.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.301+0000 7fa9beffd640 1 -- 172.21.15.78:0/3824657785 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa9c80acd20 con 0x7fa9cc108700 2024-09-11T00:26:31.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.476+0000 7fa9d3f94640 1 -- 172.21.15.78:0/3824657785 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa9cc02e5c0 con 0x7fa9cc108700 2024-09-11T00:26:31.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.477+0000 7fa9beffd640 1 -- 172.21.15.78:0/3824657785 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7fa9c80ac620 con 0x7fa9cc108700 2024-09-11T00:26:31.480 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2024-09-11T00:26:31.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.479+0000 7fa9d3f94640 1 -- 172.21.15.78:0/3824657785 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa9b80b5450 msgr2=0x7fa9b80b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:31.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.479+0000 7fa9d3f94640 1 --2- 172.21.15.78:0/3824657785 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa9b80b5450 0x7fa9b80b7910 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009890 tx=0x7fa9c0008040 comp rx=0 tx=0).stop 2024-09-11T00:26:31.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.479+0000 7fa9d3f94640 1 -- 172.21.15.78:0/3824657785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9cc108700 msgr2=0x7fa9cc199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:31.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.479+0000 7fa9d3f94640 1 --2- 172.21.15.78:0/3824657785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9cc108700 0x7fa9cc199740 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800d950 tx=0x7fa9c800de10 comp rx=0 tx=0).stop 2024-09-11T00:26:31.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.479+0000 7fa9d3f94640 1 -- 172.21.15.78:0/3824657785 shutdown_connections 2024-09-11T00:26:31.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.479+0000 7fa9d3f94640 1 --2- 172.21.15.78:0/3824657785 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa9b80b5450 0x7fa9b80b7910 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.479+0000 7fa9d3f94640 1 --2- 172.21.15.78:0/3824657785 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa9cc109080 0x7fa9cc19ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.479+0000 7fa9d3f94640 1 --2- 172.21.15.78:0/3824657785 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9cc108700 0x7fa9cc199740 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.479+0000 7fa9d3f94640 1 --2- 172.21.15.78:0/3824657785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9cc102d00 0x7fa9cc199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.479+0000 7fa9d3f94640 1 -- 172.21.15.78:0/3824657785 >> 172.21.15.78:0/3824657785 conn(0x7fa9cc0fe740 msgr2=0x7fa9cc100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:31.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.479+0000 7fa9d3f94640 1 -- 172.21.15.78:0/3824657785 shutdown_connections 2024-09-11T00:26:31.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.479+0000 7fa9d3f94640 1 -- 172.21.15.78:0/3824657785 wait complete. 2024-09-11T00:26:31.492 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-11T00:26:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.593+0000 7ff187695640 1 -- 172.21.15.78:0/3425497693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1801086d0 msgr2=0x7ff180108b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.593+0000 7ff187695640 1 --2- 172.21.15.78:0/3425497693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1801086d0 0x7ff180108b10 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff170009900 tx=0x7ff17002a410 comp rx=0 tx=0).stop 2024-09-11T00:26:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.593+0000 7ff187695640 1 -- 172.21.15.78:0/3425497693 shutdown_connections 2024-09-11T00:26:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.593+0000 7ff187695640 1 --2- 172.21.15.78:0/3425497693 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff180109050 0x7ff18010f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.593+0000 7ff187695640 1 --2- 172.21.15.78:0/3425497693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1801086d0 0x7ff180108b10 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.593+0000 7ff187695640 1 --2- 172.21.15.78:0/3425497693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff180102cd0 0x7ff1801030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.593+0000 7ff187695640 1 -- 172.21.15.78:0/3425497693 >> 172.21.15.78:0/3425497693 conn(0x7ff1800fe710 msgr2=0x7ff180100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.593+0000 7ff187695640 1 -- 172.21.15.78:0/3425497693 shutdown_connections 2024-09-11T00:26:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.593+0000 7ff187695640 1 -- 172.21.15.78:0/3425497693 wait complete. 2024-09-11T00:26:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.593+0000 7ff187695640 1 Processor -- start 2024-09-11T00:26:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.593+0000 7ff187695640 1 -- start start 2024-09-11T00:26:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.593+0000 7ff187695640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff180102cd0 0x7ff180199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.593+0000 7ff187695640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1801086d0 0x7ff1801996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.594+0000 7ff187695640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff180109050 0x7ff18019ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.594+0000 7ff187695640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff180112ca0 con 0x7ff180109050 2024-09-11T00:26:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.594+0000 7ff187695640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff180112b20 con 0x7ff1801086d0 2024-09-11T00:26:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.594+0000 7ff187695640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff180112e20 con 0x7ff180102cd0 2024-09-11T00:26:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.594+0000 7ff185c32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff180109050 0x7ff18019ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.594+0000 7ff185c32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff180109050 0x7ff18019ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60914/0 (socket says 172.21.15.78:60914) 2024-09-11T00:26:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.594+0000 7ff185c32640 1 -- 172.21.15.78:0/1299492566 learned_addr learned my addr 172.21.15.78:0/1299492566 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:26:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.594+0000 7ff185431640 1 --2- 172.21.15.78:0/1299492566 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff180102cd0 0x7ff180199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.594+0000 7ff184c30640 1 --2- 172.21.15.78:0/1299492566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1801086d0 0x7ff1801996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.594+0000 7ff185c32640 1 -- 172.21.15.78:0/1299492566 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff180102cd0 msgr2=0x7ff180199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.594+0000 7ff185c32640 1 --2- 172.21.15.78:0/1299492566 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff180102cd0 0x7ff180199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.594+0000 7ff185c32640 1 -- 172.21.15.78:0/1299492566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1801086d0 msgr2=0x7ff1801996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.594+0000 7ff185c32640 1 --2- 172.21.15.78:0/1299492566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1801086d0 0x7ff1801996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.594+0000 7ff185c32640 1 -- 172.21.15.78:0/1299492566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18019f200 con 0x7ff180109050 2024-09-11T00:26:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.594+0000 7ff185c32640 1 --2- 172.21.15.78:0/1299492566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff180109050 0x7ff18019ea30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff17800eaa0 tx=0x7ff17800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.594+0000 7ff1767fc640 1 -- 172.21.15.78:0/1299492566 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17800cdb0 con 0x7ff180109050 2024-09-11T00:26:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.594+0000 7ff1767fc640 1 -- 172.21.15.78:0/1299492566 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff178005020 con 0x7ff180109050 2024-09-11T00:26:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.594+0000 7ff187695640 1 -- 172.21.15.78:0/1299492566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff18019f4f0 con 0x7ff180109050 2024-09-11T00:26:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.594+0000 7ff1767fc640 1 -- 172.21.15.78:0/1299492566 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1780116d0 con 0x7ff180109050 2024-09-11T00:26:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.594+0000 7ff187695640 1 -- 172.21.15.78:0/1299492566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1801a5bb0 con 0x7ff180109050 2024-09-11T00:26:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.595+0000 7ff187695640 1 -- 172.21.15.78:0/1299492566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1801030b0 con 0x7ff180109050 2024-09-11T00:26:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.597+0000 7ff1767fc640 1 -- 172.21.15.78:0/1299492566 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7ff17800f040 con 0x7ff180109050 2024-09-11T00:26:31.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.597+0000 7ff1767fc640 1 --2- 172.21.15.78:0/1299492566 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff16c0b5450 0x7ff16c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:31.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.598+0000 7ff185431640 1 --2- 172.21.15.78:0/1299492566 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff16c0b5450 0x7ff16c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:31.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.598+0000 7ff1767fc640 1 -- 172.21.15.78:0/1299492566 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8536+0+0 (secure 0 0 0) 0x7ff1780e6320 con 0x7ff180109050 2024-09-11T00:26:31.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.598+0000 7ff185431640 1 --2- 172.21.15.78:0/1299492566 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff16c0b5450 0x7ff16c0b7910 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff17c005e10 tx=0x7ff17c005da0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:31.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.601+0000 7ff1767fc640 1 -- 172.21.15.78:0/1299492566 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff178016030 con 0x7ff180109050 2024-09-11T00:26:31.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.776+0000 7ff187695640 1 -- 172.21.15.78:0/1299492566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff18002e5c0 con 0x7ff180109050 2024-09-11T00:26:31.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.776+0000 7ff1767fc640 1 -- 172.21.15.78:0/1299492566 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7ff1780ace90 con 0x7ff180109050 2024-09-11T00:26:31.778 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2024-09-11T00:26:31.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.778+0000 7ff187695640 1 -- 172.21.15.78:0/1299492566 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff16c0b5450 msgr2=0x7ff16c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:31.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.778+0000 7ff187695640 1 --2- 172.21.15.78:0/1299492566 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff16c0b5450 0x7ff16c0b7910 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff17c005e10 tx=0x7ff17c005da0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.778+0000 7ff187695640 1 -- 172.21.15.78:0/1299492566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff180109050 msgr2=0x7ff18019ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:31.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.778+0000 7ff187695640 1 --2- 172.21.15.78:0/1299492566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff180109050 0x7ff18019ea30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff17800eaa0 tx=0x7ff17800ef60 comp rx=0 tx=0).stop 2024-09-11T00:26:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.778+0000 7ff187695640 1 -- 172.21.15.78:0/1299492566 shutdown_connections 2024-09-11T00:26:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.778+0000 7ff187695640 1 --2- 172.21.15.78:0/1299492566 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7ff16c0b5450 0x7ff16c0b7910 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.778+0000 7ff187695640 1 --2- 172.21.15.78:0/1299492566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff180109050 0x7ff18019ea30 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.778+0000 7ff187695640 1 --2- 172.21.15.78:0/1299492566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1801086d0 0x7ff1801996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.778+0000 7ff187695640 1 --2- 172.21.15.78:0/1299492566 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff180102cd0 0x7ff180199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.778+0000 7ff187695640 1 -- 172.21.15.78:0/1299492566 >> 172.21.15.78:0/1299492566 conn(0x7ff1800fe710 msgr2=0x7ff180100b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.778+0000 7ff187695640 1 -- 172.21.15.78:0/1299492566 shutdown_connections 2024-09-11T00:26:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.778+0000 7ff187695640 1 -- 172.21.15.78:0/1299492566 wait complete. 2024-09-11T00:26:31.791 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-11T00:26:31.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.887+0000 7f315606a640 1 -- 172.21.15.78:0/266515118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3150107620 msgr2=0x7f3150107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:31.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.887+0000 7f315606a640 1 --2- 172.21.15.78:0/266515118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3150107620 0x7f3150107a60 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f3138009900 tx=0x7f313802a410 comp rx=0 tx=0).stop 2024-09-11T00:26:31.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.887+0000 7f315606a640 1 -- 172.21.15.78:0/266515118 shutdown_connections 2024-09-11T00:26:31.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.887+0000 7f315606a640 1 --2- 172.21.15.78:0/266515118 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3150107fa0 0x7f315010e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.887+0000 7f315606a640 1 --2- 172.21.15.78:0/266515118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3150107620 0x7f3150107a60 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.887+0000 7f315606a640 1 --2- 172.21.15.78:0/266515118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3150101c20 0x7f3150102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.887+0000 7f315606a640 1 -- 172.21.15.78:0/266515118 >> 172.21.15.78:0/266515118 conn(0x7f31500fd660 msgr2=0x7f31500ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:31.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.887+0000 7f315606a640 1 -- 172.21.15.78:0/266515118 shutdown_connections 2024-09-11T00:26:31.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.887+0000 7f315606a640 1 -- 172.21.15.78:0/266515118 wait complete. 2024-09-11T00:26:31.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.887+0000 7f315606a640 1 Processor -- start 2024-09-11T00:26:31.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.887+0000 7f315606a640 1 -- start start 2024-09-11T00:26:31.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.888+0000 7f315606a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3150101c20 0x7f3150199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:31.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.888+0000 7f315606a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3150107620 0x7f3150199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:31.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.888+0000 7f315606a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3150107fa0 0x7f315019eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:31.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.888+0000 7f315606a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3150111c60 con 0x7f3150101c20 2024-09-11T00:26:31.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.888+0000 7f315606a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3150111ae0 con 0x7f3150107fa0 2024-09-11T00:26:31.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.888+0000 7f315606a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3150111de0 con 0x7f3150107620 2024-09-11T00:26:31.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.888+0000 7f314f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3150101c20 0x7f3150199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:31.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.888+0000 7f314f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3150101c20 0x7f3150199220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60926/0 (socket says 172.21.15.78:60926) 2024-09-11T00:26:31.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.888+0000 7f314f7fe640 1 -- 172.21.15.78:0/3877903213 learned_addr learned my addr 172.21.15.78:0/3877903213 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:26:31.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.888+0000 7f314ffff640 1 --2- 172.21.15.78:0/3877903213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3150107fa0 0x7f315019eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:31.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.888+0000 7f314f7fe640 1 -- 172.21.15.78:0/3877903213 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3150107620 msgr2=0x7f3150199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:31.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.888+0000 7f314f7fe640 1 --2- 172.21.15.78:0/3877903213 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3150107620 0x7f3150199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.888+0000 7f314f7fe640 1 -- 172.21.15.78:0/3877903213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3150107fa0 msgr2=0x7f315019eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:31.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.888+0000 7f314f7fe640 1 --2- 172.21.15.78:0/3877903213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3150107fa0 0x7f315019eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:31.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.888+0000 7f314f7fe640 1 -- 172.21.15.78:0/3877903213 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315019f2c0 con 0x7f3150101c20 2024-09-11T00:26:31.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.888+0000 7f314ffff640 1 --2- 172.21.15.78:0/3877903213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3150107fa0 0x7f315019eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:26:31.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.888+0000 7f314f7fe640 1 --2- 172.21.15.78:0/3877903213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3150101c20 0x7f3150199220 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f314000e9f0 tx=0x7f314000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:31.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.888+0000 7f314d7fa640 1 -- 172.21.15.78:0/3877903213 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314000cd80 con 0x7f3150101c20 2024-09-11T00:26:31.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.888+0000 7f314d7fa640 1 -- 172.21.15.78:0/3877903213 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31400108e0 con 0x7f3150101c20 2024-09-11T00:26:31.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.888+0000 7f315606a640 1 -- 172.21.15.78:0/3877903213 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315019f5b0 con 0x7f3150101c20 2024-09-11T00:26:31.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.888+0000 7f314d7fa640 1 -- 172.21.15.78:0/3877903213 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3140018980 con 0x7f3150101c20 2024-09-11T00:26:31.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.889+0000 7f315606a640 1 -- 172.21.15.78:0/3877903213 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31501a5e50 con 0x7f3150101c20 2024-09-11T00:26:31.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.889+0000 7f315606a640 1 -- 172.21.15.78:0/3877903213 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3150102ec0 con 0x7f3150101c20 2024-09-11T00:26:31.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.891+0000 7f314d7fa640 1 -- 172.21.15.78:0/3877903213 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f3140010430 con 0x7f3150101c20 2024-09-11T00:26:31.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.891+0000 7f314d7fa640 1 --2- 172.21.15.78:0/3877903213 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f313c0b54d0 0x7f313c0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:31.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.891+0000 7f3146ffd640 1 --2- 172.21.15.78:0/3877903213 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f313c0b54d0 0x7f313c0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:31.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.892+0000 7f314d7fa640 1 -- 172.21.15.78:0/3877903213 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8536+0+0 (secure 0 0 0) 0x7f31400e6920 con 0x7f3150101c20 2024-09-11T00:26:31.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.892+0000 7f3146ffd640 1 --2- 172.21.15.78:0/3877903213 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f313c0b54d0 0x7f313c0b7990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f31380096c0 tx=0x7f3138031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:31.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:31.894+0000 7f314d7fa640 1 -- 172.21.15.78:0/3877903213 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f31400ad430 con 0x7f3150101c20 2024-09-11T00:26:32.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:31 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3293099695' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T00:26:32.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:31 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3824657785' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-11T00:26:32.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:31 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1299492566' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-11T00:26:32.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:31 smithi078 ceph-mon[30865]: pgmap v633: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:26:32.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:32.121+0000 7f315606a640 1 -- 172.21.15.78:0/3877903213 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f3150102000 con 0x7f3150101c20 2024-09-11T00:26:32.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:32.129+0000 7f314d7fa640 1 -- 172.21.15.78:0/3877903213 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v24) ==== 81+0+828475 (secure 0 0 0) 0x7f31400acd30 con 0x7f3150101c20 2024-09-11T00:26:32.150 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:26:32.151 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:26:32.151 INFO:teuthology.orchestra.run.smithi078.stdout: "epoch": 24, 2024-09-11T00:26:32.151 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.151 INFO:teuthology.orchestra.run.smithi078.stdout: "active_gid": 14220, 2024-09-11T00:26:32.151 INFO:teuthology.orchestra.run.smithi078.stdout: "active_name": "x", 2024-09-11T00:26:32.151 INFO:teuthology.orchestra.run.smithi078.stdout: "active_addrs": { 2024-09-11T00:26:32.151 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-09-11T00:26:32.151 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.151 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-09-11T00:26:32.151 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.78:6800", 2024-09-11T00:26:32.152 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 3195506449 2024-09-11T00:26:32.152 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.152 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.152 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2024-09-11T00:26:32.153 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.78:6801", 2024-09-11T00:26:32.153 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 3195506449 2024-09-11T00:26:32.153 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.153 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-09-11T00:26:32.153 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.153 INFO:teuthology.orchestra.run.smithi078.stdout: "active_addr": "172.21.15.78:6801/3195506449", 2024-09-11T00:26:32.153 INFO:teuthology.orchestra.run.smithi078.stdout: "active_change": "2024-09-11T00:07:55.586721+0000", 2024-09-11T00:26:32.153 INFO:teuthology.orchestra.run.smithi078.stdout: "active_mgr_features": 4540719139924082687, 2024-09-11T00:26:32.154 INFO:teuthology.orchestra.run.smithi078.stdout: "available": true, 2024-09-11T00:26:32.154 INFO:teuthology.orchestra.run.smithi078.stdout: "standbys": [ 2024-09-11T00:26:32.154 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.154 INFO:teuthology.orchestra.run.smithi078.stdout: "gid": 24145, 2024-09-11T00:26:32.154 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "z", 2024-09-11T00:26:32.154 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_features": 4540719139924082687, 2024-09-11T00:26:32.154 INFO:teuthology.orchestra.run.smithi078.stdout: "available_modules": [ 2024-09-11T00:26:32.154 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.154 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "alerts", 2024-09-11T00:26:32.154 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.154 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.154 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.154 INFO:teuthology.orchestra.run.smithi078.stdout: "interval": { 2024-09-11T00:26:32.155 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "interval", 2024-09-11T00:26:32.155 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.155 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.155 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.155 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "60", 2024-09-11T00:26:32.155 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.155 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.155 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.155 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T00:26:32.156 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.156 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.156 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.156 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.156 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.156 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.156 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.156 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.156 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.156 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.156 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.156 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.156 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.157 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.157 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.157 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.157 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.157 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.157 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.157 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.157 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.157 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.157 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.157 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.157 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.157 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.158 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.158 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.158 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.158 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.158 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.158 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.158 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.158 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.158 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.158 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.158 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.159 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.159 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.159 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.159 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.159 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.159 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.159 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.159 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.159 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.159 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.159 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.159 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.159 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.159 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.159 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.160 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.160 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.160 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.160 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.160 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.160 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.160 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.160 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.160 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.160 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.160 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.160 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.160 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.161 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.161 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.161 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.161 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.161 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.161 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.161 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.161 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.161 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.161 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_destination": { 2024-09-11T00:26:32.162 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_destination", 2024-09-11T00:26:32.162 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.162 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.162 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.162 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.162 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.162 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.162 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.162 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-11T00:26:32.162 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.162 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.162 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.162 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.163 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_from_name": { 2024-09-11T00:26:32.163 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_from_name", 2024-09-11T00:26:32.163 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.163 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.163 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.163 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "Ceph", 2024-09-11T00:26:32.163 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.163 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.163 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.163 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Email From: name", 2024-09-11T00:26:32.163 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.163 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.163 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.163 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.164 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_host": { 2024-09-11T00:26:32.164 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_host", 2024-09-11T00:26:32.164 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.164 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.164 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.164 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.164 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.164 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.164 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.164 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "SMTP server", 2024-09-11T00:26:32.164 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.164 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.164 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.165 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.165 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_password": { 2024-09-11T00:26:32.165 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_password", 2024-09-11T00:26:32.165 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.165 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.165 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.165 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.165 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.165 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.165 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.165 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Password to authenticate with", 2024-09-11T00:26:32.165 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.165 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.165 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.166 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.166 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_port": { 2024-09-11T00:26:32.166 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_port", 2024-09-11T00:26:32.166 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.166 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.166 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.166 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "465", 2024-09-11T00:26:32.166 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.166 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.167 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.167 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "SMTP port", 2024-09-11T00:26:32.167 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.167 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.167 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.167 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.167 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_sender": { 2024-09-11T00:26:32.167 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_sender", 2024-09-11T00:26:32.167 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.168 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.168 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.168 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.168 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.168 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.168 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.168 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "SMTP envelope sender", 2024-09-11T00:26:32.168 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.168 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.168 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.168 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.169 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_ssl": { 2024-09-11T00:26:32.169 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_ssl", 2024-09-11T00:26:32.169 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.169 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.169 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.169 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.169 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.169 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.169 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.169 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T00:26:32.169 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.169 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.169 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.169 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.170 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_user": { 2024-09-11T00:26:32.170 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_user", 2024-09-11T00:26:32.170 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.170 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.170 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.170 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.170 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.170 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.170 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.170 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "User to authenticate as", 2024-09-11T00:26:32.170 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.170 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.170 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.170 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.170 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.171 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.171 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.171 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.171 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.171 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.171 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.171 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.171 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.171 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.171 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.171 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.171 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.171 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.171 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.171 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.172 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.172 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "balancer", 2024-09-11T00:26:32.172 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.172 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.172 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.172 INFO:teuthology.orchestra.run.smithi078.stdout: "active": { 2024-09-11T00:26:32.172 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "active", 2024-09-11T00:26:32.172 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.172 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.173 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.173 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.173 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.173 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.173 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.173 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T00:26:32.173 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.173 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.173 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.173 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.173 INFO:teuthology.orchestra.run.smithi078.stdout: "begin_time": { 2024-09-11T00:26:32.174 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "begin_time", 2024-09-11T00:26:32.174 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.174 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.174 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.174 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0000", 2024-09-11T00:26:32.174 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.174 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.174 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.174 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T00:26:32.174 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T00:26:32.174 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.175 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.175 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.175 INFO:teuthology.orchestra.run.smithi078.stdout: "begin_weekday": { 2024-09-11T00:26:32.175 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "begin_weekday", 2024-09-11T00:26:32.175 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "uint", 2024-09-11T00:26:32.175 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.175 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.175 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.175 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "0", 2024-09-11T00:26:32.176 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "6", 2024-09-11T00:26:32.176 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.176 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T00:26:32.176 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T00:26:32.176 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.176 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.176 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.176 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_compat_max_iterations": { 2024-09-11T00:26:32.177 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "crush_compat_max_iterations", 2024-09-11T00:26:32.177 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "uint", 2024-09-11T00:26:32.177 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.177 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.178 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "25", 2024-09-11T00:26:32.178 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "1", 2024-09-11T00:26:32.178 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "250", 2024-09-11T00:26:32.178 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.178 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T00:26:32.178 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.178 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.178 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.178 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.178 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_compat_metrics": { 2024-09-11T00:26:32.179 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "crush_compat_metrics", 2024-09-11T00:26:32.179 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.179 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.179 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.179 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T00:26:32.179 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.179 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.179 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.179 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T00:26:32.179 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T00:26:32.180 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.180 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.180 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.180 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_compat_step": { 2024-09-11T00:26:32.180 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "crush_compat_step", 2024-09-11T00:26:32.180 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "float", 2024-09-11T00:26:32.180 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.180 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.180 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0.5", 2024-09-11T00:26:32.180 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "0.001", 2024-09-11T00:26:32.181 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "0.999", 2024-09-11T00:26:32.181 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.181 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "aggressiveness of optimization", 2024-09-11T00:26:32.181 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T00:26:32.181 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.181 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.181 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.181 INFO:teuthology.orchestra.run.smithi078.stdout: "end_time": { 2024-09-11T00:26:32.182 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "end_time", 2024-09-11T00:26:32.182 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.182 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.182 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.182 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "2359", 2024-09-11T00:26:32.182 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.182 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.182 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.183 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T00:26:32.183 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T00:26:32.183 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.183 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.183 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.183 INFO:teuthology.orchestra.run.smithi078.stdout: "end_weekday": { 2024-09-11T00:26:32.183 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "end_weekday", 2024-09-11T00:26:32.184 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "uint", 2024-09-11T00:26:32.184 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.184 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.184 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.184 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "0", 2024-09-11T00:26:32.184 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "6", 2024-09-11T00:26:32.184 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.185 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T00:26:32.185 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T00:26:32.185 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.185 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.185 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.185 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.185 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.186 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.186 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.186 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.186 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.186 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.186 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.186 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.186 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.186 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.186 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.186 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.186 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.186 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.186 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.187 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.187 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.187 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.187 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.187 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.187 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.187 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.187 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.187 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.187 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.187 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.187 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.187 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.187 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.188 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.188 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.188 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.188 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.188 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.188 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.188 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.188 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.188 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.188 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.188 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.188 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.188 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.189 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.189 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.189 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.190 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.190 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.190 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.190 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.190 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.191 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.191 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.191 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.191 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.191 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.191 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.192 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.192 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.192 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.192 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.192 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.192 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.192 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.192 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.192 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.192 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.193 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.193 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.193 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.193 INFO:teuthology.orchestra.run.smithi078.stdout: "min_score": { 2024-09-11T00:26:32.193 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "min_score", 2024-09-11T00:26:32.194 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "float", 2024-09-11T00:26:32.194 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.194 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.194 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.194 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.194 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.195 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.195 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T00:26:32.195 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.195 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.195 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.196 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.196 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": { 2024-09-11T00:26:32.196 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "mode", 2024-09-11T00:26:32.196 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.196 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.197 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.197 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "upmap", 2024-09-11T00:26:32.197 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.197 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.197 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.198 INFO:teuthology.orchestra.run.smithi078.stdout: "crush-compat", 2024-09-11T00:26:32.198 INFO:teuthology.orchestra.run.smithi078.stdout: "none", 2024-09-11T00:26:32.198 INFO:teuthology.orchestra.run.smithi078.stdout: "read", 2024-09-11T00:26:32.198 INFO:teuthology.orchestra.run.smithi078.stdout: "upmap", 2024-09-11T00:26:32.198 INFO:teuthology.orchestra.run.smithi078.stdout: "upmap-read" 2024-09-11T00:26:32.199 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.199 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Balancer mode", 2024-09-11T00:26:32.199 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.199 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.200 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.200 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.200 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_ids": { 2024-09-11T00:26:32.201 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "pool_ids", 2024-09-11T00:26:32.201 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.201 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.201 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.201 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.201 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.201 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.201 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.201 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T00:26:32.201 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.202 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.202 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.202 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.202 INFO:teuthology.orchestra.run.smithi078.stdout: "sleep_interval": { 2024-09-11T00:26:32.202 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sleep_interval", 2024-09-11T00:26:32.202 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.202 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.202 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.202 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "60", 2024-09-11T00:26:32.202 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.202 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.202 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.202 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T00:26:32.202 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.203 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.203 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.203 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.203 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.203 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.203 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.203 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.203 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.203 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.203 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.203 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.203 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.203 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.203 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.204 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.204 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.204 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.204 INFO:teuthology.orchestra.run.smithi078.stdout: "upmap_max_deviation": { 2024-09-11T00:26:32.204 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "upmap_max_deviation", 2024-09-11T00:26:32.204 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.204 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.204 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.204 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "5", 2024-09-11T00:26:32.204 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "1", 2024-09-11T00:26:32.204 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.204 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.204 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T00:26:32.204 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T00:26:32.205 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.205 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.205 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.205 INFO:teuthology.orchestra.run.smithi078.stdout: "upmap_max_optimizations": { 2024-09-11T00:26:32.205 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "upmap_max_optimizations", 2024-09-11T00:26:32.205 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "uint", 2024-09-11T00:26:32.205 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.205 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.205 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:32.205 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.205 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.206 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.206 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T00:26:32.206 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.206 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.206 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.206 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.206 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.206 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.207 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.207 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cephadm", 2024-09-11T00:26:32.207 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.207 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.207 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.207 INFO:teuthology.orchestra.run.smithi078.stdout: "agent_down_multiplier": { 2024-09-11T00:26:32.207 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "agent_down_multiplier", 2024-09-11T00:26:32.207 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "float", 2024-09-11T00:26:32.207 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.207 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.207 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "3.0", 2024-09-11T00:26:32.207 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.207 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.208 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.208 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T00:26:32.208 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.208 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.208 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.208 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.208 INFO:teuthology.orchestra.run.smithi078.stdout: "agent_refresh_rate": { 2024-09-11T00:26:32.208 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "agent_refresh_rate", 2024-09-11T00:26:32.209 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.209 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.209 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.209 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "20", 2024-09-11T00:26:32.209 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.209 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.209 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.209 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T00:26:32.209 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.209 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.209 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.210 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.210 INFO:teuthology.orchestra.run.smithi078.stdout: "agent_starting_port": { 2024-09-11T00:26:32.210 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "agent_starting_port", 2024-09-11T00:26:32.210 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.210 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.210 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.210 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "4721", 2024-09-11T00:26:32.210 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.210 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.210 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.211 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T00:26:32.211 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.211 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.211 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.211 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.211 INFO:teuthology.orchestra.run.smithi078.stdout: "allow_ptrace": { 2024-09-11T00:26:32.211 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "allow_ptrace", 2024-09-11T00:26:32.211 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.211 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.211 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.212 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.212 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.212 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.212 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.212 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T00:26:32.212 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T00:26:32.212 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.212 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.212 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.213 INFO:teuthology.orchestra.run.smithi078.stdout: "autotune_interval": { 2024-09-11T00:26:32.213 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "autotune_interval", 2024-09-11T00:26:32.213 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.213 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.213 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.213 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "600", 2024-09-11T00:26:32.213 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.213 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.213 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.213 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T00:26:32.213 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.214 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.214 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.214 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.214 INFO:teuthology.orchestra.run.smithi078.stdout: "autotune_memory_target_ratio": { 2024-09-11T00:26:32.214 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T00:26:32.214 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "float", 2024-09-11T00:26:32.214 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.214 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.214 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0.7", 2024-09-11T00:26:32.215 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.215 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.215 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.215 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T00:26:32.215 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.216 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.216 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.216 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.217 INFO:teuthology.orchestra.run.smithi078.stdout: "cephadm_log_destination": { 2024-09-11T00:26:32.217 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cephadm_log_destination", 2024-09-11T00:26:32.217 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.217 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.218 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.218 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.218 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.218 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.218 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.218 INFO:teuthology.orchestra.run.smithi078.stdout: "file", 2024-09-11T00:26:32.219 INFO:teuthology.orchestra.run.smithi078.stdout: "file,syslog", 2024-09-11T00:26:32.219 INFO:teuthology.orchestra.run.smithi078.stdout: "syslog" 2024-09-11T00:26:32.219 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.219 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T00:26:32.219 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.219 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.220 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.220 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.220 INFO:teuthology.orchestra.run.smithi078.stdout: "cgroups_split": { 2024-09-11T00:26:32.220 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cgroups_split", 2024-09-11T00:26:32.220 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.220 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.220 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.220 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.220 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.220 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.220 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.220 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T00:26:32.220 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.221 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.221 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.221 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.221 INFO:teuthology.orchestra.run.smithi078.stdout: "config_checks_enabled": { 2024-09-11T00:26:32.221 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "config_checks_enabled", 2024-09-11T00:26:32.221 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.221 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.221 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.221 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.221 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.221 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.221 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.221 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T00:26:32.222 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.222 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.222 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.222 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.222 INFO:teuthology.orchestra.run.smithi078.stdout: "config_dashboard": { 2024-09-11T00:26:32.222 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "config_dashboard", 2024-09-11T00:26:32.222 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.222 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.222 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.222 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.222 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.222 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.222 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.222 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T00:26:32.223 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.223 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.223 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.223 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.223 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_alertmanager": { 2024-09-11T00:26:32.223 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_alertmanager", 2024-09-11T00:26:32.223 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.223 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.223 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.223 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-11T00:26:32.223 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.223 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.223 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.223 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Prometheus container image", 2024-09-11T00:26:32.224 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.224 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.224 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.224 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.224 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_base": { 2024-09-11T00:26:32.224 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_base", 2024-09-11T00:26:32.224 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.225 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.225 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.225 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T00:26:32.225 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.225 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.225 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.225 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Container image name, without the tag", 2024-09-11T00:26:32.225 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.225 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.225 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.225 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.225 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_elasticsearch": { 2024-09-11T00:26:32.225 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_elasticsearch", 2024-09-11T00:26:32.225 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.226 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.226 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.226 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T00:26:32.226 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.226 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.226 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.226 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "elasticsearch container image", 2024-09-11T00:26:32.226 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.226 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.226 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.226 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.226 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_grafana": { 2024-09-11T00:26:32.227 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_grafana", 2024-09-11T00:26:32.227 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.227 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.227 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.227 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-11T00:26:32.227 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.227 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.227 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.227 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Prometheus container image", 2024-09-11T00:26:32.227 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.227 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.227 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.227 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.228 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_haproxy": { 2024-09-11T00:26:32.228 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_haproxy", 2024-09-11T00:26:32.228 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.228 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.228 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.228 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T00:26:32.228 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.228 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.228 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.228 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "HAproxy container image", 2024-09-11T00:26:32.228 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.228 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.228 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.229 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.229 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_jaeger_agent": { 2024-09-11T00:26:32.229 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_jaeger_agent", 2024-09-11T00:26:32.229 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.229 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.229 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.229 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T00:26:32.229 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.229 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.229 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.229 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Jaeger agent container image", 2024-09-11T00:26:32.229 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.229 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.230 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.230 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.230 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_jaeger_collector": { 2024-09-11T00:26:32.230 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_jaeger_collector", 2024-09-11T00:26:32.230 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.230 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.230 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.230 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T00:26:32.230 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.230 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.230 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.230 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Jaeger collector container image", 2024-09-11T00:26:32.230 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.230 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.231 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.231 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.231 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_jaeger_query": { 2024-09-11T00:26:32.231 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_jaeger_query", 2024-09-11T00:26:32.231 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.231 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.231 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.231 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T00:26:32.231 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.231 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.231 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.231 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Jaeger query container image", 2024-09-11T00:26:32.231 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.232 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.232 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.232 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.232 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_keepalived": { 2024-09-11T00:26:32.232 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_keepalived", 2024-09-11T00:26:32.232 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.232 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.232 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.232 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T00:26:32.232 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.232 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.232 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.233 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Keepalived container image", 2024-09-11T00:26:32.233 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.233 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.233 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.233 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.233 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_loki": { 2024-09-11T00:26:32.233 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_loki", 2024-09-11T00:26:32.233 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.233 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.233 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.233 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T00:26:32.233 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.234 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.234 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.234 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Loki container image", 2024-09-11T00:26:32.234 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.234 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.234 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.234 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.234 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_nginx": { 2024-09-11T00:26:32.234 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_nginx", 2024-09-11T00:26:32.234 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.234 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.234 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.234 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-11T00:26:32.234 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.235 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.235 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.235 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Nginx container image", 2024-09-11T00:26:32.235 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.235 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.235 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.235 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.235 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_node_exporter": { 2024-09-11T00:26:32.235 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_node_exporter", 2024-09-11T00:26:32.235 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.235 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.235 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.235 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-11T00:26:32.235 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Prometheus container image", 2024-09-11T00:26:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_nvmeof": { 2024-09-11T00:26:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_nvmeof", 2024-09-11T00:26:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.236 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-11T00:26:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Nvme-of container image", 2024-09-11T00:26:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.237 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_oauth2_proxy": { 2024-09-11T00:26:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_oauth2_proxy", 2024-09-11T00:26:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-11T00:26:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "oauth2-proxy container image", 2024-09-11T00:26:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.238 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_prometheus": { 2024-09-11T00:26:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_prometheus", 2024-09-11T00:26:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-11T00:26:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Prometheus container image", 2024-09-11T00:26:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.239 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_promtail": { 2024-09-11T00:26:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_promtail", 2024-09-11T00:26:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T00:26:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Promtail container image", 2024-09-11T00:26:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.240 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_samba": { 2024-09-11T00:26:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_samba", 2024-09-11T00:26:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T00:26:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Samba/SMB container image", 2024-09-11T00:26:32.241 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_samba_metrics": { 2024-09-11T00:26:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_samba_metrics", 2024-09-11T00:26:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-11T00:26:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-11T00:26:32.242 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_snmp_gateway": { 2024-09-11T00:26:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_snmp_gateway", 2024-09-11T00:26:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T00:26:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "SNMP Gateway container image", 2024-09-11T00:26:32.243 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "container_init": { 2024-09-11T00:26:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_init", 2024-09-11T00:26:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.244 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T00:26:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "daemon_cache_timeout": { 2024-09-11T00:26:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "daemon_cache_timeout", 2024-09-11T00:26:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "600", 2024-09-11T00:26:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.245 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T00:26:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "default_cephadm_command_timeout": { 2024-09-11T00:26:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T00:26:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "900", 2024-09-11T00:26:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.246 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T00:26:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "default_registry": { 2024-09-11T00:26:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "default_registry", 2024-09-11T00:26:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "docker.io", 2024-09-11T00:26:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.247 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T00:26:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "device_cache_timeout": { 2024-09-11T00:26:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "device_cache_timeout", 2024-09-11T00:26:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "1800", 2024-09-11T00:26:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.248 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "seconds to cache device inventory", 2024-09-11T00:26:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "device_enhanced_scan": { 2024-09-11T00:26:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "device_enhanced_scan", 2024-09-11T00:26:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T00:26:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "facts_cache_timeout": { 2024-09-11T00:26:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "facts_cache_timeout", 2024-09-11T00:26:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "60", 2024-09-11T00:26:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.250 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "seconds to cache host facts data", 2024-09-11T00:26:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "grafana_dashboards_path": { 2024-09-11T00:26:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "grafana_dashboards_path", 2024-09-11T00:26:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T00:26:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.251 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T00:26:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "host_check_interval": { 2024-09-11T00:26:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "host_check_interval", 2024-09-11T00:26:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.252 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "600", 2024-09-11T00:26:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how frequently to perform a host check", 2024-09-11T00:26:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "hw_monitoring": { 2024-09-11T00:26:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "hw_monitoring", 2024-09-11T00:26:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.253 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T00:26:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "inventory_list_all": { 2024-09-11T00:26:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "inventory_list_all", 2024-09-11T00:26:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T00:26:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "log_refresh_metadata": { 2024-09-11T00:26:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_refresh_metadata", 2024-09-11T00:26:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T00:26:32.257 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T00:26:32.258 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.259 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T00:26:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T00:26:32.261 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T00:26:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T00:26:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T00:26:32.262 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "*", 2024-09-11T00:26:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T00:26:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "max_count_per_host": { 2024-09-11T00:26:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "max_count_per_host", 2024-09-11T00:26:32.263 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "max number of daemons per service per host", 2024-09-11T00:26:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "max_osd_draining_count": { 2024-09-11T00:26:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "max_osd_draining_count", 2024-09-11T00:26:32.264 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T00:26:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.265 INFO:teuthology.orchestra.run.smithi078.stdout: "migration_current": { 2024-09-11T00:26:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "migration_current", 2024-09-11T00:26:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "internal - do not modify", 2024-09-11T00:26:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": { 2024-09-11T00:26:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "mode", 2024-09-11T00:26:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "root", 2024-09-11T00:26:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: "cephadm-package", 2024-09-11T00:26:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: "root" 2024-09-11T00:26:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T00:26:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: "oob_default_addr": { 2024-09-11T00:26:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "oob_default_addr", 2024-09-11T00:26:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "169.254.1.1", 2024-09-11T00:26:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T00:26:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "prometheus_alerts_path": { 2024-09-11T00:26:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "prometheus_alerts_path", 2024-09-11T00:26:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T00:26:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T00:26:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: "registry_insecure": { 2024-09-11T00:26:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "registry_insecure", 2024-09-11T00:26:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T00:26:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: "registry_password": { 2024-09-11T00:26:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "registry_password", 2024-09-11T00:26:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T00:26:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: "registry_url": { 2024-09-11T00:26:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "registry_url", 2024-09-11T00:26:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T00:26:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: "registry_username": { 2024-09-11T00:26:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "registry_username", 2024-09-11T00:26:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T00:26:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: "secure_monitoring_stack": { 2024-09-11T00:26:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "secure_monitoring_stack", 2024-09-11T00:26:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T00:26:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: "service_discovery_port": { 2024-09-11T00:26:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "service_discovery_port", 2024-09-11T00:26:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "8765", 2024-09-11T00:26:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "cephadm service discovery port", 2024-09-11T00:26:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: "ssh_config_file": { 2024-09-11T00:26:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ssh_config_file", 2024-09-11T00:26:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T00:26:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: "use_agent": { 2024-09-11T00:26:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "use_agent", 2024-09-11T00:26:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T00:26:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.280 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.280 INFO:teuthology.orchestra.run.smithi078.stdout: "use_repo_digest": { 2024-09-11T00:26:32.280 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "use_repo_digest", 2024-09-11T00:26:32.280 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.280 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.280 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.280 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.280 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.280 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.280 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.280 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T00:26:32.280 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.280 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.281 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.281 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.281 INFO:teuthology.orchestra.run.smithi078.stdout: "warn_on_failed_host_check": { 2024-09-11T00:26:32.281 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "warn_on_failed_host_check", 2024-09-11T00:26:32.281 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.281 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.281 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.281 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.281 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.281 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.281 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.281 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T00:26:32.281 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.282 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.282 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.282 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.282 INFO:teuthology.orchestra.run.smithi078.stdout: "warn_on_stray_daemons": { 2024-09-11T00:26:32.282 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "warn_on_stray_daemons", 2024-09-11T00:26:32.282 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.282 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.282 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.282 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.282 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.282 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.282 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.282 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T00:26:32.283 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.283 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.283 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.283 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.283 INFO:teuthology.orchestra.run.smithi078.stdout: "warn_on_stray_hosts": { 2024-09-11T00:26:32.283 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "warn_on_stray_hosts", 2024-09-11T00:26:32.283 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.283 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.283 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.283 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.283 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.283 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.283 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.283 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T00:26:32.284 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.284 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.284 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.284 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.284 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.284 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.284 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.284 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "crash", 2024-09-11T00:26:32.284 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.284 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.284 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.284 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.284 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.285 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.285 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.285 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.285 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.285 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.285 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.285 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.285 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.285 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.285 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.285 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.285 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.285 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.285 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.286 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.286 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.286 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.286 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.286 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.286 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.286 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.286 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.286 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.286 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.286 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.286 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.286 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.286 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.287 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.287 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.287 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.287 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.287 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.287 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.287 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.287 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.287 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.287 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.287 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.287 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.287 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.287 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.288 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.288 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.288 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.288 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.288 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.288 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.288 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.288 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.288 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.288 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.288 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.288 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.288 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.289 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.289 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.289 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.289 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.289 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.289 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.289 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.289 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.289 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.289 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.289 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.289 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.289 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.290 INFO:teuthology.orchestra.run.smithi078.stdout: "retain_interval": { 2024-09-11T00:26:32.290 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "retain_interval", 2024-09-11T00:26:32.290 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.290 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.290 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.290 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "31536000", 2024-09-11T00:26:32.290 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.290 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.290 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.290 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T00:26:32.290 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.290 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.290 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.290 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.291 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.291 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.291 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.291 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.291 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.291 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.291 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.291 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.291 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.291 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.291 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.291 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.291 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.292 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.292 INFO:teuthology.orchestra.run.smithi078.stdout: "warn_recent_interval": { 2024-09-11T00:26:32.292 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "warn_recent_interval", 2024-09-11T00:26:32.292 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.292 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.292 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.292 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "1209600", 2024-09-11T00:26:32.292 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.292 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.292 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.292 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T00:26:32.292 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.293 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.293 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.293 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.293 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.293 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.293 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.293 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "dashboard", 2024-09-11T00:26:32.293 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.293 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.293 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.293 INFO:teuthology.orchestra.run.smithi078.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T00:26:32.293 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T00:26:32.293 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.293 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.294 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.294 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:32.294 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.294 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.294 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.294 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.294 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.294 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.294 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.294 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.294 INFO:teuthology.orchestra.run.smithi078.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T00:26:32.294 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T00:26:32.295 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.295 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.295 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.295 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.295 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.295 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.295 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.295 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.295 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.295 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.295 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.295 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.295 INFO:teuthology.orchestra.run.smithi078.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T00:26:32.295 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T00:26:32.296 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.296 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.296 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.296 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.296 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.296 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.296 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.296 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.296 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.296 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.296 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.296 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.297 INFO:teuthology.orchestra.run.smithi078.stdout: "AUDIT_API_ENABLED": { 2024-09-11T00:26:32.297 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T00:26:32.297 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.297 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.297 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.297 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.297 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.297 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.297 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.297 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.297 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.297 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.297 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.298 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.298 INFO:teuthology.orchestra.run.smithi078.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T00:26:32.298 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T00:26:32.298 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.298 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.298 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.298 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.298 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.298 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.298 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.298 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.298 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.298 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.299 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.299 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.299 INFO:teuthology.orchestra.run.smithi078.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T00:26:32.299 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T00:26:32.299 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.299 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.299 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.299 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.299 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.299 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.299 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.299 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.299 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.299 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.299 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.300 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.300 INFO:teuthology.orchestra.run.smithi078.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T00:26:32.300 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T00:26:32.300 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.300 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.300 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.300 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.300 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.300 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.300 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.300 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.300 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.300 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T00:26:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T00:26:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.301 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.302 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.302 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.302 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.302 INFO:teuthology.orchestra.run.smithi078.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T00:26:32.302 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T00:26:32.302 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.302 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.302 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.302 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.302 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.302 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.302 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.302 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.302 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.303 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.303 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.303 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.303 INFO:teuthology.orchestra.run.smithi078.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T00:26:32.303 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T00:26:32.303 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.303 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.303 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.303 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.303 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.303 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.303 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.303 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.303 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.304 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.304 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.304 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.304 INFO:teuthology.orchestra.run.smithi078.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T00:26:32.304 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T00:26:32.304 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.304 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.304 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.304 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.304 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.304 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.304 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.304 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.304 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.305 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.305 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.305 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.305 INFO:teuthology.orchestra.run.smithi078.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T00:26:32.305 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T00:26:32.305 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.305 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.305 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.305 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.305 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.305 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.305 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.305 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.305 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.306 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.306 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.306 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.306 INFO:teuthology.orchestra.run.smithi078.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T00:26:32.306 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T00:26:32.306 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.306 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.306 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.306 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.306 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.306 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.306 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.306 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.307 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.307 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.307 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.307 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.307 INFO:teuthology.orchestra.run.smithi078.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T00:26:32.307 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T00:26:32.307 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.307 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.307 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.307 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.307 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.307 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.308 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.308 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.308 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.308 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.308 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.308 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.308 INFO:teuthology.orchestra.run.smithi078.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T00:26:32.308 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T00:26:32.308 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.308 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.308 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.308 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "admin", 2024-09-11T00:26:32.308 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.309 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.309 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.309 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.309 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.309 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.309 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.309 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.309 INFO:teuthology.orchestra.run.smithi078.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T00:26:32.309 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T00:26:32.309 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.309 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.309 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.309 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.310 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.310 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.310 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.310 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.310 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.310 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.310 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.310 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.310 INFO:teuthology.orchestra.run.smithi078.stdout: "GRAFANA_API_URL": { 2024-09-11T00:26:32.310 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "GRAFANA_API_URL", 2024-09-11T00:26:32.310 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.310 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.310 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.310 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.310 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.311 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.311 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.311 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.311 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.311 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.311 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.311 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.311 INFO:teuthology.orchestra.run.smithi078.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T00:26:32.311 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T00:26:32.311 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.311 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.311 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.311 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "admin", 2024-09-11T00:26:32.312 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.312 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.312 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.312 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.312 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.312 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.312 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.312 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.312 INFO:teuthology.orchestra.run.smithi078.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T00:26:32.312 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T00:26:32.312 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.312 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.312 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.313 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.313 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.313 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.313 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.313 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.313 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.313 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.313 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.313 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.313 INFO:teuthology.orchestra.run.smithi078.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T00:26:32.313 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T00:26:32.313 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.313 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.313 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.314 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.314 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.314 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.314 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.314 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.314 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.314 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.314 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.314 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.314 INFO:teuthology.orchestra.run.smithi078.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T00:26:32.314 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T00:26:32.314 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.314 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.314 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.315 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.315 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.315 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.315 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.315 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.315 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.315 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.315 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.315 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.315 INFO:teuthology.orchestra.run.smithi078.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T00:26:32.315 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T00:26:32.315 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.315 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.315 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.315 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.316 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.316 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.316 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.316 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.316 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.316 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.316 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.316 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.316 INFO:teuthology.orchestra.run.smithi078.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-11T00:26:32.316 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-11T00:26:32.316 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.316 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.317 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.317 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "[]", 2024-09-11T00:26:32.317 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.317 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.317 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.317 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.317 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.317 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.317 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.317 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.317 INFO:teuthology.orchestra.run.smithi078.stdout: "MULTICLUSTER_CONFIG": { 2024-09-11T00:26:32.317 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-11T00:26:32.317 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.317 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.318 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.318 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "{}", 2024-09-11T00:26:32.318 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.318 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.318 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.318 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.318 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.318 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.318 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.318 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.318 INFO:teuthology.orchestra.run.smithi078.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T00:26:32.318 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T00:26:32.318 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.318 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.319 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.319 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.319 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.319 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.319 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.319 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.320 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.320 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.320 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.320 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.320 INFO:teuthology.orchestra.run.smithi078.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T00:26:32.320 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T00:26:32.320 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.320 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.320 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.320 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.320 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.320 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.321 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.321 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.321 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.321 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.321 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.321 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.321 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T00:26:32.321 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T00:26:32.321 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.321 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.321 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.321 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.321 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.322 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.322 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.322 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.322 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.322 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.322 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.322 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.322 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T00:26:32.322 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T00:26:32.322 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.322 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.322 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.322 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.322 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.323 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.323 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.323 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.323 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.323 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.323 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.323 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.323 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T00:26:32.323 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T00:26:32.323 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.323 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.323 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.323 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.324 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.324 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.324 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.324 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.324 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.324 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.324 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.324 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.324 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T00:26:32.324 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T00:26:32.324 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.324 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.324 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.325 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.325 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.325 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.325 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.325 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.325 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.325 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.325 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.325 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.325 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T00:26:32.325 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T00:26:32.325 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.325 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.326 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.326 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.326 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.326 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.326 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.326 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.326 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.326 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.326 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.326 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.326 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T00:26:32.326 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T00:26:32.326 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.327 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.327 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.327 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.327 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.327 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.327 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.327 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.327 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.327 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.327 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.327 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.327 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T00:26:32.327 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T00:26:32.327 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.328 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.328 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.328 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.328 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.328 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.328 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.328 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.328 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.328 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.328 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.328 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.328 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T00:26:32.328 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T00:26:32.328 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.329 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.329 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.329 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.329 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.329 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.329 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.329 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.329 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.329 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.329 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.329 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.329 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T00:26:32.329 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T00:26:32.330 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.330 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.330 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.330 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T00:26:32.330 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.330 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.330 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.330 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.330 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.330 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.330 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.330 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.330 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T00:26:32.330 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T00:26:32.331 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.331 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.331 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.331 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:32.331 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.331 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.331 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.331 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.331 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.331 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.331 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.331 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.331 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T00:26:32.331 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T00:26:32.332 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.332 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.332 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.332 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "8", 2024-09-11T00:26:32.332 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.332 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.332 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.332 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.332 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.332 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.332 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.332 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.332 INFO:teuthology.orchestra.run.smithi078.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T00:26:32.332 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T00:26:32.333 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.333 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.333 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.333 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "45", 2024-09-11T00:26:32.333 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.333 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.333 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.333 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.333 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.333 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.333 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.333 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.333 INFO:teuthology.orchestra.run.smithi078.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T00:26:32.334 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T00:26:32.334 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.334 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.334 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.334 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.334 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.334 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.334 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.334 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.334 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.334 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.334 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.334 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.335 INFO:teuthology.orchestra.run.smithi078.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T00:26:32.335 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T00:26:32.335 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.335 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.335 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.335 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "admin", 2024-09-11T00:26:32.335 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.335 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.335 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.335 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.335 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.335 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.335 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.335 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.336 INFO:teuthology.orchestra.run.smithi078.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T00:26:32.336 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T00:26:32.336 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.336 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.336 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.336 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.336 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.336 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.336 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.336 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.336 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.336 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.336 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.337 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.337 INFO:teuthology.orchestra.run.smithi078.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T00:26:32.337 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T00:26:32.337 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.337 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.337 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.337 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.337 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.337 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.337 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.337 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.337 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.337 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.341 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.341 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.341 INFO:teuthology.orchestra.run.smithi078.stdout: "UNSAFE_TLS_v1_2": { 2024-09-11T00:26:32.341 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-11T00:26:32.341 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.342 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.342 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.342 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.342 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.342 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.342 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.342 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.342 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.342 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.342 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.342 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.342 INFO:teuthology.orchestra.run.smithi078.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T00:26:32.343 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T00:26:32.343 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.343 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.343 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.343 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.343 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.343 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.343 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.343 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.344 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.344 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.344 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.344 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.344 INFO:teuthology.orchestra.run.smithi078.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T00:26:32.344 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T00:26:32.344 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.344 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.344 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.344 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:32.344 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.344 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.344 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.344 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.345 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.345 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.345 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.345 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.345 INFO:teuthology.orchestra.run.smithi078.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T00:26:32.345 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T00:26:32.345 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.345 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.345 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.345 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "5", 2024-09-11T00:26:32.345 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.345 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: "cross_origin_url": { 2024-09-11T00:26:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cross_origin_url", 2024-09-11T00:26:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.346 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.347 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.347 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.347 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.347 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.347 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.347 INFO:teuthology.orchestra.run.smithi078.stdout: "crt_file": { 2024-09-11T00:26:32.347 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "crt_file", 2024-09-11T00:26:32.347 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.347 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.347 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.347 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.347 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.347 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.348 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.348 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.348 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.348 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.348 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.348 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.348 INFO:teuthology.orchestra.run.smithi078.stdout: "debug": { 2024-09-11T00:26:32.348 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "debug", 2024-09-11T00:26:32.348 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.348 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.348 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.348 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.348 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.348 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.349 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.349 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Enable/disable debug options", 2024-09-11T00:26:32.349 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.349 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.349 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.349 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.349 INFO:teuthology.orchestra.run.smithi078.stdout: "jwt_token_ttl": { 2024-09-11T00:26:32.349 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "jwt_token_ttl", 2024-09-11T00:26:32.349 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.349 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.349 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.349 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "28800", 2024-09-11T00:26:32.349 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.350 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.350 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.350 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.350 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.350 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.350 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.350 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.350 INFO:teuthology.orchestra.run.smithi078.stdout: "key_file": { 2024-09-11T00:26:32.350 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "key_file", 2024-09-11T00:26:32.350 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.350 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.350 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.350 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.350 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.351 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.351 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.351 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.351 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.351 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.351 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.351 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.351 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.351 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.351 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.351 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.351 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.351 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.352 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.352 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.352 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.352 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.352 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.352 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.352 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.352 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.352 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.352 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.352 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.352 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.352 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.353 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.353 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.353 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.353 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.353 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.353 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.353 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.353 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.353 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.353 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.353 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.353 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.353 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.354 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.354 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.354 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.354 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.354 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.354 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.354 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.354 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.354 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.354 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.354 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.354 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.354 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.355 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.355 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.355 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.355 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.355 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.355 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.355 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.355 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.355 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.355 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.355 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.355 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.355 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.356 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.356 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.356 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.356 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.356 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.356 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.356 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.356 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.356 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.356 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.356 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.356 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.356 INFO:teuthology.orchestra.run.smithi078.stdout: "motd": { 2024-09-11T00:26:32.357 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "motd", 2024-09-11T00:26:32.357 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.357 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.357 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.357 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.357 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.357 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.357 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.357 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "The message of the day", 2024-09-11T00:26:32.357 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.357 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.357 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.357 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.357 INFO:teuthology.orchestra.run.smithi078.stdout: "redirect_resolve_ip_addr": { 2024-09-11T00:26:32.358 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T00:26:32.358 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.358 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.358 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.358 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.358 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.358 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.358 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.358 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.358 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.358 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.358 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.358 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.358 INFO:teuthology.orchestra.run.smithi078.stdout: "server_addr": { 2024-09-11T00:26:32.359 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "server_addr", 2024-09-11T00:26:32.359 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.359 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.359 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.359 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "::", 2024-09-11T00:26:32.359 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.359 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.359 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.359 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.359 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.359 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.359 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.359 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.360 INFO:teuthology.orchestra.run.smithi078.stdout: "server_port": { 2024-09-11T00:26:32.360 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "server_port", 2024-09-11T00:26:32.360 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.360 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.360 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.360 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "8080", 2024-09-11T00:26:32.360 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.360 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.360 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.360 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.360 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.360 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.360 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.360 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.361 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.361 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.361 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.361 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.361 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.361 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.361 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.361 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.361 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.361 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.361 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.361 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.361 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.361 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.362 INFO:teuthology.orchestra.run.smithi078.stdout: "ssl": { 2024-09-11T00:26:32.362 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ssl", 2024-09-11T00:26:32.362 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.362 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.362 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.362 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.362 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.362 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.362 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.362 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.362 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.362 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.362 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.362 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.363 INFO:teuthology.orchestra.run.smithi078.stdout: "ssl_server_port": { 2024-09-11T00:26:32.363 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ssl_server_port", 2024-09-11T00:26:32.363 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.363 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.363 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.363 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "8443", 2024-09-11T00:26:32.363 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.363 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.363 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.363 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.363 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.363 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.363 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.363 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.364 INFO:teuthology.orchestra.run.smithi078.stdout: "standby_behaviour": { 2024-09-11T00:26:32.364 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "standby_behaviour", 2024-09-11T00:26:32.364 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.364 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.364 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.364 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "redirect", 2024-09-11T00:26:32.364 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.364 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.364 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.364 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.365 INFO:teuthology.orchestra.run.smithi078.stdout: "redirect" 2024-09-11T00:26:32.365 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.365 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.365 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.365 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.365 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.365 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.365 INFO:teuthology.orchestra.run.smithi078.stdout: "standby_error_status_code": { 2024-09-11T00:26:32.365 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "standby_error_status_code", 2024-09-11T00:26:32.365 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.365 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.365 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.365 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "500", 2024-09-11T00:26:32.366 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "400", 2024-09-11T00:26:32.366 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "599", 2024-09-11T00:26:32.366 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.366 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.366 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.366 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.366 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.366 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.366 INFO:teuthology.orchestra.run.smithi078.stdout: "url_prefix": { 2024-09-11T00:26:32.367 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "url_prefix", 2024-09-11T00:26:32.367 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.367 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.367 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.367 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.367 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.367 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.367 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.367 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.367 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.367 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.368 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.368 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.368 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.368 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.368 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.368 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "devicehealth", 2024-09-11T00:26:32.368 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.369 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.369 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.369 INFO:teuthology.orchestra.run.smithi078.stdout: "enable_monitoring": { 2024-09-11T00:26:32.369 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "enable_monitoring", 2024-09-11T00:26:32.369 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.369 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.369 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.369 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.369 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.369 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.370 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.370 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "monitor device health metrics", 2024-09-11T00:26:32.370 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.370 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.370 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.370 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.370 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.370 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.370 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.370 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.370 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.371 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.371 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.371 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.371 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.371 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.371 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.371 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.371 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.371 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.372 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.372 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.372 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.372 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.372 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.372 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.372 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.372 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.372 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.372 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.373 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.373 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.373 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.373 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.373 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.373 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.373 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.373 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.373 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.373 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.373 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.374 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.374 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.374 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.374 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.374 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.374 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.374 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.374 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.374 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.375 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.375 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.375 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.375 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.375 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.375 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.375 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.375 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.375 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.376 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.376 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.376 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.376 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.376 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.376 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.376 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.376 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.377 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.377 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.377 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.377 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.377 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.377 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.377 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.377 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.377 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.377 INFO:teuthology.orchestra.run.smithi078.stdout: "mark_out_threshold": { 2024-09-11T00:26:32.377 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "mark_out_threshold", 2024-09-11T00:26:32.377 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.378 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.378 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.378 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "2419200", 2024-09-11T00:26:32.378 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.378 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.378 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.378 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T00:26:32.378 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.378 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.378 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.378 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.378 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": { 2024-09-11T00:26:32.378 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "pool_name", 2024-09-11T00:26:32.378 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.379 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.379 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.379 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "device_health_metrics", 2024-09-11T00:26:32.379 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.379 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.379 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.379 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T00:26:32.379 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.379 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.379 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.379 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.379 INFO:teuthology.orchestra.run.smithi078.stdout: "retention_period": { 2024-09-11T00:26:32.379 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "retention_period", 2024-09-11T00:26:32.380 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.380 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.380 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.380 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "15552000", 2024-09-11T00:26:32.380 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.380 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.380 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.380 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how long to retain device health metrics", 2024-09-11T00:26:32.380 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.380 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.380 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.380 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.380 INFO:teuthology.orchestra.run.smithi078.stdout: "scrape_frequency": { 2024-09-11T00:26:32.381 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "scrape_frequency", 2024-09-11T00:26:32.381 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.381 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.381 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.381 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "86400", 2024-09-11T00:26:32.381 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.381 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.381 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.381 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T00:26:32.381 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.381 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.381 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.381 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.381 INFO:teuthology.orchestra.run.smithi078.stdout: "self_heal": { 2024-09-11T00:26:32.382 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "self_heal", 2024-09-11T00:26:32.382 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.382 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.382 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.382 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.382 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.382 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.382 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.382 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T00:26:32.382 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.382 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.382 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.382 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.383 INFO:teuthology.orchestra.run.smithi078.stdout: "sleep_interval": { 2024-09-11T00:26:32.383 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sleep_interval", 2024-09-11T00:26:32.383 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.383 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.383 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.383 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "600", 2024-09-11T00:26:32.383 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.383 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.383 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.383 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T00:26:32.383 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.383 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.384 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.384 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.384 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.384 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.384 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.384 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.384 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.384 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.384 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.384 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.384 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.384 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.384 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.385 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.385 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.385 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.385 INFO:teuthology.orchestra.run.smithi078.stdout: "warn_threshold": { 2024-09-11T00:26:32.385 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "warn_threshold", 2024-09-11T00:26:32.385 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.385 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.385 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.385 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "7257600", 2024-09-11T00:26:32.385 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.385 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.385 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.385 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T00:26:32.386 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.386 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.386 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.386 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.386 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.386 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.386 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.386 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "diskprediction_local", 2024-09-11T00:26:32.386 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.386 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.386 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.386 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.386 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.387 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.387 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.387 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.387 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.387 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.387 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.387 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.387 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.387 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.387 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.387 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.387 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.387 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.388 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.388 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.388 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.388 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.388 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.388 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.388 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.388 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.388 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.388 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.388 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.388 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.388 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.388 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.389 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.389 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.389 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.389 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.389 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.389 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.389 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.389 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.389 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.389 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.389 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.389 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.389 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.390 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.390 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.390 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.390 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.390 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.390 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.390 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.390 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.390 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.390 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.390 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.390 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.391 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.391 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.391 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.391 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.391 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.391 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.391 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.391 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.391 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.391 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.391 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.391 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.391 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.391 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.392 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.392 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.392 INFO:teuthology.orchestra.run.smithi078.stdout: "predict_interval": { 2024-09-11T00:26:32.392 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "predict_interval", 2024-09-11T00:26:32.392 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.392 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.392 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.392 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "86400", 2024-09-11T00:26:32.392 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.392 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.392 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.392 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.392 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.393 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.393 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.393 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.393 INFO:teuthology.orchestra.run.smithi078.stdout: "predictor_model": { 2024-09-11T00:26:32.393 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "predictor_model", 2024-09-11T00:26:32.393 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.393 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.393 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.393 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "prophetstor", 2024-09-11T00:26:32.393 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.393 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.393 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.393 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.394 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.394 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.394 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.394 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.394 INFO:teuthology.orchestra.run.smithi078.stdout: "sleep_interval": { 2024-09-11T00:26:32.394 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sleep_interval", 2024-09-11T00:26:32.394 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.394 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.394 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.394 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "600", 2024-09-11T00:26:32.394 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.394 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.394 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.395 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.395 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.395 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.395 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.395 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.395 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.395 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.395 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.395 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.395 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.395 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.395 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.395 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.395 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.396 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.396 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.396 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.396 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.396 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.396 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.396 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.396 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.396 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "influx", 2024-09-11T00:26:32.396 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": false, 2024-09-11T00:26:32.396 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "influxdb python module not found", 2024-09-11T00:26:32.396 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.396 INFO:teuthology.orchestra.run.smithi078.stdout: "batch_size": { 2024-09-11T00:26:32.397 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "batch_size", 2024-09-11T00:26:32.397 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.397 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.397 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.397 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "5000", 2024-09-11T00:26:32.397 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.397 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.397 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.397 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T00:26:32.397 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.397 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.397 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.397 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.398 INFO:teuthology.orchestra.run.smithi078.stdout: "database": { 2024-09-11T00:26:32.398 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "database", 2024-09-11T00:26:32.398 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.398 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.398 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.398 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "ceph", 2024-09-11T00:26:32.398 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.398 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.398 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.398 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T00:26:32.398 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.398 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.399 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.399 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.399 INFO:teuthology.orchestra.run.smithi078.stdout: "hostname": { 2024-09-11T00:26:32.399 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "hostname", 2024-09-11T00:26:32.399 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.399 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.399 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.399 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.399 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.400 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.400 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.400 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "InfluxDB server hostname", 2024-09-11T00:26:32.400 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.400 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.400 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.400 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.400 INFO:teuthology.orchestra.run.smithi078.stdout: "interval": { 2024-09-11T00:26:32.400 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "interval", 2024-09-11T00:26:32.400 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.400 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.400 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.400 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "30", 2024-09-11T00:26:32.401 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "5", 2024-09-11T00:26:32.401 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.401 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.401 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T00:26:32.401 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.401 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.401 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.401 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.401 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.401 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.401 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.401 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.402 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.402 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.402 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.402 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.402 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.402 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.402 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.402 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.402 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.403 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.403 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.403 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.403 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.403 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.403 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.403 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.403 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.403 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.403 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.403 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.403 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.403 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.404 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.404 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.404 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.404 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.404 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.404 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.404 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.404 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.404 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.404 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.405 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.405 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.405 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.405 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.405 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.405 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.405 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.405 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.405 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.405 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.405 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.406 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.406 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.406 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.406 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.406 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.406 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.406 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.406 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.406 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.406 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.406 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.407 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.407 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.407 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.407 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.407 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.407 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.407 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.407 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.407 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.407 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.407 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.408 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.408 INFO:teuthology.orchestra.run.smithi078.stdout: "password": { 2024-09-11T00:26:32.408 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "password", 2024-09-11T00:26:32.408 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.408 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.408 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.408 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.408 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.408 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.408 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.409 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "password of InfluxDB server user", 2024-09-11T00:26:32.409 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.409 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.409 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.409 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.409 INFO:teuthology.orchestra.run.smithi078.stdout: "port": { 2024-09-11T00:26:32.409 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "port", 2024-09-11T00:26:32.409 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.409 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.409 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.410 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "8086", 2024-09-11T00:26:32.410 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.410 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.410 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.410 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "InfluxDB server port", 2024-09-11T00:26:32.410 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.410 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.410 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.410 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.410 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.411 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.411 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.411 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.411 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.411 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.411 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.411 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.411 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.411 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.411 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.411 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.412 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.412 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.412 INFO:teuthology.orchestra.run.smithi078.stdout: "ssl": { 2024-09-11T00:26:32.412 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ssl", 2024-09-11T00:26:32.412 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.412 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.412 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.412 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "false", 2024-09-11T00:26:32.412 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.412 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.412 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.412 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T00:26:32.412 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.413 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.413 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.413 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.413 INFO:teuthology.orchestra.run.smithi078.stdout: "threads": { 2024-09-11T00:26:32.413 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "threads", 2024-09-11T00:26:32.413 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.413 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.413 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.413 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "5", 2024-09-11T00:26:32.413 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "1", 2024-09-11T00:26:32.413 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "32", 2024-09-11T00:26:32.413 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.413 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T00:26:32.413 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.414 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.414 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.414 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.414 INFO:teuthology.orchestra.run.smithi078.stdout: "username": { 2024-09-11T00:26:32.414 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "username", 2024-09-11T00:26:32.414 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.414 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.414 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.414 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.415 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.415 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.415 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.415 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "username of InfluxDB server user", 2024-09-11T00:26:32.415 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.415 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.415 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.415 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.415 INFO:teuthology.orchestra.run.smithi078.stdout: "verify_ssl": { 2024-09-11T00:26:32.415 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "verify_ssl", 2024-09-11T00:26:32.415 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.415 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.416 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.416 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "true", 2024-09-11T00:26:32.416 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.416 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.416 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.416 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T00:26:32.416 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.416 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.416 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.416 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.416 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.416 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.416 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.417 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "insights", 2024-09-11T00:26:32.417 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.417 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.417 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.417 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.417 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.417 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.417 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.417 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.417 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.417 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.417 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.417 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.417 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.418 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.418 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.418 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.418 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.418 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.418 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.418 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.418 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.418 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.418 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.418 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.418 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.419 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.419 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.419 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.420 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.420 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.420 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.420 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.420 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.420 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.420 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.420 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.420 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.421 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.421 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.421 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.421 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.421 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.421 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.421 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.421 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.421 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.421 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.421 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.421 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.421 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.422 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.422 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.422 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.422 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.422 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.422 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.422 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.422 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.422 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.422 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.422 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.422 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.422 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.422 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.423 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.423 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.423 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.423 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.423 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.423 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.423 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.423 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.423 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.423 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.423 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.423 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.423 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.423 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.424 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.424 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.424 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.424 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.424 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.424 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.424 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.424 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.424 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.424 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.424 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.424 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.424 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "iostat", 2024-09-11T00:26:32.425 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.425 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.425 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.425 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.425 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.425 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.425 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.425 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.425 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.425 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.425 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.425 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.425 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.425 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.426 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.426 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.426 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.426 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.426 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.426 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.426 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.426 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.426 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.426 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.426 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.426 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.426 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.427 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.427 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.427 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.427 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.427 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.427 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.427 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.427 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.427 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.428 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.428 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.428 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.428 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.428 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.428 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.428 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.428 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.428 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.428 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.428 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.428 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.428 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.429 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.429 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.429 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.429 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.429 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.429 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.429 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.429 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.429 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.429 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.429 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.429 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.429 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.430 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.430 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.430 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.430 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.430 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.430 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.430 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.430 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.430 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.430 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.430 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.430 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.431 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.431 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.431 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.431 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.431 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.431 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.431 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.431 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.431 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.431 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.431 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.431 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.431 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.431 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.432 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.432 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.432 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "k8sevents", 2024-09-11T00:26:32.432 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.432 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.432 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.432 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_event_retention_days": { 2024-09-11T00:26:32.432 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ceph_event_retention_days", 2024-09-11T00:26:32.432 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.432 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.432 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.432 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "7", 2024-09-11T00:26:32.433 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.433 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.433 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.433 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T00:26:32.433 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.433 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.433 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.433 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.433 INFO:teuthology.orchestra.run.smithi078.stdout: "config_check_secs": { 2024-09-11T00:26:32.433 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "config_check_secs", 2024-09-11T00:26:32.433 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.433 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.433 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.434 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:32.434 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "10", 2024-09-11T00:26:32.434 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.434 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.434 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T00:26:32.434 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.434 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.434 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.434 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.434 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.434 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.434 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.434 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.435 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.435 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.435 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.435 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.435 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.435 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.435 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.435 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.435 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.435 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.435 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.435 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.435 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.435 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.436 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.436 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.436 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.436 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.436 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.436 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.436 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.436 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.436 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.436 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.436 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.436 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.436 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.437 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.437 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.437 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.437 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.437 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.437 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.437 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.437 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.437 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.437 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.437 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.437 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.437 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.437 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.438 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.438 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.438 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.438 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.438 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.438 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.438 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.438 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.438 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.438 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.438 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.438 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.438 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.438 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.439 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.439 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.439 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.439 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.439 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.439 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.439 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.439 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.439 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.439 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.439 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.439 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.439 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.439 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.440 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.440 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.440 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.440 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.440 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.440 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.440 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.440 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.440 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.440 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.440 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.440 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.440 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.441 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.441 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "localpool", 2024-09-11T00:26:32.441 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.441 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.441 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.441 INFO:teuthology.orchestra.run.smithi078.stdout: "failure_domain": { 2024-09-11T00:26:32.441 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "failure_domain", 2024-09-11T00:26:32.441 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.441 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.441 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.441 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "host", 2024-09-11T00:26:32.442 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.442 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.442 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.442 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "failure domain for any created local pool", 2024-09-11T00:26:32.442 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T00:26:32.442 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.442 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.442 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.442 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.442 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.442 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.442 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.442 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.443 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.443 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.443 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.443 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.443 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.443 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.443 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.443 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.443 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.443 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.443 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.443 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.443 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.443 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.444 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.444 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.444 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.444 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.444 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.444 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.444 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.444 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.444 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.444 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.444 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.444 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.444 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.445 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.445 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.445 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.445 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.445 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.445 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.445 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.445 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.445 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.445 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.445 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.445 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.445 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.446 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.446 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.446 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.446 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.446 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.446 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.446 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.446 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.446 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.446 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.446 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.446 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.446 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.446 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.447 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.447 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.447 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.447 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.447 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.447 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.447 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.447 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.447 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.447 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.447 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.447 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": { 2024-09-11T00:26:32.447 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "min_size", 2024-09-11T00:26:32.448 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.448 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.448 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.448 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.448 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.448 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.448 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.448 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "default min_size for any created local pool", 2024-09-11T00:26:32.448 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T00:26:32.448 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.448 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.448 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.448 INFO:teuthology.orchestra.run.smithi078.stdout: "num_rep": { 2024-09-11T00:26:32.449 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "num_rep", 2024-09-11T00:26:32.449 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.449 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.449 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.449 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "3", 2024-09-11T00:26:32.449 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.449 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.449 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.449 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "default replica count for any created local pool", 2024-09-11T00:26:32.449 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.449 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.449 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.449 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.450 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": { 2024-09-11T00:26:32.450 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "pg_num", 2024-09-11T00:26:32.450 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.450 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.450 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.450 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "128", 2024-09-11T00:26:32.450 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.450 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.450 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.450 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T00:26:32.450 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.450 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.450 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.450 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.451 INFO:teuthology.orchestra.run.smithi078.stdout: "prefix": { 2024-09-11T00:26:32.451 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "prefix", 2024-09-11T00:26:32.451 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.451 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.451 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.451 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.451 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.451 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.451 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.451 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "name prefix for any created local pool", 2024-09-11T00:26:32.451 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.451 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.451 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.451 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.452 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.452 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.452 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.452 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.452 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.452 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.452 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.452 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.452 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.452 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.452 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.452 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.452 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.452 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.453 INFO:teuthology.orchestra.run.smithi078.stdout: "subtree": { 2024-09-11T00:26:32.453 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "subtree", 2024-09-11T00:26:32.453 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.453 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.453 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.453 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "rack", 2024-09-11T00:26:32.453 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.453 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.453 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.453 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T00:26:32.453 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T00:26:32.453 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.453 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.453 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.454 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.454 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.454 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.454 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "mds_autoscaler", 2024-09-11T00:26:32.454 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.454 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.454 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.454 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.454 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.454 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.454 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.454 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.454 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.454 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.455 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.455 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.455 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.455 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.455 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.455 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.455 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.455 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.455 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.455 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.455 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.455 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.455 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.456 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.456 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.456 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.456 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.456 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.456 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.456 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.456 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.456 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.456 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.456 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.456 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.456 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.456 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.457 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.457 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.457 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.457 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.457 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.457 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.457 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.457 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.457 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.457 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.457 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.457 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.457 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.458 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.458 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.458 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.458 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.458 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.458 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.458 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.458 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.458 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.458 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.458 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.458 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.458 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.458 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.459 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.459 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.459 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.459 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.459 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.459 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.459 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.459 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.459 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.459 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.459 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.459 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.460 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.460 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.460 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.460 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.460 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.460 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.460 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.460 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.460 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.460 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.460 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.460 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.460 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.461 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.461 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "mirroring", 2024-09-11T00:26:32.461 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.461 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.461 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.461 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.461 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.461 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.461 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.461 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.461 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.461 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.461 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.462 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.462 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.462 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.462 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.462 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.462 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.462 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.462 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.462 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.462 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.462 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.462 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.462 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.463 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.463 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.463 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.463 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.463 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.463 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.463 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.463 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.463 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.463 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.463 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.463 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.463 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.463 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.464 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.464 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.464 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.464 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.464 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.464 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.464 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.464 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.464 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.464 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.464 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.464 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.464 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.464 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.465 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.465 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.465 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.465 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.465 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.465 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.465 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.465 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.465 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.465 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.465 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.465 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.465 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.466 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.466 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.466 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.466 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.466 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.466 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.466 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.466 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.466 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.466 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.466 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.466 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.466 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.466 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.467 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.467 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.467 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.467 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.467 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.467 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.467 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.467 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.467 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.467 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.467 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.467 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "nfs", 2024-09-11T00:26:32.467 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.467 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.468 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.468 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.468 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.468 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.468 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.468 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.468 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.468 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.468 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.468 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.469 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.469 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.469 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.469 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.469 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.469 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.469 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.469 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.469 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.469 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.469 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.469 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.469 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.470 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.470 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.470 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.470 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.470 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.470 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.470 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.470 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.470 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.470 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.470 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.470 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.470 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.470 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.471 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.471 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.471 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.471 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.471 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.471 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.471 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.471 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.471 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.471 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.471 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.471 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.471 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.472 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.472 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.472 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.472 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.472 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.472 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.472 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.472 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.472 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.472 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.472 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.472 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.472 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.472 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.473 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.473 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.473 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.473 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.473 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.473 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.473 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.473 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.473 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.473 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.473 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.473 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.473 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.474 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.474 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.474 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.474 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.474 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.474 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.474 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.474 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.474 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.474 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.474 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.474 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "orchestrator", 2024-09-11T00:26:32.475 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.475 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.475 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.475 INFO:teuthology.orchestra.run.smithi078.stdout: "fail_fs": { 2024-09-11T00:26:32.475 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "fail_fs", 2024-09-11T00:26:32.475 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.475 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.475 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.475 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.475 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.475 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.475 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.475 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T00:26:32.475 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.476 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.476 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.476 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.476 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.476 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.476 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.476 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.476 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.476 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.476 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.476 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.476 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.476 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.477 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.477 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.477 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.477 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.477 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.477 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.477 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.477 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.477 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.477 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.477 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.477 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.477 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.478 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.478 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.478 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.478 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.478 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.478 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.478 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.478 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.478 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.478 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.478 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.478 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.478 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.478 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.479 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.479 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.479 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.479 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.479 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.479 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.479 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.479 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.479 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.479 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.479 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.479 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.479 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.480 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.480 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.480 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.480 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.480 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.480 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.480 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.480 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.480 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.480 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.480 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.480 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.480 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.481 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.481 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.481 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.481 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.481 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.481 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.481 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.481 INFO:teuthology.orchestra.run.smithi078.stdout: "orchestrator": { 2024-09-11T00:26:32.481 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "orchestrator", 2024-09-11T00:26:32.481 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.481 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.481 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.481 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.482 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.482 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.482 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.482 INFO:teuthology.orchestra.run.smithi078.stdout: "cephadm", 2024-09-11T00:26:32.482 INFO:teuthology.orchestra.run.smithi078.stdout: "rook", 2024-09-11T00:26:32.482 INFO:teuthology.orchestra.run.smithi078.stdout: "test_orchestrator" 2024-09-11T00:26:32.482 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.482 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Orchestrator backend", 2024-09-11T00:26:32.482 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.482 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.482 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.482 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.482 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.482 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.483 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.483 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.483 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.483 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.483 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.483 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.483 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.483 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.483 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.483 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.483 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.483 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.483 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.483 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.484 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.484 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "osd_perf_query", 2024-09-11T00:26:32.484 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.484 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.484 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.484 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.484 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.484 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.484 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.484 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.484 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.484 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.484 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.485 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.485 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.485 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.485 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.485 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.485 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.485 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.485 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.485 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.485 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.485 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.485 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.485 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.486 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.486 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.486 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.486 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.486 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.486 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.486 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.486 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.486 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.486 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.486 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.486 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.486 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.487 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.487 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.487 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.487 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.487 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.487 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.487 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.487 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.487 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.487 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.487 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.487 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.487 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.487 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.488 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.488 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.488 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.488 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.488 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.488 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.488 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.488 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.488 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.488 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.488 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.488 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.488 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.489 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.489 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.489 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.489 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.489 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.489 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.489 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.489 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.489 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.489 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.489 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.489 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.490 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.490 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.490 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.490 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.490 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.490 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.490 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.490 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.490 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.490 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.490 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.490 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.490 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.490 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.491 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "osd_support", 2024-09-11T00:26:32.491 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.491 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.491 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.491 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.491 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.491 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.491 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.491 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.491 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.491 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.491 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.491 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.491 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.492 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.492 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.492 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.492 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.492 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.492 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.492 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.492 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.492 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.492 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.492 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.492 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.492 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.493 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.493 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.493 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.493 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.493 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.493 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.493 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.493 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.493 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.493 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.493 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.493 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.493 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.493 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.494 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.494 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.494 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.494 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.494 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.494 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.494 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.494 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.494 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.494 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.494 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.494 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.494 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.495 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.495 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.495 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.495 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.495 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.495 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.495 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.495 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.495 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.495 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.495 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.495 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.495 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.495 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.496 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.496 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.496 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.496 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.496 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.496 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.496 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.496 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.496 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.496 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.496 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.496 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.496 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "pg_autoscaler", 2024-09-11T00:26:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: "sleep_interval": { 2024-09-11T00:26:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sleep_interval", 2024-09-11T00:26:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "60", 2024-09-11T00:26:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: "threshold": { 2024-09-11T00:26:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "threshold", 2024-09-11T00:26:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "float", 2024-09-11T00:26:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "3.0", 2024-09-11T00:26:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "1.0", 2024-09-11T00:26:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "scaling threshold", 2024-09-11T00:26:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T00:26:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "progress", 2024-09-11T00:26:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: "allow_pg_recovery_event": { 2024-09-11T00:26:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "allow_pg_recovery_event", 2024-09-11T00:26:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T00:26:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": { 2024-09-11T00:26:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "enabled", 2024-09-11T00:26:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.510 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.510 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.510 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.510 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.510 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.510 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.510 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.510 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.510 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.510 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.510 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.510 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.511 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.511 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.511 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.511 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.511 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.511 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.511 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.511 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.511 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.511 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.511 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.511 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.512 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.512 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.512 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.512 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.512 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.512 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.512 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.512 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.512 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.512 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.513 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.513 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.513 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.513 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.513 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.513 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.513 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.513 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.513 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.513 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.513 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.513 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.514 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.514 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.514 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.514 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.514 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.514 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.514 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.514 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.514 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.514 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.515 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.515 INFO:teuthology.orchestra.run.smithi078.stdout: "max_completed_events": { 2024-09-11T00:26:32.515 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "max_completed_events", 2024-09-11T00:26:32.515 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.515 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.515 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.515 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "50", 2024-09-11T00:26:32.515 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.515 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.515 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.515 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "number of past completed events to remember", 2024-09-11T00:26:32.515 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.515 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.515 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.516 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.516 INFO:teuthology.orchestra.run.smithi078.stdout: "sleep_interval": { 2024-09-11T00:26:32.516 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sleep_interval", 2024-09-11T00:26:32.516 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.516 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.516 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.516 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "5", 2024-09-11T00:26:32.516 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.516 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.517 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.517 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how long the module is going to sleep", 2024-09-11T00:26:32.517 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.517 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.517 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.517 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.517 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.517 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.517 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.518 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.518 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.518 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.518 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.518 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.518 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.518 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.518 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.518 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.518 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.518 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.518 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.518 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.518 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.519 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "prometheus", 2024-09-11T00:26:32.519 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.519 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.519 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.520 INFO:teuthology.orchestra.run.smithi078.stdout: "cache": { 2024-09-11T00:26:32.520 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cache", 2024-09-11T00:26:32.520 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.520 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.520 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.520 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.520 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.520 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.520 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.520 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.520 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.521 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.521 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.521 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.521 INFO:teuthology.orchestra.run.smithi078.stdout: "exclude_perf_counters": { 2024-09-11T00:26:32.521 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "exclude_perf_counters", 2024-09-11T00:26:32.521 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.521 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.521 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.521 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.521 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.521 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.521 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.521 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T00:26:32.522 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T00:26:32.522 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.522 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.522 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.522 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.522 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.522 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.522 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.522 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.522 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.522 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.522 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.523 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.523 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.523 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.523 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.523 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.523 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.523 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.523 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.523 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.523 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.523 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.523 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.523 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.524 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.524 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.524 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.524 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.524 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.524 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.524 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.524 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.524 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.524 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.524 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.524 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.525 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.525 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.525 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.525 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.525 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.525 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.525 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.525 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.525 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.525 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.525 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.525 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.525 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.525 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.526 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.526 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.526 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.526 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.526 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.526 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.526 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.526 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.526 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.526 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.526 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.526 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.526 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.527 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.527 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.527 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.527 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.527 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.527 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.527 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.527 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.527 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.527 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.527 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_stats_pools": { 2024-09-11T00:26:32.527 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rbd_stats_pools", 2024-09-11T00:26:32.527 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.527 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.528 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.528 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.528 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.528 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.528 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.528 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.528 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.528 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.528 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.528 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.528 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T00:26:32.528 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T00:26:32.528 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.529 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.529 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.529 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "300", 2024-09-11T00:26:32.529 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.529 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.529 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.529 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.529 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.529 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.529 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.529 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.529 INFO:teuthology.orchestra.run.smithi078.stdout: "scrape_interval": { 2024-09-11T00:26:32.529 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "scrape_interval", 2024-09-11T00:26:32.529 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "float", 2024-09-11T00:26:32.530 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.530 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.530 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "15.0", 2024-09-11T00:26:32.530 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.530 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.530 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.530 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.530 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.530 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.530 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.530 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.530 INFO:teuthology.orchestra.run.smithi078.stdout: "server_addr": { 2024-09-11T00:26:32.530 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "server_addr", 2024-09-11T00:26:32.531 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.531 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.531 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.531 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "::", 2024-09-11T00:26:32.531 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.531 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.531 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.531 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T00:26:32.531 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.531 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.531 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.531 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.531 INFO:teuthology.orchestra.run.smithi078.stdout: "server_port": { 2024-09-11T00:26:32.531 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "server_port", 2024-09-11T00:26:32.532 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.532 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.532 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.532 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "9283", 2024-09-11T00:26:32.532 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.532 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.532 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.532 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T00:26:32.532 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.532 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.532 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.532 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.532 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.533 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.533 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.533 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.533 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.533 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.533 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.533 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.533 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.533 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.533 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.533 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.533 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.533 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.534 INFO:teuthology.orchestra.run.smithi078.stdout: "stale_cache_strategy": { 2024-09-11T00:26:32.534 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "stale_cache_strategy", 2024-09-11T00:26:32.534 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.534 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.534 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.534 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "log", 2024-09-11T00:26:32.534 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.534 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.534 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.534 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.534 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.534 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.534 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.534 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.535 INFO:teuthology.orchestra.run.smithi078.stdout: "standby_behaviour": { 2024-09-11T00:26:32.535 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "standby_behaviour", 2024-09-11T00:26:32.535 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.535 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.535 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.535 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "default", 2024-09-11T00:26:32.535 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.535 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.535 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.535 INFO:teuthology.orchestra.run.smithi078.stdout: "default", 2024-09-11T00:26:32.535 INFO:teuthology.orchestra.run.smithi078.stdout: "error" 2024-09-11T00:26:32.535 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.535 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.536 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.536 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.536 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.536 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.536 INFO:teuthology.orchestra.run.smithi078.stdout: "standby_error_status_code": { 2024-09-11T00:26:32.536 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "standby_error_status_code", 2024-09-11T00:26:32.536 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.536 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.536 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.536 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "500", 2024-09-11T00:26:32.536 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "400", 2024-09-11T00:26:32.536 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "599", 2024-09-11T00:26:32.536 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.536 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.537 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.537 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.537 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.537 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.537 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.537 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.537 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.537 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rbd_support", 2024-09-11T00:26:32.537 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.537 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.537 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.537 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.537 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.538 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.538 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.538 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.538 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.538 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.538 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.538 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.538 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.538 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.538 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.538 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.538 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.538 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.538 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.538 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.539 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.539 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.539 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.539 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.539 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.539 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.539 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.539 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.539 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.539 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.539 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.539 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.539 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.540 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.540 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.540 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.540 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.540 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.540 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.540 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.540 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.540 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.540 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.540 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.540 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.540 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.541 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.541 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.541 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.541 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.541 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.541 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.541 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.541 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.541 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.541 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.541 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.541 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.541 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.542 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.542 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.542 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.542 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.542 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.542 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.542 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.542 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.542 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.542 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.542 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.542 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.542 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.542 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.543 INFO:teuthology.orchestra.run.smithi078.stdout: "max_concurrent_snap_create": { 2024-09-11T00:26:32.543 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "max_concurrent_snap_create", 2024-09-11T00:26:32.543 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.543 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.543 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.543 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:32.543 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.543 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.543 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.543 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.543 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.543 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.543 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.543 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.544 INFO:teuthology.orchestra.run.smithi078.stdout: "mirror_snapshot_schedule": { 2024-09-11T00:26:32.544 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T00:26:32.544 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.544 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.544 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.544 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.544 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.544 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.544 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.544 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.544 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.544 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.544 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.544 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.545 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.545 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.545 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.545 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.545 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.545 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.545 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.545 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.545 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.545 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.545 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.545 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.545 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.545 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.546 INFO:teuthology.orchestra.run.smithi078.stdout: "trash_purge_schedule": { 2024-09-11T00:26:32.546 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "trash_purge_schedule", 2024-09-11T00:26:32.546 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.546 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.546 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.546 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.546 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.546 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.546 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.546 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.546 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.546 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.546 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.546 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.547 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.547 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.547 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.547 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "restful", 2024-09-11T00:26:32.547 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.547 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.547 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.547 INFO:teuthology.orchestra.run.smithi078.stdout: "enable_auth": { 2024-09-11T00:26:32.547 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "enable_auth", 2024-09-11T00:26:32.547 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.547 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.547 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.547 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.547 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.548 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.548 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.548 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.548 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.548 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.548 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.548 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.548 INFO:teuthology.orchestra.run.smithi078.stdout: "key_file": { 2024-09-11T00:26:32.548 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "key_file", 2024-09-11T00:26:32.548 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.548 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.548 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.548 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.549 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.549 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.549 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.549 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.549 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.549 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.549 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.549 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.549 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.549 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.549 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.549 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.549 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.549 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.550 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.550 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.550 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.550 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.550 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.550 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.550 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.550 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.550 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.550 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.550 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.550 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.550 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.551 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.551 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.551 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.551 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.551 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.551 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.551 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.551 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.551 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.551 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.551 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.551 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.551 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.551 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.552 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.552 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.552 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.552 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.552 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.552 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.552 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.552 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.552 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.552 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.552 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.552 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.552 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.553 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.553 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.553 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.553 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.553 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.553 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.553 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.553 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.553 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.553 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.553 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.553 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.553 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.553 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.554 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.554 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.554 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.554 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.554 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.554 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.554 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.554 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.554 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.554 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.554 INFO:teuthology.orchestra.run.smithi078.stdout: "max_requests": { 2024-09-11T00:26:32.554 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "max_requests", 2024-09-11T00:26:32.554 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.554 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.555 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.555 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "500", 2024-09-11T00:26:32.555 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.555 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.555 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.555 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-11T00:26:32.555 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.555 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.555 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.555 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.555 INFO:teuthology.orchestra.run.smithi078.stdout: "server_addr": { 2024-09-11T00:26:32.555 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "server_addr", 2024-09-11T00:26:32.555 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.555 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.556 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.556 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.556 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.556 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.556 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.556 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.556 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.556 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.556 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.556 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.556 INFO:teuthology.orchestra.run.smithi078.stdout: "server_port": { 2024-09-11T00:26:32.556 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "server_port", 2024-09-11T00:26:32.556 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.557 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.557 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.557 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.557 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.557 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.557 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.557 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.557 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.557 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.557 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.557 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.557 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.557 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.557 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.558 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.558 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.558 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.558 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.558 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.558 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.558 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.558 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.558 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.558 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.558 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.558 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.558 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.558 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.559 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rgw", 2024-09-11T00:26:32.559 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.559 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.559 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.559 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.559 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.559 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.559 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.559 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.559 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.559 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.559 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.559 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.559 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.560 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.560 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.560 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.560 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.560 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.560 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.560 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.560 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.560 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.560 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.560 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.560 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.560 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.561 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.561 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.561 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.561 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.561 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.561 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.561 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.561 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.561 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.561 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.561 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.561 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.562 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.562 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.562 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.562 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.562 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.562 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.562 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.562 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.562 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.562 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.562 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.562 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.562 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.562 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.563 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.563 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.563 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.563 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.563 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.563 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.563 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.563 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.563 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.563 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.563 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.563 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.563 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.564 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.564 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.564 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.564 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.564 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.564 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.564 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.564 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.564 INFO:teuthology.orchestra.run.smithi078.stdout: "secondary_zone_period_retry_limit": { 2024-09-11T00:26:32.564 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-11T00:26:32.564 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.564 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.564 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.565 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "5", 2024-09-11T00:26:32.565 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.565 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.565 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.565 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-11T00:26:32.565 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.565 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.565 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.565 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.565 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.565 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.565 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.565 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.565 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.566 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.566 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.566 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.566 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.566 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.566 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.566 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.566 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.566 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.566 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.566 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.566 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.566 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rook", 2024-09-11T00:26:32.566 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.567 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.567 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.567 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.567 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.567 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.567 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.567 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.567 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.567 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.567 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.567 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.567 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.567 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.567 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.568 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.568 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.568 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.568 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.568 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.568 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.568 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.568 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.568 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.568 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.568 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.568 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.568 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.569 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.569 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.569 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.569 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.569 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.569 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.569 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.569 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.569 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.569 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.570 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.570 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.570 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.570 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.570 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.570 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.570 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.570 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.570 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.570 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.570 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.570 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.570 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.570 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.571 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.571 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.571 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.571 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.571 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.571 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.571 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.571 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.571 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.571 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.571 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.571 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.571 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.571 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.572 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.572 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.572 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.572 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.572 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.572 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.572 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.572 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.572 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.572 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.572 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.572 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.572 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.572 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.573 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.573 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.573 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.573 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.573 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.573 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.573 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.573 INFO:teuthology.orchestra.run.smithi078.stdout: "storage_class": { 2024-09-11T00:26:32.573 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "storage_class", 2024-09-11T00:26:32.573 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.573 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.573 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.573 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "local", 2024-09-11T00:26:32.574 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.574 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.574 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.574 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T00:26:32.574 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.574 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.574 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.574 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.574 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.574 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.574 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.574 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "selftest", 2024-09-11T00:26:32.574 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.574 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.574 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.575 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.575 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.575 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.575 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.575 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.575 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.575 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.575 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.575 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.575 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.575 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.575 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.575 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.575 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.576 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.576 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.576 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.576 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.576 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.576 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.576 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.576 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.576 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.576 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.576 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.576 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.577 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.577 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.577 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.577 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.577 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.577 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.577 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.577 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.577 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.577 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.577 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.577 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.577 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.577 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.578 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.578 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.578 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.578 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.578 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.578 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.578 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.578 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.578 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.578 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.578 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.578 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.578 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.579 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.579 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.579 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.579 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.579 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.579 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.579 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.579 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.579 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.579 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.579 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.579 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.579 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.579 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.580 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.580 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.580 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.580 INFO:teuthology.orchestra.run.smithi078.stdout: "roption1": { 2024-09-11T00:26:32.580 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "roption1", 2024-09-11T00:26:32.580 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.580 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.580 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.580 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.580 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.580 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.580 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.580 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.581 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.581 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.581 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.581 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.581 INFO:teuthology.orchestra.run.smithi078.stdout: "roption2": { 2024-09-11T00:26:32.581 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "roption2", 2024-09-11T00:26:32.581 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.581 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.581 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.581 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "xyz", 2024-09-11T00:26:32.581 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.581 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.582 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.582 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.582 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.582 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.582 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.582 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.582 INFO:teuthology.orchestra.run.smithi078.stdout: "rwoption1": { 2024-09-11T00:26:32.582 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rwoption1", 2024-09-11T00:26:32.582 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.582 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.582 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.582 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.582 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.582 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.583 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.583 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.583 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.583 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.583 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.583 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.583 INFO:teuthology.orchestra.run.smithi078.stdout: "rwoption2": { 2024-09-11T00:26:32.583 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rwoption2", 2024-09-11T00:26:32.583 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.583 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.583 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.583 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.583 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.583 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.584 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.584 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.584 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.584 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.584 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.584 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.584 INFO:teuthology.orchestra.run.smithi078.stdout: "rwoption3": { 2024-09-11T00:26:32.584 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rwoption3", 2024-09-11T00:26:32.584 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "float", 2024-09-11T00:26:32.584 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.584 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.584 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.584 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.585 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.585 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.585 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.585 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.585 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.585 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.585 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.585 INFO:teuthology.orchestra.run.smithi078.stdout: "rwoption4": { 2024-09-11T00:26:32.585 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rwoption4", 2024-09-11T00:26:32.585 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.585 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.585 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.585 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.585 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.586 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.586 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.586 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.586 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.586 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.586 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.586 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.586 INFO:teuthology.orchestra.run.smithi078.stdout: "rwoption5": { 2024-09-11T00:26:32.586 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rwoption5", 2024-09-11T00:26:32.586 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.586 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.587 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.587 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.587 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.587 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.587 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.587 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.587 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.587 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.587 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.587 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.588 INFO:teuthology.orchestra.run.smithi078.stdout: "rwoption6": { 2024-09-11T00:26:32.588 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rwoption6", 2024-09-11T00:26:32.588 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.588 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.588 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.588 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.588 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.588 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.588 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.589 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.589 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.589 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.589 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.589 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.589 INFO:teuthology.orchestra.run.smithi078.stdout: "rwoption7": { 2024-09-11T00:26:32.589 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rwoption7", 2024-09-11T00:26:32.589 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.589 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.590 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.590 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.590 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "1", 2024-09-11T00:26:32.590 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "42", 2024-09-11T00:26:32.590 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.590 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.590 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.590 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.590 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.590 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.590 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.590 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.591 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.591 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.591 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.591 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.591 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.591 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.591 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.591 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.591 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.591 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.591 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.591 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.591 INFO:teuthology.orchestra.run.smithi078.stdout: "testkey": { 2024-09-11T00:26:32.591 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "testkey", 2024-09-11T00:26:32.592 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.592 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.592 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.592 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.592 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.592 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.592 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.592 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.592 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.592 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.592 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.592 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.593 INFO:teuthology.orchestra.run.smithi078.stdout: "testlkey": { 2024-09-11T00:26:32.593 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "testlkey", 2024-09-11T00:26:32.593 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.593 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.593 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.593 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.593 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.593 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.593 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.593 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.593 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.593 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.593 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.594 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.594 INFO:teuthology.orchestra.run.smithi078.stdout: "testnewline": { 2024-09-11T00:26:32.594 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "testnewline", 2024-09-11T00:26:32.594 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.594 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.594 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.594 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.594 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.594 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.594 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.594 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.594 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.594 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.595 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.595 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.595 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.595 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.595 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.595 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smb", 2024-09-11T00:26:32.595 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.595 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.595 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.595 INFO:teuthology.orchestra.run.smithi078.stdout: "internal_store_backend": { 2024-09-11T00:26:32.595 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "internal_store_backend", 2024-09-11T00:26:32.595 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.595 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.595 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.596 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.596 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.596 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.596 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.596 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-11T00:26:32.596 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.596 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.596 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.596 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.596 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.596 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.596 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.597 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.597 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.597 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.597 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.597 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.597 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.597 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.597 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.597 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.597 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.597 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.597 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.597 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.597 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.598 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.598 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.598 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.598 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.598 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.598 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.598 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.598 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.598 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.598 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.598 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.598 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.598 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.598 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.599 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.599 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.599 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.599 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.599 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.599 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.599 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.599 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.599 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.599 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.599 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.599 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.599 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.599 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.600 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.600 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.600 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.600 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.600 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.600 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.600 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.600 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.600 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.600 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.600 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.600 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.600 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.600 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.601 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.601 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.601 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.601 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.601 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.601 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.601 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.601 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.601 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.601 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.601 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.601 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.601 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.602 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.602 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.602 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.602 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.602 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.602 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.602 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.602 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.602 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.602 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.602 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.602 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.602 INFO:teuthology.orchestra.run.smithi078.stdout: "update_orchestration": { 2024-09-11T00:26:32.602 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "update_orchestration", 2024-09-11T00:26:32.602 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.603 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.603 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.603 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.603 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.603 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.603 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.603 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-11T00:26:32.603 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.603 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.603 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.603 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.603 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.603 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.603 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.604 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "snap_schedule", 2024-09-11T00:26:32.604 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.604 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.604 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.604 INFO:teuthology.orchestra.run.smithi078.stdout: "allow_m_granularity": { 2024-09-11T00:26:32.604 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "allow_m_granularity", 2024-09-11T00:26:32.604 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.604 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.604 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.604 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.604 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.604 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.604 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.605 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T00:26:32.605 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.605 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.605 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.605 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.605 INFO:teuthology.orchestra.run.smithi078.stdout: "dump_on_update": { 2024-09-11T00:26:32.605 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "dump_on_update", 2024-09-11T00:26:32.605 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.605 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.605 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.605 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.605 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.605 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.605 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.605 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "dump database to debug log on update", 2024-09-11T00:26:32.606 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.606 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.606 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.606 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.606 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.606 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.606 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.606 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.606 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.606 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.606 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.606 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.607 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.607 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.607 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.607 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.607 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.607 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.607 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.607 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.607 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.607 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.607 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.607 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.607 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.607 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.608 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.608 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.608 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.608 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.608 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.608 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.608 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.608 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.608 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.608 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.608 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.608 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.608 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.609 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.609 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.609 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.609 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.609 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.609 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.609 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.609 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.609 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.609 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.609 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.609 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.610 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.610 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.610 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.610 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.610 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.610 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.610 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.610 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.610 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.611 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.611 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.611 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.611 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.611 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.611 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.611 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.611 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.611 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.611 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.611 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.611 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.611 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.611 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.612 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.612 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.612 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.612 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.612 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.612 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.612 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.612 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.612 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.612 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.612 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.613 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.613 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.613 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.613 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.613 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.613 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.613 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "stats", 2024-09-11T00:26:32.613 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.614 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.614 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.614 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.614 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.614 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.614 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.614 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.614 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.614 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.614 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.614 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.614 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.614 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.615 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.615 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.615 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.615 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.615 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.615 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.615 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.615 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.615 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.616 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.616 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.616 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.616 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.616 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.616 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.616 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.616 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.616 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.616 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.616 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.616 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.617 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.617 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.617 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.617 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.617 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.617 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.617 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.617 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.617 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.617 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.618 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.618 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.618 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.618 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.618 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.618 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.618 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.618 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.618 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.619 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.619 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.619 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.619 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.619 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.619 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.619 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.619 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.619 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.619 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.620 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.620 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.620 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.620 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.621 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.621 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.621 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.621 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.621 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.621 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.621 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.621 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.621 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.622 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.622 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.622 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.622 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.622 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.622 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.622 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.622 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.622 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.623 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.623 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.623 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.623 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.623 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "status", 2024-09-11T00:26:32.623 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.623 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.623 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.623 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.623 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.623 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.623 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.623 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.624 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.624 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.624 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.624 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.624 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.624 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.624 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.624 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.624 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.624 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.624 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.624 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.625 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.625 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.625 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.625 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.625 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.625 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.625 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.625 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.625 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.625 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.625 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.625 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.626 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.626 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.626 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.626 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.626 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.626 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.626 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.626 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.626 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.626 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.626 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.626 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.627 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.627 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.627 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.627 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.627 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.627 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.627 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.627 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.627 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.627 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.627 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.627 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.627 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.627 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.628 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.628 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.628 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.628 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.628 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.628 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.628 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.628 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.628 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.628 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.628 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.628 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.628 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.629 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.629 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.629 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.629 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.629 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.629 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.629 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.629 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.629 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.629 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.629 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.629 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.629 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.629 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.630 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.630 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.630 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.630 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.630 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.630 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "telegraf", 2024-09-11T00:26:32.630 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.630 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.630 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.630 INFO:teuthology.orchestra.run.smithi078.stdout: "address": { 2024-09-11T00:26:32.630 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "address", 2024-09-11T00:26:32.630 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.630 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.630 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.631 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T00:26:32.631 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.631 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.631 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.631 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.631 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.631 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.631 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.631 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.631 INFO:teuthology.orchestra.run.smithi078.stdout: "interval": { 2024-09-11T00:26:32.631 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "interval", 2024-09-11T00:26:32.631 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.631 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.631 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.632 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "15", 2024-09-11T00:26:32.632 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.632 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.632 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.632 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.632 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.632 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.632 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.632 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.632 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.632 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.632 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.632 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.632 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.633 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.633 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.633 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.633 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.633 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.633 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.633 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.633 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.633 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.633 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.633 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.633 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.633 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.634 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.634 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.634 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.634 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.634 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.634 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.634 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.634 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.634 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.634 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.634 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.634 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.634 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.634 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.635 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.635 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.635 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.635 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.635 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.635 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.635 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.635 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.635 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.635 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.635 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.635 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.635 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.635 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.636 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.636 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.636 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.636 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.636 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.636 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.636 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.636 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.636 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.636 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.636 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.636 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.636 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.636 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.637 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.637 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.637 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.637 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.637 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.637 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.637 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.637 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.637 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.637 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.637 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.637 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.637 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.638 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.638 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.638 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.638 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.638 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.638 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.638 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.638 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.638 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.638 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.638 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.638 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.638 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.638 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.639 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "telemetry", 2024-09-11T00:26:32.639 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.639 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.639 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.639 INFO:teuthology.orchestra.run.smithi078.stdout: "channel_basic": { 2024-09-11T00:26:32.639 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "channel_basic", 2024-09-11T00:26:32.639 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.639 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.639 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.639 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.639 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.639 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.639 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.640 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T00:26:32.640 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.640 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.640 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.640 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.640 INFO:teuthology.orchestra.run.smithi078.stdout: "channel_crash": { 2024-09-11T00:26:32.640 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "channel_crash", 2024-09-11T00:26:32.640 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.640 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.640 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.640 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.640 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.640 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.641 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.641 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T00:26:32.641 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.641 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.641 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.641 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.641 INFO:teuthology.orchestra.run.smithi078.stdout: "channel_device": { 2024-09-11T00:26:32.641 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "channel_device", 2024-09-11T00:26:32.641 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.641 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.641 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.641 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.641 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.642 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.642 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.642 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T00:26:32.642 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.642 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.642 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.642 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.642 INFO:teuthology.orchestra.run.smithi078.stdout: "channel_ident": { 2024-09-11T00:26:32.642 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "channel_ident", 2024-09-11T00:26:32.642 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.642 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.642 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.642 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.642 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.643 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.643 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.643 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T00:26:32.643 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.643 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.643 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.643 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.643 INFO:teuthology.orchestra.run.smithi078.stdout: "channel_perf": { 2024-09-11T00:26:32.643 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "channel_perf", 2024-09-11T00:26:32.643 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.643 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.644 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.644 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.644 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.644 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.644 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.644 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T00:26:32.644 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.644 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.644 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.644 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.644 INFO:teuthology.orchestra.run.smithi078.stdout: "contact": { 2024-09-11T00:26:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "contact", 2024-09-11T00:26:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.645 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.646 INFO:teuthology.orchestra.run.smithi078.stdout: "description": { 2024-09-11T00:26:32.646 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "description", 2024-09-11T00:26:32.646 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.646 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.646 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.646 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.646 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.646 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.646 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: "device_url": { 2024-09-11T00:26:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "device_url", 2024-09-11T00:26:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T00:26:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.647 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.648 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.648 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.648 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.648 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.648 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.648 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.648 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": { 2024-09-11T00:26:32.648 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "enabled", 2024-09-11T00:26:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: "interval": { 2024-09-11T00:26:32.649 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "interval", 2024-09-11T00:26:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "24", 2024-09-11T00:26:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "8", 2024-09-11T00:26:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.650 INFO:teuthology.orchestra.run.smithi078.stdout: "last_opt_revision": { 2024-09-11T00:26:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "last_opt_revision", 2024-09-11T00:26:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "1", 2024-09-11T00:26:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.651 INFO:teuthology.orchestra.run.smithi078.stdout: "leaderboard": { 2024-09-11T00:26:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "leaderboard", 2024-09-11T00:26:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.652 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: "leaderboard_description": { 2024-09-11T00:26:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "leaderboard_description", 2024-09-11T00:26:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.653 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.654 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.654 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.654 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.654 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.654 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.654 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.654 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.654 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.654 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.654 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.655 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.656 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.656 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.656 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.656 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.656 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.656 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.656 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.656 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.656 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.656 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.656 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.656 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.657 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.657 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.657 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.657 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.657 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.657 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.657 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.657 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.657 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.657 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.657 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.657 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.657 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.657 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.658 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.658 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.658 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.658 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.658 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.658 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.658 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.658 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.658 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.658 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.658 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.658 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.658 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.659 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.659 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.659 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.659 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.659 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.659 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.659 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.659 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.659 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.659 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.659 INFO:teuthology.orchestra.run.smithi078.stdout: "organization": { 2024-09-11T00:26:32.659 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "organization", 2024-09-11T00:26:32.659 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.659 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.660 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.660 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.660 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.660 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.660 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.660 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.660 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.660 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.660 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.660 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.660 INFO:teuthology.orchestra.run.smithi078.stdout: "proxy": { 2024-09-11T00:26:32.660 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "proxy", 2024-09-11T00:26:32.660 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.661 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.661 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.661 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.661 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.661 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.661 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.661 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.661 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.661 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.661 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.661 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.661 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.661 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.662 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.662 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.662 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.662 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.662 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.662 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.662 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.662 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.662 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.662 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.662 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.662 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.662 INFO:teuthology.orchestra.run.smithi078.stdout: "url": { 2024-09-11T00:26:32.662 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "url", 2024-09-11T00:26:32.663 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.663 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.663 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.663 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T00:26:32.663 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.663 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.663 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.663 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.663 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.663 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.663 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.663 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.663 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.663 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.664 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.664 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "test_orchestrator", 2024-09-11T00:26:32.664 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.664 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.664 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.664 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.664 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.664 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.664 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.664 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.664 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.664 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.664 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.665 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.665 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.665 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.665 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.665 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.665 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.665 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.665 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.665 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.665 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.665 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.665 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.665 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.665 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.666 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.666 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.666 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.666 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.666 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.666 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.666 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.666 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.666 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.666 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.666 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.666 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.666 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.667 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.667 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.667 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.667 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.667 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.667 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.667 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.667 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.667 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.667 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.667 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.667 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.667 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.667 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.668 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.668 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.668 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.668 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.668 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.668 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.668 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.668 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.668 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.668 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.668 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.668 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.668 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.669 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.669 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.669 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.669 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.669 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.669 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.669 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.669 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.670 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.670 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.670 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.670 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.670 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.670 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.670 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.670 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.670 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.670 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.670 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.670 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.670 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.671 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.671 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.671 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.671 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.671 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "volumes", 2024-09-11T00:26:32.671 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.671 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.671 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.671 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.671 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.671 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.671 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.671 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.672 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.672 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.672 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.672 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.672 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.672 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.672 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.672 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.672 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.672 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.672 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.672 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.672 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.673 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.673 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.673 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.673 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.673 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.673 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.673 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.673 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.673 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.673 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.673 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.673 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.673 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.674 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.674 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.674 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.674 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.674 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.674 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.674 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.674 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.674 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.674 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.674 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.674 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.674 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.674 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.675 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.675 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.675 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.675 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.675 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.675 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.675 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.675 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.675 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.675 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.675 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.675 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.675 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.675 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.676 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.676 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.676 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.676 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.676 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.676 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.676 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.676 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.676 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.676 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.676 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.676 INFO:teuthology.orchestra.run.smithi078.stdout: "max_concurrent_clones": { 2024-09-11T00:26:32.676 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "max_concurrent_clones", 2024-09-11T00:26:32.677 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.677 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.677 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.677 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "4", 2024-09-11T00:26:32.677 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.677 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.677 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.677 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T00:26:32.677 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.677 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.677 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.677 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.677 INFO:teuthology.orchestra.run.smithi078.stdout: "periodic_async_work": { 2024-09-11T00:26:32.678 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "periodic_async_work", 2024-09-11T00:26:32.678 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.678 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.678 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.678 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.678 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.678 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.678 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.678 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Periodically check for async work", 2024-09-11T00:26:32.678 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.678 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.678 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.678 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.678 INFO:teuthology.orchestra.run.smithi078.stdout: "snapshot_clone_delay": { 2024-09-11T00:26:32.679 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "snapshot_clone_delay", 2024-09-11T00:26:32.679 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.679 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.679 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.679 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.679 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.679 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.679 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.679 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T00:26:32.679 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.679 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.679 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.679 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.679 INFO:teuthology.orchestra.run.smithi078.stdout: "snapshot_clone_no_wait": { 2024-09-11T00:26:32.680 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T00:26:32.680 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.680 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.680 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.680 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.680 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.680 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.680 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.680 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T00:26:32.680 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.680 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.680 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.680 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.680 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.681 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.681 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.681 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.681 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.681 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.681 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.681 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.681 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.681 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.681 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.681 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.681 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.681 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.681 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.682 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.682 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.682 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "zabbix", 2024-09-11T00:26:32.682 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.682 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.682 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.682 INFO:teuthology.orchestra.run.smithi078.stdout: "discovery_interval": { 2024-09-11T00:26:32.682 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "discovery_interval", 2024-09-11T00:26:32.682 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "uint", 2024-09-11T00:26:32.682 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.682 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.682 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "100", 2024-09-11T00:26:32.682 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.682 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.683 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.683 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.683 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.683 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.683 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.683 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.683 INFO:teuthology.orchestra.run.smithi078.stdout: "identifier": { 2024-09-11T00:26:32.683 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "identifier", 2024-09-11T00:26:32.683 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.683 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.683 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.683 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.684 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.684 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.684 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.684 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.684 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.684 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.684 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.684 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.684 INFO:teuthology.orchestra.run.smithi078.stdout: "interval": { 2024-09-11T00:26:32.684 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "interval", 2024-09-11T00:26:32.684 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.684 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.684 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.685 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "60", 2024-09-11T00:26:32.685 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.685 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.685 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.685 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.685 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.685 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.685 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.685 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.685 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.685 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.685 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.685 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.686 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.686 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.686 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.686 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.686 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.686 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.686 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.686 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.686 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.686 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.686 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.686 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.686 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.686 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.687 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.687 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.687 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.687 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.687 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.687 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.687 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.687 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.687 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.687 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.687 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.687 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.687 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.687 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.688 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.688 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.688 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.688 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.688 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.688 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.688 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.688 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.688 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.688 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.688 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.688 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.689 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.689 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.689 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.689 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.689 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.689 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.689 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.689 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.689 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.689 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.689 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.689 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.690 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.690 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.690 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.690 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.690 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.690 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.690 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.690 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.690 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.690 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.690 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.691 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.691 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.691 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.691 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.691 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.691 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.691 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.691 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.691 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.691 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.692 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.692 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.692 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.692 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.692 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.692 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.692 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.692 INFO:teuthology.orchestra.run.smithi078.stdout: "zabbix_host": { 2024-09-11T00:26:32.692 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "zabbix_host", 2024-09-11T00:26:32.693 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.693 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.693 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.693 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.693 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.693 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.693 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.693 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.693 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.694 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.694 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.694 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.694 INFO:teuthology.orchestra.run.smithi078.stdout: "zabbix_port": { 2024-09-11T00:26:32.694 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "zabbix_port", 2024-09-11T00:26:32.694 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.694 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.694 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.694 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10051", 2024-09-11T00:26:32.694 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.695 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.695 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.695 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.695 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.695 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.695 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.695 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.695 INFO:teuthology.orchestra.run.smithi078.stdout: "zabbix_sender": { 2024-09-11T00:26:32.695 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "zabbix_sender", 2024-09-11T00:26:32.695 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.695 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.695 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.695 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T00:26:32.695 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.696 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.696 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.696 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.696 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.696 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.696 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.696 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.696 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.696 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.696 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-09-11T00:26:32.696 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.696 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.696 INFO:teuthology.orchestra.run.smithi078.stdout: "gid": 24155, 2024-09-11T00:26:32.697 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "y", 2024-09-11T00:26:32.697 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr_features": 4540719139924082687, 2024-09-11T00:26:32.697 INFO:teuthology.orchestra.run.smithi078.stdout: "available_modules": [ 2024-09-11T00:26:32.697 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.697 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "alerts", 2024-09-11T00:26:32.697 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.697 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.697 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.697 INFO:teuthology.orchestra.run.smithi078.stdout: "interval": { 2024-09-11T00:26:32.697 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "interval", 2024-09-11T00:26:32.697 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.697 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.697 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.698 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "60", 2024-09-11T00:26:32.698 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.698 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.698 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.698 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T00:26:32.698 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.698 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.698 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.698 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.698 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.698 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.698 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.698 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.698 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.699 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.699 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.699 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.699 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.699 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.699 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.699 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.699 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.699 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.699 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.699 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.699 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.700 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.700 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.700 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.700 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.700 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.700 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.700 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.700 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.700 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.700 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.700 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.700 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.700 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.701 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.701 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.701 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.701 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.701 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.701 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.701 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.701 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.701 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.701 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.701 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.701 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.701 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.702 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.702 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.702 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.702 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.702 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.702 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.702 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.702 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.702 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.702 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.702 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.702 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.702 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.703 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.703 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.703 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.703 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.703 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.703 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.703 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.703 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.703 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.703 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.703 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.703 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.703 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.703 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.704 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_destination": { 2024-09-11T00:26:32.704 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_destination", 2024-09-11T00:26:32.704 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.704 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.704 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.704 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.704 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.704 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.704 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.704 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-11T00:26:32.704 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.704 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.704 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.705 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.705 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_from_name": { 2024-09-11T00:26:32.705 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_from_name", 2024-09-11T00:26:32.705 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.705 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.705 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.705 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "Ceph", 2024-09-11T00:26:32.705 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.705 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.705 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.705 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Email From: name", 2024-09-11T00:26:32.706 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.706 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.706 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.706 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.706 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_host": { 2024-09-11T00:26:32.706 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_host", 2024-09-11T00:26:32.706 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.706 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.706 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.706 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.706 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.706 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.706 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.706 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "SMTP server", 2024-09-11T00:26:32.707 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.707 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.707 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.707 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.707 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_password": { 2024-09-11T00:26:32.707 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_password", 2024-09-11T00:26:32.707 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.707 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.707 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.707 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.707 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.707 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.707 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.707 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Password to authenticate with", 2024-09-11T00:26:32.708 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.708 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.708 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.708 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.708 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_port": { 2024-09-11T00:26:32.708 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_port", 2024-09-11T00:26:32.708 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.708 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.708 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.708 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "465", 2024-09-11T00:26:32.709 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.709 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.709 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.709 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "SMTP port", 2024-09-11T00:26:32.709 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.709 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.709 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.709 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.709 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_sender": { 2024-09-11T00:26:32.709 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_sender", 2024-09-11T00:26:32.709 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.709 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.709 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.709 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.710 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.710 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.710 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.710 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "SMTP envelope sender", 2024-09-11T00:26:32.710 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.710 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.710 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.710 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.710 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_ssl": { 2024-09-11T00:26:32.710 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_ssl", 2024-09-11T00:26:32.710 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.710 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.710 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.710 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.711 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.711 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.711 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.711 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T00:26:32.711 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.711 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.711 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.711 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.711 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_user": { 2024-09-11T00:26:32.711 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_user", 2024-09-11T00:26:32.711 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.711 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.711 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.711 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.712 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.712 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.712 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.712 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "User to authenticate as", 2024-09-11T00:26:32.712 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.712 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.712 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.712 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.712 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.712 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.712 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.712 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.712 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.712 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.712 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.713 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.713 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.713 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.713 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.713 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.713 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.713 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.713 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.713 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.713 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.713 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "balancer", 2024-09-11T00:26:32.713 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.714 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.714 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.714 INFO:teuthology.orchestra.run.smithi078.stdout: "active": { 2024-09-11T00:26:32.714 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "active", 2024-09-11T00:26:32.714 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.714 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.714 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.714 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.714 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.714 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.714 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.714 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T00:26:32.714 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.715 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.715 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.715 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.715 INFO:teuthology.orchestra.run.smithi078.stdout: "begin_time": { 2024-09-11T00:26:32.715 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "begin_time", 2024-09-11T00:26:32.715 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.715 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.715 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.715 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0000", 2024-09-11T00:26:32.715 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.715 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.715 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.715 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T00:26:32.715 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T00:26:32.716 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.716 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.716 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.716 INFO:teuthology.orchestra.run.smithi078.stdout: "begin_weekday": { 2024-09-11T00:26:32.716 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "begin_weekday", 2024-09-11T00:26:32.716 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "uint", 2024-09-11T00:26:32.716 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.716 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.716 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.716 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "0", 2024-09-11T00:26:32.716 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "6", 2024-09-11T00:26:32.716 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.716 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T00:26:32.717 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T00:26:32.717 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.717 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.717 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.717 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_compat_max_iterations": { 2024-09-11T00:26:32.717 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "crush_compat_max_iterations", 2024-09-11T00:26:32.717 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "uint", 2024-09-11T00:26:32.717 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.717 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.717 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "25", 2024-09-11T00:26:32.717 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "1", 2024-09-11T00:26:32.717 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "250", 2024-09-11T00:26:32.717 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.717 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T00:26:32.718 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.718 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.718 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.718 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.718 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_compat_metrics": { 2024-09-11T00:26:32.718 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "crush_compat_metrics", 2024-09-11T00:26:32.718 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.718 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.718 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.718 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T00:26:32.718 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.718 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.718 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.718 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T00:26:32.719 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T00:26:32.719 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.719 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.719 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.719 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_compat_step": { 2024-09-11T00:26:32.719 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "crush_compat_step", 2024-09-11T00:26:32.719 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "float", 2024-09-11T00:26:32.719 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.719 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.719 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0.5", 2024-09-11T00:26:32.719 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "0.001", 2024-09-11T00:26:32.719 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "0.999", 2024-09-11T00:26:32.719 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.720 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "aggressiveness of optimization", 2024-09-11T00:26:32.720 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T00:26:32.720 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.720 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.720 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.720 INFO:teuthology.orchestra.run.smithi078.stdout: "end_time": { 2024-09-11T00:26:32.720 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "end_time", 2024-09-11T00:26:32.720 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.720 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.720 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.721 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "2359", 2024-09-11T00:26:32.721 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.721 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.721 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.721 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T00:26:32.721 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T00:26:32.721 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.721 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.721 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.721 INFO:teuthology.orchestra.run.smithi078.stdout: "end_weekday": { 2024-09-11T00:26:32.721 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "end_weekday", 2024-09-11T00:26:32.721 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "uint", 2024-09-11T00:26:32.721 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.722 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.722 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.722 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "0", 2024-09-11T00:26:32.722 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "6", 2024-09-11T00:26:32.722 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.722 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T00:26:32.722 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T00:26:32.722 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.722 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.722 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.722 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.722 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.722 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.722 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.723 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.723 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.723 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.723 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.723 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.723 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.723 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.723 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.723 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.723 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.723 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.723 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.723 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.723 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.724 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.724 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.724 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.724 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.724 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.724 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.724 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.724 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.724 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.724 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.724 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.724 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.724 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.724 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.724 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.725 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.725 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.725 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.725 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.725 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.725 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.725 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.725 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.725 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.725 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.725 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.725 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.725 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.725 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.726 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.726 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.726 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.726 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.726 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.726 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.726 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.726 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.726 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.726 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.726 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.726 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.726 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.727 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.727 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.727 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.727 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.727 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.727 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.727 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.727 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.727 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.727 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.727 INFO:teuthology.orchestra.run.smithi078.stdout: "min_score": { 2024-09-11T00:26:32.727 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "min_score", 2024-09-11T00:26:32.728 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "float", 2024-09-11T00:26:32.728 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.728 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.728 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.728 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.728 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.728 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.728 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T00:26:32.728 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.728 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.728 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.728 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.728 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": { 2024-09-11T00:26:32.728 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "mode", 2024-09-11T00:26:32.729 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.729 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.729 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.729 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "upmap", 2024-09-11T00:26:32.729 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.729 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.729 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.729 INFO:teuthology.orchestra.run.smithi078.stdout: "crush-compat", 2024-09-11T00:26:32.729 INFO:teuthology.orchestra.run.smithi078.stdout: "none", 2024-09-11T00:26:32.729 INFO:teuthology.orchestra.run.smithi078.stdout: "read", 2024-09-11T00:26:32.729 INFO:teuthology.orchestra.run.smithi078.stdout: "upmap", 2024-09-11T00:26:32.729 INFO:teuthology.orchestra.run.smithi078.stdout: "upmap-read" 2024-09-11T00:26:32.729 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.730 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Balancer mode", 2024-09-11T00:26:32.730 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.730 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.730 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.730 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.730 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_ids": { 2024-09-11T00:26:32.730 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "pool_ids", 2024-09-11T00:26:32.730 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.730 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.730 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.730 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.730 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.730 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.731 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.731 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T00:26:32.731 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.731 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.731 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.731 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.731 INFO:teuthology.orchestra.run.smithi078.stdout: "sleep_interval": { 2024-09-11T00:26:32.731 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sleep_interval", 2024-09-11T00:26:32.731 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.731 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.731 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.732 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "60", 2024-09-11T00:26:32.732 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.732 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.732 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.732 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T00:26:32.732 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.732 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.732 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.732 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.732 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.733 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.733 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.733 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.733 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.733 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.733 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.733 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.733 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.733 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.733 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.733 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.733 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.733 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.733 INFO:teuthology.orchestra.run.smithi078.stdout: "upmap_max_deviation": { 2024-09-11T00:26:32.734 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "upmap_max_deviation", 2024-09-11T00:26:32.734 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.734 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.734 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.734 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "5", 2024-09-11T00:26:32.734 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "1", 2024-09-11T00:26:32.734 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.734 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.734 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T00:26:32.734 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T00:26:32.734 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.734 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.735 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.735 INFO:teuthology.orchestra.run.smithi078.stdout: "upmap_max_optimizations": { 2024-09-11T00:26:32.735 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "upmap_max_optimizations", 2024-09-11T00:26:32.735 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "uint", 2024-09-11T00:26:32.735 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.735 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.735 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:32.735 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.735 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.735 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.735 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T00:26:32.735 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.735 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.735 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.735 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.736 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.736 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.736 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.736 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cephadm", 2024-09-11T00:26:32.736 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.736 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.736 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.736 INFO:teuthology.orchestra.run.smithi078.stdout: "agent_down_multiplier": { 2024-09-11T00:26:32.736 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "agent_down_multiplier", 2024-09-11T00:26:32.736 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "float", 2024-09-11T00:26:32.736 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.736 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.736 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "3.0", 2024-09-11T00:26:32.736 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.737 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.737 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.737 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T00:26:32.737 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.737 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.737 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.737 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.737 INFO:teuthology.orchestra.run.smithi078.stdout: "agent_refresh_rate": { 2024-09-11T00:26:32.737 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "agent_refresh_rate", 2024-09-11T00:26:32.737 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.737 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.737 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.737 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "20", 2024-09-11T00:26:32.737 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.738 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.738 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.738 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T00:26:32.738 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.738 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.738 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.738 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.738 INFO:teuthology.orchestra.run.smithi078.stdout: "agent_starting_port": { 2024-09-11T00:26:32.738 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "agent_starting_port", 2024-09-11T00:26:32.738 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.738 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.738 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.738 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "4721", 2024-09-11T00:26:32.739 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.739 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.739 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.739 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T00:26:32.739 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.739 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.739 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.739 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.739 INFO:teuthology.orchestra.run.smithi078.stdout: "allow_ptrace": { 2024-09-11T00:26:32.739 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "allow_ptrace", 2024-09-11T00:26:32.740 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.740 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.740 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.740 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.740 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.740 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.740 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.740 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T00:26:32.740 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T00:26:32.740 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.740 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.740 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.740 INFO:teuthology.orchestra.run.smithi078.stdout: "autotune_interval": { 2024-09-11T00:26:32.741 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "autotune_interval", 2024-09-11T00:26:32.741 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.741 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.741 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.741 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "600", 2024-09-11T00:26:32.741 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.741 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.741 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.741 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T00:26:32.741 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.741 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.741 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.741 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.742 INFO:teuthology.orchestra.run.smithi078.stdout: "autotune_memory_target_ratio": { 2024-09-11T00:26:32.742 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T00:26:32.742 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "float", 2024-09-11T00:26:32.742 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.742 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.742 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0.7", 2024-09-11T00:26:32.742 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.742 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.742 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.742 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T00:26:32.742 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.743 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.743 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.743 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.743 INFO:teuthology.orchestra.run.smithi078.stdout: "cephadm_log_destination": { 2024-09-11T00:26:32.743 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cephadm_log_destination", 2024-09-11T00:26:32.743 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.743 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.743 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.743 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.743 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.743 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.743 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.743 INFO:teuthology.orchestra.run.smithi078.stdout: "file", 2024-09-11T00:26:32.743 INFO:teuthology.orchestra.run.smithi078.stdout: "file,syslog", 2024-09-11T00:26:32.744 INFO:teuthology.orchestra.run.smithi078.stdout: "syslog" 2024-09-11T00:26:32.744 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.744 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T00:26:32.744 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.744 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.744 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.744 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.744 INFO:teuthology.orchestra.run.smithi078.stdout: "cgroups_split": { 2024-09-11T00:26:32.744 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cgroups_split", 2024-09-11T00:26:32.744 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.744 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.744 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.745 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.745 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.745 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.745 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.745 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T00:26:32.745 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.745 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.745 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.745 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.745 INFO:teuthology.orchestra.run.smithi078.stdout: "config_checks_enabled": { 2024-09-11T00:26:32.745 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "config_checks_enabled", 2024-09-11T00:26:32.749 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.749 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.749 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.750 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.750 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.750 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.750 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.750 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T00:26:32.750 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.750 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.750 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.750 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.750 INFO:teuthology.orchestra.run.smithi078.stdout: "config_dashboard": { 2024-09-11T00:26:32.750 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "config_dashboard", 2024-09-11T00:26:32.750 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.750 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.751 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.751 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.751 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.751 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.751 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.751 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T00:26:32.751 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.751 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.751 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.751 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.751 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_alertmanager": { 2024-09-11T00:26:32.751 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_alertmanager", 2024-09-11T00:26:32.751 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.752 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.752 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.752 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-11T00:26:32.752 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.752 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.752 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.752 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Prometheus container image", 2024-09-11T00:26:32.752 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.752 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.752 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.752 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.752 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_base": { 2024-09-11T00:26:32.752 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_base", 2024-09-11T00:26:32.752 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.753 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.753 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.753 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T00:26:32.753 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.753 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.753 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.753 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Container image name, without the tag", 2024-09-11T00:26:32.753 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.753 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.753 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.753 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.753 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_elasticsearch": { 2024-09-11T00:26:32.753 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_elasticsearch", 2024-09-11T00:26:32.754 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.754 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.754 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.754 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T00:26:32.754 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.754 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.754 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.754 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "elasticsearch container image", 2024-09-11T00:26:32.754 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.754 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.754 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.754 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.754 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_grafana": { 2024-09-11T00:26:32.754 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_grafana", 2024-09-11T00:26:32.755 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.755 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.755 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.755 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-11T00:26:32.755 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.755 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.755 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.755 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Prometheus container image", 2024-09-11T00:26:32.755 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.755 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.755 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.755 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.755 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_haproxy": { 2024-09-11T00:26:32.755 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_haproxy", 2024-09-11T00:26:32.756 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.756 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.756 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.756 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T00:26:32.756 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.756 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.756 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.756 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "HAproxy container image", 2024-09-11T00:26:32.756 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.756 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.756 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.756 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.757 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_jaeger_agent": { 2024-09-11T00:26:32.757 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_jaeger_agent", 2024-09-11T00:26:32.757 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.757 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.757 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.758 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T00:26:32.758 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.758 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.758 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.758 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Jaeger agent container image", 2024-09-11T00:26:32.758 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.758 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.758 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.759 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.759 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_jaeger_collector": { 2024-09-11T00:26:32.759 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_jaeger_collector", 2024-09-11T00:26:32.759 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.759 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.759 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.759 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T00:26:32.759 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.759 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.759 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.759 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Jaeger collector container image", 2024-09-11T00:26:32.759 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.759 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.760 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.760 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.760 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_jaeger_query": { 2024-09-11T00:26:32.760 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_jaeger_query", 2024-09-11T00:26:32.760 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.760 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.760 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.760 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T00:26:32.760 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.760 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.760 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.760 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Jaeger query container image", 2024-09-11T00:26:32.760 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.761 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.761 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.761 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.761 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_keepalived": { 2024-09-11T00:26:32.761 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_keepalived", 2024-09-11T00:26:32.761 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.761 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.761 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.761 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T00:26:32.761 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.761 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.761 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.761 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Keepalived container image", 2024-09-11T00:26:32.762 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.762 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.762 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.762 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.762 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_loki": { 2024-09-11T00:26:32.762 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_loki", 2024-09-11T00:26:32.762 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.762 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.762 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.762 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T00:26:32.762 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.762 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.762 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.762 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Loki container image", 2024-09-11T00:26:32.763 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.763 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.763 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.763 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.763 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_nginx": { 2024-09-11T00:26:32.763 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_nginx", 2024-09-11T00:26:32.763 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.763 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.763 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.763 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-11T00:26:32.763 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.763 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.763 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.763 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Nginx container image", 2024-09-11T00:26:32.764 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.764 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.764 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.764 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.764 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_node_exporter": { 2024-09-11T00:26:32.764 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_node_exporter", 2024-09-11T00:26:32.764 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.764 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.764 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.764 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-11T00:26:32.764 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.764 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.764 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.764 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Prometheus container image", 2024-09-11T00:26:32.765 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.765 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.765 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.765 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.765 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_nvmeof": { 2024-09-11T00:26:32.765 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_nvmeof", 2024-09-11T00:26:32.765 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.765 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.765 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.765 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-11T00:26:32.765 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.765 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.765 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.766 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Nvme-of container image", 2024-09-11T00:26:32.766 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.766 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.766 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.766 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.766 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_oauth2_proxy": { 2024-09-11T00:26:32.766 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_oauth2_proxy", 2024-09-11T00:26:32.766 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.766 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.766 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.766 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-11T00:26:32.766 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.766 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.766 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.767 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "oauth2-proxy container image", 2024-09-11T00:26:32.767 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.767 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.767 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.767 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.767 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_prometheus": { 2024-09-11T00:26:32.767 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_prometheus", 2024-09-11T00:26:32.767 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.767 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.767 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.767 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-11T00:26:32.767 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.767 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.767 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.767 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Prometheus container image", 2024-09-11T00:26:32.768 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.768 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.768 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.768 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.768 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_promtail": { 2024-09-11T00:26:32.768 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_promtail", 2024-09-11T00:26:32.768 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.768 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.768 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.768 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T00:26:32.768 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.768 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.769 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.769 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Promtail container image", 2024-09-11T00:26:32.769 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.769 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.769 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.769 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.769 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_samba": { 2024-09-11T00:26:32.769 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_samba", 2024-09-11T00:26:32.769 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.769 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.769 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.769 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T00:26:32.769 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.769 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.770 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.770 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Samba/SMB container image", 2024-09-11T00:26:32.770 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.770 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.770 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.770 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.770 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_samba_metrics": { 2024-09-11T00:26:32.770 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_samba_metrics", 2024-09-11T00:26:32.770 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.770 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.770 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.770 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-11T00:26:32.770 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.770 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.771 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.771 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-11T00:26:32.771 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.771 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.771 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.771 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.771 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_snmp_gateway": { 2024-09-11T00:26:32.771 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_snmp_gateway", 2024-09-11T00:26:32.771 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.771 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.771 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.771 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T00:26:32.772 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.772 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.772 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.772 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "SNMP Gateway container image", 2024-09-11T00:26:32.772 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.772 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.772 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.772 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.772 INFO:teuthology.orchestra.run.smithi078.stdout: "container_init": { 2024-09-11T00:26:32.772 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_init", 2024-09-11T00:26:32.772 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.772 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.772 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.772 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.773 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.773 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.773 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.773 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T00:26:32.773 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.773 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.773 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.773 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.773 INFO:teuthology.orchestra.run.smithi078.stdout: "daemon_cache_timeout": { 2024-09-11T00:26:32.773 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "daemon_cache_timeout", 2024-09-11T00:26:32.773 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.773 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.773 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.773 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "600", 2024-09-11T00:26:32.774 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.774 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.774 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.774 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T00:26:32.774 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.774 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.774 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.774 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.774 INFO:teuthology.orchestra.run.smithi078.stdout: "default_cephadm_command_timeout": { 2024-09-11T00:26:32.774 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T00:26:32.774 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.774 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.774 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.774 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "900", 2024-09-11T00:26:32.775 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.775 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.775 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.775 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T00:26:32.775 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.775 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.775 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.775 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.775 INFO:teuthology.orchestra.run.smithi078.stdout: "default_registry": { 2024-09-11T00:26:32.775 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "default_registry", 2024-09-11T00:26:32.775 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.775 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.775 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.775 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "docker.io", 2024-09-11T00:26:32.776 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.776 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.776 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.776 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T00:26:32.776 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.776 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.776 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.776 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.776 INFO:teuthology.orchestra.run.smithi078.stdout: "device_cache_timeout": { 2024-09-11T00:26:32.776 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "device_cache_timeout", 2024-09-11T00:26:32.776 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.776 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.776 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.776 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "1800", 2024-09-11T00:26:32.777 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.777 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.777 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.777 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "seconds to cache device inventory", 2024-09-11T00:26:32.777 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.777 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.777 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.777 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.777 INFO:teuthology.orchestra.run.smithi078.stdout: "device_enhanced_scan": { 2024-09-11T00:26:32.777 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "device_enhanced_scan", 2024-09-11T00:26:32.777 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.777 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.777 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.778 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.778 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.778 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.778 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.778 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T00:26:32.778 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.778 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.778 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.778 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.778 INFO:teuthology.orchestra.run.smithi078.stdout: "facts_cache_timeout": { 2024-09-11T00:26:32.778 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "facts_cache_timeout", 2024-09-11T00:26:32.778 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.778 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.778 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.779 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "60", 2024-09-11T00:26:32.779 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.779 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.779 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.779 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "seconds to cache host facts data", 2024-09-11T00:26:32.779 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.779 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.779 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.779 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.779 INFO:teuthology.orchestra.run.smithi078.stdout: "grafana_dashboards_path": { 2024-09-11T00:26:32.780 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "grafana_dashboards_path", 2024-09-11T00:26:32.780 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.780 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.780 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.780 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T00:26:32.780 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.780 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.780 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.780 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T00:26:32.780 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.780 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.780 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.781 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.781 INFO:teuthology.orchestra.run.smithi078.stdout: "host_check_interval": { 2024-09-11T00:26:32.781 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "host_check_interval", 2024-09-11T00:26:32.781 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.781 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.781 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.781 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "600", 2024-09-11T00:26:32.781 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.781 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.781 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.781 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how frequently to perform a host check", 2024-09-11T00:26:32.781 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.781 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.781 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.782 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.782 INFO:teuthology.orchestra.run.smithi078.stdout: "hw_monitoring": { 2024-09-11T00:26:32.782 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "hw_monitoring", 2024-09-11T00:26:32.782 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.782 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.782 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.782 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.782 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.782 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.782 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.782 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T00:26:32.782 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.782 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.782 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.783 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.783 INFO:teuthology.orchestra.run.smithi078.stdout: "inventory_list_all": { 2024-09-11T00:26:32.783 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "inventory_list_all", 2024-09-11T00:26:32.783 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.783 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.783 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.783 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.783 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.783 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.783 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.783 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T00:26:32.783 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.783 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.783 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.784 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.784 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.784 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.784 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.784 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.784 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.784 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.784 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.784 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.784 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.784 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.784 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.785 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.785 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.785 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.785 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.785 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.785 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.785 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.785 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.785 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.785 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.785 INFO:teuthology.orchestra.run.smithi078.stdout: "log_refresh_metadata": { 2024-09-11T00:26:32.785 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_refresh_metadata", 2024-09-11T00:26:32.786 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.786 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.786 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.786 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.786 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.786 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.786 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.786 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T00:26:32.786 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.786 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.786 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.787 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.787 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.787 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.787 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.787 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.787 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.787 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.787 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.787 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.787 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.787 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T00:26:32.787 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.787 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.787 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.788 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.788 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.788 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.788 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.788 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.788 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.788 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.788 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.788 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.788 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.788 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.788 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.788 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.788 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.789 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.789 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.789 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.789 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.789 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.789 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.789 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.789 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.789 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.789 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.789 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.789 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.789 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.790 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.790 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.790 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.790 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.790 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.790 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.790 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.790 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.790 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.790 INFO:teuthology.orchestra.run.smithi078.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T00:26:32.790 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T00:26:32.791 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.791 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.791 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.791 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.791 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.791 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.791 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.791 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T00:26:32.791 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.791 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.791 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.791 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.791 INFO:teuthology.orchestra.run.smithi078.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T00:26:32.792 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T00:26:32.792 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.792 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.792 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.792 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "*", 2024-09-11T00:26:32.792 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.792 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.792 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.792 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T00:26:32.792 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.792 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.792 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.792 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.792 INFO:teuthology.orchestra.run.smithi078.stdout: "max_count_per_host": { 2024-09-11T00:26:32.793 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "max_count_per_host", 2024-09-11T00:26:32.793 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.793 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.793 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.793 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:32.793 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.793 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.793 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.793 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "max number of daemons per service per host", 2024-09-11T00:26:32.793 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.793 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.793 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.793 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.793 INFO:teuthology.orchestra.run.smithi078.stdout: "max_osd_draining_count": { 2024-09-11T00:26:32.794 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "max_osd_draining_count", 2024-09-11T00:26:32.794 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.794 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.794 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.794 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:32.794 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.794 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.794 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.794 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T00:26:32.794 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.794 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.794 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.794 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.794 INFO:teuthology.orchestra.run.smithi078.stdout: "migration_current": { 2024-09-11T00:26:32.795 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "migration_current", 2024-09-11T00:26:32.795 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.795 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.795 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.795 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.795 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.795 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.795 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.795 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "internal - do not modify", 2024-09-11T00:26:32.795 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.795 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.795 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.796 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.796 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": { 2024-09-11T00:26:32.796 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "mode", 2024-09-11T00:26:32.796 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.796 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.796 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.796 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "root", 2024-09-11T00:26:32.796 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.796 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.796 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.796 INFO:teuthology.orchestra.run.smithi078.stdout: "cephadm-package", 2024-09-11T00:26:32.797 INFO:teuthology.orchestra.run.smithi078.stdout: "root" 2024-09-11T00:26:32.797 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.797 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T00:26:32.797 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.797 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.797 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.797 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.797 INFO:teuthology.orchestra.run.smithi078.stdout: "oob_default_addr": { 2024-09-11T00:26:32.797 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "oob_default_addr", 2024-09-11T00:26:32.797 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.797 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.797 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.798 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "169.254.1.1", 2024-09-11T00:26:32.798 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.798 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.798 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.798 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T00:26:32.798 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.798 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.798 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.798 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.798 INFO:teuthology.orchestra.run.smithi078.stdout: "prometheus_alerts_path": { 2024-09-11T00:26:32.798 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "prometheus_alerts_path", 2024-09-11T00:26:32.798 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.798 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.798 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.799 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T00:26:32.799 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.799 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.799 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.799 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T00:26:32.799 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.799 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.799 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.799 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.799 INFO:teuthology.orchestra.run.smithi078.stdout: "registry_insecure": { 2024-09-11T00:26:32.799 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "registry_insecure", 2024-09-11T00:26:32.799 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.799 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.799 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.800 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.800 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.800 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.800 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.800 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T00:26:32.800 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.800 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.800 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.800 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.800 INFO:teuthology.orchestra.run.smithi078.stdout: "registry_password": { 2024-09-11T00:26:32.800 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "registry_password", 2024-09-11T00:26:32.800 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.800 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.801 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.801 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.801 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.801 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.801 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.801 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T00:26:32.801 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.801 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.801 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.801 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.801 INFO:teuthology.orchestra.run.smithi078.stdout: "registry_url": { 2024-09-11T00:26:32.801 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "registry_url", 2024-09-11T00:26:32.801 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.802 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.802 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.802 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.802 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.802 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.802 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.802 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T00:26:32.802 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.802 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.802 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.802 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.802 INFO:teuthology.orchestra.run.smithi078.stdout: "registry_username": { 2024-09-11T00:26:32.802 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "registry_username", 2024-09-11T00:26:32.802 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.803 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.803 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.803 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.803 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.803 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.803 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.803 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T00:26:32.803 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.803 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.803 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.803 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.803 INFO:teuthology.orchestra.run.smithi078.stdout: "secure_monitoring_stack": { 2024-09-11T00:26:32.803 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "secure_monitoring_stack", 2024-09-11T00:26:32.804 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.804 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.804 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.804 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.804 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.804 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.804 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.804 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T00:26:32.804 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.804 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.804 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.804 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.804 INFO:teuthology.orchestra.run.smithi078.stdout: "service_discovery_port": { 2024-09-11T00:26:32.805 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "service_discovery_port", 2024-09-11T00:26:32.805 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.805 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.805 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.805 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "8765", 2024-09-11T00:26:32.805 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.805 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.805 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.805 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "cephadm service discovery port", 2024-09-11T00:26:32.805 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.805 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.805 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.805 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.805 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.806 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.806 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.806 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.806 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.806 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.806 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.806 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.806 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.806 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.806 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.806 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.806 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.806 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.807 INFO:teuthology.orchestra.run.smithi078.stdout: "ssh_config_file": { 2024-09-11T00:26:32.807 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ssh_config_file", 2024-09-11T00:26:32.807 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.807 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.807 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.807 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.807 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.807 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.807 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.807 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T00:26:32.807 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.807 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.807 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.807 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.807 INFO:teuthology.orchestra.run.smithi078.stdout: "use_agent": { 2024-09-11T00:26:32.808 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "use_agent", 2024-09-11T00:26:32.808 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.808 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.808 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.808 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.808 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.808 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.808 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.808 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T00:26:32.808 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.808 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.808 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.808 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.808 INFO:teuthology.orchestra.run.smithi078.stdout: "use_repo_digest": { 2024-09-11T00:26:32.809 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "use_repo_digest", 2024-09-11T00:26:32.809 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.809 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.809 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.809 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.809 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.809 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.809 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.809 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T00:26:32.809 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.809 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.809 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.809 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.809 INFO:teuthology.orchestra.run.smithi078.stdout: "warn_on_failed_host_check": { 2024-09-11T00:26:32.810 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "warn_on_failed_host_check", 2024-09-11T00:26:32.810 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.810 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.810 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.810 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.810 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.810 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.810 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.810 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T00:26:32.810 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.810 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.810 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.810 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.811 INFO:teuthology.orchestra.run.smithi078.stdout: "warn_on_stray_daemons": { 2024-09-11T00:26:32.811 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "warn_on_stray_daemons", 2024-09-11T00:26:32.811 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.811 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.811 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.811 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.811 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.811 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.811 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.811 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T00:26:32.811 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.811 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.811 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.812 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.812 INFO:teuthology.orchestra.run.smithi078.stdout: "warn_on_stray_hosts": { 2024-09-11T00:26:32.812 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "warn_on_stray_hosts", 2024-09-11T00:26:32.812 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.812 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.812 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.812 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.812 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.812 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.812 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.812 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T00:26:32.812 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.812 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.813 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.813 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.813 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.813 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.813 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.813 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "crash", 2024-09-11T00:26:32.813 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.813 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.813 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.813 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.813 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.813 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.813 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.813 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.814 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.814 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.814 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.814 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.814 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.814 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.814 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.814 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.814 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.814 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.814 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.814 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.814 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.814 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.814 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.815 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.815 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.815 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.815 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.815 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.815 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.815 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.815 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.815 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.815 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.815 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.815 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.815 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.815 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.816 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.816 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.816 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.816 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.816 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.816 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.816 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.816 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.816 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.816 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.816 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.816 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.816 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.817 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.817 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.817 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.817 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.817 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.817 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.817 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.817 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.817 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.817 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.817 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.817 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.817 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.817 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.817 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.818 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.818 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.818 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.818 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.818 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.818 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.818 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.818 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.818 INFO:teuthology.orchestra.run.smithi078.stdout: "retain_interval": { 2024-09-11T00:26:32.818 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "retain_interval", 2024-09-11T00:26:32.818 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.818 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.818 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.818 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "31536000", 2024-09-11T00:26:32.819 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.819 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.819 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.819 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T00:26:32.819 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.819 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.819 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.819 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.819 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.819 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.819 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.819 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.819 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.820 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.820 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.820 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.820 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.820 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.820 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.820 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.820 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.820 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.820 INFO:teuthology.orchestra.run.smithi078.stdout: "warn_recent_interval": { 2024-09-11T00:26:32.820 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "warn_recent_interval", 2024-09-11T00:26:32.820 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.820 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.820 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.821 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "1209600", 2024-09-11T00:26:32.821 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.821 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.821 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.821 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T00:26:32.821 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.821 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.821 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.821 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.821 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.822 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.822 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.822 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "dashboard", 2024-09-11T00:26:32.822 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.822 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.822 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.822 INFO:teuthology.orchestra.run.smithi078.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T00:26:32.822 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T00:26:32.822 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.822 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.822 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.822 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:32.822 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.822 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.823 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.823 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.823 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.823 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.823 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.823 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.823 INFO:teuthology.orchestra.run.smithi078.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T00:26:32.823 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T00:26:32.823 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.823 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.823 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.823 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.823 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.823 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.824 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.824 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.824 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.824 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.824 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.824 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.824 INFO:teuthology.orchestra.run.smithi078.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T00:26:32.824 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T00:26:32.824 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.824 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.824 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.824 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.825 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.825 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.825 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.825 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.825 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.825 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.825 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.825 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.825 INFO:teuthology.orchestra.run.smithi078.stdout: "AUDIT_API_ENABLED": { 2024-09-11T00:26:32.825 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T00:26:32.825 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.825 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.825 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.825 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.826 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.826 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.826 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.826 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.826 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.826 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.826 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.826 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.826 INFO:teuthology.orchestra.run.smithi078.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T00:26:32.826 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T00:26:32.826 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.826 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.826 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.826 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.827 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.827 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.827 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.827 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.827 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.827 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.827 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.827 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.827 INFO:teuthology.orchestra.run.smithi078.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T00:26:32.827 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T00:26:32.827 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.827 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.827 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.827 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.828 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.828 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.828 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.828 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.828 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.828 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.828 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.828 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.828 INFO:teuthology.orchestra.run.smithi078.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T00:26:32.828 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T00:26:32.828 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.828 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.828 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.829 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.829 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.829 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.829 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.829 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.829 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.829 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.829 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.829 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.829 INFO:teuthology.orchestra.run.smithi078.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T00:26:32.829 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T00:26:32.829 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.829 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.830 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.830 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.830 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.830 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.830 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.830 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.830 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.830 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.830 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.830 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.830 INFO:teuthology.orchestra.run.smithi078.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T00:26:32.830 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T00:26:32.830 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.830 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.831 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.831 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.831 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.831 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.831 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.831 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.831 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.831 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.831 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.831 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.831 INFO:teuthology.orchestra.run.smithi078.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T00:26:32.831 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T00:26:32.831 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.831 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.832 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.832 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.832 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.832 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.832 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.832 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.832 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.832 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.832 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.832 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.832 INFO:teuthology.orchestra.run.smithi078.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T00:26:32.832 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T00:26:32.832 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.833 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.833 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.833 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.833 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.833 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.833 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.833 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.833 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.833 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.833 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.833 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.833 INFO:teuthology.orchestra.run.smithi078.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T00:26:32.833 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T00:26:32.833 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.834 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.834 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.834 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.834 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.834 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.834 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.834 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.834 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.834 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.834 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.834 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.834 INFO:teuthology.orchestra.run.smithi078.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T00:26:32.834 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T00:26:32.834 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.835 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.835 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.835 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.835 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.835 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.835 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.835 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.835 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.835 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.835 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.835 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.835 INFO:teuthology.orchestra.run.smithi078.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T00:26:32.835 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T00:26:32.835 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.836 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.836 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.836 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.836 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.836 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.836 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.836 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.836 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.836 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.836 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.836 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.836 INFO:teuthology.orchestra.run.smithi078.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T00:26:32.836 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T00:26:32.836 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.837 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.837 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.837 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "admin", 2024-09-11T00:26:32.837 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.837 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.837 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.837 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.837 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.837 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.837 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.837 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.837 INFO:teuthology.orchestra.run.smithi078.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T00:26:32.837 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T00:26:32.838 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.838 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.838 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.838 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.838 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.838 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.838 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.838 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.838 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.838 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.838 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.838 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.838 INFO:teuthology.orchestra.run.smithi078.stdout: "GRAFANA_API_URL": { 2024-09-11T00:26:32.839 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "GRAFANA_API_URL", 2024-09-11T00:26:32.839 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.839 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.839 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.839 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.839 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.839 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.839 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.839 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.839 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.839 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.839 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.839 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.839 INFO:teuthology.orchestra.run.smithi078.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T00:26:32.839 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T00:26:32.840 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.840 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.840 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.840 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "admin", 2024-09-11T00:26:32.840 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.840 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.840 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.840 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.840 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.840 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.840 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.840 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.840 INFO:teuthology.orchestra.run.smithi078.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T00:26:32.840 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T00:26:32.841 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.841 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.841 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.841 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.841 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.841 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.841 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.841 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.841 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.841 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.841 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.841 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.841 INFO:teuthology.orchestra.run.smithi078.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T00:26:32.841 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T00:26:32.842 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.842 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.842 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.842 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.842 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.842 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.842 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.842 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.842 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.842 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.842 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.842 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.842 INFO:teuthology.orchestra.run.smithi078.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T00:26:32.843 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T00:26:32.843 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.843 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.843 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.843 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.843 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.843 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.843 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.843 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.843 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.843 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.843 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.843 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.843 INFO:teuthology.orchestra.run.smithi078.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T00:26:32.844 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T00:26:32.844 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.844 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.844 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.844 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.844 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.844 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.844 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.844 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.844 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.844 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.844 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.844 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.844 INFO:teuthology.orchestra.run.smithi078.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-11T00:26:32.845 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-11T00:26:32.845 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.845 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.845 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.845 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "[]", 2024-09-11T00:26:32.845 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.845 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.845 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.845 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.845 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.845 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.845 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.845 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.845 INFO:teuthology.orchestra.run.smithi078.stdout: "MULTICLUSTER_CONFIG": { 2024-09-11T00:26:32.845 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-11T00:26:32.846 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.846 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.846 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.846 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "{}", 2024-09-11T00:26:32.846 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.846 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.846 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.846 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.846 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.846 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.846 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.846 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.846 INFO:teuthology.orchestra.run.smithi078.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T00:26:32.846 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T00:26:32.846 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.847 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.847 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.847 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.847 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.847 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.847 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.847 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.847 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.847 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.847 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.847 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.847 INFO:teuthology.orchestra.run.smithi078.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T00:26:32.847 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T00:26:32.848 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.848 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.848 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.848 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.848 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.848 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.848 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.848 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.848 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.848 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.848 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.848 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.848 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T00:26:32.848 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T00:26:32.848 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.849 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.849 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.849 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.849 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.849 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.849 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.849 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.849 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.849 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.849 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.849 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.849 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T00:26:32.849 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T00:26:32.849 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.850 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.850 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.850 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.850 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.850 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.850 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.850 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.850 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.850 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.850 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.850 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.850 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T00:26:32.850 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T00:26:32.850 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.851 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.851 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.851 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.851 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.851 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.851 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.851 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.851 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.851 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.851 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.851 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.851 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T00:26:32.851 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T00:26:32.852 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.852 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.852 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.852 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.852 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.852 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.852 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.852 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.852 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.852 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.852 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.852 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.852 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T00:26:32.852 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T00:26:32.852 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.853 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.853 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.853 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.853 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.853 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.853 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.853 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.853 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.853 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.853 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.853 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.853 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T00:26:32.853 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T00:26:32.853 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.854 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.854 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.854 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.854 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.854 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.854 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.854 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.854 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.854 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.854 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.854 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.854 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T00:26:32.854 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T00:26:32.855 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.855 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.855 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.855 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.855 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.855 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.855 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.855 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.855 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.855 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.855 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.855 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.855 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T00:26:32.855 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T00:26:32.856 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.856 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.856 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.856 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.856 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.856 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.856 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.856 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.856 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.856 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.856 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.856 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.856 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T00:26:32.857 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T00:26:32.857 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.857 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.857 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.857 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T00:26:32.857 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.857 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.857 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.857 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.857 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.857 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.857 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.857 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.858 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T00:26:32.858 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T00:26:32.858 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.858 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.858 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.858 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:32.858 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.858 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.858 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.858 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.858 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.858 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.858 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.858 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.859 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T00:26:32.859 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T00:26:32.859 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.859 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.859 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.859 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "8", 2024-09-11T00:26:32.859 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.859 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.859 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.859 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.859 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.859 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.859 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.860 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.860 INFO:teuthology.orchestra.run.smithi078.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T00:26:32.860 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T00:26:32.860 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.860 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.860 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.860 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "45", 2024-09-11T00:26:32.860 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.860 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.860 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.860 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.860 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.860 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.861 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.861 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.861 INFO:teuthology.orchestra.run.smithi078.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T00:26:32.861 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T00:26:32.861 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.861 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.861 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.861 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.861 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.861 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.861 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.861 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.861 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.861 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.862 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.862 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.862 INFO:teuthology.orchestra.run.smithi078.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T00:26:32.862 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T00:26:32.862 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.862 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.862 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.862 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "admin", 2024-09-11T00:26:32.862 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.862 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.862 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.862 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.862 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.863 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.863 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.863 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.863 INFO:teuthology.orchestra.run.smithi078.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T00:26:32.863 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T00:26:32.863 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.863 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.863 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.863 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.863 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.863 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.863 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.863 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.863 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.863 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.864 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.864 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.864 INFO:teuthology.orchestra.run.smithi078.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T00:26:32.864 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T00:26:32.864 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.864 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.864 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.864 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.864 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.864 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.864 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.864 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.864 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.864 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.865 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.865 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.865 INFO:teuthology.orchestra.run.smithi078.stdout: "UNSAFE_TLS_v1_2": { 2024-09-11T00:26:32.865 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-11T00:26:32.865 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.865 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.865 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.865 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.865 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.865 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.865 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.865 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.865 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.865 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.866 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.866 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.866 INFO:teuthology.orchestra.run.smithi078.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T00:26:32.866 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T00:26:32.866 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.866 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.866 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.866 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.866 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.866 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.866 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.866 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.866 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.867 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.867 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.867 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.867 INFO:teuthology.orchestra.run.smithi078.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T00:26:32.867 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T00:26:32.867 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.867 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.867 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.867 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:32.867 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.867 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.867 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.867 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.867 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.868 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.868 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.868 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.868 INFO:teuthology.orchestra.run.smithi078.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T00:26:32.868 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T00:26:32.868 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.868 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.868 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.868 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "5", 2024-09-11T00:26:32.868 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.868 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.868 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.868 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.868 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.869 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.869 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.869 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.869 INFO:teuthology.orchestra.run.smithi078.stdout: "cross_origin_url": { 2024-09-11T00:26:32.869 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cross_origin_url", 2024-09-11T00:26:32.869 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.869 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.869 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.869 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.869 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.869 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.869 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.869 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.870 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.870 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.870 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.870 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.870 INFO:teuthology.orchestra.run.smithi078.stdout: "crt_file": { 2024-09-11T00:26:32.870 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "crt_file", 2024-09-11T00:26:32.870 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.870 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.870 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.870 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.870 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.870 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.870 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.870 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.871 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.871 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.871 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.871 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.871 INFO:teuthology.orchestra.run.smithi078.stdout: "debug": { 2024-09-11T00:26:32.871 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "debug", 2024-09-11T00:26:32.871 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.871 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.871 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.871 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.871 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.871 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.871 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.871 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Enable/disable debug options", 2024-09-11T00:26:32.872 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.872 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.872 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.872 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.872 INFO:teuthology.orchestra.run.smithi078.stdout: "jwt_token_ttl": { 2024-09-11T00:26:32.872 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "jwt_token_ttl", 2024-09-11T00:26:32.872 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.872 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.872 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.872 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "28800", 2024-09-11T00:26:32.872 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.872 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.872 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.873 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.873 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.873 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.873 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.873 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.873 INFO:teuthology.orchestra.run.smithi078.stdout: "key_file": { 2024-09-11T00:26:32.873 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "key_file", 2024-09-11T00:26:32.873 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.873 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.873 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.873 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.873 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.873 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.873 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.873 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.874 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.874 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.874 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.874 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.874 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.874 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.874 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.874 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.874 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.874 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.874 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.874 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.874 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.874 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.874 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.874 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.875 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.875 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.875 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.875 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.875 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.875 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.875 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.875 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.875 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.875 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.875 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.875 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.875 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.875 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.875 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.876 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.876 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.876 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.876 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.876 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.876 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.876 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.876 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.876 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.876 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.876 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.876 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.876 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.876 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.877 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.877 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.877 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.877 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.877 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.877 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.877 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.877 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.877 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.877 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.877 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.877 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.877 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.877 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.878 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.878 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.878 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.878 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.878 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.878 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.878 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.878 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.878 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.878 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.878 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.878 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.878 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.878 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.879 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.879 INFO:teuthology.orchestra.run.smithi078.stdout: "motd": { 2024-09-11T00:26:32.879 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "motd", 2024-09-11T00:26:32.879 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.879 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.879 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.879 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.879 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.879 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.879 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.879 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "The message of the day", 2024-09-11T00:26:32.879 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.879 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.879 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.880 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.880 INFO:teuthology.orchestra.run.smithi078.stdout: "redirect_resolve_ip_addr": { 2024-09-11T00:26:32.880 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T00:26:32.880 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.880 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.880 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.880 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.880 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.880 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.881 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.881 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.881 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.881 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.881 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.881 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.881 INFO:teuthology.orchestra.run.smithi078.stdout: "server_addr": { 2024-09-11T00:26:32.881 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "server_addr", 2024-09-11T00:26:32.881 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.881 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.881 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.881 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "::", 2024-09-11T00:26:32.881 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.882 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.882 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.882 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.882 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.882 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.882 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.882 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.882 INFO:teuthology.orchestra.run.smithi078.stdout: "server_port": { 2024-09-11T00:26:32.882 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "server_port", 2024-09-11T00:26:32.882 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.882 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.882 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.882 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "8080", 2024-09-11T00:26:32.882 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.882 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.883 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.883 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.883 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.883 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.883 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.883 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.883 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.883 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.883 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.883 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.883 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.883 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.883 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.883 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.884 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.884 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.884 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.884 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.884 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.884 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.884 INFO:teuthology.orchestra.run.smithi078.stdout: "ssl": { 2024-09-11T00:26:32.884 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ssl", 2024-09-11T00:26:32.884 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.884 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.884 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.884 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.884 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.884 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.884 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.885 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.885 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.885 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.885 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.885 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.885 INFO:teuthology.orchestra.run.smithi078.stdout: "ssl_server_port": { 2024-09-11T00:26:32.885 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ssl_server_port", 2024-09-11T00:26:32.885 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.885 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.885 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.885 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "8443", 2024-09-11T00:26:32.885 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.885 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.886 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.886 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.886 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.886 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.886 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.886 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.886 INFO:teuthology.orchestra.run.smithi078.stdout: "standby_behaviour": { 2024-09-11T00:26:32.886 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "standby_behaviour", 2024-09-11T00:26:32.886 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.886 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.886 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.886 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "redirect", 2024-09-11T00:26:32.886 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.886 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.886 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.887 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.887 INFO:teuthology.orchestra.run.smithi078.stdout: "redirect" 2024-09-11T00:26:32.887 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.887 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.887 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.887 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.887 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.887 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.887 INFO:teuthology.orchestra.run.smithi078.stdout: "standby_error_status_code": { 2024-09-11T00:26:32.887 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "standby_error_status_code", 2024-09-11T00:26:32.887 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.887 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.887 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.887 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "500", 2024-09-11T00:26:32.887 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "400", 2024-09-11T00:26:32.888 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "599", 2024-09-11T00:26:32.888 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.888 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.888 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.888 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.888 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.888 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.888 INFO:teuthology.orchestra.run.smithi078.stdout: "url_prefix": { 2024-09-11T00:26:32.888 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "url_prefix", 2024-09-11T00:26:32.888 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.888 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.888 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.888 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.888 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.889 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.889 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.889 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.889 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.889 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.889 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.889 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.889 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.889 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.889 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.889 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "devicehealth", 2024-09-11T00:26:32.889 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.889 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.890 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.890 INFO:teuthology.orchestra.run.smithi078.stdout: "enable_monitoring": { 2024-09-11T00:26:32.890 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "enable_monitoring", 2024-09-11T00:26:32.890 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.890 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.890 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.890 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.890 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.890 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.890 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.890 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "monitor device health metrics", 2024-09-11T00:26:32.890 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.890 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.891 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.891 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.891 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.891 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.891 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.891 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.891 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.891 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.891 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.891 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.891 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.891 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.891 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.892 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.892 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.892 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.892 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.892 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.892 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.892 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.892 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.892 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.892 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.893 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.893 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.893 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.893 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.893 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.893 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.893 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.893 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.893 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.893 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.893 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.893 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.893 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.894 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.894 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.894 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.894 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.894 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.894 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.894 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.894 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.894 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.894 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.894 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.894 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.894 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.894 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.895 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.895 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.895 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.895 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.895 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.895 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.895 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.895 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.895 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.895 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.895 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.895 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.895 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.896 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.896 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.896 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.896 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.896 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.896 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.896 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.896 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.896 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.896 INFO:teuthology.orchestra.run.smithi078.stdout: "mark_out_threshold": { 2024-09-11T00:26:32.897 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "mark_out_threshold", 2024-09-11T00:26:32.897 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.897 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.897 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.897 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "2419200", 2024-09-11T00:26:32.897 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.897 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.897 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.897 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T00:26:32.897 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.897 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.897 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.897 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.898 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": { 2024-09-11T00:26:32.898 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "pool_name", 2024-09-11T00:26:32.898 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.898 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.898 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.898 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "device_health_metrics", 2024-09-11T00:26:32.898 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.898 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.898 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.898 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T00:26:32.898 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.898 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.898 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.898 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.898 INFO:teuthology.orchestra.run.smithi078.stdout: "retention_period": { 2024-09-11T00:26:32.899 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "retention_period", 2024-09-11T00:26:32.899 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.899 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.899 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.899 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "15552000", 2024-09-11T00:26:32.899 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.899 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.899 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.899 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how long to retain device health metrics", 2024-09-11T00:26:32.899 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.899 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.899 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.899 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.899 INFO:teuthology.orchestra.run.smithi078.stdout: "scrape_frequency": { 2024-09-11T00:26:32.900 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "scrape_frequency", 2024-09-11T00:26:32.900 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.900 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.900 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.900 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "86400", 2024-09-11T00:26:32.900 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.900 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.900 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.900 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T00:26:32.900 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.900 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.900 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.900 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.900 INFO:teuthology.orchestra.run.smithi078.stdout: "self_heal": { 2024-09-11T00:26:32.901 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "self_heal", 2024-09-11T00:26:32.901 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.901 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.901 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.901 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:32.901 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.901 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.901 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.901 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T00:26:32.901 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.901 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.901 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.901 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.901 INFO:teuthology.orchestra.run.smithi078.stdout: "sleep_interval": { 2024-09-11T00:26:32.902 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sleep_interval", 2024-09-11T00:26:32.902 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.902 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.902 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.902 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "600", 2024-09-11T00:26:32.902 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.902 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.902 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.902 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T00:26:32.902 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.902 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.902 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.902 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.902 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.903 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.903 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.903 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.903 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.903 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.903 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.903 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.903 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.903 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.903 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.903 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.903 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.903 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.903 INFO:teuthology.orchestra.run.smithi078.stdout: "warn_threshold": { 2024-09-11T00:26:32.904 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "warn_threshold", 2024-09-11T00:26:32.904 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.904 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.904 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.904 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "7257600", 2024-09-11T00:26:32.904 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.904 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.904 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.904 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T00:26:32.904 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.904 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.904 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.904 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.904 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.905 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.905 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.905 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "diskprediction_local", 2024-09-11T00:26:32.905 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.905 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.905 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.905 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.905 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.905 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.905 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.905 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.905 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.905 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.906 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.906 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.906 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.906 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.906 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.906 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.906 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.906 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.906 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.906 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.906 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.906 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.906 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.907 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.907 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.907 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.907 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.907 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.907 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.907 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.907 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.907 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.907 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.907 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.907 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.907 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.907 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.908 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.908 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.908 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.908 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.908 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.908 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.908 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.908 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.908 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.908 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.908 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.908 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.908 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.908 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.909 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.909 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.909 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.909 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.909 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.909 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.909 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.909 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.909 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.909 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.909 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.909 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.909 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.909 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.910 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.910 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.910 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.910 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.910 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.910 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.910 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.910 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.910 INFO:teuthology.orchestra.run.smithi078.stdout: "predict_interval": { 2024-09-11T00:26:32.910 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "predict_interval", 2024-09-11T00:26:32.910 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.910 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.910 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.911 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "86400", 2024-09-11T00:26:32.911 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.911 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.911 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.911 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.911 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.911 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.911 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.911 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.911 INFO:teuthology.orchestra.run.smithi078.stdout: "predictor_model": { 2024-09-11T00:26:32.911 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "predictor_model", 2024-09-11T00:26:32.911 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.911 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.911 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.912 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "prophetstor", 2024-09-11T00:26:32.912 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.912 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.912 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.912 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.912 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.912 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.912 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.912 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.912 INFO:teuthology.orchestra.run.smithi078.stdout: "sleep_interval": { 2024-09-11T00:26:32.912 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sleep_interval", 2024-09-11T00:26:32.912 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.912 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.912 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.912 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "600", 2024-09-11T00:26:32.913 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.913 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.913 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.913 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.913 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.913 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.913 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.913 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.913 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.913 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.913 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.913 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.913 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.913 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.913 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.914 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.914 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.914 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.914 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.914 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.914 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.914 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.914 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.914 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.914 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.914 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "influx", 2024-09-11T00:26:32.914 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": false, 2024-09-11T00:26:32.914 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "influxdb python module not found", 2024-09-11T00:26:32.914 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.915 INFO:teuthology.orchestra.run.smithi078.stdout: "batch_size": { 2024-09-11T00:26:32.915 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "batch_size", 2024-09-11T00:26:32.915 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.915 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.915 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.915 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "5000", 2024-09-11T00:26:32.915 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.915 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.915 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.915 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T00:26:32.915 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.915 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.915 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.915 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.915 INFO:teuthology.orchestra.run.smithi078.stdout: "database": { 2024-09-11T00:26:32.916 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "database", 2024-09-11T00:26:32.916 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.916 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.916 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.916 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "ceph", 2024-09-11T00:26:32.916 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.916 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.916 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.916 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T00:26:32.916 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.916 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.916 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.916 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.916 INFO:teuthology.orchestra.run.smithi078.stdout: "hostname": { 2024-09-11T00:26:32.916 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "hostname", 2024-09-11T00:26:32.917 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.917 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.917 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.917 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.917 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.917 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.917 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.917 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "InfluxDB server hostname", 2024-09-11T00:26:32.917 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.917 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.917 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.917 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.917 INFO:teuthology.orchestra.run.smithi078.stdout: "interval": { 2024-09-11T00:26:32.917 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "interval", 2024-09-11T00:26:32.917 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:32.918 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.918 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.918 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "30", 2024-09-11T00:26:32.918 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "5", 2024-09-11T00:26:32.918 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.918 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.918 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T00:26:32.918 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.918 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.918 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.918 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.918 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.918 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.918 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.918 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.918 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.919 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.919 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.919 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.919 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.919 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.919 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.919 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.919 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.919 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.919 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.919 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.919 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.919 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.919 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.920 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.920 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.920 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.920 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.920 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.920 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.920 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.920 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.920 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.920 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.920 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.920 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.920 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.920 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.921 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.921 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.921 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.921 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.921 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.921 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.921 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.921 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.921 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.921 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.922 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.922 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.922 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.922 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.922 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.922 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.922 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.922 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.922 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.922 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.922 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.922 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.922 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.923 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.923 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.923 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.923 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.923 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.923 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.923 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.923 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.923 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.923 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.923 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.923 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.923 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.923 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.923 INFO:teuthology.orchestra.run.smithi078.stdout: "password": { 2024-09-11T00:26:32.924 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "password", 2024-09-11T00:26:32.924 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.924 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.924 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.924 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.924 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.924 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.924 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.924 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "password of InfluxDB server user", 2024-09-11T00:26:32.924 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.924 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.924 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.924 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.924 INFO:teuthology.orchestra.run.smithi078.stdout: "port": { 2024-09-11T00:26:32.925 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "port", 2024-09-11T00:26:32.925 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.925 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.925 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.925 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "8086", 2024-09-11T00:26:32.925 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.925 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.925 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.925 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "InfluxDB server port", 2024-09-11T00:26:32.925 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.925 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.925 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.925 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.926 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.926 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.926 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.926 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.926 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.926 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.926 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.926 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.926 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.926 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.926 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.926 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.926 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.926 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.926 INFO:teuthology.orchestra.run.smithi078.stdout: "ssl": { 2024-09-11T00:26:32.927 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ssl", 2024-09-11T00:26:32.927 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.927 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.927 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.927 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "false", 2024-09-11T00:26:32.927 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.927 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.927 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.927 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T00:26:32.927 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.927 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.927 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.927 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.927 INFO:teuthology.orchestra.run.smithi078.stdout: "threads": { 2024-09-11T00:26:32.927 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "threads", 2024-09-11T00:26:32.928 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.928 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.928 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.928 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "5", 2024-09-11T00:26:32.928 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "1", 2024-09-11T00:26:32.928 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "32", 2024-09-11T00:26:32.928 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.928 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T00:26:32.928 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.928 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.928 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.928 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.928 INFO:teuthology.orchestra.run.smithi078.stdout: "username": { 2024-09-11T00:26:32.928 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "username", 2024-09-11T00:26:32.928 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.929 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.929 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.929 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.929 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.929 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.929 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.929 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "username of InfluxDB server user", 2024-09-11T00:26:32.929 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.929 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.929 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.929 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.929 INFO:teuthology.orchestra.run.smithi078.stdout: "verify_ssl": { 2024-09-11T00:26:32.929 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "verify_ssl", 2024-09-11T00:26:32.929 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.930 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.930 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.930 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "true", 2024-09-11T00:26:32.930 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.930 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.930 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.930 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T00:26:32.930 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.930 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.930 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.930 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.930 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.930 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.930 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.930 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "insights", 2024-09-11T00:26:32.931 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.931 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.931 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.931 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.931 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.931 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.931 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.931 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.931 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.931 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.931 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.931 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.931 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.931 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.931 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.932 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.932 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.932 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.932 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.932 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.932 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.932 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.932 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.932 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.932 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.932 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.932 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.932 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.933 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.933 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.933 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.933 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.933 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.933 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.933 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.933 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.933 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.933 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.933 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.933 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.933 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.933 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.934 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.934 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.934 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.934 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.934 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.934 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.934 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.934 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.934 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.934 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.934 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.934 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.934 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.934 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.935 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.935 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.935 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.935 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.935 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.935 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.935 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.935 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.935 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.935 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.935 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.935 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.935 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.935 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.936 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.936 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.936 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.936 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.936 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.936 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.936 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.936 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.936 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.936 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.936 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.936 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.936 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.936 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.937 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.937 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.937 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.937 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.937 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.937 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.937 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "iostat", 2024-09-11T00:26:32.937 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.937 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.937 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.937 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.937 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.937 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.938 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.938 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.938 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.938 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.938 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.938 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.938 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.938 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.938 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.938 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.938 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.938 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.938 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.938 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.938 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.939 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.939 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.939 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.939 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.939 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.939 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.939 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.939 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.939 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.939 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.939 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.939 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.939 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.939 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.941 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.941 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.941 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.941 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.941 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.941 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.941 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.941 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.941 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.941 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.941 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.941 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.941 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.941 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.941 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.942 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.942 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.942 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.942 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.942 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.942 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.942 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.942 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.942 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.942 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.942 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.942 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.942 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.942 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.943 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.943 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.943 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.943 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.943 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.943 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.943 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.943 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.943 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.943 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.943 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.943 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "k8sevents", 2024-09-11T00:26:32.943 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.943 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.944 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.944 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_event_retention_days": { 2024-09-11T00:26:32.944 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ceph_event_retention_days", 2024-09-11T00:26:32.944 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.944 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.944 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.944 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "7", 2024-09-11T00:26:32.944 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.944 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.944 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.944 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T00:26:32.944 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.944 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.945 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.945 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.945 INFO:teuthology.orchestra.run.smithi078.stdout: "config_check_secs": { 2024-09-11T00:26:32.945 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "config_check_secs", 2024-09-11T00:26:32.945 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.945 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.945 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.945 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:32.945 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "10", 2024-09-11T00:26:32.945 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.945 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.945 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T00:26:32.945 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.945 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.946 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.946 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.946 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.946 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.946 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.946 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.946 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.946 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.946 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.946 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.946 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.946 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.946 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.946 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.947 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.947 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.947 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.947 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.947 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.947 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.947 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.947 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.947 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.947 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.947 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.947 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.947 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.947 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.948 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.948 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.948 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.948 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.948 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.948 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.948 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.948 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.948 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.948 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.948 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.948 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.948 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.948 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.948 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.949 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.949 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.949 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.949 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.949 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.949 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.949 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.949 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.953 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.953 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.953 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.953 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.953 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.953 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.953 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.953 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.953 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.953 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.953 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.954 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.954 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.954 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.954 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.954 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.954 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.954 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.954 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.954 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.954 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.954 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.954 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.954 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.954 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.954 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.955 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.955 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.955 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.955 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.955 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.955 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.955 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.955 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.955 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.955 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.955 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.955 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.955 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "localpool", 2024-09-11T00:26:32.955 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.956 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.956 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.956 INFO:teuthology.orchestra.run.smithi078.stdout: "failure_domain": { 2024-09-11T00:26:32.956 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "failure_domain", 2024-09-11T00:26:32.956 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.956 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.956 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.956 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "host", 2024-09-11T00:26:32.956 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.956 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.956 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.956 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "failure domain for any created local pool", 2024-09-11T00:26:32.956 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T00:26:32.956 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.956 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.957 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.957 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.957 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.957 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.957 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.957 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.957 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.957 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.957 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.957 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.957 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.957 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.957 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.957 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.958 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.958 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.958 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.958 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.958 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.958 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.958 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.958 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.958 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.958 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.958 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.958 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.958 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.958 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.959 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.959 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.959 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.959 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.959 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.959 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.959 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.959 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.959 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.959 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.959 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.959 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.959 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.959 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.959 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.959 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.960 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.960 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.960 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.960 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.960 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.960 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.960 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.960 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.960 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.960 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.960 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.960 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.960 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.960 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.960 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.961 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.961 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.961 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.961 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.961 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.961 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.961 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.961 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.961 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.961 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.961 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.961 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.961 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": { 2024-09-11T00:26:32.961 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "min_size", 2024-09-11T00:26:32.961 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.962 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.962 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.962 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.962 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.962 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.962 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.962 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "default min_size for any created local pool", 2024-09-11T00:26:32.962 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T00:26:32.962 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.962 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.962 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.962 INFO:teuthology.orchestra.run.smithi078.stdout: "num_rep": { 2024-09-11T00:26:32.962 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "num_rep", 2024-09-11T00:26:32.962 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.963 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.963 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.963 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "3", 2024-09-11T00:26:32.963 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.963 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.963 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.963 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "default replica count for any created local pool", 2024-09-11T00:26:32.963 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.963 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.963 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.963 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.963 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": { 2024-09-11T00:26:32.963 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "pg_num", 2024-09-11T00:26:32.963 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.964 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.964 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.964 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "128", 2024-09-11T00:26:32.964 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.964 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.964 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.964 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T00:26:32.964 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.964 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.964 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.964 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.964 INFO:teuthology.orchestra.run.smithi078.stdout: "prefix": { 2024-09-11T00:26:32.964 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "prefix", 2024-09-11T00:26:32.964 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.965 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.965 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.965 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.965 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.965 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.965 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.965 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "name prefix for any created local pool", 2024-09-11T00:26:32.965 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.965 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.965 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.965 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.965 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.965 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.965 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.965 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.966 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.966 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.966 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.966 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.966 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.966 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.966 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.966 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.966 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.966 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.966 INFO:teuthology.orchestra.run.smithi078.stdout: "subtree": { 2024-09-11T00:26:32.966 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "subtree", 2024-09-11T00:26:32.966 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.966 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.967 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.967 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "rack", 2024-09-11T00:26:32.967 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.967 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.967 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.967 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T00:26:32.967 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T00:26:32.967 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.967 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.967 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.967 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.967 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.967 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.967 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "mds_autoscaler", 2024-09-11T00:26:32.968 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.968 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.968 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.968 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.968 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.968 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.968 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.968 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.968 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.968 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.968 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.968 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.968 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.968 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.969 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.970 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.971 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.971 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.971 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.971 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.971 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.971 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.971 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.971 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.971 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.971 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.971 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.971 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.971 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.972 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.972 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.972 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.972 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.972 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.972 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.972 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.972 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.972 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.972 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.972 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.972 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.972 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.972 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.973 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.973 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.973 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.973 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.973 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.973 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.973 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.973 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.973 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.973 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.973 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.973 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.973 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.973 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.974 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.974 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.974 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.974 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.974 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.974 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.974 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.974 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "mirroring", 2024-09-11T00:26:32.974 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.974 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.974 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.974 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.974 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.974 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.975 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.975 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.975 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.975 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.975 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.975 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.975 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.975 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.975 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.975 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.975 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.975 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.975 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.975 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.975 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.976 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.976 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.976 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.976 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.976 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.976 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.976 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.976 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.976 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.976 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.976 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.976 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.976 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.977 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.977 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.977 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.977 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.977 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.977 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.977 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.977 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.977 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.977 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.977 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.977 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.977 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.978 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.978 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.978 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.978 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.978 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.978 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.978 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.978 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.978 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.978 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.978 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.978 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.978 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.978 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.979 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.979 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.979 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.979 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.979 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.979 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.979 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.979 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.979 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.979 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.979 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.979 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.979 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.979 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.980 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.980 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.980 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.980 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.980 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.980 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.980 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.980 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.980 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.981 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.981 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.981 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.981 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.981 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.981 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.981 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "nfs", 2024-09-11T00:26:32.981 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.981 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.981 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.981 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.981 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.981 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.981 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.982 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.982 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.982 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.982 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.982 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.982 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.982 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.982 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.982 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.982 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.982 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.982 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.982 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.982 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.983 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.983 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.983 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.983 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.983 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.983 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.983 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.983 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.983 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.983 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.983 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.983 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.983 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.983 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.984 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.984 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.984 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.984 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.984 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.984 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.984 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.984 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.984 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.984 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.984 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.984 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.984 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.985 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.985 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.985 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.985 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.985 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.985 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.985 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.985 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.985 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.985 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.985 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.985 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.985 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.985 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.986 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.986 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.986 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.986 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.986 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.986 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.986 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.986 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.986 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.986 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.986 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.986 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.986 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.986 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.986 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.987 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.987 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.987 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.987 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.987 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.987 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.987 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.987 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.987 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.987 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.987 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.987 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.987 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.987 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "orchestrator", 2024-09-11T00:26:32.988 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.988 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.988 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.988 INFO:teuthology.orchestra.run.smithi078.stdout: "fail_fs": { 2024-09-11T00:26:32.988 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "fail_fs", 2024-09-11T00:26:32.988 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.988 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.988 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:32.988 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.988 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.988 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.988 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.988 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T00:26:32.988 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.989 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.989 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.989 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.989 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.989 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.989 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.989 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.989 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.989 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.989 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.989 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.989 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.989 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.989 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.990 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.990 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.990 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.990 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.990 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.990 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.990 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.990 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.990 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.990 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.990 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.990 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.990 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.990 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.991 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.991 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.991 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.991 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.991 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.991 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.991 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.991 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.991 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.991 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.991 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:32.991 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:32.991 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.992 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.992 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.992 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:32.992 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.992 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.992 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.992 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.992 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.992 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.992 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.992 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.992 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.992 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.992 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.993 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.993 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.993 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.993 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.993 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:32.993 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:32.993 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.993 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.993 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.993 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.993 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.993 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.993 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.994 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.994 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.994 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.994 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.994 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.994 INFO:teuthology.orchestra.run.smithi078.stdout: "orchestrator": { 2024-09-11T00:26:32.994 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "orchestrator", 2024-09-11T00:26:32.994 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.994 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.994 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.994 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.994 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.994 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.994 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.995 INFO:teuthology.orchestra.run.smithi078.stdout: "cephadm", 2024-09-11T00:26:32.995 INFO:teuthology.orchestra.run.smithi078.stdout: "rook", 2024-09-11T00:26:32.995 INFO:teuthology.orchestra.run.smithi078.stdout: "test_orchestrator" 2024-09-11T00:26:32.995 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.995 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Orchestrator backend", 2024-09-11T00:26:32.995 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.995 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.995 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.995 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.995 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:32.995 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:32.995 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:32.995 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:32.995 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.996 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:32.996 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.996 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.996 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.996 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.996 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.996 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.996 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.996 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.997 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:32.997 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.997 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:32.997 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "osd_perf_query", 2024-09-11T00:26:32.997 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:32.997 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:32.997 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:32.997 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:32.997 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:32.997 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:32.997 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.997 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.997 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:32.997 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.998 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.998 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:32.998 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:32.998 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:32.998 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:32.998 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:32.998 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:32.998 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:32.998 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:32.998 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.998 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.998 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.998 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.998 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:32.999 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:32.999 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:32.999 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:32.999 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:32.999 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:32.999 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:32.999 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:32.999 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:32.999 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:32.999 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:32.999 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:32.999 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:32.999 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:32.999 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.000 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.000 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.000 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.000 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.000 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.000 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.000 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.000 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.000 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.000 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.000 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.000 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.000 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.001 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.001 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.001 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.001 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.001 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.001 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.001 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.001 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.001 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.001 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.001 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.001 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.001 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.002 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.002 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.002 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.002 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.002 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.002 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.002 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.002 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.002 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.002 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.002 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.002 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.002 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.002 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.003 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.003 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.003 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.003 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.003 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.003 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.003 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.003 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.003 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.003 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.003 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.003 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.003 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "osd_support", 2024-09-11T00:26:33.003 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.004 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.004 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.004 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.004 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.004 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.004 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.004 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.004 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.004 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.004 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.004 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.004 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.004 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.004 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.005 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.005 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.005 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.005 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.005 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.005 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.005 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.005 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.005 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.005 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.005 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.005 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.005 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.006 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.006 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.006 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.006 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.006 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.006 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.006 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.006 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.006 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.006 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.006 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.006 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.006 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.006 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.007 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.007 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.007 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.007 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.007 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.007 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.007 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.007 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.007 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.007 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.007 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.007 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.007 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.008 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.008 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.008 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.008 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.008 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.008 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.008 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.008 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.008 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.008 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.008 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.008 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.008 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.008 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.009 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.009 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.009 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.009 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.009 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.009 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.009 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.009 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.009 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.009 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.009 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.009 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.009 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.009 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.010 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.010 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.010 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.010 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.010 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.010 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.010 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.010 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "pg_autoscaler", 2024-09-11T00:26:33.010 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.010 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.010 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.010 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.010 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.011 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.011 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.011 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.011 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.011 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.011 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.011 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.011 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.011 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.011 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.011 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.011 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.011 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.011 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.012 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.012 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.012 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.012 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.012 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.012 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.012 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.012 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.012 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.012 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.012 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.012 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.012 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.013 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.013 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.013 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.013 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.013 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.013 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.013 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.013 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.013 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.013 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.013 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.013 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.013 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.013 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.014 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.014 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.014 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.014 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.014 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.014 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.014 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.014 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.014 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.014 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.014 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.014 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.014 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.014 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.014 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.015 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.015 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.015 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.015 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.015 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.015 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.015 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.015 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.015 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.015 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.015 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.015 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.015 INFO:teuthology.orchestra.run.smithi078.stdout: "sleep_interval": { 2024-09-11T00:26:33.015 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sleep_interval", 2024-09-11T00:26:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "60", 2024-09-11T00:26:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: "threshold": { 2024-09-11T00:26:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "threshold", 2024-09-11T00:26:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "float", 2024-09-11T00:26:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "3.0", 2024-09-11T00:26:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "1.0", 2024-09-11T00:26:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "scaling threshold", 2024-09-11T00:26:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T00:26:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "progress", 2024-09-11T00:26:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: "allow_pg_recovery_event": { 2024-09-11T00:26:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "allow_pg_recovery_event", 2024-09-11T00:26:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T00:26:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": { 2024-09-11T00:26:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "enabled", 2024-09-11T00:26:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: "max_completed_events": { 2024-09-11T00:26:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "max_completed_events", 2024-09-11T00:26:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "50", 2024-09-11T00:26:33.027 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.027 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.027 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.027 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "number of past completed events to remember", 2024-09-11T00:26:33.027 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.027 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.027 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.027 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.027 INFO:teuthology.orchestra.run.smithi078.stdout: "sleep_interval": { 2024-09-11T00:26:33.027 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sleep_interval", 2024-09-11T00:26:33.027 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.027 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.027 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.027 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "5", 2024-09-11T00:26:33.028 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.028 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.028 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.028 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how long the module is going to sleep", 2024-09-11T00:26:33.028 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.028 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.028 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.028 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.028 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.028 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.028 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.028 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.028 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.029 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.029 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.029 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.029 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.029 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.029 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.029 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.029 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.029 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.029 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.029 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.029 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.029 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "prometheus", 2024-09-11T00:26:33.029 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.029 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.030 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.030 INFO:teuthology.orchestra.run.smithi078.stdout: "cache": { 2024-09-11T00:26:33.030 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cache", 2024-09-11T00:26:33.030 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.030 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.030 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.030 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.030 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.030 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.030 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.030 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.030 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.030 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.030 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.031 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.031 INFO:teuthology.orchestra.run.smithi078.stdout: "exclude_perf_counters": { 2024-09-11T00:26:33.031 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "exclude_perf_counters", 2024-09-11T00:26:33.031 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.031 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.031 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.031 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.031 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.031 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.031 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.031 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T00:26:33.031 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T00:26:33.031 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.031 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.032 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.032 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.032 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.032 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.032 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.032 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.032 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.032 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.032 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.032 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.032 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.032 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.033 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.033 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.033 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.033 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.033 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.033 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.033 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.033 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.033 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.033 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.033 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.033 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.034 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.034 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.034 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.034 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.034 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.034 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.034 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.034 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.034 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.034 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.034 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.034 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.034 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.035 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.035 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.035 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.035 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.035 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.035 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.035 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.035 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.035 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.035 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.035 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.035 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.035 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.035 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.036 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.036 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.036 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.036 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.036 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.036 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.036 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.036 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.036 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.036 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.036 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.036 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.037 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.037 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.037 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.037 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.037 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.037 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.037 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.037 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.037 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_stats_pools": { 2024-09-11T00:26:33.037 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rbd_stats_pools", 2024-09-11T00:26:33.037 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.037 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.037 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.037 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.038 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.038 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.038 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.038 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.038 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.038 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.038 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.038 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.038 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T00:26:33.038 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T00:26:33.038 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.038 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.038 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.038 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "300", 2024-09-11T00:26:33.039 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.039 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.039 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.039 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.039 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.039 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.039 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.039 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.039 INFO:teuthology.orchestra.run.smithi078.stdout: "scrape_interval": { 2024-09-11T00:26:33.039 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "scrape_interval", 2024-09-11T00:26:33.039 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "float", 2024-09-11T00:26:33.039 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.039 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.039 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "15.0", 2024-09-11T00:26:33.040 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.040 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.040 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.040 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.040 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.040 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.040 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.040 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.040 INFO:teuthology.orchestra.run.smithi078.stdout: "server_addr": { 2024-09-11T00:26:33.040 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "server_addr", 2024-09-11T00:26:33.040 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.040 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.040 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.040 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "::", 2024-09-11T00:26:33.041 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.041 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.041 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.041 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T00:26:33.041 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.041 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.041 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.041 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.041 INFO:teuthology.orchestra.run.smithi078.stdout: "server_port": { 2024-09-11T00:26:33.041 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "server_port", 2024-09-11T00:26:33.041 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.041 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.041 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.041 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "9283", 2024-09-11T00:26:33.042 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.042 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.042 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.042 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T00:26:33.042 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.042 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.042 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.042 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.042 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.042 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.042 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.042 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.042 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.042 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.043 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.043 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.043 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.043 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.043 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.043 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.043 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.043 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.043 INFO:teuthology.orchestra.run.smithi078.stdout: "stale_cache_strategy": { 2024-09-11T00:26:33.043 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "stale_cache_strategy", 2024-09-11T00:26:33.043 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.043 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.043 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.043 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "log", 2024-09-11T00:26:33.044 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.044 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.044 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.044 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.044 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.044 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.044 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.044 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.044 INFO:teuthology.orchestra.run.smithi078.stdout: "standby_behaviour": { 2024-09-11T00:26:33.044 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "standby_behaviour", 2024-09-11T00:26:33.044 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.044 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.044 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.044 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "default", 2024-09-11T00:26:33.045 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.045 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.045 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.045 INFO:teuthology.orchestra.run.smithi078.stdout: "default", 2024-09-11T00:26:33.045 INFO:teuthology.orchestra.run.smithi078.stdout: "error" 2024-09-11T00:26:33.045 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.045 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.045 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.045 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.045 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.045 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.045 INFO:teuthology.orchestra.run.smithi078.stdout: "standby_error_status_code": { 2024-09-11T00:26:33.045 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "standby_error_status_code", 2024-09-11T00:26:33.045 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.046 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.046 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.046 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "500", 2024-09-11T00:26:33.046 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "400", 2024-09-11T00:26:33.046 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "599", 2024-09-11T00:26:33.046 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.046 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.046 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.046 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.046 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.046 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.046 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.046 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.046 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.046 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rbd_support", 2024-09-11T00:26:33.047 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.047 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.047 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.047 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.047 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.047 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.047 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.047 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.047 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.047 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.047 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.047 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.047 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.048 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.048 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.048 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.048 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.048 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.048 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.048 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.048 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.048 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.048 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.048 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.048 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.048 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.049 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.049 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.049 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.049 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.049 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.049 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.049 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.049 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.049 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.049 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.049 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.049 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.049 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.050 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.050 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.050 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.050 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.050 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.050 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.050 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.050 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.050 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.050 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.050 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.050 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.050 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.050 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.050 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.051 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.051 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.051 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.051 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.051 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.051 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.051 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.051 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.051 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.051 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.051 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.051 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.051 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.051 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.051 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.052 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.052 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.052 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.052 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.052 INFO:teuthology.orchestra.run.smithi078.stdout: "max_concurrent_snap_create": { 2024-09-11T00:26:33.052 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "max_concurrent_snap_create", 2024-09-11T00:26:33.052 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.052 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.052 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.052 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:33.052 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.052 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.052 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.052 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.052 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.053 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.053 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.053 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.053 INFO:teuthology.orchestra.run.smithi078.stdout: "mirror_snapshot_schedule": { 2024-09-11T00:26:33.053 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T00:26:33.053 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.053 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.053 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.053 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.053 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.053 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.053 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.053 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.054 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.054 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.054 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.054 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.054 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.054 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.054 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.054 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.054 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.054 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.054 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.054 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.054 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.054 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.055 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.055 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.055 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.055 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.055 INFO:teuthology.orchestra.run.smithi078.stdout: "trash_purge_schedule": { 2024-09-11T00:26:33.055 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "trash_purge_schedule", 2024-09-11T00:26:33.055 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.055 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.055 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.055 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.055 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.055 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.055 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.056 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.056 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.056 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.056 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.056 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.056 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.056 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.056 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.056 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "restful", 2024-09-11T00:26:33.056 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.056 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.056 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.056 INFO:teuthology.orchestra.run.smithi078.stdout: "enable_auth": { 2024-09-11T00:26:33.056 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "enable_auth", 2024-09-11T00:26:33.057 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.057 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.057 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.057 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.057 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.057 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.057 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.057 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.057 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.057 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.057 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.057 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.057 INFO:teuthology.orchestra.run.smithi078.stdout: "key_file": { 2024-09-11T00:26:33.057 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "key_file", 2024-09-11T00:26:33.058 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.058 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.058 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.058 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.058 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.058 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.058 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.058 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.058 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.058 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.058 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.058 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.058 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.059 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.059 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.059 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.059 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.059 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.059 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.059 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.059 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.059 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.059 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.059 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.059 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.059 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.059 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.060 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.060 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.060 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.060 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.060 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.060 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.060 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.060 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.060 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.060 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.060 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.060 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.060 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.060 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.060 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.061 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.061 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.061 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.061 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.061 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.061 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.061 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.061 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.061 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.061 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.061 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.061 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.062 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.062 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.062 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.062 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.062 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.062 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.062 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.062 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.062 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.062 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.062 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.062 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.062 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.062 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.062 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.063 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.063 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.063 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.063 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.063 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.063 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.063 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.063 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.063 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.063 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.063 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.063 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.063 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.064 INFO:teuthology.orchestra.run.smithi078.stdout: "max_requests": { 2024-09-11T00:26:33.064 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "max_requests", 2024-09-11T00:26:33.064 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.064 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.064 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.064 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "500", 2024-09-11T00:26:33.064 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.064 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.064 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.064 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-11T00:26:33.064 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.064 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.064 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.064 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.065 INFO:teuthology.orchestra.run.smithi078.stdout: "server_addr": { 2024-09-11T00:26:33.065 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "server_addr", 2024-09-11T00:26:33.065 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.065 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.065 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.065 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.065 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.065 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.065 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.065 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.065 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.065 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.065 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.066 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.066 INFO:teuthology.orchestra.run.smithi078.stdout: "server_port": { 2024-09-11T00:26:33.066 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "server_port", 2024-09-11T00:26:33.066 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.066 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.066 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.066 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.066 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.066 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.066 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.066 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.066 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.066 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.066 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.067 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.067 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.067 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.067 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.067 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.067 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.067 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.067 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.067 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.067 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.067 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.067 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.067 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.067 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.068 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.068 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.068 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.068 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.068 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rgw", 2024-09-11T00:26:33.068 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.068 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.068 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.068 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.068 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.068 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.068 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.068 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.068 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.069 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.069 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.069 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.069 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.069 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.069 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.069 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.069 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.069 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.069 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.069 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.069 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.069 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.069 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.070 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.070 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.070 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.070 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.070 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.070 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.070 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.070 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.070 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.070 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.070 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.070 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.070 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.070 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.071 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.071 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.071 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.071 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.071 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.071 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.071 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.071 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.071 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.071 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.071 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.071 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.071 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.071 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.072 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.072 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.072 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.072 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.072 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.072 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.072 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.072 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.072 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.072 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.072 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.072 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.072 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.073 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.073 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.073 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.073 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.073 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.073 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.073 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.073 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.073 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.073 INFO:teuthology.orchestra.run.smithi078.stdout: "secondary_zone_period_retry_limit": { 2024-09-11T00:26:33.073 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-11T00:26:33.073 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.073 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.073 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.074 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "5", 2024-09-11T00:26:33.074 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.074 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.074 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.074 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-11T00:26:33.074 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.074 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.074 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.074 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.074 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.074 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.074 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.074 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.074 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rook", 2024-09-11T00:26:33.075 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.076 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.076 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.076 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.076 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.076 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.076 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.076 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.076 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.076 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.076 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.076 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.076 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.076 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.077 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.077 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.077 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.077 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.077 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.077 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.077 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.077 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.077 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.077 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.077 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.077 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.077 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.077 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.078 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.078 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.078 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.078 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.078 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.078 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.078 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.078 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.078 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.078 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.078 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.078 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.078 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.078 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.079 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.079 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.079 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.079 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.079 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.079 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.079 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.079 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.079 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.079 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.079 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.079 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.079 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.079 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.080 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.080 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.080 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.080 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.080 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.080 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.080 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.080 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.080 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.080 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.080 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.080 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.080 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.081 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.081 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.081 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.081 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.081 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.081 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.081 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.081 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.081 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.081 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.081 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.081 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.081 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.082 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.082 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.082 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.082 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.082 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.082 INFO:teuthology.orchestra.run.smithi078.stdout: "storage_class": { 2024-09-11T00:26:33.082 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "storage_class", 2024-09-11T00:26:33.082 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.082 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.082 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.082 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "local", 2024-09-11T00:26:33.082 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.082 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.082 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.083 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T00:26:33.083 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.083 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.083 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.083 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.083 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.083 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.083 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.083 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "selftest", 2024-09-11T00:26:33.083 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.083 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.083 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.083 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.083 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.084 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.084 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.084 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.084 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.084 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.084 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.084 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.084 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.084 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.084 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.084 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.084 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.084 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.085 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.085 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.085 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.085 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.085 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.085 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.085 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.085 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.085 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.085 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.085 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.085 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.085 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.085 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.086 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.086 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.086 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.086 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.086 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.086 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.086 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.086 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.086 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.086 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.086 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.086 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.086 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.086 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.087 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.087 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.087 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.087 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.087 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.087 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.087 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.087 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.087 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.087 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.087 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.087 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.087 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.087 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.088 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.088 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.088 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.088 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.088 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.088 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.088 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.088 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.088 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.088 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.088 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.088 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.088 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.089 INFO:teuthology.orchestra.run.smithi078.stdout: "roption1": { 2024-09-11T00:26:33.089 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "roption1", 2024-09-11T00:26:33.089 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.089 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.089 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.089 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.089 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.089 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.089 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.089 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.089 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.089 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.089 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.090 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.090 INFO:teuthology.orchestra.run.smithi078.stdout: "roption2": { 2024-09-11T00:26:33.090 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "roption2", 2024-09-11T00:26:33.090 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.090 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.090 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.090 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "xyz", 2024-09-11T00:26:33.090 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.090 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.090 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.090 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.090 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.090 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.090 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.091 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.091 INFO:teuthology.orchestra.run.smithi078.stdout: "rwoption1": { 2024-09-11T00:26:33.091 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rwoption1", 2024-09-11T00:26:33.091 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.091 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.091 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.091 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.091 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.091 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.091 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.091 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.091 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.091 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.091 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.092 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.092 INFO:teuthology.orchestra.run.smithi078.stdout: "rwoption2": { 2024-09-11T00:26:33.092 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rwoption2", 2024-09-11T00:26:33.092 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.092 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.092 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.092 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.092 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.092 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.092 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.092 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.092 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.092 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.092 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.093 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.093 INFO:teuthology.orchestra.run.smithi078.stdout: "rwoption3": { 2024-09-11T00:26:33.093 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rwoption3", 2024-09-11T00:26:33.093 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "float", 2024-09-11T00:26:33.093 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.093 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.093 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.093 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.093 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.093 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.093 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.093 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.094 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.094 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.094 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.094 INFO:teuthology.orchestra.run.smithi078.stdout: "rwoption4": { 2024-09-11T00:26:33.094 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rwoption4", 2024-09-11T00:26:33.094 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.094 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.094 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.094 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.094 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.094 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.094 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.094 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.094 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.095 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.095 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.095 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.095 INFO:teuthology.orchestra.run.smithi078.stdout: "rwoption5": { 2024-09-11T00:26:33.095 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rwoption5", 2024-09-11T00:26:33.095 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.095 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.095 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.095 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.095 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.095 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.095 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.095 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.095 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.096 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.096 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.096 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.096 INFO:teuthology.orchestra.run.smithi078.stdout: "rwoption6": { 2024-09-11T00:26:33.096 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rwoption6", 2024-09-11T00:26:33.096 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.096 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.096 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.096 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.096 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.096 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.096 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.096 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.097 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.097 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.097 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.097 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.097 INFO:teuthology.orchestra.run.smithi078.stdout: "rwoption7": { 2024-09-11T00:26:33.097 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rwoption7", 2024-09-11T00:26:33.097 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.097 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.097 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.097 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.097 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "1", 2024-09-11T00:26:33.097 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "42", 2024-09-11T00:26:33.097 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.097 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.098 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.098 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.098 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.098 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.098 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.098 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.098 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.098 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.098 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.098 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.098 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.098 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.098 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.098 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.099 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.099 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.099 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.099 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.099 INFO:teuthology.orchestra.run.smithi078.stdout: "testkey": { 2024-09-11T00:26:33.099 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "testkey", 2024-09-11T00:26:33.099 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.099 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.099 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.099 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.099 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.099 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.099 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.100 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.100 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.100 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.100 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.100 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.100 INFO:teuthology.orchestra.run.smithi078.stdout: "testlkey": { 2024-09-11T00:26:33.100 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "testlkey", 2024-09-11T00:26:33.100 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.100 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.100 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.100 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.100 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.100 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.101 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.101 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.101 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.101 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.101 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.101 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.101 INFO:teuthology.orchestra.run.smithi078.stdout: "testnewline": { 2024-09-11T00:26:33.101 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "testnewline", 2024-09-11T00:26:33.101 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.101 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.101 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.101 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.101 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.101 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.101 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.102 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.102 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.102 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.102 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.102 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.102 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.102 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.102 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.102 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smb", 2024-09-11T00:26:33.102 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.102 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.102 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.102 INFO:teuthology.orchestra.run.smithi078.stdout: "internal_store_backend": { 2024-09-11T00:26:33.102 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "internal_store_backend", 2024-09-11T00:26:33.102 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.103 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.103 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.103 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.103 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.103 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.103 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.103 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-11T00:26:33.103 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.103 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.103 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.103 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.103 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.103 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.104 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.104 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.104 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.104 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.104 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.104 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.104 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.104 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.104 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.104 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.104 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.104 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.104 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.108 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.108 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.108 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.108 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.108 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.108 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.108 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.108 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.108 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.108 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.108 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.108 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.108 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.109 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.109 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.109 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.109 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.109 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.109 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.109 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.109 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.109 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.109 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.109 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.109 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.109 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.110 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.110 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.110 INFO:teuthology.orchestra.run.smithi078.stdout: "update_orchestration": { 2024-09-11T00:26:33.110 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "update_orchestration", 2024-09-11T00:26:33.110 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.110 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.110 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.110 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.110 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.110 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.110 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.110 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-11T00:26:33.110 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.110 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.111 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.111 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.111 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.111 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.111 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.111 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "snap_schedule", 2024-09-11T00:26:33.111 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.111 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.111 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.111 INFO:teuthology.orchestra.run.smithi078.stdout: "allow_m_granularity": { 2024-09-11T00:26:33.111 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "allow_m_granularity", 2024-09-11T00:26:33.111 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.111 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.111 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.112 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.112 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.112 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.112 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.112 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T00:26:33.112 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.112 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.112 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.112 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.112 INFO:teuthology.orchestra.run.smithi078.stdout: "dump_on_update": { 2024-09-11T00:26:33.112 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "dump_on_update", 2024-09-11T00:26:33.112 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.112 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.113 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.113 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.113 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.113 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.113 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.113 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "dump database to debug log on update", 2024-09-11T00:26:33.113 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.113 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.113 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.113 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.113 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.113 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.113 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.113 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.114 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.114 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.114 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.114 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.114 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.114 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.114 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.114 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.114 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.114 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.114 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.114 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.114 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.114 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.115 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.115 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.115 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.115 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.115 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.115 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.115 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.115 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.115 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.115 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.115 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.115 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.115 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.115 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.116 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.116 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.116 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.116 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.116 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.116 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.116 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.116 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.116 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.116 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.116 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.116 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.116 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.116 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.117 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.117 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.117 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.117 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.117 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.117 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.117 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.117 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.117 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.117 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.117 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.117 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.117 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.117 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.118 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.118 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.118 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.118 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.118 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.118 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.118 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.118 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.118 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.118 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.118 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.118 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.118 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.118 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.118 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.119 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.119 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.119 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.119 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.119 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.119 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.119 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.119 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.119 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.119 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.119 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.119 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.119 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "stats", 2024-09-11T00:26:33.119 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.120 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.120 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.120 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.120 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.120 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.120 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.120 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.120 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.120 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.120 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.120 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.120 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.120 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.120 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.121 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.121 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.121 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.121 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.121 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.121 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.121 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.121 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.121 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.121 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.121 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.121 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.121 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.121 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.122 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.122 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.122 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.122 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.122 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.122 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.122 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.122 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.122 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.122 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.122 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.122 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.122 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.122 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.123 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.123 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.123 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.123 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.123 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.123 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.123 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.123 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.123 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.123 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.123 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.123 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.123 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.123 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.123 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.124 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.124 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.124 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.124 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.124 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.124 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.124 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.124 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.124 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.124 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.124 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.124 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.124 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.125 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.125 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.125 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.125 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.125 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.125 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.125 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.125 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.125 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.125 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.125 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.125 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.125 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.125 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.126 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.126 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.126 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.126 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.126 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.126 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "status", 2024-09-11T00:26:33.126 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.126 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.126 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.126 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.126 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.126 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.126 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.126 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.127 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.127 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.127 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.127 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.127 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.127 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.127 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.127 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.127 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.127 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.127 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.127 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.127 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.128 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.128 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.128 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.128 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.128 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.128 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.128 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.128 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.128 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.128 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.128 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.128 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.128 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.129 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.129 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.129 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.129 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.129 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.129 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.129 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.129 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.129 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.129 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.129 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.129 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.129 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.129 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.130 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.130 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.130 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.130 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.130 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.130 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.130 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.130 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.130 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.130 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.130 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.130 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.130 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.130 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.131 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.131 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.131 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.131 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.131 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.131 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.131 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.131 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.131 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.131 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.131 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.131 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.131 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.132 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.132 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.132 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.132 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.132 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.132 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.132 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.132 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.132 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.132 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.132 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.132 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.132 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.132 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.133 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.133 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "telegraf", 2024-09-11T00:26:33.133 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.133 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.133 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.133 INFO:teuthology.orchestra.run.smithi078.stdout: "address": { 2024-09-11T00:26:33.133 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "address", 2024-09-11T00:26:33.133 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.133 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.133 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.133 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T00:26:33.133 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.133 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.134 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.134 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.134 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.134 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.134 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.134 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.134 INFO:teuthology.orchestra.run.smithi078.stdout: "interval": { 2024-09-11T00:26:33.134 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "interval", 2024-09-11T00:26:33.134 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.134 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.134 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.134 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "15", 2024-09-11T00:26:33.134 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.134 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.135 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.135 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.135 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.135 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.135 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.135 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.135 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.135 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.135 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.135 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.135 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.135 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.135 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.135 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.136 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.136 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.136 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.136 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.136 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.136 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.136 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.136 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.136 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.136 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.136 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.136 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.136 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.137 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.137 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.137 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.137 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.137 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.137 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.137 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.137 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.137 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.137 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.137 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.137 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.137 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.137 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.138 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.138 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.138 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.138 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.138 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.138 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.138 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.138 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.138 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.138 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.138 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.138 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.138 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.138 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.138 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.139 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.139 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.139 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.139 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.139 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.139 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.139 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.139 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.139 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.139 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.139 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.139 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.139 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.139 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.139 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.140 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.140 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.140 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.140 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.140 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.140 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.140 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.140 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.140 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.140 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.140 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.140 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.140 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.140 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.141 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.141 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.141 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.141 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.141 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.141 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.141 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.141 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.141 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "telemetry", 2024-09-11T00:26:33.141 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.141 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.141 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.141 INFO:teuthology.orchestra.run.smithi078.stdout: "channel_basic": { 2024-09-11T00:26:33.141 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "channel_basic", 2024-09-11T00:26:33.142 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.142 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.142 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.142 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.142 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.142 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.142 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.142 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T00:26:33.142 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.142 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.142 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.142 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.142 INFO:teuthology.orchestra.run.smithi078.stdout: "channel_crash": { 2024-09-11T00:26:33.142 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "channel_crash", 2024-09-11T00:26:33.142 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.143 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.143 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.143 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.143 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.143 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.143 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.143 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T00:26:33.143 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.143 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.143 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.143 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.143 INFO:teuthology.orchestra.run.smithi078.stdout: "channel_device": { 2024-09-11T00:26:33.143 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "channel_device", 2024-09-11T00:26:33.143 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.144 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.144 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.144 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.144 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.144 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.144 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.144 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T00:26:33.144 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.144 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.144 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.144 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.144 INFO:teuthology.orchestra.run.smithi078.stdout: "channel_ident": { 2024-09-11T00:26:33.144 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "channel_ident", 2024-09-11T00:26:33.144 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.145 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.145 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.145 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.145 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.145 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.145 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.145 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T00:26:33.145 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.145 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.145 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.145 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.145 INFO:teuthology.orchestra.run.smithi078.stdout: "channel_perf": { 2024-09-11T00:26:33.146 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "channel_perf", 2024-09-11T00:26:33.146 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.146 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.146 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.146 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.146 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.146 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.146 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.146 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T00:26:33.146 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.146 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.146 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.146 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.146 INFO:teuthology.orchestra.run.smithi078.stdout: "contact": { 2024-09-11T00:26:33.147 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "contact", 2024-09-11T00:26:33.147 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.147 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.147 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.147 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.147 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.147 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.147 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.147 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.147 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.147 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.147 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.147 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.147 INFO:teuthology.orchestra.run.smithi078.stdout: "description": { 2024-09-11T00:26:33.148 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "description", 2024-09-11T00:26:33.148 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.148 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.148 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.148 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.148 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.148 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.148 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.148 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.148 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.148 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.148 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.148 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.148 INFO:teuthology.orchestra.run.smithi078.stdout: "device_url": { 2024-09-11T00:26:33.149 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "device_url", 2024-09-11T00:26:33.149 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.149 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.149 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.149 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T00:26:33.149 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.149 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.149 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.149 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.149 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.149 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.149 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.149 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.149 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": { 2024-09-11T00:26:33.150 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "enabled", 2024-09-11T00:26:33.150 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.150 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.150 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.150 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.150 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.150 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.150 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.150 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.150 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.150 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.150 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.150 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.150 INFO:teuthology.orchestra.run.smithi078.stdout: "interval": { 2024-09-11T00:26:33.151 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "interval", 2024-09-11T00:26:33.151 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.151 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.151 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.151 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "24", 2024-09-11T00:26:33.151 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "8", 2024-09-11T00:26:33.151 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.151 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.151 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.151 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.151 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.151 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.151 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.151 INFO:teuthology.orchestra.run.smithi078.stdout: "last_opt_revision": { 2024-09-11T00:26:33.152 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "last_opt_revision", 2024-09-11T00:26:33.152 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.152 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.152 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.152 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "1", 2024-09-11T00:26:33.152 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.152 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.152 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.152 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.152 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.152 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.152 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.152 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.152 INFO:teuthology.orchestra.run.smithi078.stdout: "leaderboard": { 2024-09-11T00:26:33.153 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "leaderboard", 2024-09-11T00:26:33.153 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.153 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.153 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.153 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.153 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.153 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.153 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.153 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.153 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.153 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.153 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.153 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.153 INFO:teuthology.orchestra.run.smithi078.stdout: "leaderboard_description": { 2024-09-11T00:26:33.154 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "leaderboard_description", 2024-09-11T00:26:33.154 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.154 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.154 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.154 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.154 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.154 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.154 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.154 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.154 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.154 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.154 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.154 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.154 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.154 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.155 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.155 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.155 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.155 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.155 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.155 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.155 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.155 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.155 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.155 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.155 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.155 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.155 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.155 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.156 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.156 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.156 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.156 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.156 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.156 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.156 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.156 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.156 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.156 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.156 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.156 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.156 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.156 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.157 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.157 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.157 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.157 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.157 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.157 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.157 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.157 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.157 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.157 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.157 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.157 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.157 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.158 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.158 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.158 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.158 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.158 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.158 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.158 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.158 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.158 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.158 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.158 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.158 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.158 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.158 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.159 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.159 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.159 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.159 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.159 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.159 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.159 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.159 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.159 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.159 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.159 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.159 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.159 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.159 INFO:teuthology.orchestra.run.smithi078.stdout: "organization": { 2024-09-11T00:26:33.160 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "organization", 2024-09-11T00:26:33.160 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.160 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.160 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.160 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.160 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.160 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.160 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.160 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.160 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.160 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.160 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.160 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.161 INFO:teuthology.orchestra.run.smithi078.stdout: "proxy": { 2024-09-11T00:26:33.161 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "proxy", 2024-09-11T00:26:33.161 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.161 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.161 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.161 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.161 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.161 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.161 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.161 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.161 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.161 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.161 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.161 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.161 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.162 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.162 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.162 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.162 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.162 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.162 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.162 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.162 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.162 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.162 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.162 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.162 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.162 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.162 INFO:teuthology.orchestra.run.smithi078.stdout: "url": { 2024-09-11T00:26:33.163 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "url", 2024-09-11T00:26:33.163 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.163 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.163 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.163 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T00:26:33.163 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.163 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.163 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.163 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.163 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.163 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.163 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.163 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.163 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.164 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.164 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.164 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "test_orchestrator", 2024-09-11T00:26:33.164 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.164 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.164 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.164 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.164 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.164 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.164 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.164 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.164 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.164 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.164 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.165 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.165 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.165 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.165 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.165 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.165 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.165 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.165 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.165 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.165 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.165 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.165 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.165 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.166 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.166 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.166 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.166 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.166 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.166 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.166 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.166 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.166 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.166 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.166 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.166 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.166 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.166 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.166 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.166 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.167 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.167 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.167 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.167 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.167 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.167 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.167 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.167 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.167 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.167 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.167 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.167 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.167 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.167 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.168 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.168 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.168 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.168 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.168 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.168 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.168 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.168 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.168 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.168 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.168 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.168 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.168 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.168 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.168 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.169 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.169 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.169 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.169 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.169 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.169 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.169 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.169 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.169 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.169 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.169 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.169 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.169 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.169 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.170 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.170 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.170 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.170 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.170 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.170 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.170 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.170 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "volumes", 2024-09-11T00:26:33.170 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.170 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.170 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.170 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.170 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.170 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.171 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.171 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.171 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.171 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.171 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.171 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.171 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.171 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.171 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.171 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.171 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.171 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.171 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.171 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.171 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.172 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.172 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.172 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.172 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.172 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.172 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.172 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.172 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.172 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.172 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.172 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.172 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.172 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.173 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.173 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.173 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.173 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.173 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.173 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.173 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.173 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.173 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.173 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.173 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.173 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.173 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.173 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.174 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.174 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.174 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.174 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.174 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.174 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.174 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.174 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.174 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.174 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.174 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.174 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.174 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.174 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.174 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.175 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.175 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.175 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.175 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.175 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.175 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.175 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.175 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.175 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.175 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.175 INFO:teuthology.orchestra.run.smithi078.stdout: "max_concurrent_clones": { 2024-09-11T00:26:33.175 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "max_concurrent_clones", 2024-09-11T00:26:33.175 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.175 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.176 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.176 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "4", 2024-09-11T00:26:33.176 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.176 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.176 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.176 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T00:26:33.176 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.176 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.176 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.176 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.176 INFO:teuthology.orchestra.run.smithi078.stdout: "periodic_async_work": { 2024-09-11T00:26:33.176 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "periodic_async_work", 2024-09-11T00:26:33.176 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.176 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.177 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.177 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.177 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.177 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.177 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.177 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Periodically check for async work", 2024-09-11T00:26:33.177 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.177 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.177 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.177 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.177 INFO:teuthology.orchestra.run.smithi078.stdout: "snapshot_clone_delay": { 2024-09-11T00:26:33.177 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "snapshot_clone_delay", 2024-09-11T00:26:33.177 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.177 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.178 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.178 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.178 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.178 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.178 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.178 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T00:26:33.178 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.178 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.178 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.178 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.178 INFO:teuthology.orchestra.run.smithi078.stdout: "snapshot_clone_no_wait": { 2024-09-11T00:26:33.178 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T00:26:33.178 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.178 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.179 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.179 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.179 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.179 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.179 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.179 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T00:26:33.179 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.179 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.179 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.179 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.179 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.179 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.179 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.179 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.180 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.180 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.180 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.180 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.180 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.180 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.180 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.180 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.180 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.180 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.180 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.180 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.180 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.180 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "zabbix", 2024-09-11T00:26:33.181 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.181 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.181 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.181 INFO:teuthology.orchestra.run.smithi078.stdout: "discovery_interval": { 2024-09-11T00:26:33.181 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "discovery_interval", 2024-09-11T00:26:33.181 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "uint", 2024-09-11T00:26:33.181 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.181 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.181 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "100", 2024-09-11T00:26:33.181 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.181 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.181 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.181 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.181 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.182 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.182 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.182 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.182 INFO:teuthology.orchestra.run.smithi078.stdout: "identifier": { 2024-09-11T00:26:33.182 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "identifier", 2024-09-11T00:26:33.182 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.182 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.182 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.182 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.182 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.182 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.182 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.182 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.182 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.183 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.183 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.183 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.183 INFO:teuthology.orchestra.run.smithi078.stdout: "interval": { 2024-09-11T00:26:33.183 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "interval", 2024-09-11T00:26:33.183 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.183 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.183 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.183 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "60", 2024-09-11T00:26:33.183 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.183 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.183 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.183 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.183 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.184 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.184 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.184 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.184 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.184 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.184 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.184 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.184 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.184 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.184 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.184 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.184 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.184 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.184 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.185 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.185 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.185 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.185 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.185 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.185 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.185 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.185 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.185 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.185 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.185 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.185 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.185 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.185 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.186 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.186 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.186 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.186 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.186 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.186 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.186 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.186 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.186 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.186 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.186 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.186 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.186 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.187 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.187 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.187 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.187 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.187 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.187 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.187 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.187 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.187 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.187 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.187 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.187 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.187 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.187 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.188 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.188 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.188 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.188 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.188 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.188 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.188 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.188 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.188 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.188 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.188 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.188 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.188 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.188 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.189 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.189 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.189 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.189 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.189 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.189 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.189 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.189 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.189 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.189 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.189 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.189 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.189 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.189 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.190 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.190 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.190 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.190 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.190 INFO:teuthology.orchestra.run.smithi078.stdout: "zabbix_host": { 2024-09-11T00:26:33.190 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "zabbix_host", 2024-09-11T00:26:33.190 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.190 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.190 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.190 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.190 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.190 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.190 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.190 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.191 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.191 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.191 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.191 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.191 INFO:teuthology.orchestra.run.smithi078.stdout: "zabbix_port": { 2024-09-11T00:26:33.191 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "zabbix_port", 2024-09-11T00:26:33.191 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.191 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.191 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.191 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10051", 2024-09-11T00:26:33.191 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.191 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.191 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.191 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.192 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.192 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.192 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.192 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.192 INFO:teuthology.orchestra.run.smithi078.stdout: "zabbix_sender": { 2024-09-11T00:26:33.192 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "zabbix_sender", 2024-09-11T00:26:33.192 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.192 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.192 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.192 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T00:26:33.192 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.192 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.192 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.192 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.193 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.193 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.193 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.193 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.193 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.193 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.193 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-09-11T00:26:33.193 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.193 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.193 INFO:teuthology.orchestra.run.smithi078.stdout: "modules": [ 2024-09-11T00:26:33.193 INFO:teuthology.orchestra.run.smithi078.stdout: "cephadm", 2024-09-11T00:26:33.193 INFO:teuthology.orchestra.run.smithi078.stdout: "dashboard", 2024-09-11T00:26:33.193 INFO:teuthology.orchestra.run.smithi078.stdout: "iostat", 2024-09-11T00:26:33.193 INFO:teuthology.orchestra.run.smithi078.stdout: "nfs", 2024-09-11T00:26:33.194 INFO:teuthology.orchestra.run.smithi078.stdout: "restful", 2024-09-11T00:26:33.194 INFO:teuthology.orchestra.run.smithi078.stdout: "snap_schedule" 2024-09-11T00:26:33.194 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.194 INFO:teuthology.orchestra.run.smithi078.stdout: "available_modules": [ 2024-09-11T00:26:33.194 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.194 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "alerts", 2024-09-11T00:26:33.194 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.194 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.194 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.194 INFO:teuthology.orchestra.run.smithi078.stdout: "interval": { 2024-09-11T00:26:33.194 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "interval", 2024-09-11T00:26:33.194 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.194 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.194 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.194 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "60", 2024-09-11T00:26:33.194 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.195 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.195 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.195 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T00:26:33.195 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.195 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.195 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.195 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.195 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.195 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.195 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.195 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.195 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.195 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.195 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.195 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.196 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.196 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.196 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.196 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.196 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.196 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.196 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.196 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.196 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.196 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.196 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.196 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.196 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.196 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.197 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.197 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.197 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.197 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.197 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.197 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.197 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.197 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.197 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.197 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.197 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.197 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.197 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.198 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.198 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.198 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.198 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.198 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.198 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.198 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.198 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.198 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.198 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.198 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.198 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.198 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.198 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.199 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.199 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.199 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.199 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.199 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.199 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.199 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.199 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.199 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.199 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.199 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.199 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.199 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.199 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.200 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.200 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.200 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.200 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.200 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.200 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.200 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.200 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_destination": { 2024-09-11T00:26:33.200 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_destination", 2024-09-11T00:26:33.200 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.200 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.200 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.200 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.200 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.201 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.201 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.201 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-11T00:26:33.201 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.201 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.201 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.201 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.201 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_from_name": { 2024-09-11T00:26:33.201 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_from_name", 2024-09-11T00:26:33.201 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.201 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.201 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.202 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "Ceph", 2024-09-11T00:26:33.202 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.202 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.202 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.202 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Email From: name", 2024-09-11T00:26:33.202 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.202 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.202 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.202 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.202 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_host": { 2024-09-11T00:26:33.202 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_host", 2024-09-11T00:26:33.202 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.202 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.203 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.203 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.203 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.203 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.203 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.203 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "SMTP server", 2024-09-11T00:26:33.203 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.203 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.203 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.203 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.203 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_password": { 2024-09-11T00:26:33.203 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_password", 2024-09-11T00:26:33.203 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.203 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.204 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.204 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.204 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.204 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.204 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.204 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Password to authenticate with", 2024-09-11T00:26:33.204 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.204 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.204 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.204 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.204 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_port": { 2024-09-11T00:26:33.204 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_port", 2024-09-11T00:26:33.204 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.204 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.205 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.205 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "465", 2024-09-11T00:26:33.205 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.205 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.205 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.205 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "SMTP port", 2024-09-11T00:26:33.205 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.205 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.205 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.205 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.205 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_sender": { 2024-09-11T00:26:33.205 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_sender", 2024-09-11T00:26:33.205 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.205 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.206 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.206 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.206 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.206 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.206 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.206 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "SMTP envelope sender", 2024-09-11T00:26:33.206 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.206 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.206 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.206 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.206 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_ssl": { 2024-09-11T00:26:33.206 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_ssl", 2024-09-11T00:26:33.206 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.206 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.206 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.207 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.207 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.207 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.207 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.207 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T00:26:33.207 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.207 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.207 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.207 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.207 INFO:teuthology.orchestra.run.smithi078.stdout: "smtp_user": { 2024-09-11T00:26:33.207 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smtp_user", 2024-09-11T00:26:33.207 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.207 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.207 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.208 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.208 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.208 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.208 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.208 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "User to authenticate as", 2024-09-11T00:26:33.208 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.208 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.208 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.208 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.208 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.208 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.208 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.208 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.208 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.208 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.209 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.209 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.209 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.209 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.209 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.209 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.209 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.209 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.209 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.209 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.209 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.209 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "balancer", 2024-09-11T00:26:33.209 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.209 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.210 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.210 INFO:teuthology.orchestra.run.smithi078.stdout: "active": { 2024-09-11T00:26:33.210 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "active", 2024-09-11T00:26:33.210 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.210 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.210 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.210 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.210 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.210 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.210 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.210 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T00:26:33.210 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.210 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.211 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.211 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.211 INFO:teuthology.orchestra.run.smithi078.stdout: "begin_time": { 2024-09-11T00:26:33.211 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "begin_time", 2024-09-11T00:26:33.211 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.211 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.211 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.211 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0000", 2024-09-11T00:26:33.211 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.211 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.211 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.211 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T00:26:33.211 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T00:26:33.211 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.211 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.211 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.212 INFO:teuthology.orchestra.run.smithi078.stdout: "begin_weekday": { 2024-09-11T00:26:33.212 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "begin_weekday", 2024-09-11T00:26:33.212 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "uint", 2024-09-11T00:26:33.212 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.212 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.212 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.212 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "0", 2024-09-11T00:26:33.212 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "6", 2024-09-11T00:26:33.212 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.212 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T00:26:33.212 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T00:26:33.212 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.212 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.212 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.212 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_compat_max_iterations": { 2024-09-11T00:26:33.213 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "crush_compat_max_iterations", 2024-09-11T00:26:33.213 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "uint", 2024-09-11T00:26:33.213 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.213 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.213 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "25", 2024-09-11T00:26:33.213 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "1", 2024-09-11T00:26:33.213 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "250", 2024-09-11T00:26:33.213 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.213 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T00:26:33.213 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.213 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.213 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.213 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.213 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_compat_metrics": { 2024-09-11T00:26:33.214 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "crush_compat_metrics", 2024-09-11T00:26:33.214 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.214 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.214 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.214 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T00:26:33.214 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.214 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.214 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.214 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T00:26:33.214 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T00:26:33.214 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.214 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.214 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.214 INFO:teuthology.orchestra.run.smithi078.stdout: "crush_compat_step": { 2024-09-11T00:26:33.215 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "crush_compat_step", 2024-09-11T00:26:33.215 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "float", 2024-09-11T00:26:33.215 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.215 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.215 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0.5", 2024-09-11T00:26:33.215 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "0.001", 2024-09-11T00:26:33.215 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "0.999", 2024-09-11T00:26:33.215 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.215 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "aggressiveness of optimization", 2024-09-11T00:26:33.215 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T00:26:33.215 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.215 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.215 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.215 INFO:teuthology.orchestra.run.smithi078.stdout: "end_time": { 2024-09-11T00:26:33.216 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "end_time", 2024-09-11T00:26:33.216 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.216 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.216 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.216 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "2359", 2024-09-11T00:26:33.216 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.216 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.216 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.216 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T00:26:33.216 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T00:26:33.216 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.216 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.216 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.217 INFO:teuthology.orchestra.run.smithi078.stdout: "end_weekday": { 2024-09-11T00:26:33.217 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "end_weekday", 2024-09-11T00:26:33.217 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "uint", 2024-09-11T00:26:33.217 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.217 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.217 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.217 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "0", 2024-09-11T00:26:33.217 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "6", 2024-09-11T00:26:33.217 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.217 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T00:26:33.217 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T00:26:33.217 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.217 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.217 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.218 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.218 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.218 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.218 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.218 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.218 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.218 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.218 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.218 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.218 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.218 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.218 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.218 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.218 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.219 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.219 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.219 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.219 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.219 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.219 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.219 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.219 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.219 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.219 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.219 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.219 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.219 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.219 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.220 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.220 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.220 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.220 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.220 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.220 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.220 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.220 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.220 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.220 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.220 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.220 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.220 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.221 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.221 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.221 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.221 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.221 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.221 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.221 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.221 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.221 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.221 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.221 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.221 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.221 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.221 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.222 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.222 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.222 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.222 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.222 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.222 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.222 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.222 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.222 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.222 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.222 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.222 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.222 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.222 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.222 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.223 INFO:teuthology.orchestra.run.smithi078.stdout: "min_score": { 2024-09-11T00:26:33.223 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "min_score", 2024-09-11T00:26:33.223 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "float", 2024-09-11T00:26:33.223 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.223 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.223 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.223 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.223 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.223 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.223 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T00:26:33.223 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.223 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.223 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.223 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.224 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": { 2024-09-11T00:26:33.224 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "mode", 2024-09-11T00:26:33.224 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.224 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.224 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.224 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "upmap", 2024-09-11T00:26:33.224 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.224 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.224 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.224 INFO:teuthology.orchestra.run.smithi078.stdout: "crush-compat", 2024-09-11T00:26:33.224 INFO:teuthology.orchestra.run.smithi078.stdout: "none", 2024-09-11T00:26:33.224 INFO:teuthology.orchestra.run.smithi078.stdout: "read", 2024-09-11T00:26:33.224 INFO:teuthology.orchestra.run.smithi078.stdout: "upmap", 2024-09-11T00:26:33.224 INFO:teuthology.orchestra.run.smithi078.stdout: "upmap-read" 2024-09-11T00:26:33.225 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.225 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Balancer mode", 2024-09-11T00:26:33.225 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.225 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.225 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.225 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.225 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_ids": { 2024-09-11T00:26:33.225 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "pool_ids", 2024-09-11T00:26:33.225 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.225 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.225 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.225 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.225 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.225 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.225 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.226 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T00:26:33.226 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.226 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.226 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.226 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.226 INFO:teuthology.orchestra.run.smithi078.stdout: "sleep_interval": { 2024-09-11T00:26:33.226 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sleep_interval", 2024-09-11T00:26:33.226 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.226 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.226 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.226 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "60", 2024-09-11T00:26:33.226 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.226 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.226 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.227 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T00:26:33.227 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.227 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.227 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.227 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.227 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.227 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.227 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.227 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.227 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.227 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.227 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.227 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.227 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.228 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.228 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.228 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.228 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.228 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.228 INFO:teuthology.orchestra.run.smithi078.stdout: "upmap_max_deviation": { 2024-09-11T00:26:33.228 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "upmap_max_deviation", 2024-09-11T00:26:33.228 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.228 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.228 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.228 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "5", 2024-09-11T00:26:33.228 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "1", 2024-09-11T00:26:33.228 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.228 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.229 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T00:26:33.229 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T00:26:33.229 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.229 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.229 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.229 INFO:teuthology.orchestra.run.smithi078.stdout: "upmap_max_optimizations": { 2024-09-11T00:26:33.229 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "upmap_max_optimizations", 2024-09-11T00:26:33.229 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "uint", 2024-09-11T00:26:33.229 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.229 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.229 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:33.229 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.229 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.230 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.230 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T00:26:33.230 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.230 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.230 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.230 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.230 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.230 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.230 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.230 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cephadm", 2024-09-11T00:26:33.230 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.230 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.230 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.230 INFO:teuthology.orchestra.run.smithi078.stdout: "agent_down_multiplier": { 2024-09-11T00:26:33.231 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "agent_down_multiplier", 2024-09-11T00:26:33.231 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "float", 2024-09-11T00:26:33.231 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.231 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.231 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "3.0", 2024-09-11T00:26:33.231 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.231 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.231 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.231 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T00:26:33.231 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.231 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.231 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.231 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.231 INFO:teuthology.orchestra.run.smithi078.stdout: "agent_refresh_rate": { 2024-09-11T00:26:33.231 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "agent_refresh_rate", 2024-09-11T00:26:33.232 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.232 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.232 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.232 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "20", 2024-09-11T00:26:33.232 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.232 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.232 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.232 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T00:26:33.232 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.232 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.232 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.232 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.232 INFO:teuthology.orchestra.run.smithi078.stdout: "agent_starting_port": { 2024-09-11T00:26:33.233 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "agent_starting_port", 2024-09-11T00:26:33.233 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.233 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.233 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.233 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "4721", 2024-09-11T00:26:33.233 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.233 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.233 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.233 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T00:26:33.233 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.233 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.233 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.233 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.233 INFO:teuthology.orchestra.run.smithi078.stdout: "allow_ptrace": { 2024-09-11T00:26:33.234 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "allow_ptrace", 2024-09-11T00:26:33.234 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.234 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.234 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.234 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.234 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.234 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.234 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.234 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T00:26:33.234 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T00:26:33.234 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.234 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.234 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.234 INFO:teuthology.orchestra.run.smithi078.stdout: "autotune_interval": { 2024-09-11T00:26:33.235 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "autotune_interval", 2024-09-11T00:26:33.235 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.235 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.235 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.235 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "600", 2024-09-11T00:26:33.235 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.235 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.235 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.235 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T00:26:33.235 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.235 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.235 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.235 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.235 INFO:teuthology.orchestra.run.smithi078.stdout: "autotune_memory_target_ratio": { 2024-09-11T00:26:33.236 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T00:26:33.236 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "float", 2024-09-11T00:26:33.236 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.236 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.236 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0.7", 2024-09-11T00:26:33.236 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.236 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.236 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.236 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T00:26:33.236 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.236 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.236 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.236 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.236 INFO:teuthology.orchestra.run.smithi078.stdout: "cephadm_log_destination": { 2024-09-11T00:26:33.237 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cephadm_log_destination", 2024-09-11T00:26:33.237 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.237 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.237 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.237 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.237 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.237 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.237 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.237 INFO:teuthology.orchestra.run.smithi078.stdout: "file", 2024-09-11T00:26:33.237 INFO:teuthology.orchestra.run.smithi078.stdout: "file,syslog", 2024-09-11T00:26:33.237 INFO:teuthology.orchestra.run.smithi078.stdout: "syslog" 2024-09-11T00:26:33.237 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.237 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T00:26:33.238 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.238 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.238 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.238 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.238 INFO:teuthology.orchestra.run.smithi078.stdout: "cgroups_split": { 2024-09-11T00:26:33.238 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cgroups_split", 2024-09-11T00:26:33.238 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.238 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.238 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.238 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.238 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.238 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.238 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.238 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T00:26:33.239 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.239 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.239 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.239 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.239 INFO:teuthology.orchestra.run.smithi078.stdout: "config_checks_enabled": { 2024-09-11T00:26:33.239 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "config_checks_enabled", 2024-09-11T00:26:33.239 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.239 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.239 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.239 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.239 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.239 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.239 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.240 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T00:26:33.240 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.240 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.240 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.240 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.240 INFO:teuthology.orchestra.run.smithi078.stdout: "config_dashboard": { 2024-09-11T00:26:33.240 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "config_dashboard", 2024-09-11T00:26:33.240 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.240 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.240 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.240 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.240 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.240 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.240 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.241 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T00:26:33.241 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.241 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.241 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.241 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.241 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_alertmanager": { 2024-09-11T00:26:33.241 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_alertmanager", 2024-09-11T00:26:33.241 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.241 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.241 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.241 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-11T00:26:33.241 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.241 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.241 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.241 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Prometheus container image", 2024-09-11T00:26:33.242 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.242 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.242 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.242 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.242 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_base": { 2024-09-11T00:26:33.242 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_base", 2024-09-11T00:26:33.242 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.242 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.242 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.242 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T00:26:33.242 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.242 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.242 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.242 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Container image name, without the tag", 2024-09-11T00:26:33.242 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.243 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.243 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.243 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.243 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_elasticsearch": { 2024-09-11T00:26:33.243 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_elasticsearch", 2024-09-11T00:26:33.243 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.243 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.243 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.243 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T00:26:33.243 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.243 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.243 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.243 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "elasticsearch container image", 2024-09-11T00:26:33.243 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.243 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.244 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.244 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.244 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_grafana": { 2024-09-11T00:26:33.244 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_grafana", 2024-09-11T00:26:33.244 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.244 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.244 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.244 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-11T00:26:33.244 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.244 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.244 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.244 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Prometheus container image", 2024-09-11T00:26:33.244 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.244 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.244 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.245 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.245 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_haproxy": { 2024-09-11T00:26:33.245 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_haproxy", 2024-09-11T00:26:33.245 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.245 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.245 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.245 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T00:26:33.245 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.245 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.245 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.245 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "HAproxy container image", 2024-09-11T00:26:33.245 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.245 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.245 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_jaeger_agent": { 2024-09-11T00:26:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_jaeger_agent", 2024-09-11T00:26:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T00:26:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Jaeger agent container image", 2024-09-11T00:26:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.246 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_jaeger_collector": { 2024-09-11T00:26:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_jaeger_collector", 2024-09-11T00:26:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T00:26:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Jaeger collector container image", 2024-09-11T00:26:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.247 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_jaeger_query": { 2024-09-11T00:26:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_jaeger_query", 2024-09-11T00:26:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T00:26:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Jaeger query container image", 2024-09-11T00:26:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.248 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_keepalived": { 2024-09-11T00:26:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_keepalived", 2024-09-11T00:26:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T00:26:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Keepalived container image", 2024-09-11T00:26:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.249 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.250 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.250 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_loki": { 2024-09-11T00:26:33.250 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_loki", 2024-09-11T00:26:33.250 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.250 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.250 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.250 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T00:26:33.250 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.250 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.250 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.250 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Loki container image", 2024-09-11T00:26:33.250 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.250 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.250 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.251 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.251 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_nginx": { 2024-09-11T00:26:33.251 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_nginx", 2024-09-11T00:26:33.251 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.251 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.251 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.251 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-11T00:26:33.251 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.251 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.251 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.251 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Nginx container image", 2024-09-11T00:26:33.251 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.251 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.251 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.251 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.251 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_node_exporter": { 2024-09-11T00:26:33.252 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_node_exporter", 2024-09-11T00:26:33.252 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.252 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.252 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.252 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-11T00:26:33.252 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.252 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.252 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.252 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Prometheus container image", 2024-09-11T00:26:33.252 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.252 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.252 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.252 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.252 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_nvmeof": { 2024-09-11T00:26:33.252 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_nvmeof", 2024-09-11T00:26:33.253 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.253 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.253 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.253 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-11T00:26:33.253 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.253 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.253 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.253 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Nvme-of container image", 2024-09-11T00:26:33.253 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.253 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.253 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.253 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.253 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_oauth2_proxy": { 2024-09-11T00:26:33.254 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_oauth2_proxy", 2024-09-11T00:26:33.254 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.254 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.254 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.254 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-11T00:26:33.254 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.254 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.254 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.254 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "oauth2-proxy container image", 2024-09-11T00:26:33.254 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.254 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.254 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.254 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.254 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_prometheus": { 2024-09-11T00:26:33.255 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_prometheus", 2024-09-11T00:26:33.255 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.255 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.255 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.255 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-11T00:26:33.255 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.255 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.255 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.255 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Prometheus container image", 2024-09-11T00:26:33.255 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.255 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.255 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.255 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.255 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_promtail": { 2024-09-11T00:26:33.256 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_promtail", 2024-09-11T00:26:33.256 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.256 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.256 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.256 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T00:26:33.256 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.256 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.256 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.256 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Promtail container image", 2024-09-11T00:26:33.256 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.256 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.256 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.256 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.257 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_samba": { 2024-09-11T00:26:33.257 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_samba", 2024-09-11T00:26:33.257 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.257 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.257 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.257 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T00:26:33.257 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.257 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.257 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.257 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Samba/SMB container image", 2024-09-11T00:26:33.257 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.257 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.257 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.257 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.258 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_samba_metrics": { 2024-09-11T00:26:33.258 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_samba_metrics", 2024-09-11T00:26:33.258 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.258 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.258 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.258 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-11T00:26:33.258 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.258 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.258 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.258 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-11T00:26:33.258 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.258 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.258 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.258 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.259 INFO:teuthology.orchestra.run.smithi078.stdout: "container_image_snmp_gateway": { 2024-09-11T00:26:33.259 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_image_snmp_gateway", 2024-09-11T00:26:33.259 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.259 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.259 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.259 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T00:26:33.259 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.259 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.259 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.259 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "SNMP Gateway container image", 2024-09-11T00:26:33.259 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.259 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.259 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.260 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.260 INFO:teuthology.orchestra.run.smithi078.stdout: "container_init": { 2024-09-11T00:26:33.260 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "container_init", 2024-09-11T00:26:33.260 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.260 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.260 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.260 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.260 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.260 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.260 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.260 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T00:26:33.260 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.260 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.260 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.261 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.261 INFO:teuthology.orchestra.run.smithi078.stdout: "daemon_cache_timeout": { 2024-09-11T00:26:33.261 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "daemon_cache_timeout", 2024-09-11T00:26:33.261 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.261 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.261 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.261 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "600", 2024-09-11T00:26:33.261 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.261 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.261 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.261 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T00:26:33.262 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.262 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.262 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.262 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.262 INFO:teuthology.orchestra.run.smithi078.stdout: "default_cephadm_command_timeout": { 2024-09-11T00:26:33.262 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T00:26:33.262 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.262 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.262 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.262 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "900", 2024-09-11T00:26:33.262 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.262 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.262 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.262 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T00:26:33.263 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.263 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.263 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.263 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.263 INFO:teuthology.orchestra.run.smithi078.stdout: "default_registry": { 2024-09-11T00:26:33.263 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "default_registry", 2024-09-11T00:26:33.263 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.263 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.263 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.263 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "docker.io", 2024-09-11T00:26:33.263 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.263 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.263 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.264 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T00:26:33.264 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.264 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.264 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.264 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.264 INFO:teuthology.orchestra.run.smithi078.stdout: "device_cache_timeout": { 2024-09-11T00:26:33.264 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "device_cache_timeout", 2024-09-11T00:26:33.264 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.264 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.264 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.264 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "1800", 2024-09-11T00:26:33.264 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.264 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.265 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.265 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "seconds to cache device inventory", 2024-09-11T00:26:33.265 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.265 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.265 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.265 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.265 INFO:teuthology.orchestra.run.smithi078.stdout: "device_enhanced_scan": { 2024-09-11T00:26:33.265 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "device_enhanced_scan", 2024-09-11T00:26:33.265 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.265 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.265 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.265 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.265 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.265 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.266 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.266 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T00:26:33.266 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.266 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.266 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.266 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.266 INFO:teuthology.orchestra.run.smithi078.stdout: "facts_cache_timeout": { 2024-09-11T00:26:33.266 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "facts_cache_timeout", 2024-09-11T00:26:33.266 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.266 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.266 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.266 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "60", 2024-09-11T00:26:33.266 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.266 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.267 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.267 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "seconds to cache host facts data", 2024-09-11T00:26:33.267 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.267 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.267 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.267 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.267 INFO:teuthology.orchestra.run.smithi078.stdout: "grafana_dashboards_path": { 2024-09-11T00:26:33.267 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "grafana_dashboards_path", 2024-09-11T00:26:33.267 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.267 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.267 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.267 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T00:26:33.267 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.267 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.267 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.268 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T00:26:33.268 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.268 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.268 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.268 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.268 INFO:teuthology.orchestra.run.smithi078.stdout: "host_check_interval": { 2024-09-11T00:26:33.268 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "host_check_interval", 2024-09-11T00:26:33.268 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.268 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.268 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.268 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "600", 2024-09-11T00:26:33.268 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.268 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.268 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.269 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how frequently to perform a host check", 2024-09-11T00:26:33.269 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.269 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.269 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.269 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.269 INFO:teuthology.orchestra.run.smithi078.stdout: "hw_monitoring": { 2024-09-11T00:26:33.269 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "hw_monitoring", 2024-09-11T00:26:33.269 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.269 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.269 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.269 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.269 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.269 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.269 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.270 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T00:26:33.270 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.270 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.270 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.270 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.270 INFO:teuthology.orchestra.run.smithi078.stdout: "inventory_list_all": { 2024-09-11T00:26:33.270 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "inventory_list_all", 2024-09-11T00:26:33.270 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.270 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.270 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.270 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.270 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.270 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.270 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.271 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T00:26:33.271 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.271 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.271 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.271 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.271 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.271 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.271 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.271 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.271 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.271 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.271 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.271 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.272 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.272 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.272 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.272 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.272 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.272 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.272 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.272 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.272 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.272 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.272 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.272 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.272 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.272 INFO:teuthology.orchestra.run.smithi078.stdout: "log_refresh_metadata": { 2024-09-11T00:26:33.273 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_refresh_metadata", 2024-09-11T00:26:33.273 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.273 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.273 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.273 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.273 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.273 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.273 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.273 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T00:26:33.273 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.273 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.273 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.273 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.273 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.274 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.274 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.274 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.274 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.274 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.274 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.274 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.274 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.274 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T00:26:33.274 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.274 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.274 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.274 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.274 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.275 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.275 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.275 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.275 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.275 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.275 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.275 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.275 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.275 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.275 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.275 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.275 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.275 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.275 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.275 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.276 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.276 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.276 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.276 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.276 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.276 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.276 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.276 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.276 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.276 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.276 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.276 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.276 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.277 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.277 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.277 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.277 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.277 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.277 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.277 INFO:teuthology.orchestra.run.smithi078.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T00:26:33.277 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T00:26:33.277 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.277 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.277 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.277 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.277 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.277 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.278 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.278 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T00:26:33.278 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.278 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.278 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.278 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.278 INFO:teuthology.orchestra.run.smithi078.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T00:26:33.278 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T00:26:33.278 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.278 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.278 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.278 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "*", 2024-09-11T00:26:33.278 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.278 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.279 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.279 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T00:26:33.279 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.279 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.279 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.279 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.279 INFO:teuthology.orchestra.run.smithi078.stdout: "max_count_per_host": { 2024-09-11T00:26:33.279 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "max_count_per_host", 2024-09-11T00:26:33.279 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.279 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.279 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.279 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:33.279 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.279 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.280 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.280 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "max number of daemons per service per host", 2024-09-11T00:26:33.280 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.280 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.280 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.280 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.280 INFO:teuthology.orchestra.run.smithi078.stdout: "max_osd_draining_count": { 2024-09-11T00:26:33.280 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "max_osd_draining_count", 2024-09-11T00:26:33.280 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.280 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.280 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.280 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:33.280 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.281 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.281 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.281 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T00:26:33.281 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.281 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.281 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.281 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.281 INFO:teuthology.orchestra.run.smithi078.stdout: "migration_current": { 2024-09-11T00:26:33.281 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "migration_current", 2024-09-11T00:26:33.281 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.281 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.281 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.281 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.281 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.282 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.282 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.282 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "internal - do not modify", 2024-09-11T00:26:33.282 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.282 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.282 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.282 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.282 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": { 2024-09-11T00:26:33.282 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "mode", 2024-09-11T00:26:33.282 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.282 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.282 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.282 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "root", 2024-09-11T00:26:33.282 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.283 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.283 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.283 INFO:teuthology.orchestra.run.smithi078.stdout: "cephadm-package", 2024-09-11T00:26:33.283 INFO:teuthology.orchestra.run.smithi078.stdout: "root" 2024-09-11T00:26:33.283 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.283 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T00:26:33.283 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.283 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.283 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.283 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.283 INFO:teuthology.orchestra.run.smithi078.stdout: "oob_default_addr": { 2024-09-11T00:26:33.283 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "oob_default_addr", 2024-09-11T00:26:33.283 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.283 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.284 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.284 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "169.254.1.1", 2024-09-11T00:26:33.284 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.284 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.284 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.284 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T00:26:33.284 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.284 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.284 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.284 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.284 INFO:teuthology.orchestra.run.smithi078.stdout: "prometheus_alerts_path": { 2024-09-11T00:26:33.284 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "prometheus_alerts_path", 2024-09-11T00:26:33.284 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.284 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.284 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.285 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T00:26:33.285 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.285 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.285 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.285 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T00:26:33.285 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.285 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.285 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.285 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.285 INFO:teuthology.orchestra.run.smithi078.stdout: "registry_insecure": { 2024-09-11T00:26:33.285 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "registry_insecure", 2024-09-11T00:26:33.285 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.285 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.285 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.286 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.286 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.286 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.286 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.286 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T00:26:33.286 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.286 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.286 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.286 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.286 INFO:teuthology.orchestra.run.smithi078.stdout: "registry_password": { 2024-09-11T00:26:33.286 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "registry_password", 2024-09-11T00:26:33.286 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.286 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.286 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.286 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.287 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.287 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.287 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.287 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T00:26:33.287 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.287 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.287 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.287 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.287 INFO:teuthology.orchestra.run.smithi078.stdout: "registry_url": { 2024-09-11T00:26:33.287 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "registry_url", 2024-09-11T00:26:33.287 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.287 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.287 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.287 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.288 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.288 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.288 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.288 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T00:26:33.288 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.288 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.288 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.288 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.288 INFO:teuthology.orchestra.run.smithi078.stdout: "registry_username": { 2024-09-11T00:26:33.288 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "registry_username", 2024-09-11T00:26:33.288 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.288 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.288 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.288 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.289 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.289 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.289 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.289 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T00:26:33.289 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.289 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.289 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.289 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.289 INFO:teuthology.orchestra.run.smithi078.stdout: "secure_monitoring_stack": { 2024-09-11T00:26:33.289 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "secure_monitoring_stack", 2024-09-11T00:26:33.289 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.289 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.289 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.289 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.290 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.290 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.290 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.290 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T00:26:33.290 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.290 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.290 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.290 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.290 INFO:teuthology.orchestra.run.smithi078.stdout: "service_discovery_port": { 2024-09-11T00:26:33.290 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "service_discovery_port", 2024-09-11T00:26:33.290 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.290 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.290 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.290 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "8765", 2024-09-11T00:26:33.290 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.291 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.291 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.291 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "cephadm service discovery port", 2024-09-11T00:26:33.291 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.291 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.291 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.291 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.291 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.291 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.291 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.291 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.291 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.291 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.291 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.292 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.292 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.292 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.292 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.292 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.292 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.292 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.292 INFO:teuthology.orchestra.run.smithi078.stdout: "ssh_config_file": { 2024-09-11T00:26:33.292 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ssh_config_file", 2024-09-11T00:26:33.292 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.292 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.292 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.292 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.292 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.293 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.293 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.293 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T00:26:33.293 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.293 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.293 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.293 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.293 INFO:teuthology.orchestra.run.smithi078.stdout: "use_agent": { 2024-09-11T00:26:33.293 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "use_agent", 2024-09-11T00:26:33.293 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.294 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.294 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.294 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.294 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.295 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.295 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.295 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T00:26:33.295 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.295 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.295 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.295 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.295 INFO:teuthology.orchestra.run.smithi078.stdout: "use_repo_digest": { 2024-09-11T00:26:33.295 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "use_repo_digest", 2024-09-11T00:26:33.296 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.296 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.296 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.296 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.296 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.296 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.296 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.296 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T00:26:33.296 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.297 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.297 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.297 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.297 INFO:teuthology.orchestra.run.smithi078.stdout: "warn_on_failed_host_check": { 2024-09-11T00:26:33.297 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "warn_on_failed_host_check", 2024-09-11T00:26:33.297 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.297 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.297 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.297 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.297 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.297 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.298 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.298 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T00:26:33.298 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.298 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.298 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.298 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.298 INFO:teuthology.orchestra.run.smithi078.stdout: "warn_on_stray_daemons": { 2024-09-11T00:26:33.298 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "warn_on_stray_daemons", 2024-09-11T00:26:33.298 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.298 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.298 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.298 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.298 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.298 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.299 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.299 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T00:26:33.299 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.299 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.299 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.299 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.299 INFO:teuthology.orchestra.run.smithi078.stdout: "warn_on_stray_hosts": { 2024-09-11T00:26:33.299 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "warn_on_stray_hosts", 2024-09-11T00:26:33.299 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.299 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.299 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.299 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.299 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.300 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.300 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.300 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T00:26:33.300 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.300 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.300 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.300 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.300 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.300 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.300 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.300 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "crash", 2024-09-11T00:26:33.300 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.300 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.300 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.301 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.301 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.301 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.301 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.301 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.301 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.302 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.302 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.302 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.302 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.302 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.302 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.302 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.302 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.302 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.302 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.302 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.302 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.302 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.302 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.303 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.303 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.303 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.303 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.303 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.303 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.303 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.303 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.303 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.303 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.303 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.303 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.303 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.303 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.304 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.304 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.304 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.304 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.304 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.304 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.304 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.304 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.304 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.304 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.304 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.304 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.304 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.304 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.305 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.305 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.305 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.305 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.305 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.305 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.305 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.305 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.305 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.305 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.305 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.305 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.305 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.306 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.306 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.306 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.306 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.306 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.306 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.306 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.306 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.306 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.306 INFO:teuthology.orchestra.run.smithi078.stdout: "retain_interval": { 2024-09-11T00:26:33.306 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "retain_interval", 2024-09-11T00:26:33.306 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.306 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.306 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.306 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "31536000", 2024-09-11T00:26:33.307 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.307 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.307 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.307 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T00:26:33.307 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.307 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.307 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.307 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.307 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.307 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.307 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.307 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.307 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.307 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.308 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.308 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.308 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.308 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.308 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.308 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.308 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.308 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.308 INFO:teuthology.orchestra.run.smithi078.stdout: "warn_recent_interval": { 2024-09-11T00:26:33.308 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "warn_recent_interval", 2024-09-11T00:26:33.308 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.308 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.308 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.308 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "1209600", 2024-09-11T00:26:33.309 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.309 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.309 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.309 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T00:26:33.309 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.309 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.309 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.309 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.309 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.309 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.309 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.309 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "dashboard", 2024-09-11T00:26:33.309 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.310 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.310 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.310 INFO:teuthology.orchestra.run.smithi078.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T00:26:33.310 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T00:26:33.310 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.310 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.310 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.310 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:33.310 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.310 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.310 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.310 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.310 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.311 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.311 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.311 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.311 INFO:teuthology.orchestra.run.smithi078.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T00:26:33.311 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T00:26:33.311 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.311 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.311 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.311 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.311 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.311 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.311 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.311 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.311 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.312 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.312 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.312 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.312 INFO:teuthology.orchestra.run.smithi078.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T00:26:33.312 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T00:26:33.312 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.312 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.312 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.312 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.312 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.312 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.312 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.312 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.313 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.313 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.313 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.313 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.313 INFO:teuthology.orchestra.run.smithi078.stdout: "AUDIT_API_ENABLED": { 2024-09-11T00:26:33.313 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T00:26:33.313 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.313 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.313 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.313 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.313 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.313 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.313 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.313 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.314 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.314 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.314 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.314 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.314 INFO:teuthology.orchestra.run.smithi078.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T00:26:33.314 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T00:26:33.314 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.314 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.314 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.314 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.314 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.314 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.314 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.314 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.315 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.315 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.315 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.315 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.315 INFO:teuthology.orchestra.run.smithi078.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T00:26:33.315 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T00:26:33.315 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.315 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.315 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.315 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.315 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.315 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.315 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.315 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.316 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.316 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.316 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.316 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.316 INFO:teuthology.orchestra.run.smithi078.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T00:26:33.316 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T00:26:33.316 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.316 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.316 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.316 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.316 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.316 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.316 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.316 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.317 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.317 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.317 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.317 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.317 INFO:teuthology.orchestra.run.smithi078.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T00:26:33.317 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T00:26:33.317 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.317 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.317 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.317 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.317 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.317 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.317 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.318 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.318 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.318 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.318 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.318 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.318 INFO:teuthology.orchestra.run.smithi078.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T00:26:33.318 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T00:26:33.318 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.318 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.319 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.319 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.319 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.319 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.319 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.319 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.319 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.319 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.319 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.319 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.319 INFO:teuthology.orchestra.run.smithi078.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T00:26:33.319 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T00:26:33.319 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.319 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.320 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.320 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.320 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.320 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.320 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.320 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.320 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.320 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.320 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.321 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.321 INFO:teuthology.orchestra.run.smithi078.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T00:26:33.321 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T00:26:33.321 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.321 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.321 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.321 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.321 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.321 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.321 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.321 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.321 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.322 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.322 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.322 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.322 INFO:teuthology.orchestra.run.smithi078.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T00:26:33.322 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T00:26:33.322 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.322 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.322 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.323 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.323 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.323 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.323 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.323 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.323 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.323 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.323 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.324 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.324 INFO:teuthology.orchestra.run.smithi078.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T00:26:33.324 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T00:26:33.324 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.324 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.324 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.324 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.324 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.324 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.324 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.325 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.325 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.325 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.325 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.325 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.325 INFO:teuthology.orchestra.run.smithi078.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T00:26:33.325 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T00:26:33.325 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.325 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.325 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.325 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.325 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.325 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.325 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.326 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.326 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.326 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.326 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.326 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.326 INFO:teuthology.orchestra.run.smithi078.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T00:26:33.326 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T00:26:33.326 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.326 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.326 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.326 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "admin", 2024-09-11T00:26:33.326 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.326 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.326 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.327 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.327 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.327 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.327 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.327 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.327 INFO:teuthology.orchestra.run.smithi078.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T00:26:33.327 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T00:26:33.327 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.327 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.327 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.327 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.327 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.327 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.327 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.328 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.328 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.328 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.328 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.328 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.328 INFO:teuthology.orchestra.run.smithi078.stdout: "GRAFANA_API_URL": { 2024-09-11T00:26:33.328 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "GRAFANA_API_URL", 2024-09-11T00:26:33.328 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.329 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.329 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.329 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.329 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.329 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.329 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.329 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.329 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.329 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.329 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.329 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.330 INFO:teuthology.orchestra.run.smithi078.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T00:26:33.330 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T00:26:33.330 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.330 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.330 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.330 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "admin", 2024-09-11T00:26:33.331 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.331 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.331 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.331 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.331 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.331 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.331 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.331 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.331 INFO:teuthology.orchestra.run.smithi078.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T00:26:33.332 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T00:26:33.332 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.332 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.332 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.332 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.332 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.332 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.332 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.333 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.333 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.333 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.333 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.333 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.333 INFO:teuthology.orchestra.run.smithi078.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T00:26:33.333 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T00:26:33.333 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.333 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.333 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.334 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.334 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.334 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.334 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.334 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.334 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.334 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.334 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.334 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.334 INFO:teuthology.orchestra.run.smithi078.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T00:26:33.334 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T00:26:33.334 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.334 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.334 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.335 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.335 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.335 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.335 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.335 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.335 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.335 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.335 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.335 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.335 INFO:teuthology.orchestra.run.smithi078.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T00:26:33.335 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T00:26:33.335 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.335 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.335 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.336 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.336 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.336 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.336 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.336 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.336 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.336 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.336 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.336 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.336 INFO:teuthology.orchestra.run.smithi078.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-11T00:26:33.336 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-11T00:26:33.336 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.336 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.337 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.337 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "[]", 2024-09-11T00:26:33.337 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.337 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.337 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.337 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.337 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.337 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.337 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.337 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.337 INFO:teuthology.orchestra.run.smithi078.stdout: "MULTICLUSTER_CONFIG": { 2024-09-11T00:26:33.337 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-11T00:26:33.337 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.337 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.338 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.338 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "{}", 2024-09-11T00:26:33.338 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.338 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.338 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.338 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.338 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.338 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.338 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.338 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.338 INFO:teuthology.orchestra.run.smithi078.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T00:26:33.338 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T00:26:33.338 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.338 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.339 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.339 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.339 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.339 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.339 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.339 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.339 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.339 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.339 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.339 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.339 INFO:teuthology.orchestra.run.smithi078.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T00:26:33.339 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T00:26:33.339 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.339 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.340 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.340 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.340 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.340 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.340 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.340 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.340 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.340 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.340 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.340 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.340 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T00:26:33.340 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T00:26:33.340 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.340 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.341 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.341 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.341 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.341 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.341 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.341 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.341 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.341 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.341 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.341 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.341 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T00:26:33.341 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T00:26:33.341 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.341 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.342 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.342 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.342 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.342 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.342 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.342 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.342 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.342 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.342 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.342 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.342 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T00:26:33.342 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T00:26:33.342 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.342 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.343 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.343 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.343 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.343 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.343 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.343 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.343 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.343 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.343 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.343 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.343 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T00:26:33.343 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T00:26:33.343 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.343 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.344 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.344 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.344 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.344 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.344 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.344 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.344 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.344 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.344 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.344 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.344 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T00:26:33.344 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T00:26:33.344 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.344 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.345 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.345 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.345 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.345 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.345 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.345 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.345 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.345 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.345 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.345 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.345 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T00:26:33.345 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T00:26:33.345 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.345 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.346 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.346 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.346 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.346 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.346 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.346 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.346 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.346 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.346 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.346 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.346 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T00:26:33.346 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T00:26:33.346 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.347 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.347 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.347 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.347 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.347 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.347 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.347 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.347 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.347 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.347 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.347 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.347 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T00:26:33.347 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T00:26:33.347 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.348 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.348 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.348 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.348 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.348 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.348 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.348 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.348 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.348 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.348 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.348 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.348 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T00:26:33.348 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T00:26:33.349 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.349 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.349 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.349 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T00:26:33.349 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.349 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.349 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.349 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.349 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.349 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.349 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.349 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.350 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T00:26:33.350 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T00:26:33.350 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.350 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.350 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.350 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:33.350 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.350 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.350 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.350 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.350 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.350 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.350 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.351 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.351 INFO:teuthology.orchestra.run.smithi078.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T00:26:33.351 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T00:26:33.351 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.351 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.351 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.351 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "8", 2024-09-11T00:26:33.351 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.351 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.351 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.351 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.351 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.351 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.352 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.352 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.352 INFO:teuthology.orchestra.run.smithi078.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T00:26:33.352 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T00:26:33.352 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.352 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.352 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.352 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "45", 2024-09-11T00:26:33.352 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.352 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.352 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.352 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.352 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.353 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.353 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.353 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.353 INFO:teuthology.orchestra.run.smithi078.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T00:26:33.353 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T00:26:33.353 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.353 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.353 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.353 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.353 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.353 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.353 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.353 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.354 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.354 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.354 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.354 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.354 INFO:teuthology.orchestra.run.smithi078.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T00:26:33.354 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T00:26:33.354 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.354 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.354 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.355 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "admin", 2024-09-11T00:26:33.355 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.355 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.355 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.355 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.355 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.355 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.355 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.355 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.355 INFO:teuthology.orchestra.run.smithi078.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T00:26:33.355 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T00:26:33.355 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.355 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.356 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.356 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.356 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.356 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.356 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.356 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.356 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.356 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.356 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.356 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.357 INFO:teuthology.orchestra.run.smithi078.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T00:26:33.357 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T00:26:33.357 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.357 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.361 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.361 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.361 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.361 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.361 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.361 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.361 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.361 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.362 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.362 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.362 INFO:teuthology.orchestra.run.smithi078.stdout: "UNSAFE_TLS_v1_2": { 2024-09-11T00:26:33.362 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-11T00:26:33.362 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.362 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.362 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.362 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.362 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.362 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.362 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.362 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.362 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.363 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.363 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.363 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.363 INFO:teuthology.orchestra.run.smithi078.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T00:26:33.363 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T00:26:33.363 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.363 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.363 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.363 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.363 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.363 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.363 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.363 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.364 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.364 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.364 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.364 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.364 INFO:teuthology.orchestra.run.smithi078.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T00:26:33.364 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T00:26:33.364 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.364 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.364 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.364 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:33.364 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.364 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.364 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.364 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.365 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.365 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.365 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.365 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.365 INFO:teuthology.orchestra.run.smithi078.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T00:26:33.365 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T00:26:33.365 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.365 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.365 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.365 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "5", 2024-09-11T00:26:33.365 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.365 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.365 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.366 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.366 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.366 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.366 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.366 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.366 INFO:teuthology.orchestra.run.smithi078.stdout: "cross_origin_url": { 2024-09-11T00:26:33.366 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cross_origin_url", 2024-09-11T00:26:33.366 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.366 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.366 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.366 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.366 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.366 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.366 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.367 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.367 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.367 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.367 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.367 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.367 INFO:teuthology.orchestra.run.smithi078.stdout: "crt_file": { 2024-09-11T00:26:33.367 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "crt_file", 2024-09-11T00:26:33.367 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.367 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.367 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.367 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.367 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.367 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.367 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.368 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.368 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.368 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.368 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.368 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.368 INFO:teuthology.orchestra.run.smithi078.stdout: "debug": { 2024-09-11T00:26:33.368 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "debug", 2024-09-11T00:26:33.368 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.368 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.368 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.368 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.368 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.369 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.369 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.369 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Enable/disable debug options", 2024-09-11T00:26:33.369 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.369 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.369 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.369 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.369 INFO:teuthology.orchestra.run.smithi078.stdout: "jwt_token_ttl": { 2024-09-11T00:26:33.369 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "jwt_token_ttl", 2024-09-11T00:26:33.369 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.369 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.369 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.370 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "28800", 2024-09-11T00:26:33.370 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.370 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.370 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.370 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.370 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.370 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.370 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.370 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.370 INFO:teuthology.orchestra.run.smithi078.stdout: "key_file": { 2024-09-11T00:26:33.370 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "key_file", 2024-09-11T00:26:33.370 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.370 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.371 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.371 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.371 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.371 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.371 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.371 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.371 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.371 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.371 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.371 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.371 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.371 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.371 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.372 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.372 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.372 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.372 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.372 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.372 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.372 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.372 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.372 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.372 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.372 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.372 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.372 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.373 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.373 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.373 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.373 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.373 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.373 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.373 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.373 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.373 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.373 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.373 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.373 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.373 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.373 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.374 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.374 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.374 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.374 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.374 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.374 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.374 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.374 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.374 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.374 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.374 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.374 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.374 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.374 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.375 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.375 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.375 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.375 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.375 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.375 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.375 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.375 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.375 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.375 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.375 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.375 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.375 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.375 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.376 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.376 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.376 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.376 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.376 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.376 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.376 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.376 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.376 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.376 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.376 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.376 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.376 INFO:teuthology.orchestra.run.smithi078.stdout: "motd": { 2024-09-11T00:26:33.376 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "motd", 2024-09-11T00:26:33.377 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.377 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.377 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.377 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.377 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.377 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.377 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.377 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "The message of the day", 2024-09-11T00:26:33.377 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.377 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.377 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.377 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.377 INFO:teuthology.orchestra.run.smithi078.stdout: "redirect_resolve_ip_addr": { 2024-09-11T00:26:33.377 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T00:26:33.378 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.378 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.378 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.378 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.378 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.378 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.378 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.378 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.378 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.378 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.378 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.378 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.378 INFO:teuthology.orchestra.run.smithi078.stdout: "server_addr": { 2024-09-11T00:26:33.378 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "server_addr", 2024-09-11T00:26:33.379 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.379 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.379 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.379 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "::", 2024-09-11T00:26:33.379 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.379 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.379 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.379 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.379 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.379 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.379 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.379 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.379 INFO:teuthology.orchestra.run.smithi078.stdout: "server_port": { 2024-09-11T00:26:33.379 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "server_port", 2024-09-11T00:26:33.380 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.380 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.380 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.380 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "8080", 2024-09-11T00:26:33.380 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.380 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.380 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.380 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.380 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.380 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.380 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.380 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.380 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.380 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.381 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.381 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.381 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.381 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.381 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.381 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.381 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.381 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.381 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.381 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.381 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.381 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.381 INFO:teuthology.orchestra.run.smithi078.stdout: "ssl": { 2024-09-11T00:26:33.381 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ssl", 2024-09-11T00:26:33.381 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.382 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.382 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.382 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.382 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.382 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.382 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.382 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.382 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.382 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.383 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.383 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.383 INFO:teuthology.orchestra.run.smithi078.stdout: "ssl_server_port": { 2024-09-11T00:26:33.383 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ssl_server_port", 2024-09-11T00:26:33.383 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.383 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.383 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.383 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "8443", 2024-09-11T00:26:33.383 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.383 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.383 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.383 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.383 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.383 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.383 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.384 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.384 INFO:teuthology.orchestra.run.smithi078.stdout: "standby_behaviour": { 2024-09-11T00:26:33.384 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "standby_behaviour", 2024-09-11T00:26:33.384 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.384 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.384 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.384 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "redirect", 2024-09-11T00:26:33.384 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.384 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.384 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.384 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.384 INFO:teuthology.orchestra.run.smithi078.stdout: "redirect" 2024-09-11T00:26:33.384 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.385 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.385 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.385 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.385 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.385 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.385 INFO:teuthology.orchestra.run.smithi078.stdout: "standby_error_status_code": { 2024-09-11T00:26:33.385 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "standby_error_status_code", 2024-09-11T00:26:33.385 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.385 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.385 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.385 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "500", 2024-09-11T00:26:33.385 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "400", 2024-09-11T00:26:33.385 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "599", 2024-09-11T00:26:33.385 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.386 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.386 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.386 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.386 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.386 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.386 INFO:teuthology.orchestra.run.smithi078.stdout: "url_prefix": { 2024-09-11T00:26:33.386 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "url_prefix", 2024-09-11T00:26:33.386 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.386 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.386 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.386 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.386 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.386 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.387 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.387 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.387 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.387 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.387 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.387 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.387 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.387 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.387 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.387 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "devicehealth", 2024-09-11T00:26:33.387 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.387 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.387 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.388 INFO:teuthology.orchestra.run.smithi078.stdout: "enable_monitoring": { 2024-09-11T00:26:33.388 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "enable_monitoring", 2024-09-11T00:26:33.388 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.388 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.388 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.388 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.388 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.388 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.388 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.388 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "monitor device health metrics", 2024-09-11T00:26:33.388 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.388 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.389 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.389 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.389 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.389 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.389 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.389 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.389 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.389 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.389 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.389 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.389 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.389 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.389 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.389 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.390 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.390 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.390 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.390 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.390 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.390 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.390 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.390 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.390 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.390 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.390 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.390 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.390 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.390 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.390 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.391 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.391 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.391 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.391 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.391 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.391 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.391 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.391 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.391 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.391 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.391 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.391 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.391 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.391 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.391 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.392 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.392 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.392 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.392 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.392 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.392 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.392 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.392 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.392 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.392 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.392 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.392 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.392 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.392 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.393 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.393 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.393 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.393 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.393 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.393 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.393 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.393 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.393 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.393 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.393 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.393 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.393 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.394 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.394 INFO:teuthology.orchestra.run.smithi078.stdout: "mark_out_threshold": { 2024-09-11T00:26:33.394 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "mark_out_threshold", 2024-09-11T00:26:33.394 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.394 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.394 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.394 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "2419200", 2024-09-11T00:26:33.394 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.394 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.394 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.394 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T00:26:33.394 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.394 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.394 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.394 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.394 INFO:teuthology.orchestra.run.smithi078.stdout: "pool_name": { 2024-09-11T00:26:33.395 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "pool_name", 2024-09-11T00:26:33.395 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.395 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.395 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.395 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "device_health_metrics", 2024-09-11T00:26:33.395 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.395 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.395 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.395 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T00:26:33.395 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.395 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.395 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.395 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.395 INFO:teuthology.orchestra.run.smithi078.stdout: "retention_period": { 2024-09-11T00:26:33.396 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "retention_period", 2024-09-11T00:26:33.396 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.396 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.396 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.396 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "15552000", 2024-09-11T00:26:33.396 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.396 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.396 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.396 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how long to retain device health metrics", 2024-09-11T00:26:33.396 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.396 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.396 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.396 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.397 INFO:teuthology.orchestra.run.smithi078.stdout: "scrape_frequency": { 2024-09-11T00:26:33.397 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "scrape_frequency", 2024-09-11T00:26:33.397 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.397 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.397 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.397 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "86400", 2024-09-11T00:26:33.397 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.397 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.397 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.397 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T00:26:33.397 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.397 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.397 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.397 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.398 INFO:teuthology.orchestra.run.smithi078.stdout: "self_heal": { 2024-09-11T00:26:33.398 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "self_heal", 2024-09-11T00:26:33.398 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.398 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.398 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.398 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.398 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.398 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.398 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.398 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T00:26:33.398 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.398 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.398 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.398 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.398 INFO:teuthology.orchestra.run.smithi078.stdout: "sleep_interval": { 2024-09-11T00:26:33.399 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sleep_interval", 2024-09-11T00:26:33.399 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.399 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.399 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.399 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "600", 2024-09-11T00:26:33.399 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.399 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.399 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.399 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T00:26:33.399 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.399 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.399 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.399 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.399 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.399 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.400 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.400 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.400 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.400 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.400 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.400 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.400 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.400 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.400 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.400 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.400 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.400 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.400 INFO:teuthology.orchestra.run.smithi078.stdout: "warn_threshold": { 2024-09-11T00:26:33.400 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "warn_threshold", 2024-09-11T00:26:33.401 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.401 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.401 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.401 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "7257600", 2024-09-11T00:26:33.401 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.401 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.401 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.401 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T00:26:33.401 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.401 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.401 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.401 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.401 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.402 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.402 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.402 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "diskprediction_local", 2024-09-11T00:26:33.402 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.402 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.402 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.402 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.402 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.402 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.402 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.402 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.402 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.402 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.402 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.403 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.403 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.403 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.403 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.403 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.403 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.403 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.403 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.403 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.403 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.403 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.403 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.403 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.403 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.404 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.404 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.404 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.404 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.404 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.404 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.404 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.404 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.404 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.404 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.404 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.404 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.404 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.404 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.405 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.405 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.405 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.405 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.405 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.405 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.405 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.405 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.405 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.405 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.405 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.405 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.405 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.405 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.406 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.406 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.406 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.406 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.406 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.406 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.406 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.406 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.406 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.406 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.406 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.406 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.406 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.406 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.407 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.407 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.407 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.407 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.407 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.407 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.407 INFO:teuthology.orchestra.run.smithi078.stdout: "predict_interval": { 2024-09-11T00:26:33.407 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "predict_interval", 2024-09-11T00:26:33.407 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.407 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.407 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.407 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "86400", 2024-09-11T00:26:33.407 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.408 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.408 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.408 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.408 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.408 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.408 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.408 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.408 INFO:teuthology.orchestra.run.smithi078.stdout: "predictor_model": { 2024-09-11T00:26:33.408 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "predictor_model", 2024-09-11T00:26:33.408 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.408 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.408 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.408 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "prophetstor", 2024-09-11T00:26:33.408 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.409 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.409 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.409 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.409 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.409 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.409 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.409 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.409 INFO:teuthology.orchestra.run.smithi078.stdout: "sleep_interval": { 2024-09-11T00:26:33.409 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sleep_interval", 2024-09-11T00:26:33.409 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.409 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.409 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.409 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "600", 2024-09-11T00:26:33.409 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.410 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.410 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.410 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.410 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.410 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.410 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.410 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.410 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.410 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.410 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.410 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.410 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.410 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.410 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "influx", 2024-09-11T00:26:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": false, 2024-09-11T00:26:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "influxdb python module not found", 2024-09-11T00:26:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: "batch_size": { 2024-09-11T00:26:33.412 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "batch_size", 2024-09-11T00:26:33.412 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.412 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.412 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.412 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "5000", 2024-09-11T00:26:33.412 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.412 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.412 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.412 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T00:26:33.412 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.412 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.412 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.412 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.413 INFO:teuthology.orchestra.run.smithi078.stdout: "database": { 2024-09-11T00:26:33.413 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "database", 2024-09-11T00:26:33.413 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.413 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.413 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.413 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "ceph", 2024-09-11T00:26:33.413 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.413 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.413 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.413 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T00:26:33.413 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.413 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.413 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.413 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.414 INFO:teuthology.orchestra.run.smithi078.stdout: "hostname": { 2024-09-11T00:26:33.414 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "hostname", 2024-09-11T00:26:33.414 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.414 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.414 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.414 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.414 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.414 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.414 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.414 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "InfluxDB server hostname", 2024-09-11T00:26:33.414 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.414 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.414 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.414 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.415 INFO:teuthology.orchestra.run.smithi078.stdout: "interval": { 2024-09-11T00:26:33.415 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "interval", 2024-09-11T00:26:33.415 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.415 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.415 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.415 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "30", 2024-09-11T00:26:33.415 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "5", 2024-09-11T00:26:33.415 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.415 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.415 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T00:26:33.415 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.415 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.415 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.415 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.416 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.416 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.416 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.416 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.416 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.416 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.416 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.416 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.416 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.416 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.416 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.417 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.417 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.417 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.417 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.417 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.417 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.417 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.417 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.417 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.417 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.417 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.417 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.417 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.418 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.418 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.418 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.418 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.418 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.418 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.418 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.418 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.418 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.418 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.418 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.418 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.419 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.419 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.419 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.419 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.419 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.419 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.419 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.419 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.419 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.419 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.419 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.419 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.419 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.420 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.420 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.420 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.420 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.420 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.420 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.420 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.420 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.420 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.420 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.420 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.421 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.421 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.421 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.421 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.421 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.421 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.421 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.421 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.421 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.421 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.421 INFO:teuthology.orchestra.run.smithi078.stdout: "password": { 2024-09-11T00:26:33.421 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "password", 2024-09-11T00:26:33.421 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.422 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.422 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.422 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.422 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.422 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.422 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.422 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "password of InfluxDB server user", 2024-09-11T00:26:33.422 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.422 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.422 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.422 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.422 INFO:teuthology.orchestra.run.smithi078.stdout: "port": { 2024-09-11T00:26:33.422 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "port", 2024-09-11T00:26:33.423 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.423 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.423 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.423 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "8086", 2024-09-11T00:26:33.423 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.424 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.424 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.424 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "InfluxDB server port", 2024-09-11T00:26:33.424 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.424 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.424 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.424 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.424 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.424 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.424 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.424 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.424 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.425 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.425 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.425 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.425 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.425 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.425 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.425 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.425 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.425 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.425 INFO:teuthology.orchestra.run.smithi078.stdout: "ssl": { 2024-09-11T00:26:33.425 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ssl", 2024-09-11T00:26:33.425 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.425 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.426 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.426 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "false", 2024-09-11T00:26:33.426 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.426 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.426 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.426 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T00:26:33.426 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.426 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.426 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.426 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.426 INFO:teuthology.orchestra.run.smithi078.stdout: "threads": { 2024-09-11T00:26:33.426 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "threads", 2024-09-11T00:26:33.426 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.426 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.427 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.427 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "5", 2024-09-11T00:26:33.427 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "1", 2024-09-11T00:26:33.427 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "32", 2024-09-11T00:26:33.427 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.427 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T00:26:33.427 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.427 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.427 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.427 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.427 INFO:teuthology.orchestra.run.smithi078.stdout: "username": { 2024-09-11T00:26:33.427 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "username", 2024-09-11T00:26:33.427 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.427 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.428 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.428 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.428 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.428 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.428 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.428 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "username of InfluxDB server user", 2024-09-11T00:26:33.428 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.428 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.428 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.428 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.428 INFO:teuthology.orchestra.run.smithi078.stdout: "verify_ssl": { 2024-09-11T00:26:33.428 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "verify_ssl", 2024-09-11T00:26:33.428 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.428 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.429 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.429 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "true", 2024-09-11T00:26:33.429 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.429 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.429 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.429 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T00:26:33.429 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.429 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.429 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.429 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.429 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.429 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.429 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.430 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "insights", 2024-09-11T00:26:33.430 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.430 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.430 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.430 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.430 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.430 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.430 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.430 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.430 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.430 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.430 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.430 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.431 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.431 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.431 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.431 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.431 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.431 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.431 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.431 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.431 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.432 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.432 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.432 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.432 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.432 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.432 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.432 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.432 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.432 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.432 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.432 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.432 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.432 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.433 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.433 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.433 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.433 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.433 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.433 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.433 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.433 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.433 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.433 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.433 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.433 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.433 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.433 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.433 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.434 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.434 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.434 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.434 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.434 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.434 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.434 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.434 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.434 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.434 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.434 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.434 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.434 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.435 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.435 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.435 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.435 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.435 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.435 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.435 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.435 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.435 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.435 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.435 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.435 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.435 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.435 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.435 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.436 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.436 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.436 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.436 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.436 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.436 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.436 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.436 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.436 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.436 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.436 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.436 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.436 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.437 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "iostat", 2024-09-11T00:26:33.437 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.437 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.437 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.437 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.437 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.437 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.437 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.437 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.437 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.437 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.437 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.437 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.437 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.438 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.438 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.438 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.438 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.438 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.438 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.438 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.438 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.438 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.438 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.438 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.438 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.438 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.438 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.439 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.439 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.439 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.439 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.439 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.439 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.439 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.439 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.439 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.439 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.439 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.439 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.439 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.439 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.440 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.440 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.440 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.440 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.440 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.440 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.440 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.440 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.440 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.440 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.440 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.440 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.440 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.440 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.441 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.441 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.441 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.441 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.441 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.441 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.441 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.441 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.441 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.441 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.441 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.441 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.441 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.441 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.442 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.442 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.442 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.442 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.442 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.442 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.442 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.442 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.442 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.442 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.442 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.442 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.442 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.442 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.443 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.443 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.443 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.443 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.443 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.443 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.443 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.443 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "k8sevents", 2024-09-11T00:26:33.443 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.443 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.443 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.443 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_event_retention_days": { 2024-09-11T00:26:33.443 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "ceph_event_retention_days", 2024-09-11T00:26:33.443 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.444 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.444 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.444 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "7", 2024-09-11T00:26:33.444 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.444 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.444 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.444 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T00:26:33.444 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.444 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.444 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.444 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.444 INFO:teuthology.orchestra.run.smithi078.stdout: "config_check_secs": { 2024-09-11T00:26:33.444 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "config_check_secs", 2024-09-11T00:26:33.445 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.445 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.445 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.445 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:33.445 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "10", 2024-09-11T00:26:33.445 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.445 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.445 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T00:26:33.445 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.445 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.445 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.445 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.445 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.446 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.446 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.446 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.446 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.446 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.446 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.446 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.446 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.446 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.446 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.446 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.446 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.446 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.446 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.447 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.447 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.447 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.447 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.447 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.447 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.447 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.447 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.447 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.447 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.447 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.447 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.447 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.447 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.448 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.448 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.448 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.448 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.448 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.448 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.448 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.448 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.448 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.448 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.448 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.448 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.448 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.448 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.449 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.449 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.449 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.449 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.449 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.449 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.449 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.449 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.449 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.449 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.449 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.449 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.450 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.450 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.450 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.450 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.450 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.450 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.450 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.450 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.450 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.450 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.450 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.450 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.450 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.451 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.451 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.451 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.451 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.451 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.451 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.451 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.451 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.451 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.451 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.451 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.451 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.451 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.451 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.451 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.452 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.452 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.452 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.452 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.452 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "localpool", 2024-09-11T00:26:33.452 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.452 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.452 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.452 INFO:teuthology.orchestra.run.smithi078.stdout: "failure_domain": { 2024-09-11T00:26:33.452 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "failure_domain", 2024-09-11T00:26:33.452 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.452 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.452 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.452 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "host", 2024-09-11T00:26:33.453 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.453 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.453 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.453 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "failure domain for any created local pool", 2024-09-11T00:26:33.453 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T00:26:33.453 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.453 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.453 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.453 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.453 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.453 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.453 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.453 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.453 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.454 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.454 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.454 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.454 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.454 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.454 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.454 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.454 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.454 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.454 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.454 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.454 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.454 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.454 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.454 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.455 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.455 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.455 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.455 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.455 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.455 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.455 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.455 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.455 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.455 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.455 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.455 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.455 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.455 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.456 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.456 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.456 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.456 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.456 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.456 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.456 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.456 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.456 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.456 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.456 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.456 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.456 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.457 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.457 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.457 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.457 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.457 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.457 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.457 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.457 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.457 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.457 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.457 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.457 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.457 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.458 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.458 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.458 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.458 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.458 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.458 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.458 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.458 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.458 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.458 INFO:teuthology.orchestra.run.smithi078.stdout: "min_size": { 2024-09-11T00:26:33.458 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "min_size", 2024-09-11T00:26:33.458 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.458 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.458 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.458 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.459 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.459 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.459 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.459 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "default min_size for any created local pool", 2024-09-11T00:26:33.459 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T00:26:33.459 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.459 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.459 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.459 INFO:teuthology.orchestra.run.smithi078.stdout: "num_rep": { 2024-09-11T00:26:33.459 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "num_rep", 2024-09-11T00:26:33.459 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.459 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.459 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.459 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "3", 2024-09-11T00:26:33.460 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.460 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.460 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.460 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "default replica count for any created local pool", 2024-09-11T00:26:33.460 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.460 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.460 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.460 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.460 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_num": { 2024-09-11T00:26:33.460 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "pg_num", 2024-09-11T00:26:33.460 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.460 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.460 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.460 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "128", 2024-09-11T00:26:33.461 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.461 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.461 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.461 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T00:26:33.461 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.461 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.461 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.461 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.461 INFO:teuthology.orchestra.run.smithi078.stdout: "prefix": { 2024-09-11T00:26:33.461 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "prefix", 2024-09-11T00:26:33.461 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.461 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.461 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.461 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.462 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.462 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.462 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.462 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "name prefix for any created local pool", 2024-09-11T00:26:33.462 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.462 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.462 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.462 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.462 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.462 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.462 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.462 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.462 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.462 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.463 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.463 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.463 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.463 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.463 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.463 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.463 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.463 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.463 INFO:teuthology.orchestra.run.smithi078.stdout: "subtree": { 2024-09-11T00:26:33.463 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "subtree", 2024-09-11T00:26:33.463 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.463 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.463 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.463 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "rack", 2024-09-11T00:26:33.464 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.464 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.464 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.464 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T00:26:33.464 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T00:26:33.464 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.464 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.464 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.464 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.464 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.464 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.464 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "mds_autoscaler", 2024-09-11T00:26:33.464 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.464 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.465 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.465 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.465 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.465 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.465 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.465 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.465 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.465 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.465 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.465 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.465 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.465 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.465 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.465 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.465 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.466 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.466 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.466 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.466 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.466 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.466 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.466 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.466 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.466 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.466 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.466 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.466 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.466 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.466 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.467 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.467 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.467 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.467 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.467 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.467 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.467 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.467 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.467 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.467 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.467 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.467 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.467 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.467 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.468 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.468 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.468 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.468 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.468 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.468 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.468 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.468 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.468 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.468 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.468 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.468 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.468 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.468 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.469 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.469 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.469 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.469 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.469 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.469 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.469 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.469 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.469 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.469 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.469 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.469 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.469 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.469 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.470 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.470 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.470 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.470 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.470 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.470 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.470 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.470 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.470 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.471 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.471 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.471 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.471 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.471 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.471 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.471 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.471 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.471 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "mirroring", 2024-09-11T00:26:33.471 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.471 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.471 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.471 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.472 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.472 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.472 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.472 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.472 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.472 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.472 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.472 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.472 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.472 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.472 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.472 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.473 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.473 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.473 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.473 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.473 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.473 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.473 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.473 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.473 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.473 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.474 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.474 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.474 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.474 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.474 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.474 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.474 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.474 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.474 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.474 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.474 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.474 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.474 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.474 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.475 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.475 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.475 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.475 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.475 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.475 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.475 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.475 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.475 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.475 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.476 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.476 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.476 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.476 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.476 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.476 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.476 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.476 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.476 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.476 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.476 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.476 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.477 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.477 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.477 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.477 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.477 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.477 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.477 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.477 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.477 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.477 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.477 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.478 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.478 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.478 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.478 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.478 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.478 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.478 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.478 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.478 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.478 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.478 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.478 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.479 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.479 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.479 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.479 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.479 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.479 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "nfs", 2024-09-11T00:26:33.479 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.479 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.479 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.479 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.479 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.480 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.480 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.480 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.480 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.480 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.480 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.480 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.480 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.480 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.480 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.480 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.481 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.481 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.481 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.481 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.481 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.481 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.481 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.481 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.481 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.481 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.482 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.482 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.482 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.482 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.482 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.482 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.482 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.483 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.483 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.483 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.483 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.483 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.483 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.483 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.483 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.483 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.483 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.483 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.483 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.483 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.484 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.484 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.484 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.484 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.484 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.484 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.484 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.484 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.484 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.484 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.484 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.484 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.484 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.484 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.485 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.485 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.485 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.485 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.485 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.485 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.485 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.485 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.485 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.485 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.485 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.485 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.485 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.485 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.486 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.486 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.486 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.486 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.486 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.486 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.486 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.486 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.486 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.486 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.487 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.487 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.487 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.487 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.487 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.487 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.487 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "orchestrator", 2024-09-11T00:26:33.487 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.487 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.488 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.488 INFO:teuthology.orchestra.run.smithi078.stdout: "fail_fs": { 2024-09-11T00:26:33.488 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "fail_fs", 2024-09-11T00:26:33.488 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.488 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.488 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.488 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.488 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.488 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.488 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.488 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T00:26:33.489 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.489 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.489 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.489 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.489 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.489 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.489 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.489 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.489 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.489 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.489 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.489 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.489 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.489 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.490 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.490 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.490 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.490 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.490 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.490 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.490 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.490 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.490 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.490 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.490 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.490 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.490 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.490 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.490 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.491 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.491 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.491 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.491 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.491 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.491 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.491 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.491 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.491 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.491 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.491 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.491 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.491 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.492 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.492 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.492 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.492 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.492 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.492 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.492 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.492 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.492 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.492 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.492 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.492 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.492 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.492 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.493 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.493 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.493 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.493 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.493 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.493 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.493 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.493 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.493 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.493 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.493 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.493 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.493 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.493 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.494 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.494 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.494 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.494 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.494 INFO:teuthology.orchestra.run.smithi078.stdout: "orchestrator": { 2024-09-11T00:26:33.494 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "orchestrator", 2024-09-11T00:26:33.494 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.494 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.494 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.494 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.494 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.494 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.494 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.494 INFO:teuthology.orchestra.run.smithi078.stdout: "cephadm", 2024-09-11T00:26:33.495 INFO:teuthology.orchestra.run.smithi078.stdout: "rook", 2024-09-11T00:26:33.495 INFO:teuthology.orchestra.run.smithi078.stdout: "test_orchestrator" 2024-09-11T00:26:33.495 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.495 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Orchestrator backend", 2024-09-11T00:26:33.495 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.495 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.495 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.495 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.495 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.495 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.495 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.495 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.495 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.495 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.496 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.496 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.496 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.496 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.496 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.496 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.496 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.496 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.496 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.496 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.496 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.496 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "osd_perf_query", 2024-09-11T00:26:33.496 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.496 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.497 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.497 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.497 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.497 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.497 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.497 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.497 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.497 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.497 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.497 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.497 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.497 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.497 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.497 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.498 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.498 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.498 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.498 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.498 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.498 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.498 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.498 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.498 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.498 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.498 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.498 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.498 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.498 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.498 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.499 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.499 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.499 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.499 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.499 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.499 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.499 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.499 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.499 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.499 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.499 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.499 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.499 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.500 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.500 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.500 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.500 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.500 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.500 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.500 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.500 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.500 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.500 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.500 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.500 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.500 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.500 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.501 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.501 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.501 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.501 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.501 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.501 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.501 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.501 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.501 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.501 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.501 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.501 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.501 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.501 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.501 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.502 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.502 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.502 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.502 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.502 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.502 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.502 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.502 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.502 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.502 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.502 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.502 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.502 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.502 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.503 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.503 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.503 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.503 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "osd_support", 2024-09-11T00:26:33.503 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.503 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.503 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.503 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.503 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.503 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.503 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.503 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.503 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.503 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.503 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.504 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.504 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.504 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.504 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.504 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.504 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.504 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.504 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.504 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.504 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.504 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.504 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.504 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.505 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.505 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.505 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.505 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.505 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.505 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.505 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.505 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.505 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.505 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.505 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.505 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.505 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.505 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.506 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.506 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.506 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.506 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.506 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.506 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.506 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.506 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.506 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.506 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.506 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.506 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.506 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.507 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.507 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.507 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.507 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.507 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.507 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.507 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.507 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.507 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.507 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.507 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.507 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.507 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.507 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.508 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.508 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.508 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.508 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.508 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.508 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.508 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.508 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.508 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.508 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.508 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.508 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.508 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.509 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.509 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.509 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.509 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.509 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.509 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.509 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.509 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.509 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.509 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.509 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.509 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.509 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "pg_autoscaler", 2024-09-11T00:26:33.510 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.510 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.510 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.510 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.510 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.510 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.510 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.510 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.510 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.510 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.510 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.510 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.510 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.510 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.511 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.511 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.511 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.511 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.511 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.511 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.511 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.511 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.511 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.511 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.511 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.511 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.511 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.511 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.512 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.512 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.512 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.512 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.512 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.512 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.512 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.512 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.512 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.512 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.512 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.512 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.512 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.512 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.513 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.513 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.513 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.513 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.513 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.513 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.513 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.513 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.513 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.513 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.513 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.513 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.513 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.514 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.514 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.514 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.514 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.514 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.514 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.514 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.514 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.514 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.514 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.514 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.514 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.514 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.514 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.515 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.515 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.515 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.515 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.515 INFO:teuthology.orchestra.run.smithi078.stdout: "sleep_interval": { 2024-09-11T00:26:33.515 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sleep_interval", 2024-09-11T00:26:33.515 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.515 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.515 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.515 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "60", 2024-09-11T00:26:33.515 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.515 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.516 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.516 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.516 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.516 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.516 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.516 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.516 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.516 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.516 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.516 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.517 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.517 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.517 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.517 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.517 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.517 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.517 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.517 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.517 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.517 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.517 INFO:teuthology.orchestra.run.smithi078.stdout: "threshold": { 2024-09-11T00:26:33.517 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "threshold", 2024-09-11T00:26:33.517 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "float", 2024-09-11T00:26:33.518 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.518 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.518 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "3.0", 2024-09-11T00:26:33.518 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "1.0", 2024-09-11T00:26:33.518 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.518 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.518 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "scaling threshold", 2024-09-11T00:26:33.518 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T00:26:33.518 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.518 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.518 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.518 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.518 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.519 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.519 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "progress", 2024-09-11T00:26:33.519 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.519 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.519 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.519 INFO:teuthology.orchestra.run.smithi078.stdout: "allow_pg_recovery_event": { 2024-09-11T00:26:33.519 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "allow_pg_recovery_event", 2024-09-11T00:26:33.519 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.519 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.519 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.519 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.519 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.519 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.519 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.520 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T00:26:33.520 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.520 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.520 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.520 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.520 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": { 2024-09-11T00:26:33.520 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "enabled", 2024-09-11T00:26:33.520 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.520 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.520 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.520 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.520 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.520 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.520 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.521 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.521 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.521 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.521 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.521 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.521 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.521 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.521 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.521 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.521 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.521 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.521 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.521 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.521 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.522 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.522 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.522 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.522 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.522 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.522 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.522 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.522 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.522 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.522 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.522 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.522 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.522 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.522 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.523 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.523 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.523 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.523 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.523 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.523 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.523 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.523 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.524 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.524 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.524 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.524 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.524 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.524 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.524 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.524 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.524 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.524 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.524 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.524 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.525 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.525 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.525 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.525 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.525 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.525 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.525 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.525 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.525 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.525 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.525 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.525 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.525 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.525 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.526 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.526 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.526 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.526 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.526 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.526 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.526 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.526 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.526 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.526 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.526 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.526 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.526 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.526 INFO:teuthology.orchestra.run.smithi078.stdout: "max_completed_events": { 2024-09-11T00:26:33.527 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "max_completed_events", 2024-09-11T00:26:33.527 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.527 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.527 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.527 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "50", 2024-09-11T00:26:33.527 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.527 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.527 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.527 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "number of past completed events to remember", 2024-09-11T00:26:33.527 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.527 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.527 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.527 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.527 INFO:teuthology.orchestra.run.smithi078.stdout: "sleep_interval": { 2024-09-11T00:26:33.528 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sleep_interval", 2024-09-11T00:26:33.528 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.528 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.528 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.528 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "5", 2024-09-11T00:26:33.528 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.528 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.528 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.528 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "how long the module is going to sleep", 2024-09-11T00:26:33.528 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.528 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.528 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.528 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.528 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.529 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.529 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.529 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.529 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.529 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.529 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.529 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.529 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.529 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.529 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.529 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.529 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.529 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.530 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.530 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.530 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.530 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "prometheus", 2024-09-11T00:26:33.530 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.530 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.530 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.530 INFO:teuthology.orchestra.run.smithi078.stdout: "cache": { 2024-09-11T00:26:33.530 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "cache", 2024-09-11T00:26:33.530 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.530 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.530 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.530 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.530 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.531 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.531 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.531 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.531 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.531 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.531 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.531 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.531 INFO:teuthology.orchestra.run.smithi078.stdout: "exclude_perf_counters": { 2024-09-11T00:26:33.531 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "exclude_perf_counters", 2024-09-11T00:26:33.532 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.532 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.532 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.532 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.532 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.532 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.532 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.532 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T00:26:33.532 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T00:26:33.532 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.532 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.532 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.532 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.533 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.533 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.533 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.533 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.533 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.533 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.533 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.533 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.533 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.533 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.533 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.533 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.533 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.533 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.534 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.534 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.534 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.534 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.534 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.534 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.534 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.534 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.534 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.534 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.534 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.534 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.534 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.534 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.535 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.535 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.535 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.535 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.535 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.535 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.535 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.535 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.535 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.535 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.535 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.535 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.535 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.536 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.536 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.536 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.536 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.536 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.536 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.536 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.536 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.536 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.536 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.536 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.536 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.536 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.536 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.537 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.537 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.537 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.537 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.537 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.537 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.537 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.537 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.537 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.537 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.537 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.537 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.537 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.538 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.538 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_stats_pools": { 2024-09-11T00:26:33.538 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rbd_stats_pools", 2024-09-11T00:26:33.538 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.538 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.538 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.538 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.538 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.538 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.538 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.538 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.538 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.538 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.538 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.539 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.539 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T00:26:33.539 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T00:26:33.539 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.539 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.539 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.539 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "300", 2024-09-11T00:26:33.539 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.539 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.539 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.539 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.539 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.539 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.539 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.540 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.540 INFO:teuthology.orchestra.run.smithi078.stdout: "scrape_interval": { 2024-09-11T00:26:33.540 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "scrape_interval", 2024-09-11T00:26:33.540 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "float", 2024-09-11T00:26:33.540 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.540 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.540 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "15.0", 2024-09-11T00:26:33.540 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.540 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.540 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.540 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.540 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.540 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.540 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.541 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.541 INFO:teuthology.orchestra.run.smithi078.stdout: "server_addr": { 2024-09-11T00:26:33.541 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "server_addr", 2024-09-11T00:26:33.541 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.541 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.541 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.541 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "::", 2024-09-11T00:26:33.541 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.541 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.541 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.541 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T00:26:33.541 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.541 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.541 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.542 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.542 INFO:teuthology.orchestra.run.smithi078.stdout: "server_port": { 2024-09-11T00:26:33.542 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "server_port", 2024-09-11T00:26:33.542 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.542 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.542 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.542 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "9283", 2024-09-11T00:26:33.542 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.542 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.542 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.542 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T00:26:33.542 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.542 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.543 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.543 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.543 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.543 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.543 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.543 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.543 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.543 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.543 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.543 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.543 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.543 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.543 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.543 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.544 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.544 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.544 INFO:teuthology.orchestra.run.smithi078.stdout: "stale_cache_strategy": { 2024-09-11T00:26:33.544 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "stale_cache_strategy", 2024-09-11T00:26:33.544 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.544 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.544 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.544 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "log", 2024-09-11T00:26:33.544 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.544 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.544 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.544 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.544 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.545 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.545 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.545 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.545 INFO:teuthology.orchestra.run.smithi078.stdout: "standby_behaviour": { 2024-09-11T00:26:33.545 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "standby_behaviour", 2024-09-11T00:26:33.545 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.545 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.545 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.545 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "default", 2024-09-11T00:26:33.545 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.545 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.545 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.545 INFO:teuthology.orchestra.run.smithi078.stdout: "default", 2024-09-11T00:26:33.545 INFO:teuthology.orchestra.run.smithi078.stdout: "error" 2024-09-11T00:26:33.546 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.546 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.546 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.546 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.546 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.546 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.546 INFO:teuthology.orchestra.run.smithi078.stdout: "standby_error_status_code": { 2024-09-11T00:26:33.546 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "standby_error_status_code", 2024-09-11T00:26:33.546 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.546 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.546 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.546 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "500", 2024-09-11T00:26:33.546 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "400", 2024-09-11T00:26:33.546 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "599", 2024-09-11T00:26:33.547 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.547 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.547 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.547 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.547 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.547 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.547 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.547 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.547 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.547 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rbd_support", 2024-09-11T00:26:33.547 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.547 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.547 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.547 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.548 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.548 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.548 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.548 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.548 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.548 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.548 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.548 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.548 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.548 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.548 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.548 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.548 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.548 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.549 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.549 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.549 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.549 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.549 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.549 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.549 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.549 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.549 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.549 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.549 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.549 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.549 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.549 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.550 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.550 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.550 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.550 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.550 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.550 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.550 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.550 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.550 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.550 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.550 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.550 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.550 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.550 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.551 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.551 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.551 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.551 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.551 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.551 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.551 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.551 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.551 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.551 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.551 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.551 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.551 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.551 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.552 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.552 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.552 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.552 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.552 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.552 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.552 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.552 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.552 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.552 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.552 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.552 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.552 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.552 INFO:teuthology.orchestra.run.smithi078.stdout: "max_concurrent_snap_create": { 2024-09-11T00:26:33.553 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "max_concurrent_snap_create", 2024-09-11T00:26:33.553 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.553 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.553 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.553 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10", 2024-09-11T00:26:33.553 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.553 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.553 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.553 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.553 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.553 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.553 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.553 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.553 INFO:teuthology.orchestra.run.smithi078.stdout: "mirror_snapshot_schedule": { 2024-09-11T00:26:33.553 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T00:26:33.554 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.554 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.554 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.554 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.554 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.554 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.554 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.554 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.554 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.554 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.554 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.554 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.554 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.554 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.555 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.555 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.555 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.555 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.555 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.555 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.555 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.555 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.555 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.555 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.555 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.555 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.555 INFO:teuthology.orchestra.run.smithi078.stdout: "trash_purge_schedule": { 2024-09-11T00:26:33.555 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "trash_purge_schedule", 2024-09-11T00:26:33.556 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.556 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.556 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.556 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.556 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.556 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.556 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.556 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.556 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.556 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.556 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.556 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.556 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.556 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.557 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.557 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "restful", 2024-09-11T00:26:33.557 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.557 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.557 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.557 INFO:teuthology.orchestra.run.smithi078.stdout: "enable_auth": { 2024-09-11T00:26:33.557 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "enable_auth", 2024-09-11T00:26:33.557 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.557 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.557 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.557 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.557 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.557 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.558 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.558 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.558 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.558 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.558 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.558 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.558 INFO:teuthology.orchestra.run.smithi078.stdout: "key_file": { 2024-09-11T00:26:33.558 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "key_file", 2024-09-11T00:26:33.558 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.558 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.558 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.558 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.558 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.558 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.559 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.559 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.559 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.559 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.559 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.559 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.559 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.559 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.559 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.559 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.559 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.559 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.559 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.559 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.560 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.560 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.560 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.560 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.560 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.560 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.560 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.560 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.560 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.560 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.560 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.560 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.560 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.561 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.561 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.561 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.561 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.561 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.561 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.561 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.561 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.561 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.561 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.561 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.561 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.561 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.562 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.562 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.562 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.562 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.562 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.562 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.562 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.562 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.562 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.562 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.562 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.562 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.562 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.562 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.563 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.563 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.563 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.563 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.563 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.563 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.563 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.563 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.563 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.563 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.563 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.563 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.563 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.564 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.564 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.564 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.564 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.564 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.564 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.564 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.564 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.564 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.564 INFO:teuthology.orchestra.run.smithi078.stdout: "max_requests": { 2024-09-11T00:26:33.564 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "max_requests", 2024-09-11T00:26:33.564 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.564 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.564 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.565 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "500", 2024-09-11T00:26:33.565 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.565 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.569 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.569 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-11T00:26:33.569 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.569 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.570 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.570 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.570 INFO:teuthology.orchestra.run.smithi078.stdout: "server_addr": { 2024-09-11T00:26:33.570 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "server_addr", 2024-09-11T00:26:33.570 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.570 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.570 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.570 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.570 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.570 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.570 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.570 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.570 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.571 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.571 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.571 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.571 INFO:teuthology.orchestra.run.smithi078.stdout: "server_port": { 2024-09-11T00:26:33.571 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "server_port", 2024-09-11T00:26:33.571 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.571 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.571 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.571 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.571 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.571 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.571 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.571 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.571 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.572 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.572 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.572 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.572 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.572 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.572 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.572 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.572 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.572 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.572 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.572 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.572 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.572 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.572 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.573 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.573 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.573 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.573 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.573 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.573 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.573 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rgw", 2024-09-11T00:26:33.573 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.573 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.573 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.573 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.573 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.573 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.573 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.574 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.574 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.574 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.574 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.574 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.574 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.574 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.574 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.574 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.574 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.574 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.574 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.574 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.575 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.575 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.575 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.575 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.575 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.575 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.575 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.575 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.575 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.575 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.575 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.575 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.575 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.575 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.576 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.576 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.576 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.576 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.576 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.576 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.576 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.576 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.576 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.576 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.576 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.576 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.576 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.576 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.577 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.577 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.577 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.577 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.577 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.577 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.577 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.577 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.577 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.577 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.577 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.577 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.577 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.577 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.578 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.578 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.578 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.578 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.578 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.578 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.578 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.578 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.578 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.578 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.578 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.578 INFO:teuthology.orchestra.run.smithi078.stdout: "secondary_zone_period_retry_limit": { 2024-09-11T00:26:33.578 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-11T00:26:33.578 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.579 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.579 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.579 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "5", 2024-09-11T00:26:33.579 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.579 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.579 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.579 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-11T00:26:33.579 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.579 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.579 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.579 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.579 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.579 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.579 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.580 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.580 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.580 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.580 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.580 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.580 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.580 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.580 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.580 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.580 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.580 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.580 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.580 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.580 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.581 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rook", 2024-09-11T00:26:33.581 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.581 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.581 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.581 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.581 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.581 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.581 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.581 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.581 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.581 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.581 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.581 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.581 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.582 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.582 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.582 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.582 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.582 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.582 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.582 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.582 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.582 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.582 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.582 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.582 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.582 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.582 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.583 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.583 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.583 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.583 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.583 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.583 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.583 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.584 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.584 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.584 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.584 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.584 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.584 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.584 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.584 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.584 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.584 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.584 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.584 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.584 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.584 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.585 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.585 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.585 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.585 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.585 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.585 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.585 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.585 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.585 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.585 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.585 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.585 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.585 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.585 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.586 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.586 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.586 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.586 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.586 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.586 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.586 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.586 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.586 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.586 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.586 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.586 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.586 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.586 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.587 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.587 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.587 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.587 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.587 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.587 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.587 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.587 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.587 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.587 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.587 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.587 INFO:teuthology.orchestra.run.smithi078.stdout: "storage_class": { 2024-09-11T00:26:33.587 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "storage_class", 2024-09-11T00:26:33.587 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.588 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.588 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.588 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "local", 2024-09-11T00:26:33.588 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.588 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.588 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.588 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T00:26:33.588 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.588 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.588 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.588 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.588 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.588 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.589 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.589 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "selftest", 2024-09-11T00:26:33.589 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.589 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.589 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.589 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.589 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.589 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.589 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.589 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.589 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.589 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.589 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.589 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.590 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.590 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.590 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.590 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.590 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.590 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.590 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.590 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.590 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.590 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.590 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.590 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.590 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.591 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.591 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.591 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.591 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.591 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.591 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.591 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.591 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.591 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.591 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.591 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.591 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.591 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.591 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.592 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.592 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.592 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.592 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.592 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.592 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.592 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.592 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.592 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.592 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.592 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.592 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.592 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.592 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.593 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.593 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.593 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.593 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.593 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.593 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.593 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.593 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.593 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.593 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.593 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.593 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.593 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.593 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.594 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.594 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.594 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.594 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.594 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.594 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.594 INFO:teuthology.orchestra.run.smithi078.stdout: "roption1": { 2024-09-11T00:26:33.594 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "roption1", 2024-09-11T00:26:33.594 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.594 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.594 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.594 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.594 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.594 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.595 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.595 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.595 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.595 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.595 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.595 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.595 INFO:teuthology.orchestra.run.smithi078.stdout: "roption2": { 2024-09-11T00:26:33.595 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "roption2", 2024-09-11T00:26:33.595 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.595 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.595 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.595 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "xyz", 2024-09-11T00:26:33.595 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.595 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.595 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.596 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.596 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.596 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.596 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.596 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.596 INFO:teuthology.orchestra.run.smithi078.stdout: "rwoption1": { 2024-09-11T00:26:33.596 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rwoption1", 2024-09-11T00:26:33.596 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.596 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.596 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.596 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.596 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.596 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.596 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.597 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.597 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.597 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.597 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.597 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.597 INFO:teuthology.orchestra.run.smithi078.stdout: "rwoption2": { 2024-09-11T00:26:33.597 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rwoption2", 2024-09-11T00:26:33.597 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.597 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.597 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.597 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.597 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.597 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.597 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.598 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.598 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.598 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.598 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.598 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.598 INFO:teuthology.orchestra.run.smithi078.stdout: "rwoption3": { 2024-09-11T00:26:33.598 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rwoption3", 2024-09-11T00:26:33.598 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "float", 2024-09-11T00:26:33.598 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.598 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.598 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.598 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.598 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.599 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.599 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.599 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.599 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.599 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.599 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.599 INFO:teuthology.orchestra.run.smithi078.stdout: "rwoption4": { 2024-09-11T00:26:33.599 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rwoption4", 2024-09-11T00:26:33.599 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.599 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.599 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.599 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.599 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.599 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.600 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.600 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.600 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.600 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.600 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.600 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.600 INFO:teuthology.orchestra.run.smithi078.stdout: "rwoption5": { 2024-09-11T00:26:33.600 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rwoption5", 2024-09-11T00:26:33.600 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.600 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.600 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.601 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.601 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.601 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.601 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.601 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.601 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.601 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.601 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.601 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.601 INFO:teuthology.orchestra.run.smithi078.stdout: "rwoption6": { 2024-09-11T00:26:33.601 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rwoption6", 2024-09-11T00:26:33.601 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.602 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.602 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.602 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.602 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.602 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.602 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.602 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.602 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.602 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.602 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.602 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.602 INFO:teuthology.orchestra.run.smithi078.stdout: "rwoption7": { 2024-09-11T00:26:33.603 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rwoption7", 2024-09-11T00:26:33.603 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.603 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.603 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.603 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.603 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "1", 2024-09-11T00:26:33.603 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "42", 2024-09-11T00:26:33.603 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.603 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.603 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.603 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.603 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.603 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.604 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.604 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.604 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.604 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.604 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.604 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.604 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.604 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.604 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.604 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.604 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.604 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.604 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.605 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.605 INFO:teuthology.orchestra.run.smithi078.stdout: "testkey": { 2024-09-11T00:26:33.605 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "testkey", 2024-09-11T00:26:33.605 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.605 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.605 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.605 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.605 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.605 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.605 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.605 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.605 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.606 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.606 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.606 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.606 INFO:teuthology.orchestra.run.smithi078.stdout: "testlkey": { 2024-09-11T00:26:33.606 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "testlkey", 2024-09-11T00:26:33.606 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.606 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.606 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.606 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.606 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.606 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.606 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.606 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.607 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.607 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.607 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.607 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.607 INFO:teuthology.orchestra.run.smithi078.stdout: "testnewline": { 2024-09-11T00:26:33.607 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "testnewline", 2024-09-11T00:26:33.607 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.607 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.607 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.607 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.607 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.607 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.608 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.608 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.608 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.608 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.608 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.608 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.608 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.608 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.608 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.608 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "smb", 2024-09-11T00:26:33.608 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.608 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.608 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.609 INFO:teuthology.orchestra.run.smithi078.stdout: "internal_store_backend": { 2024-09-11T00:26:33.609 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "internal_store_backend", 2024-09-11T00:26:33.609 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.609 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.609 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.609 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.609 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.609 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.609 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.609 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-11T00:26:33.609 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.609 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.609 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.609 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.610 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.610 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.610 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.610 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.610 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.610 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.610 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.610 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.610 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.610 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.610 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.610 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.610 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.611 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.611 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.611 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.611 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.611 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.611 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.611 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.611 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.611 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.611 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.611 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.611 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.611 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.611 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.612 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.612 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.612 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.612 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.612 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.612 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.612 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.612 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.612 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.612 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.612 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.612 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.612 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.612 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.613 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.613 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.613 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.613 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.613 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.613 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.613 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.613 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.613 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.613 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.613 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.613 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.613 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.613 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.614 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.614 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.614 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.614 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.614 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.614 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.614 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.614 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.614 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.614 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.614 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.614 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.614 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.614 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.615 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.615 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.615 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.615 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.615 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.615 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.615 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.615 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.615 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.615 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.615 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.615 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.615 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.615 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.616 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.616 INFO:teuthology.orchestra.run.smithi078.stdout: "update_orchestration": { 2024-09-11T00:26:33.616 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "update_orchestration", 2024-09-11T00:26:33.616 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.616 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.616 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.616 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.616 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.616 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.616 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.616 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-11T00:26:33.616 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.616 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.617 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.617 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.617 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.617 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.617 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.617 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "snap_schedule", 2024-09-11T00:26:33.617 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.617 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.617 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.617 INFO:teuthology.orchestra.run.smithi078.stdout: "allow_m_granularity": { 2024-09-11T00:26:33.617 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "allow_m_granularity", 2024-09-11T00:26:33.617 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.617 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.617 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.618 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.618 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.618 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.618 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.618 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T00:26:33.618 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.618 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.618 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.618 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.618 INFO:teuthology.orchestra.run.smithi078.stdout: "dump_on_update": { 2024-09-11T00:26:33.618 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "dump_on_update", 2024-09-11T00:26:33.618 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.618 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.619 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.619 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.619 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.619 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.619 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.619 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "dump database to debug log on update", 2024-09-11T00:26:33.619 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.619 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.619 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.619 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.619 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.619 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.619 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.619 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.620 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.620 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.620 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.620 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.620 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.620 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.620 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.620 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.620 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.620 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.620 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.620 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.621 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.621 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.621 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.621 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.621 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.621 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.621 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.621 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.621 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.621 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.621 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.621 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.621 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.622 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.622 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.622 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.622 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.622 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.622 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.622 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.622 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.622 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.622 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.622 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.622 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.622 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.622 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.623 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.623 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.623 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.623 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.623 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.623 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.623 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.623 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.623 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.623 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.623 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.623 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.623 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.624 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.624 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.624 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.624 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.624 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.624 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.624 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.624 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.624 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.625 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.625 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.625 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.625 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.625 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.625 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.625 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.625 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.625 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.625 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.625 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.625 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.626 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.626 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.626 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.626 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.626 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.626 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.626 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.626 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.626 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.626 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.626 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "stats", 2024-09-11T00:26:33.626 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.626 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.627 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.627 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.627 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.627 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.627 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.627 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.627 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.627 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.627 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.627 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.627 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.627 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.627 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.627 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.628 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.628 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.628 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.628 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.628 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.628 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.628 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.628 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.628 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.628 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.628 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.628 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.628 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.629 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.629 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.629 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.629 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.629 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.629 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.629 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.629 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.629 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.629 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.629 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.629 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.629 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.630 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.630 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.630 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.630 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.630 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.630 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.630 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.630 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.630 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.630 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.630 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.630 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.630 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.630 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.630 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.631 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.631 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.631 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.631 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.631 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.631 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.631 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.631 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.631 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.631 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.632 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.632 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.632 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.632 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.632 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.632 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.632 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.632 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.632 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.632 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.632 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.633 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.633 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.633 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.633 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.633 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.633 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.633 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.633 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.633 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.633 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.633 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.633 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.633 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "status", 2024-09-11T00:26:33.634 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.634 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.634 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.634 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.634 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.634 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.634 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.634 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.634 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.634 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.634 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.634 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.634 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.634 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.635 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.635 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.635 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.635 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.635 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.635 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.635 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.635 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.635 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.635 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.635 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.635 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.635 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.635 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.636 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.636 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.636 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.636 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.636 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.636 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.636 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.636 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.636 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.636 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.636 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.636 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.636 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.636 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.637 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.637 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.637 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.637 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.637 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.637 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.637 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.637 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.637 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.637 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.637 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.637 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.637 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.638 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.638 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.638 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.638 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.638 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.638 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.638 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.638 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.638 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.638 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.638 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.638 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.638 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.638 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.639 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.639 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.639 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.639 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.639 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.639 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.639 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.639 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.639 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.639 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.639 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.639 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.639 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.639 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.640 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.640 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.640 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.640 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.640 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.640 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.640 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.640 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "telegraf", 2024-09-11T00:26:33.640 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.640 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.640 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.640 INFO:teuthology.orchestra.run.smithi078.stdout: "address": { 2024-09-11T00:26:33.640 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "address", 2024-09-11T00:26:33.641 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.641 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.641 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.641 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T00:26:33.641 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.641 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.641 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.641 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.641 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.641 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.641 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.641 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.641 INFO:teuthology.orchestra.run.smithi078.stdout: "interval": { 2024-09-11T00:26:33.641 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "interval", 2024-09-11T00:26:33.642 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.642 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.642 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.642 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "15", 2024-09-11T00:26:33.642 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.642 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.642 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.642 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.642 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.642 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.642 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.642 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.642 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.642 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.643 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.643 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.643 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.643 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.643 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.643 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.643 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.643 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.643 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.643 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.643 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.643 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.643 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.643 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.644 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.644 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.644 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.644 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.644 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.644 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.644 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.644 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.644 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.644 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.644 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.644 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.644 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.644 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.645 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.645 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.645 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.645 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.645 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.645 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.645 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.645 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.645 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.645 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.645 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.645 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.645 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.645 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.646 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.646 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.646 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.646 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.646 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.646 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.646 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.646 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.646 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.646 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.646 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.646 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.646 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.646 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.647 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.647 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.647 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.647 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.647 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.647 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.647 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.647 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.647 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.647 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.647 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.647 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.647 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.647 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.648 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.648 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.648 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.648 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.648 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.648 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.648 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.648 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.648 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.648 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.648 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.648 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.648 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.648 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.649 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.649 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "telemetry", 2024-09-11T00:26:33.649 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.649 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.649 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.649 INFO:teuthology.orchestra.run.smithi078.stdout: "channel_basic": { 2024-09-11T00:26:33.649 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "channel_basic", 2024-09-11T00:26:33.649 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.649 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.649 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.649 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.649 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.649 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.649 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.650 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T00:26:33.650 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.650 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.650 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.650 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.650 INFO:teuthology.orchestra.run.smithi078.stdout: "channel_crash": { 2024-09-11T00:26:33.650 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "channel_crash", 2024-09-11T00:26:33.650 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.650 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.650 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.650 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.650 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.650 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.650 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.651 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T00:26:33.651 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.651 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.651 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.651 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.651 INFO:teuthology.orchestra.run.smithi078.stdout: "channel_device": { 2024-09-11T00:26:33.651 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "channel_device", 2024-09-11T00:26:33.651 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.651 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.651 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.651 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.651 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.651 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.651 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.652 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T00:26:33.652 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.652 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.652 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.652 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.652 INFO:teuthology.orchestra.run.smithi078.stdout: "channel_ident": { 2024-09-11T00:26:33.652 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "channel_ident", 2024-09-11T00:26:33.652 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.652 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.652 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.652 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.652 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.652 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.652 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.653 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T00:26:33.653 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.653 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.653 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.653 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.653 INFO:teuthology.orchestra.run.smithi078.stdout: "channel_perf": { 2024-09-11T00:26:33.653 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "channel_perf", 2024-09-11T00:26:33.653 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.653 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.653 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.653 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.653 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.653 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.654 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.654 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T00:26:33.654 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.654 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.654 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.654 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.654 INFO:teuthology.orchestra.run.smithi078.stdout: "contact": { 2024-09-11T00:26:33.654 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "contact", 2024-09-11T00:26:33.654 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.654 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.654 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.654 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.654 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.654 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.654 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.655 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.655 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.655 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.655 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.655 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.655 INFO:teuthology.orchestra.run.smithi078.stdout: "description": { 2024-09-11T00:26:33.655 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "description", 2024-09-11T00:26:33.655 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.655 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.655 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.655 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.655 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.655 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.655 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.656 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.656 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.656 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.656 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.656 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.656 INFO:teuthology.orchestra.run.smithi078.stdout: "device_url": { 2024-09-11T00:26:33.656 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "device_url", 2024-09-11T00:26:33.656 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.656 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.656 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.656 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T00:26:33.656 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.656 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.657 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.657 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.657 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.657 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.657 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.657 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.657 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": { 2024-09-11T00:26:33.657 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "enabled", 2024-09-11T00:26:33.657 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.657 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.657 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.657 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.657 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.657 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.658 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.658 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.658 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.658 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.658 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.658 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.658 INFO:teuthology.orchestra.run.smithi078.stdout: "interval": { 2024-09-11T00:26:33.658 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "interval", 2024-09-11T00:26:33.658 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.658 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.658 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.658 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "24", 2024-09-11T00:26:33.659 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "8", 2024-09-11T00:26:33.659 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.659 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.659 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.659 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.659 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.659 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.659 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.659 INFO:teuthology.orchestra.run.smithi078.stdout: "last_opt_revision": { 2024-09-11T00:26:33.659 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "last_opt_revision", 2024-09-11T00:26:33.659 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.660 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.660 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.660 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "1", 2024-09-11T00:26:33.660 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.660 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.660 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.660 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.660 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.660 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.660 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.661 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.661 INFO:teuthology.orchestra.run.smithi078.stdout: "leaderboard": { 2024-09-11T00:26:33.661 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "leaderboard", 2024-09-11T00:26:33.661 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.661 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.661 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.661 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.661 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.661 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.661 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.662 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.662 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.662 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.662 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.662 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.662 INFO:teuthology.orchestra.run.smithi078.stdout: "leaderboard_description": { 2024-09-11T00:26:33.662 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "leaderboard_description", 2024-09-11T00:26:33.662 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.662 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.662 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.663 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.663 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.663 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.663 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.663 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.663 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.663 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.663 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.663 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.663 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.663 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.664 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.664 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.664 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.664 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.664 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.664 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.664 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.664 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.664 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.664 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.665 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.665 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.665 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.665 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.665 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.665 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.665 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.665 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.665 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.665 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.666 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.666 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.666 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.666 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.666 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.666 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.666 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.666 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.666 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.666 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.666 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.666 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.667 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.667 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.667 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.667 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.667 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.667 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.667 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.667 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.667 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.667 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.667 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.667 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.667 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.668 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.668 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.668 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.668 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.668 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.668 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.668 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.668 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.668 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.668 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.668 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.668 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.668 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.668 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.669 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.669 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.669 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.669 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.669 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.669 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.669 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.669 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.669 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.669 INFO:teuthology.orchestra.run.smithi078.stdout: "organization": { 2024-09-11T00:26:33.669 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "organization", 2024-09-11T00:26:33.669 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.669 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.669 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.670 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.670 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.670 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.670 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.670 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.670 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.670 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.670 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.670 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.670 INFO:teuthology.orchestra.run.smithi078.stdout: "proxy": { 2024-09-11T00:26:33.670 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "proxy", 2024-09-11T00:26:33.670 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.670 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.670 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.670 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.671 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.671 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.671 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.671 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.671 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.671 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.671 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.671 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.671 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.671 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.671 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.671 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.671 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.671 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.672 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.672 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.672 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.672 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.672 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.672 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.672 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.672 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.672 INFO:teuthology.orchestra.run.smithi078.stdout: "url": { 2024-09-11T00:26:33.672 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "url", 2024-09-11T00:26:33.672 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.672 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.672 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.672 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T00:26:33.672 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.673 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.673 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.673 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.673 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.673 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.673 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.673 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.673 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.673 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.673 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.673 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "test_orchestrator", 2024-09-11T00:26:33.673 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.673 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.673 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.674 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.674 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.674 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.674 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.674 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.674 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.674 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.674 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.674 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.674 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.674 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.674 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.674 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.674 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.675 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.675 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.675 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.675 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.675 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.675 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.675 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.675 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.675 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.675 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.675 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.675 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.675 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.675 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.676 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.676 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.676 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.676 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.676 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.676 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.676 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.676 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.676 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.676 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.676 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.676 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.676 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.676 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.677 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.677 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.677 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.677 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.677 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.677 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.677 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.677 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.677 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.677 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.677 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.677 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.677 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.677 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.678 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.678 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.678 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.678 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.678 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.678 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.678 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.678 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.678 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.678 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.678 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.678 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.678 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.678 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.679 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.679 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.679 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.679 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.679 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.679 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.679 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.679 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.679 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.679 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.679 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.679 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.679 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.679 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.679 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.680 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.680 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.680 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "volumes", 2024-09-11T00:26:33.680 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.680 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.680 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.680 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.680 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.680 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.680 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.680 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.680 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.680 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.680 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.681 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.681 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.681 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.681 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.681 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.681 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.681 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.681 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.681 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.681 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.681 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.681 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.681 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.681 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.681 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.682 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.682 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.682 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.682 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.682 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.682 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.682 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.682 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.682 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.682 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.682 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.682 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.682 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.682 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.683 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.683 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.683 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.683 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.683 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.683 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.683 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.683 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.683 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.684 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.684 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.684 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.684 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.684 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.684 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.684 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.684 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.684 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.684 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.684 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.684 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.684 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.685 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.685 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.685 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.685 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.685 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.685 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.685 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.685 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.685 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.685 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.685 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.685 INFO:teuthology.orchestra.run.smithi078.stdout: "max_concurrent_clones": { 2024-09-11T00:26:33.685 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "max_concurrent_clones", 2024-09-11T00:26:33.685 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.686 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.686 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.686 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "4", 2024-09-11T00:26:33.686 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.686 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.686 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.686 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T00:26:33.686 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.686 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.686 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.686 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.686 INFO:teuthology.orchestra.run.smithi078.stdout: "periodic_async_work": { 2024-09-11T00:26:33.686 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "periodic_async_work", 2024-09-11T00:26:33.687 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.687 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.687 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.687 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.687 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.687 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.687 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.687 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Periodically check for async work", 2024-09-11T00:26:33.687 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.687 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.687 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.687 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.687 INFO:teuthology.orchestra.run.smithi078.stdout: "snapshot_clone_delay": { 2024-09-11T00:26:33.688 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "snapshot_clone_delay", 2024-09-11T00:26:33.688 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.688 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.688 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.688 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.688 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.688 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.688 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.688 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T00:26:33.688 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.688 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.688 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.688 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.688 INFO:teuthology.orchestra.run.smithi078.stdout: "snapshot_clone_no_wait": { 2024-09-11T00:26:33.689 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T00:26:33.689 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.689 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.689 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.689 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "True", 2024-09-11T00:26:33.689 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.689 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.689 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.689 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T00:26:33.689 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.689 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.689 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.689 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.689 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.689 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.690 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.690 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.690 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.690 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.690 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.690 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.690 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.690 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.690 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.690 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.690 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.690 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.690 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.691 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.691 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.691 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "zabbix", 2024-09-11T00:26:33.691 INFO:teuthology.orchestra.run.smithi078.stdout: "can_run": true, 2024-09-11T00:26:33.691 INFO:teuthology.orchestra.run.smithi078.stdout: "error_string": "", 2024-09-11T00:26:33.691 INFO:teuthology.orchestra.run.smithi078.stdout: "module_options": { 2024-09-11T00:26:33.691 INFO:teuthology.orchestra.run.smithi078.stdout: "discovery_interval": { 2024-09-11T00:26:33.691 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "discovery_interval", 2024-09-11T00:26:33.691 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "uint", 2024-09-11T00:26:33.691 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.691 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.691 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "100", 2024-09-11T00:26:33.691 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.692 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.692 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.692 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.692 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.692 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.692 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.692 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.692 INFO:teuthology.orchestra.run.smithi078.stdout: "identifier": { 2024-09-11T00:26:33.692 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "identifier", 2024-09-11T00:26:33.692 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.692 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.692 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.692 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.692 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.693 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.693 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.693 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.693 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.693 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.693 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.693 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.693 INFO:teuthology.orchestra.run.smithi078.stdout: "interval": { 2024-09-11T00:26:33.693 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "interval", 2024-09-11T00:26:33.693 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "secs", 2024-09-11T00:26:33.693 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.693 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.693 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "60", 2024-09-11T00:26:33.693 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.694 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.694 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.694 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.694 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.694 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.694 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.694 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.694 INFO:teuthology.orchestra.run.smithi078.stdout: "log_level": { 2024-09-11T00:26:33.694 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_level", 2024-09-11T00:26:33.694 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.694 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.694 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.694 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.694 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.695 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.695 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.695 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.695 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.695 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.695 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.695 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.695 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.695 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.695 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.695 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.695 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.695 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.695 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.696 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster": { 2024-09-11T00:26:33.696 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster", 2024-09-11T00:26:33.696 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.696 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.696 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.696 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.696 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.696 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.696 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.696 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.696 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.696 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.696 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.697 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.697 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_cluster_level": { 2024-09-11T00:26:33.697 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_cluster_level", 2024-09-11T00:26:33.697 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.697 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.697 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.697 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "info", 2024-09-11T00:26:33.697 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.697 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.697 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [ 2024-09-11T00:26:33.697 INFO:teuthology.orchestra.run.smithi078.stdout: "", 2024-09-11T00:26:33.697 INFO:teuthology.orchestra.run.smithi078.stdout: "critical", 2024-09-11T00:26:33.697 INFO:teuthology.orchestra.run.smithi078.stdout: "debug", 2024-09-11T00:26:33.698 INFO:teuthology.orchestra.run.smithi078.stdout: "error", 2024-09-11T00:26:33.698 INFO:teuthology.orchestra.run.smithi078.stdout: "info", 2024-09-11T00:26:33.698 INFO:teuthology.orchestra.run.smithi078.stdout: "warning" 2024-09-11T00:26:33.698 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.698 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.698 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.698 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.698 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.698 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.698 INFO:teuthology.orchestra.run.smithi078.stdout: "log_to_file": { 2024-09-11T00:26:33.698 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "log_to_file", 2024-09-11T00:26:33.698 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "bool", 2024-09-11T00:26:33.698 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.698 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.699 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "False", 2024-09-11T00:26:33.699 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.699 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.699 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.699 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.699 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.699 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.699 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.699 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.699 INFO:teuthology.orchestra.run.smithi078.stdout: "sqlite3_killpoint": { 2024-09-11T00:26:33.699 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "sqlite3_killpoint", 2024-09-11T00:26:33.699 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.699 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "dev", 2024-09-11T00:26:33.699 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 1, 2024-09-11T00:26:33.699 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "0", 2024-09-11T00:26:33.700 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.700 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.700 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.700 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.700 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.700 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.700 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.700 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.700 INFO:teuthology.orchestra.run.smithi078.stdout: "zabbix_host": { 2024-09-11T00:26:33.700 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "zabbix_host", 2024-09-11T00:26:33.700 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.700 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.700 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.701 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "", 2024-09-11T00:26:33.701 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.701 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.701 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.701 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.701 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.701 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.701 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.701 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.701 INFO:teuthology.orchestra.run.smithi078.stdout: "zabbix_port": { 2024-09-11T00:26:33.701 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "zabbix_port", 2024-09-11T00:26:33.701 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "int", 2024-09-11T00:26:33.701 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.701 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.702 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "10051", 2024-09-11T00:26:33.702 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.702 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.702 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.702 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.702 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.702 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.702 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.702 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.702 INFO:teuthology.orchestra.run.smithi078.stdout: "zabbix_sender": { 2024-09-11T00:26:33.702 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "zabbix_sender", 2024-09-11T00:26:33.702 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "str", 2024-09-11T00:26:33.702 INFO:teuthology.orchestra.run.smithi078.stdout: "level": "advanced", 2024-09-11T00:26:33.703 INFO:teuthology.orchestra.run.smithi078.stdout: "flags": 0, 2024-09-11T00:26:33.703 INFO:teuthology.orchestra.run.smithi078.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T00:26:33.703 INFO:teuthology.orchestra.run.smithi078.stdout: "min": "", 2024-09-11T00:26:33.703 INFO:teuthology.orchestra.run.smithi078.stdout: "max": "", 2024-09-11T00:26:33.703 INFO:teuthology.orchestra.run.smithi078.stdout: "enum_allowed": [], 2024-09-11T00:26:33.703 INFO:teuthology.orchestra.run.smithi078.stdout: "desc": "", 2024-09-11T00:26:33.703 INFO:teuthology.orchestra.run.smithi078.stdout: "long_desc": "", 2024-09-11T00:26:33.703 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-11T00:26:33.703 INFO:teuthology.orchestra.run.smithi078.stdout: "see_also": [] 2024-09-11T00:26:33.703 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.703 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.703 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.703 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.703 INFO:teuthology.orchestra.run.smithi078.stdout: "services": { 2024-09-11T00:26:33.704 INFO:teuthology.orchestra.run.smithi078.stdout: "dashboard": "https://172.21.15.78:8443/" 2024-09-11T00:26:33.704 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.704 INFO:teuthology.orchestra.run.smithi078.stdout: "always_on_modules": { 2024-09-11T00:26:33.704 INFO:teuthology.orchestra.run.smithi078.stdout: "octopus": [ 2024-09-11T00:26:33.704 INFO:teuthology.orchestra.run.smithi078.stdout: "balancer", 2024-09-11T00:26:33.704 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-11T00:26:33.704 INFO:teuthology.orchestra.run.smithi078.stdout: "devicehealth", 2024-09-11T00:26:33.704 INFO:teuthology.orchestra.run.smithi078.stdout: "orchestrator", 2024-09-11T00:26:33.704 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscaler", 2024-09-11T00:26:33.704 INFO:teuthology.orchestra.run.smithi078.stdout: "progress", 2024-09-11T00:26:33.704 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_support", 2024-09-11T00:26:33.704 INFO:teuthology.orchestra.run.smithi078.stdout: "status", 2024-09-11T00:26:33.704 INFO:teuthology.orchestra.run.smithi078.stdout: "telemetry", 2024-09-11T00:26:33.704 INFO:teuthology.orchestra.run.smithi078.stdout: "volumes" 2024-09-11T00:26:33.705 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.705 INFO:teuthology.orchestra.run.smithi078.stdout: "pacific": [ 2024-09-11T00:26:33.705 INFO:teuthology.orchestra.run.smithi078.stdout: "balancer", 2024-09-11T00:26:33.705 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-11T00:26:33.705 INFO:teuthology.orchestra.run.smithi078.stdout: "devicehealth", 2024-09-11T00:26:33.705 INFO:teuthology.orchestra.run.smithi078.stdout: "orchestrator", 2024-09-11T00:26:33.705 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscaler", 2024-09-11T00:26:33.705 INFO:teuthology.orchestra.run.smithi078.stdout: "progress", 2024-09-11T00:26:33.705 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_support", 2024-09-11T00:26:33.705 INFO:teuthology.orchestra.run.smithi078.stdout: "status", 2024-09-11T00:26:33.705 INFO:teuthology.orchestra.run.smithi078.stdout: "telemetry", 2024-09-11T00:26:33.705 INFO:teuthology.orchestra.run.smithi078.stdout: "volumes" 2024-09-11T00:26:33.705 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.705 INFO:teuthology.orchestra.run.smithi078.stdout: "quincy": [ 2024-09-11T00:26:33.706 INFO:teuthology.orchestra.run.smithi078.stdout: "balancer", 2024-09-11T00:26:33.706 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-11T00:26:33.706 INFO:teuthology.orchestra.run.smithi078.stdout: "devicehealth", 2024-09-11T00:26:33.706 INFO:teuthology.orchestra.run.smithi078.stdout: "orchestrator", 2024-09-11T00:26:33.706 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscaler", 2024-09-11T00:26:33.706 INFO:teuthology.orchestra.run.smithi078.stdout: "progress", 2024-09-11T00:26:33.706 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_support", 2024-09-11T00:26:33.706 INFO:teuthology.orchestra.run.smithi078.stdout: "status", 2024-09-11T00:26:33.706 INFO:teuthology.orchestra.run.smithi078.stdout: "telemetry", 2024-09-11T00:26:33.706 INFO:teuthology.orchestra.run.smithi078.stdout: "volumes" 2024-09-11T00:26:33.706 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.706 INFO:teuthology.orchestra.run.smithi078.stdout: "reef": [ 2024-09-11T00:26:33.706 INFO:teuthology.orchestra.run.smithi078.stdout: "balancer", 2024-09-11T00:26:33.706 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-11T00:26:33.707 INFO:teuthology.orchestra.run.smithi078.stdout: "devicehealth", 2024-09-11T00:26:33.707 INFO:teuthology.orchestra.run.smithi078.stdout: "orchestrator", 2024-09-11T00:26:33.707 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscaler", 2024-09-11T00:26:33.707 INFO:teuthology.orchestra.run.smithi078.stdout: "progress", 2024-09-11T00:26:33.707 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_support", 2024-09-11T00:26:33.707 INFO:teuthology.orchestra.run.smithi078.stdout: "status", 2024-09-11T00:26:33.707 INFO:teuthology.orchestra.run.smithi078.stdout: "telemetry", 2024-09-11T00:26:33.707 INFO:teuthology.orchestra.run.smithi078.stdout: "volumes" 2024-09-11T00:26:33.707 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-11T00:26:33.707 INFO:teuthology.orchestra.run.smithi078.stdout: "squid": [ 2024-09-11T00:26:33.707 INFO:teuthology.orchestra.run.smithi078.stdout: "balancer", 2024-09-11T00:26:33.707 INFO:teuthology.orchestra.run.smithi078.stdout: "crash", 2024-09-11T00:26:33.707 INFO:teuthology.orchestra.run.smithi078.stdout: "devicehealth", 2024-09-11T00:26:33.707 INFO:teuthology.orchestra.run.smithi078.stdout: "orchestrator", 2024-09-11T00:26:33.707 INFO:teuthology.orchestra.run.smithi078.stdout: "pg_autoscaler", 2024-09-11T00:26:33.708 INFO:teuthology.orchestra.run.smithi078.stdout: "progress", 2024-09-11T00:26:33.708 INFO:teuthology.orchestra.run.smithi078.stdout: "rbd_support", 2024-09-11T00:26:33.708 INFO:teuthology.orchestra.run.smithi078.stdout: "status", 2024-09-11T00:26:33.708 INFO:teuthology.orchestra.run.smithi078.stdout: "telemetry", 2024-09-11T00:26:33.708 INFO:teuthology.orchestra.run.smithi078.stdout: "volumes" 2024-09-11T00:26:33.708 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-09-11T00:26:33.708 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.708 INFO:teuthology.orchestra.run.smithi078.stdout: "force_disabled_modules": {}, 2024-09-11T00:26:33.708 INFO:teuthology.orchestra.run.smithi078.stdout: "last_failure_osd_epoch": 5, 2024-09-11T00:26:33.708 INFO:teuthology.orchestra.run.smithi078.stdout: "active_clients": [ 2024-09-11T00:26:33.708 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.708 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "devicehealth", 2024-09-11T00:26:33.708 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-09-11T00:26:33.708 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.708 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-09-11T00:26:33.709 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.78:0", 2024-09-11T00:26:33.709 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1595719137 2024-09-11T00:26:33.709 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.709 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-09-11T00:26:33.709 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.709 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.709 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "libcephsqlite", 2024-09-11T00:26:33.709 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-09-11T00:26:33.709 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.709 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-09-11T00:26:33.709 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.78:0", 2024-09-11T00:26:33.709 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 3169381695 2024-09-11T00:26:33.709 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.710 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-09-11T00:26:33.710 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.710 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.710 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "rbd_support", 2024-09-11T00:26:33.710 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-09-11T00:26:33.710 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.710 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-09-11T00:26:33.710 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.78:0", 2024-09-11T00:26:33.710 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2896247468 2024-09-11T00:26:33.710 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.710 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-09-11T00:26:33.710 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.710 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.710 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "snap_schedule", 2024-09-11T00:26:33.710 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-09-11T00:26:33.711 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.711 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-09-11T00:26:33.711 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.78:0", 2024-09-11T00:26:33.711 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 2549331669 2024-09-11T00:26:33.711 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.711 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-09-11T00:26:33.711 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.711 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.711 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "snap_schedule", 2024-09-11T00:26:33.711 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-09-11T00:26:33.711 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.711 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-09-11T00:26:33.711 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.78:0", 2024-09-11T00:26:33.711 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 3366295641 2024-09-11T00:26:33.712 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.712 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-09-11T00:26:33.712 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:33.712 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.712 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "volumes", 2024-09-11T00:26:33.712 INFO:teuthology.orchestra.run.smithi078.stdout: "addrvec": [ 2024-09-11T00:26:33.712 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-11T00:26:33.712 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v2", 2024-09-11T00:26:33.712 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.78:0", 2024-09-11T00:26:33.712 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 3350404179 2024-09-11T00:26:33.712 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.712 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-09-11T00:26:33.712 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:33.712 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-09-11T00:26:33.713 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:26:33.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:32.134+0000 7f315606a640 1 -- 172.21.15.78:0/3877903213 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f313c0b54d0 msgr2=0x7f313c0b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:33.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:32.134+0000 7f315606a640 1 --2- 172.21.15.78:0/3877903213 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f313c0b54d0 0x7f313c0b7990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f31380096c0 tx=0x7f3138031400 comp rx=0 tx=0).stop 2024-09-11T00:26:33.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:32.134+0000 7f315606a640 1 -- 172.21.15.78:0/3877903213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3150101c20 msgr2=0x7f3150199220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:33.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:32.134+0000 7f315606a640 1 --2- 172.21.15.78:0/3877903213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3150101c20 0x7f3150199220 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f314000e9f0 tx=0x7f314000eeb0 comp rx=0 tx=0).stop 2024-09-11T00:26:33.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:32.134+0000 7f315606a640 1 -- 172.21.15.78:0/3877903213 shutdown_connections 2024-09-11T00:26:33.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:32.134+0000 7f315606a640 1 --2- 172.21.15.78:0/3877903213 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f313c0b54d0 0x7f313c0b7990 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:33.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:32.134+0000 7f315606a640 1 --2- 172.21.15.78:0/3877903213 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3150107fa0 0x7f315019eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:33.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:32.134+0000 7f315606a640 1 --2- 172.21.15.78:0/3877903213 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3150107620 0x7f3150199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:33.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:32.134+0000 7f315606a640 1 --2- 172.21.15.78:0/3877903213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3150101c20 0x7f3150199220 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:33.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:32.134+0000 7f315606a640 1 -- 172.21.15.78:0/3877903213 >> 172.21.15.78:0/3877903213 conn(0x7f31500fd660 msgr2=0x7f315006b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:33.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:32.134+0000 7f315606a640 1 -- 172.21.15.78:0/3877903213 shutdown_connections 2024-09-11T00:26:33.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:32.135+0000 7f315606a640 1 -- 172.21.15.78:0/3877903213 wait complete. 2024-09-11T00:26:33.722 DEBUG:tasks.check_counter:Getting stats from a 2024-09-11T00:26:33.722 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-11T00:26:33.723 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:32 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3877903213' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-11T00:26:33.724 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:31 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3293099695' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T00:26:33.724 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:31 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3824657785' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-11T00:26:33.724 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:31 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1299492566' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-11T00:26:33.724 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:31 smithi138 ceph-mon[35019]: pgmap v633: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:26:33.724 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:32 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3877903213' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-11T00:26:33.724 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:31 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3293099695' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T00:26:33.725 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:31 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3824657785' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-11T00:26:33.725 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:31 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1299492566' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-11T00:26:33.725 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:31 smithi112 ceph-mon[35627]: pgmap v633: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:26:33.725 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:32 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3877903213' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-11T00:26:33.983 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:26:34.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:33 smithi078 ceph-mon[30865]: pgmap v634: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:26:34.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:33 smithi112 ceph-mon[35627]: pgmap v634: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:26:34.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:33 smithi138 ceph-mon[35019]: pgmap v634: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:26:34.491 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:26:34.492 INFO:teuthology.orchestra.run.smithi078.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:26:34.492 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_messages": 0, 2024-09-11T00:26:34.492 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages": 2, 2024-09-11T00:26:34.492 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_bytes": 0, 2024-09-11T00:26:34.492 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_bytes": 0, 2024-09-11T00:26:34.492 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_created_connections": 4, 2024-09-11T00:26:34.492 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_active_connections": 0, 2024-09-11T00:26:34.492 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_total_time": 0.001156206, 2024-09-11T00:26:34.492 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T00:26:34.492 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_recv_time": 0.000173824, 2024-09-11T00:26:34.493 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:34.493 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:34.493 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 0, 2024-09-11T00:26:34.493 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.000000000, 2024-09-11T00:26:34.493 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000000000 2024-09-11T00:26:34.493 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:34.493 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:34.493 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 0, 2024-09-11T00:26:34.493 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.000000000, 2024-09-11T00:26:34.493 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000000000 2024-09-11T00:26:34.493 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:34.493 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:26:34.493 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:26:34.493 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:34.494 INFO:teuthology.orchestra.run.smithi078.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:26:34.494 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_messages": 1, 2024-09-11T00:26:34.494 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages": 152, 2024-09-11T00:26:34.494 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_bytes": 160, 2024-09-11T00:26:34.494 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_bytes": 106944, 2024-09-11T00:26:34.494 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_created_connections": 3, 2024-09-11T00:26:34.494 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_active_connections": 2, 2024-09-11T00:26:34.494 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_total_time": 0.014147687, 2024-09-11T00:26:34.494 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_send_time": 0.011230606, 2024-09-11T00:26:34.494 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_recv_time": 0.001284669, 2024-09-11T00:26:34.494 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:34.494 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:34.494 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 150, 2024-09-11T00:26:34.494 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.008624477, 2024-09-11T00:26:34.495 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000057496 2024-09-11T00:26:34.495 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:34.495 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:34.495 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 0, 2024-09-11T00:26:34.495 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.000000000, 2024-09-11T00:26:34.495 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000000000 2024-09-11T00:26:34.495 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:34.495 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T00:26:34.495 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_encrypted_bytes": 106944 2024-09-11T00:26:34.495 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:34.495 INFO:teuthology.orchestra.run.smithi078.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:26:34.495 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_messages": 208, 2024-09-11T00:26:34.495 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages": 201, 2024-09-11T00:26:34.495 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_bytes": 829680, 2024-09-11T00:26:34.496 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_bytes": 123072, 2024-09-11T00:26:34.496 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_created_connections": 2, 2024-09-11T00:26:34.496 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_active_connections": 1, 2024-09-11T00:26:34.496 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_total_time": 0.037327589, 2024-09-11T00:26:34.496 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_send_time": 0.018021279, 2024-09-11T00:26:34.496 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_recv_time": 0.024567276, 2024-09-11T00:26:34.496 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:34.496 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:34.496 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 201, 2024-09-11T00:26:34.496 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.015120581, 2024-09-11T00:26:34.496 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000075226 2024-09-11T00:26:34.496 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:34.496 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:34.497 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 0, 2024-09-11T00:26:34.497 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.000000000, 2024-09-11T00:26:34.497 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000000000 2024-09-11T00:26:34.497 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:34.497 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_encrypted_bytes": 829680, 2024-09-11T00:26:34.497 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_encrypted_bytes": 123072 2024-09-11T00:26:34.497 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:34.497 INFO:teuthology.orchestra.run.smithi078.stdout: "cct": { 2024-09-11T00:26:34.497 INFO:teuthology.orchestra.run.smithi078.stdout: "total_workers": 0, 2024-09-11T00:26:34.497 INFO:teuthology.orchestra.run.smithi078.stdout: "unhealthy_workers": 0 2024-09-11T00:26:34.497 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:34.497 INFO:teuthology.orchestra.run.smithi078.stdout: "mempool": { 2024-09-11T00:26:34.497 INFO:teuthology.orchestra.run.smithi078.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:26:34.497 INFO:teuthology.orchestra.run.smithi078.stdout: "bloom_filter_items": 0, 2024-09-11T00:26:34.498 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:26:34.498 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:26:34.498 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:26:34.498 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:26:34.498 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:26:34.498 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:26:34.498 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:26:34.498 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:26:34.498 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:26:34.498 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:26:34.498 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:26:34.498 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:26:34.498 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:26:34.498 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_extent_items": 0, 2024-09-11T00:26:34.498 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:26:34.499 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_blob_items": 0, 2024-09-11T00:26:34.499 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:26:34.499 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:26:34.499 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:26:34.499 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:26:34.499 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:26:34.499 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:26:34.499 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:26:34.499 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_txc_items": 0, 2024-09-11T00:26:34.499 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:26:34.499 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:26:34.499 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:26:34.499 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_writing_items": 0, 2024-09-11T00:26:34.500 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_bytes": 0, 2024-09-11T00:26:34.500 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_items": 0, 2024-09-11T00:26:34.500 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:26:34.500 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:26:34.500 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:26:34.500 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:26:34.500 INFO:teuthology.orchestra.run.smithi078.stdout: "buffer_anon_bytes": 148985, 2024-09-11T00:26:34.500 INFO:teuthology.orchestra.run.smithi078.stdout: "buffer_anon_items": 30, 2024-09-11T00:26:34.500 INFO:teuthology.orchestra.run.smithi078.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:26:34.500 INFO:teuthology.orchestra.run.smithi078.stdout: "buffer_meta_items": 0, 2024-09-11T00:26:34.500 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_bytes": 0, 2024-09-11T00:26:34.500 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_items": 0, 2024-09-11T00:26:34.500 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:26:34.500 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mapbl_items": 0, 2024-09-11T00:26:34.501 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:26:34.501 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pglog_items": 0, 2024-09-11T00:26:34.501 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_bytes": 0, 2024-09-11T00:26:34.501 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_items": 0, 2024-09-11T00:26:34.501 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:26:34.501 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:26:34.501 INFO:teuthology.orchestra.run.smithi078.stdout: "pgmap_bytes": 0, 2024-09-11T00:26:34.501 INFO:teuthology.orchestra.run.smithi078.stdout: "pgmap_items": 0, 2024-09-11T00:26:34.501 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_co_bytes": 968, 2024-09-11T00:26:34.501 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_co_items": 2, 2024-09-11T00:26:34.501 INFO:teuthology.orchestra.run.smithi078.stdout: "unittest_1_bytes": 0, 2024-09-11T00:26:34.501 INFO:teuthology.orchestra.run.smithi078.stdout: "unittest_1_items": 0, 2024-09-11T00:26:34.501 INFO:teuthology.orchestra.run.smithi078.stdout: "unittest_2_bytes": 0, 2024-09-11T00:26:34.501 INFO:teuthology.orchestra.run.smithi078.stdout: "unittest_2_items": 0 2024-09-11T00:26:34.502 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:34.502 INFO:teuthology.orchestra.run.smithi078.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:26:34.502 INFO:teuthology.orchestra.run.smithi078.stdout: "val": 0, 2024-09-11T00:26:34.502 INFO:teuthology.orchestra.run.smithi078.stdout: "max": 104857600, 2024-09-11T00:26:34.502 INFO:teuthology.orchestra.run.smithi078.stdout: "get_started": 0, 2024-09-11T00:26:34.502 INFO:teuthology.orchestra.run.smithi078.stdout: "get": 205, 2024-09-11T00:26:34.502 INFO:teuthology.orchestra.run.smithi078.stdout: "get_sum": 797918, 2024-09-11T00:26:34.502 INFO:teuthology.orchestra.run.smithi078.stdout: "get_or_fail_fail": 0, 2024-09-11T00:26:34.502 INFO:teuthology.orchestra.run.smithi078.stdout: "get_or_fail_success": 205, 2024-09-11T00:26:34.502 INFO:teuthology.orchestra.run.smithi078.stdout: "take": 0, 2024-09-11T00:26:34.502 INFO:teuthology.orchestra.run.smithi078.stdout: "take_sum": 0, 2024-09-11T00:26:34.502 INFO:teuthology.orchestra.run.smithi078.stdout: "put": 205, 2024-09-11T00:26:34.502 INFO:teuthology.orchestra.run.smithi078.stdout: "put_sum": 797918, 2024-09-11T00:26:34.502 INFO:teuthology.orchestra.run.smithi078.stdout: "wait": { 2024-09-11T00:26:34.503 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 0, 2024-09-11T00:26:34.503 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.000000000, 2024-09-11T00:26:34.503 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000000000 2024-09-11T00:26:34.503 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:34.503 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:34.503 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:26:35.350 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-11T00:26:35.351 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-11T00:26:35.351 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-11T00:26:35.351 DEBUG:tasks.check_counter:Getting stats from d 2024-09-11T00:26:35.351 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-11T00:26:35.598 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:26:35.993 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:35 smithi078 ceph-mon[30865]: pgmap v635: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:26:36.100 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:26:36.101 INFO:teuthology.orchestra.run.smithi078.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:26:36.101 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_messages": 0, 2024-09-11T00:26:36.101 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages": 2, 2024-09-11T00:26:36.101 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_bytes": 0, 2024-09-11T00:26:36.101 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_bytes": 0, 2024-09-11T00:26:36.101 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_created_connections": 4, 2024-09-11T00:26:36.101 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_active_connections": 0, 2024-09-11T00:26:36.101 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_total_time": 0.001158993, 2024-09-11T00:26:36.101 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T00:26:36.101 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_recv_time": 0.000287849, 2024-09-11T00:26:36.101 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:36.101 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:36.102 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 0, 2024-09-11T00:26:36.102 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.000000000, 2024-09-11T00:26:36.102 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000000000 2024-09-11T00:26:36.102 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:36.102 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:36.102 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 0, 2024-09-11T00:26:36.102 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.000000000, 2024-09-11T00:26:36.102 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000000000 2024-09-11T00:26:36.102 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:36.102 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:26:36.102 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:26:36.102 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:36.102 INFO:teuthology.orchestra.run.smithi078.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:26:36.103 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_messages": 214, 2024-09-11T00:26:36.103 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages": 207, 2024-09-11T00:26:36.103 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_bytes": 831376, 2024-09-11T00:26:36.103 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_bytes": 126432, 2024-09-11T00:26:36.103 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_created_connections": 2, 2024-09-11T00:26:36.103 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_active_connections": 1, 2024-09-11T00:26:36.103 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_total_time": 0.037342101, 2024-09-11T00:26:36.103 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_send_time": 0.017874704, 2024-09-11T00:26:36.104 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_recv_time": 0.025463889, 2024-09-11T00:26:36.104 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:36.104 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:36.104 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 207, 2024-09-11T00:26:36.104 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.019252436, 2024-09-11T00:26:36.104 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000093006 2024-09-11T00:26:36.104 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:36.104 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:36.104 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 0, 2024-09-11T00:26:36.104 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.000000000, 2024-09-11T00:26:36.105 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000000000 2024-09-11T00:26:36.105 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:36.105 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_encrypted_bytes": 831376, 2024-09-11T00:26:36.105 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_encrypted_bytes": 126432 2024-09-11T00:26:36.105 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:36.105 INFO:teuthology.orchestra.run.smithi078.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:26:36.105 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_messages": 1, 2024-09-11T00:26:36.105 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages": 156, 2024-09-11T00:26:36.105 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_bytes": 160, 2024-09-11T00:26:36.105 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_bytes": 107648, 2024-09-11T00:26:36.105 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_created_connections": 3, 2024-09-11T00:26:36.105 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_active_connections": 2, 2024-09-11T00:26:36.105 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_total_time": 0.014746398, 2024-09-11T00:26:36.105 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_send_time": 0.011723985, 2024-09-11T00:26:36.106 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_recv_time": 0.001394369, 2024-09-11T00:26:36.106 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:36.106 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:36.106 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 154, 2024-09-11T00:26:36.106 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.009146251, 2024-09-11T00:26:36.106 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000059391 2024-09-11T00:26:36.106 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:36.106 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:36.106 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 0, 2024-09-11T00:26:36.106 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.000000000, 2024-09-11T00:26:36.106 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000000000 2024-09-11T00:26:36.106 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:36.106 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T00:26:36.106 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_encrypted_bytes": 107648 2024-09-11T00:26:36.107 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:36.107 INFO:teuthology.orchestra.run.smithi078.stdout: "cct": { 2024-09-11T00:26:36.107 INFO:teuthology.orchestra.run.smithi078.stdout: "total_workers": 0, 2024-09-11T00:26:36.107 INFO:teuthology.orchestra.run.smithi078.stdout: "unhealthy_workers": 0 2024-09-11T00:26:36.107 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:36.107 INFO:teuthology.orchestra.run.smithi078.stdout: "mempool": { 2024-09-11T00:26:36.107 INFO:teuthology.orchestra.run.smithi078.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:26:36.107 INFO:teuthology.orchestra.run.smithi078.stdout: "bloom_filter_items": 0, 2024-09-11T00:26:36.107 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:26:36.107 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:26:36.107 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:26:36.107 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:26:36.107 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:26:36.107 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:26:36.108 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:26:36.108 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:26:36.108 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:26:36.108 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:26:36.108 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:26:36.108 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:26:36.108 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:26:36.108 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_extent_items": 0, 2024-09-11T00:26:36.108 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:26:36.108 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_blob_items": 0, 2024-09-11T00:26:36.108 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:26:36.108 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:26:36.108 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:26:36.108 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:26:36.109 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:26:36.109 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:26:36.109 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:26:36.109 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_txc_items": 0, 2024-09-11T00:26:36.109 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:26:36.109 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:26:36.109 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:26:36.109 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_writing_items": 0, 2024-09-11T00:26:36.109 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_bytes": 0, 2024-09-11T00:26:36.109 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_items": 0, 2024-09-11T00:26:36.109 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:26:36.109 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:26:36.109 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:26:36.109 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:26:36.110 INFO:teuthology.orchestra.run.smithi078.stdout: "buffer_anon_bytes": 149047, 2024-09-11T00:26:36.110 INFO:teuthology.orchestra.run.smithi078.stdout: "buffer_anon_items": 31, 2024-09-11T00:26:36.110 INFO:teuthology.orchestra.run.smithi078.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:26:36.110 INFO:teuthology.orchestra.run.smithi078.stdout: "buffer_meta_items": 0, 2024-09-11T00:26:36.110 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_bytes": 0, 2024-09-11T00:26:36.110 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_items": 0, 2024-09-11T00:26:36.110 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:26:36.110 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mapbl_items": 0, 2024-09-11T00:26:36.110 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:26:36.110 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pglog_items": 0, 2024-09-11T00:26:36.110 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_bytes": 0, 2024-09-11T00:26:36.110 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_items": 0, 2024-09-11T00:26:36.110 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:26:36.110 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:26:36.111 INFO:teuthology.orchestra.run.smithi078.stdout: "pgmap_bytes": 0, 2024-09-11T00:26:36.111 INFO:teuthology.orchestra.run.smithi078.stdout: "pgmap_items": 0, 2024-09-11T00:26:36.111 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_co_bytes": 968, 2024-09-11T00:26:36.111 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_co_items": 2, 2024-09-11T00:26:36.111 INFO:teuthology.orchestra.run.smithi078.stdout: "unittest_1_bytes": 0, 2024-09-11T00:26:36.111 INFO:teuthology.orchestra.run.smithi078.stdout: "unittest_1_items": 0, 2024-09-11T00:26:36.111 INFO:teuthology.orchestra.run.smithi078.stdout: "unittest_2_bytes": 0, 2024-09-11T00:26:36.111 INFO:teuthology.orchestra.run.smithi078.stdout: "unittest_2_items": 0 2024-09-11T00:26:36.111 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:36.111 INFO:teuthology.orchestra.run.smithi078.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:26:36.111 INFO:teuthology.orchestra.run.smithi078.stdout: "val": 0, 2024-09-11T00:26:36.111 INFO:teuthology.orchestra.run.smithi078.stdout: "max": 104857600, 2024-09-11T00:26:36.111 INFO:teuthology.orchestra.run.smithi078.stdout: "get_started": 0, 2024-09-11T00:26:36.111 INFO:teuthology.orchestra.run.smithi078.stdout: "get": 211, 2024-09-11T00:26:36.111 INFO:teuthology.orchestra.run.smithi078.stdout: "get_sum": 798762, 2024-09-11T00:26:36.112 INFO:teuthology.orchestra.run.smithi078.stdout: "get_or_fail_fail": 0, 2024-09-11T00:26:36.112 INFO:teuthology.orchestra.run.smithi078.stdout: "get_or_fail_success": 211, 2024-09-11T00:26:36.112 INFO:teuthology.orchestra.run.smithi078.stdout: "take": 0, 2024-09-11T00:26:36.112 INFO:teuthology.orchestra.run.smithi078.stdout: "take_sum": 0, 2024-09-11T00:26:36.112 INFO:teuthology.orchestra.run.smithi078.stdout: "put": 211, 2024-09-11T00:26:36.112 INFO:teuthology.orchestra.run.smithi078.stdout: "put_sum": 798762, 2024-09-11T00:26:36.112 INFO:teuthology.orchestra.run.smithi078.stdout: "wait": { 2024-09-11T00:26:36.112 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 0, 2024-09-11T00:26:36.112 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.000000000, 2024-09-11T00:26:36.112 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000000000 2024-09-11T00:26:36.112 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:36.112 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:36.112 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:26:36.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:35 smithi112 ceph-mon[35627]: pgmap v635: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:26:36.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:35 smithi138 ceph-mon[35019]: pgmap v635: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:26:36.768 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-11T00:26:36.768 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-11T00:26:36.768 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-11T00:26:36.769 DEBUG:tasks.check_counter:Getting stats from g 2024-09-11T00:26:36.769 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-11T00:26:37.014 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:26:37.543 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:26:37.543 INFO:teuthology.orchestra.run.smithi078.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:26:37.544 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_messages": 4, 2024-09-11T00:26:37.544 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages": 4, 2024-09-11T00:26:37.544 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_bytes": 2944, 2024-09-11T00:26:37.544 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_bytes": 448, 2024-09-11T00:26:37.544 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_created_connections": 4, 2024-09-11T00:26:37.544 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_active_connections": 0, 2024-09-11T00:26:37.544 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_total_time": 0.003095344, 2024-09-11T00:26:37.544 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_send_time": 0.000039895, 2024-09-11T00:26:37.544 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_recv_time": 0.002210779, 2024-09-11T00:26:37.544 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:37.544 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:37.544 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 3, 2024-09-11T00:26:37.545 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.003918555, 2024-09-11T00:26:37.545 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.001306185 2024-09-11T00:26:37.545 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:37.545 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:37.545 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 0, 2024-09-11T00:26:37.545 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.000000000, 2024-09-11T00:26:37.545 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000000000 2024-09-11T00:26:37.545 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:37.545 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-11T00:26:37.545 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T00:26:37.545 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:37.545 INFO:teuthology.orchestra.run.smithi078.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:26:37.545 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_messages": 1, 2024-09-11T00:26:37.545 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages": 153, 2024-09-11T00:26:37.545 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_bytes": 160, 2024-09-11T00:26:37.546 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_bytes": 107120, 2024-09-11T00:26:37.546 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_created_connections": 3, 2024-09-11T00:26:37.546 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_active_connections": 2, 2024-09-11T00:26:37.546 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_total_time": 0.014790903, 2024-09-11T00:26:37.546 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_send_time": 0.012096097, 2024-09-11T00:26:37.546 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_recv_time": 0.001252343, 2024-09-11T00:26:37.546 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:37.546 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:37.546 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 151, 2024-09-11T00:26:37.546 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.006810536, 2024-09-11T00:26:37.546 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000045102 2024-09-11T00:26:37.546 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:37.546 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:37.547 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 0, 2024-09-11T00:26:37.547 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.000000000, 2024-09-11T00:26:37.547 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000000000 2024-09-11T00:26:37.547 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:37.547 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T00:26:37.547 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_encrypted_bytes": 107120 2024-09-11T00:26:37.547 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:37.547 INFO:teuthology.orchestra.run.smithi078.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:26:37.547 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_messages": 205, 2024-09-11T00:26:37.547 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages": 200, 2024-09-11T00:26:37.547 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_bytes": 827008, 2024-09-11T00:26:37.547 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_bytes": 123264, 2024-09-11T00:26:37.547 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_created_connections": 2, 2024-09-11T00:26:37.547 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_active_connections": 1, 2024-09-11T00:26:37.547 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_total_time": 0.034366313, 2024-09-11T00:26:37.548 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_send_time": 0.017594793, 2024-09-11T00:26:37.548 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_recv_time": 0.021933440, 2024-09-11T00:26:37.548 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:37.548 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:37.548 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 199, 2024-09-11T00:26:37.548 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.011370611, 2024-09-11T00:26:37.548 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000057138 2024-09-11T00:26:37.548 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:37.548 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:37.548 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 0, 2024-09-11T00:26:37.548 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.000000000, 2024-09-11T00:26:37.548 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000000000 2024-09-11T00:26:37.548 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:37.548 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_encrypted_bytes": 827008, 2024-09-11T00:26:37.548 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_encrypted_bytes": 123264 2024-09-11T00:26:37.549 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:37.549 INFO:teuthology.orchestra.run.smithi078.stdout: "cct": { 2024-09-11T00:26:37.549 INFO:teuthology.orchestra.run.smithi078.stdout: "total_workers": 0, 2024-09-11T00:26:37.549 INFO:teuthology.orchestra.run.smithi078.stdout: "unhealthy_workers": 0 2024-09-11T00:26:37.549 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:37.549 INFO:teuthology.orchestra.run.smithi078.stdout: "mempool": { 2024-09-11T00:26:37.549 INFO:teuthology.orchestra.run.smithi078.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:26:37.549 INFO:teuthology.orchestra.run.smithi078.stdout: "bloom_filter_items": 0, 2024-09-11T00:26:37.549 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:26:37.549 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:26:37.549 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:26:37.549 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:26:37.549 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:26:37.549 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:26:37.550 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:26:37.550 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:26:37.550 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:26:37.550 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:26:37.550 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:26:37.550 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:26:37.550 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:26:37.550 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_extent_items": 0, 2024-09-11T00:26:37.550 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:26:37.550 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_blob_items": 0, 2024-09-11T00:26:37.550 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:26:37.550 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:26:37.550 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:26:37.551 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:26:37.551 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:26:37.551 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:26:37.551 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:26:37.551 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_txc_items": 0, 2024-09-11T00:26:37.551 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:26:37.551 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:26:37.551 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:26:37.552 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_writing_items": 0, 2024-09-11T00:26:37.552 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_bytes": 0, 2024-09-11T00:26:37.552 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_items": 0, 2024-09-11T00:26:37.552 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:26:37.552 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:26:37.552 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:26:37.552 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:26:37.552 INFO:teuthology.orchestra.run.smithi078.stdout: "buffer_anon_bytes": 148967, 2024-09-11T00:26:37.552 INFO:teuthology.orchestra.run.smithi078.stdout: "buffer_anon_items": 29, 2024-09-11T00:26:37.552 INFO:teuthology.orchestra.run.smithi078.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:26:37.552 INFO:teuthology.orchestra.run.smithi078.stdout: "buffer_meta_items": 0, 2024-09-11T00:26:37.552 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_bytes": 0, 2024-09-11T00:26:37.552 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_items": 0, 2024-09-11T00:26:37.552 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:26:37.553 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mapbl_items": 0, 2024-09-11T00:26:37.553 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:26:37.553 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pglog_items": 0, 2024-09-11T00:26:37.553 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_bytes": 0, 2024-09-11T00:26:37.553 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_items": 0, 2024-09-11T00:26:37.553 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:26:37.553 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:26:37.553 INFO:teuthology.orchestra.run.smithi078.stdout: "pgmap_bytes": 0, 2024-09-11T00:26:37.553 INFO:teuthology.orchestra.run.smithi078.stdout: "pgmap_items": 0, 2024-09-11T00:26:37.554 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_co_bytes": 968, 2024-09-11T00:26:37.554 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_co_items": 2, 2024-09-11T00:26:37.554 INFO:teuthology.orchestra.run.smithi078.stdout: "unittest_1_bytes": 0, 2024-09-11T00:26:37.554 INFO:teuthology.orchestra.run.smithi078.stdout: "unittest_1_items": 0, 2024-09-11T00:26:37.554 INFO:teuthology.orchestra.run.smithi078.stdout: "unittest_2_bytes": 0, 2024-09-11T00:26:37.554 INFO:teuthology.orchestra.run.smithi078.stdout: "unittest_2_items": 0 2024-09-11T00:26:37.554 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:37.555 INFO:teuthology.orchestra.run.smithi078.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:26:37.555 INFO:teuthology.orchestra.run.smithi078.stdout: "val": 0, 2024-09-11T00:26:37.555 INFO:teuthology.orchestra.run.smithi078.stdout: "max": 104857600, 2024-09-11T00:26:37.555 INFO:teuthology.orchestra.run.smithi078.stdout: "get_started": 0, 2024-09-11T00:26:37.555 INFO:teuthology.orchestra.run.smithi078.stdout: "get": 206, 2024-09-11T00:26:37.555 INFO:teuthology.orchestra.run.smithi078.stdout: "get_sum": 798048, 2024-09-11T00:26:37.555 INFO:teuthology.orchestra.run.smithi078.stdout: "get_or_fail_fail": 0, 2024-09-11T00:26:37.555 INFO:teuthology.orchestra.run.smithi078.stdout: "get_or_fail_success": 206, 2024-09-11T00:26:37.555 INFO:teuthology.orchestra.run.smithi078.stdout: "take": 0, 2024-09-11T00:26:37.556 INFO:teuthology.orchestra.run.smithi078.stdout: "take_sum": 0, 2024-09-11T00:26:37.556 INFO:teuthology.orchestra.run.smithi078.stdout: "put": 206, 2024-09-11T00:26:37.556 INFO:teuthology.orchestra.run.smithi078.stdout: "put_sum": 798048, 2024-09-11T00:26:37.556 INFO:teuthology.orchestra.run.smithi078.stdout: "wait": { 2024-09-11T00:26:37.556 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 0, 2024-09-11T00:26:37.556 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.000000000, 2024-09-11T00:26:37.556 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000000000 2024-09-11T00:26:37.556 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:37.556 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:37.556 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:26:38.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:37 smithi112 ceph-mon[35627]: pgmap v636: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:26:38.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:37 smithi138 ceph-mon[35019]: pgmap v636: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:26:38.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:37 smithi078 ceph-mon[30865]: pgmap v636: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:26:38.392 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-11T00:26:38.392 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-11T00:26:38.392 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-11T00:26:38.393 DEBUG:tasks.check_counter:Getting stats from j 2024-09-11T00:26:38.393 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-11T00:26:38.637 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:26:39.110 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-11T00:26:39.110 INFO:teuthology.orchestra.run.smithi078.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:26:39.111 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_messages": 212, 2024-09-11T00:26:39.111 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages": 207, 2024-09-11T00:26:39.111 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_bytes": 828976, 2024-09-11T00:26:39.111 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_bytes": 127264, 2024-09-11T00:26:39.111 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_created_connections": 4, 2024-09-11T00:26:39.111 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_active_connections": 0, 2024-09-11T00:26:39.111 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_total_time": 0.036261716, 2024-09-11T00:26:39.111 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_send_time": 0.017449249, 2024-09-11T00:26:39.111 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_recv_time": 0.024221437, 2024-09-11T00:26:39.111 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:39.111 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:39.111 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 206, 2024-09-11T00:26:39.111 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.011184686, 2024-09-11T00:26:39.112 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000054294 2024-09-11T00:26:39.112 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:39.112 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:39.112 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 0, 2024-09-11T00:26:39.112 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.000000000, 2024-09-11T00:26:39.112 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000000000 2024-09-11T00:26:39.112 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:39.112 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_encrypted_bytes": 828976, 2024-09-11T00:26:39.112 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_encrypted_bytes": 127264 2024-09-11T00:26:39.112 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:39.112 INFO:teuthology.orchestra.run.smithi078.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:26:39.112 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_messages": 5, 2024-09-11T00:26:39.113 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages": 159, 2024-09-11T00:26:39.113 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_bytes": 3104, 2024-09-11T00:26:39.113 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_bytes": 108272, 2024-09-11T00:26:39.113 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_created_connections": 3, 2024-09-11T00:26:39.113 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_active_connections": 2, 2024-09-11T00:26:39.113 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_total_time": 0.017553026, 2024-09-11T00:26:39.113 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_send_time": 0.012778722, 2024-09-11T00:26:39.113 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_recv_time": 0.003207311, 2024-09-11T00:26:39.113 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:39.113 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:39.113 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 158, 2024-09-11T00:26:39.113 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.013240215, 2024-09-11T00:26:39.113 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000083798 2024-09-11T00:26:39.113 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:39.114 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:39.114 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 0, 2024-09-11T00:26:39.114 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.000000000, 2024-09-11T00:26:39.114 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000000000 2024-09-11T00:26:39.114 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:39.114 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-11T00:26:39.114 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_encrypted_bytes": 108272 2024-09-11T00:26:39.114 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:39.114 INFO:teuthology.orchestra.run.smithi078.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:26:39.114 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_messages": 0, 2024-09-11T00:26:39.114 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages": 2, 2024-09-11T00:26:39.114 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_bytes": 0, 2024-09-11T00:26:39.114 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_bytes": 0, 2024-09-11T00:26:39.114 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_created_connections": 2, 2024-09-11T00:26:39.115 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_active_connections": 1, 2024-09-11T00:26:39.115 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_total_time": 0.000346209, 2024-09-11T00:26:39.115 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T00:26:39.115 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_recv_time": 0.000273755, 2024-09-11T00:26:39.115 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:39.115 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:39.115 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 0, 2024-09-11T00:26:39.115 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.000000000, 2024-09-11T00:26:39.115 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000000000 2024-09-11T00:26:39.115 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:39.115 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:39.115 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 0, 2024-09-11T00:26:39.115 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.000000000, 2024-09-11T00:26:39.115 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000000000 2024-09-11T00:26:39.116 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:39.116 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:26:39.116 INFO:teuthology.orchestra.run.smithi078.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:26:39.116 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:39.116 INFO:teuthology.orchestra.run.smithi078.stdout: "cct": { 2024-09-11T00:26:39.116 INFO:teuthology.orchestra.run.smithi078.stdout: "total_workers": 0, 2024-09-11T00:26:39.116 INFO:teuthology.orchestra.run.smithi078.stdout: "unhealthy_workers": 0 2024-09-11T00:26:39.116 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:39.116 INFO:teuthology.orchestra.run.smithi078.stdout: "mempool": { 2024-09-11T00:26:39.117 INFO:teuthology.orchestra.run.smithi078.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:26:39.117 INFO:teuthology.orchestra.run.smithi078.stdout: "bloom_filter_items": 0, 2024-09-11T00:26:39.117 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:26:39.117 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:26:39.117 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:26:39.117 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:26:39.117 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:26:39.117 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:26:39.117 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:26:39.117 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:26:39.118 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:26:39.118 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:26:39.118 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:26:39.118 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:26:39.118 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:26:39.118 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_extent_items": 0, 2024-09-11T00:26:39.118 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:26:39.118 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_blob_items": 0, 2024-09-11T00:26:39.118 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:26:39.118 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:26:39.118 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:26:39.118 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:26:39.118 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:26:39.118 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:26:39.118 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:26:39.119 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_txc_items": 0, 2024-09-11T00:26:39.119 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:26:39.119 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:26:39.119 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:26:39.119 INFO:teuthology.orchestra.run.smithi078.stdout: "bluestore_writing_items": 0, 2024-09-11T00:26:39.119 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_bytes": 0, 2024-09-11T00:26:39.119 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_items": 0, 2024-09-11T00:26:39.119 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:26:39.119 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:26:39.119 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:26:39.119 INFO:teuthology.orchestra.run.smithi078.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:26:39.119 INFO:teuthology.orchestra.run.smithi078.stdout: "buffer_anon_bytes": 149007, 2024-09-11T00:26:39.119 INFO:teuthology.orchestra.run.smithi078.stdout: "buffer_anon_items": 30, 2024-09-11T00:26:39.119 INFO:teuthology.orchestra.run.smithi078.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:26:39.120 INFO:teuthology.orchestra.run.smithi078.stdout: "buffer_meta_items": 0, 2024-09-11T00:26:39.120 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_bytes": 0, 2024-09-11T00:26:39.120 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_items": 0, 2024-09-11T00:26:39.120 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:26:39.120 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_mapbl_items": 0, 2024-09-11T00:26:39.120 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:26:39.120 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_pglog_items": 0, 2024-09-11T00:26:39.120 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_bytes": 0, 2024-09-11T00:26:39.120 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_items": 0, 2024-09-11T00:26:39.120 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:26:39.121 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:26:39.121 INFO:teuthology.orchestra.run.smithi078.stdout: "pgmap_bytes": 0, 2024-09-11T00:26:39.121 INFO:teuthology.orchestra.run.smithi078.stdout: "pgmap_items": 0, 2024-09-11T00:26:39.121 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_co_bytes": 968, 2024-09-11T00:26:39.121 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_co_items": 2, 2024-09-11T00:26:39.121 INFO:teuthology.orchestra.run.smithi078.stdout: "unittest_1_bytes": 0, 2024-09-11T00:26:39.121 INFO:teuthology.orchestra.run.smithi078.stdout: "unittest_1_items": 0, 2024-09-11T00:26:39.121 INFO:teuthology.orchestra.run.smithi078.stdout: "unittest_2_bytes": 0, 2024-09-11T00:26:39.121 INFO:teuthology.orchestra.run.smithi078.stdout: "unittest_2_items": 0 2024-09-11T00:26:39.121 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-11T00:26:39.122 INFO:teuthology.orchestra.run.smithi078.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:26:39.122 INFO:teuthology.orchestra.run.smithi078.stdout: "val": 0, 2024-09-11T00:26:39.122 INFO:teuthology.orchestra.run.smithi078.stdout: "max": 104857600, 2024-09-11T00:26:39.122 INFO:teuthology.orchestra.run.smithi078.stdout: "get_started": 0, 2024-09-11T00:26:39.122 INFO:teuthology.orchestra.run.smithi078.stdout: "get": 213, 2024-09-11T00:26:39.122 INFO:teuthology.orchestra.run.smithi078.stdout: "get_sum": 799022, 2024-09-11T00:26:39.122 INFO:teuthology.orchestra.run.smithi078.stdout: "get_or_fail_fail": 0, 2024-09-11T00:26:39.122 INFO:teuthology.orchestra.run.smithi078.stdout: "get_or_fail_success": 213, 2024-09-11T00:26:39.122 INFO:teuthology.orchestra.run.smithi078.stdout: "take": 0, 2024-09-11T00:26:39.122 INFO:teuthology.orchestra.run.smithi078.stdout: "take_sum": 0, 2024-09-11T00:26:39.122 INFO:teuthology.orchestra.run.smithi078.stdout: "put": 213, 2024-09-11T00:26:39.122 INFO:teuthology.orchestra.run.smithi078.stdout: "put_sum": 799022, 2024-09-11T00:26:39.122 INFO:teuthology.orchestra.run.smithi078.stdout: "wait": { 2024-09-11T00:26:39.123 INFO:teuthology.orchestra.run.smithi078.stdout: "avgcount": 0, 2024-09-11T00:26:39.123 INFO:teuthology.orchestra.run.smithi078.stdout: "sum": 0.000000000, 2024-09-11T00:26:39.123 INFO:teuthology.orchestra.run.smithi078.stdout: "avgtime": 0.000000000 2024-09-11T00:26:39.123 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:39.123 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-11T00:26:39.123 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-11T00:26:39.810 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-11T00:26:39.810 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-11T00:26:39.810 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-11T00:26:39.810 DEBUG:tasks.check_counter:Getting stats from b 2024-09-11T00:26:39.810 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-11T00:26:40.072 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T00:26:40.083 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:39 smithi078 ceph-mon[30865]: pgmap v637: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:26:40.193 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:39 smithi112 ceph-mon[35627]: pgmap v637: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:26:40.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:39 smithi138 ceph-mon[35019]: pgmap v637: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:26:40.596 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-11T00:26:40.596 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:26:40.596 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 22658, 2024-09-11T00:26:40.596 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 22660, 2024-09-11T00:26:40.596 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 5706124, 2024-09-11T00:26:40.597 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 87778785, 2024-09-11T00:26:40.597 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 11, 2024-09-11T00:26:40.597 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 4, 2024-09-11T00:26:40.597 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 2.124821730, 2024-09-11T00:26:40.597 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 1.037949921, 2024-09-11T00:26:40.597 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.324305500, 2024-09-11T00:26:40.597 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.626384208, 2024-09-11T00:26:40.597 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:40.597 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 22658, 2024-09-11T00:26:40.597 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 2.244196031, 2024-09-11T00:26:40.597 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000099046 2024-09-11T00:26:40.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.598 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:40.598 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2, 2024-09-11T00:26:40.598 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000136, 2024-09-11T00:26:40.598 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000068 2024-09-11T00:26:40.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.598 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:26:40.598 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:26:40.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.598 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:26:40.598 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 21421, 2024-09-11T00:26:40.598 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 21021, 2024-09-11T00:26:40.599 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 6928658, 2024-09-11T00:26:40.599 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 99461385, 2024-09-11T00:26:40.599 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 20, 2024-09-11T00:26:40.599 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 6, 2024-09-11T00:26:40.599 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 1.977117770, 2024-09-11T00:26:40.599 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.943551958, 2024-09-11T00:26:40.599 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.326914243, 2024-09-11T00:26:40.599 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.593558684, 2024-09-11T00:26:40.599 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:40.599 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 21019, 2024-09-11T00:26:40.599 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 2.521200723, 2024-09-11T00:26:40.599 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000119948 2024-09-11T00:26:40.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.600 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:40.600 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 845, 2024-09-11T00:26:40.600 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000144629, 2024-09-11T00:26:40.600 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000171 2024-09-11T00:26:40.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.600 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 305072, 2024-09-11T00:26:40.600 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 448176 2024-09-11T00:26:40.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.600 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:26:40.600 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 90099, 2024-09-11T00:26:40.600 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 150111, 2024-09-11T00:26:40.601 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 31452825, 2024-09-11T00:26:40.601 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 98247940, 2024-09-11T00:26:40.601 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 141, 2024-09-11T00:26:40.601 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 6, 2024-09-11T00:26:40.601 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 6.359970832, 2024-09-11T00:26:40.601 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 3.757284998, 2024-09-11T00:26:40.601 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 6.695693794, 2024-09-11T00:26:40.601 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.263100627, 2024-09-11T00:26:40.601 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:40.601 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 150111, 2024-09-11T00:26:40.601 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 4.567681656, 2024-09-11T00:26:40.602 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000030428 2024-09-11T00:26:40.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.602 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:40.602 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 183222, 2024-09-11T00:26:40.602 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.027355242, 2024-09-11T00:26:40.602 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000149 2024-09-11T00:26:40.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.602 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 919872, 2024-09-11T00:26:40.602 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 184832 2024-09-11T00:26:40.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.602 INFO:teuthology.orchestra.run.smithi112.stdout: "cct": { 2024-09-11T00:26:40.602 INFO:teuthology.orchestra.run.smithi112.stdout: "total_workers": 1, 2024-09-11T00:26:40.603 INFO:teuthology.orchestra.run.smithi112.stdout: "unhealthy_workers": 0 2024-09-11T00:26:40.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.603 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-MDSRank": { 2024-09-11T00:26:40.603 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2024-09-11T00:26:40.603 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2024-09-11T00:26:40.603 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 13350, 2024-09-11T00:26:40.603 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 62.472000176, 2024-09-11T00:26:40.603 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.004679550 2024-09-11T00:26:40.603 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-11T00:26:40.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.603 INFO:teuthology.orchestra.run.smithi112.stdout: "finisher-PurgeQueue": { 2024-09-11T00:26:40.603 INFO:teuthology.orchestra.run.smithi112.stdout: "queue_len": 0, 2024-09-11T00:26:40.604 INFO:teuthology.orchestra.run.smithi112.stdout: "complete_latency": { 2024-09-11T00:26:40.604 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 11102, 2024-09-11T00:26:40.604 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 5.000345560, 2024-09-11T00:26:40.604 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000450400 2024-09-11T00:26:40.604 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-11T00:26:40.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.604 INFO:teuthology.orchestra.run.smithi112.stdout: "mds": { 2024-09-11T00:26:40.604 INFO:teuthology.orchestra.run.smithi112.stdout: "request": 40108, 2024-09-11T00:26:40.605 INFO:teuthology.orchestra.run.smithi112.stdout: "reply": 40108, 2024-09-11T00:26:40.605 INFO:teuthology.orchestra.run.smithi112.stdout: "reply_latency": { 2024-09-11T00:26:40.605 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 40108, 2024-09-11T00:26:40.605 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 208.822894324, 2024-09-11T00:26:40.605 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.005206514 2024-09-11T00:26:40.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.605 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_reply": 0, 2024-09-11T00:26:40.605 INFO:teuthology.orchestra.run.smithi112.stdout: "forward": 0, 2024-09-11T00:26:40.605 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_complete": 0, 2024-09-11T00:26:40.605 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_fetch_keys": 0, 2024-09-11T00:26:40.605 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_commit": 140, 2024-09-11T00:26:40.605 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_split": 15, 2024-09-11T00:26:40.606 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_merge": 0, 2024-09-11T00:26:40.606 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes": 30309, 2024-09-11T00:26:40.606 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_top": 23, 2024-09-11T00:26:40.606 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_bottom": 30286, 2024-09-11T00:26:40.606 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pin_tail": 0, 2024-09-11T00:26:40.606 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_pinned": 30275, 2024-09-11T00:26:40.606 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_expired": 0, 2024-09-11T00:26:40.606 INFO:teuthology.orchestra.run.smithi112.stdout: "inodes_with_caps": 3, 2024-09-11T00:26:40.606 INFO:teuthology.orchestra.run.smithi112.stdout: "caps": 4, 2024-09-11T00:26:40.606 INFO:teuthology.orchestra.run.smithi112.stdout: "subtrees": 2, 2024-09-11T00:26:40.606 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse": 70035, 2024-09-11T00:26:40.606 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_hit": 69685, 2024-09-11T00:26:40.607 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_forward": 0, 2024-09-11T00:26:40.607 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_discover": 0, 2024-09-11T00:26:40.607 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_dir_fetch": 0, 2024-09-11T00:26:40.607 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_remote_ino": 0, 2024-09-11T00:26:40.607 INFO:teuthology.orchestra.run.smithi112.stdout: "traverse_lock": 6, 2024-09-11T00:26:40.607 INFO:teuthology.orchestra.run.smithi112.stdout: "load_cent": 0, 2024-09-11T00:26:40.607 INFO:teuthology.orchestra.run.smithi112.stdout: "q": 0, 2024-09-11T00:26:40.607 INFO:teuthology.orchestra.run.smithi112.stdout: "exported": 0, 2024-09-11T00:26:40.607 INFO:teuthology.orchestra.run.smithi112.stdout: "exported_inodes": 0, 2024-09-11T00:26:40.607 INFO:teuthology.orchestra.run.smithi112.stdout: "imported": 0, 2024-09-11T00:26:40.607 INFO:teuthology.orchestra.run.smithi112.stdout: "imported_inodes": 0, 2024-09-11T00:26:40.607 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_dir_fetch": 0, 2024-09-11T00:26:40.608 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_backtrace_fetch": 24146, 2024-09-11T00:26:40.608 INFO:teuthology.orchestra.run.smithi112.stdout: "openino_peer_discover": 0, 2024-09-11T00:26:40.608 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rfiles": 4, 2024-09-11T00:26:40.608 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rbytes": 234, 2024-09-11T00:26:40.608 INFO:teuthology.orchestra.run.smithi112.stdout: "root_rsnaps": 6, 2024-09-11T00:26:40.608 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_fetch": 24146, 2024-09-11T00:26:40.608 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_set_tag": 0, 2024-09-11T00:26:40.608 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T00:26:40.608 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_inotable_repaired": 0, 2024-09-11T00:26:40.608 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_inodes": 2826, 2024-09-11T00:26:40.608 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dir_base_inodes": 19, 2024-09-11T00:26:40.608 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_dirfrag_rstats": 2807, 2024-09-11T00:26:40.609 INFO:teuthology.orchestra.run.smithi112.stdout: "scrub_file_inodes": 21320, 2024-09-11T00:26:40.609 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_inode_file_caps": 0, 2024-09-11T00:26:40.609 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_revoke": 25695, 2024-09-11T00:26:40.609 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_grant": 31126, 2024-09-11T00:26:40.609 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_trunc": 252, 2024-09-11T00:26:40.609 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T00:26:40.609 INFO:teuthology.orchestra.run.smithi112.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T00:26:40.609 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps": 40865, 2024-09-11T00:26:40.609 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_caps_dirty": 14608, 2024-09-11T00:26:40.609 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_cap_release": 114, 2024-09-11T00:26:40.609 INFO:teuthology.orchestra.run.smithi112.stdout: "process_request_cap_release": 20879 2024-09-11T00:26:40.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.610 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache": { 2024-09-11T00:26:40.610 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update": 0, 2024-09-11T00:26:40.610 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_update_receipt": 0, 2024-09-11T00:26:40.610 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_try_discover": 0, 2024-09-11T00:26:40.610 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_send_discover": 0, 2024-09-11T00:26:40.610 INFO:teuthology.orchestra.run.smithi112.stdout: "dir_handle_discover": 0, 2024-09-11T00:26:40.610 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays": 1698, 2024-09-11T00:26:40.610 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_delayed": 0, 2024-09-11T00:26:40.610 INFO:teuthology.orchestra.run.smithi112.stdout: "num_strays_enqueuing": 0, 2024-09-11T00:26:40.610 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_created": 14609, 2024-09-11T00:26:40.610 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_enqueued": 12856, 2024-09-11T00:26:40.610 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_reintegrated": 116, 2024-09-11T00:26:40.611 INFO:teuthology.orchestra.run.smithi112.stdout: "strays_migrated": 0, 2024-09-11T00:26:40.611 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_processing": 0, 2024-09-11T00:26:40.611 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_enqueued": 0, 2024-09-11T00:26:40.611 INFO:teuthology.orchestra.run.smithi112.stdout: "num_recovering_prioritized": 0, 2024-09-11T00:26:40.611 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_started": 0, 2024-09-11T00:26:40.611 INFO:teuthology.orchestra.run.smithi112.stdout: "recovery_completed": 0, 2024-09-11T00:26:40.611 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_quiesce_path": 0, 2024-09-11T00:26:40.611 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_quiesce_inode": 0, 2024-09-11T00:26:40.611 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_enqueue_scrub": 19, 2024-09-11T00:26:40.611 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_exportdir": 0, 2024-09-11T00:26:40.611 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_flush": 0, 2024-09-11T00:26:40.611 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragmentdir": 15, 2024-09-11T00:26:40.612 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_fragstats": 0, 2024-09-11T00:26:40.612 INFO:teuthology.orchestra.run.smithi112.stdout: "ireq_inodestats": 0, 2024-09-11T00:26:40.612 INFO:teuthology.orchestra.run.smithi112.stdout: "uninline_started": 0, 2024-09-11T00:26:40.612 INFO:teuthology.orchestra.run.smithi112.stdout: "uninline_succeeded": 0, 2024-09-11T00:26:40.612 INFO:teuthology.orchestra.run.smithi112.stdout: "uninline_write_failed": 0 2024-09-11T00:26:40.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.612 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log": { 2024-09-11T00:26:40.612 INFO:teuthology.orchestra.run.smithi112.stdout: "evlrg": 0, 2024-09-11T00:26:40.612 INFO:teuthology.orchestra.run.smithi112.stdout: "evadd": 78411, 2024-09-11T00:26:40.612 INFO:teuthology.orchestra.run.smithi112.stdout: "evex": 0, 2024-09-11T00:26:40.612 INFO:teuthology.orchestra.run.smithi112.stdout: "evtrm": 0, 2024-09-11T00:26:40.612 INFO:teuthology.orchestra.run.smithi112.stdout: "ev": 78411, 2024-09-11T00:26:40.613 INFO:teuthology.orchestra.run.smithi112.stdout: "evexg": 0, 2024-09-11T00:26:40.613 INFO:teuthology.orchestra.run.smithi112.stdout: "evexd": 0, 2024-09-11T00:26:40.613 INFO:teuthology.orchestra.run.smithi112.stdout: "segadd": 101, 2024-09-11T00:26:40.613 INFO:teuthology.orchestra.run.smithi112.stdout: "segex": 0, 2024-09-11T00:26:40.613 INFO:teuthology.orchestra.run.smithi112.stdout: "segtrm": 0, 2024-09-11T00:26:40.613 INFO:teuthology.orchestra.run.smithi112.stdout: "seg": 101, 2024-09-11T00:26:40.613 INFO:teuthology.orchestra.run.smithi112.stdout: "segmjr": 8, 2024-09-11T00:26:40.613 INFO:teuthology.orchestra.run.smithi112.stdout: "segexg": 0, 2024-09-11T00:26:40.613 INFO:teuthology.orchestra.run.smithi112.stdout: "segexd": 0, 2024-09-11T00:26:40.613 INFO:teuthology.orchestra.run.smithi112.stdout: "expos": 4194304, 2024-09-11T00:26:40.613 INFO:teuthology.orchestra.run.smithi112.stdout: "wrpos": 200511017, 2024-09-11T00:26:40.613 INFO:teuthology.orchestra.run.smithi112.stdout: "rdpos": 0, 2024-09-11T00:26:40.614 INFO:teuthology.orchestra.run.smithi112.stdout: "jlat": { 2024-09-11T00:26:40.614 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 12050, 2024-09-11T00:26:40.614 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 315.565467533, 2024-09-11T00:26:40.614 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.026188005 2024-09-11T00:26:40.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.614 INFO:teuthology.orchestra.run.smithi112.stdout: "replayed": 0 2024-09-11T00:26:40.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.614 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_mem": { 2024-09-11T00:26:40.614 INFO:teuthology.orchestra.run.smithi112.stdout: "ino": 13461, 2024-09-11T00:26:40.614 INFO:teuthology.orchestra.run.smithi112.stdout: "ino+": 26278, 2024-09-11T00:26:40.615 INFO:teuthology.orchestra.run.smithi112.stdout: "ino-": 12817, 2024-09-11T00:26:40.615 INFO:teuthology.orchestra.run.smithi112.stdout: "dir": 1724, 2024-09-11T00:26:40.615 INFO:teuthology.orchestra.run.smithi112.stdout: "dir+": 1921, 2024-09-11T00:26:40.615 INFO:teuthology.orchestra.run.smithi112.stdout: "dir-": 197, 2024-09-11T00:26:40.615 INFO:teuthology.orchestra.run.smithi112.stdout: "dn": 30309, 2024-09-11T00:26:40.615 INFO:teuthology.orchestra.run.smithi112.stdout: "dn+": 43375, 2024-09-11T00:26:40.615 INFO:teuthology.orchestra.run.smithi112.stdout: "dn-": 13066, 2024-09-11T00:26:40.615 INFO:teuthology.orchestra.run.smithi112.stdout: "cap": 4, 2024-09-11T00:26:40.615 INFO:teuthology.orchestra.run.smithi112.stdout: "cap+": 14513, 2024-09-11T00:26:40.615 INFO:teuthology.orchestra.run.smithi112.stdout: "cap-": 14509, 2024-09-11T00:26:40.616 INFO:teuthology.orchestra.run.smithi112.stdout: "rss": 205580, 2024-09-11T00:26:40.616 INFO:teuthology.orchestra.run.smithi112.stdout: "heap": 440262656 2024-09-11T00:26:40.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.616 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_server": { 2024-09-11T00:26:40.616 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_client_request": 45669, 2024-09-11T00:26:40.616 INFO:teuthology.orchestra.run.smithi112.stdout: "dispatch_server_request": 0, 2024-09-11T00:26:40.616 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_request": 40108, 2024-09-11T00:26:40.617 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_client_session": 260, 2024-09-11T00:26:40.617 INFO:teuthology.orchestra.run.smithi112.stdout: "handle_peer_request": 0, 2024-09-11T00:26:40.617 INFO:teuthology.orchestra.run.smithi112.stdout: "req_create_latency": { 2024-09-11T00:26:40.617 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 11670, 2024-09-11T00:26:40.617 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 50.700421553, 2024-09-11T00:26:40.617 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.004344509 2024-09-11T00:26:40.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.617 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getattr_latency": { 2024-09-11T00:26:40.617 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 132, 2024-09-11T00:26:40.617 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 2.456626154, 2024-09-11T00:26:40.617 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.018610804 2024-09-11T00:26:40.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.618 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getfilelock_latency": { 2024-09-11T00:26:40.618 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:40.618 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:40.618 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:40.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.618 INFO:teuthology.orchestra.run.smithi112.stdout: "req_link_latency": { 2024-09-11T00:26:40.618 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 263, 2024-09-11T00:26:40.618 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 9.732519843, 2024-09-11T00:26:40.619 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.037005778 2024-09-11T00:26:40.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.619 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookup_latency": { 2024-09-11T00:26:40.619 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 7363, 2024-09-11T00:26:40.619 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 11.776686498, 2024-09-11T00:26:40.619 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.001599441 2024-09-11T00:26:40.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.619 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookuphash_latency": { 2024-09-11T00:26:40.619 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:40.620 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:40.620 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:40.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.620 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupino_latency": { 2024-09-11T00:26:40.620 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 2, 2024-09-11T00:26:40.620 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000482036, 2024-09-11T00:26:40.620 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000241018 2024-09-11T00:26:40.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.620 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupname_latency": { 2024-09-11T00:26:40.620 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:40.621 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:40.621 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:40.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.621 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupparent_latency": { 2024-09-11T00:26:40.621 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:40.621 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:40.621 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:40.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.622 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lookupsnap_latency": { 2024-09-11T00:26:40.622 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:40.622 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:40.622 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:40.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.622 INFO:teuthology.orchestra.run.smithi112.stdout: "req_lssnap_latency": { 2024-09-11T00:26:40.622 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 10, 2024-09-11T00:26:40.622 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.001447434, 2024-09-11T00:26:40.622 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000144743 2024-09-11T00:26:40.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.623 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mkdir_latency": { 2024-09-11T00:26:40.623 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 1789, 2024-09-11T00:26:40.623 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 24.276906147, 2024-09-11T00:26:40.623 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.013570098 2024-09-11T00:26:40.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.623 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mknod_latency": { 2024-09-11T00:26:40.623 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 541, 2024-09-11T00:26:40.623 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 14.075106813, 2024-09-11T00:26:40.624 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.026016833 2024-09-11T00:26:40.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.624 INFO:teuthology.orchestra.run.smithi112.stdout: "req_mksnap_latency": { 2024-09-11T00:26:40.624 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 10, 2024-09-11T00:26:40.624 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.053450256, 2024-09-11T00:26:40.624 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.005345025 2024-09-11T00:26:40.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.624 INFO:teuthology.orchestra.run.smithi112.stdout: "req_open_latency": { 2024-09-11T00:26:40.624 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 45, 2024-09-11T00:26:40.624 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.188345898, 2024-09-11T00:26:40.625 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.004185464 2024-09-11T00:26:40.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.625 INFO:teuthology.orchestra.run.smithi112.stdout: "req_readdir_latency": { 2024-09-11T00:26:40.625 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 1961, 2024-09-11T00:26:40.625 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 8.685849684, 2024-09-11T00:26:40.625 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.004429296 2024-09-11T00:26:40.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.625 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rename_latency": { 2024-09-11T00:26:40.625 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 581, 2024-09-11T00:26:40.625 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 10.191259785, 2024-09-11T00:26:40.625 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.017540894 2024-09-11T00:26:40.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.626 INFO:teuthology.orchestra.run.smithi112.stdout: "req_renamesnap_latency": { 2024-09-11T00:26:40.626 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:40.626 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:40.626 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:40.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.626 INFO:teuthology.orchestra.run.smithi112.stdout: "req_snapdiff_latency": { 2024-09-11T00:26:40.626 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:40.626 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:40.626 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:40.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.626 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmdir_latency": { 2024-09-11T00:26:40.627 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 1989, 2024-09-11T00:26:40.627 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 24.190586691, 2024-09-11T00:26:40.627 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.012162185 2024-09-11T00:26:40.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.627 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmsnap_latency": { 2024-09-11T00:26:40.627 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 4, 2024-09-11T00:26:40.627 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.014563102, 2024-09-11T00:26:40.627 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.003640775 2024-09-11T00:26:40.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.627 INFO:teuthology.orchestra.run.smithi112.stdout: "req_rmxattr_latency": { 2024-09-11T00:26:40.627 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:40.627 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:40.628 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:40.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.628 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setattr_latency": { 2024-09-11T00:26:40.628 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 259, 2024-09-11T00:26:40.628 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 14.205150239, 2024-09-11T00:26:40.628 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.054846139 2024-09-11T00:26:40.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.628 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setdirlayout_latency": { 2024-09-11T00:26:40.628 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:40.628 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:40.628 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:40.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.629 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setfilelock_latency": { 2024-09-11T00:26:40.629 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:40.629 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:40.629 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:40.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.629 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setlayout_latency": { 2024-09-11T00:26:40.629 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:40.629 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:40.629 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:40.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.630 INFO:teuthology.orchestra.run.smithi112.stdout: "req_setxattr_latency": { 2024-09-11T00:26:40.630 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 7, 2024-09-11T00:26:40.630 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.018435658, 2024-09-11T00:26:40.630 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.002633665 2024-09-11T00:26:40.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.630 INFO:teuthology.orchestra.run.smithi112.stdout: "req_symlink_latency": { 2024-09-11T00:26:40.630 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 506, 2024-09-11T00:26:40.630 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 11.403785145, 2024-09-11T00:26:40.630 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.022537124 2024-09-11T00:26:40.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.630 INFO:teuthology.orchestra.run.smithi112.stdout: "req_unlink_latency": { 2024-09-11T00:26:40.630 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 12976, 2024-09-11T00:26:40.631 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 26.851271388, 2024-09-11T00:26:40.631 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.002069302 2024-09-11T00:26:40.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.631 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_revoke_eviction": 0, 2024-09-11T00:26:40.631 INFO:teuthology.orchestra.run.smithi112.stdout: "cap_acquisition_throttle": 0, 2024-09-11T00:26:40.631 INFO:teuthology.orchestra.run.smithi112.stdout: "req_getvxattr_latency": { 2024-09-11T00:26:40.631 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:40.631 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:40.631 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:40.631 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-11T00:26:40.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.632 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_sessions": { 2024-09-11T00:26:40.632 INFO:teuthology.orchestra.run.smithi112.stdout: "session_count": 2, 2024-09-11T00:26:40.632 INFO:teuthology.orchestra.run.smithi112.stdout: "session_add": 3, 2024-09-11T00:26:40.632 INFO:teuthology.orchestra.run.smithi112.stdout: "session_remove": 1, 2024-09-11T00:26:40.632 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_open": 2, 2024-09-11T00:26:40.632 INFO:teuthology.orchestra.run.smithi112.stdout: "sessions_stale": 0, 2024-09-11T00:26:40.632 INFO:teuthology.orchestra.run.smithi112.stdout: "total_load": 210, 2024-09-11T00:26:40.632 INFO:teuthology.orchestra.run.smithi112.stdout: "average_load": 105, 2024-09-11T00:26:40.632 INFO:teuthology.orchestra.run.smithi112.stdout: "avg_session_uptime": 603, 2024-09-11T00:26:40.632 INFO:teuthology.orchestra.run.smithi112.stdout: "mdthresh_evicted": 0 2024-09-11T00:26:40.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.632 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool": { 2024-09-11T00:26:40.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:26:40.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_items": 0, 2024-09-11T00:26:40.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:26:40.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:26:40.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:26:40.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:26:40.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:26:40.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:26:40.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:26:40.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:26:40.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:26:40.633 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:26:40.634 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:26:40.634 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:26:40.634 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:26:40.634 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_items": 0, 2024-09-11T00:26:40.634 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:26:40.634 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_items": 0, 2024-09-11T00:26:40.634 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:26:40.634 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:26:40.634 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:26:40.634 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:26:40.634 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:26:40.634 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:26:40.635 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:26:40.635 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_items": 0, 2024-09-11T00:26:40.635 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:26:40.635 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:26:40.635 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:26:40.635 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_items": 0, 2024-09-11T00:26:40.635 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_bytes": 0, 2024-09-11T00:26:40.635 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_items": 0, 2024-09-11T00:26:40.635 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:26:40.635 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:26:40.635 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:26:40.635 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:26:40.636 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_bytes": 14403128, 2024-09-11T00:26:40.636 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_items": 16932, 2024-09-11T00:26:40.636 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_bytes": 88, 2024-09-11T00:26:40.636 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_items": 1, 2024-09-11T00:26:40.636 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bytes": 0, 2024-09-11T00:26:40.636 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_items": 0, 2024-09-11T00:26:40.636 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:26:40.636 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_items": 0, 2024-09-11T00:26:40.636 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:26:40.636 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_items": 0, 2024-09-11T00:26:40.636 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_bytes": 8264, 2024-09-11T00:26:40.636 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_items": 183, 2024-09-11T00:26:40.637 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:26:40.637 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:26:40.637 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_bytes": 0, 2024-09-11T00:26:40.637 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_items": 0, 2024-09-11T00:26:40.637 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_bytes": 57854250, 2024-09-11T00:26:40.637 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_items": 1563604, 2024-09-11T00:26:40.637 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_bytes": 0, 2024-09-11T00:26:40.637 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_items": 0, 2024-09-11T00:26:40.637 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_bytes": 0, 2024-09-11T00:26:40.637 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_items": 0 2024-09-11T00:26:40.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.637 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter": { 2024-09-11T00:26:40.637 INFO:teuthology.orchestra.run.smithi112.stdout: "op_active": 0, 2024-09-11T00:26:40.638 INFO:teuthology.orchestra.run.smithi112.stdout: "op_laggy": 0, 2024-09-11T00:26:40.638 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send": 51580, 2024-09-11T00:26:40.638 INFO:teuthology.orchestra.run.smithi112.stdout: "op_send_bytes": 201654173, 2024-09-11T00:26:40.638 INFO:teuthology.orchestra.run.smithi112.stdout: "op_resend": 32, 2024-09-11T00:26:40.638 INFO:teuthology.orchestra.run.smithi112.stdout: "op_reply": 51580, 2024-09-11T00:26:40.638 INFO:teuthology.orchestra.run.smithi112.stdout: "op_latency": { 2024-09-11T00:26:40.638 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 51580, 2024-09-11T00:26:40.638 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 172.518506764, 2024-09-11T00:26:40.638 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.003344678 2024-09-11T00:26:40.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.638 INFO:teuthology.orchestra.run.smithi112.stdout: "op_inflight": 0, 2024-09-11T00:26:40.638 INFO:teuthology.orchestra.run.smithi112.stdout: "oplen_avg": { 2024-09-11T00:26:40.639 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 51580, 2024-09-11T00:26:40.639 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 51952 2024-09-11T00:26:40.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.639 INFO:teuthology.orchestra.run.smithi112.stdout: "op": 51580, 2024-09-11T00:26:40.639 INFO:teuthology.orchestra.run.smithi112.stdout: "op_r": 24348, 2024-09-11T00:26:40.639 INFO:teuthology.orchestra.run.smithi112.stdout: "op_w": 27232, 2024-09-11T00:26:40.639 INFO:teuthology.orchestra.run.smithi112.stdout: "op_rmw": 0, 2024-09-11T00:26:40.639 INFO:teuthology.orchestra.run.smithi112.stdout: "op_pg": 0, 2024-09-11T00:26:40.639 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_stat": 0, 2024-09-11T00:26:40.639 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_create": 11, 2024-09-11T00:26:40.639 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_read": 183, 2024-09-11T00:26:40.639 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_write": 12214, 2024-09-11T00:26:40.640 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writefull": 85, 2024-09-11T00:26:40.640 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_writesame": 0, 2024-09-11T00:26:40.640 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_append": 0, 2024-09-11T00:26:40.640 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_zero": 58, 2024-09-11T00:26:40.640 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_truncate": 15, 2024-09-11T00:26:40.640 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_delete": 14293, 2024-09-11T00:26:40.640 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_mapext": 0, 2024-09-11T00:26:40.640 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_sparse_read": 0, 2024-09-11T00:26:40.640 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_clonerange": 0, 2024-09-11T00:26:40.640 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_getxattr": 24165, 2024-09-11T00:26:40.640 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_setxattr": 22, 2024-09-11T00:26:40.640 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_cmpxattr": 0, 2024-09-11T00:26:40.641 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_rmxattr": 0, 2024-09-11T00:26:40.641 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_resetxattrs": 0, 2024-09-11T00:26:40.641 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_call": 0, 2024-09-11T00:26:40.641 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_watch": 0, 2024-09-11T00:26:40.641 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_notify": 0, 2024-09-11T00:26:40.641 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T00:26:40.641 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls": 0, 2024-09-11T00:26:40.641 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_pgls_filter": 0, 2024-09-11T00:26:40.641 INFO:teuthology.orchestra.run.smithi112.stdout: "osdop_other": 294, 2024-09-11T00:26:40.641 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_active": 0, 2024-09-11T00:26:40.641 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_send": 0, 2024-09-11T00:26:40.641 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_resend": 0, 2024-09-11T00:26:40.642 INFO:teuthology.orchestra.run.smithi112.stdout: "linger_ping": 0, 2024-09-11T00:26:40.642 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_active": 0, 2024-09-11T00:26:40.642 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_send": 0, 2024-09-11T00:26:40.642 INFO:teuthology.orchestra.run.smithi112.stdout: "poolop_resend": 0, 2024-09-11T00:26:40.642 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_active": 0, 2024-09-11T00:26:40.642 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_send": 0, 2024-09-11T00:26:40.642 INFO:teuthology.orchestra.run.smithi112.stdout: "poolstat_resend": 0, 2024-09-11T00:26:40.642 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_active": 0, 2024-09-11T00:26:40.642 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_send": 0, 2024-09-11T00:26:40.642 INFO:teuthology.orchestra.run.smithi112.stdout: "statfs_resend": 0, 2024-09-11T00:26:40.642 INFO:teuthology.orchestra.run.smithi112.stdout: "command_active": 0, 2024-09-11T00:26:40.642 INFO:teuthology.orchestra.run.smithi112.stdout: "command_send": 0, 2024-09-11T00:26:40.643 INFO:teuthology.orchestra.run.smithi112.stdout: "command_resend": 0, 2024-09-11T00:26:40.643 INFO:teuthology.orchestra.run.smithi112.stdout: "map_epoch": 87, 2024-09-11T00:26:40.643 INFO:teuthology.orchestra.run.smithi112.stdout: "map_full": 0, 2024-09-11T00:26:40.643 INFO:teuthology.orchestra.run.smithi112.stdout: "map_inc": 12, 2024-09-11T00:26:40.643 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_sessions": 12, 2024-09-11T00:26:40.643 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_open": 12, 2024-09-11T00:26:40.643 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_session_close": 0, 2024-09-11T00:26:40.643 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_laggy": 0, 2024-09-11T00:26:40.643 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_wr": 502, 2024-09-11T00:26:40.643 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_rd": 0, 2024-09-11T00:26:40.643 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_del": 110 2024-09-11T00:26:40.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.643 INFO:teuthology.orchestra.run.smithi112.stdout: "oft": { 2024-09-11T00:26:40.644 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_objs": 1, 2024-09-11T00:26:40.644 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_kv_pairs": 0, 2024-09-11T00:26:40.644 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_updates": 0, 2024-09-11T00:26:40.644 INFO:teuthology.orchestra.run.smithi112.stdout: "omap_total_removes": 0 2024-09-11T00:26:40.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.644 INFO:teuthology.orchestra.run.smithi112.stdout: "purge_queue": { 2024-09-11T00:26:40.644 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops": 0, 2024-09-11T00:26:40.644 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_ops_high_water": 38, 2024-09-11T00:26:40.644 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing": 0, 2024-09-11T00:26:40.644 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executing_high_water": 32, 2024-09-11T00:26:40.644 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executed_ops": 13793, 2024-09-11T00:26:40.645 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_executed": 12856, 2024-09-11T00:26:40.645 INFO:teuthology.orchestra.run.smithi112.stdout: "pq_item_in_journal": 0 2024-09-11T00:26:40.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.645 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:26:40.645 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-11T00:26:40.645 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-09-11T00:26:40.645 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-11T00:26:40.645 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 134174, 2024-09-11T00:26:40.645 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 31956519, 2024-09-11T00:26:40.645 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-11T00:26:40.645 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 134174, 2024-09-11T00:26:40.645 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-09-11T00:26:40.645 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-09-11T00:26:40.646 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 134174, 2024-09-11T00:26:40.646 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 31956519, 2024-09-11T00:26:40.646 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-11T00:26:40.646 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:40.646 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:40.646 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:40.646 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-11T00:26:40.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.646 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_bytes": { 2024-09-11T00:26:40.646 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-11T00:26:40.646 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-09-11T00:26:40.646 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-11T00:26:40.647 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-09-11T00:26:40.647 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-09-11T00:26:40.647 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-11T00:26:40.647 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-09-11T00:26:40.647 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 51580, 2024-09-11T00:26:40.647 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 203047013, 2024-09-11T00:26:40.647 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 51580, 2024-09-11T00:26:40.647 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 203047013, 2024-09-11T00:26:40.647 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-11T00:26:40.647 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:40.647 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:40.647 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:40.648 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-11T00:26:40.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.648 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-objecter_ops": { 2024-09-11T00:26:40.648 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-11T00:26:40.648 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 1024, 2024-09-11T00:26:40.648 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-11T00:26:40.648 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 0, 2024-09-11T00:26:40.648 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 0, 2024-09-11T00:26:40.648 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-11T00:26:40.648 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 0, 2024-09-11T00:26:40.648 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 51580, 2024-09-11T00:26:40.648 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 51580, 2024-09-11T00:26:40.649 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 51580, 2024-09-11T00:26:40.649 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 51580, 2024-09-11T00:26:40.649 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-11T00:26:40.649 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:40.649 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:40.649 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:40.649 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-11T00:26:40.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.649 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle": { 2024-09-11T00:26:40.649 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-11T00:26:40.649 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2024-09-11T00:26:40.649 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-11T00:26:40.650 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 12856, 2024-09-11T00:26:40.650 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 1392840, 2024-09-11T00:26:40.650 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-11T00:26:40.650 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 12856, 2024-09-11T00:26:40.650 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-09-11T00:26:40.650 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-09-11T00:26:40.650 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 164, 2024-09-11T00:26:40.650 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 1392840, 2024-09-11T00:26:40.651 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-11T00:26:40.651 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:40.651 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:40.651 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:40.651 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-11T00:26:40.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.651 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-write_buf_throttle-0x560c4aeacdc0": { 2024-09-11T00:26:40.651 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-11T00:26:40.651 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 3758096384, 2024-09-11T00:26:40.651 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-11T00:26:40.651 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 78411, 2024-09-11T00:26:40.651 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 196316713, 2024-09-11T00:26:40.652 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-11T00:26:40.652 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 78411, 2024-09-11T00:26:40.652 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-09-11T00:26:40.652 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-09-11T00:26:40.652 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 12050, 2024-09-11T00:26:40.652 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 196316713, 2024-09-11T00:26:40.652 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-11T00:26:40.652 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:40.652 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:40.652 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:40.652 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-11T00:26:40.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:40.653 INFO:teuthology.orchestra.run.smithi112.stdout: "trackedop": { 2024-09-11T00:26:40.653 INFO:teuthology.orchestra.run.smithi112.stdout: "slow_ops_count": 0 2024-09-11T00:26:40.653 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-11T00:26:40.653 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-11T00:26:41.531 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-11T00:26:41.531 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-09-11T00:26:41.532 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-09-11T00:26:41.532 DEBUG:tasks.check_counter:Getting stats from e 2024-09-11T00:26:41.532 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-11T00:26:41.779 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T00:26:42.217 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:41 smithi112 ceph-mon[35627]: pgmap v638: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:26:42.217 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:41 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:26:42.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:41 smithi138 ceph-mon[35019]: pgmap v638: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:26:42.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:41 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:26:42.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:41 smithi078 ceph-mon[30865]: pgmap v638: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:26:42.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:41 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:26:42.334 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-11T00:26:42.334 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:26:42.334 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 4, 2024-09-11T00:26:42.334 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 4, 2024-09-11T00:26:42.334 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 2944, 2024-09-11T00:26:42.334 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 448, 2024-09-11T00:26:42.335 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 4, 2024-09-11T00:26:42.335 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 0, 2024-09-11T00:26:42.335 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.002965965, 2024-09-11T00:26:42.335 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.000040399, 2024-09-11T00:26:42.335 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.002131755, 2024-09-11T00:26:42.335 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:42.335 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:42.335 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 3, 2024-09-11T00:26:42.335 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.003944518, 2024-09-11T00:26:42.335 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.001314839 2024-09-11T00:26:42.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:42.335 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:42.335 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:42.335 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:42.336 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:42.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:42.336 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-11T00:26:42.336 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T00:26:42.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:42.336 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:26:42.336 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 1, 2024-09-11T00:26:42.336 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 156, 2024-09-11T00:26:42.336 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 160, 2024-09-11T00:26:42.336 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 107648, 2024-09-11T00:26:42.336 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 3, 2024-09-11T00:26:42.336 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 2, 2024-09-11T00:26:42.336 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.013017125, 2024-09-11T00:26:42.336 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.010157725, 2024-09-11T00:26:42.337 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.000986141, 2024-09-11T00:26:42.337 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:42.337 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:42.337 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 154, 2024-09-11T00:26:42.337 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.010448694, 2024-09-11T00:26:42.337 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000067848 2024-09-11T00:26:42.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:42.337 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:42.337 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:42.337 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:42.337 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:42.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:42.337 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T00:26:42.337 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 107648 2024-09-11T00:26:42.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:42.338 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:26:42.338 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 212, 2024-09-11T00:26:42.338 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 207, 2024-09-11T00:26:42.338 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 829040, 2024-09-11T00:26:42.338 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 126784, 2024-09-11T00:26:42.338 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 2, 2024-09-11T00:26:42.338 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 1, 2024-09-11T00:26:42.338 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.036993069, 2024-09-11T00:26:42.338 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.017663670, 2024-09-11T00:26:42.338 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.027160694, 2024-09-11T00:26:42.338 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:42.338 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:42.338 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 206, 2024-09-11T00:26:42.339 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.013069472, 2024-09-11T00:26:42.339 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000063444 2024-09-11T00:26:42.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:42.339 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:42.339 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:42.339 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:42.339 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:42.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:42.339 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 829040, 2024-09-11T00:26:42.339 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 126784 2024-09-11T00:26:42.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:42.340 INFO:teuthology.orchestra.run.smithi112.stdout: "cct": { 2024-09-11T00:26:42.340 INFO:teuthology.orchestra.run.smithi112.stdout: "total_workers": 0, 2024-09-11T00:26:42.340 INFO:teuthology.orchestra.run.smithi112.stdout: "unhealthy_workers": 0 2024-09-11T00:26:42.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:42.340 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool": { 2024-09-11T00:26:42.340 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:26:42.340 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_items": 0, 2024-09-11T00:26:42.340 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:26:42.340 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:26:42.340 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:26:42.340 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:26:42.340 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:26:42.341 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:26:42.341 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:26:42.341 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:26:42.341 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:26:42.341 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:26:42.341 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:26:42.341 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:26:42.341 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:26:42.341 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_items": 0, 2024-09-11T00:26:42.341 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:26:42.341 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_items": 0, 2024-09-11T00:26:42.341 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:26:42.341 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:26:42.341 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:26:42.342 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:26:42.342 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:26:42.342 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:26:42.342 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:26:42.342 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_items": 0, 2024-09-11T00:26:42.342 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:26:42.342 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:26:42.342 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:26:42.342 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_items": 0, 2024-09-11T00:26:42.342 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_bytes": 0, 2024-09-11T00:26:42.342 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_items": 0, 2024-09-11T00:26:42.342 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:26:42.342 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:26:42.343 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:26:42.343 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:26:42.343 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_bytes": 148984, 2024-09-11T00:26:42.343 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_items": 30, 2024-09-11T00:26:42.343 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:26:42.343 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_items": 0, 2024-09-11T00:26:42.343 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bytes": 0, 2024-09-11T00:26:42.343 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_items": 0, 2024-09-11T00:26:42.343 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:26:42.343 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_items": 0, 2024-09-11T00:26:42.343 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:26:42.343 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_items": 0, 2024-09-11T00:26:42.343 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_bytes": 0, 2024-09-11T00:26:42.343 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_items": 0, 2024-09-11T00:26:42.344 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:26:42.344 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:26:42.344 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_bytes": 0, 2024-09-11T00:26:42.344 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_items": 0, 2024-09-11T00:26:42.344 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_bytes": 968, 2024-09-11T00:26:42.344 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_items": 2, 2024-09-11T00:26:42.344 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_bytes": 0, 2024-09-11T00:26:42.344 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_items": 0, 2024-09-11T00:26:42.344 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_bytes": 0, 2024-09-11T00:26:42.344 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_items": 0 2024-09-11T00:26:42.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:42.344 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:26:42.344 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-11T00:26:42.344 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-09-11T00:26:42.345 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-11T00:26:42.345 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 213, 2024-09-11T00:26:42.345 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 799086, 2024-09-11T00:26:42.345 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-11T00:26:42.345 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 213, 2024-09-11T00:26:42.345 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-09-11T00:26:42.345 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-09-11T00:26:42.345 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 213, 2024-09-11T00:26:42.345 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 799086, 2024-09-11T00:26:42.345 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-11T00:26:42.345 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:42.345 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:42.345 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:42.345 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-11T00:26:42.345 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-11T00:26:42.346 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-11T00:26:43.043 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.e 2024-09-11T00:26:43.044 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.e 2024-09-11T00:26:43.044 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.e 2024-09-11T00:26:43.044 DEBUG:tasks.check_counter:Getting stats from h 2024-09-11T00:26:43.044 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-11T00:26:43.900 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T00:26:44.422 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-11T00:26:44.461 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:26:44.461 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 0, 2024-09-11T00:26:44.461 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 2, 2024-09-11T00:26:44.461 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 0, 2024-09-11T00:26:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 0, 2024-09-11T00:26:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 4, 2024-09-11T00:26:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 0, 2024-09-11T00:26:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.001125134, 2024-09-11T00:26:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T00:26:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.000175469, 2024-09-11T00:26:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:26:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:26:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:26:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 1, 2024-09-11T00:26:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 155, 2024-09-11T00:26:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 160, 2024-09-11T00:26:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 107472, 2024-09-11T00:26:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 3, 2024-09-11T00:26:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 2, 2024-09-11T00:26:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.012227666, 2024-09-11T00:26:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.009570168, 2024-09-11T00:26:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.000946179, 2024-09-11T00:26:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 153, 2024-09-11T00:26:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.009509100, 2024-09-11T00:26:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000062150 2024-09-11T00:26:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T00:26:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 107472 2024-09-11T00:26:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:26:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 214, 2024-09-11T00:26:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 207, 2024-09-11T00:26:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 831440, 2024-09-11T00:26:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 125952, 2024-09-11T00:26:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 2, 2024-09-11T00:26:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 1, 2024-09-11T00:26:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.036840937, 2024-09-11T00:26:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.017442349, 2024-09-11T00:26:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.025492836, 2024-09-11T00:26:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 207, 2024-09-11T00:26:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.016409089, 2024-09-11T00:26:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000079270 2024-09-11T00:26:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 831440, 2024-09-11T00:26:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 125952 2024-09-11T00:26:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: "cct": { 2024-09-11T00:26:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: "total_workers": 0, 2024-09-11T00:26:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: "unhealthy_workers": 0 2024-09-11T00:26:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool": { 2024-09-11T00:26:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:26:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_items": 0, 2024-09-11T00:26:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:26:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:26:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:26:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:26:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:26:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:26:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:26:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:26:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:26:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:26:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:26:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:26:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:26:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_items": 0, 2024-09-11T00:26:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:26:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_items": 0, 2024-09-11T00:26:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:26:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:26:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:26:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:26:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:26:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:26:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:26:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_items": 0, 2024-09-11T00:26:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:26:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:26:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:26:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_items": 0, 2024-09-11T00:26:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_bytes": 0, 2024-09-11T00:26:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_items": 0, 2024-09-11T00:26:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:26:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:26:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:26:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:26:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_bytes": 148967, 2024-09-11T00:26:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_items": 29, 2024-09-11T00:26:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:26:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_items": 0, 2024-09-11T00:26:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bytes": 0, 2024-09-11T00:26:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_items": 0, 2024-09-11T00:26:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:26:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_items": 0, 2024-09-11T00:26:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:26:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_items": 0, 2024-09-11T00:26:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_bytes": 0, 2024-09-11T00:26:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_items": 0, 2024-09-11T00:26:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:26:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:26:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_bytes": 0, 2024-09-11T00:26:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_items": 0, 2024-09-11T00:26:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_bytes": 968, 2024-09-11T00:26:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_items": 2, 2024-09-11T00:26:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_bytes": 0, 2024-09-11T00:26:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_items": 0, 2024-09-11T00:26:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_bytes": 0, 2024-09-11T00:26:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_items": 0 2024-09-11T00:26:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:26:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-11T00:26:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-09-11T00:26:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-11T00:26:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 211, 2024-09-11T00:26:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 798826, 2024-09-11T00:26:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-11T00:26:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 211, 2024-09-11T00:26:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-09-11T00:26:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-09-11T00:26:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 211, 2024-09-11T00:26:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 798826, 2024-09-11T00:26:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-11T00:26:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-11T00:26:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-11T00:26:44.472 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-11T00:26:44.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:44 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:26:44.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:44 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:26:44.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:44 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:26:44.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:44 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:26:44.584 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:44 smithi078 ceph-mon[30865]: pgmap v639: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:26:44.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:44 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:26:44.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:44 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:26:44.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:44 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:26:44.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:44 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:26:44.733 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:44 smithi112 ceph-mon[35627]: pgmap v639: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:26:44.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:44 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:26:44.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:44 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:26:44.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:44 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:26:44.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:44 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:26:44.793 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:44 smithi138 ceph-mon[35019]: pgmap v639: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:26:45.141 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.h 2024-09-11T00:26:45.141 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.h 2024-09-11T00:26:45.141 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.h 2024-09-11T00:26:45.141 DEBUG:tasks.check_counter:Getting stats from k 2024-09-11T00:26:45.142 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-11T00:26:45.435 INFO:teuthology.orchestra.run.smithi112.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T00:26:45.983 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-11T00:26:45.983 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:26:45.983 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 0, 2024-09-11T00:26:45.983 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 2, 2024-09-11T00:26:45.983 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 0, 2024-09-11T00:26:45.984 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 0, 2024-09-11T00:26:45.984 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 4, 2024-09-11T00:26:45.984 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 0, 2024-09-11T00:26:45.984 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.001076459, 2024-09-11T00:26:45.984 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T00:26:45.984 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.000281963, 2024-09-11T00:26:45.984 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:45.984 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:45.984 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:45.984 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:45.984 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:45.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:45.985 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:45.985 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:45.985 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:45.985 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:45.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:45.985 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:26:45.985 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:26:45.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:45.985 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:26:45.985 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 5, 2024-09-11T00:26:45.985 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 161, 2024-09-11T00:26:45.985 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 3104, 2024-09-11T00:26:45.985 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 108624, 2024-09-11T00:26:45.985 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 3, 2024-09-11T00:26:45.986 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 2, 2024-09-11T00:26:45.986 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.014365817, 2024-09-11T00:26:45.986 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.009744240, 2024-09-11T00:26:45.986 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.002909936, 2024-09-11T00:26:45.986 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:45.986 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:45.986 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 160, 2024-09-11T00:26:45.986 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.014654261, 2024-09-11T00:26:45.986 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000091589 2024-09-11T00:26:45.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:45.986 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:45.986 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:45.986 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:45.987 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:45.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:45.987 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-11T00:26:45.987 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 108624 2024-09-11T00:26:45.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:45.987 INFO:teuthology.orchestra.run.smithi112.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:26:45.987 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_messages": 215, 2024-09-11T00:26:45.987 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages": 210, 2024-09-11T00:26:45.987 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_bytes": 829856, 2024-09-11T00:26:45.987 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_bytes": 128704, 2024-09-11T00:26:45.987 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_created_connections": 2, 2024-09-11T00:26:45.987 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_active_connections": 1, 2024-09-11T00:26:45.987 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_total_time": 0.037827257, 2024-09-11T00:26:45.987 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_send_time": 0.018671799, 2024-09-11T00:26:45.988 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_recv_time": 0.025867127, 2024-09-11T00:26:45.988 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:45.988 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:45.988 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 209, 2024-09-11T00:26:45.988 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.012541057, 2024-09-11T00:26:45.988 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000060005 2024-09-11T00:26:45.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:45.988 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:45.988 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:45.988 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:45.988 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:45.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:45.988 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_recv_encrypted_bytes": 829856, 2024-09-11T00:26:45.989 INFO:teuthology.orchestra.run.smithi112.stdout: "msgr_send_encrypted_bytes": 128704 2024-09-11T00:26:45.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:45.989 INFO:teuthology.orchestra.run.smithi112.stdout: "cct": { 2024-09-11T00:26:45.989 INFO:teuthology.orchestra.run.smithi112.stdout: "total_workers": 0, 2024-09-11T00:26:45.989 INFO:teuthology.orchestra.run.smithi112.stdout: "unhealthy_workers": 0 2024-09-11T00:26:45.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:45.989 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool": { 2024-09-11T00:26:45.989 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:26:45.989 INFO:teuthology.orchestra.run.smithi112.stdout: "bloom_filter_items": 0, 2024-09-11T00:26:45.989 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:26:45.989 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:26:45.989 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:26:45.989 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:26:45.990 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:26:45.990 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:26:45.990 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:26:45.990 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:26:45.990 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:26:45.990 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:26:45.990 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:26:45.990 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:26:45.990 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:26:45.990 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_items": 0, 2024-09-11T00:26:45.990 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:26:45.990 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blob_items": 0, 2024-09-11T00:26:45.990 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:26:45.990 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:26:45.991 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:26:45.991 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:26:45.991 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:26:45.991 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:26:45.991 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:26:45.991 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_txc_items": 0, 2024-09-11T00:26:45.991 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:26:45.991 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:26:45.991 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:26:45.991 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_writing_items": 0, 2024-09-11T00:26:45.991 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_bytes": 0, 2024-09-11T00:26:45.991 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_items": 0, 2024-09-11T00:26:45.991 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:26:45.991 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:26:45.992 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:26:45.992 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:26:45.992 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_bytes": 148967, 2024-09-11T00:26:45.992 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_anon_items": 29, 2024-09-11T00:26:45.992 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:26:45.992 INFO:teuthology.orchestra.run.smithi112.stdout: "buffer_meta_items": 0, 2024-09-11T00:26:45.992 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bytes": 0, 2024-09-11T00:26:45.992 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_items": 0, 2024-09-11T00:26:45.992 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:26:45.992 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mapbl_items": 0, 2024-09-11T00:26:45.992 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:26:45.992 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pglog_items": 0, 2024-09-11T00:26:45.992 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_bytes": 0, 2024-09-11T00:26:45.993 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_items": 0, 2024-09-11T00:26:45.993 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:26:45.993 INFO:teuthology.orchestra.run.smithi112.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:26:45.993 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_bytes": 0, 2024-09-11T00:26:45.993 INFO:teuthology.orchestra.run.smithi112.stdout: "pgmap_items": 0, 2024-09-11T00:26:45.993 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_bytes": 968, 2024-09-11T00:26:45.993 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_co_items": 2, 2024-09-11T00:26:45.993 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_bytes": 0, 2024-09-11T00:26:45.993 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_1_items": 0, 2024-09-11T00:26:45.993 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_bytes": 0, 2024-09-11T00:26:45.993 INFO:teuthology.orchestra.run.smithi112.stdout: "unittest_2_items": 0 2024-09-11T00:26:45.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-11T00:26:45.993 INFO:teuthology.orchestra.run.smithi112.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:26:45.993 INFO:teuthology.orchestra.run.smithi112.stdout: "val": 0, 2024-09-11T00:26:45.994 INFO:teuthology.orchestra.run.smithi112.stdout: "max": 104857600, 2024-09-11T00:26:45.994 INFO:teuthology.orchestra.run.smithi112.stdout: "get_started": 0, 2024-09-11T00:26:45.994 INFO:teuthology.orchestra.run.smithi112.stdout: "get": 216, 2024-09-11T00:26:45.994 INFO:teuthology.orchestra.run.smithi112.stdout: "get_sum": 799476, 2024-09-11T00:26:45.994 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_fail": 0, 2024-09-11T00:26:45.994 INFO:teuthology.orchestra.run.smithi112.stdout: "get_or_fail_success": 216, 2024-09-11T00:26:45.994 INFO:teuthology.orchestra.run.smithi112.stdout: "take": 0, 2024-09-11T00:26:45.994 INFO:teuthology.orchestra.run.smithi112.stdout: "take_sum": 0, 2024-09-11T00:26:45.994 INFO:teuthology.orchestra.run.smithi112.stdout: "put": 216, 2024-09-11T00:26:45.994 INFO:teuthology.orchestra.run.smithi112.stdout: "put_sum": 799476, 2024-09-11T00:26:45.994 INFO:teuthology.orchestra.run.smithi112.stdout: "wait": { 2024-09-11T00:26:45.994 INFO:teuthology.orchestra.run.smithi112.stdout: "avgcount": 0, 2024-09-11T00:26:45.994 INFO:teuthology.orchestra.run.smithi112.stdout: "sum": 0.000000000, 2024-09-11T00:26:45.994 INFO:teuthology.orchestra.run.smithi112.stdout: "avgtime": 0.000000000 2024-09-11T00:26:45.994 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-11T00:26:45.995 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-11T00:26:45.995 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-11T00:26:46.750 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-11T00:26:46.750 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-11T00:26:46.751 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-11T00:26:46.751 DEBUG:tasks.check_counter:Getting stats from c 2024-09-11T00:26:46.751 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-11T00:26:46.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:46 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:26:46.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:46 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:26:46.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:46 smithi112 ceph-mon[35627]: pgmap v640: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:26:46.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:46 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:26:46.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:46 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:26:46.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:46 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:26:47.008 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:26:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:46 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:26:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:46 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:26:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:46 smithi138 ceph-mon[35019]: pgmap v640: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:26:47.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:46 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:26:47.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:46 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:26:47.044 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:46 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:26:47.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:46 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:26:47.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:46 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:26:47.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:46 smithi078 ceph-mon[30865]: pgmap v640: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:26:47.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:46 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:26:47.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:46 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:26:47.085 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:46 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' 2024-09-11T00:26:47.546 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-11T00:26:47.546 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:26:47.547 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 0, 2024-09-11T00:26:47.547 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 2, 2024-09-11T00:26:47.547 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 0, 2024-09-11T00:26:47.547 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 0, 2024-09-11T00:26:47.547 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 4, 2024-09-11T00:26:47.547 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 0, 2024-09-11T00:26:47.547 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.001144351, 2024-09-11T00:26:47.547 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T00:26:47.547 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.000273738, 2024-09-11T00:26:47.547 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:47.548 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:47.548 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:47.548 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:47.548 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:47.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:47.548 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:47.548 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:47.548 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:47.548 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:47.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:47.549 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:26:47.549 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:26:47.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:47.549 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:26:47.549 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 216, 2024-09-11T00:26:47.549 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 209, 2024-09-11T00:26:47.549 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 831984, 2024-09-11T00:26:47.549 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 127232, 2024-09-11T00:26:47.549 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 2, 2024-09-11T00:26:47.549 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 1, 2024-09-11T00:26:47.549 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.040514481, 2024-09-11T00:26:47.550 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.019297950, 2024-09-11T00:26:47.550 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.027747742, 2024-09-11T00:26:47.550 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:47.550 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:47.550 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 209, 2024-09-11T00:26:47.550 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.017011642, 2024-09-11T00:26:47.551 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000081395 2024-09-11T00:26:47.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:47.551 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:47.551 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:47.551 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:47.551 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:47.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:47.551 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 831984, 2024-09-11T00:26:47.551 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 127232 2024-09-11T00:26:47.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:47.552 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:26:47.552 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 1, 2024-09-11T00:26:47.552 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 156, 2024-09-11T00:26:47.552 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 160, 2024-09-11T00:26:47.552 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 107648, 2024-09-11T00:26:47.552 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 3, 2024-09-11T00:26:47.552 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 2, 2024-09-11T00:26:47.552 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.012802006, 2024-09-11T00:26:47.552 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.009997552, 2024-09-11T00:26:47.553 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.000987274, 2024-09-11T00:26:47.553 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:47.553 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:47.553 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 154, 2024-09-11T00:26:47.553 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.010124406, 2024-09-11T00:26:47.553 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000065742 2024-09-11T00:26:47.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:47.553 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:47.553 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:47.553 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:47.554 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:47.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:47.554 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T00:26:47.554 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 107648 2024-09-11T00:26:47.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:47.554 INFO:teuthology.orchestra.run.smithi138.stdout: "cct": { 2024-09-11T00:26:47.554 INFO:teuthology.orchestra.run.smithi138.stdout: "total_workers": 0, 2024-09-11T00:26:47.554 INFO:teuthology.orchestra.run.smithi138.stdout: "unhealthy_workers": 0 2024-09-11T00:26:47.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:47.554 INFO:teuthology.orchestra.run.smithi138.stdout: "mempool": { 2024-09-11T00:26:47.554 INFO:teuthology.orchestra.run.smithi138.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:26:47.554 INFO:teuthology.orchestra.run.smithi138.stdout: "bloom_filter_items": 0, 2024-09-11T00:26:47.554 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:26:47.554 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:26:47.555 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:26:47.555 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:26:47.555 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:26:47.555 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:26:47.555 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:26:47.555 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:26:47.555 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:26:47.555 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:26:47.555 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:26:47.555 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:26:47.555 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:26:47.555 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_extent_items": 0, 2024-09-11T00:26:47.555 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:26:47.555 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_blob_items": 0, 2024-09-11T00:26:47.556 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:26:47.556 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:26:47.556 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:26:47.556 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:26:47.556 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:26:47.556 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:26:47.556 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:26:47.556 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_txc_items": 0, 2024-09-11T00:26:47.556 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:26:47.556 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:26:47.556 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:26:47.556 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_items": 0, 2024-09-11T00:26:47.556 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_bytes": 0, 2024-09-11T00:26:47.556 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_items": 0, 2024-09-11T00:26:47.557 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:26:47.557 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:26:47.557 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:26:47.557 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:26:47.557 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_anon_bytes": 148967, 2024-09-11T00:26:47.557 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_anon_items": 29, 2024-09-11T00:26:47.557 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:26:47.557 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_meta_items": 0, 2024-09-11T00:26:47.557 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_bytes": 0, 2024-09-11T00:26:47.557 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_items": 0, 2024-09-11T00:26:47.557 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:26:47.557 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_mapbl_items": 0, 2024-09-11T00:26:47.557 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:26:47.557 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_pglog_items": 0, 2024-09-11T00:26:47.558 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_bytes": 0, 2024-09-11T00:26:47.558 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_items": 0, 2024-09-11T00:26:47.558 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:26:47.558 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:26:47.558 INFO:teuthology.orchestra.run.smithi138.stdout: "pgmap_bytes": 0, 2024-09-11T00:26:47.558 INFO:teuthology.orchestra.run.smithi138.stdout: "pgmap_items": 0, 2024-09-11T00:26:47.558 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_co_bytes": 968, 2024-09-11T00:26:47.558 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_co_items": 2, 2024-09-11T00:26:47.558 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_1_bytes": 0, 2024-09-11T00:26:47.558 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_1_items": 0, 2024-09-11T00:26:47.558 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_2_bytes": 0, 2024-09-11T00:26:47.558 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_2_items": 0 2024-09-11T00:26:47.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:47.558 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:26:47.559 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-11T00:26:47.559 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 104857600, 2024-09-11T00:26:47.559 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-11T00:26:47.559 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 213, 2024-09-11T00:26:47.559 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 799086, 2024-09-11T00:26:47.559 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-11T00:26:47.559 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 213, 2024-09-11T00:26:47.559 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 0, 2024-09-11T00:26:47.559 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 0, 2024-09-11T00:26:47.559 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 213, 2024-09-11T00:26:47.559 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 799086, 2024-09-11T00:26:47.559 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-11T00:26:47.559 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:47.559 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:47.559 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:47.560 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-11T00:26:47.560 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-11T00:26:47.560 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-11T00:26:48.025 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:47 smithi112 ceph-mon[35627]: pgmap v641: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:26:48.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:47 smithi138 ceph-mon[35019]: pgmap v641: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:26:48.321 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.c 2024-09-11T00:26:48.321 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.c 2024-09-11T00:26:48.321 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.c 2024-09-11T00:26:48.321 DEBUG:tasks.check_counter:Getting stats from f 2024-09-11T00:26:48.322 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-11T00:26:48.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:47 smithi078 ceph-mon[30865]: pgmap v641: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:26:48.574 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:26:49.108 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-11T00:26:49.108 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:26:49.108 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 213, 2024-09-11T00:26:49.108 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 208, 2024-09-11T00:26:49.108 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 829312, 2024-09-11T00:26:49.109 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 127424, 2024-09-11T00:26:49.109 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 4, 2024-09-11T00:26:49.109 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 0, 2024-09-11T00:26:49.109 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.038399764, 2024-09-11T00:26:49.109 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.018246215, 2024-09-11T00:26:49.109 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.027052469, 2024-09-11T00:26:49.109 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:49.109 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:49.109 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 207, 2024-09-11T00:26:49.109 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.013535911, 2024-09-11T00:26:49.109 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000065390 2024-09-11T00:26:49.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:49.110 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:49.110 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:49.110 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:49.110 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:49.110 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:49.110 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 829312, 2024-09-11T00:26:49.110 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 127424 2024-09-11T00:26:49.110 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:49.110 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:26:49.110 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 1, 2024-09-11T00:26:49.110 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 157, 2024-09-11T00:26:49.110 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 160, 2024-09-11T00:26:49.110 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 107824, 2024-09-11T00:26:49.111 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 3, 2024-09-11T00:26:49.111 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 2, 2024-09-11T00:26:49.111 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.013054852, 2024-09-11T00:26:49.111 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.010276150, 2024-09-11T00:26:49.111 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.000952800, 2024-09-11T00:26:49.111 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:49.111 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:49.111 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 155, 2024-09-11T00:26:49.111 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.009484946, 2024-09-11T00:26:49.111 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000061193 2024-09-11T00:26:49.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:49.111 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:49.111 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:49.111 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:49.112 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:49.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:49.112 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T00:26:49.112 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 107824 2024-09-11T00:26:49.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:49.112 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:26:49.113 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 4, 2024-09-11T00:26:49.113 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 4, 2024-09-11T00:26:49.113 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 2944, 2024-09-11T00:26:49.113 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 448, 2024-09-11T00:26:49.113 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 2, 2024-09-11T00:26:49.113 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 1, 2024-09-11T00:26:49.113 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.002186866, 2024-09-11T00:26:49.113 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.000033193, 2024-09-11T00:26:49.113 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.002135407, 2024-09-11T00:26:49.113 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:49.113 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:49.113 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 3, 2024-09-11T00:26:49.114 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.003941924, 2024-09-11T00:26:49.114 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.001313974 2024-09-11T00:26:49.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:49.114 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:49.114 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:49.114 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:49.114 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:49.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:49.114 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-11T00:26:49.114 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T00:26:49.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:49.114 INFO:teuthology.orchestra.run.smithi138.stdout: "cct": { 2024-09-11T00:26:49.114 INFO:teuthology.orchestra.run.smithi138.stdout: "total_workers": 0, 2024-09-11T00:26:49.114 INFO:teuthology.orchestra.run.smithi138.stdout: "unhealthy_workers": 0 2024-09-11T00:26:49.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:49.115 INFO:teuthology.orchestra.run.smithi138.stdout: "mempool": { 2024-09-11T00:26:49.115 INFO:teuthology.orchestra.run.smithi138.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:26:49.115 INFO:teuthology.orchestra.run.smithi138.stdout: "bloom_filter_items": 0, 2024-09-11T00:26:49.115 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:26:49.115 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:26:49.115 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:26:49.115 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:26:49.115 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:26:49.115 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:26:49.115 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:26:49.115 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:26:49.115 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:26:49.116 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:26:49.116 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:26:49.116 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:26:49.116 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:26:49.116 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_extent_items": 0, 2024-09-11T00:26:49.116 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:26:49.117 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_blob_items": 0, 2024-09-11T00:26:49.117 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:26:49.117 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:26:49.117 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:26:49.117 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:26:49.117 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:26:49.117 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:26:49.117 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:26:49.117 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_txc_items": 0, 2024-09-11T00:26:49.117 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:26:49.118 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:26:49.118 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:26:49.118 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_items": 0, 2024-09-11T00:26:49.118 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_bytes": 0, 2024-09-11T00:26:49.118 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_items": 0, 2024-09-11T00:26:49.118 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:26:49.118 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:26:49.119 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:26:49.119 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:26:49.119 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_anon_bytes": 148967, 2024-09-11T00:26:49.119 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_anon_items": 29, 2024-09-11T00:26:49.119 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:26:49.119 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_meta_items": 0, 2024-09-11T00:26:49.119 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_bytes": 0, 2024-09-11T00:26:49.119 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_items": 0, 2024-09-11T00:26:49.119 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:26:49.119 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_mapbl_items": 0, 2024-09-11T00:26:49.119 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:26:49.119 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_pglog_items": 0, 2024-09-11T00:26:49.119 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_bytes": 0, 2024-09-11T00:26:49.120 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_items": 0, 2024-09-11T00:26:49.120 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:26:49.120 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:26:49.120 INFO:teuthology.orchestra.run.smithi138.stdout: "pgmap_bytes": 0, 2024-09-11T00:26:49.120 INFO:teuthology.orchestra.run.smithi138.stdout: "pgmap_items": 0, 2024-09-11T00:26:49.120 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_co_bytes": 968, 2024-09-11T00:26:49.120 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_co_items": 2, 2024-09-11T00:26:49.120 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_1_bytes": 0, 2024-09-11T00:26:49.120 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_1_items": 0, 2024-09-11T00:26:49.120 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_2_bytes": 0, 2024-09-11T00:26:49.120 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_2_items": 0 2024-09-11T00:26:49.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:49.120 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:26:49.121 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-11T00:26:49.121 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 104857600, 2024-09-11T00:26:49.121 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-11T00:26:49.121 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 214, 2024-09-11T00:26:49.121 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 799216, 2024-09-11T00:26:49.121 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-11T00:26:49.121 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 214, 2024-09-11T00:26:49.121 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 0, 2024-09-11T00:26:49.121 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 0, 2024-09-11T00:26:49.121 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 214, 2024-09-11T00:26:49.121 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 799216, 2024-09-11T00:26:49.121 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-11T00:26:49.121 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:49.121 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:49.122 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:49.122 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-11T00:26:49.122 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-11T00:26:49.122 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-11T00:26:49.781 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-09-11T00:26:49.781 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-09-11T00:26:49.782 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-09-11T00:26:49.782 DEBUG:tasks.check_counter:Getting stats from i 2024-09-11T00:26:49.782 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-11T00:26:50.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:49 smithi138 ceph-mon[35019]: pgmap v642: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:26:50.043 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:26:50.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:49 smithi112 ceph-mon[35627]: pgmap v642: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:26:50.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:49 smithi078 ceph-mon[30865]: pgmap v642: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:26:50.532 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-11T00:26:50.532 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:26:50.532 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 2104, 2024-09-11T00:26:50.532 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 2106, 2024-09-11T00:26:50.532 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 79477267, 2024-09-11T00:26:50.532 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 669082, 2024-09-11T00:26:50.532 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 8, 2024-09-11T00:26:50.532 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 4, 2024-09-11T00:26:50.532 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.259165667, 2024-09-11T00:26:50.532 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.092988060, 2024-09-11T00:26:50.532 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.085647286, 2024-09-11T00:26:50.533 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.062923876, 2024-09-11T00:26:50.533 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:50.533 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 2104, 2024-09-11T00:26:50.533 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.085007678, 2024-09-11T00:26:50.533 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000040402 2024-09-11T00:26:50.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.533 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:50.533 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.533 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.533 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.533 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:26:50.533 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:26:50.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.534 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:26:50.534 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 455, 2024-09-11T00:26:50.534 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 447, 2024-09-11T00:26:50.534 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 72217102, 2024-09-11T00:26:50.534 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 200040, 2024-09-11T00:26:50.534 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 6, 2024-09-11T00:26:50.534 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 5, 2024-09-11T00:26:50.534 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.089443992, 2024-09-11T00:26:50.534 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.027225122, 2024-09-11T00:26:50.534 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.063701350, 2024-09-11T00:26:50.534 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.004466913, 2024-09-11T00:26:50.534 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:50.534 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 447, 2024-09-11T00:26:50.535 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.025431969, 2024-09-11T00:26:50.535 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000056894 2024-09-11T00:26:50.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.535 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:50.535 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.535 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.535 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.535 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 851936, 2024-09-11T00:26:50.535 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 129696 2024-09-11T00:26:50.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.535 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:26:50.536 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 288, 2024-09-11T00:26:50.536 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 442, 2024-09-11T00:26:50.536 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 46211803, 2024-09-11T00:26:50.536 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 450501, 2024-09-11T00:26:50.536 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 6, 2024-09-11T00:26:50.536 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 5, 2024-09-11T00:26:50.536 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.062935849, 2024-09-11T00:26:50.536 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.022271007, 2024-09-11T00:26:50.536 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.029300576, 2024-09-11T00:26:50.536 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.007500647, 2024-09-11T00:26:50.536 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:50.537 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 440, 2024-09-11T00:26:50.537 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.024573296, 2024-09-11T00:26:50.537 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000055848 2024-09-11T00:26:50.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.537 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:50.537 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.537 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.537 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.537 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T00:26:50.537 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 359552 2024-09-11T00:26:50.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.537 INFO:teuthology.orchestra.run.smithi138.stdout: "cct": { 2024-09-11T00:26:50.538 INFO:teuthology.orchestra.run.smithi138.stdout: "total_workers": 1, 2024-09-11T00:26:50.538 INFO:teuthology.orchestra.run.smithi138.stdout: "unhealthy_workers": 0 2024-09-11T00:26:50.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.538 INFO:teuthology.orchestra.run.smithi138.stdout: "finisher-MDSRank": { 2024-09-11T00:26:50.538 INFO:teuthology.orchestra.run.smithi138.stdout: "queue_len": 0, 2024-09-11T00:26:50.538 INFO:teuthology.orchestra.run.smithi138.stdout: "complete_latency": { 2024-09-11T00:26:50.538 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 4077, 2024-09-11T00:26:50.538 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.115555056, 2024-09-11T00:26:50.538 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000028343 2024-09-11T00:26:50.538 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-11T00:26:50.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.538 INFO:teuthology.orchestra.run.smithi138.stdout: "finisher-PurgeQueue": { 2024-09-11T00:26:50.538 INFO:teuthology.orchestra.run.smithi138.stdout: "queue_len": 0, 2024-09-11T00:26:50.539 INFO:teuthology.orchestra.run.smithi138.stdout: "complete_latency": { 2024-09-11T00:26:50.539 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.540 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.540 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.540 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-11T00:26:50.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.540 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-09-11T00:26:50.540 INFO:teuthology.orchestra.run.smithi138.stdout: "request": 0, 2024-09-11T00:26:50.540 INFO:teuthology.orchestra.run.smithi138.stdout: "reply": 0, 2024-09-11T00:26:50.540 INFO:teuthology.orchestra.run.smithi138.stdout: "reply_latency": { 2024-09-11T00:26:50.540 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.540 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.541 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.541 INFO:teuthology.orchestra.run.smithi138.stdout: "slow_reply": 0, 2024-09-11T00:26:50.541 INFO:teuthology.orchestra.run.smithi138.stdout: "forward": 0, 2024-09-11T00:26:50.541 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_fetch_complete": 0, 2024-09-11T00:26:50.541 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_fetch_keys": 0, 2024-09-11T00:26:50.541 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_commit": 0, 2024-09-11T00:26:50.541 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_split": 0, 2024-09-11T00:26:50.541 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_merge": 0, 2024-09-11T00:26:50.541 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes": 43097, 2024-09-11T00:26:50.541 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_top": 0, 2024-09-11T00:26:50.542 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_bottom": 43097, 2024-09-11T00:26:50.542 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_pin_tail": 0, 2024-09-11T00:26:50.542 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_pinned": 43097, 2024-09-11T00:26:50.542 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_expired": 0, 2024-09-11T00:26:50.542 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_with_caps": 0, 2024-09-11T00:26:50.542 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": 0, 2024-09-11T00:26:50.542 INFO:teuthology.orchestra.run.smithi138.stdout: "subtrees": 2, 2024-09-11T00:26:50.542 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse": 0, 2024-09-11T00:26:50.542 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_hit": 0, 2024-09-11T00:26:50.542 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_forward": 0, 2024-09-11T00:26:50.542 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_discover": 0, 2024-09-11T00:26:50.542 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_dir_fetch": 0, 2024-09-11T00:26:50.543 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_remote_ino": 0, 2024-09-11T00:26:50.543 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_lock": 0, 2024-09-11T00:26:50.543 INFO:teuthology.orchestra.run.smithi138.stdout: "load_cent": 0, 2024-09-11T00:26:50.543 INFO:teuthology.orchestra.run.smithi138.stdout: "q": 0, 2024-09-11T00:26:50.543 INFO:teuthology.orchestra.run.smithi138.stdout: "exported": 0, 2024-09-11T00:26:50.543 INFO:teuthology.orchestra.run.smithi138.stdout: "exported_inodes": 0, 2024-09-11T00:26:50.543 INFO:teuthology.orchestra.run.smithi138.stdout: "imported": 0, 2024-09-11T00:26:50.543 INFO:teuthology.orchestra.run.smithi138.stdout: "imported_inodes": 0, 2024-09-11T00:26:50.543 INFO:teuthology.orchestra.run.smithi138.stdout: "openino_dir_fetch": 0, 2024-09-11T00:26:50.543 INFO:teuthology.orchestra.run.smithi138.stdout: "openino_backtrace_fetch": 0, 2024-09-11T00:26:50.543 INFO:teuthology.orchestra.run.smithi138.stdout: "openino_peer_discover": 0, 2024-09-11T00:26:50.543 INFO:teuthology.orchestra.run.smithi138.stdout: "root_rfiles": 4, 2024-09-11T00:26:50.544 INFO:teuthology.orchestra.run.smithi138.stdout: "root_rbytes": 234, 2024-09-11T00:26:50.544 INFO:teuthology.orchestra.run.smithi138.stdout: "root_rsnaps": 6, 2024-09-11T00:26:50.544 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T00:26:50.544 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_set_tag": 0, 2024-09-11T00:26:50.544 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T00:26:50.544 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_inotable_repaired": 0, 2024-09-11T00:26:50.544 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_dir_inodes": 0, 2024-09-11T00:26:50.544 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T00:26:50.544 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T00:26:50.544 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_file_inodes": 0, 2024-09-11T00:26:50.544 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_inode_file_caps": 0, 2024-09-11T00:26:50.544 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T00:26:50.545 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_cap_op_grant": 0, 2024-09-11T00:26:50.545 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T00:26:50.545 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T00:26:50.545 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T00:26:50.545 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_client_caps": 0, 2024-09-11T00:26:50.545 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_client_caps_dirty": 0, 2024-09-11T00:26:50.545 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_client_cap_release": 0, 2024-09-11T00:26:50.545 INFO:teuthology.orchestra.run.smithi138.stdout: "process_request_cap_release": 0 2024-09-11T00:26:50.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.546 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_cache": { 2024-09-11T00:26:50.546 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_update": 0, 2024-09-11T00:26:50.546 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_update_receipt": 0, 2024-09-11T00:26:50.546 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_try_discover": 0, 2024-09-11T00:26:50.546 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_send_discover": 0, 2024-09-11T00:26:50.546 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_handle_discover": 0, 2024-09-11T00:26:50.546 INFO:teuthology.orchestra.run.smithi138.stdout: "num_strays": 0, 2024-09-11T00:26:50.546 INFO:teuthology.orchestra.run.smithi138.stdout: "num_strays_delayed": 0, 2024-09-11T00:26:50.546 INFO:teuthology.orchestra.run.smithi138.stdout: "num_strays_enqueuing": 0, 2024-09-11T00:26:50.546 INFO:teuthology.orchestra.run.smithi138.stdout: "strays_created": 0, 2024-09-11T00:26:50.547 INFO:teuthology.orchestra.run.smithi138.stdout: "strays_enqueued": 0, 2024-09-11T00:26:50.547 INFO:teuthology.orchestra.run.smithi138.stdout: "strays_reintegrated": 0, 2024-09-11T00:26:50.547 INFO:teuthology.orchestra.run.smithi138.stdout: "strays_migrated": 0, 2024-09-11T00:26:50.547 INFO:teuthology.orchestra.run.smithi138.stdout: "num_recovering_processing": 0, 2024-09-11T00:26:50.547 INFO:teuthology.orchestra.run.smithi138.stdout: "num_recovering_enqueued": 0, 2024-09-11T00:26:50.547 INFO:teuthology.orchestra.run.smithi138.stdout: "num_recovering_prioritized": 0, 2024-09-11T00:26:50.547 INFO:teuthology.orchestra.run.smithi138.stdout: "recovery_started": 0, 2024-09-11T00:26:50.547 INFO:teuthology.orchestra.run.smithi138.stdout: "recovery_completed": 0, 2024-09-11T00:26:50.547 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_quiesce_path": 0, 2024-09-11T00:26:50.547 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_quiesce_inode": 0, 2024-09-11T00:26:50.547 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T00:26:50.547 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_exportdir": 0, 2024-09-11T00:26:50.548 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_flush": 0, 2024-09-11T00:26:50.548 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_fragmentdir": 0, 2024-09-11T00:26:50.548 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_fragstats": 0, 2024-09-11T00:26:50.548 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_inodestats": 0, 2024-09-11T00:26:50.548 INFO:teuthology.orchestra.run.smithi138.stdout: "uninline_started": 0, 2024-09-11T00:26:50.548 INFO:teuthology.orchestra.run.smithi138.stdout: "uninline_succeeded": 0, 2024-09-11T00:26:50.548 INFO:teuthology.orchestra.run.smithi138.stdout: "uninline_write_failed": 0 2024-09-11T00:26:50.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.548 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_log": { 2024-09-11T00:26:50.548 INFO:teuthology.orchestra.run.smithi138.stdout: "evlrg": 0, 2024-09-11T00:26:50.549 INFO:teuthology.orchestra.run.smithi138.stdout: "evadd": 0, 2024-09-11T00:26:50.549 INFO:teuthology.orchestra.run.smithi138.stdout: "evex": 0, 2024-09-11T00:26:50.549 INFO:teuthology.orchestra.run.smithi138.stdout: "evtrm": 0, 2024-09-11T00:26:50.549 INFO:teuthology.orchestra.run.smithi138.stdout: "ev": 78411, 2024-09-11T00:26:50.549 INFO:teuthology.orchestra.run.smithi138.stdout: "evexg": 0, 2024-09-11T00:26:50.549 INFO:teuthology.orchestra.run.smithi138.stdout: "evexd": 0, 2024-09-11T00:26:50.549 INFO:teuthology.orchestra.run.smithi138.stdout: "segadd": 0, 2024-09-11T00:26:50.549 INFO:teuthology.orchestra.run.smithi138.stdout: "segex": 0, 2024-09-11T00:26:50.549 INFO:teuthology.orchestra.run.smithi138.stdout: "segtrm": 0, 2024-09-11T00:26:50.549 INFO:teuthology.orchestra.run.smithi138.stdout: "seg": 101, 2024-09-11T00:26:50.549 INFO:teuthology.orchestra.run.smithi138.stdout: "segmjr": 8, 2024-09-11T00:26:50.550 INFO:teuthology.orchestra.run.smithi138.stdout: "segexg": 0, 2024-09-11T00:26:50.550 INFO:teuthology.orchestra.run.smithi138.stdout: "segexd": 0, 2024-09-11T00:26:50.550 INFO:teuthology.orchestra.run.smithi138.stdout: "expos": 4194304, 2024-09-11T00:26:50.550 INFO:teuthology.orchestra.run.smithi138.stdout: "wrpos": 200511017, 2024-09-11T00:26:50.550 INFO:teuthology.orchestra.run.smithi138.stdout: "rdpos": 200510905, 2024-09-11T00:26:50.550 INFO:teuthology.orchestra.run.smithi138.stdout: "jlat": { 2024-09-11T00:26:50.550 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.550 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.550 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.551 INFO:teuthology.orchestra.run.smithi138.stdout: "replayed": 78411 2024-09-11T00:26:50.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.551 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_mem": { 2024-09-11T00:26:50.551 INFO:teuthology.orchestra.run.smithi138.stdout: "ino": 13461, 2024-09-11T00:26:50.551 INFO:teuthology.orchestra.run.smithi138.stdout: "ino+": 26259, 2024-09-11T00:26:50.551 INFO:teuthology.orchestra.run.smithi138.stdout: "ino-": 12798, 2024-09-11T00:26:50.551 INFO:teuthology.orchestra.run.smithi138.stdout: "dir": 1724, 2024-09-11T00:26:50.551 INFO:teuthology.orchestra.run.smithi138.stdout: "dir+": 1921, 2024-09-11T00:26:50.551 INFO:teuthology.orchestra.run.smithi138.stdout: "dir-": 197, 2024-09-11T00:26:50.551 INFO:teuthology.orchestra.run.smithi138.stdout: "dn": 43097, 2024-09-11T00:26:50.551 INFO:teuthology.orchestra.run.smithi138.stdout: "dn+": 43331, 2024-09-11T00:26:50.551 INFO:teuthology.orchestra.run.smithi138.stdout: "dn-": 234, 2024-09-11T00:26:50.551 INFO:teuthology.orchestra.run.smithi138.stdout: "cap": 0, 2024-09-11T00:26:50.551 INFO:teuthology.orchestra.run.smithi138.stdout: "cap+": 0, 2024-09-11T00:26:50.551 INFO:teuthology.orchestra.run.smithi138.stdout: "cap-": 0, 2024-09-11T00:26:50.552 INFO:teuthology.orchestra.run.smithi138.stdout: "rss": 144056, 2024-09-11T00:26:50.552 INFO:teuthology.orchestra.run.smithi138.stdout: "heap": 351633408 2024-09-11T00:26:50.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.552 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_server": { 2024-09-11T00:26:50.552 INFO:teuthology.orchestra.run.smithi138.stdout: "dispatch_client_request": 0, 2024-09-11T00:26:50.552 INFO:teuthology.orchestra.run.smithi138.stdout: "dispatch_server_request": 0, 2024-09-11T00:26:50.552 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_client_request": 0, 2024-09-11T00:26:50.552 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_client_session": 0, 2024-09-11T00:26:50.552 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_peer_request": 0, 2024-09-11T00:26:50.552 INFO:teuthology.orchestra.run.smithi138.stdout: "req_create_latency": { 2024-09-11T00:26:50.552 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.553 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.553 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.553 INFO:teuthology.orchestra.run.smithi138.stdout: "req_getattr_latency": { 2024-09-11T00:26:50.553 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.553 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.553 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.554 INFO:teuthology.orchestra.run.smithi138.stdout: "req_getfilelock_latency": { 2024-09-11T00:26:50.554 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.554 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.554 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.554 INFO:teuthology.orchestra.run.smithi138.stdout: "req_link_latency": { 2024-09-11T00:26:50.554 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.554 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.554 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.554 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookup_latency": { 2024-09-11T00:26:50.554 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.554 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.555 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.555 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookuphash_latency": { 2024-09-11T00:26:50.555 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.555 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.555 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.555 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookupino_latency": { 2024-09-11T00:26:50.555 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.555 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.555 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.555 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookupname_latency": { 2024-09-11T00:26:50.556 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.556 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.556 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.556 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookupparent_latency": { 2024-09-11T00:26:50.556 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.556 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.556 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.556 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookupsnap_latency": { 2024-09-11T00:26:50.556 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.557 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.557 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.557 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lssnap_latency": { 2024-09-11T00:26:50.558 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.558 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.558 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.558 INFO:teuthology.orchestra.run.smithi138.stdout: "req_mkdir_latency": { 2024-09-11T00:26:50.558 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.558 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.558 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.558 INFO:teuthology.orchestra.run.smithi138.stdout: "req_mknod_latency": { 2024-09-11T00:26:50.559 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.559 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.559 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.559 INFO:teuthology.orchestra.run.smithi138.stdout: "req_mksnap_latency": { 2024-09-11T00:26:50.559 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.559 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.559 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.559 INFO:teuthology.orchestra.run.smithi138.stdout: "req_open_latency": { 2024-09-11T00:26:50.559 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.560 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.560 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.560 INFO:teuthology.orchestra.run.smithi138.stdout: "req_readdir_latency": { 2024-09-11T00:26:50.560 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.560 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.560 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.560 INFO:teuthology.orchestra.run.smithi138.stdout: "req_rename_latency": { 2024-09-11T00:26:50.560 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.561 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.561 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.561 INFO:teuthology.orchestra.run.smithi138.stdout: "req_renamesnap_latency": { 2024-09-11T00:26:50.561 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.561 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.561 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.561 INFO:teuthology.orchestra.run.smithi138.stdout: "req_snapdiff_latency": { 2024-09-11T00:26:50.561 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.561 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.561 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.562 INFO:teuthology.orchestra.run.smithi138.stdout: "req_rmdir_latency": { 2024-09-11T00:26:50.562 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.562 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.562 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.562 INFO:teuthology.orchestra.run.smithi138.stdout: "req_rmsnap_latency": { 2024-09-11T00:26:50.562 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.562 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.562 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.563 INFO:teuthology.orchestra.run.smithi138.stdout: "req_rmxattr_latency": { 2024-09-11T00:26:50.563 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.563 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.563 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.563 INFO:teuthology.orchestra.run.smithi138.stdout: "req_setattr_latency": { 2024-09-11T00:26:50.563 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.563 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.563 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.563 INFO:teuthology.orchestra.run.smithi138.stdout: "req_setdirlayout_latency": { 2024-09-11T00:26:50.564 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.564 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.564 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.564 INFO:teuthology.orchestra.run.smithi138.stdout: "req_setfilelock_latency": { 2024-09-11T00:26:50.564 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.564 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.564 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.564 INFO:teuthology.orchestra.run.smithi138.stdout: "req_setlayout_latency": { 2024-09-11T00:26:50.564 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.564 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.564 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.565 INFO:teuthology.orchestra.run.smithi138.stdout: "req_setxattr_latency": { 2024-09-11T00:26:50.565 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.565 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.565 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.565 INFO:teuthology.orchestra.run.smithi138.stdout: "req_symlink_latency": { 2024-09-11T00:26:50.565 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.565 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.565 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.565 INFO:teuthology.orchestra.run.smithi138.stdout: "req_unlink_latency": { 2024-09-11T00:26:50.565 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.566 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.566 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.566 INFO:teuthology.orchestra.run.smithi138.stdout: "cap_revoke_eviction": 0, 2024-09-11T00:26:50.566 INFO:teuthology.orchestra.run.smithi138.stdout: "cap_acquisition_throttle": 0, 2024-09-11T00:26:50.566 INFO:teuthology.orchestra.run.smithi138.stdout: "req_getvxattr_latency": { 2024-09-11T00:26:50.566 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.566 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.566 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.566 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-11T00:26:50.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.566 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_sessions": { 2024-09-11T00:26:50.566 INFO:teuthology.orchestra.run.smithi138.stdout: "session_count": 2, 2024-09-11T00:26:50.566 INFO:teuthology.orchestra.run.smithi138.stdout: "session_add": 3, 2024-09-11T00:26:50.566 INFO:teuthology.orchestra.run.smithi138.stdout: "session_remove": 1, 2024-09-11T00:26:50.567 INFO:teuthology.orchestra.run.smithi138.stdout: "sessions_open": 2, 2024-09-11T00:26:50.567 INFO:teuthology.orchestra.run.smithi138.stdout: "sessions_stale": 0, 2024-09-11T00:26:50.567 INFO:teuthology.orchestra.run.smithi138.stdout: "total_load": 0, 2024-09-11T00:26:50.567 INFO:teuthology.orchestra.run.smithi138.stdout: "average_load": 0, 2024-09-11T00:26:50.567 INFO:teuthology.orchestra.run.smithi138.stdout: "avg_session_uptime": 1902, 2024-09-11T00:26:50.567 INFO:teuthology.orchestra.run.smithi138.stdout: "mdthresh_evicted": 0 2024-09-11T00:26:50.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.567 INFO:teuthology.orchestra.run.smithi138.stdout: "mempool": { 2024-09-11T00:26:50.567 INFO:teuthology.orchestra.run.smithi138.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:26:50.567 INFO:teuthology.orchestra.run.smithi138.stdout: "bloom_filter_items": 0, 2024-09-11T00:26:50.567 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:26:50.567 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:26:50.567 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:26:50.567 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:26:50.568 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:26:50.568 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:26:50.568 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:26:50.568 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:26:50.568 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:26:50.568 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:26:50.568 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:26:50.568 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:26:50.569 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:26:50.569 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_extent_items": 0, 2024-09-11T00:26:50.569 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:26:50.569 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_blob_items": 0, 2024-09-11T00:26:50.569 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:26:50.569 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:26:50.569 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:26:50.569 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:26:50.569 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:26:50.569 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:26:50.569 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:26:50.570 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_txc_items": 0, 2024-09-11T00:26:50.570 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:26:50.570 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:26:50.570 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:26:50.570 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_items": 0, 2024-09-11T00:26:50.570 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_bytes": 0, 2024-09-11T00:26:50.570 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_items": 0, 2024-09-11T00:26:50.570 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:26:50.570 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:26:50.570 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:26:50.570 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:26:50.570 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_anon_bytes": 799326, 2024-09-11T00:26:50.570 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_anon_items": 15230, 2024-09-11T00:26:50.571 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:26:50.571 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_meta_items": 0, 2024-09-11T00:26:50.571 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_bytes": 0, 2024-09-11T00:26:50.571 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_items": 0, 2024-09-11T00:26:50.571 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:26:50.571 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_mapbl_items": 0, 2024-09-11T00:26:50.571 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:26:50.571 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_pglog_items": 0, 2024-09-11T00:26:50.571 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_bytes": 8264, 2024-09-11T00:26:50.571 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_items": 183, 2024-09-11T00:26:50.571 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:26:50.571 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:26:50.571 INFO:teuthology.orchestra.run.smithi138.stdout: "pgmap_bytes": 0, 2024-09-11T00:26:50.571 INFO:teuthology.orchestra.run.smithi138.stdout: "pgmap_items": 0, 2024-09-11T00:26:50.572 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_co_bytes": 65631284, 2024-09-11T00:26:50.572 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_co_items": 1499375, 2024-09-11T00:26:50.572 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_1_bytes": 0, 2024-09-11T00:26:50.572 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_1_items": 0, 2024-09-11T00:26:50.572 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_2_bytes": 0, 2024-09-11T00:26:50.572 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_2_items": 0 2024-09-11T00:26:50.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.572 INFO:teuthology.orchestra.run.smithi138.stdout: "objecter": { 2024-09-11T00:26:50.572 INFO:teuthology.orchestra.run.smithi138.stdout: "op_active": 0, 2024-09-11T00:26:50.572 INFO:teuthology.orchestra.run.smithi138.stdout: "op_laggy": 0, 2024-09-11T00:26:50.572 INFO:teuthology.orchestra.run.smithi138.stdout: "op_send": 2611, 2024-09-11T00:26:50.572 INFO:teuthology.orchestra.run.smithi138.stdout: "op_send_bytes": 26, 2024-09-11T00:26:50.573 INFO:teuthology.orchestra.run.smithi138.stdout: "op_resend": 4, 2024-09-11T00:26:50.573 INFO:teuthology.orchestra.run.smithi138.stdout: "op_reply": 2611, 2024-09-11T00:26:50.573 INFO:teuthology.orchestra.run.smithi138.stdout: "op_latency": { 2024-09-11T00:26:50.573 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 2611, 2024-09-11T00:26:50.573 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 2.872938467, 2024-09-11T00:26:50.573 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.001100321 2024-09-11T00:26:50.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.573 INFO:teuthology.orchestra.run.smithi138.stdout: "op_inflight": 0, 2024-09-11T00:26:50.573 INFO:teuthology.orchestra.run.smithi138.stdout: "oplen_avg": { 2024-09-11T00:26:50.574 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 2611, 2024-09-11T00:26:50.574 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 2612 2024-09-11T00:26:50.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.574 INFO:teuthology.orchestra.run.smithi138.stdout: "op": 2611, 2024-09-11T00:26:50.574 INFO:teuthology.orchestra.run.smithi138.stdout: "op_r": 2611, 2024-09-11T00:26:50.574 INFO:teuthology.orchestra.run.smithi138.stdout: "op_w": 0, 2024-09-11T00:26:50.574 INFO:teuthology.orchestra.run.smithi138.stdout: "op_rmw": 0, 2024-09-11T00:26:50.574 INFO:teuthology.orchestra.run.smithi138.stdout: "op_pg": 0, 2024-09-11T00:26:50.574 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_stat": 1684, 2024-09-11T00:26:50.574 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_create": 0, 2024-09-11T00:26:50.574 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_read": 924, 2024-09-11T00:26:50.574 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_write": 0, 2024-09-11T00:26:50.574 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_writefull": 0, 2024-09-11T00:26:50.574 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_writesame": 0, 2024-09-11T00:26:50.575 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_append": 0, 2024-09-11T00:26:50.575 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_zero": 0, 2024-09-11T00:26:50.575 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_truncate": 0, 2024-09-11T00:26:50.575 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_delete": 0, 2024-09-11T00:26:50.575 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_mapext": 0, 2024-09-11T00:26:50.575 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_sparse_read": 0, 2024-09-11T00:26:50.575 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_clonerange": 0, 2024-09-11T00:26:50.575 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_getxattr": 2, 2024-09-11T00:26:50.575 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_setxattr": 0, 2024-09-11T00:26:50.575 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_cmpxattr": 0, 2024-09-11T00:26:50.575 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_rmxattr": 0, 2024-09-11T00:26:50.575 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_resetxattrs": 0, 2024-09-11T00:26:50.575 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_call": 0, 2024-09-11T00:26:50.576 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_watch": 0, 2024-09-11T00:26:50.576 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_notify": 0, 2024-09-11T00:26:50.576 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T00:26:50.576 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_pgls": 0, 2024-09-11T00:26:50.576 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_pgls_filter": 0, 2024-09-11T00:26:50.576 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_other": 0, 2024-09-11T00:26:50.576 INFO:teuthology.orchestra.run.smithi138.stdout: "linger_active": 0, 2024-09-11T00:26:50.576 INFO:teuthology.orchestra.run.smithi138.stdout: "linger_send": 0, 2024-09-11T00:26:50.576 INFO:teuthology.orchestra.run.smithi138.stdout: "linger_resend": 0, 2024-09-11T00:26:50.576 INFO:teuthology.orchestra.run.smithi138.stdout: "linger_ping": 0, 2024-09-11T00:26:50.576 INFO:teuthology.orchestra.run.smithi138.stdout: "poolop_active": 0, 2024-09-11T00:26:50.576 INFO:teuthology.orchestra.run.smithi138.stdout: "poolop_send": 0, 2024-09-11T00:26:50.577 INFO:teuthology.orchestra.run.smithi138.stdout: "poolop_resend": 0, 2024-09-11T00:26:50.577 INFO:teuthology.orchestra.run.smithi138.stdout: "poolstat_active": 0, 2024-09-11T00:26:50.577 INFO:teuthology.orchestra.run.smithi138.stdout: "poolstat_send": 0, 2024-09-11T00:26:50.577 INFO:teuthology.orchestra.run.smithi138.stdout: "poolstat_resend": 0, 2024-09-11T00:26:50.577 INFO:teuthology.orchestra.run.smithi138.stdout: "statfs_active": 0, 2024-09-11T00:26:50.577 INFO:teuthology.orchestra.run.smithi138.stdout: "statfs_send": 0, 2024-09-11T00:26:50.577 INFO:teuthology.orchestra.run.smithi138.stdout: "statfs_resend": 0, 2024-09-11T00:26:50.577 INFO:teuthology.orchestra.run.smithi138.stdout: "command_active": 0, 2024-09-11T00:26:50.577 INFO:teuthology.orchestra.run.smithi138.stdout: "command_send": 0, 2024-09-11T00:26:50.577 INFO:teuthology.orchestra.run.smithi138.stdout: "command_resend": 0, 2024-09-11T00:26:50.577 INFO:teuthology.orchestra.run.smithi138.stdout: "map_epoch": 87, 2024-09-11T00:26:50.577 INFO:teuthology.orchestra.run.smithi138.stdout: "map_full": 0, 2024-09-11T00:26:50.577 INFO:teuthology.orchestra.run.smithi138.stdout: "map_inc": 12, 2024-09-11T00:26:50.578 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_sessions": 11, 2024-09-11T00:26:50.578 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_session_open": 11, 2024-09-11T00:26:50.578 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_session_close": 0, 2024-09-11T00:26:50.578 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_laggy": 0, 2024-09-11T00:26:50.578 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_wr": 0, 2024-09-11T00:26:50.578 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_rd": 2, 2024-09-11T00:26:50.578 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_del": 0 2024-09-11T00:26:50.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.578 INFO:teuthology.orchestra.run.smithi138.stdout: "oft": { 2024-09-11T00:26:50.578 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_total_objs": 0, 2024-09-11T00:26:50.578 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_total_kv_pairs": 0, 2024-09-11T00:26:50.578 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_total_updates": 0, 2024-09-11T00:26:50.579 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_total_removes": 0 2024-09-11T00:26:50.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.579 INFO:teuthology.orchestra.run.smithi138.stdout: "purge_queue": { 2024-09-11T00:26:50.579 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executing_ops": 0, 2024-09-11T00:26:50.579 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T00:26:50.579 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executing": 0, 2024-09-11T00:26:50.579 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executing_high_water": 0, 2024-09-11T00:26:50.579 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executed_ops": 0, 2024-09-11T00:26:50.579 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executed": 0, 2024-09-11T00:26:50.579 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_item_in_journal": 0 2024-09-11T00:26:50.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.579 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:26:50.579 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-11T00:26:50.580 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 104857600, 2024-09-11T00:26:50.580 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-11T00:26:50.580 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 2843, 2024-09-11T00:26:50.580 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 197635610, 2024-09-11T00:26:50.580 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-11T00:26:50.580 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 2843, 2024-09-11T00:26:50.580 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 0, 2024-09-11T00:26:50.580 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 0, 2024-09-11T00:26:50.580 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 2843, 2024-09-11T00:26:50.580 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 197635610, 2024-09-11T00:26:50.580 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-11T00:26:50.580 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.580 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.581 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.581 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-11T00:26:50.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.581 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-objecter_bytes": { 2024-09-11T00:26:50.581 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-11T00:26:50.581 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 104857600, 2024-09-11T00:26:50.581 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-11T00:26:50.581 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 0, 2024-09-11T00:26:50.581 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 0, 2024-09-11T00:26:50.581 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-11T00:26:50.581 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 0, 2024-09-11T00:26:50.581 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 2611, 2024-09-11T00:26:50.582 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 196327526, 2024-09-11T00:26:50.582 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 2611, 2024-09-11T00:26:50.582 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 196327526, 2024-09-11T00:26:50.582 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-11T00:26:50.582 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.582 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.582 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.582 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-11T00:26:50.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.582 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-objecter_ops": { 2024-09-11T00:26:50.582 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-11T00:26:50.582 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 1024, 2024-09-11T00:26:50.583 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-11T00:26:50.583 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 0, 2024-09-11T00:26:50.583 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 0, 2024-09-11T00:26:50.583 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-11T00:26:50.583 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 0, 2024-09-11T00:26:50.583 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 2611, 2024-09-11T00:26:50.583 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 2611, 2024-09-11T00:26:50.583 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 2611, 2024-09-11T00:26:50.583 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 2611, 2024-09-11T00:26:50.583 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-11T00:26:50.583 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.583 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.583 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.584 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-11T00:26:50.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.584 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-write_buf_throttle": { 2024-09-11T00:26:50.584 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-11T00:26:50.584 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 3758096384, 2024-09-11T00:26:50.584 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-11T00:26:50.584 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 0, 2024-09-11T00:26:50.584 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 0, 2024-09-11T00:26:50.584 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-11T00:26:50.584 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 0, 2024-09-11T00:26:50.584 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 0, 2024-09-11T00:26:50.584 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 0, 2024-09-11T00:26:50.584 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 0, 2024-09-11T00:26:50.585 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 0, 2024-09-11T00:26:50.585 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-11T00:26:50.585 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.585 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.585 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.585 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-11T00:26:50.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.585 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-write_buf_throttle-0x55c23de2f040": { 2024-09-11T00:26:50.585 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-11T00:26:50.585 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 3758096384, 2024-09-11T00:26:50.585 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-11T00:26:50.585 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 0, 2024-09-11T00:26:50.585 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 0, 2024-09-11T00:26:50.586 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-11T00:26:50.586 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 0, 2024-09-11T00:26:50.586 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 0, 2024-09-11T00:26:50.586 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 0, 2024-09-11T00:26:50.586 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 0, 2024-09-11T00:26:50.586 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 0, 2024-09-11T00:26:50.586 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-11T00:26:50.586 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:50.586 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:50.586 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:50.586 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-11T00:26:50.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:50.586 INFO:teuthology.orchestra.run.smithi138.stdout: "trackedop": { 2024-09-11T00:26:50.586 INFO:teuthology.orchestra.run.smithi138.stdout: "slow_ops_count": 0 2024-09-11T00:26:50.587 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-11T00:26:50.587 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-11T00:26:51.280 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-11T00:26:51.280 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-11T00:26:51.280 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-11T00:26:51.280 DEBUG:tasks.check_counter:Getting stats from l 2024-09-11T00:26:51.281 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-11T00:26:51.568 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:26:51.948 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:51 smithi138 ceph-mon[35019]: pgmap v643: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:26:52.056 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-11T00:26:52.057 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T00:26:52.057 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 0, 2024-09-11T00:26:52.057 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 2, 2024-09-11T00:26:52.057 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 0, 2024-09-11T00:26:52.057 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 0, 2024-09-11T00:26:52.057 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 4, 2024-09-11T00:26:52.057 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 0, 2024-09-11T00:26:52.057 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.001063670, 2024-09-11T00:26:52.057 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T00:26:52.057 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.000236270, 2024-09-11T00:26:52.057 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:52.057 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:52.058 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:52.058 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:52.058 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:52.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:52.058 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:52.058 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:52.058 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:52.058 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:52.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:52.058 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T00:26:52.058 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T00:26:52.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:52.058 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T00:26:52.058 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 1, 2024-09-11T00:26:52.059 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 161, 2024-09-11T00:26:52.059 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 160, 2024-09-11T00:26:52.059 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 108528, 2024-09-11T00:26:52.059 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 3, 2024-09-11T00:26:52.059 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 2, 2024-09-11T00:26:52.059 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.012720511, 2024-09-11T00:26:52.059 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.010246368, 2024-09-11T00:26:52.059 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.000596624, 2024-09-11T00:26:52.059 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:52.059 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:52.059 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 159, 2024-09-11T00:26:52.059 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.011077399, 2024-09-11T00:26:52.059 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000069669 2024-09-11T00:26:52.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:52.060 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:52.060 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:52.060 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:52.060 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:52.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:52.060 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T00:26:52.060 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 108528 2024-09-11T00:26:52.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:52.060 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T00:26:52.060 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 221, 2024-09-11T00:26:52.060 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 214, 2024-09-11T00:26:52.060 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 833344, 2024-09-11T00:26:52.060 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 130432, 2024-09-11T00:26:52.060 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 2, 2024-09-11T00:26:52.061 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 1, 2024-09-11T00:26:52.061 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.042194727, 2024-09-11T00:26:52.061 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.018674431, 2024-09-11T00:26:52.061 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.030372101, 2024-09-11T00:26:52.061 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T00:26:52.061 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T00:26:52.061 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 214, 2024-09-11T00:26:52.061 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.018306364, 2024-09-11T00:26:52.061 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000085543 2024-09-11T00:26:52.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:52.061 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-11T00:26:52.061 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:52.061 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:52.062 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:52.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:52.062 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 833344, 2024-09-11T00:26:52.062 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 130432 2024-09-11T00:26:52.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:52.062 INFO:teuthology.orchestra.run.smithi138.stdout: "cct": { 2024-09-11T00:26:52.062 INFO:teuthology.orchestra.run.smithi138.stdout: "total_workers": 0, 2024-09-11T00:26:52.062 INFO:teuthology.orchestra.run.smithi138.stdout: "unhealthy_workers": 0 2024-09-11T00:26:52.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:52.062 INFO:teuthology.orchestra.run.smithi138.stdout: "mempool": { 2024-09-11T00:26:52.062 INFO:teuthology.orchestra.run.smithi138.stdout: "bloom_filter_bytes": 0, 2024-09-11T00:26:52.062 INFO:teuthology.orchestra.run.smithi138.stdout: "bloom_filter_items": 0, 2024-09-11T00:26:52.062 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T00:26:52.063 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_alloc_items": 0, 2024-09-11T00:26:52.063 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T00:26:52.063 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_data_items": 0, 2024-09-11T00:26:52.063 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T00:26:52.063 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T00:26:52.063 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T00:26:52.063 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T00:26:52.063 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T00:26:52.063 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_other_items": 0, 2024-09-11T00:26:52.063 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T00:26:52.063 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T00:26:52.063 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_extent_bytes": 0, 2024-09-11T00:26:52.063 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_extent_items": 0, 2024-09-11T00:26:52.063 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_blob_bytes": 0, 2024-09-11T00:26:52.064 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_blob_items": 0, 2024-09-11T00:26:52.064 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T00:26:52.064 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T00:26:52.064 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T00:26:52.064 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T00:26:52.064 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T00:26:52.064 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_fsck_items": 0, 2024-09-11T00:26:52.064 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_txc_bytes": 0, 2024-09-11T00:26:52.064 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_txc_items": 0, 2024-09-11T00:26:52.064 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T00:26:52.064 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T00:26:52.064 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_bytes": 0, 2024-09-11T00:26:52.064 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_items": 0, 2024-09-11T00:26:52.064 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_bytes": 0, 2024-09-11T00:26:52.065 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_items": 0, 2024-09-11T00:26:52.065 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T00:26:52.065 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_reader_items": 0, 2024-09-11T00:26:52.065 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T00:26:52.065 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_writer_items": 0, 2024-09-11T00:26:52.065 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_anon_bytes": 148985, 2024-09-11T00:26:52.065 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_anon_items": 30, 2024-09-11T00:26:52.065 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_meta_bytes": 0, 2024-09-11T00:26:52.065 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_meta_items": 0, 2024-09-11T00:26:52.065 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_bytes": 0, 2024-09-11T00:26:52.065 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_items": 0, 2024-09-11T00:26:52.065 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_mapbl_bytes": 0, 2024-09-11T00:26:52.065 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_mapbl_items": 0, 2024-09-11T00:26:52.065 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_pglog_bytes": 0, 2024-09-11T00:26:52.066 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_pglog_items": 0, 2024-09-11T00:26:52.066 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_bytes": 0, 2024-09-11T00:26:52.066 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_items": 0, 2024-09-11T00:26:52.066 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T00:26:52.066 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_mapping_items": 0, 2024-09-11T00:26:52.066 INFO:teuthology.orchestra.run.smithi138.stdout: "pgmap_bytes": 0, 2024-09-11T00:26:52.066 INFO:teuthology.orchestra.run.smithi138.stdout: "pgmap_items": 0, 2024-09-11T00:26:52.066 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_co_bytes": 968, 2024-09-11T00:26:52.066 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_co_items": 2, 2024-09-11T00:26:52.066 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_1_bytes": 0, 2024-09-11T00:26:52.066 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_1_items": 0, 2024-09-11T00:26:52.066 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_2_bytes": 0, 2024-09-11T00:26:52.066 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_2_items": 0 2024-09-11T00:26:52.066 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-11T00:26:52.067 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T00:26:52.067 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-11T00:26:52.067 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 104857600, 2024-09-11T00:26:52.067 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-11T00:26:52.067 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 218, 2024-09-11T00:26:52.067 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 799736, 2024-09-11T00:26:52.067 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-11T00:26:52.067 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 218, 2024-09-11T00:26:52.067 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 0, 2024-09-11T00:26:52.067 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 0, 2024-09-11T00:26:52.067 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 218, 2024-09-11T00:26:52.067 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 799736, 2024-09-11T00:26:52.067 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-11T00:26:52.067 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-11T00:26:52.067 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-11T00:26:52.068 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-11T00:26:52.068 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-11T00:26:52.068 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-11T00:26:52.068 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-11T00:26:52.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:51 smithi112 ceph-mon[35627]: pgmap v643: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:26:52.334 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:51 smithi078 ceph-mon[30865]: pgmap v643: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-11T00:26:52.715 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-11T00:26:52.715 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-11T00:26:52.716 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-11T00:26:52.716 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-11T00:26:52.730 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-11T00:26:52.730 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-11T00:26:52.730 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:26:52.751 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-11T00:26:52.751 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T00:26:52.811 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T00:26:53.103 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:26:53.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.592+0000 7f03be28d640 1 -- 172.21.15.78:0/3323165187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03b810d110 msgr2=0x7f03b810f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:53.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.592+0000 7f03be28d640 1 --2- 172.21.15.78:0/3323165187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03b810d110 0x7f03b810f570 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f03b0009ca0 tx=0x7f03b002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:26:53.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.592+0000 7f03be28d640 1 -- 172.21.15.78:0/3323165187 shutdown_connections 2024-09-11T00:26:53.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.592+0000 7f03be28d640 1 --2- 172.21.15.78:0/3323165187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03b810d110 0x7f03b810f570 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:53.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.592+0000 7f03be28d640 1 --2- 172.21.15.78:0/3323165187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03b81045d0 0x7f03b810cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:53.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.592+0000 7f03be28d640 1 --2- 172.21.15.78:0/3323165187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03b8103cb0 0x7f03b8104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:53.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.592+0000 7f03be28d640 1 -- 172.21.15.78:0/3323165187 >> 172.21.15.78:0/3323165187 conn(0x7f03b80fd730 msgr2=0x7f03b80ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:53.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.592+0000 7f03be28d640 1 -- 172.21.15.78:0/3323165187 shutdown_connections 2024-09-11T00:26:53.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.592+0000 7f03be28d640 1 -- 172.21.15.78:0/3323165187 wait complete. 2024-09-11T00:26:53.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.592+0000 7f03be28d640 1 Processor -- start 2024-09-11T00:26:53.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.593+0000 7f03be28d640 1 -- start start 2024-09-11T00:26:53.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.593+0000 7f03be28d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03b8103cb0 0x7f03b8101960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:53.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.593+0000 7f03be28d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03b81045d0 0x7f03b8101ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:53.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.593+0000 7f03be28d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03b810d110 0x7f03b81023e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:53.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.593+0000 7f03be28d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f03b8112d80 con 0x7f03b810d110 2024-09-11T00:26:53.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.593+0000 7f03be28d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f03b8112c00 con 0x7f03b8103cb0 2024-09-11T00:26:53.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.593+0000 7f03be28d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f03b8112f00 con 0x7f03b81045d0 2024-09-11T00:26:53.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.593+0000 7f03bc82a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03b810d110 0x7f03b81023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:53.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.593+0000 7f03bc82a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03b810d110 0x7f03b81023e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48620/0 (socket says 172.21.15.78:48620) 2024-09-11T00:26:53.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.593+0000 7f03bc82a640 1 -- 172.21.15.78:0/2688603002 learned_addr learned my addr 172.21.15.78:0/2688603002 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:26:53.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.593+0000 7f03b7fff640 1 --2- 172.21.15.78:0/2688603002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03b8103cb0 0x7f03b8101960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:53.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.593+0000 7f03b77fe640 1 --2- 172.21.15.78:0/2688603002 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03b81045d0 0x7f03b8101ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:53.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.593+0000 7f03bc82a640 1 -- 172.21.15.78:0/2688603002 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03b81045d0 msgr2=0x7f03b8101ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:53.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.593+0000 7f03bc82a640 1 --2- 172.21.15.78:0/2688603002 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03b81045d0 0x7f03b8101ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:53.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.593+0000 7f03bc82a640 1 -- 172.21.15.78:0/2688603002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03b8103cb0 msgr2=0x7f03b8101960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:53.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.593+0000 7f03bc82a640 1 --2- 172.21.15.78:0/2688603002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03b8103cb0 0x7f03b8101960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:53.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.593+0000 7f03bc82a640 1 -- 172.21.15.78:0/2688603002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b81a75f0 con 0x7f03b810d110 2024-09-11T00:26:53.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.594+0000 7f03bc82a640 1 --2- 172.21.15.78:0/2688603002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03b810d110 0x7f03b81023e0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f03b0005cc0 tx=0x7f03b002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:53.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.594+0000 7f03b57fa640 1 -- 172.21.15.78:0/2688603002 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b0003bf0 con 0x7f03b810d110 2024-09-11T00:26:53.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.594+0000 7f03b57fa640 1 -- 172.21.15.78:0/2688603002 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03b0003d90 con 0x7f03b810d110 2024-09-11T00:26:53.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.594+0000 7f03be28d640 1 -- 172.21.15.78:0/2688603002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03b81a7880 con 0x7f03b810d110 2024-09-11T00:26:53.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.594+0000 7f03b57fa640 1 -- 172.21.15.78:0/2688603002 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b002fb20 con 0x7f03b810d110 2024-09-11T00:26:53.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.594+0000 7f03be28d640 1 -- 172.21.15.78:0/2688603002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03b81a7dc0 con 0x7f03b810d110 2024-09-11T00:26:53.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.595+0000 7f03be28d640 1 -- 172.21.15.78:0/2688603002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03b8104090 con 0x7f03b810d110 2024-09-11T00:26:53.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.596+0000 7f03b57fa640 1 -- 172.21.15.78:0/2688603002 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f03b0004580 con 0x7f03b810d110 2024-09-11T00:26:53.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.597+0000 7f03b57fa640 1 --2- 172.21.15.78:0/2688603002 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f03a40b5450 0x7f03a40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:53.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.597+0000 7f03b7fff640 1 --2- 172.21.15.78:0/2688603002 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f03a40b5450 0x7f03a40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:53.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.597+0000 7f03b57fa640 1 -- 172.21.15.78:0/2688603002 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8536+0+0 (secure 0 0 0) 0x7f03b01073c0 con 0x7f03b810d110 2024-09-11T00:26:53.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.597+0000 7f03b7fff640 1 --2- 172.21.15.78:0/2688603002 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f03a40b5450 0x7f03a40b7910 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f03a800abe0 tx=0x7f03a800a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:53.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.601+0000 7f03b57fa640 1 -- 172.21.15.78:0/2688603002 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f03b00cdf30 con 0x7f03b810d110 2024-09-11T00:26:53.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.788+0000 7f03be28d640 1 -- 172.21.15.78:0/2688603002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f03b81a8140 con 0x7f03b810d110 2024-09-11T00:26:53.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.788+0000 7f03b57fa640 1 -- 172.21.15.78:0/2688603002 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v87) ==== 81+0+888 (secure 0 0 0) 0x7f03b00cd830 con 0x7f03b810d110 2024-09-11T00:26:53.790 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6801/2525199237 2024-09-12T00:07:55.586578+0000 2024-09-11T00:26:53.790 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/1476776463 2024-09-12T00:06:32.958575+0000 2024-09-11T00:26:53.791 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/1949658157 2024-09-12T00:06:56.062555+0000 2024-09-11T00:26:53.791 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/2276853910 2024-09-12T00:07:55.586578+0000 2024-09-11T00:26:53.791 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/4205790529 2024-09-12T00:06:32.958575+0000 2024-09-11T00:26:53.791 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6800/2841116003 2024-09-12T00:06:32.958575+0000 2024-09-11T00:26:53.791 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/4286825123 2024-09-12T00:06:32.958575+0000 2024-09-11T00:26:53.791 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6801/2841116003 2024-09-12T00:06:32.958575+0000 2024-09-11T00:26:53.791 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/1304243506 2024-09-12T00:06:56.062555+0000 2024-09-11T00:26:53.791 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6800/2037182593 2024-09-12T00:06:56.062555+0000 2024-09-11T00:26:53.791 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/1614270050 2024-09-12T00:07:55.586578+0000 2024-09-11T00:26:53.791 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6801/2037182593 2024-09-12T00:06:56.062555+0000 2024-09-11T00:26:53.791 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/1679390655 2024-09-12T00:06:56.062555+0000 2024-09-11T00:26:53.791 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:0/2957982486 2024-09-12T00:07:55.586578+0000 2024-09-11T00:26:53.791 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78:6800/2525199237 2024-09-12T00:07:55.586578+0000 2024-09-11T00:26:53.792 INFO:teuthology.orchestra.run.smithi078.stderr:listed 15 entries 2024-09-11T00:26:53.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.790+0000 7f03be28d640 1 -- 172.21.15.78:0/2688603002 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f03a40b5450 msgr2=0x7f03a40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:53.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.790+0000 7f03be28d640 1 --2- 172.21.15.78:0/2688603002 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f03a40b5450 0x7f03a40b7910 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f03a800abe0 tx=0x7f03a800a2d0 comp rx=0 tx=0).stop 2024-09-11T00:26:53.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.790+0000 7f03be28d640 1 -- 172.21.15.78:0/2688603002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03b810d110 msgr2=0x7f03b81023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:53.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.790+0000 7f03be28d640 1 --2- 172.21.15.78:0/2688603002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03b810d110 0x7f03b81023e0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f03b0005cc0 tx=0x7f03b002f380 comp rx=0 tx=0).stop 2024-09-11T00:26:53.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.790+0000 7f03be28d640 1 -- 172.21.15.78:0/2688603002 shutdown_connections 2024-09-11T00:26:53.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.790+0000 7f03be28d640 1 --2- 172.21.15.78:0/2688603002 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f03a40b5450 0x7f03a40b7910 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:53.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.790+0000 7f03be28d640 1 --2- 172.21.15.78:0/2688603002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03b810d110 0x7f03b81023e0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:53.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.790+0000 7f03be28d640 1 --2- 172.21.15.78:0/2688603002 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03b81045d0 0x7f03b8101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:53.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.790+0000 7f03be28d640 1 --2- 172.21.15.78:0/2688603002 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03b8103cb0 0x7f03b8101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:53.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.790+0000 7f03be28d640 1 -- 172.21.15.78:0/2688603002 >> 172.21.15.78:0/2688603002 conn(0x7f03b80fd730 msgr2=0x7f03b810f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:53.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.790+0000 7f03be28d640 1 -- 172.21.15.78:0/2688603002 shutdown_connections 2024-09-11T00:26:53.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:53.790+0000 7f03be28d640 1 -- 172.21.15.78:0/2688603002 wait complete. 2024-09-11T00:26:54.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:53 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2688603002' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T00:26:54.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:53 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2688603002' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T00:26:54.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:53 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2688603002' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T00:26:54.489 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T00:26:54.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:26:54.489 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T00:26:54.533 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2024-09-11T00:26:54.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:26:54.534 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T00:26:54.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:26:54.595 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-09-11T00:26:54.653 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T00:26:54.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:26:54.654 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T00:26:54.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T00:26:54.720 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2024-09-11T00:26:54.828 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-11T00:26:54.851 INFO:tasks.cephadm:Teardown begin 2024-09-11T00:26:54.851 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T00:26:54.852 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:26:55.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:54 smithi078 ceph-mon[30865]: pgmap v644: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:26:55.097 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:26:55.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:54 smithi112 ceph-mon[35627]: pgmap v644: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:26:55.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:54 smithi138 ceph-mon[35019]: pgmap v644: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-11T00:26:55.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.594+0000 7f78e0aad640 1 -- 172.21.15.78:0/3368844175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78dc102da0 msgr2=0x7f78dc103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:55.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.594+0000 7f78e0aad640 1 --2- 172.21.15.78:0/3368844175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78dc102da0 0x7f78dc103180 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f78cc009ca0 tx=0x7f78cc02a8c0 comp rx=0 tx=0).stop 2024-09-11T00:26:55.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.594+0000 7f78e0aad640 1 -- 172.21.15.78:0/3368844175 shutdown_connections 2024-09-11T00:26:55.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.594+0000 7f78e0aad640 1 --2- 172.21.15.78:0/3368844175 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78dc109130 0x7f78dc10f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:55.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.594+0000 7f78e0aad640 1 --2- 172.21.15.78:0/3368844175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78dc1087b0 0x7f78dc108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:55.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.594+0000 7f78e0aad640 1 --2- 172.21.15.78:0/3368844175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78dc102da0 0x7f78dc103180 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:55.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.594+0000 7f78e0aad640 1 -- 172.21.15.78:0/3368844175 >> 172.21.15.78:0/3368844175 conn(0x7f78dc0fe850 msgr2=0x7f78dc100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:55.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.594+0000 7f78e0aad640 1 -- 172.21.15.78:0/3368844175 shutdown_connections 2024-09-11T00:26:55.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.594+0000 7f78e0aad640 1 -- 172.21.15.78:0/3368844175 wait complete. 2024-09-11T00:26:55.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.595+0000 7f78e0aad640 1 Processor -- start 2024-09-11T00:26:55.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.595+0000 7f78e0aad640 1 -- start start 2024-09-11T00:26:55.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.595+0000 7f78e0aad640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78dc102da0 0x7f78dc199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:55.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.595+0000 7f78e0aad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78dc1087b0 0x7f78dc199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:55.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.595+0000 7f78e0aad640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78dc109130 0x7f78dc19eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:55.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.595+0000 7f78e0aad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f78dc112db0 con 0x7f78dc1087b0 2024-09-11T00:26:55.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.595+0000 7f78e0aad640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f78dc112c30 con 0x7f78dc109130 2024-09-11T00:26:55.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.595+0000 7f78e0aad640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f78dc112f30 con 0x7f78dc102da0 2024-09-11T00:26:55.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.595+0000 7f78d9d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78dc1087b0 0x7f78dc199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:55.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.595+0000 7f78d9d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78dc1087b0 0x7f78dc199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47036/0 (socket says 172.21.15.78:47036) 2024-09-11T00:26:55.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.595+0000 7f78d9d9b640 1 -- 172.21.15.78:0/1545506799 learned_addr learned my addr 172.21.15.78:0/1545506799 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:26:55.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.595+0000 7f78da59c640 1 --2- 172.21.15.78:0/1545506799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78dc102da0 0x7f78dc199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:55.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.595+0000 7f78dad9d640 1 --2- 172.21.15.78:0/1545506799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78dc109130 0x7f78dc19eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:55.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.595+0000 7f78d9d9b640 1 -- 172.21.15.78:0/1545506799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78dc102da0 msgr2=0x7f78dc199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:55.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.595+0000 7f78d9d9b640 1 --2- 172.21.15.78:0/1545506799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78dc102da0 0x7f78dc199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:55.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.595+0000 7f78d9d9b640 1 -- 172.21.15.78:0/1545506799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78dc109130 msgr2=0x7f78dc19eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:55.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.595+0000 7f78d9d9b640 1 --2- 172.21.15.78:0/1545506799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78dc109130 0x7f78dc19eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:55.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.595+0000 7f78d9d9b640 1 -- 172.21.15.78:0/1545506799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78dc19f2d0 con 0x7f78dc1087b0 2024-09-11T00:26:55.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.596+0000 7f78d9d9b640 1 --2- 172.21.15.78:0/1545506799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78dc1087b0 0x7f78dc199760 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f78d000c920 tx=0x7f78d000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:55.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.596+0000 7f78cb7fe640 1 -- 172.21.15.78:0/1545506799 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0007c70 con 0x7f78dc1087b0 2024-09-11T00:26:55.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.596+0000 7f78cb7fe640 1 -- 172.21.15.78:0/1545506799 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78d0007e10 con 0x7f78dc1087b0 2024-09-11T00:26:55.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.596+0000 7f78cb7fe640 1 -- 172.21.15.78:0/1545506799 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0018820 con 0x7f78dc1087b0 2024-09-11T00:26:55.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.596+0000 7f78e0aad640 1 -- 172.21.15.78:0/1545506799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78dc19f5c0 con 0x7f78dc1087b0 2024-09-11T00:26:55.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.596+0000 7f78e0aad640 1 -- 172.21.15.78:0/1545506799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78dc1a5c80 con 0x7f78dc1087b0 2024-09-11T00:26:55.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.597+0000 7f78e0aad640 1 -- 172.21.15.78:0/1545506799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78dc103180 con 0x7f78dc1087b0 2024-09-11T00:26:55.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.598+0000 7f78cb7fe640 1 -- 172.21.15.78:0/1545506799 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f78d000f450 con 0x7f78dc1087b0 2024-09-11T00:26:55.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.599+0000 7f78cb7fe640 1 --2- 172.21.15.78:0/1545506799 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f78c40b5450 0x7f78c40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:55.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.599+0000 7f78da59c640 1 --2- 172.21.15.78:0/1545506799 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f78c40b5450 0x7f78c40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:55.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.600+0000 7f78cb7fe640 1 -- 172.21.15.78:0/1545506799 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8536+0+0 (secure 0 0 0) 0x7f78d00e63f0 con 0x7f78dc1087b0 2024-09-11T00:26:55.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.600+0000 7f78da59c640 1 --2- 172.21.15.78:0/1545506799 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f78c40b5450 0x7f78c40b7910 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f78cc0098d0 tx=0x7f78cc009900 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:55.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.602+0000 7f78cb7fe640 1 -- 172.21.15.78:0/1545506799 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f78d0014030 con 0x7f78dc1087b0 2024-09-11T00:26:55.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.815+0000 7f78e0aad640 1 -- 172.21.15.78:0/1545506799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78dc19a350 con 0x7f78dc1087b0 2024-09-11T00:26:55.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.816+0000 7f78cb7fe640 1 -- 172.21.15.78:0/1545506799 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f78d00acf90 con 0x7f78dc1087b0 2024-09-11T00:26:55.819 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:26:55.819 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:26:55.820 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:26:55.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.818+0000 7f78e0aad640 1 -- 172.21.15.78:0/1545506799 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f78c40b5450 msgr2=0x7f78c40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:55.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.818+0000 7f78e0aad640 1 --2- 172.21.15.78:0/1545506799 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f78c40b5450 0x7f78c40b7910 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f78cc0098d0 tx=0x7f78cc009900 comp rx=0 tx=0).stop 2024-09-11T00:26:55.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.818+0000 7f78e0aad640 1 -- 172.21.15.78:0/1545506799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78dc1087b0 msgr2=0x7f78dc199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:55.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.818+0000 7f78e0aad640 1 --2- 172.21.15.78:0/1545506799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78dc1087b0 0x7f78dc199760 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f78d000c920 tx=0x7f78d000cde0 comp rx=0 tx=0).stop 2024-09-11T00:26:55.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.818+0000 7f78e0aad640 1 -- 172.21.15.78:0/1545506799 shutdown_connections 2024-09-11T00:26:55.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.818+0000 7f78e0aad640 1 --2- 172.21.15.78:0/1545506799 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f78c40b5450 0x7f78c40b7910 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:55.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.818+0000 7f78e0aad640 1 --2- 172.21.15.78:0/1545506799 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78dc109130 0x7f78dc19eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:55.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.818+0000 7f78e0aad640 1 --2- 172.21.15.78:0/1545506799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78dc1087b0 0x7f78dc199760 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:55.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.818+0000 7f78e0aad640 1 --2- 172.21.15.78:0/1545506799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78dc102da0 0x7f78dc199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:55.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.818+0000 7f78e0aad640 1 -- 172.21.15.78:0/1545506799 >> 172.21.15.78:0/1545506799 conn(0x7f78dc0fe850 msgr2=0x7f78dc100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:55.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.818+0000 7f78e0aad640 1 -- 172.21.15.78:0/1545506799 shutdown_connections 2024-09-11T00:26:55.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:55.818+0000 7f78e0aad640 1 -- 172.21.15.78:0/1545506799 wait complete. 2024-09-11T00:26:56.084 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:55 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1545506799' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:26:56.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:55 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1545506799' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:26:56.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:55 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1545506799' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:26:56.656 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T00:26:56.903 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:26:57.024 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:56 smithi078 ceph-mon[30865]: pgmap v645: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T00:26:57.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:56 smithi112 ceph-mon[35627]: pgmap v645: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T00:26:57.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:56 smithi138 ceph-mon[35019]: pgmap v645: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-11T00:26:57.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.402+0000 7f4937f6d640 1 -- 172.21.15.78:0/2727833421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4930104590 msgr2=0x7f493010cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:57.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.402+0000 7f4937f6d640 1 --2- 172.21.15.78:0/2727833421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4930104590 0x7f493010cb70 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f4920009900 tx=0x7f492002a410 comp rx=0 tx=0).stop 2024-09-11T00:26:57.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.402+0000 7f4937f6d640 1 -- 172.21.15.78:0/2727833421 shutdown_connections 2024-09-11T00:26:57.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.402+0000 7f4937f6d640 1 --2- 172.21.15.78:0/2727833421 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f493010d140 0x7f493010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:57.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.402+0000 7f4937f6d640 1 --2- 172.21.15.78:0/2727833421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4930104590 0x7f493010cb70 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:57.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.402+0000 7f4937f6d640 1 --2- 172.21.15.78:0/2727833421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4930103b90 0x7f4930103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:57.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.402+0000 7f4937f6d640 1 -- 172.21.15.78:0/2727833421 >> 172.21.15.78:0/2727833421 conn(0x7f49300fd700 msgr2=0x7f49300ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:57.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.402+0000 7f4937f6d640 1 -- 172.21.15.78:0/2727833421 shutdown_connections 2024-09-11T00:26:57.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.402+0000 7f4937f6d640 1 -- 172.21.15.78:0/2727833421 wait complete. 2024-09-11T00:26:57.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.403+0000 7f4937f6d640 1 Processor -- start 2024-09-11T00:26:57.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.403+0000 7f4937f6d640 1 -- start start 2024-09-11T00:26:57.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.403+0000 7f4937f6d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4930103b90 0x7f4930199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:57.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.403+0000 7f4937f6d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4930104590 0x7f4930199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:57.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.403+0000 7f4937f6d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f493010d140 0x7f493019ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:57.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.403+0000 7f4937f6d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4930112d60 con 0x7f4930103b90 2024-09-11T00:26:57.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.403+0000 7f4937f6d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4930112be0 con 0x7f493010d140 2024-09-11T00:26:57.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.403+0000 7f4937f6d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4930112ee0 con 0x7f4930104590 2024-09-11T00:26:57.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.403+0000 7f4935d09640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4930103b90 0x7f4930199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:57.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.403+0000 7f4935d09640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4930103b90 0x7f4930199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47048/0 (socket says 172.21.15.78:47048) 2024-09-11T00:26:57.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.403+0000 7f4935d09640 1 -- 172.21.15.78:0/1363662620 learned_addr learned my addr 172.21.15.78:0/1363662620 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:26:57.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.403+0000 7f4935508640 1 --2- 172.21.15.78:0/1363662620 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4930104590 0x7f4930199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:57.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.404+0000 7f493650a640 1 --2- 172.21.15.78:0/1363662620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f493010d140 0x7f493019ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:57.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.404+0000 7f4935d09640 1 -- 172.21.15.78:0/1363662620 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4930104590 msgr2=0x7f4930199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:57.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.404+0000 7f4935d09640 1 --2- 172.21.15.78:0/1363662620 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4930104590 0x7f4930199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:57.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.404+0000 7f4935d09640 1 -- 172.21.15.78:0/1363662620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f493010d140 msgr2=0x7f493019ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:57.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.404+0000 7f4935d09640 1 --2- 172.21.15.78:0/1363662620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f493010d140 0x7f493019ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:57.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.404+0000 7f4935d09640 1 -- 172.21.15.78:0/1363662620 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493019f3f0 con 0x7f4930103b90 2024-09-11T00:26:57.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.404+0000 7f4935d09640 1 --2- 172.21.15.78:0/1363662620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4930103b90 0x7f4930199340 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f492c00e9f0 tx=0x7f492c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:57.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.404+0000 7f4926ffd640 1 -- 172.21.15.78:0/1363662620 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c00cd80 con 0x7f4930103b90 2024-09-11T00:26:57.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.404+0000 7f4937f6d640 1 -- 172.21.15.78:0/1363662620 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f493019f6e0 con 0x7f4930103b90 2024-09-11T00:26:57.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.404+0000 7f4926ffd640 1 -- 172.21.15.78:0/1363662620 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f492c0108e0 con 0x7f4930103b90 2024-09-11T00:26:57.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.404+0000 7f4926ffd640 1 -- 172.21.15.78:0/1363662620 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c018980 con 0x7f4930103b90 2024-09-11T00:26:57.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.404+0000 7f4937f6d640 1 -- 172.21.15.78:0/1363662620 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49301a5f70 con 0x7f4930103b90 2024-09-11T00:26:57.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.405+0000 7f4937f6d640 1 -- 172.21.15.78:0/1363662620 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f493006b0f0 con 0x7f4930103b90 2024-09-11T00:26:57.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.407+0000 7f4926ffd640 1 -- 172.21.15.78:0/1363662620 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f492c010430 con 0x7f4930103b90 2024-09-11T00:26:57.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.408+0000 7f4926ffd640 1 --2- 172.21.15.78:0/1363662620 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f491c0b5450 0x7f491c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:57.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.408+0000 7f4935508640 1 --2- 172.21.15.78:0/1363662620 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f491c0b5450 0x7f491c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:57.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.408+0000 7f4926ffd640 1 -- 172.21.15.78:0/1363662620 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8536+0+0 (secure 0 0 0) 0x7f492c0e63f0 con 0x7f4930103b90 2024-09-11T00:26:57.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.409+0000 7f4935508640 1 --2- 172.21.15.78:0/1363662620 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f491c0b5450 0x7f491c0b7910 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4920031440 tx=0x7f4920005b50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:57.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.412+0000 7f4926ffd640 1 -- 172.21.15.78:0/1363662620 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f492c0acf60 con 0x7f4930103b90 2024-09-11T00:26:57.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.629+0000 7f4937f6d640 1 -- 172.21.15.78:0/1363662620 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4930103f70 con 0x7f4930103b90 2024-09-11T00:26:57.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.629+0000 7f4926ffd640 1 -- 172.21.15.78:0/1363662620 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11858 (secure 0 0 0) 0x7f492c0ac860 con 0x7f4930103b90 2024-09-11T00:26:57.631 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:26:57.632 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"btime":"2024-09-11T00:14:35:942737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14703,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/968608466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":968608466},{"type":"v1","addr":"172.21.15.78:6835","nonce":968608466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2804778258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2804778258},{"type":"v1","addr":"172.21.15.78:6837","nonce":2804778258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2754095227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2754095227},{"type":"v1","addr":"172.21.15.78:6839","nonce":2754095227}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6841/3067187523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6840","nonce":3067187523},{"type":"v1","addr":"172.21.15.78:6841","nonce":3067187523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24527,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6833/1151759844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":1151759844},{"type":"v1","addr":"172.21.15.112:6833","nonce":1151759844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24532,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2451542817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2451542817},{"type":"v1","addr":"172.21.15.138:6833","nonce":2451542817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24548,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/2046327807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":2046327807},{"type":"v1","addr":"172.21.15.112:6835","nonce":2046327807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24565,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/1086283757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":1086283757},{"type":"v1","addr":"172.21.15.138:6835","nonce":1086283757}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3566830955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3566830955},{"type":"v1","addr":"172.21.15.138:6837","nonce":3566830955}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24575,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/3784369511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":3784369511},{"type":"v1","addr":"172.21.15.112:6837","nonce":3784369511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T00:14:26.461738+0000","modified":"2024-09-11T00:14:35.614720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24589":{"gid":24589,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6839/1175492512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":1175492512},{"type":"v1","addr":"172.21.15.138:6839","nonce":1175492512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.112:6839/433500133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6838","nonce":433500133},{"type":"v1","addr":"172.21.15.112:6839","nonce":433500133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24593,"qdb_cluster":[24593]},"id":1}]} 2024-09-11T00:26:57.632 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 20 2024-09-11T00:26:57.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.632+0000 7f4937f6d640 1 -- 172.21.15.78:0/1363662620 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f491c0b5450 msgr2=0x7f491c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:57.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.632+0000 7f4937f6d640 1 --2- 172.21.15.78:0/1363662620 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f491c0b5450 0x7f491c0b7910 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4920031440 tx=0x7f4920005b50 comp rx=0 tx=0).stop 2024-09-11T00:26:57.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.632+0000 7f4937f6d640 1 -- 172.21.15.78:0/1363662620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4930103b90 msgr2=0x7f4930199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:57.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.632+0000 7f4937f6d640 1 --2- 172.21.15.78:0/1363662620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4930103b90 0x7f4930199340 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f492c00e9f0 tx=0x7f492c00eeb0 comp rx=0 tx=0).stop 2024-09-11T00:26:57.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.632+0000 7f4937f6d640 1 -- 172.21.15.78:0/1363662620 shutdown_connections 2024-09-11T00:26:57.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.632+0000 7f4937f6d640 1 --2- 172.21.15.78:0/1363662620 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f491c0b5450 0x7f491c0b7910 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:57.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.632+0000 7f4937f6d640 1 --2- 172.21.15.78:0/1363662620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f493010d140 0x7f493019ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:57.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.632+0000 7f4937f6d640 1 --2- 172.21.15.78:0/1363662620 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4930104590 0x7f4930199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:57.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.632+0000 7f4937f6d640 1 --2- 172.21.15.78:0/1363662620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4930103b90 0x7f4930199340 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:57.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.632+0000 7f4937f6d640 1 -- 172.21.15.78:0/1363662620 >> 172.21.15.78:0/1363662620 conn(0x7f49300fd700 msgr2=0x7f49300fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:57.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.632+0000 7f4937f6d640 1 -- 172.21.15.78:0/1363662620 shutdown_connections 2024-09-11T00:26:57.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:57.632+0000 7f4937f6d640 1 -- 172.21.15.78:0/1363662620 wait complete. 2024-09-11T00:26:58.190 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:57 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1363662620' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:26:58.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:57 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1363662620' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:26:58.251 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:57 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1363662620' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T00:26:58.281 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T00:26:58.543 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:26:59.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:58 smithi138 ceph-mon[35019]: pgmap v646: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T00:26:59.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.051+0000 7fa138a43640 1 -- 172.21.15.78:0/3809210177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa134104600 msgr2=0x7fa13410caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:59.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.051+0000 7fa138a43640 1 --2- 172.21.15.78:0/3809210177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa134104600 0x7fa13410caf0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fa128009900 tx=0x7fa12802a410 comp rx=0 tx=0).stop 2024-09-11T00:26:59.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.052+0000 7fa138a43640 1 -- 172.21.15.78:0/3809210177 shutdown_connections 2024-09-11T00:26:59.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.052+0000 7fa138a43640 1 --2- 172.21.15.78:0/3809210177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa13410d140 0x7fa13410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:59.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.052+0000 7fa138a43640 1 --2- 172.21.15.78:0/3809210177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa134104600 0x7fa13410caf0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:59.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.052+0000 7fa138a43640 1 --2- 172.21.15.78:0/3809210177 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa134103ce0 0x7fa1341040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:59.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.052+0000 7fa138a43640 1 -- 172.21.15.78:0/3809210177 >> 172.21.15.78:0/3809210177 conn(0x7fa1340fd700 msgr2=0x7fa1340ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:59.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.052+0000 7fa138a43640 1 -- 172.21.15.78:0/3809210177 shutdown_connections 2024-09-11T00:26:59.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.052+0000 7fa138a43640 1 -- 172.21.15.78:0/3809210177 wait complete. 2024-09-11T00:26:59.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.052+0000 7fa138a43640 1 Processor -- start 2024-09-11T00:26:59.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.052+0000 7fa138a43640 1 -- start start 2024-09-11T00:26:59.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa138a43640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa134103ce0 0x7fa134199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:59.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa138a43640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa134104600 0x7fa134199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:59.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa138a43640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa13410d140 0x7fa13419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:59.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa138a43640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa134112df0 con 0x7fa134103ce0 2024-09-11T00:26:59.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa138a43640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa134112c70 con 0x7fa13410d140 2024-09-11T00:26:59.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa138a43640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa134112f70 con 0x7fa134104600 2024-09-11T00:26:59.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa13259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa134103ce0 0x7fa134199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:59.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa13259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa134103ce0 0x7fa134199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47074/0 (socket says 172.21.15.78:47074) 2024-09-11T00:26:59.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa13259c640 1 -- 172.21.15.78:0/266950314 learned_addr learned my addr 172.21.15.78:0/266950314 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:26:59.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa132d9d640 1 --2- 172.21.15.78:0/266950314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa13410d140 0x7fa13419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:59.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa131d9b640 1 --2- 172.21.15.78:0/266950314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa134104600 0x7fa134199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:59.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa13259c640 1 -- 172.21.15.78:0/266950314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa134104600 msgr2=0x7fa134199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:59.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa13259c640 1 --2- 172.21.15.78:0/266950314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa134104600 0x7fa134199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:59.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa13259c640 1 -- 172.21.15.78:0/266950314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa13410d140 msgr2=0x7fa13419ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:59.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa13259c640 1 --2- 172.21.15.78:0/266950314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa13410d140 0x7fa13419ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:59.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa13259c640 1 -- 172.21.15.78:0/266950314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13419f3b0 con 0x7fa134103ce0 2024-09-11T00:26:59.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa131d9b640 1 --2- 172.21.15.78:0/266950314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa134104600 0x7fa134199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:26:59.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa13259c640 1 --2- 172.21.15.78:0/266950314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa134103ce0 0x7fa134199300 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fa12400d950 tx=0x7fa12400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:59.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa1237fe640 1 -- 172.21.15.78:0/266950314 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa124017070 con 0x7fa134103ce0 2024-09-11T00:26:59.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa1237fe640 1 -- 172.21.15.78:0/266950314 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa124009c30 con 0x7fa134103ce0 2024-09-11T00:26:59.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa138a43640 1 -- 172.21.15.78:0/266950314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa13419f6a0 con 0x7fa134103ce0 2024-09-11T00:26:59.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa1237fe640 1 -- 172.21.15.78:0/266950314 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12400f620 con 0x7fa134103ce0 2024-09-11T00:26:59.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.053+0000 7fa138a43640 1 -- 172.21.15.78:0/266950314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1341a5de0 con 0x7fa134103ce0 2024-09-11T00:26:59.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.055+0000 7fa138a43640 1 -- 172.21.15.78:0/266950314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1341040c0 con 0x7fa134103ce0 2024-09-11T00:26:59.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.057+0000 7fa1237fe640 1 -- 172.21.15.78:0/266950314 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fa124010460 con 0x7fa134103ce0 2024-09-11T00:26:59.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.057+0000 7fa1237fe640 1 --2- 172.21.15.78:0/266950314 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa11c0b5450 0x7fa11c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:26:59.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.057+0000 7fa131d9b640 1 --2- 172.21.15.78:0/266950314 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa11c0b5450 0x7fa11c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:26:59.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.058+0000 7fa1237fe640 1 -- 172.21.15.78:0/266950314 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8536+0+0 (secure 0 0 0) 0x7fa1240e5c30 con 0x7fa134103ce0 2024-09-11T00:26:59.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.058+0000 7fa131d9b640 1 --2- 172.21.15.78:0/266950314 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa11c0b5450 0x7fa11c0b7910 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa128005ab0 tx=0x7fa128031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:26:59.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.060+0000 7fa1237fe640 1 -- 172.21.15.78:0/266950314 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa1240ac7a0 con 0x7fa134103ce0 2024-09-11T00:26:59.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:58 smithi112 ceph-mon[35627]: pgmap v646: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T00:26:59.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.237+0000 7fa138a43640 1 -- 172.21.15.78:0/266950314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa1341a6190 con 0x7fa134103ce0 2024-09-11T00:26:59.239 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:58 smithi078 ceph-mon[30865]: pgmap v646: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T00:26:59.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.239+0000 7fa1237fe640 1 -- 172.21.15.78:0/266950314 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+23308 (secure 0 0 0) 0x7fa124009de0 con 0x7fa134103ce0 2024-09-11T00:26:59.241 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-11T00:26:59.241 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":87,"fsid":"85a53860-6fd1-11ef-bcea-c7b262605968","created":"2024-09-11T00:06:05.704745+0000","modified":"2024-09-11T00:26:15.619172+0000","last_up_change":"2024-09-11T00:13:35.307216+0000","last_in_change":"2024-09-11T00:13:12.730667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T00:09:47.891696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T00:14:22.345345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T00:14:24.446029+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":86,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d260c219-52f2-4e7f-9188-9e66ee01dacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6803","nonce":3736366730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6805","nonce":3736366730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6809","nonce":3736366730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3736366730},{"type":"v1","addr":"172.21.15.78:6807","nonce":3736366730}]},"public_addr":"172.21.15.78:6803/3736366730","cluster_addr":"172.21.15.78:6805/3736366730","heartbeat_back_addr":"172.21.15.78:6809/3736366730","heartbeat_front_addr":"172.21.15.78:6807/3736366730","state":["exists","up"]},{"osd":1,"uuid":"d0f286a2-a121-40ee-8134-67ef01b1bc9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6801","nonce":3186321784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6803","nonce":3186321784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6807","nonce":3186321784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3186321784},{"type":"v1","addr":"172.21.15.112:6805","nonce":3186321784}]},"public_addr":"172.21.15.112:6801/3186321784","cluster_addr":"172.21.15.112:6803/3186321784","heartbeat_back_addr":"172.21.15.112:6807/3186321784","heartbeat_front_addr":"172.21.15.112:6805/3186321784","state":["exists","up"]},{"osd":2,"uuid":"0eadcce5-12af-4af6-9b4e-159e84454d8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6801","nonce":3206386630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6803","nonce":3206386630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6807","nonce":3206386630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3206386630},{"type":"v1","addr":"172.21.15.138:6805","nonce":3206386630}]},"public_addr":"172.21.15.138:6801/3206386630","cluster_addr":"172.21.15.138:6803/3206386630","heartbeat_back_addr":"172.21.15.138:6807/3206386630","heartbeat_front_addr":"172.21.15.138:6805/3206386630","state":["exists","up"]},{"osd":3,"uuid":"5f3f683d-6306-43da-8bbd-c103eca442ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6811","nonce":3832405256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6813","nonce":3832405256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6817","nonce":3832405256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3832405256},{"type":"v1","addr":"172.21.15.78:6815","nonce":3832405256}]},"public_addr":"172.21.15.78:6811/3832405256","cluster_addr":"172.21.15.78:6813/3832405256","heartbeat_back_addr":"172.21.15.78:6817/3832405256","heartbeat_front_addr":"172.21.15.78:6815/3832405256","state":["exists","up"]},{"osd":4,"uuid":"4575a0a5-821e-4346-84ac-5396042b0550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6809","nonce":2650243435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6811","nonce":2650243435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6815","nonce":2650243435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":2650243435},{"type":"v1","addr":"172.21.15.112:6813","nonce":2650243435}]},"public_addr":"172.21.15.112:6809/2650243435","cluster_addr":"172.21.15.112:6811/2650243435","heartbeat_back_addr":"172.21.15.112:6815/2650243435","heartbeat_front_addr":"172.21.15.112:6813/2650243435","state":["exists","up"]},{"osd":5,"uuid":"e81eb98f-76eb-4da5-8047-f160888720e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6809","nonce":3033110975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6811","nonce":3033110975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6815","nonce":3033110975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":3033110975},{"type":"v1","addr":"172.21.15.138:6813","nonce":3033110975}]},"public_addr":"172.21.15.138:6809/3033110975","cluster_addr":"172.21.15.138:6811/3033110975","heartbeat_back_addr":"172.21.15.138:6815/3033110975","heartbeat_front_addr":"172.21.15.138:6813/3033110975","state":["exists","up"]},{"osd":6,"uuid":"7442a091-4dba-45c4-808b-7c3b97087aa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6819","nonce":477087575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6821","nonce":477087575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6825","nonce":477087575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":477087575},{"type":"v1","addr":"172.21.15.78:6823","nonce":477087575}]},"public_addr":"172.21.15.78:6819/477087575","cluster_addr":"172.21.15.78:6821/477087575","heartbeat_back_addr":"172.21.15.78:6825/477087575","heartbeat_front_addr":"172.21.15.78:6823/477087575","state":["exists","up"]},{"osd":7,"uuid":"220c1f03-ace9-4dd0-a06d-485b0d2d08bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6817","nonce":1481363296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6819","nonce":1481363296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6823","nonce":1481363296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1481363296},{"type":"v1","addr":"172.21.15.112:6821","nonce":1481363296}]},"public_addr":"172.21.15.112:6817/1481363296","cluster_addr":"172.21.15.112:6819/1481363296","heartbeat_back_addr":"172.21.15.112:6823/1481363296","heartbeat_front_addr":"172.21.15.112:6821/1481363296","state":["exists","up"]},{"osd":8,"uuid":"adb6edaa-9a8c-4b0b-aa6a-26dc77a3a7cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6817","nonce":2195149036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6819","nonce":2195149036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6823","nonce":2195149036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2195149036},{"type":"v1","addr":"172.21.15.138:6821","nonce":2195149036}]},"public_addr":"172.21.15.138:6817/2195149036","cluster_addr":"172.21.15.138:6819/2195149036","heartbeat_back_addr":"172.21.15.138:6823/2195149036","heartbeat_front_addr":"172.21.15.138:6821/2195149036","state":["exists","up"]},{"osd":9,"uuid":"dd01f408-3712-410e-acbd-c797b7ea5058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6827","nonce":3367249449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6829","nonce":3367249449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6833","nonce":3367249449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3367249449},{"type":"v1","addr":"172.21.15.78:6831","nonce":3367249449}]},"public_addr":"172.21.15.78:6827/3367249449","cluster_addr":"172.21.15.78:6829/3367249449","heartbeat_back_addr":"172.21.15.78:6833/3367249449","heartbeat_front_addr":"172.21.15.78:6831/3367249449","state":["exists","up"]},{"osd":10,"uuid":"243c6483-1b0e-49f2-b99c-116d9e9c0617","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6825","nonce":775023408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6827","nonce":775023408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6831","nonce":775023408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":775023408},{"type":"v1","addr":"172.21.15.112:6829","nonce":775023408}]},"public_addr":"172.21.15.112:6825/775023408","cluster_addr":"172.21.15.112:6827/775023408","heartbeat_back_addr":"172.21.15.112:6831/775023408","heartbeat_front_addr":"172.21.15.112:6829/775023408","state":["exists","up"]},{"osd":11,"uuid":"fa20ac9e-b5f7-4b3a-bb51-31569f909609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6825","nonce":4046089012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6827","nonce":4046089012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6831","nonce":4046089012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":4046089012},{"type":"v1","addr":"172.21.15.138:6829","nonce":4046089012}]},"public_addr":"172.21.15.138:6825/4046089012","cluster_addr":"172.21.15.138:6827/4046089012","heartbeat_back_addr":"172.21.15.138:6831/4046089012","heartbeat_front_addr":"172.21.15.138:6829/4046089012","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:08:55.896475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:20.695819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:09:44.785187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:10.858705+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:10:35.855800+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:01.353037+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:27.492985+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:11:52.860532+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:17.946878+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:12:43.188966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:08.369978+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:13:34.192288+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":8}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6801/2525199237":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/1476776463":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1949658157":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2276853910":"2024-09-12T00:07:55.586578+0000","172.21.15.78:0/4205790529":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6800/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/4286825123":"2024-09-12T00:06:32.958575+0000","172.21.15.78:6801/2841116003":"2024-09-12T00:06:32.958575+0000","172.21.15.78:0/1304243506":"2024-09-12T00:06:56.062555+0000","172.21.15.78:6800/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1614270050":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6801/2037182593":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/1679390655":"2024-09-12T00:06:56.062555+0000","172.21.15.78:0/2957982486":"2024-09-12T00:07:55.586578+0000","172.21.15.78:6800/2525199237":"2024-09-12T00:07:55.586578+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T00:26:59.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.241+0000 7fa138a43640 1 -- 172.21.15.78:0/266950314 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa11c0b5450 msgr2=0x7fa11c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:59.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.241+0000 7fa138a43640 1 --2- 172.21.15.78:0/266950314 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa11c0b5450 0x7fa11c0b7910 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa128005ab0 tx=0x7fa128031400 comp rx=0 tx=0).stop 2024-09-11T00:26:59.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.241+0000 7fa138a43640 1 -- 172.21.15.78:0/266950314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa134103ce0 msgr2=0x7fa134199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:26:59.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.241+0000 7fa138a43640 1 --2- 172.21.15.78:0/266950314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa134103ce0 0x7fa134199300 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fa12400d950 tx=0x7fa12400de10 comp rx=0 tx=0).stop 2024-09-11T00:26:59.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.241+0000 7fa138a43640 1 -- 172.21.15.78:0/266950314 shutdown_connections 2024-09-11T00:26:59.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.241+0000 7fa138a43640 1 --2- 172.21.15.78:0/266950314 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa11c0b5450 0x7fa11c0b7910 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:59.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.241+0000 7fa138a43640 1 --2- 172.21.15.78:0/266950314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa13410d140 0x7fa13419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:59.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.241+0000 7fa138a43640 1 --2- 172.21.15.78:0/266950314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa134104600 0x7fa134199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:59.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.241+0000 7fa138a43640 1 --2- 172.21.15.78:0/266950314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa134103ce0 0x7fa134199300 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:26:59.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.241+0000 7fa138a43640 1 -- 172.21.15.78:0/266950314 >> 172.21.15.78:0/266950314 conn(0x7fa1340fd700 msgr2=0x7fa1340fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:26:59.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.241+0000 7fa138a43640 1 -- 172.21.15.78:0/266950314 shutdown_connections 2024-09-11T00:26:59.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:26:59.241+0000 7fa138a43640 1 -- 172.21.15.78:0/266950314 wait complete. 2024-09-11T00:26:59.927 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:26:59 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/266950314' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:26:59.957 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-11T00:27:00.207 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:27:00.242 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:26:59 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/266950314' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:27:00.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:26:59 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/266950314' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T00:27:00.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.667+0000 7fda342f1640 1 -- 172.21.15.78:0/989341836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda2c101c90 msgr2=0x7fda2c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:00.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.667+0000 7fda342f1640 1 --2- 172.21.15.78:0/989341836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda2c101c90 0x7fda2c102070 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fda28009900 tx=0x7fda2802a3f0 comp rx=0 tx=0).stop 2024-09-11T00:27:00.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.667+0000 7fda342f1640 1 -- 172.21.15.78:0/989341836 shutdown_connections 2024-09-11T00:27:00.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.667+0000 7fda342f1640 1 --2- 172.21.15.78:0/989341836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda2c108020 0x7fda2c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:00.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.667+0000 7fda342f1640 1 --2- 172.21.15.78:0/989341836 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda2c1076a0 0x7fda2c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:00.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.667+0000 7fda342f1640 1 --2- 172.21.15.78:0/989341836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda2c101c90 0x7fda2c102070 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:00.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.667+0000 7fda342f1640 1 -- 172.21.15.78:0/989341836 >> 172.21.15.78:0/989341836 conn(0x7fda2c0fd700 msgr2=0x7fda2c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:00.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.667+0000 7fda342f1640 1 -- 172.21.15.78:0/989341836 shutdown_connections 2024-09-11T00:27:00.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.667+0000 7fda342f1640 1 -- 172.21.15.78:0/989341836 wait complete. 2024-09-11T00:27:00.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.668+0000 7fda342f1640 1 Processor -- start 2024-09-11T00:27:00.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.668+0000 7fda342f1640 1 -- start start 2024-09-11T00:27:00.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.668+0000 7fda342f1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda2c101c90 0x7fda2c199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:00.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.668+0000 7fda342f1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda2c1076a0 0x7fda2c1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:00.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.668+0000 7fda342f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda2c108020 0x7fda2c19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:00.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.668+0000 7fda342f1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fda2c111ce0 con 0x7fda2c108020 2024-09-11T00:27:00.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.668+0000 7fda342f1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fda2c111b60 con 0x7fda2c1076a0 2024-09-11T00:27:00.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.668+0000 7fda342f1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fda2c111e60 con 0x7fda2c101c90 2024-09-11T00:27:00.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.668+0000 7fda3288e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda2c108020 0x7fda2c19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:00.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.668+0000 7fda3288e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda2c108020 0x7fda2c19eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47088/0 (socket says 172.21.15.78:47088) 2024-09-11T00:27:00.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.668+0000 7fda3288e640 1 -- 172.21.15.78:0/1994876032 learned_addr learned my addr 172.21.15.78:0/1994876032 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:27:00.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.668+0000 7fda3188c640 1 --2- 172.21.15.78:0/1994876032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda2c1076a0 0x7fda2c1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:00.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.668+0000 7fda3288e640 1 -- 172.21.15.78:0/1994876032 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda2c101c90 msgr2=0x7fda2c199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:00.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.668+0000 7fda3208d640 1 --2- 172.21.15.78:0/1994876032 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda2c101c90 0x7fda2c199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:00.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.668+0000 7fda3288e640 1 --2- 172.21.15.78:0/1994876032 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda2c101c90 0x7fda2c199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:00.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.668+0000 7fda3288e640 1 -- 172.21.15.78:0/1994876032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda2c1076a0 msgr2=0x7fda2c1997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:00.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.668+0000 7fda3288e640 1 --2- 172.21.15.78:0/1994876032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda2c1076a0 0x7fda2c1997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:00.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.668+0000 7fda3288e640 1 -- 172.21.15.78:0/1994876032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda2c19f330 con 0x7fda2c108020 2024-09-11T00:27:00.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.668+0000 7fda3188c640 1 --2- 172.21.15.78:0/1994876032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda2c1076a0 0x7fda2c1997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:27:00.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.669+0000 7fda3288e640 1 --2- 172.21.15.78:0/1994876032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda2c108020 0x7fda2c19eb60 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fda2400b970 tx=0x7fda2400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:00.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.669+0000 7fda1f7fe640 1 -- 172.21.15.78:0/1994876032 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda24019070 con 0x7fda2c108020 2024-09-11T00:27:00.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.669+0000 7fda342f1640 1 -- 172.21.15.78:0/1994876032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda2c19f620 con 0x7fda2c108020 2024-09-11T00:27:00.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.669+0000 7fda1f7fe640 1 -- 172.21.15.78:0/1994876032 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda24014440 con 0x7fda2c108020 2024-09-11T00:27:00.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.669+0000 7fda1f7fe640 1 -- 172.21.15.78:0/1994876032 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda240075d0 con 0x7fda2c108020 2024-09-11T00:27:00.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.669+0000 7fda342f1640 1 -- 172.21.15.78:0/1994876032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda2c1a5d60 con 0x7fda2c108020 2024-09-11T00:27:00.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.670+0000 7fda342f1640 1 -- 172.21.15.78:0/1994876032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda2c102070 con 0x7fda2c108020 2024-09-11T00:27:00.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.671+0000 7fda1f7fe640 1 -- 172.21.15.78:0/1994876032 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fda2400cb40 con 0x7fda2c108020 2024-09-11T00:27:00.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.672+0000 7fda1f7fe640 1 --2- 172.21.15.78:0/1994876032 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fda180b5450 0x7fda180b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:00.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.672+0000 7fda3208d640 1 --2- 172.21.15.78:0/1994876032 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fda180b5450 0x7fda180b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:00.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.672+0000 7fda1f7fe640 1 -- 172.21.15.78:0/1994876032 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8536+0+0 (secure 0 0 0) 0x7fda240e5d20 con 0x7fda2c108020 2024-09-11T00:27:00.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.672+0000 7fda3208d640 1 --2- 172.21.15.78:0/1994876032 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fda180b5450 0x7fda180b7910 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fda28006010 tx=0x7fda28000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:00.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.675+0000 7fda1f7fe640 1 -- 172.21.15.78:0/1994876032 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fda240ac890 con 0x7fda2c108020 2024-09-11T00:27:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.906+0000 7fda342f1640 1 -- 172.21.15.78:0/1994876032 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fda2c10a880 con 0x7fda2c108020 2024-09-11T00:27:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.908+0000 7fda1f7fe640 1 -- 172.21.15.78:0/1994876032 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) ==== 161+0+0 (secure 0 0 0) 0x7fda240ac190 con 0x7fda2c108020 2024-09-11T00:27:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T00:27:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.911+0000 7fda342f1640 1 -- 172.21.15.78:0/1994876032 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fda180b5450 msgr2=0x7fda180b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:00.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.911+0000 7fda342f1640 1 --2- 172.21.15.78:0/1994876032 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fda180b5450 0x7fda180b7910 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fda28006010 tx=0x7fda28000bc0 comp rx=0 tx=0).stop 2024-09-11T00:27:00.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.911+0000 7fda342f1640 1 -- 172.21.15.78:0/1994876032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda2c108020 msgr2=0x7fda2c19eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:00.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.911+0000 7fda342f1640 1 --2- 172.21.15.78:0/1994876032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda2c108020 0x7fda2c19eb60 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fda2400b970 tx=0x7fda2400be30 comp rx=0 tx=0).stop 2024-09-11T00:27:00.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.911+0000 7fda342f1640 1 -- 172.21.15.78:0/1994876032 shutdown_connections 2024-09-11T00:27:00.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.911+0000 7fda342f1640 1 --2- 172.21.15.78:0/1994876032 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fda180b5450 0x7fda180b7910 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:00.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.911+0000 7fda342f1640 1 --2- 172.21.15.78:0/1994876032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda2c108020 0x7fda2c19eb60 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:00.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.911+0000 7fda342f1640 1 --2- 172.21.15.78:0/1994876032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fda2c1076a0 0x7fda2c1997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:00.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.911+0000 7fda342f1640 1 --2- 172.21.15.78:0/1994876032 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda2c101c90 0x7fda2c199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:00.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.911+0000 7fda342f1640 1 -- 172.21.15.78:0/1994876032 >> 172.21.15.78:0/1994876032 conn(0x7fda2c0fd700 msgr2=0x7fda2c06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:00.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.911+0000 7fda342f1640 1 -- 172.21.15.78:0/1994876032 shutdown_connections 2024-09-11T00:27:00.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:00.911+0000 7fda342f1640 1 -- 172.21.15.78:0/1994876032 wait complete. 2024-09-11T00:27:01.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:00 smithi112 ceph-mon[35627]: pgmap v647: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T00:27:01.232 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 11 00:27:00 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-b[67230]: ignoring --setuser ceph since I am not root 2024-09-11T00:27:01.233 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 11 00:27:00 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-b[67230]: ignoring --setgroup ceph since I am not root 2024-09-11T00:27:01.233 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 11 00:27:00 smithi112 ceph-mds[67234]: -- 172.21.15.112:0/2597773437 <== mon.2 v2:172.21.15.112:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5640ef8c5860 con 0x5640ef8a2800 2024-09-11T00:27:01.233 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 11 00:27:00 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-b[67230]: starting mds.b at 2024-09-11T00:27:01.284 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:00 smithi078 ceph-mon[30865]: pgmap v647: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T00:27:01.284 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:00 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-a[30861]: 2024-09-11T00:27:00.906+0000 7fae4968e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:27:01.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:00 smithi138 ceph-mon[35019]: pgmap v647: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 2 op/s 2024-09-11T00:27:01.293 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:27:00 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-i[66236]: ignoring --setuser ceph since I am not root 2024-09-11T00:27:01.293 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:27:00 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-i[66236]: ignoring --setgroup ceph since I am not root 2024-09-11T00:27:01.293 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:27:00 smithi138 ceph-mds[66240]: -- 172.21.15.138:0/2228910088 <== mon.1 v2:172.21.15.138:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5573f2083c20 con 0x5573f2061000 2024-09-11T00:27:01.293 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:27:00 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-i[66236]: starting mds.i at 2024-09-11T00:27:01.612 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T00:27:01.857 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:27:02.125 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:01 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1994876032' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-11T00:27:02.126 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:01 smithi078 ceph-mon[30865]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T00:27:02.126 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:01 smithi078 ceph-mon[30865]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:27:02.126 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:01 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/1994876032' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T00:27:02.126 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:01 smithi078 ceph-mon[30865]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T00:27:02.126 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:01 smithi078 ceph-mon[30865]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-11T00:27:02.126 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:01 smithi078 ceph-mon[30865]: pgmap v649: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-11T00:27:02.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:01 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1994876032' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-11T00:27:02.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:01 smithi112 ceph-mon[35627]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T00:27:02.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:01 smithi112 ceph-mon[35627]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:27:02.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:01 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/1994876032' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T00:27:02.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:01 smithi112 ceph-mon[35627]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T00:27:02.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:01 smithi112 ceph-mon[35627]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-11T00:27:02.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:01 smithi112 ceph-mon[35627]: pgmap v649: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-11T00:27:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:01 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1994876032' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-11T00:27:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:01 smithi138 ceph-mon[35019]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T00:27:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:01 smithi138 ceph-mon[35019]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T00:27:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:01 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/1994876032' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T00:27:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:01 smithi138 ceph-mon[35019]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T00:27:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:01 smithi138 ceph-mon[35019]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-11T00:27:02.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:01 smithi138 ceph-mon[35019]: pgmap v649: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-09-11T00:27:02.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.343+0000 7fa8ee102640 1 -- 172.21.15.78:0/2196970466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8e8101cd0 msgr2=0x7fa8e81020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:02.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.343+0000 7fa8ee102640 1 --2- 172.21.15.78:0/2196970466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8e8101cd0 0x7fa8e81020b0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009900 tx=0x7fa8d802a410 comp rx=0 tx=0).stop 2024-09-11T00:27:02.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.343+0000 7fa8ee102640 1 -- 172.21.15.78:0/2196970466 shutdown_connections 2024-09-11T00:27:02.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.343+0000 7fa8ee102640 1 --2- 172.21.15.78:0/2196970466 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8e8108060 0x7fa8e810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:02.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.343+0000 7fa8ee102640 1 --2- 172.21.15.78:0/2196970466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8e81076e0 0x7fa8e8107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:02.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.343+0000 7fa8ee102640 1 --2- 172.21.15.78:0/2196970466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8e8101cd0 0x7fa8e81020b0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:02.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.343+0000 7fa8ee102640 1 -- 172.21.15.78:0/2196970466 >> 172.21.15.78:0/2196970466 conn(0x7fa8e80fd700 msgr2=0x7fa8e80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:02.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.343+0000 7fa8ee102640 1 -- 172.21.15.78:0/2196970466 shutdown_connections 2024-09-11T00:27:02.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.343+0000 7fa8ee102640 1 -- 172.21.15.78:0/2196970466 wait complete. 2024-09-11T00:27:02.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.343+0000 7fa8ee102640 1 Processor -- start 2024-09-11T00:27:02.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.343+0000 7fa8ee102640 1 -- start start 2024-09-11T00:27:02.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.343+0000 7fa8ee102640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8e8101cd0 0x7fa8e8199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:02.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.343+0000 7fa8ee102640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8e81076e0 0x7fa8e8199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:02.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.343+0000 7fa8ee102640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8e8108060 0x7fa8e819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:02.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.343+0000 7fa8ee102640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e8111d20 con 0x7fa8e8101cd0 2024-09-11T00:27:02.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.343+0000 7fa8ee102640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e8111ba0 con 0x7fa8e81076e0 2024-09-11T00:27:02.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.343+0000 7fa8ee102640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e8111ea0 con 0x7fa8e8108060 2024-09-11T00:27:02.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.344+0000 7fa8e77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8e8101cd0 0x7fa8e8199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:02.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.344+0000 7fa8e77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8e8101cd0 0x7fa8e8199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47114/0 (socket says 172.21.15.78:47114) 2024-09-11T00:27:02.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.344+0000 7fa8e77fe640 1 -- 172.21.15.78:0/507724804 learned_addr learned my addr 172.21.15.78:0/507724804 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:27:02.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.344+0000 7fa8dffff640 1 --2- 172.21.15.78:0/507724804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8e81076e0 0x7fa8e8199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.344+0000 7fa8e7fff640 1 --2- 172.21.15.78:0/507724804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8e8108060 0x7fa8e819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.344+0000 7fa8e77fe640 1 -- 172.21.15.78:0/507724804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8e8108060 msgr2=0x7fa8e819ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.344+0000 7fa8e77fe640 1 --2- 172.21.15.78:0/507724804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8e8108060 0x7fa8e819ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.344+0000 7fa8e77fe640 1 -- 172.21.15.78:0/507724804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8e81076e0 msgr2=0x7fa8e8199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.344+0000 7fa8e77fe640 1 --2- 172.21.15.78:0/507724804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8e81076e0 0x7fa8e8199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.344+0000 7fa8e77fe640 1 -- 172.21.15.78:0/507724804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e819f3b0 con 0x7fa8e8101cd0 2024-09-11T00:27:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.344+0000 7fa8e77fe640 1 --2- 172.21.15.78:0/507724804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8e8101cd0 0x7fa8e8199300 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8005940 tx=0x7fa8d80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.344+0000 7fa8e57fa640 1 -- 172.21.15.78:0/507724804 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d803f030 con 0x7fa8e8101cd0 2024-09-11T00:27:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.344+0000 7fa8e57fa640 1 -- 172.21.15.78:0/507724804 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8d8003cb0 con 0x7fa8e8101cd0 2024-09-11T00:27:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.344+0000 7fa8ee102640 1 -- 172.21.15.78:0/507724804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e819f640 con 0x7fa8e8101cd0 2024-09-11T00:27:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.344+0000 7fa8e57fa640 1 -- 172.21.15.78:0/507724804 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8035070 con 0x7fa8e8101cd0 2024-09-11T00:27:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.344+0000 7fa8ee102640 1 -- 172.21.15.78:0/507724804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8e81a5d60 con 0x7fa8e8101cd0 2024-09-11T00:27:02.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.345+0000 7fa8ee102640 1 -- 172.21.15.78:0/507724804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8e81020b0 con 0x7fa8e8101cd0 2024-09-11T00:27:02.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.347+0000 7fa8e57fa640 1 -- 172.21.15.78:0/507724804 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7fa8d8003800 con 0x7fa8e8101cd0 2024-09-11T00:27:02.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.347+0000 7fa8e57fa640 1 --2- 172.21.15.78:0/507724804 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa8d40b5450 0x7fa8d40b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:02.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.348+0000 7fa8dffff640 1 --2- 172.21.15.78:0/507724804 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa8d40b5450 0x7fa8d40b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:02.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.348+0000 7fa8e57fa640 1 -- 172.21.15.78:0/507724804 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8578+0+0 (secure 0 0 0) 0x7fa8d8106e70 con 0x7fa8e8101cd0 2024-09-11T00:27:02.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.348+0000 7fa8dffff640 1 --2- 172.21.15.78:0/507724804 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa8d40b5450 0x7fa8d40b7910 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8101240 tx=0x7fa8d0009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:02.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.350+0000 7fa8e57fa640 1 -- 172.21.15.78:0/507724804 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa8d80cd9b0 con 0x7fa8e8101cd0 2024-09-11T00:27:02.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.560+0000 7fa8ee102640 1 -- 172.21.15.78:0/507724804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa8e81a6050 con 0x7fa8e8101cd0 2024-09-11T00:27:02.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.919+0000 7fa8e57fa640 1 -- 172.21.15.78:0/507724804 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7fa8d80d6160 con 0x7fa8e8101cd0 2024-09-11T00:27:02.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.921+0000 7fa8ee102640 1 -- 172.21.15.78:0/507724804 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa8d40b5450 msgr2=0x7fa8d40b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:02.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.921+0000 7fa8ee102640 1 --2- 172.21.15.78:0/507724804 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa8d40b5450 0x7fa8d40b7910 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8101240 tx=0x7fa8d0009110 comp rx=0 tx=0).stop 2024-09-11T00:27:02.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.921+0000 7fa8ee102640 1 -- 172.21.15.78:0/507724804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8e8101cd0 msgr2=0x7fa8e8199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:02.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.921+0000 7fa8ee102640 1 --2- 172.21.15.78:0/507724804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8e8101cd0 0x7fa8e8199300 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8005940 tx=0x7fa8d80042f0 comp rx=0 tx=0).stop 2024-09-11T00:27:02.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.921+0000 7fa8ee102640 1 -- 172.21.15.78:0/507724804 shutdown_connections 2024-09-11T00:27:02.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.921+0000 7fa8ee102640 1 --2- 172.21.15.78:0/507724804 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7fa8d40b5450 0x7fa8d40b7910 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:02.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.921+0000 7fa8ee102640 1 --2- 172.21.15.78:0/507724804 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8e8108060 0x7fa8e819ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:02.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.921+0000 7fa8ee102640 1 --2- 172.21.15.78:0/507724804 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa8e81076e0 0x7fa8e8199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:02.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.921+0000 7fa8ee102640 1 --2- 172.21.15.78:0/507724804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8e8101cd0 0x7fa8e8199300 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:02.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.921+0000 7fa8ee102640 1 -- 172.21.15.78:0/507724804 >> 172.21.15.78:0/507724804 conn(0x7fa8e80fd700 msgr2=0x7fa8e806b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:02.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.921+0000 7fa8ee102640 1 -- 172.21.15.78:0/507724804 shutdown_connections 2024-09-11T00:27:02.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:02.921+0000 7fa8ee102640 1 -- 172.21.15.78:0/507724804 wait complete. 2024-09-11T00:27:03.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:02 smithi112 ceph-mon[35627]: mds.? [v2:172.21.15.138:6838/1354947608,v1:172.21.15.138:6839/1354947608] up:boot 2024-09-11T00:27:03.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:02 smithi112 ceph-mon[35627]: mds.? [v2:172.21.15.112:6838/1261148191,v1:172.21.15.112:6839/1261148191] up:boot 2024-09-11T00:27:03.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:02 smithi112 ceph-mon[35627]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-11T00:27:03.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:02 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-11T00:27:03.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:02 smithi112 ceph-mon[35627]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-11T00:27:03.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:02 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/507724804' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-11T00:27:03.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:02 smithi138 ceph-mon[35019]: mds.? [v2:172.21.15.138:6838/1354947608,v1:172.21.15.138:6839/1354947608] up:boot 2024-09-11T00:27:03.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:02 smithi138 ceph-mon[35019]: mds.? [v2:172.21.15.112:6838/1261148191,v1:172.21.15.112:6839/1261148191] up:boot 2024-09-11T00:27:03.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:02 smithi138 ceph-mon[35019]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-11T00:27:03.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:02 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-11T00:27:03.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:02 smithi138 ceph-mon[35019]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-11T00:27:03.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:02 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/507724804' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-11T00:27:03.309 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:02 smithi078 ceph-mon[30865]: mds.? [v2:172.21.15.138:6838/1354947608,v1:172.21.15.138:6839/1354947608] up:boot 2024-09-11T00:27:03.309 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:02 smithi078 ceph-mon[30865]: mds.? [v2:172.21.15.112:6838/1261148191,v1:172.21.15.112:6839/1261148191] up:boot 2024-09-11T00:27:03.309 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:02 smithi078 ceph-mon[30865]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-11T00:27:03.309 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:02 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-11T00:27:03.309 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:02 smithi078 ceph-mon[30865]: from='mgr.14220 172.21.15.78:0/1930267020' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-11T00:27:03.309 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:02 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/507724804' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-11T00:27:03.639 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T00:27:03.885 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:27:04.182 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:03 smithi078 ceph-mon[30865]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T00:27:04.182 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:03 smithi078 ceph-mon[30865]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T00:27:04.182 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:03 smithi078 ceph-mon[30865]: Cluster is now healthy 2024-09-11T00:27:04.182 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:03 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/507724804' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T00:27:04.183 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:03 smithi078 ceph-mon[30865]: fsmap 12 up:standby 2024-09-11T00:27:04.183 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:03 smithi078 ceph-mon[30865]: pgmap v650: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 40 KiB/s wr, 20 op/s 2024-09-11T00:27:04.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:03 smithi112 ceph-mon[35627]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T00:27:04.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:03 smithi112 ceph-mon[35627]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T00:27:04.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:03 smithi112 ceph-mon[35627]: Cluster is now healthy 2024-09-11T00:27:04.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:03 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/507724804' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T00:27:04.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:03 smithi112 ceph-mon[35627]: fsmap 12 up:standby 2024-09-11T00:27:04.233 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:03 smithi112 ceph-mon[35627]: pgmap v650: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 40 KiB/s wr, 20 op/s 2024-09-11T00:27:04.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:03 smithi138 ceph-mon[35019]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T00:27:04.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:03 smithi138 ceph-mon[35019]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T00:27:04.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:03 smithi138 ceph-mon[35019]: Cluster is now healthy 2024-09-11T00:27:04.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:03 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/507724804' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T00:27:04.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:03 smithi138 ceph-mon[35019]: fsmap 12 up:standby 2024-09-11T00:27:04.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:03 smithi138 ceph-mon[35019]: pgmap v650: 97 pgs: 97 active+clean; 190 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 40 KiB/s wr, 20 op/s 2024-09-11T00:27:04.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.395+0000 7f1c5b27a640 1 -- 172.21.15.78:0/2669681204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c54101c90 msgr2=0x7f1c54102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:04.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.395+0000 7f1c5b27a640 1 --2- 172.21.15.78:0/2669681204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c54101c90 0x7f1c54102070 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1c50009900 tx=0x7f1c5002a410 comp rx=0 tx=0).stop 2024-09-11T00:27:04.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.395+0000 7f1c5b27a640 1 -- 172.21.15.78:0/2669681204 shutdown_connections 2024-09-11T00:27:04.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.395+0000 7f1c5b27a640 1 --2- 172.21.15.78:0/2669681204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c54108020 0x7f1c5410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:04.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.395+0000 7f1c5b27a640 1 --2- 172.21.15.78:0/2669681204 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c541076a0 0x7f1c54107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:04.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.395+0000 7f1c5b27a640 1 --2- 172.21.15.78:0/2669681204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c54101c90 0x7f1c54102070 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:04.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.395+0000 7f1c5b27a640 1 -- 172.21.15.78:0/2669681204 >> 172.21.15.78:0/2669681204 conn(0x7f1c540fd700 msgr2=0x7f1c540ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:04.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.395+0000 7f1c5b27a640 1 -- 172.21.15.78:0/2669681204 shutdown_connections 2024-09-11T00:27:04.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.395+0000 7f1c5b27a640 1 -- 172.21.15.78:0/2669681204 wait complete. 2024-09-11T00:27:04.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.395+0000 7f1c5b27a640 1 Processor -- start 2024-09-11T00:27:04.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.395+0000 7f1c5b27a640 1 -- start start 2024-09-11T00:27:04.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.396+0000 7f1c5b27a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c54101c90 0x7f1c540fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:04.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.396+0000 7f1c5b27a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c541076a0 0x7f1c540fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:04.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.396+0000 7f1c5b27a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c54108020 0x7f1c540fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:04.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.396+0000 7f1c5b27a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1c54111d20 con 0x7f1c54108020 2024-09-11T00:27:04.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.396+0000 7f1c5b27a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1c54111ba0 con 0x7f1c541076a0 2024-09-11T00:27:04.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.396+0000 7f1c5b27a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1c54111ea0 con 0x7f1c54101c90 2024-09-11T00:27:04.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.396+0000 7f1c59817640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c54108020 0x7f1c540fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:04.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.396+0000 7f1c59817640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c54108020 0x7f1c540fe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47124/0 (socket says 172.21.15.78:47124) 2024-09-11T00:27:04.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.396+0000 7f1c59817640 1 -- 172.21.15.78:0/2184435355 learned_addr learned my addr 172.21.15.78:0/2184435355 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:27:04.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.396+0000 7f1c59016640 1 --2- 172.21.15.78:0/2184435355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c54101c90 0x7f1c540fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:04.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.396+0000 7f1c58815640 1 --2- 172.21.15.78:0/2184435355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c541076a0 0x7f1c540fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:04.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.396+0000 7f1c59817640 1 -- 172.21.15.78:0/2184435355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c54101c90 msgr2=0x7f1c540fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:04.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.396+0000 7f1c59817640 1 --2- 172.21.15.78:0/2184435355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c54101c90 0x7f1c540fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:04.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.396+0000 7f1c59817640 1 -- 172.21.15.78:0/2184435355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c541076a0 msgr2=0x7f1c540fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:04.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.396+0000 7f1c59817640 1 --2- 172.21.15.78:0/2184435355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c541076a0 0x7f1c540fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:04.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.396+0000 7f1c59817640 1 -- 172.21.15.78:0/2184435355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c541a77f0 con 0x7f1c54108020 2024-09-11T00:27:04.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.396+0000 7f1c59817640 1 --2- 172.21.15.78:0/2184435355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c54108020 0x7f1c540fe680 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00b970 tx=0x7f1c4c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:04.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.396+0000 7f1c467fc640 1 -- 172.21.15.78:0/2184435355 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c019070 con 0x7f1c54108020 2024-09-11T00:27:04.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.396+0000 7f1c5b27a640 1 -- 172.21.15.78:0/2184435355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c541a7ae0 con 0x7f1c54108020 2024-09-11T00:27:04.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.396+0000 7f1c467fc640 1 -- 172.21.15.78:0/2184435355 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c4c014440 con 0x7f1c54108020 2024-09-11T00:27:04.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.396+0000 7f1c467fc640 1 -- 172.21.15.78:0/2184435355 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c0075d0 con 0x7f1c54108020 2024-09-11T00:27:04.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.396+0000 7f1c5b27a640 1 -- 172.21.15.78:0/2184435355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c541a7fd0 con 0x7f1c54108020 2024-09-11T00:27:04.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.398+0000 7f1c5b27a640 1 -- 172.21.15.78:0/2184435355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c541020f0 con 0x7f1c54108020 2024-09-11T00:27:04.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.399+0000 7f1c467fc640 1 -- 172.21.15.78:0/2184435355 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f1c4c00cb40 con 0x7f1c54108020 2024-09-11T00:27:04.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.400+0000 7f1c467fc640 1 --2- 172.21.15.78:0/2184435355 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1c400b5450 0x7f1c400b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:04.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.400+0000 7f1c59016640 1 --2- 172.21.15.78:0/2184435355 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1c400b5450 0x7f1c400b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:04.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.400+0000 7f1c467fc640 1 -- 172.21.15.78:0/2184435355 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8578+0+0 (secure 0 0 0) 0x7f1c4c0e5d40 con 0x7f1c54108020 2024-09-11T00:27:04.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.400+0000 7f1c59016640 1 --2- 172.21.15.78:0/2184435355 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1c400b5450 0x7f1c400b7910 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1c50031440 tx=0x7f1c500095f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:04.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.403+0000 7f1c467fc640 1 -- 172.21.15.78:0/2184435355 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1c4c0ac880 con 0x7f1c54108020 2024-09-11T00:27:04.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.579+0000 7f1c5b27a640 1 -- 172.21.15.78:0/2184435355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1c5402e5c0 con 0x7f1c54108020 2024-09-11T00:27:04.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.928+0000 7f1c467fc640 1 -- 172.21.15.78:0/2184435355 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v89) ==== 181+0+0 (secure 0 0 0) 0x7f1c4c0ac180 con 0x7f1c54108020 2024-09-11T00:27:04.930 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2024-09-11T00:27:04.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.932+0000 7f1c5b27a640 1 -- 172.21.15.78:0/2184435355 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1c400b5450 msgr2=0x7f1c400b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:04.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.932+0000 7f1c5b27a640 1 --2- 172.21.15.78:0/2184435355 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1c400b5450 0x7f1c400b7910 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1c50031440 tx=0x7f1c500095f0 comp rx=0 tx=0).stop 2024-09-11T00:27:04.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.932+0000 7f1c5b27a640 1 -- 172.21.15.78:0/2184435355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c54108020 msgr2=0x7f1c540fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:04.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.932+0000 7f1c5b27a640 1 --2- 172.21.15.78:0/2184435355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c54108020 0x7f1c540fe680 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00b970 tx=0x7f1c4c00be30 comp rx=0 tx=0).stop 2024-09-11T00:27:04.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.932+0000 7f1c5b27a640 1 -- 172.21.15.78:0/2184435355 shutdown_connections 2024-09-11T00:27:04.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.932+0000 7f1c5b27a640 1 --2- 172.21.15.78:0/2184435355 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f1c400b5450 0x7f1c400b7910 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:04.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.932+0000 7f1c5b27a640 1 --2- 172.21.15.78:0/2184435355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c54108020 0x7f1c540fe680 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:04.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.932+0000 7f1c5b27a640 1 --2- 172.21.15.78:0/2184435355 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1c541076a0 0x7f1c540fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:04.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.932+0000 7f1c5b27a640 1 --2- 172.21.15.78:0/2184435355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c54101c90 0x7f1c540fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:04.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.932+0000 7f1c5b27a640 1 -- 172.21.15.78:0/2184435355 >> 172.21.15.78:0/2184435355 conn(0x7f1c540fd700 msgr2=0x7f1c5406ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:04.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.933+0000 7f1c5b27a640 1 -- 172.21.15.78:0/2184435355 shutdown_connections 2024-09-11T00:27:04.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:04.933+0000 7f1c5b27a640 1 -- 172.21.15.78:0/2184435355 wait complete. 2024-09-11T00:27:05.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:04 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2184435355' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T00:27:05.276 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:04 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2184435355' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T00:27:05.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:04 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2184435355' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T00:27:05.605 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T00:27:05.857 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:27:06.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:05 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/2184435355' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:27:06.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:05 smithi112 ceph-mon[35627]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T00:27:06.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:05 smithi112 ceph-mon[35627]: pgmap v652: 65 pgs: 65 active+clean; 577 KiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:27:06.288 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:05 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/2184435355' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:27:06.288 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:05 smithi078 ceph-mon[30865]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T00:27:06.288 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:05 smithi078 ceph-mon[30865]: pgmap v652: 65 pgs: 65 active+clean; 577 KiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:27:06.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:05 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/2184435355' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:27:06.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:05 smithi138 ceph-mon[35019]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T00:27:06.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:05 smithi138 ceph-mon[35019]: pgmap v652: 65 pgs: 65 active+clean; 577 KiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:27:06.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.370+0000 7f17350e8640 1 -- 172.21.15.78:0/3146589059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1730103ca0 msgr2=0x7f1730104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:06.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.370+0000 7f17350e8640 1 --2- 172.21.15.78:0/3146589059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1730103ca0 0x7f1730104080 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1720009ca0 tx=0x7f172002a8c0 comp rx=0 tx=0).stop 2024-09-11T00:27:06.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.370+0000 7f17350e8640 1 -- 172.21.15.78:0/3146589059 shutdown_connections 2024-09-11T00:27:06.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.370+0000 7f17350e8640 1 --2- 172.21.15.78:0/3146589059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f173010d100 0x7f173010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:06.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.370+0000 7f17350e8640 1 --2- 172.21.15.78:0/3146589059 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17301045c0 0x7f173010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:06.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.370+0000 7f17350e8640 1 --2- 172.21.15.78:0/3146589059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1730103ca0 0x7f1730104080 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:06.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.370+0000 7f17350e8640 1 -- 172.21.15.78:0/3146589059 >> 172.21.15.78:0/3146589059 conn(0x7f17300fd700 msgr2=0x7f17300ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:06.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.370+0000 7f17350e8640 1 -- 172.21.15.78:0/3146589059 shutdown_connections 2024-09-11T00:27:06.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.370+0000 7f17350e8640 1 -- 172.21.15.78:0/3146589059 wait complete. 2024-09-11T00:27:06.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.371+0000 7f17350e8640 1 Processor -- start 2024-09-11T00:27:06.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.371+0000 7f17350e8640 1 -- start start 2024-09-11T00:27:06.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.371+0000 7f17350e8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1730103ca0 0x7f17301992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:06.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.371+0000 7f17350e8640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17301045c0 0x7f1730199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:06.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.371+0000 7f17350e8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f173010d100 0x7f173019ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:06.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.371+0000 7f17350e8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1730112db0 con 0x7f173010d100 2024-09-11T00:27:06.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.371+0000 7f17350e8640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1730112c30 con 0x7f17301045c0 2024-09-11T00:27:06.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.371+0000 7f17350e8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1730112f30 con 0x7f1730103ca0 2024-09-11T00:27:06.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.371+0000 7f172f59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f173010d100 0x7f173019ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:06.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.371+0000 7f172f59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f173010d100 0x7f173019ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56940/0 (socket says 172.21.15.78:56940) 2024-09-11T00:27:06.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.371+0000 7f172f59e640 1 -- 172.21.15.78:0/3165918000 learned_addr learned my addr 172.21.15.78:0/3165918000 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-11T00:27:06.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.371+0000 7f172ed9d640 1 --2- 172.21.15.78:0/3165918000 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1730103ca0 0x7f17301992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:06.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.371+0000 7f172e59c640 1 --2- 172.21.15.78:0/3165918000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17301045c0 0x7f1730199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:06.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.372+0000 7f172f59e640 1 -- 172.21.15.78:0/3165918000 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1730103ca0 msgr2=0x7f17301992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:06.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.372+0000 7f172f59e640 1 --2- 172.21.15.78:0/3165918000 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1730103ca0 0x7f17301992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:06.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.372+0000 7f172f59e640 1 -- 172.21.15.78:0/3165918000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17301045c0 msgr2=0x7f1730199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:06.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.372+0000 7f172f59e640 1 --2- 172.21.15.78:0/3165918000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17301045c0 0x7f1730199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:06.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.372+0000 7f172f59e640 1 -- 172.21.15.78:0/3165918000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f173019f390 con 0x7f173010d100 2024-09-11T00:27:06.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.372+0000 7f172e59c640 1 --2- 172.21.15.78:0/3165918000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17301045c0 0x7f1730199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:27:06.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.372+0000 7f172f59e640 1 --2- 172.21.15.78:0/3165918000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f173010d100 0x7f173019ebc0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f1728009fd0 tx=0x7f172800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:06.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.372+0000 7f1727fff640 1 -- 172.21.15.78:0/3165918000 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1728011830 con 0x7f173010d100 2024-09-11T00:27:06.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.372+0000 7f1727fff640 1 -- 172.21.15.78:0/3165918000 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1728016070 con 0x7f173010d100 2024-09-11T00:27:06.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.372+0000 7f17350e8640 1 -- 172.21.15.78:0/3165918000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f173019f680 con 0x7f173010d100 2024-09-11T00:27:06.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.372+0000 7f1727fff640 1 -- 172.21.15.78:0/3165918000 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1728010de0 con 0x7f173010d100 2024-09-11T00:27:06.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.372+0000 7f17350e8640 1 -- 172.21.15.78:0/3165918000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17301a5dc0 con 0x7f173010d100 2024-09-11T00:27:06.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.373+0000 7f17350e8640 1 -- 172.21.15.78:0/3165918000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1730104080 con 0x7f173010d100 2024-09-11T00:27:06.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.374+0000 7f1727fff640 1 -- 172.21.15.78:0/3165918000 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 24) ==== 153381+0+0 (secure 0 0 0) 0x7f17280119d0 con 0x7f173010d100 2024-09-11T00:27:06.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.375+0000 7f1727fff640 1 --2- 172.21.15.78:0/3165918000 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f171c0b5450 0x7f171c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:27:06.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.375+0000 7f172ed9d640 1 --2- 172.21.15.78:0/3165918000 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f171c0b5450 0x7f171c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:27:06.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.375+0000 7f1727fff640 1 -- 172.21.15.78:0/3165918000 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8053+0+0 (secure 0 0 0) 0x7f17280e59e0 con 0x7f173010d100 2024-09-11T00:27:06.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.375+0000 7f172ed9d640 1 --2- 172.21.15.78:0/3165918000 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f171c0b5450 0x7f171c0b7910 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f17200098d0 tx=0x7f1720009900 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:27:06.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.378+0000 7f1727fff640 1 -- 172.21.15.78:0/3165918000 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f17280ac780 con 0x7f173010d100 2024-09-11T00:27:06.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.555+0000 7f17350e8640 1 -- 172.21.15.78:0/3165918000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f17301a60e0 con 0x7f173010d100 2024-09-11T00:27:06.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.940+0000 7f1727fff640 1 -- 172.21.15.78:0/3165918000 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v90) ==== 169+0+0 (secure 0 0 0) 0x7f17280ac080 con 0x7f173010d100 2024-09-11T00:27:06.943 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2024-09-11T00:27:06.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.943+0000 7f17350e8640 1 -- 172.21.15.78:0/3165918000 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f171c0b5450 msgr2=0x7f171c0b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:06.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.943+0000 7f17350e8640 1 --2- 172.21.15.78:0/3165918000 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f171c0b5450 0x7f171c0b7910 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f17200098d0 tx=0x7f1720009900 comp rx=0 tx=0).stop 2024-09-11T00:27:06.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.944+0000 7f17350e8640 1 -- 172.21.15.78:0/3165918000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f173010d100 msgr2=0x7f173019ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:27:06.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.944+0000 7f17350e8640 1 --2- 172.21.15.78:0/3165918000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f173010d100 0x7f173019ebc0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f1728009fd0 tx=0x7f172800b8e0 comp rx=0 tx=0).stop 2024-09-11T00:27:06.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.944+0000 7f17350e8640 1 -- 172.21.15.78:0/3165918000 shutdown_connections 2024-09-11T00:27:06.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.944+0000 7f17350e8640 1 --2- 172.21.15.78:0/3165918000 >> [v2:172.21.15.78:6800/3195506449,v1:172.21.15.78:6801/3195506449] conn(0x7f171c0b5450 0x7f171c0b7910 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:06.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.944+0000 7f17350e8640 1 --2- 172.21.15.78:0/3165918000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f173010d100 0x7f173019ebc0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:06.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.944+0000 7f17350e8640 1 --2- 172.21.15.78:0/3165918000 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f17301045c0 0x7f1730199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:06.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.944+0000 7f17350e8640 1 --2- 172.21.15.78:0/3165918000 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1730103ca0 0x7f17301992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:27:06.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.944+0000 7f17350e8640 1 -- 172.21.15.78:0/3165918000 >> 172.21.15.78:0/3165918000 conn(0x7f17300fd700 msgr2=0x7f173010f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:27:06.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.945+0000 7f17350e8640 1 -- 172.21.15.78:0/3165918000 shutdown_connections 2024-09-11T00:27:06.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-11T00:27:06.945+0000 7f17350e8640 1 -- 172.21.15.78:0/3165918000 wait complete. 2024-09-11T00:27:07.232 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:06 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3165918000' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T00:27:07.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:06 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3165918000' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T00:27:07.316 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:06 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3165918000' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T00:27:07.628 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:27:07.693 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:27:07.728 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:27:07.760 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-11T00:27:07.761 DEBUG:teuthology.orchestra.run.smithi078:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T00:27:07.777 DEBUG:teuthology.orchestra.run.smithi112:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T00:27:07.796 DEBUG:teuthology.orchestra.run.smithi138:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T00:27:07.818 INFO:tasks.cephadm:Stopping all daemons... 2024-09-11T00:27:07.818 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-11T00:27:07.818 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mon.a 2024-09-11T00:27:07.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:07 smithi112 ceph-mon[35627]: from='client.? 172.21.15.78:0/3165918000' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:27:07.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:07 smithi112 ceph-mon[35627]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T00:27:07.982 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:07 smithi112 ceph-mon[35627]: pgmap v654: 1 pgs: 1 active+clean; 577 KiB data, 972 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:27:08.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:07 smithi138 ceph-mon[35019]: from='client.? 172.21.15.78:0/3165918000' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:27:08.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:07 smithi138 ceph-mon[35019]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T00:27:08.043 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:07 smithi138 ceph-mon[35019]: pgmap v654: 1 pgs: 1 active+clean; 577 KiB data, 972 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:27:08.149 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:07 smithi078 systemd[1]: Stopping Ceph mon.a for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:27:08.149 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:07 smithi078 ceph-mon[30865]: from='client.? 172.21.15.78:0/3165918000' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T00:27:08.149 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:07 smithi078 ceph-mon[30865]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T00:27:08.149 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:07 smithi078 ceph-mon[30865]: pgmap v654: 1 pgs: 1 active+clean; 577 KiB data, 972 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T00:27:08.547 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:08 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-a[30861]: 2024-09-11T00:27:08.144+0000 7fae4ee99640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:27:08.548 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:08 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-a[30861]: 2024-09-11T00:27:08.144+0000 7fae4ee99640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-11T00:27:08.548 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:08 smithi078 podman[103435]: 2024-09-11 00:27:08.206838827 +0000 UTC m=+0.197351671 container died bbe0280c637f15797db422ec026267387eebe74d60a085d3471efc9dea76c0bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731) 2024-09-11T00:27:08.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:08 smithi078 podman[103435]: 2024-09-11 00:27:08.645503595 +0000 UTC m=+0.636016443 container cleanup bbe0280c637f15797db422ec026267387eebe74d60a085d3471efc9dea76c0bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:27:08.834 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:08 smithi078 bash[103435]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-a 2024-09-11T00:27:09.075 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mon.a.service' 2024-09-11T00:27:09.099 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:08 smithi078 podman[103446]: 2024-09-11 00:27:08.846988955 +0000 UTC m=+0.633467760 container remove bbe0280c637f15797db422ec026267387eebe74d60a085d3471efc9dea76c0bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-11T00:27:09.100 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:09 smithi078 systemd[1]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-11T00:27:09.100 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:09 smithi078 systemd[1]: Stopped Ceph mon.a for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:27:09.100 INFO:journalctl@ceph.mon.a.smithi078.stdout:Sep 11 00:27:09 smithi078 systemd[1]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mon.a.service: Consumed 17.417s CPU time. 2024-09-11T00:27:09.128 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:27:09.128 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-11T00:27:09.128 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-11T00:27:09.128 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mon.b 2024-09-11T00:27:09.444 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:09 smithi112 systemd[1]: Stopping Ceph mon.b for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:27:09.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:09 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-b[35623]: 2024-09-11T00:27:09.442+0000 7f3a723f9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:27:09.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:09 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-b[35623]: 2024-09-11T00:27:09.442+0000 7f3a723f9640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-11T00:27:09.732 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:09 smithi112 podman[71308]: 2024-09-11 00:27:09.473319876 +0000 UTC m=+0.156599586 container died d7e4d59fe83afcef44841f3684d61c9085e833c61735568503c81d37c9c62cd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-b, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux ) 2024-09-11T00:27:10.145 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:09 smithi112 podman[71308]: 2024-09-11 00:27:09.859547331 +0000 UTC m=+0.542827038 container cleanup d7e4d59fe83afcef44841f3684d61c9085e833c61735568503c81d37c9c62cd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-11T00:27:10.146 INFO:journalctl@ceph.mon.b.smithi112.stdout:Sep 11 00:27:09 smithi112 bash[71308]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-b 2024-09-11T00:27:10.291 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mon.b.service' 2024-09-11T00:27:10.339 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:27:10.340 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-11T00:27:10.340 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-11T00:27:10.340 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mon.c 2024-09-11T00:27:10.658 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:10 smithi138 systemd[1]: Stopping Ceph mon.c for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:27:10.920 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:10 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-c[35015]: 2024-09-11T00:27:10.655+0000 7f09f5a1f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:27:10.920 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:10 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-c[35015]: 2024-09-11T00:27:10.655+0000 7f09f5a1f640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-11T00:27:11.242 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:10 smithi138 podman[70475]: 2024-09-11 00:27:10.920606031 +0000 UTC m=+0.386868079 container died 6e9b400a21b2dce6d8a4353f90e2ee21227f0fb4aaca1bdd11d8c9b25252f5bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-c, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-11T00:27:11.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:11 smithi138 podman[70475]: 2024-09-11 00:27:11.340118307 +0000 UTC m=+0.806380360 container cleanup 6e9b400a21b2dce6d8a4353f90e2ee21227f0fb4aaca1bdd11d8c9b25252f5bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-c, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-11T00:27:11.543 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 11 00:27:11 smithi138 bash[70475]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mon-c 2024-09-11T00:27:11.767 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mon.c.service' 2024-09-11T00:27:11.812 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:27:11.812 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-11T00:27:11.812 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-11T00:27:11.812 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mgr.x 2024-09-11T00:27:12.135 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:27:11 smithi078 systemd[1]: Stopping Ceph mgr.x for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:27:12.485 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:27:12 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: 2024-09-11T00:27:12.132+0000 7f375fad9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:27:12.486 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:27:12 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x[31093]: 2024-09-11T00:27:12.132+0000 7f375fad9640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-11T00:27:12.486 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:27:12 smithi078 podman[103560]: 2024-09-11 00:27:12.16502954 +0000 UTC m=+0.161623217 container died 01d2b57432f8f15c23568bc32f5bbb36debdb16d49212e5363e970a5e689fae8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:27:12.834 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:27:12 smithi078 podman[103560]: 2024-09-11 00:27:12.69278091 +0000 UTC m=+0.689374567 container cleanup 01d2b57432f8f15c23568bc32f5bbb36debdb16d49212e5363e970a5e689fae8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:27:12.834 INFO:journalctl@ceph.mgr.x.smithi078.stdout:Sep 11 00:27:12 smithi078 bash[103560]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-x 2024-09-11T00:27:13.167 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-11T00:27:13.202 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:27:13.202 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-11T00:27:13.202 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-11T00:27:13.203 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mgr.y 2024-09-11T00:27:13.482 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 11 00:27:13 smithi112 systemd[1]: Stopping Ceph mgr.y for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:27:13.850 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 11 00:27:13 smithi112 podman[71429]: 2024-09-11 00:27:13.543918587 +0000 UTC m=+0.146117456 container died aaa7b99388fe0e7e807f780286fc31db544882bb634cb25bb98777424da40a42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-11T00:27:14.210 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 11 00:27:13 smithi112 podman[71429]: 2024-09-11 00:27:13.965564457 +0000 UTC m=+0.567763323 container cleanup aaa7b99388fe0e7e807f780286fc31db544882bb634cb25bb98777424da40a42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-11T00:27:14.210 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 11 00:27:13 smithi112 bash[71429]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-y 2024-09-11T00:27:14.443 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-11T00:27:14.465 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 11 00:27:14 smithi112 podman[71440]: 2024-09-11 00:27:14.208871819 +0000 UTC m=+0.656082014 container remove aaa7b99388fe0e7e807f780286fc31db544882bb634cb25bb98777424da40a42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-11T00:27:14.465 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 11 00:27:14 smithi112 systemd[1]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-11T00:27:14.465 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 11 00:27:14 smithi112 systemd[1]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-09-11T00:27:14.465 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 11 00:27:14 smithi112 systemd[1]: Stopped Ceph mgr.y for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:27:14.465 INFO:journalctl@ceph.mgr.y.smithi112.stdout:Sep 11 00:27:14 smithi112 systemd[1]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mgr.y.service: Consumed 7.026s CPU time. 2024-09-11T00:27:14.478 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:27:14.478 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-11T00:27:14.478 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-11T00:27:14.478 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mgr.z 2024-09-11T00:27:14.793 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 11 00:27:14 smithi138 systemd[1]: Stopping Ceph mgr.z for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:27:15.139 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 11 00:27:14 smithi138 podman[70607]: 2024-09-11 00:27:14.834239996 +0000 UTC m=+0.152846986 container died b8d535b4a3ee5a74f6de922004fb950666c8a8227a1f4da62a7b64c57e37037c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-11T00:27:15.498 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 11 00:27:15 smithi138 podman[70607]: 2024-09-11 00:27:15.237762207 +0000 UTC m=+0.556369196 container cleanup b8d535b4a3ee5a74f6de922004fb950666c8a8227a1f4da62a7b64c57e37037c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-z, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-11T00:27:15.498 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 11 00:27:15 smithi138 bash[70607]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mgr-z 2024-09-11T00:27:15.627 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-11T00:27:15.662 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:27:15.662 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-11T00:27:15.662 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-11T00:27:15.663 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.0 2024-09-11T00:27:15.974 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:27:15 smithi078 systemd[1]: Stopping Ceph osd.0 for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:27:16.334 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:27:15 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-0[48993]: 2024-09-11T00:27:15.971+0000 7f5b2be01640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:27:16.334 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:27:15 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-0[48993]: 2024-09-11T00:27:15.971+0000 7f5b2be01640 -1 osd.0 90 *** Got signal Terminated *** 2024-09-11T00:27:16.334 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:27:15 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-0[48993]: 2024-09-11T00:27:15.971+0000 7f5b2be01640 -1 osd.0 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:27:21.742 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:27:21 smithi078 podman[103681]: 2024-09-11 00:27:21.433293466 +0000 UTC m=+5.581501220 container died 5859532c7167ac002050ec63de9ffeb6c935abe79523b4c989d35d197b66737d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-11T00:27:22.084 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:27:21 smithi078 podman[103681]: 2024-09-11 00:27:21.922510423 +0000 UTC m=+6.070718210 container cleanup 5859532c7167ac002050ec63de9ffeb6c935abe79523b4c989d35d197b66737d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731) 2024-09-11T00:27:22.084 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:27:21 smithi078 bash[103681]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-0 2024-09-11T00:27:22.538 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:27:22 smithi078 podman[103697]: 2024-09-11 00:27:22.190806894 +0000 UTC m=+0.750753743 container remove 5859532c7167ac002050ec63de9ffeb6c935abe79523b4c989d35d197b66737d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, io.buildah.version=1.37.2) 2024-09-11T00:27:22.834 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:27:22 smithi078 podman[103791]: 2024-09-11 00:27:22.439759715 +0000 UTC m=+0.016063122 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:27:22.834 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:27:22 smithi078 podman[103791]: 2024-09-11 00:27:22.582348913 +0000 UTC m=+0.158652353 container create de45670166ae56f53690c5fafbbeccad76d545c8fc3d137d300487e5cac2d55a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-11T00:27:23.334 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:27:22 smithi078 podman[103791]: 2024-09-11 00:27:22.86104529 +0000 UTC m=+0.437348684 container init de45670166ae56f53690c5fafbbeccad76d545c8fc3d137d300487e5cac2d55a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-11T00:27:23.334 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:27:22 smithi078 podman[103791]: 2024-09-11 00:27:22.864590904 +0000 UTC m=+0.440894316 container start de45670166ae56f53690c5fafbbeccad76d545c8fc3d137d300487e5cac2d55a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-11T00:27:23.335 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:27:22 smithi078 podman[103791]: 2024-09-11 00:27:22.927800924 +0000 UTC m=+0.504104325 container attach de45670166ae56f53690c5fafbbeccad76d545c8fc3d137d300487e5cac2d55a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:27:23.335 INFO:journalctl@ceph.osd.0.smithi078.stdout:Sep 11 00:27:23 smithi078 podman[103791]: 2024-09-11 00:27:23.053434433 +0000 UTC m=+0.629737838 container died de45670166ae56f53690c5fafbbeccad76d545c8fc3d137d300487e5cac2d55a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:27:23.706 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.0.service' 2024-09-11T00:27:23.744 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:27:23.744 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-11T00:27:23.745 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-11T00:27:23.745 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.1 2024-09-11T00:27:24.080 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:27:23 smithi112 systemd[1]: Stopping Ceph osd.1 for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:27:24.482 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:27:24 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-1[41333]: 2024-09-11T00:27:24.078+0000 7f5a7f857640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:27:24.482 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:27:24 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-1[41333]: 2024-09-11T00:27:24.078+0000 7f5a7f857640 -1 osd.1 90 *** Got signal Terminated *** 2024-09-11T00:27:24.483 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:27:24 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-1[41333]: 2024-09-11T00:27:24.078+0000 7f5a7f857640 -1 osd.1 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:27:29.898 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:27:29 smithi112 podman[71556]: 2024-09-11 00:27:29.592582434 +0000 UTC m=+5.653437379 container died e587b8fd3afba722862a37d106143c365de53896270895cd4fb9d4daa3676ced (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:27:30.232 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:27:29 smithi112 podman[71556]: 2024-09-11 00:27:29.996208316 +0000 UTC m=+6.057063333 container cleanup e587b8fd3afba722862a37d106143c365de53896270895cd4fb9d4daa3676ced (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-11T00:27:30.232 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:27:29 smithi112 bash[71556]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-1 2024-09-11T00:27:30.665 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:27:30 smithi112 podman[71571]: 2024-09-11 00:27:30.256081525 +0000 UTC m=+0.666176305 container remove e587b8fd3afba722862a37d106143c365de53896270895cd4fb9d4daa3676ced (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0) 2024-09-11T00:27:30.960 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:27:30 smithi112 podman[71664]: 2024-09-11 00:27:30.566711857 +0000 UTC m=+0.015598187 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:27:30.960 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:27:30 smithi112 podman[71664]: 2024-09-11 00:27:30.690220265 +0000 UTC m=+0.139106584 container create 9ac92e9be044936a6a93ee75341355507038f7e55d04e8034dcd4faec84b7507 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:27:31.232 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:27:30 smithi112 podman[71664]: 2024-09-11 00:27:30.959511283 +0000 UTC m=+0.408397602 container init 9ac92e9be044936a6a93ee75341355507038f7e55d04e8034dcd4faec84b7507 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-09-11T00:27:31.232 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:27:30 smithi112 podman[71664]: 2024-09-11 00:27:30.962988285 +0000 UTC m=+0.411874614 container start 9ac92e9be044936a6a93ee75341355507038f7e55d04e8034dcd4faec84b7507 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-11T00:27:31.233 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:27:31 smithi112 podman[71664]: 2024-09-11 00:27:31.068213677 +0000 UTC m=+0.517100014 container attach 9ac92e9be044936a6a93ee75341355507038f7e55d04e8034dcd4faec84b7507 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:27:31.233 INFO:journalctl@ceph.osd.1.smithi112.stdout:Sep 11 00:27:31 smithi112 podman[71664]: 2024-09-11 00:27:31.160420287 +0000 UTC m=+0.609306615 container died 9ac92e9be044936a6a93ee75341355507038f7e55d04e8034dcd4faec84b7507 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-11T00:27:31.845 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.1.service' 2024-09-11T00:27:31.888 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:27:31.888 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-11T00:27:31.888 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-11T00:27:31.888 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.2 2024-09-11T00:27:32.251 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:27:31 smithi138 systemd[1]: Stopping Ceph osd.2 for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:27:32.543 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:27:32 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-2[41172]: 2024-09-11T00:27:32.249+0000 7efdcba86640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:27:32.543 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:27:32 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-2[41172]: 2024-09-11T00:27:32.249+0000 7efdcba86640 -1 osd.2 90 *** Got signal Terminated *** 2024-09-11T00:27:32.543 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:27:32 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-2[41172]: 2024-09-11T00:27:32.249+0000 7efdcba86640 -1 osd.2 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:27:37.910 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:27:37 smithi138 podman[70739]: 2024-09-11 00:27:37.62110306 +0000 UTC m=+5.541672763 container died 30e043e711bc42790080aa64591fe4bb9efa3fd208f2498fa39033e58aadab86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-11T00:27:38.286 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:27:38 smithi138 podman[70739]: 2024-09-11 00:27:38.008273827 +0000 UTC m=+5.928843575 container cleanup 30e043e711bc42790080aa64591fe4bb9efa3fd208f2498fa39033e58aadab86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:27:38.286 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:27:38 smithi138 bash[70739]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-2 2024-09-11T00:27:38.543 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:27:38 smithi138 podman[70756]: 2024-09-11 00:27:38.285209343 +0000 UTC m=+0.660598828 container remove 30e043e711bc42790080aa64591fe4bb9efa3fd208f2498fa39033e58aadab86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:27:38.906 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:27:38 smithi138 podman[70847]: 2024-09-11 00:27:38.525273113 +0000 UTC m=+0.016387652 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:27:38.906 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:27:38 smithi138 podman[70847]: 2024-09-11 00:27:38.652826268 +0000 UTC m=+0.143940842 container create 66131a8b8f75f88026b38f0f976fd9e45b2b785166c166be533a438c3a72c2a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:27:39.294 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:27:38 smithi138 podman[70847]: 2024-09-11 00:27:38.905237008 +0000 UTC m=+0.396351533 container init 66131a8b8f75f88026b38f0f976fd9e45b2b785166c166be533a438c3a72c2a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:27:39.294 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:27:38 smithi138 podman[70847]: 2024-09-11 00:27:38.908798543 +0000 UTC m=+0.399913070 container start 66131a8b8f75f88026b38f0f976fd9e45b2b785166c166be533a438c3a72c2a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-11T00:27:39.294 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:27:39 smithi138 podman[70847]: 2024-09-11 00:27:39.022344521 +0000 UTC m=+0.513459049 container attach 66131a8b8f75f88026b38f0f976fd9e45b2b785166c166be533a438c3a72c2a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-11T00:27:39.294 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 11 00:27:39 smithi138 podman[70847]: 2024-09-11 00:27:39.096900384 +0000 UTC m=+0.588014916 container died 66131a8b8f75f88026b38f0f976fd9e45b2b785166c166be533a438c3a72c2a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-11T00:27:39.796 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.2.service' 2024-09-11T00:27:39.835 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:27:39.836 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-11T00:27:39.836 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-11T00:27:39.836 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.3 2024-09-11T00:27:40.160 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 11 00:27:39 smithi078 systemd[1]: Stopping Ceph osd.3 for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:27:40.417 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 11 00:27:40 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-3[55897]: 2024-09-11T00:27:40.158+0000 7f69decfe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:27:40.417 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 11 00:27:40 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-3[55897]: 2024-09-11T00:27:40.158+0000 7f69decfe640 -1 osd.3 90 *** Got signal Terminated *** 2024-09-11T00:27:40.417 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 11 00:27:40 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-3[55897]: 2024-09-11T00:27:40.158+0000 7f69decfe640 -1 osd.3 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:27:42.942 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:42 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:42.685+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:27:43.293 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:42 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:42.894+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:20.451414+0000 front 2024-09-11T00:27:20.451395+0000 (oldest deadline 2024-09-11T00:27:42.151485+0000) 2024-09-11T00:27:43.334 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:42 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:42.940+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:27:43.334 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 11 00:27:43 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-3[55897]: 2024-09-11T00:27:43.167+0000 7f69db313640 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.585820+0000 front 2024-09-11T00:27:17.585790+0000 (oldest deadline 2024-09-11T00:27:42.885924+0000) 2024-09-11T00:27:43.482 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:43 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:43.223+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:27:43.983 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:43 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:43.674+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:27:44.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:43 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:43.873+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:20.451414+0000 front 2024-09-11T00:27:20.451395+0000 (oldest deadline 2024-09-11T00:27:42.151485+0000) 2024-09-11T00:27:44.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:43 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:43.713+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:27:44.334 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:43 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:43.981+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:27:44.334 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 11 00:27:44 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-3[55897]: 2024-09-11T00:27:44.142+0000 7f69db313640 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.585820+0000 front 2024-09-11T00:27:17.585790+0000 (oldest deadline 2024-09-11T00:27:42.885924+0000) 2024-09-11T00:27:44.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:44 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:44.248+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:27:45.024 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:44 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:44.707+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:27:45.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:44 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:44.837+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:20.451414+0000 front 2024-09-11T00:27:20.451395+0000 (oldest deadline 2024-09-11T00:27:42.151485+0000) 2024-09-11T00:27:45.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:44 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:44.674+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:27:45.334 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:45 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:45.022+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:27:45.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:45 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:45.282+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:27:46.002 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 11 00:27:45 smithi078 podman[103894]: 2024-09-11 00:27:45.721056466 +0000 UTC m=+5.682006649 container died db42163dd160410fcb2b0f79d3711a5f6e04e7e0a5d8740d83643e78f5aaff3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-3, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-11T00:27:46.003 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:45 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:45.751+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:27:46.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:45 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:45.698+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:27:46.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:45 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:45.789+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:20.451414+0000 front 2024-09-11T00:27:20.451395+0000 (oldest deadline 2024-09-11T00:27:42.151485+0000) 2024-09-11T00:27:46.302 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:46 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:46.063+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:27:46.303 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 11 00:27:46 smithi078 podman[103894]: 2024-09-11 00:27:46.091781539 +0000 UTC m=+6.052731714 container cleanup db42163dd160410fcb2b0f79d3711a5f6e04e7e0a5d8740d83643e78f5aaff3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-3, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:27:46.303 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 11 00:27:46 smithi078 bash[103894]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-3 2024-09-11T00:27:46.584 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 11 00:27:46 smithi078 podman[103923]: 2024-09-11 00:27:46.301539525 +0000 UTC m=+0.578489547 container remove db42163dd160410fcb2b0f79d3711a5f6e04e7e0a5d8740d83643e78f5aaff3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-11T00:27:46.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:46 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:46.301+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:27:46.748 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:46 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:46.426+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:27:47.023 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:46 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:46.784+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:27:47.025 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 11 00:27:46 smithi078 podman[104009]: 2024-09-11 00:27:46.607041604 +0000 UTC m=+0.015900504 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:27:47.025 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 11 00:27:46 smithi078 podman[104009]: 2024-09-11 00:27:46.744243451 +0000 UTC m=+0.153102334 container create efa4e2de1289e772a916ad424c4ffc7218eeef255c5630c99c59d2810b50287e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-11T00:27:47.025 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 11 00:27:47 smithi078 podman[104009]: 2024-09-11 00:27:47.022079906 +0000 UTC m=+0.430938793 container init efa4e2de1289e772a916ad424c4ffc7218eeef255c5630c99c59d2810b50287e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-11T00:27:47.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:46 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:46.790+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:20.451414+0000 front 2024-09-11T00:27:20.451395+0000 (oldest deadline 2024-09-11T00:27:42.151485+0000) 2024-09-11T00:27:47.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:46 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:46.745+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:27:47.334 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:47 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:47.027+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:27:47.334 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 11 00:27:47 smithi078 podman[104009]: 2024-09-11 00:27:47.0258354 +0000 UTC m=+0.434694285 container start efa4e2de1289e772a916ad424c4ffc7218eeef255c5630c99c59d2810b50287e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-11T00:27:47.334 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 11 00:27:47 smithi078 podman[104009]: 2024-09-11 00:27:47.121972155 +0000 UTC m=+0.530831040 container attach efa4e2de1289e772a916ad424c4ffc7218eeef255c5630c99c59d2810b50287e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-11T00:27:47.334 INFO:journalctl@ceph.osd.3.smithi078.stdout:Sep 11 00:27:47 smithi078 podman[104009]: 2024-09-11 00:27:47.216838082 +0000 UTC m=+0.625696977 container died efa4e2de1289e772a916ad424c4ffc7218eeef255c5630c99c59d2810b50287e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-11T00:27:47.698 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:47 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:47.395+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:27:47.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:47 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:47.279+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:27:47.885 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:47 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:47.825+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:27:47.918 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.3.service' 2024-09-11T00:27:47.959 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:27:47.959 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-11T00:27:47.959 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-11T00:27:47.959 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.4 2024-09-11T00:27:48.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:47 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:47.832+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:20.451414+0000 front 2024-09-11T00:27:20.451395+0000 (oldest deadline 2024-09-11T00:27:42.151485+0000) 2024-09-11T00:27:48.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:47 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:47.696+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:27:48.269 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 11 00:27:48 smithi112 systemd[1]: Stopping Ceph osd.4 for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:27:48.334 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:48 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:47.999+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:27:48.658 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:48 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:48.380+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:27:48.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:48 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:48.320+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:27:48.732 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 11 00:27:48 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-4[48254]: 2024-09-11T00:27:48.267+0000 7f88e1258640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:27:48.732 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 11 00:27:48 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-4[48254]: 2024-09-11T00:27:48.267+0000 7f88e1258640 -1 osd.4 90 *** Got signal Terminated *** 2024-09-11T00:27:48.732 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 11 00:27:48 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-4[48254]: 2024-09-11T00:27:48.267+0000 7f88e1258640 -1 osd.4 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:27:49.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:48 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:48.875+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:20.451414+0000 front 2024-09-11T00:27:20.451395+0000 (oldest deadline 2024-09-11T00:27:42.151485+0000) 2024-09-11T00:27:49.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:48 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:48.656+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:27:49.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:48 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:48.812+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:27:49.084 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:48 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:48.959+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:27:49.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:49 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:49.351+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:27:49.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:49 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:49.367+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:27:49.793 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:49 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:49.610+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:27:50.084 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:49 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:49.933+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:27:50.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:49 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:49.827+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:27:50.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:49 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:49.827+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:26.179988+0000 front 2024-09-11T00:27:26.180004+0000 (oldest deadline 2024-09-11T00:27:49.680018+0000) 2024-09-11T00:27:50.293 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:49 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:49.906+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:20.451414+0000 front 2024-09-11T00:27:20.451395+0000 (oldest deadline 2024-09-11T00:27:42.151485+0000) 2024-09-11T00:27:50.609 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:50 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:50.324+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:27:50.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:50 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:50.313+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:27:50.875 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:50 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:50.607+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:27:51.084 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:50 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:50.923+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:27:51.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:50 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:50.783+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:27:51.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:50 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:50.783+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:26.179988+0000 front 2024-09-11T00:27:26.180004+0000 (oldest deadline 2024-09-11T00:27:49.680018+0000) 2024-09-11T00:27:51.129 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:50 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:50.873+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:20.451414+0000 front 2024-09-11T00:27:20.451395+0000 (oldest deadline 2024-09-11T00:27:42.151485+0000) 2024-09-11T00:27:51.544 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:51 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:51.317+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:27:51.544 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:51 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:51.318+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:27:51.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:51 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:51.298+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:27:51.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:51 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:51.298+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:27:52.044 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:51 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:51.855+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:20.451414+0000 front 2024-09-11T00:27:20.451395+0000 (oldest deadline 2024-09-11T00:27:42.151485+0000) 2024-09-11T00:27:52.044 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:51 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:51.855+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.052641+0000 front 2024-09-11T00:27:28.052483+0000 (oldest deadline 2024-09-11T00:27:51.552509+0000) 2024-09-11T00:27:52.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:51 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:51.613+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:27:52.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:51 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:51.613+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:27:52.086 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:51 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:51.957+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:27:52.087 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:51 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:51.823+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:27:52.087 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:51 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:51.823+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:26.179988+0000 front 2024-09-11T00:27:26.180004+0000 (oldest deadline 2024-09-11T00:27:49.680018+0000) 2024-09-11T00:27:52.616 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:52 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:52.296+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:27:52.617 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:52 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:52.296+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:27:52.633 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:52 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:52.295+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:27:52.633 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:52 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:52.295+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:27:52.633 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:27:52 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:27:52.370+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:27:53.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:52 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:52.843+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:20.451414+0000 front 2024-09-11T00:27:20.451395+0000 (oldest deadline 2024-09-11T00:27:42.151485+0000) 2024-09-11T00:27:53.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:52 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:52.843+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.052641+0000 front 2024-09-11T00:27:28.052483+0000 (oldest deadline 2024-09-11T00:27:51.552509+0000) 2024-09-11T00:27:53.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:52 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:52.615+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:27:53.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:52 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:52.615+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:27:53.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:52 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:52.816+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:27:53.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:52 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:52.816+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:26.179988+0000 front 2024-09-11T00:27:26.180004+0000 (oldest deadline 2024-09-11T00:27:49.680018+0000) 2024-09-11T00:27:53.084 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:52 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:52.949+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:27:53.084 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:52 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:52.949+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:27:53.543 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:53 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:53.262+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:27:53.543 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:53 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:53.262+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:27:53.732 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:27:53 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:27:53.349+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:27:53.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:53 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:53.294+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:27:53.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:53 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:53.294+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:27:53.892 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:53 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:53.606+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:27:53.892 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:53 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:53.606+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:27:54.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:53 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:53.779+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:27:54.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:53 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:53.779+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:26.179988+0000 front 2024-09-11T00:27:26.180004+0000 (oldest deadline 2024-09-11T00:27:49.680018+0000) 2024-09-11T00:27:54.084 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:53 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:53.959+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:27:54.084 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:53 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:53.959+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:27:54.086 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 11 00:27:53 smithi112 podman[71779]: 2024-09-11 00:27:53.783045164 +0000 UTC m=+5.634430277 container died bf1fbf1d57dd9b6689be7612fd1d5394418c96e99df7b6d0f5e1293df004c56e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:27:54.293 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:53 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:53.890+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:20.451414+0000 front 2024-09-11T00:27:20.451395+0000 (oldest deadline 2024-09-11T00:27:42.151485+0000) 2024-09-11T00:27:54.293 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:53 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:53.890+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.052641+0000 front 2024-09-11T00:27:28.052483+0000 (oldest deadline 2024-09-11T00:27:51.552509+0000) 2024-09-11T00:27:54.337 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 11 00:27:54 smithi112 podman[71779]: 2024-09-11 00:27:54.201430887 +0000 UTC m=+6.052815995 container cleanup bf1fbf1d57dd9b6689be7612fd1d5394418c96e99df7b6d0f5e1293df004c56e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-11T00:27:54.337 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 11 00:27:54 smithi112 bash[71779]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-4 2024-09-11T00:27:54.338 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:54 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:54.305+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:27:54.338 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:54 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:54.305+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:27:54.627 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:54 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:54.308+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:27:54.627 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:54 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:54.308+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:27:54.732 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 11 00:27:54 smithi112 podman[71796]: 2024-09-11 00:27:54.43605164 +0000 UTC m=+0.654847633 container remove bf1fbf1d57dd9b6689be7612fd1d5394418c96e99df7b6d0f5e1293df004c56e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-4, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731) 2024-09-11T00:27:54.732 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:27:54 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:27:54.334+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:27:55.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:54 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:54.861+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:20.451414+0000 front 2024-09-11T00:27:20.451395+0000 (oldest deadline 2024-09-11T00:27:42.151485+0000) 2024-09-11T00:27:55.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:54 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:54.861+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.052641+0000 front 2024-09-11T00:27:28.052483+0000 (oldest deadline 2024-09-11T00:27:51.552509+0000) 2024-09-11T00:27:55.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:54 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:54.625+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:27:55.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:54 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:54.625+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:27:55.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:54 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:54.731+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:27:55.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:54 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:54.731+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:26.179988+0000 front 2024-09-11T00:27:26.180004+0000 (oldest deadline 2024-09-11T00:27:49.680018+0000) 2024-09-11T00:27:55.084 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:54 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:54.953+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:27:55.084 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:54 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:54.953+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:27:55.175 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 11 00:27:54 smithi112 podman[71884]: 2024-09-11 00:27:54.764870995 +0000 UTC m=+0.016038794 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:27:55.175 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 11 00:27:54 smithi112 podman[71884]: 2024-09-11 00:27:54.89538932 +0000 UTC m=+0.146557111 container create 3122ab4d83b36402c324e6f5ce274cc2bf58478cee8b31fbf44a53814ad1fd22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-11T00:27:55.175 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 11 00:27:55 smithi112 podman[71884]: 2024-09-11 00:27:55.173460327 +0000 UTC m=+0.424628129 container init 3122ab4d83b36402c324e6f5ce274cc2bf58478cee8b31fbf44a53814ad1fd22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-11T00:27:55.482 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:27:55 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:27:55.340+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:27:55.482 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:55 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:55.347+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:27:55.482 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:55 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:55.347+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:27:55.483 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 11 00:27:55 smithi112 podman[71884]: 2024-09-11 00:27:55.177467195 +0000 UTC m=+0.428634985 container start 3122ab4d83b36402c324e6f5ce274cc2bf58478cee8b31fbf44a53814ad1fd22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, ceph=True) 2024-09-11T00:27:55.483 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 11 00:27:55 smithi112 podman[71884]: 2024-09-11 00:27:55.281455537 +0000 UTC m=+0.532623340 container attach 3122ab4d83b36402c324e6f5ce274cc2bf58478cee8b31fbf44a53814ad1fd22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-11T00:27:55.483 INFO:journalctl@ceph.osd.4.smithi112.stdout:Sep 11 00:27:55 smithi112 podman[71884]: 2024-09-11 00:27:55.3630645 +0000 UTC m=+0.614232290 container died 3122ab4d83b36402c324e6f5ce274cc2bf58478cee8b31fbf44a53814ad1fd22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-11T00:27:55.663 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:55 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:55.327+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:27:55.664 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:55 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:55.327+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:27:56.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:55 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:55.824+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:20.451414+0000 front 2024-09-11T00:27:20.451395+0000 (oldest deadline 2024-09-11T00:27:42.151485+0000) 2024-09-11T00:27:56.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:55 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:55.824+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.052641+0000 front 2024-09-11T00:27:28.052483+0000 (oldest deadline 2024-09-11T00:27:51.552509+0000) 2024-09-11T00:27:56.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:55 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:55.662+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:27:56.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:55 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:55.662+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:27:56.062 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.4.service' 2024-09-11T00:27:56.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:55 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:55.773+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:27:56.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:55 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:55.773+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:26.179988+0000 front 2024-09-11T00:27:26.180004+0000 (oldest deadline 2024-09-11T00:27:49.680018+0000) 2024-09-11T00:27:56.084 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:55 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:55.983+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:27:56.084 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:55 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:55.983+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:27:56.102 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:27:56.103 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-11T00:27:56.103 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-11T00:27:56.103 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.5 2024-09-11T00:27:56.505 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:56 smithi138 systemd[1]: Stopping Ceph osd.5 for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:27:56.505 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:56 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:56.504+0000 7f7a3530c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:27:56.506 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:56 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:56.312+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:27:56.506 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:56 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:56.312+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:27:56.732 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:27:56 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:27:56.337+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:27:56.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:56 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:56.384+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:27:56.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:56 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:56.384+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:27:56.793 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:56 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:56.672+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:27:56.793 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:56 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:56.672+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:27:56.793 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:56 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:56.504+0000 7f7a3530c640 -1 osd.5 90 *** Got signal Terminated *** 2024-09-11T00:27:56.793 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:56 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:56.504+0000 7f7a3530c640 -1 osd.5 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:27:57.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:56.750+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:27:57.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:56.750+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:26.179988+0000 front 2024-09-11T00:27:26.180004+0000 (oldest deadline 2024-09-11T00:27:49.680018+0000) 2024-09-11T00:27:57.084 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:56.983+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:27:57.084 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:56 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:56.983+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:27:57.293 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:56 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:56.817+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:20.451414+0000 front 2024-09-11T00:27:20.451395+0000 (oldest deadline 2024-09-11T00:27:42.151485+0000) 2024-09-11T00:27:57.294 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:56 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:56.817+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.052641+0000 front 2024-09-11T00:27:28.052483+0000 (oldest deadline 2024-09-11T00:27:51.552509+0000) 2024-09-11T00:27:57.692 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:57 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:57.319+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:27:57.693 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:57 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:57.319+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:27:57.732 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:27:57 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:27:57.334+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:27:57.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:57 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:57.384+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:27:57.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:57 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:57.384+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:27:58.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:57 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:57.798+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:20.451414+0000 front 2024-09-11T00:27:20.451395+0000 (oldest deadline 2024-09-11T00:27:42.151485+0000) 2024-09-11T00:27:58.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:57 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:57.798+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.052641+0000 front 2024-09-11T00:27:28.052483+0000 (oldest deadline 2024-09-11T00:27:51.552509+0000) 2024-09-11T00:27:58.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:57 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:57.691+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:27:58.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:57 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:57.691+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:27:58.084 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:57.951+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:27:58.084 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:57.951+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:27:58.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:57.779+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:27:58.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:57 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:57.779+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:26.179988+0000 front 2024-09-11T00:27:26.180004+0000 (oldest deadline 2024-09-11T00:27:49.680018+0000) 2024-09-11T00:27:58.690 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:58 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:58.312+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:27:58.690 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:58 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:58.312+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:27:58.690 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:58 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:58.312+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:27:58.732 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:27:58 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:27:58.291+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:27:58.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:58 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:58.367+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:27:58.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:58 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:58.367+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:27:59.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:58 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:58.689+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:27:59.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:58 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:58.689+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:27:59.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:58 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:58.813+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:20.451414+0000 front 2024-09-11T00:27:20.451395+0000 (oldest deadline 2024-09-11T00:27:42.151485+0000) 2024-09-11T00:27:59.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:58 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:58.813+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.052641+0000 front 2024-09-11T00:27:28.052483+0000 (oldest deadline 2024-09-11T00:27:51.552509+0000) 2024-09-11T00:27:59.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:58 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:58.813+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:33.253217+0000 front 2024-09-11T00:27:33.253167+0000 (oldest deadline 2024-09-11T00:27:57.853846+0000) 2024-09-11T00:27:59.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:58 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:58.741+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:27:59.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:58 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:58.741+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:26.179988+0000 front 2024-09-11T00:27:26.180004+0000 (oldest deadline 2024-09-11T00:27:49.680018+0000) 2024-09-11T00:27:59.084 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:58 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:58.965+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:27:59.084 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:58 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:58.965+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:27:59.084 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:27:58 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:27:58.965+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:27:59.675 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:59 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:59.299+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:27:59.676 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:59 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:59.299+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:27:59.676 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:27:59 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:27:59.299+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:27:59.732 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:27:59 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:27:59.245+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:27:59.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:59 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:59.395+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:27:59.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:27:59 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:27:59.395+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:00.010 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:59 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:59.707+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:28:00.010 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:59 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:59.707+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:26.179988+0000 front 2024-09-11T00:27:26.180004+0000 (oldest deadline 2024-09-11T00:27:49.680018+0000) 2024-09-11T00:28:00.010 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:27:59 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:27:59.707+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:34.881886+0000 front 2024-09-11T00:27:34.881902+0000 (oldest deadline 2024-09-11T00:27:59.581682+0000) 2024-09-11T00:28:00.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:59 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:59.674+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:00.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:27:59 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:27:59.674+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:00.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:59 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:59.824+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:20.451414+0000 front 2024-09-11T00:27:20.451395+0000 (oldest deadline 2024-09-11T00:27:42.151485+0000) 2024-09-11T00:28:00.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:59 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:59.824+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.052641+0000 front 2024-09-11T00:27:28.052483+0000 (oldest deadline 2024-09-11T00:27:51.552509+0000) 2024-09-11T00:28:00.044 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:27:59 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:27:59.824+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:33.253217+0000 front 2024-09-11T00:27:33.253167+0000 (oldest deadline 2024-09-11T00:27:57.853846+0000) 2024-09-11T00:28:00.334 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:00 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:00.007+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:00.334 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:00 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:00.007+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:00.334 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:00 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:00.007+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:00.545 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:00 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:00.275+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:00.545 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:00 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:00.275+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:00.545 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:00 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:00.275+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:00.732 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:00 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:00.238+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:28:00.732 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:00 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:00.238+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:35.171785+0000 front 2024-09-11T00:27:35.171900+0000 (oldest deadline 2024-09-11T00:27:59.871682+0000) 2024-09-11T00:28:00.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:00 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:00.392+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:00.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:00 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:00.392+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:00.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:00 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:00.392+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:01.028 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:00 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:00.738+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:28:01.029 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:00 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:00.738+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:26.179988+0000 front 2024-09-11T00:27:26.180004+0000 (oldest deadline 2024-09-11T00:27:49.680018+0000) 2024-09-11T00:28:01.029 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:00 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:00.738+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:34.881886+0000 front 2024-09-11T00:27:34.881902+0000 (oldest deadline 2024-09-11T00:27:59.581682+0000) 2024-09-11T00:28:01.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:00 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:00.718+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:01.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:00 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:00.718+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:01.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:28:00 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:28:00.840+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:20.451414+0000 front 2024-09-11T00:27:20.451395+0000 (oldest deadline 2024-09-11T00:27:42.151485+0000) 2024-09-11T00:28:01.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:28:00 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:28:00.840+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.052641+0000 front 2024-09-11T00:27:28.052483+0000 (oldest deadline 2024-09-11T00:27:51.552509+0000) 2024-09-11T00:28:01.043 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:28:00 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5[47820]: 2024-09-11T00:28:00.840+0000 7f7a31921640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:33.253217+0000 front 2024-09-11T00:27:33.253167+0000 (oldest deadline 2024-09-11T00:27:57.853846+0000) 2024-09-11T00:28:01.334 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:01 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:01.027+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:01.334 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:01 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:01.027+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:01.334 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:01 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:01.027+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:01.482 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:01 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:01.210+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:28:01.482 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:01 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:01.210+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:35.171785+0000 front 2024-09-11T00:27:35.171900+0000 (oldest deadline 2024-09-11T00:27:59.871682+0000) 2024-09-11T00:28:01.482 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:01 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:01.439+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:01.482 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:01 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:01.439+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:01.482 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:01 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:01.439+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:01.692 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:01 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:01.311+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:01.692 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:01 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:01.311+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:01.692 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:01 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:01.311+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:01.979 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:01 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:01.690+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:01.980 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:01 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:01.690+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:02.074 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:01 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:01.770+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:28:02.075 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:01 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:01.770+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:26.179988+0000 front 2024-09-11T00:27:26.180004+0000 (oldest deadline 2024-09-11T00:27:49.680018+0000) 2024-09-11T00:28:02.075 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:01 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:01.770+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:34.881886+0000 front 2024-09-11T00:27:34.881902+0000 (oldest deadline 2024-09-11T00:27:59.581682+0000) 2024-09-11T00:28:02.239 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:28:01 smithi138 podman[70961]: 2024-09-11 00:28:01.978476238 +0000 UTC m=+5.681791546 container died 3097ff33fa99c3c247f9b246f790815857b9cef1b903a7484a448b6deeef3040 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:28:02.334 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:02 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:02.073+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:02.334 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:02 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:02.073+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:02.334 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:02 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:02.073+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:02.482 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:02 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:02.183+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:28:02.482 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:02 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:02.183+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:35.171785+0000 front 2024-09-11T00:27:35.171900+0000 (oldest deadline 2024-09-11T00:27:59.871682+0000) 2024-09-11T00:28:02.482 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:02 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:02.422+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:02.483 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:02 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:02.422+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:02.483 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:02 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:02.422+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:02.543 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:28:02 smithi138 podman[70961]: 2024-09-11 00:28:02.337590719 +0000 UTC m=+6.040906017 container cleanup 3097ff33fa99c3c247f9b246f790815857b9cef1b903a7484a448b6deeef3040 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-11T00:28:02.543 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:28:02 smithi138 bash[70961]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5 2024-09-11T00:28:02.544 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:02 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:02.299+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:02.544 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:02 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:02.299+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:02.544 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:02 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:02.299+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:02.999 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:28:02 smithi138 podman[70979]: 2024-09-11 00:28:02.56419783 +0000 UTC m=+0.583437713 container remove 3097ff33fa99c3c247f9b246f790815857b9cef1b903a7484a448b6deeef3040 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:28:02.999 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:02 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:02.664+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:03.000 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:02 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:02.664+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:03.000 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:02 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:02.664+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:03.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:02 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:02.774+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:28:03.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:02 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:02.774+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:26.179988+0000 front 2024-09-11T00:27:26.180004+0000 (oldest deadline 2024-09-11T00:27:49.680018+0000) 2024-09-11T00:28:03.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:02 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:02.774+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:34.881886+0000 front 2024-09-11T00:27:34.881902+0000 (oldest deadline 2024-09-11T00:27:59.581682+0000) 2024-09-11T00:28:03.260 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:28:02 smithi138 podman[71069]: 2024-09-11 00:28:02.99840427 +0000 UTC m=+0.113098209 container create 77197b1e57f1ba892a846ecbec05546d4a7813880f52b40d71304c51edf8e885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-09-11T00:28:03.260 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:28:02 smithi138 podman[71069]: 2024-09-11 00:28:02.901187599 +0000 UTC m=+0.015881552 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:28:03.261 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:28:03 smithi138 podman[71069]: 2024-09-11 00:28:03.259195017 +0000 UTC m=+0.373888957 container init 77197b1e57f1ba892a846ecbec05546d4a7813880f52b40d71304c51edf8e885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True) 2024-09-11T00:28:03.457 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:03 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:03.169+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:28:03.457 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:03 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:03.169+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:35.171785+0000 front 2024-09-11T00:27:35.171900+0000 (oldest deadline 2024-09-11T00:27:59.871682+0000) 2024-09-11T00:28:03.543 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:03 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:03.281+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:03.543 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:03 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:03.281+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:03.544 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:03 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:03.281+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:03.544 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:28:03 smithi138 podman[71069]: 2024-09-11 00:28:03.262570955 +0000 UTC m=+0.377264905 container start 77197b1e57f1ba892a846ecbec05546d4a7813880f52b40d71304c51edf8e885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2) 2024-09-11T00:28:03.544 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:28:03 smithi138 podman[71069]: 2024-09-11 00:28:03.3510317 +0000 UTC m=+0.465725645 container attach 77197b1e57f1ba892a846ecbec05546d4a7813880f52b40d71304c51edf8e885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:28:03.544 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 11 00:28:03 smithi138 podman[71069]: 2024-09-11 00:28:03.448059364 +0000 UTC m=+0.562753314 container died 77197b1e57f1ba892a846ecbec05546d4a7813880f52b40d71304c51edf8e885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-11T00:28:03.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:03 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:03.094+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:03.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:03 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:03.094+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:03.585 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:03 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:03.094+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:03.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:03 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:03.455+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:03.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:03 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:03.455+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:03.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:03 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:03.455+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:04.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:03 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:03.664+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:04.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:03 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:03.664+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:04.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:03 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:03.664+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:04.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:03 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:03.726+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:28:04.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:03 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:03.726+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:26.179988+0000 front 2024-09-11T00:27:26.180004+0000 (oldest deadline 2024-09-11T00:27:49.680018+0000) 2024-09-11T00:28:04.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:03 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:03.726+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:34.881886+0000 front 2024-09-11T00:27:34.881902+0000 (oldest deadline 2024-09-11T00:27:59.581682+0000) 2024-09-11T00:28:04.128 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.5.service' 2024-09-11T00:28:04.170 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:28:04.170 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-11T00:28:04.170 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-11T00:28:04.170 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.6 2024-09-11T00:28:04.477 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:04 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:04.142+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:28:04.478 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:04 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:04.142+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:35.171785+0000 front 2024-09-11T00:27:35.171900+0000 (oldest deadline 2024-09-11T00:27:59.871682+0000) 2024-09-11T00:28:04.488 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:04 smithi078 systemd[1]: Stopping Ceph osd.6 for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:28:04.488 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:04 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:04.135+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:04.488 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:04 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:04.135+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:04.488 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:04 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:04.135+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:04.543 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:04 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:04.239+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:04.543 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:04 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:04.239+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:04.543 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:04 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:04.239+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:04.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:04 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:04.476+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:04.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:04 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:04.476+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:04.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:04 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:04.476+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:04.834 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:04 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:04.486+0000 7f6a003b2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:28:04.834 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:04 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:04.486+0000 7f6a003b2640 -1 osd.6 90 *** Got signal Terminated *** 2024-09-11T00:28:04.834 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:04 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:04.486+0000 7f6a003b2640 -1 osd.6 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:28:04.834 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:04 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:04.709+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:28:04.834 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:04 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:04.709+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:26.179988+0000 front 2024-09-11T00:27:26.180004+0000 (oldest deadline 2024-09-11T00:27:49.680018+0000) 2024-09-11T00:28:04.834 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:04 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:04.709+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:34.881886+0000 front 2024-09-11T00:27:34.881902+0000 (oldest deadline 2024-09-11T00:27:59.581682+0000) 2024-09-11T00:28:05.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:04 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:04.626+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:05.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:04 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:04.626+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:05.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:04 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:04.626+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:05.461 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:05 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:05.185+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:28:05.461 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:05 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:05.185+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:35.171785+0000 front 2024-09-11T00:27:35.171900+0000 (oldest deadline 2024-09-11T00:27:59.871682+0000) 2024-09-11T00:28:05.543 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:05 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:05.274+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:05.543 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:05 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:05.274+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:05.543 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:05 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:05.274+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:05.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:05 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:05.131+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:05.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:05 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:05.131+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:05.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:05 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:05.131+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:05.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:05 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:05.459+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:05.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:05 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:05.459+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:05.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:05 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:05.459+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:06.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:05 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:05.674+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:06.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:05 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:05.674+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:06.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:05 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:05.674+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:06.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:05 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:05.732+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:28:06.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:05 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:05.732+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:26.179988+0000 front 2024-09-11T00:27:26.180004+0000 (oldest deadline 2024-09-11T00:27:49.680018+0000) 2024-09-11T00:28:06.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:05 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:05.732+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:34.881886+0000 front 2024-09-11T00:27:34.881902+0000 (oldest deadline 2024-09-11T00:27:59.581682+0000) 2024-09-11T00:28:06.482 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:06 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:06.202+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:28:06.482 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:06 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:06.202+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:35.171785+0000 front 2024-09-11T00:27:35.171900+0000 (oldest deadline 2024-09-11T00:27:59.871682+0000) 2024-09-11T00:28:06.482 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:06 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:06.411+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:06.482 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:06 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:06.411+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:06.482 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:06 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:06.411+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:06.543 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:06 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:06.232+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:06.543 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:06 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:06.232+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:06.543 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:06 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:06.232+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:06.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:06 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:06.152+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:06.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:06 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:06.152+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:06.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:06 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:06.152+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:06.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:06 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:06.152+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:07.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:06 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:06.716+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:07.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:06 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:06.716+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:07.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:06 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:06.716+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:07.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:06 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:06.734+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:28:07.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:06 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:06.734+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:26.179988+0000 front 2024-09-11T00:27:26.180004+0000 (oldest deadline 2024-09-11T00:27:49.680018+0000) 2024-09-11T00:28:07.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:06 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:06.734+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:34.881886+0000 front 2024-09-11T00:27:34.881902+0000 (oldest deadline 2024-09-11T00:27:59.581682+0000) 2024-09-11T00:28:07.411 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:07 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:07.156+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:28:07.412 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:07 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:07.156+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:35.171785+0000 front 2024-09-11T00:27:35.171900+0000 (oldest deadline 2024-09-11T00:27:59.871682+0000) 2024-09-11T00:28:07.412 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:07 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:07.156+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.073197+0000 front 2024-09-11T00:27:42.073182+0000 (oldest deadline 2024-09-11T00:28:06.773015+0000) 2024-09-11T00:28:07.543 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:07 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:07.277+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:07.543 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:07 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:07.278+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:07.543 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:07 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:07.278+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:07.543 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:07 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:07.278+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.993795+0000 front 2024-09-11T00:27:42.993845+0000 (oldest deadline 2024-09-11T00:28:06.493671+0000) 2024-09-11T00:28:07.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:07 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:07.139+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:07.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:07 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:07.139+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:07.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:07 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:07.139+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:07.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:07 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:07.139+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:07.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:07 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:07.410+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:07.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:07 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:07.410+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:07.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:07 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:07.410+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:07.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:07 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:07.410+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:08.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:07 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:07.712+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:08.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:07 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:07.712+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:08.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:07 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:07.712+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:08.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:07 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:07.733+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:28:08.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:07 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:07.733+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:26.179988+0000 front 2024-09-11T00:27:26.180004+0000 (oldest deadline 2024-09-11T00:27:49.680018+0000) 2024-09-11T00:28:08.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:07 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:07.733+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:34.881886+0000 front 2024-09-11T00:27:34.881902+0000 (oldest deadline 2024-09-11T00:27:59.581682+0000) 2024-09-11T00:28:08.482 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:08 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:08.170+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:28:08.482 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:08 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:08.170+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:35.171785+0000 front 2024-09-11T00:27:35.171900+0000 (oldest deadline 2024-09-11T00:27:59.871682+0000) 2024-09-11T00:28:08.482 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:08 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:08.170+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.073197+0000 front 2024-09-11T00:27:42.073182+0000 (oldest deadline 2024-09-11T00:28:06.773015+0000) 2024-09-11T00:28:08.482 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:08 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:08.368+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:08.483 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:08 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:08.368+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:08.483 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:08 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:08.368+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:08.483 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:08 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:08.368+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:08.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:08 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:08.151+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:08.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:08 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:08.151+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:08.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:08 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:08.151+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:08.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:08 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:08.151+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:08.674 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:08 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:08.310+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:08.674 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:08 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:08.310+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:08.675 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:08 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:08.310+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:08.675 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:08 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:08.310+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.993795+0000 front 2024-09-11T00:27:42.993845+0000 (oldest deadline 2024-09-11T00:28:06.493671+0000) 2024-09-11T00:28:09.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:08 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:08.673+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:09.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:08 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:08.673+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:09.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:08 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:08.673+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:09.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:08 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:08.737+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.778797+0000 front 2024-09-11T00:27:16.778998+0000 (oldest deadline 2024-09-11T00:27:42.678894+0000) 2024-09-11T00:28:09.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:08 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:08.737+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:26.179988+0000 front 2024-09-11T00:27:26.180004+0000 (oldest deadline 2024-09-11T00:27:49.680018+0000) 2024-09-11T00:28:09.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:08 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6[62673]: 2024-09-11T00:28:08.737+0000 7f69f89bf640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:34.881886+0000 front 2024-09-11T00:27:34.881902+0000 (oldest deadline 2024-09-11T00:27:59.581682+0000) 2024-09-11T00:28:09.482 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:09 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:09.132+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:28:09.482 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:09 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:09.132+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:35.171785+0000 front 2024-09-11T00:27:35.171900+0000 (oldest deadline 2024-09-11T00:27:59.871682+0000) 2024-09-11T00:28:09.482 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:09 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:09.132+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.073197+0000 front 2024-09-11T00:27:42.073182+0000 (oldest deadline 2024-09-11T00:28:06.773015+0000) 2024-09-11T00:28:09.483 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:09 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:09.324+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:09.483 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:09 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:09.324+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:09.483 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:09 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:09.324+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:09.483 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:09 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:09.324+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:09.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:09 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:09.165+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:09.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:09 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:09.165+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:09.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:09 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:09.165+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:09.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:09 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:09.165+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:09.687 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:09 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:09.292+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:09.687 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:09 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:09.292+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:09.687 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:09 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:09.292+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:09.687 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:09 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:09.292+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.993795+0000 front 2024-09-11T00:27:42.993845+0000 (oldest deadline 2024-09-11T00:28:06.493671+0000) 2024-09-11T00:28:10.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:09 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:09.685+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:10.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:09 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:09.685+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:10.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:09 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:09.685+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:10.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:09 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:09.685+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:10.321 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:10 smithi078 podman[104110]: 2024-09-11 00:28:10.021357173 +0000 UTC m=+5.655900218 container died 0843a1218180fff514b849761df04272128ff688756bdc22a42de147ccdc8e13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-11T00:28:10.322 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:10 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:10.161+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:10.322 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:10 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:10.161+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:10.322 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:10 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:10.161+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:10.322 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:10 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:10.161+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:10.482 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:10 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:10.109+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:28:10.482 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:10 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:10.109+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:35.171785+0000 front 2024-09-11T00:27:35.171900+0000 (oldest deadline 2024-09-11T00:27:59.871682+0000) 2024-09-11T00:28:10.482 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:10 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:10.109+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.073197+0000 front 2024-09-11T00:27:42.073182+0000 (oldest deadline 2024-09-11T00:28:06.773015+0000) 2024-09-11T00:28:10.483 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:10 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:10.303+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:10.483 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:10 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:10.303+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:10.483 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:10 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:10.303+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:10.483 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:10 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:10.303+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:10.584 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:10 smithi078 podman[104110]: 2024-09-11 00:28:10.537046134 +0000 UTC m=+6.171589223 container cleanup 0843a1218180fff514b849761df04272128ff688756bdc22a42de147ccdc8e13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-11T00:28:10.584 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:10 smithi078 bash[104110]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6 2024-09-11T00:28:10.728 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:10 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:10.337+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:10.729 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:10 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:10.337+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:10.729 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:10 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:10.337+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:10.729 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:10 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:10.337+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.993795+0000 front 2024-09-11T00:27:42.993845+0000 (oldest deadline 2024-09-11T00:28:06.493671+0000) 2024-09-11T00:28:11.000 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:10 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:10.727+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:11.000 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:10 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:10.727+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:11.000 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:10 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:10.727+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:11.000 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:10 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:10.727+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:11.084 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:10 smithi078 podman[104127]: 2024-09-11 00:28:10.788385067 +0000 UTC m=+0.758776568 container remove 0843a1218180fff514b849761df04272128ff688756bdc22a42de147ccdc8e13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True) 2024-09-11T00:28:11.320 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:11 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:11.061+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:28:11.320 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:11 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:11.061+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:35.171785+0000 front 2024-09-11T00:27:35.171900+0000 (oldest deadline 2024-09-11T00:27:59.871682+0000) 2024-09-11T00:28:11.320 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:11 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:11.061+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.073197+0000 front 2024-09-11T00:27:42.073182+0000 (oldest deadline 2024-09-11T00:28:06.773015+0000) 2024-09-11T00:28:11.401 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:11 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:11.160+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:11.401 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:11 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:11.160+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:11.401 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:11 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:11.160+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:11.401 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:11 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:11.160+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:11.401 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:11 smithi078 podman[104219]: 2024-09-11 00:28:11.006978589 +0000 UTC m=+0.015812696 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:28:11.402 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:11 smithi078 podman[104219]: 2024-09-11 00:28:11.122515885 +0000 UTC m=+0.131349980 container create cf0fa54339bde2f6f0c9e18d47fa39130af700479d3b85f39445d32de404c557 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-11T00:28:11.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:11 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:11.318+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:11.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:11 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:11.318+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:11.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:11 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:11.318+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:11.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:11 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:11.318+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:11.777 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:11 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:11.302+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:11.777 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:11 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:11.302+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:11.777 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:11 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:11.302+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:11.778 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:11 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:11.302+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.993795+0000 front 2024-09-11T00:27:42.993845+0000 (oldest deadline 2024-09-11T00:28:06.493671+0000) 2024-09-11T00:28:11.834 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:11 smithi078 podman[104219]: 2024-09-11 00:28:11.400267304 +0000 UTC m=+0.409101398 container init cf0fa54339bde2f6f0c9e18d47fa39130af700479d3b85f39445d32de404c557 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-11T00:28:11.834 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:11 smithi078 podman[104219]: 2024-09-11 00:28:11.40366295 +0000 UTC m=+0.412497054 container start cf0fa54339bde2f6f0c9e18d47fa39130af700479d3b85f39445d32de404c557 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:28:11.834 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:11 smithi078 podman[104219]: 2024-09-11 00:28:11.492046314 +0000 UTC m=+0.500880410 container attach cf0fa54339bde2f6f0c9e18d47fa39130af700479d3b85f39445d32de404c557 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-11T00:28:11.834 INFO:journalctl@ceph.osd.6.smithi078.stdout:Sep 11 00:28:11 smithi078 podman[104242]: 2024-09-11 00:28:11.608746927 +0000 UTC m=+0.016512158 container died cf0fa54339bde2f6f0c9e18d47fa39130af700479d3b85f39445d32de404c557 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:28:12.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:11 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:11.775+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:12.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:11 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:11.775+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:12.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:11 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:11.775+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:12.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:11 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:11.775+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:12.248 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.6.service' 2024-09-11T00:28:12.289 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:28:12.289 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-11T00:28:12.289 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-11T00:28:12.289 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.7 2024-09-11T00:28:12.341 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:12 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:12.088+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:28:12.341 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:12 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:12.088+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:35.171785+0000 front 2024-09-11T00:27:35.171900+0000 (oldest deadline 2024-09-11T00:27:59.871682+0000) 2024-09-11T00:28:12.341 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:12 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:12.088+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.073197+0000 front 2024-09-11T00:27:42.073182+0000 (oldest deadline 2024-09-11T00:28:06.773015+0000) 2024-09-11T00:28:12.497 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:12 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:12.176+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:12.497 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:12 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:12.176+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:12.498 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:12 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:12.176+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:12.498 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:12 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:12.176+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:12.606 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:12 smithi112 systemd[1]: Stopping Ceph osd.7 for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:28:12.607 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:12 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:12.345+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:12.607 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:12 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:12.345+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:12.607 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:12 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:12.345+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:12.607 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:12 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:12.345+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:12.755 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:12 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:12.343+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:12.755 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:12 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:12.343+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:12.756 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:12 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:12.343+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:12.756 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:12 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:12.343+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.993795+0000 front 2024-09-11T00:27:42.993845+0000 (oldest deadline 2024-09-11T00:28:06.493671+0000) 2024-09-11T00:28:12.982 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:12 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:12.604+0000 7f30730df640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:28:12.982 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:12 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:12.604+0000 7f30730df640 -1 osd.7 90 *** Got signal Terminated *** 2024-09-11T00:28:12.982 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:12 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:12.604+0000 7f30730df640 -1 osd.7 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:28:13.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:12 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:12.740+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:13.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:12 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:12.740+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:13.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:12 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:12.740+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:13.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:12 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:12.740+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:13.385 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:13 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:13.117+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:28:13.385 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:13 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:13.117+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:35.171785+0000 front 2024-09-11T00:27:35.171900+0000 (oldest deadline 2024-09-11T00:27:59.871682+0000) 2024-09-11T00:28:13.385 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:13 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:13.117+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.073197+0000 front 2024-09-11T00:27:42.073182+0000 (oldest deadline 2024-09-11T00:28:06.773015+0000) 2024-09-11T00:28:13.443 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:13 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:13.136+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:13.443 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:13 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:13.136+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:13.443 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:13 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:13.136+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:13.443 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:13 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:13.136+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:13.720 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:13 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:13.303+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:13.720 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:13 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:13.303+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:13.720 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:13 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:13.303+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:13.720 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:13 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:13.303+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.993795+0000 front 2024-09-11T00:27:42.993845+0000 (oldest deadline 2024-09-11T00:28:06.493671+0000) 2024-09-11T00:28:13.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:13 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:13.383+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:13.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:13 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:13.383+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:13.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:13 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:13.383+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:13.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:13 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:13.383+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:14.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:13 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:13.718+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:14.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:13 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:13.718+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:14.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:13 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:13.718+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:14.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:13 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:13.718+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:14.350 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:14 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:14.087+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:28:14.350 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:14 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:14.087+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:35.171785+0000 front 2024-09-11T00:27:35.171900+0000 (oldest deadline 2024-09-11T00:27:59.871682+0000) 2024-09-11T00:28:14.350 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:14 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:14.087+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.073197+0000 front 2024-09-11T00:27:42.073182+0000 (oldest deadline 2024-09-11T00:28:06.773015+0000) 2024-09-11T00:28:14.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:14 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:14.177+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:14.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:14 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:14.177+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:14.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:14 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:14.177+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:14.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:14 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:14.177+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:14.714 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:14 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:14.341+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:14.715 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:14 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:14.341+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:14.715 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:14 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:14.341+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:14.715 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:14 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:14.341+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.993795+0000 front 2024-09-11T00:27:42.993845+0000 (oldest deadline 2024-09-11T00:28:06.493671+0000) 2024-09-11T00:28:14.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:14 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:14.349+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:14.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:14 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:14.349+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:14.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:14 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:14.349+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:14.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:14 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:14.349+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:15.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:14 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:14.713+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:15.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:14 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:14.713+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:15.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:14 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:14.713+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:15.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:14 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:14.713+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:15.385 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:15 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:15.048+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:28:15.385 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:15 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:15.048+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:35.171785+0000 front 2024-09-11T00:27:35.171900+0000 (oldest deadline 2024-09-11T00:27:59.871682+0000) 2024-09-11T00:28:15.385 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:15 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:15.048+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.073197+0000 front 2024-09-11T00:27:42.073182+0000 (oldest deadline 2024-09-11T00:28:06.773015+0000) 2024-09-11T00:28:15.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:15 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:15.206+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:15.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:15 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:15.206+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:15.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:15 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:15.206+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:15.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:15 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:15.206+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:15.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:15 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:15.383+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:15.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:15 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:15.383+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:15.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:15 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:15.383+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:15.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:15 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:15.383+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:15.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:15 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:15.383+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:15.755 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:15 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:15.379+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:15.755 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:15 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:15.379+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:15.755 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:15 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:15.379+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:15.755 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:15 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:15.379+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.993795+0000 front 2024-09-11T00:27:42.993845+0000 (oldest deadline 2024-09-11T00:28:06.493671+0000) 2024-09-11T00:28:16.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:15 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:15.754+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:16.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:15 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:15.754+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:16.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:15 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:15.754+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:16.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:15 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:15.754+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:16.347 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:16 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:16.016+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:28:16.348 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:16 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:16.016+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:35.171785+0000 front 2024-09-11T00:27:35.171900+0000 (oldest deadline 2024-09-11T00:27:59.871682+0000) 2024-09-11T00:28:16.348 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:16 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:16.016+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.073197+0000 front 2024-09-11T00:27:42.073182+0000 (oldest deadline 2024-09-11T00:28:06.773015+0000) 2024-09-11T00:28:16.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:16 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:16.165+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:16.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:16 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:16.165+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:16.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:16 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:16.165+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:16.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:16 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:16.165+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:16.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:16 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:16.346+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:16.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:16 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:16.346+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:16.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:16 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:16.346+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:16.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:16 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:16.346+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:16.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:16 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:16.346+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:16.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:16 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:16.347+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:16.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:16 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:16.347+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:16.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:16 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:16.347+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:16.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:16 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:16.347+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.993795+0000 front 2024-09-11T00:27:42.993845+0000 (oldest deadline 2024-09-11T00:28:06.493671+0000) 2024-09-11T00:28:17.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:16 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:16.793+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:17.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:16 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:16.793+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:17.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:16 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:16.793+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:17.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:16 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:16.793+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:17.370 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:17 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:17.017+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:27.570547+0000 front 2024-09-11T00:27:27.570588+0000 (oldest deadline 2024-09-11T00:27:51.670683+0000) 2024-09-11T00:28:17.370 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:17 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:17.017+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:35.171785+0000 front 2024-09-11T00:27:35.171900+0000 (oldest deadline 2024-09-11T00:27:59.871682+0000) 2024-09-11T00:28:17.371 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:17 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7[54781]: 2024-09-11T00:28:17.017+0000 7f306b6ec640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.073197+0000 front 2024-09-11T00:27:42.073182+0000 (oldest deadline 2024-09-11T00:28:06.773015+0000) 2024-09-11T00:28:17.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:17 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:17.135+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:17.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:17 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:17.135+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:17.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:17 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:17.135+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:17.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:17 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:17.135+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:17.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:17 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:17.135+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:51.769131+0000 front 2024-09-11T00:27:51.769147+0000 (oldest deadline 2024-09-11T00:28:16.468896+0000) 2024-09-11T00:28:17.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:17 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:17.368+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:17.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:17 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:17.368+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:17.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:17 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:17.368+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:17.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:17 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:17.368+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:17.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:17 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:17.368+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:17.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:17 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:17.371+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:17.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:17 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:17.371+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:17.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:17 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:17.371+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:17.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:17 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:17.371+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.993795+0000 front 2024-09-11T00:27:42.993845+0000 (oldest deadline 2024-09-11T00:28:06.493671+0000) 2024-09-11T00:28:18.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:17 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:17.797+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:18.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:17 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:17.797+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:18.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:17 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:17.797+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:18.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:17 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:17.797+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:18.323 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:18 smithi112 podman[71987]: 2024-09-11 00:28:18.013778026 +0000 UTC m=+5.528215865 container died 68d9f9f86f008c7817d4de9814e0add49015692b41ff5af1880f447bb5d88242 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:28:18.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:18 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:18.171+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:18.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:18 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:18.171+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:18.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:18 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:18.171+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:18.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:18 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:18.171+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:18.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:18 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:18.171+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:51.769131+0000 front 2024-09-11T00:27:51.769147+0000 (oldest deadline 2024-09-11T00:28:16.468896+0000) 2024-09-11T00:28:18.682 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:18 smithi112 podman[71987]: 2024-09-11 00:28:18.421708744 +0000 UTC m=+5.936146582 container cleanup 68d9f9f86f008c7817d4de9814e0add49015692b41ff5af1880f447bb5d88242 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:28:18.683 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:18 smithi112 bash[71987]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7 2024-09-11T00:28:18.683 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:18 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:18.345+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:18.683 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:18 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:18.345+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:18.683 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:18 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:18.345+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:18.683 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:18 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:18.345+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:18.683 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:18 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:18.345+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:18.783 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:18 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:18.381+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:18.783 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:18 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:18.381+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:18.783 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:18 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:18.381+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:18.783 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:18 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:18.381+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.993795+0000 front 2024-09-11T00:27:42.993845+0000 (oldest deadline 2024-09-11T00:28:06.493671+0000) 2024-09-11T00:28:18.982 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:18 smithi112 podman[72002]: 2024-09-11 00:28:18.681649305 +0000 UTC m=+0.662829307 container remove 68d9f9f86f008c7817d4de9814e0add49015692b41ff5af1880f447bb5d88242 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-11T00:28:19.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:18 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:18.781+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:19.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:18 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:18.781+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:19.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:18 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:18.781+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:19.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:18 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:18.781+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:19.286 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:19 smithi112 podman[72093]: 2024-09-11 00:28:18.935285217 +0000 UTC m=+0.015727858 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:28:19.286 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:19 smithi112 podman[72093]: 2024-09-11 00:28:19.057579928 +0000 UTC m=+0.138022606 container create 04f5ef6773fdf7346a73e0cb793642d26f4f34062457dfe65c21eac996706d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=) 2024-09-11T00:28:19.286 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:19 smithi112 podman[72093]: 2024-09-11 00:28:19.284934494 +0000 UTC m=+0.365377131 container init 04f5ef6773fdf7346a73e0cb793642d26f4f34062457dfe65c21eac996706d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-11T00:28:19.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:19 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:19.168+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:19.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:19 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:19.168+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:19.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:19 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:19.168+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:19.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:19 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:19.168+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:19.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:19 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:19.168+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:51.769131+0000 front 2024-09-11T00:27:51.769147+0000 (oldest deadline 2024-09-11T00:28:16.468896+0000) 2024-09-11T00:28:19.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:19 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:19.336+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:19.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:19 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:19.336+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:19.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:19 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:19.336+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:19.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:19 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:19.336+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:19.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:19 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:19.336+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:19.733 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:19 smithi112 podman[72093]: 2024-09-11 00:28:19.288448925 +0000 UTC m=+0.368891562 container start 04f5ef6773fdf7346a73e0cb793642d26f4f34062457dfe65c21eac996706d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:28:19.733 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:19 smithi112 podman[72093]: 2024-09-11 00:28:19.435432253 +0000 UTC m=+0.515874934 container attach 04f5ef6773fdf7346a73e0cb793642d26f4f34062457dfe65c21eac996706d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-11T00:28:19.733 INFO:journalctl@ceph.osd.7.smithi112.stdout:Sep 11 00:28:19 smithi112 podman[72093]: 2024-09-11 00:28:19.474839972 +0000 UTC m=+0.555282609 container died 04f5ef6773fdf7346a73e0cb793642d26f4f34062457dfe65c21eac996706d0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-11T00:28:19.778 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:19 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:19.414+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:19.778 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:19 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:19.414+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:19.778 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:19 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:19.414+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:19.778 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:19 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:19.414+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.993795+0000 front 2024-09-11T00:27:42.993845+0000 (oldest deadline 2024-09-11T00:28:06.493671+0000) 2024-09-11T00:28:20.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:19 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:19.777+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:20.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:19 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:19.777+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:20.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:19 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:19.777+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:20.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:19 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:19.777+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:20.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:19 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:19.777+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:20.172 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.7.service' 2024-09-11T00:28:20.214 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:28:20.214 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-11T00:28:20.214 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-11T00:28:20.214 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.8 2024-09-11T00:28:20.419 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:20 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:20.314+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:20.419 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:20 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:20.314+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:20.419 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:20 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:20.314+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:20.419 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:20 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:20.314+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:20.419 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:20 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:20.314+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:20.534 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:20 smithi138 systemd[1]: Stopping Ceph osd.8 for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:28:20.534 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:20 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:20.381+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:20.534 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:20 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:20.381+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:20.534 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:20 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:20.381+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:20.534 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:20 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:20.381+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.993795+0000 front 2024-09-11T00:27:42.993845+0000 (oldest deadline 2024-09-11T00:28:06.493671+0000) 2024-09-11T00:28:20.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:20 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:20.142+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:20.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:20 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:20.142+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:20.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:20 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:20.142+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:20.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:20 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:20.142+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:20.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:20 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:20.142+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:51.769131+0000 front 2024-09-11T00:27:51.769147+0000 (oldest deadline 2024-09-11T00:28:16.468896+0000) 2024-09-11T00:28:20.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:20 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:20.532+0000 7f94f6746640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:28:20.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:20 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:20.532+0000 7f94f6746640 -1 osd.8 90 *** Got signal Terminated *** 2024-09-11T00:28:20.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:20 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:20.532+0000 7f94f6746640 -1 osd.8 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:28:21.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:20 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:20.815+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:21.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:20 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:20.815+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:21.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:20 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:20.815+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:21.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:20 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:20.815+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:21.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:20 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:20.815+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:21.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:21 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:21.148+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:21.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:21 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:21.148+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:21.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:21 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:21.148+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:21.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:21 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:21.148+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:21.585 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:21 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:21.148+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:51.769131+0000 front 2024-09-11T00:27:51.769147+0000 (oldest deadline 2024-09-11T00:28:16.468896+0000) 2024-09-11T00:28:21.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:21 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:21.316+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:21.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:21 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:21.316+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:21.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:21 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:21.316+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:21.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:21 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:21.316+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:21.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:21 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:21.316+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:21.770 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:21 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:21.405+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:21.770 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:21 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:21.405+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:21.770 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:21 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:21.405+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:21.770 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:21 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:21.405+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.993795+0000 front 2024-09-11T00:27:42.993845+0000 (oldest deadline 2024-09-11T00:28:06.493671+0000) 2024-09-11T00:28:22.026 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:21 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:21.769+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:22.026 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:21 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:21.769+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:22.027 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:21 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:21.769+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:22.027 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:21 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:21.769+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:22.027 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:21 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:21.769+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:22.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:22 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:22.170+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:22.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:22 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:22.170+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:22.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:22 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:22.170+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:22.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:22 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:22.170+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:22.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:22 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:22.170+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:51.769131+0000 front 2024-09-11T00:27:51.769147+0000 (oldest deadline 2024-09-11T00:28:16.468896+0000) 2024-09-11T00:28:22.633 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:22 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:22.331+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:22.633 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:22 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:22.331+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:22.634 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:22 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:22.331+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:22.634 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:22 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:22.331+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:22.634 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:22 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:22.331+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:22.774 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:22 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:22.369+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:22.775 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:22 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:22.369+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:22.775 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:22 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:22.369+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:22.775 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:22 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:22.369+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.993795+0000 front 2024-09-11T00:27:42.993845+0000 (oldest deadline 2024-09-11T00:28:06.493671+0000) 2024-09-11T00:28:22.775 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:22 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:22.369+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:28:01.497528+0000 front 2024-09-11T00:28:01.497552+0000 (oldest deadline 2024-09-11T00:28:21.997644+0000) 2024-09-11T00:28:23.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:22 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:22.772+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:23.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:22 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:22.772+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:23.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:22 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:22.772+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:23.045 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:22 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:22.772+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:23.045 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:22 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:22.772+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:23.334 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:23 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:23.206+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:23.334 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:23 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:23.206+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:23.334 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:23 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:23.206+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:23.334 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:23 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:23.206+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:23.334 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:23 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:23.206+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:51.769131+0000 front 2024-09-11T00:27:51.769147+0000 (oldest deadline 2024-09-11T00:28:16.468896+0000) 2024-09-11T00:28:23.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:23 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:23.300+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:23.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:23 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:23.300+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:23.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:23 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:23.300+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:23.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:23 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:23.300+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:23.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:23 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:23.300+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:23.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:23 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:23.367+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:23.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:23 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:23.367+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:23.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:23 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:23.367+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:23.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:23 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:23.367+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.993795+0000 front 2024-09-11T00:27:42.993845+0000 (oldest deadline 2024-09-11T00:28:06.493671+0000) 2024-09-11T00:28:23.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:23 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:23.367+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:28:01.497528+0000 front 2024-09-11T00:28:01.497552+0000 (oldest deadline 2024-09-11T00:28:21.997644+0000) 2024-09-11T00:28:24.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:23 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:23.791+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:24.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:23 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:23.791+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:24.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:23 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:23.791+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:24.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:23 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:23.791+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:24.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:23 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:23.791+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:24.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:24 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:24.219+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:24.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:24 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:24.219+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:24.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:24 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:24.219+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:24.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:24 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:24.219+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:24.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:24 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:24.219+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:51.769131+0000 front 2024-09-11T00:27:51.769147+0000 (oldest deadline 2024-09-11T00:28:16.468896+0000) 2024-09-11T00:28:24.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:24 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:24.286+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:24.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:24 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:24.286+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:24.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:24 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:24.286+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:24.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:24 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:24.286+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:24.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:24 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:24.286+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:24.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:24 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:24.325+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:24.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:24 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:24.325+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:24.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:24 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:24.325+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:24.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:24 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:24.325+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.993795+0000 front 2024-09-11T00:27:42.993845+0000 (oldest deadline 2024-09-11T00:28:06.493671+0000) 2024-09-11T00:28:24.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:24 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:24.325+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:28:01.497528+0000 front 2024-09-11T00:28:01.497552+0000 (oldest deadline 2024-09-11T00:28:21.997644+0000) 2024-09-11T00:28:25.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:24 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:24.792+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:25.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:24 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:24.792+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:25.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:24 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:24.792+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:25.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:24 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:24.792+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:25.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:24 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:24.792+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:25.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:24 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:24.792+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:25.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:25 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:25.196+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:25.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:25 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:25.196+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:25.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:25 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:25.196+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:25.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:25 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:25.196+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:25.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:25 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:25.196+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:51.769131+0000 front 2024-09-11T00:27:51.769147+0000 (oldest deadline 2024-09-11T00:28:16.468896+0000) 2024-09-11T00:28:25.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:25 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:25.336+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:25.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:25 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:25.336+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:25.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:25 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:25.336+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:25.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:25 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:25.336+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:25.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:25 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:25.336+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:25.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:25 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:25.336+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:58.544002+0000 front 2024-09-11T00:27:58.544125+0000 (oldest deadline 2024-09-11T00:28:24.443898+0000) 2024-09-11T00:28:25.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:25 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:25.323+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:16.089938+0000 front 2024-09-11T00:27:16.089926+0000 (oldest deadline 2024-09-11T00:27:46.090446+0000) 2024-09-11T00:28:25.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:25 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:25.323+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.991450+0000 front 2024-09-11T00:27:28.991407+0000 (oldest deadline 2024-09-11T00:27:51.291391+0000) 2024-09-11T00:28:25.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:25 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:25.323+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:31.792385+0000 front 2024-09-11T00:27:31.792481+0000 (oldest deadline 2024-09-11T00:27:57.692624+0000) 2024-09-11T00:28:25.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:25 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:25.323+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.993795+0000 front 2024-09-11T00:27:42.993845+0000 (oldest deadline 2024-09-11T00:28:06.493671+0000) 2024-09-11T00:28:25.793 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:25 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8[54312]: 2024-09-11T00:28:25.323+0000 7f94f2d5b640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:28:01.497528+0000 front 2024-09-11T00:28:01.497552+0000 (oldest deadline 2024-09-11T00:28:21.997644+0000) 2024-09-11T00:28:26.293 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:26 smithi138 podman[71183]: 2024-09-11 00:28:26.056800749 +0000 UTC m=+5.640976148 container died b902ca867b835bf0497d6397c59da3efc0c5b0c840bfb69c8e4d9aade68a4f72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:28:26.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:25 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:25.827+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:26.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:25 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:25.827+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:26.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:25 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:25.827+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:26.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:25 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:25.827+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:26.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:25 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:25.827+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:26.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:25 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:25.827+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:26.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:26 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:26.210+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:26.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:26 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:26.210+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:26.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:26 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:26.210+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:26.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:26 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:26.210+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:26.585 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:26 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:26.210+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:51.769131+0000 front 2024-09-11T00:27:51.769147+0000 (oldest deadline 2024-09-11T00:28:16.468896+0000) 2024-09-11T00:28:26.585 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:26 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:26.210+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:56.469443+0000 front 2024-09-11T00:27:56.469423+0000 (oldest deadline 2024-09-11T00:28:25.869644+0000) 2024-09-11T00:28:26.718 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:26 smithi138 podman[71183]: 2024-09-11 00:28:26.407691174 +0000 UTC m=+5.991866572 container cleanup b902ca867b835bf0497d6397c59da3efc0c5b0c840bfb69c8e4d9aade68a4f72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:28:26.718 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:26 smithi138 bash[71183]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8 2024-09-11T00:28:26.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:26 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:26.379+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:26.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:26 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:26.379+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:26.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:26 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:26.379+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:26.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:26 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:26.379+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:26.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:26 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:26.379+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:26.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:26 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:26.380+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:58.544002+0000 front 2024-09-11T00:27:58.544125+0000 (oldest deadline 2024-09-11T00:28:24.443898+0000) 2024-09-11T00:28:27.043 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:26 smithi138 podman[71198]: 2024-09-11 00:28:26.717195525 +0000 UTC m=+0.658061154 container remove b902ca867b835bf0497d6397c59da3efc0c5b0c840bfb69c8e4d9aade68a4f72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-11T00:28:27.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:26 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:26.801+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:27.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:26 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:26.801+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:27.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:26 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:26.801+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:27.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:26 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:26.801+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:27.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:26 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:26.801+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:27.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:26 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:26.801+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:27.391 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:27 smithi138 podman[71290]: 2024-09-11 00:28:27.068252489 +0000 UTC m=+0.111092382 container create 840b6476edcd239f11756858a4d3897e88cc35d62cc999da373b22eceefc02ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:28:27.391 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:27 smithi138 podman[71290]: 2024-09-11 00:28:26.973201342 +0000 UTC m=+0.016041242 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:28:27.391 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:27 smithi138 podman[71290]: 2024-09-11 00:28:27.314981196 +0000 UTC m=+0.357821090 container init 840b6476edcd239f11756858a4d3897e88cc35d62cc999da373b22eceefc02ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-11T00:28:27.391 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:27 smithi138 podman[71290]: 2024-09-11 00:28:27.318185164 +0000 UTC m=+0.361025063 container start 840b6476edcd239f11756858a4d3897e88cc35d62cc999da373b22eceefc02ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-11T00:28:27.391 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:27 smithi138 podman[71290]: 2024-09-11 00:28:27.389953366 +0000 UTC m=+0.432793268 container attach 840b6476edcd239f11756858a4d3897e88cc35d62cc999da373b22eceefc02ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8-deactivate, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:28:27.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:27 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:27.195+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:27.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:27 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:27.195+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:27.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:27 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:27.195+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:27.585 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:27 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:27.195+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:27.585 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:27 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:27.195+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:51.769131+0000 front 2024-09-11T00:27:51.769147+0000 (oldest deadline 2024-09-11T00:28:16.468896+0000) 2024-09-11T00:28:27.585 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:27 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:27.195+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:56.469443+0000 front 2024-09-11T00:27:56.469423+0000 (oldest deadline 2024-09-11T00:28:25.869644+0000) 2024-09-11T00:28:27.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:27 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:27.343+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:27.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:27 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:27.343+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:27.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:27 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:27.343+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:27.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:27 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:27.343+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:27.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:27 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:27.343+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:27.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:27 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:27.343+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:58.544002+0000 front 2024-09-11T00:27:58.544125+0000 (oldest deadline 2024-09-11T00:28:24.443898+0000) 2024-09-11T00:28:27.784 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 11 00:28:27 smithi138 podman[71290]: 2024-09-11 00:28:27.512852026 +0000 UTC m=+0.555691922 container died 840b6476edcd239f11756858a4d3897e88cc35d62cc999da373b22eceefc02ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:28:28.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:27 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:27.782+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:28.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:27 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:27.782+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:28.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:27 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:27.782+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:28.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:27 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:27.782+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:28.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:27 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:27.782+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:28.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:27 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:27.782+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:28.131 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.8.service' 2024-09-11T00:28:28.171 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:28:28.171 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-11T00:28:28.171 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-11T00:28:28.171 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.9 2024-09-11T00:28:28.474 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:28 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:28.201+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:28.474 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:28 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:28.201+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:28.475 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:28 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:28.201+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:28.475 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:28 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:28.201+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:28.475 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:28 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:28.201+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:51.769131+0000 front 2024-09-11T00:27:51.769147+0000 (oldest deadline 2024-09-11T00:28:16.468896+0000) 2024-09-11T00:28:28.475 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:28 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:28.201+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:56.469443+0000 front 2024-09-11T00:27:56.469423+0000 (oldest deadline 2024-09-11T00:28:25.869644+0000) 2024-09-11T00:28:28.475 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:28 smithi078 systemd[1]: Stopping Ceph osd.9 for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:28:28.475 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:28 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:28.472+0000 7f8be0ab2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:28:28.475 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:28 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:28.472+0000 7f8be0ab2640 -1 osd.9 90 *** Got signal Terminated *** 2024-09-11T00:28:28.475 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:28 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:28.472+0000 7f8be0ab2640 -1 osd.9 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:28:28.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:28 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:28.344+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:28.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:28 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:28.344+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:28.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:28 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:28.344+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:28.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:28 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:28.344+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:28.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:28 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:28.344+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:28.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:28 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:28.344+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:58.544002+0000 front 2024-09-11T00:27:58.544125+0000 (oldest deadline 2024-09-11T00:28:24.443898+0000) 2024-09-11T00:28:29.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:28 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:28.745+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:29.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:28 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:28.745+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:29.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:28 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:28.745+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:29.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:28 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:28.745+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:29.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:28 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:28.745+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:29.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:28 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:28.745+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:29.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:29 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:29.195+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:29.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:29 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:29.195+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:29.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:29 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:29.195+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:29.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:29 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:29.195+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:29.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:29 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:29.195+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:51.769131+0000 front 2024-09-11T00:27:51.769147+0000 (oldest deadline 2024-09-11T00:28:16.468896+0000) 2024-09-11T00:28:29.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:29 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:29.195+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:56.469443+0000 front 2024-09-11T00:27:56.469423+0000 (oldest deadline 2024-09-11T00:28:25.869644+0000) 2024-09-11T00:28:29.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:29 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:29.355+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:29.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:29 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:29.355+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:29.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:29 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:29.355+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:29.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:29 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:29.355+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:29.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:29 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:29.355+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:29.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:29 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:29.355+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:58.544002+0000 front 2024-09-11T00:27:58.544125+0000 (oldest deadline 2024-09-11T00:28:24.443898+0000) 2024-09-11T00:28:30.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:29 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:29.787+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:30.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:29 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:29.787+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:30.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:29 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:29.787+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:30.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:29 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:29.787+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:30.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:29 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:29.787+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:30.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:29 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:29.787+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:30.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:30 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:30.154+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:30.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:30 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:30.154+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:30.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:30 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:30.154+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:30.585 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:30 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:30.154+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:30.585 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:30 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:30.154+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:51.769131+0000 front 2024-09-11T00:27:51.769147+0000 (oldest deadline 2024-09-11T00:28:16.468896+0000) 2024-09-11T00:28:30.585 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:30 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:30.154+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:56.469443+0000 front 2024-09-11T00:27:56.469423+0000 (oldest deadline 2024-09-11T00:28:25.869644+0000) 2024-09-11T00:28:30.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:30 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:30.344+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:30.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:30 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:30.344+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:30.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:30 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:30.344+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:30.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:30 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:30.344+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:30.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:30 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:30.344+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:30.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:30 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:30.344+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:58.544002+0000 front 2024-09-11T00:27:58.544125+0000 (oldest deadline 2024-09-11T00:28:24.443898+0000) 2024-09-11T00:28:31.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:30 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:30.760+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:31.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:30 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:30.760+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:31.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:30 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:30.760+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:31.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:30 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:30.760+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:31.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:30 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:30.760+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:31.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:30 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:30.760+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:31.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:31 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:31.196+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:31.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:31 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:31.196+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:31.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:31 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:31.196+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:31.585 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:31 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:31.196+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:31.585 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:31 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:31.196+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:51.769131+0000 front 2024-09-11T00:27:51.769147+0000 (oldest deadline 2024-09-11T00:28:16.468896+0000) 2024-09-11T00:28:31.585 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:31 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:31.196+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:56.469443+0000 front 2024-09-11T00:27:56.469423+0000 (oldest deadline 2024-09-11T00:28:25.869644+0000) 2024-09-11T00:28:31.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:31 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:31.300+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:31.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:31 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:31.300+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:31.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:31 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:31.300+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:31.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:31 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:31.300+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:31.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:31 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:31.300+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:31.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:31 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:31.300+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:58.544002+0000 front 2024-09-11T00:27:58.544125+0000 (oldest deadline 2024-09-11T00:28:24.443898+0000) 2024-09-11T00:28:32.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:31 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:31.775+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:32.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:31 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:31.775+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:32.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:31 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:31.775+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:32.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:31 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:31.775+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:32.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:31 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:31.775+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:32.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:31 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:31.775+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:32.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:32 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:32.211+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:32.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:32 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:32.211+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:32.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:32 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:32.211+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:32.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:32 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:32.211+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:32.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:32 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:32.211+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:51.769131+0000 front 2024-09-11T00:27:51.769147+0000 (oldest deadline 2024-09-11T00:28:16.468896+0000) 2024-09-11T00:28:32.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:32 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:32.211+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:56.469443+0000 front 2024-09-11T00:27:56.469423+0000 (oldest deadline 2024-09-11T00:28:25.869644+0000) 2024-09-11T00:28:32.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:32 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:32.211+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6822 osd.6 since back 2024-09-11T00:28:05.870081+0000 front 2024-09-11T00:28:05.870060+0000 (oldest deadline 2024-09-11T00:28:31.770016+0000) 2024-09-11T00:28:32.685 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:32 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:32.347+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:32.685 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:32 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:32.347+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:32.685 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:32 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:32.347+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:32.685 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:32 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:32.347+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:32.685 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:32 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:32.347+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:32.685 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:32 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:32.347+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:58.544002+0000 front 2024-09-11T00:27:58.544125+0000 (oldest deadline 2024-09-11T00:28:24.443898+0000) 2024-09-11T00:28:32.685 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:32 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:32.347+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6822 osd.6 since back 2024-09-11T00:28:09.445739+0000 front 2024-09-11T00:28:09.445687+0000 (oldest deadline 2024-09-11T00:28:32.345657+0000) 2024-09-11T00:28:33.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:32 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:32.768+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:33.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:32 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:32.768+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:33.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:32 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:32.768+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:33.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:32 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:32.768+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:33.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:32 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:32.768+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:33.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:32 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:32.768+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:33.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:33 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:33.235+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:17.764632+0000 front 2024-09-11T00:27:17.764619+0000 (oldest deadline 2024-09-11T00:27:42.464668+0000) 2024-09-11T00:28:33.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:33 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:33.235+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.365882+0000 front 2024-09-11T00:27:28.366083+0000 (oldest deadline 2024-09-11T00:27:52.465984+0000) 2024-09-11T00:28:33.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:33 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:33.235+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:32.967129+0000 front 2024-09-11T00:27:32.967010+0000 (oldest deadline 2024-09-11T00:27:58.866889+0000) 2024-09-11T00:28:33.585 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:33 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:33.235+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.767946+0000 front 2024-09-11T00:27:44.768089+0000 (oldest deadline 2024-09-11T00:28:05.868030+0000) 2024-09-11T00:28:33.585 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:33 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:33.235+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:51.769131+0000 front 2024-09-11T00:27:51.769147+0000 (oldest deadline 2024-09-11T00:28:16.468896+0000) 2024-09-11T00:28:33.585 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:33 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:33.235+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:56.469443+0000 front 2024-09-11T00:27:56.469423+0000 (oldest deadline 2024-09-11T00:28:25.869644+0000) 2024-09-11T00:28:33.585 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:33 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9[69215]: 2024-09-11T00:28:33.235+0000 7f8bdd0c7640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.78:6822 osd.6 since back 2024-09-11T00:28:05.870081+0000 front 2024-09-11T00:28:05.870060+0000 (oldest deadline 2024-09-11T00:28:31.770016+0000) 2024-09-11T00:28:33.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:33 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:33.370+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:33.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:33 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:33.370+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:33.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:33 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:33.370+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:33.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:33 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:33.370+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:33.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:33 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:33.370+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:33.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:33 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:33.370+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:58.544002+0000 front 2024-09-11T00:27:58.544125+0000 (oldest deadline 2024-09-11T00:28:24.443898+0000) 2024-09-11T00:28:33.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:33 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:33.370+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6822 osd.6 since back 2024-09-11T00:28:09.445739+0000 front 2024-09-11T00:28:09.445687+0000 (oldest deadline 2024-09-11T00:28:32.345657+0000) 2024-09-11T00:28:34.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:33 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:33.726+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:34.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:33 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:33.726+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:34.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:33 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:33.726+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:34.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:33 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:33.726+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:34.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:33 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:33.726+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:34.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:33 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:33.726+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:34.157 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:33 smithi078 podman[104333]: 2024-09-11 00:28:33.896613801 +0000 UTC m=+5.534046055 container died 8779d70562c13470856577ee7171187a35fdf56bdb4f1c109146d2dde29ede68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-11T00:28:34.541 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:34 smithi078 podman[104333]: 2024-09-11 00:28:34.256059833 +0000 UTC m=+5.893492086 container cleanup 8779d70562c13470856577ee7171187a35fdf56bdb4f1c109146d2dde29ede68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-11T00:28:34.542 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:34 smithi078 bash[104333]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9 2024-09-11T00:28:34.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:34 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:34.338+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:34.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:34 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:34.338+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:34.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:34 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:34.338+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:34.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:34 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:34.338+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:34.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:34 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:34.338+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:34.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:34 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:34.338+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:58.544002+0000 front 2024-09-11T00:27:58.544125+0000 (oldest deadline 2024-09-11T00:28:24.443898+0000) 2024-09-11T00:28:34.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:34 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:34.338+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6822 osd.6 since back 2024-09-11T00:28:09.445739+0000 front 2024-09-11T00:28:09.445687+0000 (oldest deadline 2024-09-11T00:28:32.345657+0000) 2024-09-11T00:28:34.834 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:34 smithi078 podman[104349]: 2024-09-11 00:28:34.540729485 +0000 UTC m=+0.642424767 container remove 8779d70562c13470856577ee7171187a35fdf56bdb4f1c109146d2dde29ede68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-11T00:28:35.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:34 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:34.772+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:35.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:34 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:34.772+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:35.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:34 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:34.772+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:35.043 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:34 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:34.772+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:35.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:34 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:34.772+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:35.044 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:34 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:34.772+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:35.153 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:34 smithi078 podman[104436]: 2024-09-11 00:28:34.767443311 +0000 UTC m=+0.015508304 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:28:35.153 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:34 smithi078 podman[104436]: 2024-09-11 00:28:34.908275019 +0000 UTC m=+0.156340048 container create 5749eb7aaf1ad9dbc088ff0dacc500ea0d34cc4409cf1f80a5e9f55bdf7df074 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-11T00:28:35.153 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:35 smithi078 podman[104436]: 2024-09-11 00:28:35.152207351 +0000 UTC m=+0.400272333 container init 5749eb7aaf1ad9dbc088ff0dacc500ea0d34cc4409cf1f80a5e9f55bdf7df074 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True) 2024-09-11T00:28:35.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:35 smithi078 podman[104436]: 2024-09-11 00:28:35.155794812 +0000 UTC m=+0.403859799 container start 5749eb7aaf1ad9dbc088ff0dacc500ea0d34cc4409cf1f80a5e9f55bdf7df074 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-11T00:28:35.584 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:35 smithi078 podman[104436]: 2024-09-11 00:28:35.227150023 +0000 UTC m=+0.475215008 container attach 5749eb7aaf1ad9dbc088ff0dacc500ea0d34cc4409cf1f80a5e9f55bdf7df074 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-11T00:28:35.585 INFO:journalctl@ceph.osd.9.smithi078.stdout:Sep 11 00:28:35 smithi078 podman[104436]: 2024-09-11 00:28:35.342943511 +0000 UTC m=+0.591008503 container died 5749eb7aaf1ad9dbc088ff0dacc500ea0d34cc4409cf1f80a5e9f55bdf7df074 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:28:35.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:35 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:35.364+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:35.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:35 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:35.364+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:35.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:35 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:35.364+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:35.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:35 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:35.364+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:35.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:35 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:35.364+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:35.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:35 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:35.364+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:58.544002+0000 front 2024-09-11T00:27:58.544125+0000 (oldest deadline 2024-09-11T00:28:24.443898+0000) 2024-09-11T00:28:35.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:35 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:35.364+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6822 osd.6 since back 2024-09-11T00:28:09.445739+0000 front 2024-09-11T00:28:09.445687+0000 (oldest deadline 2024-09-11T00:28:32.345657+0000) 2024-09-11T00:28:35.975 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.9.service' 2024-09-11T00:28:36.015 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:28:36.016 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-11T00:28:36.016 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-11T00:28:36.016 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.10 2024-09-11T00:28:36.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:35 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:35.809+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:36.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:35 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:35.809+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:36.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:35 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:35.809+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:36.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:35 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:35.809+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:36.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:35 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:35.809+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:36.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:35 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:35.809+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:36.326 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:36 smithi112 systemd[1]: Stopping Ceph osd.10 for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:28:36.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:36 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:36.323+0000 7fa11cc99640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:28:36.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:36 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:36.323+0000 7fa11cc99640 -1 osd.10 90 *** Got signal Terminated *** 2024-09-11T00:28:36.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:36 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:36.323+0000 7fa11cc99640 -1 osd.10 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:28:36.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:36 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:36.348+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:36.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:36 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:36.348+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:36.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:36 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:36.348+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:36.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:36 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:36.348+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:36.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:36 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:36.348+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:36.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:36 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:36.348+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:58.544002+0000 front 2024-09-11T00:27:58.544125+0000 (oldest deadline 2024-09-11T00:28:24.443898+0000) 2024-09-11T00:28:36.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:36 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:36.348+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6822 osd.6 since back 2024-09-11T00:28:09.445739+0000 front 2024-09-11T00:28:09.445687+0000 (oldest deadline 2024-09-11T00:28:32.345657+0000) 2024-09-11T00:28:37.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:36 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:36.828+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:37.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:36 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:36.828+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:37.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:36 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:36.828+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:37.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:36 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:36.828+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:37.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:36 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:36.828+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:37.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:36 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:36.828+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:37.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:37 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:37.319+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:37.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:37 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:37.319+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:37.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:37 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:37.319+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:37.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:37 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:37.319+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:37.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:37 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:37.319+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:37.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:37 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:37.319+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:58.544002+0000 front 2024-09-11T00:27:58.544125+0000 (oldest deadline 2024-09-11T00:28:24.443898+0000) 2024-09-11T00:28:37.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:37 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:37.319+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6822 osd.6 since back 2024-09-11T00:28:09.445739+0000 front 2024-09-11T00:28:09.445687+0000 (oldest deadline 2024-09-11T00:28:32.345657+0000) 2024-09-11T00:28:38.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:37 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:37.868+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:38.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:37 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:37.868+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:38.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:37 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:37.868+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:38.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:37 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:37.868+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:38.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:37 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:37.868+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:38.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:37 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:37.868+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:38.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:38 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:38.336+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:38.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:38 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:38.336+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:38.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:38 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:38.336+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:38.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:38 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:38.336+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:38.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:38 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:38.336+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:38.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:38 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:38.336+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:58.544002+0000 front 2024-09-11T00:27:58.544125+0000 (oldest deadline 2024-09-11T00:28:24.443898+0000) 2024-09-11T00:28:38.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:38 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:38.336+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6822 osd.6 since back 2024-09-11T00:28:09.445739+0000 front 2024-09-11T00:28:09.445687+0000 (oldest deadline 2024-09-11T00:28:32.345657+0000) 2024-09-11T00:28:39.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:38 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:38.888+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:39.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:38 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:38.889+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:39.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:38 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:38.889+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:39.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:38 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:38.889+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:39.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:38 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:38.889+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:39.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:38 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:38.889+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:39.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:39 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:39.337+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:39.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:39 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:39.337+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:39.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:39 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:39.337+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:39.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:39 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:39.337+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:39.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:39 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:39.337+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:39.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:39 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:39.337+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:58.544002+0000 front 2024-09-11T00:27:58.544125+0000 (oldest deadline 2024-09-11T00:28:24.443898+0000) 2024-09-11T00:28:39.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:39 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:39.337+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6822 osd.6 since back 2024-09-11T00:28:09.445739+0000 front 2024-09-11T00:28:09.445687+0000 (oldest deadline 2024-09-11T00:28:32.345657+0000) 2024-09-11T00:28:40.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:39 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:39.904+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:40.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:39 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:39.904+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:40.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:39 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:39.904+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:40.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:39 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:39.904+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:40.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:39 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:39.904+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:40.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:39 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:39.904+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:40.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:40 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:40.370+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:19.737578+0000 front 2024-09-11T00:27:19.737593+0000 (oldest deadline 2024-09-11T00:27:42.637495+0000) 2024-09-11T00:28:40.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:40 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:40.370+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:24.938550+0000 front 2024-09-11T00:27:24.938581+0000 (oldest deadline 2024-09-11T00:27:50.838605+0000) 2024-09-11T00:28:40.732 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:40 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:40.370+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.640150+0000 front 2024-09-11T00:27:36.640122+0000 (oldest deadline 2024-09-11T00:27:59.540229+0000) 2024-09-11T00:28:40.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:40 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:40.370+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:42.341377+0000 front 2024-09-11T00:27:42.341467+0000 (oldest deadline 2024-09-11T00:28:07.041395+0000) 2024-09-11T00:28:40.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:40 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:40.370+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:50.442749+0000 front 2024-09-11T00:27:50.442718+0000 (oldest deadline 2024-09-11T00:28:15.142717+0000) 2024-09-11T00:28:40.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:40 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:40.370+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:58.544002+0000 front 2024-09-11T00:27:58.544125+0000 (oldest deadline 2024-09-11T00:28:24.443898+0000) 2024-09-11T00:28:40.733 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:40 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10[61747]: 2024-09-11T00:28:40.370+0000 7fa1152a6640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.78:6822 osd.6 since back 2024-09-11T00:28:09.445739+0000 front 2024-09-11T00:28:09.445687+0000 (oldest deadline 2024-09-11T00:28:32.345657+0000) 2024-09-11T00:28:41.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:40 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:40.911+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:41.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:40 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:40.911+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:41.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:40 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:40.911+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:41.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:40 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:40.911+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:41.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:40 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:40.911+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:41.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:40 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:40.911+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:42.152 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:41 smithi112 podman[72208]: 2024-09-11 00:28:41.851366037 +0000 UTC m=+5.638887841 container died 8165983d2150743955822c629d4774dce23c6a4921f59699c9a5524b1e7d4a36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0) 2024-09-11T00:28:42.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:41 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:41.913+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:42.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:41 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:41.913+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:42.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:41 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:41.913+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:42.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:41 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:41.913+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:42.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:41 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:41.913+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:42.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:41 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:41.913+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:42.482 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:42 smithi112 podman[72208]: 2024-09-11 00:28:42.241457236 +0000 UTC m=+6.028979028 container cleanup 8165983d2150743955822c629d4774dce23c6a4921f59699c9a5524b1e7d4a36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-11T00:28:42.482 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:42 smithi112 bash[72208]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10 2024-09-11T00:28:42.856 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:42 smithi112 podman[72223]: 2024-09-11 00:28:42.511490384 +0000 UTC m=+0.651287482 container remove 8165983d2150743955822c629d4774dce23c6a4921f59699c9a5524b1e7d4a36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:28:43.172 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:42 smithi112 podman[72317]: 2024-09-11 00:28:42.757409412 +0000 UTC m=+0.015543863 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:28:43.172 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:42 smithi112 podman[72317]: 2024-09-11 00:28:42.876888563 +0000 UTC m=+0.135023000 container create a7e9e79d5d2c3c65fda215952fa197d1078c48d1566a72a5e19c22c5852e5a6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-11T00:28:43.172 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:43 smithi112 podman[72317]: 2024-09-11 00:28:43.096160489 +0000 UTC m=+0.354294926 container init a7e9e79d5d2c3c65fda215952fa197d1078c48d1566a72a5e19c22c5852e5a6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-11T00:28:43.172 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:43 smithi112 podman[72317]: 2024-09-11 00:28:43.099533951 +0000 UTC m=+0.357668388 container start a7e9e79d5d2c3c65fda215952fa197d1078c48d1566a72a5e19c22c5852e5a6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS) 2024-09-11T00:28:43.172 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:43 smithi112 podman[72317]: 2024-09-11 00:28:43.171050299 +0000 UTC m=+0.429184748 container attach a7e9e79d5d2c3c65fda215952fa197d1078c48d1566a72a5e19c22c5852e5a6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-11T00:28:43.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:42 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:42.867+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:43.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:42 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:42.867+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:43.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:42 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:42.867+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:43.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:42 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:42.867+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:43.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:42 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:42.867+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:43.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:42 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:42.867+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:43.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:42 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:42.867+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-09-11T00:28:16.677359+0000 front 2024-09-11T00:28:16.677329+0000 (oldest deadline 2024-09-11T00:28:42.577227+0000) 2024-09-11T00:28:43.482 INFO:journalctl@ceph.osd.10.smithi112.stdout:Sep 11 00:28:43 smithi112 podman[72317]: 2024-09-11 00:28:43.289862721 +0000 UTC m=+0.547997160 container died a7e9e79d5d2c3c65fda215952fa197d1078c48d1566a72a5e19c22c5852e5a6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-11T00:28:43.892 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.10.service' 2024-09-11T00:28:43.936 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:28:43.937 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-11T00:28:43.937 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-11T00:28:43.937 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.11 2024-09-11T00:28:44.267 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:43 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:43.882+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:44.267 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:43 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:43.882+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:44.267 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:43 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:43.882+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:44.267 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:43 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:43.882+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:44.267 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:43 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:43.882+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:44.267 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:43 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:43.882+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:44.267 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:43 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:43.882+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-09-11T00:28:16.677359+0000 front 2024-09-11T00:28:16.677329+0000 (oldest deadline 2024-09-11T00:28:42.577227+0000) 2024-09-11T00:28:44.267 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:43 smithi138 systemd[1]: Stopping Ceph osd.11 for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:28:44.267 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:44 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:44.264+0000 7f7590122640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:28:44.268 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:44 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:44.264+0000 7f7590122640 -1 osd.11 90 *** Got signal Terminated *** 2024-09-11T00:28:44.268 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:44 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:44.264+0000 7f7590122640 -1 osd.11 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T00:28:45.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:44 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:44.887+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:45.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:44 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:44.887+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:45.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:44 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:44.887+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:45.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:44 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:44.887+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:45.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:44 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:44.887+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:45.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:44 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:44.887+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:45.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:44 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:44.887+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-09-11T00:28:16.677359+0000 front 2024-09-11T00:28:16.677329+0000 (oldest deadline 2024-09-11T00:28:42.577227+0000) 2024-09-11T00:28:46.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:45 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:45.914+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:46.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:45 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:45.914+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:46.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:45 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:45.914+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:46.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:45 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:45.914+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:46.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:45 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:45.914+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:46.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:45 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:45.914+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:46.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:45 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:45.914+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-09-11T00:28:16.677359+0000 front 2024-09-11T00:28:16.677329+0000 (oldest deadline 2024-09-11T00:28:42.577227+0000) 2024-09-11T00:28:47.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:46 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:46.958+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:47.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:46 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:46.958+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:47.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:46 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:46.958+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:47.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:46 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:46.958+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:47.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:46 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:46.958+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:47.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:46 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:46.958+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:47.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:46 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:46.958+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-09-11T00:28:16.677359+0000 front 2024-09-11T00:28:16.677329+0000 (oldest deadline 2024-09-11T00:28:42.577227+0000) 2024-09-11T00:28:47.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:46 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:46.958+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6820 osd.8 since back 2024-09-11T00:28:22.577713+0000 front 2024-09-11T00:28:22.577743+0000 (oldest deadline 2024-09-11T00:28:46.677778+0000) 2024-09-11T00:28:48.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:47 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:47.934+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:48.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:47 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:47.934+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:48.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:47 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:47.934+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:48.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:47 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:47.934+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:48.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:47 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:47.934+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:48.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:47 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:47.934+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:48.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:47 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:47.934+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-09-11T00:28:16.677359+0000 front 2024-09-11T00:28:16.677329+0000 (oldest deadline 2024-09-11T00:28:42.577227+0000) 2024-09-11T00:28:48.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:47 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:47.934+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6820 osd.8 since back 2024-09-11T00:28:22.577713+0000 front 2024-09-11T00:28:22.577743+0000 (oldest deadline 2024-09-11T00:28:46.677778+0000) 2024-09-11T00:28:49.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:48 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:48.928+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6806 osd.0 since back 2024-09-11T00:27:18.469145+0000 front 2024-09-11T00:27:18.469288+0000 (oldest deadline 2024-09-11T00:27:43.169019+0000) 2024-09-11T00:28:49.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:48 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:48.928+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6804 osd.1 since back 2024-09-11T00:27:28.970757+0000 front 2024-09-11T00:27:28.970832+0000 (oldest deadline 2024-09-11T00:27:51.270556+0000) 2024-09-11T00:28:49.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:48 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:48.928+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-11T00:27:36.471706+0000 front 2024-09-11T00:27:36.471619+0000 (oldest deadline 2024-09-11T00:28:02.371663+0000) 2024-09-11T00:28:49.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:48 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:48.928+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.78:6814 osd.3 since back 2024-09-11T00:27:44.573226+0000 front 2024-09-11T00:27:44.573133+0000 (oldest deadline 2024-09-11T00:28:09.273217+0000) 2024-09-11T00:28:49.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:48 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:48.928+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6812 osd.4 since back 2024-09-11T00:27:49.774235+0000 front 2024-09-11T00:27:49.774183+0000 (oldest deadline 2024-09-11T00:28:19.174548+0000) 2024-09-11T00:28:49.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:48 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:48.928+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-11T00:27:59.175049+0000 front 2024-09-11T00:27:59.175102+0000 (oldest deadline 2024-09-11T00:28:23.875117+0000) 2024-09-11T00:28:49.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:48 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:48.928+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.112:6820 osd.7 since back 2024-09-11T00:28:16.677359+0000 front 2024-09-11T00:28:16.677329+0000 (oldest deadline 2024-09-11T00:28:42.577227+0000) 2024-09-11T00:28:49.294 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:48 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11[60836]: 2024-09-11T00:28:48.928+0000 7f758c737640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.138:6820 osd.8 since back 2024-09-11T00:28:22.577713+0000 front 2024-09-11T00:28:22.577743+0000 (oldest deadline 2024-09-11T00:28:46.677778+0000) 2024-09-11T00:28:49.968 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:49 smithi138 podman[71417]: 2024-09-11 00:28:49.675203251 +0000 UTC m=+5.548543560 container died df2c0cb60a3af9b6207fc856a6b47b307f89f41442e4519c2fd297fc61a1e79f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-11T00:28:50.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:50 smithi138 podman[71417]: 2024-09-11 00:28:50.048689768 +0000 UTC m=+5.922030118 container cleanup df2c0cb60a3af9b6207fc856a6b47b307f89f41442e4519c2fd297fc61a1e79f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:28:50.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:50 smithi138 bash[71417]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11 2024-09-11T00:28:50.643 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:50 smithi138 podman[71432]: 2024-09-11 00:28:50.333429135 +0000 UTC m=+0.655417818 container remove df2c0cb60a3af9b6207fc856a6b47b307f89f41442e4519c2fd297fc61a1e79f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-11T00:28:50.897 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:50 smithi138 podman[71522]: 2024-09-11 00:28:50.642966072 +0000 UTC m=+0.112515825 container create 0c97010e3ed0b35d95ff46c4243de4c10a68061d7b810d422486b1ee30fb4ccc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-11T00:28:50.897 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:50 smithi138 podman[71522]: 2024-09-11 00:28:50.546197029 +0000 UTC m=+0.015746783 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:28:50.897 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:50 smithi138 podman[71522]: 2024-09-11 00:28:50.837318753 +0000 UTC m=+0.306868516 container init 0c97010e3ed0b35d95ff46c4243de4c10a68061d7b810d422486b1ee30fb4ccc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:28:50.897 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:50 smithi138 podman[71522]: 2024-09-11 00:28:50.840583219 +0000 UTC m=+0.310132974 container start 0c97010e3ed0b35d95ff46c4243de4c10a68061d7b810d422486b1ee30fb4ccc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:28:50.897 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:50 smithi138 podman[71522]: 2024-09-11 00:28:50.895809296 +0000 UTC m=+0.365359065 container attach 0c97010e3ed0b35d95ff46c4243de4c10a68061d7b810d422486b1ee30fb4ccc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-09-11T00:28:51.293 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 11 00:28:51 smithi138 podman[71522]: 2024-09-11 00:28:51.034361581 +0000 UTC m=+0.503911336 container died 0c97010e3ed0b35d95ff46c4243de4c10a68061d7b810d422486b1ee30fb4ccc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-11T00:28:51.641 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@osd.11.service' 2024-09-11T00:28:51.678 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:28:51.679 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-11T00:28:51.679 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-11T00:28:51.679 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.a 2024-09-11T00:28:52.001 INFO:journalctl@ceph.mds.a.smithi078.stdout:Sep 11 00:28:51 smithi078 systemd[1]: Stopping Ceph mds.a for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:28:52.334 INFO:journalctl@ceph.mds.a.smithi078.stdout:Sep 11 00:28:52 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-a[76230]: 2024-09-11T00:28:51.999+0000 7f4298d13640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:28:52.334 INFO:journalctl@ceph.mds.a.smithi078.stdout:Sep 11 00:28:52 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-a[76230]: 2024-09-11T00:28:51.999+0000 7f4298d13640 -1 mds.a *** got signal Terminated *** 2024-09-11T00:28:53.810 INFO:journalctl@ceph.mds.a.smithi078.stdout:Sep 11 00:28:53 smithi078 podman[104551]: 2024-09-11 00:28:53.454188197 +0000 UTC m=+1.578315646 container died 648cf2d995e69f49029f1b12c89dcfa3cecc0903675855b8a76975a1c4b200c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:28:54.084 INFO:journalctl@ceph.mds.a.smithi078.stdout:Sep 11 00:28:53 smithi078 podman[104551]: 2024-09-11 00:28:53.949685476 +0000 UTC m=+2.073812924 container cleanup 648cf2d995e69f49029f1b12c89dcfa3cecc0903675855b8a76975a1c4b200c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-a, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-11T00:28:54.084 INFO:journalctl@ceph.mds.a.smithi078.stdout:Sep 11 00:28:53 smithi078 bash[104551]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-a 2024-09-11T00:28:54.335 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.a.service' 2024-09-11T00:28:54.370 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:28:54.370 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-11T00:28:54.371 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-11T00:28:54.371 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.d 2024-09-11T00:28:54.834 INFO:journalctl@ceph.mds.d.smithi078.stdout:Sep 11 00:28:54 smithi078 systemd[1]: Stopping Ceph mds.d for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:28:54.834 INFO:journalctl@ceph.mds.d.smithi078.stdout:Sep 11 00:28:54 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-d[75036]: 2024-09-11T00:28:54.686+0000 7f853cda0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:28:54.834 INFO:journalctl@ceph.mds.d.smithi078.stdout:Sep 11 00:28:54 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-d[75036]: 2024-09-11T00:28:54.686+0000 7f853cda0640 -1 mds.d *** got signal Terminated *** 2024-09-11T00:28:58.584 INFO:journalctl@ceph.mds.d.smithi078.stdout:Sep 11 00:28:58 smithi078 podman[104676]: 2024-09-11 00:28:58.322302614 +0000 UTC m=+3.729591781 container died f7b431cb7153892d824c3196b21afde994ec2a6da4ad3bcf7e6280f041bc2ee8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-d, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:28:59.072 INFO:journalctl@ceph.mds.d.smithi078.stdout:Sep 11 00:28:58 smithi078 podman[104676]: 2024-09-11 00:28:58.686579478 +0000 UTC m=+4.093868634 container cleanup f7b431cb7153892d824c3196b21afde994ec2a6da4ad3bcf7e6280f041bc2ee8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-11T00:28:59.072 INFO:journalctl@ceph.mds.d.smithi078.stdout:Sep 11 00:28:58 smithi078 bash[104676]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-d 2024-09-11T00:28:59.260 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.d.service' 2024-09-11T00:28:59.294 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:28:59.294 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-11T00:28:59.294 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-11T00:28:59.294 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.g 2024-09-11T00:28:59.609 INFO:journalctl@ceph.mds.g.smithi078.stdout:Sep 11 00:28:59 smithi078 systemd[1]: Stopping Ceph mds.g for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:29:00.084 INFO:journalctl@ceph.mds.g.smithi078.stdout:Sep 11 00:28:59 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-g[75877]: 2024-09-11T00:28:59.606+0000 7fe723f63640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:29:00.084 INFO:journalctl@ceph.mds.g.smithi078.stdout:Sep 11 00:28:59 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-g[75877]: 2024-09-11T00:28:59.606+0000 7fe723f63640 -1 mds.g *** got signal Terminated *** 2024-09-11T00:29:02.834 INFO:journalctl@ceph.mds.g.smithi078.stdout:Sep 11 00:29:02 smithi078 podman[104797]: 2024-09-11 00:29:02.431956798 +0000 UTC m=+2.929574194 container died fe509132061ebf57987344c459f085ba766341be11213a4af4f9b3c02c680086 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-g, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:29:03.142 INFO:journalctl@ceph.mds.g.smithi078.stdout:Sep 11 00:29:02 smithi078 podman[104797]: 2024-09-11 00:29:02.957128593 +0000 UTC m=+3.454745986 container cleanup fe509132061ebf57987344c459f085ba766341be11213a4af4f9b3c02c680086 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-g, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-11T00:29:03.142 INFO:journalctl@ceph.mds.g.smithi078.stdout:Sep 11 00:29:02 smithi078 bash[104797]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-g 2024-09-11T00:29:03.387 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.g.service' 2024-09-11T00:29:03.414 INFO:journalctl@ceph.mds.g.smithi078.stdout:Sep 11 00:29:03 smithi078 podman[104810]: 2024-09-11 00:29:03.141512121 +0000 UTC m=+0.704535184 container remove fe509132061ebf57987344c459f085ba766341be11213a4af4f9b3c02c680086 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:29:03.414 INFO:journalctl@ceph.mds.g.smithi078.stdout:Sep 11 00:29:03 smithi078 systemd[1]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.g.service: Deactivated successfully. 2024-09-11T00:29:03.414 INFO:journalctl@ceph.mds.g.smithi078.stdout:Sep 11 00:29:03 smithi078 systemd[1]: Stopped Ceph mds.g for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:29:03.414 INFO:journalctl@ceph.mds.g.smithi078.stdout:Sep 11 00:29:03 smithi078 systemd[1]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.g.service: Consumed 1.025s CPU time. 2024-09-11T00:29:03.420 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:29:03.420 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-11T00:29:03.420 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-11T00:29:03.420 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.j 2024-09-11T00:29:03.745 INFO:journalctl@ceph.mds.j.smithi078.stdout:Sep 11 00:29:03 smithi078 systemd[1]: Stopping Ceph mds.j for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:29:04.084 INFO:journalctl@ceph.mds.j.smithi078.stdout:Sep 11 00:29:03 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-j[74637]: 2024-09-11T00:29:03.743+0000 7f8adda58640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:29:04.084 INFO:journalctl@ceph.mds.j.smithi078.stdout:Sep 11 00:29:03 smithi078 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-j[74637]: 2024-09-11T00:29:03.743+0000 7f8adda58640 -1 mds.j *** got signal Terminated *** 2024-09-11T00:29:07.084 INFO:journalctl@ceph.mds.j.smithi078.stdout:Sep 11 00:29:06 smithi078 podman[104917]: 2024-09-11 00:29:06.796462538 +0000 UTC m=+3.158305729 container died 080545d92df4370e0b427ec78b57335060a829c4cbff79b2d70d210b37dc5792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-j, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD) 2024-09-11T00:29:07.395 INFO:journalctl@ceph.mds.j.smithi078.stdout:Sep 11 00:29:07 smithi078 podman[104917]: 2024-09-11 00:29:07.218661797 +0000 UTC m=+3.580504977 container cleanup 080545d92df4370e0b427ec78b57335060a829c4cbff79b2d70d210b37dc5792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-j, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-11T00:29:07.396 INFO:journalctl@ceph.mds.j.smithi078.stdout:Sep 11 00:29:07 smithi078 bash[104917]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-j 2024-09-11T00:29:07.649 INFO:journalctl@ceph.mds.j.smithi078.stdout:Sep 11 00:29:07 smithi078 podman[104929]: 2024-09-11 00:29:07.394676342 +0000 UTC m=+0.599619724 container remove 080545d92df4370e0b427ec78b57335060a829c4cbff79b2d70d210b37dc5792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-j, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-11T00:29:07.653 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.j.service' 2024-09-11T00:29:07.685 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:29:07.685 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-11T00:29:07.686 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-11T00:29:07.686 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.b 2024-09-11T00:29:07.982 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 11 00:29:07 smithi112 systemd[1]: Stopping Ceph mds.b for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:29:08.732 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 11 00:29:08 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-b[67230]: 2024-09-11T00:29:08.292+0000 7fc82c050640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:29:08.732 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 11 00:29:08 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-b[67230]: 2024-09-11T00:29:08.292+0000 7fc82c050640 -1 mds.b *** got signal Terminated *** 2024-09-11T00:29:12.586 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 11 00:29:12 smithi112 podman[72420]: 2024-09-11 00:29:12.298617977 +0000 UTC m=+4.418076608 container died f257b690f013fd9e43f3ea8397bd10e4c9167c2f4c55bdd5bd61f3daf3df8e6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:29:12.982 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 11 00:29:12 smithi112 podman[72420]: 2024-09-11 00:29:12.675667244 +0000 UTC m=+4.795125874 container cleanup f257b690f013fd9e43f3ea8397bd10e4c9167c2f4c55bdd5bd61f3daf3df8e6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:29:12.982 INFO:journalctl@ceph.mds.b.smithi112.stdout:Sep 11 00:29:12 smithi112 bash[72420]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-b 2024-09-11T00:29:13.121 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.b.service' 2024-09-11T00:29:13.158 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:29:13.158 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-11T00:29:13.159 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-11T00:29:13.159 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.e 2024-09-11T00:29:13.732 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 11 00:29:13 smithi112 systemd[1]: Stopping Ceph mds.e for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:29:13.732 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 11 00:29:13 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-e[66613]: 2024-09-11T00:29:13.470+0000 7f476c0c6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:29:13.732 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 11 00:29:13 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-e[66613]: 2024-09-11T00:29:13.470+0000 7f476c0c6640 -1 mds.e *** got signal Terminated *** 2024-09-11T00:29:17.431 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 11 00:29:17 smithi112 podman[72554]: 2024-09-11 00:29:17.160179527 +0000 UTC m=+3.781693919 container died 1413e0deebb9ac334f2c09c70a48be65cea4c5020970713413d5b302ae631ba0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-e, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T00:29:17.732 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 11 00:29:17 smithi112 podman[72554]: 2024-09-11 00:29:17.512710973 +0000 UTC m=+4.134225373 container cleanup 1413e0deebb9ac334f2c09c70a48be65cea4c5020970713413d5b302ae631ba0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True) 2024-09-11T00:29:17.732 INFO:journalctl@ceph.mds.e.smithi112.stdout:Sep 11 00:29:17 smithi112 bash[72554]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-e 2024-09-11T00:29:18.088 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.e.service' 2024-09-11T00:29:18.120 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:29:18.121 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-11T00:29:18.121 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-11T00:29:18.121 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.h 2024-09-11T00:29:18.451 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 11 00:29:18 smithi112 systemd[1]: Stopping Ceph mds.h for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:29:18.732 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 11 00:29:18 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-h[66917]: 2024-09-11T00:29:18.449+0000 7f5ed0712640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:29:18.732 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 11 00:29:18 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-h[66917]: 2024-09-11T00:29:18.449+0000 7f5ed0712640 -1 mds.h *** got signal Terminated *** 2024-09-11T00:29:21.227 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 11 00:29:20 smithi112 podman[72673]: 2024-09-11 00:29:20.881551784 +0000 UTC m=+2.549611213 container died 24fe572bdc9fa2081cdde2383293b34ed6daf84f0924166085900407b7db84a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-h, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-11T00:29:21.482 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 11 00:29:21 smithi112 podman[72673]: 2024-09-11 00:29:21.316925089 +0000 UTC m=+2.984984520 container cleanup 24fe572bdc9fa2081cdde2383293b34ed6daf84f0924166085900407b7db84a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-11T00:29:21.482 INFO:journalctl@ceph.mds.h.smithi112.stdout:Sep 11 00:29:21 smithi112 bash[72673]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-h 2024-09-11T00:29:21.744 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.h.service' 2024-09-11T00:29:21.775 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:29:21.775 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-11T00:29:21.776 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-11T00:29:21.776 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.k 2024-09-11T00:29:22.096 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 11 00:29:21 smithi112 systemd[1]: Stopping Ceph mds.k for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:29:22.482 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 11 00:29:22 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-k[66300]: 2024-09-11T00:29:22.095+0000 7f7936212640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:29:22.482 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 11 00:29:22 smithi112 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-k[66300]: 2024-09-11T00:29:22.095+0000 7f7936212640 -1 mds.k *** got signal Terminated *** 2024-09-11T00:29:23.955 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 11 00:29:23 smithi112 podman[72796]: 2024-09-11 00:29:23.678319647 +0000 UTC m=+1.688449040 container died 325005625e377af09da987fcc4c5806b76c8854ed19348c8baba966c254eab5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-k, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-11T00:29:24.232 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 11 00:29:24 smithi112 podman[72796]: 2024-09-11 00:29:24.05384732 +0000 UTC m=+2.063976714 container cleanup 325005625e377af09da987fcc4c5806b76c8854ed19348c8baba966c254eab5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-11T00:29:24.232 INFO:journalctl@ceph.mds.k.smithi112.stdout:Sep 11 00:29:24 smithi112 bash[72796]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-k 2024-09-11T00:29:24.488 DEBUG:teuthology.orchestra.run.smithi112:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.k.service' 2024-09-11T00:29:24.520 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:29:24.521 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-11T00:29:24.521 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-11T00:29:24.521 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.c 2024-09-11T00:29:24.993 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 11 00:29:24 smithi138 systemd[1]: Stopping Ceph mds.c for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:29:25.249 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 11 00:29:24 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-c[65932]: 2024-09-11T00:29:24.991+0000 7f2d4cc22640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:29:25.249 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 11 00:29:24 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-c[65932]: 2024-09-11T00:29:24.992+0000 7f2d4cc22640 -1 mds.c *** got signal Terminated *** 2024-09-11T00:29:26.518 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 11 00:29:26 smithi138 podman[71623]: 2024-09-11 00:29:26.242243146 +0000 UTC m=+1.525783639 container died 5ca828deae51a50bd353053cc1ab05340e9c1243cbbc3e245d4acb842e6b3b89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-c, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-11T00:29:26.793 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 11 00:29:26 smithi138 podman[71623]: 2024-09-11 00:29:26.600320547 +0000 UTC m=+1.883861038 container cleanup 5ca828deae51a50bd353053cc1ab05340e9c1243cbbc3e245d4acb842e6b3b89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-c, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:29:26.793 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 11 00:29:26 smithi138 bash[71623]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-c 2024-09-11T00:29:27.029 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.c.service' 2024-09-11T00:29:27.065 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:29:27.065 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-11T00:29:27.065 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-11T00:29:27.065 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.f 2024-09-11T00:29:27.390 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 11 00:29:27 smithi138 systemd[1]: Stopping Ceph mds.f for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:29:27.793 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 11 00:29:27 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-f[65634]: 2024-09-11T00:29:27.387+0000 7feab2cae640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:29:27.793 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 11 00:29:27 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-f[65634]: 2024-09-11T00:29:27.387+0000 7feab2cae640 -1 mds.f *** got signal Terminated *** 2024-09-11T00:29:31.658 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 11 00:29:31 smithi138 podman[71757]: 2024-09-11 00:29:31.399852936 +0000 UTC m=+4.111790584 container died fcac26eb795866a4089f3dd78f73b034fef80062829719753a8f96f65c11821c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-11T00:29:32.024 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 11 00:29:31 smithi138 podman[71757]: 2024-09-11 00:29:31.747049314 +0000 UTC m=+4.458986951 container cleanup fcac26eb795866a4089f3dd78f73b034fef80062829719753a8f96f65c11821c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-11T00:29:32.024 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 11 00:29:31 smithi138 bash[71757]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-f 2024-09-11T00:29:32.186 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.f.service' 2024-09-11T00:29:32.219 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:29:32.220 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-11T00:29:32.220 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-11T00:29:32.220 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.i 2024-09-11T00:29:32.543 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:29:32 smithi138 systemd[1]: Stopping Ceph mds.i for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:29:33.043 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:29:32 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-i[66236]: 2024-09-11T00:29:32.542+0000 7efedad20640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:29:33.043 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:29:32 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-i[66236]: 2024-09-11T00:29:32.542+0000 7efedad20640 -1 mds.i *** got signal Terminated *** 2024-09-11T00:29:36.827 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:29:36 smithi138 podman[71881]: 2024-09-11 00:29:36.554756919 +0000 UTC m=+4.122146370 container died 60be5793b80ff311ccd03fe0e26963ee2167111453d5ba82d3fd87c9a43c1bad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-i, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T00:29:37.112 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:29:36 smithi138 podman[71881]: 2024-09-11 00:29:36.926423354 +0000 UTC m=+4.493812803 container cleanup 60be5793b80ff311ccd03fe0e26963ee2167111453d5ba82d3fd87c9a43c1bad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-i, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-11T00:29:37.113 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:29:36 smithi138 bash[71881]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-i 2024-09-11T00:29:37.354 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.i.service' 2024-09-11T00:29:37.375 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:29:37 smithi138 podman[71894]: 2024-09-11 00:29:37.111446372 +0000 UTC m=+0.553502376 container remove 60be5793b80ff311ccd03fe0e26963ee2167111453d5ba82d3fd87c9a43c1bad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-i, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0) 2024-09-11T00:29:37.375 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:29:37 smithi138 systemd[1]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.i.service: Deactivated successfully. 2024-09-11T00:29:37.376 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:29:37 smithi138 systemd[1]: Stopped Ceph mds.i for 85a53860-6fd1-11ef-bcea-c7b262605968. 2024-09-11T00:29:37.376 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 11 00:29:37 smithi138 systemd[1]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.i.service: Consumed 14.357s CPU time. 2024-09-11T00:29:37.387 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:29:37.387 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-11T00:29:37.387 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-11T00:29:37.387 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.l 2024-09-11T00:29:37.691 INFO:journalctl@ceph.mds.l.smithi138.stdout:Sep 11 00:29:37 smithi138 systemd[1]: Stopping Ceph mds.l for 85a53860-6fd1-11ef-bcea-c7b262605968... 2024-09-11T00:29:38.043 INFO:journalctl@ceph.mds.l.smithi138.stdout:Sep 11 00:29:37 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-l[65331]: 2024-09-11T00:29:37.689+0000 7fcfc4bd1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:29:38.043 INFO:journalctl@ceph.mds.l.smithi138.stdout:Sep 11 00:29:37 smithi138 ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-l[65331]: 2024-09-11T00:29:37.689+0000 7fcfc4bd1640 -1 mds.l *** got signal Terminated *** 2024-09-11T00:29:41.158 INFO:journalctl@ceph.mds.l.smithi138.stdout:Sep 11 00:29:40 smithi138 podman[72002]: 2024-09-11 00:29:40.875641573 +0000 UTC m=+3.270270117 container died 7ed2a552280d302d21c6e13fc5097b0c70c094ec5f14a9a08cff40f21eb52c10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0) 2024-09-11T00:29:41.500 INFO:journalctl@ceph.mds.l.smithi138.stdout:Sep 11 00:29:41 smithi138 podman[72002]: 2024-09-11 00:29:41.256243451 +0000 UTC m=+3.650871994 container cleanup 7ed2a552280d302d21c6e13fc5097b0c70c094ec5f14a9a08cff40f21eb52c10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:29:41.500 INFO:journalctl@ceph.mds.l.smithi138.stdout:Sep 11 00:29:41 smithi138 bash[72002]: ceph-85a53860-6fd1-11ef-bcea-c7b262605968-mds-l 2024-09-11T00:29:41.622 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-85a53860-6fd1-11ef-bcea-c7b262605968@mds.l.service' 2024-09-11T00:29:41.654 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T00:29:41.654 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-11T00:29:41.654 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T00:29:41.857 INFO:teuthology.orchestra.run.smithi078.stdout:Deleting cluster with fsid: 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:29:44.294 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T00:29:44.496 INFO:teuthology.orchestra.run.smithi112.stdout:Deleting cluster with fsid: 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:29:46.992 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T00:29:47.195 INFO:teuthology.orchestra.run.smithi138.stdout:Deleting cluster with fsid: 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:29:49.558 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:29:49.591 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:29:49.625 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:29:49.652 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-11T00:29:49.654 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899821/remote/smithi078/crash 2024-09-11T00:29:49.655 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/crash -- . 2024-09-11T00:29:49.681 INFO:teuthology.orchestra.run.smithi078.stderr:tar: /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T00:29:49.681 INFO:teuthology.orchestra.run.smithi078.stderr:tar: Error is not recoverable: exiting now 2024-09-11T00:29:49.683 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899821/remote/smithi112/crash 2024-09-11T00:29:49.684 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/crash -- . 2024-09-11T00:29:49.727 INFO:teuthology.orchestra.run.smithi112.stderr:tar: /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T00:29:49.727 INFO:teuthology.orchestra.run.smithi112.stderr:tar: Error is not recoverable: exiting now 2024-09-11T00:29:49.729 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899821/remote/smithi138/crash 2024-09-11T00:29:49.730 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/crash -- . 2024-09-11T00:29:49.762 INFO:teuthology.orchestra.run.smithi138.stderr:tar: /var/lib/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T00:29:49.762 INFO:teuthology.orchestra.run.smithi138.stderr:tar: Error is not recoverable: exiting now 2024-09-11T00:29:49.763 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-11T00:29:49.763 DEBUG:teuthology.orchestra.run.smithi078:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-11T00:29:49.801 INFO:tasks.cephadm:Compressing logs... 2024-09-11T00:29:49.801 DEBUG:teuthology.orchestra.run.smithi078:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T00:29:49.844 DEBUG:teuthology.orchestra.run.smithi112:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T00:29:49.846 DEBUG:teuthology.orchestra.run.smithi138:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T00:29:49.867 INFO:teuthology.orchestra.run.smithi078.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-11T00:29:49.868 INFO:teuthology.orchestra.run.smithi078.stderr:: No such file or directory 2024-09-11T00:29:49.869 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-11T00:29:49.869 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T00:29:49.869 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T00:29:49.869 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-11T00:29:49.870 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T00:29:49.870 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-11T00:29:49.870 INFO:teuthology.orchestra.run.smithi138.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T00:29:49.870 INFO:teuthology.orchestra.run.smithi138.stderr:: No such file or directory 2024-09-11T00:29:49.870 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T00:29:49.872 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-11T00:29:49.873 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-11T00:29:49.873 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T00:29:49.873 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-11T00:29:49.873 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mon.c.log: /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-11T00:29:49.873 INFO:teuthology.orchestra.run.smithi138.stderr: 81.9% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T00:29:49.873 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-11T00:29:49.873 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.log 2024-09-11T00:29:49.874 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-11T00:29:49.874 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-11T00:29:49.874 INFO:teuthology.orchestra.run.smithi078.stderr: 84.5% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T00:29:49.874 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.g.log: 90.2% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T00:29:49.875 INFO:teuthology.orchestra.run.smithi112.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-11T00:29:49.875 INFO:teuthology.orchestra.run.smithi112.stderr:: No such file or directory 2024-09-11T00:29:49.875 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-11T00:29:49.875 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-11T00:29:49.875 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T00:29:49.876 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.5.log: 90.3% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T00:29:49.877 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-11T00:29:49.877 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-11T00:29:49.877 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.l.log: 87.4% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T00:29:49.877 INFO:teuthology.orchestra.run.smithi078.stderr: 95.0% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-11T00:29:49.878 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.log 2024-09-11T00:29:49.878 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-11T00:29:49.878 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-11T00:29:49.878 INFO:teuthology.orchestra.run.smithi078.stderr: 95.1% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-11T00:29:49.879 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-11T00:29:49.879 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-11T00:29:49.879 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-11T00:29:49.879 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T00:29:49.880 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.4.log: /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.audit.log: 90.3% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T00:29:49.880 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T00:29:49.880 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-11T00:29:49.880 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-11T00:29:49.881 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.d.log: 87.4% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T00:29:49.881 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-11T00:29:49.882 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.cephadm.log: 81.9% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T00:29:49.882 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.log 2024-09-11T00:29:49.882 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mgr.y.log: 95.0% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-11T00:29:49.883 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.8.log: 95.1% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-11T00:29:49.883 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-11T00:29:49.883 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-11T00:29:49.883 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.j.log: 91.1% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T00:29:49.883 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T00:29:49.886 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-11T00:29:49.886 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mgr.z.log: 91.0% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T00:29:49.886 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T00:29:49.887 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.3.log: 95.0% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-11T00:29:49.887 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/cephadm.log: 95.1% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-11T00:29:49.887 INFO:teuthology.orchestra.run.smithi112.stderr: 91.0% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T00:29:49.889 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-11T00:29:49.889 INFO:teuthology.orchestra.run.smithi112.stderr: 92.5% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-11T00:29:49.889 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-11T00:29:49.889 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-11T00:29:49.890 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.f.log: 92.6% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-11T00:29:49.891 INFO:teuthology.orchestra.run.smithi078.stderr: 93.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T00:29:49.892 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mon.b.log: 87.4% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T00:29:49.892 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T00:29:49.894 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.c.log: 95.0% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-11T00:29:49.894 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T00:29:49.896 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.e.log: 95.0% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-11T00:29:49.896 INFO:teuthology.orchestra.run.smithi138.stderr: 94.9% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-11T00:29:49.899 INFO:teuthology.orchestra.run.smithi112.stderr: 95.0% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-11T00:29:49.901 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T00:29:50.135 INFO:teuthology.orchestra.run.smithi138.stderr: 91.9% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-11T00:29:50.709 INFO:teuthology.orchestra.run.smithi112.stderr: 91.8% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-11T00:29:50.709 INFO:teuthology.orchestra.run.smithi078.stderr: 90.3% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-11T00:29:51.047 INFO:teuthology.orchestra.run.smithi078.stderr: 90.5% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-11T00:29:53.878 INFO:teuthology.orchestra.run.smithi078.stderr: 92.1% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-11T00:29:55.053 INFO:teuthology.orchestra.run.smithi138.stderr: 91.8% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-11T00:29:55.316 INFO:teuthology.orchestra.run.smithi078.stderr: 92.1% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-11T00:29:55.583 INFO:teuthology.orchestra.run.smithi078.stderr: 92.1% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-11T00:29:55.603 INFO:teuthology.orchestra.run.smithi112.stderr: 92.1% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-11T00:29:55.794 INFO:teuthology.orchestra.run.smithi138.stderr: 91.6% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-11T00:29:55.877 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-11T00:29:55.878 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-11T00:29:55.878 INFO:teuthology.orchestra.run.smithi078.stderr:real 0m6.022s 2024-09-11T00:29:55.879 INFO:teuthology.orchestra.run.smithi078.stderr:user 0m21.923s 2024-09-11T00:29:55.879 INFO:teuthology.orchestra.run.smithi078.stderr:sys 0m0.790s 2024-09-11T00:29:55.902 INFO:teuthology.orchestra.run.smithi112.stderr: 92.2% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-11T00:29:56.004 INFO:teuthology.orchestra.run.smithi138.stderr: 95.2% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-11T00:29:56.184 INFO:teuthology.orchestra.run.smithi138.stderr: 92.1% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-11T00:29:56.267 INFO:teuthology.orchestra.run.smithi112.stderr: 92.1% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-11T00:29:56.282 INFO:teuthology.orchestra.run.smithi138.stderr: 92.0% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-11T00:29:56.284 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-11T00:29:56.284 INFO:teuthology.orchestra.run.smithi138.stderr:real 0m6.423s 2024-09-11T00:29:56.284 INFO:teuthology.orchestra.run.smithi138.stderr:user 0m29.327s 2024-09-11T00:29:56.284 INFO:teuthology.orchestra.run.smithi138.stderr:sys 0m0.904s 2024-09-11T00:29:58.527 INFO:teuthology.orchestra.run.smithi112.stderr: 92.0% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-11T00:30:58.903 INFO:teuthology.orchestra.run.smithi112.stderr: 93.1% -- replaced with /var/log/ceph/85a53860-6fd1-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-11T00:30:58.905 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-11T00:30:58.905 INFO:teuthology.orchestra.run.smithi112.stderr:real 1m9.043s 2024-09-11T00:30:58.905 INFO:teuthology.orchestra.run.smithi112.stderr:user 1m32.955s 2024-09-11T00:30:58.905 INFO:teuthology.orchestra.run.smithi112.stderr:sys 0m2.962s 2024-09-11T00:30:58.905 INFO:tasks.cephadm:Archiving logs... 2024-09-11T00:30:58.906 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899821/remote/smithi078/log 2024-09-11T00:30:58.907 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T00:31:02.530 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899821/remote/smithi112/log 2024-09-11T00:31:02.531 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T00:31:16.737 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899821/remote/smithi138/log 2024-09-11T00:31:16.738 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T00:31:21.105 INFO:tasks.cephadm:Removing cluster... 2024-09-11T00:31:21.106 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 --force 2024-09-11T00:31:21.306 INFO:teuthology.orchestra.run.smithi078.stdout:Deleting cluster with fsid: 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:31:21.622 DEBUG:teuthology.orchestra.run.smithi112:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 --force 2024-09-11T00:31:21.824 INFO:teuthology.orchestra.run.smithi112.stdout:Deleting cluster with fsid: 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:31:22.182 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 85a53860-6fd1-11ef-bcea-c7b262605968 --force 2024-09-11T00:31:22.385 INFO:teuthology.orchestra.run.smithi138.stdout:Deleting cluster with fsid: 85a53860-6fd1-11ef-bcea-c7b262605968 2024-09-11T00:31:22.675 INFO:tasks.cephadm:Removing cephadm ... 2024-09-11T00:31:22.675 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T00:31:22.694 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T00:31:22.711 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T00:31:22.727 INFO:tasks.cephadm:Teardown complete 2024-09-11T00:31:22.727 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T00:31:22.757 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T00:31:22.757 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T00:31:22.762 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T00:31:22.765 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T00:31:22.917 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T00:31:22.936 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T00:31:22.937 DEBUG:teuthology.orchestra.run.smithi078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:31:22.940 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:31:22.943 DEBUG:teuthology.orchestra.run.smithi138:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:31:22.955 INFO:teuthology.orchestra.run.smithi078.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:31:22.955 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:31:22.958 INFO:teuthology.orchestra.run.smithi138.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:31:22.960 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:31:22.960 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-09-11T00:31:22.960 INFO:teuthology.orchestra.run.smithi112.stdout:^* hv01.front.sepia.ceph.com 3 6 377 59 -638us[ -633us] +/- 48ms 2024-09-11T00:31:22.960 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 58 +932us[ +932us] +/- 61ms 2024-09-11T00:31:22.960 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 -181us[ -176us] +/- 90ms 2024-09-11T00:31:22.960 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:31:22.962 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:31:22.962 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2024-09-11T00:31:22.962 INFO:teuthology.orchestra.run.smithi078.stdout:^* hv01.front.sepia.ceph.com 3 6 377 59 -618us[ -597us] +/- 48ms 2024-09-11T00:31:22.962 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 58 +962us[ +962us] +/- 61ms 2024-09-11T00:31:22.962 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 58 -188us[ -188us] +/- 90ms 2024-09-11T00:31:22.962 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:31:22.963 INFO:teuthology.orchestra.run.smithi138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:31:22.963 INFO:teuthology.orchestra.run.smithi138.stdout:=============================================================================== 2024-09-11T00:31:22.963 INFO:teuthology.orchestra.run.smithi138.stdout:^* hv01.front.sepia.ceph.com 3 6 377 57 -622us[ -632us] +/- 48ms 2024-09-11T00:31:22.963 INFO:teuthology.orchestra.run.smithi138.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 56 +945us[ +945us] +/- 61ms 2024-09-11T00:31:22.963 INFO:teuthology.orchestra.run.smithi138.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 -193us[ -204us] +/- 90ms 2024-09-11T00:31:22.963 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:31:22.963 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T00:31:23.029 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T00:31:23.030 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T00:31:23.180 DEBUG:teuthology.orchestra.run.smithi078:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T00:31:23.266 DEBUG:teuthology.orchestra.run.smithi112:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T00:31:23.340 DEBUG:teuthology.orchestra.run.smithi138:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T00:31:23.409 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-11T00:31:23.439 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:31:23.440 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-11T00:31:23.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:31:23.472 DEBUG:teuthology.orchestra.run.smithi138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-11T00:31:23.499 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:31:23.500 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T00:31:24.131 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T00:31:24.261 INFO:teuthology.task.internal:Duration was 1924.132654 seconds 2024-09-11T00:31:24.261 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T00:31:24.375 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T00:31:24.375 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T00:31:24.378 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T00:31:24.380 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T00:31:24.421 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T00:31:24.424 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T00:31:24.426 INFO:teuthology.orchestra.run.smithi138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T00:31:24.882 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T00:31:24.882 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi078.front.sepia.ceph.com 2024-09-11T00:31:24.882 DEBUG:teuthology.orchestra.run.smithi078:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T00:31:24.905 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2024-09-11T00:31:24.905 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T00:31:24.930 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi138.front.sepia.ceph.com 2024-09-11T00:31:24.930 DEBUG:teuthology.orchestra.run.smithi138:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T00:31:24.954 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T00:31:24.954 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T00:31:24.957 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T00:31:24.973 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T00:31:25.024 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T00:31:25.024 DEBUG:teuthology.orchestra.run.smithi078:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T00:31:25.027 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T00:31:25.044 DEBUG:teuthology.orchestra.run.smithi138:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T00:31:25.944 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T00:31:25.957 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T00:31:25.958 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T00:31:25.983 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T00:31:26.010 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T00:31:26.039 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T00:31:26.050 DEBUG:teuthology.orchestra.run.smithi078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:31:26.052 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:31:26.055 DEBUG:teuthology.orchestra.run.smithi138:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:31:26.073 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = core 2024-09-11T00:31:26.078 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2024-09-11T00:31:26.106 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = core 2024-09-11T00:31:26.138 DEBUG:teuthology.orchestra.run.smithi078:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:31:26.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:31:26.153 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:31:26.168 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:31:26.169 DEBUG:teuthology.orchestra.run.smithi138:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T00:31:26.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:31:26.194 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T00:31:26.208 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T00:31:26.210 DEBUG:teuthology.misc:Transferring archived files from smithi078:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899821/remote/smithi078 2024-09-11T00:31:26.210 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T00:31:26.266 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899821/remote/smithi112 2024-09-11T00:31:26.267 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T00:31:26.304 DEBUG:teuthology.misc:Transferring archived files from smithi138:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899821/remote/smithi138 2024-09-11T00:31:26.304 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T00:31:26.342 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T00:31:26.342 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T00:31:26.344 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T00:31:26.347 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T00:31:26.392 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T00:31:26.408 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T00:31:26.408 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T00:31:26.419 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T00:31:26.419 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T00:31:26.421 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T00:31:26.423 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T00:31:26.434 INFO:teuthology.orchestra.run.smithi078.stdout: 265340 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 00:31 /home/ubuntu/cephtest 2024-09-11T00:31:26.436 INFO:teuthology.orchestra.run.smithi112.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 00:31 /home/ubuntu/cephtest 2024-09-11T00:31:26.449 INFO:teuthology.orchestra.run.smithi138.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 00:31 /home/ubuntu/cephtest 2024-09-11T00:31:26.450 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T00:31:26.462 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T00:31:26.486 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/fsstress}} duration: 1924.1326537132263 flavor: default owner: scheduled_hyelloji@teuthology success: true 2024-09-11T00:31:26.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T00:31:26.576 INFO:teuthology.run:pass